title: Mitigating Toxic Degeneration with Empathetic Data: Exploring the Relationship Between Toxicity and Empathy

abstract: Large pre-trained neural language models have supported the effectiveness of many NLP tasks, yet are still prone to generating toxic language hindering the safety of their use. Using empathetic data, we improve over recent work on controllable text generation that aims to reduce the toxicity of generated text. We find we are able to dramatically reduce the size of fine-tuning data to 7.5-30k samples while at the same time making significant improvements over state-of-the-art toxicity mitigation of up to 3.4% absolute reduction (26% relative) from the original work on 2.3m samples, by strategically sampling data based on empathy scores. We observe that the degree of improvement is subject to specific communication components of empathy. In particular, the cognitive components of empathy significantly beat the original dataset in almost all experiments, while emotional empathy was tied to less improvement and even underperforming random samples of the original data. This is a particularly implicative insight for NLP work concerning empathy as until recently the research and resources built for it have exclusively considered empathy as an emotional concept.


title: Clinical outcome prediction under hypothetical interventions -- a representation learning framework for counterfactual reasoning

abstract: Most machine learning (ML) models are developed for prediction only; offering no option for causal interpretation of their predictions or parameters/properties. This can hamper the health systems' ability to employ ML models in clinical decision-making processes, where the need and desire for predicting outcomes under hypothetical investigations (i.e., counterfactual reasoning/explanation) is high. In this research, we introduce a new representation learning framework (i.e., partial concept bottleneck), which considers the provision of counterfactual explanations as an embedded property of the risk model. Despite architectural changes necessary for jointly optimising for prediction accuracy and counterfactual reasoning, the accuracy of our approach is comparable to prediction-only models. Our results suggest that our proposed framework has the potential to help researchers and clinicians improve personalised care (e.g., by investigating the hypothetical differential effects of interventions)


title: Exact eigenstates of multicomponent Hubbard models: SU($N$) magnetic $\eta$ pairing, weak ergodicity breaking, and partial integrability

abstract: We construct exact eigenstates of multicomponent Hubbard models in arbitrary dimensions by generalizing the $\eta$-pairing mechanism. Our models include the SU($N$) Hubbard model as a special case. Unlike the conventional two-component case, the generalized $\eta$-pairing mechanism permits the construction of eigenstates that feature off-diagonal long-range order and magnetic long-range order. These states form fragmented fermionic condensates due to a simultaneous condensation of multicomponent $\eta$ pairs. While the $\eta$-pairing states in the SU(2) Hubbard model are based on the $\eta$-pairing symmetry, the exact eigenstates in the $N$-component system with $N\geq 3$ arise not from symmetry of the Hamiltonian but from a spectrum generating algebra defined in a Hilbert subspace. We exploit this fact to show that the generalized $\eta$-pairing eigenstates do not satisfy the eigenstate thermalization hypothesis and serve as quantum many-body scar states. This result indicates a weak breakdown of ergodicity in the $N$-component Hubbard models for $N\geq 3$. Furthermore, we show that these exact eigenstates constitute integrable subsectors in which the Hubbard Hamiltonian effectively reduces to a non-interacting model. This partial integrability causes various multicomponent Hubbard models to weakly break ergodicity. We propose a method of harnessing dissipation to distill the integrable part of the dynamics and elucidate a mechanism of non-thermalization caused by dissipation. This work establishes the coexistence of off-diagonal long-range order and SU($N$) magnetism in excited eigenstates of the multicomponent Hubbard models, which presents a possibility of novel out-of-equilibrium pairing states of multicomponent fermions. These models unveil a unique feature of quantum thermalization of multicomponent fermions, which can experimentally be tested with cold-atom quantum simulators.

categories: cond-mat.str-el cond-mat.quant-gas cond-mat.stat-mech cond-mat.supr-con quant-ph


title: Combating COVID-19 using Generative Adversarial Networks and Artificial Intelligence for Medical Images: A Scoping Review

abstract: This review presents a comprehensive study on the role of GANs in addressing the challenges related to COVID-19 data scarcity and diagnosis. It is the first review that summarizes the different GANs methods and the lungs images datasets for COVID-19. It attempts to answer the questions related to applications of GANs, popular GAN architectures, frequently used image modalities, and the availability of source code. This review included 57 full-text studies that reported the use of GANs for different applications in COVID-19 lungs images data. Most of the studies (n=42) used GANs for data augmentation to enhance the performance of AI techniques for COVID-19 diagnosis. Other popular applications of GANs were segmentation of lungs and super-resolution of the lungs images. The cycleGAN and the conditional GAN were the most commonly used architectures used in nine studies each. 29 studies used chest X-Ray images while 21 studies used CT images for the training of GANs. For majority of the studies (n=47), the experiments were done and results were reported using publicly available data. A secondary evaluation of the results by radiologists/clinicians was reported by only two studies. Conclusion: Studies have shown that GANs have great potential to address the data scarcity challenge for lungs images of COVID-19. Data synthesized with GANs have been helpful to improve the training of the Convolutional Neural Network (CNN) models trained for the diagnosis of COVID-19. Besides, GANs have also contributed to enhancing the CNNs performance through the super-resolution of the images and segmentation. This review also identified key limitations of the potential transformation of GANs based methods in clinical applications.


title: Discovering Latent Concepts Learned in BERT

abstract: A large number of studies that analyze deep neural network models and their ability to encode various linguistic and non-linguistic concepts provide an interpretation of the inner mechanics of these models. The scope of the analyses is limited to pre-defined concepts that reinforce the traditional linguistic knowledge and do not reflect on how novel concepts are learned by the model. We address this limitation by discovering and analyzing latent concepts learned in neural network models in an unsupervised fashion and provide interpretations from the model's perspective. In this work, we study: i) what latent concepts exist in the pre-trained BERT model, ii) how the discovered latent concepts align or diverge from classical linguistic hierarchy and iii) how the latent concepts evolve across layers. Our findings show: i) a model learns novel concepts (e.g. animal categories and demographic groups), which do not strictly adhere to any pre-defined categorization (e.g. POS, semantic tags), ii) several latent concepts are based on multiple properties which may include semantics, syntax, and morphology, iii) the lower layers in the model dominate in learning shallow lexical concepts while the higher layers learn semantic relations and iv) the discovered latent concepts highlight potential biases learned in the model. We also release a novel BERT ConceptNet dataset (BCN) consisting of 174 concept labels and 1M annotated instances.


title: First-order electroweak phase transitions: a nonperturbative update

abstract: We study first-order electroweak phase transitions nonperturbatively, assuming any particles beyond the Standard Model are sufficiently heavy to be integrated out at the phase transition. Utilising high temperature dimensional reduction, we perform lattice Monte-Carlo simulations to calculate the main quantities characterising the transition: the critical temperature, the latent heat, the surface tension and the bubble nucleation rate, updating and extending previous lattice studies. We focus on the region where the theory gives first-order phase transitions due to an effective reduction in the Higgs self-coupling and give a detailed comparison with perturbation theory.


title: Search for the tensor glueball

abstract: The tensor glueball is searched for in BESIII data on radiative $J/\psi$ decays into $\pi^0\pi^0$ and $K_sK_s$. The $\pi\pi$ invariant mass distribution exhibits an enhancement that can be described by a pole at $(2210\pm 60) -i(180\pm 60)$\,MeV. We speculate if the tensor glueball could be distributed among high-mass tensor mesons.


title: Deep Learning Improves Dataset Recovery for High Frame Rate Synthetic Transmit Aperture Imaging

abstract: Synthetic transmit aperture (STA) imaging can achieve optimal lateral resolution in the full field of view, at the cost of low frame rate (FR) and low signal-to-noise ratio (SNR). In our previous studies, compressed sensing based synthetic transmit aperture (CS-STA) and minimal l2-norm least squares (LS-STA) methods were proposed to recover the complete STA dataset from fewer Hadamard-encoded plane wave (PW) transmissions. Results demonstrated that, compared with STA imaging, CS/LS-STA can maintain the high resolution of STA and improve the contrast in the deep region with increased FR. However, these methods would introduce errors to the recovered STA datasets and subsequently produce severe artifacts to the beamformed images. Recently, we discovered that the theoretical explanation for the error introduced in the LS-STA-based recovery is that LS-STA method neglects the null space component of the real STA data. To deal with this problem, we propose to train a convolutional neural network (CNN) under the null space learning framework (to estimate the missing null space component) for high-accuracy recovery of the STA dataset from fewer Hadamard-encoded PW transmissions. The mapping between the low-quality STA dataset (recovered using the LS-STA method) and the corresponding high-quality STA dataset (obtained using full Hadamard-encoded STA imaging, HE-STA) was learned from phantom and in vivo samples. The performance of the proposed CNN-STA method was compared with the LS-STA, STA, and HE-STA methods, in terms of visual quality, NRMSE, gCNR, and FWHM. The results demonstrate that the proposed method can improve the recovery accuracy of the STA datasets and therefore effectively suppress the artifacts presented in the images obtained using the LS-STA method. In addition, the proposed method can maintain the high lateral resolution of STA with fewer PW transmissions, as LS-STA does.


title: Radiative first-order phase transitions to next-to-next-to-leading order

abstract: We develop new perturbative tools to accurately study radiatively-induced first-order phase transitions. Previous perturbative methods have suffered internal inconsistencies and been unsuccessful in reproducing lattice data, which is often attributed to infrared divergences of massless modes (the Linde problem). We employ a consistent power counting scheme to perform calculations, and compare our results against lattice data. We conclude that the consistent expansion removes many previous issues, and indicates that the infamous Linde problem is not as big a factor in these calculations as previously thought.


title: The shadow and photon sphere of the charged black hole in Rastall gravity

abstract: Considering a charged black hole (BH) surrounded by a perfect fluid radiation field (PFRF) in Rastall gravity, we investigate this BH shadow and photon sphere on different spherical accretions backgrounds. The effect of the PFRF parameter/BH charge on the critical impact parameter is studied by investigating the light deflection near this BH. The luminosity of these BH shadows in different spherical accretions is obtained, respectively. It is found that the shadow of this BH with infalling spherical accretion is darker than static spherical accretion, and the photon sphere with infalling spherical accretion is brighter than a static one. We creatively investigate the effects of the BH charge/PFRF parameter on the luminosity of BH shadow and photon sphere. The results implying that the BH shadow is a signature of space-time geometry, and the photon sphere luminosity is affected by accretion materials and BH itself.


title: On completeness and dynamics of compact Brinkmann spacetimes

abstract: Brinkmann Lorentz manifolds are those admitting an isotropic parallel vector field. We prove geodesic completeness of the compact and also compactly homogeneous Brinkmann spaces. We also prove, partially, that their parallel vector field generates an equicontinuous flow.


title: Graph potentials and topological quantum field theories

abstract: We introduce graph potentials, which are Laurent polynomials associated to (colored) trivalent graphs. We show that the birational type of the graph potential only depends on the homotopy type of the colored graph, and use this to define a topological quantum field theory. A similar construction was recently introduced independently by Kontsevich--Odesskii under the name of multiplicative kernels. We end our paper by giving an efficient computational method to compute its partition function. This is the first paper in a series, and we give a survey of the applications of graph potentials in the other parts.


title: Modulation leakage-free continuous-variable quantum key distribution

abstract: Distributing cryptographic keys over public channels in a way that can provide information-theoretic security is the holy grail for secure communication. This can be achieved by exploiting quantum mechanical principles in so-called quantum key distribution (QKD). Continuous-variable (CV) QKD based on coherent states, in particular, is an attractive scheme for secure communication since it requires only standard telecommunication technology that can operate at room temperature. However, a recently discovered side-channel created in the process of state preparation leads to a leakage of information about the transmitted quantum state, opening a security loophole for eavesdroppers to compromise the security of the CVQKD system. Here, we present a CVQKD system without this modulation leakage vulnerability. Our implementation is based on a baseband modulation approach, and uses an in-phase and quadrature (IQ) modulator for state preparation and radio frequency heterodyne detection together with carefully designed digital signal processing for state measurement. We consider practical aspects in the implementation and demonstrate the generation of a composable secret key secure against collective attacks. This work is a step towards protecting CVQKD systems against practical imperfections of physical devices and operational limitations without performance degradation.


title: FreeMatch: Self-adaptive Thresholding for Semi-supervised Learning

abstract: Semi-supervised Learning (SSL) has witnessed great success owing to the impressive performances brought by various methods based on pseudo labeling and consistency regularization. However, we argue that existing methods might fail to utilize the unlabeled data more effectively since they either use a pre-defined / fixed threshold or an ad-hoc threshold adjusting scheme, resulting in inferior performance and slow convergence. We first analyze a motivating example to obtain intuitions on the relationship between the desirable threshold and model's learning status. Based on the analysis, we hence propose FreeMatch to adjust the confidence threshold in a self-adaptive manner according to the model's learning status. We further introduce a self-adaptive class fairness regularization penalty to encourage the model for diverse predictions during the early training stage. Extensive experiments indicate the superiority of FreeMatch especially when the labeled data are extremely rare. FreeMatch achieves 5.78%, 13.59%, and 1.28% error rate reduction over the latest state-of-the-art method FlexMatch on CIFAR-10 with 1 label per class, STL-10 with 4 labels per class, and ImageNet with 100 labels per class, respectively. Moreover, FreeMatch can also boost the performance of imbalanced SSL. The codes can be found at https://github.com/microsoft/Semi-supervised-learning.


title: Stochastic path-integral approach for predicting the superconducting temperatures of anharmonic solids

abstract: We develop a stochastic path-integral approach for predicting the superconducting transition temperatures of anharmonic solids. By defining generalized Bloch basis, we generalize the formalism of the stochastic path-integral approach, which is originally developed for liquid systems. We implement the formalism for ab initio calculations using the projector augmented-wave method, and apply the implementation to estimate the superconducting transition temperatures of metallic deuterium and hydrogen sulfide. For metallic deuterium, which is approximately harmonic, our result coincides well with that obtained from the standard approach based on the harmonic approximation and the density functional perturbation theory. For hydrogen sulfide, we find that anharmonicity strongly suppresses the predicted superconducting transition temperature. Compared to the self-consistent harmonic approximation approach, our approach yields a transition temperature closer to the experimentally observed one.


title: On groups in which every element has a prime power order and which satisfy some boundedness condition

abstract: In this paper we shall deal with periodic groups, in which each element has a prime power order. A group $G$ will be called a $BCP$-group if each element of $G$ has a prime power order and for each $p\in \pi(G)$ there exists a positive integer $u_p$ such that each $p$-element of $G$ is of order $p^i\leq p^{u_p}$. A group $G$ will be called a $BSP$-group if each element of $G$ has a prime power order and for each $p\in \pi(G)$ there exists a positive integer $v_p$ such that each finite $p$-subgroup of $G$ is of order $p^j\leq p^{v_p}$. Here $\pi(G)$ denotes the set of all primes dividing the order of some element of $G$. Our main results are the following four theorems. Theorem 1: Let $G$ be a finitely generated $BCP$-group. Then $G$ has only a finite number of normal subgroups of finite index. Theorem 4: Let $G$ be a locally graded $BCP$-group. Then $G$ is a locally finite group. Theorem 7: Let $G$ be a locally graded $BSP$-group. Then $G$ is a finite group. Theorem 9: Let $G$ be a $BSP$-group satisfying $2\in \pi(G)$. Then $G$ is a locally finite group.


title: Pocket2Mol: Efficient Molecular Sampling Based on 3D Protein Pockets

abstract: Deep generative models have achieved tremendous success in designing novel drug molecules in recent years. A new thread of works have shown the great potential in advancing the specificity and success rate of in silico drug design by considering the structure of protein pockets. This setting posts fundamental computational challenges in sampling new chemical compounds that could satisfy multiple geometrical constraints imposed by pockets. Previous sampling algorithms either sample in the graph space or only consider the 3D coordinates of atoms while ignoring other detailed chemical structures such as bond types and functional groups. To address the challenge, we develop Pocket2Mol, an E(3)-equivariant generative network composed of two modules: 1) a new graph neural network capturing both spatial and bonding relationships between atoms of the binding pockets and 2) a new efficient algorithm which samples new drug candidates conditioned on the pocket representations from a tractable distribution without relying on MCMC. Experimental results demonstrate that molecules sampled from Pocket2Mol achieve significantly better binding affinity and other drug properties such as druglikeness and synthetic accessibility.


title: A cGAN Ensemble-based Uncertainty-aware Surrogate Model for Offline Model-based Optimization in Industrial Control Problems

abstract: This study focuses on two important problems related to applying offline model-based optimization to real-world industrial control problems. The first problem is how to create a reliable probabilistic model that accurately captures the dynamics present in noisy industrial data. The second problem is how to reliably optimize control parameters without actively collecting feedback from industrial systems. Specifically, we introduce a novel cGAN ensemble-based uncertainty-aware surrogate model for reliable offline model-based optimization in industrial control problems. The effectiveness of the proposed method is demonstrated through extensive experiments conducted on two representative cases, namely a discrete control case and a continuous control case. The results of these experiments show that our method outperforms several competitive baselines in the field of offline model-based optimization for industrial control.


title: Cosmology in a locally scale invariant gravity

abstract: A `bouncing' cosmological model is proposed in the context of a Weyl-invariant scalar-tensor (WIST) theory of gravity. In addition to being Weyl-invariant the theory is U(1)-symmetric and has a conserved global charge. The entire cosmic background evolution is accounted for by a complex scalar field that evolves in the static `comoving' frame. Its (dimensional) modulus $\chi$ regulates the dynamics of masses and the apparent space expansion. Cosmological redshift is essentially due to the cosmic evolution of the Rydberg constant in the comoving frame. The temporal evolution of $\chi$ is analogous to that of a point particle in the presence of a central potential $V(\chi)$. The scalar field sources the spacetime curvature; as such it can account for the (cosmological) Dark Sector. An interplay between the energy density of radiation and that of the kinetic energy associated with the phase $\alpha$ of the scalar field (which are of opposite signs) results in a classical non-singular stable and nearly-symmetric bouncing dynamics deep in the radiation-dominated era. This encompasses the observed redshifting era which preceded by a `bounce' that follows a blushifting era. The model is essentially free of the horizon or flatness problems. Big Bang nucleosynthesis sets a lower 1-10 MeV bound on the typical energy scale at the `bounce'.


title: Rapid localization of gravitational wave hosts with FIGARO

abstract: The copious scientific literature produced after the detection of GW170817 electromagnetic counterpart demonstrated the importance of a prompt and accurate localization of the gravitational wave within the co-moving volume. In this letter, we present FIGARO, a ready to use and publicly available software that relies on Bayesian non-parametrics. FIGARO is designed to run in parallel with parameter estimation algorithms to provide updated three-dimensional volume localization information. Differently from any existing algorithms, the analytical nature of the FIGARO reconstruction allows a ranking of the entries of galaxy catalogues by their probability of being the host of a gravitational wave event, hence providing an additional tool for a prompt electromagnetic follow up of gravitational waves. We illustrate the features of FIGARO on binary black holes as well as on GW170817. Finally, we demonstrate the robustness of FIGARO by producing so-called pp-plots and we present a method based on information entropy to assess when, during the parameter estimation run, it is reasonable to begin releasing skymaps.


title: Evaluating Independence and Conditional Independence Measures

abstract: Independence and Conditional Independence (CI) are two fundamental concepts in probability and statistics, which can be applied to solve many central problems of statistical inference. There are many existing independence and CI measures defined from diverse principles and concepts. In this paper, the 16 independence measures and 16 CI measures were reviewed and then evaluated with simulated and real data. For the independence measures, eight simulated data were generating from normal distribution, normal and Archimedean copula functions to compare the measures in bivariate or multivariate, linear or nonlinear settings. Two UCI dataset, including the heart disease data and the wine quality data, were used to test the power of the independence measures in real conditions. For the CI measures, two simulated data with normal distribution and Gumbel copula, and one real data (the Beijing air data) were utilized to test the CI measures in prespecified linear or nonlinear setting and real scenario. From the experimental results, we found that most of the measures work well on the simulated data by presenting the right monotonicity of the simulations. However, the independence and CI measures were differentiated on much complex real data respectively and only a few can be considered as working well with reference to domain knowledge. We also found that the measures tend to be separated into groups based on the similarity of the behaviors of them in each setting and in general. According to the experiments, we recommend CE as a good choice for both independence and CI measure. This is also due to its rigorous distribution-free definition and consistent nonparametric estimator.


title: Penrose junction conditions with $\Lambda$: Geometric insights into low-regularity metrics for impulsive gravitational waves

abstract: Impulsive gravitational waves in Minkowski space were introduced by Roger Penrose at the end of the 1960s, and have been widely studied over the decades. Here we focus on nonexpanding waves which later have been generalized to impulses traveling in all constant-curvature backgrounds, i.e., the (anti-)de Sitter universe. While Penrose's original construction was based on his vivid geometric "scissors-and-paste" approach in a flat background, until recently a comparably powerful visualization and understanding has been missing in the case with a cosmological constant $\Lambda\not=0$. Here we review the original Penrose construction and its generalization to non-vanishing $\Lambda$ in a pedagogical way, as well as the recently established visualization: A special family of global null geodesics defines an appropriate comoving coordinate system that allows to relate the distributional to the continuous form of the metric.


title: Seismic Background Limitation of Lunar Gravitational-wave Detectors

abstract: New concepts were recently proposed for gravitational-wave (GW) detectors on the Moon. These include laser-interferometric detectors, proposed as free-range or optical-fiber interferometers, and inertial acceleration sensors. Some of them exploit the response of the Moon to GWs, others follow the design of current laser-interferometric GW detectors, which directly measure the gravitational strain with suspended optics. All of these ideas emerged since the Moon offers an extremely quiet geophysical environment compared to Earth, but at the same time, one must realize that even the quiet lunar environment sets limits to the sensitivity of lunar GW detectors. In this article, we compare the proposed mission concepts in terms of their response to GWs and evaluate how they are affected by the lunar seismic background. We discuss available mitigation strategies. From these analyses, we infer the prime observation band of each detector concept.


title: Market-Based Asset Price Probability

abstract: We consider the randomness of market trade values and volumes as the origin of asset price stochasticity. We define the first four market-based price statistical moments that depend on statistical moments and correlations of market trade values and volumes. Market-based price statistical moments coincide with conventional frequency-based ones if all trade volumes are constant during the time averaging interval. We present approximations of market-based price probability by a finite number of price statistical moments. We consider the consequences of the use of market-based price statistical moments for asset-pricing models and Value-at-Risk. We show that the use of volume weighted average price results in zero price-volume correlations. We derive market-based correlations between price and squares of volume and between squares of price and volume. To forecast market-based price volatility at horizon T one should predict the first two statistical moments of market trade values and volumes and their correlations at the same horizon T.


title: Not to Overfit or Underfit the Source Domains? An Empirical Study of Domain Generalization in Question Answering

abstract: Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain generalization (DG) is first and foremost a problem of mitigating source domain underfitting: models not adequately learning the signal already present in their multi-domain training data. Experiments on a reading comprehension DG benchmark show that as a model learns its source domains better -- using familiar methods such as knowledge distillation (KD) from a bigger model -- its zero-shot out-of-domain utility improves at an even faster pace. Improved source domain learning also demonstrates superior out-of-domain generalization over three popular existing DG approaches that aim to limit overfitting. Our implementation of KD-based domain generalization is available via PrimeQA at: https://ibm.biz/domain-generalization-with-kd.


title: Backward bifurcation, basic reinfection number and robustness of a SEIRE epidemic model with reinfection

abstract: Recent evidences show that individuals who recovered from COVID-19 can be reinfected. However, this phenomenon has rarely been studied using mathematical models. In this paper, we propose a SEIRE epidemic model to describe the spread of the epidemic with reinfection. We obtain the important thresholds $R_0$ (the basic reproduction number) and Rc (a threshold less than one). Our investigations show that when $R_0 > 1$, the system has an endemic equilibrium, which is globally asymptotically stable. When $R_c < R_0 < 1$, the epidemic system exhibits bistable dynamics. That is, the system has backward bifurcation and the disease cannot be eradicated. In order to eradicate the disease, we must ensure that the basic reproduction number $R_0$ is less than $R_c$. The basic reinfection number is obtained to measure the reinfection force, which turns out to be a new tipping point for disease dynamics. We also give definition of robustness, a new concept to measure the difficulty of completely eliminating the disease for a bistable epidemic system. Numerical simulations are carried out to verify the conclusions.


title: Topic Modelling on Consumer Financial Protection Bureau Data: An Approach Using BERT Based Embeddings

abstract: Customers' reviews and comments are important for businesses to understand users' sentiment about the products and services. However, this data needs to be analyzed to assess the sentiment associated with topics/aspects to provide efficient customer assistance. LDA and LSA fail to capture the semantic relationship and are not specific to any domain. In this study, we evaluate BERTopic, a novel method that generates topics using sentence embeddings on Consumer Financial Protection Bureau (CFPB) data. Our work shows that BERTopic is flexible and yet provides meaningful and diverse topics compared to LDA and LSA. Furthermore, domain-specific pre-trained embeddings (FinBERT) yield even better topics. We evaluated the topics on coherence score (c_v) and UMass.


title: Guidelines for the Regularization of Gammas in Batch Normalization for Deep Residual Networks

abstract: L2 regularization for weights in neural networks is widely used as a standard training trick. However, L2 regularization for gamma, a trainable parameter of batch normalization, remains an undiscussed mystery and is applied in different ways depending on the library and practitioner. In this paper, we study whether L2 regularization for gamma is valid. To explore this issue, we consider two approaches: 1) variance control to make the residual network behave like identity mapping and 2) stable optimization through the improvement of effective learning rate. Through two analyses, we specify the desirable and undesirable gamma to apply L2 regularization and propose four guidelines for managing them. In several experiments, we observed the increase and decrease in performance caused by applying L2 regularization to gamma of four categories, which is consistent with our four guidelines. Our proposed guidelines were validated through various tasks and architectures, including variants of residual networks and transformers.


title: Large Data and (Not Even Very) Complex Ecological Models: When Worlds Collide

abstract: We consider the challenges that arise when fitting complex ecological models to 'large' data sets. In particular, we focus on random effect models which are commonly used to describe individual heterogeneity, often present in ecological populations under study. In general, these models lead to a likelihood that is expressible only as an analytically intractable integral. Common techniques for fitting such models to data include, for example, the use of numerical approximations for the integral, or a Bayesian data augmentation approach. However, as the size of the data set increases (i.e. the number of individuals increases), these computational tools may become computationally infeasible. We present an efficient Bayesian model-fitting approach, whereby we initially sample from the posterior distribution of a smaller subsample of the data, before correcting this sample to obtain estimates of the posterior distribution of the full dataset, using an importance sampling approach. We consider several practical issues, including the subsampling mechanism, computational efficiencies (including the ability to parallelise the algorithm) and combining subsampling estimates using multiple subsampled datasets. We demonstrate the approach in relation to individual heterogeneity capture-recapture models. We initially demonstrate the feasibility of the approach via simulated data before considering a challenging real dataset of approximately 30,000 guillemots, and obtain posterior estimates in substantially reduced computational time.


title: Multiplicity-free representations of certain nilpotent Lie groups over Siegel domains of the second kind

abstract: We investigate the multiplicity-freeness property of holomorphic multiplier representations of an affine transformation group on a Siegel domain of the second kind. We first deal with a generalized Heisenberg group. Next, for a certain smaller group, we give some necessary and sufficient conditions for the representation defined by the trivial multiplier to be multiplicity-free. We relate the multiplicity-freeness property to the coisotropicity and the visibility of the group action and to the commutativity of the algebra of invariant differential operators.


title: Irreducible representations of $\mathbb{Z}_2^2$-graded ${\cal N} =2$ supersymmetry algebra and $\mathbb{Z}_2^2$-graded supermechanics

abstract: Irreducible representations (irreps) of $\mathbb{Z}_2^2$-graded supersymmetry algebra of ${\cal N}=2$ are obtained by the method of induced representation and they are used to derive $\mathbb{Z}_2^2$-graded supersymmetric classical actions. The irreps are four dimensional for $ \lambda = 0$ where $ \lambda $ is an eigenvalue of the Casimir element, and eight dimensional for $\lambda \neq 0.$ The eight dimensional irreps reduce to four dimensional ones only when $\lambda$ and an eigenvalue of Hamiltonian satisfy a particular relation. The reduced four dimensional irreps are used to define $\mathbb{Z}_2^2$-graded supersymmetry transformations and two types of classical actions invariant under the transformations are presented. It is shown that one of the Noether charges vanishes if all the variables of specific $\mathbb{Z}_2^2$-degree are auxiliary.


title: Six-dimensional non-extremal Reissner-Nordstrom black hole, charged massive scalar perturbation and black hole bomb

abstract: The superradiant stability of higher dimensional non-extremal Reissner-Nordstrom black hole under charged massive scalar perturbation is analytically studied. We extend our previous studies of four- and five-dimensional non-extremal Reissner-Nordstrom black hole cases to six-dimensional case. By analyzing the derivative of the effective potential with an analytical method, we find that no potential well exists outside the outer horizon of the black hole for the superradiant scalar modes. This means that there is no black hole bomb for the system consisting of six-dimensional Reissner-Nordstrom black hole and charged massive scalar perturbation and the system is superradiantly stable.


title: Unification of quantum resources in tripartite systems

abstract: In quantum resource theories (QRTs), there exists evidences of intrinsic connections among different measures of quantum resources, including entanglement, coherence, quantum steering, and so on. However, building the relations among different quantum resources is a vital yet challenging task in multipartite quantum systems. Here, we focus on a unified framework of interpreting the interconversions among different quantum resources in tripartite systems. In particular, an exact relation between the generalized geometric measure and the genuinely multipartite concurrence are derived for tripartite entanglement states. Then we obtain the tradeoff relation between the first-order coherence and the genuine tripartite entanglement by the genuinely multipartite concurrence and concurrence fill. Furthermore, the tradeoff relation between the maximum steering inequality violation and concurrence fill for an arbitrary three-qubit pure state is found. In addition, we investigate the close relation between the maximum steering inequality violation and the first-order coherence. The results show that these quantum resources are intrinsic related and can be converted to each other in the framework of QRTs, although they are still regarded to be different.


title: Discovering and Explaining the Representation Bottleneck of Graph Neural Networks from Multi-order Interactions

abstract: Graph neural networks (GNNs) mainly rely on the message-passing paradigm to propagate node features and build interactions, and different graph learning tasks require different ranges of node interactions. In this work, we explore the capacity of GNNs to capture interactions between nodes under contexts with different complexities. We discover that GNNs are usually unable to capture the most informative kinds of interaction styles for diverse graph learning tasks, and thus name this phenomenon as GNNs' representation bottleneck. As a response, we demonstrate that the inductive bias introduced by existing graph construction mechanisms can prevent GNNs from learning interactions of the most appropriate complexity, i.e., resulting in the representation bottleneck. To address that limitation, we propose a novel graph rewiring approach based on interaction patterns learned by GNNs to adjust the receptive fields of each node dynamically. Extensive experiments on both real-world and synthetic datasets prove the effectiveness of our algorithm to alleviate the representation bottleneck and its superiority to enhance the performance of GNNs over state-of-the-art graph rewiring baselines.


title: The Cavendish Computors: The women working in scientific computing for Radio Astronomy

abstract: A discussion of the history of scientific computing for Radio Astronomy in the Cavendish Laboratory of the University of Cambridge in the decades after the Second World War. This covers the development of the aperture synthesis technique for Radio Astronomy and how that required using the new computing technology developed by the University's Mathematical Laboratory: the EDSAC, EDSAC 2 and TITAN computers. It looks at the scientific advances made by the Radio Astronomy group, particularly the assembling of evidence which contradicted the Steady State Hypothesis. It also examines the software advances that allowed bigger telescopes to be built: the Fast Fourier Transform (FFT) and the degridding algorithm. Throughout, the contribution of women is uncovered, from the diagrams they drew for scientific publications, through programming and operating computers, to writing scientific papers.


title: Textual Explanations and Critiques in Recommendation Systems

abstract: Artificial intelligence and machine learning algorithms have become ubiquitous. Although they offer a wide range of benefits, their adoption in decision-critical fields is limited by their lack of interpretability, particularly with textual data. Moreover, with more data available than ever before, it has become increasingly important to explain automated predictions. Generally, users find it difficult to understand the underlying computational processes and interact with the models, especially when the models fail to generate the outcomes or explanations, or both, correctly. This problem highlights the growing need for users to better understand the models' inner workings and gain control over their actions. This dissertation focuses on two fundamental challenges of addressing this need. The first involves explanation generation: inferring high-quality explanations from text documents in a scalable and data-driven manner. The second challenge consists in making explanations actionable, and we refer to it as critiquing. This dissertation examines two important applications in natural language processing and recommendation tasks. Overall, we demonstrate that interpretability does not come at the cost of reduced performance in two consequential applications. Our framework is applicable to other fields as well. This dissertation presents an effective means of closing the gap between promise and practice in artificial intelligence.


title: Querying Spatial-Temporal-Spectral Data Using a Graphical Query Builder

abstract: Constructing complex queries on data which combines spatial, temporal, and spectral aspects is a challenging and error-prone process. Query interfaces of general-purpose database management systems fall short in providing intuitive support for users to effectively and efficiently construct queries. To address this situation, we developed GraphicalQueryBuilder, a tool which provides interactive and immediate feedback during query construction and visually represents search space and queries. A user study with ten professionals showed that users were able to complete queries on average 40% faster and 40 percentage points more accurately compared to a Microsoft Access baseline.


title: Analytic smoothing effect of linear landau equation with soft potential

abstract: In this work, we study the linear Landau equation with soft potential and show that the solution to the Cauchy problem with initial datum in $L^{2}(\mathbb{R}^3)$ enjoys an analytic regularizing effect, and the evolution of analytic radius is same as heat equations.


title: Supervised Learning and Model Analysis with Compositional Data

abstract: The compositionality and sparsity of high-throughput sequencing data poses a challenge for regression and classification. However, in microbiome research in particular, conditional modeling is an essential tool to investigate relationships between phenotypes and the microbiome. Existing techniques are often inadequate: they either rely on extensions of the linear log-contrast model (which adjusts for compositionality, but is often unable to capture useful signals), or they are based on black-box machine learning methods (which may capture useful signals, but ignore compositionality in downstream analyses). We propose KernelBiome, a kernel-based nonparametric regression and classification framework for compositional data. It is tailored to sparse compositional data and is able to incorporate prior knowledge, such as phylogenetic structure. KernelBiome captures complex signals, including in the zero-structure, while automatically adapting model complexity. We demonstrate on par or improved predictive performance compared with state-of-the-art machine learning methods. Additionally, our framework provides two key advantages: (i) We propose two novel quantities to interpret contributions of individual components and prove that they consistently estimate average perturbation effects of the conditional mean, extending the interpretability of linear log-contrast models to nonparametric models. (ii) We show that the connection between kernels and distances aids interpretability and provides a data-driven embedding that can augment further analysis. Finally, we apply the KernelBiome framework to two public microbiome studies and illustrate the proposed model analysis. KernelBiome is available as an open-source Python package at https://github.com/shimenghuang/KernelBiome.


title: A weighted Sobolev-Poincar\'e type trace inequality on Riemannian manifolds

abstract: Given $(M, g)$ a smooth compact $(n+1)$-dimensional Riemannian manifold with boundary $\partial M$. Let $\rho$ be a defining function of $M$ and $\sigma \in(0,1)$. In this paper we study a weighted Sobolev-Poincar\'e type trace inequality corresponding to the embedding of $W^{1,2}(\rho^{1-2 \sigma}, M) \hookrightarrow L^{p}(\partial M)$, where $p=\frac{2 n}{n-2 \sigma}$. More precisely, under some assumptions on the manifold, we prove that there exists a constant $B>0$ such that, for all $u \in W^{1,2}(\rho^{1-2\sigma}, M)$, $$ \Big(\int_{\partial M}|u|^{p} \,\ud s_{g}\Big)^{2/p} \leq \mu^{-1} \int_{M} \rho^{1-2 \sigma}|\nabla_{g} u|^{2} \,\ud v_{g}+B \Big|\int_{\partial M} |u|^{p-2}u \,\ud s_{g}\Big|^{2/(p-1)}. $$ This inequality is sharp in the sense that $\mu^{-1}$ cannot be replaced by any smaller constant. Moreover, unlike the classical Sobolev inequality, $\mu^{-1}$ does not depend on $n$ and $\sigma$ only, but depends on the manifold.


title: Monolayer and bilayer PtCl$_3$: Energetics, magnetism, and band topology

abstract: Two-dimensional (2D) magnetic materials hosting nontrivial topological states are interesting for fundamental research as well as practical applications. Recently, the topological state of 2D Weyl half-semimetal (WHS) was proposed, which hosts fully spin polarized Weyl points robust against spin-orbit coupling in a 2D ferromagnetic system, and single-layer PtCl$_3$ was predicted as a platform for realizing this state. Here, we perform an extensive search of 2D PtCl$_3$ structures, by using the particle swarm optimization technique and density functional theory calculation. We show that the desired PtCl$_3$ phase corresponds to the most stable one at its stoichiometry. The 2D structure also possesses good thermal stability up to 600 K. We suggest SnS$_2$ as a substrate for the growth of 2D PtCl$_3$, which has excellent lattice matching and preserves the WHS state in PtCl$_3$. We find that uniaxial strains along the zigzag direction maintain the WHS state, whereas small strains along the armchair direction drives a topological phase transition from the WHS to a quantum anomalous Hall (QAH) insulator phase. Furthermore, we study bilayer PtCl$_3$ and show that the stacking configuration has strong impact on the magnetism and the electronic band structure. Particularly, the $AA'$ stacked bilayer PtCl$_3$ realizes an interesting topological state -- the 2D antiferromagnetic mirror Chern insulator, which has a pair of topological gapless edge bands. Our work provides guidance for the experimental realization of 2D PtCl$_3$ and will facilitate the study of 2D magnetic topological states, including WHS, QAH insulator, and magnetic mirror Chern insulator states.


title: Variable Functioning and Its Application to Large Scale Steel Frame Design Optimization

abstract: To solve complex real-world problems, heuristics and concept-based approaches can be used in order to incorporate information into the problem. In this study, a concept-based approach called variable functioning Fx is introduced to reduce the optimization variables and narrow down the search space. In this method, the relationships among one or more subset of variables are defined with functions using information prior to optimization; thus, instead of modifying the variables in the search process, the function variables are optimized. By using problem structure analysis technique and engineering expert knowledge, the $Fx$ method is used to enhance the steel frame design optimization process as a complex real-world problem. The proposed approach is coupled with particle swarm optimization and differential evolution algorithms and used for three case studies. The algorithms are applied to optimize the case studies by considering the relationships among column cross-section areas. The results show that $Fx$ can significantly improve both the convergence rate and the final design of a frame structure, even if it is only used for seeding.


title: The Contact Process with Switching

abstract: In this paper, we introduce a type switching mechanism for the Contact Process on the lattice $\mathbb{Z}^d$. That is, we allow the individual particles/sites to switch between two (or more) types independently of one another, and the different types may exhibit specific infection and recovery dynamics. Such type switches can eg.\ be motivated from biology, where 'phenotypic switching' is common among micro-organisms. Our framework includes as special cases systems with switches between 'active' and 'dormant' states (the Contact Process with dormancy, CPD), and the Contact Process in a randomly evolving environment (CPREE) introduced by Broman (2007). The 'standard' multi-type Contact Process (without type-switching) can also be recovered as a limiting case. After constructing the process from a graphical representation, we establish several basic properties that are mostly analogous to the classical Contact Process. We then provide couplings between several variants of the system, which in particular yield the existence of a phase transition. Further, we investigate the effect of the switching parameters on the critical value of the system by providing rigorous bounds obtained from the coupling arguments as well as numerical and heuristic results. Finally, we investigate scaling limits for the process as the switching parameters tend to 0 (slow switching regime) resp.\ $\infty$ (fast switching regime). We conclude with a brief discussion of further model variants and questions for future research.


title: Classifiers are Better Experts for Controllable Text Generation

abstract: This paper proposes a simple method for controllable text generation based on weighting logits with a free-form classifier, namely CAIF sampling. Using an arbitrary text classifier, we adjust a small part of a language model's logits and guide text generation towards or away from classifier prediction. We experimented with toxicity avoidance and sentiment control tasks and showed that the proposed method significantly outperforms recent PPLM, GeDi, and DExperts on PPL and task accuracy metrics based on the external classifier of generated texts. In addition, compared to other approaches, it is easier to implement and tune and has significantly fewer restrictions and requirements.


title: Fairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanations

abstract: As post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to ensure that the quality of the resulting explanations is consistently high across various population subgroups including the minority groups. For instance, it should not be the case that explanations associated with instances belonging to a particular gender subgroup (e.g., female) are less accurate than those associated with other genders. However, there is little to no research that assesses if there exist such group-based disparities in the quality of the explanations output by state-of-the-art explanation methods. In this work, we address the aforementioned gaps by initiating the study of identifying group-based disparities in explanation quality. To this end, we first outline the key properties which constitute explanation quality and where disparities can be particularly problematic. We then leverage these properties to propose a novel evaluation framework which can quantitatively measure disparities in the quality of explanations output by state-of-the-art methods. Using this framework, we carry out a rigorous empirical analysis to understand if and when group-based disparities in explanation quality arise. Our results indicate that such disparities are more likely to occur when the models being explained are complex and highly non-linear. In addition, we also observe that certain post hoc explanation methods (e.g., Integrated Gradients, SHAP) are more likely to exhibit the aforementioned disparities. To the best of our knowledge, this work is the first to highlight and study the problem of group-based disparities in explanation quality. In doing so, our work sheds light on previously unexplored ways in which explanation methods may introduce unfairness in real world decision making.


title: An exact sequence for generalized string links over surfaces

abstract: In this work we extend Goldberg result \cite{Goldberg} for generalized string links over closed, connected and orientable surfaces of genus $g \geq 1$, i.e., different from the sphere (up to link-homotopy).

categories: math.GT math-ph math.AG math.AT math.GR math.MP


title: Exploiting the Relationship Between Kendall's Rank Correlation and Cosine Similarity for Attribution Protection

abstract: Model attributions are important in deep neural networks as they aid practitioners in understanding the models, but recent studies reveal that attributions can be easily perturbed by adding imperceptible noise to the input. The non-differentiable Kendall's rank correlation is a key performance index for attribution protection. In this paper, we first show that the expected Kendall's rank correlation is positively correlated to cosine similarity and then indicate that the direction of attribution is the key to attribution robustness. Based on these findings, we explore the vector space of attribution to explain the shortcomings of attribution defense methods using $\ell_p$ norm and propose integrated gradient regularizer (IGR), which maximizes the cosine similarity between natural and perturbed attributions. Our analysis further exposes that IGR encourages neurons with the same activation states for natural samples and the corresponding perturbed samples, which is shown to induce robustness to gradient-based attribution methods. Our experiments on different models and datasets confirm our analysis on attribution protection and demonstrate a decent improvement in adversarial robustness.


title: A CLT for the LSS of large dimensional sample covariance matrices with unbounded dispersions

abstract: In this paper, we establish the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix when the population covariance matrices are not uniformly bounded, which is a nontrivial extension of the Bai-Silverstein theorem (BST) (2004). The latter has strongly stimulated the development of high-dimensional statistics, especially the application of random matrix theory to statistics. However, the assumption of uniform boundedness of the population covariance matrices is found strongly limited to the applications of BST. The aim of this paper is to remove the blockages to the applications of BST. The new CLT, allows the spiked eigenvalues to exist and tend to infinity. It is interesting to note that the roles of either spiked eigenvalues or the bulk eigenvalues or both of the two are dominating in the CLT. Moreover, the results are checked by simulation studies with various population settings. The CLT for LSS is then applied for testing the hypothesis that a covariance matrix $ \bSi $ is equal to an identity matrix. For this, the asymptotic distributions for the corrected likelihood ratio test (LRT) and Nagao's trace test (NT) under alternative are derived, and we also propose the asymptotic power of LRT and NT under certain alternatives.


title: Topological States in Chevrel Phase Materials from First-principle Calculations

abstract: Chevrel phase materials form a family of ternary molybdenum chalcogenides with a general chemical formula $A_x{\rm Mo}_6X_8$ ($A$ = metal elements, $X$ = chalcogen). The variety of $A$ atoms makes a large number of family members and leads to many tunable physical properties, such as the superconductivity, thermoelectricity and the ionic conductivity. In this work, we have further found various nontrivial band topological states in these materials by using first-principle calculations. The compounds having time-reversal symmetry, such as ${\rm BaMo}_6{\rm S}_8$, ${\rm SrMo}_6{\rm S}_8$, and ${\rm Mo}_6{\rm S}_8$, are topological insulators in both of the $R\bar{3}$ and $P\bar{1}$ phases, whereas ${\rm EuMo}_6{\rm S}_8$ within ferromagnetic state, it is an axion insulator in the $R\bar{3}$ phase and a trivial one in the $P\bar{1}$ phase. This indicates that the change of $A$ ions can modify the chemical potential, lattice distortion, and magnetic orders, which offers a unique way to influence the topological states and other properties. We hope this work can stimulate further studies of Chevrel phase materials to find more intriguing phenomena, such as topological superconducting states and Majorana modes.


title: Random matrix theory and moments of moments of $L$-functions

abstract: We give an analytic proof of the asymptotic behaviour of the moments of moments of the characteristic polynomials of random symplectic and orthogonal matrices. We therefore obtain alternate, integral expressions for the leading order coefficients previously found by Assiotis, Bailey and Keating. We also discuss the conjectures of Bailey and Keating for the corresponding moments of moments of L-functions with symplectic and orthogonal symmetry. Specifically, we show that these conjectures follow from the shifted moments conjecture of Conrey, Farmer, Keating, Rubinstein and Snaith.


title: Domain Adaptation in Multilingual and Multi-Domain Monolingual Settings for Complex Word Identification

abstract: Complex word identification (CWI) is a cornerstone process towards proper text simplification. CWI is highly dependent on context, whereas its difficulty is augmented by the scarcity of available datasets which vary greatly in terms of domains and languages. As such, it becomes increasingly more difficult to develop a robust model that generalizes across a wide array of input examples. In this paper, we propose a novel training technique for the CWI task based on domain adaptation to improve the target character and context representations. This technique addresses the problem of working with multiple domains, inasmuch as it creates a way of smoothing the differences between the explored datasets. Moreover, we also propose a similar auxiliary task, namely text simplification, that can be used to complement lexical complexity prediction. Our model obtains a boost of up to 2.42% in terms of Pearson Correlation Coefficients in contrast to vanilla training techniques, when considering the CompLex from the Lexical Complexity Prediction 2021 dataset. At the same time, we obtain an increase of 3% in Pearson scores, while considering a cross-lingual setup relying on the Complex Word Identification 2018 dataset. In addition, our model yields state-of-the-art results in terms of Mean Absolute Error.


title: Phase randomization in disordered layered systems

abstract: The propagation of light through a disordered layered system is studied. It is shown that distribution function of the transmission coefficient phase tends to stationary non-uniform distribution as the number of layers increases. The exponential convergence to the stationary distribution allows unambiguous definition of the phase randomization length scale.


title: Sub-symmetry protected topological states

abstract: A hallmark of symmetry-protected topological phases (SPTs) are topologically protected boundary states, which are immune to perturbations that respect the protecting symmetry. It is commonly believed that any perturbation that destroys an SPT phase simultaneously destroys the boundary states. However, by introducing and exploring a weaker sub-symmetry (SubSy) requirement on perturbations, we find that the nature of boundary state protection is in fact more complex. We demonstrate that the boundary states are protected by only the SubSy using prototypical Su-Schrieffer-Heeger (SSH) and breathing Kagome lattice (BKL) models, even though the overall topological invariant and the SPT phase are destroyed by SubSy preserving perturbations. By employing judiciously controlled symmetry breaking in photonic lattices, we experimentally demonstrate such SubSy protection of topological states. Furthermore, we introduce a long-range hopping symmetry in BKLs, which resolves a debate on the topological nature of their corner states. Our results apply to other systems beyond photonics, heralding the possibility of exploring the intriguing properties of SPT phases in the absence of full symmetry in different physical contexts.


title: Interactive Dashboard to Monitor the COVID-19 Outbreak and Vaccine Administration

abstract: Dashboards are the most common visualization method for displaying COVID-19 data and informing the public. We examined 15 different dashboards to see how various visualization techniques were used. This paper describes the creation and implementation of a dashboard for COVID-19 epidemic and vaccination administration data in Sri Lanka.


title: Skew left braces and the Yang-Baxter equation

abstract: We give a self-contained proof that a skew left brace yields a solution of the Yang-Baxter equation.


title: Stochastic entropy production for continuous measurements of an open quantum system

abstract: We investigate the total stochastic entropy production of a two-level bosonic open quantum system under protocols of time dependent coupling to a harmonic environment. These processes are intended to represent the measurement of a system observable, and consequent selection of an eigenstate, whilst the system is also subjected to thermalising environmental noise. The entropy production depends on the evolution of the system variables and their probability density function, and is expressed through system and environmental contributions. The continuous stochastic dynamics of the open system is based on the Markovian approximation to the exact, noise-averaged stochastic Liouville-von Neumann equation, unravelled through the addition of stochastic environmental disturbance mimicking a measuring device. Under the thermalising influence of time independent coupling to the environment, the mean rate of entropy production vanishes asymptotically, indicating equilibrium. In contrast, a positive mean production of entropy as the system responds to time dependent coupling characterises the irreversibility of quantum measurement, and a comparison of its production for two coupling protocols, representing connection to and disconnection from the external measuring device, satisfies a detailed fluctuation theorem.


title: The role of Riesz potentials in the weak-strong uniqueness for Euler-Poisson systems

abstract: In this article, the weak-strong uniqueness principle is proved for an Euler-Poisson system in the whole space, with initial data so that the strong solution exists. Some results on Riesz potentials are used to justify the considered weak formulation. Then, one follows the relative energy methodology and, in order to handle the solution of Poisson's equation, employs the theory of Riesz potentials.


title: Meta Self-Refinement for Robust Learning with Weak Supervision

abstract: Training deep neural networks (DNNs) under weak supervision has attracted increasing research attention as it can significantly reduce the annotation cost. However, labels from weak supervision can be noisy, and the high capacity of DNNs enables them to easily overfit the label noise, resulting in poor generalization. Recent methods leverage self-training to build noise-resistant models, in which a teacher trained under weak supervision is used to provide highly confident labels for teaching the students. Nevertheless, the teacher derived from such frameworks may have fitted a substantial amount of noise and therefore produce incorrect pseudo-labels with high confidence, leading to severe error propagation. In this work, we propose Meta Self-Refinement (MSR), a noise-resistant learning framework, to effectively combat label noise from weak supervision. Instead of relying on a fixed teacher trained with noisy labels, we encourage the teacher to refine its pseudo-labels. At each training step, MSR performs a meta gradient descent on the current mini-batch to maximize the student performance on a clean validation set. Extensive experimentation on eight NLP benchmarks demonstrates that MSR is robust against label noise in all settings and outperforms state-of-the-art methods by up to 11.4% in accuracy and 9.26% in F1 score.


title: Auslander theorem for PI Artin-Schelter regular algebras

abstract: We prove a version of a theorem of Auslander for finite group actions or coactions on noetherian polynomial identity Artin-Schelter regular algebra.


title: A Computational Framework of Cortical Microcircuits Approximates Sign-concordant Random Backpropagation

abstract: Several recent studies attempt to address the biological implausibility of the well-known backpropagation (BP) method. While promising methods such as feedback alignment, direct feedback alignment, and their variants like sign-concordant feedback alignment tackle BP's weight transport problem, their validity remains controversial owing to a set of other unsolved issues. In this work, we answer the question of whether it is possible to realize random backpropagation solely based on mechanisms observed in neuroscience. We propose a hypothetical framework consisting of a new microcircuit architecture and its supporting Hebbian learning rules. Comprising three types of cells and two types of synaptic connectivity, the proposed microcircuit architecture computes and propagates error signals through local feedback connections and supports the training of multi-layered spiking neural networks with a globally defined spiking error function. We employ the Hebbian rule operating in local compartments to update synaptic weights and achieve supervised learning in a biologically plausible manner. Finally, we interpret the proposed framework from an optimization point of view and show its equivalence to sign-concordant feedback alignment. The proposed framework is benchmarked on several datasets including MNIST and CIFAR10, demonstrating promising BP-comparable accuracy.


title: Searching for cosmic string induced stochastic gravitational wave background with the Parkes Pulsar Timing Array

abstract: We search for stochastic gravitational wave background emitted from cosmic strings using the Parkes Pulsar Timing Array data over 15 years. While we find that the common power-law excess revealed by several pulsar timing array experiments might be accounted for by the gravitational wave background from cosmic strings, the lack of the characteristic Hellings-Downs correlation cannot establish its physical origin yet. The constraints on the cosmic string model parameters are thus derived with conservative assumption that the common power-law excess is due to unknown background. Two representative cosmic string models with different loop distribution functions are considered. We obtain constraints on the dimensionless string tension parameter $G\mu<10^{-11}\sim10^{-10}$, which is more stringent by two orders of magnitude than that obtained by the high-frequency LIGO-Virgo experiment for one model, and less stringent for the other. The results provide the chance to test the Grand unified theories, with the spontaneous symmetry breaking scale of $U(1)$ being two-to-three orders of magnitude below $10^{16}$ GeV. The pulsar timing array experiments are thus quite complementary to the LIGO-Virgo experiment in probing the cosmic strings and the underlying beyond standard model physics in the early Universe.


title: Mutual Influence Regression Model

abstract: In this article, we propose the mutual influence regression model (MIR) to establish the relationship between the mutual influence matrix of actors and a set of similarity matrices induced by their associated attributes. This model is able to explain the heterogeneous structure of the mutual influence matrix by extending the commonly used spatial autoregressive model while allowing it to change with time. To facilitate making inferences with MIR, we establish parameter estimation, weight matrices selection and model testing. Specifically, we employ the quasi-maximum likelihood estimation method to estimate unknown regression coefficients, and demonstrate that the resulting estimator is asymptotically normal without imposing the normality assumption and while allowing the number of similarity matrices to diverge. In addition, an extended BIC-type criterion is introduced for selecting relevant matrices from the divergent number of similarity matrices. To assess the adequacy of the proposed model, we further propose an influence matrix test and develop a novel approach in order to obtain the limiting distribution of the test. Finally, we extend the model to accommodate endogenous weight matrices, exogenous covariates, and both individual and time fixed effects, to broaden the usefulness of MIR. The simulation studies support our theoretical findings, and a real example is presented to illustrate the usefulness of the proposed MIR model.


title: Posterior Probability Matters: Doubly-Adaptive Calibration for Neural Predictions in Online Advertising

abstract: Predicting user response probabilities is vital for ad ranking and bidding. We hope that predictive models can produce accurate probabilistic predictions that reflect true likelihoods. Calibration techniques aim to post-process model predictions to posterior probabilities. Field-level calibration -- which performs calibration w.r.t. to a specific field value -- is fine-grained and more practical. In this paper we propose a doubly-adaptive approach AdaCalib. It learns an isotonic function family to calibrate model predictions with the guidance of posterior statistics, and field-adaptive mechanisms are designed to ensure that the posterior is appropriate for the field value to be calibrated. Experiments verify that AdaCalib achieves significant improvement on calibration performance. It has been deployed online and beats previous approach.


title: Additive dimension and the growth of sets

abstract: We develop the theory of the additive dimension ${\rm dim} (A)$, i.e. the size of a maximal dissociated subset of a set $A$. It was shown that the additive dimension is closely connected with the growth of higher sumsets $nA$ of our set $A$. We apply this approach to demonstrate that for any small multiplicative subgroup $\Gamma$ the sequence $|n\Gamma|$ grows very fast. Also, we obtain a series of applications to the sum--product phenomenon and to the Balog--Wooley decomposition--type results.


title: Inward and Outward Network Influence Analysis

abstract: Measuring heterogeneous influence across nodes in a network is critical in network analysis. This paper proposes an Inward and Outward Network Influence (IONI) model to assess nodal heterogeneity. Specifically, we allow for two types of influence parameters; one measures the magnitude of influence that each node exerts on others (outward influence), while we introduce a new parameter to quantify the receptivity of each node to being influenced by others (inward influence). Accordingly, these two types of influence measures naturally classify all nodes into four quadrants (high inward and high outward, low inward and high outward, low inward and low outward, high inward and low outward). To demonstrate our four-quadrant clustering method in practice, we apply the quasi-maximum likelihood approach to estimate the influence parameters, and we show the asymptotic properties of the resulting estimators. In addition, score tests are proposed to examine the homogeneity of the two types of influence parameters. To improve the accuracy of inferences about nodal influences, we introduce a Bayesian information criterion that selects the optimal influence model. The usefulness of the IONI model and the four-quadrant clustering method is illustrated via simulation studies and an empirical example involving customer segmentation.


title: Associated squark-electroweakino production with NLO+NLL precision

abstract: Motivated by the increased precision expected from LHC Run 3, equally accurate theory predictions are mandatory. As supersymmetry mass limits increase, predictions can be improved by threshold resummation. We examine the effects of including next-to-leading logarithms on associated squark-electroweakino production at the LHC and find a significant reduction in the uncertainty of factorisation and renormalisation scale dependence and a modest increase in the total cross section.


title: Regulating Facial Processing Technologies: Tensions Between Legal and Technical Considerations in the Application of Illinois BIPA

abstract: Harms resulting from the development and deployment of facial processing technologies (FPT) have been met with increasing controversy. Several states and cities in the U.S. have banned the use of facial recognition by law enforcement and governments, but FPT are still being developed and used in a wide variety of contexts where they primarily are regulated by state biometric information privacy laws. Among these laws, the 2008 Illinois Biometric Information Privacy Act (BIPA) has generated a significant amount of litigation. Yet, with most BIPA lawsuits reaching settlements before there have been meaningful clarifications of relevant technical intricacies and legal definitions, there remains a great degree of uncertainty as to how exactly this law applies to FPT. What we have found through applications of BIPA in FPT litigation so far, however, points to potential disconnects between technical and legal communities. This paper analyzes what we know based on BIPA court proceedings and highlights these points of tension: areas where the technical operationalization of BIPA may create unintended and undesirable incentives for FPT development, as well as areas where BIPA litigation can bring to light the limitations of solely technical methods in achieving legal privacy values. These factors are relevant for (i) reasoning about biometric information privacy laws as a governing mechanism for FPT, (ii) assessing the potential harms of FPT, and (iii) providing incentives for the mitigation of these harms. By illuminating these considerations, we hope to empower courts and lawmakers to take a more nuanced approach to regulating FPT and developers to better understand privacy values in the current U.S. legal landscape.


title: The effect of dressing on thermalization of interacting waves

abstract: We propose a more general setup for prethermalization in the system of interacting waves. The idea lies in dividing the multi-wave interactions into trivial and nontrivial ones. The trivial interactions will dress waves and lead to a less strongly interacting system which is statistically equivalent to the original one. With this in mind, we find that prethermalization occurs not only in the weakly interacting regime but also in the strongly interacting regime. The irreversible process towards equilibrium is governed by the Zakharov equation, from which double scaling of the thermalization time is expected. Finally, the theory is well confirmed in numerical experiments.


title: Conditional Vector Graphics Generation for Music Cover Images

abstract: Generative Adversarial Networks (GAN) have motivated a rapid growth of the domain of computer image synthesis. As almost all the existing image synthesis algorithms consider an image as a pixel matrix, the high-resolution image synthesis is complicated.A good alternative can be vector images. However, they belong to the highly sophisticated parametric space, which is a restriction for solving the task of synthesizing vector graphics by GANs. In this paper, we consider a specific application domain that softens this restriction dramatically allowing the usage of vector image synthesis. Music cover images should meet the requirements of Internet streaming services and printing standards, which imply high resolution of graphic materials without any additional requirements on the content of such images. Existing music cover image generation services do not analyze tracks themselves; however, some services mostly consider only genre tags. To generate music covers as vector images that reflect the music and consist of simple geometric objects, we suggest a GAN-based algorithm called CoverGAN. The assessment of resulting images is based on their correspondence to the music compared with AttnGAN and DALL-E text-to-image generation according to title or lyrics. Moreover, the significance of the patterns found by CoverGAN has been evaluated in terms of the correspondence of the generated cover images to the musical tracks. Listeners evaluate the music covers generated by the proposed algorithm as quite satisfactory and corresponding to the tracks. Music cover images generation code and demo are available at https://github.com/IzhanVarsky/CoverGAN.


title: Imputations for High Missing Rate Data in Covariates via Semi-supervised Learning Approach

abstract: Advancements in data collection techniques and the heterogeneity of data resources can yield high percentages of missing observations on variables, such as block-wise missing data. Under missing-data scenarios, traditional methods such as the simple average, $k$-nearest neighbor, multiple, and regression imputations may lead to results that are unstable or unable be computed. Motivated by the concept of semi-supervised learning (see, e.g., Zhu and Goldberg, 2009 and Chapelle et al., 2010), we propose a novel approach with which to fill in missing values in covariates that have high missing rates. Specifically, we consider the missing and non-missing subjects in any covariate as the unlabelled and labelled target outputs, respectively, and treat their corresponding responses as the unlabelled and labelled inputs. This innovative setting allows us to impute a large number of missing data without imposing any model assumptions. In addition, the resulting imputation has a closed form for continuous covariates, and it can be calculated efficiently. An analogous procedure is applicable for discrete covariates. We further employ the nonparametric techniques to show the theoretical properties of imputed covariates. Simulation studies and an online consumer finance example are presented to illustrate the usefulness of the proposed method.


title: TiBERT: Tibetan Pre-trained Language Model

abstract: The pre-trained language model is trained on large-scale unlabeled text and can achieve state-of-the-art results in many different downstream tasks. However, the current pre-trained language model is mainly concentrated in the Chinese and English fields. For low resource language such as Tibetan, there is lack of a monolingual pre-trained model. To promote the development of Tibetan natural language processing tasks, this paper collects the large-scale training data from Tibetan websites and constructs a vocabulary that can cover 99.95$\%$ of the words in the corpus by using Sentencepiece. Then, we train the Tibetan monolingual pre-trained language model named TiBERT on the data and vocabulary. Finally, we apply TiBERT to the downstream tasks of text classification and question generation, and compare it with classic models and multilingual pre-trained models, the experimental results show that TiBERT can achieve the best performance. Our model is published in http://tibert.cmli-nlp.com/


title: Chirality of Gravitational Waves in Chern-Simons $f(R)$ Gravity Cosmology

abstract: In this paper we shall consider an axionic Chern-Simons corrected $f(R)$ gravity theoretical framework, and we shall study the chirality of the generated primordial gravitational waves. Particularly, we shall consider two main axion models, the canonical misalignment axion model and the kinetic axion model, both of which provide an interesting particle phenomenology, in the presence of $R^2$ terms in the inflationary Lagrangian. The axion does not affect significantly the background evolution during the inflationary era, which is solely controlled by $R^2$ gravity. However, the due to the presence of the Chern-Simons term, the tensor perturbations are directly affected, and our aim is to reveal the extent of effects of the Chern-Simons term on the gravitational waves modes, for both the axion models. We aim to produce analytical descriptions of the primordial tensor modes behavior, and thus we solve analytically the evolution equations of the tensor modes, for a nearly de Sitter primordial evolution controlled by the $R^2$ gravity. We focus the analytical study on superhorizon and subhorizon modes. For the misalignment model, we were able to produce analytic solutions for both the subhorizon and superhorizon modes, in which case we found the behavior of the circular polarization function. Our results indicate that the produced tensor spectrum is strongly chiral. For the kinetic axion model though, analytic solutions are obtained only for the superhorizon modes. In order to have a grasp of the behavior of the chirality of the tensor modes, we studied the chirality of the superhorizon modes, however a more complete study is needed, which is impossible to do analytically though.


title: Gravitational Faraday effect from on-shell amplitudes

abstract: Effects of massive object's spin on massive-massless $2 \to 2$ classical scattering is studied. Focus is set on the less-considered dimensionless expansion parameter $\lambda/b$, where $\lambda$ is the massless particle's wavelength and $b$ is the impact parameter. Corrections in $\lambda/b$ start to appear from $\mathcal{O}(G^2)$, with leading correction terms tied to the gravitational Faraday effect, which is a special case of the Lense-Thirring effect. We compute the eikonal phase up to $\mathcal{O}(G^2)$ and extract spin effect on the scattering angle and time delay up to 14th order in spin. The gravitational Faraday effect at linear order in spin is reproduced by $\lambda/b$ correction terms, which we compute to higher orders in spin. We find that the equivalence principle, or universality, holds up to NLO for general spinning bodies, i.e. away from geometric optics limit. Furthermore, in the black hole limit, we confirm the absence of particular spin structure observed, along with the associated shift symmetry, and argue that it holds to arbitrary spin order at $\mathcal{O}(G^2)$ in the massless probe limit.


title: A Schwarz lemma for the pentablock

abstract: In this paper we prove a Schwarz lemma for the pentablock. The set \[ \mathcal{P}=\{(a_{21}, \text{tr} \ A, \det A) : A=[a_{ij}]_{i,j=1}^2 \in \mathbb{B}^{2\times 2}\} \] where $\mathbb{B}^{2\times 2}$ denotes the open unit ball in the space of $2\times 2$ complex matrices, is called the pentablock. The pentablock is a bounded nonconvex domain in $\Bbb{C}^3$ which arises naturally in connection with a certain problem of $\mu$-synthesis. We develop a concrete structure theory for the rational maps from the unit disc $\Bbb{D}$ to the closed pentablock $\overline{\mathcal{P}}$ that map the unit circle ${\mathbb{T}}$ to the distinguished boundary $b\overline{\mathcal{P}}$ of $\overline{\mathcal{P}}$. Such maps are called rational ${\overline{\mathcal{P}}}$-inner functions. We give relations between penta-inner functions and inner functions from $\Bbb{D}$ to the symmetrized bidisc. We describe the construction of rational penta-inner functions $x = (a, s, p) : \Bbb{D} \rightarrow \overline{\mathcal{P}}$ of prescribed degree from the zeroes of $a, s$ and $s^2-4p$. The proof of this theorem is constructive: it gives an algorithm for the construction of a family of such functions $x$ subject to the computation of Fej\'er-Riesz factorizations of certain non-negative trigonometric functions on the circle. We use properties and the construction of rational ${\overline{\mathcal{P}}}$-inner functions to prove a Schwarz lemma for the pentablock.


title: Optimization of Decision Tree Evaluation Using SIMD Instructions

abstract: Decision forest (decision tree ensemble) is one of the most popular machine learning algorithms. To use large models on big data, like document scoring with learning-to-rank models, we need to evaluate these models efficiently. In this paper, we explore MatrixNet, the ancestor of the popular CatBoost library. Both libraries use the SSE instruction set for scoring on CPU. This paper investigates the opportunities given by the AVX instruction set to evaluate models more efficiently. We achieved 35% speedup on the binarization stage (nodes conditions comparison), and 20% speedup on the trees apply stage on the ranking model.


title: Finding Global Homophily in Graph Neural Networks When Meeting Heterophily

abstract: We investigate graph neural networks on graphs with heterophily. Some existing methods amplify a node's neighborhood with multi-hop neighbors to include more nodes with homophily. However, it is a significant challenge to set personalized neighborhood sizes for different nodes. Further, for other homophilous nodes excluded in the neighborhood, they are ignored for information aggregation. To address these problems, we propose two models GloGNN and GloGNN++, which generate a node's embedding by aggregating information from global nodes in the graph. In each layer, both models learn a coefficient matrix to capture the correlations between nodes, based on which neighborhood aggregation is performed. The coefficient matrix allows signed values and is derived from an optimization problem that has a closed-form solution. We further accelerate neighborhood aggregation and derive a linear time complexity. We theoretically explain the models' effectiveness by proving that both the coefficient matrix and the generated node embedding matrix have the desired grouping effect. We conduct extensive experiments to compare our models against 11 other competitors on 15 benchmark datasets in a wide range of domains, scales and graph heterophilies. Experimental results show that our methods achieve superior performance and are also very efficient.


title: 3DLinker: An E(3) Equivariant Variational Autoencoder for Molecular Linker Design

abstract: Deep learning has achieved tremendous success in designing novel chemical compounds with desirable pharmaceutical properties. In this work, we focus on a new type of drug design problem -- generating a small "linker" to physically attach two independent molecules with their distinct functions. The main computational challenges include: 1) the generation of linkers is conditional on the two given molecules, in contrast to generating full molecules from scratch in previous works; 2) linkers heavily depend on the anchor atoms of the two molecules to be connected, which are not known beforehand; 3) 3D structures and orientations of the molecules need to be considered to avoid atom clashes, for which equivariance to E(3) group are necessary. To address these problems, we propose a conditional generative model, named 3DLinker, which is able to predict anchor atoms and jointly generate linker graphs and their 3D structures based on an E(3) equivariant graph variational autoencoder. So far as we know, there are no previous models that could achieve this task. We compare our model with multiple conditional generative models modified from other molecular design tasks and find that our model has a significantly higher rate in recovering molecular graphs, and more importantly, accurately predicting the 3D coordinates of all the atoms.


title: Uncertainty estimation for Cross-dataset performance in Trajectory prediction

abstract: While a lot of work has been carried on developing trajectory prediction methods, and various datasets have been proposed for benchmarking this task, little study has been done so far on the generalizability and the transferability of these methods across dataset. In this paper, we observe the performance of two of the latest state-of-the-art trajectory prediction methods across four different datasets (Argoverse, NuScenes, Interaction, Shifts). This analysis allows to gain some insights on the generalizability proprieties of most recent trajectory prediction models and to analyze which dataset is more representative of real driving scenes and therefore enables better transferability. Furthermore we present a novel method to estimate prediction uncertainty and show how it could be used to achieve better performance across datasets.


title: COIN: Communication-Aware In-Memory Acceleration for Graph Convolutional Networks

abstract: Graph convolutional networks (GCNs) have shown remarkable learning capabilities when processing graph-structured data found inherently in many application areas. GCNs distribute the outputs of neural networks embedded in each vertex over multiple iterations to take advantage of the relations captured by the underlying graphs. Consequently, they incur a significant amount of computation and irregular communication overheads, which call for GCN-specific hardware accelerators. To this end, this paper presents a communication-aware in-memory computing architecture (COIN) for GCN hardware acceleration. Besides accelerating the computation using custom compute elements (CE) and in-memory computing, COIN aims at minimizing the intra- and inter-CE communication in GCN operations to optimize the performance and energy efficiency. Experimental evaluations with widely used datasets show up to 105x improvement in energy consumption compared to state-of-the-art GCN accelerator.


title: Scaling limit for a second-order particle system with local annihilation

abstract: For a second-order particle system in $\mathbb R^d$ subject to locally-in-space pairwise annihilation, we prove a scaling limit for its empirical measure on position and velocity towards a degenerate elliptic partial differential equation. Crucial ingredients are Green's function estimates for the associated hypoelliptic operator and an It\^o-Tanaka trick.


title: Generalization Bounds on Multi-Kernel Learning with Mixed Datasets

abstract: This paper presents novel generalization bounds for the multi-kernel learning problem. Motivated by applications in sensor networks and spatial-temporal models, we assume that the dataset is mixed where each sample is taken from a finite pool of Markov chains. Our bounds for learning kernels admit $O(\sqrt{\log m})$ dependency on the number of base kernels and $O(1/\sqrt{n})$ dependency on the number of training samples. However, some $O(1/\sqrt{n})$ terms are added to compensate for the dependency among samples compared with existing generalization bounds for multi-kernel learning with i.i.d. datasets.


title: Dynamic Ready Queue Based Process Priority Scheduling Algorithm

abstract: CPU scheduling is the reason behind the performance of multiprocessing and in time-shared operating systems. Different scheduling criteria are used to evaluate Central Processing Unit Scheduling algorithms which are based on different properties of the system. Round Robin is known to be the most recurrent pre-emptive algorithm used in an environment where processes are allotted a unit of time and multiprocessing operating systems. In this paper, a reformed variation of the Round Robin algorithm has been introduced to minimise the completion time, turnaround time, waiting time and number of context switches that results in the better performance of the system. The proposed work consists of calculation of priority on the basis of the difference between time spent in ready upto the moment and arrival time of the process, to ease up the burden on the ready queue. We have also evaluated the performance of the proposed approach on different datasets and measured the different scheduling criteria.


title: Learn2Weight: Parameter Adaptation against Similar-domain Adversarial Attacks

abstract: Recent work in black-box adversarial attacks for NLP systems has attracted much attention. Prior black-box attacks assume that attackers can observe output labels from target models based on selected inputs. In this work, inspired by adversarial transferability, we propose a new type of black-box NLP adversarial attack that an attacker can choose a similar domain and transfer the adversarial examples to the target domain and cause poor performance in target model. Based on domain adaptation theory, we then propose a defensive strategy, called Learn2Weight, which trains to predict the weight adjustments for a target model in order to defend against an attack of similar-domain adversarial examples. Using Amazon multi-domain sentiment classification datasets, we empirically show that Learn2Weight is effective against the attack compared to standard black-box defense methods such as adversarial training and defensive distillation. This work contributes to the growing literature on machine learning safety.


title: A tower of hidden sectors: a general treatment and physics implications

abstract: An analysis of a tower of hidden sectors coupled to each other, with one of these hidden sectors coupled to the visible sector, is given and the implications of such couplings on physics in the visible sector are investigated. Thus the analysis considers $n$ number of hidden sectors where the visible sector couples only to hidden sector 1, while the latter couples also to hidden sector 2, and the hidden sector 2 couples to hidden sector 3 and so on. A set of successively feeble couplings of the hidden sectors to the visible sector are generated in such a set up. In general each of these sectors live in a different heat bath. We develop a closed form set of coupled Boltzmann equations for the correlated evolution of the temperatures and number densities of each of the heat baths. We then apply the formalism to a simplified model with scalar portals between the different sectors. Predictions related to dark matter direct detection experiments and future CMB probes of dark radiation are made.


title: The domino problem of the hyperbolic plane is undecidable, new proof

abstract: The present paper is a new version of the arXiv paper revisiting the proof given in a previous paper of the author published in 2008 proving that the general tiling problem of the hyperbolic plane is undecidable by proving a slightly stronger version using only a regular polygon as the basic shape of the tiles. The problem was raised by a paper of Raphael Robinson in 1971, in his famous simplified proof that the general tiling problem is undecidable for the Euclidean plane, initially proved by Robert Berger in 1966. The present construction improves that of the recent arXiv paper. It also strongly reduces the number of prototiles.


title: Selected problems in probability theory

abstract: This celebratory article contains a personal and idiosyncratic selection of a few open problems in discrete probability theory. These include certain well known questions concerning Lorentz scatterers and self-avoiding walks, and also some problems of percolation-type. The author hopes the reader will find something to leaven winter evenings, and perhaps even a project for the longer term.


title: cMelGAN: An Efficient Conditional Generative Model Based on Mel Spectrograms

abstract: Analysing music in the field of machine learning is a very difficult problem with numerous constraints to consider. The nature of audio data, with its very high dimensionality and widely varying scales of structure, is one of the primary reasons why it is so difficult to model. There are many applications of machine learning in music, like the classifying the mood of a piece of music, conditional music generation, or popularity prediction. The goal for this project was to develop a genre-conditional generative model of music based on Mel spectrograms and evaluate its performance by comparing it to existing generative music models that use note-based representations. We initially implemented an autoregressive, RNN-based generative model called MelNet . However, due to its slow speed and low fidelity output, we decided to create a new, fully convolutional architecture that is based on the MelGAN [4] and conditional GAN architectures, called cMelGAN.