title: A Tale of Two Efficient and Informative Negative Sampling Distributions

abstract: Softmax classifiers with a very large number of classes naturally occur in many applications such as natural language processing and information retrieval. The calculation of full softmax is costly from the computational and energy perspective. There have been various sampling approaches to overcome this challenge, popularly known as negative sampling (NS). Ideally, NS should sample negative classes from a distribution that is dependent on the input data, the current parameters, and the correct positive class. Unfortunately, due to the dynamically updated parameters and data samples, there is no sampling scheme that is provably adaptive and samples the negative classes efficiently. Therefore, alternative heuristics like random sampling, static frequency-based sampling, or learning-based biased sampling, which primarily trade either the sampling cost or the adaptivity of samples per iteration are adopted. In this paper, we show two classes of distributions where the sampling scheme is truly adaptive and provably generates negative samples in near-constant time. Our implementation in C++ on CPU is significantly superior, both in terms of wall-clock time and accuracy, compared to the most optimized TensorFlow implementations of other popular negative sampling approaches on powerful NVIDIA V100 GPU.


title: On the space of Sylvester matrix rank functions

abstract: Given a ring $R$, the notion of Sylvester rank function was conceived within the context of Cohn's classification theory of epic division $R$-rings. In this paper we study and describe the space of Sylvester rank functions on certain families of rings, including Dedekind domains, simple left noetherian rings and skew Laurent polynomial rings $\mathcal{D}[t^{\pm 1};\tau]$ for any division ring $\mathcal{D}$ and any automorphism $\tau$ of $\mathcal{D}$.


title: Self-dual criticality in three-dimensional $\mathbb{Z}_2$ gauge theory with matter

abstract: The simplest topologically ordered phase in 2+1D is the deconfined phase of $Z_2$ gauge theory, realized for example in the toric code. This phase permits a duality that exchanges electric and magnetic excitations (``$e$'' and ``$m$'' particles). Condensing either particle while the other remains gapped yields a phase transition with 3D Ising exponents. More mysterious, however, is the transition out of the deconfined phase when self-duality symmetry is preserved. If this transition is continuous, which has so far been unclear, then it may be the simplest critical point for which we still lack any useful continuum Lagrangian description. This transition also has a soft matter interpretation, as a multicritical point for classical membranes in 3D. We study the self-dual transition with Monte Carlo simulations of the $Z_2$ gauge-Higgs model on cubic lattices of linear size $L\leq 96$. Our results indicate a continuous transition: for example, cumulants show a striking parameter-free scaling collapse. We estimate scaling dimensions by using duality symmetry to distinguish the leading duality-odd/duality-even scaling operators $A$ and $S$. All local operators have large scaling dimensions, making standard techniques for locating the critical point ineffective. We develop an alternative using ``renormalization group trajectories'' of cumulants. We check that two- and three-point functions, and temporal correlators in the Monte-Carlo dynamics, are scale-invariant, with scaling dimensions $x_A$ and $x_S$ and dynamical exponent $z$. We also give a picture for emergence of 1-form symmetries, in some parts of the phase diagram, in terms of ``patching'' of membranes/worldsurfaces. We relate this to the percolation of anyon worldlines in spacetime. Analyzing percolation yields a fourth exponent for the self-dual transition. We propose variations of the model for further investigation.


title: Real-time Webcam Heart-Rate and Variability Estimation with Clean Ground Truth for Evaluation

abstract: Remote photo-plethysmography (rPPG) uses a camera to estimate a person's heart rate (HR). Similar to how heart rate can provide useful information about a person's vital signs, insights about the underlying physio/psychological conditions can be obtained from heart rate variability (HRV). HRV is a measure of the fine fluctuations in the intervals between heart beats. However, this measure requires temporally locating heart beats with a high degree of precision. We introduce a refined and efficient real-time rPPG pipeline with novel filtering and motion suppression that not only estimates heart rates, but also extracts the pulse waveform to time heart beats and measure heart rate variability. This unsupervised method requires no rPPG specific training and is able to operate in real-time. We also introduce a new multi-modal video dataset, VicarPPG 2, specifically designed to evaluate rPPG algorithms on HR and HRV estimation. We validate and study our method under various conditions on a comprehensive range of public and self-recorded datasets, showing state-of-the-art results and providing useful insights into some unique aspects. Lastly, we make available CleanerPPG, a collection of human-verified ground truth peak/heart-beat annotations for existing rPPG datasets. These verified annotations should make future evaluations and benchmarking of rPPG algorithms more accurate, standardized and fair.


title: Exploring charm decays with missing energy in leptoquark models

abstract: We investigate the possibility that scalar leptoquarks generate consequential effects on the flavor-changing neutral-current decays of charmed hadrons into final states with missing energy ($\not\!\!E$) carried away by either standard model or sterile neutrinos. We focus on scenarios involving the $R_2$, $\tilde R_2$, and $\bar S_1$ leptoquarks and take into account various pertinent constraints, learning that meson-mixing ones and those inferred from collider searches can be of significance. We find in particular that the branching fractions of charmed meson decays $D\to M\!\not\!\!E$, $M=\pi,\rho$, and $D_s\to K^{(*)}\!\not\!\!E$ and singly charmed baryon decays $\Lambda_c^+\to p\!\not\!\!E$ and $\Xi_c\to\Sigma\!\not\!\!E$ are presently allowed to attain the $10^{-7}$-$10^{-6}$ levels if induced by $R_2$ and that the impact of $\tilde R_2$ is comparatively much less. In contrast, the contributions of $\bar S_1$, which couples to right-handed up-type quarks and the sterile neutrinos, could lead to branching fractions as high as order $10^{-3}$. This suggests that these charmed hadron decays might be within reach of the BESIII and Belle II experiments or future super charm-tau factories and could serve as potentially promising probes of leptoquark interactions with sterile neutrinos.


title: Global weak solutions of the Navier-Stokes equations for intermittent initial data in half-space

abstract: We prove existence of global-in-time weak solutions of the incompressible Navier-Stokes equations in the half-space $\mathbb{R}^3_+$ with initial data in a weighted space that allow non-uniformly locally square integrable functions that grow at spatial infinity in an intermittent sense. The space for initial data is built on cubes whose sides $R$ are proportional to the distance to the origin and the square integral of the data is allowed to grow as a power of $R$. The existence is obtained via a new a priori estimate and stability result in the weighted space, as well as new pressure estimates. Also, we prove eventual regularity of such weak solutions, up to the boundary, for $(x,t)$ satisfying $t>c_1|x|^2 + c_2$, where $c_1,c_2>0$, for a large class of initial data $u_0$, with $c_1$ arbitrarily small. As an application of the existence theorem, we construct global discretely self-similar solutions, thus extending the theory on the half-space to the same generality as the whole space.


title: The EFT-Hedron

abstract: We re-examine the constraints imposed by causality and unitarity on the low-energy effective field theory expansion of four-particle scattering amplitudes, exposing a hidden "totally positive" structure strikingly similar to the positive geometries associated with grassmannians and amplituhedra. This forces the infinite tower of higher-dimension operators to lie inside a new geometry we call the "EFThedron". We initiate a systematic investigation of the boundary structure of the EFThedron, giving infinitely many linear and non-linear inequalities that must be satisfied by the EFT expansion in any theory. We illustrate the EFThedron geometry and constraints in a wide variety of examples, including new consistency conditions on the scattering amplitudes of photons and gravitons in the real world.


title: Synthesizing Optical Spectra using Computer-Generated Holography Techniques

abstract: Experimental control and detection of atoms and molecules often rely on optical transitions between different electronic states. In many cases, substructure such as hyperfine or spin-rotation structure leads to the need for multiple optical frequencies spaced by MHz to GHz. The task of creating multiple optical frequencies -- optical spectral engineering -- becomes challenging when the number of frequencies becomes large, a situation that one could encounter in complex molecules and atoms in large magnetic fields. In this work, we present a novel method to synthesize arbitrary optical spectra by modulating a monochromatic light field with a time-dependent phase generated through computer-generated holography techniques. Our method is compatible with non-linear optical processes such as sum frequency generation and second harmonic generation. Additional requirements that arise from the finite lifetimes of excited states can also be satisfied in our approach. As a proof-of-principle demonstration, we generate spectra suitable for cycling photons on the X-B transition in CaF, and verify via Optical Bloch Equation simulations that one can achieve high photon scattering rates, which are important for fluorescent detection and laser cooling. Our method could offer significant simplifications in future experiments that would otherwise be prohibitively complex.


title: On the critical-subcritical moments of moments of random characteristic polynomials: a GMC perspective

abstract: We study the 'critical moments' of subcritical Gaussian multiplicative chaos (GMCs) in dimensions $d \leq 2$. In particular, we establish a fully explicit formula for the leading order asymptotics, which is closely related to large deviation results for GMCs and demonstrates a similar universality feature. We conjecture that our result correctly describes the behaviour of analogous moments of moments of random matrices, or more generally structures which are asymptotically Gaussian and log-correlated in the entire mesoscopic scale. This is verified for an integer case in the setting of circular unitary ensemble, extending and strengthening the results of Claeys et al. and Fahs to higher-order moments.


title: Thermodynamic instability of splitting thin shell solutions in braneworld Einstein-Gauss-Bonnet gravity

abstract: The thermodynamic stability of braneworld cosmological solutions in five-dimensional Einstein-Gauss-Bonnet gravity is addressed, particularly in the context of the splitting vacuum thin shells in which the shells represent either an ephemeral or a branch-changing false vacuum bubble spontaneously emerging from the braneworld and there is more than one possible solution for the same distributional initial data set. The free energy associated with the competing solutions is computed. It is shown that the criterion to decide which solution is preferred coincides with the criterion of the possibility of having a splitting solution. This result suggests an equivalence between a thermodynamic and a dynamic selection criteria among possible classical solutions that deserve further consideration.


title: Exploration of Voice User Interfaces for Older Adults - A Pilot Study to Address Progressive Vision Loss

abstract: Voice User Interfaces (VUIs) owing to recent developments in Artificial Intelligence (AI) and Natural Language Processing (NLP), are becoming increasingly intuitive and functional. They are especially promising for older adults, also with special needs, as VUIs remove some barriers related to access to Information and Communications Technology (ICT) solutions. In this pilot study we examine interdisciplinary opportunities in the area of VUIs as assistive technologies, based on an exploratory study with older adults, and a follow-up in-depth pilot study with two participants regarding the needs of people who are gradually losing their sight at a later age.


title: Uncovering the invariant structural organization of the human connectome

abstract: In order to understand the complex cognitive functions of the human brain, it is essential to study the structural connectome, i.e., the wiring of different brain regions to each other through axonal pathways. However, the high degree of plasticity and cross-population variability in human brains makes it difficult to relate structure to function, motivating a search for invariant patterns in the connectivity. At the same time, variability within a population can provide information about generative mechanisms. In this paper we analyze the connection topology and link-weight distribution of human structural connectomes obtained from a database comprising 196 subjects. By demonstrating a correspondence between the occurrence frequency of individual links and their average weight across the population, we show that the process by which the brain is wired is not independent of the process by which the link weights of the connectome are determined. Furthermore, using the specific distribution of the weights associated with each link over the entire population, we show that a single parameter that is specific to a link can account for its frequency of occurrence, as well as, the variation in its weight across different subjects. This parameter provides a basis for ``rescaling'' the link weights in each connectome, allowing us to obtain a generic network representative of the human brain, distinct from a simple average over the connectomes. We obtain functional connectomes by implementing a neural mass model on each of the vertices of the corresponding structural connectomes. By comparing with the empirical functional brain networks, we demonstrate that the rescaling procedure yields a closer structure-function correspondence. Finally, we show that the representative network can be decomposed into a basal component that is stable across the population and a highly variable superstructure.


title: Hexagon Bootstrap in the Double Scaling Limit

abstract: We study the six-particle amplitude in planar $\mathcal{N} = 4$ super Yang-Mills theory in the double scaling (DS) limit, the only nontrivial codimension-one boundary of its positive kinematic region. We construct the relevant function space, which is significantly constrained due to the extended Steinmann relations, up to weight 13 in coproduct form, and up to weight 12 as an explicit polylogarithmic representation. Expanding the latter in the collinear boundary of the DS limit, and using the Pentagon Operator Product Expansion, we compute the non-divergent coefficient of a certain component of the Next-to-Maximally-Helicity-Violating amplitude through weight 12 and eight loops. We also specialize our results to the overlapping origin limit, observing a general pattern for its leading divergences.


title: Studying Strategically: Learning to Mask for Closed-book QA

abstract: Closed-book question-answering (QA) is a challenging task that requires a model to directly answer questions without access to external knowledge. It has been shown that directly fine-tuning pre-trained language models with (question, answer) examples yields surprisingly competitive performance, which is further improved upon through adding an intermediate pre-training stage between general pre-training and fine-tuning. Prior work used a heuristic during this intermediate stage, whereby named entities and dates are masked, and the model is trained to recover these tokens. In this paper, we aim to learn the optimal masking strategy for the intermediate pre-training stage. We first train our masking policy to extract spans that are likely to be tested, using supervision from the downstream task itself, then deploy the learned policy during intermediate pre-training. Thus, our policy packs task-relevant knowledge into the parameters of a language model. Our approach is particularly effective on TriviaQA, outperforming strong heuristics when used to pre-train BART.


title: A Large-$N$ Phase Transition in a Finite Lattice Gauge Theory

abstract: We consider gauge theories of non-Abelian $finite$ groups, and discuss the 1+1 dimensional lattice gauge theory of the permutation group $S_N$ as an illustrative example. The partition function at finite $N$ can be written explicitly in a compact form using properties of $S_N$ conjugacy classes. A natural large-$N$ limit exists with a new 't Hooft coupling, $\lambda=g^2 \log N$. We identify a Gross-Witten-Wadia-like phase transition at infinite $N$, at $\lambda=2$. It is first order. An analogue of the string tension can be computed from the Wilson loop expectation value, and it jumps from zero to a finite value. We view this as a type of large-$N$ (de-)confinement transition. Our holographic motivations for considering such theories are briefly discussed.


title: Room-temperature superconductivity in an artificial 2D Mott-insulating square lattice and its advanced condensed phase that generates a low-loss current in the atmosphere: A possible perpetual motion machine

abstract: A 2D metallic phononic crystal (PnC), which is fabricated by drilling periodic holes in a suspended niobium (Nb) film, is repeatedly cooled and warmed in the temperature range of 2--300 K. During the first five temperature cycles, the resistance of the metallic PnC gradually increases in accordance with the Friedel sum rule, indicating that narrow Nb bridges between adjacent thru-holes are converted into $d$-orbital-filled Mott insulators. The consequent 2D Mott-insulating square lattice is a crystallographic analog of a copper oxide layer in high-temperature superconductors such as YBCO and BSCCO. Subsequent temperature cycles of the thus produced ideal Hubbard crystal realize zero resistance at 60 K, and the zero-resistance state remains up to 300 K, being retained in the atmosphere (i.e., at room temperature, in a terrestrial magnetic field, and under atmospheric pressure). The necessity of the latter temperature cycles remains unclear in this study; however, a possible transition mechanism involving the combined Josephson and charging effects is discussed. The critical current and critical field of the room-temperature superconductor (RTSC) are $I_{C}$ = 18.8 mA and $\mu_{0}H_{\perp}$ = 12 T, respectively. Once a large current exceeding $I_{C}$ is applied to the RTSC, some of the $d$ electrons are forced out, and a special interface consisting of the p-type semiconducting and superconducting states is formed. Carriers diffuse because of the nonequilibrium charge concentration, but they are Andreev-reflected back. In the reversible, thermally isolated system, the entropy never increases, and a simple experiment confirms a low-loss current generated from the interface spontaneously. That is, this study challenges the forbidden perpetual motion machine which can be a solution to the World energy crisis.


title: Intrinsic Bias Metrics Do Not Correlate with Application Bias

abstract: Natural Language Processing (NLP) systems learn harmful societal biases that cause them to amplify inequality as they are deployed in more and more situations. To guide efforts at debiasing these systems, the NLP community relies on a variety of metrics that quantify bias in models. Some of these metrics are intrinsic, measuring bias in word embedding spaces, and some are extrinsic, measuring bias in downstream tasks that the word embeddings enable. Do these intrinsic and extrinsic metrics correlate with each other? We compare intrinsic and extrinsic metrics across hundreds of trained models covering different tasks and experimental conditions. Our results show no reliable correlation between these metrics that holds in all scenarios across tasks and languages. We urge researchers working on debiasing to focus on extrinsic measures of bias, and to make using these measures more feasible via creation of new challenge sets and annotated test data. To aid this effort, we release code, a new intrinsic metric, and an annotated test set focused on gender bias in hate speech.


title: Ultra Unification

abstract: Strong, electromagnetic, and weak forces were unified in the Standard Model (SM) with spontaneous gauge symmetry breaking. These forces were further conjectured to be unified in a simple Lie group gauge interaction in the Grand Unification (GUT). In this work, we propose a theory beyond the SM and GUT by adding new gapped Topological Phase Sectors consistent with the nonperturbative global anomaly cancellation and cobordism constraints (especially from the baryon minus lepton number ${\bf B}-{\bf L}$, the electroweak hypercharge $Y$, and the mixed gauge-gravitational anomaly). Gapped Topological Phase Sectors are constructed via symmetry extension, whose low energy contains unitary Lorentz invariant topological quantum field theories (TQFTs): either 3+1d non-invertible TQFT, or 4+1d invertible or non-invertible TQFT (short-range or long-range entangled gapped phase). Alternatively, there could also be right-handed "sterile" neutrinos, gapless unparticle physics, more general interacting conformal field theories, or gravity with topological cobordism constraints, or their combinations to altogether cancel the mixed gauge-gravitational anomaly. We propose that a new high-energy physics frontier beyond the conventional 0d particle physics relies on the new Topological Force and Topological Matter including gapped extended objects (gapped 1d line and 2d surface operators or defects, etc., whose open ends carry deconfined fractionalized particle or anyonic string excitations) or gapless conformal matter. Physical characterizations of these gapped extended objects require the mathematical theories of cohomology, cobordism, or category. Although weaker than the weak force, Topological Force is infinite-range or long-range which does not decay in the distance, and mediates between the linked worldvolume trajectories via fractional or categorical statistical interactions.


title: Anomalous Symmetries End at the Boundary

abstract: A global symmetry of a quantum field theory is said to have an 't Hooft anomaly if it cannot be promoted to a local symmetry of a gauged theory. In this paper, we show that the anomaly is also an obstruction to defining symmetric boundary conditions. This applies to Lorentz symmetries with gravitational anomalies as well. For theories with perturbative anomalies, we demonstrate the obstruction by analyzing the Wess-Zumino consistency conditions and current Ward identities in the presence of a boundary. We then recast the problem in terms of symmetry defects and find the same conclusions for anomalies of discrete and orientation-reversing global symmetries, up to the conjecture that global gravitational anomalies, which may not be associated with any diffeomorphism symmetry, also forbid the existence of boundary conditions. This conjecture holds for known gravitational anomalies in $D \le 3$ which allows us to conclude the obstruction result for $D \le 4$.


title: Discovery of Electrochemically Induced Grain Boundary Transitions

abstract: Electric fields and currents, which are used in innovative materials processing and electrochemical energy conversion, can often alter microstructures in unexpected ways. However, little is known about the underlying mechanisms. Using ZnO-Bi2O3 as a model system, this study uncovers how an applied electric current can change the microstructural evolution through an electrochemically induced grain boundary (GB) transition. By combining aberration-corrected electron microscopy, photoluminescence spectroscopy, first-principles calculations, a generalizable thermodynamic model, and ab initio molecular dynamics, this study reveals that electrochemical reduction can cause a GB disorder-to-order transition to markedly increase GB diffusivities and mobilities. Consequently, abruptly enhanced or abnormal grain growth takes place. These findings advance our fundamental knowledge of GB complexion (phase-like) transitions and electric field effects on microstructural stability and evolution, with broad scientific and technological impacts. A new method to tailor the GB structures and properties, as well as the microstructures, electrochemically can also be envisioned.


title: Empirically Classifying Network Mechanisms

abstract: Network models are used to study interconnected systems across many physical, biological, and social disciplines. Such models often assume a particular network-generating mechanism, which when fit to data produces estimates of mechanism-specific parameters that describe how systems function. For instance, a social network model might assume new individuals connect to others with probability proportional to their number of pre-existing connections ('preferential attachment'), and then estimate the disparity in interactions between famous and obscure individuals with similar qualifications. However, without a means of testing the relevance of the assumed mechanism, conclusions from such models could be misleading. Here we introduce a simple empirical approach which can mechanistically classify arbitrary network data. Our approach compares empirical networks to model networks from a user-provided candidate set of mechanisms, and classifies each network--with high accuracy--as originating from either one of the mechanisms or none of them. We tested 373 empirical networks against five of the most widely studied network mechanisms and found that most (228) were unlike any of these mechanisms. This raises the possibility that some empirical networks arise from mixtures of mechanisms. We show that mixtures are often unidentifiable because different mixtures can produce functionally equivalent networks. In such systems, which are governed by multiple mechanisms, our approach can still accurately predict out-of-sample functional properties.


title: EC-GAN: Low-Sample Classification using Semi-Supervised Algorithms and GANs

abstract: Semi-supervised learning has been gaining attention as it allows for performing image analysis tasks such as classification with limited labeled data. Some popular algorithms using Generative Adversarial Networks (GANs) for semi-supervised classification share a single architecture for classification and discrimination. However, this may require a model to converge to a separate data distribution for each task, which may reduce overall performance. While progress in semi-supervised learning has been made, less addressed are small-scale, fully-supervised tasks where even unlabeled data is unavailable and unattainable. We therefore, propose a novel GAN model namely External Classifier GAN (EC-GAN), that utilizes GANs and semi-supervised algorithms to improve classification in fully-supervised regimes. Our method leverages a GAN to generate artificial data used to supplement supervised classification. More specifically, we attach an external classifier, hence the name EC-GAN, to the GAN's generator, as opposed to sharing an architecture with the discriminator. Our experiments demonstrate that EC-GAN's performance is comparable to the shared architecture method, far superior to the standard data augmentation and regularization-based approach, and effective on a small, realistic dataset.


title: Etat de l'art sur l'application des bandits multi-bras

abstract: The Multi-armed bandit offer the advantage to learn and exploit the already learnt knowledge at the same time. This capability allows this approach to be applied in different domains, going from clinical trials where the goal is investigating the effects of different experimental treatments while minimizing patient losses, to adaptive routing where the goal is to minimize the delays in a network. This article provides a review of the recent results on applying bandit to real-life scenario and summarize the state of the art for each of these fields. Different techniques has been proposed to solve this problem setting, like epsilon-greedy, Upper confident bound (UCB) and Thompson Sampling (TS). We are showing here how this algorithms were adapted to solve the different problems of exploration exploitation.


abstract: We propose the Automatic-differentiated Physics-Informed Echo State Network (API-ESN). The network is constrained by the physical equations through the reservoir's exact time-derivative, which is computed by automatic differentiation. As compared to the original Physics-Informed Echo State Network, the accuracy of the time-derivative is increased by up to seven orders of magnitude. This increased accuracy is key in chaotic dynamical systems, where errors grows exponentially in time. The network is showcased in the reconstruction of unmeasured (hidden) states of a chaotic system. The API-ESN eliminates a source of error, which is present in existing physics-informed echo state networks, in the computation of the time-derivative. This opens up new possibilities for an accurate reconstruction of chaotic dynamical states.


title: Yet another argument in favour of NP=CoNP

abstract: This article shows yet another proof of NP=CoNP$. In a previous article, we proved that NP=PSPACE and from it we can conclude that NP=CoNP immediately. The former proof shows how to obtain polynomial and, polynomial in time checkable Dag-like proofs for all purely implicational Minimal logic tautologies. From the fact that Minimal implicational logic is PSPACE-complete we get the proof that NP=PSPACE. This first proof of NP=CoNP uses Hudelmaier linear upper-bound on the height of Sequent Calculus minimal implicational logic proofs. In an addendum to the proof of NP=PSPACE, we observe that we do not need to use Hudelmaier upper-bound since any proof of non-hamiltonicity for any graph is linear upper-bounded. By the CoNP-completeness of non-hamiltonicity, we obtain NP=CoNP as a corollary of the first proof. In this article we show the third proof of CoNP=NP, also providing polynomial size and polynomial verifiable certificates that are Dags. They are generated from normal Natural Deduction proofs, linear height upper-bounded too, by removing redundancy, i.e., repeated parts. The existence of repeated parts is a consequence of the redundancy theorem for a family of super-polynomial proofs in the purely implicational Minimal logic. It is mandatory to read at least two previous articles to get the details of the proof presented here. The article that proves the redundancy theorem and the article that shows how to remove the repeated parts of a normal Natural Deduction proof to have a polynomial Dag certificate for minimal implicational logic tautologies.


title: Deep Unsupervised Identification of Selected SNPs between Adapted Populations on Pool-seq Data

abstract: The exploration of selected single nucleotide polymorphisms (SNPs) to identify genetic diversity between different sequencing population pools (Pool-seq) is a fundamental task in genetic research. As underlying sequence reads and their alignment are error-prone and univariate statistical solutions only take individual positions of the genome into account, the identification of selected SNPs remains a challenging process. Deep learning models like convolutional neural networks (CNNs) are able to consider large input areas in their decisions. We suggest an unsupervised pipeline to be independent of a rarely known ground truth. We train a supervised discriminator CNN to distinguish alignments from different populations and utilize the model for unsupervised SNP calling by applying explainable artificial intelligence methods. Our proposed multivariate method is based on two main assumptions: We assume (i) that instances having a high predictive certainty of being distinguishable are likely to contain genetic variants, and (ii) that selected SNPs are located at regions with input features having the highest influence on the model's decision process. We directly compare our method with statistical results on two different Pool-seq datasets and show that our solution is able to extend statistical results.


title: Mixed Neumann-Fourier expressions for solving integral equations

abstract: While teaching a course on integral equations, I noticed that a straightforward combination of Neumann series and Fourier series for the resolvent (or the solution) of an integral equation has good approximation qualities. This short article presents and investigates this combination of approximating series.


title: Periodic orbit evaluation of a spectral statistic of quantum graphs without the semiclassical limit

abstract: Energy level statistics of quantized chaotic systems have been evaluated in the semiclassical limit via their periodic orbits using the Gutzwiller and related trace formulae. Here we evaluate a spectral statistic of chaotic 4-regular quantum graphs from their periodic orbits without the semiclassical limit. The variance of the n-th coefficient of the characteristic polynomial is determined by the sizes of the sets of distinct primitive periodic orbits with n bonds which have no self-intersections, and the sizes of the sets with a given number of self-intersections which all consist of two sections of the pseudo orbit crossing at a single vertex. Using this result we observe the mechanism that connects semiclassical results to the total number of orbits regardless of their structure.


title: SEH: Size Estimate Hedging for Single-Server Queues

abstract: For a single server system, Shortest Remaining Processing Time (SRPT) is an optimal size-based policy. In this paper, we discuss scheduling a single-server system when exact information about the jobs' processing times is not available. When the SRPT policy uses estimated processing times, the underestimation of large jobs can significantly degrade performance. We propose a simple heuristic, Size Estimate Hedging (SEH), that only uses estimated processing times for scheduling decisions. A job's priority is increased dynamically according to an SRPT rule until it is determined that it is underestimated, at which time the priority is frozen. Numerical results suggest that SEH has desirable performance for estimation error variance that is consistent with what is seen in practice.


title: Explainability Matters: Backdoor Attacks on Medical Imaging

abstract: Deep neural networks have been shown to be vulnerable to backdoor attacks, which could be easily introduced to the training set prior to model training. Recent work has focused on investigating backdoor attacks on natural images or toy datasets. Consequently, the exact impact of backdoors is not yet fully understood in complex real-world applications, such as in medical imaging where misdiagnosis can be very costly. In this paper, we explore the impact of backdoor attacks on a multi-label disease classification task using chest radiography, with the assumption that the attacker can manipulate the training dataset to execute the attack. Extensive evaluation of a state-of-the-art architecture demonstrates that by introducing images with few-pixel perturbations into the training set, an attacker can execute the backdoor successfully without having to be involved with the training procedure. A simple 3$\times$3 pixel trigger can achieve up to 1.00 Area Under the Receiver Operating Characteristic (AUROC) curve on the set of infected images. In the set of clean images, the backdoored neural network could still achieve up to 0.85 AUROC, highlighting the stealthiness of the attack. As the use of deep learning based diagnostic systems proliferates in clinical practice, we also show how explainability is indispensable in this context, as it can identify spatially localized backdoors in inference time.


title: Adversarial Estimation of Riesz Representers

abstract: Many causal parameters are linear functionals of an underlying regression. The Riesz representer is a key component in the asymptotic variance of a semiparametrically estimated linear functional. We propose an adversarial framework to estimate the Riesz representer using general function spaces. We prove a nonasymptotic mean square rate in terms of an abstract quantity called the critical radius, then specialize it for neural networks, random forests, and reproducing kernel Hilbert spaces as leading cases. Our estimators are highly compatible with targeted and debiased machine learning with sample splitting; our guarantees directly verify general conditions for inference that allow mis-specification. We also use our guarantees to prove inference without sample splitting, based on stability or complexity. Our estimators achieve nominal coverage in highly nonlinear simulations where some previous methods break down. They shed new light on the heterogeneous effects of matching grants.


title: UnNatural Language Inference

abstract: Recent investigations into the inner-workings of state-of-the-art large-scale pre-trained Transformer-based Natural Language Understanding (NLU) models indicate that they appear to know humanlike syntax, at least to some extent. We provide novel evidence that complicates this claim: we find that state-of-the-art Natural Language Inference (NLI) models assign the same labels to permuted examples as they do to the original, i.e. they are largely invariant to random word-order permutations. This behavior notably differs from that of humans; we struggle with ungrammatical sentences. To measure the severity of this issue, we propose a suite of metrics and investigate which properties of particular permutations lead models to be word-order invariant. In the MNLI dataset, for example, we find almost all (98.7%) examples contain at least one permutation which elicits the gold label. Models are sometimes even able to assign gold labels to permutations that they originally failed to predict correctly. We provide a comprehensive empirical evaluation of this phenomenon, and further show that this issue exists for both Transformers and pre-Transformer RNN / ConvNet based encoders, as well as across multiple languages (English and Mandarin Chinese). Our code and data are available at https://github.com/facebookresearch/unlu.


title: Challenges and Advances in Modeling of the Solar Atmosphere: A White Paper of Findings and Recommendations

abstract: The next decade will be an exciting period for solar astrophysics, as new ground- and space-based instrumentation will provide unprecedented observations of the solar atmosphere and heliosphere. The synergy between modeling effort and comprehensive analysis of observations is crucial for the understanding of the physical processes behind the observed phenomena. However, the unprecedented wealth of data on one hand, and the complexity of the physical phenomena on the other, require the development of new approaches in both data analysis and numerical modeling. In this white paper, we summarize recent numerical achievements to reproduce structure, dynamics, and observed phenomena from the photosphere to the low corona and outline challenges we expect to face for the interpretation of future observations.


title: Encoding sinusoidal functions in hybrid automata formalism

abstract: Hybrid systems can express a plethora of physical phenomena and systems as they can combine continuous and discrete dynamics. There exist several tools that enable the reachability analysis of hybrid systems modeled as hybrid automata. However, these tools exhibit certain limitations in the type of mathematical operations that they natively support. For example, SpaceEx, a well-established tool in the hybrid verification community, supports the use of linear ODEs in the flow of each discrete location. Mathematical functions like algebraic equations or trigonometric functions have to be encoded as the solutions of a set of ODEs. In this article, we provide a mechanism to define sinusoidal functions that are supported by SpaceEx. We also show how certain Simulink blocks can be translated into hybrid automata.


title: VLT Spectroscopy of Ultra-Faint Dwarf Galaxies. 1. Bo\"otes I, Leo IV, Leo V

abstract: We perform consistent reductions and measurements for three ultra-faint dwarf galaxies (UFDs): Bo\"otes I, Leo IV and Leo V. Using the public archival data from the GIRAFFE spectrograph on the Very Large Telescope (VLT), we locate new members and provide refined measurements of physical parameters for these dwarf galaxies. We identify nine new Leo IV members and four new Leo V members, and perform a comparative analysis of previously discovered members. Additionally, we identify one new binary star in both Leo IV and Leo V. After removing binary stars, we recalculate the velocity dispersions of Bo\"otes I and Leo IV to be 5.1$^{+0.7}_{-0.8}$ and 3.4$^{+1.3}_{-0.9}$ km s$^{-1}$, respectively; We do not resolve the Leo V velocity dispersion. We identify a weak velocity gradient in Leo V that is $\sim$4$\times$ smaller than the previously calculated gradient and that has a corresponding position angle which differs from the literature value by $\sim$120 deg. Combining the VLT data with previous literature, we re-analyze the Bo\"otes I metallicity distribution function and find that a model including infall of pristine gas while Bo\"otes I was forming stars best fits the data. Our analysis of Leo IV, Leo V and other UFDs will enhance our understanding of these enigmatic stellar populations and contribute to future dark matter studies. This is the first in a series of papers examining thirteen UDFs observed with VLT/GIRAFFE between 2009 and 2017. Similar analyses of the remaining ten UFDs will be presented in forthcoming papers.


title: Bad metallic transport in geometrically frustrated models

abstract: We study the transport properties for a family of geometrically frustrated models on the triangular lattice with an interaction scale far exceeding the single-particle bandwidth. Starting from the interaction-only limit, which can be solved exactly, we analyze the transport and thermodynamic behavior as a function of filling and temperature at the leading non-trivial order in the single-particle hopping. Over a broad range of intermediate temperatures, we find evidence of a dc resistivity scaling linearly with temperature and with typical values far exceeding the quantum of resistance, $h/e^2$. At a sequence of commensurate fillings, the bad-metallic regime eventually crosses over into interaction induced insulating phases in the limit of low temperatures. We discuss the relevance of our results to experiments in cold-atom and moir\'e heterostructure based platforms.


title: Observing a Changing Hilbert-Space Inner Product

abstract: In quantum mechanics, physical states are represented by rays in Hilbert space $\mathscr H$, which is a vector space imbued by an inner product $\langle\,|\,\rangle$, whose physical meaning arises as the overlap $\langle\phi|\psi\rangle$ for $|\psi\rangle$ a pure state (description of preparation) and $\langle\phi|$ a projective measurement. However, current quantum theory does not formally address the consequences of a changing inner product during the interval between preparation and measurement. We establish a theoretical framework for such a changing inner product, which we show is consistent with standard quantum mechanics. Furthermore, we show that this change is described by a quantum channel, which is tomographically observable, and we elucidate how our result is strongly related to the exploding topic of PT-symmetric quantum mechanics. We explain how to realize experimentally a changing inner product for a qubit in terms of a qutrit protocol with a unitary channel.


title: Quantum State Tomography of Four-Level Systems with Noisy Measurements

abstract: In this article, we investigate the problem of state reconstruction of four-level quantum systems. A realistic scenario is considered with measurement results distorted by random unitary operators. Two frames which define injective measurements are applied and compared. By introducing arbitrary rotations, we can test the performance of the framework versus the amount of experimental noise. The results of numerical simulations are depicted on graphs and discussed. In particular, a class of entangled states is reconstructed. The concurrence is used as a figure of merit in order to quantify how well entanglement is preserved through noisy measurements.


title: Large-Charge Limit of AdS Boson Stars with Mixed Boundary Conditions

abstract: It was recently shown that charged AdS boson stars can reproduce the universal structure of the lowest scaling dimension in the subsector of a CFT with fixed large global $U(1)$ charge $Q$. Using the model consisting of Einstein-Maxwell gravity with a negative cosmological constant, coupled to a $U(1)$-charged conformally massless scalar with the fourth-order self interaction, we construct a class of charged AdS boson star solutions in the large $Q$ limit, where the scalar field obeys a mixed boundary condition, parameterized by $k$ that interpolates between the Neumann and Dirichlet boundary conditions corresponding to $k=0$ and $\infty$ respectively. By varying $k$, we numerically read off the $k$ dependence of the leading coefficient $c_{3/2}(k) \equiv \lim_{Q\rightarrow \infty} M/Q^{3/2}$. We find that $c_{3/2}(k)$ is a monotonously increasing function which grows linearly when $k$ is sufficiently small. When $k\rightarrow \infty$, $c_{3/2}(k)$ approaches the maximal value at a decreasing rate given by $k^{-3/2}$ . We also obtain a close form expression that fits the numerical data for the entire range of $k$ within $10^{-4}$ accuracy.


title: How periodic driving stabilises and destabilises Anderson localisation on random trees

abstract: Motivated by the link between Anderson localisation on high-dimensional graphs and many-body localisation, we study the effect of periodic driving on Anderson localisation on random trees. The time dependence is eliminated in favour of an extra dimension, resulting in an extended graph wherein the disorder is correlated along the new dimension. The extra dimension increases the number of paths between any two sites and allows for interference between their amplitudes. We study the localisation problem within the forward scattering approximation (FSA) which we adapt to this extended graph. At low frequency, this favours delocalisation as the availability of a large number of extra paths dominates. By contrast, at high frequency, it stabilises localisation compared to the static system. These lead to a regime of re-entrant localisation in the phase diagram. Analysing the statistics of path amplitudes within the FSA, we provide a detailed theoretical picture of the physical mechanisms governing the phase diagram.

categories: cond-mat.dis-nn cond-mat.quant-gas cond-mat.stat-mech quant-ph


title: BMS algebra from residual gauge invariance in light-cone gravity

abstract: We analyze the residual gauge freedom in gravity, in four dimensions, in the light-cone gauge, in a formulation where unphysical fields are integrated out. By checking the invariance of the light-cone Hamiltonian, we obtain a set of residual gauge transformations, which satisfy the BMS algebra realized on the two physical fields in the theory. Hence, the BMS algebra appears as a consequence of residual gauge invariance in the bulk and not just at the asymptotic boundary. We highlight the key features of the light-cone BMS algebra and discuss its connection with the quadratic form structure of the Hamiltonian.


title: The $\epsilon'/\epsilon$-Story: 1976-2021

abstract: The ratio $\epsilon'/\epsilon$ measures the size of the direct CP violation in $K_L\to\pi\pi$ decays $(\epsilon^\prime)$ relative to the indirect one described by $\epsilon$ and is very sensitive to new sources of CP violation. As such it played a prominent role in particle physics already for 45 years. Due to the smallness of $\epsilon'/\epsilon$ its measurement required heroic efforts in the 1980s and the 1990s on both sides of the Atlantic with final results presented by NA48 and KTeV collaborations 20 years ago. Unfortunately, even 45 years after the first calculation of $\epsilon'/\epsilon$ we do not know to which degree the Standard Model agrees with this data and how large is the room left for new physics contributions to this ratio. This is due to significant non-perturbative (hadronic) uncertainties accompanied by partial cancellation between the QCD penguin contributions and electroweak penguin contributions. While the significant control over the short distance perturbative effects has been achieved already in the early 1990s, with several improvements since then, different views on the non-perturbative contributions to $\epsilon'/\epsilon$ have been expressed by different authors over last thirty years. In fact even today the uncertainty in the room left for NP contributions to $\epsilon'/\epsilon$ is very significant. My own work on $\epsilon'/\epsilon$ started in 1983 and involved both perturbative and non-perturbative calculations. This writing is a non-technical recollection of the steps which led to the present status of $\epsilon'/\epsilon$ including several historical remarks not known to everybody. The present status of the $\Delta I=1/2$ rule is also summarized. This story is dedicated to Jean-Marc Gerard on the occasion of the 35th anniversary of our collaboration and his 64th birthday.


title: $\texttt{RGE++}:$ A $\texttt{C++}$ library to solve renormalisation group equations in quantum field theory

abstract: In recent years three-, four- and five-loop beta functions have been computed for various phenomenologically interesting models. However, most of these results have not been implemented in easy to use software packages. $\texttt{RGE++}$ bridges this gap by providing a flexible, template-based, $\texttt{C++}$ library to solve renormalisation group equations. Furthermore, we implement the available beta functions for the Standard Model, the minimal supersymmetric extension of the Standard Model and two-Higgs-doublet models, as well as right-handed neutrino extensions of the former two.


title: Dynamical Phase Error in Interacting Topological Quantum Memories

abstract: A local Hamiltonian with Topological Quantum Order (TQO) has a robust ground state degeneracy that makes it an excellent quantum memory candidate. This memory can be corrupted however if part of the state leaves the protected ground state manifold and returns later with a dynamically accrued phase error. Here we analyse how TQO suppresses this process and use this to quantify the degree to which spectral densities in different topological sectors are correlated. We provide numerical verification of our results by modelling an interacting p-wave superconducting wire.


title: Bootstrapping BPS spectra of 5d/6d field theories

abstract: We propose a systematic approach to computing the BPS spectra of any 5d/6d supersymmetric quantum field theory in Coulomb phases, which admits either gauge theory descriptions or geometric descriptions, based on the Nakajima-Yoshioka's blowup equations. We provide a significant generalization of the blowup equation approach in terms of both properly quantized magnetic fluxes on the blowup $\hat{\mathbb{C}}^2$ and the effective prepotential for 5d/6d field theories on the Omega background which is uniquely determined by the Chern-Simons couplings on their Coulomb branches. We employ our method to compute BPS spectra of all rank-1 and rank-2 5d Kaluza-Klein (KK) theories descending from 6d $\mathcal{N}=(1,0)$ superconformal field theories (SCFTs) compactified on a circle with/without twist. We also discuss various 5d SCFTs and KK theories of higher ranks, which include a few exotic cases such as new rank-1 and rank-2 5d SCFTs engineered with frozen singularity as well as the 5d $SU(3)_8$ gauge theory currently having neither a brane web nor a smooth shrinkable geometric description. The results serve as non-trivial checks for a large class of non-trivial dualities among 5d theories and also as independent evidences for the existence of certain exotic theories.


title: Islands in Linear Dilaton Black Holes

abstract: We derive a novel four-dimensional black hole with planar horizon that asymptotes to the linear dilaton background. The usual growth of its entanglement entropy before Page's time is established. After that, emergent islands modify to a large extent the entropy, which becomes finite and is saturated by its Bekenstein-Hawking value in accordance with the finiteness of the von Neumann entropy of eternal black holes. We demonstrate that viewed from the string frame, our solution is the two-dimensional Witten black hole with two additional free bosons. We generalize our findings by considering a general class of linear dilaton black hole solutions at a generic point along the $\sigma$-model renormalization group (RG) equations. For those, we observe that the entanglement entropy is "running" i.e. it is changing along the RG flow with respect to the two-dimensional worldsheet length scale. At any fixed moment before Page's time the aforementioned entropy increases towards the infrared (IR) domain, whereas the presence of islands leads the running entropy to decrease towards the IR at later times. Finally, we present a four-dimensional charged black hole that asymptotes to the linear dilaton background as well. We compute the associated entanglement entropy for the extremal case and we find that an island is needed in order for it to follow the Page curve.


title: Consensus with Bounded Space and Minimal Communication

abstract: Population protocols are a fundamental model in distributed computing, where many nodes with bounded memory and computational power have random pairwise interactions over time. This model has been studied in a rich body of literature aiming to understand the tradeoffs between the memory and time needed to perform computational tasks. We study the population protocol model focusing on the communication complexity needed to achieve consensus with high probability. When the number of memory states is $s = O(\log \log{n})$, the best upper bound known was given by a protocol with $O(n \log{n})$ communication, while the best lower bound was $\Omega(n \log(n)/s)$ communication. We design a protocol that shows the lower bound is sharp. When each agent has $s=O(\log{n}^{\theta})$ states of memory, with $\theta \in (0,1/2)$, consensus can be reached in time $O(\log(n))$ with $O(n \log{(n)}/s)$ communications with high probability.


title: Stability analysis on charged black hole with non-linear complex scalar

abstract: It has been shown recently that the charged black hole can be scalarized if Maxwell field minimally couples with a complex scalar which has nonnegative nonlinear potential. We firstly prove that such scalarization cannot be a result of continuous phase transition for general scalar potential. Furthermore, we numerically find that it is possible that the RN black hole will be scalarized by a first order phase transition spontaneously and extreme RN black hole is not stable in micro-canonical ensemble. In addition, considering a massless scalar perturbation, we compute the quasi-normal modes of the scalarized charged black hole and the results imply that the spontaneously scalarized charged black hole is not only favored in thermodynamics but also is kinetically stable against scalar perturbation at linear level. Our numerical results also definitely gives negative answer to Penrose-Gibbons conjecture and two new versions of Penrose inequality in charged case are suggested.


title: The Pile: An 800GB Dataset of Diverse Text for Language Modeling

abstract: Recent work has demonstrated that increased training dataset diversity improves general cross-domain knowledge and downstream generalization capability for large-scale language models. With this in mind, we present \textit{the Pile}: an 825 GiB English text corpus targeted at training large-scale language models. The Pile is constructed from 22 diverse high-quality subsets -- both existing and newly constructed -- many of which derive from academic or professional sources. Our evaluation of the untuned performance of GPT-2 and GPT-3 on the Pile shows that these models struggle on many of its components, such as academic writing. Conversely, models trained on the Pile improve significantly over both Raw CC and CC-100 on all components of the Pile, while improving performance on downstream evaluations. Through an in-depth exploratory analysis, we document potentially concerning aspects of the data for prospective users. We make publicly available the code used in its construction.


title: Hawking Radiation from Universal Horizons

abstract: The persistence of a suitable notion of black hole thermodynamics in Lorentz breaking theories of gravity is not only a non-trivial consistency test for such theories, it is also an interesting investigation {\em per se}, as it might help us identifying the crucial features at the root of these surprising laws governing such purely gravitational objects. In past investigations, controversial findings were presented in this sense. With the aim of settling this issue, we present here two complementary derivations of Hawking radiation in geometries endowed with universal horizons: a novel feature of back holes in Lorentz breaking theories of gravity which reproduces several properties normally characterizing Killing horizons. We find that both the derivations agree on the fact that the Hawking temperature associated to these geometries is set by the generalized universal horizon peeling surface gravity, as required for consistency with extant derivations of the first law of thermodynamics for these black holes. We shall also comment on the compatibility of our results with previous alternative derivations and on their significance for the survival of the generalized second law of black hole thermodynamics in Lorentz breaking theories of gravity.


title: Random Embeddings with Optimal Accuracy

abstract: This work constructs Jonson-Lindenstrauss embeddings with best accuracy, as measured by variance, mean-squared error and exponential concentration of the length distortion. Lower bounds for any data and embedding dimensions are determined, and accompanied by matching and efficiently samplable constructions (built on orthogonal matrices). Novel techniques: a unit sphere parametrization, the use of singular-value latent variables and Schur-convexity are of independent interest.


title: Dynamical quantum Cherenkov transition of fast impurities in quantum liquids

abstract: The challenge of understanding the dynamics of a mobile impurity in an interacting quantum many-body medium comes from the necessity of including entanglement between the impurity and excited states of the environment in a wide range of energy scales. In this paper, we investigate the motion of a finite mass impurity injected into a three-dimensional quantum Bose fluid as it starts shedding Bogoliubov excitations. We uncover a transition in the dynamics as the impurity's velocity crosses a critical value which depends on the strength of the interaction between the impurity and bosons as well as the impurity's recoil energy. We find that in injection experiments, the two regimes differ not only in the character of the impurity velocity abatement, but also exhibit qualitative differences in the Loschmidt echo, density ripples excited in the BEC, and momentum distribution of scattered bosonic particles. The transition is a manifestation of a dynamical quantum Cherenkov effect, and should be experimentally observable with ultracold atoms using Ramsey interferometry, RF spectroscopy, absorption imaging, and time-of-flight imaging.


title: Constructions of Lagrangian cobordisms

abstract: Lagrangian cobordisms between Legendrian knots arise in Symplectic Field Theory and impose an interesting and not well-understood relation on Legendrian knots. There are some known "elementary" building blocks for Lagrangian cobordisms that are smoothly the attachment of $0$- and $1$-handles. An important question is whether every pair of non-empty Legendrians that are related by a connected Lagrangian cobordism can be related by a ribbon Lagrangian cobordism, in particular one that is "decomposable" into a composition of these elementary building blocks. We will describe these and other combinatorial building blocks as well as some geometric methods, involving the theory of satellites, to construct Lagrangian cobordisms. We will then survey some known results, derived through Heegaard Floer Homology and contact surgery, that may provide a pathway to proving the existence of nondecomposable (nonribbon) Lagrangian cobordisms.


title: Physical conditions and redshift evolution of optically thin C III absorbers: Low-z sample

abstract: We present a detailed analysis of 99 optically thin C III absorption systems at redshift, $0.2 \le z \le 0.9$ associated with neutral hydrogen column densities in the range, $15 \le {\rm log}$ $N_{\rm H\,I}$ ($cm^{-2}$) $\le 16.2$. Using photoionization models, we infer the number density ($n_{\rm H}$), C-abundance ($[C/H]$) and line-of-sight thickness ($L$) of these systems in the ranges, $-3.4 \le$ log $n_{\rm H}$ (in $cm^{-3}$) $\le -1.6$, $-1.6 \le [C/H] \le 0.4$, and 1.3 pc $\le L \le$ 10 kpc, respectively with most of the systems having sub-kpc scale thickness. We combine the low$-z$ and previously reported high$-z$ ($2.1\le z\le 3.3$) optically thin C III systems to study the redshift evolution and various correlation between the derived physical parameters. We see a significant redshift evolution in $n_{\rm H}$, $[C/H]$ and $L$. We compare the redshift evolution of metallicity in C III systems with those of various types of absorption systems. We find that the slope of $[C/H]$ vs. $z$ for C III absorbers is stepper compared to the redshift evolution of cosmic metallicity of the damped \lya\ sample (DLAs) but consistent with that of sub$-$DLAs. We find the existence of strong anti-correlation between $L$ vs. $[C/H]$ for the combined sample with a significance level of 8.39$\sigma$. We see evidence of two distinct $[C/H]$ branch C III populations (low$-[C/H]$ branch, $[C/H]$ $\le -1.2$ and high$-[C/H]$ branch, $[C/H]$ $> -1.2$) in the combined C III sample when divided appropriately in the $L$ vs. $N_{\rm C\,III}$ plane. Further studies of C III absorbers in the redshift range, $1.0 \le z \le 2.0$ is important to map the redshift evolution of these absorbers and gain insights into the time evolution physical conditions of the circumgalactic medium.


title: Multi-agent systems for quadcopters

abstract: Unmanned Aerial Vehicles (UAVs) have been increasingly used in the context of remote sensing missions such as target search and tracking, mapping, or surveillance monitoring. In the first part of our paper we consider agent dynamics, network topologies, and collective behaviors. The objective is to enable multiple UAVs to collaborate toward a common goal, as one would find in a remote sensing setting. An agreement protocol is carried out by the multi-agents using local information, and without external user input. The second part of the paper focuses on the equations of motion for a specific type of UAV, the quadcopter, and expresses them as an affine nonlinear control system. Finally, we illustrate our work with a simulation of an agreement protocol for dynamically sound quadcopters augmenting the particle graph theoretic approach with orientation and a proper dynamics for quadcopters.


title: Two Year Cosmology Large Angular Scale Surveyor (CLASS) Observations: Long Timescale Stability Achieved with a Front-End Variable-delay Polarization Modulator at 40 GHz

abstract: The Cosmology Large Angular Scale Surveyor (CLASS) is a four-telescope array observing the largest angular scales ($2 \lesssim \ell \lesssim 200$) of the cosmic microwave background (CMB) polarization. These scales encode information about reionization and inflation during the early universe. The instrument stability necessary to observe these angular scales from the ground is achieved through the use of a variable-delay polarization modulator (VPM) as the first optical element in each of the CLASS telescopes. Here we develop a demodulation scheme used to extract the polarization timestreams from the CLASS data and apply this method to selected data from the first two years of observations by the 40 GHz CLASS telescope. These timestreams are used to measure the $1/f$ noise and temperature-to-polarization ($T\rightarrow P$) leakage present in the CLASS data. We find a median knee frequency for the pair-differenced demodulated linear polarization of 15.12 mHz and a $T\rightarrow P$ leakage of $<3.8\times10^{-4}$ (95\% confidence) across the focal plane. We examine the sources of $1/f$ noise present in the data and find the component of $1/f$ due to atmospheric precipitable water vapor (PWV) has an amplitude of $203 \pm 12 \mathrm{\mu K_{RJ}\sqrt{s}}$ for 1 mm of PWV when evaluated at 10 mHz; accounting for $\sim32\%$ of the $1/f$ noise in the central pixels of the focal plane. The low level of $T\rightarrow P$ leakage and $1/f$ noise achieved through the use of a front-end polarization modulator enables the observation of the largest scales of the CMB polarization from the ground by the CLASS telescopes.


title: Modified Gaussian Process Regression Models for Cyclic Capacity Prediction of Lithium-ion Batteries

abstract: This paper presents the development of machine learning-enabled data-driven models for effective capacity predictions for lithium-ion batteries under different cyclic conditions. To achieve this, a model structure is first proposed with the considerations of battery ageing tendency and the corresponding operational temperature and depth-of-discharge. Then based on a systematic understanding of covariance functions within the Gaussian process regression, two related data-driven models are developed. Specifically, by modifying the isotropic squared exponential kernel with an automatic relevance determination structure, 'Model A' could extract the highly relevant input features for capacity predictions. Through coupling the Arrhenius law and a polynomial equation into a compositional kernel, 'Model B' is capable of considering the electrochemical and empirical knowledge of battery degradation. The developed models are validated and compared on the Nickel Manganese Cobalt Oxide (NMC) lithium-ion batteries with various cycling patterns. Experimental results demonstrate that the modified Gaussian process regression model considering the battery electrochemical and empirical ageing signature outperforms other counterparts and is able to achieve satisfactory results for both one-step and multi-step predictions. The proposed technique is promising for battery capacity predictions under various cycling cases.


title: KART: Parameterization of Privacy Leakage Scenarios from Pre-trained Language Models

abstract: For the safe sharing pre-trained language models, no guidelines exist at present owing to the difficulty in estimating the upper bound of the risk of privacy leakage. One problem is that previous studies have assessed the risk for different real-world privacy leakage scenarios and attack methods, which reduces the portability of the findings. To tackle this problem, we represent complex real-world privacy leakage scenarios under a universal parameterization, \textit{Knowledge, Anonymization, Resource, and Target} (KART). KART parameterization has two merits: (i) it clarifies the definition of privacy leakage in each experiment and (ii) it improves the comparability of the findings of risk assessments. We show that previous studies can be simply reviewed by parameterizing the scenarios with KART. We also demonstrate privacy risk assessments in different scenarios under the same attack method, which suggests that KART helps approximate the upper bound of risk under a specific attack or scenario. We believe that KART helps integrate past and future findings on privacy risk and will contribute to a standard for sharing language models.


title: Triple Higgs Boson Production at the Large Hadron Collider with Two Real Singlet Scalars

abstract: We investigate the production of three Higgs bosons in the Two Real Singlet extension of the Standard Model, where the scalar sector is augmented by two additional real scalar fields which are singlets under the Standard Model gauge group. The model contains three neutral CP-even scalars, allowing for resonant production and asymmetric decay chains. We focus on the signature $p p\,\rightarrow\,h_3\,\rightarrow\,h_1\,h_2\,\rightarrow\,h_1\,h_1\,h_1$, where we identify $h_3$ as the heaviest scalar state, $h_2$ as the second heaviest and the lightest, $h_1$, as the Standard Model-like Higgs boson discovered by the Large Hadron Collider experiments. The dominant final state occurs when all three Higgs bosons decay to bottom-anti-bottom quark pairs, $h_1\,\rightarrow\,b\,\bar{b}$, leading to 6 $b$-jets. Taking into account all current theoretical and experimental constraints, we determine the discovery prospects for this channel in future runs of the Large Hadron Collider, as well as in the high-luminosity phase.


title: Uniqueness of extremal isolated horizons and their identification with horizons of all type D black holes

abstract: We systematically investigate axisymmetric extremal isolated horizons (EIHs) defined by vanishing surface gravity, corresponding to zero temperature. In the first part, using the Newman-Penrose and GHP formalism we derive the most general metric function for such EIHs in the Einstein-Maxwell theory, which complements the previous result of Lewandowski and Pawlowski. We prove that it depends on 5 independent parameters, namely deficit angles on the north and south poles of a spherical-like section of the horizon, its radius (area), and total electric and magnetic charges of the black hole. The deficit angles and both charges can be separately set to zero. In the second part of our paper, we identify this general axially symmetric solution for EIH with extremal horizons in exact electrovacuum Plebanski-Demianski spacetimes, using the convenient parametrization of this family by Griffiths and Podolsky. They represent all (double aligned) black holes of algebraic type D without a cosmological constant. Apart from a conicity, they depend on 6 physical parameters (mass, Kerr-like rotation, NUT parameter, acceleration, electric and magnetic charges) constrained by the extremality condition. We were able to determine their relation to the EIH geometrical parameters. This explicit identification of type D extremal black holes with a unique form of EIH includes several interesting subclasses, such as accelerating extremely charged Reissner-Nordstrom black hole (C-metric), extremal accelerating Kerr-Newman, accelerating Kerr-NUT, or non-accelerating Kerr-Newman-NUT black holes.


title: Effects of Axial Load on the Location of a Combined Null Point in Energy Piles

abstract: Soil structure interaction in energy piles has not yet been understood comprehensively. One of the important underlying issues is the location of a zero-displacement point, known as the null point. This study investigates how the location of a combined null point in fully floating energy piles is affected by relative magnitudes of thermal and mechanical loads. Analytical solutions are used to address four different loading scenarios including compressive and tensile loads, and heating and cooling. It was found that the location of the combined null point coincides with the location of the maximum magnitude of the axial stress induced by thermo-mechanical load. Furthermore, while a thermal null point is always present in fully floating energy piles, the combined null point is absent in the case of a small magnitude of thermal load as compared to the mechanical load. With increase in the relative magnitude of thermal load as compared to the mechanical load the combined null point emerges at different locations for different load combinations. In all cases it subsequently moves towards the mid-length of the pile with increase in the relative magnitude of thermal load.


title: Bridging hybrid- and full-kinetic models with Landau-fluid electrons: I. 2D magnetic reconnection

abstract: Magnetic reconnection (MR) plays a fundamental role in plasma dynamics under many different conditions, from space and astrophysical environments to laboratory devices. High-resolution in-situ measurements from space missions allow to study naturally occurring MR processes in great detail. Alongside direct measurements, numerical simulations play a key role in investigating the fundamental physics underlying MR. The choice of an adequate plasma model to be employed in numerical simulations, while also compromising with their computational cost, is crucial to efficiently address the problem. We consider a new plasma model that includes a refined electron response within the hybrid-kinetic framework (kinetic ions, fluid electrons). The extent to which this new model can reproduce a full-kinetic description of 2D MR, with particular focus on its robustness during the non-linear stage, is evaluated. We perform 2D simulations of MR with moderate guide field by means of three different plasma models: a hybrid-Vlasov-Maxwell model with isotropic, isothermal electrons, a hybrid-Vlasov-Landau-fluid (HVLF) model where an anisotropic electron fluid is equipped with a Landau-fluid closure, and a full-kinetic one. When compared to the full-kinetic case, the HVLF model effectively reproduces the main features of MR, as well as several aspects of the associated electron micro-physics and its feedback onto proton dynamics. This includes the global evolution of MR and the local physics occurring within the so-called electron-diffusion region, as well as the evolution of species pressure anisotropy. In particular, anisotropy driven instabilities (such as firehose, mirror, and cyclotron instabilities) play a relevant role in regulating electrons anisotropy during the non-linear stage of MR. As expected, the HVLF model captures all these features, except for the electron-cyclotron instability.


title: Optimizing Optimizers: Regret-optimal gradient descent algorithms

abstract: The need for fast and robust optimization algorithms are of critical importance in all areas of machine learning. This paper treats the task of designing optimization algorithms as an optimal control problem. Using regret as a metric for an algorithm's performance, we study the existence, uniqueness and consistency of regret-optimal algorithms. By providing first-order optimality conditions for the control problem, we show that regret-optimal algorithms must satisfy a specific structure in their dynamics which we show is equivalent to performing dual-preconditioned gradient descent on the value function generated by its regret. Using these optimal dynamics, we provide bounds on their rates of convergence to solutions of convex optimization problems. Though closed-form optimal dynamics cannot be obtained in general, we present fast numerical methods for approximating them, generating optimization algorithms which directly optimize their long-term regret. Lastly, these are benchmarked against commonly used optimization algorithms to demonstrate their effectiveness.


title: Metastable Helium Absorptions with 3D Hydrodynamics and Self-Consistent Photochemistry I: WASP-69b, Dimensionality, XUV Flux Level, Spectral Types, and Flares

abstract: The metastable Helium (He*) lines near $10830~{\rm A}$ are ideal probes of atmospheric erosion--a common phenomenon of close-in exoplanet evolution. A handful of exoplanet observations yielded well-resolved He* absorption features in transits, yet they were mostly analyzed with 1D isothermal models prescribing mass-loss rates. This work devises 3D hydrodynamics co-evolved with ray-tracing radiative transfer and non-equilibrium thermochemsitry. Starting from the observed stellar/planetary properties with reasonable assumptions about the host's high energy irradiation, we predict from first principle the mass loss rate, the temperature and ionization profiles, and 3D outflow kinematics. Our simulations well reproduce the observed He* line profiles and light curves of WASP-69b. We further investigate the dependence of He* observables on simulation conditions and host radiation. The key findings are: (1) Simulations reveal a photoevaporative outflow ($\sim 0.5~M_{\oplus}~{\rm Gyr}^{-1}$) for WASP-69b without a prominent comet-like tail, consistent with the symmetric transit shape (Vissapragada et al. 2020). (2) 3D simulations are mandatory for hydrodynamic features, including Coriolis force, advection, and kinematic line broadening. (3) EUV ($>13.6~{\rm eV}$) photons dominate photoevaporative outflows and populate He* via recombination; FUV is also detrimental by destroying He*; X-ray plays a secondary role. (4) K stars hit the sweet spot of EUV/FUV balance for He* line observation, while G and M stars are also worthy targets. (5) Stellar flars create characteristic responses in the He* line profiles.


title: Long-Term Autonomy in Forest Environment using Self-Corrective SLAM

abstract: Vehicles with prolonged autonomous missions have to maintain environment awareness by simultaneous localization and mapping (SLAM). Closed loop correction is substituted by interpolation in rigid body transformation space in order to systematically reduce the accumulated error over different scales. The computation is divided to an edge computed lightweight SLAM and iterative corrections in the cloud environment. Tree locations in the forest environment are sent via a potentially limited communication bandwidths. Data from a real forest site is used in the verification of the proposed algorithm. The algorithm adds new iterative closest point (ICP) cases to the initial SLAM and measures the resulting map quality by the mean of the root mean squared error (RMSE) of individual tree clusters. Adding 4% more match cases yields the mean RMSE 0.15 m on a large site with 180 m odometric distance.


title: Fiber integration of gerbes and Deligne line bundles

abstract: Let $\pi: X \to S$ be a family of smooth projective curves, and let $L$ and $M$ be a pair of line bundles on $X$. We show that Deligne's line bundle $\langle{L,M}\rangle$ can be obtained from the $\mathcal{K}_2$-gerbe $G_{L,M}$ constructed in a previous work by the authors via an integration along the fiber map for gerbes that categorifies the well known one arising from the Leray spectral sequence of $\pi$. Our construction provides a full account of the biadditivity properties of $\langle {L,M}\rangle$. The functorial description of the low degree maps in the Leray spectral sequence for $\pi$ we develop are of independent interest, and along the course we provide an example of their application to the Brauer group.


title: Metastable Helium Absorptions with 3D Hydrodynamics and Self-Consistent Photochemistry II: WASP-107b, Stellar Wind, Radiation Pressure, and Shear Instability

abstract: This paper presents simulations of the metastable helium (He*) observations of WASP-107b, so far the highest signal-to-noise ratio detection that is confirmed by three different instruments. We employ full 3D hydrodynamics coupled with co-evolving non-equilibrium thermochemistry and ray-tracing radiation, predicting mass loss rates, temperature profiles, and synthetic He* line profiles and light curves from first principles. We found that a stellar wind stronger than solar is demanded by the observed heavily blueshifted line profile and asymmetric transit light curve. Contrary to previous beliefs, we argue that radiation pressure can be important for Ly$\alpha$ observations but {\it not} He*. We found WASP-107b is losing mass at a rate of $\dot{M} \simeq 1.0\times 10^{-9}~M_\oplus~{\rm yr}^{-1}$. Although $\dot{M}$ varies by $<1~\%$ given constant wind and irradiation from the host, shear instabilities still emerge from wind impacts, producing $\sim 10~\%$ fluctuations of He* transit depths over hour-long timescales. The common assumption that He* transit depth indicates the fluctuation of $\dot{M}$ is problematic. The trailing tail is more susceptible than planet adjacency to the shear instabilities, thus the line profile is more variable in the blue-shifted wing, while the transit light curve is more variable after mid-transit. We stress the synergy between Ly$\alpha$ (higher altitudes, lower density) and He* (lower altitudes, higher density) transit observations, particularly simultaneous ones, yield better understanding of planetary outflows and stellar wind properties.


title: Effects of End Restraints on Thermo-Mechanical Response of Energy Piles

abstract: Currently, soil structure interaction in energy piles has not been understood thoroughly. One of the important underlying features is the effect of tip and head restraints on displacement, strain and stress in energy piles. This study has investigated thermo-mechanical response of energy piles subjected to different end restraints by using recently found analytical solutions, thus providing a fundamental, rational, mechanics-based understanding. End restraints are found to have a substantial effect on thermo-mechanical response of energy piles, especially on thermal axial displacement and axial stress in the pile. Head restraint imposed by interaction of an energy pile with the superstructure led to a decrease in the magnitude of head displacement and increase in axial stress, while decreasing the axial strain. The impact of head restraint was more pronounced in end bearing than in fully floating energy piles.


title: Neutrino mass ordering obfuscated by the NSI

abstract: Determination of the neutrino mass ordering (NMO) is one of the biggest priorities in the intensity frontier of high energy particle physics. To accomplish that goal a lot of efforts are being put together with the atmospheric, solar, reactor, and accelerator neutrinos. In the standard 3-flavor framework, NMO is defined to be normal if $m_1<m_2<m_3$, and inverted if $m_3<m_1<m_2$, where $m_1$, $m_2$, and $m_3$ are the masses of the three neutrino mass eigenstates $\nu_1$, $\nu_2$, and $\nu_3$ respectively. Interestingly, two long-baseline experiments T2K and NO$\nu$A are playing a leading role in this direction and provide a $\sim2.4\sigma$ indication in favor of normal ordering (NO) which we find in this work. In addition, we examine how the situation looks like in presence of non-standard interactions (NSI) of neutrinos with a special focus on the non-diagonal flavor changing type $\varepsilon_{e\tau}$ and $\varepsilon_{e\mu}$. We find that the present indication of NO in the standard 3-flavor framework gets completely vanished in the presence of NSI of the flavor changing type involving the $e-\tau$ flavors.


title: Combining single-molecule super-resolved localization microscopy with fluorescence polarization imaging to study cellular processes

abstract: Super-resolution microscopy has catalyzed valuable insights into the sub-cellular, mechanistic details of many different biological processes across a wide range of cell types. Fluorescence polarization spectroscopy tools have also enabled important insights into cellular processes through identifying orientational changes of biological molecules typically at an ensemble level. Here, we combine these two biophysical methodologies in a single home-made instrument to enable the simultaneous detection of orthogonal fluorescence polarization signals from single fluorescent protein molecules used as common reporters on the localization of proteins in cellular processes. These enable measurement of spatial location to a super-resolved precision better than the diffraction-limited optical resolution, as well as estimation of molecular stoichiometry based on the brightness of individual fluorophores. In this innovation we have adapted a millisecond timescale microscope used for single-molecule detection to enable splitting of fluorescence polarization emissions into two separate imaging channels for s- and p- polarization signals, which are imaged onto separate halves of the same high sensitivity back-illuminated CMOS camera detector. We applied this fluorescence polarization super-resolved imaging modality to a range of test fluorescent samples relevant to the study of biological processes, including purified monomeric green fluorescent protein, single combed DNA molecules, and protein assemblies and complexes from live Escherichia coli and Saccharomyces cerevisiae cells. Our findings are qualitative but demonstrate promise in showing how fluorescence polarization and super-resolved localization microscopy can be combined on the same sample to enable simultaneous measurements of polarization and stoichiometry of tracked molecular complexes, as well as the translational diffusion coefficient.


title: Particle Swarm Based Hyper-Parameter Optimization for Machine Learned Interatomic Potentials

abstract: Modeling non-empirical and highly flexible interatomic potential energy surfaces (PES) using machine learning (ML) approaches is becoming popular in molecular and materials research. Training an ML-PES is typically performed in two stages: feature extraction and structure-property relationship modeling. The feature extraction stage transforms atomic positions into a symmetry-invariant mathematical representation. This representation can be fine-tuned by adjusting on a set of so-called "hyper-parameters" (HPs). Subsequently, an ML algorithm such as neural networks or Gaussian process regression (GPR) is used to model the structure-PES relationship based on another set of HPs. Choosing optimal values for the two sets of HPs is critical to ensure the high quality of the resulting ML-PES model. In this paper, we explore HP optimization strategies tailored for ML-PES generation using a custom-coded parallel particle swarm optimizer (available freely at https://github.com/suresh0807/PPSO.git). We employ the smooth overlap of atomic positions (SOAP) descriptor in combination with GPR-based Gaussian approximation potentials (GAP) and optimize HPs for four distinct systems: a toy C dimer, amorphous carbon, $\alpha$-Fe, and small organic molecules (QM9 dataset). We propose a two-step optimization strategy in which the HPs related to the feature extraction stage are optimized first, followed by the optimization of the HPs in the training stage. This strategy is computationally more efficient than optimizing all HPs at the same time by means of significantly reducing the number of ML models needed to be trained to obtain the optimal HPs. This approach can be trivially extended to other combinations of descriptor and ML algorithm and brings us another step closer to fully automated ML-PES generation.


title: Duality for positive opetopes and positive zoom complexes

abstract: We show that the positive zoom complexes, with fairly natural morphisms, form a dual category to the category of positive opetopes with contraction epimorphisms. We also show how this duality can be extended to opetopic cardinals.


title: A simple regulatory architecture allows learning the statistical structure of a changing environment

abstract: Bacteria live in environments that are continuously fluctuating and changing. Exploiting any predictability of such fluctuations can lead to an increased fitness. On longer timescales bacteria can "learn" the structure of these fluctuations through evolution. However, on shorter timescales, inferring the statistics of the environment and acting upon this information would need to be accomplished by physiological mechanisms. Here, we use a model of metabolism to show that a simple generalization of a common regulatory motif (end-product inhibition) is sufficient both for learning continuous-valued features of the statistical structure of the environment and for translating this information into predictive behavior; moreover, it accomplishes these tasks near-optimally. We discuss plausible genetic circuits that could instantiate the mechanism we describe, including one similar to the architecture of two-component signaling, and argue that the key ingredients required for such predictive behavior are readily accessible to bacteria.


title: Federated Nonconvex Sparse Learning

abstract: Nonconvex sparse learning plays an essential role in many areas, such as signal processing and deep network compression. Iterative hard thresholding (IHT) methods are the state-of-the-art for nonconvex sparse learning due to their capability of recovering true support and scalability with large datasets. Theoretical analysis of IHT is currently based on centralized IID data. In realistic large-scale situations, however, data are distributed, hardly IID, and private to local edge computing devices. It is thus necessary to examine the property of IHT in federated settings, which update in parallel on local devices and communicate with a central server only once in a while without sharing local data. In this paper, we propose two IHT methods: Federated Hard Thresholding (Fed-HT) and Federated Iterative Hard Thresholding (FedIter-HT). We prove that both algorithms enjoy a linear convergence rate and have strong guarantees to recover the optimal sparse estimator, similar to traditional IHT methods, but now with decentralized non-IID data. Empirical results demonstrate that the Fed-HT and FedIter-HT outperform their competitor - a distributed IHT, in terms of decreasing the objective values with lower requirements on communication rounds and bandwidth.


title: A note on combining chaotic dynamical systems using the fuzzy logic XOR operator

abstract: In this paper we explore whatever combining two chaotic dynamical systems using the fuzzy logic operator XOR can maintain or not the chaotic properties of the resulting dynamical system. This study is motivated by techniques used in applications to secure communications ,images encryption and cryptography.


title: Psychoacoustic Calibration of Loss Functions for Efficient End-to-End Neural Audio Coding

abstract: Conventional audio coding technologies commonly leverage human perception of sound, or psychoacoustics, to reduce the bitrate while preserving the perceptual quality of the decoded audio signals. For neural audio codecs, however, the objective nature of the loss function usually leads to suboptimal sound quality as well as high run-time complexity due to the large model size. In this work, we present a psychoacoustic calibration scheme to re-define the loss functions of neural audio coding systems so that it can decode signals more perceptually similar to the reference, yet with a much lower model complexity. The proposed loss function incorporates the global masking threshold, allowing the reconstruction error that corresponds to inaudible artifacts. Experimental results show that the proposed model outperforms the baseline neural codec twice as large and consuming 23.4% more bits per second. With the proposed method, a lightweight neural codec, with only 0.9 million parameters, performs near-transparent audio coding comparable with the commercial MPEG-1 Audio Layer III codec at 112 kbps.


title: Data Criticality in Multi-Threaded Applications: An Insight for Many-Core Systems

abstract: Multi-threaded applications are capable of exploiting the full potential of many-core systems. However, Network-on-Chip (NoC) based inter-core communication in many-core systems is responsible for 60-75% of the miss latency experienced by multi-threaded applications. Delay in the arrival of critical data at the requesting core severely hampers performance. This brief presents some interesting insights about how critical data is requested from the memory by multi-threaded applications. Then it investigates the cause of delay in NoC and how it affects the performance. Finally, this brief shows how NoC-aware memory access optimisations can significantly improve performance. Our experimental evaluation considers early restart memory access optimisation and demonstrates that by exploiting NoC resources, critical data can be prioritised to reduce miss penalty by 10-12% and improve system performance by 7-11%.


title: Towards Modelling Coherence in Spoken Discourse

abstract: While there has been significant progress towards modelling coherence in written discourse, the work in modelling spoken discourse coherence has been quite limited. Unlike the coherence in text, coherence in spoken discourse is also dependent on the prosodic and acoustic patterns in speech. In this paper, we model coherence in spoken discourse with audio-based coherence models. We perform experiments with four coherence-related tasks with spoken discourses. In our experiments, we evaluate machine-generated speech against the speech delivered by expert human speakers. We also compare the spoken discourses generated by human language learners of varying language proficiency levels. Our results show that incorporating the audio modality along with the text benefits the coherence models in performing downstream coherence related tasks with spoken discourses.


title: Clustered active-subspace based local Gaussian Process emulator for high-dimensional and complex computer models

abstract: Quantifying uncertainties in physical or engineering systems often requires a large number of simulations of the underlying computer models that are computationally intensive. Emulators or surrogate models are often used to accelerate the computation in such problems, and in this regard the Gaussian Process (GP) emulator is a popular choice for its ability to quantify the approximation error in the emulator itself. However, a major limitation of the GP emulator is that it can not handle problems of very high dimensions, which is often addressed with dimension reduction techniques. In this work we hope to address an issue that the models of interest are so complex that they admit different low dimensional structures in different parameter regimes. Building upon the active subspace method for dimension reduction, we propose a clustered active subspace method which identifies the local low-dimensional structures as well as the parameter regimes they are in (represented as clusters), and then construct low dimensional and local GP emulators within the clusters. Specifically we design a clustering method based on the gradient information to identify these clusters, and a local GP construction procedure to construct the GP emulator within a local cluster. With numerical examples, we demonstrate that the proposed method is effective when the underlying models are of complex low-dimensional structures.


title: Conflict-driven Inductive Logic Programming

abstract: The goal of Inductive Logic Programming (ILP) is to learn a program that explains a set of examples. Until recently, most research on ILP targeted learning Prolog programs. The ILASP system instead learns Answer Set Programs (ASP). Learning such expressive programs widens the applicability of ILP considerably; for example, enabling preference learning, learning common-sense knowledge, including defaults and exceptions, and learning non-deterministic theories. Early versions of ILASP can be considered meta-level ILP approaches, which encode a learning task as a logic program and delegate the search to an ASP solver. More recently, ILASP has shifted towards a new method, inspired by conflict-driven SAT and ASP solvers. The fundamental idea of the approach, called Conflict-driven ILP (CDILP), is to iteratively interleave the search for a hypothesis with the generation of constraints which explain why the current hypothesis does not cover a particular example. These coverage constraints allow ILASP to rule out not just the current hypothesis, but an entire class of hypotheses that do not satisfy the coverage constraint. This paper formalises the CDILP approach and presents the ILASP3 and ILASP4 systems for CDILP, which are demonstrated to be more scalable than previous ILASP systems, particularly in the presence of noise. Under consideration in Theory and Practice of Logic Programming (TPLP).


title: CauchyCP: a powerful test under non-proportional hazards using Cauchy combination of change-point Cox regressions

abstract: Non-proportional hazards data are routinely encountered in randomized clinical trials. In such cases, classic Cox proportional hazards model can suffer from severe power loss, with difficulty in interpretation of the estimated hazard ratio since the treatment effect varies over time. We propose CauchyCP, an omnibus test of change-point Cox regression models, to overcome both challenges while detecting signals of non-proportional hazards patterns. Extensive simulation studies demonstrate that, compared to existing treatment comparison tests under non-proportional hazards, the proposed CauchyCP test 1) controls the type I error better at small $\alpha$ levels ($< 0.01$); 2) increases the power of detecting time-varying effects; and 3) is more computationally efficient. The superior performance of CauchyCP is further illustrated using retrospective analyses of two randomized clinical trial datasets and a pharmacogenetic biomarker study dataset. The R package $\textit{CauchyCP}$ is publicly available on CRAN.