title: Word Frequency Does Not Predict Grammatical Knowledge in Language Models

abstract: Neural language models learn, to varying degrees of accuracy, the grammatical properties of natural languages. In this work, we investigate whether there are systematic sources of variation in the language models' accuracy. Focusing on subject-verb agreement and reflexive anaphora, we find that certain nouns are systematically understood better than others, an effect which is robust across grammatical tasks and different language models. Surprisingly, we find that across four orders of magnitude, corpus frequency is unrelated to a noun's performance on grammatical tasks. Finally, we find that a novel noun's grammatical properties can be few-shot learned from various types of training data. The results present a paradox: there should be less variation in grammatical performance than is actually observed.


title: Examining the causal structures of deep neural networks using information theory

abstract: Deep Neural Networks (DNNs) are often examined at the level of their response to input, such as analyzing the mutual information between nodes and data sets. Yet DNNs can also be examined at the level of causation, exploring "what does what" within the layers of the network itself. Historically, analyzing the causal structure of DNNs has received less attention than understanding their responses to input. Yet definitionally, generalizability must be a function of a DNN's causal structure since it reflects how the DNN responds to unseen or even not-yet-defined future inputs. Here, we introduce a suite of metrics based on information theory to quantify and track changes in the causal structure of DNNs during training. Specifically, we introduce the effective information (EI) of a feedforward DNN, which is the mutual information between layer input and output following a maximum-entropy perturbation. The EI can be used to assess the degree of causal influence nodes and edges have over their downstream targets in each layer. We show that the EI can be further decomposed in order to examine the sensitivity of a layer (measured by how well edges transmit perturbations) and the degeneracy of a layer (measured by how edge overlap interferes with transmission), along with estimates of the amount of integrated information of a layer. Together, these properties define where each layer lies in the "causal plane" which can be used to visualize how layer connectivity becomes more sensitive or degenerate over time, and how integration changes during training, revealing how the layer-by-layer causal structure differentiates. These results may help in understanding the generalization capabilities of DNNs and provide foundational tools for making DNNs both more generalizable and more explainable.


title: Bayesian Importance of Features (BIF)

abstract: We introduce a simple and intuitive framework that provides quantitative explanations of statistical models through the probabilistic assessment of input feature importance. The core idea comes from utilizing the Dirichlet distribution to define the importance of input features and learning it via approximate Bayesian inference. The learned importance has probabilistic interpretation and provides the relative significance of each input feature to a model's output, additionally assessing confidence about its importance quantification. As a consequence of using the Dirichlet distribution over the explanations, we can define a closed-form divergence to gauge the similarity between learned importance under different models. We use this divergence to study the feature importance explainability tradeoffs with essential notions in modern machine learning, such as privacy and fairness. Furthermore, BIF can work on two levels: global explanation (feature importance across all data instances) and local explanation (individual feature importance for each data instance). We show the effectiveness of our method on a variety of synthetic and real datasets, taking into account both tabular and image datasets. The code is available at https://github.com/kamadforge/featimp_dp.


title: Lorenz ratio of an impure compensated metal in the degenerate Fermi liquid regime

abstract: The Lorenz ratio serves as a measure to compare thermal and electric conductivities of metals. Recent experiments observed small Lorenz ratios in the compensated metal WP$_2$, indicating that charge flow is strongly favored over heat conduction. Motivated by these findings, we study transport properties of compensated metals in the presence of electron-electron collisions and electron-impurity scattering. We focus on intermediate temperatures, where the phonon contributions to transport are weak and elastic and inelastic scattering rates are comparable. Our exact solution for the kinetic equation in the presence of general Fermi-liquid interactions is used to extract the Lorenz ratio for short and long range interactions. We find that the Lorenz ratio develops a temperature dependence and gets enhanced as a consequence of disorder scattering. For collisions mediated by the Coulomb interaction, impurities give rise to a non-monotonic dependence of the Lorenz ratio on the screening wave number with a minimum for intermediate screening strength. To help future experimental efforts, we establish a scheme to connect the exact results with the solution of the Boltzmann equation under the relaxation time approximation for all collision integrals. Our recipe provides simple phenomenological expressions for the transport coefficients and it allows for a physically transparent interpretation of the results.


title: Long-time behavior for a nonlocal model from directed polymers

abstract: We consider the long time behavior of solutions to a nonlocal reaction diffusion equation that arises in the study of directed polymers. The model is characterized by convolution with a kernel $R$ and an $L^2$ inner product. In one spatial dimension, we extend a previous result of the authors [arXiv:2002.02799], where only the case $R =\delta$ was considered; in particular, we show that solutions spread according to a $2/3$ power law consistent with the KPZ scaling conjectured for direct polymers. In the special case when $R = \delta$, we find the exact profile of the solution in the rescaled coordinates. We also consider the behavior in higher dimensions. When the dimension is three or larger, we show that the long-time behavior is the same as the heat equation in the sense that the solution converges to a standard Gaussian. In contrast, when the dimension is two, we construct a non-Gaussian self-similar solution.


title: AgCl-induced hot salt stress corrosion cracking in a titanium alloy

abstract: The mechanism of AgCl-induced stress corrosion cracking of Ti-6246 was examined at \SI{500}{\mega\pascal} and \SI{380}{\celsius} for \SI{24}{\hour} exposures. SEM and STEM-EDX examination of a FIB-sectioned blister and crack showed that metallic Ag was formed and migrated along the crack. TEM analysis also revealed the presence of \ce{SnO2} and \ce{Al2O3} corrosion products mixed into \ce{TiO2}. The fracture surface has a transgranular nature with a brittle appearance in the primary $\alpha$ phase. Long, straight and non-interacting dislocations were observed in a cleavage-fractured primary $\alpha$ grain, with basal and pyramidal traces. This is consistent with a dislocation emission view of the the cracking mechanism.


title: Exponential iteration and Borel sets

abstract: We determine the exact Borel class of the points whose iterates under $\exp(z)+a$ tend to infinity. We also prove that the sets of non-escaping Julia points for many of these functions are topologically equivalent.


title: Modeling Long Cycles

abstract: Recurrent boom-and-bust cycles are a salient feature of economic and financial history. Cycles found in the data are stochastic, often highly persistent, and span substantial fractions of the sample size. We refer to such cycles as "long". In this paper, we develop a novel approach to modeling cyclical behavior specifically designed to capture long cycles. We show that existing inferential procedures may produce misleading results in the presence of long cycles, and propose a new econometric procedure for the inference on the cycle length. Our procedure is asymptotically valid regardless of the cycle length. We apply our methodology to a set of macroeconomic and financial variables for the U.S. We find evidence of long stochastic cycles in the standard business cycle variables, as well as in credit and house prices. However, we rule out the presence of stochastic cycles in asset market data. Moreover, according to our result, financial cycles as characterized by credit and house prices tend to be twice as long as business cycles.


title: Improved Neural Language Model Fusion for Streaming Recurrent Neural Network Transducer

abstract: Recurrent Neural Network Transducer (RNN-T), like most end-to-end speech recognition model architectures, has an implicit neural network language model (NNLM) and cannot easily leverage unpaired text data during training. Previous work has proposed various fusion methods to incorporate external NNLMs into end-to-end ASR to address this weakness. In this paper, we propose extensions to these techniques that allow RNN-T to exploit external NNLMs during both training and inference time, resulting in 13-18% relative Word Error Rate improvement on Librispeech compared to strong baselines. Furthermore, our methods do not incur extra algorithmic latency and allow for flexible plug-and-play of different NNLMs without re-training. We also share in-depth analysis to better understand the benefits of the different NNLM fusion methods. Our work provides a reliable technique for leveraging unpaired text data to significantly improve RNN-T while keeping the system streamable, flexible, and lightweight.


title: Domain Wall-Magnetic Tunnel Junction Spin Orbit Torque Devices and Circuits for In-Memory Computing

abstract: There are pressing problems with traditional computing, especially for accomplishing data-intensive and real-time tasks, that motivate the development of in-memory computing devices to both store information and perform computation. Magnetic tunnel junction (MTJ) memory elements can be used for computation by manipulating a domain wall (DW), a transition region between magnetic domains. But, these devices have suffered from challenges: spin transfer torque (STT) switching of a DW requires high current, and the multiple etch steps needed to create an MTJ pillar on top of a DW track has led to reduced tunnel magnetoresistance (TMR). These issues have limited experimental study of devices and circuits. Here, we study prototypes of three-terminal domain wall-magnetic tunnel junction (DW-MTJ) in-memory computing devices that can address data processing bottlenecks and resolve these challenges by using perpendicular magnetic anisotropy (PMA), spin-orbit torque (SOT) switching, and an optimized lithography process to produce average device tunnel magnetoresistance TMR = 164%, resistance-area product RA = 31 {\Omega}-{\mu}m^2, close to the RA of the unpatterned film, and lower switching current density compared to using spin transfer torque. A two-device circuit shows bit propagation between devices. Device initialization variation in switching voltage is shown to be curtailed to 7% by controlling the DW initial position, which we show corresponds to 96% accuracy in a DW-MTJ full adder simulation. These results make strides in using MTJs and DWs for in-memory and neuromorphic computing applications.


title: Versatile Verification of Tree Ensembles

abstract: Machine learned models often must abide by certain requirements (e.g., fairness or legal). This has spurred interested in developing approaches that can provably verify whether a model satisfies certain properties. This paper introduces a generic algorithm called Veritas that enables tackling multiple different verification tasks for tree ensemble models like random forests (RFs) and gradient boosting decision trees (GBDTs). This generality contrasts with previous work, which has focused exclusively on either adversarial example generation or robustness checking. Veritas formulates the verification task as a generic optimization problem and introduces a novel search space representation. Veritas offers two key advantages. First, it provides anytime lower and upper bounds when the optimization problem cannot be solved exactly. In contrast, many existing methods have focused on exact solutions and are thus limited by the verification problem being NP-complete. Second, Veritas produces full (bounded suboptimal) solutions that can be used to generate concrete examples. We experimentally show that Veritas outperforms the previous state of the art by (a) generating exact solutions more frequently, (b) producing tighter bounds when (a) is not possible, and (c) offering orders of magnitude speed ups. Subsequently, Veritas enables tackling more and larger real-world verification scenarios.


title: Characterization of a vacuum ultraviolet light source at 118 nm

abstract: Vacuum ultraviolet (VUV) light at 118 nm has been shown to be a powerful tool to ionize molecules for various gas-phase chemical studies. A convenient table top source of 118 nm light can be produced by frequency tripling 355 nm light from a Nd:YAG laser in xenon gas. This process has a low efficiency, typically producing only nJ/pulse of VUV light. Simple models of the tripling process predict the power of 118 nm light produced should increase quadratically with increasing xenon pressure. However, experimental 118 nm production has been observed to reach a maximum and then decrease to zero with increasing xenon pressure. Here, we describe the basic theory and experimental setup for producing 118 nm light and a new proposed model for the mechanism limiting the production based on pressure broadened absorption.


title: Analysis of a simple equation for the ground state of the Bose gas II: Monotonicity, Convexity and Condensate Fraction

abstract: In a recent paper we studied an equation (called the "simple equation") introduced by one of us in 1963 for an approximate correlation function associated to the ground state of an interacting Bose gas. Solving the equation yields a relation between the density $\rho$ of the gas and the energy per particle. Our construction of solutions gave a well-defined function $\rho(e)$ for the density as a function of the energy $e$. We had conjectured that $\rho(e)$ is a strictly monotone increasing function, so that it can be inverted to yield the strictly monotone increasing function $e(\rho)$. We had also conjectured that $\rho e(\rho)$ is convex as a function of $\rho$. We prove both conjectures here for small densities, the context in which they have the most physical relevance, and the monotonicity also for large densities. Both conjectures are grounded in the underlying physics, and their proof provides further mathematical evidence for the validity of the assumptions underlying the derivation of the simple equation, at least for low or high densities, if not intermediate densities, although the equation gives surprisingly good predictions for all densities $\rho$. Another problem left open in our previous paper was whether the simple equation could be used to compute accurate predictions of observables other than the energy. Here, we provide a recipe for computing predictions for any one- or two-particle observables for the ground state of the Bose gas. We focus on the condensate fraction and the momentum distribution, and show that they have the same low density asymptotic behavior as that predicted for the Bose gas. Along with the computation of the low density energy of the simple equation in our previous paper, this shows that the simple equation reproduces the known and conjectured properties of the Bose gas at low densities.

categories: math-ph cond-mat.quant-gas math.AP math.MP


title: Breve historia de la astrobiolog\'ia en Argentina

abstract: Astrobiology or exobiology is a relatively new area of science that investigates the possibilities of finding life in other places in the universe. This not only includes the exploration of planets near or distant to Earth, but also the exploration of our own planet in the study of the origin and evolution of life. Given the complexity of the questions this field tries to answer, astrobiology nourishes from various areas of science, such as physics, chemistry, astronomy, geology, among others, the reason why is considered an interdisciplinary or transdisciplinary area. Some of these questions have also arisen from these areas and have converged in what is now astrobiology. Even many of these questions have also been asked in ancient times, although without the scientific and technical framework that we have today. This is the case of civilizations such as those of ancient Greece, among others, which have raised questions directly related to the possibilities of finding life on other worlds. Therefore, many of the questions today are part of astrobiology predate the development of astrobiology itself. This has been the path that has led to the development of astrobiology as a young science worldwide. Many Latin American countries, such as Argentina, have not been the exception to this.


title: Nested sampling with plateaus

abstract: It was recently emphasised by Riley (2019); Schittenhelm & Wacker (2020) that that in the presence of plateaus in the likelihood function nested sampling (NS) produces faulty estimates of the evidence and posterior densities. After informally explaining the cause of the problem, we present a modified version of NS that handles plateaus and can be applied retrospectively to NS runs from popular NS software using anesthetic. In the modified NS, live points in a plateau are evicted one by one without replacement, with ordinary NS compression of the prior volume after each eviction but taking into account the dynamic number of live points. The live points are replenished once all points in the plateau are removed. We demonstrate it on a number of examples. Since the modification is simple, we propose that it becomes the canonical version of Skilling's NS algorithm.

categories: stat.CO astro-ph.IM hep-ph physics.data-an


title: Surface Energy of the Titan Aerosol Analog "Tholin"

abstract: The photochemical haze produced in the upper atmosphere of Titan plays a key role in various atmospheric and surface processes on Titan. The surface energy, one important physical properties of the haze, is crucial for understanding the growth of the haze particles and can be used to predict their wetting behavior with solid and liquid species on Titan. We produced Titan analog haze materials, so-called "tholin", with different energy sources and measured their surface energies through contact angle and direct force measurements. From the contact angle measurement, we found that the tholins produced by cold plasma and UV irradiation have total surface energy around 60-70 mJ/m2. The direct force measurement yields a total surface energy of ~66 mJ/m2 for plasma tholin. The surface energy of tholin is relatively high compared to common polymers, indicating its high cohesiveness. Therefore, the Titan haze particles would likely coagulate easily to form bigger particles, while the haze-derived surface sand particles would need higher wind speed to be mobilized because of the high interparticle cohesion. The high surface energy of tholins also makes them easily wettable by Titan's atmospheric hydrocarbon condensates and surface liquids. Thus, the hazes particles are likely good cloud condensation nuclei (CCN) for hydrocarbon clouds (methane and ethane) to nucleate and grow. And if the hazes particles are denser compared to the lake liquids, they would likely sink into the lakes instead of forming a floating film to dampen the lake surface waves.


title: MarbleNet: Deep 1D Time-Channel Separable Convolutional Neural Network for Voice Activity Detection

abstract: We present MarbleNet, an end-to-end neural network for Voice Activity Detection (VAD). MarbleNet is a deep residual network composed from blocks of 1D time-channel separable convolution, batch-normalization, ReLU and dropout layers. When compared to a state-of-the-art VAD model, MarbleNet is able to achieve similar performance with roughly 1/10-th the parameter cost. We further conduct extensive ablation studies on different training methods and choices of parameters in order to study the robustness of MarbleNet in real-world VAD tasks.


title: LightSeq: A High Performance Inference Library for Transformers

abstract: Transformer, BERT and their variants have achieved great success in natural language processing. Since Transformer models are huge in size, serving these models is a challenge for real industrial applications. In this paper, we propose LightSeq, a highly efficient inference library for models in the Transformer family. LightSeq includes a series of GPU optimization techniques to to streamline the computation of neural layers and to reduce memory footprint. LightSeq can easily import models trained using PyTorch and Tensorflow. Experimental results on machine translation benchmarks show that LightSeq achieves up to 14x speedup compared with TensorFlow and 1.4x compared with FasterTransformer, a concurrent CUDA implementation. The code is available at https://github.com/bytedance/lightseq.


title: Unifying Matrix Data Structures: Simplifying and Speeding up Iterative Algorithms

abstract: Many algorithms use data structures that maintain properties of matrices undergoing some changes. The applications are wide-ranging and include for example matchings, shortest paths, linear programming, semi-definite programming, convex hull and volume computation. Given the wide range of applications, the exact property these data structures must maintain varies from one application to another, forcing algorithm designers to invent them from scratch or modify existing ones. Thus it is not surprising that these data structures and their proofs are usually tailor-made for their specific application and that maintaining more complicated properties results in more complicated proofs. In this paper we present a unifying framework that captures a wide range of these data structures. The simplicity of this framework allows us to give short proofs for many existing data structures regardless of how complicated the to be maintained property is. We also show how the framework can be used to speed up existing iterative algorithms, such as the simplex algorithm. More formally, consider any rational function $f(A_1,...,A_d)$ with input matrices $A_1,...,A_d$. We show that the task of maintaining $f(A_1,...,A_d)$ under updates to $A_1,...,A_d$ can be reduced to the much simpler problem of maintaining some matrix inverse $M^{-1}$ under updates to $M$. The latter is a well studied problem called dynamic matrix inverse. By applying our reduction and using known algorithms for dynamic matrix inverse we can obtain fast data structures and iterative algorithms for much more general problems.


title: Powers of Principal $Q$-Borel ideals

abstract: Fix a poset $Q$ on $\{x_1,\ldots,x_n\}$. A $Q$-Borel monomial ideal $I \subseteq \mathbb{K}[x_1,\ldots,x_n]$ is a monomial ideal whose monomials are closed under the Borel-like moves induced by $Q$. A monomial ideal $I$ is a principal $Q$-Borel ideal, denoted $I=Q(m)$, if there is a monomial $m$ such that all the minimal generators of $I$ can be obtained via $Q$-Borel moves from $m$. In this paper we study powers of principal $Q$-Borel ideals. Among our results, we show that all powers of $Q(m)$ agree with their symbolic powers, and that the ideal $Q(m)$ satisfies the persistence property for associated primes. We also compute the analytic spread of $Q(m)$ in terms of the poset $Q$.


title: How We Refactor and How We Document it? On the Use of Supervised Machine Learning Algorithms to Classify Refactoring Documentation

abstract: Refactoring is the art of improving the design of a system without altering its external behavior. Refactoring has become a well established and disciplined software engineering practice that has attracted a significant amount of research presuming that refactoring is primarily motivated by the need to improve system structures. However, recent studies have shown that developers may incorporate refactorings in other development activities that go beyond improving the design. Unfortunately, these studies are limited to developer interviews and a reduced set of projects. To cope with the above-mentioned limitations, we aim to better understand what motivates developers to apply refactoring by mining and classifying a large set of 111,884 commits containing refactorings, extracted from 800 Java projects. We trained a multi-class classifier to categorize these commits into 3 categories, namely, Internal QA, External QA, and Code Smell Resolution, along with the traditional BugFix and Functional categories. This classification challenges the original definition of refactoring, being exclusive to improving the design and fixing code smells. Further, to better understand our classification results, we analyzed commit messages to extract textual patterns that developers regularly use to describe their refactorings. The results show that (1) fixing code smells is not the main driver for developers to refactoring their codebases. Refactoring is solicited for a wide variety of reasons, going beyond its traditional definition; (2) the distribution of refactorings differs between production and test files; (3) developers use several patterns to purposefully target refactoring; (4) the textual patterns, extracted from commit messages, provide better coverage for how developers document their refactorings.


title: Stock Price Prediction Using CNN and LSTM-Based Deep Learning Models

abstract: Designing robust and accurate predictive models for stock price prediction has been an active area of research for a long time. While on one side, the supporters of the efficient market hypothesis claim that it is impossible to forecast stock prices accurately, many researchers believe otherwise. There exist propositions in the literature that have demonstrated that if properly designed and optimized, predictive models can very accurately and reliably predict future values of stock prices. This paper presents a suite of deep learning based models for stock price prediction. We use the historical records of the NIFTY 50 index listed in the National Stock Exchange of India, during the period from December 29, 2008 to July 31, 2020, for training and testing the models. Our proposition includes two regression models built on convolutional neural networks and three long and short term memory network based predictive models. To forecast the open values of the NIFTY 50 index records, we adopted a multi step prediction technique with walk forward validation. In this approach, the open values of the NIFTY 50 index are predicted on a time horizon of one week, and once a week is over, the actual index values are included in the training set before the model is trained again, and the forecasts for the next week are made. We present detailed results on the forecasting accuracies for all our proposed models. The results show that while all the models are very accurate in forecasting the NIFTY 50 open values, the univariate encoder decoder convolutional LSTM with the previous two weeks data as the input is the most accurate model. On the other hand, a univariate CNN model with previous one week data as the input is found to be the fastest model in terms of its execution speed.


title: Financial Data Analysis Using Expert Bayesian Framework For Bankruptcy Prediction

abstract: In recent years, bankruptcy forecasting has gained lot of attention from researchers as well as practitioners in the field of financial risk management. For bankruptcy prediction, various approaches proposed in the past and currently in practice relies on accounting ratios and using statistical modeling or machine learning methods. These models have had varying degrees of successes. Models such as Linear Discriminant Analysis or Artificial Neural Network employ discriminative classification techniques. They lack explicit provision to include prior expert knowledge. In this paper, we propose another route of generative modeling using Expert Bayesian framework. The biggest advantage of the proposed framework is an explicit inclusion of expert judgment in the modeling process. Also the proposed methodology provides a way to quantify uncertainty in prediction. As a result the model built using Bayesian framework is highly flexible, interpretable and intuitive in nature. The proposed approach is well suited for highly regulated or safety critical applications such as in finance or in medical diagnosis. In such cases accuracy in the prediction is not the only concern for decision makers. Decision makers and other stakeholders are also interested in uncertainty in the prediction as well as interpretability of the model. We empirically demonstrate these benefits of proposed framework on real world dataset using Stan, a probabilistic programming language. We found that the proposed model is either comparable or superior to the other existing methods. Also resulting model has much less False Positive Rate compared to many existing state of the art methods. The corresponding R code for the experiments is available at Github repository.


title: General higher-order majorization-minimization algorithms for (non)convex optimization

abstract: Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function so that along the iterations the objective function decreases. Such a simple principle allows to solve a large class of optimization problems, even nonconvex and nonsmooth. We propose a general higher-order majorization-minimization algorithmic framework for minimizing an objective function that admits an approximation (surrogate) such that the corresponding error function has a higher-order Lipschitz continuous derivative. We present convergence guarantees for our new method for general optimization problems with (non)convex and/or (non)smooth objective function. For convex (possibly nonsmooth) problems we provide global sublinear convergence rates, while for problems with uniformly convex objective function we obtain locally faster superlinear convergence rates. We also prove global stationary point guarantees for general nonconvex (possibly nonsmooth) problems and under Kurdyka-Lojasiewicz property of the objective function we derive local convergence rates ranging from sublinear to superlinear for our majorization-minimization algorithm. Moreover, for unconstrained nonconvex problems we derive convergence rates in terms of first- and second-order optimality conditions.


title: Mechanisms of Ti3Al precipitation in hcp alpha-Ti

abstract: Nucleation and growth of Ti$_3$Al \textalpha{}$_2$ ordered domains in \textalpha{}-Ti--Al--X alloys were characterised using a combination of transmission electron microscopy, atom probe tomography and small angle X-ray scattering. Model alloys based on Ti--7Al~(wt.\%) and containing O, V and Mo were aged at \SI{550}{\celsius} for times up to \SI{120}{\day} and the resulting precipitate dispersions were observed at intermediate points. Precipitates grew to around \SI{30}{\nano\metre} in size, with a volume fraction of 6--10\% depending on tertiary solutes. Interstitial O was found to increase the equilibrium volume fraction of \textalpha{}$_2$, while V and Mo showed relatively little influence. Addition of any of the solutes in this study, but most prominently Mo, was found to increase nucleation density and decrease precipitate size and possibly coarsening rate. Coarsening can be described by the Lifshitz-Slyozov-Wagner model, suggesting a matrix diffusion-controlled coarsening mechanism (rather than control by interfacial coherency). Solutionising temperature was found to affect nucleation number density with an activation energy of $E_{\mathrm{f}} = 1.5\pm{}0.4$~eV, supporting the hypothesis that vacancy concentration affects \textalpha{}$_2$ nucleation. The observation that all solutes increase nucleation number density is also consistent with a vacancy-controlled nucleation mechanism.


title: Rough pseudodifferential operators on Hardy spaces for Fourier integral operators

abstract: We prove mapping properties of pseudodifferential operators with rough symbols on Hardy spaces for Fourier integral operators. The symbols $a(x,\eta)$ are elements of $C^{r}_{*}S^{m}_{1,\delta}$ classes that have limited regularity in the $x$ variable. We show that the associated pseudodifferential operator $a(x,D)$ maps between Sobolev spaces $\mathcal{H}^{s,p}_{FIO}(\mathbb{R}^{n})$ and $\mathcal{H}^{t,p}_{FIO}(\mathbb{R}^{n})$ over the Hardy space for Fourier integral operators $\mathcal{H}^{p}_{FIO}(\mathbb{R}^{n})$. Our main result implies that for $m=0$, $\delta=1/2$ and $r>n-1$, $a(x,D)$ acts boundedly on $\mathcal{H}^{p}_{FIO}(\mathbb{R}^{n})$ for all $p\in(1,\infty)$.


title: Data-Driven Stabilization of Periodic Orbits

abstract: Periodic orbits are among the simplest non-equilibrium solutions to dynamical systems, and they play a significant role in our modern understanding of the rich structures observed in many systems. For example, it is known that embedded within any chaotic attractor are infinitely many unstable periodic orbits (UPOs) and so a chaotic trajectory can be thought of as `jumping' from one UPO to another in a seemingly unpredictable manner. A number of studies have sought to exploit the existence of these UPOs to control a chaotic system. These methods rely on introducing small, precise parameter manipulations each time the trajectory crosses a transverse section to the flow. Typically these methods suffer from the fact that they require a precise description of the Poincar\'e mapping for the flow, which is a difficult task since there is no systematic way of producing such a mapping associated to a given system. Here we employ recent model discovery methods for producing accurate and parsimonious parameter-dependent Poincar\'e mappings to stabilize UPOs in nonlinear dynamical systems. Specifically, we use the sparse identification of nonlinear dynamics (SINDy) method to frame model discovery as a sparse regression problem, which can be implemented in a computationally efficient manner. This approach provides an explicit Poincar\'e mapping that faithfully describes the dynamics of the flow in the Poincar\'e section and can be used to identify UPOs. For each UPO, we then determine the parameter manipulations that stabilize this orbit. The utility of these methods are demonstrated on a variety of differential equations, including the R\"ossler system in a chaotic parameter regime.


title: The scaling-law flows: An attempt at scaling-law vector calculus

abstract: In this paper, the scaling-law vector calculus, which is related to the connection between the vector calculus and the scaling law in fractal geometry, is addressed based on the Leibniz derivative and Stieltjes integral for the first time. The Gauss-Ostrogradsky-like theorem, Stokes-like theorem, Green-like theorem, and Green-like identities are considered in the sense of the scaling-law vector calculus. The Navier-Stokes-like equations are obtained in detail. The obtained result is as a potentially mathematical tool proposed to develop an important way of approaching this challenge for the scaling-law flows.


title: Expectile Neural Networks for Genetic Data Analysis of Complex Diseases

abstract: The genetic etiologies of common diseases are highly complex and heterogeneous. Classic statistical methods, such as linear regression, have successfully identified numerous genetic variants associated with complex diseases. Nonetheless, for most complex diseases, the identified variants only account for a small proportion of heritability. Challenges remain to discover additional variants contributing to complex diseases. Expectile regression is a generalization of linear regression and provides completed information on the conditional distribution of a phenotype of interest. While expectile regression has many nice properties and holds great promise for genetic data analyses (e.g., investigating genetic variants predisposing to a high-risk population), it has been rarely used in genetic research. In this paper, we develop an expectile neural network (ENN) method for genetic data analyses of complex diseases. Similar to expectile regression, ENN provides a comprehensive view of relationships between genetic variants and disease phenotypes and can be used to discover genetic variants predisposing to sub-populations (e.g., high-risk groups). We further integrate the idea of neural networks into ENN, making it capable of capturing non-linear and non-additive genetic effects (e.g., gene-gene interactions). Through simulations, we showed that the proposed method outperformed an existing expectile regression when there exist complex relationships between genetic variants and disease phenotypes. We also applied the proposed method to the genetic data from the Study of Addiction: Genetics and Environment(SAGE), investigating the relationships of candidate genes with smoking quantity.


title: Transversal flexoelectric coefficients for fifty select atomic monolayers from first principles

abstract: We calculate transversal flexoelectric coefficients along the principal directions for fifty select atomic monolayers using ab initio Density Functional Theory (DFT). Specifically, considering representative materials from each of Groups IV, III-V, V monolayers, transition metal dichalcogenides (TMDs), Group III monochalcogenides, Group IV monochalcogenides, transition metal trichalcogenides (TMTs), and Group V chalcogenides, we perform symmetry-adapted DFT simulations to calculate the flexoelectric coefficients at practically relevant bending curvatures. We find that the materials demonstrate linear behavior and have similar coefficients along both principal directions, with values for TMTs being up to a factor of five larger than graphene. In addition, we find electronic origins for the flexoelectric effect, which increases with monolayer thickness, elastic modulus along bending direction, and sum of polarizability of constituent atoms.


title: Incorporating Symbolic Domain Knowledge into Graph Neural Networks

abstract: Our interest is in scientific problems with the following characteristics: (1) Data are naturally represented as graphs; (2) The amount of data available is typically small; and (3) There is significant domain-knowledge, usually expressed in some symbolic form. These kinds of problems have been addressed effectively in the past by Inductive Logic Programming (ILP), by virtue of 2 important characteristics: (a) The use of a representation language that easily captures the relation encoded in graph-structured data, and (b) The inclusion of prior information encoded as domain-specific relations, that can alleviate problems of data scarcity, and construct new relations. Recent advances have seen the emergence of deep neural networks specifically developed for graph-structured data (Graph-based Neural Networks, or GNNs). While GNNs have been shown to be able to handle graph-structured data, less has been done to investigate the inclusion of domain-knowledge. Here we investigate this aspect of GNNs empirically by employing an operation we term "vertex-enrichment" and denote the corresponding GNNs as "VEGNNs". Using over 70 real-world datasets and substantial amounts of symbolic domain-knowledge, we examine the result of vertex-enrichment across 5 different variants of GNNs. Our results provide support for the following: (a) Inclusion of domain-knowledge by vertex-enrichment can significantly improve the performance of a GNN. That is, the performance VEGNNs is significantly better than GNNs across all GNN variants; (b) The inclusion of domain-specific relations constructed using ILP improves the performance of VEGNNs, across all GNN variants. Taken together, the results provide evidence that it is possible to incorporate symbolic domain knowledge into a GNN, and that ILP can play an important role in providing high-level relationships that are not easily discovered by a GNN.


title: An investigation of Modern Foreign Language (MFL) teachers and their cognitions of Computer Assisted Language Learning (CALL) amid the COVID-19 health pandemic

abstract: A study was performed with 33 Modern Foreign Language (MFL) teachers to afford insight into how classroom practitioners interact with Computer Assisted Language Learning (CALL) in Second Language (L2) pedagogy. A questionnaire with CALL specific statements was completed by MFL teachers who were recruited via UK based Facebook groups. Significantly, participants acknowledged a gap in practice from the expectation of CALL in the MFL classroom. Overall, respondents were shown to be interested and regular consumers of CALL who perceived its ease and importance in L2 teaching and learning.


title: Graph Contrastive Learning with Augmentations

abstract: Generalizable, transferrable, and robust representation learning on graph-structured data remains a challenge for current graph neural networks (GNNs). Unlike what has been developed for convolutional neural networks (CNNs) for image data, self-supervised learning and pre-training are less explored for GNNs. In this paper, we propose a graph contrastive learning (GraphCL) framework for learning unsupervised representations of graph data. We first design four types of graph augmentations to incorporate various priors. We then systematically study the impact of various combinations of graph augmentations on multiple datasets, in four different settings: semi-supervised, unsupervised, and transfer learning as well as adversarial attacks. The results show that, even without tuning augmentation extents nor using sophisticated GNN architectures, our GraphCL framework can produce graph representations of similar or better generalizability, transferrability, and robustness compared to state-of-the-art methods. We also investigate the impact of parameterized graph augmentation extents and patterns, and observe further performance gains in preliminary experiments. Our codes are available at https://github.com/Shen-Lab/GraphCL.


title: T$^2$-Net: A Semi-supervised Deep Model for Turbulence Forecasting

abstract: Accurate air turbulence forecasting can help airlines avoid hazardous turbulence, guide the routes that keep passengers safe, maximize efficiency, and reduce costs. Traditional turbulence forecasting approaches heavily rely on painstakingly customized turbulence indexes, which are less effective in dynamic and complex weather conditions. The recent availability of high-resolution weather data and turbulence records allows more accurate forecasting of the turbulence in a data-driven way. However, it is a non-trivial task for developing a machine learning based turbulence forecasting system due to two challenges: (1) Complex spatio-temporal correlations, turbulence is caused by air movement with complex spatio-temporal patterns, (2) Label scarcity, very limited turbulence labels can be obtained. To this end, in this paper, we develop a unified semi-supervised framework, T$^2$-Net, to address the above challenges. Specifically, we first build an encoder-decoder paradigm based on the convolutional LSTM to model the spatio-temporal correlations. Then, to tackle the label scarcity problem, we propose a novel Dual Label Guessing method to take advantage of massive unlabeled turbulence data. It integrates complementary signals from the main Turbulence Forecasting task and the auxiliary Turbulence Detection task to generate pseudo-labels, which are dynamically utilized as additional training data. Finally, extensive experimental results on a real-world turbulence dataset validate the superiority of our method on turbulence forecasting.


title: Relative Contrast Estimation and Inference for Treatment Recommendation

abstract: When there are resource constraints, it is important to rank or estimate treatment benefits according to patient characteristics. This facilitates prioritization of assigning different treatments. Most existing literature on individualized treatment rules targets absolute conditional treatment effect differences as the metric for benefits. However, there can be settings where relative differences may better represent such benefits. In this paper, we consider modeling such relative differences that form scale-invariant contrasts between conditional treatment effects. We show that all scale-invariant contrasts are monotonic transformations of each other. Therefore we posit a single index model for a particular relative contrast. Identifiability of the model is enforced via an intuitive $l_2$ norm constraint on index parameters. We then derive estimating equations and efficient scores via semiparametric efficiency theory. Based on the efficient score and its variant, we propose a two-step approach that consists of minimizing a doubly robust loss function and a subsequent one-step efficiency augmentation procedure to achieve efficiency bound. Careful theoretical and numerical studies are provided to show the superiority of the proposed approach.


title: Classifying Be star variability with TESS I: the southern ecliptic

abstract: TESS photometry is analyzed for 432 classical Be stars observed in the first year of the mission. The often complex and diverse variability of each object in this sample is classified to obtain an understanding of the behavior of this class as a population. 98\% of the systems are variable above the noise level, with timescales spanning nearly the entire range of what is accessible with TESS, from tens of minutes to tens of days. The variability seen with TESS is summarized as follows. Nearly every system contains multiple periodic signals in the frequency regime between about 0.5 -- 4 d$^{-1}$. One or more groups of closely-spaced frequencies is the most common feature, present in 85\% of the sample. Among the Be stars with brightening events that are characteristic of mass ejection episodes (17\% of the full sample, or 30\% of early-type stars), all have at least one frequency group, and the majority of these (83\%) show a concurrent temporary amplitude enhancement in one or more frequency groups. About one third of the sample is dominated by low frequency ($f < 0.5$ d$^{-1}$, and often much lower) variability. Stochastic signals are prominent in about 26\% of the sample, with varying degrees of intensity. Higher frequency signals ($6 < f < 15$ d$^{-1}$) are sometimes seen (in 14\% of the sample) and in most cases likely reflect p mode pulsation. In rare cases ($\sim$3\%), even higher frequencies beyond the traditional p mode regime ($f > 15$ d$^{-1}$) are observed.


title: Towards experiments with highly charged ions at HESR

abstract: The atomic physic collaboration SPARC is a part of the APPA pillar at the future Facility for Antiproton and Ion Research. It aims for atomic-physics research across virtually the full range of atomic matter. A research area of the atomic physics experiments is the study of the collision dynamics in strong electro-magnetic fields as well as the fundamental interactions between electrons and heavy nuclei at the HESR. Here we give a short overview about the central instruments for SPARC experiments at this storage ring.


title: EnckeHH: an integrator for gravitational dynamics with a dominant mass that achieves optimal error behaviour

abstract: We present EnckeHH, a new, highly accurate code for orbital dynamics of perturbed Keplerian systems such as planetary systems or galactic centre systems. It solves Encke's equations of motion, which assume perturbed Keplerian orbits. By incorporating numerical techniques, we have made the code follow optimal roundoff error growth. In a $10^ {12}$ day integration of the outer Solar System, EnckeHH was $3.5$ orders of magnitude more accurate than IAS15 in a fixed time step test. Adaptive steps are recommended for IAS15. Through study of efficiency plots, we show that EnckeHH reaches significantly higher accuracy than the Rebound integrators IAS15 and WHCKL for fixed step size.


title: Controlled Molecule Generator for Optimizing Multiple Chemical Properties

abstract: Generating a novel and optimized molecule with desired chemical properties is an essential part of the drug discovery process. Failure to meet one of the required properties can frequently lead to failure in a clinical test which is costly. In addition, optimizing these multiple properties is a challenging task because the optimization of one property is prone to changing other properties. In this paper, we pose this multi-property optimization problem as a sequence translation process and propose a new optimized molecule generator model based on the Transformer with two constraint networks: property prediction and similarity prediction. We further improve the model by incorporating score predictions from these constraint networks in a modified beam search algorithm. The experiments demonstrate that our proposed model outperforms state-of-the-art models by a significant margin for optimizing multiple properties simultaneously.


title: Modeling of Magneto-Rotational Stellar Evolution I. Method and first applications

abstract: While magnetic fields have long been considered to be important for the evolution of magnetic non-degenerate stars and compact stars, it has become clear in recent years that actually all of the stars are deeply affected. This is particularly true regarding their internal angular momentum distribution, but magnetic fields may also influence internal mixing processes and even the fate of the star. We propose a new framework for stellar evolution simulations, in which the interplay between magnetic field, rotation, mass loss, and changes in the stellar density and temperature distributions are treated self-consistently. For average large-scale stellar magnetic fields which are symmetric to the axis of rotation of the star, we derive 1D evolution equations for the toroidal and poloidal components from the mean-field MHD equation by applying Alfven's theorem, and a conservative form of the angular momentum transfer due to the Lorentz force is formulated. We implement our formalism into a numerical stellar evolution code and simulate the magneto-rotational evolution of 1.5 M$_\odot$ stars. The Lorentz force aided by the $\Omega$ effect imposes torsional Alfven waves propagating through the magnetized medium, leading to near-rigid rotation within the Alfven timescale. Our models with different initial spins and B-fields can reproduce the main observed properties of Ap/Bp stars. Calculations continued to the red-giant regime show a pronounced core-envelope coupling, which reproduces the core and surface rotation periods determined by asteroseismic observations.


title: Collision models can efficiently simulate any multipartite Markovian quantum dynamics

abstract: We introduce the multipartite collision model, defined in terms of elementary interactions between subsystems and ancillae, and show that it can simulate the Markovian dynamics of any multipartite open quantum system. We develop a method to estimate an analytical error bound for any repeated interactions model, and we use it to prove that the error of our scheme displays an optimal scaling. Finally, we provide a simple decomposition of the multipartite collision model into elementary quantum gates, and show that it is efficiently simulable on a quantum computer according to the dissipative quantum Church-Turing theorem, i.e. it requires a polynomial number of resources.


title: A Brief Note of Analyzing and Plotting $\nu_\mu$ Disappearance in SBN Detector under ROOT Framework

abstract: This is a brief technical note of analyzing the $\nu_\mu$ disappearance in SBN detector. We here provide a kind of method of plotting the histograms and the heat map plot. We will explore the properties via ROOT framework supported by CERN. The main language we used is C++.


title: Probing Task-Oriented Dialogue Representation from Language Models

abstract: This paper investigates pre-trained language models to find out which model intrinsically carries the most informative representation for task-oriented dialogue tasks. We approach the problem from two aspects: supervised classifier probe and unsupervised mutual information probe. We fine-tune a feed-forward layer as the classifier probe on top of a fixed pre-trained language model with annotated labels in a supervised way. Meanwhile, we propose an unsupervised mutual information probe to evaluate the mutual dependence between a real clustering and a representation clustering. The goals of this empirical paper are to 1) investigate probing techniques, especially from the unsupervised mutual information aspect, 2) provide guidelines of pre-trained language model selection for the dialogue research community, 3) find insights of pre-training factors for dialogue application that may be the key to success.


title: Non-Thermal Emergence of an Orbital-Selective Mott Phase in FeTe$_{1-x}$Se$_x$

abstract: Electronic correlation is of fundamental importance to high temperature superconductivity. Iron-based superconductors are believed to possess moderate correlation strength, which combined with their multi-orbital nature makes them a fascinating platform for the emergence of exotic phenomena. A particularly striking form is the emergence of an orbital selective Mott phase, where the localization of a subset of orbitals leads to a drastically reconstructed Fermi surface. Here, we report spectroscopic evidence of the reorganization of the Fermi surface from FeSe to FeTe as Se is substituted by Te. We uncover a particularly transparent way to visualize the localization of the $d_{xy}$ electron orbital through the suppression of its hybridization with the more coherent $d$ electron orbitals, which leads to a redistribution of the orbital-dependent spectral weight near the Fermi level. These noteworthy features of the Fermi surface are accompanied by a divergent behavior of a band renormalization in the $d_{xy}$ orbital. All of our observations are further supported by our theoretical calculations to be salient spectroscopic signatures of such a non-thermal evolution from a strongly correlated metallic phase towards an orbital-selective Mott phase in FeTe$_{1-x}$Se$_x$ as Se concentration is reduced.


title: Processing of incomplete images by (graph) convolutional neural networks

abstract: We investigate the problem of training neural networks from incomplete images without replacing missing values. For this purpose, we first represent an image as a graph, in which missing pixels are entirely ignored. The graph image representation is processed using a spatial graph convolutional network (SGCN) -- a type of graph convolutional networks, which is a proper generalization of classical CNNs operating on images. On one hand, our approach avoids the problem of missing data imputation while, on the other hand, there is a natural correspondence between CNNs and SGCN. Experiments confirm that our approach performs better than analogical CNNs with the imputation of missing values on typical classification and reconstruction tasks.


title: The investor problem based on the HJM model

abstract: We consider a consumption-investment problem (both on finite and infinite time horizon) in which the investor has an access to the bond market. In our approach prices of bonds with different maturities are described by the general HJM factor model. We assume that the bond market consists of entire family of rolling bonds and the investment strategy is a general signed measure distributed on all real numbers representing time to maturity specifications for different rolling bonds. In particular, we can consider portfolio of coupon bonds. The investor's objective is to maximize time-additive utility of the consumption process. We solve the problem by means of the HJB equation for which we prove required regularity of its solution and all required estimates to ensure applicability of the verification theorem. Explicit calculations for affine models are presented.


title: Commutativity preserving transformations on conjugacy classes of compact self-adjoint operators

abstract: Let $H$ be a complex Hilbert space of dimension not less than $3$ and let ${\mathcal C}$ be a conjugacy class of compact self-adjoint operators on $H$. Suppose that the dimension of the kernels of operators from ${\mathcal C}$ not less than the dimension of their ranges. In the case when ${\mathcal C}$ is formed by operators of finite rank $k$ and $\dim H=2k$, we assume that $k\ge 4$. We show that every bijective transformation of C preserving the commutativity in both directions is induced by a unitary or anti-unitary operator up to a permutation of eigenspaces of the same dimension.


title: An exploratory study on machine learning to couple numerical solutions of partial differential equations

abstract: As further progress in the accurate and efficient computation of coupled partial differential equations (PDEs) becomes increasingly difficult, it has become highly desired to develop new methods for such computation. In deviation from conventional approaches, this short communication paper explores a computational paradigm that couples numerical solutions of PDEs via machine-learning (ML) based methods, together with a preliminary study on the paradigm. Particularly, it solves PDEs in subdomains as in a conventional approach but develops and trains artificial neural networks (ANN) to couple the PDEs' solutions at their interfaces, leading to solutions to the PDEs in the whole domains. The concepts and algorithms for the ML coupling are discussed using coupled Poisson equations and coupled advection-diffusion equations. Preliminary numerical examples illustrate the feasibility and performance of the ML coupling. Although preliminary, the results of this exploratory study indicate that the ML paradigm is promising and deserves further research.


title: A Robinson-Schensted Correspondence for Partial Permutations

abstract: We study the Steinberg variety associated to matrix Schubert varieties, and develop a Robinson-Schensted type correspondence, $\tau\leftrightarrow(\Lambda,\mathsf Q,\mathsf P)$. Here $\tau$ is a partial permutation of size $p\times q$, $\Lambda$ an admissible signed Young diagram of size $p+q$, and $\mathsf P$ (resp. $\mathsf Q$) a standard Young tableau of size $p$ (resp. $q$) whose shape is determined by $\Lambda$. By embedding the matrix Schubert variety into a Schubert variety, we find a close relationship between the combinatorics of the classical Robinson-Schensted-Knuth correspondence and our bijection. We also show that an involution $(\Lambda,\mathsf Q,\mathsf P)\mapsto(\Lambda^\vee,\mathsf P,\mathsf Q)$ corresponds to projective duality on matrix Schubert varieties.


title: Extension of the Hauser-Feshbach Fission Fragment Decay Model to Multi-Chance Fission

abstract: The Hauser-Feshbach fission fragment decay model, $\mathtt{HF^3D}$, which calculates the statistical decay of fission fragments, has been expanded to include multi-chance fission, up to neutron incident energies of 20 MeV. The deterministic decay takes as input pre-scission quantities - fission probabilities and the average energy causing fission - and post-scission quantities - yields in mass, charge, total kinetic energy, spin, and parity. From these fission fragment initial conditions, the full decay is followed through both prompt and delayed particle emissions, allowing for the calculation of prompt neutron and $\gamma$ properties, such as multiplicity and energy distributions, both independent and cumulative fission yields, and delayed neutron observables. In this work, we describe the implementation of multi-chance fission into the $\mathtt{HF^3D}$ model, and show an example of prompt and delayed quantities beyond first-chance fission, using the example of neutron-induced fission on $^{235}$U. This expansion represents significant progress in consistently modeling the emission of prompt and delayed particles from fissile systems.


title: Improving Limited Labeled Dialogue State Tracking with Self-Supervision

abstract: Existing dialogue state tracking (DST) models require plenty of labeled data. However, collecting high-quality labels is costly, especially when the number of domains increases. In this paper, we address a practical DST problem that is rarely discussed, i.e., learning efficiently with limited labeled data. We present and investigate two self-supervised objectives: preserving latent consistency and modeling conversational behavior. We encourage a DST model to have consistent latent distributions given a perturbed input, making it more robust to an unseen scenario. We also add an auxiliary utterance generation task, modeling a potential correlation between conversational behavior and dialogue states. The experimental results show that our proposed self-supervised signals can improve joint goal accuracy by 8.95\% when only 1\% labeled data is used on the MultiWOZ dataset. We can achieve an additional 1.76\% improvement if some unlabeled data is jointly trained as semi-supervised learning. We analyze and visualize how our proposed self-supervised signals help the DST task and hope to stimulate future data-efficient DST research.


title: Bayesian Fusion of Data Partitioned Particle Estimates

abstract: We present a Bayesian data fusion method to approximate a posterior distribution from an ensemble of particle estimates that only have access to subsets of the data. Our approach relies on approximate probabilistic inference of model parameters through Monte Carlo methods, followed by an update and resample scheme related to multiple importance sampling to combine information from the initial estimates. We show the method is convergent in the particle limit and directly suited to application on multi-sensor data fusion problems by demonstrating efficacy on a multi-sensor Keplerian orbit determination problem and a bearings-only tracking problem.


title: $p$-form gauge fields: charges and memories

abstract: In this thesis, we study the asymptotic structure of $p$-form theories on flat space. $p$-form theories are generalizations of Maxwell's theory of electrodynamics in which the gauge potential is a higher-rank differential form. As in the Maxwell theory, there is a choice of boundary conditions with an infinite-dimensional asymptotic symmetry group. For higher $p$-form theories on $(2p+2)$-dimensional flat spacetime, the surface charges are classified by the Hodge decomposition of gauge parameters on $2p$-sphere into exact and co-exact charges. For the exact parameters which are special features of higher-form theories, the surface charges are non-commuting. In presence of $p$-branes, there are non-trivial zero-mode charges analogous to the electric charge for point particles. Although our $p$-form discussion is restricted to $2p+2$ dimensions, we generalize the study of Maxwell theory not only to general dimensions but also to the anti-de Sitter background. Finally, motivated by the IR triangle of gauge theories that relate asymptotic symmetries, memory effects, and soft theorems, we introduce a new kind of memory effect exerted on the internal modes of closed and open strings. On closed string probes, soft 2-form radiation rotates left- and right-moving modes oppositely, which amounts to a unit shift in the spin of probe particles. This provides the first instance of an `internal memory effect' on a non-local object. We conclude by general remarks on the physical significance of soft modes.


title: Hydrodynamics of tandem flapping pectoral fins with varying stroke phase offsets

abstract: We show how phasing between tandem bioinspired fins flapping at high-stroke amplitudes modulates rear fin thrust production and wake characteristics. Load cell thrust measurements show that the rear fin generates 25% more thrust than the front fin when it lags the latter by a quarter cycle, and performs 8% worse when it leads the front fin by the same amount. The flow interactions between the fins responsible for these observations are analyzed using two-dimensional particle image velocimetry measurements and three-dimensional computational fluid dynamics simulations. Distributions of velocity elucidate variations in the effective flow induced on the rear fin for different phase offsets. Vortex structure interactions and particle rakes reveal the contributions of the leading- and trailing-edge vortices shed by the front fin in modulating the suction at the rear fin leading edge. Furthermore, the wake structure far downstream of the fins changes in its coherence, axial and radial extents for the different phase offsets. These findings are relevant for the design and performance optimization of various unmanned underwater vehicles that utilize such tandem systems.


title: Benchmarking Deep Learning Interpretability in Time Series Predictions

abstract: Saliency methods are used extensively to highlight the importance of input features in model predictions. These methods are mostly used in vision and language tasks, and their applications to time series data is relatively unexplored. In this paper, we set out to extensively compare the performance of various saliency-based interpretability methods across diverse neural architectures, including Recurrent Neural Network, Temporal Convolutional Networks, and Transformers in a new benchmark of synthetic time series data. We propose and report multiple metrics to empirically evaluate the performance of saliency methods for detecting feature importance over time using both precision (i.e., whether identified features contain meaningful signals) and recall (i.e., the number of features with signal identified as important). Through several experiments, we show that (i) in general, network architectures and saliency methods fail to reliably and accurately identify feature importance over time in time series data, (ii) this failure is mainly due to the conflation of time and feature domains, and (iii) the quality of saliency maps can be improved substantially by using our proposed two-step temporal saliency rescaling (TSR) approach that first calculates the importance of each time step before calculating the importance of each feature at a time step.


title: Precise Subtyping for Asynchronous Multiparty Sessions

abstract: This paper presents the first formalisation of the precise subtyping relation for asynchronous multiparty sessions. We show that our subtyping relation is sound (i.e., guarantees safe process replacement) and also complete: any extension of the relation is unsound. To achieve our results, we develop a novel session decomposition technique, from full session types (including internal/external choices) into single input/output session trees (without choices). Previous work studies precise subtyping for binary sessions (with just two participants), or multiparty sessions (with any number of participants) and synchronous interaction. Here, we cover multiparty sessions with asynchronous interaction, where messages are transmitted via FIFO queues (as in the TCP/IP protocol), and prove that our subtyping is both operationally and denotationally precise. In the asynchronous multiparty setting, finding the precise subtyping relation is a highly complex task: this is because, under some conditions, participants can permute the order of their inputs and outputs, by sending some messages earlier or receiving some later, without causing errors; the precise subtyping relation must capture all such valid permutations -- and consequently, its formalisation, reasoning and proofs become challenging. Our session decomposition technique overcomes this complexity, expressing the subtyping relation as a composition of refinement relations between single input/output trees, and providing a simple reasoning principle for asynchronous message optimisations.


title: Client-Server Sessions in Linear Logic

abstract: We introduce coexponentials, a new set of modalities for Classical Linear Logic. As duals to exponentials, the coexponentials codify a distributed form of the structural rules of weakening and contraction. This makes them a suitable logical device for encapsulating the pattern of a server receiving requests from an arbitrary number of clients on a single channel. Guided by this intuition we formulate a system of session types based on Classical Linear Logic with coexponentials, which is suited to modelling client-server interactions. We also present a session-typed functional programming language for server-client programming, which we translate to our system of coexponentials.


title: A novel variational form of the Schatten-$p$ quasi-norm

abstract: The Schatten-$p$ quasi-norm with $p\in(0,1)$ has recently gained considerable attention in various low-rank matrix estimation problems offering significant benefits over relevant convex heuristics such as the nuclear norm. However, due to the nonconvexity of the Schatten-$p$ quasi-norm, minimization suffers from two major drawbacks: 1) the lack of theoretical guarantees and 2) the high computational cost which is demanded for the minimization task even for trivial tasks such as finding stationary points. In an attempt to reduce the high computational cost induced by Schatten-$p$ quasi-norm minimization, variational forms, which are defined over smaller-size matrix factors whose product equals the original matrix, have been proposed. Here, we propose and analyze a novel variational form of Schatten-$p$ quasi-norm which, for the first time in the literature, is defined for any continuous value of $p\in(0,1]$ and decouples along the columns of the factorized matrices. The proposed form can be considered as the natural generalization of the well-known variational form of the nuclear norm to the nonconvex case i.e., for $p\in(0,1)$. The resulting formulation gives way to SVD-free algorithms thus offering lower computational complexity than the one that is induced by the original definition of the Schatten-$p$ quasi-norm. A local optimality analysis is provided which shows~that we can arrive at a local minimum of the original Schatten-$p$ quasi-norm problem by reaching a local minimum of the matrix factorization based surrogate problem. In addition, for the case of the squared Frobenius loss with linear operators obeying the restricted isometry property (RIP), a rank-one update scheme is proposed, which offers a way to escape poor local minima. Finally, the efficiency of our approach is empirically shown on a matrix completion problem.


title: Risk Preferences and Efficiency of Household Portfolios

abstract: We propose a novel approach to infer investors' risk preferences from their portfolio choices, and then use the implied risk preferences to measure the efficiency of investment portfolios. We analyze a dataset spanning a period of six years, consisting of end of month stock trading records, along with investors' demographic information and self-assessed financial knowledge. Unlike estimates of risk aversion based on the share of risky assets, our statistical analysis suggests that the implied risk aversion coefficient of an investor increases with her wealth and financial literacy. Portfolio diversification, Sharpe ratio, and expected portfolio returns correlate positively with the efficiency of the portfolio, whereas a higher standard deviation reduces the efficiency of the portfolio. We find that affluent and financially educated investors as well as those holding retirement related accounts hold more efficient portfolios.


title: HarperValleyBank: A Domain-Specific Spoken Dialog Corpus

abstract: We introduce HarperValleyBank, a free, public domain spoken dialog corpus. The data simulate simple consumer banking interactions, containing about 23 hours of audio from 1,446 human-human conversations between 59 unique speakers. We selected intents and utterance templates to allow realistic variation while controlling overall task complexity and limiting vocabulary size to about 700 unique words. We provide audio data along with transcripts and annotations for speaker identity, caller intent, dialog actions, and emotional valence. The data size and domain specificity makes for quick transcription experiments with modern end-to-end neural approaches. Further, we provide baselines for representation learning, adapting recent work to embed waveforms for downstream prediction tasks. Our experiments show that tasks using our annotations are sensitive to both the model choice and corpus size.


title: Promotion and Cyclic Sieving on Rectangular $\delta$-Semistandard Tableaux

abstract: Let $\delta=(\delta_1,\ldots,\delta_n)$ be a string of letters $h$ and $v$. We define a Young tableau to be $\delta$-semistandard if the entries are weakly increasing along rows and columns, and the entries $i$ form a horizontal strip if $\delta_i=h$ and a vertical strip if $\delta_i=v$. We define $\delta$-promotion on such tableaux via a modified jeu-de-taquin. The first main result is that $\delta$-promotion has period $n$ on rectangular $\delta$-semistandard tableaux, generalizing the results of Haiman and Rhoades for standard and semistandard tableaux. The second main result states that the set of rectangular $\delta$-semistandard tableaux for fixed $\delta$ and content $\gamma$ exhibits the cyclic sieving phenomenon with the generalized Kostka polynomial. To do so we follow Fontaine-Kamnitzer and associate to $(\delta,\gamma)$ an $SL_m$-invariant space Inv$(V_{\lambda^1}\otimes\cdots\otimes V_{\lambda^n})$ where each $V_{\lambda^i}$ is an alternating or symmetric representation. We show that the Satake basis of the corresponding invariant space is indexed by the set of tableaux corresponding to $(\delta,\gamma)$ and is permuted by rotation of tensor factors. We then diagonalize the rotation action using the fusion product. This cyclic sieving generalizes the result of Rhoades, and of Fontaine-Kamnitzer (in type A), and is closely related to that of Westbury.


title: Field-induced quantum critical point in the new itinerant antiferromagnet Ti$_3$Cu$_4$

abstract: New phases of matter emerge at the edge of magnetic instabilities. In local moment systems, such as heavy fermions, the magnetism can be destabilized by pressure, chemical doping, and, rarely, by magnetic field, towards a zero-temperature transition at a quantum critical point (QCP). Even more rare are instances of QCPs induced by pressure or doping in itinerant moment systems, with no known examples of analogous field-induced \textit{T} = 0 transitions. Here we report the discovery of a new itinerant antiferromagnet with no magnetic constituents, in single crystals of Ti$_3$Cu$_4$ with $T_N$ = 11.3 K. Band structure calculations point to an orbital-selective, spin density wave ground state, a consequence of the square net structural motif in Ti$_3$Cu$_4$. A small magnetic field, $H_C$ = 4.87 T, suppresses the long-range order via a continuous second-order transition, resulting in a field-induced QCP. The magnetic Gr\"uneisen ratio diverges as $H \rightarrow H_C$ and $T\rightarrow0$, with a sign change at $H_C$ and $T^{-1}$ scaling at $H~=~H_C$, providing evidence from thermodynamic measurements for quantum criticality for $H \parallel c$. Non-Fermi liquid (NFL) to Fermi liquid (FL) crossover is observed close to the QCP, as revealed by the power law behavior of the electrical resistivity.


title: Hausdorff dimension of sets of numbers with large L\"uroth elements

abstract: L\"uroth series, like regular continued fractions, provide an interesting identification of real numbers with infinite sequences of integers. These sequences give deep arithmetic and measure-theoretic properties of subsets of numbers according to their growth. Although different, regular continued fractions and L\"uroth series share several properties. In this paper, we explore one similarity by estimating the Hausdorff dimension of subsets of real numbers whose L\"uroth expansion grows at a definite rate. This is an extension of a result of Y. Sun and J. Wu to the context of L\"uroth series. It was recently shown by Y. Feng, B. Tan, and Q.-L. Zhou that the lower bound in our main theorem is actually an equality.


title: Memorizing without overfitting: Bias, variance, and interpolation in over-parameterized models

abstract: The bias-variance trade-off is a central concept in supervised learning. In classical statistics, increasing the complexity of a model (e.g., number of parameters) reduces bias but also increases variance. Until recently, it was commonly believed that optimal performance is achieved at intermediate model complexities which strike a balance between bias and variance. Modern Deep Learning methods flout this dogma, achieving state-of-the-art performance using "over-parameterized models" where the number of fit parameters is large enough to perfectly fit the training data. As a result, understanding bias and variance in over-parameterized models has emerged as a fundamental problem in machine learning. Here, we use methods from statistical physics to derive analytic expressions for bias and variance in two minimal models of over-parameterization (linear regression and two-layer neural networks with nonlinear data distributions), allowing us to disentangle properties stemming from the model architecture and random sampling of data. In both models, increasing the number of fit parameters leads to a phase transition where the training error goes to zero and the test error diverges as a result of the variance (while the bias remains finite). Beyond this threshold, the test error of the two-layer neural network decreases due to a monotonic decrease in \emph{both} the bias and variance in contrast with the classical bias-variance trade-off. We also show that in contrast with classical intuition, over-parameterized models can overfit even in the absence of noise and exhibit bias even if the student and teacher models match. We synthesize these results to construct a holistic understanding of generalization error and the bias-variance trade-off in over-parameterized models and relate our results to random matrix theory.


title: Accelerate the Warm-up Stage in the Lasso Computation via a Homotopic Approach

abstract: In optimization, it is known that when the objective functions are strictly convex and well-conditioned, gradient-based approaches can be extremely effective, e.g., achieving the exponential rate of convergence. On the other hand, the existing Lasso-type estimator in general cannot achieve the optimal rate due to the undesirable behavior of the absolute function at the origin. A homotopic method is to use a sequence of surrogate functions to approximate the $\ell_1$ penalty that is used in the Lasso-type of estimators. The surrogate functions will converge to the $\ell_1$ penalty in the Lasso estimator. At the same time, each surrogate function is strictly convex, which enables a provable faster numerical rate of convergence. In this paper, we demonstrate that by meticulously defining the surrogate functions, one can prove a faster numerical convergence rate than any existing methods in computing for the Lasso-type of estimators. Namely, the state-of-the-art algorithms can only guarantee $O(1/\epsilon)$ or $O(1/\sqrt{\epsilon})$ convergence rates, while we can prove an $O([\log(1/\epsilon)]^2)$ for the newly proposed algorithm. Our numerical simulations show that the new algorithm also performs better empirically.


title: A discretize-then-map approach for the treatment of parameterized geometries in model order reduction

abstract: We present a general approach for the treatment of parameterized geometries in projection-based model order reduction. During the offline stage, given (i) a family of parameterized domains $\{ \Omega_{\mu}: \mu \in \mathcal{P} \} \subset \mathbb{R}^D$ where $\mu \in \mathcal{P} \subset \mathbb{R}^P$ denotes a vector of parameters, (ii) a parameterized mapping ${\Phi}_{\mu}$ between a reference domain $\Omega$ and the parameter-dependent domain $\Omega_{\mu}$, and (iii) a finite element triangulation of $\Omega$, we resort to an empirical quadrature procedure to select a subset of the elements of the grid. During the online stage, we first use the mapping to "move" the nodes of the selected elements and then we use standard element-wise residual evaluation routines to evaluate the residual and possibly its Jacobian. We discuss how to devise an online-efficient reduced-order model and we discuss the differences with the more standard "map-then-discretize" approach (e.g., Rozza, Huynh, Patera, ACME, 2007); in particular, we show how the discretize-then-map framework greatly simplifies the implementation of the reduced-order model. We apply our approach to a two-dimensional potential flow problem past a parameterized airfoil, and to the two-dimensional RANS simulations of the flow past the Ahmed body.


title: A 2D Surgical Simulation Framework for Tool-Tissue Interaction

abstract: The control and task automation of robotic surgical system is very challenging, especially in soft tissue manipulation, due to the unpredictable deformations. Thus, an accurate simulator of soft tissues with the ability of interacting with robot manipulators is necessary. In this work, we propose a novel 2D simulation framework for tool-tissue interaction. This framework continuously tracks the motion of manipulator and simulates the tissue deformation in presence of collision detection. The deformation energy can be computed for the control and planning task.


title: Consumer Theory with Non-Parametric Taste Uncertainty and Individual Heterogeneity

abstract: We introduce two models of non-parametric random utility for demand systems: the stochastic absolute risk aversion (SARA) model, and the stochastic safety-first (SSF) model. In each model, individual-level heterogeneity is characterized by a distribution $\pi\in\Pi$ of taste parameters, and heterogeneity across consumers is introduced using a distribution $F$ over the distributions in $\Pi$. Demand is non-separable and heterogeneity is infinite-dimensional. Both models admit corner solutions. We consider two frameworks for estimation: a Bayesian framework in which $F$ is known, and a hyperparametric (or empirical Bayesian) framework in which $F$ is a member of a known parametric family. Our methods are illustrated by an application to a large U.S. panel of scanner data on alcohol consumption.


title: Neural Unsigned Distance Fields for Implicit Function Learning

abstract: In this work we target a learnable output representation that allows continuous, high resolution outputs of arbitrary shape. Recent works represent 3D surfaces implicitly with a Neural Network, thereby breaking previous barriers in resolution, and ability to represent diverse topologies. However, neural implicit representations are limited to closed surfaces, which divide the space into inside and outside. Many real world objects such as walls of a scene scanned by a sensor, clothing, or a car with inner structures are not closed. This constitutes a significant barrier, in terms of data pre-processing (objects need to be artificially closed creating artifacts), and the ability to output open surfaces. In this work, we propose Neural Distance Fields (NDF), a neural network based model which predicts the unsigned distance field for arbitrary 3D shapes given sparse point clouds. NDF represent surfaces at high resolutions as prior implicit models, but do not require closed surface data, and significantly broaden the class of representable shapes in the output. NDF allow to extract the surface as very dense point clouds and as meshes. We also show that NDF allow for surface normal calculation and can be rendered using a slight modification of sphere tracing. We find NDF can be used for multi-target regression (multiple outputs for one input) with techniques that have been exclusively used for rendering in graphics. Experiments on ShapeNet show that NDF, while simple, is the state-of-the art, and allows to reconstruct shapes with inner structures, such as the chairs inside a bus. Notably, we show that NDF are not restricted to 3D shapes, and can approximate more general open surfaces such as curves, manifolds, and functions. Code is available for research at https://virtualhumans.mpi-inf.mpg.de/ndf/.


title: Near-maxima of the two-dimensional Discrete Gaussian Free Field

abstract: We consider the Discrete Gaussian Free Field (DGFF) in domains $D_N\subseteq\mathbb Z^2$ arising, via scaling by $N$, from nice domains $D\subseteq\mathbb R^2$. We study the statistics of the values order $\sqrt{\log N}$ below the absolute maximum. Encoded as a point process on $D\times\mathbb R$, the scaled spatial distribution of these near-extremal level sets in $D_N$ and the field values (in units of $\sqrt{\log N}$ below the absolute maximum) tends, as $N\to\infty$, in law to the product of the critical Liouville Quantum Gravity (cLQG) $Z^D$ and the Rayleigh law. The convergence holds jointly with the extremal process, for which $Z^D$ enters as the intensity measure of the limiting Poisson point process, and that of the DGFF itself; the cLQG defined by the limit field then coincides with $Z^D$. While the limit near-extremal process is measurable with respect to the limit continuum GFF, the limit extremal process is not. Our results explain why the various ways to "norm" the lattice cLQG measure lead to the same limit object, modulo overall normalization.


title: A measurement-based variational quantum eigensolver

abstract: Variational quantum eigensolvers (VQEs) combine classical optimization with efficient cost function evaluations on quantum computers. We propose a new approach to VQEs using the principles of measurement-based quantum computation. This strategy uses entagled resource states and local measurements. We present two measurement-based VQE schemes. The first introduces a new approach for constructing variational families. The second provides a translation of circuit-based to measurement-based schemes. Both schemes offer problem-specific advantages in terms of the required resources and coherence times.


title: Dynamically incoherent surface endomorphisms

abstract: We explicitly construct a dynamically incoherent partially hyperbolic endomorphisms of $\mathbb{T}^2$ in the homotopy class of any linear expanding map with integer eigenvalues. These examples exhibit branching of centre curves along countably many circles, and thus exhibit a form of coherence that has not been observed for invertible systems.


title: Exploiting the Nonlinear Stiffness of TMP Origami Folding to Enhance Robotic Jumping Performance

abstract: Via numerical simulation and experimental assessment, this study examines the use of origami folding to develop robotic jumping mechanisms with tailored nonlinear stiffness to improve dynamic performance. Specifically, we use Tachi-Miura Polyhedron (TMP) bellow origami -- which exhibits a nonlinear "strain-softening" force-displacement curve -- as a jumping robotic skeleton with embedded energy storage. TMP's nonlinear stiffness allows it to store more energy than a linear spring and offers improved jumping height and airtime. Moreover, the nonlinearity can be tailored by directly changing the underlying TMP crease geometry. A critical challenge is to minimize the TMP's hysteresis and energy loss during its compression stage right before jumping. So we used the plastically annealed lamina emergent origami (PALEO) concept to modify the TMP creases. PALEO increases the folding limit before plastic deformation occurs, thus improving the overall strain energy retention. Jumping experiments confirmed that a nonlinear TMP mechanism achieved roughly 9% improvement in air time and a 13% improvement in jumping height compared to a "control" TMP sample with a relatively linear stiffness. This study's results validate the advantages of using origami in robotic jumping mechanisms and demonstrate the benefits of utilizing nonlinear spring elements for improving jumping performance. Therefore, they could foster a new family of energetically efficient jumping mechanisms with optimized performance in the future.


title: Interior Point Solving for LP-based prediction+optimisation

abstract: Solving optimization problems is the key to decision making in many real-life analytics applications. However, the coefficients of the optimization problems are often uncertain and dependent on external factors, such as future demand or energy or stock prices. Machine learning (ML) models, especially neural networks, are increasingly being used to estimate these coefficients in a data-driven way. Hence, end-to-end predict-and-optimize approaches, which consider how effective the predicted values are to solve the optimization problem, have received increasing attention. In case of integer linear programming problems, a popular approach to overcome their non-differentiabilty is to add a quadratic penalty term to the continuous relaxation, such that results from differentiating over quadratic programs can be used. Instead we investigate the use of the more principled logarithmic barrier term, as widely used in interior point solvers for linear programming. Specifically, instead of differentiating the KKT conditions, we consider the homogeneous self-dual formulation of the LP and we show the relation between the interior point step direction and corresponding gradients needed for learning. Finally our empirical experiments demonstrate our approach performs as good as if not better than the state-of-the-art QPTL (Quadratic Programming task loss) formulation of Wilder et al. and SPO approach of Elmachtoub and Grigas.


title: Reading Between the Lines: Exploring Infilling in Visual Narratives

abstract: Generating long form narratives such as stories and procedures from multiple modalities has been a long standing dream for artificial intelligence. In this regard, there is often crucial subtext that is derived from the surrounding contexts. The general seq2seq training methods render the models shorthanded while attempting to bridge the gap between these neighbouring contexts. In this paper, we tackle this problem by using \textit{infilling} techniques involving prediction of missing steps in a narrative while generating textual descriptions from a sequence of images. We also present a new large scale \textit{visual procedure telling} (ViPT) dataset with a total of 46,200 procedures and around 340k pairwise images and textual descriptions that is rich in such contextual dependencies. Generating steps using infilling technique demonstrates the effectiveness in visual procedures with more coherent texts. We conclusively show a METEOR score of 27.51 on procedures which is higher than the state-of-the-art on visual storytelling. We also demonstrate the effects of interposing new text with missing images during inference. The code and the dataset will be publicly available at https://visual-narratives.github.io/Visual-Narratives/.


title: Overdetermined problems for fully nonlinear equations in space forms

abstract: We study overdetermined problems for fully nonlinear elliptic equations in subdomains $\O$ of the Euclidean sphere $\mathbb{S}^{N}$ and the hyperbolic space $\mathbb{H}^{N}$. We prove, the existence of a classical solution to the underlined equation forces $\O$ to be a geodesic ball in the ambient space. Our result extends to fully nonlinear equations, a similar result in the case of semilinear equations with the Laplace operator due to Kumaresan and Prajapat.


title: The bound-state solutions of the one-dimensional hydrogen atom

abstract: The one-dimensional hydrogen atom is an intriguing quantum mechanics problem that exhibits several properties which have been continually debated. In particular, there has been variance as to whether or not even-parity solutions exist, and specifically whether or not the ground state is an even-parity state with infinite negative energy. We study a "regularized" version of this system, where the potential is a constant in the vicinity of the origin, and we discuss the even- and odd-parity solutions for this regularized one-dimensional hydrogen atom. We show how the even-parity states, with the exception of the ground state, converge to the same functional form and become degenerate for $x > 0$ with the odd-parity solutions as the cutoff approaches zero. This differs with conclusions derived from analysis of the singular (i.e., without regularization) one-dimensional Coulomb potential, where even-parity solutions are absent from the spectrum.


title: Descriptive complexity in Cantor series

abstract: A Cantor series expansion for a real number $x$ with respect to a basic sequence $Q=(q_1,q_2,\dots)$, where $q_i \geq 2$, is a representation of the form $x=a_0 + \sum_{i=1}^\infty \frac{a_i}{q_1q_2\cdots q_i}$ where $0 \leq a_i<q_i$. These generalize ordinary base $b$ expansions where $q_i=b$. Ki and Linton showed that for ordinary base $b$ expansions the set of normal numbers is a $\boldsymbol{\Pi}^0_3$-complete set, establishing the exact complexity of this set. In the case of Cantor series there are three natural notions of normality: normality, ratio normality,and distribution normality (these notions are equivalent for base $b$ expansions). We show that for any $Q$ the set $\mathscr{DN}(Q)$ of distribution normal number is $\boldsymbol{\Pi}^0_3$-complete, and if $Q$ is $1$-divergent (i.e., $\sum_{i=1}^\infty \frac{1}{q_i}$ diverges) then the sets $\mathscr{N}(Q)$ and $\mathscr{RN}(Q)$ of normal and ratio normal numbers are $\boldsymbol{\Pi}^0_3$-complete. We further show that all five non-trivial differences of these sets are $D_2(\boldsymbol{\Pi}^0_3)$-complete if $\lim_i q_i=\infty$ and $Q$ is $1$-divergent (the trivial case is $\mathscr{N}(Q)\setminus \mathscr{RN}(Q)=\emptyset$). This shows that except for the containment $\mathscr{N}(Q)\subseteq \mathscr{RN}(Q)$, these three notions are as independent as possible.


title: On the stability of the open-string QED neutron and dark matter

abstract: We study the stability of a hypothetical QED neutron, which consists of a color-singlet system of two $d$ quarks and a $u$ quark interacting with the QED interaction. As a quark cannot be isolated, the intrinsic motion of the three quarks in the lowest-energy state may lie predominantly in 1+1 dimensions, as in a $d$-$u$-$d$ open string. The attractive $d$-$u$ and $u$-$d$ QED interactions may overcome the weaker repulsive $d$-$d$ QED interaction to bind the three quarks together. We examine the QED neutron in a phenomenological three-body problem in 1+1 dimensions with an effective interaction extracted from Schwinger's exact QED solution in 1+1 dimensions. The phenomenological model in a variational calculation yields a stable QED neutron at 44.5 MeV. The analogous QED proton with two $u$ quarks and a $d$ quark has been found to be too repulsive to be stable and does not have a bound or continuum state, onto which the QED neutron can decay via the weak interaction. Consequently, the QED neutron is stable against the weak decay, has a long lifetime, and is in fact a QED dark neutron. It may be produced following the deconfinement-to-confinement phase transition of the quark gluon plasma in high-energy heavy-ion collisions. Because of the long lifetime of the QED dark neutron, self-gravitating assemblies of QED dark neutrons or dark antineutrons may be good candidates for a part of the primordial dark matter produced during the phase transition of the quark gluon plasma in the evolution of the early Universe.


title: KFC: A Scalable Approximation Algorithm for $k$-center Fair Clustering

abstract: In this paper, we study the problem of fair clustering on the $k-$center objective. In fair clustering, the input is $N$ points, each belonging to at least one of $l$ protected groups, e.g. male, female, Asian, Hispanic. The objective is to cluster the $N$ points into $k$ clusters to minimize a classical clustering objective function. However, there is an additional constraint that each cluster needs to be fair, under some notion of fairness. This ensures that no group is either "over-represented" or "under-represented" in any cluster. Our work builds on the work of Chierichetti et al. (NIPS 2017), Bera et al. (NeurIPS 2019), Ahmadian et al. (KDD 2019), and Bercea et al. (APPROX 2019). We obtain a randomized $3-$approximation algorithm for the $k-$center objective function, beating the previous state of the art ($4-$approximation). We test our algorithm on real datasets, and show that our algorithm is effective in finding good clusters without over-representation or under-representation, surpassing the current state of the art in runtime speed, clustering cost, while achieving similar fairness violations.


title: Analyzing Conserved Currents in F(R) theory of gravity

abstract: F(R) theory of gravity is claimed to admit a host of conserved currents under the imposition of Noether symmetry following various techniques. However, for a constrained system such as gravity, Noether symmetry is not on-shell. As a result, the symmetries do not necessarily satisfy the field equations in general, constraints in particular, unless the generator is modified to incorporate the constraints. In the present manuscript, we apply the first theorem of Poisson to unveil the fact that not all the conserved currents appearing in the literature for F(R) theory of gravity, satisfy the field equations. We also provide a list of available forms of F(R) along with associated conserved currents, and construct a generalized action, which might address the cosmic puzzle, elegantly.