title: Cold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoods

abstract: Graph Neural Networks (GNNs) have achieved state-of-the-art performance in node classification, regression, and recommendation tasks. GNNs work well when rich and high-quality connections are available. However, their effectiveness is often jeopardized in many real-world graphs in which node degrees have power-law distributions. The extreme case of this situation, where a node may have no neighbors, is called Strict Cold Start (SCS). SCS forces the prediction to rely completely on the node's own features. We propose Cold Brew, a teacher-student distillation approach to address the SCS and noisy-neighbor challenges for GNNs. We also introduce feature contribution ratio (FCR), a metric to quantify the behavior of inductive GNNs to solve SCS. We experimentally show that FCR disentangles the contributions of different graph data components and helps select the best architecture for SCS generalization. We further demonstrate the superior performance of Cold Brew on several public benchmark and proprietary e-commerce datasets, where many nodes have either very few or noisy connections. Our source code is available at https://github.com/amazon-research/gnn-tail-generalization.


title: First equilibrium reconstruction for ITER with the code NICE

abstract: In this short paper we present the first application of the IMAS compatible code NICE to equilibrium reconstrution for ITER geometry. The inverse problem is formulated as a least square problem and the numerical methods implemented in NICE in order to solve it are presented. The results of a numerical experiment are shown: a reference equilibrium is computed from which a set of synthetic magnetic measurements are extracted. Then these measurements are used successfully to reconstruct the equilibrium of the plasma.

categories: physics.plasm-ph cs.NA math.NA physics.comp-ph


title: Extreme local extrema of the sine-Gordon field

abstract: We prove that for $\beta<6\pi$ the local extremal process of the massive sine-Gordon field on the unit torus in $d=2$ converges to a Poisson point process with random intensity measure ${\rm Z}^{\mathrm{SG}}(dx) \otimes e^{-\alpha h}dh$ for some $\alpha>0$. The proof combines existing methods for the extremal process associated to the Gaussian free field, which was introduced and studied by Biskup and Louidor, and a strong coupling between the sine-Gordon field and the Gaussian free field.


title: Polarization Tomography with Stokes Parameters

abstract: We present a simple but powerful technique for the analysis of polarized emission from radio galaxies and other objects. It is based on the fact that images of Stokes parameters often contain considerably more information than is available in polarized intensity and angle maps. In general, however, the orientation of the Stokes parameters will not be matched to the position angles of structures in the source. Polarization tomography, the technique presented in this paper, consists of making a series of single linear Stokes parameter images, $S(\rho)$, where each image is rotated by an angle $\rho$ from the initial orientation of Q and U. Examination of these images, in a series of still frames or a movie, reveals often hidden patterns of polarization angles, as well as structures that were obscured by the presence of overlapping polarized emission. We provide both cartoon examples and a quick look at the complex polarized structure in Cygnus A.


title: Double robust estimation of partially adaptive treatment strategies

abstract: Precision medicine aims to tailor treatment decisions according to patients' characteristics. G-estimation and dynamic weighted ordinary least squares (dWOLS) are double robust statistical methods that can be used to identify optimal adaptive treatment strategies. They require both a model for the outcome and a model for the treatment and are consistent if at least one of these models is correctly specified. It is underappreciated that these methods additionally require modeling all existing treatment-confounder interactions to yield consistent estimators. Identifying partially adaptive treatment strategies that tailor treatments according to only a few covariates, ignoring some interactions, may be preferable in practice. It has been proposed to combine inverse probability weighting and G-estimation to address this issue, but we argue that the resulting estimator is not expected to be double robust. Building on G-estimation and dWOLS, we propose alternative estimators of partially adaptive strategies and demonstrate their double robustness. We investigate and compare the empirical performance of six estimators in a simulation study. As expected, estimators combining inverse probability weighting with either G-estimation or dWOLS are biased when the treatment model is incorrectly specified. The other estimators are unbiased if either the treatment or the outcome model are correctly specified and have similar standard errors. Using data maintained by the Centre des Maladies du Sein, the methods are illustrated to estimate a partially adaptive treatment strategy for tailoring hormonal therapy use in breast cancer patients according to their estrogen receptor status and body mass index. R software implementing our estimators is provided.


title: Hybrid BYOL-ViT: Efficient approach to deal with small datasets

abstract: Supervised learning can learn large representational spaces, which are crucial for handling difficult learning tasks. However, due to the design of the model, classical image classification approaches struggle to generalize to new problems and new situations when dealing with small datasets. In fact, supervised learning can lose the location of image features which leads to supervision collapse in very deep architectures. In this paper, we investigate how self-supervision with strong and sufficient augmentation of unlabeled data can train effectively the first layers of a neural network even better than supervised learning, with no need for millions of labeled data. The main goal is to disconnect pixel data from annotation by getting generic task-agnostic low-level features. Furthermore, we look into Vision Transformers (ViT) and show that the low-level features derived from a self-supervised architecture can improve the robustness and the overall performance of this emergent architecture. We evaluated our method on one of the smallest open-source datasets STL-10 and we obtained a significant boost of performance from 41.66% to 83.25% when inputting low-level features from a self-supervised learning architecture to the ViT instead of the raw images.


title: Errett Bishop theorems on Complex Analytic Sets: Chow's Theorem Revisited and Foliations with all leaves Compact on K\"ahler Manifolds

abstract: In this paper we present a series of seemingly unrelated results of Complex Analysis which are in fact connected via a different approach to their proofs using the results of Errett Bishop of volumes and limits of analytic varieties. We start by proving Chow's theorem by a technique suggested long time ago in the beautiful book by Gabriel Stolzenberg. We think this approach is very attractive and easier for students and newcomers to understand; also the theory presented here is linked to areas of mathematics that are not usually associated with Chow's result. In addition, Bishop's results imply both Chow's and Remmert-Stein's theorems directly, meaning that this view is simpler and just as profound as Remmert-Stein's proof. After that, we give a comparison table that explains how Bishop's theorems generalize to several complex variables classical results of one complex variable and prove Montel's compactness theorem using the techniques presented here. Finally we give an alternative proof of a theorem of Edwards, Millet and Sullivan of foliations with compact leaves for the case of complex foliations in K\"ahler manifolds.


title: Robust Direct Aperture Optimization for Radiation Therapy Treatment Planning

abstract: Intensity-modulated radiation therapy (IMRT) allows for the design of customized, highly-conformal treatments for cancer patients. Creating IMRT treatment plans, however, is a mathematically complex process, which is often tackled in multiple, simpler stages. This sequential approach typically separates radiation dose requirements from mechanical deliverability considerations, which may result in suboptimal treatment quality. For patient health to be considered paramount, holistic models must address these plan elements concurrently, eliminating quality loss between stages. This combined direct aperture optimization (DAO) approach is rarely paired with uncertainty mitigation techniques, such as robust optimization, due to the inherent complexity of both parts. This paper outlines a robust DAO (RDAO) model and discusses novel methodologies for efficiently integrating salient constraints. Because the highly-complex RDAO model is difficult to solve, an original candidate plan generation (CPG) heuristic is proposed. The CPG produces rapid, high-quality, feasible plans, which are immediately clinically viable, and can also be used to generate a feasible incumbent solution for warm starting the RDAO model. Computational results obtained using clinical patient datasets with motion uncertainty show the benefit of incorporating the CPG, both in terms of first incumbent solution and final output plan quality.


title: Bridging atomistic simulations and thermodynamic hydration models of aqueous electrolyte solutions

abstract: Chemical thermodynamic models of solvent and solute activities predict the equilibrium behaviour of aqueous solutions. How-ever, these models are semi-empirical. They represent micro-scale ion and solvent behaviours that control the macroscopic properties using small numbers of parameters whose values are obtained by fitting to activities and other partial derivatives of the Gibbs energy measured for the bulk solutions. We have conducted atomistic simulations of aqueous electrolyte solutions (MgCl2 and CaCl2) to determine the parameters of aqueous thermodynamic hydration models. We have implemented a coopera-tive hydration model to categorize the water molecules in electrolyte solutions into different subpopulations. The value of the electrolyte-specific parameter, k, was determined from the ion-affected subpopulation with the lowest absolute value of the free energy of removing the water molecule. The other equilibrium constant parameter, K1, associated with the first degree of hydra-tion, was computed from the free energy of hydration of hydrated clusters in solution. The hydration number, h, was determined from a reorientation dynamic analysis of the water subpopulations compared to bulk-like behaviour. The computed values of these parameters were inserted in the Stokes & Robinson (Journal of Solution Chemistry 1973, 2, 173-191) and Balomenos (Fluid Phase Equilibria 2006, 243, 29-37) models, which were applied to evaluate the osmotic coefficients of MgCl2 solutions. Such an approach removes the dependence on the availability of experimental data and could lead to aqueous thermodynamic models capable of estimating the values of solute and solvent activities, thermal and volumetric properties for a wide range of composition and concentrations.


title: Similarity Dimension of Fractal Curves with Multiple Generators

abstract: We propose a definition for the similarity dimension of fractal curves with multiple generators.


title: Dueling RL: Reinforcement Learning with Trajectory Preferences

abstract: We consider the problem of preference based reinforcement learning (PbRL), where, unlike traditional reinforcement learning, an agent receives feedback only in terms of a 1 bit (0/1) preference over a trajectory pair instead of absolute rewards for them. The success of the traditional RL framework crucially relies on the underlying agent-reward model, which, however, depends on how accurately a system designer can express an appropriate reward function and often a non-trivial task. The main novelty of our framework is the ability to learn from preference-based trajectory feedback that eliminates the need to hand-craft numeric reward models. This paper sets up a formal framework for the PbRL problem with non-markovian rewards, where the trajectory preferences are encoded by a generalized linear model of dimension $d$. Assuming the transition model is known, we then propose an algorithm with almost optimal regret guarantee of $\tilde {\mathcal{O}}\left( SH d \log (T / \delta) \sqrt{T} \right)$. We further, extend the above algorithm to the case of unknown transition dynamics, and provide an algorithm with near optimal regret guarantee $\widetilde{\mathcal{O}}((\sqrt{d} + H^2 + |\mathcal{S}|)\sqrt{dT} +\sqrt{|\mathcal{S}||\mathcal{A}|TH} )$. To the best of our knowledge, our work is one of the first to give tight regret guarantees for preference based RL problems with trajectory preferences.


title: In-Situ Sensing and Dynamics Predictions for Electrothermally-Actuated Soft Robot Limbs

abstract: Untethered soft robots that locomote using electrothermally-responsive materials like shape memory alloy (SMA) face challenging design constraints for sensing actuator states. At the same time, modeling of actuator behaviors faces steep challenges, even with available sensor data, due to complex electrical-thermal-mechanical interactions and hysteresis. This article proposes a framework for in-situ sensing and dynamics modeling of actuator states, particularly temperature of SMA wires, which is used to predict robot motions. A planar soft limb is developed, actuated by a pair of SMA coils, that includes compact and robust sensors for temperature and angular deflection. Data from these sensors are used to train a neural network based on the long short-term memory (LSTM) architecture to model both unidirectional (single SMA) and bidirectional (both SMAs) motion. Predictions from the model demonstrate that data from the temperature sensor, combined with control inputs, allow for dynamics predictions over extraordinarily long open-loop timescales (10 minutes) with little drift. Prediction errors are on the order of the soft deflection sensor's accuracy. This architecture allows for compact designs of electrothermally-actuated soft robots that include sensing sufficient for motion predictions, helping to bring these robots into practical application.


title: A physicist's guide to the solution of Kummer's equation and confluent hypergeometric functions

abstract: The confluent hypergeometric equation, also known as Kummer's equation, is one of the most important differential equations in physics, chemistry, and engineering. Its two power series solutions are the Kummer function, M(a,b,z), often referred to as the confluent hypergeometric function of the first kind, and z^{1-b}M(1+a-b,2-b,z), where a and b are parameters that appear in the differential equation. A third function, the Tricomi function, U(a,b,z), sometimes referred to as the confluent hypergeometric function of the second kind, is also a solution of the confluent hypergeometric equation that is routinely used. All three of these functions must be considered in a search for two linearly independent solutions of the confluent hypergeometric equation. There are situations, when a, b, and a - b are integers, where one of these functions is not defined, or two of the functions are not linearly independent, or one of the linearly independent solutions of the differential equation is different from these three functions. Many of these special cases correspond precisely to cases needed to solve physics problems. This leads to significant confusion about how to work with confluent hypergeometric equations, in spite of authoritative references such as the NIST Digital Library of Mathematical Functions. Here, we carefully describe all of the different cases one has to consider and what the explicit formulas are for the two linearly independent solutions of the confluent hypergeometric equation. Our results are summarized in Table I in Section 3. As an example, we use these solutions to study the bound states of the hydrogenic atom, going beyond the standard treatment in textbooks. We also briefly consider the cutoff Coulomb potential. We hope that this guide will aid physics instruction that involves the confluent hypergeometric differential equation.


title: On the semistability of binary forms over number fields

abstract: Let $K$ be a number field, ${\mathcal O}_K$ its ring of integers, and $f(x, y) \in {\mathcal O}_K[x, y]$ a binary form with integer coefficents. For any given prime $p \in {\mathcal O}_K$ we determine explicitly a binary form $g$ (resp. $\bar f$), $\mbox{GL}_2 (K)$-equivalent to $f$ which is semistable over the local field $K_p$ (resp. the global field $K$). Moreover, if $\xi(f) $ is the corresponding moduli point in the weighted projective space ${\mathbb{WP}}_{\mathbf w}^n (K)$ for a strictly semistable binary form $f$, we determine the weighted moduli height $\mathfrak{h} (\xi(f))$ for $d=4, 6, 8, 10$.


title: The nascent coffee ring with arbitrary droplet contact set: an asymptotic analysis

abstract: We consider the effect of droplet geometry on the early-stages of coffee ring formation during the evaporation of a thin droplet with an arbitrary simple, smooth, pinned contact line. We perform a systematic matched asymptotic analysis of the small-capillary number, large-solutal Peclet number limit for two evaporative models: a kinetic model, in which the evaporative flux is constant across the droplet, and a diffusive model, in which the evaporative flux is singular at the contact line. For both evaporative models, solute is transported to the contact line by a capillary flow while, local to the contact line, solute diffusion counters advection. The resulting interplay leads to the formation of the nascent coffee ring. By exploiting a coordinate system embedded in the contact line, we solve explicitly the local leading-order problem, deriving a similarity profile (in the form of a gamma distribution) that describes the coffee ring profile in its early stages. Notably, the ring characteristics change due to the concomitant asymmetry in the shape of the droplet free surface, the evaporative flux (in the diffusive evaporative regime) and the mass flux into the contact line. We utilize the asymptotic model to determine the effects of geometry on the growth of the coffee ring for a droplet with an elliptical contact set. Our results offer mechanistic insight into the effect of contact-line curvature on the development of the coffee-ring from deposition up to jamming of the solute; moreover our model predicts when finite concentration effects become relevant.


title: Stability and bifurcations of symmetric tops

abstract: We study the stability and bifurcation of relative equilibria of a particle on the Lie group $SO(3)$ whose motion is governed by an $SO(3)\times SO(2)$ invariant metric and an $SO(2)\times SO(2)$ invariant potential. Our method is to reduce the number of degrees of freedom at singular values of the $SO(2)\times SO(2)$ momentum map and study the stability of the equilibria of the reduced systems as a function of spin. The result is an elementary analysis of the fast/slow transition in the Lagrange and Kirchhoff tops. More generally, since an $SO(2)\times SO(2)$ invariant potential on $SO(3)$ can be thought of as ${\mathbb Z}_2$ invariant function on a circle, we analyze the stability and bifurcation of relative equilibria of the system in terms of the second and fourth derivative of the function.


title: Observations about utilitarian coherence in the avian compass

abstract: It is hypothesised that the avian compass relies on spin dynamics in a recombining radical pair. Quantum coherence has been suggested as a resource to this process that nature may utilise to achieve increased compass sensitivity. To date, the true functional role of coherence in these natural systems has remained speculative, lacking insights from sufficiently complex models. Here, we investigate realistically large radical pair models with up to 21 nuclear spins, inspired by the putative magnetosensory protein cryptochrome. By varying relative radical orientations, we reveal correlations of several coherence measures with compass fidelity. Whilst electronic coherence is found to be an ineffective predictor of compass sensitivity, a robust correlation of compass sensitivity and a global coherence measure is established. The results demonstrate the importance of realistic models, and appropriate choice of coherence measure, in elucidating the quantum nature of the avian compass.


title: Model-assisted deep learning of rare extreme events from partial observations

abstract: To predict rare extreme events using deep neural networks, one encounters the so-called small data problem because even long-term observations often contain few extreme events. Here, we investigate a model-assisted framework where the training data is obtained from numerical simulations, as opposed to observations, with adequate samples from extreme events. However, to ensure the trained networks are applicable in practice, the training is not performed on the full simulation data; instead we only use a small subset of observable quantities which can be measured in practice. We investigate the feasibility of this model-assisted framework on three different dynamical systems (Rossler attractor, FitzHugh-Nagumo model, and a turbulent fluid flow) and three different deep neural network architectures (feedforward, long short-term memory, and reservoir computing). In each case, we study the prediction accuracy, robustness to noise, reproducibility under repeated training, and sensitivity to the type of input data. In particular, we find long short-term memory networks to be most robust to noise and to yield relatively accurate predictions, while requiring minimal fine-tuning of the hyperparameters.


title: Simple odd $\beta$-cycle inequalities for binary polynomial optimization

abstract: We consider the multilinear polytope which arises naturally in binary polynomial optimization. Del Pia and Di Gregorio introduced the class of odd $\beta$-cycle inequalities valid for this polytope, showed that these generally have Chv{\'a}tal rank 2 with respect to the standard relaxation and that, together with flower inequalities, they yield a perfect formulation for cycle hypergraph instances. Moreover, they describe a separation algorithm in case the instance is a cycle hypergraph. We introduce a weaker version, called simple odd $\beta$-cycle inequalities, for which we establish a strongly polynomial-time separation algorithm for arbitrary instances. These inequalities still have Chv{\'a}tal rank 2 in general and still suffice to describe the multilinear polytope for cycle hypergraphs. Finally, we report about computational results of our prototype implementation. The simple odd $\beta$-cycle inequalities sometimes help to close more of the integrality gap in the experiments; however, the preliminary implementation has substantial computational cost, suggesting room for improvement in the separation algorithm.


title: ExoMol line lists -- XLIV. IR and UV line list for silicon monoxide (SiO)

abstract: A new silicon monoxide ($^{28}$Si$^{16}$O) line list covering infrared, visible and ultraviolet regions called SiOUVenIR is presented. This line list extends the infrared EBJT ExoMol line list by including vibronic transitions to the $A\,{}^{1}\Pi$ and $E\,{}^{1}\Sigma^{+}$ electronic states. Strong perturbations to the $A\,{}^{1}\Pi$ band system are accurately modelled through the treatment of 6 dark electronic states: $C\,{}^{1}\Sigma^{-}$, $D\,{}^{1}\Delta$, $a\,{}^{3}\Sigma^{+}$, $b\,{}^{3}\Pi$, $e\,{}^{3}\Sigma^{-}$ and $d\,{}^{3}\Delta$. Along with the $X\,{}^{1}\Sigma^{+}$ ground state, these 9 electronic states were used to build a comprehensive spectroscopic model of SiO using a combination of empirical and ab initio curves, including the potential energy (PE), spin-orbit (SO), electronic angular momentum (EAM) and (transition) dipole moment curves. The ab initio PE and coupling curves, computed at the multireference configuration interaction (MRCI) level of theory, were refined by fitting their analytical representations to 2617 experimentally derived SiO energy levels determined from 97 vibronic bands belonging to the $X$-$X$, $E$-$X$ and $A$-$X$ electronic systems through the MARVEL procedure. 112 observed forbidden transitions from the $C$-$X$, $D$-$X$, $e$-$X$, and $d$-$X$ bands were assigned using our predictions, and these could be fed back into the MARVEL procedure. The SiOUVenIR line list was computed using published ab initio transition dipole moments for the $E$-$X$ and $A$-$X$ bands; the line list is suitable for temperatures up to 10,000 K and for wavelengths longer than 140 nm. SiOUVenIR is available from www.exomol.com and the CDS database.


title: Multiscale DeepONet for Nonlinear Operators in Oscillatory Function Spaces for Building Seismic Wave Responses

abstract: In this paper, we propose a multiscale DeepONet to represent nonlinear operator between Banach spaces of highly oscillatory continuous functions. The multiscale deep neural network (DNN) utilizes a multiple scaling technique to convert high frequency function to lower frequency functions before using a DNN to learn a specific range of frequency of the function. The multi-scale concept is integrated into the DeepONet which is based on a universal approximation theory of nonlinear operators. The resulting multi-scale DeepONet is shown to be effective to represent building seismic response operator which maps oscillatory seismic excitation to the oscillatory building responses.


title: KMT-2021-BLG-0912Lb: A microlensing super Earth around a K-type star

abstract: The light curve of the microlensing event KMT-2021-BLG-0912 exhibits a very short anomaly relative to a single-lens single-source form. We investigate the light curve for the purpose of identifying the origin of the anomaly. We model the light curve under various interpretations. From this, we find four solutions, in which three solutions are found under the assumption that the lens is composed of two masses (2L1S models), and the other solution is found under the assumption that the source is comprised of a binary-star system (1L2S model). The 1L2S model is ruled out based on the contradiction that the faint source companion is bigger than its primary, and one of the 2L1S solutions is excluded from the combination of the relatively worse fit, blending constraint, and lower overall probability, leaving two surviving solutions with the planet/host mass ratios of $q\sim 2.8\times 10^{-5}$ and $\sim 1.1\times 10^{-5}$. A subtle central deviation supports the possibility of a tertiary lens component, either a binary companion to the host with a very large or small separation or a second planet lying near the Einstein ring, but it is difficult to claim a secure detection due to the marginal fit improvement, lack of consistency among different data sets, and difficulty in uniquely specifying the nature of the tertiary component. With the observables of the event, it is estimated that the masses of the planet and host are $\sim (6.9~M_\oplus, 0.75~M_\odot)$ according to one solution and $\sim (2.8~M_\oplus, 0.80~M_\odot)$ according to the other solution, indicating that the planet is a super Earth around a K-type star, regardless of the solution.


title: Explaining Face Presentation Attack Detection Using Natural Language

abstract: A large number of deep neural network based techniques have been developed to address the challenging problem of face presentation attack detection (PAD). Whereas such techniques' focus has been on improving PAD performance in terms of classification accuracy and robustness against unseen attacks and environmental conditions, there exists little attention on the explainability of PAD predictions. In this paper, we tackle the problem of explaining PAD predictions through natural language. Our approach passes feature representations of a deep layer of the PAD model to a language model to generate text describing the reasoning behind the PAD prediction. Due to the limited amount of annotated data in our study, we apply a light-weight LSTM network as our natural language generation model. We investigate how the quality of the generated explanations is affected by different loss functions, including the commonly used word-wise cross entropy loss, a sentence discriminative loss, and a sentence semantic loss. We perform our experiments using face images from a dataset consisting of 1,105 bona-fide and 924 presentation attack samples. Our quantitative and qualitative results show the effectiveness of our model for generating proper PAD explanations through text as well as the power of the sentence-wise losses. To the best of our knowledge, this is the first introduction of a joint biometrics-NLP task. Our dataset can be obtained through our GitHub page.


title: Adaptive solution of initial value problems by a dynamical Galerkin scheme

abstract: We study dynamical Galerkin schemes for evolutionary partial differential equations (PDEs), where the projection operator changes over time. When selecting a subset of basis functions, the projection operator is non-differentiable in time and an integral formulation has to be used. We analyze the projected equations with respect to existence and uniqueness of the solution and prove that non-smooth projection operators introduce dissipation, a result which is crucial for adaptive discretizations of PDEs, e.g., adaptive wavelet methods. For the Burgers equation we illustrate numerically that thresholding the wavelet coefficients, and thus changing the projection space, will indeed introduce dissipation of energy. We discuss consequences for the so-called `pseudo-adaptive' simulations, where time evolution and dealiasing are done in Fourier space, whilst thresholding is carried out in wavelet space. Numerical examples are given for the inviscid Burgers equation in 1D and the incompressible Euler equations in 2D and 3D.

categories: math.NA cs.NA physics.comp-ph physics.flu-dyn


title: The two formation pathways of S0 galaxies

abstract: Despite their ubiquity throughout the Universe, the formation of S0 galaxies remains uncertain. Recent observations have revealed that S0 galaxies make up a diverse population which is difficult to explain with a single formation pathway, suggesting that the picture of how these galaxies form is more complicated than originally envisioned. Here we take advantage of the latest hydrodynamical cosmological simulations and follow up these studies with an investigation into the formation histories of S0s in IllustrisTNG. We first classify IllustrisTNG galaxies in a way which is fully consistent with the observations, and reproduce the observed photometric and environmental distributions seen for the S0 population. We then trace the formation histories of S0 galaxies back through time, identifying two main distinct pathways; those which experienced gas stripping via group infalls (37 percent of S0s) or significant merger events (57 percent). We find that those forming via mergers feature a transient star-forming ring, whose present-day occurrence rate matches observations. We find that these formation pathways together can reproduce the range in rotational support in observed S0s, concluding that there are two main formation pathways for S0 galaxies.


title: On Assessing The Safety of Reinforcement Learning algorithms Using Formal Methods

abstract: The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training, adversarial detection, and robust learning are not always adapted to all disturbances in which the agent is deployed. Those disturbances include moving adversaries whose behavior can be unpredictable by the agent, and as a matter of fact harmful to its learning. Ensuring the safety of critical systems also requires methods that give formal guarantees on the behaviour of the agent evolving in a perturbed environment. It is therefore necessary to propose new solutions adapted to the learning challenges faced by the agent. In this paper, first we generate adversarial agents that exhibit flaws in the agent's policy by presenting moving adversaries. Secondly, We use reward shaping and a modified Q-learning algorithm as defense mechanisms to improve the agent's policy when facing adversarial perturbations. Finally, probabilistic model checking is employed to evaluate the effectiveness of both mechanisms. We have conducted experiments on a discrete grid world with a single agent facing non-learning and learning adversaries. Our results show a diminution in the number of collisions between the agent and the adversaries. Probabilistic model checking provides lower and upper probabilistic bounds regarding the agent's safety in the adversarial environment.


title: Mito-nuclear selection induces a trade-off between species ecological dominance and evolutionary lifespan

abstract: Mitochondrial and nuclear genomes must be co-adapted to ensure proper cellular respiration and energy production. Mito-nuclear incompatibility reduces individual fitness and induces hybrid infertility, suggesting a possible role in reproductive barriers and speciation. Here we develop a birth-death model for evolution in spatially extended populations under selection for mito-nuclear co-adaptation. Mating is constrained by physical and genetic proximity, and offspring inherit nuclear genomes from both parents, with recombination. The model predicts macroscopic patterns including a community's long-term species diversity, its species abundance distribution, speciation and extinction rates, as well as intra- and inter-specific genetic variation. We explore how these long-term outcomes depend upon the microscopic parameters of reproduction: individual fitness governed by mito-nuclear compatibility, constraints on mating compatibility, and ecological carrying capacity. We find that strong selection for mito-nuclear compatibility reduces the equilibrium number of species after a radiation, increases the species' abundances, while simultaneously increasing both speciation and extinction rates. The negative correlation between species diversity and diversification rates in our model agrees with the broad empirical pattern of lower species diversity and higher speciation/extinction rates in temperate regions, compared to the tropics. We therefore suggest that these empirical patterns may be caused in part by latitudinal variation in metabolic demands, and corresponding variation in selection on mito-nuclear function.


title: TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches

abstract: Machine learning models are increasingly being trained across multiple GPUs and servers. In this setting, data is transferred between GPUs using communication collectives such as AlltoAll and AllReduce, which can become a significant bottleneck in training large models. Thus, it is important to use efficient algorithms for collective communication. We develop TACCL, a tool that enables algorithm designers to guide a synthesizer into automatically generating algorithms for a given hardware configuration and communication collective. TACCL uses a novel communication sketch abstraction to get crucial information from the designer to significantly reduce the search space and guide the synthesizer towards better algorithms. TACCL also uses a novel encoding of the problem that allows it to scale beyond single-node topologies. We use TACCL to synthesize algorithms for three collectives and two hardware topologies: DGX-2 and NDv2. We demonstrate that the algorithms synthesized by TACCL outperform the Nvidia Collective Communication Library (NCCL) by up to 6.7x. We also show that TACCL can speed up end-to-end training of Transformer-XL and BERT models by 11%--2.3x for different batch sizes.


title: Perturbative structure of two- and four-point functions of color charge in a non-Gaussian small-$x$ action

abstract: We compute the perturbative expansion of the two- and four-point functions of color charges in the Color Glass Condensate framework considering the quartic correction to the McLerran-Venugopalan (MV) model of Gaussian color charge fluctuations. Expressions for these correlators in the perturbative expansion for small and large non-Gaussian color charge fluctuations are derived for arbitrary orders in perturbation theory. We explicitly show that the perturbative series does not converge at higher orders as expected. We apply the Borel-Pad\'e resummation method to our problem to construct a convergent series. It is shown that the fully non-perturbative solution can be described by the Borel-Pad\'e approximants constructed from the first few terms of the perturbative series for small non-Gaussian fluctuations.


title: Lin-Lu-Yau curvature and diameter of amply regular graphs

abstract: By Hall's marriage theorem, we study lower bounds of the Lin-Lu-Yau curvature of amply regular graphs with girth $3$ or $4$ under different parameter restrictions. As a consequence, we show that each conference graph has positive Lin-Lu-Yau curvature. Our approach also provides a geometric proof of a classical diameter estimate for amply regular graphs in the case of girth $4$ and some special cases of girth $3$.


title: A toolkit for data-driven discovery of governing equations in high-noise regimes

abstract: We consider the data-driven discovery of governing equations from time-series data in the limit of high noise. The algorithms developed describe an extensive toolkit of methods for circumventing the deleterious effects of noise in the context of the sparse identification of nonlinear dynamics (SINDy) framework. We offer two primary contributions, both focused on noisy data acquired from a system x' = f(x). First, we propose, for use in high-noise settings, an extensive toolkit of critically enabling extensions for the SINDy regression method, to progressively cull functionals from an over-complete library and yield a set of sparse equations that regress to the derivate x'. These innovations can extract sparse governing equations and coefficients from high-noise time-series data (e.g. 300% added noise). For example, it discovers the correct sparse libraries in the Lorenz system, with median coefficient estimate errors equal to 1% - 3% (for 50% noise), 6% - 8% (for 100% noise); and 23% - 25% (for 300% noise). The enabling modules in the toolkit are combined into a single method, but the individual modules can be tactically applied in other equation discovery methods (SINDy or not) to improve results on high-noise data. Second, we propose a technique, applicable to any model discovery method based on x' = f(x), to assess the accuracy of a discovered model in the context of non-unique solutions due to noisy data. Currently, this non-uniqueness can obscure a discovered model's accuracy and thus a discovery method's effectiveness. We describe a technique that uses linear dependencies among functionals to transform a discovered model into an equivalent form that is closest to the true model, enabling more accurate assessment of a discovered model's accuracy.


title: Query-augmented Active Metric Learning

abstract: In this paper we propose an active metric learning method for clustering with pairwise constraints. The proposed method actively queries the label of informative instance pairs, while estimating underlying metrics by incorporating unlabeled instance pairs, which leads to a more accurate and efficient clustering process. In particular, we augment the queried constraints by generating more pairwise labels to provide additional information in learning a metric to enhance clustering performance. Furthermore, we increase the robustness of metric learning by updating the learned metric sequentially and penalizing the irrelevant features adaptively. In addition, we propose a novel active query strategy that evaluates the information gain of instance pairs more accurately by incorporating the neighborhood structure, which improves clustering efficiency without extra labeling cost. In theory, we provide a tighter error bound of the proposed metric learning method utilizing augmented queries compared with methods using existing constraints only. Furthermore, we also investigate the improvement using the active query strategy instead of random selection. Numerical studies on simulation settings and real datasets indicate that the proposed method is especially advantageous when the signal-to-noise ratio between significant features and irrelevant features is low.


title: Performance Evaluation of Python Parallel Programming Models: Charm4Py and mpi4py

abstract: Python is rapidly becoming the lingua franca of machine learning and scientific computing. With the broad use of frameworks such as Numpy, SciPy, and TensorFlow, scientific computing and machine learning are seeing a productivity boost on systems without a requisite loss in performance. While high-performance libraries often provide adequate performance within a node, distributed computing is required to scale Python across nodes and make it genuinely competitive in large-scale high-performance computing. Many frameworks, such as Charm4Py, DaCe, Dask, Legate Numpy, mpi4py, and Ray, scale Python across nodes. However, little is known about these frameworks' relative strengths and weaknesses, leaving practitioners and scientists without enough information about which frameworks are suitable for their requirements. In this paper, we seek to narrow this knowledge gap by studying the relative performance of two such frameworks: Charm4Py and mpi4py. We perform a comparative performance analysis of Charm4Py and mpi4py using CPU and GPU-based microbenchmarks other representative mini-apps for scientific computing.


title: An Instance-Dependent Analysis for the Cooperative Multi-Player Multi-Armed Bandit

abstract: We study the problem of information sharing and cooperation in Multi-Player Multi-Armed bandits. We propose the first algorithm that achieves logarithmic regret for this problem when the collision reward is unknown. Our results are based on two innovations. First, we show that a simple modification to a successive elimination strategy can be used to allow the players to estimate their suboptimality gaps, up to constant factors, in the absence of collisions. Second, we leverage the first result to design a communication protocol that successfully uses the small reward of collisions to coordinate among players, while preserving meaningful instance-dependent logarithmic regret guarantees.


title: Impact of grain properties on the penetration of intruders near a wall into granular matter: a DEM study

abstract: DEM simulations were used to study the sensitivity of a granular system to the change of the mechanical properties of the grains, applied to the penetration of a cylindrical intruder near a vertical wall. The simulations reproduce a real experimental setup, changing the friction, the Young modulus and the restitution coefficient of the particles.


title: LiMoSeg: Real-time Bird's Eye View based LiDAR Motion Segmentation

abstract: Moving object detection and segmentation is an essential task in the Autonomous Driving pipeline. Detecting and isolating static and moving components of a vehicle's surroundings are particularly crucial in path planning and localization tasks. This paper proposes a novel real-time architecture for motion segmentation of Light Detection and Ranging (LiDAR) data. We use three successive scans of LiDAR data in 2D Bird's Eye View (BEV) representation to perform pixel-wise classification as static or moving. Furthermore, we propose a novel data augmentation technique to reduce the significant class imbalance between static and moving objects. We achieve this by artificially synthesizing moving objects by cutting and pasting static vehicles. We demonstrate a low latency of 8 ms on a commonly used automotive embedded platform, namely Nvidia Jetson Xavier. To the best of our knowledge, this is the first work directly performing motion segmentation in LiDAR BEV space. We provide quantitative results on the challenging SemanticKITTI dataset, and qualitative results are provided in https://youtu.be/2aJ-cL8b0LI.


title: Mobility-limiting antipredator response in the rock-paper-scissors model

abstract: Antipredator behavior is present in many biological systems where individuals collectively react to an imminent attack. The antipredator response may influence spatial pattern formation and ecosystem stability but requires an organism's cost to contribute to the collective effort. We investigate a nonhierarchical tritrophic system, whose predator-prey interactions are described by the rock-paper-scissors game rules. In our spatial stochastic simulations, the radius of antipredator response defines the maximum prey group size that disturbs the predator's action, determining the individual cost to participate in antipredator strategies. We consider that each organism contributes equally to the collective effort, having its mobility limited by the proportion of energy devoted to the antipredator reaction. Our outcomes show that the antipredator response leads to spiral patterns, with the segregation of organisms of the same species occupying departed spatial domains. We found that a less localized antipredator response increases the average size of the single-species patches, improving the protection of individuals against predation. Finally, our findings show that although the increase of the predation risk for a more localized antipredator response, the high mobility constraining benefits species coexistence. Our results may help ecologists understand the mechanisms leading to the stability of biological systems where locality is crucial to behavioral interactions among species.

categories: q-bio.PE nlin.AO nlin.CG nlin.PS physics.bio-ph


title: Papaya: Practical, Private, and Scalable Federated Learning

abstract: Cross-device Federated Learning (FL) is a distributed learning paradigm with several challenges that differentiate it from traditional distributed learning, variability in the system characteristics on each device, and millions of clients coordinating with a central server being primary ones. Most FL systems described in the literature are synchronous - they perform a synchronized aggregation of model updates from individual clients. Scaling synchronous FL is challenging since increasing the number of clients training in parallel leads to diminishing returns in training speed, analogous to large-batch training. Moreover, stragglers hinder synchronous FL training. In this work, we outline a production asynchronous FL system design. Our work tackles the aforementioned issues, sketches of some of the system design challenges and their solutions, and touches upon principles that emerged from building a production FL system for millions of clients. Empirically, we demonstrate that asynchronous FL converges faster than synchronous FL when training across nearly one hundred million devices. In particular, in high concurrency settings, asynchronous FL is 5x faster and has nearly 8x less communication overhead than synchronous FL.


title: Automated generation of 0D and 1D reduced-order models of patient-specific blood flow

abstract: Three-dimensional (3D) cardiovascular fluid dynamics simulations typically require hours to days of computing time on a high-performance computing cluster. One-dimensional (1D) and lumped-parameter zero-dimensional (0D) models show great promise for accurately predicting blood bulk flow and pressure waveforms with only a fraction of the cost. They can also accelerate uncertainty quantification, optimization, and design parameterization studies. Despite several prior studies generating 1D and 0D models and comparing them to 3D solutions, these were typically limited to either 1D or 0D and a singular category of vascular anatomies. This work proposes a fully automated and openly available framework to generate and simulate 1D and 0D models from 3D patient-specific geometries, automatically detecting vessel junctions and stenosis segments. Our only input is the 3D geometry; we do not use any prior knowledge from 3D simulations. All computational tools presented in this work are implemented in the open-source software platform SimVascular. We demonstrate the reduced-order approximation quality against rigid-wall 3D solutions in a comprehensive comparison with N=72 publicly available models from various anatomies, vessel types, and disease conditions. Relative average approximation errors of flows and pressures typically ranged from 1% to 10% for both 1D and 0D models, measured at the outlets of terminal vessel branches. In general, 0D model errors were only slightly higher than 1D model errors despite requiring only a third of the 1D runtime. Automatically generated ROMs can significantly speed up model development and shift the computational load from high-performance machines to personal computers.


title: EvoLearner: Learning Description Logics with Evolutionary Algorithms

abstract: Classifying nodes in knowledge graphs is an important task, e.g., for predicting missing types of entities, predicting which molecules cause cancer, or predicting which drugs are promising treatment candidates. While black-box models often achieve high predictive performance, they are only post-hoc and locally explainable and do not allow the learned model to be easily enriched with domain knowledge. Towards this end, learning description logic concepts from positive and negative examples has been proposed. However, learning such concepts often takes a long time and state-of-the-art approaches provide limited support for literal data values, although they are crucial for many applications. In this paper, we propose EvoLearner - an evolutionary approach to learn concepts in ALCQ(D), which is the attributive language with complement (ALC) paired with qualified cardinality restrictions (Q) and data properties (D). We contribute a novel initialization method for the initial population: starting from positive examples, we perform biased random walks and translate them to description logic concepts. Moreover, we improve support for data properties by maximizing information gain when deciding where to split the data. We show that our approach significantly outperforms the state of the art on the benchmarking framework SML-Bench for structured machine learning. Our ablation study confirms that this is due to our novel initialization method and support for data properties.


title: User Centered Design (VI): Human Factors Approaches for Intelligent Human-Computer Interaction

abstract: Starting from the design philosophy of "user-centered design", this paper analyzes the human factors characteristics of intelligent human-computer interaction (iHCI) and proposes a concept of "user-oriented iHCI". The paper further proposes a new human factors framework for iHCI based on the theories of joint cognitive systems, situation awareness, and intelligent agents. With the help of the concept and framework, the paper analyzes the human factors issues in the ecosystem of autonomous vehicle co-driving and proposes an initial human factors solution. Finally, the paper analyzes the two important research areas in iHCI (i.e., user intention recognition, human-computer collaboration) and points out the key human factors questions for future research.


title: Combining machine learning with physics: A framework for tracking and sorting multiple dark solitons

abstract: In ultracold-atom experiments, data often comes in the form of images which suffer information loss inherent in the techniques used to prepare and measure the system. This is particularly problematic when the processes of interest are complicated, such as interactions among excitations in Bose-Einstein condensates (BECs). In this paper, we describe a framework combining machine learning (ML) models with physics-based traditional analyses to identify and track multiple solitonic excitations in images of BECs. We use an ML-based object detector to locate the solitonic excitations and develop a physics-informed classifier to sort solitonic excitations into physically motivated subcategories. Lastly, we introduce a quality metric quantifying the likelihood that a specific feature is a longitudinal soliton. Our trained implementation of this framework, SolDet, is publicly available as an open-source python package. SolDet is broadly applicable to feature identification in cold-atom images when trained on a suitable user-provided dataset.


title: On the Assignment Graphs of Oriented Graphs

abstract: In this paper, we extend the ideas of graph pebbling to oriented graphs and find a classification for all graphs with fully traversable pebbling assignments that are isomorphic to their assignment graph. We then give some cases in which a graph with a non-fully traversable pebbling assignment is isomorphic to its assignment graph.


title: Manipulation of Exciton Dynamics in Single-Layer WSe2 Using a Toroidal Dielectric Metasurface

abstract: Recent advances in emerging atomically thin transition metal dichalcogenide semiconductors with strong light-matter interactions and tunable optical properties provide novel approaches for realizing new material functionalities. Coupling two-dimensional semiconductors with all-dielectric resonant nanostructures represents an especially attractive opportunity for manipulating optical properties in both the near-field and far-field regimes. Here, by integrating single-layer WSe2 and titanium oxide (TiO2) dielectric metasurfaces with toroidal resonances, we realized robust exciton emission enhancement over one order of magnitude at both room and low temperatures. Furthermore, we could control exciton dynamics and annihilation by using temperature to tailor the spectral overlap of excitonic and toroidal resonances, allowing us to selectively enhance the Purcell effect. Our results provide rich physical insight into the strong light-matter interactions in single-layer TMDs coupled with toroidal dielectric metasurfaces, with important implications for optoelectronics and photonics applications.


title: On Trace Zero Matrices and Commutators

abstract: Given any commutative ring $R$, a commutator of two $n\times n$ matrices over $R$ has trace $0$. In this paper, we study the converse: whether every $n \times n$ trace $0$ matrix is a commutator. We show that if $R$ is a B\'{e}zout domain with algebraically closed quotient field, then every $n\times n$ trace $0$ matrix is a commutator. We also show that if $R$ is a regular ring with large enough Krull dimension relative to $n$, then there exist a $n\times n$ trace $0$ matrix that is not a commutator. This improves on a result of Lissner by increasing the size of the matrix allowed for a fixed $R$. We also give an example of a Noetherian dimension $1$ commutative domain $R$ that admits a $n\times n$ trace $0$ non-commutator for any $n\ge 2$.


title: Lymph Node Detection in T2 MRI with Transformers

abstract: Identification of lymph nodes (LN) in T2 Magnetic Resonance Imaging (MRI) is an important step performed by radiologists during the assessment of lymphoproliferative diseases. The size of the nodes play a crucial role in their staging, and radiologists sometimes use an additional contrast sequence such as diffusion weighted imaging (DWI) for confirmation. However, lymph nodes have diverse appearances in T2 MRI scans, making it tough to stage for metastasis. Furthermore, radiologists often miss smaller metastatic lymph nodes over the course of a busy day. To deal with these issues, we propose to use the DEtection TRansformer (DETR) network to localize suspicious metastatic lymph nodes for staging in challenging T2 MRI scans acquired by different scanners and exam protocols. False positives (FP) were reduced through a bounding box fusion technique, and a precision of 65.41\% and sensitivity of 91.66\% at 4 FP per image was achieved. To the best of our knowledge, our results improve upon the current state-of-the-art for lymph node detection in T2 MRI scans.


title: Universal Lesion Detection in CT Scans using Neural Network Ensembles

abstract: In clinical practice, radiologists are reliant on the lesion size when distinguishing metastatic from non-metastatic lesions. A prerequisite for lesion sizing is their detection, as it promotes the downstream assessment of tumor spread. However, lesions vary in their size and appearance in CT scans, and radiologists often miss small lesions during a busy clinical day. To overcome these challenges, we propose the use of state-of-the-art detection neural networks to flag suspicious lesions present in the NIH DeepLesion dataset for sizing. Additionally, we incorporate a bounding box fusion technique to minimize false positives (FP) and improve detection accuracy. Finally, to resemble clinical usage, we constructed an ensemble of the best detection models to localize lesions for sizing with a precision of 65.17% and sensitivity of 91.67% at 4 FP per image. Our results improve upon or maintain the performance of current state-of-the-art methods for lesion detection in challenging CT scans.


title: Programming for All: Understanding the Nature of Programs

abstract: Computer programs are part of our daily life, we use them, we provide them with data, they support our decisions, they help us remember, they control machines, etc. Programs are made by people, but in most cases we are not their authors, so we have to decide if we can trust them. Programs enable computers and computer-controlled machines to behave in a large variety of ways. They bring the intrinsic power of computers to life. Programs have a variety of properties that all citizens must be aware of. Due to the intangible nature of programs, most of these properties are very unusual, but important to understand the digital world. In this position paper, we describe the Nature of Programs in the form of knowledge statements, accompanied by examples from everyday life to clarify their meaning. Everything is formulated in an easily understandable manner and avoids obscure technical language. We suggest that these knowledge statements must be imparted to all teachers and school students. A great way to learn and experience the nature of programs is to develop programs yourself.


title: Active Linear Regression for $\ell_p$ Norms and Beyond

abstract: We study active sampling algorithms for linear regression, which aim to query only a few entries of a target vector $b\in\mathbb R^n$ and output a near minimizer to $\min_{x\in\mathbb R^d} \|Ax-b\|$, for a design matrix $A\in\mathbb R^{n \times d}$ and loss $\|\cdot\|$. For $p$ norm regression for any $0<p<\infty$, we give an algorithm based on Lewis weight sampling outputting a $(1+\epsilon)$-approximate solution using just $\tilde O(d/\epsilon^2)$ queries to $b$ for $p\in(0,1)$, $\tilde{O}(d/\epsilon)$ queries for $1<p<2$, and $\tilde{O}(d^{p/2}/\epsilon^p)$ queries for $2<p<\infty$. For $0<p<2$, our bounds are optimal up to log factors, settling the query complexity for this range. For $2<p<\infty$, our dependence on $d$ is optimal, while our dependence on $\epsilon$ is off by at most $\epsilon$, up to log factors. Our result resolves an open question of [CD21], who gave near optimal bounds for the $1$ norm, but required $d^2/\epsilon^2$ samples for $\ell_p$ regression with $1<p<2$, and gave no bounds for $2<p<\infty$ or $0<p<1$. We also give the first total sensitivity bound of $O(d^{\max\{1,p/2\}}\log^2n)$ for loss functions of degree $p$ polynomial growth, improving a result of [TMF20]. By combining this with our techniques for $\ell_p$ regression, we obtain an active regression algorithm making $\tilde O(d^{1+\max\{1,p/2\}}/\mathrm{poly}(\epsilon))$ queries for such loss functions, including the Tukey and Huber losses, answering another question of [CD21]. For the Huber loss, we further improve our bound to $\tilde O(d^{4-2\sqrt2}/\mathrm{poly}(\epsilon))$ samples. Our sensitivity bounds also have many applications, including Orlicz norm subspace embeddings, robust subspace approximation, and dimension reduction for smoothed $p$-norms. Finally, our active sampling results give the first sublinear time algorithms for Kronecker product regression under every $p$ norm.


title: Bioinspired magnetic active matter and the physical limits of magnetotaxis

abstract: Magnetotactic bacteria (MTB) are endowed with an exquisite orientation mechanism allowing them to swim along the geomagnetic field lines [1-3]. This mechanism consists of a chain of bio-synthesized magnetic nano-crystals [1,4,5]. Although the physics behind the minimum size of this biological compass is well understood [6], it is yet unclear what sets its maximum size [6-8]. Here, by using a macroscopic experiment inspired in these microorganisms, we show that larger magnetic moments will drive the collective behavior of MTB into a phase where bacteria are unable to swim freely, in detriment of their evolutive fitness [3,9]. Simple macroscopic experiments, numerical simulations, and analytic estimates are used to explain the upper limit for the size of the chain of nano-crystals in MTB. Our macroscopic bio-inspired experiment, and physical model provide new opportunities to explore and understand the phases of magnetic active matter at all scales.


title: Construction of Arithmetic Teichmuller spaces II: Towards Diophantine Estimates

abstract: This paper deals with three consequences of the existence of Arithmetic Teichmuller spaces of arXiv:2106.11452. Let $\mathscr{X}_{F,\mathbb{Q}_p}$ (resp. $B=B_{\mathbb{Q}_p}$) be the complete Fargues-Fontaine curve (resp. the ring) constructed by Fargues-Fontaine with the datum $F={\mathbb{C}_p^\flat}$ (the tilt of $\mathbb{C}_p$), $E=\mathbb{Q}_p$. Fix an odd prime $\ell$, let $\ell^*=\frac{\ell-1}{2}$. The construction (\S 7) of an uncountable subset $\Sigma_{F}\subset \mathscr{X}_{F,\mathbb{Q}_p}^{\ell^*}$ with a simultaneous valuation scaling property (Theorem 7.8.1), Galois action and other symmetries. Now fix a Tate elliptic curve over a finite extension of $\mathbb{Q}_p$. The existence of $\Sigma_{F}$ leads to the construction (\S 9) of a set $\widetilde{\Theta}\subset B^{\ell^*}$ consisting of lifts (to $B$), of values (lying in different untilts provided by $\Sigma_{F}$) of a chosen theta-function evaluated at $2\ell$-torsion points on the chosen elliptic curve. The construction of $\widetilde{\Theta}$ can be easily adelized. Moreover I also prove a lower bound (Theorem 10.1.1) for the size of $\widetilde{\Theta}$ (here size is defined in terms of the Fr\'echet structure of $B$). I also demonstrate (in \S 11) the existence of ``log-links'' in the theory of [Joshi 2021].


title: Dielectric response of electrons with strong local correlations and long-ranged Coulomb interactions

abstract: Motivated by recent experiments, we append long ranged Coulomb interactions to dominant strong local correlations and study the resulting $t$-$J$-$V_C$ model for the 2-dimensional cuprate materials. This model includes the effect of short ranged Hubbard-Gutzwiller-Kanamori type correlations and long ranged Coulomb interactions on tight binding electrons. We calculate the $ \{\vec{q},\omega\}$ dependent charge density fluctuations in this model using the extremely correlated fermi liquid theory, characterized by quasiparticles with very small weight $Z$. We develop a novel set of formulae to represent the dynamical charge susceptibility and the dielectric function, using a version of the charge-current continuity equation for a band system valid for arbitrary $\vec{q}$. Combining these ingredients, we present results for the dynamical charge susceptibility $\widetilde{\chi}_{\rho\rho}(\vec{q},\omega)$, (longitudinal) dielectric function $\varepsilon(\vec{q},\omega)$, current susceptibility $\widetilde{\chi}_{J J}(\vec{q},\omega)$, conductivity $\sigma(\vec{q},\omega)$, and the plasma frequency for any $\vec{q}$. We also present calculations for the first moment of the structure function and discuss a characteristic energy scale $\Omega_p(\vec{q})$, which locates a peak in $\Im m \, \widetilde{\chi}_{\rho\rho}(\vec{q},\omega)$.


title: Determinants of Women's Attitude towards Intimate Partner Violence: Evidence from Bangladesh

abstract: Purpose: The purpose of this study is to identify the important determinants responsible for the variation in women's attitude towards intimate partner violence (IPV). Methods: A nationally representative Bangladesh Demographic and Health Survey 2014 data of 17,863 women is used to address the research questions. In the study, two response variables are constructed from the five attitude questions, and a series of individual and community-level predictors are tested. The preliminary statistical methods employed in the study include univariate and bivariate distributions, while the adopted statistical models include binary logistic, ordinal logistic, mixed-effects multilevel logistic models for each response variable, and finally, the generalized ordinal logistic regression. Results: Statistical analyses reveal that among the individual-level independent variables age at first marriage, respondent's education, decision score, religion, NGO membership, access to information, husband's education, normalized wealth score, and division indicator have significant effects on the women's attitude towards IPV. Among the three community-level variables, only the mean decision score is found significant in lowering the likelihood. Conclusions: It is evident that other than religion, NGO membership, and division indicator, the higher the value of the variable, the lower the likelihood of justifying IPV. However, being a Muslim, NGO member, and resident of other divisions, women are found more tolerant of IPV from their respective counterparts. These findings suggest the government, policymakers, practitioners, academicians, and all other stakeholders to work on the significant determinants to divert women's wrong attitude towards IPV, and thus help to take away this deep-rooted problem from society.


title: Mitigating domain shift in AI-based tuberculosis screening with unsupervised domain adaptation

abstract: We demonstrate that Domain Invariant Feature Learning (DIFL) can improve the out-of-domain generalizability of a deep learning Tuberculosis screening algorithm. It is well known that state of the art deep learning algorithms often have difficulty generalizing to unseen data distributions due to "domain shift". In the context of medical imaging, this could lead to unintended biases such as the inability to generalize from one patient population to another. We analyze the performance of a ResNet-50 classifier for the purposes of Tuberculosis screening using the four most popular public datasets with geographically diverse sources of imagery. We show that without domain adaptation, ResNet-50 has difficulty in generalizing between imaging distributions from a number of public Tuberculosis screening datasets with imagery from geographically distributed regions. However, with the incorporation of DIFL, the out-of-domain performance is greatly enhanced. Analysis criteria includes a comparison of accuracy, sensitivity, specificity and AUC over both the baseline, as well as the DIFL enhanced algorithms. We conclude that DIFL improves generalizability of Tuberculosis screening while maintaining acceptable accuracy over the source domain imagery when applied across a variety of public datasets.


title: Safe Policy Optimization with Local Generalized Linear Function Approximations

abstract: Safe exploration is a key to applying reinforcement learning (RL) in safety-critical systems. Existing safe exploration methods guaranteed safety under the assumption of regularity, and it has been difficult to apply them to large-scale real problems. We propose a novel algorithm, SPO-LF, that optimizes an agent's policy while learning the relation between a locally available feature obtained by sensors and environmental reward/safety using generalized linear function approximations. We provide theoretical guarantees on its safety and optimality. We experimentally show that our algorithm is 1) more efficient in terms of sample complexity and computational cost and 2) more applicable to large-scale problems than previous safe RL methods with theoretical guarantees, and 3) comparably sample-efficient and safer compared with existing advanced deep RL methods with safety constraints.


title: Multicomputation with Numbers: The Case of Simple Multiway Systems

abstract: Integer iteration rules such as n |-> {a n + b, c n +d} are studied as minimal examples of the general process of multicomputation. Despite the simplicity of such rules, their multiway graphs can be complex, exhibiting, for example, emergent geometry and difficult questions of confluence. Generalizations to rules involving non-integers and other functions are also considered. Connections with physics and with various number-theoretic and other questions are made.


title: Double frustration and magneto-electro-elastic excitations in collinear multiferroic materials

abstract: We discuss a model scenario for multiferroic systems of type II (collinear spins) where the electric dipolar order competes with a frustrated magnetic order in determining the elastic distortions of the lattice ion positions. High magnetic frustration due to second neighbors exchange and small spin easy-axis anisotropy lead to the appearance of the so called quantum magnetic plateau states. Increasing the magnetic field above the plateau border produces composite excitations, where fractionalized spin tertions arise together with spontaneous dipolar flips (in the form of domain walls) and enhanced localized elastic distortions. This peculiar magneto-electric effect may be described by magneto-electric-elastic (MEE) quasiparticles that could be detected by X-ray and neutron diffraction techniques. Our results are supported by extensive DMRG computations on the spin sector and self-consistent equations for the lattice distortions.


title: Nearly-Linear Time LP Solvers and Rounding Algorithms for Scheduling Problems

abstract: We study nearly-linear time approximation algorithms for non-preemptive scheduling problems in two settings: the unrelated machine setting, and the identical machine with job precedence constraints setting, under the well-studied objectives such as makespan and weighted completion time. For many problems, we develop nearly-linear time approximation algorithms with approximation ratios matching the current best ones achieved in polynomial time. Our main technique is linear programming relaxation. For the unrelated machine setting, we formulate mixed packing and covering LP relaxations of nearly-linear size, and solve them approximately using the nearly-linear time solver of Young. For the makespan objective, we develop a rounding algorithm with $(2+\epsilon)$-approximation ratio. For the weighted completion time objective, we prove the LP is as strong as the rectangle LP used by Im and Li, leading to a nearly-linear time $(1.45 + \epsilon)$-approximation for the problem. For problems in the identical machine with precedence constraints setting, the precedence constraints can not be formulated as packing or covering constraints. To achieve the nearly-linear running time, we define a polytope for the constraints, and leverage the multiplicative weight update (MWU) method with an oracle which always returns solutions in the polytope.


title: Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives

abstract: Background: Electronic Health Records (EHRs) contain rich information of patients' health history, which usually include both structured and unstructured data. There have been many studies focusing on distilling valuable information from structured data, such as disease codes, laboratory test results, and treatments. However, relying on structured data only might be insufficient in reflecting patients' comprehensive information and such data may occasionally contain erroneous records. Objective: With the recent advances of machine learning (ML) and deep learning (DL) techniques, an increasing number of studies seek to obtain more accurate results by incorporating unstructured free-text data as well. This paper reviews studies that use multimodal data, i.e. a combination of structured and unstructured data, from EHRs as input for conventional ML or DL models to address the targeted tasks. Materials and Methods: We searched in the Institute of Electrical and Electronics Engineers (IEEE) Digital Library, PubMed, and Association for Computing Machinery (ACM) Digital Library for articles related to ML-based multimodal EHR studies. Results and Discussion: With the final 94 included studies, we focus on how data from different modalities were combined and interacted using conventional ML and DL techniques, and how these algorithms were applied in EHR-related tasks. Further, we investigate the advantages and limitations of these fusion methods and indicate future directions for ML-based multimodal EHR research.


title: The Frobenius problem for numerical semigroups generated by sequences that satisfy a linear recurrence relation

abstract: Consider a sequence of positive integers of the form $ca^n-d$, $n\geq 1$, where $a, c$ and $d$ are positive integers, $a>1$. For each $n\geq 1$, let $S_n$ be the submonoid of $\mathbb N$ generated by $\mathbf s_j=ca^{n+j}-d$, with $j\in\mathbb N$. We obtain a numerical semigroup $(1/e)S_n$ by dividing every element of $S_n$ by $e=\gcd(S_n)$. We characterize the embedding dimension of $S_n$ and describe a method to find the minimal generating set of $S_n$. We also show how to find the maximum element of the Ap\'ery set ${\rm Ap}(S_n, \mathbf s_0)$, characterize the elements of ${\rm Ap}(S_n, \mathbf s_0)$, and use these results to compute the Frobenius number of the numerical semigroup $(1/e)S_n$, where $e=\gcd(S_n)$.


title: Dynamics of charged particles moving around Kerr black hole with inductive charge and external magnetic field

abstract: We mainly focus on the effects of small changes of parameters on the dynamics of charged particles around the Kerr black hole surrounded by an external magnetic field, which can be considered as a tidal environment. The radial motions of charged particles on the equatorial plane are studied via an effective potential. It is found that the particle energies at the local maxima values of the effective potentials increase with an increase of the black hole spin and the particle angular momenta, but decrease with an increase of one of the inductive charge parameter and magnetic field parameter. The radii of stable circular orbits on the equatorial plane also increase, whereas those of the innermost stable circular orbits decrease. On the other hand, the effects of small variations of the parameters on the orbital regular and chaotic dynamics of charged particles on the non-equatorial plane are traced by means of a time-transformed explicit symplectic integrator, Poincar\'{e} sections and fast Lyapunov indicators. It is shown that the dynamics sensitively depends on small variations of the inductive charge parameter, magnetic field parameter, energy and angular momentum. Chaos occurs easily as each of the dynamical parameters increases. When the dragging effects of the spacetime increase, the chaotic properties are not always weakened under some circumstances.


title: Label-Aware Distribution Calibration for Long-tailed Classification

abstract: Real-world data usually present long-tailed distributions. Training on imbalanced data tends to render neural networks perform well on head classes while much worse on tail classes. The severe sparseness of training instances for the tail classes is the main challenge, which results in biased distribution estimation during training. Plenty of efforts have been devoted to ameliorating the challenge, including data re-sampling and synthesizing new training instances for tail classes. However, no prior research has exploited the transferable knowledge from head classes to tail classes for calibrating the distribution of tail classes. In this paper, we suppose that tail classes can be enriched by similar head classes and propose a novel distribution calibration approach named as label-Aware Distribution Calibration LADC. LADC transfers the statistics from relevant head classes to infer the distribution of tail classes. Sampling from calibrated distribution further facilitates re-balancing the classifier. Experiments on both image and text long-tailed datasets demonstrate that LADC significantly outperforms existing methods.The visualization also shows that LADC provides a more accurate distribution estimation.


title: Modular Decomposition of Hierarchical Finite State Machines

abstract: In this paper we develop an analogue of the graph-theoretic `modular decomposition' in automata theory. This decomposition allows us to identify hierarchical finite state machines (HFSMs) equivalent to a given finite state machine (FSM). We first define a module of an FSM, which is a collection of nodes which can be treated as a nested FSM. We then identify a natural subset of FSM modules called thin modules, which are algebraically well-behaved. We construct a linear-space directed graph, which uniquely represents every thin module, and hence every equivalent (thin) HFSM. We call this graph the modular decomposition. The modular decomposition makes clear the significant common structure underlying equivalent HFSMs, and allows us to efficiently construct equivalent HFSMs. Finally, we provide an $O(n^2k)$ algorithm for constructing the modular decomposition of an $n$-state $k$-symbol FSM.


title: Programmable black phosphorus image sensor for broadband optoelectronic edge computing

abstract: Image sensors with internal computing capability enable in-sensor computing that can significantly reduce the communication latency and power consumption for machine vision in distributed systems and robotics. Two-dimensional semiconductors are uniquely advantageous in realizing such intelligent visionary sensors because of their tunable electrical and optical properties and amenability for heterogeneous integration. Here, we report a multifunctional infrared image sensor based on an array of black phosphorous programmable phototransistors (bP-PPT). By controlling the stored charges in the gate dielectric layers electrically and optically, the bP-PPT's electrical conductance and photoresponsivity can be locally or remotely programmed with high precision to implement an in-sensor convolutional neural network (CNN). The sensor array can receive optical images transmitted over a broad spectral range in the infrared and perform inference computation to process and recognize the images with 92% accuracy. The demonstrated multispectral infrared imaging and in-sensor computing with the black phosphorous optoelectronic sensor array can be scaled up to build a more complex visionary neural network, which will find many promising applications for distributed and remote multispectral sensing.


title: Joint Neural AEC and Beamforming with Double-Talk Detection

abstract: Acoustic echo cancellation (AEC) in full-duplex communication systems eliminates acoustic feedback. However, nonlinear distortions induced by audio devices, background noise, reverberation, and double-talk reduce the efficiency of conventional AEC systems. Several hybrid AEC models were proposed to address this, which use deep learning models to suppress residual echo from standard adaptive filtering. This paper proposes deep learning-based joint AEC and beamforming model (JAECBF) building on our previous self-attentive recurrent neural network (RNN) beamformer. The proposed network consists of two modules: (i) multi-channel neural-AEC, and (ii) joint AEC-RNN beamformer with a double-talk detection (DTD) that computes time-frequency (T-F) beamforming weights. We train the proposed model in an end-to-end approach to eliminate background noise and echoes from far-end audio devices, which include nonlinear distortions. From experimental evaluations, we find the proposed network outperforms other multi-channel AEC and denoising systems in terms of speech recognition rate and overall speech quality.


title: Optical photonic crystals fabricated from colloidal systems

abstract: Photonic crystals of close-packed arrays of air spheres in a dielectric background of titania have been fabricated with a novel ceramic technique. Unlike previous methods, ordering of the spheres and the formation of the titania network are performed simultaneously. The photonic crystals exhibit a reflectance peak and a uniform color at the position of the first stop band. The wavelength of the reflectance peak scales very well with the sphere size.


title: The Role of Adaptive Optimizers for Honest Private Hyperparameter Selection

abstract: Hyperparameter optimization is a ubiquitous challenge in machine learning, and the performance of a trained model depends crucially upon their effective selection. While a rich set of tools exist for this purpose, there are currently no practical hyperparameter selection methods under the constraint of differential privacy (DP). We study honest hyperparameter selection for differentially private machine learning, in which the process of hyperparameter tuning is accounted for in the overall privacy budget. To this end, we i) show that standard composition tools outperform more advanced techniques in many settings, ii) empirically and theoretically demonstrate an intrinsic connection between the learning rate and clipping norm hyperparameters, iii) show that adaptive optimizers like DPAdam enjoy a significant advantage in the process of honest hyperparameter tuning, and iv) draw upon novel limiting behaviour of Adam in the DP setting to design a new and more efficient optimizer.


title: Turbulence and particle acceleration in a relativistic plasma

abstract: In a collisionless plasma, the energy distribution function of plasma particles can be strongly affected by turbulence. In particular, it can develop a non-thermal power-law tail at high energies. We argue that turbulence with initially relativistically strong magnetic perturbations (magnetization parameter $\sigma \gg 1$) quickly evolves into a state with ultra-relativistic plasma temperature but mildly relativistic turbulent fluctuations. We present a phenomenological and numerical study suggesting that in this case, the exponent $\alpha$ in the power-law particle energy distribution function, $f(\gamma)d\gamma\propto \gamma^{-\alpha}d\gamma$, depends on magnetic compressibility of turbulence. Our analytic prediction for the scaling exponent $\alpha$ is in good agreement with the numerical results.


title: Lepton flavor violating decays $\tau\rightarrow{Pl}$ in the $U(1)_X$SSM model

abstract: $U(1)_X$SSM is the extension of the minimal supersymmetric standard model(MSSM) and its local gauge group is $SU(3)_C\times SU(2)_L \times U(1)_Y \times U(1)_X$. To obtain this model, three singlet new Higgs superfields and right-handed neutrinos are added to MSSM. In the framework of $U(1)_X$SSM, we study lepton flavor violating decays $\tau\rightarrow{Pl}(P=\pi,~\eta,~\eta^\prime;~l=\mu,~e)$. According to the latest experimental data of $\tau\rightarrow{Pe}$ and $\tau\rightarrow{P\mu}$, the influence of different sensitive parameters on the results is analyzed to make a reasonable prediction for future experiments. From the numerical analysis, the non-diagonal elements which correspond to the generations of the initial lepton and final lepton are main sensitive parameters and lepton flavor violation(LFV) sources. This work can provide a basis for finding the existence of new physics(NP).


title: FPM: A Collection of Large-scale Foundation Pre-trained Language Models

abstract: Large-scale Transformer models have significantly promoted the recent development of natural language processing applications. However, little effort has been made to unify the effective models. In this paper, driven by providing a new set of baseline models in the future, we adopt various novel transformer architectures and launch a model set with the help of recent mainstream technologies. We focus the discussions on optimizing the depth of the networks based on the existing powerful encode-decoder structures. We show that by properly avoiding training defects such as non-convergence and degradation, scaling up off-the-shelf transformer architectures consistently delivers better performance. To stimulate future research on large-scale language model pretraining, we present extensive results and detailed discussions on network performance improvements with respect to the network depth and confirm the existence of the optimal number of layers under specific tasks. To the best of our knowledge, we provide the largest Chinese generative model and the largest Chinese encoding model. The BERT language models we trained on English datasets deliver a 14.45% higher F1 score than the Turing-NLR.


title: Structure-Behavior Coalescence Process Algebra -- Toward a Unified View of the System in Model-Based Systems Engineering

abstract: In Model-Based Systems Engineering (MBSE), the Systems Modeling Language (SysML) specification includes a metamodel that defines the language concepts and a user model that defines how the language concepts are represented. In SysML, an important use of metamodel is to provide an integrated semantic framework that every diagram in the user model can be projected as a view of the metamodel. However, most existing SysML metamodels lack such capability of being a basis for unification of different views of a system. To overcome the shortcomings of the current SysML metamodel approaches, we developed Channel-Based Multi-Queue Structure-Behavior Coalescence Process Algebra (C-M-SBC-PA), which provides an integrated semantic framework that is able to integrate structural constructs with behavioral constructs. Using C-M-SBC-PA as the metamodel of SysML, each diagram in the user model can be projected as a view of the C-M-SBC-PA metamodel.


title: Real-time Instance Segmentation of Surgical Instruments using Attention and Multi-scale Feature Fusion

abstract: Precise instrument segmentation aid surgeons to navigate the body more easily and increase patient safety. While accurate tracking of surgical instruments in real-time plays a crucial role in minimally invasive computer-assisted surgeries, it is a challenging task to achieve, mainly due to 1) complex surgical environment, and 2) model design with both optimal accuracy and speed. Deep learning gives us the opportunity to learn complex environment from large surgery scene environments and placements of these instruments in real world scenarios. The Robust Medical Instrument Segmentation 2019 challenge (ROBUST-MIS) provides more than 10,000 frames with surgical tools in different clinical settings. In this paper, we use a light-weight single stage instance segmentation model complemented with a convolutional block attention module for achieving both faster and accurate inference. We further improve accuracy through data augmentation and optimal anchor localisation strategies. To our knowledge, this is the first work that explicitly focuses on both real-time performance and improved accuracy. Our approach out-performed top team performances in the ROBUST-MIS challenge with over 44% improvement on both area-based metric MI_DSC and distance-based metric MI_NSD. We also demonstrate real-time performance (> 60 frames-per-second) with different but competitive variants of our final approach.


title: Bound on photon circular orbits in general relativity and beyond

abstract: Existence of a photon circular orbit can tell us a lot about the nature of the underlying spacetime, since it plays a pivotal role in the understanding of the characteristic signatures of compact objects, namely the quasi-normal modes and shadow radius. For this purpose, determination of the location of the photon circular orbit is of utmost importance. In this work, we derive bounds on the location of the photon circular orbit around compact objects within the purview of general relativity and beyond. As we have explicitly demonstrated, contrary to the earlier results in the context of general relativity, the bound on the location of the photon circular orbit is not necessarily an upper bound, rather depending on the matter content it is possible to arrive at a lower bound as well. This have interesting implications for the quasi-normal modes and shadow radius, the two key observables related to the strong field tests of gravity. Besides discussing the bound for higher dimensional general relativity, we have also considered how the bound on the photon circular orbits gets modified in the braneworld scenario, for pure Lovelock and general Lovelock theories of gravity. Implications of these results for compact objects have also been discussed.


title: vlang: Mapping Verilog Netlists to Modern Technologies

abstract: Portability of hardware designs between Programmable Logic Devices (PLD) can be accomplished through the use of device-agnostic hardware description languages (HDL) such as Verilog or VHDL. Hardware designers can use HDLs to migrate hardware designs between devices and explore performance, area and power tradeoffs, as well as, port designs to an alternative device. However, if design files are corrupt or missing, the portability of the design is lost. While reverse engineering efforts may be able to recover an HDL-netlist of the original design, HDL-netlists use device-specific primitives, restricting portability. Additionally, the recovered design may benefit from other computational technologies (e.g., $\mu$P, GPGPUs), but is restricted to the domain of PLDs. In this work, we provide a new framework, vlang, which automatically maps Verilog-netlists into LLVM's intermediate representation (IR). The remapped design can use the LLVM-framework to target many device technologies such as: x86-64 assembly, RISC-V, ARM or to other PLDs with a modern high-level synthesis tool. Our framework is able to preserve the exact functionality of the original design within the software executable. The vlang-produced software executable can be used with other software programs, or to verify the functionality and correctness of the remapped design. We evaluate our work with a suite of hardware designs from OpenCores. We compare our framework against state-of-the-art simulators, thereby outlining our framework's ability to produce a fully-functional, cycle accurate software-executable. We also explore the usage of vlang as a front-end for high-level synthesis tools.


title: On the structure of $1$-generator quasi-polycyclic codes over finite chain rings

abstract: Quasi-polycyclic (QP for short) codes over a finite chain ring $R$ are a generalization of quasi-cyclic codes, and these codes can be viewed as an $R[x]$-submodule of $\mathcal{R}_m^{\ell}$, where $\mathcal{R}_m:= R[x]/\langle f\rangle$, and $f$ is a monic polynomial of degree $m$ over $R$. If $f$ factors uniquely into monic and coprime basic irreducibles, then their algebraic structure allow us to characterize the generator polynomials and the minimal generating sets of 1-generator QP codes as $R$-modules. In addition, we also determine the parity check polynomials for these codes by using the strong Gr\"{o}bner bases. In particular, via Magma system, some quaternary codes with new parameters are derived from these 1-generator QP codes.


title: Practical, Provably-Correct Interactive Learning in the Realizable Setting: The Power of True Believers

abstract: We consider interactive learning in the realizable setting and develop a general framework to handle problems ranging from best arm identification to active classification. We begin our investigation with the observation that agnostic algorithms \emph{cannot} be minimax-optimal in the realizable setting. Hence, we design novel computationally efficient algorithms for the realizable setting that match the minimax lower bound up to logarithmic factors and are general-purpose, accommodating a wide variety of function classes including kernel methods, H{\"o}lder smooth functions, and convex functions. The sample complexities of our algorithms can be quantified in terms of well-known quantities like the extended teaching dimension and haystack dimension. However, unlike algorithms based directly on those combinatorial quantities, our algorithms are computationally efficient. To achieve computational efficiency, our algorithms sample from the version space using Monte Carlo "hit-and-run" algorithms instead of maintaining the version space explicitly. Our approach has two key strengths. First, it is simple, consisting of two unifying, greedy algorithms. Second, our algorithms have the capability to seamlessly leverage prior knowledge that is often available and useful in practice. In addition to our new theoretical results, we demonstrate empirically that our algorithms are competitive with Gaussian process UCB methods.


title: Building an AI-ready RSE Workforce

abstract: Artificial Intelligence has been transforming industries and academic research across the globe, and research software development is no exception. Machine learning and deep learning are being applied in every aspect of the research software development lifecycles, from new algorithm design paradigms to software development processes. In this paper, we discuss our views on today's challenges and opportunities that AI has presented on research software development and engineers, and the approaches we, at the University of Florida, are taking to prepare our workforce for the new era of AI.


title: Transitioning from Stage-III to Stage-IV: Cosmology from galaxy$\times$CMB lensing and shear$\times$CMB lensing

abstract: We examine the cosmological constraining power from two cross-correlation probes between galaxy and CMB surveys: the cross-correlation of lens galaxy density with CMB lensing convergence $\langle\delta\kappa\rangle$, and source galaxy weak lensing shear with CMB lensing convergence $\langle\gamma\kappa\rangle$. These two cross-correlation probes provide an independent cross-check of other large-scale structure constraints and are insensitive to galaxy-only or CMB-only systematic effects. In addition, when combined with other large-scale structure probes, the cross-correlations can break degeneracies in cosmological and nuisance parameters, improving both the precision and robustness of the analysis. In this work, we study how the constraining power of $\langle\delta\kappa\rangle+\langle\gamma\kappa\rangle$ changes from Stage-III (ongoing) to Stage-IV (future) surveys. Given the flexibility in selecting the lens galaxy sample, we also explore systematically the impact on cosmological constraints when we vary the redshift range and magnitude limit of the lens galaxies using mock galaxy catalogs. We find that in our setup, the contribution to cosmological constraints from $\langle\delta\kappa\rangle$ and $\langle\gamma\kappa\rangle$ are comparable in the Stage-III datasets; but in Stage-IV surveys, the noise in $\langle\delta\kappa\rangle$ becomes subdominant to cosmic variance, preventing $\langle\delta\kappa\rangle$ to further improve the constraints. This implies that to maximize the cosmological constraints from future $\langle\delta\kappa\rangle+\langle\gamma\kappa\rangle$ analyses, we should focus more on the requirements on $\langle\gamma\kappa\rangle$ instead of $\langle\delta\kappa\rangle$. Furthermore, the selection of the lens sample should be optimized in terms of our ability to characterize its redshift or galaxy bias instead of its number density.


title: Disorder Dynamics in Battery Nanoparticles During Phase Transitions Revealed by Operando Single-Particle Diffraction

abstract: Structural and ion-ordering phase transitions limit the viability of sodium-ion intercalation materials in grid scale battery storage by reducing their lifetime. However, the combination of phenomena in nanoparticulate electrodes creates complex behavior that is difficult to investigate, especially on the single nanoparticle scale under operating conditions. In this work, operando single-particle x-ray diffraction (oSP-XRD) is used to observe single-particle rotation, interlayer spacing, and layer misorientation in a functional sodium-ion battery. oSP-XRD is applied to Na$_{2/3}$[Ni$_{1/3}$Mn$_{2/3}$]O$_{2}$, an archetypal P2-type sodium-ion positive electrode material with the notorious P2-O2 phase transition induced by sodium (de)intercalation. It is found that during sodium extraction, the misorientation of crystalline layers inside individual particles increases before the layers suddenly align just prior to the P2-O2 transition. The increase in the long-range order coincides with an additional voltage plateau signifying a phase transition prior to the P2-O2 transition. To explain the layer alignment, a model for the phase evolution is proposed that includes a transition from localized to correlated Jahn-Teller distortions. The model is anticipated to guide further characterization and engineering of sodium-ion intercalation materials with P2-O2 type transitions. oSP-XRD therefore opens a powerful avenue for revealing complex phase behavior in heterogeneous nanoparticulate systems.