title: Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting

abstract: In this work, we consider rather general and broad class of Markov chains, Ito chains, that look like Euler-Maryama discretization of some Stochastic Differential Equation. The chain we study is a unified framework for theoretical analysis. It comes with almost arbitrary isotropic and state-dependent noise instead of normal and state-independent one as in most related papers. Moreover, in our chain the drift and diffusion coefficient can be inexact in order to cover wide range of applications as Stochastic Gradient Langevin Dynamics, sampling, Stochastic Gradient Descent or Stochastic Gradient Boosting. We prove the bound in $W_{2}$-distance between the laws of our Ito chain and corresponding differential equation. These results improve or cover most of the known estimates. And for some particular cases, our analysis is the first.


title: Measurement of nuclear effects in neutrino-argon interactions using generalized kinematic imbalance variables with the MicroBooNE detector

abstract: We present a set of new generalized kinematic imbalance variables that can be measured in neutrino scattering. These variables extend previous measurements of kinematic imbalance on the transverse plane, and are more sensitive to modeling of nuclear effects. We demonstrate the enhanced power of these variables using simulation, and then use the MicroBooNE detector to measure them for the first time. We report flux-integrated single- and double-differential measurements of charged-current muon neutrino scattering on argon using a topolgy with one muon and one proton in the final state as a function of these novel kinematic imbalance variables. These measurements allow us to demonstrate that the treatment of charged current quasielastic interactions in GENIE version 2 is inadequate to describe data. Further, they reveal tensions with more modern generator predictions particularly in regions of phase space where final state interactions are important.


title: Transformers and Large Language Models for Chemistry and Drug Discovery

abstract: Language modeling has seen impressive progress over the last years, mainly prompted by the invention of the Transformer architecture, sparking a revolution in many fields of machine learning, with breakthroughs in chemistry and biology. In this chapter, we explore how analogies between chemical and natural language have inspired the use of Transformers to tackle important bottlenecks in the drug discovery process, such as retrosynthetic planning and chemical space exploration. The revolution started with models able to perform particular tasks with a single type of data, like linearised molecular graphs, which then evolved to include other types of data, like spectra from analytical instruments, synthesis actions, and human language. A new trend leverages recent developments in large language models, giving rise to a wave of models capable of solving generic tasks in chemistry, all facilitated by the flexibility of natural language. As we continue to explore and harness these capabilities, we can look forward to a future where machine learning plays an even more integral role in accelerating scientific discovery.


title: Exoskeleton-Mediated Physical Human-Human Interaction for a Sit-to-Stand Rehabilitation Task

abstract: Sit-to-Stand (StS) is a fundamental daily activity that can be challenging for stroke survivors due to strength, motor control, and proprioception deficits in their lower limbs. Existing therapies involve repetitive StS exercises, but these can be physically demanding for therapists while assistive devices may limit patient participation and hinder motor learning. To address these challenges, this work proposes the use of two lower-limb exoskeletons to mediate physical interaction between therapists and patients during a StS rehabilitative task. This approach offers several advantages, including improved therapist-patient interaction, safety enforcement, and performance quantification. The whole body control of the two exoskeletons transmits online feedback between the two users, but at the same time assists in movement and ensures balance, and thus helping subjects with greater difficulty. In this study we present the architecture of the framework, presenting and discussing some technical choices made in the design.


title: Quantile-based Maximum Likelihood Training for Outlier Detection

abstract: Discriminative learning effectively predicts true object class for image classification. However, it often results in false positives for outliers, posing critical concerns in applications like autonomous driving and video surveillance systems. Previous attempts to address this challenge involved training image classifiers through contrastive learning using actual outlier data or synthesizing outliers for self-supervised learning. Furthermore, unsupervised generative modeling of inliers in pixel space has shown limited success for outlier detection. In this work, we introduce a quantile-based maximum likelihood objective for learning the inlier distribution to improve the outlier separation during inference. Our approach fits a normalizing flow to pre-trained discriminative features and detects the outliers according to the evaluated log-likelihood. The experimental evaluation demonstrates the effectiveness of our method as it surpasses the performance of the state-of-the-art unsupervised methods for outlier detection. The results are also competitive compared with a recent self-supervised approach for outlier detection. Our work allows to reduce dependency on well-sampled negative training data, which is especially important for domains like medical diagnostics or remote sensing.


title: Notes on osculations and mode tracing in semi-analytical waveguide modeling

abstract: The dispersion curves of (elastic) waveguides frequently exhibit crossings and osculations (also known as veering, repulsion, or avoided crossing). Osculations are regions in the dispersion diagram where curves approach each other arbitrarily closely without ever crossing before veering apart. In semi-analytical (undamped) waveguide models, dispersion curves are obtained as solutions to discretized parameterized Hermitian eigenvalue problems. In the mathematical literature, it is known that such eigencurves can exhibit crossing points only if the corresponding matrix flow (parameter-dependent matrix) is uniformly decomposable. We discuss the implications for the solution of the waveguide problem. In particular, we make use of a simple algorithm recently suggested in the literature for decomposing matrix flows. We also employ a method for mode tracing based on approximating the eigenvalue problem for individual modes by an ordinary differential equation that can be solved by standard procedures.


title: A law of the iterated logarithm for small counts in Karlin's occupancy scheme

abstract: In the Karlin infinite occupancy scheme, balls are thrown independently into an infinite array of boxes $1$, $2,\ldots$, with probability $p_k$ of hitting the box $k$. For $j,n\in\mathbb{N}$, denote by $\mathcal{K}^*_j(n)$ the number of boxes containing exactly $j$ balls provided that $n$ balls have been thrown. We call $\textit{small counts}$ the variables $\mathcal{K}^*_j(n)$, with $j$ fixed. Our main result is a law of the iterated logarithm (LIL) for the small counts as the number of balls thrown becomes large. Its proof exploits a Poissonization technique and is based on a new LIL for infinite sums of independent indicators $\sum_{k\geq 1}\Bbb{1}_{A_k(t)}$ as $t\to\infty$, where the family of events $(A_k(t))_{t\geq 0}$ is not necessarily monotone in $t$. The latter LIL is an extension of a LIL obtained recently by Buraczewski, Iksanov and Kotelnikova (2023+) in the situation that $(A_k(t))_{t\geq 0}$ forms a nondecreasing family of events.


title: Relational Composition of Physical Systems: A Categorical Approach

abstract: In this master's thesis, we rigorously develop two frameworks of relational composition of systems using tools from category theory. The first framework addresses port-Hamiltonian systems, which are dynamical systems whose dynamics are connected to flows of energy across a boundary. The second framework addresses thermostatic systems, which are descriptions of equilibria in physical systems using entropy. We also review necessary subjects to develop these frameworks from a category-theoretic viewpoint, including inear algebra, differential geometry, and convex geometry.


title: Predictive auxiliary objectives in deep RL mimic learning in the brain

abstract: The ability to predict upcoming events has been hypothesized to comprise a key aspect of natural and machine cognition. This is supported by trends in deep reinforcement learning (RL), where self-supervised auxiliary objectives such as prediction are widely used to support representation learning and improve task performance. Here, we study the effects predictive auxiliary objectives have on representation learning across different modules of an RL system and how these mimic representational changes observed in the brain. We find that predictive objectives improve and stabilize learning particularly in resource-limited architectures, and we identify settings where longer predictive horizons better support representational transfer. Furthermore, we find that representational changes in this RL system bear a striking resemblance to changes in neural activity observed in the brain across various experiments. Specifically, we draw a connection between the auxiliary predictive model of the RL system and hippocampus, an area thought to learn a predictive model to support memory-guided behavior. We also connect the encoder network and the value learning network of the RL system to visual cortex and striatum in the brain, respectively. This work demonstrates how representation learning in deep RL systems can provide an interpretable framework for modeling multi-region interactions in the brain. The deep RL perspective taken here also suggests an additional role of the hippocampus in the brain -- that of an auxiliary learning system that benefits representation learning in other regions.


title: A Necessary Condition on the Collatz Conjecture

abstract: The Collatz conjecture implies that an iterated function sequence under a certain linear operator, beginning with a certain complex valued function, must converge to a certain complex function.


title: A trion in a magnetic field revisited

abstract: We revisit the problem of a two dimensional trion in an external magnetic field. We demonstrate that the approximations used previously for finding the energy spectrum of this system break down in the experimentally accessible range of magnetic fields. It is shown that the neglect of the Coulomb-induced mixing of different Landau levels corresponding to non-interacting particles leads to a strong underestimation of the trion binding energies even at extremely high magnetic fields (hundreds of Tesla). Moreover, proper account of the Coulomb effects for certain values of the parameters can lead to the appearance of additional discrete trion states which were overlooked previously. Finally, we provide a database of the matrix elements necessary for calculation of the magnetotrion spectra for a wide class of materials.


title: Numerical Analysis of time-dependent Hamilton-Jacobi Equations on Networks

abstract: A new algorithm for time dependent Hamilton Jacobi equations on networks, based on semi Lagrangian scheme, is proposed. It is based on the definition of viscosity solution for this kind of problems recently given in. A thorough convergence analysis, not requiring weak semilimits, is provided. In particular, the check of the supersolution property at the vertices is performed through a dynamical technique which seems new. The scheme is efficient, explicit, allows long time steps, and is suitable to be implemented in a parallel algorithm. We present some numerical tests, showing the advantage in terms of computational cost over the one proposed in [7]


title: On $A^4 + hB^4 = C^4 + hD^4$

abstract: In this paper, this author proved that $A^4 + hB^4 = C^4 + hD^4$ always has the integral solutions for $h < 20000.$ Then we conjecture the equation $A^4 + hB^4 = C^4 + hD^4$ always has the integral solutions.


title: Predicting New Heavy Fermion Materials within Carbon-Boron Clathrate Structures

abstract: Heavy fermion materials have been a rich playground for strongly correlated physics for decades. However, engineering tunable and synthesizable heavy fermion materials remains a challenge. We strive to integrate heavy fermion properties into carbon boron clathrates as a universal structure which can host a diverse array of interesting physical phenomena. Using a combination of density functional theory and dynamical mean field theory, we study two rare earth carbon boron clathrates, SmB$_3$C$_3$ and CeB$_3$C$_3$, and explore properties arising from the strong electronic correlations. We find a significant increase in the density of states at the Fermi level in CeB$_3$C$_3$ as the temperature is lowered, indicating the development of a heavy electron state. In SmB$_3$C$_3$, a potential Kondo insulating state is identified. Both findings point to rare earth carbon boron clathrates as novel strongly correlated materials within a universally tunable structure, offering a fresh platform to innovate upon conventional heavy-fermion materials design.


title: Gamma-ray Blazar Classification using Machine Learning with Advanced Weight Initialization and Self-Supervised Learning Techniques

abstract: Machine learning has emerged as a powerful tool in the field of gamma-ray astrophysics. The algorithms can distinguish between different source types, such as blazars and pulsars, and help uncover new insights into the high-energy universe. The Large Area Telescope (LAT) on-board the Fermi Gamma-ray telescope has significantly advanced our understanding of the Universe. The instrument has detected a large number of gamma-ray emitting sources, among which a significant number of objects have been identified as active galactic nuclei (AGN). The sample is primarily composed of blazars; however, more than one-third of these sources are either of an unknown class or lack a definite association with a low-energy counterpart. In this work, we employ multiple machine learning algorithms to classify the sources based on their other physical properties. In particular, we utilized smart initialisation techniques and self-supervised learning for classifying blazars into BL Lacertae objects (BL Lac) and flat spectrum radio quasars (FSRQ). The core advantage of the algorithm is its simplicity, usage of minimum number of features and easy deployment due to lesser number of parameters without compromising on the performance. The model predicts that out of the 1115 sources of uncertain type in the 4FGL-DR3 catalog, 820 can be classified as BL Lacs, and 295 can be classified as FSRQs.


title: Diagnosing tracer transport in convective penetration of a stably stratified layer

abstract: We use large-eddy simulations to study the penetration of a buoyant plume carrying a passive tracer into a stably stratified layer with constant buoyancy frequency. Using a buoyancy-tracer volume distribution, we develop a method for objectively partitioning buoyancy-tracer space into three regions, each of which corresponds to a coherent region in physical space. Specifically, we identify a source region where undiluted plume fluid enters the stratified layer, a transport region where much of the transition from undiluted to mixed fluid occurs in the plume cap, and an accumulation region corresponding to the radially spreading intrusion. This method enables quantification of different measures of turbulence and mixing within each of the three regions, including potential energy and turbulent kinetic energy dissipation rates, an activity parameter, and the instantaneous mixing efficiency. We find that the most intense buoyancy gradients lie in a thin layer at the cap of the penetrating plume. This forms the primary stage of mixing between plume and environment and exhibits a mixing efficiency around 50%. Newly generated mixtures of environmental and plume fluid joining the intrusion are subjected to relatively weak turbulence and weaker buoyancy gradients as mixtures are homogenised. As the intrusion spreads radially, environmental fluid surrounding the intrusion is mixed into the intrusion with moderate mixing efficiency. This dominates the total entrainment of environmental fluid into the plume as a whole. However, the 'strongest' entrainment, as measured by the specific entrainment rate, is largest in the plume cap where the most buoyant environmental fluid is entrained.


title: Magnetic Field Properties inside the Jet of Mrk 421: Multiwavelength Polarimetry Including the Imaging X-ray Polarimetry Explorer

abstract: We conducted a polarimetry campaign from radio to X-ray wavelengths of the high-synchrotron-peak (HSP) blazar Mrk 421, including Imaging X-ray Polarimetry Explorer (IXPE) measurements on 2022 December 6-8. We detected X-ray polarization of Mrk 421 with a degree of $\Pi_{\rm X}$=14$\pm$1$\%$ and an electric-vector position angle $\psi_{\rm X}$=107$\pm$3$^{\circ}$ in the 2-8 keV band. From the time variability analysis, we find a significant episodic variation in $\psi_{\rm X}$. During 7 months from the first IXPE pointing of Mrk 421 in 2022 May, $\psi_{\rm X}$ varied across the range of 0$^{\circ}$ to 180$^{\circ}$, while $\Pi_{\rm X}$ maintained similar values within $\sim$10-15$\%$. Furthermore, a swing in $\psi_{\rm X}$ in 2022 June was accompanied by simultaneous spectral variations. The results of the multiwavelength polarimetry show that the X-ray polarization degree was generally $\sim$2-3 times greater than that at longer wavelengths, while the polarization angle fluctuated. Additionally, based on radio, infrared, and optical polarimetry, we find that rotation of $\psi$ occurred in the opposite direction with respect to the rotation of $\psi_{\rm X}$ over longer timescales at similar epochs. The polarization behavior observed across multiple wavelengths is consistent with previous IXPE findings for HSP blazars. This result favors the energy-stratified shock model developed to explain variable emission in relativistic jets. The accompanying spectral variation during the $\psi_{\rm X}$ rotation can be explained by a fluctuation in the physical conditions, e.g., in the energy distribution of relativistic electrons. The opposite rotation direction of $\psi$ between the X-ray and longer-wavelength polarization accentuates the conclusion that the X-ray emitting region is spatially separated from that at longer wavelengths.


title: Dynamics of wind turbine operational states

abstract: Modern wind turbines gather a wealth of data with Supervisory Control And Data Acquisition (SCADA) systems. We study the short-term mutual dependencies of a variety of observables by evaluating Pearson correlation matrices on a moving time window. Using clustering on these matrices, we identify multiple stable operational states, which characterize the non-stationarity of mutual dependencies at a single turbine. They represent different turbine operational settings. Moreover, we combine the clustering analysis with a construction of a stochastic process to study the switching dynamics of those states in more detail. Calculating the distances between correlation matrices we obtain a time series that describes the behavior of the complex system in a collective way. Assuming this time series to be governed by a Langevin equation, we estimate the deterministic (drift) and stochastic (diffusion) components of the dynamics to understand the underlying non-stationarity. After adapting our method to specific features of our data, we are able to study the dynamics of operational states and their transitions as well as to resolve hysteresis effects.

categories: physics.flu-dyn physics.ao-ph physics.data-an stat.AP


title: Postulating the Unicity of the Macroscopic Physical World

abstract: We argue that a clear view on quantum mechanics is obtained by considering that the unicity of the macroscopic world is a fundamental postulate of physics, rather than an issue that must be mathematically justified or demonstrated. This postulate allows a framework in which quantum mechanics can be constructed, in a complete mathematically consistent way. This is made possible by using general operator algebras to extend the mathematical description of the physical world towards macroscopic systems. Such an approach goes beyond the usual type I operator algebras used in standard textbook quantum mechanics. This avoids a major pitfall, which is the temptation to make the usual type I formalism 'universal'. This may also provide a meta-framework for both classical and quantum physics, shedding a new light on ancient conceptual antagonisms, and clarifying the status of quantum objects. Beyond exploring remote corners of quantum physics, we expect these ideas to be helpful to better understand and develop quantum technologies.


title: High Dimensional Causal Inference with Variational Backdoor Adjustment

abstract: Backdoor adjustment is a technique in causal inference for estimating interventional quantities from purely observational data. For example, in medical settings, backdoor adjustment can be used to control for confounding and estimate the effectiveness of a treatment. However, high dimensional treatments and confounders pose a series of potential pitfalls: tractability, identifiability, optimization. In this work, we take a generative modeling approach to backdoor adjustment for high dimensional treatments and confounders. We cast backdoor adjustment as an optimization problem in variational inference without reliance on proxy variables and hidden confounders. Empirically, our method is able to estimate interventional likelihood in a variety of high dimensional settings, including semi-synthetic X-ray medical data. To the best of our knowledge, this is the first application of backdoor adjustment in which all the relevant variables are high dimensional.


title: Quadratic Equations in Elamite Mathematics

abstract: In this article, we study some of quadratic equations and their solutions found in the Susa Mathematical Texts (\textbf{SMT}). We show that the Susa scribes used this group of equations in different problems and took a standard approach, known as completing the square, to find solutions


title: Colossal c-axis response and lack of rotational symmetry breaking within the kagome plane of the CsV$_3$Sb$_5$ superconductor

abstract: The kagome materials AV4$_3$Sb$_5$ (A = K, Rb, Cs) host an intriguing interplay between unconventional superconductivity and charge-density-waves. Here, we investigate CsV$_3$Sb$_5$ by combining high-resolution thermal-expansion, heat-capacity and electrical resistance under strain measurements. We directly unveil that the superconducting and charge-ordered states strongly compete, and that this competition is dramatically influenced by tuning the crystallographic c-axis. In addition, we report the absence of additional bulk phase transitions within the charge-ordered state, notably associated with rotational symmetry-breaking within the kagome planes. This suggests that any breaking of the C$_6$ invariance occurs via different stacking of C$_6$-symmetric kagome patterns. Finally, we find that the charge-density-wave phase exhibits an enhanced A$_{1g}$-symmetric elastoresistance coefficient, whose large increase at low temperature is driven by electronic degrees of freedom.


title: Leveraging Multilingual Self-Supervised Pretrained Models for Sequence-to-Sequence End-to-End Spoken Language Understanding

abstract: A number of methods have been proposed for End-to-End Spoken Language Understanding (E2E-SLU) using pretrained models, however their evaluation often lacks multilingual setup and tasks that require prediction of lexical fillers, such as slot filling. In this work, we propose a unified method that integrates multilingual pretrained speech and text models and performs E2E-SLU on six datasets in four languages in a generative manner, including the prediction of lexical fillers. We investigate how the proposed method can be improved by pretraining on widely available speech recognition data using several training objectives. Pretraining on 7000 hours of multilingual data allows us to outperform the state-of-the-art ultimately on two SLU datasets and partly on two more SLU datasets. Finally, we examine the cross-lingual capabilities of the proposed model and improve on the best known result on the PortMEDIA-Language dataset by almost half, achieving a Concept/Value Error Rate of 23.65%.


title: A $p$-adic analogue of Borel's theorem

abstract: We prove that Shimura varieties of abelian type satisfy a $p$-adic Borel-extension property over discretely valued fields. More precisely, let $\mathsf{D}$ denote the rigid-analytic closed unit disc and $\mathsf{D}^{\times} = \mathsf{D} \setminus \{0\}$, let $X$ be a smooth rigid-analytic variety, and let $S(G,\mathcal{H})_{\mathsf{K}}$ denote a Shimura variety of abelian type with torsion-free level structure. We prove every rigid-analytic map defined over a discretely valued $p$-adic field $\mathsf{D}^{\times} \times X \rightarrow S(G,\mathcal{H})_{\mathsf{K}}^{\textrm{an}}$ extends to an analytic map $\mathsf{D} \times X \rightarrow (S(G,\mathcal{H})_{\mathsf{K}}^{\textrm{BB}})^{\textrm{an}}$, where $S(G,\mathcal{H})_{\mathsf{K}}^{\textrm{BB}}$ is the Baily-Borel compactification of $S(G,\mathcal{H})_{\mathsf{K}}$. We also deduce various applications to algebraicity of analytic maps, degenerations of families of abeloids, and to $p$-adic notions of hyperbolicity. Along the way, we also prove an extension result for Rapoport-Zink spaces.


title: Quantifying Uncertainty in Deep Learning Classification with Noise in Discrete Inputs for Risk-Based Decision Making

abstract: The use of Deep Neural Network (DNN) models in risk-based decision-making has attracted extensive attention with broad applications in medical, finance, manufacturing, and quality control. To mitigate prediction-related risks in decision making, prediction confidence or uncertainty should be assessed alongside the overall performance of algorithms. Recent studies on Bayesian deep learning helps quantify prediction uncertainty arises from input noises and model parameters. However, the normality assumption of input noise in these models limits their applicability to problems involving categorical and discrete feature variables in tabular datasets. In this paper, we propose a mathematical framework to quantify prediction uncertainty for DNN models. The prediction uncertainty arises from errors in predictors that follow some known finite discrete distribution. We then conducted a case study using the framework to predict treatment outcome for tuberculosis patients during their course of treatment. The results demonstrate under a certain level of risk, we can identify risk-sensitive cases, which are prone to be misclassified due to error in predictors. Comparing to the Monte Carlo dropout method, our proposed framework is more aware of misclassification cases. Our proposed framework for uncertainty quantification in deep learning can support risk-based decision making in applications when discrete errors in predictors are present.


title: Theory and modeling of molecular modes in the NMR relaxation of fluids

abstract: Traditional theories of the NMR autocorrelation function for intramolecular dipole pairs assume single-exponential decay, yet the calculated autocorrelation of realistic systems display a rich, multi-exponential behavior resulting in anomalous NMR relaxation dispersion (i.e., frequency dependence). We develop an approach to model and interpret the multi-exponential autocorrelation using simple, physical models within a rigorous statistical mechanical development that encompasses both rotational and translational diffusion in the same framework. We recast the problem of evaluating the autocorrelation in terms of averaging over a diffusion propagator whose evolution is described by a Fokker-Planck equation. The time-independent part admits an eigenfunction expansion, allowing us to write the propagator as a sum over modes. Each mode has a spatial part that depends on the specified eigenfunction, and a temporal part that depends on the corresponding eigenvalue (i.e., correlation time) with a simple, exponential decay. The spatial part is a probability distribution of the dipole-pair, analogous to the stationary states of a quantum harmonic oscillator. Drawing inspiration from the idea of inherent structures in liquids, we interpret each of the spatial contributions as a specific molecular mode. These modes can be used to model and predict NMR dipole-dipole relaxation dispersion of fluids by incorporating phenomena on the molecular level. We validate our statistical mechanical description of the distribution in molecular modes with molecular dynamics simulations interpreted without any relaxation models or adjustable parameters: the most important poles in the Pad{\'e}-Laplace transform of the simulated autocorrelation agree with the eigenvalues predicted by the theory.


title: Developing and Refining a Multifunctional Facial Recognition System for Older Adults with Cognitive Impairments: A Journey Towards Enhanced Quality of Life

abstract: In an era where the global population is aging significantly, cognitive impairments among the elderly have become a major health concern. The need for effective assistive technologies is clear, and facial recognition systems are emerging as promising tools to address this issue. This document discusses the development and evaluation of a new Multifunctional Facial Recognition System (MFRS), designed specifically to assist older adults with cognitive impairments. The MFRS leverages face_recognition [1], a powerful open-source library capable of extracting, identifying, and manipulating facial features. Our system integrates the face recognition and retrieval capabilities of face_recognition, along with additional functionalities to capture images and record voice memos. This combination of features notably enhances the system's usability and versatility, making it a more user-friendly and universally applicable tool for end-users. The source code for this project can be accessed at https://github.com/Li-8023/Multi-function-face-recognition.git.


title: Design and Performance of Parallel-channel Nanocryotrons in Magnetic Fields

abstract: We introduce a design modification to conventional geometry of the cryogenic three-terminal switch, the nanocryotron (nTron). The conventional geometry of nTrons is modified by including parallel current-carrying channels, an approach aimed at enhancing the device's performance in magnetic field environments. The common challenge in nTron technology is to maintain efficient operation under varying magnetic field conditions. Here we show that the adaptation of parallel channel configurations leads to an enhanced gate signal sensitivity, an increase in operational gain, and a reduction in the impact of superconducting vortices on nTron operation within magnetic fields up to 1 Tesla. Contrary to traditional designs that are constrained by their effective channel width, the parallel nanowire channels permits larger nTron cross sections, further bolstering the device's magnetic field resilience while improving electro-thermal recovery times due to reduced local inductance. This advancement in nTron design not only augments its functionality in magnetic fields but also broadens its applicability in technological environments, offering a simple design alternative to existing nTron devices.


title: QR-Tag: Angular Measurement and Tracking with a QR-Design Marker

abstract: Directional information measurement has many applications in domains such as robotics, virtual and augmented reality, and industrial computer vision. Conventional methods either require pre-calibration or necessitate controlled environments. The state-of-the-art MoireTag approach exploits the Moire effect and QR-design to continuously track the angular shift precisely. However, it is still not a fully QR code design. To overcome the above challenges, we propose a novel snapshot method for discrete angular measurement and tracking with scannable QR-design patterns that are generated by binary structures printed on both sides of a glass plate. The QR codes, resulting from the parallax effect due to the geometry alignment between two layers, can be readily measured as angular information using a phone camera. The simulation results show that the proposed non-contact object tracking framework is computationally efficient with high accuracy.


title: Grokking as the Transition from Lazy to Rich Training Dynamics

abstract: We propose that the grokking phenomenon, where the train loss of a neural network decreases much earlier than its test loss, can arise due to a neural network transitioning from lazy training dynamics to a rich, feature learning regime. To illustrate this mechanism, we study the simple setting of vanilla gradient descent on a polynomial regression problem with a two layer neural network which exhibits grokking without regularization in a way that cannot be explained by existing theories. We identify sufficient statistics for the test loss of such a network, and tracking these over training reveals that grokking arises in this setting when the network first attempts to fit a kernel regression solution with its initial features, followed by late-time feature learning where a generalizing solution is identified after train loss is already low. We find that the key determinants of grokking are the rate of feature learning -- which can be controlled precisely by parameters that scale the network output -- and the alignment of the initial features with the target function $y(x)$. We argue this delayed generalization arises when (1) the top eigenvectors of the initial neural tangent kernel and the task labels $y(x)$ are misaligned, but (2) the dataset size is large enough so that it is possible for the network to generalize eventually, but not so large that train loss perfectly tracks test loss at all epochs, and (3) the network begins training in the lazy regime so does not learn features immediately. We conclude with evidence that this transition from lazy (linear model) to rich training (feature learning) can control grokking in more general settings, like on MNIST, one-layer Transformers, and student-teacher networks.


title: BYOC: Personalized Few-Shot Classification with Co-Authored Class Descriptions

abstract: Text classification is a well-studied and versatile building block for many NLP applications. Yet, existing approaches require either large annotated corpora to train a model with or, when using large language models as a base, require carefully crafting the prompt as well as using a long context that can fit many examples. As a result, it is not possible for end-users to build classifiers for themselves. To address this issue, we propose a novel approach to few-shot text classification using an LLM. Rather than few-shot examples, the LLM is prompted with descriptions of the salient features of each class. These descriptions are coauthored by the user and the LLM interactively: while the user annotates each few-shot example, the LLM asks relevant questions that the user answers. Examples, questions, and answers are summarized to form the classification prompt. Our experiments show that our approach yields high accuracy classifiers, within 82% of the performance of models trained with significantly larger datasets while using only 1% of their training sets. Additionally, in a study with 30 participants, we show that end-users are able to build classifiers to suit their specific needs. The personalized classifiers show an average accuracy of 90%, which is 15% higher than the state-of-the-art approach.


title: Theoretical Analysis of Robust Overfitting for Wide DNNs: An NTK Approach

abstract: Adversarial training (AT) is a canonical method for enhancing the robustness of deep neural networks (DNNs). However, recent studies empirically demonstrated that it suffers from robust overfitting, i.e., a long time AT can be detrimental to the robustness of DNNs. This paper presents a theoretical explanation of robust overfitting for DNNs. Specifically, we non-trivially extend the neural tangent kernel (NTK) theory to AT and prove that an adversarially trained wide DNN can be well approximated by a linearized DNN. Moreover, for squared loss, closed-form AT dynamics for the linearized DNN can be derived, which reveals a new AT degeneration phenomenon: a long-term AT will result in a wide DNN degenerates to that obtained without AT and thus cause robust overfitting. Based on our theoretical results, we further design a method namely Adv-NTK, the first AT algorithm for infinite-width DNNs. Experiments on real-world datasets show that Adv-NTK can help infinite-width DNNs enhance comparable robustness to that of their finite-width counterparts, which in turn justifies our theoretical findings. The code is available at https://github.com/fshp971/adv-ntk.


title: When is Agnostic Reinforcement Learning Statistically Tractable?

abstract: We study the problem of agnostic PAC reinforcement learning (RL): given a policy class $\Pi$, how many rounds of interaction with an unknown MDP (with a potentially large state and action space) are required to learn an $\epsilon$-suboptimal policy with respect to $\Pi$? Towards that end, we introduce a new complexity measure, called the \emph{spanning capacity}, that depends solely on the set $\Pi$ and is independent of the MDP dynamics. With a generative model, we show that for any policy class $\Pi$, bounded spanning capacity characterizes PAC learnability. However, for online RL, the situation is more subtle. We show there exists a policy class $\Pi$ with a bounded spanning capacity that requires a superpolynomial number of samples to learn. This reveals a surprising separation for agnostic learnability between generative access and online access models (as well as between deterministic/stochastic MDPs under online access). On the positive side, we identify an additional \emph{sunflower} structure, which in conjunction with bounded spanning capacity enables statistically efficient online RL via a new algorithm called POPLER, which takes inspiration from classical importance sampling methods as well as techniques for reachable-state identification and policy evaluation in reward-free exploration.


title: Learning Interactive Real-World Simulators

abstract: Generative models trained on internet data have revolutionized how text, image, and video content can be created. Perhaps the next milestone for generative models is to simulate realistic experience in response to actions taken by humans, robots, and other interactive agents. Applications of a real-world simulator range from controllable content creation in games and movies, to training embodied agents purely in simulation that can be directly deployed in the real world. We explore the possibility of learning a universal simulator of real-world interaction through generative modeling. We first make the important observation that natural datasets available for learning a real-world simulator are often rich along different dimensions (e.g., abundant objects in image data, densely sampled actions in robotics data, and diverse movements in navigation data). With careful orchestration of diverse datasets, each providing a different aspect of the overall experience, we can simulate the visual outcome of both high-level instructions such as ``open the drawer'' and low-level controls such as "move by x, y" from otherwise static scenes and objects. We use the simulator to train both high-level vision-language policies and low-level reinforcement learning policies, each of which can be deployed in the real world in zero shot after training purely in simulation. We also show that other types of intelligence such as video captioning models can benefit from training with simulated experience, opening up even wider applications. Video demos can be found at https://universal-simulator.github.io.


title: Extensions of a scale-separated AdS$_4$ solution and their mass spectrum

abstract: We consider two extensions of the so-called DGKT solution, a 4d scale-separated anti-de Sitter (AdS) solution obtained as a compactification on a 6d torus orbifold. Each extension consists in a specific large $n$ expansion beyond the DGKT solution, where $n$ is the unbounded $F_4$-flux parameter. One of the extensions considered generalizes the known warped, partially backreacted solution. We analyse the two extensions in 10d massive type IIA supergravity as well as in a 4d effective theory, using a general warped compactification formalism, including axions. On top of known corrections to DGKT, we mainly get new ones from $F_4$; other fluxes are very constrained by flux quantization. In each extension, one would expect corresponding corrections to the mass spectrum, before reaching contributions from $\alpha'$-corrections. But the mass spectrum turns out to be robust, and conformal dimensions remain unchanged.


title: OptiMUS: Optimization Modeling Using MIP Solvers and large language models

abstract: Optimization problems are pervasive across various sectors, from manufacturing and distribution to healthcare. However, most such problems are still solved heuristically by hand rather than optimally by state-of-the-art solvers, as the expertise required to formulate and solve these problems limits the widespread adoption of optimization tools and techniques. We introduce OptiMUS, a Large Language Model (LLM)-based agent designed to formulate and solve MILP problems from their natural language descriptions. OptiMUS is capable of developing mathematical models, writing and debugging solver code, developing tests, and checking the validity of generated solutions. To benchmark our agent, we present NLP4LP, a novel dataset of linear programming (LP) and mixed integer linear programming (MILP) problems. Our experiments demonstrate that OptiMUS solves nearly twice as many problems as a basic LLM prompting strategy. OptiMUS code and NLP4LP dataset are available at \href{https://github.com/teshnizi/OptiMUS}{https://github.com/teshnizi/OptiMUS}


title: Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models

abstract: We present Step-Back Prompting, a simple prompting technique that enables LLMs to do abstractions to derive high-level concepts and first principles from instances containing specific details. Using the concepts and principles to guide reasoning, LLMs significantly improve their abilities in following a correct reasoning path towards the solution. We conduct experiments of Step-Back Prompting with PaLM-2L, GPT-4 and Llama2-70B models, and observe substantial performance gains on various challenging reasoning-intensive tasks including STEM, Knowledge QA, and Multi-Hop Reasoning. For instance, Step-Back Prompting improves PaLM-2L performance on MMLU (Physics and Chemistry) by 7% and 11% respectively, TimeQA by 27%, and MuSiQue by 7%.


title: Assessment of slip transfer criteria for prismatic-to-prismatic slip in pure Ti from 3D grain boundary data

abstract: Slip transfer and blocking across grain boundaries was studied in a Ti foil with a strong rolling texture deformed in tension. Prior to deformation, the shape of the grains and the orientation of the grain boundaries were quantified through laboratory scale diffraction contrast tomography (LabDCT). Mechanical deformation led to the activation of <a> prismatic slip, and slip transfer/blocking was assessed in > 300 grain boundaries by means of slip trace analysis and electron backscatter diffraction. A categorical model was employed to accurately assess slip transfer, and the "F1 score" of various slip transfer criteria proposed in the literature was evaluated for the first time from 3D grain boundary information. Remarkably, for the prismatic-dominated slip transfer in the current Ti sample, the results show that the best predictions of slip transfer/blocking are provided by the angle \k{appa}, which is directly related to the residual Burgers vector, and by the Luster-Morris parameter m'. In contrast, metrics based on the twist angle {\theta} and on the LRB criterion were not able to predict accurately slip transfer/blocking. Thus, the extensive analysis of the 3D grain boundary data and the novel application of LabDCT was able to help clarify the role of grain boundary orientation on the mechanisms of plastic deformation in polycrystals with strong prismatic-dominated slip.


title: Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity Analysis

abstract: Multivariate Time Series (MTS) widely exists in real-word complex systems, such as traffic and energy systems, making their forecasting crucial for understanding and influencing these systems. Recently, deep learning-based approaches have gained much popularity for effectively modeling temporal and spatial dependencies in MTS, specifically in Long-term Time Series Forecasting (LTSF) and Spatial-Temporal Forecasting (STF). However, the fair benchmarking issue and the choice of technical approaches have been hotly debated in related work. Such controversies significantly hinder our understanding of progress in this field. Thus, this paper aims to address these controversies to present insights into advancements achieved. To resolve benchmarking issues, we introduce BasicTS, a benchmark designed for fair comparisons in MTS forecasting. BasicTS establishes a unified training pipeline and reasonable evaluation settings, enabling an unbiased evaluation of over 30 popular MTS forecasting models on more than 18 datasets. Furthermore, we highlight the heterogeneity among MTS datasets and classify them based on temporal and spatial characteristics. We further prove that neglecting heterogeneity is the primary reason for generating controversies in technical approaches. Moreover, based on the proposed BasicTS and rich heterogeneous MTS datasets, we conduct an exhaustive and reproducible performance and efficiency comparison of popular models, providing insights for researchers in selecting and designing MTS forecasting models.


title: XLSSC 122 caught in the act of growing up: Spatially resolved SZ observations of a z=1.98 galaxy cluster

abstract: How protoclusters evolved from sparse galaxy overdensities to mature galaxy clusters is still not well understood. In this context, detecting and characterizing the hot ICM at high redshifts (z~2) is key to understanding how the continuous accretion from and mergers along the filamentary large-scale structure impact the first phases of cluster formation. We study the dynamical state and morphology of the z=1.98 galaxy cluster XLSSC 122 with high-resolution observations (~5") of the ICM through the SZ effect. Via Bayesian forward modeling, we map the ICM on scales from the virial radius down to the core of the cluster. To constrain such a broad range of spatial scales, we employ a new technique that jointly forward-models parametric descriptions of the pressure distribution to interferometric ACA and ALMA observations and multi-band imaging data from the 6-m, single-dish Atacama Cosmology Telescope. We detect the SZ effect with $11\sigma$ in the ALMA+ACA observations and find a flattened inner pressure profile that is consistent with a non-cool core classification with a significance of $>3\sigma$. In contrast to the previous works, we find better agreement between the SZ effect signal and the X-ray emission as well as the cluster member distribution. Further, XLSSC 122 exhibits an excess of SZ flux in the south of the cluster where no X-ray emission is detected. By reconstructing the interferometric observations and modeling in the uv-plane, we obtain a tentative detection of an infalling group or filamentary-like structure that is believed to boost and heat up the ICM while the density of the gas is low. In addition, we provide an improved SZ mass of $M_{500,\mathrm{c}} = 1.66^{+0.23}_{-0.20} \times 10^{14} \rm M_\odot$. Altogether, the observations indicate that we see XLSSC 122 in a dynamic phase of cluster formation while a large reservoir of gas is already thermalized.


title: From Innermost to Full Almost-Sure Termination of Probabilistic Term Rewriting

abstract: There are many evaluation strategies for term rewrite systems, but proving termination automatically is usually easiest for innermost rewriting. Several syntactic criteria exist when innermost termination implies full termination. We adapt these criteria to the probabilistic setting, e.g., we show when it suffices to analyze almost-sure termination (AST) w.r.t. innermost rewriting to prove full AST of probabilistic term rewrite systems (PTRSs). These criteria also apply to other notions of termination like positive AST. We implemented and evaluated our new contributions in the tool AProVE.


title: From Text to Knowledge with Graphs: modelling, querying and exploiting textual content

abstract: This paper highlights the challenges, current trends, and open issues related to the representation, querying and analytics of content extracted from texts. The internet contains vast text-based information on various subjects, including commercial documents, medical records, scientific experiments, engineering tests, and events that impact urban and natural environments. Extracting knowledge from this text involves understanding the nuances of natural language and accurately representing the content without losing information. This allows knowledge to be accessed, inferred, or discovered. To achieve this, combining results from various fields, such as linguistics, natural language processing, knowledge representation, data storage, querying, and analytics, is necessary. The vision in this paper is that graphs can be a well-suited text content representation once annotated and the right querying and analytics techniques are applied. This paper discusses this hypothesis from the perspective of linguistics, natural language processing, graph models and databases and artificial intelligence provided by the panellists of the DOING session in the MADICS Symposium 2022.


title: Text-driven Prompt Generation for Vision-Language Models in Federated Learning

abstract: Prompt learning for vision-language models, e.g., CoOp, has shown great success in adapting CLIP to different downstream tasks, making it a promising solution for federated learning due to computational reasons. Existing prompt learning techniques replace hand-crafted text prompts with learned vectors that offer improvements on seen classes, but struggle to generalize to unseen classes. Our work addresses this challenge by proposing Federated Text-driven Prompt Generation (FedTPG), which learns a unified prompt generation network across multiple remote clients in a scalable manner. The prompt generation network is conditioned on task-related text input, thus is context-aware, making it suitable to generalize for both seen and unseen classes. Our comprehensive empirical evaluations on nine diverse image classification datasets show that our method is superior to existing federated prompt learning methods, that achieve overall better generalization on both seen and unseen classes and is also generalizable to unseen datasets.


title: Factorized Tensor Networks for Multi-Task and Multi-Domain Learning

abstract: Multi-task and multi-domain learning methods seek to learn multiple tasks/domains, jointly or one after another, using a single unified network. The key challenge and opportunity is to exploit shared information across tasks and domains to improve the efficiency of the unified network. The efficiency can be in terms of accuracy, storage cost, computation, or sample complexity. In this paper, we propose a factorized tensor network (FTN) that can achieve accuracy comparable to independent single-task/domain networks with a small number of additional parameters. FTN uses a frozen backbone network from a source model and incrementally adds task/domain-specific low-rank tensor factors to the shared frozen network. This approach can adapt to a large number of target domains and tasks without catastrophic forgetting. Furthermore, FTN requires a significantly smaller number of task-specific parameters compared to existing methods. We performed experiments on widely used multi-domain and multi-task datasets. We show the experiments on convolutional-based architecture with different backbones and on transformer-based architecture. We observed that FTN achieves similar accuracy as single-task/domain methods while using only a fraction of additional parameters per task.


title: On Time Domain Conformer Models for Monaural Speech Separation in Noisy Reverberant Acoustic Environments

abstract: Speech separation remains an important topic for multi-speaker technology researchers. Convolution augmented transformers (conformers) have performed well for many speech processing tasks but have been under-researched for speech separation. Most recent state-of-the-art (SOTA) separation models have been time-domain audio separation networks (TasNets). A number of successful models have made use of dual-path (DP) networks which sequentially process local and global information. Time domain conformers (TD-Conformers) are an analogue of the DP approach in that they also process local and global context sequentially but have a different time complexity function. It is shown that for realistic shorter signal lengths, conformers are more efficient when controlling for feature dimension. Subsampling layers are proposed to further improve computational efficiency. The best TD-Conformer achieves 14.6 dB and 21.2 dB SISDR improvement on the WHAMR and WSJ0-2Mix benchmarks, respectively.


title: Critical phenomena of RNA-like polymers -- a synopsis

abstract: This work examines field theories for RNA-like polymers with single strand and double strand polymers and a periodic base sequence. These field theories originate from lattice models, describe polymers in a good solvent, and in principle exactly describe the critical behavior. A central role is played by the conventional one-component branched polymer and the mapping of the corresponding field theory to the Lee-Yang field theory in two less dimensions. Critical phenomena in the context of polymers as well as the Lee-Yang model entail pecularities, which we derive in detail. A new result is that the critical point of RNA-like branched polymers (with periodic base sequence) looks like the critical point of the classical one-component branched polymer, but with one more critical exponent for the single strand polymer. A random base sequence generates additional relevant interactions, and invalidates the simple picture.


title: Classical Larmor formula through the Unruh effect for uniformly accelerated electrons

abstract: We investigate the connection between the classical Larmor formula and the quantum Unruh effect by computing the emitted power by a uniformly accelerated charged particle and its angular distribution in the coaccelerated frame. We consider a classical particle accelerated with nonzero charge only for a finite period and then take the infinite-time limit after removing the effects due to the initial charging and final discharging processes. We show that the result found for the interaction rates agrees with previous studies in which the period of acceleration with nonzero charge was taken to be infinite from the beginning. We also show that the power and angular distribution of emission, which is attributed either to the emission or absorption of a Rindler photon in the coaccelerated frame, is given by the Larmor formula, confirming that, at tree level, it is necessary to take into account the Unruh effect in order to reproduce the classical Larmor radiation formula in the coaccelerated frame.


title: Exact quench dynamics of the Floquet quantum East model at the deterministic point

abstract: We study the nonequilibrium dynamics of the Floquet quantum East model (a Trotterized version of the kinetically constrained quantum East spin chain) at its "deterministic point", where evolution is defined in terms of CNOT permutation gates. We solve exactly the thermalization dynamics for a broad class of initial product states by means of "space evolution". We prove: (i) the entanglement of a block of spins grows at most at one-half the maximal speed allowed by locality (i.e., half the speed of dual-unitary circuits); (ii) if the block of spins is initially prepared in a classical configuration, speed of entanglement is a quarter of the maximum; (iii) thermalization to the infinite temperature state is reached exactly in a time that scales with the size of the block.


title: Hadron-hadron potentials coupled to quark degrees of freedom for X(3872)

abstract: To study the internal structure of the exotic hadron $X(3872)$, considering the coupled-channel potential between quarks and hadrons is necessary because $X(3872)$ is regarded as a mixture state of $c\bar{c}$ and $D^0\bar{D}^{*0}$. In this work, we construct the hadron-hadron potentials coupled to the quark channel and study the properties of the $D^0\bar{D}^{*0}$ potentials for $X(3872)$. In particular, we compare various local approximations by focusing on the scattering phase shifts.


title: Statistical inference for radially-stable generalized Pareto distributions and return level-sets in geometric extremes

abstract: We use a functional analogue of the quantile function for probability measures admitting a continuous Lebesgue density on $\mathbb{R}^d$ to characterise the class of non-trivial limit distributions of radially recentered and rescaled multivariate exceedances. A new class of multivariate distributions is identified, termed radially-stable generalised Pareto distributions, and is shown to admit certain stability properties that permit extrapolation to extremal sets along any direction in cones such as $\mathbb{R}^d$ and $\mathbb{R}_+^d$. Leveraging the limit Poisson point process likelihood of the point process of radially renormalised exceedances, we develop parsimonious statistical models that exploit theoretical links between structural star-bodies and are amenable to Bayesian inference. Our framework sharpens statistical inference by suitably including additional information from the angular directions of the geometric exceedances and facilitates efficient computations in dimensions $d=2$ and $d=3$. Additionally, it naturally leads to the notion of return level-set, which is a canonical quantile set expressed in terms of its average recurrence interval, and a geometric analogue of the uni-dimensional return level. We illustrate our methods with a simulation study showing superior predictive performance of probabilities of rare events, and with two case studies, one associated with river flow extremes, and the other with oceanographic extremes.


title: Learning Layer-wise Equivariances Automatically using Gradients

abstract: Convolutions encode equivariance symmetries into neural networks leading to better generalisation performance. However, symmetries provide fixed hard constraints on the functions a network can represent, need to be specified in advance, and can not be adapted. Our goal is to allow flexible symmetry constraints that can automatically be learned from data using gradients. Learning symmetry and associated weight connectivity structures from scratch is difficult for two reasons. First, it requires efficient and flexible parameterisations of layer-wise equivariances. Secondly, symmetries act as constraints and are therefore not encouraged by training losses measuring data fit. To overcome these challenges, we improve parameterisations of soft equivariance and learn the amount of equivariance in layers by optimising the marginal likelihood, estimated using differentiable Laplace approximations. The objective balances data fit and model complexity enabling layer-wise symmetry discovery in deep networks. We demonstrate the ability to automatically learn layer-wise equivariances on image classification tasks, achieving equivalent or improved performance over baselines with hard-coded symmetry.


title: Design of perfectly conducting objects that are invisible to an incident plane wave

abstract: This work concerns the design of perfectly conducting objects that are invisible to an incident transverse magnetic plane wave. The object in question is a finite planar waveguide with a finite periodic array of barriers. By optimizing this array, the amplitude of the scattered field is reduced to less than $10^{-9}$ times the amplitude of the incident plane wave everywhere outside the waveguide. To accurately evaluate such minute amplitudes, we employ a recently developed boundary integral equation technique, adapted for objects whose boundaries have endpoints, corners, and branch points.


title: Derived deformation theory of crepant curves

abstract: This paper determines the full derived deformation theory of certain smooth rational curves C in Calabi-Yau 3-folds, by determining all higher A_\infty-products in its controlling DG-algebra. This geometric setup includes very general cases where C does not contract, cases where the curve neighbourhood is not rational, all known simple smooth 3-fold flops, and all known divisorial contractions to curves. As a corollary, it is shown that the noncommutative deformation theory of C can be described as a superpotential algebra derived from what we call free necklace polynomials, which are elements in the free algebra obtained via a closed formula from combinatorial gluing data. The description of these polynomials, together with the above results, establishes a suitably interpreted string theory prediction due to Ferrari, Aspinwall-Katz and Curto-Morrison. Perhaps most significantly, the main results give both the language and evidence to finally formulate new contractibility conjectures for rational curves in CY 3-folds, which lift Artin's celebrated results from surfaces.


title: Recovering 21cm Monopole Signals Without Smoothness

abstract: We expect the monopole signal at the lowest frequencies below $100\,$MHz to be composed of two components: the deep Rayleigh-Jeans tail of the cosmic microwave background and two distinct features: the dark ages trough at $\sim 17\,$MHz and the cosmic dawn trough at $\sim 75\,$Mhz. These are hidden under orders of magnitude brighter foregrounds whose emission is approximately a power-law with a spectral index $\approx -2.5$. It is usually assumed that monopole signals of interest are separable from foregrounds based on spectral smoothness. We argue that this is a difficult approach and likely impossible for the Dark Ages trough. Instead, we suggest that the fluctuations in the foreground emission around the sky should be used to build a model distribution of possible shapes of foregrounds, which can be used to constrain the presence of a monopole signal. We implement this idea using normalizing flows and show that this technique allows for efficient unsupervised detection of the amplitude, width, and center of the Dark Ages trough as well as the Rayleigh-Jeans tail of the cosmic microwave background for a sufficiently sensitive experiment. We show that achromatic and smooth response significantly helps with foreground separation. We discuss the limitations of the inherent assumptions in this method and the impact on the design of future low-frequency experiments.


title: Probabilistic and Maximum Entropy Modeling of Chemical Reaction Systems: Characteristics and Comparisons to Mass Action Kinetic Models

abstract: We demonstrate and characterize a first-principles approach to modeling the mass action dynamics of metabolism. Starting from a basic definition of entropy expressed as a multinomial probability density using Boltzmann probabilities with standard chemical potentials, we derive and compare the free energy dissipation and the entropy production rates. We express the relation between the entropy production and the chemical master equation for modeling metabolism, which unifies chemical kinetics and chemical thermodynamics. Subsequent implementation of an maximum free energy dissipation model for systems of coupled reactions is accomplished by using an approximation to the Marcelin equation for mass action kinetics that maximizes the entropy production. Because prediction uncertainty with respect to parameter variability is frequently a concern with mass action models utilizing rate constants, we compare and contrast the maximum entropy production model, which has its own set of rate parameters, to a population of standard mass action models in which the rate constants are randomly chosen. We show that a maximum entropy production model is characterized by a high probability of free energy dissipation rate, and likewise entropy production rate, relative to other models. We then characterize the variability of the maximum entropy production predictions with respect to uncertainties in parameters (standard free energies of formation) and with respect to ionic strengths typically found in a cell.


title: Predicting Player Engagement in Tom Clancy's The Division 2: A Multimodal Approach via Pixels and Gamepad Actions

abstract: This paper introduces a large scale multimodal corpus collected for the purpose of analysing and predicting player engagement in commercial-standard games. The corpus is solicited from 25 players of the action role-playing game Tom Clancy's The Division 2, who annotated their level of engagement using a time-continuous annotation tool. The cleaned and processed corpus presented in this paper consists of nearly 20 hours of annotated gameplay videos accompanied by logged gamepad actions. We report preliminary results on predicting long-term player engagement based on in-game footage and game controller actions using Convolutional Neural Network architectures. Results obtained suggest we can predict the player engagement with up to 72% accuracy on average (88% at best) when we fuse information from the game footage and the player's controller input. Our findings validate the hypothesis that long-term (i.e. 1 hour of play) engagement can be predicted efficiently solely from pixels and gamepad actions.


title: Factorization algebra

abstract: Factorization algebras are local-to-global objects living on manifolds, and they arise naturally in mathematics and physics. Their local structure encompasses examples like associative algebras and vertex algebras; in these examples, their global structure encompasses Hochschild homology and conformal blocks. In the setting of quantum field theory, factorization algebras articulate a minimal set of axioms satisfied by the observables of a theory, and they capture concepts like the operator product and correlation functions. In this survey article for the Encyclopedia of Mathematical Physics, 2nd Edition, we give the definitions and key examples, compare this approach with other approaches to mathematically formalizing field theory, describe key results, and explain how higher symmetries can be encoded in this framework.


title: Layout Sequence Prediction From Noisy Mobile Modality

abstract: Trajectory prediction plays a vital role in understanding pedestrian movement for applications such as autonomous driving and robotics. Current trajectory prediction models depend on long, complete, and accurately observed sequences from visual modalities. Nevertheless, real-world situations often involve obstructed cameras, missed objects, or objects out of sight due to environmental factors, leading to incomplete or noisy trajectories. To overcome these limitations, we propose LTrajDiff, a novel approach that treats objects obstructed or out of sight as equally important as those with fully visible trajectories. LTrajDiff utilizes sensor data from mobile phones to surmount out-of-sight constraints, albeit introducing new challenges such as modality fusion, noisy data, and the absence of spatial layout and object size information. We employ a denoising diffusion model to predict precise layout sequences from noisy mobile data using a coarse-to-fine diffusion strategy, incorporating the RMS, Siamese Masked Encoding Module, and MFM. Our model predicts layout sequences by implicitly inferring object size and projection status from a single reference timestamp or significantly obstructed sequences. Achieving SOTA results in randomly obstructed experiments and extremely short input experiments, our model illustrates the effectiveness of leveraging noisy mobile data. In summary, our approach offers a promising solution to the challenges faced by layout sequence and trajectory prediction models in real-world settings, paving the way for utilizing sensor data from mobile phones to accurately predict pedestrian bounding box trajectories. To the best of our knowledge, this is the first work that addresses severely obstructed and extremely short layout sequences by combining vision with noisy mobile modality, making it the pioneering work in the field of layout sequence trajectory prediction.


title: On the Correlation between Random Variables and their Principal Components

abstract: The article attempts to find an algebraic formula describing the correlation coefficients between random variables and the principal components representing them. As a result of the analysis, starting from selected statistics relating to individual random variables, the equivalents of these statistics relating to a set of random variables were presented in the language of linear algebra, using the concepts of vector and matrix. This made it possible, in subsequent steps, to derive the expected formula. The formula found is identical to the formula used in Factor Analysis to calculate factor loadings. The discussion showed that it is possible to apply this formula to optimize the number of principal components in Principal Component Analysis, as well as to optimize the number of factors in Factor Analysis.


title: NP-Hardness of Tensor Network Contraction Ordering

abstract: We study the optimal order (or sequence) of contracting a tensor network with a minimal computational cost. We conclude 2 different versions of this optimal sequence: that minimize the operation number (OMS) and that minimize the time complexity (CMS). Existing results only shows that OMS is NP-hard, but no conclusion on CMS problem. In this work, we firstly reduce CMS to CMS-0, which is a sub-problem of CMS with no free indices. Then we prove that CMS is easier than OMS, both in general and in tree cases. Last but not least, we prove that CMS is still NP-hard. Based on our results, we have built up relationships of hardness of different tensor network contraction problems.


title: Delay-Optimal Service Chain Forwarding and Offloading in Collaborative Edge Computing

abstract: Collaborative edge computing (CEC) is an emerging paradigm for heterogeneous devices to collaborate on edge computation jobs. For congestible links and computing units, delay-optimal forwarding and offloading for service chain tasks (e.g., DNN with vertical split) in CEC remains an open problem. In this paper, we formulate the service chain forwarding and offloading in CEC with arbitrary topology and heterogeneous transmission/computation capability, and aim to minimize the network aggregated cost. We consider congestion-aware nonlinear cost functions that cover various performance metrics and constraints, such as average queueing delay with limited processor capacity. We solve the non-convex optimization problem globally by analyzing the KKT condition and proposing a sufficiency optimality condition. We propose a polynomial-time distributed algorithm that converges to the global optimum. The algorithm adapts to changes in input rates and network topology, and can be implemented as an online algorithm. Numerical evaluation shows that our method significantly outperforms baselines in multiple network instances, especially in congested scenarios.


title: Quantum advantage of time-reversed ancilla-based metrology of absorption parameters

abstract: Quantum estimation of parameters defining open-system dynamics may be enhanced by using ancillas that are entangled with the probe but are not submitted to the dynamics. Here we consider the important problem of estimation of transmission of light by a sample, with losses due to absorption and scattering. We show, through the determination of the quantum Fisher information, that the ancilla strategy leads to the best possible precision in single-mode estimation, the one obtained for a Fock state input, through joint photon-counting of probe and ancilla, which are modes of a bimodal squeezed state produced by an optical parametric amplifier. This proposal overcomes the challenge of producing and detecting high photon-number Fock states, and it is quite robust against additional noise: we show that it is immune to phase noise and the precision does not change if the incoming state gets disentangled. Furthermore, the quantum gain is still present under moderate photon losses of the input beams. We also discuss an alternative to joint photon counting, which is readily implementable with present technology, and approaches the quantum Fisher information result for weak absorption, even with moderate photons losses of the input beams before the sample is probed: a time-reversal procedure, placing the sample between two optical parametric amplifiers, with the second undoing the squeezing produced by the first one. The precision of estimation of the loss parameter is obtained from the average outgoing total photon number and its variance. In both procedures, the state of the probe and the detection procedure are independent of the value of the parameter.


title: HydraViT: Adaptive Multi-Branch Transformer for Multi-Label Disease Classification from Chest X-ray Images

abstract: Chest X-ray is an essential diagnostic tool in the identification of chest diseases given its high sensitivity to pathological abnormalities in the lungs. However, image-driven diagnosis is still challenging due to heterogeneity in size and location of pathology, as well as visual similarities and co-occurrence of separate pathology. Since disease-related regions often occupy a relatively small portion of diagnostic images, classification models based on traditional convolutional neural networks (CNNs) are adversely affected given their locality bias. While CNNs were previously augmented with attention maps or spatial masks to guide focus on potentially critical regions, learning localization guidance under heterogeneity in the spatial distribution of pathology is challenging. To improve multi-label classification performance, here we propose a novel method, HydraViT, that synergistically combines a transformer backbone with a multi-branch output module with learned weighting. The transformer backbone enhances sensitivity to long-range context in X-ray images, while using the self-attention mechanism to adaptively focus on task-critical regions. The multi-branch output module dedicates an independent branch to each disease label to attain robust learning across separate disease classes, along with an aggregated branch across labels to maintain sensitivity to co-occurrence relationships among pathology. Experiments demonstrate that, on average, HydraViT outperforms competing attention-guided methods by 1.2%, region-guided methods by 1.4%, and semantic-guided methods by 1.0% in multi-label classification performance.


title: Ions-induced Epitaxial Growth of Perovskite Nanocomposites for Highly Efficient Light-Emitting Diodes with EQE Exceeding 30%

abstract: Metal halide perovskites, a class of cost-effective semiconductor materials, are of great interest for modern and upcoming display technologies that prioritize the light-emitting diodes (LEDs) with high efficiency and excellent color purity. The prevailing approach to achieving efficient luminescence from pervoskites is enhancing exciton binding effect and confining carriers by reducing their dimensionality or grain size. However, splitting pervoskite lattice into smaller ones generates abundant boundaries in solid films and results in more surface trap states, needing exact passivation to suppress trap-assisted nonradiative losses. Here, an ions-induced heteroepitaxial growth method is employed to assembe perovskite lattices with different structures into large-sized grains to produce lattice-anchored nanocomposites for efficient LEDs with high color purity. This approach enables the nanocomposite thin films, composed of three-dimensional (3D) CsPbBr3 and its variant of zero-dimensional (0D) Cs4PbBr6, to feature significant low trap-assisted nonradiative recombination, enhanced light out-coupling with a corrugated surface, and well-balanced charge carrier transport. Based on the resultant 3D/0D perovskite nanocomposites, we demonstrate the perovskite LEDs achieving an remarkable external quantum efficiency of 31.0% at the emission peak of 521 nm with a narrow full width at half-maximum of only 18 nm. This research introduces a novel approach to the development of well-assembled nanocomposites for perovskite LEDs, demonstrating high efficiency comparable to that of state-of-the-art organic LEDs.


title: Revisit the intrinsic features of flip-flopping flow behind side-by-side circular cylinders

abstract: As one of the most intriguing wake patterns of two side-by-side circular cylinders at an intermediate gap spacing, the flip-flopping (FF) flow has attracted great attention of fundamental research interest. This FF flow is featured by the intermittently and randomly switching gap flow with correspondingly changing forces of the two cylinders. In this paper, we first present a partition map of the wake patterns behind two side-by-side circular cylinders and briefly introduce intrinsic features of each flow pattern. We focus on the FF flow aiming to explain: (i) the origin of the FF flow between laminar and turbulent regimes, (ii) their connections in different flow regimes, and (iii) mechanisms of the significantly varying flip-over time scale of the FF flows. In the laminar regime, we further divide the FF flow into the sub-classed I (FF1) and II (FF2), based on their different origins from the in-phase and anti-phase synchronized vortex shedding instabilities, respectively. By exploring the vortex interactions, we show that the FF flow in the turbulent regime has the same origin and similar vortex dynamics as the FF2 wake in the laminar regime, despite some minor disparities. Thus, a connection is established between the FF2 pattern in the laminar flow and the FF pattern in the turbulent flow. For the FF flow in the laminar regime (Re < 150-200), the mildly decreasing switching time, is several vortex shedding periods. However, for the FF flow in the weak turbulence regime (150-200 < Re < 1000-1700), the switching time scale increases significantly with Re owing to the increased vortex formation length. The FF in the strong turbulence regime (Re > 1000-1700) has a switching time scale of several orders of magnitude longer than the vortex shedding period, where the switching scale decreases gradually with Re due to the stronger Kelvin-Helmholtz vortices.


title: Working towards a gauge-invariant description of the Higgs model: from local composite operators to spectral density functions

abstract: We analyze different BRST invariant solutions for the introduction of a mass term in Yang-Mills (YM) theories. First, we analyze the non-local composite gauge-invariant field $A^h_{\mu}(x)$, which can be localized by the Stueckelberg-like field $\xi^a(x)$. This enables us to introduce a mass term in the $SU(N)$ YM model, a feature that has been indicated at a non-perturbative level by both analytical and numerical studies. We also consider the unitary Abelian Higgs model and investigate its spectral functions at one-loop order. This analysis allows to disentangle what is physical and what is not at the level of the elementary particle propagators, in conjunction with the Nielsen identities. We highlight the role of the tadpole graphs and the gauge choices to get sensible results. We also introduce an Abelian Curci-Ferrari action coupled to a scalar field to model a massive photon which, like the non-Abelian Curci-Ferarri model, is left invariant by a modified non-nilpotent BRST symmetry. Finally, the spectral properties of a set of local gauge-invariant composite operators are investigated in the $U(1)$ and $SU(2)$ Higgs model quantized in the 't Hooft $R_{\xi}$ gauge. These operators enable us to give a gauge-invariant description of the spectrum of the theory, thereby surpassing certain incommodities when using the standard elementary fields. The corresponding two-point correlation functions are evaluated at one-loop order and their spectral functions are obtained explicitly. It is shown that the spectral functions of the elementary fields suffer from a strong unphysical dependence from the gauge parameter $\xi$, and can even exhibit positivity violating behaviour. In contrast, the BRST invariant local operators exhibit a well defined positive spectral density.


title: Reinforcement Learning in the Era of LLMs: What is Essential? What is needed? An RL Perspective on RLHF, Prompting, and Beyond

abstract: Recent advancements in Large Language Models (LLMs) have garnered wide attention and led to successful products such as ChatGPT and GPT-4. Their proficiency in adhering to instructions and delivering harmless, helpful, and honest (3H) responses can largely be attributed to the technique of Reinforcement Learning from Human Feedback (RLHF). In this paper, we aim to link the research in conventional RL to RL techniques used in LLM research. Demystify this technique by discussing why, when, and how RL excels. Furthermore, we explore potential future avenues that could either benefit from or contribute to RLHF research. Highlighted Takeaways: 1. RLHF is Online Inverse RL with Offline Demonstration Data. 2. RLHF $>$ SFT because Imitation Learning (and Inverse RL) $>$ Behavior Cloning (BC) by alleviating the problem of compounding error. 3. The RM step in RLHF generates a proxy of the expensive human feedback, such an insight can be generalized to other LLM tasks such as prompting evaluation and optimization where feedback is also expensive. 4. The policy learning in RLHF is more challenging than conventional problems studied in IRL due to their high action dimensionality and feedback sparsity. 5. The main superiority of PPO over off-policy value-based methods is its stability gained from (almost) on-policy data and conservative policy updates.


title: Understanding Transfer Learning and Gradient-Based Meta-Learning Techniques

abstract: Deep neural networks can yield good performance on various tasks but often require large amounts of data to train them. Meta-learning received considerable attention as one approach to improve the generalization of these networks from a limited amount of data. Whilst meta-learning techniques have been observed to be successful at this in various scenarios, recent results suggest that when evaluated on tasks from a different data distribution than the one used for training, a baseline that simply finetunes a pre-trained network may be more effective than more complicated meta-learning techniques such as MAML, which is one of the most popular meta-learning techniques. This is surprising as the learning behaviour of MAML mimics that of finetuning: both rely on re-using learned features. We investigate the observed performance differences between finetuning, MAML, and another meta-learning technique called Reptile, and show that MAML and Reptile specialize for fast adaptation in low-data regimes of similar data distribution as the one used for training. Our findings show that both the output layer and the noisy training conditions induced by data scarcity play important roles in facilitating this specialization for MAML. Lastly, we show that the pre-trained features as obtained by the finetuning baseline are more diverse and discriminative than those learned by MAML and Reptile. Due to this lack of diversity and distribution specialization, MAML and Reptile may fail to generalize to out-of-distribution tasks whereas finetuning can fall back on the diversity of the learned features.


title: RevelsMD: Reduced Variance Estimators of the Local Structure in Molecular Dynamics

abstract: RevelsMD is a new open source Python library, which uses reduced variance force sampling based estimators to calculate 3D particle densities and radial distribution functions from molecular dynamics simulations. This short note describes the scientific background of the code, its utility and how it fits within the current zeitgeist in computational chemistry and materials science.


title: Latent Diffusion Model for DNA Sequence Generation

abstract: The harnessing of machine learning, especially deep generative models, has opened up promising avenues in the field of synthetic DNA sequence generation. Whilst Generative Adversarial Networks (GANs) have gained traction for this application, they often face issues such as limited sample diversity and mode collapse. On the other hand, Diffusion Models are a promising new class of generative models that are not burdened with these problems, enabling them to reach the state-of-the-art in domains such as image generation. In light of this, we propose a novel latent diffusion model, DiscDiff, tailored for discrete DNA sequence generation. By simply embedding discrete DNA sequences into a continuous latent space using an autoencoder, we are able to leverage the powerful generative abilities of continuous diffusion models for the generation of discrete data. Additionally, we introduce Fr\'echet Reconstruction Distance (FReD) as a new metric to measure the sample quality of DNA sequence generations. Our DiscDiff model demonstrates an ability to generate synthetic DNA sequences that align closely with real DNA in terms of Motif Distribution, Latent Embedding Distribution (FReD), and Chromatin Profiles. Additionally, we contribute a comprehensive cross-species dataset of 150K unique promoter-gene sequences from 15 species, enriching resources for future generative modelling in genomics. We will make our code public upon publication.


title: Differential Sensitivity in Discontinuous Models

abstract: Differential sensitivity measures provide valuable tools for interpreting complex computational models used in applications ranging from simulation to algorithmic prediction. Taking the derivative of the model output in direction of a model parameter can reveal input-output relations and the relative importance of model parameters and input variables. Nonetheless, it is unclear how such derivatives should be taken when the model function has discontinuities and/or input variables are discrete. We present a general framework for addressing such problems, considering derivatives of quantile-based output risk measures, with respect to distortions to random input variables (risk factors), which impact the model output through step-functions. We prove that, subject to weak technical conditions, the derivatives are well-defined and derive the corresponding formulas. We apply our results to the sensitivity analysis of compound risk models and to a numerical study of reinsurance credit risk in a multi-line insurance portfolio.


title: Some algebraic invariants of the edge ideals of some $q$-fold bristled graphs

abstract: In this paper, we compute the exact values of regularity of the quotient rings of the edge ideals associated to multi triangular snake and multi triangular ouroboros snake graphs. Also we compute the exact values of depth, Stanley depth, regularity and projective dimension of the quotient rings of the edge ideals associated to $q$-fold bristled graphs of multi triangular snake and multi triangular ouroboros snake graphs.


title: Multi-Robot Task Assignment and Path Finding for Time-Sensitive Missions with Online Task Generation

abstract: Executing time-sensitive multi-robot missions involves two distinct problems: Multi-Robot Task Assignment (MRTA) and Multi-Agent Path Finding (MAPF). Computing safe paths that complete every task and minimize the time to mission completion, or makespan, is a significant computational challenge even for small teams. In many missions, tasks can be generated during execution which is typically handled by either recomputing task assignments and paths from scratch, or by modifying existing plans using approximate approaches. While performing task reassignment and path finding from scratch produces theoretically optimal results, the computational load makes it too expensive for online implementation. In this work, we present Time-Sensitive Online Task Assignment and Navigation (TSOTAN), a framework which can quickly incorporate online generated tasks while guaranteeing bounded suboptimal task assignment makespans. It does this by assessing the quality of partial task reassignments and only performing a complete reoptimization when the makespan exceeds a user specified suboptimality bound. Through experiments in 2D environments we demonstrate TSOTAN's ability to produce quality solutions with computation times suitable for online implementation.


title: Field-controlled dynamics of skyrmions and monopoles

abstract: Magnetic monopoles, despite their ongoing experimental search as elementary particles, have inspired the discovery of analogous excitations in condensed matter systems. In chiral condensed matter systems, emergent monopoles are responsible for the onset of transitions between topologically distinct states and phases, like in the case of transitions from helical and conical phase to A-phase comprising periodic arrays of skyrmions. By combining numerical modeling and optical characterizations, we describe how different geometrical configurations of skyrmions terminating at monopoles can be realized in liquid crystals and liquid crystal ferromagnets. We demonstrate how such complex structures can be effectively manipulated by external magnetic and electric fields. Furthermore, we discuss how our findings may hint at similar dynamics in other physical systems, and their potential applications.


title: CoQuest: Exploring Research Question Co-Creation with an LLM-based Agent

abstract: Developing novel research questions (RQs) often requires extensive literature reviews, especially in interdisciplinary fields. To support RQ development through human-AI co-creation, we leveraged Large Language Models (LLMs) to build an LLM-based agent system named CoQuest. We conducted an experiment with 20 HCI researchers to examine the impact of two interaction designs: breadth-first and depth-first RQ generation. The findings revealed that participants perceived the breadth-first approach as more creative and trustworthy upon task completion. Conversely, during the task, participants considered the depth-first generated RQs as more creative. Additionally, we discovered that AI processing delays allowed users to reflect on multiple RQs simultaneously, leading to a higher quantity of generated RQs and an enhanced sense of control. Our work makes both theoretical and practical contributions by proposing and evaluating a mental model for human-AI co-creation of RQs. We also address potential ethical issues, such as biases and over-reliance on AI, advocating for using the system to improve human research creativity rather than automating scientific inquiry.


title: The Evaporating Massive Embedded Stellar Cluster IRS 13 Close to Sgr A*. I. Detection of a rich population of dusty objects in the IRS 13 cluster

abstract: A detailed analysis of the Nuclear Stellar Cluster (NSC) concedes not only the existence of the Scluster with its fast-moving stars and the supermassive black hole (SMBH) Sgr A*. It also reveals an embedded region of gas and dust with an exceptionally high stellar density called IRS 13. The IRS 13 cluster can be divided into the northern and the eastern counterparts, called IRS 13N and IRS 13E, respectively. This work will focus on both regions and study their most prominent members using rich infrared and radio/submm data baselines. Applying a multiwavelength analysis enables us to determine a comprehensive photometric footprint of the investigated cluster sample. Using the raytracing-based radiative transfer model HYPERION, the spectral energy distribution of the IRS 13 members suggests a stellar nature of the dusty sources. These putative Young Stellar Objects (YSOs) have a comparable spectroscopic identification to the D and G sources in or near the S cluster. Furthermore, we report the existence of a population of dusty sources in IRS 13 that can be mostly identified in the H-, K-, and Lband. Together with the objects reported in literature, we propose that this population is the outcome of a recent star formation process. Furthermore, we report that these presumably young objects are arranged in a disk structure. Although it cannot be excluded that the intrinsic arrangement of IRS 13 does show a disk structure, we find indications that the investigated cluster sample might be related to the counterclockwise disk.


title: Manifold-augmented Eikonal Equations: Geodesic Distances and Flows on Differentiable Manifolds

abstract: Manifolds discovered by machine learning models provide a compact representation of the underlying data. Geodesics on these manifolds define locally length-minimising curves and provide a notion of distance, which are key for reduced-order modelling, statistical inference, and interpolation. In this work, we propose a model-based parameterisation for distance fields and geodesic flows on manifolds, exploiting solutions of a manifold-augmented Eikonal equation. We demonstrate how the geometry of the manifold impacts the distance field, and exploit the geodesic flow to obtain globally length-minimising curves directly. This work opens opportunities for statistics and reduced-order modelling on differentiable manifolds.


title: Assessing Dengue Risk Globally Using Non-Markovian Models

abstract: Dengue is a vector-borne disease transmitted by Aedes mosquitoes. The worldwide spread of these mosquitoes and the increasing disease burden have emphasized the need for a spatio-temporal risk map capable of assessing dengue outbreak conditions and quantifying the outbreak risk. Given that the life cycle of Aedes mosquitoes is strongly influenced by habitat temperature, numerous studies have utilized temperature-dependent development rates of these mosquitoes to construct virus transmission and outbreak risk models. In this study, we advance existing research by developing a mechanistic model for the mosquito life cycle that accurately accounts for the non-Markovian nature of the process. By fitting the model to data on human dengue cases, we estimate several model parameters, allowing the development of a global spatiotemporal dengue risk map. This risk model employs temperature and precipitation data to assess the environmental suitability for dengue outbreaks in a given area. Furthermore, we demonstrate how to reduce the model to the corresponding differential equations, enabling us to utilize existing methods for analyzing the system and fitting the model to observations. This approach can be further applied to similar non-Markovian processes that are currently described with less accurate Markovian models.


title: Provably Accelerating Ill-Conditioned Low-rank Estimation via Scaled Gradient Descent, Even with Overparameterization

abstract: Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor factorization, one of the most popular approaches is to employ simple iterative algorithms such as gradient descent (GD) to recover the low-rank factors directly, which allow for small memory and computation footprints. However, the convergence rate of GD depends linearly, and sometimes even quadratically, on the condition number of the low-rank object, and therefore, GD slows down painstakingly when the problem is ill-conditioned. This chapter introduces a new algorithmic approach, dubbed scaled gradient descent (ScaledGD), that provably converges linearly at a constant rate independent of the condition number of the low-rank object, while maintaining the low per-iteration cost of gradient descent for a variety of tasks including sensing, robust principal component analysis and completion. In addition, ScaledGD continues to admit fast global convergence to the minimax-optimal solution, again almost independent of the condition number, from a small random initialization when the rank is over-specified in the presence of Gaussian noise. In total, ScaledGD highlights the power of appropriate preconditioning in accelerating nonconvex statistical estimation, where the iteration-varying preconditioners promote desirable invariance properties of the trajectory with respect to the symmetry in low-rank factorization without hurting generalization.


title: Entropy Based Multi-robot Active SLAM

abstract: In this article, we present an efficient multi-robot active SLAM framework that involves a frontier-sharing method for maximum exploration of an unknown environment. It encourages the robots to spread into the environment while weighting the goal frontiers with the pose graph SLAM uncertainly and path entropy. Our approach works on a limited number of frontier points and weights the goal frontiers with a utility function that encapsulates both the SLAM and map uncertainties, thus providing an efficient and not computationally expensive solution. Our approach has been tested on publicly available simulation environments and on real robots. An accumulative 31% more coverage than similar state-of-the-art approaches has been obtained, proving the capability of our approach for efficient environment exploration.