title: Asteroids were born bigger: An implication of surface mass ablation during gas-assisted implantation into the asteroid belt

abstract: The origins of carbonaceous asteroids in the asteroid belt is not fully understood. The leading hypothesis is that they were not born at their current location but instead implanted into the asteroid belt early in the Solar System history. We investigate how the migration and growth of Jupiter and Saturn in their natal disk impact nearby planetesimals and subsequent planetesimal implantation into the asteroid belt. We account for the effects of surface ablation of planetesimals caused by thermal and frictional heating between the gas-disk medium and planetesimal surface, when planetesimals travel through the gas disk. We have performed simulations considering planetesimals of different compositions as water-ice rich planetesimals, water-ice poor planetesimals, organic-rich planetesimals, and fayalite-rich planetesimals. Our findings indicate that, regardless of the migration history of the giant planets, water-ice rich, organic-rich, and fayalite-rich planetesimals implanted into the asteroid belt generally experience surface ablation during implantation in the asteroid belt, shrinking in size. Planetesimals with enstatite-like compositions were inconsequential to surface ablation, preserving their original sizes. By assuming an initial planetesimal size-frequency distribution, our results show that -- under the effects of surface ablation -- the planetesimal population implanted into the asteroid belt shows a SFD slope slightly steeper than that of the initial one. This holds true for all migration histories of the giant planets considered in this work, but for the Grand-Tack model where the SFD slope remains broadly unchanged. Altogether, our results suggest that the largest C-type asteroids in the asteroid belt may have been born bigger. High-degree surface ablation during implantation into the asteroid belt may have even exposed the cores of early differentiated C-type planetesimals.


title: MPC-Inspired Reinforcement Learning for Verifiable Model-Free Control

abstract: In this paper, we introduce a new class of parameterized controllers, drawing inspiration from Model Predictive Control (MPC). The controller resembles a Quadratic Programming (QP) solver of a linear MPC problem, with the parameters of the controller being trained via Deep Reinforcement Learning (DRL) rather than derived from system models. This approach addresses the limitations of common controllers with Multi-Layer Perceptron (MLP) or other general neural network architecture used in DRL, in terms of verifiability and performance guarantees, and the learned controllers possess verifiable properties like persistent feasibility and asymptotic stability akin to MPC. On the other hand, numerical examples illustrate that the proposed controller empirically matches MPC and MLP controllers in terms of control performance and has superior robustness against modeling uncertainty and noises. Furthermore, the proposed controller is significantly more computationally efficient compared to MPC and requires fewer parameters to learn than MLP controllers. Real-world experiments on vehicle drift maneuvering task demonstrate the potential of these controllers for robotics and other demanding control tasks.


title: A Data-Driven Framework for Improving Public EV Charging Infrastructure: Modeling and Forecasting

abstract: This work presents an investigation and assessment framework, which, supported by realistic data, aims at provisioning operators with in-depth insights into the consumer-perceived Quality-of-Experience (QoE) at public Electric Vehicle (EV) charging infrastructures. Motivated by the unprecedented EV market growth, it is suspected that the existing charging infrastructure will soon be no longer capable of sustaining the rapidly growing charging demands; let alone that the currently adopted ad hoc infrastructure expansion strategies seem to be far from contributing any quality service sustainability solutions that tangibly reduce (ultimately mitigate) the severity of this problem. Without suitable QoE metrics, operators, today, face remarkable difficulty in assessing the performance of EV Charging Stations (EVCSs) in this regard. This paper aims at filling this gap through the formulation of novel and original critical QoE performance metrics that provide operators with visibility into the per-EVCS operational dynamics and allow for the optimization of these stations' respective utilization. Such metrics shall then be used as inputs to a Machine Learning model finely tailored and trained using recent real-world data sets for the purpose of forecasting future long-term EVCS loads. This will, in turn, allow for making informed optimal EV charging infrastructure expansions that will be capable of reliably coping with the rising EV charging demands and maintaining acceptable QoE levels. The model's accuracy has been tested and extensive simulations are conducted to evaluate the achieved performance in terms of the above listed metrics and show the suitability of the recommended infrastructure expansions.


title: ProsDectNet: Bridging the Gap in Prostate Cancer Detection via Transrectal B-mode Ultrasound Imaging

abstract: Interpreting traditional B-mode ultrasound images can be challenging due to image artifacts (e.g., shadowing, speckle), leading to low sensitivity and limited diagnostic accuracy. While Magnetic Resonance Imaging (MRI) has been proposed as a solution, it is expensive and not widely available. Furthermore, most biopsies are guided by Transrectal Ultrasound (TRUS) alone and can miss up to 52% cancers, highlighting the need for improved targeting. To address this issue, we propose ProsDectNet, a multi-task deep learning approach that localizes prostate cancer on B-mode ultrasound. Our model is pre-trained using radiologist-labeled data and fine-tuned using biopsy-confirmed labels. ProsDectNet includes a lesion detection and patch classification head, with uncertainty minimization using entropy to improve model performance and reduce false positive predictions. We trained and validated ProsDectNet using a cohort of 289 patients who underwent MRI-TRUS fusion targeted biopsy. We then tested our approach on a group of 41 patients and found that ProsDectNet outperformed the average expert clinician in detecting prostate cancer on B-mode ultrasound images, achieving a patient-level ROC-AUC of 82%, a sensitivity of 74%, and a specificity of 67%. Our results demonstrate that ProsDectNet has the potential to be used as a computer-aided diagnosis system to improve targeted biopsy and treatment planning.


title: Optical probing of phononic properties of a tin-vacancy color center in diamond

abstract: The coherence characteristics of a tin-vacancy color center in diamond are investigated through optical means including coherent population trapping between the ground state orbital levels and linewidth broadening effects. Due to the large spin-orbit splitting of the orbital ground states, thermalization between the ground states occurs at rates that are impractical to measure directly. Here, spectral information is transformed into its conjugate variable time, providing picosecond resolution and revealing an orbital depolarization timescale of ${\sim30{\rm~ps}}$. Consequences of the investigated dynamics are then used to estimate spin dephasing times limited by thermal effects.


title: Beyond-mean-field effects in mixtures: few-body and many-body aspects

abstract: The discovery of ultracold dilute liquids has significantly elevated our interest in various phenomena which go under the name of beyond-mean-field (BMF) physics. In these lecture notes we give an elementary introduction to the quantum stabilization and liquefaction of a collapsing weakly interacting Bose-Bose mixture. A detailed derivation of the leading BMF correction, also known as the Lee-Huang-Yang (LHY) term, in this system is presented in a manner suitable for further generalizations and extensions. Although the LHY term is a nonanalytic function of the density $n$, under certain conditions the leading BMF correction becomes analytic and can be expanded in integer powers of $n$, effectively introducing three-body and higher-order interactions. We discuss why and how well the Bogoliubov approach can predict these few-body observables.


title: Artificial Neural Nets and the Representation of Human Concepts

abstract: What do artificial neural networks (ANNs) learn? The machine learning (ML) community shares the narrative that ANNs must develop abstract human concepts to perform complex tasks. Some go even further and believe that these concepts are stored in individual units of the network. Based on current research, I systematically investigate the assumptions underlying this narrative. I conclude that ANNs are indeed capable of performing complex prediction tasks, and that they may learn human and non-human concepts to do so. However, evidence indicates that ANNs do not represent these concepts in individual units.


title: Minimizing Robot Digging Times to Retrieve Bins in Robotic-Based Compact Storage and Retrieval Systems

abstract: Robotic-based compact storage and retrieval systems provide high-density storage in distribution center and warehouse applications. In the system, items are stored in bins, and the bins are organized inside a three-dimensional grid. Robots move on top of the grid to retrieve and deliver bins. To retrieve a bin, a robot removes all bins above one by one with its gripper, called bin digging. The closer the target bin is to the top of the grid, the less digging is required to retrieve the bin. In this paper, we propose a policy to optimally arrange the bins in the grid while processing bin requests so that the most frequently accessed bins remain near the top of the grid. This improves the performance of the system and makes it responsive to changes in bin demand. Our solution approach identifies the optimal bin arrangement in the storage facility, initiates a transition to this optimal set-up, and subsequently ensures the ongoing maintenance of this arrangement for optimal performance. We perform extensive simulations on a custom-built discrete event model of the system. Our simulation results show that under the proposed policy more than half of the bins requested are located on top of the grid, reducing bin digging compared to existing policies. Compared to existing approaches, the proposed policy reduces the retrieval time of the requested bins by over 30% and the number of bin requests that exceed certain time thresholds by nearly 50%.


title: Influence of initial conditions on data-driven model identification and information entropy for ideal mhd problems

abstract: Data-driven methods of model identification are able to discern governing dynamics of a system from data. Such methods are well suited to help us learn about systems with unpredictable evolution or systems with ambiguous governing dynamics given our current understanding. Many plasma problems of interest fall into these categories as there are a wide range of models that exist, however each model is only useful in a certain regime and often limited by computational complexity. To ensure data-driven methods align with theory, they must be consistent and predictable when acting on data whose governing dynamics are known. Weak Sparse Identification of Nonlinear Dynamics (WSINDy) is a recently developed data-driven method that has shown promise in learning governing dynamics from data with high noise levels [1]. This work examines how WSINDy acts on ideal MHD test problems as the initial conditions are varied and specifies limiting requirements for successful equation identification. It is hard to recover the governing dynamics from data that emphasize a single dominant behavior. In these low information cases, Shannon information entropy is able to pick up on the redundancies in the data that affect recoverability.

categories: physics.data-an physics.comp-ph physics.flu-dyn physics.plasm-ph


title: Transition Path Sampling with Boltzmann Generator-based MCMC Moves

abstract: Sampling all possible transition paths between two 3D states of a molecular system has various applications ranging from catalyst design to drug discovery. Current approaches to sample transition paths use Markov chain Monte Carlo and rely on time-intensive molecular dynamics simulations to find new paths. Our approach operates in the latent space of a normalizing flow that maps from the molecule's Boltzmann distribution to a Gaussian, where we propose new paths without requiring molecular simulations. Using alanine dipeptide, we explore Metropolis-Hastings acceptance criteria in the latent space for exact sampling and investigate different latent proposal mechanisms.


title: Three-dimensional imaging of single atoms in an optical lattice via helical point-spread-function engineering

abstract: We demonstrate a method for determining the three-dimensional location of single atoms in a quantum gas microscopy system using a phase-only spatial light modulator to modify the point-spread function of the high-resolution imaging system. Here, the typical diffracted spot generated by a single atom as a point source is modified to a double spot that rotates as a function of the atom's distance from the focal plane of the imaging system. We present and numerically validate a simple model linking the rotation angle of the point-spread function with the distance to the focal plane. We show that, when aberrations in the system are carefully calibrated and compensated for, this method can be used to determine an atom's position to within a single lattice site in a single experimental image, extending quantum simulation with microscopy systems further into the regime of three dimensions.


title: Occasionally Misspecified

abstract: When fitting a particular Economic model on a sample of data, the model may turn out to be heavily misspecified for some observations. This can happen because of unmodelled idiosyncratic events, such as an abrupt but short-lived change in policy. These outliers can significantly alter estimates and inferences. A robust estimation is desirable to limit their influence. For skewed data, this induces another bias which can also invalidate the estimation and inferences. This paper proposes a robust GMM estimator with a simple bias correction that does not degrade robustness significantly. The paper provides finite-sample robustness bounds, and asymptotic uniform equivalence with an oracle that discards all outliers. Consistency and asymptotic normality ensue from that result. An application to the "Price-Puzzle," which finds inflation increases when monetary policy tightens, illustrates the concerns and the method. The proposed estimator finds the intuitive result: tighter monetary policy leads to a decline in inflation.


title: Active Learning approach to simulations of Strongly Correlated Matter with the Ghost Gutzwiller Approximation

abstract: Quantum embedding (QE) methods such as the Ghost Gutzwiller Approximation (gGA) offer a powerful approach to simulating strongly-correlated systems, but come with the computational bottleneck of computing the ground state of an auxiliary embedding Hamiltonian (EH) iteratively. In this work, we introduce an active learning (AL) framework integrated within the gGA to address this challenge. The methodology is applied to the single-band Hubbard model and results in a significant reduction in the number of instances where the EH must be solved. Through a principal component analysis (PCA), we find that the EH parameters form a low-dimensional structure that is largely independent of the geometric specifics of the systems, especially in the strongly-correlated regime. Our AL strategy enables us to discover this low-dimensionality structure on the fly, while leveraging it for reducing the computational cost of gGA, laying the groundwork for more efficient simulations of complex strongly-correlated materials.


title: Quantum Algorithms for Simulating Nuclear Effective Field Theories

abstract: Quantum computers offer the potential to simulate nuclear processes that are classically intractable. With the goal of understanding the necessary quantum resources, we employ state-of-the-art Hamiltonian-simulation methods, and conduct a thorough algorithmic analysis, to estimate the qubit and gate costs to simulate low-energy effective field theories (EFTs) of nuclear physics. In particular, within the framework of nuclear lattice EFT, we obtain simulation costs for the leading-order pionless and pionful EFTs. We consider both static pions represented by a one-pion-exchange potential between the nucleons, and dynamical pions represented by relativistic bosonic fields coupled to non-relativistic nucleons. We examine the resource costs for the tasks of time evolution and energy estimation for physically relevant scales. We account for model errors associated with truncating either long-range interactions in the one-pion-exchange EFT or the pionic Hilbert space in the dynamical-pion EFT, and for algorithmic errors associated with product-formula approximations and quantum phase estimation. Our results show that the pionless EFT is the least costly to simulate and the dynamical-pion theory is the costliest. We demonstrate how symmetries of the low-energy nuclear Hamiltonians can be utilized to obtain tighter error bounds on the simulation algorithm. By retaining the locality of nucleonic interactions when mapped to qubits, we achieve reduced circuit depth and substantial parallelization. We further develop new methods to bound the algorithmic error for classes of fermionic Hamiltonians that preserve the number of fermions, and demonstrate that reasonably tight Trotter error bounds can be achieved by explicitly computing nested commutators of Hamiltonian terms. This work highlights the importance of combining physics insights and algorithmic advancement in reducing quantum-simulation costs.


title: Spline-Based Multi-State Models for Analyzing Disease Progression

abstract: Motivated by disease progression-related studies, we propose an estimation method for fitting general non-homogeneous multi-state Markov models. The proposal can handle many types of multi-state processes, with several states and various combinations of observation schemes (e.g., intermittent, exactly observed, censored), and allows for the transition intensities to be flexibly modelled through additive (spline-based) predictors. The algorithm is based on a computationally efficient and stable penalized maximum likelihood estimation approach which exploits the information provided by the analytical Hessian matrix of the model log-likelihood. The proposed modeling framework is employed in case studies that aim at modeling the onset of cardiac allograft vasculopathy, and cognitive decline due to aging, where novel patterns are uncovered. To support applicability and reproducibility, all developed tools are implemented in the R package flexmsm.


title: Deep Learning for Dynamic NFT Valuation

abstract: I study the price dynamics of non-fungible tokens (NFTs) and propose a deep learning framework for dynamic valuation of NFTs. I use data from the Ethereum blockchain and OpenSea to train a deep learning model on historical trades, market trends, and traits/rarity features of Bored Ape Yacht Club NFTs. After hyperparameter tuning, the model is able to predict the price of NFTs with high accuracy. I propose an application framework for this model using zero-knowledge machine learning (zkML) and discuss its potential use cases in the context of decentralized finance (DeFi) applications.


title: Explosive Nucleosynthesis in Core-Collapse Type II Supernovae: Insights from new C, N, Si, and Al-Mg isotopic compositions of presolar grains

abstract: We report C, N, Si, and Al-Mg isotope data for 39 presolar X silicon carbide (SiC) and four silicon nitride grains - a group of presolar grains that condensed in the remnants of core-collapse Type II supernovae (CCSNe) - isolated from the Murchison meteorite. Energy dispersive X-ray (EDX) data were used to determine the Mg and Al contents of the X SiC grains for comparison with the Mg/Al ratios determined by secondary ion mass spectroscopy (SIMS). Previous SIMS studies have used O-rich standards in the absence of alternatives. In this study, the correlated isotopic and elemental data of the X SiC grains enabled accurate determination of the initial 26Al/27Al ratios for the grains. Our new grain data suggest that (i) the literature data for X grains are affected to varying degrees by asteroidal/terrestrial contamination, and (ii) the Al/Mg ratios in SiC are a factor of two (with +/-6% 1 sigma uncertainties) lower than estimated based on the SIMS analyses that used O-rich standards. The lowered Al/Mg ratios result in proportionally higher inferred initial 26Al/27Al ratios for presolar SiC grains. In addition, the suppression of asteroidal/terrestrial contamination in this study leads to the observation of negative trends for 12C/13C-30Si/28Si and 26Al/27Al-30Si/28Si among our CCSN grains. We discuss these isotope trends in the light of explosive CCSN nucleosynthesis models, based on which we provide new insights into several non-traditional CCSN nucleosynthesis processes, including explosive H burning, the existence of a C/Si zone in the outer regions of CCSNe, and neutrino-nucleus reactions in deep CCSN regions.


title: High-Quality Live Video Streaming via Transcoding Time Prediction and Preset Selection

abstract: Video streaming often requires transcoding content into different resolutions and bitrates to match the recipient's internet speed and screen capabilities. Video encoders like x264 offer various presets, each with different tradeoffs between transcoding time and rate-distortion performance. Choosing the best preset for video transcoding is difficult, especially for live streaming, as trying all the presets and choosing the best one is not feasible. One solution is to predict each preset's transcoding time and select the preset that ensures the highest quality while adhering to live streaming time constraints. Prediction of video transcoding time is also critical in minimizing streaming delays, deploying resource management algorithms, and load balancing. We propose a learning-based framework for predicting the transcoding time of videos across various presets. Our predictor's features for video transcoding time prediction are derived directly from the ingested stream, primarily from the header or metadata. As a result, only minimal additional delay is incurred for feature extraction, rendering our approach ideal for live-streaming applications. We evaluated our learning-based transcoding time prediction using a dataset of videos. The results demonstrate that our framework can accurately predict the transcoding time for different presets, with a mean absolute percentage error (MAPE) of nearly 5.0%. Leveraging these predictions, we then select the most suitable transcoding preset for live video streaming. Utilizing our transcoding time prediction-based preset selection improved Peak Signal-to-Noise Ratio (PSNR) of up to 5 dB.


title: PixLore: A Dataset-driven Approach to Rich Image Captioning

abstract: In the domain of vision-language integration, generating detailed image captions poses a significant challenge due to the lack of a curated and rich dataset. This study introduces PixLore, a novel method that leverages Querying Transformers through the fine-tuning of the BLIP-2 model using the LoRa method on a standard commercial GPU. Our approach, which involves training on a carefully assembled dataset from state-of-the-art Computer Vision models combined and augmented by ChatGPT, addresses the question of whether intricate image understanding can be achieved with an ensemble of smaller-scale models. Comparative evaluations against major models such as GPT-4 and Google Bard demonstrate that PixLore-2.7B, despite having considerably fewer parameters, is rated higher than the existing State-of-the-Art models in over half of the assessments. This research not only presents a groundbreaking approach but also highlights the importance of well-curated datasets in enhancing the performance of smaller models.


title: An Introduction to Isomorphic Mathematical Analysis System

abstract: This paper is to build a primitive framework for a new possible extended system of real mathematical analysis - the Isomorphic Mathematical Analysis System (IMAS). It is based on some new concepts: e.g. isomorphic frame, dual-variable-isomorphic function, and isomorphic coordinate system. More concepts are introduced to constitute the whole IMAS framework. This IMAS attempts to provide current MA with new implements, which include isomorphic frame, thereby effectively putting the MA to work as well in some unevenly distributed coordinate spaces, realized by the isomorphic coordinate system. With these implements, many existing MA concepts are extended and incorporated into the new IMAS.


title: The Steady State of Intermediate-Mass Black Holes Near a Supermassive Black Hole

abstract: Aims: Investigate properties of a cluster of intermediate-mass black holes surrounding a supermassive black hole. Methods: We simulate clusters of equal-mass intermediate-mass black holes ($m_{\rm{IMBH}} = 10^{3}$ ${\rm{M_\odot}}$) initialised in a shell between $0.15\leq r$ [pc] $\leq 0.25$ centered about a supermassive black hole. We explore the influence of the cluster population and supermassive black hole mass on the merger rate, the ejection rate and the escape velocity. For $M_{\text{SMBH}} = 4\times10^{6}$ ${\rm {M}_\odot}$, we use both a Newtonian and post-Newtonian formalism, going up to the 2.5th order and including cross-terms. For the other two SMBH masses ($M_{\rm{SMBH}} = 4\times10^{5}$ ${\rm{M_\odot}}$ and $M_{\rm{SMBH}} = 4\times10^{7}$ $\rm{M_\odot}$), we model the system only taking into account relativistic effects. The simulations end once a black hole escapes the cluster, a merger occurs, or the system has evolved till $100$ Myr. Results: The post-Newtonian formalism accelerates the loss rate of intermediate-mass black holes. Ejections occur more often for lower supermassive black hole masses while more massive ones increase the rate of mergers. Although relativistic effects allow for circularisation, all merging binaries have $e \gtrsim 0.97$. Strong gravitational wave signals are suppressed during our Newtonian calculations. Weaker and more frequent signals are expected from gravitational wave radiation emitted in a fly-by. In our post-Newtonian calculations, $30/406$ of the gravitational wave events capable of being observed with LISA and $\mu$Ares are detected as gravitational wave capture binaries with the remaining being in-cluster mergers. Throughout our investigation, no IMBH-IMBH binaries were detected.


title: A Review of Machine Learning Methods Applied to Video Analysis Systems

abstract: The paper provides a survey of the development of machine-learning techniques for video analysis. The survey provides a summary of the most popular deep learning methods used for human activity recognition. We discuss how popular architectures perform on standard datasets and highlight the differences from real-life datasets dominated by multiple activities performed by multiple participants over long periods. For real-life datasets, we describe the use of low-parameter models (with 200X or 1,000X fewer parameters) that are trained to detect a single activity after the relevant objects have been successfully detected. Our survey then turns to a summary of machine learning methods that are specifically developed for working with a small number of labeled video samples. Our goal here is to describe modern techniques that are specifically designed so as to minimize the amount of ground truth that is needed for training and testing video analysis systems. We provide summaries of the development of self-supervised learning, semi-supervised learning, active learning, and zero-shot learning for applications in video analysis. For each method, we provide representative examples.


title: Exact solution of a lambda quantum system driven by a two-photon wavepacket

abstract: Three-level atoms in lambda configuration find diverse applications in quantum information processing, and a promising way to manipulate their quantum states is with single-photon pulses propagating in a waveguide (which can be theoretically regarded as a highly broadband regime of the Jaynes-Cummings model). Here, we analytically find the non-perturbative dynamics of a lambda atom driven by a two-photon wavepacket, propagating in a one-dimensional electromagnetic environment. As an application, we study the dynamics of a quantum state purification. By comparing our exact model with an approximated model of two cascaded single-photon wavepackets, we show how two-photon nonlinearities and stimulated emission affect the purification.


title: Kosambi-Cartan-Chern (KCC) Perspective on Chaos: Unveiling Hidden Attractors in Nonlinear Autonomous Systems

abstract: This article confronts the formidable task of exploring chaos within hidden attractors in nonlinear 3-D autonomous systems, highlighting the lack of established analytical and numerical methodologies for such investigations. As the basin of attraction does not touch the unstable manifold ,there are no straightforward numerical processes to detect those attractors and one has to implement special numerical-analytical strategy.In this article we present an alternative approach that allows us to predict the basin of attraction associated with hidden attractors, overcoming the existing limitations. The method discussed here based on KCC theory (Kosambi-Cartan-Chern) which enable us to conduct a comprehensive theoretical analysis by means of evaluating geometric invariants and instability exponents, thereby delineating the regions encompassing chaotic and periodic zones. Our analytical predictions are thoroughly validated by numerical results.


title: Neither hype nor gloom do DNNs justice

abstract: Neither the hype exemplified in some exaggerated claims about deep neural networks (DNNs), nor the gloom expressed by Bowers et al. do DNNs as models in vision science justice: DNNs rapidly evolve, and today's limitations are often tomorrow's successes. In addition, providing explanations as well as prediction and image-computability are model desiderata; one should not be favoured at the expense of the other.


title: Neuron-level LLM Patching for Code Generation

abstract: Large Language Models (LLMs) have found widespread adoption in software engineering, particularly in code generation tasks. However, updating these models with new knowledge can be prohibitively expensive, yet it is essential for maximizing their utility. In this paper, we propose a novel and effective model editing approach, \textsc{MENT}, to patch LLMs in coding tasks. \textsc{MENT} is effective, efficient, and reliable. It can correct a neural model by patching 1 or 2 neurons. As the pioneer work on neuron-level model editing of generative models, we formalize the editing process and introduce the involved concepts. Besides, we also introduce new measures to evaluate its generalization ability, and build a benchmark for further study. Our approach is evaluated on three coding tasks, including API-seq recommendation, line-level code generation, and pseudocode-to-code transaction. The experimental results show that the proposed approach outperforms the state of the arts by a significant margin in both effectiveness and efficiency measures. In addition, we demonstrate the usages of \textsc{MENT} for LLM reasoning in software engineering. By editing LLM knowledge, the directly or indirectly dependent behaviors of API invocation in the chain-of-thought will change accordingly. It explained the significance of repairing LLMs.


title: Filtering Pixel Latent Variables for Unmixing Noisy and Undersampled Volumetric Images

abstract: The development of robust signal unmixing algorithms is essential for leveraging multimodal datasets acquired through a wide array of scientific imaging technologies, including hyperspectral or time-resolved acquisitions. In experimental physics, enhancing the spatio-temporal resolution or expanding the number of detection channels often leads to diminished sampling rate and signal-to-noise ratio, significantly affecting the efficacy of signal unmixing algorithms. We propose applying band-pass filters to the latent space of a multi-dimensional convolutional neural network to disentangle overlapping signal components, enabling the isolation and quantification of their individual contributions. Using multi-dimensional convolution kernels to process all dimensions simultaneously enhances the network's ability to extract information from adjacent pixels, time- or spectral-bins. This approach enables more effective separation of components in cases where individual pixels do not provide clear, well-resolved information. We showcase the method's practical use in experimental physics through two test cases that highlight the versatility of our approach: fluorescence lifetime microscopy and mode decomposition in optical fibers. The latent unmixing method extracts valuable information from complex signals that cannot be resolved by standard methods. Application of latent unmixing to real FLIM experiments will increase the number of distinguishable fluorescent markers. It will also open new possibilities in optics and photonics for multichannel separations at increased sampling rate.


title: Stellar Population Properties in the Stellar Streams Around SPRC047

abstract: We have investigated the properties (e.g., age, metallicity) of the stellar populations of a ring-like tidal stellar stream (or streams) around the edge-on galaxy SPRC047 (z = 0.031) using spectral energy distribution (SED) fits to integrated broad-band aperture flux densities. We used visual images in six different bands and Spitzer/IRAC 3.6 micron data. We have attempted to derive best-fit stellar population parameters (metallicity, age) in three non-contiguous segments of the stream. Due to the very low surface brightness of the stream, we have performed a deconvolution with a Richardson-Lucy type algorithm of the low spatial resolution 3.6 micron IRAC image, thereby reducing the effect of the point-spread-function (PSF) aliased "emission" from the bright edge-on central galaxy at the locations of our three stream segments. Our SED fits that used several different star formation history priors, from an exponentially decaying star formation burst to continuous star formation, indicate that the age-metallicity-dust degeneracy is not resolved, most likely because of inadequate wavelength coverage and low signal-to-noise ratios of the low surface brightness features. We also discuss how future deep visual-near-infrared observations, combined with absolute flux calibration uncertainties at or below the 1 per cent level, complemented by equally well absolute flux calibrated observations in ultraviolet and mid-infrared bands, would improve the accuracy of broad-band SED fitting results for low surface brightness targets, such as stellar streams around nearby galaxies that are not resolved into stars.


title: Learning 3D Particle-based Simulators from RGB-D Videos

abstract: Realistic simulation is critical for applications ranging from robotics to animation. Traditional analytic simulators sometimes struggle to capture sufficiently realistic simulation which can lead to problems including the well known "sim-to-real" gap in robotics. Learned simulators have emerged as an alternative for better capturing real-world physical dynamics, but require access to privileged ground truth physics information such as precise object geometry or particle tracks. Here we propose a method for learning simulators directly from observations. Visual Particle Dynamics (VPD) jointly learns a latent particle-based representation of 3D scenes, a neural simulator of the latent particle dynamics, and a renderer that can produce images of the scene from arbitrary views. VPD learns end to end from posed RGB-D videos and does not require access to privileged information. Unlike existing 2D video prediction models, we show that VPD's 3D structure enables scene editing and long-term predictions. These results pave the way for downstream applications ranging from video editing to robotic planning.


title: Programmable patchy particles for materials design

abstract: Direct design of complex functional materials would revolutionize technologies ranging from printable organs to novel clean energy devices. However, even incremental steps towards designing functional materials have proven challenging. If the material is constructed from highly complex components, the design space of materials properties rapidly becomes too computationally expensive to search. On the other hand, very simple components such as uniform spherical particles are not powerful enough to capture rich functional behavior. Here, we introduce a differentiable materials design model with components that are simple enough to design yet powerful enough to capture complex materials properties: rigid bodies composed of spherical particles with directional interactions (patchy particles). We showcase the method with self-assembly designs ranging from open lattices to self-limiting clusters, all of which are notoriously challenging design goals to achieve using purely isotropic particles. By directly optimizing over the location and interaction of the patches on patchy particles using gradient descent, we dramatically reduce the computation time for finding the optimal building blocks.


title: Emergence and Function of Abstract Representations in Self-Supervised Transformers

abstract: Human intelligence relies in part on our brains' ability to create abstract mental models that succinctly capture the hidden blueprint of our reality. Such abstract world models notably allow us to rapidly navigate novel situations by generalizing prior knowledge, a trait deep learning systems have historically struggled to replicate. However, the recent shift from supervised to self-supervised objectives, combined with expressive transformer-based architectures, have yielded powerful foundation models that appear to learn versatile representations that can support a wide range of downstream tasks. This promising development raises the intriguing possibility of such models developing in silico abstract world models. We test this hypothesis by studying the inner workings of small-scale transformers trained to reconstruct partially masked visual scenes generated from a simple blueprint. We show that the network develops intermediate abstract representations, or abstractions, that encode all semantic features of the dataset. These abstractions manifest as low-dimensional manifolds where the embeddings of semantically related tokens transiently converge, thus allowing for the generalization of downstream computations. Using precise manipulation experiments, we demonstrate that abstractions are central to the network's decision-making process. Our research also suggests that these abstractions are compositionally structured, exhibiting features like contextual independence and part-whole relationships that mirror the compositional nature of the dataset. Finally, we introduce a Language-Enhanced Architecture (LEA) designed to encourage the network to articulate its computations. We find that LEA develops an abstraction-centric language that can be easily interpreted, allowing us to more readily access and steer the network's decision-making process.


title: All-Sky Search for Transient Astrophysical Neutrino Emission with 10 Years of IceCube Cascade Events

abstract: We present the results of a time-dependent search for neutrino flares in data collected by IceCube between May 2011 and 2021. This data set contains cascade-like events originating from charged-current electron neutrino and tau neutrino interactions and all-flavor neutral-current interactions. IceCube's previous all-sky searches for neutrino flares used data sets consisting of track-like events originating from charged-current muon neutrino interactions. The cascade data sets are statistically independent of the track data sets and provide a new opportunity to observe the transient all-sky landscape. This search uses the spatial, temporal, and energy information of the cascade-like events to conduct searches for the most statistically significant neutrino flares in the northern and southern skies. No statistically significant time-dependent neutrino emission was observed. For the most statistically significant location in the northern sky, $p_\mathrm{global} =$ 0.71, and in the southern sky, $p_\mathrm{global} =$ 0.51. These results are compatible with the background hypothesis. Assuming an E$^{-2.53}$ spectrum from the diffuse astrophysical neutrino flux as measured with cascades, these results are used to calculate upper limits at the 90\% confidence level on neutrino flares of varying duration and constrain the contribution of these flares to the diffuse astrophysical neutrino flux. These constraints are independent of a specified class of astrophysical objects and show that multiple unresolved transient sources may contribute to the diffuse astrophysical neutrino flux.


title: Graph Polynomials for the Numbers of Independent Sets and Bipartite Cuts for Undirected Graphs

abstract: The graph polynomial for the number of independent sets of size $k$ in a general undirected graph is shown to be equal to an elementary symmetric polynomial of the vertex monomials, which are determined by the edges incident at the vertices. The edge variables that comprise the vertex monomials are shown to be nilpotent of degree two. The index of nilpotency of the algebra generated by the graph's vertex monomials is the order of a maximum independent set of the graph. Graph polynomials for the number of cliques and vertex covers are derived from the graph polynomial for independent sets. The graph polynomial for the number of bipartite cuts is given as a coefficient of a multivariate Laurent polynomial.


title: AntGrip -- Boosting Parallel Plate Gripper Performance Inspired by the Internal Hairs of Ant Mandibles

abstract: Ants use their mandibles - effectively a two-finger gripper - for a wide range of grasping activities. Here we investigate whether mimicking the internal hairs found on ant mandibles can improve performance of a two-finger parallel plate robot gripper. With bin picking applications in mind, the gripper fingers are long and slim, with interchangeable soft gripping pads that can be hairy or hairless. A total of 2400 video-documented experiments have been conducted, comparing hairless to hairy pads with different hair patterns. Simply by adding hairs, the grasp success rate was increased by at least 29%, and the number of objects that remain securely gripped during manipulation more than doubled. This result not only advances the state of the art in grasping technology, but also provides novel insight into the mechanical role of mandible hairs in ant biology.


title: Product Centered Dirichlet Processes for Dependent Clustering

abstract: While there is an immense literature on Bayesian methods for clustering, the multiview case has received little attention. This problem focuses on obtaining distinct but statistically dependent clusterings in a common set of entities for different data types. For example, clustering patients into subgroups with subgroup membership varying according to the domain of the patient variables. A challenge is how to model the across-view dependence between the partitions of patients into subgroups. The complexities of the partition space make standard methods to model dependence, such as correlation, infeasible. In this article, we propose CLustering with Independence Centering (CLIC), a clustering prior that uses a single parameter to explicitly model dependence between clusterings across views. CLIC is induced by the product centered Dirichlet process (PCDP), a novel hierarchical prior that bridges between independent and equivalent partitions. We show appealing theoretic properties, provide a finite approximation and prove its accuracy, present a marginal Gibbs sampler for posterior computation, and derive closed form expressions for the marginal and joint partition distributions for the CLIC model. On synthetic data and in an application to epidemiology, CLIC accurately characterizes view-specific partitions while providing inference on the dependence level.


title: A priori obstructions to resolution of singularities

abstract: We present an argument due to Thom to formulate a priori cohomology obstructions for a projective variety to admit an embedded resolution of singularities, and generalize the argument to a field of characteristic $p > 0$. We show that these obstructions are defined for a general cohomology theory that satisfies localization, \'etale excision, and $\mathbb{A}^1$-invariance, and is equipped with a proper pushforward. As examples, we show that odd degree Steenrod homology operations on higher Chow groups mod $\ell$, defined by a suitable $E_{\infty}$-algebra structure, vanish on the fundamental class of a smooth variety, where $\ell$ is any prime. We extend this general vanishing result to arbitrary varieties for operations defined mod $\ell \neq p$. Along the way, we also obtain a Wu formula for the mod $p$ Steenrod operations in the case of closed embeddings of smooth varieties.


title: Entropy of a unitary operator on $l^2(\mathbb{N}_0)$

abstract: In this article we continue to study the concept of entropy introduced in [4], [15]-[17]. We calculate entropy for a wider class of finite-dimensional operators in comparison with [15]. We also approximate the entropy of a unitary operator on $l^2(\mathbb{N}_0)$ by the entropy of finite-dimensional operators. Finally we calculate the entropy of several operators on $l^2(\mathbb{N}_0)$.


title: Toward Scalable and Transparent Multimodal Analytics to Study Standard Medical Procedures: Linking Hand Movement, Proximity, and Gaze Data

abstract: This study employed multimodal learning analytics (MMLA) to analyze behavioral dynamics during the ABCDE procedure in nursing education, focusing on gaze entropy, hand movement velocities, and proximity measures. Utilizing accelerometers and eye-tracking techniques, behaviorgrams were generated to depict various procedural phases. Results identified four primary phases characterized by distinct patterns of visual attention, hand movements, and proximity to the patient or instruments. The findings suggest that MMLA can offer valuable insights into procedural competence in medical education. This research underscores the potential of MMLA to provide detailed, objective evaluations of clinical procedures and their inherent complexities.


title: Nodal Sets of Laplacian Eigenfunctions with an Eigenvalue of Multiplicity 2

abstract: We study the effects of a domain deformation to the nodal set of Laplacian eigenfunctions when the eigenvalue is degenerate. In particular, we study deformations of a rectangle that perturb one side and how they change the nodal sets corresponding to an eigenvalue of multiplicity 2. We establish geometric properties, such as number of nodal domains, presence of crossings, and boundary intersections, of nodal sets for a large class of boundary deformations and study how these properties change along each eigenvalue branch for small perturbations. We show that internal crossings of the nodal set break under generic deformations and obtain estimates on the location and regularity of the nodal sets on the perturbed rectangle.


title: A Constituent Model of Light Hybrid Meson Decays

abstract: A model of light hybrid mesons and their strong decays is developed. The model employs a gluonic quasiparticle to describe low energy gluodynamics and uses the QCD Hamiltonian in Coulomb gauge to guide the construction of states and decay amplitudes. We compute the partial widths of the twelve low lying isovector and vector hybrids. Implications of these results on hybrid searches are also made, with the chief conclusions being that direct observation of the vector states will be difficult, that a hybrid $\pi(1800)$ has distinctive decay characteristics, a narrow $\eta(1900)$ hybrid should exist, an $\eta_1(1750)$ should be sought, and that the exotic nature of $J^{PC}= 2^{-+}$ hybrid mesons should be discernible with sufficient data. We argue that the isovector $\pi_2$ hybrid has been discovered, giving a total of four possible hybrid mesons, $\pi_1(1600)$, $\eta_1(1855)$, $\pi(1800)$, and $\pi_2(2360)$, which appear to be filling out the lowlying hybrid supermultiplet in the expected fashion.


title: Quantum Simulation of Lindbladian Dynamics via Repeated Interactions

abstract: The Lindblad equation generalizes the Schr\"{o}dinger equation to quantum systems that undergo dissipative dynamics. The quantum simulation of Lindbladian dynamics is therefore non-unitary, preventing a naive application of state-of-the-art quantum algorithms. Here, we make use of an approximate correspondence between Lindbladian dynamics and evolution based on Repeated Interaction (RI) CPTP maps to write down a Hamiltonian formulation of the Lindblad dynamics and derive a rigorous error bound on the master equation. Specifically, we show that the number of interactions needed to simulate the Liouvillian $e^{t\mathcal{L}}$ within error $\epsilon$ scales in a weak coupling limit as $\nu\in O(t^2\|\mathcal{L}\|_{1\rightarrow 1}^2/\epsilon)$. This is significant because the error in the Lindbladian approximation to the dynamics is not explicitly bounded in existing quantum algorithms for open system simulations. We then provide quantum algorithms to simulate RI maps using an iterative Qubitization approach and Trotter-Suzuki formulas and specifically show that for iterative Qubitization the number of operations needed to simulate the dynamics (for a fixed value of $\nu$) scales in a weak coupling limit as $O(\alpha_0 t + \nu \log(1/\epsilon)/\log\log(1/\epsilon))$ where $\alpha_0$ is the coefficient $1$-norm for the system and bath Hamiltonians. This scaling would appear to be optimal if the complexity of $\nu$ is not considered, which underscores the importance of considering the error in the Liouvillian that we reveal in this work.


title: Rational Kriging

abstract: This article proposes a new kriging that has a rational form. It is shown that the generalized least squares estimate of the mean from rational kriging is much more well behaved than that from ordinary kriging. Parameter estimation and uncertainty quantification for rational kriging are proposed using a Gaussian process framework. Its potential applications in emulation and calibration of computer models are also discussed.


title: GCov-Based Portmanteau Test

abstract: We examine finite sample performance of the Generalized Covariance (GCov) residual-based specification test for semiparametric models with i.i.d. errors. The residual-based multivariate portmanteau test statistic follows asymptotically a $\chi^2$ distribution when the model is estimated by the GCov estimator. The test is shown to perform well in application to the univariate mixed causal-noncausal MAR, double autoregressive (DAR) and multivariate Vector Autoregressive (VAR) models. We also introduce a bootstrap procedure that provides the limiting distribution of the test statistic when the specification test is applied to a model estimated by the maximum likelihood, or the approximate or quasi-maximum likelihood under a parametric assumption on the error distribution.


title: Nonlinear generation of sound waves in the pre-galactic epoch and 21 cm absorption

abstract: The structure of the sound waves generated in baryonic gas during the evolution of dark matter halos with masses less than the Jeans mass is calculated. In this case, the source of the gravitational field that creates the wave can be either at a linear stage (an evolving perturbation in dark matter) or at a nonlinear stage (detached and virialized objects). The peculiar velocity of baryons in the sound wave in the second order of velocity cause absorption of the relic radiation in the 21 cm line. It is shown that this additional absorption at sound waves ranges from fractions of a percent (at the redshifts z~15-20) to about percent (at z~7-15) of the absorption value in a homogeneous Universe, however, additional absorption may be larger in the case of a non-standard spectrum of small scale cosmological perturbations.


title: The Thermodynamic Costs of Pure Dephasing in Quantum Heat Engines: Quasistatic Efficiency at Finite Power

abstract: Quantum heat engines are commonly believed to achieve their optimal efficiency when operated under quasi-static conditions. However, when running at finite power, they suffer effective friction due to the generation of coherences and transitions between energy eigenstates. It was noted that it is possible to increase the power of a quantum heat engine using external control schemes or suitable dephasing noise. Here, we investigate the thermodynamic cost associated with dephasing noise schemes using both numerical and analytical methods. Our findings unveil that the observed gain in power is generally not free of thermodynamic costs, as it involves heat flows from thermal baths into the dephasing bath. These contributions must be duly accounted for when determining the engine's overall efficiency. Interestingly, we identify a particular working regime where these costs become negligible, demonstrating that quantum heat engines can be operated at any power with an efficiency per cycle that approaches arbitrarily closely that under quasistatic operation.


title: Realizing abstract simplicial complexes with specified edge lengths

abstract: For finite abstract simplicial complex $\Sigma$, initial realization $\alpha$ in $\mathbb{E}^d$, and desired edge lengths $L$, we give practical sufficient conditions for the existence of a non-self-intersecting perturbation of $\alpha$ realizing the lengths $L$. We provide software to verify these conditions by computer and optionally assist in the creation of an initial realization from abstract simplicial data. Applications include proving the existence of a planar embedding of a graph with specified edge lengths or proving the existence of polyhedra (or higher-dimensional polytopes) with specified edge lengths.


title: Holographic transport beyond the supergravity approximation

abstract: We set up a unified framework to efficiently compute the shear and bulk viscosities of strongly coupled gauge theories with gravitational holographic duals involving higher derivative corrections. We consider both Weyl$^4$ corrections, encoding the finite 't Hooft coupling corrections of the boundary theory, and Riemann$^2$ corrections, responsible for non-equal central charges $c\ne a$ of the theory at the ultraviolet fixed point. Our expressions for the viscosities in higher derivative holographic models are extracted from a radially conserved current and depend only on the horizon data.


title: Kink in cuprates: the role of the low-energy density of states

abstract: The 40-70 meV band-structure renormalization (so-called kink) in high-temperature cuprate superconductors - which has been mainly interpreted in terms of electron-boson coupling - is observed to be strongly suppressed both above the superconducting transition temperature and under optical excitation. We employ equilibrium and time- and angle-resolved photoemission spectroscopy, in combination with Migdal-Eliashberg simulations, to investigate the suppression of the near-nodal kink in Bi$_2$Sr$_2$CaCu$_2$O$_{8+\delta}$. We show that the $\sim$30$\%$ decrease of the kink strength across the superconducting-to-normal-state phase transition can be entirely accounted for by the filling of the superconducting gap, without additional consideration of temperature-dependent electron-boson coupling. Our findings demonstrate that consideration of changes in the density of states is essential to quantitatively account for the band structure renormalization effects in cuprates.


title: Exploring Parity Challenges in Reinforcement Learning through Curriculum Learning with Noisy Labels

abstract: This paper delves into applying reinforcement learning (RL) in strategy games, particularly those characterized by parity challenges, as seen in specific positions of Go and Chess and a broader range of impartial games. We propose a simulated learning process, structured within a curriculum learning framework and augmented with noisy labels, to mirror the intricacies of self-play learning scenarios. This approach thoroughly analyses how neural networks (NNs) adapt and evolve from elementary to increasingly complex game positions. Our empirical research indicates that even minimal label noise can significantly impede NNs' ability to discern effective strategies, a difficulty that intensifies with the growing complexity of the game positions. These findings underscore the urgent need for advanced methodologies in RL training, specifically tailored to counter the obstacles imposed by noisy evaluations. The development of such methodologies is crucial not only for enhancing NN proficiency in strategy games with significant parity elements but also for broadening the resilience and efficiency of RL systems across diverse and complex environments.


title: Exact Polarization of Particles of Any Spin at Global Equilibrium

abstract: The polarization of the $\Lambda$ particle offers the unique opportunity to study the hydrodynamic gradients in the Quark-Gluon Plasma formed in heavy-ion collisions. However, the theoretical formula commonly used to calculate polarization is only a linear order expansion in thermal vorticity and neglects higher-order corrections. Here, I present an exact calculation to all orders in (constant) thermal vorticity at global equilibrium, obtaining the analytic form of the spin density matrix and the polarization vector for massive particles of any spin. Finally, I extend these results to local equilibrium and assess their phenomenological impact by numerically calculating the polarization vector in a 3+1 hydrodynamic simulation.


title: Screening fifth forces in scalar-vector-tensor theories

abstract: We study a screening mechanism in the context of scalar-vector-tensor (SVT) theories. This screening mechanism is based on both the derivative self-interactions of the vector field and the interactions of the scalar field with the vector field and curvature. We calculate the field equations in a spherically symmetric space-time, and then, we study the conditions for which this mechanism is successful in a weak gravitational background. In order to corroborate these analytical results, we have performed a numerical integration of the full equations. Finally, the corrections to the gravitational potentials have also been computed. We conclude that the present model, including both kinds of interactions, can avoid the propagation of the additional longitudinal mode arising in these theories. We also show that the space parameter of the model is compatible with solar system constraints. This result extends the previous one found in the literature for generalized Proca theories to the case of SVT theories in the presence of scalar-vector interactions.


title: Estimation Sample Complexity of a Class of Nonlinear Continuous-time Systems

abstract: We present a method of parameter estimation for large class of nonlinear systems, namely those in which the state consists of output derivatives and the flow is linear in the parameter. The method, which solves for the unknown parameter by directly inverting the dynamics using regularized linear regression, is based on new design and analysis ideas for differentiation filtering and regularized least squares. Combined in series, they yield a novel finite-sample bound on mean absolute error of estimation.


title: Review of Quasi-Randomization Approaches for Estimation from Non-probability Samples

abstract: The recent proliferation of computers and the internet have opened new opportunities for collecting and processing data. However, such data are often obtained without a well-planned probability survey design. Such non-probability based samples cannot be automatically regarded as representative of the population of interest. Several classes of methods for estimation and inferences from non-probability samples have been developed in recent years. The quasi-randomization methods assume that non-probability sample selection is governed by an underlying latent random mechanism. The basic idea is to use information collected from a probability ("reference") sample to uncover latent non-probability survey participation probabilities (also known as "propensity scores") and use them in estimation of target finite population parameters. In this paper, we review and compare theoretical properties of recently developed methods of estimation survey participation probabilities and study their relative performances in simulations.


title: Ultralow Noise Microwave Synthesis Via Difference Frequency Division of a Brillouin Resonator

abstract: Low phase noise microwave oscillators are at the center of a multitude of applications that span the gamut of photonics and electronics. Within this space, optically-derived approaches to microwave frequency synthesis are particularly compelling owing to their unique combination of ultrawideband frequency access and the potential for resiliency to temperature and environmental perturbation via common-mode noise rejection. We demonstrate here an optical frequency divider that uses the 30 terahertz frequency gap between two stimulated Brillouin scattering (SBS) lasers as the basis for frequency division. The resulting microwave signal, centered at 10 GHz frequency, exhibits exceptionally low phase noise levels of -95 dBc/Hz and -110 dBc/Hz at 10 Hz and 100 Hz frequency offset, respectively. Moreover, the two SBS lasers, generated from a common fiber resonator, exhibits a high degree of correlated noise cancellation in their frequency difference. We measure 16.1 dB of noise rejection against intentionally applied vibrations, thus showcasing a promising pathway towards portable and robust ultralow noise photonic-microwave synthesis.


title: Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving

abstract: Machine learning (ML) inference platforms are tasked with balancing two competing goals: ensuring high throughput given many requests, and delivering low-latency responses to support interactive applications. Unfortunately, existing platform knobs (e.g., batch sizes) fail to ease this fundamental tension, and instead only enable users to harshly trade off one property for the other. This paper explores an alternate strategy to taming throughput-latency tradeoffs by changing the granularity at which inference is performed. We present Apparate, a system that automatically applies and manages early exits (EEs) in ML models, whereby certain inputs can exit with results at intermediate layers. To cope with the time-varying overhead and accuracy challenges that EEs bring, Apparate repurposes exits to provide continual feedback that powers several novel runtime monitoring and adaptation strategies. Apparate lowers median response latencies by 40.5-91.5% and 10.0-24.2% for diverse CV and NLP workloads, respectively, without affecting throughputs or violating tight accuracy constraints.


title: Model Extraction Attacks Revisited

abstract: Model extraction (ME) attacks represent one major threat to Machine-Learning-as-a-Service (MLaaS) platforms by ``stealing'' the functionality of confidential machine-learning models through querying black-box APIs. Over seven years have passed since ME attacks were first conceptualized in the seminal work. During this period, substantial advances have been made in both ME attacks and MLaaS platforms, raising the intriguing question: How has the vulnerability of MLaaS platforms to ME attacks been evolving? In this work, we conduct an in-depth study to answer this critical question. Specifically, we characterize the vulnerability of current, mainstream MLaaS platforms to ME attacks from multiple perspectives including attack strategies, learning techniques, surrogate-model design, and benchmark tasks. Many of our findings challenge previously reported results, suggesting emerging patterns of ME vulnerability. Further, by analyzing the vulnerability of the same MLaaS platforms using historical datasets from the past four years, we retrospectively characterize the evolution of ME vulnerability over time, leading to a set of interesting findings. Finally, we make suggestions about improving the current practice of MLaaS in terms of attack robustness. Our study sheds light on the current state of ME vulnerability in the wild and points to several promising directions for future research.


title: Cross Domain Generative Augmentation: Domain Generalization with Latent Diffusion Models

abstract: Despite the huge effort in developing novel regularizers for Domain Generalization (DG), adding simple data augmentation to the vanilla ERM which is a practical implementation of the Vicinal Risk Minimization principle (VRM) \citep{chapelle2000vicinal} outperforms or stays competitive with many of the proposed regularizers. The VRM reduces the estimation error in ERM by replacing the point-wise kernel estimates with a more precise estimation of true data distribution that reduces the gap between data points \textbf{within each domain}. However, in the DG setting, the estimation error of true data distribution by ERM is mainly caused by the distribution shift \textbf{between domains} which cannot be fully addressed by simple data augmentation techniques within each domain. Inspired by this limitation of VRM, we propose a novel data augmentation named Cross Domain Generative Augmentation (CDGA) that replaces the pointwise kernel estimates in ERM with new density estimates in the \textbf{vicinity of domain pairs} so that the gap between domains is further reduced. To this end, CDGA, which is built upon latent diffusion models (LDM), generates synthetic images to fill the gap between all domains and as a result, reduces the non-iidness. We show that CDGA outperforms SOTA DG methods under the Domainbed benchmark. To explain the effectiveness of CDGA, we generate more than 5 Million synthetic images and perform extensive ablation studies including data scaling laws, distribution visualization, domain shift quantification, adversarial robustness, and loss landscape analysis.


title: Higher-Order Equivariant Neural Networks for Charge Density Prediction in Materials

abstract: The calculation of electron density distribution using density functional theory (DFT) in materials and molecules is central to the study of their quantum and macro-scale properties, yet accurate and efficient calculation remains a long-standing challenge. We introduce ChargE3Net, an E(3)-equivariant graph neural network for predicting electron density in atomic systems. ChargE3Net enables the learning of higher-order equivariant feature to achieve high predictive accuracy and model expressivity. We show that ChargE3Net exceeds the performance of prior work on diverse sets of molecules and materials. When trained on the massive dataset of over 100K materials in the Materials Project database, our model is able to capture the complexity and variability in the data, leading to a significant 26.7% reduction in self-consistent iterations when used to initialize DFT calculations on unseen materials. Furthermore, we show that non-self-consistent DFT calculations using our predicted charge densities yield near-DFT performance on electronic and thermodynamic property prediction at a fraction of the computational cost. Further analysis attributes the greater predictive accuracy to improved modeling of systems with high angular variations. These results illuminate a pathway towards a machine learning-accelerated ab initio calculations for materials discovery.


title: Production of the $X(4014)$ as the spin-2 partner of $X(3872)$ in $e^+e^-$ collisions

abstract: In 2021, the Belle collaboration reported the first observation of a new structure in the $\psi(2S) \gamma$ final state produced in the two-photon fusion process. In the hadronic molecule picture, this new structure can be associated with the shallow isoscalar $D^*\bar{D}^*$ bound state and as such is an excellent candidate for the spin-2 partner of the $X(3872)$ with the quantum numbers $J^{PC}=2^{++}$ conventionally named $X_2$. In this work we evaluate the electronic width of this new state and argue that its nature is sensitive to its total width, the experimental measurement currently available being unable to distinguish between different options. Our estimates demonstrate that the planned Super $\tau$-Charm Facility offers a promising opportunity to search for and study this new state in the invariant mass distributions for the final states $J/\psi\gamma$ and $\psi(2S)\gamma$.


title: NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Models

abstract: Generative models have been very popular in the recent years for their image generation capabilities. GAN-based models are highly regarded for their disentangled latent space, which is a key feature contributing to their success in controlled image editing. On the other hand, diffusion models have emerged as powerful tools for generating high-quality images. However, the latent space of diffusion models is not as thoroughly explored or understood. Existing methods that aim to explore the latent space of diffusion models usually relies on text prompts to pinpoint specific semantics. However, this approach may be restrictive in areas such as art, fashion, or specialized fields like medicine, where suitable text prompts might not be available or easy to conceive thus limiting the scope of existing work. In this paper, we propose an unsupervised method to discover latent semantics in text-to-image diffusion models without relying on text prompts. Our method takes a small set of unlabeled images from specific domains, such as faces or cats, and a pre-trained diffusion model, and discovers diverse semantics in unsupervised fashion using a contrastive learning objective. Moreover, the learned directions can be applied simultaneously, either within the same domain (such as various types of facial edits) or across different domains (such as applying cat and face edits within the same image) without interfering with each other. Our extensive experiments show that our method achieves highly disentangled edits, outperforming existing approaches in both diffusion-based and GAN-based latent space editing methods.


title: Loss Functions in the Era of Semantic Segmentation: A Survey and Outlook

abstract: Semantic image segmentation, the process of classifying each pixel in an image into a particular class, plays an important role in many visual understanding systems. As the predominant criterion for evaluating the performance of statistical models, loss functions are crucial for shaping the development of deep learning-based segmentation algorithms and improving their overall performance. To aid researchers in identifying the optimal loss function for their particular application, this survey provides a comprehensive and unified review of $25$ loss functions utilized in image segmentation. We provide a novel taxonomy and thorough review of how these loss functions are customized and leveraged in image segmentation, with a systematic categorization emphasizing their significant features and applications. Furthermore, to evaluate the efficacy of these methods in real-world scenarios, we propose unbiased evaluations of some distinct and renowned loss functions on established medical and natural image datasets. We conclude this review by identifying current challenges and unveiling future research opportunities. Finally, we have compiled the reviewed studies that have open-source implementations on our GitHub page.


title: The logic of NTQR evaluations of noisy AI agents: Complete postulates and logically consistent error correlations

abstract: In his "ship of state" allegory (\textit{Republic}, Book VI, 488) Plato poses a question -- how can a crew of sailors presumed to know little about the art of navigation recognize the true pilot among them? The allegory argues that a simple majority voting procedure cannot safely determine who is most qualified to pilot a ship when the voting members are ignorant or biased. We formalize Plato's concerns by considering the problem in AI safety of monitoring noisy AI agents in unsupervised settings. An algorithm evaluating AI agents using unlabeled data would be subject to the evaluation dilemma - how would we know the evaluation algorithm was correct itself? This endless validation chain can be avoided by considering purely algebraic functions of the observed responses. We can construct complete postulates than can prove or disprove the logical consistency of any grading algorithm. A complete set of postulates exists whenever we are evaluating $N$ experts that took $T$ tests with $Q$ questions with $R$ responses each. We discuss evaluating binary classifiers that have taken a single test - the $(N,T=1,Q,R=2)$ tests. We show how some of the postulates have been previously identified in the ML literature but not recognized as such - the \textbf{agreement equations} of Platanios. The complete postulates for pair correlated binary classifiers are considered and we show how it allows for error correlations to be quickly calculated. An algebraic evaluator based on the assumption that the ensemble is error independent is compared with grading by majority voting on evaluations using the \uciadult and and \texttt{two-norm} datasets. Throughout, we demonstrate how the formalism of logical consistency via algebraic postulates of evaluation can help increase the safety of machines using AI algorithms.


title: Turbulence modulation in dense liquid-solid channel flow

abstract: We investigate the mechanisms by which inertial solid particles modulate turbulence and alter the fluid mass transport in dense turbulent liquid-solid flows. To this end, we perform Euler-Lagrange simulations at friction Reynolds number 180, particle friction Stokes number 7.9, particle-to-fluid density ratio 8.9, and particle volume fraction ranging from 1% up to 12%. We show that the mechanisms underpinning the flow modulation are two fold: (I) the increase of the suspension's apparent kinematic viscosity with increasing solid volume fraction and (II) turbulence modulation through the particle feedback force. For solid volume fraction below 3%, the increase of the suspension's apparent kinematic viscosity by the disperse particles accounts for most of the flow modification, namely, the reduction of turbulent fluctuations, reduction of the bulk fluid velocity, and increase of friction coefficient. In denser channels, the particle feedback force leads to greater reduction of bulk fluid velocity and increase of friction coefficient than can be accounted for solely based on the increased apparent kinematic viscosity. In these cases, particle stress significantly alters the stress balance, to a point where it exceeds the Reynolds stress at solid volume fraction 12%.


title: Twist numbers on hyperbolic once-punctured tori

abstract: On a hyperbolic surface homeomorphic to a torus with a puncture, each oriented simple geodesic inherits a well-defined relative twist number in $[0,1]$, given by the ratio to its hyperbolic length of the hyperbolic distance between the orthogonal projections of the cusp (or boundary) on its left and right, respectively. With the Markov Uniqueness Conjecture in mind, the twist numbers for simple geodesics on the modular torus $\mathcal{X}$ are of particular interest. Up to isometries of $\mathcal{X}$, simple geodesics are parameterized naturally by $\mathbb{Q}\cap[0,1]$, and the relative twist number yields a map $\tau_{\mathcal{X}}:\mathbb{Q}\cap [0,1] \to [0,1]$. We use hyperbolic geometry and the Farey graph to show that the graph of $\tau_{\mathcal{X}}$ is dense in $[0,1]\times [0,1]$, and the same conclusion holds for any complete hyperbolic structure $\mathcal{Y}$ on the punctured torus. It follows that the twist number of a simple closed curve on the punctured torus does not extend continuously to the space of measured laminations. We also include some explicit calculations of geometric quantities associated to Markov triples, and the curious fact that $\tau_{\mathcal{X}}$ is never equal to zero.


title: Nonlocal, Flat Band Meta-optics for Monolithic, High Efficiency, Compact Photodetectors

abstract: Miniaturized photodetectors are becoming increasingly sought-after components for a range of next generation technologies, such as autonomous vehicles, integrated wearable devices, or gadgets embedded in the Internet of Things. A major challenge, however, lies in shrinking the device footprint, while maintaining high efficiency. This conundrum can be solved by realizing non-trivial relation between the energy and momentum of photons, such as dispersion-free angle-independent devices, known as flat bands. Here, we leverage flat band meta-optics to simultaneously achieve critical absorption over a wide range of incidence angles. For a monolithic silicon meta-optical photodiode, we achieved ~10-fold enhancement in the photon-to-electron conversion efficiency. Such enhancement over a large angular range of ~36 degrees allows incoming light to be collected via a large aperture lens and focused on a compact photodiode, potentially enabling high-speed and low-light operation. Our research unveils new possibilities for creating compact and efficient optoelectronic devices with far-reaching impact on various applications, including augmented reality and light detection and ranging.


title: Novel Evolution of the Mineralocorticoid Receptor in Humans compared to Chimpanzees, Gorillas and Orangutans

abstract: Five distinct full-length mineralocorticoid receptor (MR) genes have been identified in humans. These human MRs can be distinguished by the presence or absence of an in-frame insertion of 12 base pairs coding for Lys, Cys, Ser, Trp (KCSW) in their DNA-binding domain (DBD) and the presence of two amino acid mutations in their amino terminal domain (NTD). Two human MRs with the KCSW insertion (MR-KCSW) and three human MRs without KCSW in the DBD have been identified. The three human MRs without KCSW contain either (Ile-180, Ala-241) or (Val-180, Val-241) or (Ile-180, Val-241) in their NTD. The two human MRs with KCSW contain either (Val-180, Val-241) or (Ile-180, Val-241) in their NTD. Human MR-KCSW with (Ile-180, Ala-241) has not been cloned. In contrast, chimpanzees contain two MRs with KCSW and two MRs without KCSW in their DBD and both contain only Ile180, Val-241 in their NTDs. Each pair of chimpanzee MRs differ at another amino acid in the NTD. A chimpanzee MR with either Val-180, Val-241 or Ile-180, Ala-241 in the NTD has not been cloned. Gorillas and orangutans each contain one MR with KCSW in the DBD and one MR without KCSW. Both gorilla and orangutan MRs contain I-180, Val-241 in their NTD. Neither Val-180, Val-241 nor Ile-180, Ala-241 are found in the NTD in either a gorilla MR or an orangutan MR. These data suggest that human MRs with Val-180, Val-241 or Ile-180, Ala-241 in the NTD evolved after humans and chimpanzees diverged from their common ancestor. These unique human MRs may have had a role in the divergent evolution of humans from chimpanzees. Studies are underway to characterize transcriptional activation of the five human MRs by aldosterone, cortisol, and other corticosteroids for comparison with each other to elucidate the roles of these MRs in human physiology.


title: On the Performance of Temporal Difference Learning With Neural Networks

abstract: Neural Temporal Difference (TD) Learning is an approximate temporal difference method for policy evaluation that uses a neural network for function approximation. Analysis of Neural TD Learning has proven to be challenging. In this paper we provide a convergence analysis of Neural TD Learning with a projection onto $B(\theta_0, \omega)$, a ball of fixed radius $\omega$ around the initial point $\theta_0$. We show an approximation bound of $O(\epsilon) + \tilde{O} (1/\sqrt{m})$ where $\epsilon$ is the approximation quality of the best neural network in $B(\theta_0, \omega)$ and $m$ is the width of all hidden layers in the network.


title: Generative Network Layer for Communication Systems with Artificial Intelligence

abstract: The traditional role of the network layer is the transfer of packet replicas from source to destination through intermediate network nodes. We present a generative network layer that uses Generative AI (GenAI) at intermediate or edge network nodes and analyze its impact on the required data rates in the network. We conduct a case study where the GenAI-aided nodes generate images from prompts that consist of substantially compressed latent representations. The results from network flow analyses under image quality constraints show that the generative network layer can achieve an improvement of more than 100% in terms of the required data rate.


title: Sub-Alfvenic Turbulence: Magnetic to Kinetic Energy Ratio, Modification of Weak Cascade and Implications for Magnetic Field Strength Measurement

abstract: We study the properties of sub-Alfvenic magnetohydrodynamic (MHD) turbulence, i.e., turbulence with Alfven Mach number $M_A=V_L/V_A<1$, where $V_L$ is the velocity at the injection scale and $V_A$ is the Alfven velocity. We demonstrate that weak turbulence can have different regimes depending on whether it is driven by velocity or magnetic fluctuations. If the turbulence is driven by isotropic bulk forces, i.e. velocity-driven, in an incompressible conducting fluid, we predict that the kinetic energy is $M_A^{-2}$ times larger than the energy of magnetic fluctuations. This effect arises from the long parallel wavelength tail of the forcing, which excites modes with $k_\|/k_\perp < M_A$. We also predict that as the turbulent cascade reaches the strong regime the energy of slow modes exceeds the energy of Alfven modes by a factor $M_A^{-1}$. These effects are absent if the turbulence is magnetically driven at the injection scale. We confirm these predictions with numerical simulations. As the assumption of magnetic and kinetic energy equipartition is at the core of the Davis-Chandrasekhar-Fermi (DCF) approach to measuring magnetic field strength in sub-Alfvenic turbulence, we conclude that the DCF technique is not universally applicable. In particular, we suggest that the dynamical excitation of long azimuthal wavelength modes in the galactic disk may compromise the use of the DCF technique. We discuss alternative expressions that can be used to obtain magnetic field strength from observations.


title: Generalized difference-in-differences

abstract: We propose a new method for estimating causal effects in longitudinal/panel data settings that we call generalized difference-in-differences. Our approach unifies two alternative approaches in these settings: ignorability estimators (e.g., synthetic controls) and difference-in-differences (DiD) estimators. We propose a new identifying assumption -- a stable bias assumption -- which generalizes the conditional parallel trends assumption in DiD, leading to the proposed generalized DiD framework. This change gives generalized DiD estimators the flexibility of ignorability estimators while maintaining the robustness to unobserved confounding of DiD. We also show how ignorability and DiD estimators are special cases of generalized DiD. We then propose influence-function based estimators of the observed data functional, allowing the use of double/debiased machine learning for estimation. We also show how generalized DiD easily extends to include clustered treatment assignment and staggered adoption settings, and we discuss how the framework can facilitate estimation of other treatment effects beyond the average treatment effect on the treated. Finally, we provide simulations which show that generalized DiD outperforms ignorability and DiD estimators when their identifying assumptions are not met, while being competitive with these special cases when their identifying assumptions are met.


title: A Digital Compositing Approach to obtain Animated Chinese Still-life Paintings with Global Effects

abstract: In this work, we present a method for turning Chinese still-life paintings with global illumination effects into dynamic paintings with moving lights. Our goal is to preserve the original look and feel of still-life paintings with moving lights and objects. We have developed a deceptively simple method that can be computed as a composite of two animated texture images using an animated rendering. The compositing process can be implemented directly in an animation system such as AfterEffect, which allows for the basic compositing operation over animations. It is also possible to control the colors by changing the material colors in animated rendering. We have provided a proof-of-concept based on an original digital Still-Life painting that is in realist Chinese style. This approach can be used to turn almost any still-life painting into a dynamic painting.


title: Towards Controlled Table-to-Text Generation with Scientific Reasoning

abstract: The sheer volume of scientific experimental results and complex technical statements, often presented in tabular formats, presents a formidable barrier to individuals acquiring preferred information. The realms of scientific reasoning and content generation that adhere to user preferences encounter distinct challenges. In this work, we present a new task for generating fluent and logical descriptions that match user preferences over scientific tabular data, aiming to automate scientific document analysis. To facilitate research in this direction, we construct a new challenging dataset CTRLSciTab consisting of table-description pairs extracted from the scientific literature, with highlighted cells and corresponding domain-specific knowledge base. We evaluated popular pre-trained language models to establish a baseline and proposed a novel architecture outperforming competing approaches. The results showed that large models struggle to produce accurate content that aligns with user preferences. As the first of its kind, our work should motivate further research in scientific domains.


title: Public policy for management of forest pests within an ownership mosaic

abstract: The benefits of investments in sustainability are often public goods that accrue at broad scales and to many people. Urban forests exemplify this; trees supply ecosystem service benefits from local (in the case of shade) to global (in the case of carbon sequestration) scales. The complex mosaic of public and private ownership that typically defines an urban forest makes the public goods problem of investing in forest sustainability especially acute. This results in incentives for private tree owners to invest in tree care that typically fall short of those of a public forest manager aiming for the social optimum. The management of a forest pest, such as emerald ash borer, provides a salient focus area because pests threaten the provision of public goods from urban forests and pest management generates feedback that alters pest spread and shapes future risks. We study how managers can design policies to address forest pest outbreaks and achieve uniform management across a mosaic of ownership types. We develop a game theoretic model to derive optimal subsidies for the treatment of forests pests and evaluate the efficacy of these policies in mitigating the spread of forest pests with a dynamic epidemiological model. Our results suggest that a combination of optimal treatment subsidies for privately owned trees and targeted treatment of public trees can be far more effective at reducing pest-induced tree mortality than either approach in isolation. While we focus on the management of urban forests, designing programs that align private and public incentives for investment in public goods could advance sustainability in a wide range of systems.


title: Disentangled Latent Representation Learning for Tackling the Confounding M-Bias Problem in Causal Inference

abstract: In causal inference, it is a fundamental task to estimate the causal effect from observational data. However, latent confounders pose major challenges in causal inference in observational data, for example, confounding bias and M-bias. Recent data-driven causal effect estimators tackle the confounding bias problem via balanced representation learning, but assume no M-bias in the system, thus they fail to handle the M-bias. In this paper, we identify a challenging and unsolved problem caused by a variable that leads to confounding bias and M-bias simultaneously. To address this problem with co-occurring M-bias and confounding bias, we propose a novel Disentangled Latent Representation learning framework for learning latent representations from proxy variables for unbiased Causal effect Estimation (DLRCE) from observational data. Specifically, DLRCE learns three sets of latent representations from the measured proxy variables to adjust for the confounding bias and M-bias. Extensive experiments on both synthetic and three real-world datasets demonstrate that DLRCE significantly outperforms the state-of-the-art estimators in the case of the presence of both confounding bias and M-bias.


title: Guaranteed Trust Region Optimization via Two-Phase KL Penalization

abstract: On-policy reinforcement learning (RL) has become a popular framework for solving sequential decision problems due to its computational efficiency and theoretical simplicity. Some on-policy methods guarantee every policy update is constrained to a trust region relative to the prior policy to ensure training stability. These methods often require computationally intensive non-linear optimization or require a particular form of action distribution. In this work, we show that applying KL penalization alone is nearly sufficient to enforce such trust regions. Then, we show that introducing a "fixup" phase is sufficient to guarantee a trust region is enforced on every policy update while adding fewer than 5% additional gradient steps in practice. The resulting algorithm, which we call FixPO, is able to train a variety of policy architectures and action spaces, is easy to implement, and produces results competitive with other trust region methods.


title: Active oscillator: recurrence relation approach

abstract: The present work analyzes stationary distributions of active Brownian particles in a harmonic trap. Generally, obtaining stationary distributions for this system is non-trivial, and up to date no exact expressions are available. In this work, we develop and explore a method based on a transformation of the Fokker-Planck equation into a recurrence relation for generating moments of a distribution. The method, therefore, offers an analytically tractable approach, an alternative to numerical simulations, in a situation where more direct analytical approaches fail. Although the current work focuses on the active Brownian particle model, the method is general and valid for any type of active dynamics and any system dimension.


title: Active Learning Guided Federated Online Adaptation: Applications in Medical Image Segmentation

abstract: Data privacy, storage, and distribution shifts are major bottlenecks in medical image analysis. Data cannot be shared across patients, physicians, and facilities due to privacy concerns, usually requiring each patient's data to be analyzed in a discreet setting at a near real-time pace. However, one would like to take advantage of the accumulated knowledge across healthcare facilities as the computational systems analyze data of more and more patients while incorporating feedback provided by physicians to improve accuracy. Motivated by these, we propose a method for medical image segmentation that adapts to each incoming data batch (online adaptation), incorporates physician feedback through active learning, and assimilates knowledge across facilities in a federated setup. Combining an online adaptation scheme at test time with an efficient sampling strategy with budgeted annotation helps bridge the gap between the source and the incoming stream of target domain data. A federated setup allows collaborative aggregation of knowledge across distinct distributed models without needing to share the data across different models. This facilitates the improvement of performance over time by accumulating knowledge across users. Towards achieving these goals, we propose a computationally amicable, privacy-preserving image segmentation technique \textbf{DrFRODA} that uses federated learning to adapt the model in an online manner with feedback from doctors in the loop. Our experiments on publicly available datasets show that the proposed distributed active learning-based online adaptation method outperforms unsupervised online adaptation methods and shows competitive results with offline active learning-based adaptation methods.


title: FINKER: Frequency Identification through Nonparametric KErnel Regression in astronomical time series

abstract: Optimal frequency identification in astronomical datasets is crucial for variable star studies, exoplanet detection, and asteroseismology. Traditional period-finding methods often rely on specific parametric assumptions, employ binning procedures, or overlook the regression nature of the problem, limiting their applicability and precision. We aim to introduce a universal, nonparametric kernel regression method for optimal frequency determination that is generalizable, efficient, and robust across various astronomical data types. FINKER uses nonparametric kernel regression on folded datasets at different frequencies, selecting the optimal frequency by minimizing squared residuals. This technique inherently incorporates a weighting system that accounts for measurement uncertainties and facilitates multiband data analysis. We evaluate our method's performance across a range of frequencies pertinent to diverse data types and compare it with an established period-finding algorithm, conditional entropy. The method demonstrates superior performance in accuracy and robustness compared to existing algorithms, requiring fewer observations to identify significant frequencies reliably. It exhibits resilience against noise and adapts well to datasets with varying complexity.


title: Large-scale Training of Foundation Models for Wearable Biosignals

abstract: Tracking biosignals is crucial for monitoring wellness and preempting the development of severe medical conditions. Today, wearable devices can conveniently record various biosignals, creating the opportunity to monitor health status without disruption to one's daily routine. Despite widespread use of wearable devices and existing digital biomarkers, the absence of curated data with annotated medical labels hinders the development of new biomarkers to measure common health conditions. In fact, medical datasets are usually small in comparison to other domains, which is an obstacle for developing neural network models for biosignals. To address this challenge, we have employed self-supervised learning using the unlabeled sensor data collected under informed consent from the large longitudinal Apple Heart and Movement Study (AHMS) to train foundation models for two common biosignals: photoplethysmography (PPG) and electrocardiogram (ECG) recorded on Apple Watch. We curated PPG and ECG datasets from AHMS that include data from ~141K participants spanning ~3 years. Our self-supervised learning framework includes participant level positive pair selection, stochastic augmentation module and a regularized contrastive loss optimized with momentum training, and generalizes well to both PPG and ECG modalities. We show that the pre-trained foundation models readily encode information regarding participants' demographics and health conditions. To the best of our knowledge, this is the first study that builds foundation models using large-scale PPG and ECG data collected via wearable consumer devices $\unicode{x2013}$ prior works have commonly used smaller-size datasets collected in clinical and experimental settings. We believe PPG and ECG foundation models can enhance future wearable devices by reducing the reliance on labeled data and hold the potential to help the users improve their health.


title: Rethinking materials simulations: Blending direct numerical simulations with neural operators

abstract: Direct numerical simulations (DNS) are accurate but computationally expensive for predicting materials evolution across timescales, due to the complexity of the underlying evolution equations, the nature of multiscale spatio-temporal interactions, and the need to reach long-time integration. We develop a new method that blends numerical solvers with neural operators to accelerate such simulations. This methodology is based on the integration of a community numerical solver with a U-Net neural operator, enhanced by a temporal-conditioning mechanism that enables accurate extrapolation and efficient time-to-solution predictions of the dynamics. We demonstrate the effectiveness of this framework on simulations of microstructure evolution during physical vapor deposition modeled via the phase-field method. Such simulations exhibit high spatial gradients due to the co-evolution of different material phases with simultaneous slow and fast materials dynamics. We establish accurate extrapolation of the coupled solver with up to 16.5$\times$ speed-up compared to DNS. This methodology is generalizable to a broad range of evolutionary models, from solid mechanics, to fluid dynamics, geophysics, climate, and more.