title: APO & SMARTS flare star campaign observations I. Blue wing asymmetries in chromospheric lines during mid M dwarf flares from simultaneous spectroscopic and photometric observation data

abstract: We conducted the time-resolved simultaneous optical spectroscopic and photometric observations of mid M dwarf flare stars YZ CMi, EV Lac, and AD Leo. Spectroscopic observations were obtained using Apache Point Observatory 3.5m and Small \& Moderate Aperture Research Telescope System 1.5m telescopes during 31 nights. Among the 41 detected flares, seven flares showed clear blue wing asymmetries in the H$\alpha$ line, with various correspondences in flare properties. The duration of the blue wing asymmetries range from 20 min to 2.5 hours, including a flare showing the shift from blue to red wing asymmetry. Blue wing asymmetries can be observed during both white-light and candidate non white-light flares. All of the seven flares showed blue wing asymmetries also in the H$\beta$ line, but there are large varieties on which other chromospheric lines showed blue wing asymmetries. One among the 7 flares was also observed with soft X-ray spectroscopy, which enabled us to estimate the flare magnetic field and length of the flare loop. The line-of-sight velocities of the blue-shifted components range from -73 to -122 km s$^{-1}$. Assuming that the blue-shifts were caused by prominence eruptions, the mass of upward moving plasma was estimated to be 10$^{15}$ -- 10$^{19}$ g, which are roughly on the relation between flare energy and erupting mass expected from solar coronal mass ejections (CMEs). Although further investigations are necessary for understanding the observed various properties, these possible prominence eruptions on M-dwarfs could evolve into CMEs, assuming the similar acceleration mechanism with solar eruptions.


title: Backdoor Adjustment of Confounding by Provenance for Robust Text Classification of Multi-institutional Clinical Notes

abstract: Natural Language Processing (NLP) methods have been broadly applied to clinical tasks. Machine learning and deep learning approaches have been used to improve the performance of clinical NLP. However, these approaches require sufficiently large datasets for training, and trained models have been shown to transfer poorly across sites. These issues have led to the promotion of data collection and integration across different institutions for accurate and portable models. However, this can introduce a form of bias called confounding by provenance. When source-specific data distributions differ at deployment, this may harm model performance. To address this issue, we evaluate the utility of backdoor adjustment for text classification in a multi-site dataset of clinical notes annotated for mentions of substance abuse. Using an evaluation framework devised to measure robustness to distributional shifts, we assess the utility of backdoor adjustment. Our results indicate that backdoor adjustment can effectively mitigate for confounding shift.


title: Extended habitability of exoplanets due to subglacial water

abstract: Considering subglacial liquid water, a significant extension of the classical Habitable Zone is obtained. Elaborating on the model of Wandel (2023) it is shown how an atmosphere and liquid water could survive on tidally locked planets closely orbiting an M-dwarf host, extending the Habitable Zone boundary inwards. In addition, subglacial liquid water could extend the Habitable Zone beyond the outer boundary of the conservative Habitable Zone as well. These two results enhance the circumstellar region with a potential for liquid water well beyond the conservative boundaries of the classical Habitable Zone. It is argued that the probable recent JWST detection of atmospheric water vapor on the rocky Earth-sized exoplanet GJ 486 b, along with earlier detections of water on other planets orbiting M-dwarf stars gives an empirical answer to the much-argued question, of whether such planets can support liquid water, organic chemistry and eventually life. It is shown how water on terrestrial planets closely orbiting M-dwarf stars may sustain in a subglacial melting layer. Finally, the model is applied to a few exoplanets demonstrating how water detection may constrain their atmospheric properties.


title: Dual-stage Flows-based Generative Modeling for Traceable Urban Planning

abstract: Urban planning, which aims to design feasible land-use configurations for target areas, has become increasingly essential due to the high-speed urbanization process in the modern era. However, the traditional urban planning conducted by human designers can be a complex and onerous task. Thanks to the advancement of deep learning algorithms, researchers have started to develop automated planning techniques. While these models have exhibited promising results, they still grapple with a couple of unresolved limitations: 1) Ignoring the relationship between urban functional zones and configurations and failing to capture the relationship among different functional zones. 2) Less interpretable and stable generation process. To overcome these limitations, we propose a novel generative framework based on normalizing flows, namely Dual-stage Urban Flows (DSUF) framework. Specifically, the first stage is to utilize zone-level urban planning flows to generate urban functional zones based on given surrounding contexts and human guidance. Then we employ an Information Fusion Module to capture the relationship among functional zones and fuse the information of different aspects. The second stage is to use configuration-level urban planning flows to obtain land-use configurations derived from fused information. We design several experiments to indicate that our framework can outperform compared to other generative models for the urban planning task.


title: Consistent Dimer Models on Surfaces with Boundary

abstract: A dimer model is a quiver with faces embedded in a surface. We define and investigate notions of consistency for dimer models on general surfaces with boundary which restrict to well-studied consistency conditions in the disk and torus case. We define weak consistency in terms of the associated dimer algebra and show that it is equivalent to the absence of bad configurations on the strand diagram. In the disk and torus case, weakly consistent models are nondegenerate, meaning that every arrow is contained in a perfect matching; this is not true for general surfaces. Strong consistency is defined to require weak consistency as well as nondegeneracy. We prove that the completed dimer algebra of a weakly consistent dimer model as well as the noncompleted dimer algebra of a strongly consistent dimer model are bimodule internally 3-Calabi-Yau with respect to their boundary idempotents. As a consequence, the Gorenstein-projective module category of the completed boundary algebra of suitable dimer models categorifies the cluster algebra given by their underlying quiver. We provide additional consequences of weak and strong consistency, including that one may reduce a strongly consistent dimer model by removing digon-faces and that consistency behaves well under taking dimer submodels.


title: Multistationarity questions in reduced vs extended biochemical networks

abstract: We address several questions in reduced versus extended networks via the elimination or addition of intermediate complexes in the framework of chemical reaction networks with mass-action kinetics. We clarify and extend advances in the literature concerning multistationarity in this context. We establish general results about MESSI systems, which we use to compute the circuits of multistationarity for significant biochemical networks.


title: Learning Optimal Advantage from Preferences and Mistaking it for Reward

abstract: We consider algorithms for learning reward functions from human preferences over pairs of trajectory segments, as used in reinforcement learning from human feedback (RLHF). Most recent work assumes that human preferences are generated based only upon the reward accrued within those segments, or their partial return. Recent work casts doubt on the validity of this assumption, proposing an alternative preference model based upon regret. We investigate the consequences of assuming preferences are based upon partial return when they actually arise from regret. We argue that the learned function is an approximation of the optimal advantage function, $\hat{A^*_r}$, not a reward function. We find that if a specific pitfall is addressed, this incorrect assumption is not particularly harmful, resulting in a highly shaped reward function. Nonetheless, this incorrect usage of $\hat{A^*_r}$ is less desirable than the appropriate and simpler approach of greedy maximization of $\hat{A^*_r}$. From the perspective of the regret preference model, we also provide a clearer interpretation of fine tuning contemporary large language models with RLHF. This paper overall provides insight regarding why learning under the partial return preference model tends to work so well in practice, despite it conforming poorly to how humans give preferences.


title: The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising "Alignment" in Large Language Models

abstract: In this paper, we address the concept of "alignment" in large language models (LLMs) through the lens of post-structuralist socio-political theory, specifically examining its parallels to empty signifiers. To establish a shared vocabulary around how abstract concepts of alignment are operationalised in empirical datasets, we propose a framework that demarcates: 1) which dimensions of model behaviour are considered important, then 2) how meanings and definitions are ascribed to these dimensions, and by whom. We situate existing empirical literature and provide guidance on deciding which paradigm to follow. Through this framework, we aim to foster a culture of transparency and critical evaluation, aiding the community in navigating the complexities of aligning LLMs with human populations.


title: Cuspidality criterion for symmetric powers of automorphic representations of GL(2) over function fields

abstract: Given a cuspidal automorphic representation of GL(2) over a global function field, we establish a comprehensive cuspidality criterion for symmetric powers. The proof is via passage to the Galois side, possible over function fields thanks to the Langlands correspondence of L. Lafforgue and additional results of G. Henniart and B. Lemaire. Our work is guided by the number fields results of Kim-Shahidi and Ramakrishnan.


title: Distributionally Safe Reinforcement Learning under Model Uncertainty: A Single-Level Approach by Differentiable Convex Programming

abstract: Safety assurance is uncompromisable for safety-critical environments with the presence of drastic model uncertainties (e.g., distributional shift), especially with humans in the loop. However, incorporating uncertainty in safe learning will naturally lead to a bi-level problem, where at the lower level the (worst-case) safety constraint is evaluated within the uncertainty ambiguity set. In this paper, we present a tractable distributionally safe reinforcement learning framework to enforce safety under a distributional shift measured by a Wasserstein metric. To improve the tractability, we first use duality theory to transform the lower-level optimization from infinite-dimensional probability space where distributional shift is measured, to a finite-dimensional parametric space. Moreover, by differentiable convex programming, the bi-level safe learning problem is further reduced to a single-level one with two sequential computationally efficient modules: a convex quadratic program to guarantee safety followed by a projected gradient ascent to simultaneously find the worst-case uncertainty. This end-to-end differentiable framework with safety constraints, to the best of our knowledge, is the first tractable single-level solution to address distributional safety. We test our approach on first and second-order systems with varying complexities and compare our results with the uncertainty-agnostic policies, where our approach demonstrates a significant improvement on safety guarantees.


title: Chain trajectories, domain shapes and terminal boundaries in block copolymers

abstract: The packing geometry of macromolecules in complex mesophases is of key importance to self-organization in synthetic and biological soft materials. While approximate or heuristic models rely on often-untested assumptions about how flexible molecules "fit in" to distinct locations of complex assemblies, physical assemblies derive from ensembles of fluctuating conformations, obscuring the connection between mesophase geometry and the underlying arrangements. Here, we present an approach to extract and analyze features of molecular packing in diblock block copolymer (BCP) melts, a prototypical soft matter system, based on the statistical description of chain conformations in self-consistent field (SCF) theory. We show how average BCP chain trajectories in ordered morphologies can be analyzed from the SCF-derived orientational order parameter of chain segments. We use these extracted trajectories to analyze the features of local packing geometry, including chain bending and tilt, as well as the terminal boundaries that delineate distinct domains in ordered BCP morphologies. We illustrate this analysis by focusing on measurable features of packing frustration in 2D (columnar) and 3D (spherical and bicontinuous) morphologies, notably establishing an explicit link between chain conformations in complex morphologies and their medial geometry.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech physics.chem-ph


title: Optimization-based frequentist confidence intervals for functionals in constrained inverse problems: Resolving the Burrus conjecture

abstract: We present an optimization-based framework to construct confidence intervals for functionals in constrained inverse problems, ensuring valid one-at-a-time frequentist coverage guarantees. Our approach builds upon the now-called strict bounds intervals, originally pioneered by Burrus (1965) and Rust and Burrus (1972), which offer ways to directly incorporate any side information about the parameters during inference without introducing external biases. This family of methods allows for uncertainty quantification in ill-posed inverse problems without needing to select a regularizing prior. By tying optimization-based intervals to an inversion of a constrained likelihood ratio test, we translate interval coverage guarantees into type I error control and characterize the resulting interval via solutions to optimization problems. Along the way, we refute the Burrus conjecture, which posited that, for possibly rank-deficient linear Gaussian models with positivity constraints, a correction based on the quantile of the chi-squared distribution with one degree of freedom suffices to shorten intervals while maintaining frequentist coverage guarantees. Our framework provides a novel approach to analyzing the conjecture, and we construct a counterexample employing a stochastic dominance argument, which we also use to disprove a general form of the conjecture. We illustrate our framework with several numerical examples and provide directions for extensions beyond the Rust-Burrus method for nonlinear, non-Gaussian settings with general constraints.


title: Improved Inference of Human Intent by Combining Plan Recognition and Language Feedback

abstract: Conversational assistive robots can aid people, especially those with cognitive impairments, to accomplish various tasks such as cooking meals, performing exercises, or operating machines. However, to interact with people effectively, robots must recognize human plans and goals from noisy observations of human actions, even when the user acts sub-optimally. Previous works on Plan and Goal Recognition (PGR) as planning have used hierarchical task networks (HTN) to model the actor/human. However, these techniques are insufficient as they do not have user engagement via natural modes of interaction such as language. Moreover, they have no mechanisms to let users, especially those with cognitive impairments, know of a deviation from their original plan or about any sub-optimal actions taken towards their goal. We propose a novel framework for plan and goal recognition in partially observable domains -- Dialogue for Goal Recognition (D4GR) enabling a robot to rectify its belief in human progress by asking clarification questions about noisy sensor data and sub-optimal human actions. We evaluate the performance of D4GR over two simulated domains -- kitchen and blocks domain. With language feedback and the world state information in a hierarchical task model, we show that D4GR framework for the highest sensor noise performs 1% better than HTN in goal accuracy in both domains. For plan accuracy, D4GR outperforms by 4% in the kitchen domain and 2% in the blocks domain in comparison to HTN. The ALWAYS-ASK oracle outperforms our policy by 3% in goal recognition and 7%in plan recognition. D4GR does so by asking 68% fewer questions than an oracle baseline. We also demonstrate a real-world robot scenario in the kitchen domain, validating the improved plan and goal recognition of D4GR in a realistic setting.


title: Effects of Ionic Strength on the Morphology, Scattering, and Mechanical Response of Neurofilament-Derived Protein Brushes

abstract: Protein brushes not only play a key role in the functionality of neurofilaments but also have wide applications in biomedical materials. Here, we investigate the effect of ionic strength on the morphology of protein brushes using a continuous-space self-consistent field theory. A coarse-grained multi-block charged macromolecular model is developed to capture the chemical identity of amino acid sequences. For neurofilament heavy (NFH) brushes at pH 2.4, we predict three morphological regimes: swollen brushes, condensed brushes, and coexisting brushes which consist of both a dense inner layer and a diffuse outer layer. The brush height predicted by our theory is in good agreement with experimental data for a wide range of ionic strengths. The dramatic height decrease is a result of the electrostatic screening-induced transition from the overlapping state to the isolated state of the coexisting brushes. We also study the evolution of the scattering and mechanical responses accompanying the morphological change. The oscillation in the reflectivity spectra characterizes the existence and microstructure of the inner condensed layer, whereas the shoulder in the force spectra signifies the swollen morphology.


title: Anisotropies in the spatial distribution and kinematics of dwarf galaxies in the Local Group and beyond

abstract: The Local Group (LG) of galaxies is dominated by the M31 and Milky Way (MW) pair, a configuration which suggests that the mass distribution in the LG and its surroundings should be highly anisotropic. We use the APOSTLE cosmological simulations to examine how this anisotropy manifests on the spatial distribution and kinematics of dwarf galaxies out to a distance of 3 Mpc from the MW. The simulations indicate a clear preference for dwarfs to be located close to the axis defined by the MW-M31 direction, even for dwarfs in the LG periphery (LGP; i.e., those at distances 1.25<d/Mpc<3). The LGP "Hubble flow" is also affected; at fixed distance from the MW the mean recession speed, <V_{rad} >, varies with angular distance to M31, peaking in the anti-M31 direction and reaching a minimum behind M31. The combined M31-MW mass decelerates the local expansion; the LG "turnaround radius" (where <V_{rad}>=0) in APOSTLE is located at r ~ 1.25 Mpc from the LG barycentre and the pure Hubble flow (where <V_{rad}> ~ H_0*d) is not reached out to at least 3 Mpc. The predicted flow is very cold, with a barycentric dispersion of <40 km/s. A comparison of these predicted features with existing observations gives mixed results. There is clear observational evidence for an angular anisotropy in V_{rad} around the LGP, but little evidence for a preferred spatial distribution of LGP dwarfs along the MW-M31 axis. The observed local Hubble flow is also peculiar. Although the coldness of the flow is consistent with the simulations, it is significantly less decelerated: relative to the MW, on average, all galaxies beyond d~1.25 Mpc seem to be on a pure Hubble flow. We argue that these oddities may result from incompleteness and inhomogeneous sky coverage, but a full explanation may need to await the completion of deep all-sky surveys able to fill the gaps in our current inventory of nearby dwarfs.


title: Disk Cooling and Wind Lines As Seen In the Spectral Line Evolution of V960 Mon

abstract: We follow up our photometric study of the post-outburst evolution of the FU Ori object V960 Mon with a complementary spectroscopic study at high dispersion that uses time series spectra from Keck/HIRES. Consistent with the photometric results reported in Carvalho et al. 2023, we find that the spectral evolution of V960 Mon corresponds to a decrease in the temperature of the inner disk, driven by a combination of decreasing accretion rate and increasing inner disk radius. We also find that although the majority of the absorption lines are well-matched by our accretion disk model spectrum, there are several strong absorption line families and a few emission lines that are not captured by the model. By subtracting the accretion disk model from the data at each epoch, we isolate the wind/outflow components of the system. The residuals show both broad and highly blueshifted profiles, as well as narrow and only slightly blueshifted profiles, with some lines displaying both types of features.


title: Parameterized Model-checking of Discrete-Timed Networks and Symmetric-Broadcast Systems

abstract: We study the complexity of the model-checking problem for discrete-timed systems with arbitrarily many anonymous and identical contributors, with and without a distinguished "controller" process, communicating via synchronous rendezvous. Our work extends the seminal work on untimed systems by German and Sistla adding discrete-time clocks, thus allowing one to model more realistic protocols. For the case without a controller, we show that the systems can be efficiently simulated -- and vice versa -- by systems of untimed processes communicating via rendezvous and symmetric broadcast, which we call "RB-systems". Symmetric broadcast is a novel communication primitive that, like ordinary asymmetric broadcast, allows all processes to synchronize without distinction between sender/receiver processes. We show that the complexity of the parameterized model-checking problem for safety specifications is pspace-complete, and for liveness specifications it is decidable in exptime. The latter result required automata theory, rational linear programming, and geometric reasoning for solving certain reachability questions in a new variant of vector addition systems called "vector rendezvous systems". We believe such proof techniques are of independent interest and will be useful in solving related problems. For the case with a controller, we show that the parameterized model-checking problems for RB-systems and systems with asymmetric broadcast are inter-reducible. This implies that for discrete timed-networks with a controller the parameterized model-checking problem is undecidable for liveness specifications. Our work exploits the intimate connection between discrete-timed systems and systems of processes communicating via broadcast. This allows us to prove decidability results for liveness properties of parameterized timed-systems, as well as extend work from untimed systems to timed systems.


title: Dual-Polarization Phase Retrieval Receiver in Silicon Photonics

abstract: We demonstrate a silicon photonic dual-polarization phase retrieval receiver. The receiver recovers phase from intensity-only measurements without a local oscillator or transmitted carrier. We design silicon waveguides providing long delays and microring resonators with large dispersion to enable symbol-to-symbol interference and dispersive projection in the phase retrieval algorithm. We retrieve the full field of a polarization-division multiplexed 30-GBd QPSK and 20-GBd 8QAM signals over 80 km of SSMF.


title: Study of the long-term Very High Energy emission of the blazars 1ES 1215+3031 and VER J0521+211 with the HAWC gamma-ray observatory

abstract: Blazars are the most abundant type of extragalactic gamma-ray source, usually presenting high variability across the electromagnetic spectrum. Their Very High Energy (VHE, above 0.1 TeV) emission has been studied in detail using Air Cherenkov Telescopes, with observations biased to flaring periods while their average activity has not been properly characterized. In this work, we report the results of 2090 days of quasi-continuous observations of the blazars 1ES 1215+303 and VER J0521+211, carried out with the High Altitude Water Cherenkov (HAWC) gamma-ray observatory. Fitting a power-law attenuated by photon-photon interaction with the extragalactic background light, we obtained a 6.2 $\sigma$ level detection for 1ES 1215+303 and a 4.3 $\sigma$ marginal detection for VER J0521+211. With the inclusion of the HAWC TeV spectrum, we built quasi-simultaneous multiwavelength spectral distributions and fitted a leptonic emission model to the observed data.


title: Large Language Models Can Be Good Privacy Protection Learners

abstract: The proliferation of Large Language Models (LLMs) has driven considerable interest in fine-tuning them with domain-specific data to create specialized language models. Nevertheless, such domain-specific fine-tuning data often contains sensitive personally identifiable information (PII). Direct fine-tuning LLMs on this data without privacy protection poses a risk of leakage. To address this challenge, we introduce Privacy Protection Language Models (PPLM), a novel paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding data privacy. Our work offers a theoretical analysis for model design and delves into various techniques such as corpus curation, penalty-based unlikelihood in training loss, and instruction-based tuning, etc. Extensive experiments across diverse datasets and scenarios demonstrate the effectiveness of our approaches. In particular, instruction tuning with both positive and negative examples, stands out as a promising method, effectively protecting private data while enhancing the model's knowledge. Our work underscores the potential for Large Language Models as robust privacy protection learners.


title: SGORP: A Subgradient-based Method for d-Dimensional Rectilinear Partitioning

abstract: Partitioning for load balancing is a crucial first step to parallelize any type of computation. In this work, we propose SGORP, a new spatial partitioning method based on Subgradient Optimization, to solve the $d$-dimensional Rectilinear Partitioning Problem (RPP). Our proposed method allows the use of customizable objective functions as well as some user-specific constraints, such as symmetric partitioning on selected dimensions. Extensive experimental evaluation using over 600 test matrices shows that our algorithm achieves favorable performance against the state-of-the-art RPP and Symmetric RPP algorithms. Additionally, we show the effectiveness of our algorithm to do application-specific load balancing using two applications as motivation: Triangle Counting and Sparse Matrix Multiplication (SpGEMM), where we model their load-balancing problems as $3$-dimensional RPPs.


title: Flat hypercomplex nilmanifolds are H-solvable

abstract: We say that a hypercomplex nilpotent Lie algebra is $\mathbb{H}$-solvable if there exists a sequence of $\mathbb{H}$-invariant subalgebras $\mathfrak{g}_1^{ \mathbb{H}}\supset\mathfrak{g}_2^{ \mathbb{H}}\supset\cdots\supset\mathfrak{g}_{k-1}^{ \mathbb{H}}\supset\mathfrak{g}_k^{ \mathbb{H}}=0,$ such that $[\mathfrak{g}_i^{ \mathbb{H}},\mathfrak{g}_i^{ \mathbb{H}}]\subset\mathfrak{g}^{ \mathbb{H}}_{i+1}.$ Let $N=\Gamma\backslash G$ be a hypercomplex nilmanifold with flat Obata connection and $\mathfrak{g}=Lie(G)$. We prove that the Lie algebra $\mathfrak{g}$ is $ \mathbb{H}$-solvable.


title: Finite-N corrections to dynamical Lorentz symmetry breaking

abstract: A model of $N$ 4-component massless fermions in a quartic self-interaction based on the ref. [18] is investigated in the presence of chemical potential and temperature via optimized perturbation theory that accesses finite-N contributions. We use the generating functional approach to calculate the corrections at one-loop to the effective potential of the model. The model introduces an auxiliary vector field that breaks the Lorentz symmetry in the presence of a temperature $(T)$, and of a chemical potential $(\mu)$. These thermodynamics quantities are introduced through the Matsubara formalism. Thereby, the one-loop integrals are modified and via the principle of minimum sensitivity, we obtain the gap equations of the model. The correspondent solutions of these equations define the vacuum states of the model associated with the background vector field. We discuss the solutions of the four cases in which $(T = 0,\mu = 0)$, $(T \neq 0,\mu \neq 0)$, $(T \neq 0,\mu = 0)$ and $(T = 0,\mu \neq 0)$, where the effective potential is so obtained as a function of the background vector field, the chemical potential, and the temperature. The work demonstrates the persistence of second-order phase transitions in the finite-N improvement made on the finite-$N$ self-interacting fermions.


title: Prompting-based Temporal Domain Generalization

abstract: Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of trained models in future time periods. This paper presents a novel prompting-based approach to temporal domain generalization that is parameter-efficient, time-efficient, and does not require access to future data during training. Our method adapts a trained model to temporal drift by learning global prompts, domain-specific prompts, and drift-aware prompts that capture underlying temporal dynamics. Experiments on classification, regression, and time series forecasting tasks demonstrate the generality of the proposed approach. The code repository will be publicly shared.


title: Smart pixel sensors: towards on-sensor filtering of pixel clusters with deep learning

abstract: Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of O(40MHz) and intelligently reduces the data within the pixelated region of the detector at rate will enhance physics performance at high luminosity and enable physics analyses that are not currently possible. Using the shape of charge clusters deposited in an array of small pixels, the physical properties of the traversing particle can be extracted with locally customized neural networks. In this first demonstration, we present a neural network that can be embedded into the on-sensor readout and filter out hits from low momentum tracks, reducing the detector's data volume by 54.4-75.4%. The network is designed and simulated as a custom readout integrated circuit with 28 nm CMOS technology and is expected to operate at less than 300 $\mu W$ with an area of less than 0.2 mm$^2$. The temporal development of charge clusters is investigated to demonstrate possible future performance gains, and there is also a discussion of future algorithmic and technological improvements that could enhance efficiency, data reduction, and power per area.


title: Estimating viscoelastic, soft material properties using a modified Rayleigh cavitation bubble collapse time

abstract: Accurate determination of high strain rate (> 10^3 1/s) constitutive properties of soft materials remains a formidable challenge. Albeit recent advancements among experimental techniques, in particular inertial microcavitation rheometry (IMR), the intrinsic requirement to visualize the bubble cavitation dynamics has limited its application to nominally transparent materials. Here, in an effort to address this challenge and to expand the experimental capability of IMR to optically opaque materials, we investigated whether one could use the acoustic signature of the time interval between bubble nucleation and collapse, characterized as the bubble collapse time, to infer the viscoelastic material properties without being able to image the bubble directly in the tissue. By introducing a modified Rayleigh collapse time for soft materials, which is strongly dependent on the stiffness of the material at hand, we show that, in principle, one can obtain an order of magnitude or better estimate of the viscoelastic material properties of the soft material under investigation. Using a newly developed energy-based theoretical framework, we show that for materials stiffer than 10 kPa the bubble collapse time during a single bubble cavitation event can provide quantitative and meaningful information about the constitutive properties of the material at hand. For very soft materials (i.e., shear modulus less than 10 kPa) our theory shows that unless the collapse time measurement has very high precision and low uncertainties, the material property estimates based on the bubble collapse time only will not be accurate and require visual resolution of the full cavitation kinematics.


title: ML4EJ: Decoding the Role of Urban Features in Shaping Environmental Injustice Using Interpretable Machine Learning

abstract: Understanding the key factors shaping environmental hazard exposures and their associated environmental injustice issues is vital for formulating equitable policy measures. Traditional perspectives on environmental injustice have primarily focused on the socioeconomic dimensions, often overlooking the influence of heterogeneous urban characteristics. This limited view may obstruct a comprehensive understanding of the complex nature of environmental justice and its relationship with urban design features. To address this gap, this study creates an interpretable machine learning model to examine the effects of various urban features and their non-linear interactions to the exposure disparities of three primary hazards: air pollution, urban heat, and flooding. The analysis trains and tests models with data from six metropolitan counties in the United States using Random Forest and XGBoost. The performance is used to measure the extent to which variations of urban features shape disparities in environmental hazard levels. In addition, the analysis of feature importance reveals features related to social-demographic characteristics as the most prominent urban features that shape hazard extent. Features related to infrastructure distribution and land cover are relatively important for urban heat and air pollution exposure respectively. Moreover, we evaluate the models' transferability across different regions and hazards. The results highlight limited transferability, underscoring the intricate differences among hazards and regions and the way in which urban features shape hazard exposures. The insights gleaned from this study offer fresh perspectives on the relationship among urban features and their interplay with environmental hazard exposure disparities, informing the development of more integrated urban design policies to enhance social equity and environmental injustice issues.


title: Human-Like Autonomous Driving on Dense Traffic

abstract: This paper proposes a imitation learning model for autonomous driving on highway traffic by mimicking human drivers' driving behaviours. The study utilizes the HighD traffic dataset, which is complex, high-dimensional, and diverse in vehicle variations. Imitation learning is an alternative solution to autonomous highway driving that reduces the sample complexity of learning a challenging task compared to reinforcement learning. However, imitation learning has limitations such as vulnerability to compounding errors in unseen states, poor generalization, and inability to predict outlier driver profiles. To address these issues, the paper proposes mixture density network behaviour cloning model to manage complex and non-linear relationships between inputs and outputs and make more informed decisions about the vehicle's actions. Additional improvement is using collision penalty based on the GAIL model. The paper includes a simulated driving test to demonstrate the effectiveness of the proposed method based on real traffic scenarios and provides conclusions on its potential impact on autonomous driving.


title: A Bakry-\'Emery approach to Lipschitz transportation on manifolds

abstract: On weighted Riemannian manifolds we prove the existence of globally Lipschitz transport maps between the weight (probability) measure and log-Lipschitz perturbations of it, via Kim and Milman's diffusion transport map, assuming that the curvature-dimension condition $\mathrm{CD}(\rho_{1}, \infty)$ holds, as well as a second order version of it, namely $\Gamma_{3} \geq \rho_{2} \Gamma_{2}$. We get new results as corollaries to this result, as the preservation of Poincar\'e's inequality for the exponential measure on $(0,+\infty)$ when perturbed by a log-Lipschitz potential and a new growth estimate for the Monge map pushing forward the gamma distribution on $(0,+\infty)$ (then getting as a particular case the exponential one), via Laguerre's generator.


title: Addressing Quantum's "Fine Print": State Preparation and Information Extraction for Quantum Algorithms and Geologic Fracture Networks

abstract: Quantum algorithms provide an exponential speedup for solving certain classes of linear systems, including those that model geologic fracture flow. However, this revolutionary gain in efficiency does not come without difficulty. Quantum algorithms require that problems satisfy not only algorithm-specific constraints, but also application-specific ones. Otherwise, the quantum advantage carefully attained through algorithmic ingenuity can be entirely negated. Previous work addressing quantum algorithms for geologic fracture flow has illustrated core algorithmic approaches while incrementally removing assumptions. This work addresses two further requirements for solving geologic fracture flow systems with quantum algorithms: efficient system state preparation and efficient information extraction. Our approach to addressing each is consistent with an overall exponential speed-up.


title: Splitting the Difference on Adversarial Training

abstract: The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the expense of a degraded natural accuracy. Most adversarial training methods aim to learn a model that finds, for each class, a common decision boundary encompassing both the clean and perturbed examples. In this work, we take a fundamentally different approach by treating the perturbed examples of each class as a separate class to be learned, effectively splitting each class into two classes: "clean" and "adversarial." This split doubles the number of classes to be learned, but at the same time considerably simplifies the decision boundaries. We provide a theoretical plausibility argument that sheds some light on the conditions under which our approach can be expected to be beneficial. Likewise, we empirically demonstrate that our method learns robust models while attaining optimal or near-optimal natural accuracy, e.g., on CIFAR-10 we obtain near-optimal natural accuracy of $95.01\%$ alongside significant robustness across multiple tasks. The ability to achieve such near-optimal natural accuracy, while maintaining a significant level of robustness, makes our method applicable to real-world applications where natural accuracy is at a premium. As a whole, our main contribution is a general method that confers a significant level of robustness upon classifiers with only minor or negligible degradation of their natural accuracy.


title: The fractional logarithmic Schr\"{o}dinger operator: properties and functional spaces

abstract: In this note, we deal with the fractional Logarithmic Schr\"{o}dinger operator $(I+(-\Delta)^s)^{\log}$ and the corresponding energy spaces for variational study. The fractional (relativistic) Logarithmic Schr\"{o}dinger operator is the pseudo-differential operator with logarithmic Fourier symbol, $\log(1+|\xi|^{2s})$, $s>0$. We first establish the integral representation corresponding to the operator and provide an asymptotics property of the related kernel. We introduce the functional analytic theory allowing to study the operator from a PDE point of view and the associated Dirichlet problems in an open set of $\mathbb{ R}^N.$ We also establish some variational inequalities, provide the fundamental solution and the asymptotics of the corresponding Green function at zero and at infinity.


title: Strengthening the union-closed sets conjecture

abstract: A family of sets $\mathcal{F}$ is union-closed if $X,Y \in \mathcal{F} \implies X \cup Y \in \mathcal{F}$. Let $\mathcal{A} \neq \{\emptyset\}$ be a finite union-closed family of sets. The union-closed sets conjecture, also called Frankl's conjecture, states that there exists an element of $\bigcup_{A \in \mathcal{A}} A $ that appears in at least $\frac{|\mathcal{A}|}{2}$ members of $\mathcal{A}$. Let $\mathcal{A}_B=\{A\in\mathcal{A}|A \cap B = B\}$ and $\mathcal{A}_{\bar{B}}=\{A\in\mathcal{A}|A \cap B = \emptyset\}$ where $B \subseteq \bigcup_{A \in \mathcal{A}}A$. Further, let ${S \choose k}$ be the set of all $k$-element subsets of a set $S$, and $[n]=\{1,2,\cdots,n\}=\bigcup_{A \in \mathcal{A}}A$. The union-closed sets conjecture can then be stated as $\exists B \in {[n] \choose 1}$ $|\mathcal{A}_{B}| \geq |\mathcal{A}_{\bar{B}}|$. With this notation, we introduce the stronger conjecture that $\forall x \in [n]$ $\exists B \in {[n] \choose n+1-x}$ $|\mathcal{A}_B| \geq |\mathcal{A}_{\bar{B}}|$, and we prove the new conjecture for $x \in [\lceil \frac{n}{3} \rceil + 1]$, where $\lceil \frac{n}{3} \rceil$ is the smallest integer greater than or equal to $\frac{n}{3}$. Other related conjectures are investigated.


title: On the braid index of a two-bridge knot

abstract: In this paper, we consider two properties on the braid index of a two-bridge knot. We prove an inequality on the braid indices of two-bridge knots if there exists an epimorphism between their knot groups. Moreover, we provide the average braid index of all two-bridge knots with a given crossing number.


title: An updated survey of Active Galaxies with the HAWC gamma-ray observatory

abstract: We present an update of the survey of Active Galaxies with the High Altitude Water Cherenkov (HAWC) gamma-ray observatory. This work adds 567 days of HAWC data to the previously published survey, providing a refined analysis of an updated total exposure of 2090 days. The sample includes 138 nearby AGNs from the 3FHL catalog. We fit a modified power-law to their very high energy spectra, including the exponential attenuation caused by the Extragalactic Background Light. We found four sources with significant detections (above 5$\sigma$): the radio galaxy M87 and the BL Lac objects Mkn 421, Mkn 501 and 1ES 1215+303. We also report eight sources with a marginal detection (between 3$\sigma$ and 5$\sigma$) of which seven are classified as BL Lac objects and one as a radio galaxy.


title: Computationally Efficient Chance Constrained Covariance Control with Output Feedback

abstract: This paper studies the problem of developing computationally efficient solutions for steering the distribution of the state of a stochastic, linear dynamical system between two boundary Gaussian distributions in the presence of chance-constraints on the state and control input. It is assumed that the state is only partially available through a measurement model corrupted with noise. The filtered state is reconstructed with a Kalman filter, the chance constraints are reformulated as difference of convex (DC) constraints, and the resulting covariance control problem is reformulated as a DC program, which is solved using successive convexification. The efficiency of the proposed method is illustrated on a double integrator example with varying time horizons, and is compared to other state-of-the-art chance constrained covariance control methods.


title: OCU-Net: A Novel U-Net Architecture for Enhanced Oral Cancer Segmentation

abstract: Accurate detection of oral cancer is crucial for improving patient outcomes. However, the field faces two key challenges: the scarcity of deep learning-based image segmentation research specifically targeting oral cancer and the lack of annotated data. Our study proposes OCU-Net, a pioneering U-Net image segmentation architecture exclusively designed to detect oral cancer in hematoxylin and eosin (H&E) stained image datasets. OCU-Net incorporates advanced deep learning modules, such as the Channel and Spatial Attention Fusion (CSAF) module, a novel and innovative feature that emphasizes important channel and spatial areas in H&E images while exploring contextual information. In addition, OCU-Net integrates other innovative components such as Squeeze-and-Excite (SE) attention module, Atrous Spatial Pyramid Pooling (ASPP) module, residual blocks, and multi-scale fusion. The incorporation of these modules showed superior performance for oral cancer segmentation for two datasets used in this research. Furthermore, we effectively utilized the efficient ImageNet pre-trained MobileNet-V2 model as a backbone of our OCU-Net to create OCU-Netm, an enhanced version achieving state-of-the-art results. Comprehensive evaluation demonstrates that OCU-Net and OCU-Netm outperformed existing segmentation methods, highlighting their precision in identifying cancer cells in H&E images from OCDC and ORCA datasets.


title: QGP probes from a dynamical holographic model of AdS/QCD

abstract: In this paper, we employ the gauge/gravity duality to study some features of the quark gluon plasma. For this purpose, we implement a holographic QCD model constructed from an Einstein-Maxwell-Dilaton gravity at finite temperature and finite chemical potential. The model captures both the confinement and deconfinement phases of QCD and we use it to study the effect of temperature and chemical potential on a heavy quark moving through the plasma. We calculate the drag force, Langevin diffusion coefficients and also the jet quenching parameter, and our results align with other holographic QCD models and the experimental data.


title: Machine learning for online sea ice bias correction within global ice-ocean simulations

abstract: In this study we perform online sea ice bias correction within a GFDL global ice-ocean model. For this, we use a convolutional neural network (CNN) which was developed in a previous study (Gregory et al., 2023) for the purpose of predicting sea ice concentration (SIC) data assimilation (DA) increments. An initial implementation of the CNN shows systematic improvements in SIC biases relative to the free-running model, however large summertime errors remain. We show that these residual errors can be significantly improved with a data augmentation approach, in which sequential CNN and DA corrections are applied to a new simulation over the training period. This then provides a new training data set with which to refine the weights of the initial network. We propose that this machine-learned correction scheme could be utilized for generating improved initial conditions, and also for real-time sea ice bias correction within seasonal-to-subseasonal sea ice forecasts.


title: ResidualTransformer: Residual Low-Rank Learning with Weight-Sharing for Transformer Layers

abstract: Memory constraint of always-on devices is one of the major concerns when deploying speech processing models on these devices. While larger models trained with sufficiently large amount of data generally perform better, making them fit in the device memory is a demanding challenge. In this paper, we aim to reduce model size by reparameterizing model weights across Transformer encoder layers and assuming a special weight composition and structure. More specifically, inspired by ResNet and the more recent LoRA work, we propose an approach named ResidualTransformer, where each weight matrix in a Transformer layer comprises 1) a shared full-rank component with its adjacent layers, and 2) a unique low-rank component to itself. The low-rank matrices only account for a small amount of model size increase. In addition, we add diagonal weight matrices to improve modeling capacity of the low-rank matrices. Experiments of our 10k-hour speech recognition and speech translation tasks show that the Transformer encoder size can be reduced by ~3X with very slight performance degradation.


title: Positivity from Cosmological Correlators

abstract: Effective field theories in flat space and in anti-de Sitter space are constrained by causality and unitarity, often in the form of positivity bounds. Similar bounds have been harder to demonstrate in cosmological backgrounds, where the roles of unitarity and causality are more obscure. Fortunately, the expansion of the universe ensures that late-time cosmological correlators are effectively classical and the role of unitarity is played by classical statistical inequalities. For multi-field inflation, the resulting positivity constraints have long been known in terms of the Suyama-Yamaguchi inequality. In this paper, we demonstrate that similar statistical bounds imply nontrivial constraints for massive fields in the early universe. We show that any real anomalous dimensions for principal series fields in de Sitter space must be positive. We also derive a limit on the amplitude of oscillatory signals from inflation, including those arising in cosmological collider physics. Finally, we demonstrate that these constraints manifest themselves directly in the two-point statistics of matter and galaxies that will be measured in upcoming surveys.


title: DON-LSTM: Multi-Resolution Learning with DeepONets and Long Short-Term Memory Neural Networks

abstract: Deep operator networks (DeepONets, DONs) offer a distinct advantage over traditional neural networks in their ability to be trained on multi-resolution data. This property becomes especially relevant in real-world scenarios where high-resolution measurements are difficult to obtain, while low-resolution data is more readily available. Nevertheless, DeepONets alone often struggle to capture and maintain dependencies over long sequences compared to other state-of-the-art algorithms. We propose a novel architecture, named DON-LSTM, which extends the DeepONet with a long short-term memory network (LSTM). Combining these two architectures, we equip the network with explicit mechanisms to leverage multi-resolution data, as well as capture temporal dependencies in long sequences. We test our method on long-time-evolution modeling of multiple non-linear systems and show that the proposed multi-resolution DON-LSTM achieves significantly lower generalization error and requires fewer high-resolution samples compared to its vanilla counterparts.


title: FairVision: Equitable Deep Learning for Eye Disease Screening via Fair Identity Scaling

abstract: Equity in AI for healthcare is crucial due to its direct impact on human well-being. Despite advancements in 2D medical imaging fairness, the fairness of 3D models remains underexplored, hindered by the small sizes of 3D fairness datasets. Since 3D imaging surpasses 2D imaging in SOTA clinical care, it is critical to understand the fairness of these 3D models. To address this research gap, we conduct the first comprehensive study on the fairness of 3D medical imaging models across multiple protected attributes. Our investigation spans both 2D and 3D models and evaluates fairness across five architectures on three common eye diseases, revealing significant biases across race, gender, and ethnicity. To alleviate these biases, we propose a novel fair identity scaling (FIS) method that improves both overall performance and fairness, outperforming various SOTA fairness methods. Moreover, we release Harvard-FairVision, the first large-scale medical fairness dataset with 30,000 subjects featuring both 2D and 3D imaging data and six demographic identity attributes. Harvard-FairVision provides labels for three major eye disorders affecting about 380 million people worldwide, serving as a valuable resource for both 2D and 3D fairness learning. Our code and dataset are publicly accessible at \url{https://ophai.hms.harvard.edu/datasets/harvard-fairvision30k}.


title: Concurrent spin squeezing and light squeezing in an atomic ensemble

abstract: Squeezed spin states and squeezed light are both key resources for quantum metrology and quantum information science, but have largely been separately investigated experimentally so far. Simultaneous generation of these two types of quantum states in one experiment setup is an intriguing goal, and could also enable the study of the analogies and distinctions between atoms and light from a new perspective. Here we report an experimental demonstration of concurrent spin squeezing and light squeezing in a hot atomic ensemble, by judiciously engineering a symmetric atom-light interaction Hamiltonian. The squeezing process is deterministic, yielding fixed squeezing directions for the light field and the collective atomic spin. Furthermore, the squeezed light modes lie in the multiple frequency sidebands of a single spatial mode. This novel type of dual squeezed state may be a promising resource for quantum information science and technologies. Our method can be extended to other quantum platforms such as optomechanical and cold atom systems.


title: On the Financial Consequences of Simplified Battery Sizing Models without Considering Operational Details

abstract: Optimal battery sizing studies tend to overly simplify the practical aspects of battery operation within the battery sizing framework. Such assumptions may lead to a suboptimal battery capacity, resulting in significant financial losses for a battery project that could last more than a decade. In this paper, we compare the most common existing sizing methods in the literature with a battery sizing model that incorporates the practical operation of a battery, that is, receding horizon operation. Consequently, we quantify the financial losses caused by the suboptimal capacities obtained by these models for a realistic case study related to community battery storage (CBS). We develop the case study by constructing a mathematical framework for the CBS and local end users. Our results show that existing sizing methods can lead to financial losses of up to 22%.


title: Short Interval Results For Powerfree Polynomials Over Finite Fields

abstract: Let $k \geq 2$ be an integer and $\mathbb F_q$ be a finite field with $q$ elements. We prove several results on the distribution in short intervals of polynomials in $\mathbb F_q[x]$ that are not divisible by the $k$th power of any non-constant polynomial. Our main result generalizes a recent theorem by Carmon and Entin on the distribution of squarefree polynomials to all $k \ge 2$. We also develop polynomial versions of the classical techniques used to study gaps between $k$-free integers in $\mathbb Z$. We apply these techniques to obtain analogues in $\mathbb F_q[x]$ of some classical theorems on the distribution of $k$-free integers. The latter results complement the main theorem in the case when the degrees of the polynomials are of moderate size.


title: Cassini's floating potential in Titan's ionosphere: 3-D Particle-In-Cell Simulations

abstract: Accurate determination of Cassini's spacecraft potential in Titan's ionosphere is important for interpreting measurements by its low energy plasma instruments. Estimates of the floating potential varied significantly, however, between the various different plasma instruments. In this study we utilize 3-D particle-in-cell simulations to understand the key features of Cassini's plasma interaction in Titan's ionosphere. The spacecraft is observed to charge to negative potentials for all scenarios considered, and close agreement is found between the current onto the simulated Langmuir Probe and that observed in Titan's ionosphere. These simulations are therefore shown to provide a viable technique for modeling spacecraft interacting with Titan's dusty ionosphere.

categories: physics.space-ph astro-ph.EP astro-ph.IM physics.plasm-ph


title: Towards an Interpretable Representation of Speaker Identity via Perceptual Voice Qualities

abstract: Unlike other data modalities such as text and vision, speech does not lend itself to easy interpretation. While lay people can understand how to describe an image or sentence via perception, non-expert descriptions of speech often end at high-level demographic information, such as gender or age. In this paper, we propose a possible interpretable representation of speaker identity based on perceptual voice qualities (PQs). By adding gendered PQs to the pathology-focused Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) protocol, our PQ-based approach provides a perceptual latent space of the character of adult voices that is an intermediary of abstraction between high-level demographics and low-level acoustic, physical, or learned representations. Contrary to prior belief, we demonstrate that these PQs are hearable by ensembles of non-experts, and further demonstrate that the information encoded in a PQ-based representation is predictable by various speech representations.


title: Single-shot Non-destructive Quantum Sensing for Gaseous Samples with Hundreds of Chiral Molecules

abstract: Chiral discrimination that is efficient to tiny amounts of chiral substances, especially at the single-molecule level, is highly demanded. Here, we propose a single-shot nondestructive quantum sensing method addressing such an issue. Our scheme consists of two steps. In the first step, the two enantiomers are prepared in different rotational states via microwave enantio-specific state transfer. Then, the chiral discrimination is transferred to quantum hypothesis testing. In the second step, we for the first time introduce a non-destructive quantum-state detection technique assisted with a microwave resonator to chiral discrimination, through which the molecular chirality is determined by the sign of the output signals. Using a typical chiral molecule, 1,2-propanediol, and an experimentally feasible model based on spherical Fabry-P\'{e}rot cavity, we show that the molecular chirality of slowly moving enantiopure gaseous samples with $10^2 - 10^3$ molecules can be highly credibly distinguished in a single-shot detection. By further trapping chiral molecules, it is promising to achieve chiral discrimination at the single molecule level by using our approach.


title: Stanley-Wilf Limits for Patterns in Rooted Labeled Forests

abstract: Building off recent work of Garg and Peng, we continue the investigation into classical and consecutive pattern avoidance in rooted forests. We prove a forest analogue of the Stanley-Wilf conjecture for avoiding a single pattern as well as certain other sets of patterns. Our techniques are analytic, easily generalizing to different types of pattern avoidance and allowing for computations of convergent lower bounds of the forest Stanley-Wilf limit in the cases covered by our result. We end with several open questions and directions for future research, including some on the limit distributions of certain statistics of pattern-avoiding forests.


title: UNCOVER: The rest ultraviolet to near infrared multiwavelength structures and dust distributions of sub-millimeter-detected galaxies in Abell 2744

abstract: With the wavelength coverage, sensitivity, and high spatial resolution of JWST, it is now possible to peer through the dust attenuation to probe the rest-frame near infrared (NIR) and stellar structures of extremely dusty galaxies at cosmic noon (z~1-3). In this paper we leverage the combined ALMA and JWST/HST coverage in Abell 2744 to study the multiwavelength (0.5-4.4um) structures of 11 sub-millimeter (sub-mm) detected galaxies at z~0.9-3.5 that are fainter than bright "classical" sub-mm galaxies (SMGs). While these objects reveal a diversity of structures and sizes, all exhibit decreasing sizes and increasing central concentration towards longer wavelengths. The smaller sizes of these objects at long wavelengths indicate that their stellar mass profiles are more compact than their optical light profiles, likely due to centrally-concentrated dust obscuration. Further, we find that galaxies with higher central concentration values tend to have more extreme size ratios (comparing the rest-frame NIR to rest-frame optical); this suggests that the galaxies with the most compact light distributions also have the most concentrated dust distributions. We also find the galaxies with the most extreme size ratios do not have elevated 1.2mm flux densities compared to the rest of our sample: we argue this means compact dust geometry, rather than e.g. high total dust quantity, drives the most extreme observed rest-frame NIR-to-optical size ratios. Upcoming higher resolution 1.2mm ALMA imaging will facilitate joint spatially-resolved analysis and will directly test the dust distributions within this representative sub-mm population.


title: Quantitative bounds to propagation of quantum correlations in many-body systems

abstract: We investigate how much information about a quantum system can be simultaneously communicated to independent observers, by establishing quantitative limits to bipartite quantum correlations in many-body systems. As recently reported in Phys. Rev. Lett. 129, 010401 (2022), bounds on quantum discord and entanglement of formation between a single quantum system and its environment, e.g., a large number of photons, dictate that independent observers which monitor environment fragments inevitably acquire only classical information about the system. Here, we corroborate and generalize those findings. First, we calculate continuity bounds of quantum discord, which establish how much states with a small amount of quantum correlations deviate from being embeddings of classical probability distributions. Also, we demonstrate a universally valid upper bound to the bipartite entanglement of formation between an arbitrary pair of components of a many-body quantum system. The results confirm that proliferation of classical information in the Universe suppresses quantum correlations.


title: Entanglement-Assisted Quantum Chiral Spectroscopy

abstract: The most important problem of spectroscopic chiral analysis is the inherently weak chiral signals are easily overwhelmed by the environment noises. Enormous efforts had been spent to overcome this problem by enhancing the symmetry break in the light-molecule interactions or reducing the environment noises. Here, we propose an alternative way to solve this problem by using frequency-entangled photons as probe signals and detecting them in coincidence, i.e., using quantum chiral spectroscopy. For this purpose, we develop the theory of entanglement-assisted quantum chiral spectroscopy. Our results show that the signals of left- and right-handed molecules in the quantum spectrum are always distinguishable by suitably configuring the entangled probe photons. In construct, the classical spectrum of the two enantiomers become indistinguishable when the symmetry break in the interactions is overwhelmed by the environment noises. This offers our quantum chiral spectroscopy a great advantage over all classical chiral spectroscopy. Our work opens up an exciting area that exploring profound advantages of quantum spectroscopy in chiral analysis.


title: Validating posteriors obtained by an emulator when jointly-fitting mock data of the global 21-cm signal and high-z galaxy UV luminosity function

abstract: Although neural-network-based emulators enable efficient parameter estimation in 21-cm cosmology, the accuracy of such constraints is poorly understood. We employ nested sampling to fit mock data of the global 21-cm signal and high-$z$ galaxy ultraviolet luminosity function (UVLF) and compare for the first time the emulated posteriors obtained using the global signal emulator ${\tt globalemu}$ to the `true' posteriors obtained using the full model on which the emulator is trained using ${\tt ARES}$. Of the eight model parameters we employ, four control the star formation efficiency (SFE), and thus can be constrained by UVLF data, while the remaining four control UV and X-ray photon production, and the minimum virial temperature of star-forming halos ($T_{\rm min}$), and thus are uniquely probed by reionization and 21-cm measurements. For noise levels of 50 and 250 mK in the 21-cm data being jointly-fit, the emulated and `true' posteriors are consistent to within $1\sigma$. However, at lower noise levels of 10 and 25 mK, ${\tt globalemu}$ overpredicts $T_{\rm min}$ and underpredicts $\gamma_{\rm lo}$, an SFE parameter, by $\approx3-4\sigma$, while the `true' ${\tt ARES}$ posteriors capture their fiducial values within $1\sigma$. We find that jointly-fitting the mock UVLF and 21-cm data significantly improves constraints on the SFE parameters by breaking degeneracies in the ${\tt ARES}$ parameter space. Our results demonstrate the astrophysical constraints that can be expected for global 21-cm experiments for a range of noise levels from pessimistic to optimistic, and also the potential for probing redshift evolution of SFE parameters by including UVLF data.


title: Multi-physics modeling of non-equilibrium phenomena in inductively coupled plasma discharges: Part II. Multi-temperature approach

abstract: This paper provides a comparison between the vibrational-specific state-to-state (StS) model for nitrogen plasma elaborated in Part I of this work and conventional two-temperature (2-T) models for simulating inductively coupled plasma (ICP) discharges under non-Local Thermodynamic Equilibrium (NLTE) conditions. Simulations are performed within the multi-physics computational framework established for ICP in Part I. Based on the findings of Part I, the quasi-steady-state (QSS) assumption is validated in the plasma core, thereby enabling the calculation of global rate coefficients under this assumption. This facilitates the reduction of the StS model to a "consistent" macroscopic 2-T model. Results from the StS model for nitrogen ICP torch exhibit considerable discrepancies when compared against predictions from the widely utilized Park 2-T model. On the contrary, the comparison between the newly proposed 2-T model, consistently derived from the original vibronic StS model, and the full StS results demonstrate excellent agreement in terms of plasma core location, morphology, and peak temperature distributions. This demonstrates the ability of the proposed 2-T model to capture the energy transfer and reactive processes predicted by the comprehensive StS model. Additionally, the study identifies the vibrational-translational (VT) energy transfer term in the 2-T model as the predominant factor in dictating plasma core morphology. This suggests a strong sensitivity of the ICP flow field to heavy-impact vibrational excitations and dissociative events.


title: Learning to Reach Goals via Diffusion

abstract: We present a novel perspective on goal-conditioned reinforcement learning by framing it within the context of denoising diffusion models. Analogous to the diffusion process, where Gaussian noise is used to create random trajectories that walk away from the data manifold, we construct trajectories that move away from potential goal states. We then learn a goal-conditioned policy to reverse these deviations, analogously to the score function. This approach, which we call Merlin, can reach specified goals from an arbitrary initial state without learning a separate value function. In contrast to recent works utilizing diffusion models in offline RL, Merlin stands out as the first method to perform diffusion in the state space, requiring only one ``denoising" iteration per environment step. We experimentally validate our approach in various offline goal-reaching tasks, demonstrating substantial performance enhancements compared to state-of-the-art methods while improving computational efficiency over other diffusion-based RL methods by an order of magnitude. Our results suggest that this perspective on diffusion for RL is a simple, scalable, and practical direction for sequential decision making.


title: Proactive Human-Robot Interaction using Visuo-Lingual Transformers

abstract: Humans possess the innate ability to extract latent visuo-lingual cues to infer context through human interaction. During collaboration, this enables proactive prediction of the underlying intention of a series of tasks. In contrast, robotic agents collaborating with humans naively follow elementary instructions to complete tasks or use specific hand-crafted triggers to initiate proactive collaboration when working towards the completion of a goal. Endowing such robots with the ability to reason about the end goal and proactively suggest intermediate tasks will engender a much more intuitive method for human-robot collaboration. To this end, we propose a learning-based method that uses visual cues from the scene, lingual commands from a user and knowledge of prior object-object interaction to identify and proactively predict the underlying goal the user intends to achieve. Specifically, we propose ViLing-MMT, a vision-language multimodal transformer-based architecture that captures inter and intra-modal dependencies to provide accurate scene descriptions and proactively suggest tasks where applicable. We evaluate our proposed model in simulation and real-world scenarios.


title: Inference of Sample Complier Average Causal Effects under Experiments with Completely Randomized Design and Computer Assisted Balance-Improving Designs

abstract: Non-compliance is common in real world experiments. We focus on inference about the sample complier average causal effect, that is, the average treatment effect for experimental units who are compliers. We present three types of inference strategies for the sample complier average causal effect: the Wald estimator, regression adjustment estimators and model-based Bayesian inference. Because modern computer assisted experimental designs have been used to improve covariate balance over complete randomization, we discuss inference under both complete randomization and a specific computer assisted experimental design - Mahalanobis distance based rerandomization, under which asymptotic properties of the Wald estimator and regression adjustment estimators can be derived. We use Monte Carlo simulation to compare the finite sample performance of the methods under both experimental designs. We find that under either design, the Bayesian method performs the best because it is stable, it yields smallest median absolute error and smallest median interval length. The improvement by the Bayesian method is especially large when the fraction of compliers is small. We present an application to a job training experiment with non-compliance.


title: Ophiuchus: Scalable Modeling of Protein Structures through Hierarchical Coarse-graining SO(3)-Equivariant Autoencoders

abstract: Three-dimensional native states of natural proteins display recurring and hierarchical patterns. Yet, traditional graph-based modeling of protein structures is often limited to operate within a single fine-grained resolution, and lacks hourglass neural architectures to learn those high-level building blocks. We narrow this gap by introducing Ophiuchus, an SO(3)-equivariant coarse-graining model that efficiently operates on all-atom protein structures. Our model departs from current approaches that employ graph modeling, instead focusing on local convolutional coarsening to model sequence-motif interactions with efficient time complexity in protein length. We measure the reconstruction capabilities of Ophiuchus across different compression rates, and compare it to existing models. We examine the learned latent space and demonstrate its utility through conformational interpolation. Finally, we leverage denoising diffusion probabilistic models (DDPM) in the latent space to efficiently sample protein structures. Our experiments demonstrate Ophiuchus to be a scalable basis for efficient protein modeling and generation.


title: Importance Sampling Approach for Dynamic Stochastic Optimal Power Flow Control

abstract: Renewable energy sources (RES) has become common in modern power systems, helping to address decarbonization and energy security goals. Despite being attractive, RES such as solar and have low inertia and high uncertainty, thus compromising power grid stability and increasing the risk of energy blackouts. Stochastic (chance-constrained) optimization and other state-of-the-art algorithms to optimize and control power generation under uncertainty either explicitly assume the distribution of renewables, or use data-driven approximations. The latter becomes time-consuming and inaccurate, esp. when optimizing over multiple time steps. This paper considers a discrete-time chance-constraint direct current optimal power flow control problem for minimizing power generation costs subjected to power balance and security constraints. We propose an importance-sampling-based data-driven approximation for the optimal automated generation control, which allows to improve accuracy and reduce data requirements compared to state-of-the-art methods. We support the proposed approach theoretically and empirically. The results demonstrate the approach superior performance in handling generation uncertainty, enhancing the stability of renewable-integrated power systems, and facilitating the transition to clean energy.


title: Interior point method in tensor optimal transport

abstract: We study a tensor optimal transport (TOT) problem for $d\ge 2$ discrete measures. This is a linear programming problem on $d$-tensors. We introduces an interior point method (ipm) for $d$-TOT with a corresponding barrier function. Using a "short-step" ipm following central path within $\varepsilon$ precision we estimate the number of iterations.


title: Prepare Ansatz for VQE with Diffusion Model

abstract: The Variational Quantum Eigensolver (VQE) is a quantum algorithm used to find the ground state energy of a given Hamiltonian. The key component of VQE is the ansatz, which is a trial wavefunction that the algorithm uses to approximate the ground state. Designing a good ansatz can significantly improve the performance of the VQE algorithm. Typical ansatz structures include the Unitary Coupled Cluster (UCC) ansatz and the Hardware-Efficient Ansatz (HEA). The primary distinction between these two structures lies in their dependence on the problem and hardware. The UCC ansatz is tailored to the target Hamiltonian, whereas the HEA is determined by the hardware topology. We believe that an intermediate approach could combine the benefits of the UCC ansatz while introducing additional parameters to increase its expressiveness and capability. In this paper, we propose utilizing a diffusion model to facilitate the generation of ansatz. We create a sequence of UCC ansatzes as training data and input this data into the diffusion model. The model then generates quantum circuits that have a similar structure to the input data. These quantum circuits are subsequently tested using a VQE task to evaluate their performance. This approach provides a systematic method for generating ansatzes that maintain a similar structure while incorporating additional parameters, enhancing their expressiveness and capability. We validate on small molecules that the diffusion model can help prepare ansatz circuits for VQE.


title: Poset Associahedra and Stack-sorting

abstract: For any finite connected poset $P$, Galashin introduced a simple convex $(|P|-2)$-dimensional polytope $\mathscr{A}(P)$ called the poset associahedron. For a certain family of posets, whose poset associahedra interpolate between the classical permutohedron and associahedron, we give a simple combinatorial interpretation of the $h$-vector. Our interpretation relates to the theory of stack-sorting of permutations. It also allows us to prove real-rootedness of some of their $h$-polynomials.


title: A Recipe for Improved Certifiable Robustness

abstract: Recent studies have highlighted the potential of Lipschitz-based methods for training certifiably robust neural networks against adversarial attacks. A key challenge, supported both theoretically and empirically, is that robustness demands greater network capacity and more data than standard training. However, effectively adding capacity under stringent Lipschitz constraints has proven more difficult than it may seem, evident by the fact that state-of-the-art approach tend more towards \emph{underfitting} than overfitting. Moreover, we posit that a lack of careful exploration of the design space for Lipshitz-based approaches has left potential performance gains on the table. In this work, we provide a more comprehensive evaluation to better uncover the potential of Lipschitz-based certification methods. Using a combination of novel techniques, design optimizations, and synthesis of prior work, we are able to significantly improve the state-of-the-art VRA for deterministic certification on a variety of benchmark datasets, and over a range of perturbation sizes. Of particular note, we discover that the addition of large ``Cholesky-orthogonalized residual dense'' layers to the end of existing state-of-the-art Lipschitz-controlled ResNet architectures is especially effective for increasing network capacity and performance. Combined with filtered generative data augmentation, our final results further the state of the art deterministic VRA by up to 8.5 percentage points\footnote{Code is available at \url{https://github.com/hukkai/liresnet}}.


title: Closed-Loop Until Further Notice: Comparing Predictive Control Methods in Closed-Loop

abstract: For future extremely large telescopes, error in extreme adaptive optics systems at small angular separations will be highly impacted by the lag time of the correction, which is typically on millisecond timescales; one solution is to apply a predictive correction to catch up with the system delay. Predictive control leads to significant RMS error reductions in simulation (on the order of 5-10x improvement in RMS error compared with a standard integral controller), but shows only modest improvement on-sky (less than 2x in RMS error). This performance limitation is likely impacted by elements of pseudo open loop (POL) reconstruction, which requires assumptions about the response of the deformable mirror and accuracy of the wavefront measurements that are difficult to verify in practice. In this work, we explore a closed-loop method for data-driven prediction using a reformulated empirical orthogonal functions (EOF). We examine the performance of the open and closed-loop methods in simulation on perfect systems and systems with an inaccurate understanding of the DM response.


title: Community Archetypes: An Empirical Framework for Guiding Research Methodologies to Reflect User Experiences of Sense of Virtual Community

abstract: Humans need a sense of community (SOC), and social media platforms afford opportunities to address this need by providing users with a sense of virtual community (SOVC). This paper explores SOVC on Reddit and is motivated by two goals: (1) providing researchers with an excellent resource for methodological decisions in studies of Reddit communities; and (2) creating the foundation for a new class of research methods and community support tools that reflect users' experiences of SOVC. To ensure that methods are respectfully and ethically designed in service and accountability to impacted communities, our work takes a qualitative, community-centered approach by engaging with two key stakeholder groups. First, we interviewed 21 researchers to understand how they study "community" on Reddit. Second, we surveyed 12 subreddits to gain insight into user experiences of SOVC. Results show that some research methods can broadly reflect users' SOVC regardless of the topic or type of subreddit. However, user responses also evidenced the existence of five distinct Community Archetypes: Topical Q&A, Learning & Perspective Broadening, Social Support, Content Generation, and Affiliation with an Entity. We offer the Community Archetypes framework to support future work in designing methods that align more closely with user experiences of SOVC and to create community support tools that can meaningfully nourish the human need for SOC/SOVC in our modern world.


title: Can negative bare couplings make sense? The $\vec{\phi}^4$ theory at large $N$

abstract: Scalar $\lambda\phi^4$ theory in 3+1D, for a positive coupling constant $\lambda>0$, is known to have no interacting continuum limit, which is referred to as quantum triviality. However, it has been recently argued that the theory in 3+1D with an $N$-component scalar $\vec{\phi}$ and a $(\vec{\phi}\cdot\vec{\phi})^{\,2}=\vec{\phi}^{\,4}$ interaction term does have an interacting continuum limit at large $N$. It has been suggested that this continuum limit has a negative (bare) coupling constant and exhibits asymptotic freedom, similar to the $\mathcal{P}\mathcal{T}$-symmetric $-g\phi^4$ field theory. In this paper I study the $\vec{\phi}^{\,4}$ theory in 3+1D at large $N$ with a negative coupling constant $-g<0$, and with the scalar field taking values in a $\mathcal{P}\mathcal{T}$-symmetric complex domain. The theory is non-trivial, has asymptotic freedom, and has a Landau pole in the IR, and I demonstrate that the thermal partition function matches that of the positive-coupling $\lambda>0$ theory when the Landau poles of the two theories (in the $\lambda>0$ case a pole in the UV) are identified with one another. Thus the $\vec{\phi}^{\,4}$ theory at large $N$ appears to have a negative bare coupling constant; the coupling only becomes positive in the IR, which in the context of other $\mathcal{P}\mathcal{T}$-symmetric and large-$N$ quantum field theories I argue is perfectly acceptable.


title: The unresolved stochastic background from compact binary mergers detectable by next-generation ground-based gravitational-wave observatories

abstract: The next generation of ground-based gravitational-wave detectors will look much deeper into the Universe and have unprecedented sensitivities and low-frequency capabilities. Especially alluring is the possibility of detecting an early-Universe cosmological stochastic background that could provide important insights into the beginnings of our Universe and fundamental physics at extremely high energies. However, even if next-generation detectors are sensitive to cosmological stochastic backgrounds, they will be masked by more dominant astrophysical backgrounds, namely the residual background from the imperfect subtraction of resolvable compact binary coalescences (CBCs) as well as the CBC background from individually unresolvable CBCs. Using our latest knowledge of masses, rates, and delay time distributions, we present a data-driven estimate of the unresolvable CBC background that will be seen by next-generation detectors. Accounting for statistical and systematic errors, this estimate quantifies an important piece in the CBC noise budget for next-generation detectors and can help inform detector design and subtraction algorithms. We compare our results with predictions for backgrounds from several cosmological sources in the literature, finding that the unresolvable background will likely be a significant impediment for many models. This motivates the need for simultaneous inference methods or other statistical techniques to detect early-Universe cosmological backgrounds.


title: Shaping the Epochal Individuality and Generality: The Temporal Dynamics of Uncertainty and Prediction Error in Musical Improvisation

abstract: Musical improvisation, much like spontaneous speech, reveals intricate facets of the improviser's state of mind and emotional character. However, the specific musical components that reveal such individuality remain largely unexplored. Within the framework of brain's statistical learning and predictive processing, this study examined the temporal dynamics of uncertainty and surprise (prediction error) in a piece of musical improvisation. This study employed the HBSL model to analyze a corpus of 456 Jazz improvisations, spanning 1905 to 2009, from 78 distinct Jazz musicians. The results indicated distinctive temporal patterns of surprise and uncertainty, especially in pitch and pitch-rhythm sequences, revealing era-specific features from the early 20th to the 21st centuries. Conversely, rhythm sequences exhibited a consistent degree of uncertainty across eras. Further, the acoustic properties remain unchanged across different periods. These findings highlight the importance of how temporal dynamics of surprise and uncertainty in improvisational music change over periods, profoundly influencing the distinctive methodologies artists adopt for improvisation in each era. Further, it is suggested that the development of improvisational music can be attributed to the brain's adaptive statistical learning mechanisms, which constantly refine internal models to mirror the cultural and emotional nuances of their respective epochs. This study unravels the evolutionary trajectory of improvisational music and highlights the nuanced shifts artists employ to resonate with the cultural and emotional landscapes of their times.


title: Parameterized Convex Minorant for Objective Function Approximation in Amortized Optimization

abstract: Parameterized convex minorant (PCM) method is proposed for the approximation of the objective function in amortized optimization. In the proposed method, the objective function approximator is expressed by the sum of a PCM and a nonnegative gap function, where the objective function approximator is bounded from below by the PCM convex in the optimization variable. The proposed objective function approximator is a universal approximator for continuous functions, and the global minimizer of the PCM attains the global minimum of the objective function approximator. Therefore, the global minimizer of the objective function approximator can be obtained by a single convex optimization. As a realization of the proposed method, extended parameterized log-sum-exp network is proposed by utilizing a parameterized log-sum-exp network as the PCM. Numerical simulation is performed for parameterized non-convex objective function approximation and for learning-based nonlinear model predictive control to demonstrate the performance and characteristics of the proposed method. The simulation results support that the proposed method can be used to learn objective functions and to find a global minimizer reliably and quickly by using convex optimization algorithms.


title: MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentation

abstract: Health risk prediction is one of the fundamental tasks under predictive modeling in the medical domain, which aims to forecast the potential health risks that patients may face in the future using their historical Electronic Health Records (EHR). Researchers have developed several risk prediction models to handle the unique challenges of EHR data, such as its sequential nature, high dimensionality, and inherent noise. These models have yielded impressive results. Nonetheless, a key issue undermining their effectiveness is data insufficiency. A variety of data generation and augmentation methods have been introduced to mitigate this issue by expanding the size of the training data set through the learning of underlying data distributions. However, the performance of these methods is often limited due to their task-unrelated design. To address these shortcomings, this paper introduces a novel, end-to-end diffusion-based risk prediction model, named MedDiffusion. It enhances risk prediction performance by creating synthetic patient data during training to enlarge sample space. Furthermore, MedDiffusion discerns hidden relationships between patient visits using a step-wise attention mechanism, enabling the model to automatically retain the most vital information for generating high-quality data. Experimental evaluation on four real-world medical datasets demonstrates that MedDiffusion outperforms 14 cutting-edge baselines in terms of PR-AUC, F1, and Cohen's Kappa. We also conduct ablation studies and benchmark our model against GAN-based alternatives to further validate the rationality and adaptability of our model design. Additionally, we analyze generated data to offer fresh insights into the model's interpretability.


title: Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem

abstract: AI audits are an increasingly popular mechanism for algorithmic accountability; however, they remain poorly defined. Without a clear understanding of audit practices, let alone widely used standards or regulatory guidance, claims that an AI product or system has been audited, whether by first-, second-, or third-party auditors, are difficult to verify and may exacerbate, rather than mitigate, bias and harm. To address this knowledge gap, we provide the first comprehensive field scan of the AI audit ecosystem. We share a catalog of individuals (N=438) and organizations (N=189) who engage in algorithmic audits or whose work is directly relevant to algorithmic audits; conduct an anonymous survey of the group (N=152); and interview industry leaders (N=10). We identify emerging best practices as well as methods and tools that are becoming commonplace, and enumerate common barriers to leveraging algorithmic audits as effective accountability mechanisms. We outline policy recommendations to improve the quality and impact of these audits, and highlight proposals with wide support from algorithmic auditors as well as areas of debate. Our recommendations have implications for lawmakers, regulators, internal company policymakers, and standards-setting bodies, as well as for auditors. They are: 1) require the owners and operators of AI systems to engage in independent algorithmic audits against clearly defined standards; 2) notify individuals when they are subject to algorithmic decision-making systems; 3) mandate disclosure of key components of audit findings for peer review; 4) consider real-world harm in the audit process, including through standardized harm incident reporting and response mechanisms; 5) directly involve the stakeholders most likely to be harmed by AI systems in the algorithmic audit process; and 6) formalize evaluation and, potentially, accreditation of algorithmic auditors.


title: SCB-Dataset3: A Benchmark for Detecting Student Classroom Behavior

abstract: The use of deep learning methods to automatically detect students' classroom behavior is a promising approach for analyzing their class performance and improving teaching effectiveness. However, the lack of publicly available datasets on student behavior poses a challenge for researchers in this field. To address this issue, we propose the Student Classroom Behavior dataset (SCB-dataset3), which represents real-life scenarios. Our dataset comprises 5686 images with 45578 labels, focusing on six behaviors: hand-raising, reading, writing, using a phone, bowing the head, and leaning over the table. We evaluated the dataset using the YOLOv5, YOLOv7, and YOLOv8 algorithms, achieving a mean average precision (map) of up to 80.3$\%$. We believe that our dataset can serve as a robust foundation for future research in student behavior detection and contribute to advancements in this field. Our SCB-dataset3 is available for download at: https://github.com/Whiffe/SCB-dataset


title: A Spatio-Temporal Attention-Based Method for Detecting Student Classroom Behaviors

abstract: Accurately detecting student behavior from classroom videos is beneficial for analyzing their classroom status and improving teaching efficiency. However, low accuracy in student classroom behavior detection is a prevalent issue. To address this issue, we propose a Spatio-Temporal Attention-Based Method for Detecting Student Classroom Behaviors (BDSTA). Firstly, the SlowFast network is used to generate motion and environmental information feature maps from the video. Then, the spatio-temporal attention module is applied to the feature maps, including information aggregation, compression and stimulation processes. Subsequently, attention maps in the time, channel and space dimensions are obtained, and multi-label behavior classification is performed based on these attention maps. To solve the long-tail data problem that exists in student classroom behavior datasets, we use an improved focal loss function to assign more weight to the tail class data during training. Experimental results are conducted on a self-made student classroom behavior dataset named STSCB. Compared with the SlowFast model, the average accuracy of student behavior classification detection improves by 8.94\% using BDSTA.


title: Federated Conditional Stochastic Optimization

abstract: Conditional stochastic optimization has found applications in a wide range of machine learning tasks, such as invariant learning, AUPRC maximization, and meta-learning. As the demand for training models with large-scale distributed data grows in these applications, there is an increasing need for communication-efficient distributed optimization algorithms, such as federated learning algorithms. This paper considers the nonconvex conditional stochastic optimization in federated learning and proposes the first federated conditional stochastic optimization algorithm (FCSG) with a conditional stochastic gradient estimator and a momentum-based algorithm (FCSG-M). To match the lower bound complexity in the single-machine setting, we design an accelerated algorithm (Acc-FCSG-M) via the variance reduction to achieve the best sample and communication complexity. Compared with the existing optimization analysis for MAML in FL, federated conditional stochastic optimization considers the sample of tasks. Extensive experimental results on various tasks validate the efficiency of these algorithms.


title: Assessing the Risk of Permafrost Degradation with Physics-Informed Machine Learning

abstract: Global warming accelerates permafrost degradation, impacting the reliability of critical infrastructure used by more than five million people daily. Furthermore, permafrost thaw produces substantial methane emissions, further accelerating global warming and climate change and putting more than eight billion people at additional risk. To mitigate the upcoming risk, policymakers and stakeholders must be given an accurate prediction of the thaw development. Unfortunately, comprehensive physics-based permafrost models require location-specific fine-tuning that is challenging in practice. Models of intermediate complexity require few input parameters but have relatively low accuracy. The performance of pure data-driven models is low as well as the observational data is sparse and limited. In this work, we designed a physics-informed machine-learning approach for permafrost thaw prediction. The method uses a heat equation to regularize data-driven approach trained over permafrost monitoring data and climate projections. The latter leads to higher precision and better numerical stability allowing for reliable decision-making or construction and maintenance in the areas endangered by permafrost thaw with a time horizon of decades.


title: Predicting the Splash of a Drop Impacting a Thin Liquid Film

abstract: In most spray coating and deposition applications, the target surface may be initially dry but with continuous drop impact a thin layer of liquid film is formed on which further impingement occurs. An experimental study of the process of drop impact on a thin stagnant film of the same liquid and the subsequent drop-film interactions is carried out. The impacting drop results in either liquid deposition or it can cause prompt or delayed splash. Deposition occurs when the drop merges with the liquid film without generating secondary drops. Splash results in the production of secondary drops either at the instant of impact (prompt splash) or through a delayed break-up of the rim of the crown formed as a result of the impact (delayed splash). Experiments are conducted to characterize the phenomena using five different Newtonian liquids and by varying drop impact diameter and velocity. The liquids are chosen so as to cover a wide range of liquid properties (viscosity and surface tension). A high-speed digital camera is used to capture the drop impact dynamics. The threshold of splashing is found to be related to drop size, impact velocity, liquid properties and thin film thickness. Experimental analysis of the significance of inertial, viscous and capillary forces in determining the splash and no-splash (or deposition) boundary helps in establishing an empirical correlation for the same. The splash and no-splash outcomes predicted by the proposed correlation agree well with experimental data available in the literature.