title: Beta decay and related processes from an angular momentum perspective

abstract: We ask the question of how angular momentum is conserved in weak interaction processes, beginning with inverse beta decay for massless neutrinos and electrons, in which both the incident neutrino and final electron are in helicity eigenstates with respect, however, to {\em different} directions. To elucidate the problem we recast the final electron state in terms of a spherical Dirac wave. We then generalize these results to massive neutrinos and electrons, and finally examine electron-positron annihilation processes through the same lens. In all these processes, the apparent non-conservation of angular momentum is a result of the quantum measurement process in which the measuring apparatus is not in an initially well-defined quantum state, but is coupled to the outside world; the measuring process, being outside the rules of elementary quantum mechanics, does not allow a satisfactory accounting of the angular momentum transfer.


title: Extracting Prompts by Inverting LLM Outputs

abstract: We consider the problem of language model inversion: given outputs of a language model, we seek to extract the prompt that generated these outputs. We develop a new black-box method, output2prompt, that learns to extract prompts without access to the model's logits and without adversarial or jailbreaking queries. In contrast to previous work, output2prompt only needs outputs of normal user queries. To improve memory efficiency, output2prompt employs a new sparse encoding techique. We measure the efficacy of output2prompt on a variety of user and system prompts and demonstrate zero-shot transferability across different LLMs.


title: Make Inference Faster: Efficient GPU Memory Management for Butterfly Sparse Matrix Multiplication

abstract: This paper is the first to assess the state of existing sparse matrix multiplication algorithms on GPU for the butterfly structure, a promising form of sparsity. This is achieved through a comprehensive benchmark that can be easily modified to add a new implementation. The goal is to provide a simple tool for users to select the optimal implementation based on their settings. Using this benchmark, we find that existing implementations spend up to 50% of their total runtime on memory rewriting operations. We show that these memory operations can be optimized by introducing a new CUDA kernel that minimizes the transfers between the different levels of GPU memory, achieving a median speed-up factor of x1.4 while also reducing energy consumption (median of x0.85). We also demonstrate the broader significance of our results by showing how the new kernel can speed up the inference of neural networks.


title: Modeling of Deuteron Induced Reactions on Molybdenum at Low Energies

abstract: The activities of the EUROfusion consortium on the development of high quality nuclear data for fusion applications include evaluations of deuteron induced reactions and related data libraries for needs of the DEMO fusion power plant and IFMIF-DONES neutron--source nuclear analyses. Molybdenum is one of the major constituents of the reference stainless steels used in critical components of these projects. While the TENDL deuteron data library was the current reference used by EUROfusion, need of its further improvement has already been pointed out. The weak binding energy of the deuteron is responsible for the high complexity of its interaction with nuclei, involving also a variety of reactions initiated by the nucleons following the deuteron breakup. Their analysis completed that of the deuteron interactions with Mo and its stable isotopes, from elastic scattering to pre-equilibrium and compound--nucleus reactions, up to 50 MeV. A particular attention has been paid to the breakup, stripping, and pick-up direct interactions which amount to around half of the deuteron total--reaction cross section. The due account of most experimental data has validated the present approach, highlighted some prevalent features, and emphasized weak points and consequently the need for modeling/evaluation upgrade.


title: Fast Transaction Scheduling in Blockchain Sharding

abstract: Sharding is a promising technique for addressing the scalability issues of blockchain. It divides the $n$ participating nodes into $s$ disjoint groups called shards, where each shard processes transactions in parallel. We investigate scheduling algorithms for the blockchain sharding systems, where each transaction resides in a shard of the communication graph and attempts to access accounts at possibly remote shards. We examine batch scheduling problems on the shard graph $G_s$, where given a set of transactions, we aim to find efficient schedules to execute them as fast as possible. First, we present a centralized scheduler where one of the shards has global knowledge of transactions to be processed. For general graphs, where the transaction and its accessing objects are arbitrarily far from each other with a maximum distance $d$, the centralized scheduler provides $O(kd)$ approximation to the optimal schedule, where $k$ is the maximum number of shards each transaction accesses. Consequently, for a Clique graph where shards are at a unit distance from each other, we obtain $O(k)$ approximation to the optimal schedule. We also get $O(k \log s)$ approximation for Hypercube, Butterfly, and $g$-dimensional Grid, where $g=O(\log s)$. Next, we provide a centralized scheduler with a bucketing approach that offers improved bounds for special cases. Finally, we provide a distributed scheduler where shards do not require global transaction information. We achieve this by using a hierarchical clustering of the shards and using the centralized scheduler in each cluster. We show that the distributed scheduler has a competitive ratio of $O(\mathcal{A_\mathcal{CS}} \log ^2 s)$, where $\mathcal{A_\mathcal{CS}}$ is the approximation ratio of the centralized scheduler. To our knowledge, we are the first to give provably fast transaction scheduling algorithms for blockchain sharding systems.


title: On similarity to contractions of class $C_{\cdot 0}$ with finite defects

abstract: A criterion on the similarity of a (bounded, linear) operator $T$ on a (complex, separable) Hilbert space $\mathcal H$ in terms of shift-type invariant subspaces of $T$ to a contraction of class $C_{\cdot 0}$ with finite unequal defects is given. Namely, $T$ is similar to such a contraction if and only if the minimal quantity of (closed) invariant subspaces $\mathcal M$ of $T$ such that the restriction $T|_{\mathcal M}$ of $T$ on $\mathcal M$ is similar to the simple unilateral shift, whose linear span is $\mathcal H$, is finite. A sufficient condition for the similarity of an absolutely continuous polynomially bounded operator $T$ to a contraction of class $C_{\cdot 0}$ with finite equal defects is given. Namely, $T$ is similar to such a contraction if the (spectral) multiplicity of $T$ is finite and $B(T)=\mathbb O$, where $B$ is a finite product of Blaschke products with simple zeros satisfying the Carleson interpolating condition (a Carleson--Newman product).


title: Kinetic inductance current sensor for visible to near-infrared wavelength transition-edge sensor readout

abstract: Single-photon detectors based on the superconducting transition-edge sensor (TES) are used in a number of visible to near-infrared (VNIR) applications, particularly for photon-number-resolving measurements in quantum information science. To be practical for large-scale photonic quantum computing or for future spectroscopic imaging applications in astronomy, the size of VNIR TES arrays must be increased from a few pixels to many thousands. Historically, TES arrays have been read out with multiplexed superconducting quantum interference devices (SQUIDs), but the microsecond-duration pulse signals of VNIR TESs are notoriously difficult to multiplex. In this manuscript, we introduce the kinetic inductance current sensor (KICS), a more readily scalable readout technology that exploits the nonlinear kinetic inductance in a superconducting resonator to make sensitive current measurements. KICS devices can replace SQUIDs for many applications because of their ability to measure fast, high slew-rate signals, their compatibility with standard microwave frequency-division multiplexing techniques, and their relatively simple fabrication. Here, we demonstrate the readout of a VNIR TES using a KICS with $3.7$ $\text{MHz}$ of bandwidth. We measure a readout noise of $1.4$ $\text{pA}/\sqrt{\text{Hz}}$, considerably below the TES noise at frequencies of interest, and a TES energy resolution of $(0.137 \pm 0.001)$ $\text{eV}$ at $0.8$ $\text{eV}$, comparable to resolutions observed with non-multiplexed SQUID readouts.


title: What Variables Affect Out-Of-Distribution Generalization in Pretrained Models?

abstract: Embeddings produced by pre-trained deep neural networks (DNNs) are widely used; however, their efficacy for downstream tasks can vary widely. We study the factors influencing out-of-distribution (OOD) generalization of pre-trained DNN embeddings through the lens of the tunnel effect hypothesis, which suggests deeper DNN layers compress representations and hinder OOD performance. Contrary to earlier work, we find the tunnel effect is not universal. Based on 10,584 linear probes, we study the conditions that mitigate the tunnel effect by varying DNN architecture, training dataset, image resolution, and augmentations. We quantify each variable's impact using a novel SHAP analysis. Our results emphasize the danger of generalizing findings from toy datasets to broader contexts.


title: Agentic Skill Discovery

abstract: Language-conditioned robotic skills make it possible to apply the high-level reasoning of Large Language Models (LLMs) to low-level robotic control. A remaining challenge is to acquire a diverse set of fundamental skills. Existing approaches either manually decompose a complex task into atomic robotic actions in a top-down fashion, or bootstrap as many combinations as possible in a bottom-up fashion to cover a wider range of task possibilities. These decompositions or combinations, however, require an initial skill library. For example, a "grasping" capability can never emerge from a skill library containing only diverse "pushing" skills. Existing skill discovery techniques with reinforcement learning acquire skills by an exhaustive exploration but often yield non-meaningful behaviors. In this study, we introduce a novel framework for skill discovery that is entirely driven by LLMs. The framework begins with an LLM generating task proposals based on the provided scene description and the robot's configurations, aiming to incrementally acquire new skills upon task completion. For each proposed task, a series of reinforcement learning processes are initiated, utilizing reward and success determination functions sampled by the LLM to develop the corresponding policy. The reliability and trustworthiness of learned behaviors are further ensured by an independent vision-language model. We show that starting with zero skill, the ASD skill library emerges and expands to more and more meaningful and reliable skills, enabling the robot to efficiently further propose and complete advanced tasks. The project page can be found at: https://agentic-skill-discovery.github.io.


title: AdjointDEIS: Efficient Gradients for Diffusion Models

abstract: The optimization of the latents and parameters of diffusion models with respect to some differentiable metric defined on the output of the model is a challenging and complex problem. The sampling for diffusion models is done by solving either the probability flow ODE or diffusion SDE wherein a neural network approximates the score function or related quantity, allowing a numerical ODE/SDE solver to be used. However, na\"ive backpropagation techniques are memory intensive, requiring the storage of all intermediate states, and face additional complexity in handling the injected noise from the diffusion term of the diffusion SDE. We propose a novel method based on the stochastic adjoint sensitivity method to calculate the gradientwith respect to the initial noise, conditional information, and model parameters by solving an additional SDE whose solution is the gradient of the diffusion SDE. We exploit the unique construction of diffusion SDEs to further simplify the formulation of the adjoint diffusion SDE and use a change-of-variables to simplify the solution to an exponentially weighted integral. Using this formulation we derive a custom solver for the adjoint SDE as well as the simpler adjoint ODE. The proposed adjoint diffusion solvers can efficiently compute the gradients for both the probability flow ODE and diffusion SDE for latents and parameters of the model. Lastly, we demonstrate the effectiveness of the adjoint diffusion solvers onthe face morphing problem.


title: Confirmation and Characterization of the Eccentric, Warm Jupiter TIC 393818343 b with a Network of Citizen Scientists

abstract: NASA's Transiting Exoplanet Survey Satellite (TESS) has identified over 7,000 candidate exoplanets via the transit method, with gas giants among the most readily detected due to their large radii. Even so, long intervals between TESS observations for much of the sky lead to candidates for which only a single transit is detected in one TESS sector, leaving those candidate exoplanets with unconstrained orbital periods. Here, we confirm the planetary nature of TIC 393818343 b, originally identified via a single TESS transit, using radial velocity data and ground-based photometric observations from citizen scientists with the Unistellar Network and Exoplanet Watch. We determine a period of $P$ = 16.24921 $\substack{+0.00010 \\ -0.00011}$ days, a mass $M_{P}$ = 4.34 $\pm$ 0.15 $M_{J}$, and semi-major axis $a$ = 0.1291 $\substack{+0.0021 \\ -0.0022}$ au, placing TIC 393818343 b in the "warm Jupiter" population of exoplanets. With an eccentricity $e$ = 0.6058 $\pm$ 0.0023, TIC 393818343 b is the most eccentric warm Jupiter to be discovered by TESS orbiting less than 0.15 au from its host star and therefore an excellent candidate for follow-up, as it may inform our future understanding of how hot and warm Jupiter populations are linked.


title: Evidence of the quantum-optical nature of high-harmonic generation

abstract: High-harmonic generation is a light up-conversion process occurring in a strong laser field, leading to coherent bursts of extreme ultrashort broadband radiation [1]. As a new perspective, we propose that ultrafast strong-field electronic or photonic processes such as high-harmonic generation can potentially generate non-classical states of light well before the decoherence of the system occurs [2, 3]. This could address fundamental challenges in quantum technology such as scalability, decoherence or the generation of massively entangled states [4]. Here, we report experimental evidence of the non-classical nature of the harmonic emission in several semiconductors excited by a femtosecond infrared laser. By investigating single- and double beam intensity cross-correlation [5], we measure characteristic, non-classical features in the single photon statistics. We observe two-mode squeezing in the generated harmonic radiation, which depends on the laser intensity that governs the transition from Super-Poissonian to Poissonian photon statistics. The measured violation of the Cauchy-Schwarz inequality realizes a direct test of multipartite entanglement in high-harmonic generation [6]. This result is supported by the theory of multimodal detection and the Hamiltonian from which the effective squeezing modes of the harmonics can be derived [7, 8]. With this work, we show experimentally that high-harmonic generation is a new quantum bosonic platform that intrinsically produces non-classical states of light with unique features such as multipartite broadband entanglement or multimode squeezing. The source operates at room temperature using standard semiconductors and a standard commercial fiber laser, opening new routes for the quantum industry, such as optical quantum computing, communication and imaging.


title: ROB 204: Introduction to Human-Robot Systems at the University of Michigan, Ann Arbor

abstract: The University of Michigan Robotics program focuses on the study of embodied intelligence that must sense, reason, act, and work with people to improve quality of life and productivity equitably across society. ROB 204, part of the core curriculum towards the undergraduate degree in Robotics, introduces students to topics that enable conceptually designing a robotic system to address users' needs from a sociotechnical context. Students are introduced to human-robot interaction (HRI) concepts and the process for socially-engaged design with a Learn-Reinforce-Integrate approach. In this paper, we discuss the course topics and our teaching methodology, and provide recommendations for delivering this material. Overall, students leave the course with a new understanding and appreciation for how human capabilities can inform requirements for a robotics system, how humans can interact with a robot, and how to assess the usability of robotic systems.


title: The 18 May 2024 superbolide over the Iberian Peninsula: USG space sensors and ground-based independent observations

abstract: On 18 May 2024, a superbolide traversed the western part of the Iberian Peninsula, culminating its flight over the Atlantic Ocean and generating significant media attention. This event was caused by a weak carbonaceous meteoroid of 89.8$\pm$0.4 cm, with a density of 1660 kg/m$^{3}$, entering the atmosphere at 41.6 km/s$^{1}$ with an angle of 10.9$^\circ$. The luminous phase started at 138 km and ended at an altitude of 54 km. The meteoroid's heliocentric orbit was characterized by an inclination of 15.4$^\circ$, a high eccentricity of 0.965, a semi-major axis of 3 au, and a notably short perihelion distance of 0.11 au. The superbolide was recorded by multiple ground-based stations of the Spanish Meteor Network (SPMN), the European Space Agency (ESA), and the U.S. Government (USG) space sensors. Our analysis shows a relatively good agreement with the radiant and velocity data reported by the Center for Near-Earth Object Studies (CNEOS), with a deviation of 1$^\circ$ and 1.2 km/s$^{1}$, respectively. Due to the absence of observable deceleration, we successfully reconciled satellite radiometric data with a purely dynamic atmospheric flight model, constraining the meteoroid's mass and coherently fitting its velocity profile. The inferred bulk density and aerodynamic strength of the meteoroid from the flight model are compatible with the properties recently measured for sample-returned materials from asteroid Bennu. The physical properties and the orbital results suggest that this meteoroid originated from a recent disruption of a comet, indicating the existence of hazardous meter-sized projectiles arriving on Earth from objects formed in the distant regions of the Solar System.


title: OAC: Output-adaptive Calibration for Accurate Post-training Quantization

abstract: Deployment of Large Language Models (LLMs) has major computational costs, due to their rapidly expanding size. Compression of LLMs reduces the memory footprint, latency, and energy required for their inference. Post-training Quantization (PTQ) techniques have been developed to compress LLMs while avoiding expensive re-training. Most PTQ approaches formulate the quantization error based on a layer-wise $\ell_2$ loss, ignoring the model output. Then, each layer is calibrated using its layer-wise Hessian to update the weights towards minimizing the $\ell_2$ quantization error. The Hessian is also used for detecting the most salient weights to quantization. Such PTQ approaches are prone to accuracy drop in low-precision quantization. We propose Output-adaptive Calibration (OAC) to incorporate the model output in the calibration process. We formulate the quantization error based on the distortion of the output cross-entropy loss. OAC approximates the output-adaptive Hessian for each layer under reasonable assumptions to reduce the computational complexity. The output-adaptive Hessians are used to update the weight matrices and detect the salient weights towards maintaining the model output. Our proposed method outperforms the state-of-the-art baselines such as SpQR and BiLLM, especially, at extreme low-precision (2-bit and binary) quantization.


title: Enhancing Student Feedback Using Predictive Models in Visual Literacy Courses

abstract: Peer review is a popular feedback mechanism in higher education that actively engages students and provides researchers with a means to assess student engagement. However, there is little empirical support for the durability of peer review, particularly when using data predictive modeling to analyze student comments. This study uses Na\"ive Bayes modeling to analyze peer review data obtained from an undergraduate visual literacy course over five years. We expand on the research of Friedman and Rosen and Beasley et al. by focusing on the Na\"ive Bayes model of students' remarks. Our findings highlight the utility of Na\"ive Bayes modeling, particularly in the analysis of student comments based on parts of speech, where nouns emerged as the prominent category. Additionally, when examining students' comments using the visual peer review rubric, the lie factor emerged as the predominant factor. Comparing Na\"ive Bayes model to Beasley's approach, we found both help instructors map directions taken in the class, but the Na\"ive Bayes model provides a more specific outline for forecasting with a more detailed framework for identifying core topics within the course, enhancing the forecasting of educational directions. Through the application of the Holdout Method and $\mathrm{k}$-fold cross-validation with continuity correction, we have validated the model's predictive accuracy, underscoring its effectiveness in offering deep insights into peer review mechanisms. Our study findings suggest that using predictive modeling to assess student comments can provide a new way to better serve the students' classroom comments on their visual peer work. This can benefit courses by inspiring changes to course content, reinforcement of course content, modification of projects, or modifications to the rubric itself.


title: 1991T-like Supernovae

abstract: Understanding the nature of the luminous 1991T-like supernovae is of great importance to supernova cosmology as they are likely to have been more common in the early universe. In this paper we explore the observational properties of 1991T-like supernovae to study their relationship to other luminous, slow-declining Type~Ia supernovae (SNe Ia). From the spectroscopic and photometric criteria defined in Phillips et al. (1992), we identify 17 1991T-like supernovae from the literature. Combining these objects with ten 1991T-like supernovae from the Carnegie Supernova Project-II, the spectra, light curves, and colors of these events, along with their host galaxy properties, are examined in detail. We conclude that 1991T-like supernovae are closely related in essentially all of their UV, optical, and near-infrared properties -- as well as their host galaxy parameters -- to the slow-declining subset of Branch core-normal supernovae and to the intermediate 1999aa-like events, forming a continuum of luminous SNe Ia. The overriding difference between these three subgroups appears to be the extent to which $^{56}$Ni mixes into the ejecta, producing the pre-maximum spectra dominated by Fe III absorption, the broader UV light curves, and the higher luminosities that characterize the 1991T-like events. Nevertheless, the association of 1991T-like SNe with the rare Type Ia CSM supernovae would seem to run counter to this hypothesis, in which case 1991T-like events may form a separate subclass of SNe Ia, possibly arising from single-degenerate progenitor systems.


title: AGRaME: Any-Granularity Ranking with Multi-Vector Embeddings

abstract: Ranking is a fundamental and popular problem in search. However, existing ranking algorithms usually restrict the granularity of ranking to full passages or require a specific dense index for each desired level of granularity. Such lack of flexibility in granularity negatively affects many applications that can benefit from more granular ranking, such as sentence-level ranking for open-domain question-answering, or proposition-level ranking for attribution. In this work, we introduce the idea of any-granularity ranking, which leverages multi-vector embeddings to rank at varying levels of granularity while maintaining encoding at a single (coarser) level of granularity. We propose a multi-granular contrastive loss for training multi-vector approaches, and validate its utility with both sentences and propositions as ranking units. Finally, we demonstrate the application of proposition-level ranking to post-hoc citation addition in retrieval-augmented generation, surpassing the performance of prompt-driven citation generation.


title: Layers of planar hexagonal heterostructure modeled by quantum graphs

abstract: The work presents a study on the quantum theory of periodic graphs applied to mono- and bilayer hexagonal materials. Different parameters associated with the atoms present at the vertices of these materials were analyzed, verifying the existence of gaps in the spectral bands and expressing the width of these openings according to the parameters. The study was extended to heterostructures with mixed layers and "sandwiches" of graphene and hexagonal boron nitride. The dispersion relationships obtained in these models were analyzed and it was concluded that the inclusion of hBN layers on graphene layers can induce a gap in the graphene. Furthermore, it was observed that the inclusion of a single layer of graphene between two layers of hBN reduces the width of the spectral gap. The interaction between carbon atoms and nitrogen and boron atoms was pointed out as responsible for these results. Finally, the inclusion of a magnetic field in the hBN layer was considered, demonstrating that specific values of magnetic flux can eliminate conical touches in the dispersion relation of the operator and ensure the existence of gaps.

categories: math-ph cond-mat.mes-hall math.FA math.MP math.SP


title: Generation of vortex electrons by atomic photoionization

abstract: We explore the process of orbital angular momentum (OAM) transfer from a twisted light beam to an electron in atomic ionization within the first Born approximation. The characteristics of the ejected electron are studied regardless of the detection scheme. We find that the outgoing electron possesses a definite projection of OAM when a single atom is located on the propagation axis of the photon, whereas the size of the electron wave packet is solely determined by the energy of the photon rather than by its transverse coherence length. Shifting the position of the atom yields a finite dispersion of the electron OAM. We also study a more experimentally feasible scenario -- a localized finite-sized atomic target -- and develop representative approaches to describing coherent and incoherent regimes of photoionization.

categories: physics.atom-ph hep-ph physics.optics quant-ph


title: Amortized nonmyopic active search via deep imitation learning

abstract: Active search formalizes a specialized active learning setting where the goal is to collect members of a rare, valuable class. The state-of-the-art algorithm approximates the optimal Bayesian policy in a budget-aware manner, and has been shown to achieve impressive empirical performance in previous work. However, even this approximate policy has a superlinear computational complexity with respect to the size of the search problem, rendering its application impractical in large spaces or in real-time systems where decisions must be made quickly. We study the amortization of this policy by training a neural network to learn to search. To circumvent the difficulty of learning from scratch, we appeal to imitation learning techniques to mimic the behavior of the expert, expensive-to-compute policy. Our policy network, trained on synthetic data, learns a beneficial search strategy that yields nonmyopic decisions carefully balancing exploration and exploitation. Extensive experiments demonstrate our policy achieves competitive performance at real-world tasks that closely approximates the expert's at a fraction of the cost, while outperforming cheaper baselines.


title: Aya 23: Open Weight Releases to Further Multilingual Progress

abstract: This technical report introduces Aya 23, a family of multilingual language models. Aya 23 builds on the recent release of the Aya model (\"Ust\"un et al., 2024), focusing on pairing a highly performant pre-trained model with the recently released Aya collection (Singh et al., 2024). The result is a powerful multilingual large language model serving 23 languages, expanding state-of-art language modeling capabilities to approximately half of the world's population. The Aya model covered 101 languages whereas Aya 23 is an experiment in depth vs breadth, exploring the impact of allocating more capacity to fewer languages that are included during pre-training. Aya 23 outperforms both previous massively multilingual models like Aya 101 for the languages it covers, as well as widely used models like Gemma, Mistral and Mixtral on an extensive range of discriminative and generative tasks. We release the open weights for both the 8B and 35B models as part of our continued commitment for expanding access to multilingual progress.


title: Generating camera failures as a class of physics-based adversarial examples

abstract: While there has been extensive work on generating physics-based adversarial samples recently, an overlooked class of such samples come from physical failures in the camera. Camera failures can occur as a result of an external physical process, i.e. breakdown of a component due to stress, or an internal component failure. In this work, we develop a simulated physical process for generating broken lens as a class of physics-based adversarial samples. We create a stress-based physical simulation by generating particles constrained in a mesh and apply stress at a random point and at a random angle. We perform stress propagation through the mesh and the end result of the mesh is a corresponding image which simulates the broken lens pattern. We also develop a neural emulator which learns the non-linear mapping between the mesh as a graph and the stress propagation using constrained propagation setup. We can then statistically compare the difference between the generated adversarial samples with real, simulated and emulated adversarial examples using the detection failure rate of the different classes and in between the samples using the Frechet Inception distance. Our goal through this work is to provide a robust physics based process for generating adversarial samples.


title: NeCGS: Neural Compression for 3D Geometry Sets

abstract: This paper explores the problem of effectively compressing 3D geometry sets containing diverse categories. We make \textit{the first} attempt to tackle this fundamental and challenging problem and propose NeCGS, a neural compression paradigm, which can compress hundreds of detailed and diverse 3D mesh models (~684 MB) by about 900 times (0.76 MB) with high accuracy and preservation of detailed geometric details. Specifically, we first represent each irregular mesh model/shape in a regular representation that implicitly describes the geometry structure of the model using a 4D regular volume, called TSDF-Def volume. Such a regular representation can not only capture local surfaces more effectively but also facilitate the subsequent process. Then we construct a quantization-aware auto-decoder network architecture to regress these 4D volumes, which can summarize the similarity of local geometric structures within a model and across different models for redundancy limination, resulting in more compact representations, including an embedded feature of a smaller size associated with each model and a network parameter set shared by all models. We finally encode the resulting features and network parameters into bitstreams through entropy coding. After decompressing the features and network parameters, we can reconstruct the TSDF-Def volumes, where the 3D surfaces can be extracted through the deformable marching cubes.Extensive experiments and ablation studies demonstrate the significant advantages of our NeCGS over state-of-the-art methods both quantitatively and qualitatively.


title: Monge-Amp\`ere gravity, optimal transport theory and their link to the Galileons

abstract: Mathematicians have been proposing for sometimes that Monge-Amp\`ere equation, a nonlinear generalization of the Poisson equation, where trace of the Hessian is replaced by its determinant, provides an alternative non-relativistic description of gravity. Monge-Amp\`ere equation is affine invariant, has rich geometric properties, connects to optimal transport theory, and remains bounded at short distances. Monge-Amp\`ere gravity, that uses a slightly different form of the Monge-Amp\`ere equation, naturally emerges through the application of large-deviation principle to a Brownian system of indistinguishable and independent particles. In this work we provide a physical formulation of this mathematical model, study its theoretical viability and confront it with observations. We show that Monge-Amp\`ere gravity cannot replace the Newtonian gravity as it does not withstand the solar-system test. We then show that Monge-Amp\`ere gravity can describe a scalar field, often evoked in modified theories of gravity such as Galileons. We show that Monge-Amp\`ere gravity, as a nonlinear model of a new scalar field, is screened at short distances, and behaves differently from Newtonian gravity above galactic scales but approaches it asymptotically. Finally, we write a relativistic Lagrangian for Monge-Amp\`ere gravity in flat space time, which is the field equation of a sum of the Lagrangians of all Galileons. We also show how the Monge-Amp\`ere equation can be obtained from the fully covariant Lagrangian of quartic Galileon in the static limit. The connection between optimal transport theory and modified theories of gravity with second-order field equations, unravelled here, remains a promising domain to further explore.


title: Input-driven circuit reconfiguration in critical recurrent neural networks

abstract: Changing a circuit dynamically, without actually changing the hardware itself, is called reconfiguration, and is of great importance due to its manifold technological applications. Circuit reconfiguration appears to be a feature of the cerebral cortex, and hence understanding the neuroarchitectural and dynamical features underlying self-reconfiguration may prove key to elucidate brain function. We present a very simple single-layer recurrent network, whose signal pathways can be reconfigured "on the fly" using only its inputs, with no changes to its synaptic weights. We use the low spatio-temporal frequencies of the input to landscape the ongoing activity, which in turn permits or denies the propagation of traveling waves. This mechanism uses the inherent properties of dynamically-critical systems, which we guarantee through unitary convolution kernels. We show this network solves the classical connectedness problem, by allowing signal propagation only along the regions to be evaluated for connectedness and forbidding it elsewhere.


title: "This really lets us see the entire world:" Designing a conversational telepresence robot for homebound older adults

abstract: In this paper, we explore the design and use of conversational telepresence robots to help homebound older adults interact with the external world. An initial needfinding study (N=8) using video vignettes revealed older adults' experiential needs for robot-mediated remote experiences such as exploration, reminiscence and social participation. We then designed a prototype system to support these goals and conducted a technology probe study (N=11) to garner a deeper understanding of user preferences for remote experiences. The study revealed user interactive patterns in each desired experience, highlighting the need of robot guidance, social engagements with the robot and the remote bystanders. Our work identifies a novel design space where conversational telepresence robots can be used to foster meaningful interactions in the remote physical environment. We offer design insights into the robot's proactive role in providing guidance and using dialogue to create personalized, contextualized and meaningful experiences.


title: Preferential Latent Space Models for Networks with Textual Edges

abstract: Many real-world networks contain rich textual information in the edges, such as email networks where an edge between two nodes is an email exchange. Other examples include co-author networks and social media networks. The useful textual information carried in the edges is often discarded in most network analyses, resulting in an incomplete view of the relationships between nodes. In this work, we propose to represent the text document between each pair of nodes as a vector counting the appearances of keywords extracted from the corpus, and introduce a new and flexible preferential latent space network model that can offer direct insights on how contents of the textual exchanges modulate the relationships between nodes. We establish identifiability conditions for the proposed model and tackle model estimation with a computationally efficient projected gradient descent algorithm. We further derive the non-asymptotic error bound of the estimator from each step of the algorithm. The efficacy of our proposed method is demonstrated through simulations and an analysis of the Enron email network.


title: CEEBERT: Cross-Domain Inference in Early Exit BERT

abstract: Pre-trained Language Models (PLMs), like BERT, with self-supervision objectives exhibit remarkable performance and generalization across various tasks. However, they suffer in inference latency due to their large size. To address this issue, side branches are attached at intermediate layers, enabling early inference of samples without requiring them to pass through all layers. However, the challenge is to decide which layer to infer and exit each sample so that the accuracy and latency are balanced. Moreover, the distribution of the samples to be inferred may differ from that used for training necessitating cross-domain adaptation. We propose an online learning algorithm named Cross-Domain Inference in Early Exit BERT (CeeBERT) that dynamically determines early exits of samples based on the level of confidence at each exit point. CeeBERT learns optimal thresholds from domain-specific confidence observed at intermediate layers on the fly, eliminating the need for labeled data. Experimental results on five distinct datasets with BERT and ALBERT models demonstrate CeeBERT's ability to improve latency by reducing unnecessary computations with minimal drop in performance. By adapting to the threshold values, CeeBERT can speed up the BERT/ALBERT models by $2\times$ - $3.5\times$ with minimal drop in accuracy.


title: Two-dimensional electrons at internal and twistronic twin boundaries of van der Waals ferroelectrics

abstract: Semiconducting transition metal dichalcogenides (MX$_2$) occur in 2H and rhombohedral polytypes, respectively distinguished by anti-parallel and parallel orientation of consecutive monolayer lattices. In its bulk form, rhombohedral MX$_2$ is ferroelectric, hosting an out-of-plane electric polarization, the direction of which is dictated by stacking. Here, we predict that twin boundaries, separating adjacent polarization domains with reversed built-in electric fields, are able to host two-dimensional electrons and holes with an areal density reaching $\sim 10^{13} {\rm cm}^{-2}$. Our modelling suggests that n-doped twin boundaries have a more promising binding energy than p-doped ones, whereas hole accumulation is stable at external surfaces of a twinned film. We also propose that the introduction of a twist at the twinned interface, with a `magic' angle $\theta^* \approx 3^{\circ}$, should promote a regime of strongly correlated states of electrons, such as Wigner crystals, due to commensurability between the moir\'e pattern at the interface and the accumulated carrier density.


title: Estimation and goodness-of-fit testing for positive random variables with explicit Laplace transform

abstract: Many flexible families of positive random variables exhibit non-closed forms of the density and distribution functions and this feature is considered unappealing for modelling purposes. However, such families are often characterized by a simple expression of the corresponding Laplace transform. Relying on the Laplace transform, we propose to carry out parameter estimation and goodness-of-fit testing for a general class of non-standard laws. We suggest a novel data-driven inferential technique, providing parameter estimators and goodness-of-fit tests, whose large-sample properties are derived. The implementation of the method is specifically considered for the positive stable and Tweedie distributions. A Monte Carlo study shows good finite-sample performance of the proposed technique for such laws.


title: Modularity, Higher-Order Recombination, and New Venture Success

abstract: Modularity is critical for the emergence and evolution of complex social, natural, and technological systems robust to exploratory failure. We consider this in the context of emerging business organizations, which can be understood as complex systems. We build a theory of organizational emergence as higher-order, modular recombination wherein successful start-ups assemble novel combinations of successful modular components, rather than engage in the lower-order combination of disparate, singular components. Lower-order combinations are critical for long-term socio-economic transformation, but manifest diffuse benefits requiring support as public goods. Higher-order combinations facilitate rapid experimentation and attract private funding. We evaluate this with U.S. venture-funded start-ups over 45 years using company descriptions. We build a dynamic semantic space with word embedding models constructed from evolving business discourse, which allow us to measure the modularity of and distance between new venture components. Using event history models, we demonstrate how ventures more likely achieve successful IPOs and high-priced acquisitions when they combine diverse modules of clustered components. We demonstrate how higher-order combination enables venture success by accelerating firm development and diversifying investment, and we reflect on its implications for social innovation.


title: On Bivariate Jacobi Konhauser Polynomials

abstract: Recently, \"Ozarslan and Elidemir (2023) introduced a methodology for constructing two-variable biorthogonal polynomial families with the help of one-variable biorthogonal and orthogonal polynomial families. The primary objective of the paper is to introduce novel class of two-variable biorthogonal polynomials namley bivariate Jacobi Konhauser polynomials. We investigate several fundamental properties of these polynomials including their biorthogonality property, operational formula, generating function, and integral representation. Furthermore, We inverstigate their images under the Laplace transform, fractional integral and derivative operators. Corresponding to these polynomials, we define the new type bivariate Jacobi Konhauser Mittag Leffler (JKML) function and obtain the similar properties for them.


title: Signature, slicing foams, and crossing changes of Klein graphs

abstract: A totally oriented Klein graph is a trivalent spatial graph in the 3-sphere with a 3-coloring of its edges and an orientation on each bicolored link. A totally oriented Klein foam is a 3-colored 2-complex in the 4-ball whose boundary is a Klein foam and whose bicolored surfaces are oriented. We extend Gille-Robert's signature for 3-Hamiltonian Klein graphs to all totally oriented Klein graphs and develop an analogy of Murasugi's bounds relating the signature, slice genus and unknotting number of knots. In particular, we show that the signature of a totally oriented Klein graph produces a lower bound on the negative orbifold Euler characteristic of certain totally oriented Klein foams bounded by $\Gamma$. When $\Gamma$ is abstractly planar, these negative Euler characteristics, in turn, produce a lower bound on a certain natural unknotting number for $\Gamma$. Mutatis mutandi, we produce lower bounds on the corresponding Gordian distance between two totally oriented Klein graphs that can be related by a sequence of crossing changes. We also give examples of theta-curves for which our lower bounds on unknotting number improve on previously known bounds.


title: Impact of Turbulent Magnetic Fields on Disk Formation and Fragmentation in First Star Formation

abstract: Recent cosmological hydrodynamic simulations have suggested that the first stars in the universe often form as binary or multiple systems. However, previous studies typically overlooked the potential influence of magnetic fields during this process, assuming them to be weak and minimally impactful. Emerging theoretical investigations, however, propose an alternative perspective, suggesting that turbulent dynamo effects within first-star forming clouds can generate strong magnetic fields. In this study, we perform three-dimensional ideal magnetohydrodynamics simulations, starting from the gravitational collapse of a turbulent cloud core to the early accretion phase, where disk fragmentation frequently occurs. Our findings reveal that turbulent magnetic fields, if they reach an equipartition level with turbulence energy across all scales during the collapse phase, can significantly affect the properties of the multiple systems. Specifically, both magnetic pressure and torques contribute to disk stabilization, leading to a reduction in the number of fragments, particularly for low-mass stars. Additionally, our observations indicate the launching of protostellar jets driven by magnetic pressure of toroidal fields, although their overall impact on star formation dynamics appears to be minor. Given the case with which seed magnetic fields amplify to the full equipartition level, our results suggest that magnetic fields likely play a significant role in shaping the initial mass function of the first stars, highlighting the importance of magnetic effects on star formation in the early universe.


title: On the minimum spectral radius of connected graphs of given order and size

abstract: In this paper, we study a question of Hong from 1993 related to the minimum spectral radii of the adjacency matrices of connected graphs of given order and size. Hong asked if it is true that among all connected graphs of given number of vertices $n$ and number of edges $e$, the graphs having minimum spectral radius (the minimizer graphs) must be almost regular, meaning that the difference between their maximum degree and their minimum degree is at most one. In this paper, we answer Hong's question positively for various values of $n$ and $e$ and in several cases, we determined the graphs with minimum spectral radius.


title: Credal Wrapper of Model Averaging for Uncertainty Estimation on Out-Of-Distribution Detection

abstract: This paper presents an innovative approach, called credal wrapper, to formulating a credal set representation of model averaging for Bayesian neural networks (BNNs) and deep ensembles, capable of improving uncertainty estimation in classification tasks. Given a finite collection of single distributions derived from BNNs or deep ensembles, the proposed approach extracts an upper and a lower probability bound per class, acknowledging the epistemic uncertainty due to the availability of a limited amount of sampled predictive distributions. Such probability intervals over classes can be mapped on a convex set of probabilities (a 'credal set') from which, in turn, a unique prediction can be obtained using a transformation called 'intersection probability transformation'. In this article, we conduct extensive experiments on multiple out-of-distribution (OOD) detection benchmarks, encompassing various dataset pairs (CIFAR10/100 vs SVHN/Tiny-ImageNet, CIFAR10 vs CIFAR10-C, CIFAR100 vs CIFAR100-C and ImageNet vs ImageNet-O) and using different network architectures (such as VGG16, Res18/50, EfficientNet B2, and ViT Base). Compared to BNN and deep ensemble baselines, the proposed credal representation methodology exhibits superior performance in uncertainty estimation and achieves lower expected calibration error on OOD samples.


title: Two-center problem with harmonic-like interactions: periodic orbits and integrability

abstract: We study the classical planar two-center problem of a particle $m$ subjected to harmonic-like interactions with two fixed centers. For convenient values of the dimensionless parameter of this problem we use the averaging theory for showing analytically the existence of periodic orbits bifurcating from two of the three equilibrium points of the Hamiltonian system modeling this problem. Moreover, it is shown that the system is generically non-integrable in the sense of Liouville-Arnold. The analytical results are complemented by numerical computations of the Poincar\'e sections as well as providing some explicit periodic orbits.


title: Breaking Barriers: Investigating Gender Dynamics in Introductory Physics Lab Classes

abstract: The persistent underrepresentation of women and other gender minorities in physical science fields has been an ongoing concern. This study investigates gender dynamics in introductory physics laboratory courses, specifically exploring whether students of different gender identities exhibit equal inclination and confidence in conducting lab experiments, and whether they face barriers that impact their participation. The study was conducted across three institutions, involving non-physics students enrolled in algebra-based and calculus-based physics courses. Our findings reveal no significant differences in participation levels across genders in various lab activities. However, a subtle yet significant trended was observed: non-male students tend to express greater preferences and comfort levels for note-taking, calculations, and graphing tasks compared to their male counterparts, who gravitated more towards hands-on equipment handling. Although no overt barriers deterring participation based solely on gender were identified, some students reported experiences or witnessed instances where gender dynamics hindered full engagement, such as assumptions about competence or difficulty asserting voices in male-dominated groups. These findings contribute insights into potential gender-based inclinations and experiences within laboratory environments. The results underscore the importance of fostering an inclusive climate that encourages equitable opportunities and engagement from all gender identities in scientific exploration and learning.


title: Provably Efficient Reinforcement Learning for Infinite-Horizon Average-Reward Linear MDPs

abstract: We resolve the open problem of designing a computationally efficient algorithm for infinite-horizon average-reward linear Markov Decision Processes (MDPs) with $\widetilde{O}(\sqrt{T})$ regret. Previous approaches with $\widetilde{O}(\sqrt{T})$ regret either suffer from computational inefficiency or require strong assumptions on dynamics, such as ergodicity. In this paper, we approximate the average-reward setting by the discounted setting and show that running an optimistic value iteration-based algorithm for learning the discounted setting achieves $\widetilde{O}(\sqrt{T})$ regret when the discounting factor $\gamma$ is tuned appropriately. The challenge in the approximation approach is to get a regret bound with a sharp dependency on the effective horizon $1 / (1 - \gamma)$. We use a computationally efficient clipping operator that constrains the span of the optimistic state value function estimate to achieve a sharp regret bound in terms of the effective horizon, which leads to $\widetilde{O}(\sqrt{T})$ regret.


title: From Explainable to Interactive AI: A Literature Review on Current Trends in Human-AI Interaction

abstract: AI systems are increasingly being adopted across various domains and application areas. With this surge, there is a growing research focus and societal concern for actively involving humans in developing, operating, and adopting these systems. Despite this concern, most existing literature on AI and Human-Computer Interaction (HCI) primarily focuses on explaining how AI systems operate and, at times, allowing users to contest AI decisions. Existing studies often overlook more impactful forms of user interaction with AI systems, such as giving users agency beyond contestability and enabling them to adapt and even co-design the AI's internal mechanics. In this survey, we aim to bridge this gap by reviewing the state-of-the-art in Human-Centered AI literature, the domain where AI and HCI studies converge, extending past Explainable and Contestable AI, delving into the Interactive AI and beyond. Our analysis contributes to shaping the trajectory of future Interactive AI design and advocates for a more user-centric approach that provides users with greater agency, fostering not only their understanding of AI's workings but also their active engagement in its development and evolution.


title: Revisiting MoE and Dense Speed-Accuracy Comparisons for LLM Training

abstract: Mixture-of-Experts (MoE) enjoys performance gain by increasing model capacity while keeping computation cost constant. When comparing MoE to dense models, prior work typically adopt the following setting: 1) use FLOPs or activated parameters as a measure of model complexity; 2) train all models to the same number of tokens. We argue that this setting favors MoE as FLOPs and activated parameters do not accurately measure the communication overhead in sparse layers, leading to a larger actual training budget for MoE. In this work, we revisit the settings by adopting step time as a more accurate measure of model complexity, and by determining the total compute budget under the Chinchilla compute-optimal settings. To efficiently run MoE on modern accelerators, we adopt a 3D sharding method that keeps the dense-to-MoE step time increase within a healthy range. We evaluate MoE and dense LLMs on a set of nine 0-shot and two 1-shot English tasks, as well as MMLU 5-shot and GSM8K 8-shot across three model scales at 6.4B, 12.6B, and 29.6B. Experimental results show that even under these settings, MoE consistently outperform dense LLMs on the speed-accuracy trade-off curve with meaningful gaps. Our full model implementation and sharding strategy will be released at~\url{https://github.com/apple/axlearn}


title: A Latent Variable Approach to Learning High-dimensional Multivariate longitudinal Data

abstract: High-dimensional multivariate longitudinal data, which arise when many outcome variables are measured repeatedly over time, are becoming increasingly common in social, behavioral and health sciences. We propose a latent variable model for drawing statistical inferences on covariate effects and predicting future outcomes based on high-dimensional multivariate longitudinal data. This model introduces unobserved factors to account for the between-variable and across-time dependence and assist the prediction. Statistical inference and prediction tools are developed under a general setting that allows outcome variables to be of mixed types and possibly unobserved for certain time points, for example, due to right censoring. A central limit theorem is established for drawing statistical inferences on regression coefficients. Additionally, an information criterion is introduced to choose the number of factors. The proposed model is applied to customer grocery shopping records to predict and understand shopping behavior.


title: Controlling Behavioral Diversity in Multi-Agent Reinforcement Learning

abstract: The study of behavioral diversity in Multi-Agent Reinforcement Learning (MARL) is a nascent yet promising field. In this context, the present work deals with the question of how to control the diversity of a multi-agent system. With no existing approaches to control diversity to a set value, current solutions focus on blindly promoting it via intrinsic rewards or additional loss functions, effectively changing the learning objective and lacking a principled measure for it. To address this, we introduce Diversity Control (DiCo), a method able to control diversity to an exact value of a given metric by representing policies as the sum of a parameter-shared component and dynamically scaled per-agent components. By applying constraints directly to the policy architecture, DiCo leaves the learning objective unchanged, enabling its applicability to any actor-critic MARL algorithm. We theoretically prove that DiCo achieves the desired diversity, and we provide several experiments, both in cooperative and competitive tasks, that show how DiCo can be employed as a novel paradigm to increase performance and sample efficiency in MARL. Multimedia results are available on the paper's website: https://sites.google.com/view/dico-marl.


title: CCBNet: Confidential Collaborative Bayesian Networks Inference

abstract: Effective large-scale process optimization in manufacturing industries requires close cooperation between different human expert parties who encode their knowledge of related domains as Bayesian network models. For instance, Bayesian networks for domains such as lithography equipment, processes, and auxiliary tools must be conjointly used to effectively identify process optimizations in the semiconductor industry. However, business confidentiality across domains hinders such collaboration, and encourages alternatives to centralized inference. We propose CCBNet, the first Confidentiality-preserving Collaborative Bayesian Network inference framework. CCBNet leverages secret sharing to securely perform analysis on the combined knowledge of party models by joining two novel subprotocols: (i) CABN, which augments probability distributions for features across parties by modeling them into secret shares of their normalized combination; and (ii) SAVE, which aggregates party inference result shares through distributed variable elimination. We extensively evaluate CCBNet via 9 public Bayesian networks. Our results show that CCBNet achieves predictive quality that is similar to the ones of centralized methods while preserving model confidentiality. We further demonstrate that CCBNet scales to challenging manufacturing use cases that involve 16-128 parties in large networks of 223-1003 features, and decreases, on average, computational overhead by 23%, while communicating 71k values per request. Finally, we showcase possible attacks and mitigations for partially reconstructing party networks in the two subprotocols.


title: ElastoGen: 4D Generative Elastodynamics

abstract: We present ElastoGen, a knowledge-driven model that generates physically accurate and coherent 4D elastodynamics. Instead of relying on petabyte-scale data-driven learning, ElastoGen leverages the principles of physics-in-the-loop and learns from established physical knowledge, such as partial differential equations and their numerical solutions. The core idea of ElastoGen is converting the global differential operator, corresponding to the nonlinear elastodynamic equations, into iterative local convolution-like operations, which naturally fit modern neural networks. Each network module is specifically designed to support this goal rather than functioning as a black box. As a result, ElastoGen is exceptionally lightweight in terms of both training requirements and network scale. Additionally, due to its alignment with physical procedures, ElastoGen efficiently generates accurate dynamics for a wide range of hyperelastic materials and can be easily integrated with upstream and downstream deep modules to enable end-to-end 4D generation.


title: Characterization of Nearly Self-Orthogonal Quasi-Twisted Codes and Related Quantum Codes

abstract: Quasi-twisted codes are used here as the classical ingredients in the so-called Construction X for quantum error-control codes. The construction utilizes nearly self-orthogonal codes to design quantum stabilizer codes. We expand the choices of the inner product to also cover the symplectic and trace-symplectic inner products, in addition to the original Hermitian one. A refined lower bound on the minimum distance of the resulting quantum codes is established and illustrated. We report numerous record breaking quantum codes from our randomized search for inclusion in the updated online database.


title: Remoteness of graphs with given size and connectivity constraints

abstract: Let $G$ be a finite, simple connected graph. The average distance of a vertex $v$ of $G$ is the arithmetic mean of the distances from $v$ to all other vertices of $G$. The remoteness $\rho(G)$ of $G$ is the maximum of the average distances of the vertices of $G$. In this paper, we give sharp upper bounds on the remoteness of a graph of given order, connectivity and size. We also obtain corresponding bound s for $2$-edge-connected and $3$-edge-connected graphs, and bounds in terms of order and size for triangle-free graphs.


title: Message-Passing Monte Carlo: Generating low-discrepancy point sets via Graph Neural Networks

abstract: Discrepancy is a well-known measure for the irregularity of the distribution of a point set. Point sets with small discrepancy are called low-discrepancy and are known to efficiently fill the space in a uniform manner. Low-discrepancy points play a central role in many problems in science and engineering, including numerical integration, computer vision, machine perception, computer graphics, machine learning, and simulation. In this work, we present the first machine learning approach to generate a new class of low-discrepancy point sets named Message-Passing Monte Carlo (MPMC) points. Motivated by the geometric nature of generating low-discrepancy point sets, we leverage tools from Geometric Deep Learning and base our model on Graph Neural Networks. We further provide an extension of our framework to higher dimensions, which flexibly allows the generation of custom-made points that emphasize the uniformity in specific dimensions that are primarily important for the particular problem at hand. Finally, we demonstrate that our proposed model achieves state-of-the-art performance superior to previous methods by a significant margin. In fact, MPMC points are empirically shown to be either optimal or near-optimal with respect to the discrepancy for every dimension and the number of points for which the optimal discrepancy can be determined.


title: A lightweight algorithm to model radiation damage effects in Monte Carlo events for High-Luminosity LHC experiments

abstract: Radiation damage significantly impacts the performance of silicon tracking detectors in Large Hadron Collider (LHC) experiments such as ATLAS and CMS, with signal reduction being the most critical effect; adjusting sensor bias voltage and detection thresholds can help mitigate these effects, generating simulated data that accurately mirror the performance evolution with the accumulation of luminosity, hence fluence, is crucial. The ATLAS and CMS collaborations have developed and implemented algorithms to correct simulated Monte Carlo (MC) events for radiation damage effects, achieving impressive agreement between collision data and simulated events. In preparation for the high-luminosity phase (HL-LHC), the demand for a faster ATLAS MC production algorithm becomes imperative due to escalating collision, events, tracks, and particle hit rates, imposing stringent constraints on available computing resources. This article outlines the philosophy behind the new algorithm, its implementation strategy, and the essential components involved. The results from closure tests indicate that the events simulated using the new algorithm agree with fully simulated events at the level of few \%. The first tests on computing performance show that the new algorithm is as fast as it is when no radiation damage corrections are applied.


title: Quantum Self-Propulsion of an Inhomogeneous Object out of Thermal Equilibrium

abstract: In an earlier paper, we explored how quantum vacuum torque can arise: a body or nanoparticle that is out of thermal equilibrium with its environment experiences a spontaneous torque. But this requires that the body be composed of nonreciprocal material, which seems to necessitate the presence of an external influence, such as a magnetic field. Then the electric polarizability of the particle has a real part that is nonsymmetric. This effect occurs to first order in the polarizability. To that order, no self-propulsive force can arise. Here, we consider second-order effects, and show that spontaneous forces can arise in vacuum, without requiring exotic electromagnetic properties. Thermal nonequilibrium is still necessary, but the electric susceptibility of the body need only be inhomogeneous. We investigate four examples of such a body: a needle composed of distinct halves; a sphere and a ball, each hemisphere being made of a different substance; and a thin slab, each face of which is different. The results found are consistent with previous numerical investigations. Here, we take into account the skin depth of metal surfaces. We also consider the frictional forces that would cause the body to acquire a terminal velocity, which might be observable. More likely to be important is relaxation to thermal equilibrium, which can still lead to a readily observable terminal velocity. A general treatment of such forces on a moving body, expressed in momentum space, is provided, which incorporates both propulsive and frictional forces. The source of the propulsive force is the nonsymmetric pattern of radiation from different parts of the body, the higher reflectivity of the metal portion playing a crucial role.


title: Model-Agnostic Utility-Preserving Biometric Information Anonymization

abstract: The recent rapid advancements in both sensing and machine learning technologies have given rise to the universal collection and utilization of people's biometrics, such as fingerprints, voices, retina/facial scans, or gait/motion/gestures data, enabling a wide range of applications including authentication, health monitoring, or much more sophisticated analytics. While providing better user experiences and deeper business insights, the use of biometrics has raised serious privacy concerns due to their intrinsic sensitive nature and the accompanying high risk of leaking sensitive information such as identity or medical conditions. In this paper, we propose a novel modality-agnostic data transformation framework that is capable of anonymizing biometric data by suppressing its sensitive attributes and retaining features relevant to downstream machine learning-based analyses that are of research and business values. We carried out a thorough experimental evaluation using publicly available facial, voice, and motion datasets. Results show that our proposed framework can achieve a \highlight{high suppression level for sensitive information}, while at the same time retain underlying data utility such that subsequent analyses on the anonymized biometric data could still be carried out to yield satisfactory accuracy.


title: A classification model based on a population of hypergraphs

abstract: This paper introduces a novel hypergraph classification algorithm. The use of hypergraphs in this framework has been widely studied. In previous work, hypergraph models are typically constructed using distance or attribute based methods. That is, hyperedges are generated by connecting a set of samples which are within a certain distance or have a common attribute. These methods however, do not often focus on multi-way interactions directly. The algorithm provided in this paper looks to address this problem by constructing hypergraphs which explore multi-way interactions of any order. We also increase the performance and robustness of the algorithm by using a population of hypergraphs. The algorithm is evaluated on two datasets, demonstrating promising performance compared to a generic random forest classification algorithm.


title: Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning

abstract: Spatial reasoning plays a vital role in both human cognition and machine intelligence, prompting new research into language models' (LMs) capabilities in this regard. However, existing benchmarks reveal shortcomings in evaluating qualitative spatial reasoning (QSR). These benchmarks typically present oversimplified scenarios or unclear natural language descriptions, hindering effective evaluation. We present a novel benchmark for assessing QSR in LMs, which is grounded in realistic 3D simulation data, offering a series of diverse room layouts with various objects and their spatial relationships. This approach provides a more detailed and context-rich narrative for spatial reasoning evaluation, diverging from traditional, toy-task-oriented scenarios. Our benchmark encompasses a broad spectrum of qualitative spatial relationships, including topological, directional, and distance relations. These are presented with different viewing points, varied granularities, and density of relation constraints to mimic real-world complexities. A key contribution is our logic-based consistency-checking tool, which enables the assessment of multiple plausible solutions, aligning with real-world scenarios where spatial relationships are often open to interpretation. Our benchmark evaluation of advanced LMs reveals their strengths and limitations in spatial reasoning. They face difficulties with multi-hop spatial reasoning and interpreting a mix of different view descriptions, pointing to areas for future improvement.


title: Direct Preference Optimization With Unobserved Preference Heterogeneity

abstract: RLHF has emerged as a pivotal step in aligning language models with human objectives and values. It typically involves learning a reward model from human preference data and then using reinforcement learning to update the generative model accordingly. Conversely, Direct Preference Optimization (DPO) directly optimizes the generative model with preference data, skipping reinforcement learning. However, both RLHF and DPO assume uniform preferences, overlooking the reality of diverse human annotators. This paper presents a new method to align generative models with varied human preferences. We propose an Expectation-Maximization adaptation to DPO, generating a mixture of models based on latent preference types of the annotators. We then introduce a min-max regret ensemble learning model to produce a single generative method to minimize worst-case regret among annotator subgroups with similar latent factors. Our algorithms leverage the simplicity of DPO while accommodating diverse preferences. Experimental results validate the effectiveness of our approach in producing equitable generative policies.


title: Agile Culture Clash: Unveiling Challenges in Cultivating an Agile Mindset in Organizations

abstract: Context: In agile transformations, there are many challenges such as alignment between agile practices and the organizational goals and strategies or issues with shifts in how work is organized and executed. One very important challenge but less considered and treated in research are cultural challenges associated with an agile mindset. Although research shows that cultural clashes and general organizational resistance to change are part of the most significant agile adoption barriers. Objective: We identify challenges that arise from the interplay between agile culture and organizational culture. In doing so, we tackle this field and come up with important contributions for further research regarding a problem that practitioners face today. Method: This is done with a mixed-method research approach. First, we gathered qualitative data among our network of agile practitioners and derived in sum 15 challenges with agile culture. Then, we conducted quantitative data by means of a questionnaire study with 92 participants. Results: We identified 7 key challenges out of the 15 challenges with agile culture. These key challenges refer to the technical agility (doing agile) and the cultural agility (being agile). The results are presented in type of a conceptual model named the Agile Cultural Challenges (ACuCa). Conclusion: Based on our results, we started deriving future work aspects to do more detailed research on the topic of cultural challenges while transitioning or using agile methods in software development and beyond.


title: Promoting Constructive Deliberation: Reframing for Receptiveness

abstract: To promote constructive discussion of controversial topics online, we propose automatic reframing of disagreeing responses to signal receptiveness to a preceding comment. Drawing on research from psychology, communications, and linguistics, we identify six strategies for reframing. We automatically reframe replies to comments according to each strategy, using a Reddit dataset. Through human-centered experiments, we find that the replies generated with our framework are perceived to be significantly more receptive than the original replies and a generic receptiveness baseline. We illustrate how transforming receptiveness, a particular social science construct, into a computational framework, can make LLM generations more aligned with human perceptions. We analyze and discuss the implications of our results, and highlight how a tool based on our framework might be used for more teachable and creative content moderation.


title: Rapid Sensing of Heat Stress using Machine Learning of Micrographs of Red Blood Cells Dispersed in Liquid Crystals

abstract: An imbalance between bodily heat production and heat dissipation leads to heat stress in organisms. In addition to diminished animal well-being, heat stress is detrimental to the poultry industry as poultry entails fast growth and high yield, resulting in greater metabolic activity and higher body heat production. When stressed, cells overexpress heat shock proteins (such as HSP70, a well-established intracellular stress indicator) and may undergo changes in their mechanical properties. Liquid crystals (LCs, fluids with orientational order) have been recently employed to rapidly characterize changes in mechanical properties of cells enabling a means of optically reporting the presence of disease in organisms. In this work, we explore the difference in the expression of HSP70 to a change in the LC response pattern via the use of convolutional neural networks (CNNs). The machine-learning (ML) models were trained on hundreds of such LC-response micrographs of chicken red blood cells with and without heat stress. Trained models exhibited remarkable accuracy of up to 99% on detecting the presence of heat stress in unseen microscope samples. We also show that crosslinking the chicken and human RBCs using glutaraldehyde in order to simulate a diseased cell was an efficient strategy for planning, building, training, and evaluating ML models. Overall, our efforts build towards the rapid detection of disease in organisms, which is accompanied by a distinct change in the mechanical properties of cells. We aim to eventuate CNN-enabled LC-sensors can rapidly report the presence of disease in scenarios where human judgment could be prohibitively difficult or slow.


title: Dynamic, Symmetry-Preserving, and Hardware-Adaptable Circuits for Quantum Computing Many-Body States and Correlators of the Anderson Impurity Model

abstract: We present a hardware-reconfigurable ansatz on $N_q$-qubits for the variational preparation of many-body states of the Anderson impurity model (AIM) with $N_{\text{imp}}+N_{\text{bath}}=N_q/2$ sites, which conserves total charge and spin z-component within each variational search subspace. The many-body ground state of the AIM is determined as the minimum over all minima of $O(N_q^2)$ distinct charge-spin sectors. Hamiltonian expectation values are shown to require $\omega(N_q) < N_{\text{meas.}} \leq O(N_{\text{imp}}N_{\text{bath}})$ symmetry-preserving, parallelizable measurement circuits, each amenable to post-selection. To obtain the one-particle impurity Green's function we show how initial Krylov vectors can be computed via mid-circuit measurement and how Lanczos iterations can be computed using the symmetry-preserving ansatz. For a single-impurity Anderson model with a number of bath sites increasing from one to six, we show using numerical emulation that the ease of variational ground-state preparation is suggestive of linear scaling in circuit depth and sub-quartic scaling in optimizer complexity. We therefore expect that, combined with time-dependent methods for Green's function computation, our ansatz provides a useful tool to account for electronic correlations on early fault-tolerant processors. Finally, with a view towards computing real materials properties of interest like magnetic susceptibilities and electron-hole propagators, we provide a straightforward method to compute many-body, time-dependent correlation functions using a combination of time evolution, mid-circuit measurement-conditioned operations, and the Hadamard test.


title: Optimizing example selection for retrieval-augmented machine translation with translation memories

abstract: Retrieval-augmented machine translation leverages examples from a translation memory by retrieving similar instances. These examples are used to condition the predictions of a neural decoder. We aim to improve the upstream retrieval step and consider a fixed downstream edit-based model: the multi-Levenshtein Transformer. The task consists of finding a set of examples that maximizes the overall coverage of the source sentence. To this end, we rely on the theory of submodular functions and explore new algorithms to optimize this coverage. We evaluate the resulting performance gains for the machine translation task.


title: Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization

abstract: We study whether transformers can learn to implicitly reason over parametric knowledge, a skill that even the most capable language models struggle with. Focusing on two representative reasoning types, composition and comparison, we consistently find that transformers can learn implicit reasoning, but only through grokking, i.e., extended training far beyond overfitting. The levels of generalization also vary across reasoning types: when faced with out-of-distribution examples, transformers fail to systematically generalize for composition but succeed for comparison. We delve into the model's internals throughout training, conducting analytical experiments that reveal: 1) the mechanism behind grokking, such as the formation of the generalizing circuit and its relation to the relative efficiency of generalizing and memorizing circuits, and 2) the connection between systematicity and the configuration of the generalizing circuit. Our findings guide data and training setup to better induce implicit reasoning and suggest potential improvements to the transformer architecture, such as encouraging cross-layer knowledge sharing. Furthermore, we demonstrate that for a challenging reasoning task with a large search space, GPT-4-Turbo and Gemini-1.5-Pro based on non-parametric memory fail badly regardless of prompting styles or retrieval augmentation, while a fully grokked transformer can achieve near-perfect accuracy, showcasing the power of parametric memory for complex reasoning.


title: A $Li$ne $Me$asuring library for large and complex spectroscopic data sets: Implementation of a virtual observatory for JWST spectra

abstract: The upcoming generation of telescopes, instruments, and surveys is poised to usher in an unprecedented "Big Data" era in the field of astronomy. Within this context, even seemingly modest tasks such as spectral line analyses could become increasingly challenging for astronomers. In this paper, we announce the release of ${\rm L{\small I}M{\small E}}$. This package is tailored for multidisciplinary observations with long-slit and integral field spectroscopy (IFS) support. ${\rm L{\small I}M{\small E}}$ functions encompass the reading of observational files, detecting lines, conditioned line fitting, and the plotting and storage of results. Most importantly, these measurements are structured to support the subsequent chemical and kinematic analyses. To reduce the coding effort required from users, we introduced a notation system for atomic transitions that is accessible to humans and machine-readable. Along with this system, we present an extensive database of line bands, spanning from the ultraviolet to the infrared wavelength range. Additionally, we propose a model designed to train machine learning algorithms in line detection. ${\rm L{\small I}M{\small E}}$ features a comprehensive online documentation, which details the command attributes and includes several tutorials. These tutorials range from measuring a single line to analyzing an entire IFS data cube. This library functions and measurements are showcased in an online virtual observatory. The data in this interactive website come from the JWST NIRSpec observations of the CEERs survey. In this regard, ${\rm L{\small I}M{\small E}}$ offers improvements related to the dissemination and accessibility of astronomical spectra.


title: Temporal Stamp Classifier: Classifying Short Sequences of Astronomical Alerts

abstract: In this work, we propose a deep learning-based classification model of astronomical objects using alerts reported by the Zwicky Transient Facility (ZTF) survey. The model takes as inputs sequences of stamp images and metadata contained in each alert, as well as features from the All-WISE catalog. The proposed model, called temporal stamp classifier, is able to discriminate between three classes of astronomical objects: Active Galactic Nuclei (AGN), Super-Novae (SNe) and Variable Stars (VS), with an accuracy of approximately 98% in the test set, when using 2 to 5 detections. The results show that the model performance improves with the addition of more detections. Simple recurrence models obtain competitive results with those of more complex models such as LSTM.We also propose changes to the original stamp classifier model, which only uses the first detection. The performance of the latter model improves with changes in the architecture and the addition of random rotations, achieving a 1.46% increase in test accuracy.


title: 4+3 Phases of Compute-Optimal Neural Scaling Laws

abstract: We consider the three parameter solvable neural scaling model introduced by Maloney, Roberts, and Sully. The model has three parameters: data complexity, target complexity, and model-parameter-count. We use this neural scaling model to derive new predictions about the compute-limited, infinite-data scaling law regime. To train the neural scaling model, we run one-pass stochastic gradient descent on a mean-squared loss. We derive a representation of the loss curves which holds over all iteration counts and improves in accuracy as the model parameter count grows. We then analyze the compute-optimal model-parameter-count, and identify 4 phases (+3 subphases) in the data-complexity/target-complexity phase-plane. The phase boundaries are determined by the relative importance of model capacity, optimizer noise, and embedding of the features. We furthermore derive, with mathematical proof and extensive numerical evidence, the scaling-law exponents in all of these phases, in particular computing the optimal model-parameter-count as a function of floating point operation budget.

categories: stat.ML cs.LG math.OC math.PR math.ST stat.TH


abstract: The main purpose of this paper is to provide formulas for the Hilbert-Kunz multiplicity of fiber products and idealization rings. We calculate the Hilbert-Kunz multiplicity of a fiber product $R \times_T S$, with $R$, $S$ and $T$ being Noetherian local rings with common characteristic and residue field. Inspired by a work of Strazzanti and Armengou we calculate the Hilbert-Kunz multiplicity of an idealization ring $R \ltimes M$, where $M$ is a finite $R$-module. We explore certain examples and structural consequences and obtain some bounds for the Hilbert-Kunz multiplicity.


title: Refined conjectures on Fitting ideals of Selmer groups over $\mathbf{Z}_p^2$-extensions

abstract: Let $p>3$ be a prime number and $K$ be an imaginary quadratic field where $p$ splits. Let $K_\infty$ be the $\mathbf{Z}_p^2$-extension of $K$ and let $K_n$ be a finite subextension of $K_\infty/K$. Let $E$ be an elliptic curve with good ordinary reduction at $p$. Under some hypotheses, we show that the Mazur-Tate element attached to $E$ over $K_n$ by S. Haran generates the Fitting ideal of the dual Selmer group of $E$ over $K_n$.


title: Eliciting Informative Text Evaluations with Large Language Models

abstract: Peer prediction mechanisms motivate high-quality feedback with provable guarantees. However, current methods only apply to rather simple reports, like multiple-choice or scalar numbers. We aim to broaden these techniques to the larger domain of text-based reports, drawing on the recent developments in large language models. This vastly increases the applicability of peer prediction mechanisms as textual feedback is the norm in a large variety of feedback channels: peer reviews, e-commerce customer reviews, and comments on social media. We introduce two mechanisms, the Generative Peer Prediction Mechanism (GPPM) and the Generative Synopsis Peer Prediction Mechanism (GSPPM). These mechanisms utilize LLMs as predictors, mapping from one agent's report to a prediction of her peer's report. Theoretically, we show that when the LLM prediction is sufficiently accurate, our mechanisms can incentivize high effort and truth-telling as an (approximate) Bayesian Nash equilibrium. Empirically, we confirm the efficacy of our mechanisms through experiments conducted on two real datasets: the Yelp review dataset and the ICLR OpenReview dataset. We highlight the results that on the ICLR dataset, our mechanisms can differentiate three quality levels -- human-written reviews, GPT-4-generated reviews, and GPT-3.5-generated reviews in terms of expected scores. Additionally, GSPPM penalizes LLM-generated reviews more effectively than GPPM.


title: Critical Assessment of Mass and Lattice Disorder in Thermal Conductivity Prediction for Medium and High Entropy Ceramics

abstract: Medium and high entropy ceramics, with their distinctive disordered structures, exhibit ultra-low thermal conductivity and high temperature stability. These properties make them strong contenders for next generation thermal barrier coating (TBC) materials. However, predicting their thermal conductivity has been challenging, primarily due to their unique phonon scattering mechanisms. Apart from the conventional phonon-phonon scattering mechanism, the phonon-disorder scattering, comprising both mass and force constant disorder, are also expected to make significant contribution in determining the thermal conductivity of medium and high entropy ceramics. However, it remains challenging to quantify the phonon-disorder contribution, particular in the aspect of force constant disorder. Here we demonstrated a relationship between the lattice disorder, a quantity more readily calculable, with force constant disorder, rendering it possible to substitute the force constant disorder by lattice disorder. Based on this relationship and drawing inspiration from Klement's equation of static imperfection, we have developed a model that quantitatively assesses the connection between disorder and thermal conductivity. Applying our model to the medium/high entropy rocksalt and pyrochlore oxides as representatives, we found good alignment between the theoretical predictions and experimental measurements of thermal conductivities, confirming the validity of our model. The model developed offers a critical predictive tool for rapid screening of TBC materials based on medium and high entropy ceramics.


title: A Survey of Distributed Learning in Cloud, Mobile, and Edge Settings

abstract: In the era of deep learning (DL), convolutional neural networks (CNNs), and large language models (LLMs), machine learning (ML) models are becoming increasingly complex, demanding significant computational resources for both inference and training stages. To address this challenge, distributed learning has emerged as a crucial approach, employing parallelization across various devices and environments. This survey explores the landscape of distributed learning, encompassing cloud and edge settings. We delve into the core concepts of data and model parallelism, examining how models are partitioned across different dimensions and layers to optimize resource utilization and performance. We analyze various partitioning schemes for different layer types, including fully connected, convolutional, and recurrent layers, highlighting the trade-offs between computational efficiency, communication overhead, and memory constraints. This survey provides valuable insights for future research and development in this rapidly evolving field by comparing and contrasting distributed learning approaches across diverse contexts.


title: Constructing Interlocking Assemblies with Crystallographic Symmetries

abstract: This work presents a construction method for interlocking assemblies based on planar crystallographic symmetries. Planar crystallographic groups, also known as wallpaper groups, correspond to tessellations of the plane with a tile, called a fundamental domain, such that the action of the group can be used to tessellate the plane with the given tile. The main idea of this method is to extend the action of a wallpaper group so that it acts on three-dimensional space and places two fundamental domains into parallel planes. Next, we interpolate between these domains to obtain a block that serves as a candidate for interlocking assemblies. We show that the resulting blocks can be triangulated, and we can also approximate blocks with smooth surfaces using this approach. Finally, we show that there exists a family of blocks derived from this construction that can be tiled in multiple ways, characterised by generalised Truchet tiles. The assemblies of one block in this family, which we call RhomBlock, correspond to tessellations with lozenges.


title: Distributed Harmonization: Federated Clustered Batch Effect Adjustment and Generalization

abstract: Independent and identically distributed (i.i.d.) data is essential to many data analysis and modeling techniques. In the medical domain, collecting data from multiple sites or institutions is a common strategy that guarantees sufficient clinical diversity, determined by the decentralized nature of medical data. However, data from various sites are easily biased by the local environment or facilities, thereby violating the i.i.d. rule. A common strategy is to harmonize the site bias while retaining important biological information. The ComBat is among the most popular harmonization approaches and has recently been extended to handle distributed sites. However, when faced with situations involving newly joined sites in training or evaluating data from unknown/unseen sites, ComBat lacks compatibility and requires retraining with data from all the sites. The retraining leads to significant computational and logistic overhead that is usually prohibitive. In this work, we develop a novel Cluster ComBat harmonization algorithm, which leverages cluster patterns of the data in different sites and greatly advances the usability of ComBat harmonization. We use extensive simulation and real medical imaging data from ADNI to demonstrate the superiority of the proposed approach. Our codes are provided in https://github.com/illidanlab/distributed-cluster-harmonization.


title: Advancements in Translation Accuracy for Stereo Visual-Inertial Initialization

abstract: As the current initialization method in the state-of-the-art Stereo Visual-Inertial SLAM framework, ORB-SLAM3 has limitations. Its success depends on the performance of the pure stereo SLAM system and is based on the underlying assumption that pure visual SLAM can accurately estimate the camera trajectory, which is essential for inertial parameter estimation. Meanwhile, the further improved initialization method for ORB-SLAM3, known as Stereo-NEC, is time-consuming due to applying keypoint tracking to estimate gyroscope bias with normal epipolar constraints. To address the limitations of previous methods, this paper proposes a method aimed at enhancing translation accuracy during the initialization stage. The fundamental concept of our method is to improve the translation estimate with a 3 Degree-of-Freedom (DoF) Bundle Adjustment (BA), independently, while the rotation estimate is fixed, instead of using ORB-SLAM3's 6-DoF BA. Additionally, the rotation estimate will be updated by considering IMU measurements and gyroscope bias, unlike ORB-SLAM3's rotation, which is directly obtained from stereo visual odometry and may yield inferior results when operating in challenging scenarios. We also conduct extensive evaluations on the public benchmark, the EuRoC dataset, demonstrating that our method excels in accuracy.


title: MuDreamer: Learning Predictive World Models without Reconstruction

abstract: The DreamerV3 agent recently demonstrated state-of-the-art performance in diverse domains, learning powerful world models in latent space using a pixel reconstruction loss. However, while the reconstruction loss is essential to Dreamer's performance, it also necessitates modeling unnecessary information. Consequently, Dreamer sometimes fails to perceive crucial elements which are necessary for task-solving when visual distractions are present in the observation, significantly limiting its potential. In this paper, we present MuDreamer, a robust reinforcement learning agent that builds upon the DreamerV3 algorithm by learning a predictive world model without the need for reconstructing input signals. Rather than relying on pixel reconstruction, hidden representations are instead learned by predicting the environment value function and previously selected actions. Similar to predictive self-supervised methods for images, we find that the use of batch normalization is crucial to prevent learning collapse. We also study the effect of KL balancing between model posterior and prior losses on convergence speed and learning stability. We evaluate MuDreamer on the commonly used DeepMind Visual Control Suite and demonstrate stronger robustness to visual distractions compared to DreamerV3 and other reconstruction-free approaches, replacing the environment background with task-irrelevant real-world videos. Our method also achieves comparable performance on the Atari100k benchmark while benefiting from faster training.


title: Efficient Certificates of Anti-Concentration Beyond Gaussians

abstract: A set of high dimensional points $X=\{x_1, x_2,\ldots, x_n\} \subset R^d$ in isotropic position is said to be $\delta$-anti concentrated if for every direction $v$, the fraction of points in $X$ satisfying $|\langle x_i,v \rangle |\leq \delta$ is at most $O(\delta)$. Motivated by applications to list-decodable learning and clustering, recent works have considered the problem of constructing efficient certificates of anti-concentration in the average case, when the set of points $X$ corresponds to samples from a Gaussian distribution. Their certificates played a crucial role in several subsequent works in algorithmic robust statistics on list-decodable learning and settling the robust learnability of arbitrary Gaussian mixtures, yet remain limited to rotationally invariant distributions. This work presents a new (and arguably the most natural) formulation for anti-concentration. Using this formulation, we give quasi-polynomial time verifiable sum-of-squares certificates of anti-concentration that hold for a wide class of non-Gaussian distributions including anti-concentrated bounded product distributions and uniform distributions over $L_p$ balls (and their affine transformations). Consequently, our method upgrades and extends results in algorithmic robust statistics e.g., list-decodable learning and clustering, to such distributions. Our approach constructs a canonical integer program for anti-concentration and analysis a sum-of-squares relaxation of it, independent of the intended application. We rely on duality and analyze a pseudo-expectation on large subsets of the input points that take a small value in some direction. Our analysis uses the method of polynomial reweightings to reduce the problem to analyzing only analytically dense or sparse directions.


title: Acoustical Features as Knee Health Biomarkers: A Critical Analysis

abstract: Acoustical knee health assessment has long promised an alternative to clinically available medical imaging tools, but this modality has yet to be adopted in medical practice. The field is currently led by machine learning models processing acoustical features, which have presented promising diagnostic performances. However, these methods overlook the intricate multi-source nature of audio signals and the underlying mechanisms at play. By addressing this critical gap, the present paper introduces a novel causal framework for validating knee acoustical features. We argue that current machine learning methodologies for acoustical knee diagnosis lack the required assurances and thus cannot be used to classify acoustic features as biomarkers. Our framework establishes a set of essential theoretical guarantees necessary to validate this claim. We apply our methodology to three real-world experiments investigating the effect of researchers' expectations, the experimental protocol and the wearable employed sensor. This investigation reveals latent issues such as underlying shortcut learning and performance inflation. This study is the first independent result reproduction study in the field of acoustical knee health evaluation. We conclude with actionable insights from our findings, offering valuable guidance to navigate these crucial limitations in future research.