title: Dynamic Evidence Disclosure: Delay the Good to Accelerate the Bad

abstract: We analyze the dynamic tradeoff between the generation and the disclosure of evidence. Agents are tempted to delay investing in a new technology in order to learn from information generated by the experiences of others. This informational free-riding is collectively harmful as it slows down innovation adoption. A welfare-maximizing designer can delay the disclosure of previously generated information in order to speed up adoption. The optimal policy transparently discloses bad news and delays good news. This finding resonates with regulation demanding that fatal breakdowns be reported promptly. Remarkably, the designer's intervention makes all agents better off.


title: Secure Cross-Chain Provenance for Digital Forensics Collaboration

abstract: In digital forensics and various sectors like medicine and supply chain, blockchains play a crucial role in providing a secure and tamper-resistant system that meticulously records every detail, ensuring accountability. However, collaboration among different agencies, each with its own blockchains, creates challenges due to diverse protocols and a lack of interoperability, hindering seamless information sharing. Cross-chain technology has been introduced to address these challenges. Current research about blockchains in digital forensics, tends to focus on individual agencies, lacking a comprehensive approach to collaboration and the essential aspect of cross-chain functionality. This emphasizes the necessity for a framework capable of effectively addressing challenges in securely sharing case information, implementing access controls, and capturing provenance data across interconnected blockchains. Our solution, ForensiCross, is the first cross-chain solution specifically designed for digital forensics and provenance. It includes BridgeChain and features a unique communication protocol for cross-chain and multi-chain solutions. ForensiCross offers meticulous provenance capture and extraction methods, mathematical analysis to ensure reliability, scalability considerations for a distributed intermediary in collaborative blockchain contexts, and robust security measures against potential vulnerabilities and attacks. Analysis and evaluation results indicate that ForensiCross is secure and, despite a slight increase in communication time, outperforms in node count efficiency and has secure provenance extraction. As an all-encompassing solution, ForensiCross aims to simplify collaborative investigations by ensuring data integrity and traceability.


title: CHG Shapley: Efficient Data Valuation and Selection towards Trustworthy Machine Learning

abstract: Understanding the decision-making process of machine learning models is crucial for ensuring trustworthy machine learning. Data Shapley, a landmark study on data valuation, advances this understanding by assessing the contribution of each datum to model accuracy. However, the resource-intensive and time-consuming nature of multiple model retraining poses challenges for applying Data Shapley to large datasets. To address this, we propose the CHG (Conduct of Hardness and Gradient) score, which approximates the utility of each data subset on model accuracy during a single model training. By deriving the closed-form expression of the Shapley value for each data point under the CHG score utility function, we reduce the computational complexity to the equivalent of a single model retraining, an exponential improvement over existing methods. Additionally, we employ CHG Shapley for real-time data selection, demonstrating its effectiveness in identifying high-value and noisy data. CHG Shapley facilitates trustworthy model training through efficient data valuation, introducing a novel data-centric perspective on trustworthy machine learning.


title: PerfCurator: Curating a large-scale dataset of performance bug-related commits from public repositories

abstract: Performance bugs challenge software development, degrading performance and wasting computational resources. Software developers invest substantial effort in addressing these issues. Curating these performance bugs can offer valuable insights to the software engineering research community, aiding in developing new mitigation strategies. However, there is no large-scale open-source performance bugs dataset available. To bridge this gap, we propose PerfCurator, a repository miner that collects performance bug-related commits at scale. PerfCurator employs PcBERT-KD, a 125M parameter BERT model trained to classify performance bug-related commits. Our evaluation shows PcBERT-KD achieves accuracy comparable to 7 billion parameter LLMs but with significantly lower computational overhead, enabling cost-effective deployment on CPU clusters. Utilizing PcBERT-KD as the core component, we deployed PerfCurator on a 50-node CPU cluster to mine GitHub repositories. This extensive mining operation resulted in the construction of a large-scale dataset comprising 114K performance bug-fix commits in Python, 217.9K in C++, and 76.6K in Java. Our results demonstrate that this large-scale dataset significantly enhances the effectiveness of data-driven performance bug detection systems.


title: Correspondence Free Multivector Cloud Registration using Conformal Geometric Algebra

abstract: We present, for the first time, a novel theoretical approach to address the problem of correspondence free multivector cloud registration in conformal geometric algebra. Such formalism achieves several favorable properties. Primarily, it forms an orthogonal automorphism that extends beyond the typical vector space to the entire conformal geometric algebra while respecting the multivector grading. Concretely, the registration can be viewed as an orthogonal transformation (\it i.e., scale, translation, rotation) belonging to $SO(4,1)$ - group of special orthogonal transformations in conformal geometric algebra. We will show that such formalism is able to: $(i)$ perform the registration without directly accessing the input multivectors. Instead, we use primitives or geometric objects provided by the conformal model - the multivectors, $(ii)$ the geometric objects are obtained by solving a multilinear eigenvalue problem to find sets of eigenmultivectors. In this way, we can explicitly avoid solving the correspondences in the registration process. Most importantly, this offers rotation and translation equivariant properties between the input multivectors and the eigenmultivectors. Experimental evaluation is conducted in datasets commonly used in point cloud registration, to testify the usefulness of the approach with emphasis to ambiguities arising from high levels of noise. The code is available at https://github.com/Numerical-Geometric-Algebra/RegistrationGA . This work was submitted to the International Journal of Computer Vision and is currently under review.


title: A Clipped Trip: the Dynamics of SGD with Gradient Clipping in High-Dimensions

abstract: The success of modern machine learning is due in part to the adaptive optimization methods that have been developed to deal with the difficulties of training large models over complex datasets. One such method is gradient clipping: a practical procedure with limited theoretical underpinnings. In this work, we study clipping in a least squares problem under streaming SGD. We develop a theoretical analysis of the learning dynamics in the limit of large intrinsic dimension-a model and dataset dependent notion of dimensionality. In this limit we find a deterministic equation that describes the evolution of the loss. We show that with Gaussian noise clipping cannot improve SGD performance. Yet, in other noisy settings, clipping can provide benefits with tuning of the clipping threshold. In these cases, clipping biases updates in a way beneficial to training which cannot be recovered by SGD under any schedule. We conclude with a discussion about the links between high-dimensional clipping and neural network training.


title: LibProf: A Python Profiler for Improving Cold Start Performance in Serverless Applications

abstract: Serverless computing abstracts away server management, enabling automatic scaling and efficient resource utilization. However, cold-start latency remains a significant challenge, affecting end-to-end performance. Our preliminary study reveals that inefficient library initialization and usage are major contributors to this latency in Python-based serverless applications. We introduce LibProf, a Python profiler that uses dynamic program analysis to identify inefficient library initializations. LibProf collects library usage data through statistical sampling and call-path profiling, then generates a report to guide developers in addressing four types of inefficiency patterns. Systematic evaluations on 15 serverless applications demonstrate that LibProf effectively identifies inefficiencies. LibProf guided optimization results up to 2.26x speedup in cold-start execution time and 1.51x reduction in memory usage.


title: Mapping Interfacial Energetic Landscape in Organic Solar Cells Reveals Pathways to Reducing Nonradiative Losses

abstract: Bulk heterojunction (BHJ) organic solar cells have made remarkable inroads towards 20% efficiency, yet nonradiative recombination losses ({\Delta}Vnr) remain high compared to silicon and perovskite photovoltaics. Interfaces buried within BHJ blends hold the key to recombination losses but access to their energetic landscape underpinning charge transfer (CT) states and their disorder remain elusive. Here, we reveal the energetic landscape and CT state manifold of modern BHJs with both spatial and energetic resolutions and link the offset between singlet (ES1) and CT energy (ES1-CT) and interfacial energetic disorder with {\Delta}Vnr. We do so by locally mapping the energy distributions of modern PM6-based BHJs with IT4F, Y6 and PC71BM acceptors and combine it, for the first time, with sensitive EQE measurements, to visualize and quantify donor (D) and acceptor (A) energetics at interfaces and associated them with CT states within a modified Marcus framework. A key new ability is the identification of the specific BHJ interfaces associated with the CT manifold, including where the lowest energy CT states reside. Moreover, we quantify energy levels and electronic disorders directly at these and other interfaces and connect these contributions to the energy losses. We delineate the influences of S1-CT offset and interfacial energetic disorder on {\Delta}Vnr across morphologically varied BHJs. Our results show both factors influencing energy losses in different ways. We demonstrate that PM6:Y6 can achieve low {\Delta}Vnr by forming a nominally sharp D/A interface with exceptionally low interfacial disorder via judicious processing combined with a low S1 to CT offset. This provides a design rule to minimize {\Delta}Vnr for modern NFAs: sharp D/A interfaces with low S1 to CT offset exhibiting minimal interfacial disorder.


title: Interactive Evolution: A Neural-Symbolic Self-Training Framework For Large Language Models

abstract: One of the primary driving forces contributing to the superior performance of Large Language Models (LLMs) is the extensive availability of human-annotated natural language data, which is used for alignment fine-tuning. This inspired researchers to investigate self-training methods to mitigate the extensive reliance on human annotations. However, the current success of self-training has been primarily observed in natural language scenarios, rather than in the increasingly important neural-symbolic scenarios. To this end, we propose an environment-guided neural-symbolic self-training framework named ENVISIONS. It aims to overcome two main challenges: (1) the scarcity of symbolic data, and (2) the limited proficiency of LLMs in processing symbolic language. Extensive evaluations conducted on three distinct domains demonstrate the effectiveness of our approach. Additionally, we have conducted a comprehensive analysis to uncover the factors contributing to ENVISIONS's success, thereby offering valuable insights for future research in this area. Code will be available at \url{https://github.com/xufangzhi/ENVISIONS}.


title: InterNeRF: Scaling Radiance Fields via Parameter Interpolation

abstract: Neural Radiance Fields (NeRFs) have unmatched fidelity on large, real-world scenes. A common approach for scaling NeRFs is to partition the scene into regions, each of which is assigned its own parameters. When implemented naively, such an approach is limited by poor test-time scaling and inconsistent appearance and geometry. We instead propose InterNeRF, a novel architecture for rendering a target view using a subset of the model's parameters. Our approach enables out-of-core training and rendering, increasing total model capacity with only a modest increase to training time. We demonstrate significant improvements in multi-room scenes while remaining competitive on standard benchmarks.


title: Probability Estimates of a 21st Century AMOC Collapse

abstract: There is increasing concern that the Atlantic Meridional Overturning Circulation (AMOC) may collapse this century with a disrupting societal impact on large parts of the world. Preliminary estimates of the probability of such an AMOC collapse have so far been based on conceptual models and statistical analyses of proxy data. Here, we provide observationally based estimates of such probabilities from reanalysis data. We first identify optimal observation regions of an AMOC collapse from a recent global climate model simulation. Salinity data near the southern boundary of the Atlantic turn out to be optimal to provide estimates of the time of the AMOC collapse in this model. Based on the reanalysis products, we next determine probability density functions of the AMOC collapse time. The collapse time is estimated between 2037-2064 (10-90% CI) with a mean of 2050 and the probability of an AMOC collapse before the year 2050 is estimated to be 59 +/- 17%.


title: V3Det Challenge 2024 on Vast Vocabulary and Open Vocabulary Object Detection: Methods and Results

abstract: Detecting objects in real-world scenes is a complex task due to various challenges, including the vast range of object categories, and potential encounters with previously unknown or unseen objects. The challenges necessitate the development of public benchmarks and challenges to advance the field of object detection. Inspired by the success of previous COCO and LVIS Challenges, we organize the V3Det Challenge 2024 in conjunction with the 4th Open World Vision Workshop: Visual Perception via Learning in an Open World (VPLOW) at CVPR 2024, Seattle, US. This challenge aims to push the boundaries of object detection research and encourage innovation in this field. The V3Det Challenge 2024 consists of two tracks: 1) Vast Vocabulary Object Detection: This track focuses on detecting objects from a large set of 13204 categories, testing the detection algorithm's ability to recognize and locate diverse objects. 2) Open Vocabulary Object Detection: This track goes a step further, requiring algorithms to detect objects from an open set of categories, including unknown objects. In the following sections, we will provide a comprehensive summary and analysis of the solutions submitted by participants. By analyzing the methods and solutions presented, we aim to inspire future research directions in vast vocabulary and open-vocabulary object detection, driving progress in this field. Challenge homepage: https://v3det.openxlab.org.cn/challenge


title: Imagination Policy: Using Generative Point Cloud Models for Learning Manipulation Policies

abstract: Humans can imagine goal states during planning and perform actions to match those goals. In this work, we propose Imagination Policy, a novel multi-task key-frame policy network for solving high-precision pick and place tasks. Instead of learning actions directly, Imagination Policy generates point clouds to imagine desired states which are then translated to actions using rigid action estimation. This transforms action inference into a local generative task. We leverage pick and place symmetries underlying the tasks in the generation process and achieve extremely high sample efficiency and generalizability to unseen configurations. Finally, we demonstrate state-of-the-art performance across various tasks on the RLbench benchmark compared with several strong baselines.


title: Transcendence: Generative Models Can Outperform The Experts That Train Them

abstract: Generative models are trained with the simple objective of imitating the conditional probability distribution induced by the data they are trained on. Therefore, when trained on data generated by humans, we may not expect the artificial model to outperform the humans on their original objectives. In this work, we study the phenomenon of transcendence: when a generative model achieves capabilities that surpass the abilities of the experts generating its data. We demonstrate transcendence by training an autoregressive transformer to play chess from game transcripts, and show that the trained model can sometimes achieve better performance than all players in the dataset. We theoretically prove that transcendence can be enabled by low-temperature sampling, and rigorously assess this claim experimentally. Finally, we discuss other sources of transcendence, laying the groundwork for future investigation of this phenomenon in a broader setting.


title: Detection Prospects of Gravitational Waves from SU(2) Axion Inflation

abstract: We study detection prospects of a gravitational-wave background (GWB) sourced by SU(2) gauge fields considering all possible observational constraints. More precisely, we consider bounds set by cosmic microwave background measurements, primordial black hole overproduction, as well as backreaction of the gauge fields on the background evolution. Gravitational-waves data from the first three observing runs of the LIGO-Virgo-KAGRA Collaboration show no evidence for a GWB contribution from axion inflation. However, we are able to place conservative constraints on the parameters of the SU(2) inflation with current data. We investigate conditions on the inflationary potential that would lead to a detectable signal that evades astrophysical and cosmological constraints and discuss detection prospects for third generation networks.


title: Domain Generalization for In-Orbit 6D Pose Estimation

abstract: We address the problem of estimating the relative 6D pose, i.e., position and orientation, of a target spacecraft, from a monocular image, a key capability for future autonomous Rendezvous and Proximity Operations. Due to the difficulty of acquiring large sets of real images, spacecraft pose estimation networks are exclusively trained on synthetic ones. However, because those images do not capture the illumination conditions encountered in orbit, pose estimation networks face a domain gap problem, i.e., they do not generalize to real images. Our work introduces a method that bridges this domain gap. It relies on a novel, end-to-end, neural-based architecture as well as a novel learning strategy. This strategy improves the domain generalization abilities of the network through multi-task learning and aggressive data augmentation policies, thereby enforcing the network to learn domain-invariant features. We demonstrate that our method effectively closes the domain gap, achieving state-of-the-art accuracy on the widespread SPEED+ dataset. Finally, ablation studies assess the impact of key components of our method on its generalization abilities.


title: Phase-resolved measurement of entangled states via common-path interferometry

abstract: We propose and experimentally demonstrate a method to directly measure the phase of biphoton states using an entangled mode as a collinear reference. The technique is demonstrated with entangled photonic spatial modes in the Laguerre-Gaussian basis, and it is applicable to any pure quantum system containing an exploitable reference state in its entanglement spectrum. As one particularly useful application, we use the new methodology to directly measure the geometric phase accumulation of entangled photons.


title: Multi-Layer Ranking with Large Language Models for News Source Recommendation

abstract: To seek reliable information sources for news events, we introduce a novel task of expert recommendation, which aims to identify trustworthy sources based on their previously quoted statements. To achieve this, we built a novel dataset, called NewsQuote, consisting of 23,571 quote-speaker pairs sourced from a collection of news articles. We formulate the recommendation task as the retrieval of experts based on their likelihood of being associated with a given query. We also propose a multi-layer ranking framework employing Large Language Models to improve the recommendation performance. Our results show that employing an in-context learning based LLM ranker and a multi-layer ranking-based filter significantly improve both the predictive quality and behavioural quality of the recommender system.


title: Location of blow-up points in fully parabolic chemotaxis systems with spatially heterogeneous logistic source

abstract: We consider the fully parabolic, spatially heterogeneous chemotaxis-growth system \begin{align*} \begin{cases} u_t = \Delta u - \nabla\cdot(u\nabla v) + \kappa(x)u-\mu(x)u^2, \\ v_t = \Delta v - v + u \end{cases} \end{align*} in bounded domains $\Omega\subset \mathbb{R}^2$ and show that the blow-up set is contained in the set of zeroes of $\mu$.


title: Critical Fermions are Universal Embezzlers

abstract: Universal embezzlers are bipartite quantum systems from which any entangled state may be extracted to arbitrary precision using local operations while perturbing the state of the system arbitrarily little. Here, we show that universal embezzlers are ubiquitous in many-body physics: The ground state sector of every local, translation-invariant, and critical free-fermionic many-body system on a one-dimensional lattice is a universal embezzler if bi-partitioned into two half-chains. The same property holds in locally-interacting, dual spin chains via the Jordan-Wigner transformation. Universal embezzlement manifests already for finite system sizes, not only in the thermodynamic limit: For any finite error and any targeted entangled state, a finite length of the chain is sufficient to embezzle said state within the given error. On a technical level, our main result establishes that the half-chain observable algebras associated with ground state sectors of the given models are type III$_1$ factors.

categories: quant-ph cond-mat.str-el math-ph math.MP math.OA


title: Retrieval of the physical parameters of galaxies from WEAVE-StePS-like data using machine learning

abstract: The WHT Enhanced Area Velocity Explorer (WEAVE) is a new, massively multiplexing spectrograph. This new instrument will be exploited to obtain high S/N spectra of $\sim$25000 galaxies at intermediate redshifts for the WEAVE Stellar Population Survey (WEAVE-StePS). We test machine learning methods for retrieving the key physical parameters of galaxies from WEAVE-StePS-like spectra using both photometric and spectroscopic information at various S/Ns and redshifts. We simulated $\sim$105000 galaxy spectra assuming SFH with an exponentially declining star formation rate, covering a wide range of ages, stellar metallicities, sSFRs, and dust extinctions. We then evaluated the ability of the random forest and KNN algorithms to correctly predict such parameters assuming no measurement errors. We checked how much the predictive ability deteriorates for different S/Ns and redshifts, finding that both algorithms still accurately estimate the ages and metallicities with low bias. The dispersion varies from 0.08-0.16 dex for ages and 0.11-0.25 dex for metallicity, depending on the redshift and S/N. For dust attenuation, we find a similarly low bias and dispersion. For the sSFR, we find a very good constraining power for star-forming galaxies, log sSFR$\gtrsim$ -11, where the bias is $\sim$ 0.01 dex and the dispersion is $\sim$ 0.10 dex. For more quiescent galaxies, with log sSFR$\lesssim$ -11, we find a higher bias, 0.61-0.86 dex, and a higher dispersion, $\sim$ 0.4 dex, for different S/Ns and redshifts. Generally, we find that the RF outperforms the KNN. Finally, the retrieved sSFR was used to successfully classify galaxies as part of the blue cloud, green valley, or red sequence. We demonstrate that machine learning algorithms can accurately estimate the physical parameters of simulated galaxies even at relatively low S/N=10 per angstrom spectra with available ancillary photometric information.


title: On the Differentiability of the Primal-Dual Interior-Point Method

abstract: Primal-Dual Interior-Point methods are capable of solving constrained convex optimization problems to tight tolerances in a fast and robust manner. The derivatives of the primal-dual solution with respect to the problem matrices can be computed using the implicit function theorem, enabling efficient differentiation of these optimizers for a fraction of the cost of the total solution time. In the presence of active inequality constraints, this technique is only capable of providing discontinuous subgradients that present a challenge to algorithms that rely on the smoothness of these derivatives. This paper presents a technique for relaxing primal-dual solutions with a logarithmic barrier to provide smooth derivatives near active inequality constraints, with the ability to specify a uniform and consistent amount of smoothing. We pair this with an efficient primal-dual interior-point algorithm for solving an always-feasible $\ell_1$-penalized variant of a convex quadratic program, eliminating the issues surrounding learning potentially infeasible problems. This parallelizable and smoothly differentiable solver is demonstrated on a range of robotics tasks where smoothing is important. An open source implementation in JAX is available at github.com/kevin-tracy/qpax.


title: Flexible and Reversible Conversion between Extensible Records and Overloading Constraints for ML

abstract: Most ML-like functional languages provide records and overloading as unrelated features. Records not only represent data structures, but are also used to implement dictionary passing, whereas overloading produces type constraints that are basically dictionaries subject to compiler-driven dispatching. In this paper we explore how records and overloading constraints can be converted one into the other, allowing the programmer to switch between the two at a very reasonable cost in terms of syntactic overhead. To achieve this we introduce two language constructs, namely inject and eject, performing a type-driven syntactic transformation. The former literally injects constraints into the type and produces a function adding an extra record argument. The latter does the opposite, ejecting a record argument from a function and turning fields into type constraints. The conversion is reversible and can be restricted to a subset of symbols, granting additional control to the programmer. Although what we call inject has already been proposed in literature, making it a language operator and coupling it with its reverse counterpart represent a novel design. The goal is to allow the programmer to switch from a dictionary-passing style to compiler-assisted constraint resolution, and vice versa, enabling reuse between libraries that otherwise would not interoperate.


title: A randomized preconditioned Cholesky-QR algorithm

abstract: We a present and analyze rpCholesky-QR, a randomized preconditioned Cholesky-QR algorithm for computing the thin QR factorization of real mxn matrices with rank n. rpCholesky-QR has a low orthogonalization error, a residual on the order of machine precision, and does not break down for highly singular matrices. We derive rigorous and interpretable two-norm perturbation bounds for rpCholesky-QR that require a minimum of assumptions. Numerical experiments corroborate the accuracy of rpCholesky-QR for preconditioners sampled from as few as 3n rows, and illustrate that the two-norm deviation from orthonormality increases with only the condition number of the preconditioned matrix, rather than its square -- even if the original matrix is numerically singular.


title: Particle production in HRG with thermodynamically consistent EoS and partially deformable hadrons

abstract: In the present work, we analyze several strange as well as non-strange relative hadronic yields obtained in the ultra-relativistic heavy-ion collisions (URHIC) experiments over a wide range of centre-of-mass collision energy ($\sqrt{s_{NN}}$). We invoke the formation of a hot and dense hadronic resonance gas (HRG) in the final stage following the URHIC. We use an earlier proposed thermodynamically consistent approach for obtaining the equation of state (EoS) of a hadronic resonance gas (HRG). It takes into account an important aspect of the hadronic interaction, viz., the hadronic hard-core repulsion, by assigning hard-core volumes to the hadrons, leading to an excluded volume (EV) type effect. We have invoked the bag model approach to assign hard-core volumes to baryons (antibaryons) while treating mesons to be point particles. We employ ansatz to obtain the dependence of the temperature and baryon chemical potential of the HRG system on the centre-of-mass energy in the URHIC. We also find strong evidence of double freeze-out scenario, corresponding to baryons (antibaryons) and mesons, respectively. Strangeness (anti-strangeness) imbalance factor is also seen to play an important role in explaining the ratio of strange hadrons to the non-strange ones. The HRG model can explain the experimental data on various relative hadronic multiplicities quite satisfactorily over a wide range of $\sqrt{s_{NN}}$, ranging from the lowest RHIC energies to the highest LHC energies for the set of the model parameters obtaining the best theoretical fit to the experimental data by minimizing the $\chi^{2}$/dof value.


title: A Semantic-based Layer Freezing Approach to Efficient Fine-Tuning of Language Models

abstract: Finetuning language models (LMs) is crucial for adapting the models to downstream data and tasks. However, full finetuning is usually costly. Existing work, such as parameter-efficient finetuning (PEFT), often focuses on \textit{how to finetune} but neglects the issue of \textit{where to finetune}. As a pioneering work on answering where to finetune (at the layer level), we conduct a semantic analysis of the LM inference process. We first propose a virtual transition of the latent representation and then trace its factual transition. Based on the deviation in transitions, we estimate the gain of finetuning each model layer, and further, narrow down the scope for finetuning. We perform extensive experiments across well-known LMs and datasets. The results show that our approach is effective and efficient, and outperforms the existing baselines. Our approach is orthogonal to existing efficient techniques, such as PEFT methods, offering practical values on LM finetuning.


title: DustNet: skillful neural network predictions of Saharan dust

abstract: Suspended in the atmosphere are millions of tonnes of mineral dust which interacts with weather and climate. Accurate representation of mineral dust in weather models is vital, yet remains challenging. Large scale weather models use high power supercomputers and take hours to complete the forecast. Such computational burden allows them to only include monthly climatological means of mineral dust as input states inhibiting their forecasting accuracy. Here, we introduce DustNet a simple, accurate and super fast forecasting model for 24-hours ahead predictions of aerosol optical depth AOD. DustNet trains in less than 8 minutes and creates predictions in 2 seconds on a desktop computer. Created by DustNet predictions outperform the state-of-the-art physics-based model on coarse 1 x 1 degree resolution at 95% of grid locations when compared to ground truth satellite data. Our results show DustNet has a potential for fast and accurate AOD forecasting which could transform our understanding of dust impacts on weather patterns.

categories: physics.geo-ph cs.AI physics.ao-ph physics.data-an


title: Photo-induced pattern formations and melting of charge-density-wave order

abstract: We investigate the out-of-equilibrium dynamics of a photo-excited charge-density-wave (CDW) state in the square-lattice Holstein model, in a setup similar to a pump-probe experiment. At half-filling, the ground state of this system is characterized by a checkerboard modulation of particle densities, accompanied by a concomitant lattice distortion. An efficient real-space dynamics method integrating the von~Neumann equation for electron density matrix and Newton equation for classical lattice dynamics is developed to simulate the dynamical evolution of a photo-excited Holstein system. We find that the energy injected by a short pump pulse results in the reduction of the CDW order and the generation of coherent phonons. At strong photoexcitations, while the CDW order is melted in the sense that the time-averaged order parameter vanishes, a dynamical CDW state is self-sustained by the strong coherent phonon oscillations. Our large-scale simulations further uncover a dynamical regime of intermediate fluence where complex pattern formation is induced by the pump pulse. The emergent spatial textures are characterized by super density modulations on top of the short-range checkerboard CDW order. Our demonstration of pattern formation highlights the significance of dynamical inhomogeneity in quantum many-body systems in pump-probe experiments.


title: Analyzing the influence of graviton fluctuations on the inflationary spectrum with a Kucha\v{r}-Torre clock

abstract: This paper focuses on the search for a coherent and consistent formulation to describe quantum gravity corrections to Quantum Field Theory. We implement two fundamental ingredients discussed in previous analyses: on one hand, the construction of the Wentzel-Kramer-Brillouin and Born-Oppenheimer picture for the Wheeler-DeWitt theory of gravity and matter by using a reference fluid as physical clock; on the other hand, we explicitly separate in the metric field its own purely classical contribution from the quantum graviton degrees of freedom. This allows to derive, by the expansion in a Planckian parameter, a unitary theory properly evaluating the Quantum Field Theory modifications in the considered regime. More specifically, we recover at zero order the standard theory on curved space-time after averaging over the graviton sector. The physical corrections are induced at first order by (quantum) gravitons, thought as the slow-varying component of the system, as opposed to the fast quantum matter and reference fluid. The genuine contribution due to gravitons, non-factorizable into an independent phase, provides a coherent quantum gravity modification on Quantum Field Theory. We show this by determining the predicted inflationary spectrum during an exact de Sitter phase of the primordial Universe, finding a breaking of the scale invariant morphology even when the inflation potential is modelled by a cosmological constant term. Remarkably, the behavior of such non-scale-invariant spectrum overlaps predictions previously obtained in literature by neglecting non-unitary terms emerging in those formulations. In this respect, the present model provides a satisfactory regularization of such approaches, by virtue of a more realistic construction of the physical clock for the total (gravity + matter) quantum dynamics.


title: STAR: SocioTechnical Approach to Red Teaming Language Models

abstract: This research introduces STAR, a sociotechnical framework that improves on current best practices for red teaming safety of large language models. STAR makes two key contributions: it enhances steerability by generating parameterised instructions for human red teamers, leading to improved coverage of the risk surface. Parameterised instructions also provide more detailed insights into model failures at no increased cost. Second, STAR improves signal quality by matching demographics to assess harms for specific groups, resulting in more sensitive annotations. STAR further employs a novel step of arbitration to leverage diverse viewpoints and improve label reliability, treating disagreement not as noise but as a valuable contribution to signal quality.


title: Minkowski Inequalities and non-isolated hypersurface singularities

abstract: We derive a number of inequalities involving L\^e numbers of non-isolated hypersurface singularities. In particular, we derive L\^e-Iomdine formulas with inequalities and use these, together with Teissier's Minkowski inequalities for sectional Milnor numbers of isolated hypersurface singularities, to arrive at ``Minkowski inequalities'' for L\^e numbers.


title: Folk-ontological stances toward robots and psychological human likeness

abstract: It has often been argued that people can attribute mental states to robots without making any ontological commitments to the reality of those states. But what does it mean to 'attribute' a mental state to a robot, and what is an 'ontological commitment'? It will be argued that, on a plausible interpretation of these two notions, it is not clear how mental state attribution can occur without any ontological commitment. Taking inspiration from the philosophical debate on scientific realism, a provisional taxonomy of folk-ontological stances towards robots will also be identified, corresponding to different ways of understanding robotic minds. They include realism, non-realism, eliminativism, reductionism, fictionalism and agnosticism. Instrumentalism will also be discussed and presented as a folk-epistemological stance. In the last part of the article it will be argued that people's folk-ontological stances towards robots and humans can influence their perception of the human-likeness of robots. The analysis carried out here can be seen as encouraging a 'folk-ontological turn' in human-robot interaction research, aimed at explicitly determining what beliefs people have about the reality of robot minds.


title: Understanding Layered Portability from HPC to Cloud in Containerized Environments

abstract: Recent development in lightweight OS-level virtualization, containers, provides a potential solution for running HPC applications on the cloud platform. In this work, we focus on the impact of different layers in a containerized environment when migrating HPC containers from a dedicated HPC system to a cloud platform. On three ARM-based platforms, including the latest Nvidia Grace CPU, we use six representative HPC applications to characterize the impact of container virtualization, host OS and kernel, and rootless and privileged container execution. Our results indicate less than 4\% container overhead in DGEMM, miniMD, and XSBench, but 8\%-10\% overhead in FFT, HPCG, and Hypre. We also show that changing between the container execution modes results in negligible performance differences in the six applications.


title: Joint Linked Component Analysis for Multiview Data

abstract: In this work, we propose the joint linked component analysis (joint\_LCA) for multiview data. Unlike classic methods which extract the shared components in a sequential manner, the objective of joint\_LCA is to identify the view-specific loading matrices and the rank of the common latent subspace simultaneously. We formulate a matrix decomposition model where a joint structure and an individual structure are present in each data view, which enables us to arrive at a clean svd representation for the cross covariance between any pair of data views. An objective function with a novel penalty term is then proposed to achieve simultaneous estimation and rank selection. In addition, a refitting procedure is employed as a remedy to reduce the shrinkage bias caused by the penalization.


title: Pre-inflationary scalar perturbations on closed universes in loop quantum cosmology

abstract: The inflationary and pre-inflationary evolution of scalar modes of cosmological perturbations in a closed universe is analyzed for a loop quantum cosmology model with an inflationary regime consistent with the constraints on inflation derived from observations of the cosmic microwave background. The effective background dynamics includes a bounce induced by quantum gravity effects. Initial conditions for the perturbations are set before the bounce, and the perturbations are numerically evolved until the end of inflation, allowing the determination of the primordial power spectrum for comoving curvature perturbations. The power spectrum includes corrections due to the presence of spatial curvature and excitations produced before the onset of slow-roll inflation. The deviations from the usual power-law spectrum can be significant for observable modes even for spatial curvatures much smaller than the observational limit obtained without considering the pre-inflationary evolution of the perturbations.


title: Photoinduced Patterning of Oxygen Vacancies to Promote the Ferroelectric Phase of $\mathrm{Hf_{0.5}Zr_{0.5}O_2}$

abstract: Photoinduced reductions in the oxygen vacancy concentration were leveraged to increase the ferroelectric phase fraction of $\mathrm{Hf_{0.5}Zr_{0.5}O_2}$ (HZO) thin-films. Modest ($\sim 0.02-0.77~\mathrm{mJ/\mu m^2}$) laser doses of visible light (488 nm, 2.54 eV) spatially patterned the concentration of oxygen vacancies as monitored by photoluminescence imaging. Local, tip-based, near-field, nanoFTIR measurements showed that the photoinduced oxygen vacancy concentration reduction promoted formation of the ferroelectric phase (space group $Pca2_1$) resulting in an increase in the piezoelectric response measured by piezoresponse force microscopy. Photoinduced vacancy tailoring provides, therefore, a spatially prescriptive, post-synthesis, and low-entry method to modify phase in \hfo-based materials.


title: Simulation of bright and dark diffuse multiple scattering lines in high-flux synchrotron X-ray experiments

abstract: We present a theoretical framework for understanding diffuse multiple scattering (DMS) in single crystals, focusing on diffuse scattering-Bragg (DS-Bragg) channels. These channels, when probed with high-flux, low-divergent monochromatic synchrotron X-rays, provide well-defined visualizations of Kossel lines. Our main contribution lies in modeling the intensity distribution along these lines by considering DS around individual reciprocal lattice nodes. The model incorporates contributions from both general DS and mosaicity, elucidating their connection to second-order scattering events. This comprehensive approach advances our understanding of DMS phenomena, enabling their use as probes for complex material behavior, particularly under extreme conditions.


title: Canonical Filtrations of Finite-Dimensional Algebras

abstract: We study canonical filtrations of finite-dimensional associative algebras and Lie algebras. These filtrations are defined via optimal destabilizing one-parameter subgroups in the sense of geometric invariant theory (GIT), and appear to be a new invariant of finite-dimensional algebras. We establish some fundamental properties of these filtrations, and show that an algebra is semisimple if and only if it is GIT semistable. We give a method to compute canonical filtrations of algebras whose automorphism group or module of derivations is sufficiently rich, and use this to compute these filtrations in examples when the automorphism group contains a sufficiently large torus. We also obtain some results on the structure of the associated graded algebra of the canonical filtration of an associative algebra.


title: Matching Query Image Against Selected NeRF Feature for Efficient and Scalable Localization

abstract: Neural implicit representations such as NeRF have revolutionized 3D scene representation with photo-realistic quality. However, existing methods for visual localization within NeRF representations suffer from inefficiency and scalability issues, particularly in large-scale environments. This work proposes MatLoc-NeRF, a novel matching-based localization framework using selected NeRF features. It addresses efficiency by employing a learnable feature selection mechanism that identifies informative NeRF features for matching with query images. This eliminates the need for all NeRF features or additional descriptors, leading to faster and more accurate pose estimation. To tackle large-scale scenes, MatLoc-NeRF utilizes a pose-aware scene partitioning strategy. It ensures that only the most relevant NeRF sub-block generates key features for a specific pose. Additionally, scene segmentation and a place predictor provide fast coarse initial pose estimation. Evaluations on public large-scale datasets demonstrate that MatLoc-NeRF achieves superior efficiency and accuracy compared to existing NeRF-based localization methods.


title: Stein Variational Ergodic Search

abstract: Exploration requires that robots reason about numerous ways to cover a space in response to dynamically changing conditions. However, in continuous domains there are potentially infinitely many options for robots to explore which can prove computationally challenging. How then should a robot efficiently optimize and choose exploration strategies to adopt? In this work, we explore this question through the use of variational inference to efficiently solve for distributions of coverage trajectories. Our approach leverages ergodic search methods to optimize coverage trajectories in continuous time and space. In order to reason about distributions of trajectories, we formulate ergodic search as a probabilistic inference problem. We propose to leverage Stein variational methods to approximate a posterior distribution over ergodic trajectories through parallel computation. As a result, it becomes possible to efficiently optimize distributions of feasible coverage trajectories for which robots can adapt exploration. We demonstrate that the proposed Stein variational ergodic search approach facilitates efficient identification of multiple coverage strategies and show online adaptation in a model-predictive control formulation. Simulated and physical experiments demonstrate adaptability and diversity in exploration strategies online.


title: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities

abstract: Perceiving and understanding non-speech sounds and non-verbal speech is essential to making decisions that help us interact with our surroundings. In this paper, we propose GAMA, a novel General-purpose Large Audio-Language Model (LALM) with Advanced Audio Understanding and Complex Reasoning Abilities. We build GAMA by integrating an LLM with multiple types of audio representations, including features from a custom Audio Q-Former, a multi-layer aggregator that aggregates features from multiple layers of an audio encoder. We fine-tune GAMA on a large-scale audio-language dataset, which augments it with audio understanding capabilities. Next, we propose CompA-R (Instruction-Tuning for Complex Audio Reasoning), a synthetically generated instruction-tuning (IT) dataset with instructions that require the model to perform complex reasoning on the input audio. We instruction-tune GAMA with CompA-R to endow it with complex reasoning abilities, where we further add a soft prompt as input with high-level semantic evidence by leveraging event tags of the input audio. Finally, we also propose CompA-R-test, a human-labeled evaluation dataset for evaluating the capabilities of LALMs on open-ended audio question-answering that requires complex reasoning. Through automated and expert human evaluations, we show that GAMA outperforms all other LALMs in literature on diverse audio understanding tasks by margins of 1%-84%. Further, GAMA IT-ed on CompA-R proves to be superior in its complex reasoning and instruction following capabilities.


title: Solving Vision Tasks with Simple Photoreceptors Instead of Cameras

abstract: A de facto standard in solving computer vision problems is to use a common high-resolution camera and choose its placement on an agent (i.e., position and orientation) based on human intuition. On the other hand, extremely simple and well-designed visual sensors found throughout nature allow many organisms to perform diverse, complex behaviors. In this work, motivated by these examples, we raise the following questions: 1. How effective simple visual sensors are in solving vision tasks? 2. What role does their design play in their effectiveness? We explore simple sensors with resolutions as low as one-by-one pixel, representing a single photoreceptor First, we demonstrate that just a few photoreceptors can be enough to solve many tasks, such as visual navigation and continuous control, reasonably well, with performance comparable to that of a high-resolution camera. Second, we show that the design of these simple visual sensors plays a crucial role in their ability to provide useful information and successfully solve these tasks. To find a well-performing design, we present a computational design optimization algorithm and evaluate its effectiveness across different tasks and domains, showing promising results. Finally, we perform a human survey to evaluate the effectiveness of intuitive designs devised manually by humans, showing that the computationally found design is among the best designs in most cases.


title: Demonstration of RIP gates in a quantum processor with negligible transverse coupling

abstract: Here, we report the experimental demonstration of a novel multi-mode linear bus interferometer (LBI) coupler in a six qubit superconducting quantum processor. A key feature of this coupler is an engineered multi-path interference which eliminates transverse coupling between qubits over a wide frequency range. This negligible static coupling is achieved without any flux bias tuning, and greatly reduces the impact of qubit frequency collisions. We achieve good simultaneous single qubit gate operation and low ZZ rates (below 600 Hz) across the device without staggering qubit frequencies, even in cases where qubits are as close as 10 MHz. Multi-qubit interactions are still possible through the coupler using microwave-driven resonator induced phase gates, which we utilize to demonstrate simultaneous two qubit gates with fidelities as high as 99.4%


title: Simon's algorithm in the NISQ cloud

abstract: Simon's algorithm was one of the first problems to demonstrate a genuine quantum advantage. The algorithm, however, assumes access to noise-free qubits. In our work we use Simon's algorithm to benchmark the error rates of devices currently available in the "quantum cloud." As a main result we obtain an objective comparison between the different physical platforms made available by IBM and IonQ. Our study highlights the importance of understanding the device architectures and chip topologies when transpiling quantum algorithms onto hardware. For instance, we demonstrate that two-qubit operations on spatially separated qubits on superconducting chips should be avoided.


title: Deep Learning methodology for the identification of wood species using high-resolution macroscopic images

abstract: Significant advancements in the field of wood species identification are needed worldwide to support sustainable timber trade. In this work we contribute to automate the identification of wood species via high-resolution macroscopic images of timber. The main challenge of this problem is that fine-grained patterns in timber are crucial in order to accurately identify wood species, and these patterns are not properly learned by traditional convolutional neural networks (CNNs) trained on low/medium resolution images. We propose a Timber Deep Learning Identification with Patch-based Inference Voting methodology, abbreviated TDLI-PIV methodology. Our proposal exploits the concept of patching and the availability of high-resolution macroscopic images of timber in order to overcome the inherent challenges that CNNs face in timber identification. The TDLI-PIV methodology is able to capture fine-grained patterns in timber and, moreover, boosts robustness and prediction accuracy via a collaborative voting inference process. In this work we also introduce a new data set of marcroscopic images of timber, called GOIMAI-Phase-I, which has been obtained using optical magnification in order to capture fine-grained details, which contrasts to the other datasets that are publicly available. More concretely, images in GOIMAI-Phase-I are taken with a smartphone with a 24x magnifying lens attached to the camera. Our data set contains 2120 images of timber and covers 37 legally protected wood species. Our experiments have assessed the performance of the TDLI-PIV methodology, involving the comparison with other methodologies available in the literature, exploration of data augmentation methods and the effect that the dataset size has on the accuracy of TDLI-PIV.


title: On localizing groups of exotic diffeomorphisms of 4-manifolds

abstract: Ruberman in the 90's showed that the group of exotic diffeomorphisms of closed 4-manifolds can be infinitely generated. We provide various results on the question of when such infinite generation can localize to a smaller embedded submanifold of the original manifold. Our results include: (1) All known infinitely generated groups of exotic diffeomorphisms of 4-manifolds detected by families Seiberg-Witten theory do not localize to any topologically (locally-flatly) embedded rational homology balls in the ambient 4-manifold. (2) Many exotic diffeomorphisms cannot be obtained as Dehn twists along homology spheres (under mild assumptions). (3) There is no contractible 4-manifolds with Seifert fibered boundary that have a universal property for exotic diffeomorphisms analogous to a universal cork. In addition, there is no universal compact 4-manifold $W$ such that the set of exotic diffeomorphisms of a 4-manifold can localize to an embedding of $W$. (4) Certain infinite generations of exotic diffeomorphism groups do localize to a non-compact subset $V$ with a small Betti number, but not to any compact subset of $V$. (5) An analogous result holds for mapping class groups of 4-manifolds.


title: Optimal Transport-Assisted Risk-Sensitive Q-Learning

abstract: The primary goal of reinforcement learning is to develop decision-making policies that prioritize optimal performance without considering risk or safety. In contrast, safe reinforcement learning aims to mitigate or avoid unsafe states. This paper presents a risk-sensitive Q-learning algorithm that leverages optimal transport theory to enhance the agent safety. By integrating optimal transport into the Q-learning framework, our approach seeks to optimize the policy's expected return while minimizing the Wasserstein distance between the policy's stationary distribution and a predefined risk distribution, which encapsulates safety preferences from domain experts. We validate the proposed algorithm in a Gridworld environment. The results indicate that our method significantly reduces the frequency of visits to risky states and achieves faster convergence to a stable policy compared to the traditional Q-learning algorithm.


title: Task Me Anything

abstract: Benchmarks for large multimodal language models (MLMs) now serve to simultaneously assess the general capabilities of models instead of evaluating for a specific capability. As a result, when a developer wants to identify which models to use for their application, they are overwhelmed by the number of benchmarks and remain uncertain about which benchmark's results are most reflective of their specific use case. This paper introduces Task-Me-Anything, a benchmark generation engine which produces a benchmark tailored to a user's needs. Task-Me-Anything maintains an extendable taxonomy of visual assets and can programmatically generate a vast number of task instances. Additionally, it algorithmically addresses user queries regarding MLM performance efficiently within a computational budget. It contains 113K images, 10K videos, 2K 3D object assets, over 365 object categories, 655 attributes, and 335 relationships. It can generate 750M image/video question-answering pairs, which focus on evaluating MLM perceptual capabilities. Task-Me-Anything reveals critical insights: open-source MLMs excel in object and attribute recognition but lack spatial and temporal understanding; each model exhibits unique strengths and weaknesses; larger models generally perform better, though exceptions exist; and GPT4o demonstrates challenges in recognizing rotating/moving objects and distinguishing colors.


title: Improving Multi-Agent Debate with Sparse Communication Topology

abstract: Multi-agent debate has proven effective in improving large language models quality for reasoning and factuality tasks. While various role-playing strategies in multi-agent debates have been explored, in terms of the communication among agents, existing approaches adopt a brute force algorithm -- each agent can communicate with all other agents. In this paper, we systematically investigate the effect of communication connectivity in multi-agent systems. Our experiments on GPT and Mistral models reveal that multi-agent debates leveraging sparse communication topology can achieve comparable or superior performance while significantly reducing computational costs. Furthermore, we extend the multi-agent debate framework to multimodal reasoning and alignment labeling tasks, showcasing its broad applicability and effectiveness. Our findings underscore the importance of communication connectivity on enhancing the efficiency and effectiveness of the "society of minds" approach.


title: Domino tilings of three-dimensional cylinders: regularity of hamiltonian disks

abstract: We consider tree-dimensional domino tilings of cylinders $\mathcal{D} \times [0,N] \subset \mathbb{R}^3$, where $\mathcal{D} \subset \mathbb{R}^2$ is a balanced quadriculated disk and $N \in \mathbb{N}$. A flip is a local move in the space of tilings: two adjacent and parallel dominoes are removed and then replaced in a different position. The twist is a flip invariant that associates an integer number to a domino tiling. A disk $\mathcal{D}$ is called regular if any two tilings of $\mathcal{D} \times [0,N]$ sharing the same twist can be connected trough a sequence of flips once extra vertical space is added to the cylinder. We prove that hamiltonian disks with narrow and small bottlenecks are regular. In particular, we show that the absence of a bottleneck in a hamiltonian disk implies regularity.


title: Brain-inspired Computational Modeling of Action Recognition with Recurrent Spiking Neural Networks Equipped with Reinforcement Delay Learning

abstract: The growing interest in brain-inspired computational models arises from the remarkable problem-solving efficiency of the human brain. Action recognition, a complex task in computational neuroscience, has received significant attention due to both its intricate nature and the brain's exceptional performance in this area. Nevertheless, current solutions for action recognition either exhibit limitations in effectively addressing the problem or lack the necessary biological plausibility. Deep neural networks, for instance, demonstrate acceptable performance but deviate from biological evidence, thereby restricting their suitability for brain-inspired computational studies. On the other hand, the majority of brain-inspired models proposed for action recognition exhibit significantly lower effectiveness compared to deep models and fail to achieve human-level performance. This deficiency can be attributed to their disregard for the underlying mechanisms of the brain. In this article, we present an effective brain-inspired computational model for action recognition. We equip our model with novel biologically plausible mechanisms for spiking neural networks that are crucial for learning spatio-temporal patterns. The key idea behind these new mechanisms is to bridge the gap between the brain's capabilities and action recognition tasks by integrating key biological principles into our computational framework. Furthermore, we evaluate the performance of our model against other models using a benchmark dataset for action recognition, DVS-128 Gesture. The results show that our model outperforms previous biologically plausible models and competes with deep supervised models.


title: Compact Proofs of Model Performance via Mechanistic Interpretability

abstract: In this work, we propose using mechanistic interpretability -- techniques for reverse engineering model weights into human-interpretable algorithms -- to derive and compactly prove formal guarantees on model performance. We prototype this approach by formally proving lower bounds on the accuracy of 151 small transformers trained on a Max-of-$K$ task. We create 102 different computer-assisted proof strategies and assess their length and tightness of bound on each of our models. Using quantitative metrics, we find that shorter proofs seem to require and provide more mechanistic understanding. Moreover, we find that more faithful mechanistic understanding leads to tighter performance bounds. We confirm these connections by qualitatively examining a subset of our proofs. Finally, we identify compounding structureless noise as a key challenge for using mechanistic interpretability to generate compact proofs on model performance.


title: Split, Unlearn, Merge: Leveraging Data Attributes for More Effective Unlearning in LLMs

abstract: Large language models (LLMs) have shown to pose social and ethical risks such as generating toxic language or facilitating malicious use of hazardous knowledge. Machine unlearning is a promising approach to improve LLM safety by directly removing harmful behaviors and knowledge. In this paper, we propose "SPlit, UNlearn, MerGE" (SPUNGE), a framework that can be used with any unlearning method to amplify its effectiveness. SPUNGE leverages data attributes during unlearning by splitting unlearning data into subsets based on specific attribute values, unlearning each subset separately, and merging the unlearned models. We empirically demonstrate that SPUNGE significantly improves the performance of two recent unlearning methods on state-of-the-art LLMs while maintaining their general capabilities on standard academic benchmarks.


title: DiffMM: Multi-Modal Diffusion Model for Recommendation

abstract: The rise of online multi-modal sharing platforms like TikTok and YouTube has enabled personalized recommender systems to incorporate multiple modalities (such as visual, textual, and acoustic) into user representations. However, addressing the challenge of data sparsity in these systems remains a key issue. To address this limitation, recent research has introduced self-supervised learning techniques to enhance recommender systems. However, these methods often rely on simplistic random augmentation or intuitive cross-view information, which can introduce irrelevant noise and fail to accurately align the multi-modal context with user-item interaction modeling. To fill this research gap, we propose a novel multi-modal graph diffusion model for recommendation called DiffMM. Our framework integrates a modality-aware graph diffusion model with a cross-modal contrastive learning paradigm to improve modality-aware user representation learning. This integration facilitates better alignment between multi-modal feature information and collaborative relation modeling. Our approach leverages diffusion models' generative capabilities to automatically generate a user-item graph that is aware of different modalities, facilitating the incorporation of useful multi-modal knowledge in modeling user-item interactions. We conduct extensive experiments on three public datasets, consistently demonstrating the superiority of our DiffMM over various competitive baselines. For open-sourced model implementation details, you can access the source codes of our proposed framework at: https://github.com/HKUDS/DiffMM .


title: Soft-output Guessing Codeword Decoding

abstract: We establish that it is possible to extract accurate blockwise and bitwise soft output from Guessing Codeword Decoding with minimal additional computational complexity by considering it as a variant of Guessing Random Additive Noise Decoding. Blockwise soft output can be used to control decoding misdetection rate while bitwise soft output results in a soft-input soft-output decoder that can be used for efficient iterative decoding of long, high redundancy codes.


title: The systole of random hyperbolic 3-manifolds

abstract: We study the systole of a model of random hyperbolic 3-manifolds introduced by Petri and Raimbault, answering a question posed in that same article. These are compact manifolds with boundary constructed by randomly gluing truncated tetrahedra along their faces. We prove that the limit, as the volume tends to infinity, of the expected value of their systole exists and we give a closed formula of it. Moreover, we compute a numerical approximation of this value.


title: MDCR: A Dataset for Multi-Document Conditional Reasoning

abstract: The same real-life questions posed to different individuals may lead to different answers based on their unique situations. For instance, whether a student is eligible for a scholarship depends on eligibility conditions, such as major or degree required. ConditionalQA was proposed to evaluate models' capability of reading a document and answering eligibility questions, considering unmentioned conditions. However, it is limited to questions on single documents, neglecting harder cases that may require cross-document reasoning and optimization, for example, "What is the maximum number of scholarships attainable?" Such questions over multiple documents are not only more challenging due to more context having to understand, but also because the model has to (1) explore all possible combinations of unmentioned conditions and (2) understand the relationship between conditions across documents, to reason about the optimal outcome. To evaluate models' capability of answering such questions, we propose a new dataset MDCR, which can reflect real-world challenges and serve as a new test bed for complex conditional reasoning that requires optimization. We evaluate this dataset using the most recent LLMs and demonstrate their limitations in solving this task. We believe this dataset will facilitate future research in answering optimization questions with unknown conditions.


title: CELL your Model: Contrastive Explanation Methods for Large Language Models

abstract: The advent of black-box deep neural network classification models has sparked the need to explain their decisions. However, in the case of generative AI such as large language models (LLMs), there is no class prediction to explain. Rather, one can ask why an LLM output a particular response to a given prompt. In this paper, we answer this question by proposing, to the best of our knowledge, the first contrastive explanation methods requiring simply black-box/query access. Our explanations suggest that an LLM outputs a reply to a given prompt because if the prompt was slightly modified, the LLM would have given a different response that is either less preferable or contradicts the original response. The key insight is that contrastive explanations simply require a distance function that has meaning to the user and not necessarily a real valued representation of a specific response (viz. class label). We offer two algorithms for finding contrastive explanations: i) A myopic algorithm, which although effective in creating contrasts, requires many model calls and ii) A budgeted algorithm, our main algorithmic contribution, which intelligently creates contrasts adhering to a query budget, necessary for longer contexts. We show the efficacy of these methods on diverse natural language tasks such as open-text generation, automated red teaming, and explaining conversational degradation.


title: A Brief Survey on Leveraging Large Scale Vision Models for Enhanced Robot Grasping

abstract: Robotic grasping presents a difficult motor task in real-world scenarios, constituting a major hurdle to the deployment of capable robots across various industries. Notably, the scarcity of data makes grasping particularly challenging for learned models. Recent advancements in computer vision have witnessed a growth of successful unsupervised training mechanisms predicated on massive amounts of data sourced from the Internet, and now nearly all prominent models leverage pretrained backbone networks. Against this backdrop, we begin to investigate the potential benefits of large-scale visual pretraining in enhancing robot grasping performance. This preliminary literature review sheds light on critical challenges and delineates prospective directions for future research in visual pretraining for robotic manipulation.


title: A universal coefficient theorem for actions of finite groups on C*-algebras

abstract: The equivariant bootstrap class in the Kasparov category of actions of a finite group G consists of those actions that are equivalent to one on a Type I C*-algebra. Using a result by Arano and Kubota, we show that this bootstrap class is already generated by the continuous functions on G/H for all cyclic subgroups H of G. Then we prove a Universal Coefficient Theorem for the localisation of this bootstrap class at the group order |G|. This allows us to classify certain G-actions on stable Kirchberg algebras up to cocycle conjugacy.


title: Holographic Classical Shadow Tomography

abstract: We introduce "holographic shadows", a new class of randomized measurement schemes for classical shadow tomography that achieves the optimal scaling of sample complexity for learning geometrically local Pauli operators at any length scale, without the need for fine-tuning protocol parameters such as circuit depth or measurement rate. Our approach utilizes hierarchical quantum circuits, such as tree quantum circuits or holographic random tensor networks. Measurements within the holographic bulk correspond to measurements at different scales on the boundary (i.e. the physical system of interests), facilitating efficient quantum state estimation across observable at all scales. Considering the task of estimating string-like Pauli observables supported on contiguous intervals of $k$ sites in a 1D system, our method achieves an optimal sample complexity scaling of $\sim d^k\mathrm{poly}(k)$, with $d$ the local Hilbert space dimension. We present a holographic minimal cut framework to demonstrate the universality of this sample complexity scaling and validate it with numerical simulations, illustrating the efficacy of holographic shadows in enhancing quantum state learning capabilities.


title: Quantum metrology with a squeezed Kerr oscillator

abstract: We study the squeezing dynamics in a Kerr-nonlinear oscillator, and quantify the metrological usefulness of the resulting states. Even if the nonlinearity limits the attainable squeezing by making the evolution non-Gaussian, the states obtained still have a high quantum Fisher information for sensing displacements. However, contrary to the Gaussian case, the amplitude of the displacement cannot be estimated by simple quadrature measurements. Therefore, we propose the use of a measurement-after-interaction protocol where a linear quadrature measurement is preceded by an additional nonlinear evolution, and show the significant sensitivity enhancement that can be obtained. Our results are robust when considering realistic imperfections such as energy relaxation, and can be implemented in state-of-the-art experimental setups.


title: Effective Faraday interaction between light and nuclear spins of Helium-3 in its ground state: a semiclassical study

abstract: We derive the semiclassical evolution equations for a system consisting of helium-3 atoms in the $2^3S$ metastable state interacting with a light field far-detuned from the $2^3S-2^3P$ transition, in the presence of metastability exchange collisions with ground state helium atoms and a static magnetic field. For two configurations, each corresponding to a particular choice of atom-light detuning in which the contribution of either the metastable level $F=1/2$ or $F=3/2$ is dominant, we derive a simple model of three coupled collective spins from which we can analytically extract an effective coupling constant between the collective nuclear spin and light. In these two configurations, we compare the predictions of our simplified model with the full model.


title: Bell inequalities as a tool to probe quantum chaos

abstract: We introduce a permutationally invariant multipartite Bell inequality for many-body three-level systems and use it to explore a possible connection between the presence of nonlocality and quantum chaos. For this, we interpret the Bell operator resulting from fixing the measurement settings as a system Hamiltonian and explore the energy level spacing distribution for different measurement choices and SU(3) irreducible representations. Interestingly, we find that in every irreducible representation displaying nonlocality, the measurement settings yielding maximal violation result in a Bell operator whose energy level spacing distribution signals the absence of quantum chaos. This situation changes when the measurement settings slightly depart from the optimal ones, as we generally observe a level spacing distribution characteristic of chaotic systems. Our work suggests an intriguing connection between Bell nonlocality, quantum chaos and random matrix theory. These subjects belonged to the beloved areas of the late Fritz Haake, and we dedicate this paper to his memory.


title: Deriving three-outcome permutationally invariant Bell inequalities

abstract: We present strategies to derive Bell inequalities valid for systems composed of many three-level parties. This scenario is formalized by a Bell experiment with $N$ observers, each of which performs one out of two possible three-outcome measurements on their share of the system. As the complexity of the set of classical correlations prohibits its full characterization in this multipartite scenario, we consider its projection to a lower dimensional subspace spanned by permutationally invariant one- and two-body observables. This simplification allows us to formulate two complementary methods for detecting nonlocality in multipartite three-level systems, both having a complexity independent of $N$. Our work can have interesting applications in the detection of Bell correlations in paradigmatic spin-1 models, as well as in experiments with solid-state systems or atomic ensembles.


title: FetchBench: A Simulation Benchmark for Robot Fetching

abstract: Fetching, which includes approaching, grasping, and retrieving, is a critical challenge for robot manipulation tasks. Existing methods primarily focus on table-top scenarios, which do not adequately capture the complexities of environments where both grasping and planning are essential. To address this gap, we propose a new benchmark FetchBench, featuring diverse procedural scenes that integrate both grasping and motion planning challenges. Additionally, FetchBench includes a data generation pipeline that collects successful fetch trajectories for use in imitation learning methods. We implement multiple baselines from the traditional sense-plan-act pipeline to end-to-end behavior models. Our empirical analysis reveals that these methods achieve a maximum success rate of only 20%, indicating substantial room for improvement. Additionally, we identify key bottlenecks within the sense-plan-act pipeline and make recommendations based on the systematic analysis.


title: DataComp-LM: In search of the next generation of training sets for language models

abstract: We introduce DataComp for Language Models (DCLM), a testbed for controlled dataset experiments with the goal of improving language models. As part of DCLM, we provide a standardized corpus of 240T tokens extracted from Common Crawl, effective pretraining recipes based on the OpenLM framework, and a broad suite of 53 downstream evaluations. Participants in the DCLM benchmark can experiment with data curation strategies such as deduplication, filtering, and data mixing at model scales ranging from 412M to 7B parameters. As a baseline for DCLM, we conduct extensive experiments and find that model-based filtering is key to assembling a high-quality training set. The resulting dataset, DCLM-Baseline enables training a 7B parameter language model from scratch to 64% 5-shot accuracy on MMLU with 2.6T training tokens. Compared to MAP-Neo, the previous state-of-the-art in open-data language models, DCLM-Baseline represents a 6.6 percentage point improvement on MMLU while being trained with 40% less compute. Our baseline model is also comparable to Mistral-7B-v0.3 and Llama 3 8B on MMLU (63% & 66%), and performs similarly on an average of 53 natural language understanding tasks while being trained with 6.6x less compute than Llama 3 8B. Our results highlight the importance of dataset design for training language models and offer a starting point for further research on data curation.


title: Run Time Assured Reinforcement Learning for Six Degree-of-Freedom Spacecraft Inspection

abstract: The trial and error approach of reinforcement learning (RL) results in high performance across many complex tasks, but it can also lead to unsafe behavior. Run time assurance (RTA) approaches can be used to assure safety of the agent during training, allowing it to safely explore the environment. This paper investigates the application of RTA during RL training for a 6-Degree-of-Freedom spacecraft inspection task, where the agent must control its translational motion and attitude to inspect a passive chief spacecraft. Several safety constraints are developed based on position, velocity, attitude, temperature, and power of the spacecraft, and are all enforced simultaneously during training through the use of control barrier functions. This paper also explores simulating the RL agent and RTA at different frequencies to best balance training performance and safety assurance. The agent is trained with and without RTA, and the performance is compared across several metrics including inspection percentage and fuel usage.


title: Stochastic theory of nonlinear electrical circuits in thermal equilibrium

abstract: We revisit the theory of dissipative mechanics in RLC circuits, allowing for circuit elements to have nonlinear constitutive relations, and for the circuit to have arbitrary topology. We systematically generalize the dissipationless Hamiltonian mechanics of an LC circuit to account for resistors and incorporate the physical postulate that the resulting RLC circuit thermalizes with its environment at a constant positive temperature. Our theory explains stochastic fluctuations, or Johnson noise, which are mandated by the fluctuation-dissipation theorem. Assuming Gaussian Markovian noise, we obtain exact expressions for multiplicative Johnson noise through nonlinear resistors in circuits with convenient (parasitic) capacitors and/or inductors. With linear resistors, our formalism is describable using a Kubo-Martin-Schwinger-invariant Lagrangian formalism for dissipative thermal systems. Generalizing our technique to quantum circuits could lead to an alternative way to study decoherence in nonlinear superconducting circuits without the Caldeira-Leggett formalism.


title: Finding Linear Explanations for a Given Ranking

abstract: Given a relation and a ranking of its tuples, but no information about the ranking function, we propose RankExplain to solve 2 types of problems: SAT asks if any linear scoring function can exactly reproduce the given ranking. OPT identifies the linear scoring function that minimizes position-based error, i.e., the total of the ranking-position differences over all tuples in the top-k. Our solution consists of linear programs that solve the problems exactly and can be implemented using MILP solvers. These solvers also support additional constraints on the scoring function, allowing the user to explore competing hypotheses through alternative scoring functions. We also discuss techniques for dealing with numerical imprecision and for improving performance and scalability. Experiments demonstrate that RankExplain can solve realistic problems. It is the first technique to provide exact solutions for OPT; and it is the fastest in producing exact solutions for SAT.


title: Turbulent magnetic decay controlled by two conserved quantities

abstract: The decay of a turbulent magnetic field is slower with helicity than without. Furthermore, the magnetic correlation length grows faster for a helical than a nonhelical field. Both helical and nonhelical decay laws involve conserved quantities: the mean magnetic helicity density and the Hosking integral. Using direct numerical simulations, we show quantitatively that in the fractionally helical case the magnetic energy and correlation length are approximately given by the maximum of the values for the purely helical and purely nonhelical cases. The time of switch-over from one to the other decay law can be obtained on dimensional grounds and is approximately given by $I_\mathrm{H}^{1/2}I_\mathrm{M}^{-3/2}$, where $I_\mathrm{H}$ is the Hosking integral and $I_\mathrm{M}$ is the mean magnetic helicity density. An earlier approach based on the decay time is found to agree with our new result and suggests that the Hosking integral exceeds naive estimates by the square of the same resistivity-dependent factor by which the turbulent decay time exceeds the Alfv\'en time.


title: Mix-Domain Contrastive Learning for Unpaired H&E-to-IHC Stain Translation

abstract: H&E-to-IHC stain translation techniques offer a promising solution for precise cancer diagnosis, especially in low-resource regions where there is a shortage of health professionals and limited access to expensive equipment. Considering the pixel-level misalignment of H&E-IHC image pairs, current research explores the pathological consistency between patches from the same positions of the image pair. However, most of them overemphasize the correspondence between domains or patches, overlooking the side information provided by the non-corresponding objects. In this paper, we propose a Mix-Domain Contrastive Learning (MDCL) method to leverage the supervision information in unpaired H&E-to-IHC stain translation. Specifically, the proposed MDCL method aggregates the inter-domain and intra-domain pathology information by estimating the correlation between the anchor patch and all the patches from the matching images, encouraging the network to learn additional contrastive knowledge from mixed domains. With the mix-domain pathology information aggregation, MDCL enhances the pathological consistency between the corresponding patches and the component discrepancy of the patches from the different positions of the generated IHC image. Extensive experiments on two H&E-to-IHC stain translation datasets, namely MIST and BCI, demonstrate that the proposed method achieves state-of-the-art performance across multiple metrics.


title: Magnetic field in mini starburst complex Sgr B2

abstract: We report the first arcsecond-resolution observations of the magnetic field in the mini starburst complex Sgr B2. SMA polarization observations revealed magnetic field morphology in three dense cores of Sgr B2 N(orth), M(ain), and S(outh). The total plane-of-sky magnetic field strengths in these cores are estimated to be 4.3-10.0 mG, 6.2-14.7 mG, and 1.9-4.5 mG derived from the angular dispersion function method after applying the correction factors of 0.21 and 0.5. Combining with analyses of the parsec-scale polarization data from SOFIA, we found that a magnetically supercritical condition is present from the cloud-scale ($\sim$10 pc) to core-scale ($\sim$0.2 pc) in Sgr B2, which is consistent with the burst of star formation activities in the region likely resulted from a multi-scale gravitational collapse from the cloud to dense cores.


title: Safety Arithmetic: A Framework for Test-time Safety Alignment of Language Models by Steering Parameters and Activations

abstract: Ensuring the safe alignment of large language models (LLMs) with human values is critical as they become integral to applications like translation and question answering. Current alignment methods struggle with dynamic user intentions and complex objectives, making models vulnerable to generating harmful content. We propose Safety Arithmetic, a training-free framework enhancing LLM safety across different scenarios: Base models, Supervised fine-tuned models (SFT), and Edited models. Safety Arithmetic involves Harm Direction Removal to avoid harmful content and Safety Alignment to promote safe responses. Additionally, we present NoIntentEdit, a dataset highlighting edit instances that could compromise model safety if used unintentionally. Our experiments show that Safety Arithmetic significantly improves safety measures, reduces over-safety, and maintains model utility, outperforming existing methods in ensuring safe content generation.


title: PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Models

abstract: Text-to-image (T2I) models have made substantial progress in generating images from textual prompts. However, they frequently fail to produce images consistent with physical commonsense, a vital capability for applications in world simulation and everyday tasks. Current T2I evaluation benchmarks focus on metrics such as accuracy, bias, and safety, neglecting the evaluation of models' internal knowledge, particularly physical commonsense. To address this issue, we introduce PhyBench, a comprehensive T2I evaluation dataset comprising 700 prompts across 4 primary categories: mechanics, optics, thermodynamics, and material properties, encompassing 31 distinct physical scenarios. We assess 6 prominent T2I models, including proprietary models DALLE3 and Gemini, and demonstrate that incorporating physical principles into prompts enhances the models' ability to generate physically accurate images. Our findings reveal that: (1) even advanced models frequently err in various physical scenarios, except for optics; (2) GPT-4o, with item-specific scoring instructions, effectively evaluates the models' understanding of physical commonsense, closely aligning with human assessments; and (3) current T2I models are primarily focused on text-to-image translation, lacking profound reasoning regarding physical commonsense. We advocate for increased attention to the inherent knowledge within T2I models, beyond their utility as mere image generation tools. The code and data are available at https://github.com/OpenGVLab/PhyBench.


title: Efficient Discovery of Significant Patterns with Few-Shot Resampling

abstract: Significant pattern mining is a fundamental task in mining transactional data, requiring to identify patterns significantly associated with the value of a given feature, the target. In several applications, such as biomedicine, basket market analysis, and social networks, the goal is to discover patterns whose association with the target is defined with respect to an underlying population, or process, of which the dataset represents only a collection of observations, or samples. A natural way to capture the association of a pattern with the target is to consider its statistical significance, assessing its deviation from the (null) hypothesis of independence between the pattern and the target. While several algorithms have been proposed to find statistically significant patterns, it remains a computationally demanding task, and for complex patterns such as subgroups, no efficient solution exists. We present FSR, an efficient algorithm to identify statistically significant patterns with rigorous guarantees on the probability of false discoveries. FSR builds on a novel general framework for mining significant patterns that captures some of the most commonly considered patterns, including itemsets, sequential patterns, and subgroups. FSR uses a small number of resampled datasets, obtained by assigning i.i.d. labels to each transaction, to rigorously bound the supremum deviation of a quality statistic measuring the significance of patterns. FSR builds on novel tight bounds on the supremum deviation that require to mine a small number of resampled datasets, while providing a high effectiveness in discovering significant patterns. As a test case, we consider significant subgroup mining, and our evaluation on several real datasets shows that FSR is effective in discovering significant subgroups, while requiring a small number of resampled datasets.


title: New construction of a vacuum doubly rotating black ring by the Ehlers transformation

abstract: Using the Ehlers transformation, we derive an exact solution for a doubly rotating black ring in five-dimensional vacuum Einstein theory. It is well-known that the vacuum Einstein theory with three commuting Killing vector fields can be reduced to a non-linear sigma model with $SL(3,{\mathbb R})$ target space symmetry. As shown previously by Giusto and Saxena, the $SO(2,1)$ subgroup in the $SL(3,{\mathbb R})$ can generate a rotating solution from a static solution while preserving asymptotic flatness. This so-called Ehlers transformation actually transforms the five-dimensional Schwarzschild black hole into the five-dimensional Myers-Perry black hole. However, unlike the case with the black hole, applying this method directly to the static black ring or the Emparan-Reall black ring, does not yield a regular rotating black ring due to the emergence of a Dirac-Misner string singularity. To solve this undesirable issue, we use a singular vacuum solution of a rotating black ring/lens that already possesses a Dirac-Misner string singularity as the seed solution for the Ehlers transformation. The resulting solution is regular, indicating the absence of curvature singularities, conical singularities, orbifold singularities, Dirac-Misner string singularities, and closed timelike curves both on and outside the horizon. We show that this solution obtained by the Ehlers transformation coincides precisely with the Pomeransky-Sen'kov solution. We expect that applying this method to other theories may lead to the finding of new exact solutions, such as solutions for black lenses and capped black holes, as well as black ring configurations.


title: Predicting quantum learnability from landscape fluctuation

abstract: The tradeoff between trainability and expressibility is a central challenge faced by today's variational quantum computing. Recent studies indicate that resolving this dilemma necessitates designing specific parametrized quantum circuits (PQC) tailored for specific problems, which urgently needs a general and efficient method to assess the learnability of PQCs regarding a given target. In this Letter, we demonstrate a simple and efficient metric for learnability by comparing the fluctuations of the given training landscape with standard learnable landscapes. This metric shows surprising effectiveness in predicting learnability as it unifies the effects of insufficient expressibility, barren plateaus, bad local minima, and overparametrization. Importantly, it does not require actual training and can be estimated efficiently on classical computers via Clifford sampling. We conduct extensive numerical experiments to validate its effectiveness regarding both physical and random Hamiltonians. We also prove a compact lower bound for the metric in locally scrambled circuits as analytical guidance. Our findings enable efficient predictions of learnability, allowing fast selection of suitable PQCs for a given problem without training, which can improve the efficiency of variational quantum computing especially when access to quantum devices is limited.


title: A conservation law for posterior predictive variance

abstract: We use the law of total variance to generate multiple expressions for the posterior predictive variance in Bayesian hierarchical models. These expressions are sums of terms involving conditional expectations and conditional variances. Since the posterior predictive variance is fixed given the hierarchical model, it represents a constant quantity that is conserved over the various expressions for it. The terms in the expressions can be assessed in absolute or relative terms to understand the main contributors to the length of prediction intervals. Also, sometimes these terms can be intepreted in the context of the hierarchical model. We show several examples, closed form and computational, to illustrate the uses of this approach in model assessment.


title: Condensate Formation in a Chiral Lattice Gas

abstract: We investigate the formation of condensates in a binary lattice gas in the presence of chiral interactions. These interactions differ between a given microscopic configuration and its mirror image. We consider a two dimensional lattice gas with nearest-neighbour interactions to which we add interactions involving favoured local structures that are chiral. We focus on favoured local structures that have the shape of the letter L and explore condensate formation through simulations and analytical calculations. At low temperature, this model can exhibit four different phases that are characterised by different periodic tiling patterns, depending on the strength of interactions and the chemical potential. When particle numbers are conserved, some of these phases can coexist. We analyse the structure and surface tension of interfaces between coexisting phases and determine the condensate shapes of minimal free energy. We show that these shapes can be quadrilaterals or octagons of different orientation and symmetry.


title: Faces of Experimental Pain: Transferability of Deep Learned Heat Pain Features to Electrical Pain

abstract: The limited size of pain datasets are a challenge in developing robust deep learning models for pain recognition. Transfer learning approaches are often employed in these scenarios. In this study, we investigate whether deep learned feature representation for one type of experimentally induced pain can be transferred to another. Participating in the AI4Pain challenge, our goal is to classify three levels of pain (No-Pain, Low-Pain, High-Pain). The challenge dataset contains data collected from 65 participants undergoing varying intensities of electrical pain. We utilize the video recording from the dataset to investigate the transferability of deep learned heat pain model to electrical pain. In our proposed approach, we leverage an existing heat pain convolutional neural network (CNN) - trained on BioVid dataset - as a feature extractor. The images from the challenge dataset are inputted to the pre-trained heat pain CNN to obtain feature vectors. These feature vectors are used to train two machine learning models: a simple feed-forward neural network and a long short-term memory (LSTM) network. Our approach was tested using the dataset's predefined training, validation, and testing splits. Our models outperformed the baseline of the challenge on both the validation and tests sets, highlighting the potential of models trained on other pain datasets for reliable feature extraction.


title: Physics-Constrained Learning for PDE Systems with Uncertainty Quantified Port-Hamiltonian Models

abstract: Modeling the dynamics of flexible objects has become an emerging topic in the community as these objects become more present in many applications, e.g., soft robotics. Due to the properties of flexible materials, the movements of soft objects are often highly nonlinear and, thus, complex to predict. Data-driven approaches seem promising for modeling those complex dynamics but often neglect basic physical principles, which consequently makes them untrustworthy and limits generalization. To address this problem, we propose a physics-constrained learning method that combines powerful learning tools and reliable physical models. Our method leverages the data collected from observations by sending them into a Gaussian process that is physically constrained by a distributed Port-Hamiltonian model. Based on the Bayesian nature of the Gaussian process, we not only learn the dynamics of the system, but also enable uncertainty quantification. Furthermore, the proposed approach preserves the compositional nature of Port-Hamiltonian systems.


title: Computationally Efficient RL under Linear Bellman Completeness for Deterministic Dynamics

abstract: We study computationally and statistically efficient Reinforcement Learning algorithms for the linear Bellman Complete setting, a setting that uses linear function approximation to capture value functions and unifies existing models like linear Markov Decision Processes (MDP) and Linear Quadratic Regulators (LQR). While it is known from the prior works that this setting is statistically tractable, it remained open whether a computationally efficient algorithm exists. Our work provides a computationally efficient algorithm for the linear Bellman complete setting that works for MDPs with large action spaces, random initial states, and random rewards but relies on the underlying dynamics to be deterministic. Our approach is based on randomization: we inject random noise into least square regression problems to perform optimistic value iteration. Our key technical contribution is to carefully design the noise to only act in the null space of the training data to ensure optimism while circumventing a subtle error amplification issue.