title: Quantum Coherence and Distinguishability: A Resource-Theoretic Perspective on Wave-Particle Duality

abstract: Wave-particle duality, the cornerstone of quantum mechanics, illustrates essential trade-offs between two complementary aspects of quantum systems. Captured by Bohr's complementarity principle, the wave-particle duality relation indicates that perfect path discrimination in a multipath interferometer obliterates interference patterns and vice versa. In this work, from the perspective of coherence resource manipulation, we uncover a novel duality relation between quantum coherence and distinguishability in ensembles of mutually orthogonal pure states. We demonstrate the sum of `co-bits', coherence preserved after discrimination, and classical bits, distinguishability extracted through perfect discrimination is bounded. One cannot simultaneously extract all classical information and preserve coherence. Such duality relation exposes an inherent trade-off between quantum coherence and classical distinguishability resources. Our findings offer a fresh perspective and advance our understanding of the intrinsic complementary relationship between quantum and classical resources.


title: Thirteen New M Dwarf + T Dwarf Pairs Identified with WISE/NEOWISE

abstract: We present the discovery of 13 new widely separated T dwarf companions to M dwarf primaries, identified using WISE/NEOWISE data by the CatWISE and Backyard Worlds: Planet 9 projects. This sample represents a $\sim$60% increase in the number of known M+T systems, and allows us to probe the most extreme products of binary/planetary system formation, a discovery space made available by the CatWISE2020 catalog and the Backyard Worlds: Planet 9 effort. Highlights among the sample are WISEP J075108.79-763449.6, a previously known T9 thought to be old due to its SED, which we now find is part of a common-proper-motion pair with L 34-26 A, a well studied young M3 V star within 10 pc of the Sun; CWISE J054129.32-745021.5 B and 2MASS J05581644-4501559 B, two T8 dwarfs possibly associated with the very fast-rotating M4 V stars CWISE J054129.32-745021.5 A and 2MASS J05581644-4501559 A; and UCAC3 52-1038 B, which is among the widest late T companions to main sequence stars, with a projected separation of $\sim$7100 au. The new benchmarks presented here are prime $JWST$ targets, and can help us place strong constraints on formation and evolution theory of substellar objects as well as on atmospheric models for these cold exoplanet analogs.


title: Adapting to time: why nature evolved a diverse set of neurons

abstract: Brains have evolved a diverse set of neurons with varying morphologies, physiological properties and rich dynamics that impact their processing of temporal information. By contrast, most neural network models include a homogeneous set of units that only vary in terms of their spatial parameters (weights and biases). To investigate the importance of temporal parameters to neural function, we trained spiking neural networks on tasks of varying temporal complexity, with different subsets of parameters held constant. We find that in a tightly resource constrained setting, adapting conduction delays is essential to solve all test conditions, and indeed that it is possible to solve these tasks using only temporal parameters (delays and time constants) with weights held constant. In the most complex spatio-temporal task we studied, we found that an adaptable bursting parameter was essential. More generally, allowing for adaptation of both temporal and spatial parameters increases network robustness to noise, an important feature for both biological brains and neuromorphic computing systems. In summary, our findings highlight how rich and adaptable dynamics are key to solving temporally structured tasks at a low neural resource cost, which may be part of the reason why biological neurons vary so dramatically in their physiological properties.


title: Machine Learning Techniques for MRI Data Processing at Expanding Scale

abstract: Imaging sites around the world generate growing amounts of medical scan data with ever more versatile and affordable technology. Large-scale studies acquire MRI for tens of thousands of participants, together with metadata ranging from lifestyle questionnaires to biochemical assays, genetic analyses and more. These large datasets encode substantial information about human health and hold considerable potential for machine learning training and analysis. This chapter examines ongoing large-scale studies and the challenge of distribution shifts between them. Transfer learning for overcoming such shifts is discussed, together with federated learning for safe access to distributed training data securely held at multiple institutions. Finally, representation learning is reviewed as a methodology for encoding embeddings that express abstract relationships in multi-modal input formats.


title: PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Driving

abstract: We present PLUTO, a powerful framework that pushes the limit of imitation learning-based planning for autonomous driving. Our improvements stem from three pivotal aspects: a longitudinal-lateral aware model architecture that enables flexible and diverse driving behaviors; An innovative auxiliary loss computation method that is broadly applicable and efficient for batch-wise calculation; A novel training framework that leverages contrastive learning, augmented by a suite of new data augmentations to regulate driving behaviors and facilitate the understanding of underlying interactions. We assessed our framework using the large-scale real-world nuPlan dataset and its associated standardized planning benchmark. Impressively, PLUTO achieves state-of-the-art closed-loop performance, beating other competing learning-based methods and surpassing the current top-performed rule-based planner for the first time. Results and code are available at https://jchengai.github.io/pluto.


title: Preserving linear invariants in ensemble filtering methods

abstract: Formulating dynamical models for physical phenomena is essential for understanding the interplay between the different mechanisms and predicting the evolution of physical states. However, a dynamical model alone is often insufficient to address these fundamental tasks, as it suffers from model errors and uncertainties. One common remedy is to rely on data assimilation, where the state estimate is updated with observations of the true system. Ensemble filters sequentially assimilate observations by updating a set of samples over time. They operate in two steps: a forecast step that propagates each sample through the dynamical model and an analysis step that updates the samples with incoming observations. For accurate and robust predictions of dynamical systems, discrete solutions must preserve their critical invariants. While modern numerical solvers satisfy these invariants, existing invariant-preserving analysis steps are limited to Gaussian settings and are often not compatible with classical regularization techniques of ensemble filters, e.g., inflation and covariance tapering. The present work focuses on preserving linear invariants, such as mass, stoichiometric balance of chemical species, and electrical charges. Using tools from measure transport theory (Spantini et al., 2022, SIAM Review), we introduce a generic class of nonlinear ensemble filters that automatically preserve desired linear invariants in non-Gaussian filtering problems. By specializing this framework to the Gaussian setting, we recover a constrained formulation of the Kalman filter. Then, we show how to combine existing regularization techniques for the ensemble Kalman filter (Evensen, 1994, J. Geophys. Res.) with the preservation of the linear invariants. Finally, we assess the benefits of preserving linear invariants for the ensemble Kalman filter and nonlinear ensemble filters.

categories: stat.CO physics.ao-ph physics.data-an stat.ME stat.ML


title: X-Ray: A Sequential 3D Representation For Generation

abstract: We introduce X-Ray, a novel 3D sequential representation inspired by the penetrability of x-ray scans. X-Ray transforms a 3D object into a series of surface frames at different layers, making it suitable for generating 3D models from images. Our method utilizes ray casting from the camera center to capture geometric and textured details, including depth, normal, and color, across all intersected surfaces. This process efficiently condenses the whole 3D object into a multi-frame video format, motivating the utilize of a network architecture similar to those in video diffusion models. This design ensures an efficient 3D representation by focusing solely on surface information. Also, we propose a two-stage pipeline to generate 3D objects from X-Ray Diffusion Model and Upsampler. We demonstrate the practicality and adaptability of our X-Ray representation by synthesizing the complete visible and hidden surfaces of a 3D object from a single input image. Experimental results reveal the state-of-the-art superiority of our representation in enhancing the accuracy of 3D generation, paving the way for new 3D representation research and practical applications.


title: Comparison of Empirical Models of Ionospheric Heating to Global Simulations

abstract: Intense currents produced during geomagnetic storms dissipate energy in the ionosphere through Joule heating. This dissipation has significant space weather effects, and thus it is important to determine the ability of physics-based simulations to replicate real events quantitatively. Several empirical models estimate Joule heating based on ionospheric currents using the AE index. In this study, we select 11 magnetic storm simulations from the CCMC database and compare the integrated Joule heating in the simulations with the results of empirical models. We also use the SWMF global magnetohydrodynamic simulations for 12 storms to reproduce the correlation between the simulated AE index and simulated Joule heating. We find that the scale factors in the empirical models are half what is predicted by the SWMF simulations.


title: Divergence-free framings of three-manifolds via eigenspinors

abstract: Gromov used convex integration to prove that any closed orientable three-manifold equipped with a volume form admits three divergence-free vector fields which are linearly independent at every point. We provide an alternative proof of this (inspired by Seiberg-Witten theory) using geometric properties of eigenspinors in three dimensions. In fact, our proof shows that for any Riemannian metric, one can find three divergence-free vector fields such that at every point they are orthogonal and have the same non-zero length.


title: Full Event Particle-Level Unfolding with Variable-Length Latent Variational Diffusion

abstract: The measurements performed by particle physics experiments must account for the imperfect response of the detectors used to observe the interactions. One approach, unfolding, statistically adjusts the experimental data for detector effects. Recently, generative machine learning models have shown promise for performing unbinned unfolding in a high number of dimensions. However, all current generative approaches are limited to unfolding a fixed set of observables, making them unable to perform full-event unfolding in the variable dimensional environment of collider data. A novel modification to the variational latent diffusion model (VLD) approach to generative unfolding is presented, which allows for unfolding of high- and variable-dimensional feature spaces. The performance of this method is evaluated in the context of semi-leptonic top quark pair production at the Large Hadron Collider.


title: DE-LIoT: The Data-Energy Networking Paradigm for Sustainable Light-Based Internet of Things

abstract: The growing demand for Internet of Things (IoT) networks has sparked interest in sustainable, zero-energy designs through Energy Harvesting (EH) to extend the lifespans of IoT sensors. Visible Light Communication (VLC) is particularly promising, integrating signal transmission with optical power harvesting to enable both data exchange and energy transfer in indoor network nodes. VLC indoor channels, however, can be unstable due to their line-of-sight nature and indoor movements. In conventional EH-based IoT networks, maximum Energy Storage (ES) capacity might halt further harvesting or waste excess energy, leading to resource inefficiency. Addressing these issues, this paper proposes a novel VLC-based WPANs concept that enhances both data and energy harvesting efficiency. The architecture employs densely distributed nodes and a central controller for simultaneous data and energy network operation, ensuring efficient energy exchange and resource optimisation. This approach, with centralised control and energy-state-aware nodes, aims for long-term energy autonomy. The feasibility of the Data-Energy Networking-enabled Light-based Internet of Things (DE-LIoT) concept is validated through real hardware implementation, demonstrating its sustainability and practical applicability. Results show significant improvements in the lifetime of resource-limited nodes, confirming the effectiveness of this new data and energy networking model in enhancing sustainability and resource optimisation in VLC-based WPANs.


title: New point of view about optical activity in helically-coiled fiber

abstract: The optical activity in a helically-coiled optical fiber is reexamined. It is proven that not only is there no circular birefringence in the fiber but the polarization relative to the laboratory reference frame is not rotated along the fiber. The reason for this is that in contrast with the polarization vector, the Jones vector does not give a complete description of the polarization. As a mathematical entity in some local reference frame that depends on the instantaneous propagation direction, it can only describe the state of polarization relative to that reference frame. With the new implication of the Jones vector, the results of the experiment reported by Papp and Harms in 1977 are explained satisfactorily. In particular, it is shown that the state of polarization relative to the Tang frame remains unchanged along the fiber. The optical activity appears only relative to the Serret-Frenet frame.


title: Regularized Conformal Electrodynamics: Novel C-metric in (2+1) Dimensions

abstract: Conformal electrodynamics is a particularly interesting example of power Maxwell non-linear electrodynamics, designed to possess conformal symmetry in all dimensions. In this paper, we propose a regularized version of Conformal electrodynamics, minimally regularizing the field of a point charge at the origin by breaking the conformal invariance of the theory with a dimensionfull "Born-Infeld-like" parameter. In four dimensions the new theory reduces to the recently studied Regularized Maxwell electrodynamics, distinguished by its "Maxwell-like" solutions for accelerated and slowly rotating black hole spacetimes. Focusing on three dimensions, we show that the new theory shares many of the properties of its four-dimensional cousin, including the existence of the charged C-metric solution (currently unknown in the Maxwell theory).


title: Transitions and Thermodynamics on Species Graphs of Chemical Reaction Networks

abstract: Chemical reaction networks (CRNs) exhibit complex dynamics governed by their underlying network structure. In this paper, we propose a novel approach to study the dynamics of CRNs by representing them on species graphs (S-graphs). By scaling concentrations by conservation laws, we obtain a graph representation of transitions compatible with the S-graph, which allows us to treat the dynamics in CRNs as transitions between chemicals. We also define thermodynamic-like quantities on the S-graph from the introduced transitions and investigate their properties, including the relationship between specieswise forces, activities, and conventional thermodynamic quantities. Remarkably, we demonstrate that this formulation can be developed for a class of irreversible CRNs, while for reversible CRNs, it is related to conventional thermodynamic quantities associated with reactions. The behavior of these specieswise quantities is numerically validated using an oscillating system (Brusselator). Our work provides a novel methodology for studying dynamics on S-graphs, paving the way for a deeper understanding of the intricate interplay between the structure and dynamics of chemical reaction networks.


title: Statistical Validation of Contagion Centrality in Financial Networks

abstract: In this paper, we introduce a novel centrality measure to evaluate shock propagation on financial networks capturing a notion of contagion and systemic risk contributions. In comparison to many popular centrality metrics (e.g., eigenvector centrality) which provide only a relative centrality between nodes, our proposed measure is in an absolute scale permitting comparisons of contagion risk over time. In addition, we provide a statistical validation method when the network is estimated from data, as is done in practice. This statistical test allows us to reliably assess the computed centrality values. We validate our methodology on simulated data and conduct empirical case studies using financial data. We find that our proposed centrality measure increases significantly during times of financial distress and is able to provide insights in to the (market implied) risk-levels of different firms and sectors.


title: Managing Expectations and Imbalanced Training Data in Reactive Force Field Development: an Application to Water Adsorption on Alumina

abstract: ReaxFF is a computationally efficient model for reactive molecular dynamics simulations, which has been applied to a wide variety of chemical systems. When ReaxFF parameters are not yet available for a chemistry of interest, they must be (re)optimized, for which one defines a set of training data that the new ReaxFF parameters should reproduce. ReaxFF training sets typically contain diverse properties with different units, some of which are more abundant (by orders of magnitude) than others. To find the best parameters, one conventionally minimizes a weighted sum of squared errors over all data in the training set. One of the challenges in such numerical optimizations is to assign weights so that the optimized parameters represent a good compromise between all the requirements defined in the training set. This work introduces a new loss function, called Balanced Loss, and a workflow that replaces weight assignment with a more manageable procedure. The training data is divided into categories with corresponding "tolerances", i.e. acceptable root-mean-square errors for the categories, which define the expectations for the optimized ReaxFF parameters. Through the Log-Sum-Exp form of Balanced Loss, the parameter optimization is also a validation of one's expectations, providing meaningful feedback that can be used to reconfigure the tolerances if needed. The new methodology is demonstrated with a non-trivial parameterization of ReaxFF for water adsorption on alumina. This results in a new force field that reproduces both rare and frequent properties of a validation set not used for training. We also demonstrate the robustness of the new force field with a molecular dynamics simulation of water desorption from a $\gamma$-Al$_2$O$_3$ slab model.


title: Zero-shot Cross-lingual Stance Detection via Adversarial Language Adaptation

abstract: Stance detection has been widely studied as the task of determining if a social media post is positive, negative or neutral towards a specific issue, such as support towards vaccines. Research in stance detection has however often been limited to a single language and, where more than one language has been studied, research has focused on few-shot settings, overlooking the challenges of developing a zero-shot cross-lingual stance detection model. This paper makes the first such effort by introducing a novel approach to zero-shot cross-lingual stance detection, Multilingual Translation-Augmented BERT (MTAB), aiming to enhance the performance of a cross-lingual classifier in the absence of explicit training data for target languages. Our technique employs translation augmentation to improve zero-shot performance and pairs it with adversarial learning to further boost model efficacy. Through experiments on datasets labeled for stance towards vaccines in four languages English, German, French, Italian. We demonstrate the effectiveness of our proposed approach, showcasing improved results in comparison to a strong baseline model as well as ablated versions of our model. Our experiments demonstrate the effectiveness of model components, not least the translation-augmented data as well as the adversarial learning component, to the improved performance of the model. We have made our source code accessible on GitHub.


title: Hybrid Intersection Types for PCF (Extended Version)

abstract: Intersection type systems have been independently applied to different evaluation strategies, such as call-by-name (CBN) and call-by-value (CBV). These type systems have been then generalized to different subsuming paradigms being able, in particular, to encode CBN and CBV in a unique unifying framework. However, there are no intersection type systems that explicitly enable CBN and CBV to cohabit together without making use of an encoding into a common target framework. This work proposes an intersection type system for PCF with a specific notion of evaluation, called PCFH. Evaluation in PCFH actually has a hybrid nature, in the sense that CBN and CBV operational behaviors cohabit together. Indeed, PCFH combines a CBV-like operational behavior for function application with a CBN-like behavior for recursion. This hybrid nature is reflected in the type system, which turns out to be sound and complete with respect to PCFH: not only typability implies normalization, but also the converse holds. Moreover, the type system is quantitative, in the sense that the size of typing derivations provides upper bounds for the length of the reduction sequences to normal form. This type system is then refined to a tight one, offering exact information regarding the length of normalization sequences. This is the first time that a sound and complete quantitative type system has been designed for a hybrid computational model.


title: Quantifying Scalar Field Dynamics with DESI 2024 Y1 BAO measurements

abstract: Quintessence scalar fields are a natural candidate for evolving dark energy. Unlike the phenomenological $w_0w_a$ parameterization of the dark energy equation of state, they cannot accommodate the phantom regime of dark energy $w(z) < -1$, or crossings into the phantom regime. Recent baryon acoustic oscillation (BAO) measurements by the Dark Energy Spectroscopic Instrument (DESI) indicate a preference for evolving dark energy over a cosmological constant, ranging from $2.6\sigma-3.9\sigma$ when fitting to $w_0w_a$, and combining the DESI BAO measurements with other cosmological probes. In this work, we directly fit three simple scalar field models to the DESI BAO data, combined with cosmic microwave background anisotropy measurements and supernova data sets. Quantifying the preference for scalar field dynamics exhibited by the data, we find that $2-4\%$ of kinetic scalar field energy $\Omega_{\rm scf,k}$, is preferred over $\Lambda$CDM at the $95\%$ confidence level, for a canonical scalar field with a quadratic or linear potential. Fitting to the supernova data sets Pantheon, Pantheon+, DES-Y5, and Union3, we show that the mild tension ($n_{\sigma}< 3.4 $) under $\Lambda$CDM emerges from a BAO preference for smaller values of fractional mass-energy density $\Omega_m < 0.29$, while all supernova data sets, except for Pantheon, prefer larger values, $\Omega_m > 0.3$. The tension under $\Lambda$CDM remains noticeable ($n_{\sigma} <2.8$), when replacing two of the DESI BAO measurements redshift bins with effective redshifts $z_{\text{eff}} =0.51$, and $z_{\text{eff}}= 0.706$ with comparable BOSS DR 12 BAO measurements at $z_{\text{eff}} =0.51$, and $z_{\text{eff}}= 0.61$. Canonical scalar fields as dark energy are successful in mitigating that tension.


title: Recommendations for Early Definition Science with the Nancy Grace Roman Space Telescope

abstract: The Nancy Grace Roman Space Telescope (Roman), NASA's next flagship observatory, has significant mission time to be spent on surveys for general astrophysics in addition to its three core community surveys. We considered what types of observations outside the core surveys would most benefit from early definition, given 700 hours of mission time in the first two years of Roman's operation. We recommend that a survey of the Galactic plane be defined early, based on the broad range of stakeholders for such a survey, the added scientific value of a first pass to obtain a baseline for proper motions complementary to Gaia's, and the significant potential synergies with ground-based surveys, notably the Legacy Survey of Space and Time (LSST) on Rubin. We also found strong motivation to follow a community definition process for ultra-deep observations with Roman.


title: Heterogeneous Face Recognition Using Domain Invariant Units

abstract: Heterogeneous Face Recognition (HFR) aims to expand the applicability of Face Recognition (FR) systems to challenging scenarios, enabling the matching of face images across different domains, such as matching thermal images to visible spectra. However, the development of HFR systems is challenging because of the significant domain gap between modalities and the lack of availability of large-scale paired multi-channel data. In this work, we leverage a pretrained face recognition model as a teacher network to learn domaininvariant network layers called Domain-Invariant Units (DIU) to reduce the domain gap. The proposed DIU can be trained effectively even with a limited amount of paired training data, in a contrastive distillation framework. This proposed approach has the potential to enhance pretrained models, making them more adaptable to a wider range of variations in data. We extensively evaluate our approach on multiple challenging benchmarks, demonstrating superior performance compared to state-of-the-art methods.


title: On-the-Fly Point Annotation for Fast Medical Video Labeling

abstract: Purpose: In medical research, deep learning models rely on high-quality annotated data, a process often laborious and timeconsuming. This is particularly true for detection tasks where bounding box annotations are required. The need to adjust two corners makes the process inherently frame-by-frame. Given the scarcity of experts' time, efficient annotation methods suitable for clinicians are needed. Methods: We propose an on-the-fly method for live video annotation to enhance the annotation efficiency. In this approach, a continuous single-point annotation is maintained by keeping the cursor on the object in a live video, mitigating the need for tedious pausing and repetitive navigation inherent in traditional annotation methods. This novel annotation paradigm inherits the point annotation's ability to generate pseudo-labels using a point-to-box teacher model. We empirically evaluate this approach by developing a dataset and comparing on-the-fly annotation time against traditional annotation method. Results: Using our method, annotation speed was 3.2x faster than the traditional annotation technique. We achieved a mean improvement of 6.51 +- 0.98 AP@50 over conventional method at equivalent annotation budgets on the developed dataset. Conclusion: Without bells and whistles, our approach offers a significant speed-up in annotation tasks. It can be easily implemented on any annotation platform to accelerate the integration of deep learning in video-based medical research.


title: Laser-written micro-channel atomic magnetometer

abstract: We demonstrate a sensitive optically-pumped magnetometer using rubidium vapor and 0.75 amg of nitrogen buffer gas in a sub-mm-width sensing channel excavated by femtosecond laser writing followed by chemical etching. The channel is buried less than 1 mm below the surface of its fused silica host material, which also includes reservoir chambers and micro-strainer connections, to preserve a clean optical environment. Using a zero-field-resonance magnetometry strategy and a sensing volume of 2.25 mm$^3$, we demonstrate a sensitivity of $\approx$ 1 $\mathrm{pT}/\sqrt{\mathrm{Hz}}$ at $10$ Hz. The device can be integrated with photonic structures and microfluidic channels with 3D versatility. Its sensitivity, bandwidth and stand-off distance will enable detection of localized fields from magnetic nanoparticles and \mul NMR samples.


title: Direct Comparison of SiPM and PMT Sensor Performances in a large-size imaging air Cherenkov telescope

abstract: The peak photon detection efficiency (PDE) of silicon photomultipliers (SiPMs) can be as good or better than the PDE of photomultiplier tubes (PMTs). There are experiments where the signal is measured in the presence of a strong, steady background light emission. In these, one needs to accurately evaluate the signal-to-noise ratio. Imaging Atmospheric Cherenkov Telescopes (IACTs) observe in the presence of strong noise induced by the light of the night sky. It is certainly interesting to investigate the SiPM performance under operational conditions of IACTs and to compare it with that of the PMTs. For that purpose, we built a SiPM-based detector module, which was installed in one of the imaging cameras of the two Major Atmospheric Gamma-ray Imaging Cherenkov (MAGIC) telescopes in 2015. The experience gained from that module was used to design the second generation of modules of improved performance. Two such modules were installed in 2017. MAGIC is a system of two IACTs located on the Canary Island of La Palma. The mechanical structure of the MAGIC imaging cameras offers the possibility to install up to 6 additional detector modules of 7 pixels each into the open vertices of the hexagonal-shaped camera. This allows us to directly, without making any assumption, compare the performance of the PMT-based modules with that of the SiPM-based prototype modules, where SiPMs from three different manufacturers are used.


title: Machine Learning in Viscoelastic Fluids via Energy-Based Kernel Embedding

abstract: The ability to measure differences in collected data is of fundamental importance for quantitative science and machine learning, motivating the establishment of metrics grounded in physical principles. In this study, we focus on the development of such metrics for viscoelastic fluid flows governed by a large class of linear and nonlinear stress models. To do this, we introduce a kernel function corresponding to a given viscoelastic stress model that implicitly embeds flowfield snapshots into a Reproducing Kernel Hilbert Space (RKHS) whose squared norm equals the total mechanical energy. Working implicitly with lifted representations in the RKHS via the kernel function provides natural and unambiguous metrics for distances and angles between flowfields without the need for hyperparameter tuning. Additionally, we present a solution to the preimage problem for our kernels, enabling accurate reconstruction of flowfields from their RKHS representations. Through numerical experiments on an unsteady viscoelastic lid-driven cavity flow, we demonstrate the utility of our kernels for extracting energetically-dominant coherent structures in viscoelastic flows across a range of Reynolds and Weissenberg numbers. Specifically, the features extracted by Kernel Principal Component Analysis (KPCA) of flowfield snapshots using our kernel functions yield reconstructions with superior accuracy in terms of mechanical energy compared to conventional methods such as ordinary Principal Component Analysis (PCA) with na\"ively-defined state vectors or KPCA with ad-hoc choices of kernel functions. Our findings underscore the importance of principled choices of metrics in both scientific and machine learning investigations of complex fluid systems.


title: Operando Analysis of Adsorption-Limited Hydrogen Oxidation Reaction at Palladium Surfaces

abstract: Palladium (Pd) catalysts have been extensively studied for the direct synthesis of H2O through the hydrogen oxidation reaction at ambient conditions. This heterogeneous catalytic reaction not only holds considerable practical significance but also serves as a classical model for investigating fundamental mechanisms, including adsorption and reactions between adsorbates. Nonetheless, the governing mechanisms and kinetics of its intermediate reaction stages under varying gas conditions remains elusive. This is attributed to the intricate interplay between adsorption, atomic diffusion, and concurrent phase transformation of catalyst. Herein, the Pd-catalyzed, water-forming hydrogen oxidation is studied, in situ, to investigate intermediate reaction stages via fluid cell transmission electron microscopy. The dynamic behaviors of water generation, associated with reversible palladium hydride formation, are captured in real time with a nanoscale spatial resolution. Our findings suggest that the hydrogen oxidation rate catalyzed by Pd is significantly affected by the sequence in which gases are introduced. Through direct evidence of electron diffraction and density functional theory calculation, we demonstrate that the hydrogen oxidation rate is limited by adsorption processes of gas precursors. These nanoscale insights help identify the optimal reaction conditions for Pd-catalyzed hydrogen oxidation, which has substantial implications for water production technologies. The developed understanding also advocates a broader exploration of analogous mechanisms in other metal-catalyzed reactions.


title: Automatic Discovery of Visual Circuits

abstract: To date, most discoveries of network subcomponents that implement human-interpretable computations in deep vision models have involved close study of single units and large amounts of human labor. We explore scalable methods for extracting the subgraph of a vision model's computational graph that underlies recognition of a specific visual concept. We introduce a new method for identifying these subgraphs: specifying a visual concept using a few examples, and then tracing the interdependence of neuron activations across layers, or their functional connectivity. We find that our approach extracts circuits that causally affect model output, and that editing these circuits can defend large pretrained models from adversarial attacks.


title: Highest-weight vectors and three-point functions in GKO coset decomposition

abstract: We revisit the classical Goddard-Kent-Olive coset construction. We find the formulas for the highest weight vectors in coset decomposition and calculate their norms. We also derive formulas for matrix elements of natural vertex operators between these vectors. This leads to relations on conformal blocks. Due to the AGT relation, these relations are equivalent to blowup relations on Nekrasov partition functions with the presence of the surface defect. These relations can be used to prove Kyiv formulas for the Painlev\'e tau-functions (following Nekrasov's method).


title: Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizer

abstract: We address the task of estimating camera parameters from a set of images depicting a scene. Popular feature-based structure-from-motion (SfM) tools solve this task by incremental reconstruction: they repeat triangulation of sparse 3D points and registration of more camera views to the sparse point cloud. We re-interpret incremental structure-from-motion as an iterated application and refinement of a visual relocalizer, that is, of a method that registers new views to the current state of the reconstruction. This perspective allows us to investigate alternative visual relocalizers that are not rooted in local feature matching. We show that scene coordinate regression, a learning-based relocalization approach, allows us to build implicit, neural scene representations from unposed images. Different from other learning-based reconstruction methods, we do not require pose priors nor sequential inputs, and we optimize efficiently over thousands of images. Our method, ACE0 (ACE Zero), estimates camera poses to an accuracy comparable to feature-based SfM, as demonstrated by novel view synthesis. Project page: https://nianticlabs.github.io/acezero/


title: Integration of first-order ODEs by Jacobi fields

abstract: A new class of vector fields enabling the integration of first-order ordinary differential equations (ODEs) is introduced. These vector fields are not, in general, Lie point symmetries. The results are based on a relation between 2-dimensional Riemannian manifolds and the integrability of first-order ODEs, which was established in a previous work of the authors. An integration procedure is provided, together with several examples to illustrate it. A connection between integrating factors of first-order ODEs and Schr\"odinger-type equations is highlighted.


title: Electroporation-mediated Metformin for effective anticancer treatment of triple-negative breast cancer cells

abstract: In this research, we investigated the efficacy of Metformin, the most commonly administered type-2 diabetes drug for triple negative breast cancer (TNBC) treatment, due to its various anticancer properties. It is a plant-based bio-compound, synthesized as a novel biguanide, called dimethyl biguanide or metformin. One of the ways it operates is by hindering electron transport chain-complex I, in mitochondria, which causes a drop-in energy (ATP) generation. This eventually builds energetic stress and a decline in energy. Therefore, the natural cellular processes and proliferating tumor cells are obstructed. Here, we used electroporation, where, the MDA-MB-231, human TNBC cells were subjected to high intensity, short-duration electrical pulses (EP) in the presence of Metformin. The cell viability results indicate lower cell viability of 43.45% as compared to 85.20% with drug alone at 5mM concentration. This indicates that Metformin, the most common diabetes drug could also be explored for cancer treatment.


title: A Genetic Algorithm For Convex Hull Optimisation

abstract: Computationally efficient and automated generation of convex hulls is desirable for high throughput materials discovery of thermodynamically stable multi-species crystal structures. A convex hull genetic algorithm is proposed that uses methodology adapted from multi-objective optimisation techniques to optimise the convex hull itself as an object, enabling efficient discovery of convex hulls for N >= 2 species. This method, when tested on a LiSi system utilising pre-trained machine learned potentials, was found to be able to efficiently discover reported structures as well as new potential LiSi candidate structures.


title: Pre-Calc: Learning to Use the Calculator Improves Numeracy in Language Models

abstract: Quantitative and numerical comprehension in language is an important task in many fields like education and finance, but still remains a challenging task for language models. While tool and calculator usage has shown to be helpful to improve mathematical reasoning in large pretrained decoder-only language models, this remains unexplored for smaller language models with encoders. In this paper, we propose Pre-Calc, a simple pre-finetuning objective of learning to use the calculator for both encoder-only and encoder-decoder architectures, formulated as a discriminative and generative task respectively. We pre-train BERT and RoBERTa for discriminative calculator use and Flan-T5 for generative calculator use on the MAWPS, SVAMP, and AsDiv-A datasets, which improves performance on downstream tasks that require numerical understanding. Our code and data are available at https://github.com/calc-cmu/pre-calc.


title: Rethinking Legal Compliance Automation: Opportunities with Large Language Models

abstract: As software-intensive systems face growing pressure to comply with laws and regulations, providing automated support for compliance analysis has become paramount. Despite advances in the Requirements Engineering (RE) community on legal compliance analysis, important obstacles remain in developing accurate and generalizable compliance automation solutions. This paper highlights some observed limitations of current approaches and examines how adopting new automation strategies that leverage Large Language Models (LLMs) can help address these shortcomings and open up fresh opportunities. Specifically, we argue that the examination of (textual) legal artifacts should, first, employ a broader context than sentences, which have widely been used as the units of analysis in past research. Second, the mode of analysis with legal artifacts needs to shift from classification and information extraction to more end-to-end strategies that are not only accurate but also capable of providing explanation and justification. We present a compliance analysis approach designed to address these limitations. We further outline our evaluation plan for the approach and provide preliminary evaluation results based on data processing agreements (DPAs) that must comply with the General Data Protection Regulation (GDPR). Our initial findings suggest that our approach yields substantial accuracy improvements and, at the same time, provides justification for compliance decisions.


title: A Stochastic Geo-spatiotemporal Bipartite Network to Optimize GCOOS Sensor Placement Strategies

abstract: This paper proposes two new measures applicable in a spatial bipartite network model: coverage and coverage robustness. The bipartite network must consist of observer nodes, observable nodes, and edges that connect observer nodes to observable nodes. The coverage and coverage robustness scores evaluate the effectiveness of the observer node placements. This measure is beneficial for stochastic data as it may be coupled with Monte Carlo simulations to identify optimal placements for new observer nodes. In this paper, we construct a Geo-SpatioTemporal Bipartite Network (GSTBN) within the stochastic and dynamical environment of the Gulf of Mexico. This GSTBN consists of GCOOS sensor nodes and HYCOM Region of Interest (RoI) event nodes. The goal is to identify optimal placements to expand GCOOS to improve the forecasting outcomes by the HYCOM ocean prediction model.


title: A General Continuous-Time Formulation of Stochastic ADMM and Its Variants

abstract: Stochastic versions of the alternating direction method of multiplier (ADMM) and its variants play a key role in many modern large-scale machine learning problems. In this work, we introduce a unified algorithmic framework called generalized stochastic ADMM and investigate their continuous-time analysis. The generalized framework widely includes many stochastic ADMM variants such as standard, linearized and gradient-based ADMM. Our continuous-time analysis provides us with new insights into stochastic ADMM and variants, and we rigorously prove that under some proper scaling, the trajectory of stochastic ADMM weakly converges to the solution of a stochastic differential equation with small noise. Our analysis also provides a theoretical explanation of why the relaxation parameter should be chosen between 0 and 2.


title: Infrared-Radio-follow-up Observations for Detection of the Magnetic Radio Emission of Extra-Solar Planets: A New Window to Detect Exoplanets

abstract: There are several methods for indirectly detecting exoplanets, such as transit, radial velocity, astrometry, and the conventional gravitational microlensing approach. These methods rely on observing the effects of exoplanets on the emission or motion of observed stars. All these techniques have focused on the optical or infrared domains. However, an alternative method for exoplanet detection via microlensing events involves planets orbiting the source star, creating a binary source system. In this study, we explore a novel approach to detecting and studying exoplanets exclusively through their radio emissions resulting from magnetospheric processes. We propose utilizing the Roman telescope as a survey observer to detect microlensing events. Subsequently, we investigate the potential for detecting planetary radio signals through follow-up observations of these microlensing events in the radio band using the SKA telescope. This method is viable due to the comparable radio emission levels of exoplanets and their parent stars, unlike optical and infrared emissions. We conduct a Monte Carlo simulation to replicate the observations by the Nancy Roman Telescope, followed by a follow-up observation in radio frequencies using the SKA telescope. We determine that approximately 1155 exoplanets exhibit detectable signals by the SKA telescope during the 7-season observations by the Nancy Roman Telescope. This result indicates that such a method cannot only facilitate the direct detection of exoplanets but also enable the measurement of their magnetic field strength through analysis of their radio emissions.


title: The Alaric parton shower for hadron colliders

abstract: We introduce the Alaric parton shower for simulating QCD radiation at hadron colliders and present numerical results from an implementation in the event generator Sherpa. Alaric provides a consistent framework to quantify certain systematic uncertainties which cannot be eliminated by comparing the parton shower with analytic resummation. In particular, it allows to study recoil effects away from the soft and collinear limits without the need to change the evolution variable or the splitting functions. We assess the performance of Alaric in Drell-Yan lepton pair and QCD jet production, and present the first multi-jet merging for the new algorithm.


title: Better Synthetic Data by Retrieving and Transforming Existing Datasets

abstract: Despite recent advances in large language models, building dependable and deployable NLP models typically requires abundant, high-quality training data. However, task-specific data is not available for many use cases, and manually curating task-specific data is labor-intensive. Recent work has studied prompt-driven synthetic data generation using large language models, but these generated datasets tend to lack complexity and diversity. To address these limitations, we introduce a method, DataTune, to make better use of existing, publicly available datasets to improve automatic dataset generation. DataTune performs dataset transformation, enabling the repurposing of publicly available datasets into a format that is directly aligned with the specific requirements of target tasks. On a diverse set of language-based tasks from the BIG-Bench benchmark, we find that finetuning language models via DataTune improves over a few-shot prompting baseline by 49% and improves over existing methods that use synthetic or retrieved training data by 34%. We find that dataset transformation significantly increases the diversity and difficulty of generated data on many tasks. We integrate DataTune into an open-source repository to make this method accessible to the community: https://github.com/neulab/prompt2model.


title: Bistable Organic Electrochemical Transistors: Enthalpy vs. Entropy

abstract: Organic electrochemical transistors (OECTs) serve as the foundation for a wide range of emerging applications, from bioelectronic implants and smart sensor systems to neuromorphic computing. Their ascent originates from a distinctive switching mechanism based on the coupling of electronic and ionic charge carriers, which gives rise to a multitude of unique characteristics. Notably, various OECT systems have been reported with significant hysteresis in their transfer curve. While being a feature sought after as non-volatile memory in neuromorphic systems, no universal explanation has yet been given for its physical origin, impeding its advanced implementation. Herein, we present a thermodynamic framework that readily elucidates the emergence of bistable OECT operation through the interplay of enthalpy and entropy. We validate our model through three experimental approaches, covering temperature-resolved characterizations, targeted material manipulation, and thermal imaging. In this context, we demonstrate the exceptional scenario where the subthreshold swing deviates from Boltzmann statistics, and we provide an alternate view on existing data in literature, which further supports our model. Finally, we leverage the bistability in form of a single-OECT Schmitt trigger, thus compacting the complexity of a multi-component circuit into a single device. These insights offer a revised understanding of OECT physics and promote their application in non-conventional computing, where symmetry-breaking phenomena are pivotal to unlock novel paradigms.


title: On the asymptotic number of low-lying states in the two-dimensional confined Stark effect

abstract: We investigate the Stark operator restricted to a bounded domain $\Omega\subset\mathbb{R}^2$ with Dirichlet boundary conditions. In the semiclassical limit, a three-term asymptotic expansion for its individual eigenvalues has been established, with coefficients dependent on the curvature of $\Omega$. We analyse the accumulation of eigenvalues beneath the leading-order terms in these expansions, establishing Weyl-type asymptotics. Furthermore, we derive weak asymptotics for the density of the spectral projector onto these low-lying states.


title: Toward Research Software Categories

abstract: Research software has been categorized in different contexts to serve different goals. We start with a look at what research software is, before we discuss the purpose of research software categories. We propose a multi-dimensional categorization of research software. We present a template for characterizing such categories. As selected dimensions, we present our proposed role-based, developer-based, and maturity-based categories. Since our work has been inspired by various previous efforts to categorize research software, we discuss them as related works. We characterize all these categories via the previously introduced template, to enable a systematic comparison.


title: An inverse problem in Polya-Schur theory. I. Non-genegerate and degenerate operators

abstract: Given a linear ordinary differential operator T with polynomial coefficients, we study the class of closed subsets of the complex plane such that T sends any polynomial (resp. any polynomial of degree exceeding a given positive integer) with all roots in a given subset to a polynomial with all roots in the same subset or to 0. Below we discuss some general properties of such invariant subsets as well as the problem of existence of the minimal under inclusion invariant subset.


title: Lessons Learned in Performing a Trustworthy AI and Fundamental Rights Assessment

abstract: This report shares the experiences, results and lessons learned in conducting a pilot project ``Responsible use of AI'' in cooperation with the Province of Friesland, Rijks ICT Gilde-part of the Ministry of the Interior and Kingdom Relations (BZK) (both in The Netherlands) and a group of members of the Z-Inspection$^{\small{\circledR}}$ Initiative. The pilot project took place from May 2022 through January 2023. During the pilot, the practical application of a deep learning algorithm from the province of Fr\^yslan was assessed. The AI maps heathland grassland by means of satellite images for monitoring nature reserves. Environmental monitoring is one of the crucial activities carried on by society for several purposes ranging from maintaining standards on drinkable water to quantifying the CO2 emissions of a particular state or region. Using satellite imagery and machine learning to support decisions is becoming an important part of environmental monitoring. The main focus of this report is to share the experiences, results and lessons learned from performing both a Trustworthy AI assessment using the Z-Inspection$^{\small{\circledR}}$ process and the EU framework for Trustworthy AI, and combining it with a Fundamental Rights assessment using the Fundamental Rights and Algorithms Impact Assessment (FRAIA) as recommended by the Dutch government for the use of AI algorithms by the Dutch public authorities.


title: Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data

abstract: Learning from preference labels plays a crucial role in fine-tuning large language models. There are several distinct approaches for preference fine-tuning, including supervised learning, on-policy reinforcement learning (RL), and contrastive learning. Different methods come with different implementation tradeoffs and performance differences, and existing empirical findings present different conclusions, for instance, some results show that online RL is quite important to attain good fine-tuning results, while others find (offline) contrastive or even purely supervised methods sufficient. This raises a natural question: what kind of approaches are important for fine-tuning with preference data and why? In this paper, we answer this question by performing a rigorous analysis of a number of fine-tuning techniques on didactic and full-scale LLM problems. Our main finding is that, in general, approaches that use on-policy sampling or attempt to push down the likelihood on certain responses (i.e., employ a "negative gradient") outperform offline and maximum likelihood objectives. We conceptualize our insights and unify methods that use on-policy sampling or negative gradient under a notion of mode-seeking objectives for categorical distributions. Mode-seeking objectives are able to alter probability mass on specific bins of a categorical distribution at a fast rate compared to maximum likelihood, allowing them to relocate masses across bins more effectively. Our analysis prescribes actionable insights for preference fine-tuning of LLMs and informs how data should be collected for maximal improvement.


title: Graphic Design with Large Multimodal Model

abstract: In the field of graphic design, automating the integration of design elements into a cohesive multi-layered artwork not only boosts productivity but also paves the way for the democratization of graphic design. One existing practice is Graphic Layout Generation (GLG), which aims to layout sequential design elements. It has been constrained by the necessity for a predefined correct sequence of layers, thus limiting creative potential and increasing user workload. In this paper, we present Hierarchical Layout Generation (HLG) as a more flexible and pragmatic setup, which creates graphic composition from unordered sets of design elements. To tackle the HLG task, we introduce Graphist, the first layout generation model based on large multimodal models. Graphist efficiently reframes the HLG as a sequence generation problem, utilizing RGB-A images as input, outputs a JSON draft protocol, indicating the coordinates, size, and order of each element. We develop new evaluation metrics for HLG. Graphist outperforms prior arts and establishes a strong baseline for this field. Project homepage: https://github.com/graphic-design-ai/graphist


title: Broken lines and compatible pairs for rank 2 quantum cluster algebras

abstract: There have been several combinatorial constructions of universally positive bases in cluster algebras, and these same combinatorial objects play a crucial role in the known proofs of the famous positivity conjecture for cluster algebras. The greedy basis was constructed in rank $2$ by Lee-Li-Zelevinsky using compatible pairs on Dyck paths. The theta basis, introduced by Gross-Hacking-Keel-Kontsevich, has elements expressed as a sum over broken lines on scattering diagrams. It was shown by Cheung-Gross-Muller-Musiker-Rupel-Stella-Williams that these bases coincide in rank $2$ via algebraic methods, and they posed the open problem of giving a combinatorial proof by constructing a (weighted) bijection between compatible pairs and broken lines. We construct a quantum-weighted bijection between compatible pairs and broken lines for the quantum type $A_2$ and the quantum Kronecker cluster algebras. By specializing the quantum parameter, this handles the problem of Cheung et al. for skew-symmetric cluster algebras of finite and affine type. For cluster monomials in skew-symmetric rank-$2$ cluster algebras, we construct a quantum-weighted bijection between positive compatible pairs (which comprise almost all compatible pairs) and broken lines of negative angular momentum.


title: Assessing GPT-4-Vision's Capabilities in UML-Based Code Generation

abstract: The emergence of advanced neural networks has opened up new ways in automated code generation from conceptual models, promising to enhance software development processes. This paper presents a preliminary evaluation of GPT-4-Vision, a state-of-the-art deep learning model, and its capabilities in transforming Unified Modeling Language (UML) class diagrams into fully operating Java class files. In our study, we used exported images of 18 class diagrams comprising 10 single-class and 8 multi-class diagrams. We used 3 different prompts for each input, and we manually evaluated the results. We created a scoring system in which we scored the occurrence of elements found in the diagram within the source code. On average, the model was able to generate source code for 88% of the elements shown in the diagrams. Our results indicate that GPT-4-Vision exhibits proficiency in handling single-class UML diagrams, successfully transforming them into syntactically correct class files. However, for multi-class UML diagrams, the model's performance is weaker compared to single-class diagrams. In summary, further investigations are necessary to exploit the model's potential completely.


title: Analysing the interaction of expansion decisions by end customers and grid development in the context of a municipal energy system

abstract: In order to achieve greenhouse gas neutrality by 2045, the Climate Protection Act sets emission reduction targets for the years 2030 and 2040, as well as decreasing annual emission volumes for some sectors, including the building sector. Measures to decarbonize the building sector include energy retrofits and the expansion of renewable, decentralized power generators and low-CO2 heat generators. These measures thus change both the load and the generation of the future energy supply concept. Considering the interactions of the changed installed technologies on the building level and their influence on the electrical grid infrastructure is necessary. The grid operator will remedy the future congested grid states by grid expansion measures and pass on the costs to the connected grid users, which in turn could influence their behaviour and decisions. The aim of this work is a holistic analysis of the staggered interactions of generation expansion and grid expansion for a future decentralized energy supply concept conditioned by the expansion in the field of self-generation. To enable the analysis of the interactions, a multi-criteria optimization procedure for expansion and operation decisions at the building level is combined with an approach to determine grid expansion. As part of this work, the effect of an expansion of hosting capacity on the grid charges and thus the decision-making behaviour was investigated.


title: Beyond Scaling: Predicting Patent Approval with Domain-specific Fine-grained Claim Dependency Graph

abstract: Model scaling is becoming the default choice for many language tasks due to the success of large language models (LLMs). However, it can fall short in specific scenarios where simple customized methods excel. In this paper, we delve into the patent approval pre-diction task and unveil that simple domain-specific graph methods outperform enlarging the model, using the intrinsic dependencies within the patent data. Specifically, we first extend the embedding-based state-of-the-art (SOTA) by scaling up its backbone model with various sizes of open-source LLMs, then explore prompt-based methods to harness proprietary LLMs' potential, but find the best results close to random guessing, underlining the ineffectiveness of model scaling-up. Hence, we propose a novel Fine-grained cLAim depeNdency (FLAN) Graph through meticulous patent data analyses, capturing the inherent dependencies across segments of the patent text. As it is model-agnostic, we apply cost-effective graph models to our FLAN Graph to obtain representations for approval prediction. Extensive experiments and detailed analyses prove that incorporating FLAN Graph via various graph models consistently outperforms all LLM baselines significantly. We hope that our observations and analyses in this paper can bring more attention to this challenging task and prompt further research into the limitations of LLMs. Our source code and dataset can be obtained from http://github.com/ShangDataLab/FLAN-Graph.


title: On the incidence rate of RR Lyrae stars with non-radial modes

abstract: Over the recent years, additional low-amplitude non-radial modes were detected in many of the first-overtone RR Lyrae stars. These non-radial modes form a characteristic period ratio with the dominant first-overtone mode of around 0.61. The incidence rate of this phenomenon changes from population to population. It is also strongly dependent on the quality of the analyzed data. Current models explaining these additional signals involve non-radial modes of degrees 8 and 9. Using synthetic horizontal branch populations, we investigate the incidence rate of first-overtone RR Lyrae stars with non-radial modes depending on the population properties, i.e., ages and metallicities. We compare our results with the observed results for globular clusters and the numerous collection of field first-overtone RR Lyrae stars to test the predictions of the models. We used synthetic horizontal branches combined with pulsation models to predict how the incidence rate would depend on the age and metallicity of the population. To test whether the results based on synthetic horizontal branches are realistic, we compared them to incidence rates observed by TESS in first-overtone field RR Lyrae stars, using photometric metallicity values from a newly established calibration for TESS. The analysis of synthetic horizontal branches showed that the incidence rate decreases with decreasing metallicity. We inferred photometric metallicity for RR Lyrae stars observed by TESS and showed that the theoretical predictions are in agreement with the observations. Using the same method, we also conclude that the metallicity distribution of RR Lyrae stars showing an additional mode with a period-ratio around $0.68$ appears to be different from that of both all first-overtone stars and those showing additional non-radial modes.


title: Temporal Entanglement Profiles in Dual-Unitary Clifford Circuits with Measurements

abstract: We study temporal entanglement in dual-unitary Clifford circuits with probabilistic measurements preserving spatial unitarity. We exactly characterize the temporal entanglement barrier in the measurement-free regime, exhibiting ballistic growth and decay and a volume-law peak. In the presence of measurements, we relate the temporal entanglement to the scrambling properties of the circuit. For "good scramblers" measurements do not qualitatively change the temporal entanglement profile but only result in a reduced entanglement velocity, whereas for "poor scramblers" the initial ballistic growth of temporal entanglement with bath size is modified to diffusive. This difference is understood through a mapping of the underlying operator dynamics to a biased and an unbiased persistent random walk respectively. In the latter case measurements additionally modify the ballistic decay to the perfect dephaser limit, with vanishing temporal entanglement, to an exponential decay, which we describe through a spatial transfer matrix method. This spatial dynamics is shown to be described by a non-Hermitian hopping model, exhibiting a PT-breaking transition at a critical measurement rate $p=1/2$. In all cases the peak value of the temporal entanglement barrier exhibits volume-law scaling for all measurement rates.


title: Two classes of Hadamard matrices of Goethals-Seidel type

abstract: We introduce two classes of Hadamard matrices of Goethals-Seidel type and construct many matrices in these classes.


title: The Life and Legacy of Bui Tuong Phong

abstract: We examine the life and legacy of pioneering Vietnamese American computer scientist B\`ui Tuong Phong, whose shading and lighting models turned 50 last year. We trace the trajectory of his life through Vietnam, France, and the United States, and its intersections with global conflicts. Crucially, we present evidence that his name has been cited incorrectly over the last five decades. His family name appears to be B\`ui, not Phong. By presenting these facts at SIGGRAPH, we hope to collect more information about his life, and ensure that his name is remembered correctly in the future.


title: A Fresh Look into the Interaction of Exoplanets Magnetosphere with Stellar Winds using MHD Simulations

abstract: Numerous numerical studies have been carried out in recent years that simulate different aspects of exoplanets' magnetosphere and stellar winds. These studies have focused primarily on hot Jupiters with sun-like stars. This study addresses the challenges inherent in utilizing existing MHD codes to model hot Jupiter-star systems. Due to the scaling of the system and the assumption of a uniformly flowing stellar wind at the outer boundary of the simulation, MHD codes necessitate a minimum distance of greater than 0.4 au for a Jupiter-like planet orbiting a sun-like star to avoid substantial violations of the code's assumptions. Additionally, employing the GAMERA (Grid Agnostic MHD for Extended Research Applications) MHD code, we simulate star-planet interactions considering various stellar types (Sun-like and M Dwarf stars) with both Jupiter-like and Earth-like planets positioned at varying orbital distances. Furthermore, we explore the impact of tidal locking on the total power within the magnetosphere-ionosphere systems.


title: Pipeline Provenance for Analysis, Evaluation, Trust or Reproducibility

abstract: Data volumes and rates of research infrastructures will continue to increase in the upcoming years and impact how we interact with their final data products. Little of the processed data can be directly investigated and most of it will be automatically processed with as little user interaction as possible. Capturing all necessary information of such processing ensures reproducibility of the final results and generates trust in the entire process. We present PRAETOR, a software suite that enables automated generation, modelling, and analysis of provenance information of Python pipelines. Furthermore, the evaluation of the pipeline performance, based upon a user defined quality matrix in the provenance, enables the first step of machine learning processes, where such information can be fed into dedicated optimisation procedures.


title: Penn & Slavery Project's Augmented Reality Tour: Augmenting a Campus to Reveal a Hidden History

abstract: In 2006 and 2016, the University of Pennsylvania denied any ties to slavery. In 2017, a group of undergraduate researchers, led by Professor Kathleen Brown, investigated this claim. Initial research, focused on 18th century faculty and trustees who owned slaves, revealed deep connections between the university's history and the institution of slavery. These findings, and discussions amongst the researchers shaped the Penn and Slavery Project's goal of redefining complicity beyond ownership. Breanna Moore's contributions in PSP's second semester expanded the project's focus to include generational wealth gaps. In 2018, VanJessica Gladney served as the PSP's Public History Fellow and spread the project outreach in the greater Philadelphia area. That year, the PSP team began to design an augmented reality app as a Digital Interruption and an attempt to display the truth about Penn's history on its campus. Unfortunately, PSP faced delays due to COVID 19. Despite setbacks, the project persisted, engaging with activists and the wider community to confront historical injustices and modern inequalities.


title: Tropicalization of curve arrangement complements and arroids

abstract: We define arroids as an abstract axiom set encoding the intersection properties of arrangements of curves. The tropicalization of the complement of arrangement of curves meeting pairwise transversely is shown to be determined by the associated arroid. We give conditions for when the cohomology of the complement of an arrangement is computable using tropical cohomology, and we give criteria for when the complement is a maximal variety in terms of tropical geometry.


title: TAVGBench: Benchmarking Text to Audible-Video Generation

abstract: The Text to Audible-Video Generation (TAVG) task involves generating videos with accompanying audio based on text descriptions. Achieving this requires skillful alignment of both audio and video elements. To support research in this field, we have developed a comprehensive Text to Audible-Video Generation Benchmark (TAVGBench), which contains over 1.7 million clips with a total duration of 11.8 thousand hours. We propose an automatic annotation pipeline to ensure each audible video has detailed descriptions for both its audio and video contents. We also introduce the Audio-Visual Harmoni score (AVHScore) to provide a quantitative measure of the alignment between the generated audio and video modalities. Additionally, we present a baseline model for TAVG called TAVDiffusion, which uses a two-stream latent diffusion model to provide a fundamental starting point for further research in this area. We achieve the alignment of audio and video by employing cross-attention and contrastive learning. Through extensive experiments and evaluations on TAVGBench, we demonstrate the effectiveness of our proposed model under both conventional metrics and our proposed metrics.


title: A unified theory of tunneling times promoted by Ramsey clocks

abstract: What time does a clock tell after quantum tunneling? Predictions and indirect measurements range from superluminal or instantaneous tunneling to finite durations, depending on the specific experiment and the precise definition of the elapsed time. Proposals and implementations utilize the atomic motion to define this delay, even though the inherent quantum nature of atoms implies a delocalization and is in sharp contrast to classical trajectories. Here, we rely on an operational approach: we prepare atoms in a coherent superposition of internal states and study the time read off via a Ramsey sequence after the tunneling process without the notion of classical trajectories or velocities. Our operational framework (a) unifies definitions of tunneling delay within one approach; (b) connects the time to a frequency standard given by a conventional atomic clock which can be boosted by differential light shifts; and (c) highlights that there exists no superluminal or instantaneous tunneling.


title: Observational characterisation of large-scale transport and horizontal turbulent diffusivity in the quiet Sun

abstract: The Sun is a magnetic star, and the only spatio-temporally resolved astrophysical system displaying turbulent MHD thermal convection. This makes it a privileged object of study to understand fluid turbulence in extreme regimes and its interactions with magnetic fields. Global analyses of high-resolution solar observations provided by the NASA Solar Dynamics Observatory can shed light on the physical processes underlying large-scale emergent phenomena such as the solar dynamo cycle. Combining a Coherent Structure Tracking reconstruction of photospheric flows, based on photometric data, and a statistical analysis of virtual passive tracers trajectories advected by these flows, we characterise one of the most important such processes, turbulent diffusion, over an unprecedentedly long monitoring period of 6 consecutive days of a significant fraction of the solar disc. We first confirm, and provide a new global view of the emergence of a remarkable dynamical pattern of Lagrangian Coherent Structures tiling the entire surface. These structures act as transport barriers on the time and spatial scale of supergranulation and, by transiently accumulating particles and magnetic fields, regulate large-scale turbulent surface diffusion. We then further statistically characterise the turbulent transport regime using two different methods, and obtain an effective horizontal turbulent diffusivity $D=2-3\times10^8~\mathrm{m}^2~\mathrm{s}^{-1}$ on the longest timescales probed. This estimate is consistent with the transport coefficients required in large-scale mean-field solar dynamo models, and is in broad agreement with the results of global simulations. Our analysis may also have implications for understanding the connections between solar-surface, coronal and solar-wind dynamics, and provides valuable lessons to characterise turbulent transport in other, unresolved turbulent astrophysical systems.

categories: astro-ph.SR astro-ph.GA astro-ph.HE physics.plasm-ph


title: A New Optimization Model for Multiple-Control Toffoli Quantum Circuit Design

abstract: As quantum technology is advancing, the efficient design of quantum circuits has become an important area of research. This paper provides an introduction to the MCT quantum circuit design problem for reversible Boolean functions without assuming a prior background in quantum computing. While this is a well-studied problem, optimization models that minimize the true objective have only been explored recently. This paper introduces a new optimization model and symmetry-breaking constraints that improve solving time by up to two orders of magnitude compared to earlier work when a Constraint Programming solver is used. Experiments with up to seven qubits and using up to 15 quantum gates result in several new best-known circuits for well-known benchmarks. Finally, an extensive comparison with other approaches shows that optimization models may require more time but can provide superior circuits with optimality guarantees.


title: Encoding Petri Nets into CCS (Technical Report)

abstract: This paper explores the problem of determining which classes of Petri nets can be encoded into behaviourally-equivalent CCS processes. Most of the existing related literature focuses on the inverse problem (i.e., encoding process calculi belonging to the CCS family into Petri nets), or extends CCS with Petri net-like multi-synchronisation (Multi-CCS). In this work, our main focus are free-choice and workflow nets (which are widely used in process mining to describe system interactions) and our target is plain CCS. We present several novel encodings, including one from free-choice workflow nets (produced by process mining algorithms like the alpha-miner) into CCS processes, and we prove that our encodings produce CCS processes that are weakly bisimilar to the original net. Besides contributing new expressiveness results, our encodings open a door towards bringing analysis and verification techniques from the realm of process calculi into the realm of process mining.


title: Activating the Flexibility in Distribution systems via a Unified Quantification Approach

abstract: Effective quantification of the cost of flexibility and its contribution to the system is essential for activating the flexibility of the numerous distributed energy resources (DERs) in power systems operation. We first propose a unified flexibility cost quantification method for heterogonous DERs based on the adjustment ranges in both power and accumulated energy consumption. Compared with traditional power range-based approaches, the proposed method can reflect the potential inconvenience caused to different DER users by flexibility activation and directly capture the time-dependent characteristics of DER's flexibility regions. Extending to the aggregator level, we then propose a flexibility cost formulation aligned with the aggregated flexibility model. On this basis, a model for distribution system operators (DSOs) is proposed to coordinate the DER aggregators' participation in the transmission system operation for energy arbitrage and ancillary services provision. This model derives a method for quantifying the contribution of each aggregator's activated flexibility region to the DSO's revenue from the transmission system, which is used to allocate the revenue to each aggregator while ensuring that the DSO is non-profit. Numerical tests on the IEEE 33-node distribution system validate the proposed methods.


title: A Survey on Self-Evolution of Large Language Models

abstract: Large language models (LLMs) have significantly advanced in various fields and intelligent agent applications. However, current LLMs that learn from human or external model supervision are costly and may face performance ceilings as task complexity and diversity increase. To address this issue, self-evolution approaches that enable LLM to autonomously acquire, refine, and learn from experiences generated by the model itself are rapidly growing. This new training paradigm inspired by the human experiential learning process offers the potential to scale LLMs towards superintelligence. In this work, we present a comprehensive survey of self-evolution approaches in LLMs. We first propose a conceptual framework for self-evolution and outline the evolving process as iterative cycles composed of four phases: experience acquisition, experience refinement, updating, and evaluation. Second, we categorize the evolution objectives of LLMs and LLM-based agents; then, we summarize the literature and provide taxonomy and insights for each module. Lastly, we pinpoint existing challenges and propose future directions to improve self-evolution frameworks, equipping researchers with critical insights to fast-track the development of self-evolving LLMs. Our corresponding GitHub repository is available at https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/Awesome-Self-Evolution-of-LLM


title: STROOBnet Optimization via GPU-Accelerated Proximal Recurrence Strategies

abstract: Spatiotemporal networks' observational capabilities are crucial for accurate data gathering and informed decisions across multiple sectors. This study focuses on the Spatiotemporal Ranged Observer-Observable Bipartite Network (STROOBnet), linking observational nodes (e.g., surveillance cameras) to events within defined geographical regions, enabling efficient monitoring. Using data from Real-Time Crime Camera (RTCC) systems and Calls for Service (CFS) in New Orleans, where RTCC combats rising crime amidst reduced police presence, we address the network's initial observational imbalances. Aiming for uniform observational efficacy, we propose the Proximal Recurrence approach. It outperformed traditional clustering methods like k-means and DBSCAN by offering holistic event frequency and spatial consideration, enhancing observational coverage.


title: Poisoning Attacks on Federated Learning-based Wireless Traffic Prediction

abstract: Federated Learning (FL) offers a distributed framework to train a global control model across multiple base stations without compromising the privacy of their local network data. This makes it ideal for applications like wireless traffic prediction (WTP), which plays a crucial role in optimizing network resources, enabling proactive traffic flow management, and enhancing the reliability of downstream communication-aided applications, such as IoT devices, autonomous vehicles, and industrial automation systems. Despite its promise, the security aspects of FL-based distributed wireless systems, particularly in regression-based WTP problems, remain inadequately investigated. In this paper, we introduce a novel fake traffic injection (FTI) attack, designed to undermine the FL-based WTP system by injecting fabricated traffic distributions with minimal knowledge. We further propose a defense mechanism, termed global-local inconsistency detection (GLID), which strategically removes abnormal model parameters that deviate beyond a specific percentile range estimated through statistical methods in each dimension. Extensive experimental evaluations, performed on real-world wireless traffic datasets, demonstrate that both our attack and defense strategies significantly outperform existing baselines.


title: Function Computation and Identification over Locally Homomorphic Multiple-Access Channels

abstract: We develop the notion of a locally homomorphic channel and prove an approximate equivalence between those and codes for computing functions. Further, we derive decomposition properties of locally homomorphic channels which we use to analyze and construct codes where two messages must be encoded independently. This leads to new results for identification and K-identification when all messages are sent over multiple-access channels, which yield surprising rate improvements compared to naive code constructions. In particular, we demonstrate that for the example of identification with deterministic encoders, both encoders can be constructed independently.


title: Strong Asymptotics of Multiple Orthogonal Polynomials for Angelesco Systems. Part I: Non-Marginal Directions

abstract: In this work, we establish strong asymptotics of multiple orthogonal polynomials of the second type for Angelesco systems with measures that satisfy Szeg\H{o} conditions. We consider multi-indices that converge to infinity in the non-marginal directions.


title: Direct observation of Floquet-Bloch states in monolayer graphene

abstract: Floquet engineering is a novel method of manipulating quantum phases of matter via periodic driving [1, 2]. It has successfully been utilized in different platforms ranging from photonic systems [3] to optical lattice of ultracold atoms [4, 5]. In solids, light can be used as the periodic drive via coherent light-matter interaction. This leads to hybridization of Bloch electrons with photons resulting in replica bands known as Floquet-Bloch states. After the direct observation of Floquet-Bloch states in a topological insulator [6], their manifestations have been seen in a number of other experiments [7-14]. By engineering the electronic band structure using Floquet-Bloch states, various exotic phase transitions have been predicted [15-22] to occur. To realize these phases, it is necessary to better understand the nature of Floquet-Bloch states in different materials. However, direct energy and momentum resolved observation of these states is still limited to only few material systems [6, 10, 14, 23, 24]. Here, we report direct observation of Floquet-Bloch states in monolayer epitaxial graphene which was the first proposed material platform [15] for Floquet engineering. By using time- and angle-resolved photoemission spectroscopy (trARPES) with mid-infrared (mid-IR) pump excitation, we detected replicas of the Dirac cone. Pump polarization dependence of these replica bands unequivocally shows that they originate from the scattering between Floquet-Bloch states and photon-dressed free-electron-like photoemission final states, called Volkov states. Beyond graphene, our method can potentially be used to directly observe Floquet-Bloch states in other systems paving the way for Floquet engineering in a wide range of quantum materials.


title: Towards testing the general bounce cosmology with the CMB B-mode auto-bispectrum

abstract: It has been shown that a three-point correlation function of tensor perturbations from a bounce model in general relativity with a minimally-coupled scalar field is highly suppressed, and the resultant three-point function of cosmic microwave background (CMB) B-mode polarizations is too small to be detected by CMB experiments. On the other hand, bounce models in a more general class with a non-minimal derivative coupling between a scalar field and gravity can predict the three-point correlation function of the tensor perturbations without any suppression, the amplitude of which is allowed to be much larger than that in general relativity. In this paper, we evaluate the three-point function of the B-mode polarizations from the general bounce cosmology with the non-minimal coupling and show that a signal-to-noise ratio of the B-mode auto-bispectrum in the general class can reach unity for $\ell_{\rm max}\geq9$ and increase up to $5.39$ for $\ell_{\rm max}=100$ in the full-sky case. We also discuss the possibility to test the general class of bounce models by upcoming CMB experiments.


title: A Multimodal Automated Interpretability Agent

abstract: This paper describes MAIA, a Multimodal Automated Interpretability Agent. MAIA is a system that uses neural models to automate neural model understanding tasks like feature interpretation and failure mode discovery. It equips a pre-trained vision-language model with a set of tools that support iterative experimentation on subcomponents of other models to explain their behavior. These include tools commonly used by human interpretability researchers: for synthesizing and editing inputs, computing maximally activating exemplars from real-world datasets, and summarizing and describing experimental results. Interpretability experiments proposed by MAIA compose these tools to describe and explain system behavior. We evaluate applications of MAIA to computer vision models. We first characterize MAIA's ability to describe (neuron-level) features in learned representations of images. Across several trained models and a novel dataset of synthetic vision neurons with paired ground-truth descriptions, MAIA produces descriptions comparable to those generated by expert human experimenters. We then show that MAIA can aid in two additional interpretability tasks: reducing sensitivity to spurious features, and automatically identifying inputs likely to be mis-classified.


title: PARAMANU-GANITA: Language Model with Mathematical Capabilities

abstract: In this paper, we present Paramanu-Ganita, a 208 million parameter novel Auto Regressive (AR) decoder based language model on mathematics. The model is pretrained from scratch at context size of 4096 on our curated mixed mathematical corpus. We evaluate our model on both perplexity metric and GSM8k mathematical benchmark. Paramanu-Ganita despite being 35 times smaller than 7B LLMs, outperformed generalist LLMs such as LLaMa-1 7B by 28.4% points, LLaMa-2 7B by 27.6% points, Falcon 7B by 32.6% points, PaLM 8B by 35.3% points, and math specialised LLMs such as Minerva 8B by 23.2% points, and LLEMMA-7B by 3.0% points in GSM8k test accuracy metric respectively. Paramanu-Ganita also outperformed giant LLMs like PaLM 62B by 6.4% points, Falcon 40B by 19.8% points, LLaMa-1 33B by 3.8% points and Vicuna 13B by 11.8% points respectively. The large significant margin improvement in performance of our math model over the existing LLMs signifies that reasoning capabilities of language model are just not restricted to LLMs with humongous number of parameters. Paramanu-Ganita took 146 hours of A100 training whereas math specialised LLM, LLEMMA 7B, was trained for 23,000 A100 hours of training equivalent. Thus, our approach of pretraining powerful domain specialised language models from scratch for domain adaptation is much more cost-effective than performing continual training of LLMs for domain adaptation. Hence, we conclude that for strong mathematical reasoning abilities of language model, we do not need giant LLMs and immense computing power to our end. In the end, we want to point out that we have only trained Paramanu-Ganita only on a part of our entire mathematical corpus and yet to explore the full potential of our model.


title: SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generation

abstract: The rapid evolution of multimodal foundation model has demonstrated significant progresses in vision-language understanding and generation, e.g., our previous work SEED-LLaMA. However, there remains a gap between its capability and the real-world applicability, primarily due to the model's limited capacity to effectively respond to various user instructions and interact with diverse visual data. In this work, we focus on bridging this gap through integrating two enhanced features: (1) comprehending images of arbitrary sizes and ratios, and (2) enabling multi-granularity image generation. We present a unified and versatile foundation model, namely, SEED-X, which is able to model multi-granularity visual semantics for comprehension and generation tasks. Besides the competitive results on public benchmarks, SEED-X demonstrates its effectiveness in handling real-world applications across various domains after instruction tuning. We hope that our work will inspire future research into what can be achieved by versatile multimodal foundation models in real-world applications. The models, codes, and datasets will be released in https://github.com/AILab-CVC/SEED-X.


title: RTP-LX: Can LLMs Evaluate Toxicity in Multilingual Scenarios?

abstract: Large language models (LLMs) and small language models (SLMs) are being adopted at remarkable speed, although their safety still remains a serious concern. With the advent of multilingual S/LLMs, the question now becomes a matter of scale: can we expand multilingual safety evaluations of these models with the same velocity at which they are deployed? To this end we introduce RTP-LX, a human-transcreated and human-annotated corpus of toxic prompts and outputs in 28 languages. RTP-LX follows participatory design practices, and a portion of the corpus is especially designed to detect culturally-specific toxic language. We evaluate seven S/LLMs on their ability to detect toxic content in a culturally-sensitive, multilingual scenario. We find that, although they typically score acceptably in terms of accuracy, they have low agreement with human judges when judging holistically the toxicity of a prompt, and have difficulty discerning harm in context-dependent scenarios, particularly with subtle-yet-harmful content (e.g. microagressions, bias). We release of this dataset to contribute to further reduce harmful uses of these models and improve their safe deployment.


title: A lower bound on the number of colours needed to nicely colour a sphere

abstract: The Hadwiger--Nelson problem is about determining the chromatic number of the plane (CNP), defined as the minimum number of colours needed to colour the plane so that no two points of distance 1 have the same colour. In this paper we investigate a related problem for spheres and we use a few natural restrictions on the colouring. Thomassen showed that with these restrictions, the chromatic number of all manifolds satisfying certain properties (including the plane and all spheres with a large enough radius) is at least 7. We prove that with these restrictions, the chromatic number of any sphere with a large enough radius is at least 8. This also gives a new lower bound for the minimum colours needed for colouring the 3-dimensional space with the same restrictions.


title: MLQAOA: Graph Learning Accelerated Hybrid Quantum-Classical Multilevel QAOA

abstract: Learning the problem structure at multiple levels of coarseness to inform the decomposition-based hybrid quantum-classical combinatorial optimization solvers is a promising approach to scaling up variational approaches. We introduce a multilevel algorithm reinforced with the spectral graph representation learning-based accelerator to tackle large-scale graph maximum cut instances and fused with several versions of the quantum approximate optimization algorithm (QAOA) and QAOA-inspired algorithms. The graph representation learning model utilizes the idea of QAOA variational parameters concentration and substantially improves the performance of QAOA. We demonstrate the potential of using multilevel QAOA and representation learning-based approaches on very large graphs by achieving high-quality solutions in a much faster time. Reproducibility: Our source code and results are available at https://github.com/bachbao/MLQAOA


title: On the convergence rates of discrete solutions to the Wave Kinetic Equation

abstract: In this paper, we consider the long-term behavior of some special solutions to the Wave Kinetic Equation (WKE). This equation provides a mesoscopic description of wave systems interacting nonlinearly via the cubic NLS equation. Escobedo and Vel\'azquez showed that, starting with initial data given by countably many Dirac masses, solutions remain a linear combination of countably many Dirac masses at all times. Moreover, there is convergence to a single Dirac mass at long times. The first goal of this paper is to give quantitative rates for the speed of said convergence. In order to study the optimality of the bounds we obtain, we introduce and analyze a toy model accounting only for the leading order quadratic interactions.


title: A Python GPU-accelerated solver for the Gross-Pitaevskii equation and applications to many-body cavity QED

abstract: TorchGPE is a general-purpose Python package developed for solving the Gross-Pitaevskii equation (GPE). This solver is designed to integrate wave functions across a spectrum of linear and non-linear potentials. A distinctive aspect of TorchGPE is its modular approach, which allows the incorporation of arbitrary self-consistent and time-dependent potentials, e.g., those relevant in many-body cavity QED models. The package employs a symmetric split-step Fourier propagation method, effective in both real and imaginary time. In our work, we demonstrate a significant improvement in computational efficiency by leveraging GPU computing capabilities. With the integration of the latter technology, TorchGPE achieves a substantial speed-up with respect to conventional CPU-based methods, greatly expanding the scope and potential of research in this field.

categories: physics.comp-ph cond-mat.quant-gas physics.atom-ph quant-ph


title: A mean curvature flow arising in adversarial training

abstract: We connect adversarial training for binary classification to a geometric evolution equation for the decision boundary. Relying on a perspective that recasts adversarial training as a regularization problem, we introduce a modified training scheme that constitutes a minimizing movements scheme for a nonlocal perimeter functional. We prove that the scheme is monotone and consistent as the adversarial budget vanishes and the perimeter localizes, and as a consequence we rigorously show that the scheme approximates a weighted mean curvature flow. This highlights that the efficacy of adversarial training may be due to locally minimizing the length of the decision boundary. In our analysis, we introduce a variety of tools for working with the subdifferential of a supremal-type nonlocal total variation and its regularity properties.


title: GeoDiffuser: Geometry-Based Image Editing with Diffusion Models

abstract: The success of image generative models has enabled us to build methods that can edit images based on text or other user input. However, these methods are bespoke, imprecise, require additional information, or are limited to only 2D image edits. We present GeoDiffuser, a zero-shot optimization-based method that unifies common 2D and 3D image-based object editing capabilities into a single method. Our key insight is to view image editing operations as geometric transformations. We show that these transformations can be directly incorporated into the attention layers in diffusion models to implicitly perform editing operations. Our training-free optimization method uses an objective function that seeks to preserve object style but generate plausible images, for instance with accurate lighting and shadows. It also inpaints disoccluded parts of the image where the object was originally located. Given a natural image and user input, we segment the foreground object using SAM and estimate a corresponding transform which is used by our optimization approach for editing. GeoDiffuser can perform common 2D and 3D edits like object translation, 3D rotation, and removal. We present quantitative results, including a perceptual study, that shows how our approach is better than existing methods. Visit https://ivl.cs.brown.edu/research/geodiffuser.html for more information.


title: Multipolar Skyrmion Crystals in Non-Kramers Doublet Systems

abstract: We study the Kondo lattice model of multipolar magnetic moments interacting with conduction electrons on a triangular lattice. Bond-dependent electron hoppings induce a compass-like anisotropy in the effective Ruderman-Kittel-Kasuya-Yosida interaction between multipolar moments. This unique anisotropy stabilizes multipolar skyrmion crystals with a skyrmion topological charge of 1 and 2 at a zero magnetic field. Diverse multipolar phases in the phase diagram give rise to novel spontaneous Hall response of conduction electrons.


title: Learning H-Infinity Locomotion Control

abstract: Stable locomotion in precipitous environments is an essential task for quadruped robots, requiring the ability to resist various external disturbances. Recent neural policies enhance robustness against disturbances by learning to resist external forces sampled from a fixed distribution in the simulated environment. However, the force generation process doesn't consider the robot's current state, making it difficult to identify the most effective direction and magnitude that can push the robot to the most unstable but recoverable state. Thus, challenging cases in the buffer are insufficient to optimize robustness. In this paper, we propose to model the robust locomotion learning process as an adversarial interaction between the locomotion policy and a learnable disturbance that is conditioned on the robot state to generate appropriate external forces. To make the joint optimization stable, our novel $H_{\infty}$ constraint mandates the bound of the ratio between the cost and the intensity of the external forces. We verify the robustness of our approach in both simulated environments and real-world deployment, on quadrupedal locomotion tasks and a more challenging task where the quadruped performs locomotion merely on hind legs. Training and deployment code will be made public.