title: Greater than the sum of its parts: The role of minority and majority status in collaborative problem-solving communication

abstract: Collaborative problem-solving (CPS) is a vital skill used both in the workplace and in educational environments. CPS is useful in tackling increasingly complex global, economic, and political issues and is considered a central 21st century skill. The increasingly connected global community presents a fruitful opportunity for creative and collaborative problem-solving interactions and solutions that involve diverse perspectives. Unfortunately, women and underrepresented minorities (URMs) often face obstacles during collaborative interactions that hinder their key participation in these problem-solving conversations. Here, we explored the communication patterns of minority and non-minority individuals working together in a CPS task. Group Communication Analysis (GCA), a temporally-sensitive computational linguistic tool, was used to examine how URM status impacts individuals' sociocognitive linguistic patterns. Results show differences across racial/ethnic groups in key sociocognitive features that indicate fruitful collaborative interactions. We also investigated how the groups' racial/ethnic composition impacts both individual and group communication patterns. In general, individuals in more demographically diverse groups displayed more productive communication behaviors than individuals who were in majority-dominated groups. We discuss the implications of individual and group diversity on communication patterns that emerge during CPS and how these patterns can impact collaborative outcomes.


title: Molecular Arithmetic Coding (MAC) for Internet of Bio-Nano Things (IoBNT)

abstract: Molecular Communication (MC) has emerged as a promising paradigm employing molecules to transfer information at the nano-scale. Unlike MC channel coding, MC source coding has remained mostly an unexplored area of research. In a recent paper, prefix source coding was introduced into the field, through an MC-adapted version of the Huffman Coding. In the context of MC source coding, this paper proposes the Molecular Arithmetic Coding (MAC) whose algorithmic implementation and code-structure is non-arbitrarily different than that of the widely-known classical arithmetic coding. MAC is designed to mitigate Inter-Symbol Interference (ISI) for alphabets with known symbol probabilities through, in a highly efficient way, avoiding consecutive 1-bits. However, due to bit precision limitations any arithmetic coding method faces, without any assumption made on the structure of the symbol alphabet, unique-decodability of MAC is not guaranteed. Accordingly, a uniquely-decodable new coding scheme named Molecular Arithmetic with Prefix Coding (MAPC) is also introduced. Across multiple alphabets, we show that MAPC provides a better compression performance compared to the optimal MC-adapted prefix coding. Simulation results of an exemplary alphabet demonstrates the superior symbol and word error rate performance of MAPC compared to the optimal MC-adapted prefix coding and to the uncoded BCSK schemes.


title: Notes on complex $q=2$ SYK

abstract: This note clarifies and extends results on the complex SYK model to the solvable q = 2 case. We calculate the four point function OPE of fermions in the low energy CFT, implying the existence of a tower of integer-weight operators in the IR. We comment on the lack of a mode breaking conformal symmetry in this special case of SYK and the consequences for deformations of the theory near the conformal fixed point. We use the nearly-free structure of the model to provide a closed form expression for OPE coefficients of the integer-weight operators. We also discuss analytic and numerical results relevant to the thermodynamics of q = 2 SYK in both the complex and real case. The tower of operators transform in the discrete series of representations of SL(2,R), the representations shared by dS2 and AdS2. In this work we continue discussion of holographic models including these representations.


title: Calibrated rank volatility stabilized models for large equity markets

abstract: In the framework of stochastic portfolio theory we introduce rank volatility stabilized models for large equity markets over long time horizons. These models are rank-based extensions of the volatility stabilized models introduced by Fernholz & Karatzas in 2005. On the theoretical side we establish global existence of the model and ergodicity of the induced ranked market weights. We also derive explicit expressions for growth-optimal portfolios and show the existence of relative arbitrage with respect to the market portfolio. On the empirical side we calibrate the model to sixteen years of CRSP US equity data matching (i) rank-based volatilities, (ii) stock turnover as measured by market weight collisions, (iii) the average market rate of return and (iv) the capital distribution curve. Assessment of model fit and error analysis is conducted both in and out of sample. To the best of our knowledge this is the first model exhibiting relative arbitrage that has statistically been shown to have a good quantitative fit with the empirical features (i)-(iv). We additionally simulate trajectories of the calibrated model and compare them to historical trajectories, both in and out of sample.


title: Real-time Regulation of Detention Ponds via Feedback Control: Balancing Flood Mitigation and Water Quality

abstract: Floods in urban areas are becoming more intense due to unplanned urbanization and more frequent due to climate change. One of the most effective strategies to alleviate the effects of flooding is the use of flood control reservoirs such as detention ponds, which attenuate flood waves by storing water and slowing the release after the storm. Detention ponds can also improve water quality by allowing the settlement of pollutants inside the reservoir. The operation of most detention ponds occurs passively, where the outflows are governed by fixed hydraulic structures such as fully open orifices and weirs. The operation of detention ponds can be enhanced with active controls: orifices can be retrofitted with controlled valves, and spillways can have controllable gates such that their control schedule can be defined in real-time with a model predictive control (MPC) approach. In this paper, we develop a distributed quasi-2D hydrologic-hydrodynamic coupled with a reservoir flood routing model and an optimization approach (MPC) to identify the opening or closing of valves and movable gates working as spillways. We adapt the optimization problem to switch from a flood-related cost function to a heuristic function that aims to increase the detention time when no inflow hydrographs are predicted within a prediction horizon. The numerical case studies show the potential results of applying the methods herein developed in a real-world watershed in Sao Paulo, Brazil. We test the performance of MPC compared to static (i.e., fixed hydraulic device opening) alternatives with valves either fully or partially opened. The results indicate that the control algorithm presented in this paper can achieve greater flood and proxy water quality performance compared to passive scenarios.


title: When every S-flat module is (flat) projective

abstract: Let R be a commutative ring with identity and S a multiplicative subset of R. The aim of this paper is to study the class of commutative rings in which every S-flat module is flat (resp., projective). An R-module M is said to be S-flat if the localization of M at S, M_S, is a flat R_S-module. Commutative rings R for which all S-flat R-modules are flat are characterized by the fact that R/Rs is a von Neumann regular ring for every s in S. While, commutative rings R for which all S-flat R-modules are projective are characterized by the following two conditions: R is perfect and the Jacobson radical J(R) of R is S-divisible. Rings satisfying these conditions are called S-perfect. Moreover, we give some examples to distinguish perfect rings, S-perfect rings, and semisimple rings. We also investigate the transfer results of the "S-perfectness" for various ring constructions, which allows the construction of more interesting examples.


title: On finite group global and gauged $q$-form symmetries in TQFT

abstract: We describe a method to implement finite group global and gauged $q$-form symmetries into the axiomatic structure of $d$-dimensional Topological Quantum Field Theory (TQFT) in terms of bordisms decorated by cohomology classes. Namely, on a manifold with a boundary, the gauge field is considered as a class in an appropriate relative cohomology group. It is defined in a way that allows self-consistent cutting and gluing of the manifolds and involves a choice of a $(d-q-2)$-skeleton in the boundary. The method, in a sense, generalizes to arbitrary $d$ and $q$ a method that has been considered in the literature in the case of $d=3,\;q=0,1$.

categories: math-ph cond-mat.str-el hep-th math.AT math.GT math.MP


title: Differentiable master equation solver for quantum device characterisation

abstract: Differentiable models of physical systems provide a powerful platform for gradient-based algorithms, with particular impact on parameter estimation and optimal control. Quantum systems present a particular challenge for such characterisation and control, owing to their inherently stochastic nature and sensitivity to environmental parameters. To address this challenge, we present a versatile differentiable quantum master equation solver, and incorporate this solver into a framework for device characterisation. Our approach utilises gradient-based optimisation and Bayesian inference to provide estimates and uncertainties in quantum device parameters. To showcase our approach, we consider steady state charge transport through electrostatically defined quantum dots. Using simulated data, we demonstrate efficient estimation of parameters for a single quantum dot, and model selection as well as the capability of our solver to compute time evolution for a double quantum dot system. Our differentiable solver stands to widen the impact of physics-aware machine learning algorithms on quantum devices for characterisation and control.


title: Canadian Physics Counts: An exploration of the diverse identities of physics students and professionals in Canada

abstract: The lack of diversity in physics remains a persistent worldwide problem. Despite being a quantitative discipline which relies on measurements to construct and validate hypotheses, there remains a paucity of data on both demographics and experiences of marginalized groups. In Canada, there has never been a nationwide assessment of those studying or working in physics. Here, we present findings from Canadian Physics Counts: the first national survey of equity, diversity, and inclusion (EDI) in the Canadian physics community. Our intersectional approach allowed us to gather a wealth of information on gender identity, sexual orientation, race, disability, and more. Analyses revealed key findings, including the first data on physicists who identify as non-binary or gender diverse, as well as the first data on Black and Indigenous scholars. Black physicists (1.2%) and Indigenous physicists (.3%) were found to be the most underrepresented, while White men were overrepresented across all sectors. Among respondents with a disability, 5% reported receiving full accommodations for their required needs at their place of work or study. One in four respondents from BIPOC gender diverse backgrounds identified as being disabled, and the proportion of sexually diverse students who reported having a disability was more than three times higher than the proportion of heterosexual students with a disability. The data also revealed that students represented more demographic diversity than working professionals, highlighting the importance of acting today in order to retain the diverse physicists of tomorrow. Our analysis identifies areas for intervention and offers recommendations for building a diverse and inclusive physics community in Canada that can be a global exemplar.


title: Extensive-Form Game Solving via Blackwell Approachability on Treeplexes

abstract: In this paper, we introduce the first algorithmic framework for Blackwell approachability on the sequence-form polytope, the class of convex polytopes capturing the strategies of players in extensive-form games (EFGs). This leads to a new class of regret-minimization algorithms that are stepsize-invariant, in the same sense as the Regret Matching and Regret Matching$^+$ algorithms for the simplex. Our modular framework can be combined with any existing regret minimizer over cones to compute a Nash equilibrium in two-player zero-sum EFGs with perfect recall, through the self-play framework. Leveraging predictive online mirror descent, we introduce Predictive Treeplex Blackwell$^+$ (PTB$^+$), and show a $O(1/\sqrt{T})$ convergence rate to Nash equilibrium in self-play. We then show how to stabilize PTB$^+$ with a stepsize, resulting in an algorithm with a state-of-the-art $O(1/T)$ convergence rate. We provide an extensive set of experiments to compare our framework with several algorithmic benchmarks, including CFR$^+$ and its predictive variant, and we highlight interesting connections between practical performance and the stepsize-dependence or stepsize-invariance properties of classical algorithms.


title: On the rigidity of the complex Grassmannians

abstract: We study the integrability to second order of the infinitesimal Einstein deformations of the symmetric metric $g$ on the complex Grassmannian of $k$-planes inside $\mathbb{C}^n$. By showing the nonvanishing of Koiso's obstruction polynomial, we characterize the infinitesimal deformations that are integrable to second order as an explicit variety inside $\mathfrak{su}(n)$. In particular we show that $g$ is isolated in the moduli space of Einstein metrics if $n$ is odd.


title: Curvature Perturbations Protected Against One Loop

abstract: We examine one-loop corrections from small-scale curvature perturbations to the superhorizon-limit ones in single-field inflation models, which have recently caused controversy. We consider the case where the Universe experiences transitions of slow-roll (SR) $\to$ intermediate period $\to$ SR. The intermediate period can be an ultra-slow-roll period or a resonant amplification period, either of which enhances small-scale curvature perturbations. We assume that the superhorizon curvature perturbations are conserved at least during each of the SR periods. Within this framework, we show that the superhorizon curvature perturbations during the first and the second SR periods coincide at one-loop level in the slow-roll limit.


title: Propagation and emission of gravitational waves in the weak-field limit within the Palatini formalism

abstract: In the era of gravitational waves physics, when detections of wave fronts are increasing in number, sensibility, frequencies and distances, gravitational physics has entered a period of maximum activity and brilliance. This has open a new window where General Relativity can be challenged in both weak as strong-field regimes. In this paper, we focus on the analysis of gravitational waves propagation and emission in the weak-field regime for gravitational theories within the Palatini formalism. Our results show that gravitational waves propagation in vacuum matches General Relativity predictions as well as the multipolar expansion when considering weak sources, independently of the form of the gravitational action.


title: Fermionic vacuum stresses in models with toroidal compact dimensions

abstract: We investigate vacuum expectation value of the energy-momentum tensor for a massive Dirac field in flat spacetime with a toroidal subspace of a general dimension. Quasiperiodicity conditions with arbitrary phases are imposed on the field operator along compact dimensions. These phases are interpreted in terms of magnetic fluxes enclosed by compact dimensions. The equation of state in the uncompact subspace is of the cosmological constant type. It is shown that, in addition to the diagonal components, the vacuum energy-momentum tensor has nonzero off-diagonal components. In special cases of twisted (antiperiodic) and untwisted (periodic) fields the off diagonal components vanish. For untwisted fields the vacuum energy density is positive and the energy-momentum tensor obeys the strong energy condition. For general values of the phases in the periodicity conditions the energy density and stresses can be either positive or negative. The numerical results are given for a Kaluza-Klein type model with two extra dimensions.


title: Birdtracks of Exotic SU(N) Color Structures

abstract: I introduce a systematic procedure for constructing complete and independent sets of interactions of fields transforming under exotic representations of SU(N), in particular the SU(3) gauge group of QCD. It uncovers errors in previous results, starting with interactions of four fields including a single sextet.


title: Alternative Method for Estimating Betti Numbers

abstract: Topological data analysis (TDA) is a fast-growing field that utilizes advanced tools from topology to analyze large-scale data. A central problem in topological data analysis is estimating the so-called Betti numbers of the underlying simplicial complex. While the difficulty of this problem has been established as NP-hard, previous works have showcased appealing quantum speedup. In this article, we provide an alternative method for estimating Betti numbers and normalized Betti numbers of given simplicial complex, based on some recent advances in quantum algorithm, specifically, quantum singular value transformation. Our method can be faster than the best-known classical method for finding Betti numbers, and interestingly, it can also find the Betti numbers of the complement graph to our original one. Comparing to the best known quantum algorithm, our method generally requires lower depth circuit, in trade-off for longer running time. Regarding normalized Betti numbers, our method could match the running time of best-known quantum method in the case of dense simplices.


title: Invariant amplitudes, unpolarized cross sections, and polarization asymmetries in (anti)neutrino-nucleon elastic scattering

abstract: At leading order in weak and electromagnetic couplings, cross sections for (anti)neutrino-nucleon elastic scattering are determined by four nucleon form factors that depend on the momentum transfer $Q^2$. Including radiative corrections in the Standard Model and potential new physics contributions beyond the Standard Model, eight invariant amplitudes are possible, depending on both $Q^2$ and the (anti)neutrino energy $E_\nu$. We review the definition of these amplitudes and use them to compute both unpolarized and polarized observables including radiative corrections. We show that unpolarized accelerator neutrino cross-section measurements can probe new physics parameter space within the constraints inferred from precision beta decay measurements.


title: A divide-and-conquer approach for sparse recovery of high dimensional signals

abstract: Compressed sensing (CS) techniques demand significant storage and computational resources, when recovering high-dimensional sparse signals. Block CS (BCS), a special class of CS, addresses both the storage and complexity issues by partitioning the sparse recovery problem into several sub-problems. In this paper, we derive a Welch bound-based guarantee on the reconstruction error with BCS. Our guarantee reveals that the reconstruction quality with BCS monotonically reduces with an increasing number of partitions. To alleviate this performance loss, we propose a sparse recovery technique that exploits correlation across the partitions of the sparse signal. Our method outperforms BCS in the moderate SNR regime, for a modest increase in the storage and computational complexities.


title: Dramatic Drop in the X-Ray Polarization of Swift J1727.8$-$1613 in the Soft Spectral State

abstract: Black-hole X-ray binaries exhibit different spectral and timing properties in different accretion states. The X-ray outburst of a recently discovered and extraordinarily bright source, Swift$~$J1727.8$-$1613, has enabled the first investigation of how the X-ray polarization properties of a source evolve with spectral state. The 2$-$8 keV polarization degree was previously measured by the Imaging X-ray Polarimetry Explorer (IXPE) to be $\approx$ 4% in the hard and hard intermediate states. Here we present new IXPE results taken in the soft state, with the X-ray flux dominated by the thermal accretion-disk emission. We find that the polarization degree has dropped dramatically to $\lesssim$ 1%. This result indicates that the measured X-ray polarization is largely sensitive to the accretion state and the polarization fraction is significantly higher in the hard state when the X-ray emission is dominated by up-scattered radiation in the X-ray corona. The combined polarization measurements in the soft and hard states disfavor a very high or low inclination of the system.


title: Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level

abstract: Neighborhood attention reduces the cost of self attention by restricting each token's attention span to its nearest neighbors. This restriction, parameterized by a window size and dilation factor, draws a spectrum of possible attention patterns between linear projection and self attention. Neighborhood attention, and more generally sliding window attention patterns, have long been bounded by infrastructure, particularly in higher-rank spaces (2-D and 3-D), calling for the development of custom kernels, which have been limited in either functionality, or performance, if not both. In this work, we first show that neighborhood attention can be represented as a batched GEMM problem, similar to standard attention, and implement it for 1-D and 2-D neighborhood attention. These kernels on average provide 895% and 272% improvement in full precision latency compared to existing naive kernels for 1-D and 2-D neighborhood attention respectively. We find certain inherent inefficiencies in all unfused neighborhood attention kernels that bound their performance and lower-precision scalability. We also developed fused neighborhood attention; an adaptation of fused dot-product attention kernels that allow fine-grained control over attention across different spatial axes. Known for reducing the quadratic time complexity of self attention to a linear complexity, neighborhood attention can now enjoy a reduced and constant memory footprint, and record-breaking half precision latency. We observe that our fused kernels successfully circumvent some of the unavoidable inefficiencies in unfused implementations. While our unfused GEMM-based kernels only improve half precision performance compared to naive kernels by an average of 496% and 113% in 1-D and 2-D problems respectively, our fused kernels improve naive kernels by an average of 1607% and 581% in 1-D and 2-D problems respectively.


title: Exciton Condensation in Landau Levels of Quantum Spin Hall Insulators

abstract: The interplay of band topology and electron interactions can lead to novel quantum states of matter. In this work, we theoretically study the quantum spin Hall insulator (QSHI) in a perpendicular magnetic field. In the noninteracting case, the QSHI with space inversion and uniaxial spin rotation symmetries undergoes a topological transition into a normal insulator phase at a critical magnetic field $B_{\mathrm{c}}$. The exciton condensation in the lowest Landau levels is triggered by Coulomb interactions in the vicinity of $B_{\mathrm{c}}$ and spontaneously breaks the inversion and the spin rotation symmetries. We propose that the electron spin resonance spectroscopy can directly probe the exciton condensation order. Our results should apply to the InAs/GaSb quantum wells and other QSHIs.


title: PixArt-\Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

abstract: In this paper, we introduce PixArt-\Sigma, a Diffusion Transformer model~(DiT) capable of directly generating images at 4K resolution. PixArt-\Sigma represents a significant advancement over its predecessor, PixArt-\alpha, offering images of markedly higher fidelity and improved alignment with text prompts. A key feature of PixArt-\Sigma is its training efficiency. Leveraging the foundational pre-training of PixArt-\alpha, it evolves from the `weaker' baseline to a `stronger' model via incorporating higher quality data, a process we term "weak-to-strong training". The advancements in PixArt-\Sigma are twofold: (1) High-Quality Training Data: PixArt-\Sigma incorporates superior-quality image data, paired with more precise and detailed image captions. (2) Efficient Token Compression: we propose a novel attention module within the DiT framework that compresses both keys and values, significantly improving efficiency and facilitating ultra-high-resolution image generation. Thanks to these improvements, PixArt-\Sigma achieves superior image quality and user prompt adherence capabilities with significantly smaller model size (0.6B parameters) than existing text-to-image diffusion models, such as SDXL (2.6B parameters) and SD Cascade (5.1B parameters). Moreover, PixArt-\Sigma's capability to generate 4K images supports the creation of high-resolution posters and wallpapers, efficiently bolstering the production of high-quality visual content in industries such as film and gaming.


title: Analysis of Systems' Performance in Natural Language Processing Competitions

abstract: Collaborative competitions have gained popularity in the scientific and technological fields. These competitions involve defining tasks, selecting evaluation scores, and devising result verification methods. In the standard scenario, participants receive a training set and are expected to provide a solution for a held-out dataset kept by organizers. An essential challenge for organizers arises when comparing algorithms' performance, assessing multiple participants, and ranking them. Statistical tools are often used for this purpose; however, traditional statistical methods often fail to capture decisive differences between systems' performance. This manuscript describes an evaluation methodology for statistically analyzing competition results and competition. The methodology is designed to be universally applicable; however, it is illustrated using eight natural language competitions as case studies involving classification and regression problems. The proposed methodology offers several advantages, including off-the-shell comparisons with correction mechanisms and the inclusion of confidence intervals. Furthermore, we introduce metrics that allow organizers to assess the difficulty of competitions. Our analysis shows the potential usefulness of our methodology for effectively evaluating competition results.


title: On $[1,2]$-Domination in Interval and Circle Graphs

abstract: A subset $S$ of vertices in a graph $G=(V, E)$ is Dominating Set if each vertex in $V(G)\setminus S$ is adjacent to at least one vertex in $S$. Chellali et al. in 2013, by restricting the number of neighbors in $S$ of a vertex outside $S$, introduced the concept of $[1,j]$-dominating set. A set $D \subseteq V$ of a graph $G = (V, E)$ is called $[1,j]$-Dominating Set of $G$ if every vertex not in $D$ has at least one neighbor and at most $j$ neighbors in $D$. The Minimum $[1,j]$-Domination problem is the problem of finding the minimum set $D$. Given a positive integer $k$ and a graph $G = (V, E)$, the $[1,j]$-Domination Decision problem is to decide whether $G$ has $[1,j]$-dominating set of cardinality at most $k$. A polynomial-time algorithm was obtained in split graphs for a constant $j$ in contrast to the classic Dominating Set problem which is NP-hard in split graphs. This result motivates us to investigate the effect of restriction $j$ on the complexity of $[1,j]$-domination problem on various classes of graphs. Although for $j\geq 3$, it has been proved that the minimum of classical domination is equal to minimum $[1,j]$-domination in interval graphs, the complexity of finding the minimum $[1,2]$-domination in interval graphs is still outstanding. In this paper, we propose a polynomial-time algorithm for computing a minimum $[1,2]$ on non-proper interval graphs by a dynamic programming technique. Next, on the negative side, we show that the minimum $[1,2]$-dominating set problem on circle graphs is $NP$-complete.


title: On phase transitions during collisions near the horizon of black holes

abstract: During particle collisions in the vicinity of the horizon of black holes, it is possible to achieve energies and temperatures corresponding to phase transitions in particle physics. It is shown that the sizes of the regions of the new phase are of the order of the Compton length for the corresponding mass scale. The lifetime is also on the order of the Compton time. It is shown that the inverse influence of the energy density in the electro-weak phase transition in collisions on the space-time metric can be neglected.


title: Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantification

abstract: Large language models (LLMs) are notorious for hallucinating, i.e., producing erroneous claims in their output. Such hallucinations can be dangerous, as occasional factual inaccuracies in the generated text might be obscured by the rest of the output being generally factually correct, making it extremely hard for the users to spot them. Current services that leverage LLMs usually do not provide any means for detecting unreliable generations. Here, we aim to bridge this gap. In particular, we propose a novel fact-checking and hallucination detection pipeline based on token-level uncertainty quantification. Uncertainty scores leverage information encapsulated in the output of a neural network or its layers to detect unreliable predictions, and we show that they can be used to fact-check the atomic claims in the LLM output. Moreover, we present a novel token-level uncertainty quantification method that removes the impact of uncertainty about what claim to generate on the current step and what surface form to use. Our method Claim Conditioned Probability (CCP) measures only the uncertainty of a particular claim value expressed by the model. Experiments on the task of biography generation demonstrate strong improvements for CCP compared to the baselines for seven LLMs and four languages. Human evaluation reveals that the fact-checking pipeline based on uncertainty quantification is competitive with a fact-checking tool that leverages external knowledge.


title: AUFormer: Vision Transformers are Parameter-Efficient Facial Action Unit Detectors

abstract: Facial Action Units (AU) is a vital concept in the realm of affective computing, and AU detection has always been a hot research topic. Existing methods suffer from overfitting issues due to the utilization of a large number of learnable parameters on scarce AU-annotated datasets or heavy reliance on substantial additional relevant data. Parameter-Efficient Transfer Learning (PETL) provides a promising paradigm to address these challenges, whereas its existing methods lack design for AU characteristics. Therefore, we innovatively investigate PETL paradigm to AU detection, introducing AUFormer and proposing a novel Mixture-of-Knowledge Expert (MoKE) collaboration mechanism. An individual MoKE specific to a certain AU with minimal learnable parameters first integrates personalized multi-scale and correlation knowledge. Then the MoKE collaborates with other MoKEs in the expert group to obtain aggregated information and inject it into the frozen Vision Transformer (ViT) to achieve parameter-efficient AU detection. Additionally, we design a Margin-truncated Difficulty-aware Weighted Asymmetric Loss (MDWA-Loss), which can encourage the model to focus more on activated AUs, differentiate the difficulty of unactivated AUs, and discard potential mislabeled samples. Extensive experiments from various perspectives, including within-domain, cross-domain, data efficiency, and micro-expression domain, demonstrate AUFormer's state-of-the-art performance and robust generalization abilities without relying on additional relevant data. The code for AUFormer is available at https://github.com/yuankaishen2001/AUFormer.


title: Qubit dynamics of ergotropy and environment-induced work

abstract: We investigate the dynamics of ergotropy in open systems under Markovian and non-Markovian evolutions. In this scenario, we begin by formulating the ergotropy of an arbitrary qubit state in terms of energy and coherence. Thus, we determine the conditions for ergotropy freezing and ergotropy sudden death as a consequence of the system-bath interaction. In order to use ergotropy as a resource for energy extraction in the form of work in an open-system scenario, we adopt the entropy-based formulation of quantum thermodynamics. In this approach, the work gains an additional environment-induced component, which may be present even for constant Hamiltonians. We then establish an analytical relationship between the environment-induced work and ergotropy, providing an interpretation of environment-induced work in terms of variation of ergotropy. In particular, energy transfer by environment-induced work can be performed up to a limit, which is governed by the energy cost to transit between the initial and final passive states of the quantum dynamics. We illustrate these results for qubit states evolving under non-dissipative and dissipative quantum processes.


title: Discrete hypocoercivity for a nonlinear kinetic reaction model

abstract: In this article, we propose a finite volume discretization of a one dimensional nonlinear reaction kinetic model proposed in [Neumann, Schmeiser, Kint. Rel. Mod. 2016], which describes a 2-species recombination-generation process. Specifically, we establish the long-time convergence of approximate solutions towards equilibrium, at exponential rate. The study is based on an adaptation for a discretization of the linearized problem of the $L^2$ hypocoercivity method introduced in [Dolbeault, Mouhot, Schmeiser, 2015]. From this, we can deduce a local result for the discrete nonlinear problem. As in the continuous framework, this result requires the establishment of a maximum principle, which necessitates the use of monotone numerical fluxes.


title: Delving into the Trajectory Long-tail Distribution for Muti-object Tracking

abstract: Multiple Object Tracking (MOT) is a critical area within computer vision, with a broad spectrum of practical implementations. Current research has primarily focused on the development of tracking algorithms and enhancement of post-processing techniques. Yet, there has been a lack of thorough examination concerning the nature of tracking data it self. In this study, we pioneer an exploration into the distribution patterns of tracking data and identify a pronounced long-tail distribution issue within existing MOT datasets. We note a significant imbalance in the distribution of trajectory lengths across different pedestrians, a phenomenon we refer to as ``pedestrians trajectory long-tail distribution''. Addressing this challenge, we introduce a bespoke strategy designed to mitigate the effects of this skewed distribution. Specifically, we propose two data augmentation strategies, including Stationary Camera View Data Augmentation (SVA) and Dynamic Camera View Data Augmentation (DVA) , designed for viewpoint states and the Group Softmax (GS) module for Re-ID. SVA is to backtrack and predict the pedestrian trajectory of tail classes, and DVA is to use diffusion model to change the background of the scene. GS divides the pedestrians into unrelated groups and performs softmax operation on each group individually. Our proposed strategies can be integrated into numerous existing tracking systems, and extensive experimentation validates the efficacy of our method in reducing the influence of long-tail distribution on multi-object tracking performance. The code is available at https://github.com/chen-si-jia/Trajectory-Long-tail-Distribution-for-MOT.


title: ObjectCompose: Evaluating Resilience of Vision-Based Models on Object-to-Background Compositional Changes

abstract: Given the large-scale multi-modal training of recent vision-based models and their generalization capabilities, understanding the extent of their robustness is critical for their real-world deployment. In this work, we evaluate the resilience of current vision-based models against diverse object-to-background context variations. The majority of robustness evaluation methods have introduced synthetic datasets to induce changes to object characteristics (viewpoints, scale, color) or utilized image transformation techniques (adversarial changes, common corruptions) on real images to simulate shifts in distributions. Recent works have explored leveraging large language models and diffusion models to generate changes in the background. However, these methods either lack in offering control over the changes to be made or distort the object semantics, making them unsuitable for the task. Our method, on the other hand, can induce diverse object-to-background changes while preserving the original semantics and appearance of the object. To achieve this goal, we harness the generative capabilities of text-to-image, image-to-text, and image-to-segment models to automatically generate a broad spectrum of object-to-background changes. We induce both natural and adversarial background changes by either modifying the textual prompts or optimizing the latents and textual embedding of text-to-image models. We produce various versions of standard vision datasets (ImageNet, COCO), incorporating either diverse and realistic backgrounds into the images or introducing color, texture, and adversarial changes in the background. We conduct extensive experiment to analyze the robustness of vision-based models against object-to-background context variations across diverse tasks. Code https://github.com/Muhammad-Huzaifaa/ObjectCompose.git


title: Convergence of a Ramshaw-Mesina Iteration

abstract: In 1991 Ramshaw and Mesina introduced a clever synthesis of penalty methods and artificial compression methods. Its form makes it an interesting option to replace the pressure update in the Uzawa iteration. The result, for the Stokes problem, is \begin{equation} \left\{ \begin{array} [c]{cc} Step\ 1: & -\triangle u^{n+1}+\nabla p^{n}=f(x),\ {\rm in}\ \Omega,\ u^{n+1}|_{\partial\Omega}=0,\\ Step\ 2: & p^{n+1}-p^{n}+\beta\nabla\cdot(u^{n+1}-u^{n})+\alpha ^{2}\nabla\cdot u^{n+1}=0. \end{array} \right. \end{equation} For saddle point problems, including Stokes, this iteration converges under a condition similar to the one required for Uzawa iteration.


title: mmPlace: Robust Place Recognition with Intermediate Frequency Signal of Low-cost Single-chip Millimeter Wave Radar

abstract: Place recognition is crucial for tasks like loop-closure detection and re-localization. Single-chip millimeter wave radar (single-chip radar in short) emerges as a low-cost sensor option for place recognition, with the advantage of insensitivity to degraded visual environments. However, it encounters two challenges. Firstly, sparse point cloud from single-chip radar leads to poor performance when using current place recognition methods, which assume much denser data. Secondly, its performance significantly declines in scenarios involving rotational and lateral variations, due to limited overlap in its field of view (FOV). We propose mmPlace, a robust place recognition system to address these challenges. Specifically, mmPlace transforms intermediate frequency (IF) signal into range azimuth heatmap and employs a spatial encoder to extract features. Additionally, to improve the performance in scenarios involving rotational and lateral variations, mmPlace employs a rotating platform and concatenates heatmaps in a rotation cycle, effectively expanding the system's FOV. We evaluate mmPlace's performance on the milliSonic dataset, which is collected on the University of Science and Technology of China (USTC) campus, the city roads surrounding the campus, and an underground parking garage. The results demonstrate that mmPlace outperforms point cloud-based methods and achieves 87.37% recall@1 in scenarios involving rotational and lateral variations.


title: Quantum Advantage in Reversing Unknown Unitary Evolutions

abstract: We introduce the Quantum Unitary Reversal Algorithm (QURA), a deterministic and exact approach to universally reverse arbitrary unknown unitary transformations using $\mathcal{O}(d^2)$ calls of the unitary, where $d$ is the system dimension. Our construction resolves a fundamental problem of time-reversal simulations for closed quantum systems by affirming the feasibility of reversing any unitary evolution without knowing the exact process. The algorithm also provides the construction of a key oracle for unitary inversion in quantum algorithm frameworks such as quantum singular value transformation. Notably, our work demonstrates that compared with classical methods relying on process tomography, reversing an unknown unitary on a quantum computer holds a quadratic quantum advantage in computation complexity. QURA ensures an exact unitary inversion while the classical counterpart can never achieve exact inversion using a finite number of unitary calls.


title: Observation of Nonlinear Response and Onsager Regression in a Photon Bose-Einstein Condensate

abstract: The quantum regression theorem states that the correlations of a system at two different times are governed by the same equations of motion as the temporal response of the average values. Such a relation provides a powerful framework for the investigation of physical systems by establishing a formal connection between intrinsic microscopic behaviour and a macroscopic 'effect' due to an external 'cause'. Measuring the response to a controlled perturbation in this way allows to determine, for example, structure factors in condensed matter systems as well as other correlation functions of material systems. Here we experimentally demonstrate that the two-time particle number correlations in a photon Bose-Einstein condensate inside a dye-filled microcavity exhibit the same dynamics as the response of the condensate to a sudden perturbation of the dye molecule bath. This confirms the regression theorem for a quantum gas and, moreover, establishes a test of this relation in an unconventional form where the perturbation acts on the bath and only the condensate response is monitored. For strong perturbations, we observe nonlinear relaxation dynamics which our microscopic theory relates to the equilibrium fluctuations, thereby extending the regression theorem beyond the regime of linear response. The demonstrated nonlinearity of the condensate-bath system paves the way for studies of novel elementary excitations in lattices of driven-dissipative photon condensates.


title: Common 7B Language Models Already Possess Strong Math Capabilities

abstract: Mathematical capabilities were previously believed to emerge in common language models only at a very large scale or require extensive math-related pre-training. This paper shows that the LLaMA-2 7B model with common pre-training already exhibits strong mathematical abilities, as evidenced by its impressive accuracy of 97.7% and 72.0% on the GSM8K and MATH benchmarks, respectively, when selecting the best response from 256 random generations. The primary issue with the current base model is the difficulty in consistently eliciting its inherent mathematical capabilities. Notably, the accuracy for the first answer drops to 49.5% and 7.9% on the GSM8K and MATH benchmarks, respectively. We find that simply scaling up the SFT data can significantly enhance the reliability of generating correct answers. However, the potential for extensive scaling is constrained by the scarcity of publicly available math questions. To overcome this limitation, we employ synthetic data, which proves to be nearly as effective as real data and shows no clear saturation when scaled up to approximately one million samples. This straightforward approach achieves an accuracy of 82.6% on GSM8K and 40.6% on MATH using LLaMA-2 7B models, surpassing previous models by 14.2% and 20.8%, respectively. We also provide insights into scaling behaviors across different reasoning complexities and error types.


title: The Variable Radius Form of the Extended Exterior Sphere Condition

abstract: We introduce a variable radius form of the extended exterior sphere condition of [16], and then, we prove that the complement of a closed set satisfying this new property is nothing but the union of closed balls with lower semicontinous radius function. This generalizes, to the variable radius case, the main result of [16], namely, [16, Theorem 1.2]. On the other hand, as it is shown in [14,15] for prox-regularity, the exterior sphere condition, and the union of closed balls property, we prove that the constant and the variable radius forms of the extended exterior sphere condition belong to the S-convexity regularity class.


title: QRscript specification

abstract: This specification document specifies the syntax and semantics of QRscript. The current document only shows the part related to the QRscript header, i.e., the first part of the binary code that must be inserted into the QR code. A QR code containing an executable code is called an executable QR code (eQR code). QRscript supports different dialects, i.e., sublanguages with implementation characteristics specific to the application field. The specifications of the individual dialects will be described in separate documents.


title: Tuning transduction from hidden observables to optimize information harvesting

abstract: Biological and living organisms sense and process information from their surroundings, typically having access only to a subset of external observables for a limited amount of time. In this work, we uncover how biological systems can exploit these accessible degrees of freedom (DOFs) to transduce information from the inaccessible ones with a limited energy budget. We find that optimal transduction strategies may boost information harvesting over the ideal case in which all DOFs are known, even when only finite-time trajectories are observed, at the price of higher dissipation. We apply our results to red blood cells, inferring the implemented transduction strategy from membrane flickering data and shedding light on the connection between mechanical stress and transduction efficiency. Our framework offers novel insights into the adaptive strategies of biological systems under non-equilibrium conditions.


title: Isomeric states of fission fragments explored via Penning trap mass spectrometry at IGISOL

abstract: The masses of $^{84}$Br, $^{105}$Mo, $^{115,119,121}$Pd, $^{122}$Ag, $^{127,129}$In, $^{132}$Sb and their respective isomeric states have been measured with the JYFLTRAP Penning trap mass spectrometer using the phase-imaging ion-cyclotron-resonance technique. The excitation energies of the isomeric states in $^{132}$Sb and $^{119}$Pd were experimentally determined for the first time, while for $^{84}$Br, $^{115}$Pd and $^{127,129}$In, the precision of the mass values was substantially improved. In $^{105}$Mo and $^{121}$Pd there were no signs of a long-lived isomeric state. The ground-state measurements of $^{119}$Pd and $^{122}$Ag indicated that both are significantly more bound than the literature values. For $^{122}$Ag, there was no indication of a proposed third long-lived state. The results for the $N=49$ nucleus $^{84}$Br and isomers close to doubly magic $^{132}$Sn have been compared to the shell-model and the microscopic quasiparticle-phonon model calculations.


title: Stability and causality of rest frame modes in second-order spin hydrodynamics

abstract: We analyze the low- and high-momentum rest frame modes in the second-order spin hydrodynamics and check the asymptotic causality of the theory. A truncation scheme of the Israel-Stewart formalism derived in our earlier work is proposed that extends the minimal causal formulation. It consists of altogether 40 interconnected relaxation-type dynamical equations -- 16 (24) of them correspond to the independent components of the energy-momentum (spin) tensor. Similarly to previous studies, we find that the stability of the perturbations and asymptotic causality require using the spin equation of state that satisfies the generalized Frenkel condition demanding that the ``electric'' and ``magnetic'' components of the spin density tensor have opposite signs. For low-momentum modes this behavior is similar to that found earlier for the first-order (Navier-Stokes) spin hydrodynamics.


title: GMKF: Generalized Moment Kalman Filter for Polynomial Systems with Arbitrary Noise

abstract: This paper develops a new filtering approach for state estimation in polynomial systems corrupted by arbitrary noise, which commonly arise in robotics. We first consider a batch setup where we perform state estimation using all data collected from the initial to the current time. We formulate the batch state estimation problem as a Polynomial Optimization Problem (POP) and relax the assumption of Gaussian noise by specifying a finite number of moments of the noise. We solve the resulting POP using a moment relaxation and prove that under suitable conditions on the rank of the relaxation, (i) we can extract a provably optimal estimate from the moment relaxation, and (ii) we can obtain a belief representation from the dual (sum-of-squares) relaxation. We then turn our attention to the filtering setup and apply similar insights to develop a GMKF for recursive state estimation in polynomial systems with arbitrary noise. The GMKF formulates the prediction and update steps as POPs and solves them using moment relaxations, carrying over a possibly non-Gaussian belief. In the linear-Gaussian case, GMKF reduces to the standard Kalman Filter. We demonstrate that GMKF performs well under highly non-Gaussian noise and outperforms common alternatives, including the Extended and Unscented Kalman Filter, and their variants on matrix Lie group.


title: Seedless Extractors for Device-Independent Quantum Cryptography

abstract: Device-independent (DI) quantum cryptography aims at providing secure cryptography with minimal trust in, or characterisation of, the underlying quantum devices. An essential step in DI protocols is randomness extraction (or privacy amplification) which requires the honest parties to have a seed of additional bits with sufficient entropy and statistical independence of any bits generated during the protocol. In this work we introduce a method for extraction in DI protocols which does not require a seed and is secure against computationally unbounded quantum adversary. The key idea is to use the Bell violation of the raw data, instead of its min-entropy, as the extractor promise.


title: Parendi: Thousand-Way Parallel RTL Simulation

abstract: Hardware development relies on simulations, particularly cycle-accurate RTL (Register Transfer Level) simulations, which consume significant time. As single-processor performance grows only slowly, conventional, single-threaded RTL simulation is becoming less practical for increasingly complex chips and systems. A solution is parallel RTL simulation, where ideally, simulators could run on thousands of parallel cores. However, existing simulators can only exploit tens of cores. This paper studies the challenges inherent in running parallel RTL simulation on a multi-thousand-core machine (the Graphcore IPU, a 1472-core machine). Simulation performance requires balancing three factors: synchronization, communication, and computation. We experimentally evaluate each metric and analyze how it affects parallel simulation speed, drawing on contrasts between the large-scale IPU and smaller but faster x86 systems. Using this analysis, we build Parendi, an RTL simulator for the IPU. It distributes RTL simulation across 5888 cores on 4 IPU sockets. Parendi runs large RTL designs up to 4x faster than a powerful, state-of-the-art x86 multicore system.


title: Molecular Gas Tracers in Young and Old Protoplanetary Disks

abstract: Molecular emission is used to investigate both the physical and chemical properties of protoplanetary disks. Therefore, to accurately derive disk properties, we need a thorough understanding of the behavior of the molecular probes we rely on. Here we investigate how the molecular line emission of N$_2$H$^+$, HCO$^+$, HCN, and C$^{18}$O compare to other measured quantities in a set of 20 protoplanetary disks. Overall, we find positive correlations between multiple line fluxes and the disk dust mass and radius. We also generally find strong positive correlations between the line fluxes of different molecular species. However, some disks do show noticeable differences in the relative fluxes of N$_2$H$^+$, HCO$^+$, HCN, and C$^{18}$O. These differences occur even within a single star-forming region. This results in a potentially large range of different disk masses and chemical compositions for systems of similar age and birth environment. While we make preliminary comparisons of molecular fluxes across different star-forming regions, more complete and uniform samples are needed in the future to search for trends with birth environment or age.


title: QRtree -- Decision Tree dialect specification of QRscript

abstract: This specification document specifies the syntax and semantics of QRtree, which is a specific dialect of QRscript particularly suited to represent decision trees without chance nodes. The term dialect identifies one of the possible sub-languages that can be encoded inside of an eQR code via QRscript. This specification will describe an intermediate representation of QRtree, made through a language derived by the three-address code. It will then define the transformation rules from the intermediate representation to a binary code. The latter is a binary representation called eQRtreebytecode. These rules can also be applied inversely to transform the eQRtreeBytecode into the intermediate representation. This specification document will pay particular attention to the creation of a compact eQRtreebytecode, as the maximum number of bits that can be stored in a QR code is, at the time of writing, equal to 2953 bytes (in the case of QR code version 40 with a "low" error correction level).


title: Literature Review of Current Sustainability Assessment Frameworks and Approaches for Organizations

abstract: This systematic literature review explores sustainability assessment frameworks (SAFs) across diverse industries. The review focuses on SAF design approaches including the methods used for Sustainability Indicator (SI) selection, relative importance assessment, and interdependency analysis. Various methods, including literature reviews, stakeholder interviews, questionnaires, Pareto analysis, SMART approach, and adherence to sustainability standards, contribute to the complex SI selection process. Fuzzy-AHP stands out as a robust technique for assessing relative SI importance. While dynamic sustainability and performance indices are essential, methods like DEMATEL, VIKOR, correlation analysis, and causal models for interdependency assessment exhibit static limitations. The review presents strengths and limitations of SAFs, addressing gaps in design approaches and contributing to a comprehensive understanding. The insights of this review aim to benefit policymakers, administrators, leaders, and researchers, fostering sustainability practices. Future research recommendations include exploring multi-criteria decision-making models and hybrid approaches, extending sustainability evaluation across organizational levels and supply chains. Emphasizing adaptability to industry specifics and dynamic global adjustments is proposed for holistic sustainability practices, further enhancing organizational sustainability.


title: On the controllability of nonlinear systems with a periodic drift

abstract: Sufficient and necessary conditions are established for controllability of affine control systems, motivated by these with a drift all of whose solutions are periodic. In contrast with previously known results, these conditions encompass the case of a control set whose convex hull contains the origin but is not a neighborhood of the origin. The condition is expressed by means of pushforwards along the flow of the drift, rather than in terms of Lie brackets. It turns out that this also amounts to local controllability of a time-varying linear approximation with constrained controls. Global and local results are given, as well as a few illustrative examples.


title: How is the density of quasi-two-dimensional uniform dipolar quantum Bose gases affected by trap imperfections?

abstract: We theoretically investigate the impact of weak perturbations of a flat potential on the density of a quasi-two-dimensional dipolar Bose gas. We use a mean-field perturbative treatment of the potential defects and derive their effects at first order in the mean-field stable regime. We first focus on defects containing a single spatial frequency and study the wavevector dependence of the density perturbation. A qualitative modification of the wavenumber dependence with the interaction parameters and a sensitivity in the excitation direction reveal the long-range and anisotropic dipolar effects. These effects are found to be most important at intermediate wavenumbers and can give rise to a local maximum in the density perturbation reminiscent of the roton mode softening and local instabilities. The dependence on the gas and interaction parameters is studied. The case of a flat potential perturbed with white noise on a certain momentum range is then examined. Here it is found that the strength perturbation becomes independent of the mean density when sufficiently large. Our study touches upon experimentally relevant issues, giving hints on how flat a uniform potential should be to achieve uniform quasi-two-dimensional dipolar Bose gases.


title: Rethinking of Encoder-based Warm-start Methods in Hyperparameter Optimization

abstract: Effectively representing heterogeneous tabular datasets for meta-learning remains an open problem. Previous approaches rely on predefined meta-features, for example, statistical measures or landmarkers. Encoder-based models, such as Dataset2Vec, allow us to extract significant meta-features automatically without human intervention. This research introduces a novel encoder-based representation of tabular datasets implemented within the liltab package available on GitHub https://github.com/azoz01/liltab. Our package is based on an established model for heterogeneous tabular data proposed in [Tomoharu Iwata and Atsutoshi Kumagai. Meta-learning from Tasks with Heterogeneous Attribute Spaces. In Advances in Neural Information Processing Systems, 2020]. The proposed approach employs a different model for encoding feature relationships, generating alternative representations compared to existing methods like Dataset2Vec. Both of them leverage the fundamental assumption of dataset similarity learning. In this work, we evaluate Dataset2Vec and liltab on two common meta-tasks -- representing entire datasets and hyperparameter optimization warm-start. However, validation on an independent metaMIMIC dataset highlights the nuanced challenges in representation learning. We show that general representations may not suffice for some meta-tasks where requirements are not explicitly considered during extraction.


title: A sharp H\"{o}rmander condition for bilinear Fourier multipliers with Lipschitz singularities

abstract: This paper studies the $L^{p}$ boundedness of bilinear Fourier multipliers in the local $L^{2}$ range. We assume a H\"{o}rmander condition relative to a singular set that is a finite union of Lipschitz curves. The H\"{o}rmander condition is sharp with respect to the Sobolev exponent. Our setup generalizes the non-degenerate bilinear Hilbert transform but avoids issues of uniform bounds near degeneracy.


title: Quantum-enhanced joint estimation of phase and phase diffusion

abstract: Accurate phase estimation in the presence of unknown phase diffusive noise is a crucial yet challenging task in noisy quantum metrology. This problem is particularly interesting due to the detrimental impact of the associated noise. Here, we investigate the joint estimation of phase and phase diffusion using generalized Holland-Burnett states, known for their experimental accessibility. These states provide performance close to the optimal state in single-parameter phase estimation, even in the presence of photon losses. We adopt a twofold approach by analyzing the joint information extraction through the double homodyne measurement and the joint information availability across all probe states. Through our analysis, we find that the highest sensitivities are obtained by using states created by directing all input photons into one port of a balanced beam splitter. Furthermore, we infer that good levels of sensitivity persist even in the presence of moderate photon losses, illustrating the remarkable resilience of our probe states under lossy conditions.


title: Testing an entropy estimator related to the dynamical state of galaxy clusters

abstract: We propose the entropy estimator $H_Z$, calculated from global dynamical parameters, in an attempt to capture the degree of evolution of galaxy systems. We assume that the observed (spatial and velocity) distributions of member galaxies in these systems evolve over time towards states of higher dynamical relaxation (higher entropy), becoming more random and homogeneous in virial equilibrium. Thus, the $H_Z$-entropy should correspond to the gravitacional assembly state of the systems. This was tested in a sample of 70 well sampled clusters in the Local Universe whose gravitational assembly state, classified from optical and X-ray analysis of substructures, shows clear statistical correlation with $H_Z$. This estimator was also tested on a sample of clusters (halos) from the IllustrisTNG simulations, obtaining results in agreement with the observational ones.

categories: astro-ph.CO cs.IT math.DS math.IT physics.data-an stat.AP


title: Masked Capsule Autoencoders

abstract: We propose Masked Capsule Autoencoders (MCAE), the first Capsule Network that utilises pretraining in a self-supervised manner. Capsule Networks have emerged as a powerful alternative to Convolutional Neural Networks (CNNs), and have shown favourable properties when compared to Vision Transformers (ViT), but have struggled to effectively learn when presented with more complex data, leading to Capsule Network models that do not scale to modern tasks. Our proposed MCAE model alleviates this issue by reformulating the Capsule Network to use masked image modelling as a pretraining stage before finetuning in a supervised manner. Across several experiments and ablations studies we demonstrate that similarly to CNNs and ViTs, Capsule Networks can also benefit from self-supervised pretraining, paving the way for further advancements in this neural network domain. For instance, pretraining on the Imagenette dataset, a dataset of 10 classes of Imagenet-sized images, we achieve not only state-of-the-art results for Capsule Networks but also a 9% improvement compared to purely supervised training. Thus we propose that Capsule Networks benefit from and should be trained within a masked image modelling framework, with a novel capsule decoder, to improve a Capsule Network's performance on realistic-sized images.


title: Discrete-to-continuous crystalline curvature flows

abstract: We consider here a fully discrete variant of the implicit variational scheme for mean curvature flow [AlmTayWan,LucStu], in a setting where the flow is governed by a crystalline surface tension defined by the limit of pairwise interactions energy on the discrete grid. The algorithm is based on a new discrete distance from the evolving sets, which prevents the occurrence of the spatial drift and pinning phenomena identified in [BraGelNov] in a similar discrete framework. We provide the first rigorous convergence result holding in any dimension, for any initial set and for a large class of purely crystalline anisotropies, in which the spatial discretization mesh can be of the same order or coarser than the time step.


title: A Sub-Quadratic Time Algorithm for Robust Sparse Mean Estimation

abstract: We study the algorithmic problem of sparse mean estimation in the presence of adversarial outliers. Specifically, the algorithm observes a \emph{corrupted} set of samples from $\mathcal{N}(\mu,\mathbf{I}_d)$, where the unknown mean $\mu \in \mathbb{R}^d$ is constrained to be $k$-sparse. A series of prior works has developed efficient algorithms for robust sparse mean estimation with sample complexity $\mathrm{poly}(k,\log d, 1/\epsilon)$ and runtime $d^2 \mathrm{poly}(k,\log d,1/\epsilon)$, where $\epsilon$ is the fraction of contamination. In particular, the fastest runtime of existing algorithms is quadratic ($\Omega(d^2)$), which can be prohibitive in high dimensions. This quadratic barrier in the runtime stems from the reliance of these algorithms on the sample covariance matrix, which is of size $d^2$. Our main contribution is an algorithm for robust sparse mean estimation which runs in \emph{subquadratic} time using $\mathrm{poly}(k,\log d,1/\epsilon)$ samples. We also provide analogous results for robust sparse PCA. Our results build on algorithmic advances in detecting weak correlations, a generalized version of the light-bulb problem by Valiant.


title: On the evaluations of multiple $S$ and $T$ values of the form $S(\overset{{}_{(-)}}{2}, 1, \ldots, 1, \overset{{}_{(-)}}{1})$ and $T(\overset{{}_{(-)}}{2}, 1, \ldots, 1, \overset{{}_{(-)}}{1})$

abstract: Xu, Yan and Zhao showed that in even weight, the multiple $T$ value $T(2, 1, \ldots, 1, \overline{1})$ is a polynomial in $\log(2)$, $\pi$, Riemann zeta values, and Dirichlet beta values. Based on low-weight examples, they conjectured that $\log(2)$ does not appear in the evaluation. We show that their conjecture is correct, and in fact follows largely from various earlier results of theirs. More precisely, we derive explicit formulae for $T(2, 1, \ldots, 1, \overline{1})$ in even weight and $S(2, 1, \ldots, 1, \overline{1})$ in odd weight via generating series calculations. We also resolve another conjecture of theirs on the evaluations of $T(\overline{2}, 1, \ldots, 1, \overline{1})$, $S(\overline{2}, 1, \ldots, 1, 1)$, and $S(\overline{2}, 1, \ldots, 1, \overline{1})$ in even weight, by way of calculations involving Goncharov's theory of iterated integrals and multiple polylogarithms.


title: Tight general bounds for the extremal numbers of 0-1 matrices

abstract: A zero-one matrix $M$ is said to contain another zero-one matrix $A$ if we can delete some rows and columns of $M$ and replace some $1$-entries with $0$-entries such that the resulting matrix is $A$. The extremal number of $A$, denoted $\operatorname{ex}(n,A)$, is the maximum number of $1$-entries that an $n\times n$ zero-one matrix can have without containing $A$. The systematic study of this function for various patterns $A$ goes back to the work of F\"uredi and Hajnal from 1992, and the field has many connections to other areas of mathematics and theoretical computer science. The problem has been particularly extensively studied for so-called acyclic matrices, but very little is known about the general case (that is, the case where $A$ is not necessarily acyclic). We prove the first asymptotically tight general result by showing that if $A$ has at most $t$ $1$-entries in every row, then $\operatorname{ex}(n,A)\leq n^{2-1/t+o(1)}$. This verifies a conjecture of Methuku and Tomon. Our result also provides the first tight general bound for the extremal number of vertex-ordered graphs with interval chromatic number $2$, generalizing a celebrated result of F\"uredi, and Alon, Krivelevich and Sudakov about the (unordered) extremal number of bipartite graphs with maximum degree $t$ in one of the vertex classes.


title: Stretchable Pneumatic Sleeve for Adaptable, Low-Displacement Anchoring in Exosuits

abstract: Despite recent advances in wearable technology, interfacing movement assistance devices with the human body remains challenging. We present a stretchable pneumatic sleeve that can anchor an exosuit actuator to the human arm with a low displacement of the actuator's mounting point relative to the body during operation. Our sleeve has the potential to serve as an adaptable attachment mechanism for exosuits, since it can adjust its pressure to only compress the arm as much as needed to transmit the applied exosuit forces without a large displacement. We discuss the design of our sleeve, which is made of fabric pneumatic artificial muscle (fPAM) actuators formed into bands. We quantify the performance of nine fPAM bands of various lengths and widths, as well as three sleeves (an fPAM sleeve, a series pouch motor (SPM) sleeve as in previous literature, and an off the shelf hook and loop sleeve), through the measurement of the compressing force as a function of pressure and the localized pulling force that can be resisted as a function of both pressure and mounting point displacement. Our experimental results show that fPAM bands with smaller resting length and/or larger resting width produce higher forces. Also, when inflated, an fPAM sleeve that has equivalent dimensions to the SPM sleeve while fully stretched has similar performance to the SPM sleeve. While inflated, both pneumatic sleeves decrease the mounting point displacement compared to the hook and loop sleeve. Compared to the SPM sleeve, the fPAM sleeve is able to hold larger internal pressure before bursting, increasing its possible force range. Also, when not inflated, the fPAM sleeve resists the pulling force well, indicating its ability to provide anchoring when not actuated.


title: Fast, robust and laser-free universal entangling gates for trapped-ion quantum computing

abstract: A novel two-qubit entangling gate for RF-controlled trapped-ion quantum processors is proposed theoretically and demonstrated experimentally. The speed of this gate is an order of magnitude higher than that of previously demonstrated two-qubit entangling gates in static magnetic field gradients. At the same time, the phase-modulated field driving the gate, dynamically decouples the qubits from amplitude and frequency noise, increasing the qubits' coherence time by two orders of magnitude. The gate requires only a single continuous RF field per qubit, making it well suited for scaling a quantum processor to large numbers of qubits. Implementing this entangling gate, we generate the Bell states $|\Phi^+\rangle$ and $|\Psi^+\rangle$ in $\leq 313$ $\mathrm{\mathrm{\mu}}$s with fidelities up to $98^{+2}_{-3}$ % in a static magnetic gradient of only 19.09 T/m. At higher magnetic field gradients, the entangling gate speed can be further improved to match that of laser-based counterparts.


title: Photonic probabilistic machine learning using quantum vacuum noise

abstract: Probabilistic machine learning utilizes controllable sources of randomness to encode uncertainty and enable statistical modeling. Harnessing the pure randomness of quantum vacuum noise, which stems from fluctuating electromagnetic fields, has shown promise for high speed and energy-efficient stochastic photonic elements. Nevertheless, photonic computing hardware which can control these stochastic elements to program probabilistic machine learning algorithms has been limited. Here, we implement a photonic probabilistic computer consisting of a controllable stochastic photonic element - a photonic probabilistic neuron (PPN). Our PPN is implemented in a bistable optical parametric oscillator (OPO) with vacuum-level injected bias fields. We then program a measurement-and-feedback loop for time-multiplexed PPNs with electronic processors (FPGA or GPU) to solve certain probabilistic machine learning tasks. We showcase probabilistic inference and image generation of MNIST-handwritten digits, which are representative examples of discriminative and generative models. In both implementations, quantum vacuum noise is used as a random seed to encode classification uncertainty or probabilistic generation of samples. In addition, we propose a path towards an all-optical probabilistic computing platform, with an estimated sampling rate of ~ 1 Gbps and energy consumption of ~ 5 fJ/MAC. Our work paves the way for scalable, ultrafast, and energy-efficient probabilistic machine learning hardware.


title: How Far Are We from Intelligent Visual Deductive Reasoning?

abstract: Vision-Language Models (VLMs) such as GPT-4V have recently demonstrated incredible strides on diverse vision language tasks. We dig into vision-based deductive reasoning, a more sophisticated but less explored realm, and find previously unexposed blindspots in the current SOTA VLMs. Specifically, we leverage Raven's Progressive Matrices (RPMs), to assess VLMs' abilities to perform multi-hop relational and deductive reasoning relying solely on visual clues. We perform comprehensive evaluations of several popular VLMs employing standard strategies such as in-context learning, self-consistency, and Chain-of-thoughts (CoT) on three diverse datasets, including the Mensa IQ test, IntelligenceTest, and RAVEN. The results reveal that despite the impressive capabilities of LLMs in text-based reasoning, we are still far from achieving comparable proficiency in visual deductive reasoning. We found that certain standard strategies that are effective when applied to LLMs do not seamlessly translate to the challenges presented by visual reasoning tasks. Moreover, a detailed analysis reveals that VLMs struggle to solve these tasks mainly because they are unable to perceive and comprehend multiple, confounding abstract patterns in RPM examples.


title: Enumerating stably trivial vector bundles with higher real $K$-theory

abstract: Given positive integers $r$ and $c$, let $\phi(r,c)$ denote the number of isomorphism classes of complex rank $r$ topological vector bundles on $\mathbb{CP}^{r+c}$ that are stably trivial. We compute the $p$-adic valuation of the number $\phi(r,c)$ for all pairs $r$ and $c$ such that $c \leq \operatorname{min}\{r,2p-3\}$. We also give some systematic lower bounds for $p$-divisibility of $\phi(r,c)$ when $c<2p^2-p-2$, and detect some nontrivial $p$-divisibility for larger $c$. As an additional application of our methods, we find new $p$-torsion in unstable homotopy groups of unitary groups.


title: Coherent multidimensional spectroscopy in polariton systems

abstract: The fast dynamics of molecular polaritonics is scrutinized theoretically through the implementation of two-dimensional spectroscopy protocols. We derive conceptually simple and computationally efficient formulas to calculate two-dimensional spectra for molecules, each of them modeled as a system of two electronic states including vibrational relaxation, immersed in an optical cavity, thus coupled to quantized radiation. Cavity photon losses and molecular relaxation are incorporated into the Hamiltonian dynamics to form an open quantum system that is solved through a master equation. In the collective case, the relaxation dynamics into dark states reveals to be the crucial factor to explain the asymmetries in both the diagonal and cross peaks of two-dimensional spectra for long waiting times between excitation and detection, a feature shown by recent experiments. Our theoretical method provides a deeper insight in those processes that yield relevant signals in multidimensional molecular spectroscopy.


title: SnapNTell: Enhancing Entity-Centric Visual Question Answering with Retrieval Augmented Multimodal LLM

abstract: Vision-extended LLMs have made significant strides in Visual Question Answering (VQA). Despite these advancements, VLLMs still encounter substantial difficulties in handling queries involving long-tail entities, with a tendency to produce erroneous or hallucinated responses. In this work, we introduce a novel evaluative benchmark named \textbf{SnapNTell}, specifically tailored for entity-centric VQA. This task aims to test the models' capabilities in identifying entities and providing detailed, entity-specific knowledge. We have developed the \textbf{SnapNTell Dataset}, distinct from traditional VQA datasets: (1) It encompasses a wide range of categorized entities, each represented by images and explicitly named in the answers; (2) It features QA pairs that require extensive knowledge for accurate responses. The dataset is organized into 22 major categories, containing 7,568 unique entities in total. For each entity, we curated 10 illustrative images and crafted 10 knowledge-intensive QA pairs. To address this novel task, we devised a scalable, efficient, and transparent retrieval-augmented multimodal LLM. Our approach markedly outperforms existing methods on the SnapNTell dataset, achieving a 66.5\% improvement in the BELURT score. We will soon make the dataset and the source code publicly accessible.


title: Benchmarking News Recommendation in the Era of Green AI

abstract: Over recent years, news recommender systems have gained significant attention in both academia and industry, emphasizing the need for a standardized benchmark to evaluate and compare the performance of these systems. Concurrently, Green AI advocates for reducing the energy consumption and environmental impact of machine learning. To address these concerns, we introduce the first Green AI benchmarking framework for news recommendation, known as GreenRec, and propose a metric for assessing the tradeoff between recommendation accuracy and efficiency. Our benchmark encompasses 30 base models and their variants, covering traditional end-to-end training paradigms as well as our proposed efficient only-encode-once (OLEO) paradigm. Through experiments consuming 2000 GPU hours, we observe that the OLEO paradigm achieves competitive accuracy compared to state-of-the-art end-to-end paradigms and delivers up to a 2992\% improvement in sustainability metrics.


title: Assessing the query complexity limits of quantum phase estimation using symmetry aware spectral bounds

abstract: The computational cost of quantum algorithms for physics and chemistry is closely linked to the spectrum of the Hamiltonian, a property that manifests in the necessary rescaling of its eigenvalues. The typical approach of using the 1-norm as an upper bound to the spectral norm to rescale the Hamiltonian suits the most general case of bounded Hermitian operators but neglects the influence of symmetries commonly found in chemical systems. In this work, we introduce a hierarchy of symmetry-aware spectral bounds that provide a unified understanding of the performance of quantum phase estimation algorithms using block-encoded electronic structure Hamiltonians. We present a variational and numerically tractable method for computing these bounds, based on orbital optimization, to demonstrate that the computed bounds are smaller than conventional spectral bounds for a variety of molecular benchmark systems. We also highlight the unique analytical and numerical scaling behavior of these bounds in the thermodynamic and complete basis set limits. Our work shows that there is room for improvement in reducing the 1-norm, not yet achieved through methods like double factorization and tensor hypercontraction, but highlights potential challenges in improving the performance of current quantum algorithms beyond small constant factors through 1-norm reduction techniques alone.


title: Control Theorems for Hilbert Modular Varieties

abstract: We prove an exact control theorem, in the sense of Hida theory, for the ordinary part of the middle degree \'etale cohomology of certain Hilbert modular varieties, after localizing at a suitable maximal ideal of the Hecke algebra. Our method of proof builds upon the techniques introduced by Loeffler-Rockwood-Zerbes; another important ingredient in our proof is the recent work of Caraiani-Tamiozzo on the vanishing of the \'etale cohomology of Hilbert modular varieties with torsion coefficients outside the middle degree. This work will be used in forthcoming work of the author to show that the Asai-Flach Euler system corresponding to a quadratic Hilbert modular form varies in Hida families.


title: I Can't Believe It's Not Scene Flow!

abstract: Current scene flow methods broadly fail to describe motion on small objects, and current scene flow evaluation protocols hide this failure by averaging over many points, with most drawn larger objects. To fix this evaluation failure, we propose a new evaluation protocol, Bucket Normalized EPE, which is class-aware and speed-normalized, enabling contextualized error comparisons between object types that move at vastly different speeds. To highlight current method failures, we propose a frustratingly simple supervised scene flow baseline, TrackFlow, built by bolting a high-quality pretrained detector (trained using many class rebalancing techniques) onto a simple tracker, that produces state-of-the-art performance on current standard evaluations and large improvements over prior art on our new evaluation. Our results make it clear that all scene flow evaluations must be class and speed aware, and supervised scene flow methods must address point class imbalances. We release the evaluation code publicly at https://github.com/kylevedder/BucketedSceneFlowEval.


title: Quantum One-Wayness of the Single-Round Sponge with Invertible Permutations

abstract: Sponge hashing is a novel class of cryptographic hash algorithms which underlies the current international hash function standard SHA-3. In a nutshell, a sponge function takes as input a bit-stream of any length and processes it via a simple iterative procedure: it repeatedly feeds each block of the input into a so-called block function, and then produces a short digest which consists of a subset of the final output bits. While much is known about the post-quantum security of the sponge construction in the case when the block function is modeled as a random function or permutation, the case of invertible permutations, which more accurately models the construction underlying SHA-3, has so far remained a fundamental open problem. In this work, we make new progress towards overcoming this barrier and show several results. First, we prove the "double-sided zero-search" conjecture proposed by Unruh (eprint' 2021) and show that finding zero-pairs in a random $2n$-bit permutation requires at least $\Omega(2^{n/2})$ many queries -- and this is tight due to Grover's algorithm. At the core of our proof lies a novel "symmetrization argument" which uses insights from the theory of Young subgroups. Second, we consider more general variants of the double-sided search problem and show similar query lower bounds for them. As an application, we prove the quantum one-wayness of the single-round sponge with invertible permutations in the quantum random oracle model.


title: Effects of mechanical stress, chemical potential, and coverage on hydrogen solubility during hydrogen enhanced decohesion of ferritic steel grain boundaries: A first-principles study

abstract: Hydrogen enhanced decohesion (HEDE) is one of the many mechanisms of hydrogen embrittlement, a phenomenon which severely impacts structural materials such as iron and iron alloys. Grain boundaries (GBs) play a critical role in this mechanism, where they can provide trapping sites or act as hydrogen diffusion pathways. The interaction of H with GBs and other crystallographic defects, and thus the solubility and distribution of H in the microstructure, depends on the concentration, chemical potential and local stress. Therefore, for a quantitative assessment of HEDE, a generalized solution energy in conjunction with the cohesive strength as a function of hydrogen coverage is needed. In this work, we carry out density functional theory calculations to investigate the influence of H on the decohesion of the $\Sigma$5(310)[001] and $\Sigma$3(112)[1$\bar{1}$0] symmetrical tilt GBs in bcc Fe, as examples for open and close-packed GB structures. A method to identify the segregation sites at the GB plane is proposed. The results indicate that at higher local concentrations, H leads to a significant reduction of the cohesive strength of the GB planes, significantly more pronounced at the $\Sigma$5 than at the $\Sigma$3 GB. Interestingly, at finite stress the $\Sigma$3 GB becomes more favorable for H solution, as opposed to the case of zero stress, where the $\Sigma$5 GB is more attractive. This suggests that under certain conditions stresses in the microstructure can lead to a re-distribution of H to the stronger grain boundary, which opens a new path to designing H-resistant microstructures. To round up our study, we investigate the effects of typical alloying elements in ferritic steel, C, V, Cr and Mn, on the solubility of H and the strength of the GBs.


title: Bayesian Inference of Time-Varying Origin-Destination Matrices from Boarding/Alighting Counts for Transit Services

abstract: Origin-destination (OD) demand matrices are crucial for transit agencies to design and operate transit systems. This paper presents a novel temporal Bayesian model designed to estimate transit OD matrices at the individual bus-journey level from boarding/alighting counts at bus stops. Our approach begins by modeling the number of alighting passengers at subsequent bus stops, given a boarding stop, through a multinomial distribution parameterized by alighting probabilities. Given the large scale of the problem, we generate alighting probabilities with a latent variable matrix and factorize it into a mapping matrix and a temporal matrix, thereby substantially reducing the number of parameters. To further encode a temporally-smooth structure in the parameters, we impose a Gaussian process prior on the columns of the temporal factor matrix. For model inference, we develop a two-stage algorithm with the Markov chain Monte Carlo (MCMC) method. In the first stage, latent OD matrices are sampled conditional on model parameters using a Metropolis-Hastings sampling algorithm with a Markov model-based proposal distribution. In the second stage, we sample model parameters conditional on latent OD matrices using slice and elliptical slice sampling algorithms. We assess the proposed model using real-world data collected from three bus routes with varying numbers of stops, and the results demonstrate that our model achieves accurate posterior mean estimation and outperforms the widely used iterative proportional fitting (IPF) method. Additionally, our model can provide uncertainty quantification for the OD demand matrices, thus benefiting many downstream planning/operational tasks that require robust decisions.


title: Speech Emotion Recognition Via CNN-Transformer and Multidimensional Attention Mechanism

abstract: Speech Emotion Recognition (SER) is crucial in human-machine interactions. Mainstream approaches utilize Convolutional Neural Networks or Recurrent Neural Networks to learn local energy feature representations of speech segments from speech information, but struggle with capturing global information such as the duration of energy in speech. Some use Transformers to capture global information, but there is room for improvement in terms of parameter count and performance. Furthermore, existing attention mechanisms focus on spatial or channel dimensions, hindering learning of important temporal information in speech. In this paper, to model local and global information at different levels of granularity in speech and capture temporal, spatial and channel dependencies in speech signals, we propose a Speech Emotion Recognition network based on CNN-Transformer and multi-dimensional attention mechanisms. Specifically, a stack of CNN blocks is dedicated to capturing local information in speech from a time-frequency perspective. In addition, a time-channel-space attention mechanism is used to enhance features across three dimensions. Moreover, we model local and global dependencies of feature sequences using large convolutional kernels with depthwise separable convolutions and lightweight Transformer modules. We evaluate the proposed method on IEMOCAP and Emo-DB datasets and show our approach significantly improves the performance over the state-of-the-art methods.


title: SQ Lower Bounds for Non-Gaussian Component Analysis with Weaker Assumptions

abstract: We study the complexity of Non-Gaussian Component Analysis (NGCA) in the Statistical Query (SQ) model. Prior work developed a general methodology to prove SQ lower bounds for this task that have been applicable to a wide range of contexts. In particular, it was known that for any univariate distribution $A$ satisfying certain conditions, distinguishing between a standard multivariate Gaussian and a distribution that behaves like $A$ in a random hidden direction and like a standard Gaussian in the orthogonal complement, is SQ-hard. The required conditions were that (1) $A$ matches many low-order moments with the standard univariate Gaussian, and (2) the chi-squared norm of $A$ with respect to the standard Gaussian is finite. While the moment-matching condition is necessary for hardness, the chi-squared condition was only required for technical reasons. In this work, we establish that the latter condition is indeed not necessary. In particular, we prove near-optimal SQ lower bounds for NGCA under the moment-matching condition only. Our result naturally generalizes to the setting of a hidden subspace. Leveraging our general SQ lower bound, we obtain near-optimal SQ lower bounds for a range of concrete estimation tasks where existing techniques provide sub-optimal or even vacuous guarantees.


title: A General Calibrated Regret Metric for Detecting and Mitigating Human-Robot Interaction Failures

abstract: Robot decision-making increasingly relies on expressive data-driven human prediction models when operating around people. While these models are known to suffer from prediction errors in out-of-distribution interactions, not all prediction errors equally impact downstream robot performance. We identify that the mathematical notion of regret precisely characterizes the degree to which incorrect predictions of future interaction outcomes degraded closed-loop robot performance. However, canonical regret measures can be poorly calibrated across diverse deployment interactions. We derive a calibrated regret metric that evaluates the quality of robot decisions in probability space rather than reward space. With this transformation, our metric removes the need for explicit reward functions to calculate the robot's regret, enables fairer comparison of interaction anomalies across disparate deployment contexts, and facilitates targeted dataset construction of "system-level" prediction failures. We experimentally quantify the value of this high-regret interaction data for aiding the robot in improving its downstream decision-making. In a suite of closed-loop autonomous driving simulations, we find that fine-tuning ego-conditioned behavior predictors exclusively on high-regret human-robot interaction data can improve the robot's overall re-deployment performance with significantly (77%) less data.


title: LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error

abstract: Tools are essential for large language models (LLMs) to acquire up-to-date information and take consequential actions in external environments. Existing work on tool-augmented LLMs primarily focuses on the broad coverage of tools and the flexibility of adding new tools. However, a critical aspect that has surprisingly been understudied is simply how accurately an LLM uses tools for which it has been trained. We find that existing LLMs, including GPT-4 and open-source LLMs specifically fine-tuned for tool use, only reach a correctness rate in the range of 30% to 60%, far from reliable use in practice. We propose a biologically inspired method for tool-augmented LLMs, simulated trial and error (STE), that orchestrates three key mechanisms for successful tool use behaviors in the biological system: trial and error, imagination, and memory. Specifically, STE leverages an LLM's 'imagination' to simulate plausible scenarios for using a tool, after which the LLM interacts with the tool to learn from its execution feedback. Both short-term and long-term memory are employed to improve the depth and breadth of the exploration, respectively. Comprehensive experiments on ToolBench show that STE substantially improves tool learning for LLMs under both in-context learning and fine-tuning settings, bringing a boost of 46.7% to Mistral-Instruct-7B and enabling it to outperform GPT-4. We also show effective continual learning of tools via a simple experience replay strategy.


title: GNN-VPA: A Variance-Preserving Aggregation Strategy for Graph Neural Networks

abstract: Graph neural networks (GNNs), and especially message-passing neural networks, excel in various domains such as physics, drug discovery, and molecular modeling. The expressivity of GNNs with respect to their ability to discriminate non-isomorphic graphs critically depends on the functions employed for message aggregation and graph-level readout. By applying signal propagation theory, we propose a variance-preserving aggregation function (VPA) that maintains expressivity, but yields improved forward and backward dynamics. Experiments demonstrate that VPA leads to increased predictive performance for popular GNN architectures as well as improved learning dynamics. Our results could pave the way towards normalizer-free or self-normalizing GNNs.


title: A Stabilizing NMPC Strategy for a Class of Nonholonomic Systems with Drift

abstract: In this paper, we present a stabilizing Nonlinear Model Predictive Control (NMPC) scheme tailored for a class of nonholonomic systems with drift, where the acceleration is laterally restrained. Examples include a mobile robot with drifting wheels on a planar surface or a spacecraft maneuvering in a vacuum. The novelty lies in the formulation of the terminal set, reachable from a significant distance from the equilibrium, and the terminal cost, represented as the integration of the stage cost. The proposed approach establishes essential steps for ensuring stability and feasibility guarantees. Simulation results substantiate the viability and effectiveness of the NMPC scheme.


title: Iyer-Wald ambiguities and gauge covariance of Entropy current in Higher derivative theories of gravity

abstract: In [arXiv:2105.06455, arXiv:2206.04538], the authors have been able to argue for an ultra-local version of the second law of black hole mechanics, for arbitrary diffeomorphism invariant theories of gravity non-minimally coupled to matter fields, by constructing an entropy current on the dynamical horizon with manifestly positive divergence. This has been achieved by working in the horizon-adapted coordinate system. In this work, we show that the local entropy production through the divergence of the entropy current is covariant under affine reparametrizations that leave the gauge of horizon-adapted coordinates invariant. We explicitly derive a formula for how the entropy current transforms under such coordinate transformations. This extends the analysis of [arXiv:2204.08447] for arbitrary diffeomorphism invariant theories of gravity non-minimally coupled to matter fields. We also study the Iyer-Wald ambiguities of the covariant phase formalism that generically plague the components of the entropy current.


title: JAX-SPH: A Differentiable Smoothed Particle Hydrodynamics Framework

abstract: Particle-based fluid simulations have emerged as a powerful tool for solving the Navier-Stokes equations, especially in cases that include intricate physics and free surfaces. The recent addition of machine learning methods to the toolbox for solving such problems is pushing the boundary of the quality vs. speed tradeoff of such numerical simulations. In this work, we lead the way to Lagrangian fluid simulators compatible with deep learning frameworks, and propose JAX-SPH - a Smoothed Particle Hydrodynamics (SPH) framework implemented in JAX. JAX-SPH builds on the code for dataset generation from the LagrangeBench project (Toshev et al., 2023) and extends this code in multiple ways: (a) integration of further key SPH algorithms, (b) restructuring the code toward a Python library, (c) verification of the gradients through the solver, and (d) demonstration of the utility of the gradients for solving inverse problems as well as a Solver-in-the-Loop application. Our code is available at https://github.com/tumaer/jax-sph.


title: Noise-mitigated randomized measurements and self-calibrating shadow estimation

abstract: Randomized measurements are increasingly appreciated as powerful tools to estimate properties of quantum systems, e.g., in the characterization of hybrid classical-quantum computation. On many platforms they constitute natively accessible measurements, serving as the building block of prominent schemes like shadow estimation. In the real world, however, the implementation of the random gates at the core of these schemes is susceptible to various sources of noise and imperfections, strongly limiting the applicability of protocols. To attenuate the impact of this shortcoming, in this work we introduce an error-mitigated method of randomized measurements, giving rise to a robust shadow estimation procedure. On the practical side, we show that error mitigation and shadow estimation can be carried out using the same session of quantum experiments, hence ensuring that we can address and mitigate the noise affecting the randomization measurements. Mathematically, we develop a picture derived from Fourier-transforms to connect randomized benchmarking and shadow estimation. We prove rigorous performance guarantees and show the functioning using comprehensive numerics. More conceptually, we demonstrate that, if properly used, easily accessible data from randomized benchmarking schemes already provide such valuable diagnostic information to inform about the noise dynamics and to assist in quantum learning procedures.