title: BATON: Aligning Text-to-Audio Model with Human Preference Feedback

abstract: With the development of AI-Generated Content (AIGC), text-to-audio models are gaining widespread attention. However, it is challenging for these models to generate audio aligned with human preference due to the inherent information density of natural language and limited model understanding ability. To alleviate this issue, we formulate the BATON, a framework designed to enhance the alignment between generated audio and text prompt using human preference feedback. Our BATON comprises three key stages: Firstly, we curated a dataset containing both prompts and the corresponding generated audio, which was then annotated based on human feedback. Secondly, we introduced a reward model using the constructed dataset, which can mimic human preference by assigning rewards to input text-audio pairs. Finally, we employed the reward model to fine-tune an off-the-shelf text-to-audio model. The experiment results demonstrate that our BATON can significantly improve the generation quality of the original text-to-audio models, concerning audio integrity, temporal relationship, and alignment with human preference.


title: Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement

abstract: An increasing amount of research in Natural Language Inference (NLI) focuses on the application and evaluation of Large Language Models (LLMs) and their reasoning capabilities. Despite their success, however, LLMs are still prone to factual errors and inconsistencies in their explanations, offering limited control and interpretability for inference in complex domains. In this paper, we focus on ethical NLI, investigating how hybrid neuro-symbolic techniques can enhance the logical validity and alignment of ethical explanations produced by LLMs. Specifically, we present an abductive-deductive framework named Logic-Explainer, which integrates LLMs with an external backward-chaining solver to refine step-wise natural language explanations and jointly verify their correctness, reduce incompleteness and minimise redundancy. An extensive empirical analysis demonstrates that Logic-Explainer can improve explanations generated via in-context learning methods and Chain-of-Thought (CoT) on challenging ethical NLI tasks, while, at the same time, producing formal proofs describing and supporting models' reasoning. As ethical NLI requires commonsense reasoning to identify underlying moral violations, our results suggest the effectiveness of neuro-symbolic methods for multi-step NLI more broadly, opening new opportunities to enhance the logical consistency, reliability, and alignment of LLMs.


title: Health-LLM: Personalized Retrieval-Augmented Disease Prediction System

abstract: Recent advancements in artificial intelligence (AI), especially large language models (LLMs), have significantly advanced healthcare applications and demonstrated potentials in intelligent medical treatment. However, there are conspicuous challenges such as vast data volumes and inconsistent symptom characterization standards, preventing full integration of healthcare AI systems with individual patients' needs. To promote professional and personalized healthcare, we propose an innovative framework, Heath-LLM, which combines large-scale feature extraction and medical knowledge trade-off scoring. Compared to traditional health management applications, our system has three main advantages: (1) It integrates health reports and medical knowledge into a large model to ask relevant questions to large language model for disease prediction; (2) It leverages a retrieval augmented generation (RAG) mechanism to enhance feature extraction; (3) It incorporates a semi-automated feature updating framework that can merge and delete features to improve accuracy of disease prediction. We experiment on a large number of health reports to assess the effectiveness of Health-LLM system. The results indicate that the proposed system surpasses the existing ones and has the potential to significantly advance disease prediction and personalized health management. The code is available at https://github.com/jmyissb/HealthLLM.


title: Mott resistive switching initiated by topological defects

abstract: Resistive switching is the fundamental process that triggers the sudden change of the electrical properties in solid-state devices under the action of intense electric fields. Despite its relevance for information processing, ultrafast electronics, neuromorphic devices, resistive memories and brain-inspired computation, the nature of the local stochastic fluctuations that drive the formation of metallic nuclei out of the insulating state has remained hidden. Here, using operando X-ray nano-imaging, we have captured the early-stages of resistive switching in a V2O3-based device under working conditions. V2O3 is a paradigmatic Mott material, which undergoes a first-order metal-to-insulator transition coupled to a lattice transformation that breaks the threefold rotational symmetry of the rhombohedral metal phase. We reveal a new class of volatile electronic switching triggered by nanoscale topological defects of the lattice order parameter of the insulating phase. Our results pave the way to the use of strain engineering approaches to manipulate topological defects and achieve the full control of the electronic Mott switching. The concept of topology-driven reversible electronic transition is of interest for a broad class of quantum materials, comprising transition metal oxides, chalcogenides and kagome metals, that exhibit first-order electronic transitions coupled to a symmetry-breaking order.


title: Small gaps between almost-twin primes

abstract: Let $m \in \mathbb{N}$ be large. We show that there exist infinitely many primes $q_{1}< \cdot\cdot\cdot < q_{m+1}$ such that \[ q_{m+1}-q_{1}=O(e^{7.63m}) \] and $q_{j}+2$ has at most \[ \frac{7.36m}{\log 2} + \frac{4\log m}{\log 2} + 21 \] prime factors for each $1 \leq j \leq m+1$. This improves the previous result of Li and Pan, replacing $e^{7.63m}$ by $m^{4}e^{8m}$ and $\frac{7.36m}{\log 2} + \frac{4\log m}{\log 2} + 21$ by $\frac{16m}{\log 2} + \frac{5\log m}{\log 2} + 37$. The main inputs are the Maynard-Tao sieve, a minorant for the indicator function of the primes constructed by Baker and Irving, for which a stronger equidistribution theorem in arithmatic progressions to smooth moduli is applicable, and Tao's approach previously used to estimate $\sum_{x \leq n < 2x} \mathbf{1}_{\mathbb{P}}(n)\mathbf{1}_{\mathbb{P}}(n+12)\omega_{n}$, where $\mathbf{1}_{\mathbb{P}}$ stands for the characteristic function of the primes and $\omega_{n}$ are multidimensional sieve weights.


title: Comment on: Was Ada Lovelace Actually the First Programmer?

abstract: Comment on Herbert Bruderer's recent CACM contribution, providing additional citations to recent publications on Ada Lovelace and suggesting a correction to his conclusions.


title: A System Level Analysis for Integrated Sensing and Communication

abstract: In this work, we provide a system level analysis of integrated sensing and communication (ISAC) systems, where a setup with a mono-static dual-functional radar communication base station is assumed. We derive the ISAC signal-to-noise ratio (SNR) equation that relates communication and radar SNR for different distances. We also derive the ISAC range equation, which can be used for sensing-assisted beamforming applications. Specifically, we show that increasing the frequency and bandwidth is more favorable to the radar application in terms of relative SNR and range while increasing the transmit power is more favorable to communications. Numerical examples reveal that if the range for communication and radar is desired to be in the same order, the ISAC system should operate in mmWave or sub-THz bands, whereas sub-6GHz allows scenarios where the communication range is of orders of magnitude higher than that of radar.


title: Unlearnable Algorithms for In-context Learning

abstract: Machine unlearning is a desirable operation as models get increasingly deployed on data with unknown provenance. However, achieving exact unlearning -- obtaining a model that matches the model distribution when the data to be forgotten was never used -- is challenging or inefficient, often requiring significant retraining. In this paper, we focus on efficient unlearning methods for the task adaptation phase of a pretrained large language model (LLM). We observe that an LLM's ability to do in-context learning for task adaptation allows for efficient exact unlearning of task adaptation training data. We provide an algorithm for selecting few-shot training examples to prepend to the prompt given to an LLM (for task adaptation), ERASE, whose unlearning operation cost is independent of model and dataset size, meaning it scales to large models and datasets. We additionally compare our approach to fine-tuning approaches and discuss the trade-offs between the two approaches. This leads us to propose a new holistic measure of unlearning cost which accounts for varying inference costs, and conclude that in-context learning can often be more favourable than fine-tuning for deployments involving unlearning requests.


title: On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategy

abstract: 3D Gaussian Splatting has garnered extensive attention and application in real-time neural rendering. Concurrently, concerns have been raised about the limitations of this technology in aspects such as point cloud storage, performance, and robustness in sparse viewpoints, leading to various improvements. However, there has been a notable lack of attention to the fundamental problem of projection errors introduced by the local affine approximation inherent in the splatting itself, and the consequential impact of these errors on the quality of photo-realistic rendering. This paper addresses the projection error function of 3D Gaussian Splatting, commencing with the residual error from the first-order Taylor expansion of the projection function. The analysis establishes a correlation between the error and the Gaussian mean position. Subsequently, leveraging function optimization theory, this paper analyzes the function's minima to provide an optimal projection strategy for Gaussian Splatting referred to Optimal Gaussian Splatting, which can accommodate a variety of camera models. Experimental validation further confirms that this projection methodology reduces artifacts, resulting in a more convincingly realistic rendering.


title: Moving curves of least gonality on symmetric products of curves

abstract: This paper is a sequel of arXiv:2208.00990. Let $C$ be a smooth complex projective curve of genus $g$ and let $C^{(k)}$ be its $k$-fold symmetric product. The covering gonality of $C^{(k)}$ is the least gonality of an irreducible curve $E\subset C^{(k)}$ passing through a general point of $C^{(k)}$. It follows from previous works of the authors that if $2\leq k\leq 4$ and $g\geq k+4$, the covering gonality of $C^{(k)}$ equals the gonality of $C$. In this paper, we prove that under mild assumptions of generality on $C$, the only curves $E\subset C^{(k)}$ computing the covering gonality of $C^{(k)}$ are copies of $C$ of the form $C+p$, for some point $p\in C^{(k-1)}$. As a byproduct, we deduce that the connecting gonality of $C^{(k)}$ (i.e. the least gonality of an irreducible curve $E\subset C^{(k)}$ connecting two general points of $C^{(k)}$) is strictly larger than the covering gonality.


title: To tweak or not to tweak. How exploiting flexibilities in gene set analysis leads to over-optimism

abstract: Gene set analysis, a popular approach for analysing high-throughput gene expression data, aims to identify sets of genes that show enriched expression patterns between two conditions. In addition to the multitude of methods available for this task, users are typically left with many options when creating the required input and specifying the internal parameters of the chosen method. This flexibility can lead to uncertainty about the 'right' choice, further reinforced by a lack of evidence-based guidance. Especially when their statistical experience is scarce, this uncertainty might entice users to produce preferable results using a 'trial-and-error' approach. While it may seem unproblematic at first glance, this practice can be viewed as a form of 'cherry-picking' and cause an optimistic bias, rendering the results non-replicable on independent data. After this problem has attracted a lot of attention in the context of classical hypothesis testing, we now aim to raise awareness of such over-optimism in the different and more complex context of gene set analyses. We mimic a hypothetical researcher who systematically selects the analysis variants yielding their preferred results, thereby considering three distinct goals they might pursue. Using a selection of popular gene set analysis methods, we tweak the results in this way for two frequently used benchmark gene expression data sets. Our study indicates that the potential for over-optimism is particularly high for a group of methods frequently used despite being commonly criticised. We conclude by providing practical recommendations to counter over-optimism in research findings in gene set analysis and beyond.


title: $V_{lowk}$ Renormalization Group Flow, Vector Manifestation and Sound Velocity in Massive Compact Stars

abstract: The $V_{lowk}$-renormalization group approach on the surface of Fermi liquid for nuclear matter to which Tom Kuo made a pioneering contribution at Stony Brook is found to inject the pivotal input in the formulation of the generalized nuclear effective field theory with acronym ``G$n$EFT" applicable to superdense compact-star physics. A topology change in terms of skyrmions and half-skyrmions is shown to play the role of the ``putative" hadron-quark continuity (HQC)" conjectured in QCD. Crucially involved are hidden local symmetry (``HLS") and hidden scale symmetry (``HSS") with the vacuum sliding with density in nuclear medium, with the nuclear tensor force emerging as a Landau Fermi-liquid fixed-point quantity. A possibly novel paradigm, a ``Cheshire Catism," in nuclear correlations is suggested.


title: The Sonora Substellar Atmosphere Models. IV. Elf Owl: Atmospheric Mixing and Chemical Disequilibrium with Varying Metallicity and C/O Ratios

abstract: Disequilibrium chemistry due to vertical mixing in the atmospheres of many brown dwarfs and giant exoplanets is well-established. Atmosphere models for these objects typically parameterize mixing with the highly uncertain $K_{\rm zz}$ diffusion parameter. The role of mixing in altering the abundances of C-N-O-bearing molecules has mostly been explored for solar composition atmospheres. However, atmospheric metallicity and the C/O ratio also impact atmospheric chemistry. Therefore, we present the \texttt{Sonora Elf Owl} grid of self-consistent cloud-free 1D radiative-convective equilibrium model atmospheres for JWST observations, which includes a variation of $K_{\rm zz}$ across several orders of magnitude and also encompasses sub-solar to super-solar metallicities and C/O ratios. We find that the impact of $K_{\rm zz}$ on the $T(P)$ profile and spectra is a strong function of both $T_{\rm eff}$ and metallicity. For metal-poor objects $K_{\rm zz}$ has large impacts on the atmosphere at significantly higher $T_{\rm eff}$ compared to metal-rich atmospheres where the impact of $K_{\rm zz}$ is seen to occur at lower $T_{\rm eff}$. We identify significant spectral degeneracies between varying $K_{\rm zz}$ and metallicity in multiple wavelength windows, in particular at 3-5 $\mu$m. We use the \texttt{Sonora Elf Owl} atmospheric grid to fit the observed spectra of a sample of 9 early to late T- type objects from $T_{\rm eff}=550-1150$ K. We find evidence for very inefficient vertical mixing in these objects with inferred $K_{\rm zz}$ values lying in the range between $\sim$ 10$^1$-10$^4$ cm$^2$s$^{-1}$. Using self-consistent models, we find that this slow vertical mixing is due to the observations probing mixing in the deep detached radiative zone in these atmospheres.


title: Relative Lie algebra cohomology of SU(2,1) and Eisenstein classes on Picard surfaces

abstract: We consider Picard surfaces, locally symmetric varieties $S_{\Gamma}$ attached to the Lie group SU(2,1), and we construct explicit differential forms on $S_{\Gamma}$ representing Eisenstein classes, i.e. cohomology classes restricting non-trivially to the boundary of the Borel-Serre compactification. This is needed for the computation of the class of the extensions of the Hodge structure that we have constructed in [2] according to the predictions of the Bloch-Beilinson conjectures. The tool for the construction of the differential forms is an analysis of relative Lie algebra cohomology of the principal series of SU(2,1) using recent methods of Buttcane and Miller.


title: The Sonora Substellar Atmosphere Models. III. Diamondback: Atmospheric Properties, Spectra, and Evolution for Warm Cloudy Substellar Objects

abstract: We present a new grid of cloudy atmosphere and evolution models for substellar objects. These models include the effect of refractory cloud species, including silicate clouds, on the spectra and evolution. We include effective temperatures from 900 to 2400 K and surface gravities from log g=3.5-5.5, appropriate for a broad range of objects with masses between 1 and 84 Jupiter masses. Model pressure-temperature structures are calculated assuming radiative-convective and chemical equilibrium. We consider the effect of both clouds and metallicity on the atmospheric structure, resulting spectra, and thermal evolution of substellar worlds. We parameterize clouds using the Ackerman & Marley (2001) cloud model, including cloud parameter fsed values from 1-8; we include three metallicities (-0.5, 0.0, and +0.5). Refractory clouds and metallicity both alter the evolution of substellar objects, changing the inferred temperature at a given age by up to 100-200 K. We compare to the observed photometry of brown dwarfs, finding broad agreement with the measured photometry. We publish the spectra, evolution, and other data products online with open access.


title: Building Expressive and Tractable Probabilistic Generative Models: A Review

abstract: We present a comprehensive survey of the advancements and techniques in the field of tractable probabilistic generative modeling, primarily focusing on Probabilistic Circuits (PCs). We provide a unified perspective on the inherent trade-offs between expressivity and tractability, highlighting the design principles and algorithmic extensions that have enabled building expressive and efficient PCs, and provide a taxonomy of the field. We also discuss recent efforts to build deep and hybrid PCs by fusing notions from deep neural models, and outline the challenges and open questions that can guide future research in this evolving field.


title: EuroPED-NN: Uncertainty aware surrogate model

abstract: This work successfully generates uncertainty aware surrogate models, via the Bayesian neural network with noise contrastive prior (BNN-NCP) technique, of the EuroPED plasma pedestal model using data from the JET-ILW pedestal database and subsequent model evaluations. All this conform EuroPED-NN. The BNN-NCP technique is proven to be a good fit for uncertainty aware surrogate models, matching the output results as a regular neural network, providing prediction's confidence as uncertainties, and highlighting the out of distribution (OOD) regions using surrogate model uncertainties. This provides critical insights into model robustness and reliability. EuroPED-NN has been physically validated, first, analyzing electron density $n_e\!\left(\psi_{\text{pol}}=0.94\right)$ with respect to increasing plasma current, $I_p$, and second, validating the $\Delta-\beta_{p,ped}$ relation associated with the EuroPED model. Affirming the robustness of the underlying physics learned by the surrogate model.


title: Control-Theoretic Techniques for Online Adaptation of Deep Neural Networks in Dynamical Systems

abstract: Deep neural networks (DNNs), trained with gradient-based optimization and backpropagation, are currently the primary tool in modern artificial intelligence, machine learning, and data science. In many applications, DNNs are trained offline, through supervised learning or reinforcement learning, and deployed online for inference. However, training DNNs with standard backpropagation and gradient-based optimization gives no intrinsic performance guarantees or bounds on the DNN, which is essential for applications such as controls. Additionally, many offline-training and online-inference problems, such as sim2real transfer of reinforcement learning policies, experience domain shift from the training distribution to the real-world distribution. To address these stability and transfer learning issues, we propose using techniques from control theory to update DNN parameters online. We formulate the fully-connected feedforward DNN as a continuous-time dynamical system, and we propose novel last-layer update laws that guarantee desirable error convergence under various conditions on the time derivative of the DNN input vector. We further show that training the DNN under spectral normalization controls the upper bound of the error trajectories of the online DNN predictions, which is desirable when numerically differentiated quantities or noisy state measurements are input to the DNN. The proposed online DNN adaptation laws are validated in simulation to learn the dynamics of the Van der Pol system under domain shift, where parameters are varied in inference from the training dataset. The simulations demonstrate the effectiveness of using control-theoretic techniques to derive performance improvements and guarantees in DNN-based learning systems.


title: Hypergeometric systems from groups with torsion

abstract: We consider $A$-hypergeometric (or GKZ-)systems in the case where the grading (character) group is an arbitrary finitely generated Abelian group. Emulating the approach taken for classical GKZ-systems in arXiv:math/0406383 that allows for a coefficient module, we show that these $D$-modules are holonomic systems. For this purpose we formulate an Euler--Koszul complex in this context, built on an extension of the category of $A$-toric modules. We derive that these new systems are regular holonomic under circumstances that are similar to those that lead to regular holonomic classical GKZ-systems. For the appropriate coefficient module, our $D$-modules specialize to the "better behaved GKZ-systems" introduced by Borisov and Horja. We certify the corresponding $D$-modules as regular holonomic, and establish a holonomic duality on the level of $D$-modules that was suggested on the level of solutions by Borisov and Horja and later shown by Borisov and Han in a special situation (arXiv:1308.2238, arXiv:2301.01374).


title: 360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roaming

abstract: 3D Gaussian Splatting (3D-GS) has recently attracted great attention with real-time and photo-realistic renderings. This technique typically takes perspective images as input and optimizes a set of 3D elliptical Gaussians by splatting them onto the image planes, resulting in 2D Gaussians. However, applying 3D-GS to panoramic inputs presents challenges in effectively modeling the projection onto the spherical surface of ${360^\circ}$ images using 2D Gaussians. In practical applications, input panoramas are often sparse, leading to unreliable initialization of 3D Gaussians and subsequent degradation of 3D-GS quality. In addition, due to the under-constrained geometry of texture-less planes (e.g., walls and floors), 3D-GS struggles to model these flat regions with elliptical Gaussians, resulting in significant floaters in novel views. To address these issues, we propose 360-GS, a novel $360^{\circ}$ Gaussian splatting for a limited set of panoramic inputs. Instead of splatting 3D Gaussians directly onto the spherical surface, 360-GS projects them onto the tangent plane of the unit sphere and then maps them to the spherical projections. This adaptation enables the representation of the projection using Gaussians. We guide the optimization of 360-GS by exploiting layout priors within panoramas, which are simple to obtain and contain strong structural information about the indoor scene. Our experimental results demonstrate that 360-GS allows panoramic rendering and outperforms state-of-the-art methods with fewer artifacts in novel view synthesis, thus providing immersive roaming in indoor scenarios.


title: To Search or To Gen? Exploring the Synergy between Generative AI and Web Search in Programming

abstract: The convergence of generative AI and web search is reshaping problem-solving for programmers. However, the lack of understanding regarding their interplay in the information-seeking process often leads programmers to perceive them as alternatives rather than complementary tools. To analyze this interaction and explore their synergy, we conducted an interview study with eight experienced programmers. Drawing from the results and literature, we have identified three major challenges and proposed three decision-making stages, each with its own relevant factors. Additionally, we present a comprehensive process model that captures programmers' interaction patterns. This model encompasses decision-making stages, the information-foraging loop, and cognitive activities during system interaction, offering a holistic framework to comprehend and optimize the use of these convergent tools in programming.


title: On the global in time existence and uniqueness of solutions to the Boltzmann hierarchy

abstract: In this paper we establish the global in time existence and uniqueness of solutions to the Boltzmann hierarchy, a hierarchy of equations instrumental for the rigorous derivation of the Boltzmann equation from many particles. Inspired by available $L^{\infty}$-based a-priori estimate for solutions to the Boltzmann equation, we develop the polynomially weighted $L^\infty$ a-priori bounds for solutions to the Boltzmann hierarchy and handle the factorial growth of the number of terms in the Dyson's series by reorganizing the sum through a combinatorial technique known as the Klainerman-Machedon board game argument. This paper is the first work that exploits such a combinatorial technique in conjunction with an $L^{\infty}$-based estimate to prove uniqueness of the mild solutions to the Boltzmann hierarchy. Our proof of existence of global in time mild solutions to the Boltzmann hierarchy for admissible initial data is constructive and it employs known global in time solutions to the Boltzmann equation via a Hewitt-Savage type theorem.


title: Benchmarking Multipartite Entanglement Generation with Graph States

abstract: As quantum computing technology slowly matures and the number of available qubits on a QPU gradually increases, interest in assessing the capabilities of quantum computing hardware in a scalable manner is growing. One of the key properties for quantum computing is the ability to generate multipartite entangled states. In this paper, aspects of benchmarking entanglement generation capabilities of noisy intermediate-scale quantum (NISQ) devices are discussed based on the preparation of graph states and the verification of entanglement in the prepared states. Thereby, we use entanglement witnesses that are specifically suited for a scalable experiment design. This choice of entanglement witnesses can detect A) bipartite entanglement and B) genuine multipartite entanglement for graph states with constant two measurement settings if the prepared graph state is based on a 2-colorable graph, e.g., a square grid graph or one of its subgraphs. With this, we experimentally verify that a fully bipartite entangled state can be prepared on a 127-qubit IBM Quantum superconducting QPU, and genuine multipartite entanglement can be detected for states of up to 23 qubits with quantum readout error mitigation.


title: Loop soup representation of zeta-regularised determinants and equivariant Symanzik identities

abstract: We derive a stochastic representation for determinants of Laplace-type operators on vectors bundles over manifolds. Namely, inverse powers of those determinants are written as the expectation of a product of holonomies defined over Brownian loop soups. Our results hold over compact manifolds of dimension 2 or 3, in the presence of mass or a boundary. We derive a few consequences, including some regularity as a function of the operator and the conformal invariance of the zeta function on surfaces. Our second main result is the rigorous construction of a stochastic gauge theory minimally coupling a scalar field to a prescribed random smooth gauge field, which we prove obeys the so-called Symanzik identities. Some of these results are continuous analogues of the work of A. Kassel and T. L\'evy in the discrete.


title: Multiple q-Kravchuk polynomials

abstract: We study a family of type II multiple orthogonal polynomials. We consider orthogonality conditions with respect to a vector measure, in which each component is a q-analogue of the binomial distribution. The lowering and raising operators as well as the Rodrigues formula for these polynomials are obtained. The difference equation of order r+1 is studied. The connection via limit relation between four types of Kravchuk polynomials is discussed.


title: AnimateLCM: Accelerating the Animation of Personalized Diffusion Models and Adapters with Decoupled Consistency Learning

abstract: Video diffusion models has been gaining increasing attention for its ability to produce videos that are both coherent and of high fidelity. However, the iterative denoising process makes it computationally intensive and time-consuming, thus limiting its applications. Inspired by the Consistency Model (CM) that distills pretrained image diffusion models to accelerate the sampling with minimal steps and its successful extension Latent Consistency Model (LCM) on conditional image generation, we propose AnimateLCM, allowing for high-fidelity video generation within minimal steps. Instead of directly conducting consistency learning on the raw video dataset, we propose a decoupled consistency learning strategy that decouples the distillation of image generation priors and motion generation priors, which improves the training efficiency and enhance the generation visual quality. Additionally, to enable the combination of plug-and-play adapters in stable diffusion community to achieve various functions (e.g., ControlNet for controllable generation). we propose an efficient strategy to adapt existing adapters to our distilled text-conditioned video consistency model or train adapters from scratch without harming the sampling speed. We validate the proposed strategy in image-conditioned video generation and layout-conditioned video generation, all achieving top-performing results. Experimental results validate the effectiveness of our proposed method. Code and weights will be made public. More details are available at https://github.com/G-U-N/AnimateLCM.


title: Lightcone expansion beyond leading power

abstract: We discuss recent developments in descriptions of processes using power expansion around the lightcone within Soft-Collinear Effective Theory. First, we present an overview of the systematically improvable framework that enables factorization of high-energy scattering processes beyond leading power in the expansion in ratios of energy scales. As an illustration of the relevant concepts, we describe the recently derived factorization theorem for the off-diagonal channel of the Drell-Yan production process at threshold. This example exposes endpoint divergences appearing in convolution integrals in factorization formulas. Lastly, we discuss the solution to these complications developed in the context of ''gluon thrust'' in $e^+e^-$ collisions.


title: Mixed Static and Reconfigurable Metasurface Deployment in Indoor Dense Spaces: How Much Reconfigurability is Needed?

abstract: In this paper, we investigate how metasurfaces can be deployed to deliver high data rates in a millimeter-wave (mmWave) indoor dense space with many blocking objects. These surfaces can either be static metasurfaces (SMSs) that reflect with fixed phase-shifts or reconfigurable intelligent surfaces (RISs) that can reconfigure their phase-shifts to the currently served user. The latter comes with an increased power, cabling, and signaling cost. To see how reconfigurability affects the network performance, we propose an iterative algorithm based on the feasible point pursuit successive convex approximation method. We jointly optimize the types and phase-shifts of the surfaces and the time portion allocated to each user equipment to maximize the minimum data rate achieved by the network. Our numerical results demonstrate that the minimum data rate improves as more RISs are introduced but the gain diminishes after some point. Therefore, introducing more reconfigurability is not always necessary. Another result shows that to reach the same data rate achieved by using 22 SMSs, at least 18 RISs are needed. This suggests that when it is costly to deploy many RISs, as an inexpensive alternative solution, one can reach the same data rate just by densely deploying more SMSs.


title: Neural Risk Limiting Dispatch in Power Networks: Formulation and Generalization Guarantees

abstract: Risk limiting dispatch (RLD) has been proposed as an approach that effectively trades off economic costs with operational risks for power dispatch under uncertainty. However, how to solve the RLD problem with provably near-optimal performance still remains an open problem. This paper presents a learning-based solution to this challenge. We first design a data-driven formulation for the RLD problem, which aims to construct a decision rule that directly maps day-ahead observable information to cost-effective dispatch decisions for the future delivery interval. Unlike most existing works that follow a predict-then-optimize paradigm, this end-to-end rule bypasses the additional suboptimality introduced by separately handling prediction and optimization. We then propose neural RLD, a novel solution method to the data-driven formulation. This method leverages an L2-regularized neural network to learn the decision rule, thereby transforming the data-driven formulation into a neural network training task that can be efficiently completed by stochastic gradient descent. A theoretical performance guarantee is further established to bound the suboptimality of our method, which implies that its suboptimality approaches to zero with high probability as more samples are utilized. Simulation tests across various systems demonstrate our method's superior performance in convergence, suboptimality, and computational efficiency compared with benchmarks.


title: On the Choice of Loss Function in Learning-based Optimal Power Flow

abstract: We analyze and contrast two ways to train machine learning models for solving AC optimal power flow (OPF) problems, distinguished with the loss functions used. The first trains a mapping from the loads to the optimal dispatch decisions, utilizing mean square error (MSE) between predicted and optimal dispatch decisions as the loss function. The other intends to learn the same mapping, but directly uses the OPF cost of the predicted decisions, referred to as decision loss, as the loss function. In addition to better aligning with the OPF cost which results in reduced suboptimality, the use of decision loss can circumvent feasibility issues that arise with MSE when the underlying mapping from loads to optimal dispatch is discontinuous. Since decision loss does not capture the OPF constraints, we further develop a neural network with a specific structure and introduce a modified training algorithm incorporating Lagrangian duality to improve feasibility.} This result in an improved performance measured by feasibility and suboptimality as demonstrated with an IEEE 39-bus case study.


title: Mesh motion in fluid-structure interaction with deep operator networks

abstract: A mesh motion model based on deep operator networks is presented. The model is trained on and evaluated against a biharmonic mesh motion model on a fluid-structure interaction benchmark problem and further evaluated in a setting where biharmonic mesh motion fails. The performance of the proposed mesh motion model is comparable to the biharmonic mesh motion on the test problems.


title: Adaptive Control for Triadic Human-Robot-FES Collaboration in Gait Rehabilitation: A Pilot Study

abstract: The hybridisation of robot-assisted gait training and functional electrical stimulation (FES) can provide numerous physiological benefits to neurological patients. However, the design of an effective hybrid controller poses significant challenges. In this over-actuated system, it is extremely difficult to find the right balance between robotic assistance and FES that will provide personalised assistance, prevent muscle fatigue and encourage the patient's active participation in order to accelerate recovery. In this paper, we present an adaptive hybrid robot-FES controller to do this and enable the triadic collaboration between the patient, the robot and FES. A patient-driven controller is designed where the voluntary movement of the patient is prioritised and assistance is provided using FES and the robot in a hierarchical order depending on the patient's performance and their muscles' fitness. The performance of this hybrid adaptive controller is tested in simulation and on one healthy subject. Our results indicate an increase in tracking performance with lower overall assistance, and less muscle fatigue when the hybrid adaptive controller is used, compared to its non adaptive equivalent. This suggests that our hybrid adaptive controller may be able to adapt to the behaviour of the user to provide assistance as needed and prevent the early termination of physical therapy due to muscle fatigue.


title: Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics

abstract: Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the amount and complexity of the data increases. Quantum-based vision transformer models could potentially alleviate this issue by reducing the training and operating time while maintaining the same predictive power. Although current quantum computers are not yet able to perform high-dimensional tasks yet, they do offer one of the most efficient solutions for the future. In this work, we construct several variations of a quantum hybrid vision transformer for a classification problem in high energy physics (distinguishing photons and electrons in the electromagnetic calorimeter). We test them against classical vision transformer architectures. Our findings indicate that the hybrid models can achieve comparable performance to their classical analogues with a similar number of parameters.


title: Field direction dependence of the electrocaloric effect in single crystal BaTiO$_3$

abstract: Single crystalline ferroelectric perovskites show a large electrocaloric effect (ECE) at field-induced phase transitions, raising attention to solid-state cooling technology. However, paraelectric-ferroelectric transition temperatures are often too high for practical applications and lower transitions are so far underrepresented in literature. Particularly, the role of thermal hysteresis and field direction on the responses is critical, but not yet fully understood. Using ab initio based coarse-grained molecular dynamics, we show that the polarization changes at zero fields are good descriptors for the field direction dependence of transition temperatures both for BaTiO$_3$ and PbTiO$_3$ even though both materials show different microscopic field coupling. Furthermore, we reveal that the choice of field direction can reduce irreversibilities related to thermal hysteresis and can adjust the temperature windows of large caloric responses. Based on our results we identify favorable temperature- and texturing conditions for polycrystals.


title: Robust Sufficient Dimension Reduction via $\alpha$-Distance Covariance

abstract: We introduce a novel sufficient dimension-reduction (SDR) method which is robust against outliers using $\alpha$-distance covariance (dCov) in dimension-reduction problems. Under very mild conditions on the predictors, the central subspace is effectively estimated and model-free advantage without estimating link function based on the projection on the Stiefel manifold. We establish the convergence property of the proposed estimation under some regularity conditions. We compare the performance of our method with existing SDR methods by simulation and real data analysis and show that our algorithm improves the computational efficiency and effectiveness.


title: Effect of radius ratio on the sheared annular centrifugal turbulent convection

abstract: We perform the linear stability analysis and direct numerical simulations to study the effect of radius ratio on the instability and flow characteristics of the sheared annular centrifugal Rayleigh-B\'enard convection (ACRBC), where the cold inner cylinder and the hot outer cylinder rotate with a small angular velocity difference. With the shear enhancement, the thermal convection is suppressed and finally gets stable for different radius ratios $\eta\in[0.2, 0.95]$. Considering the inhomogeneous distribution of shear stresses in the base flow, a new global Richardson number $Ri_g$ is defined and the marginal-state curves for different radius ratios are successfully unified in the parameter domain of $Ri_g$ and the Rayleigh number $Ra$. The results are consistent with the marginal-state curve of the wall-sheared classical RBC in the streamwise direction, demonstrating that the basic stabilization mechanisms are identical. Moreover, systems with small radius ratios exhibit greater geometric asymmetry. On the one hand, this results in a smaller equivalent aspect ratio for the system, accommodating fewer convection roll pairs. Fewer roll pairs are more likely to cause a transition in the flow structure during shear enhancement. On the other hand, the shear distribution is more inhomogeneous, allowing for an outward shift of the convection region and the elevation of bulk temperature under strong shear.


title: Transitive $(q-1)$-fold packings of $\rm{PG}_n(q)$

abstract: A $t$-fold packing of a projective space $\rm{PG}_n(q)$ is a collection $\mathcal{P}$ of line-spreads such that each line of $\rm{PG}_n(q)$ occurs in precisely $t$ spreads in $\mathcal{P}$. A $t$-fold packing $\mathcal{P}$ is transitive if a subgroup of $\rm{P\Gamma L}_{n+1}(q)$ preserves and acts transitively on $\mathcal{P}$. We give a construction for a transitive $(q-1)$-fold packing of $\rm{PG}_n(q)$, where $q=2^k$, for any odd positive integers $n$ and $k$, such that $n\geq 3$. This generalises a construction of Baker from 1976 for the case $q=2$.


title: Reply to: Assessing the precision of morphogen gradients in neural tube development

abstract: In a recent article [Vetter and Iber, Nat. Commun. 13, 1145 (2022)], we demonstrated that single morphogen gradients in the developing mouse neural tube can carry sufficient positional accuracy to explain the patterning precision of progenitor domain boundaries. Zagorski et al. had previously concluded otherwise [Zagorski et al., Science 356, 1379-1383 (2017)], based on methodological inconsistencies that we have revealed. The authors now comment on our work with a Matters Arising letter. We rebut their criticism point by point in the Supplement, and summarize the main aspects here.


title: Dense Reward for Free in Reinforcement Learning from Human Feedback

abstract: Reinforcement Learning from Human Feedback (RLHF) has been credited as the key advance that has allowed Large Language Models (LLMs) to effectively follow instructions and produce useful assistance. Classically, this involves generating completions from the LLM in response to a query before using a separate reward model to assign a score to the full completion. As an auto-regressive process, the LLM has to take many "actions" (selecting individual tokens) and only receives a single, sparse reward at the end of an episode, a setup that is known to be difficult to optimise in traditional reinforcement learning. In this work we leverage the fact that the reward model contains more information than just its scalar output, in particular, it calculates an attention map over tokens as part of the transformer architecture. We use these attention weights to redistribute the reward along the whole completion, effectively densifying the signal and highlighting the most important tokens, all without incurring extra computational cost or requiring any additional modelling. We demonstrate that, theoretically, this approach is equivalent to potential-based reward shaping, ensuring that the optimal policy remains unchanged. Empirically, we show that it stabilises training, accelerates the rate of learning, and, in practical cases, may lead to better local optima.


title: Element-specific and high-bandwidth ferromagnetic resonance spectroscopy with a coherent, extreme ultraviolet (EUV) source

abstract: We applied a tabletop, ultrafast, high-harmonic generation (HHG) source to measure the element-specific ferromagnetic resonance (FMR) in ultra-thin magnetic alloys and multilayers on an opaque Si substrate. We demonstrate a continuous wave bandwidth of 62 GHz, with promise to extend to 100 GHz or higher. This laboratory-scale instrument detects the FMR using ultrafast, extreme ultraviolet (EUV) light, with photon energies spanning the M-edges of most relevant magnetic elements. An RF frequency comb generator is used to produce a microwave excitation that is intrinsically synchronized to the EUV pulses with a timing jitter of 1.1 ps or better. We apply this system to measure the dynamics in a multilayer system as well as Ni-Fe and Co-Fe alloys. Since this instrument operates in reflection-mode, it is a milestone toward measuring and imaging the dynamics of the magnetic state and spin transport of active devices on arbitrary and opaque substrates. The higher bandwidth also enables measurements of materials with high magnetic anisotropy, as well as ferrimagnets, antiferromagnets, and short-wavelength (high wavevector) spinwaves in nanostructures or nanodevices. Furthermore, the coherence and short wavelength of the EUV will enable extending these studies using dynamic nanoscale lensless imaging techniques such as coherent diffractive imaging, ptychography, and holography.


title: High-resolution MHz time- and angle-resolved photoemission spectroscopy based on a tunable vacuum ultraviolet source

abstract: Time and angle-resolved photoemission spectroscopy (trARPES) allows direct mapping of the electronic band structure and its dynamic response on femtosecond timescales. Here, we present a new ARPES system, powered by a new fiber-based femtosecond light source in the vacuum ultraviolet (VUV) range, accessing the complete first Brillouin zone for most materials. We present trARPES data on Au(111), polycrystalline Au, Bi2Se3 and TaTe2, demonstrating an energy resolution of 21 meV with a time resolution of <360 fs, at a high repetition rate of 1 MHz. The system is integrated with an extreme ultraviolet (EUV) high harmonic generation (HHG) beamline, enabling excellent tunability of the time-bandwidth resolution.


title: Apparent Dark Matter Inspired by Einstein Equation of State

abstract: The purpose of this article is twofold. First, by means of Padmanabhan's proposal on the emergence nature of gravity, we recover the $\Lambda$CDM model and the effect of the dark matter in the context of cosmology. Toward this goal, we use the key idea of Padmanabhan that states cosmic space emerges as the cosmic time progress and link the emergence of space to the difference between the number of degrees of freedom on the boundary and in the bulk. Interestingly enough, we show that the effect of the cold dark matter in the cosmological setup can be understood by assuming an interaction between the numbers of degrees of freedom in the bulk. In the second part, we follow the Jacobson's argument and obtain the modified Einstein field equations with additional dark matter component emerging due to the interaction term between dark energy and baryonic matter related by $\Omega_{DM,0}=\sqrt{2 \alpha \Omega_{M,0} \Omega_{DE,0}}$, where $\alpha$ is a coupling constant. Finally, a correspondence with Yukawa cosmology is pointed out, and the role of massive gravitons as a possibility in explaining the nature of the dark sector as well as the theoretical origin of the Modified Newtonian Dynamics (MOND) are addressed. We speculate that the interaction coupling $\alpha$ fundamentally measures the entanglement between the gravitons and matter fields and there exists a fundamental limitation in measuring the gravitons wavelength.


title: CroissantLLM: A Truly Bilingual French-English Language Model

abstract: We introduce CroissantLLM, a 1.3B language model pretrained on a set of 3T English and French tokens, to bring to the research and industrial community a high-performance, fully open-sourced bilingual model that runs swiftly on consumer-grade local hardware. To that end, we pioneer the approach of training an intrinsically bilingual model with a 1:1 English-to-French pretraining data ratio, a custom tokenizer, and bilingual finetuning datasets. We release the training dataset, notably containing a French split with manually curated, high-quality, and varied data sources. To assess performance outside of English, we craft a novel benchmark, FrenchBench, consisting of an array of classification and generation tasks, covering various orthogonal aspects of model performance in the French Language. Additionally, rooted in transparency and to foster further Large Language Model research, we release codebases, and dozens of checkpoints across various model sizes, training data distributions, and training steps, as well as fine-tuned Chat models, and strong translation models. We evaluate our model through the FMTI framework, and validate 81 % of the transparency criteria, far beyond the scores of even most open initiatives. This work enriches the NLP landscape, breaking away from previous English-centric work in order to strengthen our understanding of multilinguality in language models.


title: Learning and Calibrating Heterogeneous Bounded Rational Market Behaviour with Multi-Agent Reinforcement Learning

abstract: Agent-based models (ABMs) have shown promise for modelling various real world phenomena incompatible with traditional equilibrium analysis. However, a critical concern is the manual definition of behavioural rules in ABMs. Recent developments in multi-agent reinforcement learning (MARL) offer a way to address this issue from an optimisation perspective, where agents strive to maximise their utility, eliminating the need for manual rule specification. This learning-focused approach aligns with established economic and financial models through the use of rational utility-maximising agents. However, this representation departs from the fundamental motivation for ABMs: that realistic dynamics emerging from bounded rationality and agent heterogeneity can be modelled. To resolve this apparent disparity between the two approaches, we propose a novel technique for representing heterogeneous processing-constrained agents within a MARL framework. The proposed approach treats agents as constrained optimisers with varying degrees of strategic skills, permitting departure from strict utility maximisation. Behaviour is learnt through repeated simulations with policy gradients to adjust action likelihoods. To allow efficient computation, we use parameterised shared policy learning with distributions of agent skill levels. Shared policy learning avoids the need for agents to learn individual policies yet still enables a spectrum of bounded rational behaviours. We validate our model's effectiveness using real-world data on a range of canonical $n$-agent settings, demonstrating significantly improved predictive capability.

categories: cs.MA cs.CE cs.GT cs.LG econ.GN q-fin.EC


title: EU-28's progress towards the 2020 renewable energy share. A club convergence analysis

abstract: This paper assesses the convergence of the EU-28 countries towards their common goal of 20% in the renewable energy share indicator by year 2020. The potential presence of clubs of convergence towards different steady state equilibria is also analyzed from both the standpoints of global convergence to the 20% goal and specific convergence to the various targets assigned to Member States. Two clubs of convergence are detected in the former case, each corresponding to different RES targets. A probit model is also fitted with the aim of better understanding the determinants of club membership, that seemingly include real GDP per capita, expenditure on environmental protection, energy dependence, and nuclear capacity, with all of them having statistically significant effects. Finally, convergence is also analyzed separately for the transport, heating and cooling, and electricity sectors.


title: Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spaces

abstract: Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in computational efficiency are mainly achieved by attention sparsification with random or heuristic-based graph subsampling, which falls short in data-dependent context reasoning. State space models (SSMs), such as Mamba, have gained prominence for their effectiveness and efficiency in modeling long-range dependencies in sequential data. However, adapting SSMs to non-sequential graph data presents a notable challenge. In this work, we introduce Graph-Mamba, the first attempt to enhance long-range context modeling in graph networks by integrating a Mamba block with the input-dependent node selection mechanism. Specifically, we formulate graph-centric node prioritization and permutation strategies to enhance context-aware reasoning, leading to a substantial improvement in predictive performance. Extensive experiments on ten benchmark datasets demonstrate that Graph-Mamba outperforms state-of-the-art methods in long-range graph prediction tasks, with a fraction of the computational cost in both FLOPs and GPU memory consumption. The code and models are publicly available at https://github.com/bowang-lab/Graph-Mamba.


title: From Pre-Quantum to Post-Quantum IoT Security: A Survey on Quantum-Resistant Cryptosystems for the Internet of Things

abstract: This article provides a survey on what can be called post-quantum IoT systems (IoT systems protected from the currently known quantum computing attacks): the main post-quantum cryptosystems and initiatives are reviewed, the most relevant IoT architectures and challenges are analyzed, and the expected future trends are indicated. Thus, this paper is aimed at providing a wide view of post-quantum IoT security and give useful guidelines to the future post-quantum IoT developers.


title: Hausdorff Reductions and the Exponential Hierarchies

abstract: The Strong Exponential Hierarchy $SEH$ was shown to collapse to $P^{NExp}$ by Hemachandra by proving $P^{NExp} = NP^{NExp}$ via a census argument. Nonetheless, Hemachandra also asked for certificate-based and alternating Turing machine characterizations of the $SEH$ levels, in the hope that these might have revealed deeper structural reasons behind the collapse. These open questions have thus far remained unanswered. To close them, by building upon the notion of Hausdorff reductions, we investigate a natural normal form for the intermediate levels of the (generalized) exponential hierarchies, i.e., the single-, the double-Exponential Hierarchy, and so on. Although the two characterizations asked for derive from our Hausdorff characterization, it is nevertheless from the latter that a surprising structural reason behind the collapse of $SEH$ is uncovered as a consequence of a very general result: the intermediate levels of the exponential hierarchies are precisely characterized by specific "Hausdorff classes", which define these levels without resorting to oracle machines. By this, contrarily to oracle classes, which may have different shapes for a same class (e.g., $P^{NP}_{||} = P^{NP[Log]} = LogSpace^{NP}$), hierarchy intermediate levels are univocally identified by Hausdorff classes (under the hypothesis of no hierarchy collapse). In fact, we show that the rather simple reason behind many equivalences of oracle classes is that they just refer to different ways of deciding the languages of a same Hausdorff class, and this happens also for $P^{NExp}$ and $NP^{NExp}$. In addition, via Hausdorff classes, we define complete problems for various intermediate levels of the exponential hierarchies. Through these, we obtain matching lower-bounds for problems known to be in $P^{NExp[Log]}$, but whose hardness was left open due to the lack of known $P^{NExp[Log]}$-complete problems.


title: Quantum fluctuation dynamics of open quantum systems with collective operator-valued rates, and applications to Hopfield-like networks

abstract: We consider a class of open quantum many-body systems that evolves in a Markovian fashion, the dynamical generator being in GKS-Lindblad form. Here, the Hamiltonian contribution is characterized by an all-to-all coupling, and the dissipation features local transitions that depend on collective, operator-valued rates, encoding average properties of the system. These types of generators can be formally obtained by generalizing, to the quantum realm, classical (mean-field) stochastic Markov dynamics, with state-dependent transitions. Focusing on the dynamics emerging in the limit of infinitely large systems, we build on the exactness of the mean-field equations for the dynamics of average operators. In this framework, we derive the dynamics of quantum fluctuation operators, that can be used in turn to understand the fate of quantum correlations in the system. We apply our results to quantum generalized Hopfield associative memories, showing that, asymptotically and at the mesoscopic scale only a very weak amount of quantum correlations, in the form of quantum discord, emerges beyond classical correlations.

categories: cond-mat.stat-mech math-ph math.MP quant-ph


title: Human Expertise in Algorithmic Prediction

abstract: We introduce a novel framework for incorporating human expertise into algorithmic predictions. Our approach focuses on the use of human judgment to distinguish inputs which `look the same' to any feasible predictive algorithm. We argue that this framing clarifies the problem of human/AI collaboration in prediction tasks, as experts often have access to information -- particularly subjective information -- which is not encoded in the algorithm's training data. We use this insight to develop a set of principled algorithms for selectively incorporating human feedback only when it improves the performance of any feasible predictor. We find empirically that although algorithms often outperform their human counterparts on average, human judgment can significantly improve algorithmic predictions on specific instances (which can be identified ex-ante). In an X-ray classification task, we find that this subset constitutes nearly 30% of the patient population. Our approach provides a natural way of uncovering this heterogeneity and thus enabling effective human-AI collaboration.


title: ReAGent: A Model-agnostic Feature Attribution Method for Generative Language Models

abstract: Feature attribution methods (FAs), such as gradients and attention, are widely employed approaches to derive the importance of all input features to the model predictions. Existing work in natural language processing has mostly focused on developing and testing FAs for encoder-only language models (LMs) in classification tasks. However, it is unknown if it is faithful to use these FAs for decoder-only models on text generation, due to the inherent differences between model architectures and task settings respectively. Moreover, previous work has demonstrated that there is no `one-wins-all' FA across models and tasks. This makes the selection of a FA computationally expensive for large LMs since input importance derivation often requires multiple forward and backward passes including gradient computations that might be prohibitive even with access to large compute. To address these issues, we present a model-agnostic FA for generative LMs called Recursive Attribution Generator (ReAGent). Our method updates the token importance distribution in a recursive manner. For each update, we compute the difference in the probability distribution over the vocabulary for predicting the next token between using the original input and using a modified version where a part of the input is replaced with RoBERTa predictions. Our intuition is that replacing an important token in the context should have resulted in a larger change in the model's confidence in predicting the token than replacing an unimportant token. Our method can be universally applied to any generative LM without accessing internal model weights or additional training and fine-tuning, as most other FAs require. We extensively compare the faithfulness of ReAGent with seven popular FAs across six decoder-only LMs of various sizes. The results show that our method consistently provides more faithful token importance distributions.


title: LLMs learn governing principles of dynamical systems, revealing an in-context neural scaling law

abstract: Pretrained large language models (LLMs) are surprisingly effective at performing zero-shot tasks, including time-series forecasting. However, understanding the mechanisms behind such capabilities remains highly challenging due to the complexity of the models. We study LLMs' ability to extrapolate the behavior of dynamical systems whose evolution is governed by principles of physical interest. Our results show that LLaMA 2, a language model trained primarily on texts, achieves accurate predictions of dynamical system time series without fine-tuning or prompt engineering. Moreover, the accuracy of the learned physical rules increases with the length of the input context window, revealing an in-context version of neural scaling law. Along the way, we present a flexible and efficient algorithm for extracting probability density functions of multi-digit numbers directly from LLMs.


title: Analytical methods in Celestial Mechanics: satellites' stability and galactic billiards

abstract: In this paper, two models of interest for Celestial Mechanics are presented and analysed, using both analytic and numerical techniques, from the point of view of the possible presence of regular and/or chaotic motion, as well as the stability of the considered orbits. The first model, presented in a Hamiltonian formalism, can be used to describe the motion of a satellite around the Earth, taking into account both the non-spherical shape of our planet and the third-body gravitational influence of Sun and Moon. Using semi-analytical techniques coming from Normal Form and Nekhoroshev theories it is possible to provide stability estimates for the orbital elements of its geocentric motion. The second dynamical system presented can be used as a simplified model to describe the motion of a particle in an elliptic galaxy having a central massive core, and is constructed as a refraction billiard where an inner dynamics, induced by a Keplerian potential, is coupled with an external one, where a harmonic oscillator-type potential is considered. The investigation of the dynamics is carried on by using tools of ODEs' theory and is focused on studying the trajectories' properties in terms of periodicity, stability and, possibly, chaoticity.


title: The Energy and Dynamics of Trapped Radiative Feedback with Stellar Winds

abstract: In this paper, we explore the significant, non-linear impact that stellar winds have on H ii regions. We perform a parameter study using three-dimensional radiative magnetohydrodynamic simulations of wind and ultraviolet radiation feedback from a 35 Msun star formed self-consistently in a turbulent, self-gravitating cloud, similar to the Orion Nebula (M42) and its main ionizing source Theta 1 Ori C. Stellar winds suppress early radiative feedback by trapping ionizing radiation in the shell around the wind bubble. Rapid breakouts of warm photoionized gas ('champagne flows') still occur if the star forms close to the edge of the cloud. The impact of wind bubbles can be enhanced if we detect and remove numerical overcooling caused by shocks crossing grid cells. However, the majority of the energy in the wind bubble is still lost to turbulent mixing between the wind bubble and the gas around it. These results begin to converge if the spatial resolution at the wind bubble interface is increased by refining the grid on pressure gradients. Wind bubbles form a thin chimney close to the star, which then expands outwards as an extended plume once the wind bubble breaks out of the dense core the star formed in, allowing them to expand faster than a spherical wind bubble. We also find wind bubbles mixing completely with the photoionized gas when the H ii region breaks out of the cloud as a champagne flow, a process we term 'hot champagne'.


title: Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents

abstract: Recent advancements on Large Language Models (LLMs) enable AI Agents to automatically generate and execute multi-step plans to solve complex tasks. However, since LLM's content generation process is hardly controllable, current LLM-based agents frequently generate invalid or non-executable plans, which jeopardizes the performance of the generated plans and corrupts users' trust in LLM-based agents. In response, this paper proposes a novel ``Formal-LLM'' framework for LLM-based agents by integrating the expressiveness of natural language and the precision of formal language. Specifically, the framework allows human users to express their requirements or constraints for the planning process as an automaton. A stack-based LLM plan generation process is then conducted under the supervision of the automaton to ensure that the generated plan satisfies the constraints, making the planning process controllable. We conduct experiments on both benchmark tasks and practical real-life tasks, and our framework achieves over 50% overall performance increase, which validates the feasibility and effectiveness of employing Formal-LLM to guide the plan generation of agents, preventing the agents from generating invalid and unsuccessful plans. Further, more controllable LLM-based agents can facilitate the broader utilization of LLM in application scenarios where high validity of planning is essential. The work is open-sourced at https://github.com/agiresearch/Formal-LLM.


title: Investigating the magnetism of Ni from a momentum space perspective

abstract: For more than three decades, clear discrepancies have existed between spin densities in momentum space revealed by Magnetic Compton scattering experiments and theoretical calculations based on density functional theory (DFT). Here by making a wide comparison between different theoretical methods, including DFT, DFT combined with dynamical mean field theory, and Hedin's $GW$ approximation, we discover how the magnetic Compton profiles of Ni can be predicted remarkably well. We find that the essential ingredients missing in DFT are (i) local spin fluctuations and (ii) a non-local treatment of electron correlations.


title: Cheeger sets for rotationally symmetric planar convex bodies

abstract: In this note we obtain some properties of the Cheeger set $C_\Omega$ asociated to a $k$-rotationally symmetric planar convex body $\Omega$. More precisely, we prove that $C_\Omega$ is also $k$-rotationally symmetric and touches all the edges of $\Omega$.


title: Test of the physical significance of Bell nonlocality

abstract: The experimental violation of a Bell inequality implies that at least one of a set of assumptions fails in nature. However, existing tests are inconclusive about which of the assumptions is the one that fails. Here, we show that there are quantum correlations that cannot be simulated with hidden variables that allow the slightest free will (or, equivalently, that limit, even minimally, retrocausal influences) or restrict, even minimally, actions at a distance. This result goes beyond Bell's theorem and demolishes the arguably most attractive motivation for considering hidden-variable theories with measurement dependence or actions at distance, namely, that simulating quantum correlations typically requires a small amount of these resources. We show that there is a feasible experiment that can discard any hidden-variable theory allowing for arbitrarily small free will and having arbitrarily small limitations to actions at a distance. The experiment involves two observers, each of them choosing between two measurements with $2^N$ outcomes. The larger $N$ for which a specific Bell-like inequality is violated, the larger the set of excluded hidden-variable theories. In the limit of $N$ tending to infinity, the only alternatives to the absence of hidden variables are complete superdeterminism or complete parameter dependence. We also explore the implications of this result for quantum information.


title: Intrinsic Kerr amplification for microwave electromechanics

abstract: Electromechanical transduction gain of 21 dB is realized in a micro-cantilever resonant force sensor operated in the unresolved-sideband regime. Strain-dependent kinetic inductance weakly couples cantilever motion to a superconducting nonlinear resonant circuit. A single pump generates motional sidebands and parametrically amplifies them via four-wave mixing. We study the gain and added noise, and we analyze potential benefits of this integrated amplification process in the context force sensitivity.


title: Signal Quality Auditing for Time-series Data

abstract: Signal quality assessment (SQA) is required for monitoring the reliability of data acquisition systems, especially in AI-driven Predictive Maintenance (PMx) application contexts. SQA is vital for addressing "silent failures" of data acquisition hardware and software, which when unnoticed, misinform the users of data, creating the risk for incorrect decisions with unintended or even catastrophic consequences. We have developed an open-source software implementation of signal quality indices (SQIs) for the analysis of time-series data. We codify a range of SQIs, demonstrate them using established benchmark data, and show that they can be effective for signal quality assessment. We also study alternative approaches to denoising time-series data in an attempt to improve the quality of the already degraded signal, and evaluate them empirically on relevant real-world data. To our knowledge, our software toolkit is the first to provide an open source implementation of a broad range of signal quality assessment and improvement techniques validated on publicly available benchmark data for ease of reproducibility. The generality of our framework can be easily extended to assessing reliability of arbitrary time-series measurements in complex systems, especially when morphological patterns of the waveform shapes and signal periodicity are of key interest in downstream analyses.


title: Weakly subnormal subgroups and variations of the Baer-Suzuki theorem

abstract: A subgroup $R$ of a finite group $G$ is weakly subnormal in $G$ if $R$ is not subnormal in $G$ but it is subnormal in every proper overgroup of $R$ in $G$. In this paper, we first classify all finite groups $G$ which contains a weakly subnormal $p$-subgroup for some prime $p$. We then determine all finite groups containing a cyclic weakly subnormal $p$-subgroup. As applications, we prove a number of variations of the Baer-Suzuki theorem using the orders of certain group elements.


title: High stationarity and derived topologies on $\mathcal{P}_{\kappa}(A)$

abstract: Let $\kappa$ be an uncountable regular cardinal, $\kappa \subseteq A$. We study a notion of $n$-stationarity on $\mathcal{P}_{\kappa}(A)$. We construct a sequence of topologies $\langle \tau_0, \tau_1, \dots \rangle $ on $\mathcal{P}_{\kappa}(A)$ characterising the simultaneous reflection of a pair of $n$-stationary sets in terms of elements in the base of $\tau_n$. This result constitutes a complete generalisation to the context of $\mathcal{P}_{\kappa}(A)$ of Bagaria's prior characterisation of $n$-simultaneous reflection in terms of derived topologies on ordinals.


title: Linearly coupled quantum harmonic oscillators and their quantum entanglement

abstract: Quantum harmonic oscillators linearly coupled through coordinates and momenta, represented by the Hamiltonian $ {\hat H}=\sum^2_{i=1}\left( \frac{ {\hat p}^{2}_i}{2 m_i } + \frac{m_i \omega^2_i}{2} x^2_i\right) +{\hat H}_{int} $, where the interaction of two oscillators ${\hat H}_{int} = i k_1 x_1 { \hat p }_2+ i k_2 x_2 {\hat p}_1 + k_3 x_1 x_2-k_4 {\hat p}_1 {\hat p}_2$, found in many applications of quantum optics, nonlinear physics, molecular chemistry and biophysics. Despite this, there is currently no general solution to the Schr\"{o}dinger equation for such a system. This is especially relevant for quantum entanglement of such a system in quantum optics applications. Here this problem is solved and it is shown that quantum entanglement depends on only one coefficient $R \in (0,1)$, which includes all the parameters of the system under consideration. It has been shown that quantum entanglement can be very large at certain values of this coefficient. The results obtained have a fairly simple analytical form, which facilitates analysis.


title: Distilling Conditional Diffusion Models for Offline Reinforcement Learning through Trajectory Stitching

abstract: Deep generative models have recently emerged as an effective approach to offline reinforcement learning. However, their large model size poses challenges in computation. We address this issue by proposing a knowledge distillation method based on data augmentation. In particular, high-return trajectories are generated from a conditional diffusion model, and they are blended with the original trajectories through a novel stitching algorithm that leverages a new reward generator. Applying the resulting dataset to behavioral cloning, the learned shallow policy whose size is much smaller outperforms or nearly matches deep generative planners on several D4RL benchmarks.


title: Exploring the Dynamics between Cobot's Production Rhythm, Locus of Control and Emotional State in a Collaborative Assembly Scenario

abstract: In industrial scenarios, there is widespread use of collaborative robots (cobots), and growing interest is directed at evaluating and measuring the impact of some characteristics of the cobot on the human factor. In the present pilot study, the effect that the production rhythm (C1 - Slow, C2 - Fast, C3 - Adapted to the participant's pace) of a cobot has on the Experiential Locus of Control (ELoC) and the emotional state of 31 participants has been examined. The operators' performance, the degree of basic internal Locus of Control, and the attitude towards the robots were also considered. No difference was found regarding the emotional state and the ELoC in the three conditions, but considering the other psychological variables, a more complex situation emerges. Overall, results seem to indicate a need to consider the person's psychological characteristics to offer a differentiated and optimal interaction experience.


title: Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI

abstract: In the current landscape of deep learning research, there is a predominant emphasis on achieving high predictive accuracy in supervised tasks involving large image and language datasets. However, a broader perspective reveals a multitude of overlooked metrics, tasks, and data types, such as uncertainty, active and continual learning, and scientific data, that demand attention. Bayesian deep learning (BDL) constitutes a promising avenue, offering advantages across these diverse settings. This paper posits that BDL can elevate the capabilities of deep learning. It revisits the strengths of BDL, acknowledges existing challenges, and highlights some exciting research avenues aimed at addressing these obstacles. Looking ahead, the discussion focuses on possible ways to combine large-scale foundation models with BDL to unlock their full potential.


title: Anomalous entropy-driven kinetics of dislocation nucleation

abstract: The kinetics of dislocation reactions, such as dislocation multiplication, controls the plastic deformation in crystals beyond their elastic limit, therefore critical mechanisms in a number of applications in materials science. We present a series of large-scale molecular dynamics simulations that shows that one such type of reactions, the nucleation of dislocation at free surfaces, exhibit extremely unconventional kinetics, including unexpectedly large nucleation rates under compression, very strong entropic stabilization under tension, as well as strong non-Arrhenius behavior. These unusual kinetics are quantitatively rationalized using a variational transition state theory approach coupled with an efficient numerical scheme for the estimation of vibrational entropy changes. These results highlight the need for a variational treatment of the kinetics to quantitatively capture dislocation reaction kinetics, especially at low-to-moderate strains where large deformations are required to activate reactions. These observations suggest possible explanations to previously observed unconventional deformation kinetics in both molecular dynamics simulations and experiments.


title: An Analysis of the Variance of Diffusion-based Speech Enhancement

abstract: Diffusion models proved to be powerful models for generative speech enhancement. In recent SGMSE+ approaches, training involves a stochastic differential equation for the diffusion process, adding both Gaussian and environmental noise to the clean speech signal gradually. The speech enhancement performance varies depending on the choice of the stochastic differential equation that controls the evolution of the mean and the variance along the diffusion processes when adding environmental and Gaussian noise. In this work, we highlight that the scale of the variance is a dominant parameter for speech enhancement performance and show that it controls the tradeoff between noise attenuation and speech distortions. More concretely, we show that a larger variance increases the noise attenuation and allows for reducing the computational footprint, as fewer function evaluations for generating the estimate are required


title: Examining the Influence of Digital Phantom Models in Virtual Imaging Trials for Tomographic Breast Imaging

abstract: Purpose: Digital phantoms are one of the key components of virtual imaging trials (VITs) that aim to assess and optimize new medical imaging systems and algorithms. However, these phantoms vary in their voxel resolution, appearance, and structural details. This study aims to examine whether and how variations between digital phantoms influence system optimization with digital breast tomosynthesis (DBT) as a chosen modality. Methods: We selected widely used and open-access digital breast phantoms generated with different methods. For each phantom type, we created an ensemble of DBT images to test acquisition strategies. Human observer localization ROC (LROC) was used to assess observer performance studies for each case. Noise power spectrum (NPS) was estimated to compare the phantom structural components. Further, we computed several gaze metrics to quantify the gaze pattern when viewing images generated from different phantom types. Results: Our LROC results show that the arc samplings for peak performance were approximately 2.5 degrees and 6 degrees in Bakic and XCAT breast phantoms respectively for 3-mm lesion detection tasks and indicate that system optimization outcomes from VITs can vary with phantom types and structural frequency components. Additionally, a significant correlation (p= 0.01) between gaze metrics and diagnostic performance suggests that gaze analysis can be used to understand and evaluate task difficulty in VITs.

categories: physics.med-ph cs.HC eess.IV eess.SP physics.app-ph


title: Impact of anti-symmetric contributions to signal multipoles in the measurement of black-hole spins

abstract: Many current models for the gravitational-wave signal from precessing black-hole binaries neglect an asymmetry in the $\pm m$ multipoles. The asymmetry is weak, but is responsible for out-of-plane recoil, which for the final black hole can be several thousand km/s. In this work we show that the multipole asymmetry is also necessary to accurately measure the black-hole spins. We consider synthetic signals calculated from the numerical relativity surrogate model NRSur7dq4, which includes the multipole asymmetry, and measure the signal parameters using two versions of the same model, one with and one without the multipole asymmetry included. We find that in high signal-to-noise-ratio observations where the spin magnitude and direction can in principle be measured accurately, neglecting the multipole asymmetry can result in biased measurements of these quantities. Measurements of the black-hole masses and the standard aligned-spin combination $\chi_{\rm eff}$ are not in general strongly affected. As an illustration of the impact of the multipole asymmetry on a real signal we consider the LVK observation GW200129_065458, and find that the inclusion of the multipole asymmetry is necessary to identify the binary as unequal-mass and a high in-plane spin in the primary.


title: Optimal monotone conditional error functions

abstract: This note presents a method that provides optimal monotone conditional error functions for a large class of adaptive two stage designs. The presented method builds on a previously developed general theory for optimal adaptive two stage designs where sample sizes are reassessed for a specific conditional power and the goal is to minimize the expected sample size. The previous theory can easily lead to a non-monotonous conditional error function which is highly undesirable for logical reasons and can harm type I error rate control for composite null hypotheses. The here presented method extends the existing theory by introducing intermediate monotonising steps that can easily be implemented.


title: On the stability of the Yamabe invariant of $S^3$

abstract: Let $g$ be a complete, asymptotically flat metric on $\mathbb{R}^3$ with vanishing scalar curvature. Moreover, assume that $(\mathbb{R}^3,g)$ supports a nearly Euclidean $L^2$ Sobolev inequality. We prove that $(\mathbb{R}^3,g)$ must be close to Euclidean space with respect to the $d_p$-distance defined by Lee-Naber-Neumayer. We then discuss some consequences for the stability of the Yamabe invariant of $S^3$. More precisely, we show that if such a manifold $(\mathbb{R}^3,g)$ carries a suitably normalized, positive solution to $\Delta_g w + \lambda w^5 = 0$ then $w$ must be close, in a certain sense, to a conformal factor that transforms Euclidean space into a round sphere.


title: Leveraging Approximate Model-based Shielding for Probabilistic Safety Guarantees in Continuous Environments

abstract: Shielding is a popular technique for achieving safe reinforcement learning (RL). However, classical shielding approaches come with quite restrictive assumptions making them difficult to deploy in complex environments, particularly those with continuous state or action spaces. In this paper we extend the more versatile approximate model-based shielding (AMBS) framework to the continuous setting. In particular we use Safety Gym as our test-bed, allowing for a more direct comparison of AMBS with popular constrained RL algorithms. We also provide strong probabilistic safety guarantees for the continuous setting. In addition, we propose two novel penalty techniques that directly modify the policy gradient, which empirically provide more stable convergence in our experiments.


title: Gate-tunable Josephson diode effect in Rashba spin-orbit coupled quantum dot junctions

abstract: We theoretically explore Josephson diode effect (JDE) in superconductor/quantum dot (QD)/superconductor junction in the presence of a magnetic field and Rashba spin-orbit interaction (RSOI). We calculate the Josephson current in our QD junction using Keldysh non-equilibrium Green's function technique. We show that JDE is induced in our chiral QD junction with large rectification coefficient (RC) in the presence of RSOI and external magnetic field simultaneously. Interestingly, the sign and magnitude of the RC are highly controllable by the magnetic field and RSOI. For realistic RSOI strength in the presence of magnetic field and chirality, the RC can be tuned to be as high as $70\%$ by an external gate potential, indicating a giant JDE in our QD junction. Our proposed QD-based Josephson diode (JD) may serve as a potential superconducting device component.


title: The Entropy of Dynamical Black Holes

abstract: We propose a new formula for the entropy of a dynamical black hole$-$valid to leading order for perturbations off of a stationary black hole background$-$in an arbitrary classical diffeomorphism covariant Lagrangian theory of gravity in $n$ dimensions. In stationary eras, this formula agrees with the usual Noether charge formula, but in nonstationary eras, we obtain a nontrivial correction term. In general relativity, our formula for the entropy of a dynamical black hole is $1/4$ of the horizon area plus a term involving the integral of the expansion of the null generators of the horizon, which we show is $1/4$ of the area of the apparent horizon to leading order. Our formula for entropy in a general theory of gravity obeys a "local physical process version" of the first law of black hole thermodynamics. For first order perturbations sourced by external matter that satisfies the null energy condition, our entropy obeys the second law of black hole thermodynamics. For vacuum perturbations, the second law is obeyed at leading order if and only if the "modified canonical energy flux" is positive (as is the case in general relativity but presumably would not hold in general theories). We obtain a general relationship between our formula for the entropy of a dynamical black hole and a formula proposed independently by Dong and by Wall. We then consider the generalized second law in semiclassical gravity for first order perturbations of a stationary black hole. We show that the validity of the quantum null energy condition (QNEC) on a Killing horizon is equivalent to the generalized second law using our notion of black hole entropy but using a modified notion of von Neumann entropy for matter. On the other hand, the generalized second law for the Dong-Wall entropy is equivalent to an integrated version of QNEC, using the unmodified von Neumann entropy for the entropy of matter.


title: Further understanding the interaction between dark energy and dark matter: current status and future directions

abstract: The interaction between dark matter and dark energy can be incorporated into field theory models of dark energy that have proved successful in alleviating the coincidence problem. We review recent advances in this field, including new models and constraints from different astronomical data sets. We show that interactions are allowed by observations and can reduce the current tensions among different measurements of cosmological parameters. We extend our discussion to include constraints from non-linear effects and results from cosmological simulations. Finally, we discuss forthcoming multi-messenger data from current and future observational facilities that will help to improve our understanding of the interactions within the dark sector.


title: USDnet: Unsupervised Speech Dereverberation via Neural Forward Filtering

abstract: In reverberant conditions with a single speaker, each far-field microphone records a reverberant version of the same speaker signal at a different location. In over-determined conditions, where there are more microphones than speakers, each recorded mixture signal can be leveraged as a constraint to narrow down the solutions to target anechoic speech and thereby reduce reverberation. Equipped with this insight, we propose USDnet, a novel deep neural network (DNN) approach for unsupervised speech dereverberation (USD). At each training step, we first feed an input mixture to USDnet to produce an estimate for target speech, and then linearly filter the DNN estimate to approximate the multi-microphone mixture so that the constraint can be satisfied at each microphone, thereby regularizing the DNN estimate to approximate target anechoic speech. The linear filter can be estimated based on the mixture and DNN estimate via neural forward filtering algorithms such as forward convolutive prediction. We show that this novel methodology can promote unsupervised dereverberation of single-source reverberant speech.


title: A High-Finesse Suspended Interferometric Sensor for Macroscopic Quantum Mechanics with Femtometre Sensitivity

abstract: We present an interferometric sensor for investigating macroscopic quantum mechanics on a table-top scale. The sensor consists of pair of suspended optical cavities with a finesse in excess of 100,000 comprising 10 g fused-silica mirrors. In the current room-temperature operation, we achieve a peak sensitivity of \SI{0.5}{\fmasd} in the acoustic frequency band, limited by the readout noise. With additional suppression of the readout noise, we will be able to reach the quantum radiation pressure noise, which would represent a novel measurement of the quantum back-action effect. Such a sensor can eventually be utilised for demonstrating macroscopic entanglement and testing semi-classical and quantum gravity models.


title: WiOpen: A Robust Wi-Fi-based Open-set Gesture Recognition Framework

abstract: Recent years have witnessed a growing interest in Wi-Fi-based gesture recognition. However, existing works have predominantly focused on closed-set paradigms, where all testing gestures are predefined during training. This poses a significant challenge in real-world applications, as unseen gestures might be misclassified as known classes during testing. To address this issue, we propose WiOpen, a robust Wi-Fi-based Open-Set Gesture Recognition (OSGR) framework. Implementing OSGR requires addressing challenges caused by the unique uncertainty in Wi-Fi sensing. This uncertainty, resulting from noise and domains, leads to widely scattered and irregular data distributions in collected Wi-Fi sensing data. Consequently, data ambiguity between classes and challenges in defining appropriate decision boundaries to identify unknowns arise. To tackle these challenges, WiOpen adopts a two-fold approach to eliminate uncertainty and define precise decision boundaries. Initially, it addresses uncertainty induced by noise during data preprocessing by utilizing the CSI ratio. Next, it designs the OSGR network based on an uncertainty quantification method. Throughout the learning process, this network effectively mitigates uncertainty stemming from domains. Ultimately, the network leverages relationships among samples' neighbors to dynamically define open-set decision boundaries, successfully realizing OSGR. Comprehensive experiments on publicly accessible datasets confirm WiOpen's effectiveness. Notably, WiOpen also demonstrates superiority in cross-domain tasks when compared to state-of-the-art approaches.


title: SLIM: Skill Learning with Multiple Critics

abstract: Self-supervised skill learning aims to acquire useful behaviors that leverage the underlying dynamics of the environment. Latent variable models, based on mutual information maximization, have been successful in this task but still struggle in the context of robotic manipulation. As it requires impacting a possibly large set of degrees of freedom composing the environment, mutual information maximization fails alone in producing useful and safe manipulation behaviors. Furthermore, tackling this by augmenting skill discovery rewards with additional rewards through a naive combination might fail to produce desired behaviors. To address this limitation, we introduce SLIM, a multi-critic learning approach for skill discovery with a particular focus on robotic manipulation. Our main insight is that utilizing multiple critics in an actor-critic framework to gracefully combine multiple reward functions leads to a significant improvement in latent-variable skill discovery for robotic manipulation while overcoming possible interference occurring among rewards which hinders convergence to useful skills. Furthermore, in the context of tabletop manipulation, we demonstrate the applicability of our novel skill discovery approach to acquire safe and efficient motor primitives in a hierarchical reinforcement learning fashion and leverage them through planning, significantly surpassing baseline approaches for skill discovery.


title: Role of filler lanthanide ions on lattice dynamics of phosphide skutterudites RFe$_4$P$_{12}$ (R = La, Ce, and Pr) from first principles

abstract: Phosphide skutterudites primarily show promise for thermoelectric applications due to their chemical stability at high temperatures and relatively low cost. Ion doping and band gap engineering have been used to enhance their typically poor thermoelectric performance, opening avenues for practical applications. Herein, we report a comparative lattice dynamics study on the impact of filler and temperature on the structural and vibrational properties of RFe$_4$P$_{12}$ (R = La, Ce, and Pr) skutterudites. Calculations are performed within the quasi-harmonic approximation, and the results are critically compared against experimental data and other \textit{ab initio} calculations. We found gaps between the heat-carrying acoustic and optical modes, a-o gaps, of approximately 4, -2, and 0.01\,cm$^{-1}$ for La, Ce, and Pr compounds, respectively. These results suggest a filler-induced reduction in the a-o gap is attributed to the softening of the optical modes instead of the conventionally considered upward shift of acoustic modes proposed in the \textit{rattling} scenario. The distinct softening of the optical modes is rationalized by the stiffening of chemical bonds between the filler and host lattice.


title: Resolution invariant deep operator network for PDEs with complex geometries

abstract: Neural operators (NO) are discretization invariant deep learning methods with functional output and can approximate any continuous operator. NO have demonstrated the superiority of solving partial differential equations (PDEs) over other deep learning methods. However, the spatial domain of its input function needs to be identical to its output, which limits its applicability. For instance, the widely used Fourier neural operator (FNO) fails to approximate the operator that maps the boundary condition to the PDE solution. To address this issue, we propose a novel framework called resolution-invariant deep operator (RDO) that decouples the spatial domain of the input and output. RDO is motivated by the Deep operator network (DeepONet) and it does not require retraining the network when the input/output is changed compared with DeepONet. RDO takes functional input and its output is also functional so that it keeps the resolution invariant property of NO. It can also resolve PDEs with complex geometries whereas NO fail. Various numerical experiments demonstrate the advantage of our method over DeepONet and FNO.


title: Connected power operations and simplicial Poincar\'e duality

abstract: We introduce a structure termed ``connected cyclic diagonal'' on a chain complex, which induces stable power operations in its cohomology with the property that negative power operations consistently vanish. This chain level structure is useful to represent power operations for spectra, whose cohomology lacks a cup product. Using a Poincar\'e duality algebra structure on the integral chains of the standard augmented simplex, we provide an effective method for the construction of cyclic diagonals on a broad class of augmented simplicial objects.


title: Emo-Avatar: Efficient Monocular Video Style Avatar through Texture Rendering

abstract: Artistic video portrait generation is a significant and sought-after task in the fields of computer graphics and vision. While various methods have been developed that integrate NeRFs or StyleGANs with instructional editing models for creating and editing drivable portraits, these approaches face several challenges. They often rely heavily on large datasets, require extensive customization processes, and frequently result in reduced image quality. To address the above problems, we propose the Efficient Monotonic Video Style Avatar (Emo-Avatar) through deferred neural rendering that enhances StyleGAN's capacity for producing dynamic, drivable portrait videos. We proposed a two-stage deferred neural rendering pipeline. In the first stage, we utilize few-shot PTI initialization to initialize the StyleGAN generator through several extreme poses sampled from the video to capture the consistent representation of aligned faces from the target portrait. In the second stage, we propose a Laplacian pyramid for high-frequency texture sampling from UV maps deformed by dynamic flow of expression for motion-aware texture prior integration to provide torso features to enhance StyleGAN's ability to generate complete and upper body for portrait video rendering. Emo-Avatar reduces style customization time from hours to merely 5 minutes compared with existing methods. In addition, Emo-Avatar requires only a single reference image for editing and employs region-aware contrastive learning with semantic invariant CLIP guidance, ensuring consistent high-resolution output and identity preservation. Through both quantitative and qualitative assessments, Emo-Avatar demonstrates superior performance over existing methods in terms of training efficiency, rendering quality and editability in self- and cross-reenactment.