title: Facilitating the systematic nanoscale study of battery materials by atom probe tomography through in-situ metal coating

abstract: Through its capability for 3D mapping of Li at the nanoscale, atom probe tomography (APT) is poised to play a key role in understanding the microstructural degradation of lithium-ion batteries (LIB) during successive charge and discharge cycles. However, APT application to materials for LIB is plagued by the field induced delithiation (deintercalation) of Li-ions during the analysis itself that prevents the precise assessment of the Li distribution. Here, we showcase how a thin Cr-coating, in-situ formed on APT specimens of NMC811 in the focused-ion beam (FIB), preserves the sample's integrity and circumvent this deleterious delithiation. Cr-coated specimens demonstrated remarkable improvements in data quality and virtually eliminated premature specimen failures, allowing for more precise measurements via. improved statistics. Through improved data analysis, we reveal substantial cation fluctuations in commercial grade NMC811, including complete grains of LiMnO. The current methodology stands out for its simplicity and cost-effectiveness and is a viable approach to prepare battery cathodes and anodes for systematic APT studies.


title: Applying Deep Learning to Calibrate Stochastic Volatility Models

abstract: Stochastic volatility models, where the volatility is a stochastic process, can capture most of the essential stylized facts of implied volatility surfaces and give more realistic dynamics of the volatility smile/skew. However, they come with the significant issue that they take too long to calibrate. Alternative calibration methods based on Deep Learning (DL) techniques have been recently used to build fast and accurate solutions to the calibration problem. Huge and Savine developed a Differential Machine Learning (DML) approach, where Machine Learning models are trained on samples of not only features and labels but also differentials of labels to features. The present work aims to apply the DML technique to price vanilla European options (i.e. the calibration instruments), more specifically, puts when the underlying asset follows a Heston model and then calibrate the model on the trained network. DML allows for fast training and accurate pricing. The trained neural network dramatically reduces Heston calibration's computation time. In this work, we also introduce different regularisation techniques, and we apply them notably in the case of the DML. We compare their performance in reducing overfitting and improving the generalisation error. The DML performance is also compared to the classical DL (without differentiation) one in the case of Feed-Forward Neural Networks. We show that the DML outperforms the DL. The complete code for our experiments is provided in the GitHub repository: https://github.com/asridi/DML-Calibration-Heston-Model

categories: q-fin.CP cs.AI q-fin.MF q-fin.PR q-fin.RM


title: Predicting the mechanical properties of spring networks

abstract: The elastic response of mechanical, chemical, and biological systems is often modeled using a discrete arrangement of Hookean springs, either representing finite material elements or even the molecular bonds of a system. However, to date, there is no direct derivation of the relation between a general discrete spring network and it's corresponding elastic continuum. Furthermore, understanding the network's mechanical response requires simulations that may be expensive computationally. Here we report a method to derive the exact elastic continuum model of any discrete network of springs, requiring network geometry and topology only. We identify and calculate the so-called "non-affine" displacements. Explicit comparison of our calculations to simulations of different crystalline and disordered configurations, shows we successfully capture the mechanics even of auxetic materials. Our method is valid for residually stressed systems with non-trivial geometries, is easily generalizable to other discrete models, and opens the possibility of a rational design of elastic systems.

categories: cond-mat.soft cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.stat-mech physics.comp-ph


title: Conformal little Higgs models

abstract: Little Higgs models address the hierarchy problem by identifying the SM Higgs doublet as pseudo-Nambu--Goldstone bosons (pNGB) arising from global symmetries with collective breakings. These models are designed to address the little hierarchy problem up to a scale of $\Lambda\!\sim\! {\cal O}(10)$ TeV. Consequently, these models necessitate an ultraviolet (UV) completion above this scale. On the other hand, conformal extensions of the Standard Model are intriguing because scales emerge as a consequence of dimensional transmutation. In this study, we present a unified framework in which the electroweak hierarchy problem is tackled through a conformal symmetry collectively broken around the TeV scale, offering an appealing UV completion for little Higgs models. Notably, this framework automatically ensures the presence of the required UV fixed points, eliminating the need for careful adjustments to the particle content of the theory. Moreover, this framework naturally addresses the flavor puzzles associated with composite or little Higgs models. Furthermore, we suggest that in this framework all known little Higgs models can be UV-completed through conformal dynamics above the scale $\Lambda$ up to arbitrary high scales.


title: MC-NeRF: Multi-Camera Neural Radiance Fields for Multi-Camera Image Acquisition Systems

abstract: Neural Radiance Fields (NeRF) use multi-view images for 3D scene representation, demonstrating remarkable performance. As one of the primary sources of multi-view images, multi-camera systems encounter challenges such as varying intrinsic parameters and frequent pose changes. Most previous NeRF-based methods assume a unique camera and rarely consider multi-camera scenarios. Besides, some NeRF methods that can optimize intrinsic and extrinsic parameters still remain susceptible to suboptimal solutions when these parameters are poor initialized. In this paper, we propose MC-NeRF, a method that enables joint optimization of both intrinsic and extrinsic parameters alongside NeRF. The method also supports each image corresponding to independent camera parameters. First, we tackle coupling issue and the degenerate case that arise from the joint optimization between intrinsic and extrinsic parameters. Second, based on the proposed solutions, we introduce an efficient calibration image acquisition scheme for multi-camera systems, including the design of calibration object. Finally, we present an end-to-end network with training sequence that enables the estimation of intrinsic and extrinsic parameters, along with the rendering network. Furthermore, recognizing that most existing datasets are designed for a unique camera, we construct a real multi-camera image acquisition system and create a corresponding new dataset, which includes both simulated data and real-world captured images. Experiments confirm the effectiveness of our method when each image corresponds to different camera parameters. Specifically, we use multi-cameras, each with different intrinsic and extrinsic parameters in real-world system, to achieve 3D scene representation without providing initial poses.


title: Thermodynamic entropy production in the dynamical Casimir effect

abstract: This paper address the question of thermodynamic entropy production in the context of the dynamical Casimir effect. Specifically, we study a scalar quantum field confined within a one-dimensional ideal cavity subject to time-varying boundary conditions dictated by an externally prescribed trajectory of one of the cavity mirrors. The central question is how the thermodynamic entropy of the field evolves over time. Utilizing an effective Hamiltonian approach, we compute the entropy production and reveal that it exhibits scaling behavior concerning the number of particles created in the short-time limit. Furthermore, this approach elucidates the direct connection between this entropy and the emergence of quantum coherence within the mode basis of the field. In addition, by considering a distinct approach based on the time evolution of Gaussian states we examine the long-time limit of entropy production within a single mode of the field. This approach results in establishing a connection between the thermodynamic entropy production in a single field mode and the entanglement between that particular mode and all other modes. Consequently, by employing two distinct approaches, we comprehensively address both the short-term and long-term dynamics of the system. Our results thus link the irreversible dynamics of the field, as measured by entropy production and induced by the dynamical Casimir effect, to two fundamental aspects of quantum mechanics: coherence and entanglement.


title: Punctured JSJ tori and tautological extensions of Azumaya algebras

abstract: The $SL_2(\mathbb{C})$ character variety $X(M)$ has emerged as an important tool in studying the topology of hyperbolic 3-manifolds. Chinburg-Reid-Stover constructed arithmetic invariants stemming from a canonical Azumaya algebra over the normalization of an irreducible component of $X(M)$ containing a lift of the holonomy representation of $M$. We provide an explicit topological criterion for extending the canonical Azumaya algebra over an ideal point, potentially leading to finer arithmetic invariants than those of Chinburg-Reid-Stover. This topological criterion involves Culler-Shalen theory and, in some cases, JSJ decompositions of toroidal Dehn fillings of knot complements in the three-sphere. Inspired by the work of Paoluzzi-Porti and Tillmann, we provide examples of several cases where these refined invariants exist. Along the way, we show that certain families of Seifert surfaces in hyperbolic knot complements can be associated to ideal points of character varieties.


title: TFNet: Exploiting Temporal Cues for Fast and Accurate LiDAR Semantic Segmentation

abstract: LiDAR semantic segmentation plays a crucial role in enabling autonomous driving and robots to understand their surroundings accurately and robustly. A multitude of methods exist within this domain, including point-based, range-image-based, polar-coordinate-based, and hybrid strategies. Among these, range-image-based techniques have gained widespread adoption in practical applications due to their efficiency. However, they face a significant challenge known as the ``many-to-one'' problem caused by the range image's limited horizontal and vertical angular resolution. As a result, around 20% of the 3D points can be occluded. In this paper, we present TFNet, a range-image-based LiDAR semantic segmentation method that utilizes temporal information to address this issue. Specifically, we incorporate a temporal fusion layer to extract useful information from previous scans and integrate it with the current scan. We then design a max-voting-based post-processing technique to correct false predictions, particularly those caused by the ``many-to-one'' issue. We evaluated the approach on two benchmarks and demonstrated that the plug-in post-processing technique is generic and can be applied to various networks.


title: Method for measuring the proton charge radius from the time-like region

abstract: We propose a novel method for measuring the proton charge radius. The method explores the facts that the Dalitz decay $J/\psi \to p\bar{p}e^+e^-$ contains the proton form factors and the measurable lowest four-momentum transfer squared value can be as low as $\sim 4m_e^2= 1.05\times10^{-6}$ GeV$^2$ in the time-like region. We identify a kinematic region where the proton form factors are essential and propose a method for subtracting the background from the data. It is estimated that the proton charge radius can be measured to a precision of 0.04 fm at the BESIII setup and one order of magnitude better at the future Super $\tau$-Charm Facility. Furthermore, the same method can be used to measure the charge radii of charged hyperons, which are otherwise difficult to access.


title: The mass of simple and higher-order networks

abstract: We propose a theoretical framework that explains how the mass of simple and higher-order networks emerges from their topology and geometry. We use the discrete topological Dirac operator to define an action for a massless self-interacting topological Dirac field inspired by the Nambu-Jona Lasinio model. The mass of the network is strictly speaking the mass of this topological Dirac field defined on the network; it results from the chiral symmetry breaking of the model and satisfies a self-consistent gap equation. Interestingly, it is shown that the mass of a network depends on its spectral properties, topology, and geometry. Due to the breaking of the matter-antimatter symmetry observed for the harmonic modes of the discrete topological Dirac operator, two possible definitions of the network mass can be given. For both possible definitions, the mass of the network comes from a gap equation with the difference among the two definitions encoded in the value of the bare mass. Indeed, the bare mass can be determined either by the Betti number $\beta_0$ or by the Betti number $\beta_1$ of the network. We provide numerical results on the mass of different networks, including random graphs, scale-free, and real weighted collaboration networks. We also discuss the generalization of these results to higher-order networks, defining the mass of simplicial complexes. The observed dependence of the mass of the considered topological Dirac field with the topology and geometry of the network could lead to interesting physics in the scenario in which the considered Dirac field is coupled with a dynamical evolution of the underlying network structure.

categories: cond-mat.dis-nn cond-mat.stat-mech gr-qc quant-ph


title: ExpertQA: Expert-Curated Questions and Attributed Answers

abstract: As language models are adopted by a more sophisticated and diverse set of users, the importance of guaranteeing that they provide factually correct information supported by verifiable sources is critical across fields of study. This is especially the case for high-stakes fields, such as medicine and law, where the risk of propagating false information is high and can lead to undesirable societal consequences. Previous work studying attribution and factuality has not focused on analyzing these characteristics of language model outputs in domain-specific scenarios. In this work, we conduct human evaluation of responses from a few representative systems along various axes of attribution and factuality, by bringing domain experts in the loop. Specifically, we collect expert-curated questions from 484 participants across 32 fields of study, and then ask the same experts to evaluate generated responses to their own questions. In addition, we ask experts to improve upon responses from language models. The output of our analysis is ExpertQA, a high-quality long-form QA dataset with 2177 questions spanning 32 fields, along with verified answers and attributions for claims in the answers.


title: Water, not salt, causes most of the Seebeck effect of nonisothermal aqueous electrolytes

abstract: When two electrolyte-immersed electrodes have different temperatures, a voltage $\Delta \psi$ can be measured between them. This electrolyte Seebeck effect is usually explained by cations and anions flowing differently in thermal gradients. However, our molecular dynamics simulations of aqueous electrolytes reveal a large temperature-dependent potential drop $\chi$ near blocking electrodes caused by water layering and orientation. The difference in surface potentials at hot and cold electrodes is more important to the Seebeck effect than ionic thermodiffusion, $\Delta \psi \sim \chi_{\rm hot}-\chi_{\rm cold}$.


title: A Differentiable Model of the Evolution of Dark Matter Halo Concentration

abstract: We introduce a new model of the evolution of the concentration of dark matter halos, c(t). For individual halos, our model approximates c(t) as a power law with a time-dependent index, such that at early times, concentration has a nearly constant value of c=3-4, and as cosmic time progresses, c(t) smoothly increases. Using large samples of halo merger trees taken from the Bolshoi-P and MDPL2 cosmological simulations, we demonstrate that our 3-parameter model can approximate the evolution of the concentration of individual halos with a typical accuracy of 0.1 dex for t>2 Gyr for all Bolshoi-P and MDPL2 halos of present-day mass greater than 10^11.5 Msun. We additionally present a new model of the evolution of the concentration of halo populations, which we show faithfully reproduces both average concentration growth, as well as the diversity of smooth trajectories of c(t), including capturing correlations with halo mass and halo assembly history. Our publicly available source code, Diffprof, can be used to generate Monte Carlo realizations of the concentration histories of cosmologically representative halo populations; Diffprof is differentiable due to its implementation in the JAX autodiff library, which facilitates the incorporation of our model into existing analytical halo model frameworks.


title: On Distributed and Asynchronous Sampling of Gaussian Processes for Sequential Binary Hypothesis Testing

abstract: In this work, we consider a binary sequential hypothesis testing problem with distributed and asynchronous measurements. The aim is to analyze the effect of sampling times of jointly $\textit{wide-sense stationary}$ (WSS) Gaussian observation processes at distributed sensors on the expected stopping time of the sequential test at the fusion center (FC). The distributed system is such that the sensors and the FC sample observations periodically, where the sampling times are not necessarily synchronous, i.e., the sampling times at different sensors and the FC may be different from each other. The sampling times, however, are restricted to be within a time window and a sample obtained within the window is assumed to be $\textit{uncorrelated}$ with samples outside the window. We also assume that correlations may exist only between the observations sampled at the FC and those at the sensors in a pairwise manner (sensor pairs not including the FC have independent observations). The effect of $\textit{asynchronous}$ sampling on the SPRT performance is analyzed by obtaining bounds for the expected stopping time. We illustrate the validity of the theoretical results with numerical results.


title: SMARTFEAT: Efficient Feature Construction through Feature-Level Foundation Model Interactions

abstract: Before applying data analytics or machine learning to a data set, a vital step is usually the construction of an informative set of features from the data. In this paper, we present SMARTFEAT, an efficient automated feature engineering tool to assist data users, even non-experts, in constructing useful features. Leveraging the power of Foundation Models (FMs), our approach enables the creation of new features from the data, based on contextual information and open-world knowledge. Our method incorporates an intelligent operator selector that discerns a subset of operators, effectively avoiding exhaustive combinations of original features, as is typically observed in traditional automated feature engineering tools. Moreover, we address the limitations of performing data tasks through row-level interactions with FMs, which could lead to significant delays and costs due to excessive API calls. We introduce a function generator that facilitates the acquisition of efficient data transformations, such as dataframe built-in methods or lambda functions, ensuring the applicability of SMARTFEAT to generate new features for large datasets. Code repo with prompt details and datasets: (https://github.com/niceIrene/SMARTFEAT).


title: Overhead-constrained circuit knitting for variational quantum dynamics

abstract: Simulating the dynamics of large quantum systems is a formidable yet vital pursuit for obtaining a deeper understanding of quantum mechanical phenomena. While quantum computers hold great promise for speeding up such simulations, their practical application remains hindered by limited scale and pervasive noise. In this work, we propose an approach that addresses these challenges by employing circuit knitting to partition a large quantum system into smaller subsystems that can each be simulated on a separate device. The evolution of the system is governed by the projected variational quantum dynamics (PVQD) algorithm, supplemented with constraints on the parameters of the variational quantum circuit, ensuring that the sampling overhead imposed by the circuit knitting scheme remains controllable. We test our method on quantum spin systems with multiple weakly entangled blocks each consisting of strongly correlated spins, where we are able to accurately simulate the dynamics while keeping the sampling overhead manageable. Further, we show that the same method can be used to reduce the circuit depth by cutting long-ranged gates.


title: Logarithmic Sobolev inequalities for non-equilibrium steady states

abstract: We consider two methods to establish log-Sobolev inequalities for the invariant measure of a diffusion process when its density is not explicit and the curvature is not positive everywhere. In the first approach, based on the Holley-Stroock and Aida-Shigekawa perturbation arguments [16, 1], the control on the (non-explicit) perturbation is obtained by stochastic control methods, following the comparison technique introduced by Conforti [7]. The second method combines the Wasserstein-$2$ contraction method, used in [24] to prove a Poincar\'e inequality in some non-equilibrium cases, with Wang's hypercontractivity results [29].


title: Improved Distributed Algorithms for Random Colorings

abstract: Markov Chain Monte Carlo (MCMC) algorithms are a widely-used algorithmic tool for sampling from high-dimensional distributions, a notable example is the equilibirum distribution of graphical models. The Glauber dynamics, also known as the Gibbs sampler, is the simplest example of an MCMC algorithm; the transitions of the chain update the configuration at a randomly chosen coordinate at each step. Several works have studied distributed versions of the Glauber dynamics and we extend these efforts to a more general family of Markov chains. An important combinatorial problem in the study of MCMC algorithms is random colorings. Given a graph $G$ of maximum degree $\Delta$ and an integer $k\geq\Delta+1$, the goal is to generate a random proper vertex $k$-coloring of $G$. Jerrum (1995) proved that the Glauber dynamics has $O(n\log{n})$ mixing time when $k>2\Delta$. Fischer and Ghaffari (2018), and independently Feng, Hayes, and Yin (2018), presented a parallel and distributed version of the Glauber dynamics which converges in $O(\log{n})$ rounds for $k>(2+\varepsilon)\Delta$ for any $\varepsilon>0$. We improve this result to $k>(11/6-\delta)\Delta$ for a fixed $\delta>0$. This matches the state of the art for randomly sampling colorings of general graphs in the sequential setting. Whereas previous works focused on distributed variants of the Glauber dynamics, our work presents a parallel and distributed version of the more general flip dynamics presented by Vigoda (2000) (and refined by Chen, Delcourt, Moitra, Perarnau, and Postle (2019)), which recolors local maximal two-colored components in each step.


title: Identifying the Group-Theoretic Structure of Machine-Learned Symmetries

abstract: Deep learning was recently successfully used in deriving symmetry transformations that preserve important physics quantities. Being completely agnostic, these techniques postpone the identification of the discovered symmetries to a later stage. In this letter we propose methods for examining and identifying the group-theoretic structure of such machine-learned symmetries. We design loss functions which probe the subalgebra structure either during the deep learning stage of symmetry discovery or in a subsequent post-processing stage. We illustrate the new methods with examples from the U(n) Lie group family, obtaining the respective subalgebra decompositions. As an application to particle physics, we demonstrate the identification of the residual symmetries after the spontaneous breaking of non-Abelian gauge symmetries like SU(3) and SU(5) which are commonly used in model building.

categories: hep-ph cs.LG hep-th math-ph math.GR math.MP


title: CiwaGAN: Articulatory information exchange

abstract: Humans encode information into sounds by controlling articulators and decode information from sounds using the auditory apparatus. This paper introduces CiwaGAN, a model of human spoken language acquisition that combines unsupervised articulatory modeling with an unsupervised model of information exchange through the auditory modality. While prior research includes unsupervised articulatory modeling and information exchange separately, our model is the first to combine the two components. The paper also proposes an improved articulatory model with more interpretable internal representations. The proposed CiwaGAN model is the most realistic approximation of human spoken language acquisition using deep learning. As such, it is useful for cognitively plausible simulations of the human speech act.


title: Local proton heating at magnetic discontinuities in Alfvenic and non-Alfvenic solar wind

abstract: We investigate the local proton energization at magnetic discontinuities/intermittent structures and the corresponding kinetic signatures in velocity phase space in Alfv\'enic and non-Alfv\'enic wind streams observed by Parker Solar Probe. By means of the Partial Variance of Increments method, we find that the hottest proton populations are localized around compressible, kinetic-scale magnetic structures in both types of wind. Furthermore, the Alfv\'enic wind shows preferential enhancements of $T_\parallel$ as smaller scale structures are considered, whereas the non-Alfvenic wind shows preferential $T_\bot$ enhancements. Although proton beams are present in both types of wind, the proton velocity distribution function displays distinct features. Hot beams, i.e., beams with beam-to-core perpendicular temperature up to three times larger than the total distribution anisotropy, are found in the non-Alfv\'enic wind, whereas colder beams in the Alfv\'enic wind. Our data analysis is complemented by 2.5D hybrid simulations in different geometrical setups, which support the idea that proton beams in Alfv\'enic and non-Alfv\'enic wind have different kinetic properties and origins. The development of a perpendicular nonlinear cascade, favored in balanced turbulence, allows a preferential relative enhancement of the perpendicular plasma temperature and the formation of hot beams. Cold field-aligned beams are instead favored by Alfv\'en wave steepening. Non-Maxwellian distribution functions are found near discontinuities and intermittent structures, pointing to the fact that the nonlinear formation of small-scale structures is intrinsically related to the development of highly non-thermal features in collisionless plasmas.


title: Hints of point-symmetric structures in SN 1987A: the jittering jets explosion mechanism

abstract: I identify a point-symmetric structure composed of three pairs of clumps in the recently released JWST image of the ejecta of SN 1987A and argue that these pairs of clumps support the jittering jets explosion mechanism (JJEM) for SN 1987A. I compare this point-symmetric structure with the multipolar-lobe morphology of a post-asymptotic giant branch nebula. The three pairs of clumps in the post-AGB nebula are formed at the tip of jet-inflated lobes. I use this similarity to strengthen earlier claims that SN 1987A was exploded by jets in the frame of the JJEM.


title: The Rise and Potential of Large Language Model Based Agents: A Survey

abstract: For a long time, humanity has pursued artificial intelligence (AI) equivalent to or surpassing the human level, with AI agents considered a promising vehicle for this pursuit. AI agents are artificial entities that sense their environment, make decisions, and take actions. Many efforts have been made to develop intelligent agents, but they mainly focus on advancement in algorithms or training strategies to enhance specific capabilities or performance on particular tasks. Actually, what the community lacks is a general and powerful model to serve as a starting point for designing AI agents that can adapt to diverse scenarios. Due to the versatile capabilities they demonstrate, large language models (LLMs) are regarded as potential sparks for Artificial General Intelligence (AGI), offering hope for building general AI agents. Many researchers have leveraged LLMs as the foundation to build AI agents and have achieved significant progress. In this paper, we perform a comprehensive survey on LLM-based agents. We start by tracing the concept of agents from its philosophical origins to its development in AI, and explain why LLMs are suitable foundations for agents. Building upon this, we present a general framework for LLM-based agents, comprising three main components: brain, perception, and action, and the framework can be tailored for different applications. Subsequently, we explore the extensive applications of LLM-based agents in three aspects: single-agent scenarios, multi-agent scenarios, and human-agent cooperation. Following this, we delve into agent societies, exploring the behavior and personality of LLM-based agents, the social phenomena that emerge from an agent society, and the insights they offer for human society. Finally, we discuss several key topics and open problems within the field. A repository for the related papers at https://github.com/WooooDyy/LLM-Agent-Paper-List.


title: Stable iterative refinement algorithms for solving linear systems

abstract: Iterative refinement (IR) is a popular scheme for solving a linear system of equations based on gradually improving the accuracy of an initial approximation. Originally developed to improve upon the accuracy of Gaussian elimination, interest in IR has been revived because of its suitability for execution on fast low-precision hardware such as analog devices and graphics processing units. IR generally converges when the error associated with the solution method is small, but is known to diverge when this error is large. We propose and analyze a novel enhancement to the IR algorithm by adding a line search optimization step that guarantees the algorithm will not diverge. Numerical experiments verify our theoretical results and illustrate the effectiveness of our proposed scheme.


title: Gradient constrained sharpness-aware prompt learning for vision-language models

abstract: This paper targets a novel trade-off problem in generalizable prompt learning for vision-language models (VLM), i.e., improving the performance on unseen classes while maintaining the performance on seen classes. Comparing with existing generalizable methods that neglect the seen classes degradation, the setting of this problem is more strict and fits more closely with practical applications. To solve this problem, we start from the optimization perspective, and leverage the relationship between loss landscape geometry and model generalization ability. By analyzing the loss landscapes of the state-of-the-art method and vanilla Sharpness-aware Minimization (SAM) based method, we conclude that the trade-off performance correlates to both loss value and loss sharpness, while each of them is indispensable. However, we find the optimizing gradient of existing methods cannot maintain high relevance to both loss value and loss sharpness during optimization, which severely affects their trade-off performance. To this end, we propose a novel SAM-based method for prompt learning, denoted as Gradient Constrained Sharpness-aware Context Optimization (GCSCoOp), to dynamically constrain the optimizing gradient, thus achieving above two-fold optimization objective simultaneously. Extensive experiments verify the effectiveness of GCSCoOp in the trade-off problem.


title: Beta Diffusion

abstract: We introduce beta diffusion, a novel generative modeling method that integrates demasking and denoising to generate data within bounded ranges. Using scaled and shifted beta distributions, beta diffusion utilizes multiplicative transitions over time to create both forward and reverse diffusion processes, maintaining beta distributions in both the forward marginals and the reverse conditionals, given the data at any point in time. Unlike traditional diffusion-based generative models relying on additive Gaussian noise and reweighted evidence lower bounds (ELBOs), beta diffusion is multiplicative and optimized with KL-divergence upper bounds (KLUBs) derived from the convexity of the KL divergence. We demonstrate that the proposed KLUBs are more effective for optimizing beta diffusion compared to negative ELBOs, which can also be derived as the KLUBs of the same KL divergence with its two arguments swapped. The loss function of beta diffusion, expressed in terms of Bregman divergence, further supports the efficacy of KLUBs for optimization. Experimental results on both synthetic data and natural images demonstrate the unique capabilities of beta diffusion in generative modeling of range-bounded data and validate the effectiveness of KLUBs in optimizing diffusion models, thereby making them valuable additions to the family of diffusion-based generative models and the optimization techniques used to train them.


title: Cosmological constraints from low redshift 21 cm intensity mapping with machine learning

abstract: The future 21 cm intensity mapping observations constitute a promising way to trace the matter distribution of the Universe and probe cosmology. Here we assess its capability for cosmological constraints using as a case study the BINGO radio telescope, that will survey the Universe at low redshifts ($0.13 < z < 0.45$). We use neural networks (NNs) to map summary statistics, namely, the angular power spectrum (APS) and the Minkowski functionals (MFs), calculated from simulations into cosmological parameters. Our simulations span a wide grid of cosmologies, sampled under the $\Lambda$CDM scenario, {$\Omega_c, h$}, and under an extension assuming the Chevallier-Polarski-Linder (CPL) parameterization, {$\Omega_c, h, w_0, w_a$}. In general, NNs trained over APS outperform those using MFs, while their combination provides 27% (5%) tighter error ellipse in the $\Omega_c-h$ plane under the $\Lambda$CDM scenario (CPL parameterization) compared to the individual use of the APS. Their combination allows predicting $\Omega_c$ and $h$ with 4.9% and 1.6% fractional errors, respectively, which increases to 6.4% and 3.7% under CPL parameterization. Although we find large bias on $w_a$ estimates, we still predict $w_0$ with 24.3% error. We also confirm our results to be robust to foreground contamination, besides finding the instrumental noise to cause the greater impact on the predictions. Still, our results illustrate the capability of future low redshift 21 cm observations in providing competitive cosmological constraints using NNs, showing the ease of combining different summary statistics.


title: Nuclear Recoil Identification in a Scientific Charge-Coupled Device

abstract: Charge-coupled devices (CCDs) are a leading technology in direct dark matter searches because of their eV-scale energy threshold and high spatial resolution. The sensitivity of future CCD experiments could be enhanced by distinguishing nuclear recoil signals from electronic recoil backgrounds in the CCD silicon target. We present a technique for event-by-event identification of nuclear recoils based on the spatial correlation between the primary ionization event and the lattice defect left behind by the recoiling atom, later identified as a localized excess of leakage current under thermal stimulation. By irradiating a CCD with an $^{241}$Am$^{9}$Be neutron source, we demonstrate $>93\%$ identification efficiency for nuclear recoils with energies $>150$ keV, where the ionization events were confirmed to be nuclear recoils from topology. The technique remains fully efficient down to 90 keV, decreasing to 50$\%$ at 8 keV, and reaching ($6\pm2$)$\%$ at 1.5--3.5 keV. Irradiation with a $^{24}$Na $\gamma$-ray source shows no evidence of defect generation by electronic recoils, with the fraction of electronic recoils with energies $<85$ keV that are spatially correlated with defects $<0.1$$\%$.

categories: physics.ins-det astro-ph.CO hep-ex nucl-ex


title: Agents: An Open-source Framework for Autonomous Language Agents

abstract: Recent advances on large language models (LLMs) enable researchers and developers to build autonomous language agents that can automatically solve various tasks and interact with environments, humans, and other agents using natural language interfaces. We consider language agents as a promising direction towards artificial general intelligence and release Agents, an open-source library with the goal of opening up these advances to a wider non-specialist audience. Agents is carefully engineered to support important features including planning, memory, tool usage, multi-agent communication, and fine-grained symbolic control. Agents is user-friendly as it enables non-specialists to build, customize, test, tune, and deploy state-of-the-art autonomous language agents without much coding. The library is also research-friendly as its modularized design makes it easily extensible for researchers. Agents is available at https://github.com/aiwaves-cn/agents.


title: Gradient Dynamics in Linear Quadratic Network Games with Time-Varying Connectivity and Population Fluctuation

abstract: In this paper, we consider a learning problem among non-cooperative agents interacting in a time-varying system. Specifically, we focus on repeated linear quadratic network games, in which the network of interactions changes with time and agents may not be present at each iteration. To get tractability, we assume that at each iteration, the network of interactions is sampled from an underlying random network model and agents participate at random with a given probability. Under these assumptions, we consider a gradient-based learning algorithm and establish almost sure convergence of the agents' strategies to the Nash equilibrium of the game played over the expected network. Additionally, we prove, in the large population regime, that the learned strategy is an $\epsilon$-Nash equilibrium for each stage game with high probability. We validate our results over an online market application.


title: A Unified Perspective on Multiple Shooting In Differential Dynamic Programming

abstract: Differential Dynamic Programming (DDP) is an efficient computational tool for solving nonlinear optimal control problems. It was originally designed as a single shooting method and thus is sensitive to the initial guess supplied. This work considers the extension of DDP to multiple shooting (MS), improving its robustness to initial guesses. A novel derivation is proposed that accounts for the defect between shooting segments during the DDP backward pass, while still maintaining quadratic convergence locally. The derivation enables unifying multiple previous MS algorithms, and opens the door to many smaller algorithmic improvements. A penalty method is introduced to strategically control the step size, further improving the convergence performance. An adaptive merit function and a more reliable acceptance condition are employed for globalization. The effects of these improvements are benchmarked for trajectory optimization with a quadrotor, an acrobot, and a manipulator. MS-DDP is also demonstrated for use in Model Predictive Control (MPC) for dynamic jumping with a quadruped robot, showing its benefits over a single shooting approach.


title: Optimally Controlling the Timing of Energy Transfer in Elastic Joints: Experimental Validation of the Bi-Stiffness Actuation Concept

abstract: Elastic actuation taps into elastic elements' energy storage for dynamic motions beyond rigid actuation. While Series Elastic Actuators (SEA) and Variable Stiffness Actuators (VSA) are highly sophisticated, they do not fully provide control over energy transfer timing. To overcome this problem on the basic system level, the Bi-Stiffness Actuation (BSA) concept was recently proposed. Theoretically, it allows for full link decoupling, while simultaneously being able to lock the spring in the drive train via a switch-and-hold mechanism. Thus, the user would be in full control of the potential energy storage and release timing. In this work, we introduce an initial proof-of-concept of Bi-Stiffness-Actuation in the form of a 1-DoF physical prototype, which is implemented using a modular testbed. We present a hybrid system model, as well as the mechatronic implementation of the actuator. We corroborate the feasibility of the concept by conducting a series of hardware experiments using an open-loop control signal obtained by trajectory optimization. Here, we compare the performance of the prototype with a comparable SEA implementation. We show that BSA outperforms SEA 1) in terms of maximum velocity at low final times and 2) in terms of the movement strategy itself: The clutch mechanism allows the BSA to generate consistent launch sequences while the SEA has to rely on lengthy and possibly dangerous oscillatory swing-up motions. Furthermore, we demonstrate that providing full control authority over the energy transfer timing and link decoupling allows the user to synchronously release both elastic joint and gravitational energy. This facilitates the optimal exploitation of elastic and gravitational potentials in a synergistic manner.


title: Ca$^2$Lib: Simple and Accurate LiDAR-RGB Calibration using Small Common Markers

abstract: In many fields of robotics, knowing the relative position and orientation between two sensors is a mandatory precondition to operate with multiple sensing modalities. In this context, the pair LiDAR-RGB cameras offer complementary features: LiDARs yield sparse high quality range measurements, while RGB cameras provide a dense color measurement of the environment. Existing techniques often rely either on complex calibration targets that are expensive to obtain, or extracted virtual correspondences that can hinder the estimate's accuracy. In this paper we address the problem of LiDAR-RGB calibration using typical calibration patterns (i.e. A3 chessboard) with minimal human intervention. Our approach exploits the planarity of the target to find correspondences between the sensors measurements, leading to features that are robust to LiDAR noise. Moreover, we estimate a solution by solving a joint non-linear optimization problem. We validated our approach by carrying on quantitative and comparative experiments with other state-of-the-art approaches. Our results show that our simple schema performs on par or better than other approches using complex calibration targets. Finally, we release an open-source C++ implementation at \url{https://github.com/srrg-sapienza/ca2lib}


title: Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructions

abstract: Training large language models to follow instructions makes them perform better on a wide range of tasks and generally become more helpful. However, a perfectly helpful model will follow even the most malicious instructions and readily generate harmful content. In this paper, we raise concerns over the safety of models that only emphasize helpfulness, not harmlessness, in their instruction-tuning. We show that several popular instruction-tuned models are highly unsafe. Moreover, we show that adding just 3% safety examples (a few hundred demonstrations) when fine-tuning a model like LLaMA can substantially improve its safety. Our safety-tuning does not make models significantly less capable or helpful as measured by standard benchmarks. However, we do find exaggerated safety behaviours, where too much safety-tuning makes models refuse perfectly safe prompts if they superficially resemble unsafe ones. As a whole, our results illustrate trade-offs in training LLMs to be helpful and training them to be safe.


title: Particle-hole asymmetric ferromagnetism and spin textures in the triangular Hubbard-Hofstadter model

abstract: In a lattice model subject to a perpendicular magnetic field, when the lattice constant is comparable to the magnetic length, one enters the "Hofstadter regime," where continuum Landau levels become fractal magnetic Bloch bands. Strong mixing between bands alters the nature of the resulting quantum phases compared to the continuum limit; lattice potential, magnetic field, and Coulomb interaction must be treated on equal footing. Using determinant quantum Monte Carlo (DQMC) and density matrix renormalization group (DMRG) techniques, we study this regime numerically in the context of the Hubbard-Hofstadter model on a triangular lattice. In the field-filling phase diagram, we find a broad wedge-shaped region of ferromagnetic ground states for filling factor $\nu \leq 1$, bounded below by filling factor $\nu = 1$ and bounded above by half-filling the lowest Hofstadter subband. We observe signatures of SU(2) quantum Hall ferromagnetism at filling factors $\nu=1$ and $\nu=3$. The phases near $\nu=1$ are particle-hole asymmetric, and we observe a rapid decrease in ground state spin polarization consistent with the formation of skyrmions only on the electron doped side. At large fields, above the ferromagnetic wedge, we observe a low-spin metallic region with spin correlations peaked at small momenta. We argue that the phenomenology of this region likely results from exchange interaction mixing fractal Hofstadter subbands. The phase diagram derived beyond the continuum limit points to a rich landscape to explore interaction effects in magnetic Bloch bands.


title: Mean-field games of speedy information access with observation costs

abstract: We investigate mean-field games (MFG) in which agents can actively control their speed of access to information. Specifically, the agents can dynamically decide to obtain observations with reduced delay by accepting higher observation costs. Agents seek to exploit their active information acquisition by making further decisions to influence their state dynamics so as to maximise rewards. In a mean-field equilibrium, each generic agent solves individually a partially observed Markov decision problem in which the way partial observations are obtained is itself subject to dynamic control actions, while no agent can improve unilaterally given the actions of all others. Based on a finite characterisation of belief states, we show how the mean-field game with controlled costly information access can be formulated as an equivalent standard mean-field game on an augmented but finite state space. With sufficient entropy regularisation, a fixed point iteration converges to the unique MFG equilibrium. Moreover, we derive an approximate $\varepsilon$-Nash equilibrium for a large but finite population size and small regularisation parameter. We illustrate our (extended) MFG of information access and of controls by an example from epidemiology, where medical testing results can be procured at different speeds and costs.


title: Using network metrics to explore the community structure that underlies movement patterns

abstract: This work aims to explore the community structure of Santiago de Chile by analyzing the movement patterns of its residents. We use a dataset containing the approximate locations of home and work places for a subset of anonymized residents to construct a network that represents the movement patterns within the city. Through the analysis of this network, we aim to identify the communities or sub-cities that exist within Santiago de Chile and gain insights into the factors that drive the spatial organization of the city. We employ modularity optimization algorithms and clustering techniques to identify the communities within the network. Our results present that the novelty of combining community detection algorithms with segregation tools provides new insights to further the understanding of the complex geography of segregation during working hours.


title: Acceleration by Stepsize Hedging I: Multi-Step Descent and the Silver Stepsize Schedule

abstract: Can we accelerate convergence of gradient descent without changing the algorithm -- just by carefully choosing stepsizes? Surprisingly, we show that the answer is yes. Our proposed Silver Stepsize Schedule optimizes strongly convex functions in $k^{\log_{\rho} 2} \approx k^{0.7864}$ iterations, where $\rho=1+\sqrt{2}$ is the silver ratio and $k$ is the condition number. This is intermediate between the textbook unaccelerated rate $k$ and the accelerated rate $\sqrt{k}$ due to Nesterov in 1983. The non-strongly convex setting is conceptually identical, and standard black-box reductions imply an analogous accelerated rate $\varepsilon^{-\log_{\rho} 2} \approx \varepsilon^{-0.7864}$. We conjecture and provide partial evidence that these rates are optimal among all possible stepsize schedules. The Silver Stepsize Schedule is constructed recursively in a fully explicit way. It is non-monotonic, fractal-like, and approximately periodic of period $k^{\log_{\rho} 2}$. This leads to a phase transition in the convergence rate: initially super-exponential (acceleration regime), then exponential (saturation regime).


title: mEBAL2 Database and Benchmark: Image-based Multispectral Eyeblink Detection

abstract: This work introduces a new multispectral database and novel approaches for eyeblink detection in RGB and Near-Infrared (NIR) individual images. Our contributed dataset (mEBAL2, multimodal Eye Blink and Attention Level estimation, Version 2) is the largest existing eyeblink database, representing a great opportunity to improve data-driven multispectral approaches for blink detection and related applications (e.g., attention level estimation and presentation attack detection in face biometrics). mEBAL2 includes 21,100 image sequences from 180 different students (more than 2 million labeled images in total) while conducting a number of e-learning tasks of varying difficulty or taking a real course on HTML initiation through the edX MOOC platform. mEBAL2 uses multiple sensors, including two Near-Infrared (NIR) and one RGB camera to capture facial gestures during the execution of the tasks, as well as an Electroencephalogram (EEG) band to get the cognitive activity of the user and blinking events. Furthermore, this work proposes a Convolutional Neural Network architecture as benchmark for blink detection on mEBAL2 with performances up to 97%. Different training methodologies are implemented using the RGB spectrum, NIR spectrum, and the combination of both to enhance the performance on existing eyeblink detectors. We demonstrate that combining NIR and RGB images during training improves the performance of RGB eyeblink detectors (i.e., detection based only on a RGB image). Finally, the generalization capacity of the proposed eyeblink detectors is validated in wilder and more challenging environments like the HUST-LEBW dataset to show the usefulness of mEBAL2 to train a new generation of data-driven approaches for eyeblink detection.


title: The cost of solving linear differential equations on a quantum computer: fast-forwarding to explicit resource counts

abstract: How well can quantum computers simulate classical dynamical systems? There is increasing effort in developing quantum algorithms to efficiently simulate dynamics beyond Hamiltonian simulation, but so far exact resource estimates are not known. In this work, we provide two significant contributions. First, we give the first non-asymptotic computation of the cost of encoding the solution to general linear ordinary differential equations into quantum states -- either the solution at a final time, or an encoding of the whole history within a time interval. Second, we show that the stability properties of a large class of classical dynamics allow their fast-forwarding, making their quantum simulation much more time-efficient. From this point of view, quantum Hamiltonian dynamics is a boundary case that does not allow this form of stability-induced fast-forwarding. In particular, we find that the history state can always be output with complexity $O(T^{1/2})$ for any stable linear system. We present a range of asymptotic improvements over state-of-the-art in various regimes. We illustrate our results with a family of dynamics including linearized collisional plasma problems, coupled, damped, forced harmonic oscillators and dissipative nonlinear problems. In this case the scaling is quadratically improved, and leads to significant reductions in the query counts after inclusion of all relevant constant prefactors.


title: Scalable Model-Based Gaussian Process Clustering

abstract: Gaussian process is an indispensable tool in clustering functional data, owing to it's flexibility and inherent uncertainty quantification. However, when the functional data is observed over a large grid (say, of length $p$), Gaussian process clustering quickly renders itself infeasible, incurring $O(p^2)$ space complexity and $O(p^3)$ time complexity per iteration; and thus prohibiting it's natural adaptation to large environmental applications. To ensure scalability of Gaussian process clustering in such applications, we propose to embed the popular Vecchia approximation for Gaussian processes at the heart of the clustering task, provide crucial theoretical insights towards algorithmic design, and finally develop a computationally efficient expectation maximization (EM) algorithm. Empirical evidence of the utility of our proposal is provided via simulations and analysis of polar temperature anomaly (\href{https://www.ncei.noaa.gov/access/monitoring/climate-at-a-glance/global/time-series}{noaa.gov}) data-sets.


title: Laser-pump-resistive-probe technique to study nanosecond-scale relaxation processes

abstract: Standard optical pump-probe methods analyze a system's temporal response to a laser pulse within sub-femtoseconds to several nanoseconds, constrained by the optical delay line's length. While resistance is a sensitive detector in various fields, its measurements are typically slow (>microseconds) due to stabilization requirements. We suggest here a time-resolved pump-probe technique which combines an optical pump pulse and a rectangular electrical probe pulse through the sample, measuring transmission in a 50 Ohm matched circuit with a digital oscilloscope. This allows electrically-driven delays from nanoseconds to seconds. Demonstrations include studying heat-induced changes in a thin amorphous VO$_x$ film and carrier relaxation in a CdS photoresistor, showcasing potential applications in heat transfer, biochemical reactions, and gradual electronic transformations.


title: Single-soft emissions for amplitudes with two colored particles at three loops

abstract: We compute the three-loop correction to the universal single-soft emission current for the case of scattering amplitudes with two additional color-charged partons. We present results valid for QCD and $\mathcal{N}=4$ super-symmetric Yang-Mills theory. To achieve our results we develop a new integrand expansion technique for scattering amplitudes in the presence of soft emissions. Furthermore, we obtain contributions from single final-state parton matrix elements to the Higgs boson and Drell-Yan production cross section at next-to-next-to-next-to-next-to leading order (N$^4$LO) in perturbative QCD in the threshold limit.


title: Generating Sets and Algebraic Properties of Pure Mapping Class Groups of Infinite Graphs

abstract: We completely classify the locally finite, infinite graphs with pure mapping class groups admitting a coarsely bounded generating set. We also study algebraic properties of the pure mapping class group: We establish a semidirect product decomposition, compute first integral cohomology, and classify when they satisfy residual finiteness and the Tits alternative. These results provide a framework and some initial steps towards quasi-isometric and algebraic rigidity of these groups.


title: Vortex Lattices in Active Nematics with Periodic Obstacle Arrays

abstract: We numerically model a two-dimensional active nematic confined by a periodic array of fixed obstacles. Even in the passive nematic, the appearance of topological defects is unavoidable due to planar anchoring by the obstacle surfaces. We show that a vortex lattice state emerges as activity is increased, and that this lattice may be tuned from ``ferromagnetic'' to ``antiferromagnetic'' by varying the gap size between obstacles. We map the rich variety of states exhibited by the system as a function of distance between obstacles and activity, including a pinned defect state, motile defects, the vortex lattice, and active turbulence. We demonstrate that the flows in the active turbulent phase can be tuned by the presence of obstacles, and explore the effects of a frustrated lattice geometry on the vortex lattice phase.


title: Some notes concerning a generalized KMM-type optimization method for density ratio estimation

abstract: In the present paper we introduce new optimization algorithms for the task of density ratio estimation. More precisely, we consider extending the well-known KMM method using the construction of a suitable loss function, in order to encompass more general situations involving the estimation of density ratio with respect to subsets of the training data and test data, respectively. The associated codes can be found at https://github.com/CDAlecsa/Generalized-KMM.


title: A Novel Local-Global Feature Fusion Framework for Body-weight Exercise Recognition with Pressure Mapping Sensors

abstract: We present a novel local-global feature fusion framework for body-weight exercise recognition with floor-based dynamic pressure maps. One step further from the existing studies using deep neural networks mainly focusing on global feature extraction, the proposed framework aims to combine local and global features using image processing techniques and the YOLO object detection to localize pressure profiles from different body parts and consider physical constraints. The proposed local feature extraction method generates two sets of high-level local features consisting of cropped pressure mapping and numerical features such as angular orientation, location on the mat, and pressure area. In addition, we adopt a knowledge distillation for regularization to preserve the knowledge of the global feature extraction and improve the performance of the exercise recognition. Our experimental results demonstrate a notable 11 percent improvement in F1 score for exercise recognition while preserving label-specific features.


title: Morphological stability for in silico models of avascular tumors

abstract: The landscape of computational modeling in cancer systems biology is diverse, offering a spectrum of models and frameworks, each with its own trade-offs and advantages. Ideally, models are meant to be useful in refining hypotheses, to sharpen experimental procedures and, in the longer run, even for applications in personalized medicine. One of the greatest challenges is to balance model realism and detail with experimental data to eventually produce useful data-driven models. We contribute to this quest by developing a transparent, highly parsimonious, first principles silico model of a growing avascular tumor. We initially formulate the physiological considerations and the specific model within a stochastic cell-based framework. We next formulate a corresponding mean-field model using partial differential equations which is amenable to mathematical analysis. Despite a few notable differences between the two models, we are in this way able to successfully detail the impact of all parameters in the stability of the growth process and on the eventual tumor fate of the stochastic model. This facilitates the deduction of Bayesian priors for a given situation, but also provides important insights into the underlying mechanism of tumor growth and progression. Although the resulting model framework is relatively simple and transparent, it can still reproduce the full range of known emergent behavior. We identify a novel model instability arising from nutrient starvation and we also discuss additional insight concerning possible model additions and the effects of those. Thanks to the framework's flexibility, such additions can be readily included whenever the relevant data become available.


title: Exploring the covariant form factors for spin-1 particles

abstract: The spin-1 particles is an admirable two quarks bound state system to understand electromagnetic properties from hadronic states. These systems are generally relativistic, and therefore, need an approach using quantum field theory. In the present work, we will use both the quantum field theory at the instant form, as well, quantum field theory on the light-front~(LFQFT). In general, it is used to calculate the electromagnetic properties of spin-1 vector particles in the LFQFT formalism, with the plus component of the electromagnetic current. In the present work, we used, in addition to the plus component of the electromagnetic current; the minus component of the current, and we use that components o the current, to extract the covariant form factors; showing that to have an equivalence between these we need to add non-valence terms to the electromagnetic current, in order to restore the covariance, and obtain exactly the same results when using the instant form quantum field theory.


title: HandNeRF: Learning to Reconstruct Hand-Object Interaction Scene from a Single RGB Image

abstract: This paper presents a method to learn hand-object interaction prior for reconstructing a 3D hand-object scene from a single RGB image. The inference as well as training-data generation for 3D hand-object scene reconstruction is challenging due to the depth ambiguity of a single image and occlusions by the hand and object. We turn this challenge into an opportunity by utilizing the hand shape to constrain the possible relative configuration of the hand and object geometry. We design a generalizable implicit function, HandNeRF, that explicitly encodes the correlation of the 3D hand shape features and 2D object features to predict the hand and object scene geometry. With experiments on real-world datasets, we show that HandNeRF is able to reconstruct hand-object scenes of novel grasp configurations more accurately than comparable methods. Moreover, we demonstrate that object reconstruction from HandNeRF ensures more accurate execution of downstream tasks, such as grasping and motion planning for robotic hand-over and manipulation. The code is released here: https://github.com/SamsungLabs/HandNeRF


title: Pseudoscalar current and covariance with the light-front approach

abstract: Quantum Field Theory (QFT) is used to describe the physics of particles in terms of their fundamental constituents. The Light-Front Field Theory~(LFFT), introduced by Paul Dirac in 1949, is an alternative approach to solve some of the problems that arise in quantum field theory. The LFFT is similar to the Equal Time Quantum Field Theory~(EQT), however, some particularities are not, such as the loss of covariance in the light-front. Pion electromagnetic form factor is studied in this work at lower and higher momentum transfer regions to explore the constituent quark models and the differences among these and other models. The electromagnetic current is calculated with both the ``plus'' and ``minus'' components in the light-front approach. The results are compared with other models, as well as with experimental data.


title: Choosing a Proxy Metric from Past Experiments

abstract: In many randomized experiments, the treatment effect of the long-term metric (i.e. the primary outcome of interest) is often difficult or infeasible to measure. Such long-term metrics are often slow to react to changes and sufficiently noisy they are challenging to faithfully estimate in short-horizon experiments. A common alternative is to measure several short-term proxy metrics in the hope they closely track the long-term metric -- so they can be used to effectively guide decision-making in the near-term. We introduce a new statistical framework to both define and construct an optimal proxy metric for use in a homogeneous population of randomized experiments. Our procedure first reduces the construction of an optimal proxy metric in a given experiment to a portfolio optimization problem which depends on the true latent treatment effects and noise level of experiment under consideration. We then denoise the observed treatment effects of the long-term metric and a set of proxies in a historical corpus of randomized experiments to extract estimates of the latent treatment effects for use in the optimization problem. One key insight derived from our approach is that the optimal proxy metric for a given experiment is not apriori fixed; rather it should depend on the sample size (or effective noise level) of the randomized experiment for which it is deployed. To instantiate and evaluate our framework, we employ our methodology in a large corpus of randomized experiments from an industrial recommendation system and construct proxy metrics that perform favorably relative to several baselines.


title: Collective non-Hermitian skin effect: Point-gap topology and the doublon-holon excitations in non-reciprocal many-body systems

abstract: Open quantum systems provide a plethora of exotic topological phases of matter that has no Hermitian counterpart. Non-Hermitian skin effect, macroscopic collapse of bulk states to the boundary, has been extensively studied in various experimental platforms. However, it remains an open question whether such topological phases persist in the presence of many-body interactions. Notably, previous studies have shown that the Pauli exclusion principle suppresses the skin effect. In this study, we present a compelling counterexample by demonstrating the presence of the skin effect in doublon-holon excitations. While the ground state of the spin-half Hatano-Nelson model shows no skin effect, the doublon-holon pairs, as its collective excitations, display the many-body skin effect even in strong coupling limit. We rigorously establish the robustness of this effect by revealing a bulk-boundary correspondence mediated by the point gap topology within the many-body energy spectrum. Our findings underscore the existence of non-Hermitian topological phases in collective excitations of many-body interacting systems.


title: Investigating HLB control strategies using Genetic Algorithms: A two-orchard model approach with ACP Dispersal

abstract: This study focuses on the use of genetic algorithms to optimize control parameters in two potential strategies called mechanical and chemical control, for mitigating the spread of Huanglongbing (HLB) in citrus orchards. By developing a two-orchard model that incorporates the dispersal of the Asian Citrus Psyllid (ACP), the cost functions and objective function are explored to assess the effectiveness of the proposed control strategies. The mobility of ACP is also taken into account to capture the disease dynamics more realistically. Additionally, a mathematical expression for the global reproduction number ($R_{0}$) is derived, allowing for sensitivity analysis of the model parameters when ACP mobility is present. Furthermore, we mathematically express the cost function and efficiency of the strategy in terms of the final size and individual $R_{0}$ of each patch (i.e., when ACP mobility is absent). The results obtained through the genetic algorithms reveal optimal parameters for each control strategy, providing valuable insights for decision-making in implementing effective control measures against HLB in citrus orchards. This study highlights the importance of optimizing control parameters in disease management in agriculture and provides a solid foundation for future research in developing disease control strategies based on genetic algorithms.


title: Dark Matter Direct Detection in $t$-channel mediator models

abstract: We perform a comprehensive study of the Direct Detection phenomenology of singlet Dark Matter $t$-channel portal models. For that purpose, we present a complete one-loop matching onto a Heavy Dark-Matter Effective Field Theory, leading to a complete computation of the loop induced direct detection cross-section for both scalar and fermionic Dark Matter candidates. The results are compared with current and future bounds from Direct Detection experiments, as well as with the requirement of the correct Dark Matter relic density.


title: Nash equilibrium seeking over digraphs with row-stochastic matrices and network-independent step-sizes

abstract: In this paper, we address the challenge of Nash equilibrium (NE) seeking in non-cooperative convex games with partial-decision information. We propose a distributed algorithm, where each agent refines its strategy through projected-gradient steps and an averaging procedure. Each agent uses estimates of competitors' actions obtained solely from local neighbor interactions, in a directed communication network. Unlike previous approaches that rely on (strong) monotonicity assumptions, this work establishes the convergence towards a NE under a diagonal dominance property of the pseudo-gradient mapping, that can be checked locally by the agents. Further, this condition is physically interpretable and of relevance for many applications, as it suggests that an agent's objective function is primarily influenced by its individual strategic decisions, rather than by the actions of its competitors. In virtue of a novel block-infinity norm convergence argument, we provide explicit bounds for constant step-size that are independent of the communication structure, and can be computed in a totally decentralized way. Numerical simulations on an optical network's power control problem validate the algorithm's effectiveness.


title: Single 5-nm quantum dot detection via microtoroid optical resonator photothermal microscopy

abstract: Label-free detection techniques for single particles and molecules play an important role in basic science, disease diagnostics, and nanomaterial investigations. While traditional fluorescence-based methods offer powerful tools for single molecule detection and imaging, they are limited by a narrow range of molecular probes and issues such as photoblinking and photobleaching. Photothermal microscopy has emerged as a label-free imaging technique capable of detecting individual nanoabsorbers with high sensitivity. Whispering gallery mode microresonators can confine light in a small volume for enhanced light-matter interaction and thus are a promising ultra-sensitive photothermal microscopy platform. Previously microtoroid optical resonators were combined with photothermal microscopy to detect 250 nm long gold nanorods. Here, we combine whispering gallery mode microtoroid optical resonators with photothermal microscopy to spatially detect 5 nm diameter quantum dots (QDs) with a signal-to-noise ratio (SNR) exceeding $10^4$. To achieve this, we integrated our microtoroid based photothermal microscopy setup with a low amplitude modulated pump laser and utilized the proportional-integral-derivative (PID) controller output as the photothermal signal source to reduce noise and enhance signal stability. The measured heat dissipation of these 5 nm QDs is below the detectable level from single dye molecules, showcasing the high sensitivity and discrimination capabilities of this platform. We anticipate that our work will have application in a wide variety of fields, including the biological sciences, nanotechnology, materials science, chemistry, and medicine.


title: Improving physics-informed DeepONets with hard constraints

abstract: Current physics-informed (standard or deep operator) neural networks still rely on accurately learning the initial and/or boundary conditions of the system of differential equations they are solving. In contrast, standard numerical methods involve such conditions in computations without needing to learn them. In this study, we propose to improve current physics-informed deep learning strategies such that initial and/or boundary conditions do not need to be learned and are represented exactly in the predicted solution. Moreover, this method guarantees that when a deep operator network is applied multiple times to time-step a solution of an initial value problem, the resulting function is at least continuous.


title: Ambiguity-Aware In-Context Learning with Large Language Models

abstract: In-context learning (ICL) i.e. showing LLMs only a few task-specific demonstrations has led to downstream gains with no task-specific fine-tuning required. However, LLMs are sensitive to the choice of prompts, and therefore a crucial research question is how to select good demonstrations for ICL. One effective strategy is leveraging semantic similarity between the ICL demonstrations and test inputs by using a text retriever, which however is sub-optimal as that does not consider the LLM's existing knowledge about that task. From prior work (Lyu et al., 2023), we already know that labels paired with the demonstrations bias the model predictions. This leads us to our hypothesis whether considering LLM's existing knowledge about the task, especially with respect to the output label space can help in a better demonstration selection strategy. Through extensive experimentation on three text classification tasks, we find that it is beneficial to not only choose semantically similar ICL demonstrations but also to choose those demonstrations that help resolve the inherent label ambiguity surrounding the test example. Interestingly, we find that including demonstrations that the LLM previously mis-classified and also fall on the test example's decision boundary, brings the most performance gain.


title: ACC for $F$-signature: a likely counterexample

abstract: Let $\mathscr{k}=\overline{\mathbb{F}_2}$ and let $0\neq\alpha\in \mathscr{k}$. We present a conjecture supported by computer experimentation involving the Brenner-Monsky quartic $g_\alpha=\alpha x^2y^2+z^4+xyz^2+(x^3+y^3)z\in \mathscr{k}[[x,y,z]]$. If true, this conjecture provides a formula for the Hilbert-Kunz multiplicity and $F$-signature of the family of four-dimensional hypersurfaces defined by $uv+g_\alpha\in \mathscr{k}[[x,y,z,u,v]]$ which depends on $[\mathbb{F}_2(\alpha):\mathbb{F}_2]$, giving an infinite increasing chain of strict inequalities of $F$-signatures. Additionally, we obtain for any $t\in\mathbb{N}$ a formula for the Hilbert-Kunz multiplicity and $F$-signature of the $t$-parameter family of $3t+1$-dimensional hypersurfaces defined by $uv+\sum\limits_{i=1}^t g_{\alpha_i}(x_i,y_i,z_i)$.


title: The Adjoint Is All You Need: Characterizing Barren Plateaus in Quantum Ans\"atze

abstract: Using tools from the representation theory of compact Lie groups, we formulate a theory of Barren Plateaus (BPs) for parameterized quantum circuits whose observables lie in their dynamical Lie algebra (DLA), a setting that we term Lie algebra Supported Ansatz (LASA). A large variety of commonly used ans\"atze such as the Hamiltonian Variational Ansatz, Quantum Alternating Operator Ansatz, and many equivariant quantum neural networks are LASAs. In particular, our theory provides, for the first time, the ability to compute the variance of the gradient of the cost function of the quantum compound ansatz. We rigorously prove that, for LASA, the variance of the gradient of the cost function, for a 2-design of the dynamical Lie group, scales inversely with the dimension of the DLA, which agrees with existing numerical observations. In addition, to motivate the applicability of our results for 2-designs to practical settings, we show that rapid mixing occurs for LASAs with polynomial DLA. Lastly, we include potential extensions for handling cases when the observable lies outside of the DLA and the implications of our results.


title: Shell-model study for allowed and forbidden $\beta^-$ decay properties in the "south" region of $^{208}$Pb

abstract: The large-scale shell-model calculations have been performed for the neutron-rich nuclei in the south region of $^{208}$Pb in the nuclear chart. The weak interaction properties, such as the $\log ft$, average shape factor values, half-lives, and neutron emission probabilities, are calculated for these neutron-rich nuclei with the help of newly developed effective interaction [Yuan et al., Phys. Rev. C 106, 044314 (2022)] for $^{208}$Pb region. These calculations have been performed without truncation for a particular model space, however, for some nuclei, a certain truncation has been employed and particle-hole excitations are included in the case of core-breaking nuclei. An extensive comparison with the experimental data has been made and spin parities of several states have been proposed. In this study, we have considered 270 transitions.


title: Diffeomorphism on-shell breaking from radion stabilization

abstract: We present for the first time the nonlinear diffeomorphism in the Randall Sundrum model that can keep the effective Lagrangian invariant in any order of expansion. We will show that the off-shell diffeomorphism shapes the interaction structure. However the radion mass is in fact protected by an on-shell diffeomorphism, which can be spontaneously broken by the Goldberger-Wise mechanism. The nonlinear property of diffeomorphism also ensures a unique radion field even in the extension of RS model with intermediate branes.


title: On an induced version of Menger's theorem

abstract: We prove Menger-type results in which the obtained paths are pairwise non-adjacent, both for graphs of bounded maximum degree and, more generally, for graphs excluding a topological minor. We further show better bounds in the subcubic case, and in particular obtain a tight result for two paths using a computer-assisted proof.


title: Generative Image Dynamics

abstract: We present an approach to modeling an image-space prior on scene motion. Our prior is learned from a collection of motion trajectories extracted from real video sequences depicting natural, oscillatory dynamics such as trees, flowers, candles, and clothes swaying in the wind. We model this dense, long-term motion prior in the Fourier domain:given a single image, our trained model uses a frequency-coordinated diffusion sampling process to predict a spectral volume, which can be converted into a motion texture that spans an entire video. Along with an image-based rendering module, these trajectories can be used for a number of downstream applications, such as turning still images into seamlessly looping videos, or allowing users to realistically interact with objects in real pictures by interpreting the spectral volumes as image-space modal bases, which approximate object dynamics.


title: Physically Plausible Full-Body Hand-Object Interaction Synthesis

abstract: We propose a physics-based method for synthesizing dexterous hand-object interactions in a full-body setting. While recent advancements have addressed specific facets of human-object interactions, a comprehensive physics-based approach remains a challenge. Existing methods often focus on isolated segments of the interaction process and rely on data-driven techniques that may result in artifacts. In contrast, our proposed method embraces reinforcement learning (RL) and physics simulation to mitigate the limitations of data-driven approaches. Through a hierarchical framework, we first learn skill priors for both body and hand movements in a decoupled setting. The generic skill priors learn to decode a latent skill embedding into the motion of the underlying part. A high-level policy then controls hand-object interactions in these pretrained latent spaces, guided by task objectives of grasping and 3D target trajectory following. It is trained using a novel reward function that combines an adversarial style term with a task reward, encouraging natural motions while fulfilling the task incentives. Our method successfully accomplishes the complete interaction task, from approaching an object to grasping and subsequent manipulation. We compare our approach against kinematics-based baselines and show that it leads to more physically plausible motions.


title: Visualizing MAC and IPv6 Address Allocations

abstract: In this work, I describe a method for visualizing two types of network address allocations: Media Access Control (MAC) addresses -- hardware identifiers permanently assigned to network interfaces -- and Internet Protocol Version 6 (IPv6) allocations -- subnetworks assigned from a larger, encompassing network (e.g., allocated /64 networks from a /48 network).


title: DiffAug: Enhance Unsupervised Contrastive Learning with Domain-Knowledge-Free Diffusion-based Data Augmentation

abstract: Unsupervised Contrastive learning has gained prominence in fields such as vision, and biology, leveraging predefined positive/negative samples for representation learning. Data augmentation, categorized into hand-designed and model-based methods, has been identified as a crucial component for enhancing contrastive learning. However, hand-designed methods require human expertise in domain-specific data while sometimes distorting the meaning of the data. In contrast, generative model-based approaches usually require supervised or large-scale external data, which has become a bottleneck constraining model training in many domains. To address the problems presented above, this paper proposes DiffAug, a novel unsupervised contrastive learning technique with diffusion mode-based positive data generation. DiffAug consists of a semantic encoder and a conditional diffusion model; the conditional diffusion model generates new positive samples conditioned on the semantic encoding to serve the training of unsupervised contrast learning. With the help of iterative training of the semantic encoder and diffusion model, DiffAug improves the representation ability in an uninterrupted and unsupervised manner. Experimental evaluations show that DiffAug outperforms hand-designed and SOTA model-based augmentation methods on DNA sequence, visual, and bio-feature datasets. The code for review is released at \url{https://github.com/zangzelin/code_diffaug}.


title: TEMPO: Efficient Multi-View Pose Estimation, Tracking, and Forecasting

abstract: Existing volumetric methods for predicting 3D human pose estimation are accurate, but computationally expensive and optimized for single time-step prediction. We present TEMPO, an efficient multi-view pose estimation model that learns a robust spatiotemporal representation, improving pose accuracy while also tracking and forecasting human pose. We significantly reduce computation compared to the state-of-the-art by recurrently computing per-person 2D pose features, fusing both spatial and temporal information into a single representation. In doing so, our model is able to use spatiotemporal context to predict more accurate human poses without sacrificing efficiency. We further use this representation to track human poses over time as well as predict future poses. Finally, we demonstrate that our model is able to generalize across datasets without scene-specific fine-tuning. TEMPO achieves 10$\%$ better MPJPE with a 33$\times$ improvement in FPS compared to TesseTrack on the challenging CMU Panoptic Studio dataset.


title: Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning

abstract: Recently, large-scale pre-trained language-image models like CLIP have shown extraordinary capabilities for understanding spatial contents, but naively transferring such models to video recognition still suffers from unsatisfactory temporal modeling capabilities. Existing methods insert tunable structures into or in parallel with the pre-trained model, which either requires back-propagation through the whole pre-trained model and is thus resource-demanding, or is limited by the temporal reasoning capability of the pre-trained structure. In this work, we present DiST, which disentangles the learning of spatial and temporal aspects of videos. Specifically, DiST uses a dual-encoder structure, where a pre-trained foundation model acts as the spatial encoder, and a lightweight network is introduced as the temporal encoder. An integration branch is inserted between the encoders to fuse spatio-temporal information. The disentangled spatial and temporal learning in DiST is highly efficient because it avoids the back-propagation of massive pre-trained parameters. Meanwhile, we empirically show that disentangled learning with an extra network for integration benefits both spatial and temporal understanding. Extensive experiments on five benchmarks show that DiST delivers better performance than existing state-of-the-art methods by convincing gaps. When pre-training on the large-scale Kinetics-710, we achieve 89.7% on Kinetics-400 with a frozen ViT-L model, which verifies the scalability of DiST. Codes and models can be found in https://github.com/alibaba-mmai-research/DiST.


title: An Observationally Driven Multifield Approach for Probing the Circum-Galactic Medium with Convolutional Neural Networks

abstract: The circum-galactic medium (CGM) can feasibly be mapped by multiwavelength surveys covering broad swaths of the sky. With multiple large datasets becoming available in the near future, we develop a likelihood-free Deep Learning technique using convolutional neural networks (CNNs) to infer broad-scale physical properties of a galaxy's CGM and its halo mass for the first time. Using CAMELS (Cosmology and Astrophysics with MachinE Learning Simulations) data, including IllustrisTNG, SIMBA, and Astrid models, we train CNNs on Soft X-ray and 21-cm (HI) radio 2D maps to trace hot and cool gas, respectively, around galaxies, groups, and clusters. Our CNNs offer the unique ability to train and test on ''multifield'' datasets comprised of both HI and X-ray maps, providing complementary information about physical CGM properties and improved inferences. Applying eRASS:4 survey limits shows that X-ray is not powerful enough to infer individual halos with masses $\log(M_{\rm{halo}}/M_{\odot}) < 12.5$. The multifield improves the inference for all halo masses. Generally, the CNN trained and tested on Astrid (SIMBA) can most (least) accurately infer CGM properties. Cross-simulation analysis -- training on one galaxy formation model and testing on another -- highlights the challenges of developing CNNs trained on a single model to marginalize over astrophysical uncertainties and perform robust inferences on real data. The next crucial step in improving the resulting inferences on physical CGM properties hinges on our ability to interpret these deep-learning models.


title: Why would you put a flashlight in a dark matter detector?

abstract: Silicon photomultipliers (SiPMs) are solid-state, single-photon sensitive, pixelated sensors whose usage for scintillation detection has rapidly increased over the past decade. It is known that the avalanche process within the device, which renders a single photon detectable, can also generate secondary photons which may be detected by a separate device. This effect, known as external crosstalk, could potentially degrade the science goals of future xenon dark matter experiments. In this article, we measure the effect of external crosstalk in a dual-phase, liquid xenon time projection chamber fully instrumented with SiPMs. We then consider the implications for a future xenon dark matter experiment utilizing SiPMs and discuss possible solutions.


title: ALWOD: Active Learning for Weakly-Supervised Object Detection

abstract: Object detection (OD), a crucial vision task, remains challenged by the lack of large training datasets with precise object localization labels. In this work, we propose ALWOD, a new framework that addresses this problem by fusing active learning (AL) with weakly and semi-supervised object detection paradigms. Because the performance of AL critically depends on the model initialization, we propose a new auxiliary image generator strategy that utilizes an extremely small labeled set, coupled with a large weakly tagged set of images, as a warm-start for AL. We then propose a new AL acquisition function, another critical factor in AL success, that leverages the student-teacher OD pair disagreement and uncertainty to effectively propose the most informative images to annotate. Finally, to complete the AL loop, we introduce a new labeling task delegated to human annotators, based on selection and correction of model-proposed detections, which is both rapid and effective in labeling the informative images. We demonstrate, across several challenging benchmarks, that ALWOD significantly narrows the gap between the ODs trained on few partially labeled but strategically selected image instances and those that rely on the fully-labeled data. Our code is publicly available on https://github.com/seqam-lab/ALWOD.


title: MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning

abstract: Since the resurgence of deep learning, vision-language models (VLMs) enhanced by large language models (LLMs) have grown exponentially in popularity. However, while LLMs can utilize extensive background knowledge and task information with in-context learning, most VLMs still struggle with understanding complex multi-modal prompts with multiple images, making VLMs less effective in downstream vision-language tasks. In this paper, we address the limitation above by 1) introducing vision-language Model with Multi-Modal In-Context Learning(MMICL), a new approach to allow the VLM to deal with multi-modal inputs efficiently; 2) proposing a novel context scheme to augment the in-context learning ability of the VLM; 3) constructing the Multi-modal In-Context Learning (MIC) dataset, designed to enhance the VLM's ability to understand complex multi-modal prompts. Our experiments confirm that MMICL achieves new state-of-the-art zero-shot performance on a wide range of general vision-language tasks, especially for complex benchmarks, including MME and MMBench. Our analysis demonstrates that MMICL effectively tackles the challenge of complex multi-modal prompt understanding and emerges the impressive ICL ability. Furthermore, we observe that MMICL successfully alleviates language bias in VLMs, a common issue for VLMs that often leads to hallucination when faced with extensive textual context. Our code, dataset, dataset tool, and model are available at https://github.com/PKUnlp-icler/MIC


title: Quantum Electrodynamics of Non-Hermitian Dirac Fermions

abstract: We develop an effective quantum electrodynamics for non-Hermitian (NH) Dirac materials interacting with photons. These systems are described by nonspatial symmetry protected Lorentz invariant NH Dirac operators, featuring two velocity parameters $v_{_{\rm H}}$ and $v_{_{\rm NH}}$ associated with the standard Hermitian and a masslike anti-Hermitian Dirac operators, respectively. They display linear energy-momentum relation, however, in terms of an effective Fermi velocity $v_{_{\rm F}}=\sqrt{v^2_{_{\rm H}}-v^2_{_{\rm NH}}}$ of NH Dirac fermions. Interaction with the fluctuating electromagnetic radiation then gives birth to an emergent Lorentz symmetry in this family of NH Dirac materials in the deep infrared regime, where the system possesses a unique terminal velocity $v_{_{\rm F}}=c$, with $c$ being the speed of light. While in two dimensions such a terminal velocity is set by the speed of light in the free space, dynamic screening in three spatial dimensions permits its nonuniversal values. Manifestations of such an emergent spacetime symmetry on the scale dependence of various physical observables in correlated NH Dirac materials are discussed.


title: Looking at words and points with attention: a benchmark for text-to-shape coherence

abstract: While text-conditional 3D object generation and manipulation have seen rapid progress, the evaluation of coherence between generated 3D shapes and input textual descriptions lacks a clear benchmark. The reason is twofold: a) the low quality of the textual descriptions in the only publicly available dataset of text-shape pairs; b) the limited effectiveness of the metrics used to quantitatively assess such coherence. In this paper, we propose a comprehensive solution that addresses both weaknesses. Firstly, we employ large language models to automatically refine textual descriptions associated with shapes. Secondly, we propose a quantitative metric to assess text-to-shape coherence, through cross-attention mechanisms. To validate our approach, we conduct a user study and compare quantitatively our metric with existing ones. The refined dataset, the new metric and a set of text-shape pairs validated by the user study comprise a novel, fine-grained benchmark that we publicly release to foster research on text-to-shape coherence of text-conditioned 3D generative models. Benchmark available at https://cvlab-unibo.github.io/CrossCoherence-Web/.


title: Unified Human-Scene Interaction via Prompted Chain-of-Contacts

abstract: Human-Scene Interaction (HSI) is a vital component of fields like embodied AI and virtual reality. Despite advancements in motion quality and physical plausibility, two pivotal factors, versatile interaction control and the development of a user-friendly interface, require further exploration before the practical application of HSI. This paper presents a unified HSI framework, UniHSI, which supports unified control of diverse interactions through language commands. This framework is built upon the definition of interaction as Chain of Contacts (CoC): steps of human joint-object part pairs, which is inspired by the strong correlation between interaction types and human-object contact regions. Based on the definition, UniHSI constitutes a Large Language Model (LLM) Planner to translate language prompts into task plans in the form of CoC, and a Unified Controller that turns CoC into uniform task execution. To facilitate training and evaluation, we collect a new dataset named ScenePlan that encompasses thousands of task plans generated by LLMs based on diverse scenarios. Comprehensive experiments demonstrate the effectiveness of our framework in versatile task execution and generalizability to real scanned scenes. The project page is at https://github.com/OpenRobotLab/UniHSI .


title: Expanding on the Fundamental Metallicity Relation in Dwarf Galaxies with MUSE

abstract: The mass-metallicity relation (MZR) represents one of the most important scaling relations in the context of galaxy evolution, comprising a positive correlation between stellar mass and metallicity (Z). The fundamental metallicity relation (FMR) introduces a new parameter, the star formation rate (SFR), in the dependence. While several studies found that Z is anti-correlated with the SFR at fixed mass, the validity of this statement has been questioned extensively and no widely-accepted consensus has been reached yet. With this work, we investigate the FMR in nine nearby, spatially-resolved, dwarf galaxies, using gas diagnostics on integral-field spectroscopic data of the Multi Unit Spectroscopic Explorer (MUSE), pushing such investigations to lower galaxy masses and higher resolutions. We find that both the MZR and FMR exhibit different behaviours within different star forming regions of the galaxies. We find that the SFR surface density - metallicity anti-correlation is tighter in the low-mass galaxies of our sample. For all the galaxies considered, we find a SFR surface density - stellar mass surface density correlation. We propose that the main reason behind these findings is connected to the accretion mechanisms of the gas fuelling star formation -- low-mass, metal-poor galaxies accrete pristine gas from the intergalactic medium, while in more massive and metal-enriched systems the gas responsible for star formation is recycled from previous star forming episodes.


title: Large-Vocabulary 3D Diffusion Model with Transformer

abstract: Creating diverse and high-quality 3D assets with an automatic generative model is highly desirable. Despite extensive efforts on 3D generation, most existing works focus on the generation of a single category or a few categories. In this paper, we introduce a diffusion-based feed-forward framework for synthesizing massive categories of real-world 3D objects with a single generative model. Notably, there are three major challenges for this large-vocabulary 3D generation: a) the need for expressive yet efficient 3D representation; b) large diversity in geometry and texture across categories; c) complexity in the appearances of real-world objects. To this end, we propose a novel triplane-based 3D-aware Diffusion model with TransFormer, DiffTF, for handling challenges via three aspects. 1) Considering efficiency and robustness, we adopt a revised triplane representation and improve the fitting speed and accuracy. 2) To handle the drastic variations in geometry and texture, we regard the features of all 3D objects as a combination of generalized 3D knowledge and specialized 3D features. To extract generalized 3D knowledge from diverse categories, we propose a novel 3D-aware transformer with shared cross-plane attention. It learns the cross-plane relations across different planes and aggregates the generalized 3D knowledge with specialized 3D features. 3) In addition, we devise the 3D-aware encoder/decoder to enhance the generalized 3D knowledge in the encoded triplanes for handling categories with complex appearances. Extensive experiments on ShapeNet and OmniObject3D (over 200 diverse real-world categories) convincingly demonstrate that a single DiffTF model achieves state-of-the-art large-vocabulary 3D object generation performance with large diversity, rich semantics, and high quality.