title: 3DHR-Co: A Collaborative Test-time Refinement Framework for In-the-Wild 3D Human-Body Reconstruction Task

abstract: The field of 3D human-body reconstruction (abbreviated as 3DHR) that utilizes parametric pose and shape representations has witnessed significant advancements in recent years. However, the application of 3DHR techniques to handle real-world, diverse scenes, known as in-the-wild data, still faces limitations. The primary challenge arises as curating accurate 3D human pose ground truth (GT) for in-the-wild scenes is still difficult to obtain due to various factors. Recent test-time refinement approaches on 3DHR leverage initial 2D off-the-shelf human keypoints information to support the lack of 3D supervision on in-the-wild data. However, we observed that additional 2D supervision alone could cause the overfitting issue on common 3DHR backbones, making the 3DHR test-time refinement task seem intractable. We answer this challenge by proposing a strategy that complements 3DHR test-time refinement work under a collaborative approach. Specifically, we initially apply a pre-adaptation approach that works by collaborating various 3DHR models in a single framework to directly improve their initial outputs. This approach is then further combined with the test-time adaptation work under specific settings that minimize the overfitting issue to further boost the 3DHR performance. The whole framework is termed as 3DHR-Co, and on the experiment sides, we showed that the proposed work can significantly enhance the scores of common classic 3DHR backbones up to -34 mm pose error suppression, putting them among the top list on the in-the-wild benchmark data. Such achievement shows that our approach helps unveil the true potential of the common classic 3DHR backbones. Based on these findings, we further investigate various settings on the proposed framework to better elaborate the capability of our collaborative approach in the 3DHR task.


title: Efficient Remote Sensing Segmentation With Generative Adversarial Transformer

abstract: Most deep learning methods that achieve high segmentation accuracy require deep network architectures that are too heavy and complex to run on embedded devices with limited storage and memory space. To address this issue, this paper proposes an efficient Generative Adversarial Transfomer (GATrans) for achieving high-precision semantic segmentation while maintaining an extremely efficient size. The framework utilizes a Global Transformer Network (GTNet) as the generator, efficiently extracting multi-level features through residual connections. GTNet employs global transformer blocks with progressively linear computational complexity to reassign global features based on a learnable similarity function. To focus on object-level and pixel-level information, the GATrans optimizes the objective function by combining structural similarity losses. We validate the effectiveness of our approach through extensive experiments on the Vaihingen dataset, achieving an average F1 score of 90.17% and an overall accuracy of 91.92%.


title: Modelling the AM CVn and Double Detonation Supernova Progenitor Binary System CD-30$^{\circ}$11223

abstract: We present a detailed modelling study of CD-30$^{\circ}$11223 (CD-30), a hot subdwarf (sdB)-white dwarf (WD) binary identified as a double detonation supernova progenitor, using the open-source stellar evolution software MESA. We focus on implementing binary evolution models carefully tuned to match the observed characteristics of the system including $\log g$ and $T_{\rm eff}$. For the first time, we account for the structure of the hydrogen envelope throughout the modelling, and find that the inclusion of element diffusion is important for matching the observed radius and temperature. We investigate the two sdB mass solutions (0.47 and 0.54 $M_{\odot}$) previously proposed for this system, strongly favouring the 0.47 $M_{\odot}$ solution. The WD cooling age is compared against the sdB age using our models, which suggest an sdB likely older than the WD, contrary to the standard assumption for compact sdB-WD binaries. Subsequently, we propose a possible alternate formation channel for CD-30. We also perform binary evolution modelling of the system to study various aspects such as mass transfer, orbital period evolution and luminosity evolution. Our models confirm CD-30 as a double detonation supernova progenitor, expected to explode $\approx55$ Myr from now. The WD accretes a $\approx0.17$ $M_{\odot}$ thick helium shell that causes a detonation, leaving a 0.30 $M_{\odot}$ sdB ejected at $\approx$750 km/s. The final 15 Myr of the system are characterised by helium accretion which dominates the system luminosity, possibly resembling an AM CVn-type system.


title: A biased random walk approach for modeling the collective chemotaxis of neural crest cells

abstract: Collective cell migration is a multicellular phenomenon that arises in various biological contexts, including cancer and embryo development. "Collectiveness" can be promoted by cell-cell interactions such as co-attraction and contact inhibition of locomotion. These mechanisms act on cell polarity, pivotal for directed cell motility, through influencing the intracellular dynamics of small GTPases such as Rac1. To model these dynamics we introduce a biased random walk model, where the bias depends on the internal state of Rac1, and the Rac1 state is influenced by cell-cell interactions and chemoattractive cues. In an extensive simulation study we demonstrate and explain the scope and applicability of the introduced model in various scenarios. The use of a biased random walk model allows for the derivation of a corresponding partial differential equation for the cell density while still maintaining a certain level of intracellular detail from the individual based setting.


title: A review and outlook on anionic and cationic redox in Ni-, Li- and Mn-rich layered oxides LiMeO2 (Me = Li, Ni, Co, Mn)

abstract: The present work reviews the charge compensation in Ni based layered oxides (LiNi1-xMexO2 with x <= 0.2, Me = Co, Mn, space group R-3m) relating performance parameters to changes in the electronic and crystallographic structure of the cathode materials. Upon charge and discharge two fundamentally different redox mechanisms are observed: At low and medium states of charge (SOCs) charge compensation takes mainly place at oxygen sites while electron density is shifted from the oxygen lattice to nickel (formation of sigma bonds). At high SOCs the shift of electron density from the transition metals to oxygen (formation of pi bonds) enables an additional redox process but also oxygen release from the transition metal host structure and subsequent detrimental reactions. Depending on the Ni:Co:Mn content, both processes lead to characteristic features in the voltage profile of the cathode materials and performance parameters like the capacity, the cycling stability and the open cell voltage become a function of the composition.


title: Hybrid light-matter states in topological superconductors coupled to cavity photons

abstract: We consider a one-dimensional topological superconductor hosting Majorana bound states at its ends coupled to a single mode cavity. In the strong light-matter coupling regime, electronic and photonic degrees of freedom hybridize resulting in the formation of polaritons. We find the polariton spectrum by calculating the cavity photon spectral function of the coupled electron-photon system. In the topological phase the lower in energy polariton modes are formed by the bulk-Majorana transitions coupled to cavity photons and are also sensitive to the Majorana parity. In the trivial phase the lower polariton modes emerge due to the coupling of the bulk-bulk transitions across the gap to photons. Our work demonstrates the formation of polaritons in topological superconductors coupled to photons that contain information on the features of the Majorana bound states.


title: Co-audit: tools to help humans double-check AI-generated content

abstract: Users are increasingly being warned to check AI-generated content for correctness. Still, as LLMs (and other generative models) generate more complex output, such as summaries, tables, or code, it becomes harder for the user to audit or evaluate the output for quality or correctness. Hence, we are seeing the emergence of tool-assisted experiences to help the user double-check a piece of AI-generated content. We refer to these as co-audit tools. Co-audit tools complement prompt engineering techniques: one helps the user construct the input prompt, while the other helps them check the output response. As a specific example, this paper describes recent research on co-audit tools for spreadsheet computations powered by generative models. We explain why co-audit experiences are essential for any application of generative AI where quality is important and errors are consequential (as is common in spreadsheet computations). We propose a preliminary list of principles for co-audit, and outline research challenges.


title: Progress on an Electron Beam Profile Monitor at the Fermilab Main Injector

abstract: The current program at Fermilab involves the construction of a new superconducting linear accelerator (LINAC) to replace the existing warm version. The new LINAC, together with other planned improvements, is in support of proton beam intensities in the Main Injector (MI) that will exceed 2 MW. Measuring the transverse profiles of these high intensity beams in a ring requires non-invasive techniques. The MI uses ionization profile monitors as its only profile system. An alternative technique involves measuring the deflection of a probe beam of electrons with a trajectory perpendicular to the proton beam. This type of device was installed in MI and initial studies of it have been previously presented. This paper will present the status and recent studies of the device utilizing different techniques.


title: Generating Explanations in Medical Question-Answering by Expectation Maximization Inference over Evidence

abstract: Medical Question Answering~(medical QA) systems play an essential role in assisting healthcare workers in finding answers to their questions. However, it is not sufficient to merely provide answers by medical QA systems because users might want explanations, that is, more analytic statements in natural language that describe the elements and context that support the answer. To do so, we propose a novel approach for generating natural language explanations for answers predicted by medical QA systems. As high-quality medical explanations require additional medical knowledge, so that our system extract knowledge from medical textbooks to enhance the quality of explanations during the explanation generation process. Concretely, we designed an expectation-maximization approach that makes inferences about the evidence found in these texts, offering an efficient way to focus attention on lengthy evidence passages. Experimental results, conducted on two datasets MQAE-diag and MQAE, demonstrate the effectiveness of our framework for reasoning with textual evidence. Our approach outperforms state-of-the-art models, achieving a significant improvement of \textbf{6.86} and \textbf{9.43} percentage points on the Rouge-1 score; \textbf{8.23} and \textbf{7.82} percentage points on the Bleu-4 score on the respective datasets.


title: A Study of the Gain of Microchannel Plates in the Ionization Profile Monitors at Fermilab

abstract: One of the on-going issues with the use of microchannel plates (MCP) in the ionization profile monitors (IPM) at Fermilab is the significant decrease in gain over time. There are several possible issues that can cause this. Historically, the assumption has been that this is aging, where the secondary emission yield (SEY) of the pore surface changes after some amount of extracted charge. Recent literature searches have brought to light the possibility that this is an initial 'scrubbing' effect whereby adsorbed gasses are removed from the MCP pores by the removal of charge from the MCP. This paper discusses the results of studies conducted on the IPMs in the Main Injector at Fermilab.


title: Short Time Angular Impulse Response of Rayleigh Beams

abstract: In the dynamics of linear structures, the impulse response function is of fundamental interest. In some cases one examines the short term response wherein the disturbance is still local and the boundaries have not yet come into play, and for such short-time analysis the geometrical extent of the structure may be taken as unbounded. Here we examine the response of slender beams to angular impulses. The Euler-Bernoulli model, which does not include rotary inertia of cross sections, predicts an unphysical and unbounded initial rotation at the point of application. A finite length Euler-Bernoulli beam, when modelled using finite elements, predicts a mesh-dependent response that shows fast large-amplitude oscillations setting in very quickly. The simplest introduction of rotary inertia yields the Rayleigh beam model, which has more reasonable behaviour including a finite wave speed at all frequencies. If a Rayleigh beam is given an impulsive moment at a location away from its boundaries, then the predicted behaviour has an instantaneous finite jump in local slope or rotation, followed by smooth evolution of the slope for a finite time interval until reflections arrive from the boundary, causing subsequent slope discontinuities in time. We present a detailed study of the angular impulse response of a simply supported Rayleigh beam, starting with dimensional analysis, followed by modal expansion including all natural frequencies, culminating with an asymptotic formula for the short-time response. The asymptotic formula is obtained by breaking the series solution into two parts to be treated independently term by term, and leads to a polynomial in time. The polynomial matches the response from refined finite element (FE) simulations.


title: Toward Accurate Post-Born-Oppenheimer Molecular Simulations on Quantum Computers: An Adaptive Variational Eigensolver with Nuclear-Electronic Frozen Natural Orbitals

abstract: Nuclear quantum effects such as zero-point energy and hydrogen tunnelling play a central role in many biological and chemical processes. The nuclear-electronic orbital (NEO) approach captures these effects by treating selected nuclei quantum mechanically on the same footing as electrons. On classical computers, the resources required for an exact solution of NEO-based models grow exponentially with system size. By contrast, quantum computers offer a means of solving this problem with polynomial scaling. However, due to the limitations of current quantum devices, NEO simulations are confined to the smallest systems described by minimal basis sets whereas realistic simulations beyond the Born--Oppenheimer approximation require more sophisticated basis sets. For this purpose, we herein extend a hardware-efficient ADAPT-VQE method to the NEO framework in the frozen natural orbital (FNO) basis. We demonstrate on H$_2$ and D$_2$ molecules that the NEO-FNO-ADAPT-VQE method reduces the CNOT count by a several orders of magnitude relative to the NEO unitary coupled cluster method with singles and doubles (NEO-UCCSD) while maintaining the desired accuracy. This extreme reduction in the CNOT gate count is sufficient to permit practical computations employing the NEO method -- an important step toward accurate simulations involving non-classical nuclei and non--Born--Oppenheimer effects on near-term quantum devices. We further show that the method can capture isotope effects and we demonstrate that inclusion of correlation energy systematically improves the prediction of $\Delta$ZPE.


title: Dynamics of automorphism groups of projective surfaces: classification, examples and outlook

abstract: We first present an overview of our previous work on the dynamics of subgroups of automorphism groups of compact complex surfaces, together with a selection of open problems and new classification results. Then, we study two families of examples in depth: the first one comes from folding plane pentagons, and the second one is a family of groups introduced by J\'er\'emy Blanc, which exhibits interesting new dynamical features.


title: Coupling public and private gradient provably helps optimization

abstract: The success of large neural networks is crucially determined by the availability of data. It has been observed that training only on a small amount of public data, or privately on the abundant private data can lead to undesirable degradation of accuracy. In this work, we leverage both private and public data to improve the optimization, by coupling their gradients via a weighted linear combination. We formulate an optimal solution for the optimal weight in the convex setting to indicate that the weighting coefficient should be hyperparameter-dependent. Then, we prove the acceleration in the convergence of non-convex loss and the effects of hyper-parameters such as privacy budget, number of iterations, batch size, and model size on the choice of the weighting coefficient. We support our analysis with empirical experiments across language and vision benchmarks, and provide a guideline for choosing the optimal weight of the gradient coupling.


title: On 2-Near Perfect Numbers

abstract: Let $\sigma(n)$ be the sum of the positive divisors of $n$. A number $n$ is said to be 2-near perfect if $\sigma(n) = 2n +d_1 +d_2 $, where $d_1$ and $d_2$ are distinct positive divisors of $n$. We give a complete description of those $n$ which are 2-near perfect and of the form $n=2^k p^i$ where $p$ is prime and $i \in \{1,2\}$. We also prove related results under the additional restriction where $d_1d_2=n$.


title: Cohomology of non-generic character stacks

abstract: We study (compactly supported) cohomology of character stacks of punctured Riemann surfaces with prescribed semisimple local monodromies at punctures. In the case of generic local monodromies, the cohomology of these character stacks has already been studied by Hausel, Letellier and Rodriguez-Villegas and by Mellit. In this paper, we extend the results of Hausel, Letellier and Rodriguez-Villegas to the non-generic case. In particular, we compute the E-series and we give a conjectural formula for the mixed Poincar\'e series. Moreover, we verify our conjecture in the case of the projective line with 4 punctures and a certain choice of a non-generic quadruple.


title: On the Generalization of Training-based ChatGPT Detection Methods

abstract: ChatGPT is one of the most popular language models which achieve amazing performance on various natural language tasks. Consequently, there is also an urgent need to detect the texts generated ChatGPT from human written. One of the extensively studied methods trains classification models to distinguish both. However, existing studies also demonstrate that the trained models may suffer from distribution shifts (during test), i.e., they are ineffective to predict the generated texts from unseen language tasks or topics. In this work, we aim to have a comprehensive investigation on these methods' generalization behaviors under distribution shift caused by a wide range of factors, including prompts, text lengths, topics, and language tasks. To achieve this goal, we first collect a new dataset with human and ChatGPT texts, and then we conduct extensive studies on the collected dataset. Our studies unveil insightful findings which provide guidance for developing future methodologies or data collection strategies for ChatGPT detection.


title: Small in-plane oscillations of a slack catenary using assumed modes

abstract: In this paper we study a problem in oscillations wherein the assumed modes method offers some analytical and theoretical peculiarities. Specifically, we study small in-plane oscillations of a slack catenary, or a sagging inextensible chain fixed at both endpoints. The horizontal and vertical displacements cannot be approximated independently because of pointwise inextensibility in the chain. Moreover, the potential energy is a linear function of the generalized coordinates, and does not directly cause oscillations. Using assumed modes for the vertical displacements only, integrating from one endpoint to compute the required horizontal displacements, treating the horizontal fixity at the distal end as an added scalar constraint, and obtaining linearized equations, we construct an eigenvalue problem which contains a Lagrange multiplier. For generic assumed modes, the Lagrange multiplier is determined by enforcing equilibrium in the undeflected shape. However, when the modes thus determined are reinserted in the assumed mode expansion and the calculation done afresh, then the Lagrange multiplier is indeterminate at first order. Upon retaining terms at the next order, the distal end fixity constraint introduces quadratic terms into a Lagrangian without constraints. Results from these two approaches match perfectly. Our approach offers nontrivial insights into both oscillations and Lagrangian mechanics. It is also potentially applicable to other problems with inextensibility in one-dimensional slender members.


title: Optimistic Online Caching for Batched Requests

abstract: In this paper we study online caching problems where predictions of future requests, e.g., provided by a machine learning model, are available. Typical online optimistic policies are based on the Follow-The-Regularized-Leader algorithm and have higher computational cost than classic ones like LFU, LRU, as each update of the cache state requires to solve a constrained optimization problem. In this work we analysed the behaviour of two different optimistic policies in a \textit{batched} case, i.e., when the cache is updated less frequently in order to amortize the update cost over time or over multiple requests. Experimental results show that such an optimistic batched approach outperforms classical caching policies both on stationary and real traces


title: Parameterized Complexity of Incomplete Connected Fair Division

abstract: \textit{Fair division} of resources among competing agents is a fundamental problem in computational social choice and economic game theory. It has been intensively studied on various kinds of items (\textit{divisible} and \textit{indivisible}) and under various notions of \textit{fairness}. We focus on Connected Fair Division (\CFDO), the variant of fair division on graphs, where the \textit{resources} are modeled as an \textit{item graph}. Here, each agent has to be assigned a connected subgraph of the item graph, and each item has to be assigned to some agent. We introduce a generalization of \CFDO, termed Incomplete Connected Fair Division (\CFD), where exactly $p$ vertices of the item graph should be assigned to the agents. This might be useful, in particular when the allocations are intended to be ``economical'' as well as fair. We consider four well-known notions of fairness: \PROP, \EF, \EFO, \EFX. First, we prove that \EF-\CFD, \EFO-\CFD, and \EFX-\CFD are W[1]-hard parameterized by $p$ plus the number of agents, even for graphs having constant \textit{vertex cover number} ($\mathsf{vcn}$). In contrast, we present a randomized \FPT algorithm for \PROP-\CFD parameterized only by $p$. Additionally, we prove both positive and negative results concerning the kernelization complexity of \CFD under all four fairness notions, parameterized by $p$, $\mathsf{vcn}$, and the total number of different valuations in the item graph ($\mathsf{val}$).


title: Asymmetric Drift Map of the Milky Way disk Populations between 8$-$16 kpc with LAMOST and Gaia datasets

abstract: The application of asymmetric drift (AD) tomography across different populations provides valuable insights into the kinematics, dynamics, and rotation curves of the Galactic disk. By leveraging common stars identified in both the LAMOST and Gaia surveys, alongside Gaia DR3's circular velocity curve, we conducted a qualitative exploration of asymmetric drift distributions within the Galactic disk spanning distances from 8 to 16 kpc. In the R-Z plane, we observed that the asymmetric drift is minimal near the mid-plane of the Galactic disk and gradually increases with vertical distance, resulting in a distinctive ``horn" shape. Additionally, our analysis revealed that populations with higher [$\alpha$/Fe] ratios exhibit greater asymmetric drift compared to those with lower [$\alpha$/Fe] ratios. Specifically, we found the asymmetric drift around the solar location to be approximately 6 km s$^{-1}$, with a median value of 16 km s$^{-1}$ across the entire sample. Notably, the median asymmetric drift in the northern region of the Galactic disk (20 km s$^{-1}$) surpasses that in the southern region (13 km s$^{-1}$), with errors remaining within 2 km s$^{-1}$. Furthermore, our investigation into mono-age stellar populations unveiled that older stellar populations tend to exhibit larger asymmetric drift and velocity dispersion, aligning closely with predictions from previous numerical models. Finally, based on chemical compositions, we observed that the median asymmetric drift of the thick disk significantly exceeds that of the thin disk and found that star formation within the thick disk primarily occurred earlier than 8-10 billion years, whereas the thin disk's predominant star formation period spanned 6-8 billion years ago.


title: Numerical Simulations of Charge Trapping in Germanium Strip Detectors

abstract: Charge trapping in germanium detectors will inevitably impact their excellent spectral performance. Disordered regions in the germanium crystal structure, either created in the material during processing or induced by radiation exposure, will affect the Charge Collection Efficiency (CCE), degrading the spectral resolution. Here we present numerical simulations of charge trapping effects on the anode and cathode signals for cross-strip germanium detectors. We discuss the assumptions behind our model of trapping, which accounts for both the drift length and thermal motion of the charge carriers. We present simulated CCE curves as a function of interaction depth within the detectors, and develop a technique for benchmarking these simulations against measured data. Comparison with measured CCE curves are presented. We are developing these numerical models with a goal of characterizing, and ultimately correcting, the effects of radiation damage on the spectral resolution of germanium cross-strip detectors.


title: Dissecting Resilience Triangle: Unravelling Resilience Curve Archetypes and Properties in Human Systems Facing Weather Hazards

abstract: Resilience curves have been the primary approach for conceptualizing and representing the resilience behavior of communities during hazard events; however, the use of resilience curves has remained as a mere conceptual and visual tool with limited data-driven characterization and empirical grounding. Empirical characterizations of resilience curves provide essential insights regarding the manner in which differently impacted systems of communities absorb perturbations and recover from disruptions. To address this gap, this study examines human mobility resilience patterns following multiple weather-related hazard events in the United States by analyzing more than 2000 empirical resilience curves constructed from high-resolution location-based mobility data. These empirical resilience curves are then classified using k-means clustering based on various features into archetypes. Three main archetypes of human mobility resilience are identified: Type I, with rapid recovery after mild impact; Type II, exhibiting bimodal recovery after moderate impact; and Type III, showing slower recovery after severe impact. The results also reveal critical thresholds, such as the bimodal recovery breakpoint at a 20% impact extent, at which the recovery rate decreases, and the critical functional threshold at a 60% impact extent, above which recovery rate would be rather slow. The results show that a critical functional recovery rate of 2.5% per day is necessary to follow the bimodal resilience archetype when impact extent exceeds more than 20%. These findings provide novel and important insights into different resilience curve archetypes and their fundamental properties. Departing from using resilience curves as a mere concept and visual tool, the data-driven specification of resilience curve archetypes and their properties improve our understanding of the resilience patterns...


title: Particle physics in the sub-keV energy regime

abstract: Coherent elastic neutrino-nucleus scattering (CE$\nu$NS) and other rare-event physics searches, like dark matter detection, have been especially furthered by increasing sensitivity to low-energy particle interactions. Experiments using multiple detector technologies have sought CE$\nu$NS at the most intense terrestrial sources of neutrinos: spallation facilities and nuclear reactors. This thesis reports on the feasibility of using cryogenic pure CsI as an improved next-generation CE$\nu$NS target at the up-and-coming European Spallation Source. Calibrations and simulations presented here predict an increase by a factor of at least $\sim33$ in the rate of observable neutrino-induced events per unit mass, compared to past use of room-temperature CsI[Na]. Also reported is the first measurement of CE$\nu$NS from antineutrinos at the Dresden Generating Station, a power nuclear reactor, employing a large-mass semiconducting germanium diode dubbed NCC-1701. In each section on detecting these neutrino couplings, the importance of understanding device response to low-energy nuclear recoils is highlighted. Finally, finding synergy for tools developed to extricate sub-keV CE$\nu$NS signals, a search for the exotic mode of muon decay $\mu^+ \xrightarrow{} e^+X$ was performed. New sensitivity limits in previously untouched parameter space for a massive boson dark matter candidate of cosmological interest are presented.

categories: physics.ins-det astro-ph.CO hep-ex nucl-ex


title: Cosmology with imaging galaxy surveys: the impact of evolving galaxy bias and magnification

abstract: The joint analysis of galaxy clustering and galaxy-shear cross-correlations (galaxy-galaxy lensing) in imaging surveys constitutes one of the main avenues to obtain cosmological information. Analyses from Stage III surveys have assumed constant galaxy bias and weak lensing magnification coefficients within redshift bins. We use simple models of bias and magnification evolution to show that plausible levels of evolution impact cosmological parameter inference significantly for Stage IV surveys and possibly for current datasets as well. The distance weighting factors in galaxy-galaxy lensing cause it to have a different effective mean redshift within a lens bin than galaxy clustering. If the evolution is not included carefully in the theory modeling, this produces an apparent de-correlation of clustering and lensing even on large scales and leads to biased cosmological constraints. The level of bias is sensitive to the redshift and the width of the lens redshift distributions: for magnitude-limited-like samples it is comparable to the statistical precision even for the full DES survey, and exceeds it for Rubin-LSST. We find that ignoring the evolution can lead to approximately $1\sigma$ biases in the cosmological constraints in future Rubin-LSST analyses. We describe how these effects can be mitigated from the modeling and data sides, in particular by using cross-correlations to constrain the evolution parameters. We also demonstrate that the combination of galaxy clustering and CMB lensing does not suffer from this problem, due to the different distance weighting.


title: Entanglement of Nanophotonic Quantum Memory Nodes in a Telecom Network

abstract: A key challenge in realizing practical quantum networks for long-distance quantum communication involves robust entanglement between quantum memory nodes connected via fiber optical infrastructure. Here, we demonstrate a two-node quantum network composed of multi-qubit registers based on silicon-vacancy (SiV) centers in nanophotonic diamond cavities integrated with a telecommunication (telecom) fiber network. Remote entanglement is generated via the cavity-enhanced interactions between the SiV's electron spin qubits and optical photons. Serial, heralded spin-photon entangling gate operations with time-bin qubits are used for robust entanglement of separated nodes. Long-lived nuclear spin qubits are used to provide second-long entanglement storage and integrated error detection. By integrating efficient bi-directional quantum frequency conversion of photonic communication qubits to telecom frequencies (1350 nm), we demonstrate entanglement of two nuclear spin memories through 40 km spools of low-loss fiber and a 35 km long fiber loop deployed in the Boston area urban environment, representing an enabling step towards practical quantum repeaters and large-scale quantum networks.


title: On constructing bent functions from cyclotomic mappings

abstract: We study a new method of constructing Boolean bent functions from cyclotomic mappings. Three generic constructions are obtained by considering different branch functions such as Dillon functions, Niho functions and Kasami functions over multiplicative cosets and additive cosets respectively. As a result, several new explicit infinite families of bent functions and their duals are derived. We demonstrate that some previous constructions are special cases of our simple constructions. In addition, by studying their polynomial forms, we observe that the last construction provides some examples which are EA-inequivalent to five classes of monomials, Dillon type and Niho type polynomials.


title: Subgraph densities and scaling limits of random graphs with a prescribed modular decomposition

abstract: We consider large uniform labeled random graphs in different classes with prescribed decorations in their modular decomposition. Our main result is the estimation of the number of copies of every graph as an induced subgraph. As a consequence, we obtain the convergence of a uniform random graph in such classes to a Brownian limit object in the space of graphons. Our proofs rely on combinatorial arguments, computing generating series using the symbolic method and deriving asymptotics using singularity analysis.


title: CAD: Clustering And Deep Reinforcement Learning Based Multi-Period Portfolio Management Strategy

abstract: In this paper, we present a novel trading strategy that integrates reinforcement learning methods with clustering techniques for portfolio management in multi-period trading. Specifically, we leverage the clustering method to categorize stocks into various clusters based on their financial indices. Subsequently, we utilize the algorithm Asynchronous Advantage Actor-Critic to determine the trading actions for stocks within each cluster. Finally, we employ the algorithm DDPG to generate the portfolio weight vector, which decides the amount of stocks to buy, sell, or hold according to the trading actions of different clusters. To the best of our knowledge, our approach is the first to combine clustering methods and reinforcement learning methods for portfolio management in the context of multi-period trading. Our proposed strategy is evaluated using a series of back-tests on four datasets, comprising a of 800 stocks, obtained from the Shanghai Stock Exchange and National Association of Securities Deal Automated Quotations sources. Our results demonstrate that our approach outperforms conventional portfolio management techniques, such as the Robust Median Reversion strategy, Passive Aggressive Median Reversion Strategy, and several machine learning methods, across various metrics. In our back-test experiments, our proposed strategy yields an average return of 151% over 360 trading periods with 800 stocks, compared to the highest return of 124% achieved by other techniques over identical trading periods and stocks.


title: Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplation

abstract: Recent breakthroughs in large language models (LLMs) have brought remarkable success in the field of LLM-as-Agent. Nevertheless, a prevalent assumption is that the information processed by LLMs is consistently honest, neglecting the pervasive deceptive or misleading information in human society and AI-generated content. This oversight makes LLMs susceptible to malicious manipulations, potentially resulting in detrimental outcomes. This study utilizes the intricate Avalon game as a testbed to explore LLMs' potential in deceptive environments. Avalon, full of misinformation and requiring sophisticated logic, manifests as a "Game-of-Thoughts". Inspired by the efficacy of humans' recursive thinking and perspective-taking in the Avalon game, we introduce a novel framework, Recursive Contemplation (ReCon), to enhance LLMs' ability to identify and counteract deceptive information. ReCon combines formulation and refinement contemplation processes; formulation contemplation produces initial thoughts and speech, while refinement contemplation further polishes them. Additionally, we incorporate first-order and second-order perspective transitions into these processes respectively. Specifically, the first-order allows an LLM agent to infer others' mental states, and the second-order involves understanding how others perceive the agent's mental state. After integrating ReCon with different LLMs, extensive experiment results from the Avalon game indicate its efficacy in aiding LLMs to discern and maneuver around deceptive information without extra fine-tuning and data. Finally, we offer a possible explanation for the efficacy of ReCon and explore the current limitations of LLMs in terms of safety, reasoning, speaking style, and format, potentially furnishing insights for subsequent research.


abstract: Style transfer methods typically generate a single stylized output of color and texture coupling for reference styles, and color transfer schemes may introduce distortion or artifacts when processing reference images with duplicate textures. To solve the problem, we propose a Color and Texture Dual Pipeline Lightweight Style Transfer CTDP method, which employs a dual pipeline method to simultaneously output the results of color and texture transfer. Furthermore, we designed a masked total variation loss to suppress artifacts and small texture representations in color transfer results without affecting the semantic part of the content. More importantly, we are able to add texture structures with controllable intensity to color transfer results for the first time. Finally, we conducted feature visualization analysis on the texture generation mechanism of the framework and found that smoothing the input image can almost completely eliminate this texture structure. In comparative experiments, the color and texture transfer results generated by CTDP both achieve state-of-the-art performance. Additionally, the weight of the color transfer branch model size is as low as 20k, which is 100-1500 times smaller than that of other state-of-the-art models.


title: A combinatorial model for the moduli of bordered Riemann surfaces and a compactification

abstract: We construct a combinatorial moduli space closely related to the KSV-compactification of the moduli space of bordered marked Riemann surfaces. The open part arises from symmetric metric ribbon graphs. The compactification is obtained by considering sequences of non contractible subgraphs. This leads to a partial real blow-up of rational cells that together form a compact orbi-cell space. For genus zero the constructed space gives an orbi-cell decomposition of the corresponding analytic moduli space decorated by real numbers and a compactification of this space. In higher genus the relation is more involved, as we briefly explain. The spaces we construct are of interest in their own right as they are constructed directly from an interesting class of graphs.


title: Impact of dephasing on non-equilibrium steady-state transport in fermionic chains with long-range hopping

abstract: Quantum transport in a non-equilibrium setting plays a fundamental role in understanding the properties of systems ranging from quantum devices to biological systems. Dephasing -- a key aspect of out-of-equilibrium systems -- arises from the interactions with the noisy environment and can profoundly modify transport features. Here, we investigate the impact of dephasing on the non-equilibrium steady-state transport properties of non-interacting fermions on a one-dimensional lattice with long-range hopping ($\sim \frac{1}{r^\alpha}$). We show the emergence of distinct transport regimes as the long-range hopping parameter $\alpha$ is tuned. In the short-range limit ($\alpha \gg 1$), transport is diffusive, while for the long-range limit ($\alpha \sim \mathcal{O}(1)$), we observe a super-diffusive transport regime. Using the numerical simulation of the Lindblad master equation, and corroborated with the analysis of the current operator norm, we identify a critical long-range hopping parameter, $\alpha_c \approx 1.5$, below which super-diffusive transport becomes evident that quickly becomes independent of the dephasing strength. Interstingly, within the super-diffusive regime, we find a crossover from logarithmic to power-law system-size dependence in the non-equilibrium steady-state resistance when $\alpha$ varies from $\alpha \leq 1$ to $\alpha \lesssim 1.5$. Our results, thus, elucidate the intricate balance between dephasing and unitary dynamics, revealing novel steady-state transport features.

categories: quant-ph cond-mat.mes-hall cond-mat.stat-mech cond-mat.str-el


title: ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video

abstract: Adapting image models to video domain is becoming an efficient paradigm for solving video recognition tasks. Due to the huge number of parameters and effective transferability of image models, performing full fine-tuning is less efficient and even unnecessary. Thus, recent research is shifting its focus towards parameter-efficient image-to-video adaptation. However, these adaptation strategies inevitably introduce extra computational cost to deal with the domain gap and temporal modeling in videos. In this paper, our goal is to present a zero-cost adaptation paradigm (ZeroI2V) to transfer the image transformers to video recognition tasks (i.e., introduce zero extra cost to the adapted models during inference). To achieve this goal, we present two core designs. First, to capture the dynamics in videos and reduce the difficulty of achieving image-to-video adaptation, we exploit the flexibility of self-attention and introduce the spatial-temporal dual-headed attention (STDHA) that efficiently endow the image transformers with temporal modeling capability at zero extra parameters and computation. Second, to handle the domain gap between images and videos, we propose a linear adaption strategy which utilizes lightweight densely placed linear adapters to fully transfer the frozen image models to video recognition. Due to its customized linear design, all newly added adapters could be easily merged with the original modules through structural reparameterization after training, thus achieving zero extra cost during inference. Extensive experiments on four widely-used video recognition benchmarks show that our ZeroI2V can match or even outperform previous state-of-the-art methods while enjoying superior parameter and inference efficiency.


title: On the finiteness of Bernoulli polynomials whose derivative has only integral coefficients

abstract: It is well known that the Bernoulli polynomials $\mathbf{B}_n(x)$ have nonintegral coefficients for $n \geq 1$. However, ten cases are known so far in which the derivative $\mathbf{B}'_n(x)$ has only integral coefficients. One may assume that the number of those derivatives is finite. We can link this conjecture to a recent conjecture about the properties of a product of primes satisfying certain $p$-adic conditions. Using a related result of Bordell\`es, Luca, Moree, and Shparlinski, we then show that the number of those derivatives is indeed finite. Furthermore, we derive other characterizations of the primary conjecture. Subsequently, we extend the results to higher derivatives of the Bernoulli polynomials. This provides a product formula for these denominators, and we show similar finiteness results.


title: Optimal Estimator for Linear Regression with Shuffled Labels

abstract: This paper considers the task of linear regression with shuffled labels, i.e., $\mathbf Y = \mathbf \Pi \mathbf X \mathbf B + \mathbf W$, where $\mathbf Y \in \mathbb R^{n\times m}, \mathbf Pi \in \mathbb R^{n\times n}, \mathbf X\in \mathbb R^{n\times p}, \mathbf B \in \mathbb R^{p\times m}$, and $\mathbf W\in \mathbb R^{n\times m}$, respectively, represent the sensing results, (unknown or missing) corresponding information, sensing matrix, signal of interest, and additive sensing noise. Given the observation $\mathbf Y$ and sensing matrix $\mathbf X$, we propose a one-step estimator to reconstruct $(\mathbf \Pi, \mathbf B)$. From the computational perspective, our estimator's complexity is $O(n^3 + np^2m)$, which is no greater than the maximum complexity of a linear assignment algorithm (e.g., $O(n^3)$) and a least square algorithm (e.g., $O(np^2 m)$). From the statistical perspective, we divide the minimum $snr$ requirement into four regimes, e.g., unknown, hard, medium, and easy regimes; and present sufficient conditions for the correct permutation recovery under each regime: $(i)$ $snr \geq \Omega(1)$ in the easy regime; $(ii)$ $snr \geq \Omega(\log n)$ in the medium regime; and $(iii)$ $snr \geq \Omega((\log n)^{c_0}\cdot n^{{c_1}/{srank(\mathbf B)}})$ in the hard regime ($c_0, c_1$ are some positive constants and $srank(\mathbf B)$ denotes the stable rank of $\mathbf B$). In the end, we also provide numerical experiments to confirm the above claims.


title: TACTiS-2: Better, Faster, Simpler Attentional Copulas for Multivariate Time Series

abstract: We introduce a new model for multivariate probabilistic time series prediction, designed to flexibly address a range of tasks including forecasting, interpolation, and their combinations. Building on copula theory, we propose a simplified objective for the recently-introduced transformer-based attentional copulas (TACTiS), wherein the number of distributional parameters now scales linearly with the number of variables instead of factorially. The new objective requires the introduction of a training curriculum, which goes hand-in-hand with necessary changes to the original architecture. We show that the resulting model has significantly better training dynamics and achieves state-of-the-art performance across diverse real-world forecasting tasks, while maintaining the flexibility of prior work, such as seamless handling of unaligned and unevenly-sampled time series. Code is made available at https://github.com/ServiceNow/TACTiS.


title: Improved regularity for the stochastic fast diffusion equation

abstract: We prove that the solution to the singular-degenerate stochastic fast-diffusion equation with parameter $m\in (0,1)$, with zero Dirichlet boundary conditions on a bounded domain in any spatial dimension, and driven by linear multiplicative Wiener noise, exhibits improved regularity in the Sobolev space $W^{1,m+1}_0$ for initial data in $L^{2}$.


title: BTR: Binary Token Representations for Efficient Retrieval Augmented Language Models

abstract: Retrieval augmentation addresses many critical problems in large language models such as hallucination, staleness, and privacy leaks. However, running retrieval-augmented language models (LMs) is slow and difficult to scale due to processing large amounts of retrieved text. We introduce binary token representations (BTR), which use 1-bit vectors to precompute every token in passages, significantly reducing computation during inference. Despite the potential loss of accuracy, our new calibration techniques and training objectives restore performance. Combined with offline and runtime compression, this only requires 127GB of disk space for encoding 3 billion tokens in Wikipedia. Our experiments show that on five knowledge-intensive NLP tasks, BTR accelerates state-of-the-art inference by up to 4x and reduces storage by over 100x while maintaining over 95% task performance.


title: Towards reporting bias in visual-language datasets: bimodal augmentation by decoupling object-attribute association

abstract: Reporting bias arises when people assume that some knowledge is universally understood and hence, do not necessitate explicit elaboration. In this paper, we focus on the wide existence of reporting bias in visual-language datasets, embodied as the object-attribute association, which can subsequentially degrade models trained on them. To mitigate this bias, we propose a bimodal augmentation (BiAug) approach through object-attribute decoupling to flexibly synthesize visual-language examples with a rich array of object-attribute pairing and construct cross-modal hard negatives. We employ large language models (LLMs) in conjunction with a grounding object detector to extract target objects. Subsequently, the LLM generates a detailed attribute description for each object and produces a corresponding hard negative counterpart. An inpainting model is then used to create images based on these detailed object descriptions. By doing so, the synthesized examples explicitly complement omitted objects and attributes to learn, and the hard negative pairs steer the model to distinguish object attributes. Our experiments demonstrated that BiAug is superior in object-attribute understanding. In addition, BiAug also improves the performance on zero-shot retrieval tasks on general benchmarks like MSCOCO and Flickr30K. BiAug refines the way of collecting text-image datasets. Mitigating the reporting bias helps models achieve a deeper understanding of visual-language phenomena, expanding beyond mere frequent patterns to encompass the richness and diversity of real-world scenarios.


title: ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactions

abstract: Unfamiliar decisions -- decisions where people lack adequate domain knowledge or expertise -- specifically increase the complexity and uncertainty of the process of searching for, understanding, and making decisions with online information. Through our formative study (n=14), we observed users' challenges in accessing diverse perspectives, identifying relevant information, and deciding the right moment to make the final decision. We present ChoiceMates, a system that enables conversations with a dynamic set of LLM-powered agents for a holistic domain understanding and efficient discovery and management of information to make decisions. Agents, as opinionated personas, flexibly join the conversation, not only providing responses but also conversing among themselves to elicit each agent's preferences. Our between-subjects study (n=36) comparing ChoiceMates to conventional web search and single-agent showed that ChoiceMates was more helpful in discovering, diving deeper, and managing information compared to Web with higher confidence. We also describe how participants utilized multi-agent conversations in their decision-making process.


title: Deformation Localisation in Ion-Irradiated FeCr

abstract: Irradiation-induced ductility loss is a major concern facing structural steels in next-generation nuclear reactors. Currently, the mechanisms for this are unclear but crucial to address for the design of reactor components. Here, the deformation characteristics around nanoindents in Fe and Fe10Cr irradiated with Fe ions to $\sim$1 displacement-per-atom at 313 K are non-destructively studied. Deformation localisation in the irradiated materials is evident from the increased pile-up height and slip step formation, measured by atomic force microscopy. From 3D X-ray Laue diffraction, measurements of lattice rotation and strain fields near the indent site show a large confinement, over 85%, of plasticity in the irradiated material. We find that despite causing increased irradiation hardening, Cr content has little effect on the irradiation-induced changes in pile-up topography and deformation fields. The results demonstrate that varying Cr content in steels has limited impact on retaining strain hardening capacity and reducing irradiation-induced embrittlement.


title: Higher Analogues of Discrete Topological Complexity

abstract: In this paper, we introduce the n-th discrete topological complexity and study its properties such as its relation with simplicial Lusternik-Schnirelmann category and how the higher dimensions of discrete topological complexity relate with each other. Moreover, we find a lower bound of $n-$discrete topological complexity which is given by the n-th usual topological complexity of the geometric realisation of that complex. Furthermore, we give an example for the strict case of that lower bound.


title: Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy

abstract: Sparsely activated Mixture-of-Experts (SMoE) has shown promise to scale up the learning capacity of neural networks, however, they have issues like (a) High Memory Usage, due to duplication of the network layers into multiple copies as experts; and (b) Redundancy in Experts, as common learning-based routing policies suffer from representational collapse. Therefore, vanilla SMoE models are memory inefficient and non-scalable, especially for resource-constrained downstream scenarios. In this paper, we ask: Can we craft a compact SMoE model by consolidating expert information? What is the best recipe to merge multiple experts into fewer but more knowledgeable experts? Our pilot investigation reveals that conventional model merging methods fail to be effective in such expert merging for SMoE. The potential reasons are: (1) redundant information overshadows critical experts; (2) appropriate neuron permutation for each expert is missing to bring all of them in alignment. To address this, we propose M-SMoE, which leverages routing statistics to guide expert merging. Specifically, it starts with neuron permutation alignment for experts; then, dominant experts and their "group members" are formed; lastly, every expert group is merged into a single expert by utilizing each expert's activation frequency as their weight for merging, thus diminishing the impact of insignificant experts. Moreover, we observed that our proposed merging promotes a low dimensionality in the merged expert's weight space, naturally paving the way for additional compression. Hence, our final method, MC-SMoE (i.e., Merge, then Compress SMoE), further decomposes the merged experts into low-rank and structural sparse alternatives. Extensive experiments across 8 benchmarks validate the effectiveness of MC-SMoE. For instance, our MC-SMoE achieves up to 80% memory and a 20% FLOPs reduction, with virtually no loss in performance.


title: Extended Kinematical 3D Gravity Theories

abstract: In this work, we classify all extended and generalized kinematical Lie algebras that can be obtained by expanding the $\mathfrak{so}\left(2,2\right)$ algebra. We show that the Lie algebra expansion method based on semigroups reproduces not only the original kinematical algebras but also a family of non- and ultra-relativistic algebras. Remarkably, the extended kinematical algebras obtained as sequential expansions of the AdS algebra are characterized by a non-degenerate bilinear invariant form, ensuring the construction of a well-defined Chern-Simons gravity action in three spacetime dimensions. Contrary to the contraction process, the degeneracy of the non-Lorentzian theories is avoided without extending the relativistic algebra but considering a bigger semigroup. Using the properties of the expansion procedure, we show that our construction also applies at the level of the Chern-Simons action.


title: JugglePAC: A Pipelined Accumulation Circuit

abstract: Summing a set of numbers, namely, "Accumulation," is a subtask within many computational tasks. If the numbers to sum arrive non-stop in back-to-back clock cycles at high clock frequencies, summing them without allowing them to pile up can be quite a challenge, that is, when the latency of addition (i.e., summing two numbers) is longer than one clock cycle, which is always the case for floating-point numbers. This could also be the case for integer summations with high clock frequencies. In the case of floating-point numbers, this is handled by pipelining the adder, but that does not solve all problems. The challenges include optimization of speed, area, and latency. As well as the adaptability of the design to different application requirements, such as the ability to handle variable-size subsequent data sets with no time gap in between and with results produced in the input-order. All these factors make designing an efficient floating-point accumulator a non-trivial problem. Integer accumulation is a relatively simpler problem, where high frequencies can be achieved by using carry-save tree adders. This can then be further improved by efficient resource-sharing. In this paper, we present two fast and area-efficient accumulation circuits, JugglePAC and INTAC. JugglePAC is tailored for floating-point reduction operations (such as accumulation) and offers significant advantages with respect to the literature in terms of speed, area, and adaptability to various application requirements. INTAC is designed for fast integer accumulation. Using carry-save adders and resource-sharing, it can achieve very high clock frequencies while maintaining a low area complexity.


title: Optical conductivity and damping of plasmons due to electron-electron interaction

abstract: We re-visit the issue of plasmon damping due to electron-electron interaction. The plasmon linewidth can related to the imaginary part of the charge susceptibility or, equivalently, to the real part of the optical conductivity, $\mathrm{Re}\sigma(q,\omega)$. Approaching the problem first via a standard semi-classical Boltzmann equation, we show that $\mathrm{Re}\sigma(q,\omega)$ of two-dimensional (2D) electron gas scales as $q^2T^2/\omega^4$ for $\omega\ll T$, which agrees with the results of Refs. [1] and [2] but disagrees with that of Ref. [3], according to which $\mathrm{Re}\sigma(q,\omega) \propto q^2T^2/\omega^2$. To resolve this disagreement, we re-derive $\mathrm{Re}\sigma(q,\omega)$ using the original method of Ref. {mishchenko:2004} for an arbitrary ratio $\omega/T$ and show that, while the last term is, indeed, present, it is subleading to the $q^2T^2/\omega^4$ term. We give a physical interpretation of both leading and subleading contributions in terms of the shear and bulk viscosities of an electron liquid, respectively. We also calculate $\mathrm{Re}\sigma(q,\omega)$ for a three-dimensional (3D) electron gas and doped monolayer graphene. We find that, with all other parameters being equal, finite temperature has the strongest effect on the plasmon linewidth in graphene, where it scales as $T^4\ln T$ for $\omega\ll T$.


title: Uncovering measurement-induced entanglement via directional adaptive dynamics and incomplete information

abstract: The rich entanglement dynamics and transitions exhibited by monitored quantum systems typically only exist in the conditional state, making observation extremely difficult. In this work we construct a general recipe for mimicking the conditional entanglement dynamics of a monitored system in a corresponding measurement-free dissipative system involving directional interactions between the original system and a set of auxiliary register modes. This mirror setup autonomously implements a measurement-feedforward dynamics that effectively retains a small fraction of the information content in a typical measurement record. We illustrate our ideas in a bosonic system featuring a competition between entangling measurements and local unitary dynamics, and also discuss extensions to qubit systems and truly many-body systems.


title: Improving Dialogue Management: Quality Datasets vs Models

abstract: Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards a good goal for the user by providing the best possible response. Previous works have proposed rule-based systems (RBS), reinforcement learning (RL), and supervised learning (SL) as solutions for the correct dialogue management; in other words, select the best response given input by the user. However, this work argues that the leading cause of DMs not achieving maximum performance resides in the quality of the datasets rather than the models employed thus far; this means that dataset errors, like mislabeling, originate a large percentage of failures in dialogue management. We studied the main errors in the most widely used datasets, Multiwoz 2.1 and SGD, to demonstrate this hypothesis. To do this, we have designed a synthetic dialogue generator to fully control the amount and type of errors introduced in the dataset. Using this generator, we demonstrated that errors in the datasets contribute proportionally to the performance of the models


title: Extensions of Schoen--Simon--Yau and Schoen--Simon theorems via iteration \`{a} la De Giorgi

abstract: We give an alternative proof of the Schoen--Simon--Yau curvature estimates and associated Bernstein-type theorems (1975), and extend the original result by including the case of $6$-dimensional (stable minimal) immersions. The key step is an $\epsilon$-regularity theorem, that assumes smallness of the scale-invariant $L^2$ norm of the second fundamental form. Further, we obtain a graph description, in the Lipschitz multi-valued sense, for any stable minimal immersion of dimension $n\geq 2$, that may have a singular set $\Sigma$ of locally finite $\mathcal{H}^{n-2}$-measure, and that is weakly close to a hyperplane. (In fact, if $\mathcal{H}^{n-2}(\Sigma)=0$, the conclusion is strengthened to a union of smooth graphs.) This follows directly from an $\epsilon$-regularity theorem, that assumes smallness of the scale-invariant $L^2$ tilt-excess (verified when the hypersurface is weakly close to a hyperplane). A further direct consequence is that (for an immersed hypersurface of the type considered) any tangent cone supported on a hyperplane is the unique tangent. Specialising the multi-valued decomposition to the case of embeddings, we recover the Schoen--Simon theorem (1981). In both $\epsilon$-regularity theorems the relevant quantity (respectively, length of the second fundamental form and tilt function) solves a non-linear PDE on the immersed minimal hypersurface. The proof is carried out intrinsically (without linearising the PDE) by implementing an iteration method \`{a} la De Giorgi (from the linear De Giorgi--Nash--Moser theory). Stability implies estimates (intrinsic weak Caccioppoli inequalities) that make the iteration effective despite the non-linear framework. (In both $\epsilon$-regularity theorems the method gives explicit constants that quantify the required smallness.)


title: Two-dimensional ideal magnetohydrodynamic waves on a rotating sphere under a non-Malkus field: I. Continuous spectrum and its ray-theoretical interpretation

abstract: Two-dimensional (2D) ideal incompressible magnetohydrodynamic (MHD) linear waves at the surface of a rotating sphere are studied as a model imitating the outermost Earth's core or the solar tachocline. This thin conducting layer is permeated by a toroidal magnetic field whose magnitude depends only on the latitude. The Malkus background field, which is proportional to the sine of the colatitude, gives two well-known groups of branches on which Alfv\'en waves gradually become fast or slow magnetic Rossby (MR) waves as the field amplitude decreases. For non-Malkus fields, we show that the associated eigenvalue problems can yield a continuous spectrum instead of Alfv\'en and slow MR discrete modes. Critical latitudes attributed to the Alfv\'en resonance wipe out these discrete eigenvalues and produce an infinite number of singular eigenmodes. The theory of slowly varying wave trains in an inhomogeneous magnetic field shows that a wave packet related to this continuous spectrum propagates toward a critical latitude corresponding to the wave and is eventually absorbed there. The expected behaviour that the retrograde propagating packets which pertain to the continuous spectrum approach the latitudes from the equatorial side and that the prograde ones approach there from the polar side is consistent with the profiles of their eigenfunctions shown by our numerical calculations. Further in-depth discussions of the Alfv\'en continuum would progress the theory of ``wave-mean field interaction'' in the MHD system and one's understanding of the dynamics in such thin layers.


title: Near-field Integrated Sensing and Communication: Opportunities and Challenges

abstract: With the extremely large-scale array XL-array deployed in future wireless systems, wireless communication and sensing are expected to operate in the radiative near-field region, which needs to be characterized by the spherical rather than planar wavefronts. Unlike most existing works that considered far-field integrated sensing and communication (ISAC), we study in this article the new near-field ISAC, which integrates both functions of sensing and communication in the near-field region. To this end, we first discuss the appealing advantages of near-field communication and sensing over their far-field counterparts, respectively. Then, we introduce three approaches for near-field ISAC, including joint near-field communication and sensing, sensing-assisted near-field communication, and communication-assisted near-field sensing. We discuss their individual research opportunities, new design issues, as well as propose promising solutions. Finally, several important directions in near-field ISAC are also highlighted to motivate future work.


title: On a Derivation of the Absorbing Boundary Rule

abstract: Consider detectors waiting for a quantum particle to arrive at a surface $S$ in 3-space. For predicting the probability distribution of the time and place of detection, a rule was proposed in [arXiv:1601.03715], called the absorbing boundary rule (ABR) and involving a 1-particle Schr\"odinger equation with an absorbing boundary condition on $S$. While plausibility arguments for the ABR were given there, it would be desirable to derive the ABR from a microscopic model of a detector. We outline here such a derivation by putting together known results from the literature. Our derivation is non-rigorous, and it would still be desirable to have a rigorous version of it in the future.


title: Measuring gravity by holding atoms

abstract: Despite being the dominant force of nature on large scales, gravity remains relatively elusive to experimental measurement. Many questions remain, such as its behavior at small scales or its role in phenomena ascribed to dark matter and dark energy. Atom interferometers are powerful tools for probing Earth's gravity, the gravitational constant, dark energy theories and general relativity. However, they typically use atoms in free fall, which limits the measurement time to only a few seconds, and to even briefer intervals when measuring the interaction of the atoms with a stationary source mass. Recently, interferometers with atoms suspended for as long as 70 seconds in an optical lattice have been demonstrated. To keep the atoms from falling, however, the optical lattice must apply forces that are billion-fold as strong as the putative signals, so even tiny imperfections reduce sensitivity and generate complex systematic effects. As a result, lattice interferometers have yet to demonstrate precision and accuracy on par with their free fall counterparts and have yet to be used for precision measurement. Here, we optimize the sensitivity of a lattice interferometer and use a system of signal inversions and switches to suppress and quantify systematic effects. This enables us to measure the attraction of a miniature source mass, ruling out the existence of screened dark energy theories over their natural parameter space. More importantly, the combined accuracy of $6.2~\rm{nm/s}^2$ is four times as good as the best similar measurements with freely falling atoms, demonstrating the advantages of lattice interferometry in fundamental physics measurements. Further upgrades may enable measuring forces at sub-millimeter ranges, the gravitational Aharonov-Bohm effect and the gravitational constant, compact gravimetry, and testing whether the gravitational field itself has quantum properties.


title: The Superconducting Quasiparticle-Amplifying Transmon: A Qubit-Based Sensor for meV Scale Phonons and Single THz Photons

abstract: With great interest from the quantum computing community, an immense amount of R&D effort has been invested into improving superconducting qubits. The technologies developed for the design and fabrication of these qubits can be directly applied to applications for ultra-low threshold particle detectors, e.g. low-mass dark matter and far-IR photon sensing. We propose a novel sensor based on the transmon qubit architecture combined with a signal-enhancing superconducting quasiparticle amplification stage. We refer to these sensors as SQUATs: Superconducting Quasiparticle-Amplifying Transmons. We detail the operating principle and design of this new sensor and predict that with minimal R&D effort, solid-state based detectors patterned with these sensors can achieve sensitivity to single THz photons, and sensitivity to $1\,\mathrm{meV}$ phonons in the detector absorber substrate on the $\mu\mathrm{s}$ timescale.


title: The $\sigma_k$-Loewner-Nirenberg problem on Riemannian manifolds for $k<\frac{n}{2}$

abstract: Let $(M^n,g_0)$ be a smooth compact Riemannian manifold of dimension $n\geq 3$ with non-empty boundary $\partial M$. Let $\Gamma\subset\mathbb{R}^n$ be a symmetric convex cone and $f$ a symmetric defining function for $\Gamma$ satisfying standard assumptions. Under an algebraic condition on $\Gamma$, which is satisfied for example by the G\r{a}rding cones $\Gamma_k^+$ when $k<\frac{n}{2}$, we prove the existence of a Lipschitz viscosity solution $g_u = e^{2u}g_0$ to the fully nonlinear Loewner-Nirenberg problem associated to $(f,\Gamma)$, \begin{align*} \begin{cases} f(\lambda(-g_u^{-1}A_{g_u})) = 1, \quad \lambda(-g_u^{-1}A_{g_u}) \in \Gamma & \mathrm{on~}M\backslash\partial M \newline u(x)\rightarrow+\infty & \mathrm{as~}\operatorname{dist}_{g_0}(x,\partial M)\rightarrow 0, \end{cases} \end{align*} where $A_{g_u}$ is the Schouten tensor of $g_u$. Previous results on Euclidean domains show that, in general, $u$ is not differentiable. The solution $u$ is obtained as the limit of smooth solutions to a sequence of fully nonlinear Loewner-Nirenberg problems on approximating cones containing $(1,0,\dots,0)$, for which we also have uniqueness. In the process, we obtain an existence and uniqueness result for the corresponding Dirichlet boundary value problem with finite boundary data, which is also of independent interest. An important feature of our paper is that the existence of a conformal metric $g$ satisfying $\lambda(-g^{-1}A_g)\in\Gamma$ on $M$ is a consequence of our results, rather than an assumption.


abstract: The recent resolution of the NLTS Conjecture [ABN22] establishes a prerequisite to the Quantum PCP (QPCP) Conjecture through a novel use of newly-constructed QLDPC codes [LZ22]. Even with NLTS now solved, there remain many independent and unresolved prerequisites to the QPCP Conjecture, such as the NLSS Conjecture of [GL22]. In this work we focus on a specific and natural prerequisite to both NLSS and the QPCP Conjecture, namely, the existence of local Hamiltonians whose low-energy states all require $\omega(\log n)$ T gates to prepare. In fact, we prove a stronger result which is not necessarily implied by either conjecture: we construct local Hamiltonians whose low-energy states require $\Omega(n)$ T gates. We further show that our procedure can be applied to the NLTS Hamiltonians of [ABN22] to yield local Hamiltonians whose low-energy states require both $\Omega(\log n)$-depth and $\Omega(n)$ T gates to prepare. In order to accomplish this we define a "pseudo-stabilizer" property of a state with respect to each local Hamiltonian term, and prove an additive local energy lower bound for each term at which the state is pseudo-stabilizer. By proving a relationship between the number of T gates preparing a state and the number of terms at which the state is pseudo-stabilizer, we are able to give a constant energy lower bound which applies to any state with T-count less than $c \cdot n$ for some fixed positive constant $c$. This result represents a significant improvement over [CCNN23] where we used a different technique to give an energy bound which only distinguishes between stabilizer states and states which require a non-zero number of T gates.


title: Fairly Extreme: Minimizing Outages Equitably

abstract: This paper focuses on the problem of minimizing the outages due to extreme events on the power grid equitably among all customers of the grid. The paper presents two ways of incorporating fairness into the existing formulations that seek to minimize the total outage in the power grid. The first method is motivated by existing literature on incorporating fairness in optimization problems and this is done by modifying the problem's objective function. The second method introduces a novel notion of fairness, termed $\varepsilon$-fairness, that can be incorporated into existing problem formulations through a single second-order cone constraint. Both these methods are very general and can be used to incorporate fairness in existing planning and operational optimization problems in the power grid and beyond. Extensive computational case studies that examine the effectiveness of both these methods to characterize fairness is presented followed by conclusions and ways forward.


title: Hydrodynamic regime and cold plasmas hit by short laser pulses

abstract: We briefly report and elaborate on some conditions allowing a hydrodynamic description of the impact of a very short and arbitrarily intense laser pulse onto a cold plasma, as well as the localization of the first wave-breaking due to the plasma inhomogeneity. We use a recently developed fully relativistic plane model whereby we reduce the system of the Lorentz-Maxwell and continuity PDEs into a 1-parameter family of decoupled systems of non-autonomous Hamilton equations in dimension 1, with the light-like coordinate $\xi=ct\!-\!z$ replacing time $t$ as an independent variable. Apriori estimates on the Jacobian $\hat J$ of the change from Lagrangian to Eulerian coordinates in terms of the input data (initial density and pulse profile) are obtained applying Liapunov direct method to an associated family of pairs of ODEs; wave-breaking is pinpointed by the inequality $\hat J\le 0$. These results may help in drastically simplifying the study of extreme acceleration mechanisms of electrons, which have very important applications.


title: A peridynamic-informed deep learning model for brittle damage prediction

abstract: In this study, a novel approach that combines the principles of peridynamic (PD) theory with PINN is presented to predict quasi-static damage and crack propagation in brittle materials. To achieve high prediction accuracy and convergence rate, the linearized PD governing equation is enforced in the PINN's residual-based loss function. The proposed PD-INN is able to learn and capture intricate displacement patterns associated with different geometrical parameters, such as pre-crack position and length. Several enhancements like cyclical annealing schedule and deformation gradient aware optimization technique are proposed to ensure the model would not get stuck in its trivial solution. The model's performance assessment is conducted by monitoring the behavior of loss function throughout the training process. The PD-INN predictions are also validated through several benchmark cases with the results obtained from high-fidelity techniques such as PD direct numerical method and Extended-Finite Element Method. Our results show the ability of the nonlocal PD-INN to predict damage and crack propagation accurately and efficiently.


title: Streaming Motion Forecasting for Autonomous Driving

abstract: Trajectory forecasting is a widely-studied problem for autonomous navigation. However, existing benchmarks evaluate forecasting based on independent snapshots of trajectories, which are not representative of real-world applications that operate on a continuous stream of data. To bridge this gap, we introduce a benchmark that continuously queries future trajectories on streaming data and we refer to it as "streaming forecasting." Our benchmark inherently captures the disappearance and re-appearance of agents, presenting the emergent challenge of forecasting for occluded agents, which is a safety-critical problem yet overlooked by snapshot-based benchmarks. Moreover, forecasting in the context of continuous timestamps naturally asks for temporal coherence between predictions from adjacent timestamps. Based on this benchmark, we further provide solutions and analysis for streaming forecasting. We propose a plug-and-play meta-algorithm called "Predictive Streamer" that can adapt any snapshot-based forecaster into a streaming forecaster. Our algorithm estimates the states of occluded agents by propagating their positions with multi-modal trajectories, and leverages differentiable filters to ensure temporal consistency. Both occlusion reasoning and temporal coherence strategies significantly improve forecasting quality, resulting in 25% smaller endpoint errors for occluded agents and 10-20% smaller fluctuations of trajectories. Our work is intended to generate interest within the community by highlighting the importance of addressing motion forecasting in its intrinsic streaming setting. Code is available at https://github.com/ziqipang/StreamingForecasting.


title: RA-DIT: Retrieval-Augmented Dual Instruction Tuning

abstract: Retrieval-augmented language models (RALMs) improve performance by accessing long-tail and up-to-date knowledge from external data stores, but are challenging to build. Existing approaches require either expensive retrieval-specific modifications to LM pre-training or use post-hoc integration of the data store that leads to suboptimal performance. We introduce Retrieval-Augmented Dual Instruction Tuning (RA-DIT), a lightweight fine-tuning methodology that provides a third option by retrofitting any LLM with retrieval capabilities. Our approach operates in two distinct fine-tuning steps: (1) one updates a pre-trained LM to better use retrieved information, while (2) the other updates the retriever to return more relevant results, as preferred by the LM. By fine-tuning over tasks that require both knowledge utilization and contextual awareness, we demonstrate that each stage yields significant performance improvements, and using both leads to additional gains. Our best model, RA-DIT 65B, achieves state-of-the-art performance across a range of knowledge-intensive zero- and few-shot learning benchmarks, significantly outperforming existing in-context RALM approaches by up to +8.9% in 0-shot setting and +1.4% in 5-shot setting on average.


title: Scaling Up Music Information Retrieval Training with Semi-Supervised Learning

abstract: In the era of data-driven Music Information Retrieval (MIR), the scarcity of labeled data has been one of the major concerns to the success of an MIR task. In this work, we leverage the semi-supervised teacher-student training approach to improve MIR tasks. For training, we scale up the unlabeled music data to 240k hours, which is much larger than any public MIR datasets. We iteratively create and refine the pseudo-labels in the noisy teacher-student training process. Knowledge expansion is also explored to iteratively scale up the model sizes from as small as less than 3M to almost 100M parameters. We study the performance correlation between data size and model size in the experiments. By scaling up both model size and training data, our models achieve state-of-the-art results on several MIR tasks compared to models that are either trained in a supervised manner or based on a self-supervised pretrained model. To our knowledge, this is the first attempt to study the effects of scaling up both model and training data for a variety of MIR tasks.


title: Separation-of-charge confinement and the Higgs transition in SU(3) gauge Higgs theory

abstract: With SU(3) gauge Higgs theory as an example, we examine critically the idea that the confinement property in an SU(N) gauge-Higgs theory, with the Higgs field in the fundamental representation, persists in an unbroken SU(N-1) subgroup.


title: Evolution of self-organized structure, the internal transport barrier in the ion-temperature-gradient driven gyrokinetic turbulence

abstract: Understanding the self-organization of the most promising internal transport barrier in fusion plasmas needs a long-time nonlinear gyrokinetic global simulation. The Neighboring Equilibrium Update method, which solves the secularity problem in a perturbative simulation and speeds up the numerical computation by more than 10 times. It is found that the internal transport barrier emerges at the magnetic axis due to inward propagated turbulence avalanche, and its outward expansion is the catastrophe of self-organized structure induced by outward propagated avalanche.


title: Less is More: Toward Zero-Shot Local Scene Graph Generation via Foundation Models

abstract: Humans inherently recognize objects via selective visual perception, transform specific regions from the visual field into structured symbolic knowledge, and reason their relationships among regions based on the allocation of limited attention resources in line with humans' goals. While it is intuitive for humans, contemporary perception systems falter in extracting structural information due to the intricate cognitive abilities and commonsense knowledge required. To fill this gap, we present a new task called Local Scene Graph Generation. Distinct from the conventional scene graph generation task, which encompasses generating all objects and relationships in an image, our proposed task aims to abstract pertinent structural information with partial objects and their relationships for boosting downstream tasks that demand advanced comprehension and reasoning capabilities. Correspondingly, we introduce zEro-shot Local scEne GrAph geNeraTion (ELEGANT), a framework harnessing foundation models renowned for their powerful perception and commonsense reasoning, where collaboration and information communication among foundation models yield superior outcomes and realize zero-shot local scene graph generation without requiring labeled supervision. Furthermore, we propose a novel open-ended evaluation metric, Entity-level CLIPScorE (ECLIPSE), surpassing previous closed-set evaluation metrics by transcending their limited label space, offering a broader assessment. Experiment results show that our approach markedly outperforms baselines in the open-ended evaluation setting, and it also achieves a significant performance boost of up to 24.58% over prior methods in the close-set setting, demonstrating the effectiveness and powerful reasoning ability of our proposed framework.


title: Prompt GRB Polarization from Non-Axisymmetric Jets

abstract: Time-resolved linear polarization ($\Pi$) measurements of the prompt gamma-ray burst emission can reveal its dominant radiation mechanism. A widely considered mechanism is synchrotron radiation, for which linear polarization can be used to probe the jet's magnetic-field structure, and in turn its composition. In axisymmetric jet models the polarization angle (PA) can only change by $90^\circ$, as $\Pi$ temporarily vanishes. However, some time-resolved measurements find a continuously changing PA, which requires the flow to be non-axisymmetric in at least one out of its emissivity, bulk Lorentz factor or magnetic field. Here we consider synchrotron emission in non-axisymmetric jets, from an ultrarelativistic thin shell, comprising multiple radially-expanding mini-jets (MJs) or emissivity patches within the global jet, that yield a continuously changing PA. We explore a wide variety of possibilities with emission consisting of a single pulse or multiple overlapping pulses, presenting time-resolved and integrated polarization from different magnetic field configurations and jet angular structures. We find that emission from multiple incoherent MJs/patches reduces the net polarization due to partial cancellation in the Stokes plane. When these contain a large-scale ordered field in the plane transverse to the radial direction, $\Pi$ always starts near maximal and then declines over the single pulse or shows multiple highly polarized peaks due to multiple pulses. Observing $\Pi\lesssim40\%$ ($15\%$) integrated over one (several) pulse(s) will instead favor a shock-produced small-scale field either ordered in the radial direction or tangled in the plane transverse to it.


title: NEUCORE: Neural Concept Reasoning for Composed Image Retrieval

abstract: Composed image retrieval which combines a reference image and a text modifier to identify the desired target image is a challenging task, and requires the model to comprehend both vision and language modalities and their interactions. Existing approaches focus on holistic multi-modal interaction modeling, and ignore the composed and complimentary property between the reference image and text modifier. In order to better utilize the complementarity of multi-modal inputs for effective information fusion and retrieval, we move the multi-modal understanding to fine-granularity at concept-level, and learn the multi-modal concept alignment to identify the visual location in reference or target images corresponding to text modifier. Toward the end, we propose a NEUral COncept REasoning (NEUCORE) model which incorporates multi-modal concept alignment and progressive multimodal fusion over aligned concepts. Specifically, considering that text modifier may refer to semantic concepts not existing in the reference image and requiring to be added into the target image, we learn the multi-modal concept alignment between the text modifier and the concatenation of reference and target images, under multiple-instance learning framework with image and sentence level weak supervision. Furthermore, based on aligned concepts, to form discriminative fusion features of the input modalities for accurate target image retrieval, we propose a progressive fusion strategy with unified execution architecture instantiated by the attended language semantic concepts. Our proposed approach is evaluated on three datasets and achieves state-of-the-art results.


title: On a class of anisotropic Muckenhoupt weights and their applications to $p$-Laplace equations

abstract: In this paper, a class of anisotropic weights having the form of $|x'|^{\theta_{1}}|x|^{\theta_{2}}|x_{n}|^{\theta_{3}}$ in dimensions $n\geq2$ is considered, where $x=(x',x_{n})$ and $x'=(x_{1},...,x_{n-1})$. We first find the optimal range of $(\theta_{1},\theta_{2},\theta_{3})$ such that this type of weights belongs to the Muckenhoupt class $A_{q}$. Then we further study its doubling property, which shows that it provides an example of a doubling measure but is not in $A_{q}$. As a consequence, we obtain anisotropic weighted Poincar\'{e} and Sobolev inequalities, which are used to study the local behavior for solutions to non-homogeneous weighted $p$-Laplace equations.


title: Toward Scalable Visual Servoing Using Deep Reinforcement Learning and Optimal Control

abstract: Classical pixel-based Visual Servoing (VS) approaches offer high accuracy but suffer from a limited convergence area due to optimization nonlinearity. Modern deep learning-based VS methods overcome traditional vision issues but lack scalability, requiring training on limited scenes. This paper proposes a hybrid VS strategy utilizing Deep Reinforcement Learning (DRL) and optimal control to enhance both convergence area and scalability. The DRL component of our approach separately handles representation and policy learning to enhance scalability, generalizability, learning efficiency and ease domain adaptation. Moreover, the optimal control part ensures high end-point accuracy. Our method showcases remarkable achievements in terms of high convergence rates and minimal end-positioning errors using a 7-DOF manipulator. Importantly, it exhibits scalability across more than 1000 distinct scenes. Furthermore, we demonstrate its capacity for generalization to previously unseen datasets. Lastly, we illustrate the real-world applicability of our approach, highlighting its adaptability through single-shot domain transfer learning in environments with noise and occlusions. Real-robot experiments can be found at \url{https://sites.google.com/view/vsls}.


title: GenSim: Generating Robotic Simulation Tasks via Large Language Models

abstract: Collecting large amounts of real-world interaction data to train general robotic policies is often prohibitively expensive, thus motivating the use of simulation data. However, existing methods for data generation have generally focused on scene-level diversity (e.g., object instances and poses) rather than task-level diversity, due to the human effort required to come up with and verify novel tasks. This has made it challenging for policies trained on simulation data to demonstrate significant task-level generalization. In this paper, we propose to automatically generate rich simulation environments and expert demonstrations by exploiting a large language models' (LLM) grounding and coding ability. Our approach, dubbed GenSim, has two modes: goal-directed generation, wherein a target task is given to the LLM and the LLM proposes a task curriculum to solve the target task, and exploratory generation, wherein the LLM bootstraps from previous tasks and iteratively proposes novel tasks that would be helpful in solving more complex tasks. We use GPT4 to expand the existing benchmark by ten times to over 100 tasks, on which we conduct supervised finetuning and evaluate several LLMs including finetuned GPTs and Code Llama on code generation for robotic simulation tasks. Furthermore, we observe that LLMs-generated simulation programs can enhance task-level generalization significantly when used for multitask policy training. We further find that with minimal sim-to-real adaptation, the multitask policies pretrained on GPT4-generated simulation tasks exhibit stronger transfer to unseen long-horizon tasks in the real world and outperform baselines by 25%. See the project website (https://liruiw.github.io/gensim) for code, demos, and videos.


title: Robot Fleet Learning via Policy Merging

abstract: Fleets of robots ingest massive amounts of heterogeneous streaming data silos generated by interacting with their environments, far more than what can be stored or transmitted with ease. At the same time, teams of robots should co-acquire diverse skills through their heterogeneous experiences in varied settings. How can we enable such fleet-level learning without having to transmit or centralize fleet-scale data? In this paper, we investigate policy merging (PoMe) from such distributed heterogeneous datasets as a potential solution. To efficiently merge policies in the fleet setting, we propose FLEET-MERGE, an instantiation of distributed learning that accounts for the permutation invariance that arises when parameterizing the control policies with recurrent neural networks. We show that FLEET-MERGE consolidates the behavior of policies trained on 50 tasks in the Meta-World environment, with good performance on nearly all training tasks at test time. Moreover, we introduce a novel robotic tool-use benchmark, FLEET-TOOLS, for fleet policy learning in compositional and contact-rich robot manipulation tasks, to validate the efficacy of FLEET-MERGE on the benchmark.


title: EAST: Environment Aware Safe Tracking using Planning and Control Co-Design

abstract: This paper considers the problem of autonomous robot navigation in unknown environments with moving obstacles. We propose a new method that systematically puts planning, motion prediction and safety metric design together to achieve environmental adaptive and safe navigation. This algorithm balances optimality in travel distance and safety with respect to passing clearance. Robot adapts progress speed adaptively according to the sensed environment, being fast in wide open areas and slow down in narrow passages and taking necessary maneuvers to avoid dangerous incoming obstacles. In our method, directional distance measure, conic-shape motion prediction and custom costmap are integrated properly to evaluate system risk accurately with respect to local geometry of surrounding environments. Using such risk estimation, reference governor technique and control barrier function are worked together to enable adaptive and safe path tracking in dynamical environments. We validate our algorithm extensively both in simulation and challenging real-world environments.


title: Steepest geometric descent for regularized quasiconvex functions

abstract: We establish existence of steepest descent curves emanating from almost every point of a regular locally Lipschitz quasiconvex functions, where regularity means that the sweeping process induced by the sublevel sets is reversible. We then use max-convolution to regularize general quasiconvex functions and obtain a result of the same nature in a more general setting.


title: Elephant Neural Networks: Born to Be a Continual Learner

abstract: Catastrophic forgetting remains a significant challenge to continual learning for decades. While recent works have proposed effective methods to mitigate this problem, they mainly focus on the algorithmic side. Meanwhile, we do not fully understand what architectural properties of neural networks lead to catastrophic forgetting. This study aims to fill this gap by studying the role of activation functions in the training dynamics of neural networks and their impact on catastrophic forgetting. Our study reveals that, besides sparse representations, the gradient sparsity of activation functions also plays an important role in reducing forgetting. Based on this insight, we propose a new class of activation functions, elephant activation functions, that can generate both sparse representations and sparse gradients. We show that by simply replacing classical activation functions with elephant activation functions, we can significantly improve the resilience of neural networks to catastrophic forgetting. Our method has broad applicability and benefits for continual learning in regression, class incremental learning, and reinforcement learning tasks. Specifically, we achieves excellent performance on Split MNIST dataset in just one single pass, without using replay buffer, task boundary information, or pre-training.


title: Window-based Model Averaging Improves Generalization in Heterogeneous Federated Learning

abstract: Federated Learning (FL) aims to learn a global model from distributed users while protecting their privacy. However, when data are distributed heterogeneously the learning process becomes noisy, unstable, and biased towards the last seen clients' data, slowing down convergence. To address these issues and improve the robustness and generalization capabilities of the global model, we propose WIMA (Window-based Model Averaging). WIMA aggregates global models from different rounds using a window-based approach, effectively capturing knowledge from multiple users and reducing the bias from the last ones. By adopting a windowed view on the rounds, WIMA can be applied from the initial stages of training. Importantly, our method introduces no additional communication or client-side computation overhead. Our experiments demonstrate the robustness of WIMA against distribution shifts and bad client sampling, resulting in smoother and more stable learning trends. Additionally, WIMA can be easily integrated with state-of-the-art algorithms. We extensively evaluate our approach on standard FL benchmarks, demonstrating its effectiveness.


title: On the Ziv-Merhav theorem beyond Markovianity

abstract: We generalize to a broader class of decoupled measures a result of Ziv and Merhav on universal estimation of the specific cross (or relative) entropy for a pair of multi-level Markov measures. The result covers pairs of suitably regular g-measures and pairs of equilibrium measures arising from the small space of interactions in mathematical statistical mechanics.


title: Co-orientable taut foliations in Dehn fillings of pseudo-Anosov mapping tori with co-orientation-reversing monodromy

abstract: Let $\Sigma$ be a compact orientable surface with nonempty boundary, let $\varphi: \Sigma \to \Sigma$ be an orientation-preserving pseudo-Anosov homeomorphism, and let $M = \Sigma \times I / \stackrel{\varphi}{\sim}$ be the mapping torus of $\Sigma$ over $\varphi$. Let $\mathcal{F}^{s}$ denote the stable foliation of $\varphi$ in $\Sigma$. Let $T_1, \ldots, T_k$ denote the boundary components of $M$. With respect to a canonical choice of meridian and longitude on each $T_i$, the degeneracy locus of the suspension flow of $\varphi$ on $T_i$ can be identified with a pair of integers $(p_i; q_i)$ such that $p_i > 0$ and $-\frac{1}{2}p_i < q_i \leqslant \frac{1}{2}p_i$. Let $c_i$ denote the number of components of $T_i \cap (\Sigma \times \{0\})$. Assume that $\mathcal{F}^{s}$ is co-orientable and $\varphi$ reverses the co-orientation on $\mathcal{F}^{s}$. We show that the Dehn filling of $M$ along $\partial M$ with any multislope in $J_1 \times \ldots \times J_k$ admits a co-orientable taut foliation, where $J_i$ is one of the two open intervals in $\mathbb{R} \cup \{\infty\} \cong \mathbb{R}P^{1}$ between $\frac{p_i}{q_i + c_i}, \frac{p_i}{q_i - c_i}$ which doesn't contain $\frac{p_i}{q_i}$. For some hyperbolic fibered knot manifolds, the slopes given above contain all slopes that yield non-L-space Dehn filllings. The examples include (1) the exterior of the $(-2,3,2q+1)$-pretzel knot in $S^{3}$ for each $q \in \mathbb{Z}_{\geqslant 3}$ (see \hyperref[Kri]{[Kri]} for a previous proof), (2) the exteriors of many L-space knots in lens spaces.