title: Large Language Models for Orchestrating Bimanual Robots

abstract: Although there has been rapid progress in endowing robots with the ability to solve complex manipulation tasks, generating control policies for bimanual robots to solve tasks involving two hands is still challenging because of the difficulties in effective temporal and spatial coordination. With emergent abilities in terms of step-by-step reasoning and in-context learning, Large Language Models (LLMs) have taken control of a variety of robotic tasks. However, the nature of language communication via a single sequence of discrete symbols makes LLM-based coordination in continuous space a particular challenge for bimanual tasks. To tackle this challenge for the first time by an LLM, we present LAnguage-model-based Bimanual ORchestration (LABOR), an agent utilizing an LLM to analyze task configurations and devise coordination control policies for addressing long-horizon bimanual tasks. In the simulated environment, the LABOR agent is evaluated through several everyday tasks on the NICOL humanoid robot. Reported success rates indicate that overall coordination efficiency is close to optimal performance, while the analysis of failure causes, classified into spatial and temporal coordination and skill selection, shows that these vary over tasks. The project website can be found at http://labor-agent.github.io


title: Aspects of the geometry and topology of expanding horizons

abstract: The aim of this paper is to extend some basic results about marginally outer trapped surfaces to the context of surfaces having general null expansion. Motivated in part by recent work of Chai-Wan, we introduce the notion of $\mathfrak{g}$-stability for a general closed hypersurface $\Sigma$ in an ambient initial data set and prove that, under natural energy conditions, $\Sigma$ has positive Yamabe type, that is, $\Sigma$ admits a metric of positive scalar curvature, provided $\Sigma$ is $\mathfrak{g}$-stable. Similar results are obtained when $\Sigma$ is embedded in a spacelike, or null, hypersurface of a spacetime satisfying the dominant energy condition. Conditions implying $\mathfrak{g}$-stability are also discussed. Finally, we obtain a spacetime positive mass theorem for initial data sets with compact boundary $\Sigma$ of positive null expansion, assuming that the dominant energy condition is sufficiently strict near $\Sigma$. This extends recent results of Galloway-Lee and Lee-Lesourd-Unger.


title: Algebraic structures in Lagrangian Floer cohomology modelled on differential forms

abstract: We define a structure of an algebra on the Lagrangian Floer cohomology of a Lagrangian submanifold over the quantum cohomology of the ambient symplectic manifold. The structure is analogous to the one defined by Biran-Cornea, but is constructed in the differential forms model. In the spirit of Ganatra and Hugtenburg, we define another such algebra structure using a closed-open map. We show that the two structures coincide. As an application, we show that the module structure for the 2-dimensional Clifford torus is given by multiplication by a Novikov coefficient, similarly to the Biran-Cornea module structure for this case.


title: On off-diagonal hypergraph Ramsey numbers

abstract: A fundamental problem in Ramsey theory is to determine the growth rate in terms of $n$ of the Ramsey number $r(H, K_n^{(3)})$ of a fixed $3$-uniform hypergraph $H$ versus the complete $3$-uniform hypergraph with $n$ vertices. We study this problem, proving two main results. First, we show that for a broad class of $H$, including links of odd cycles and tight cycles of length not divisible by three, $r(H, K_n^{(3)}) \ge 2^{\Omega_H(n \log n)}$. This significantly generalizes and simplifies an earlier construction of Fox and He which handled the case of links of odd cycles and is sharp both in this case and for all but finitely many tight cycles of length not divisible by three. Second, disproving a folklore conjecture in the area, we show that there exists a linear hypergraph $H$ for which $r(H, K_n^{(3)})$ is superpolynomial in $n$. This provides the first example of a separation between $r(H,K_n^{(3)})$ and $r(H,K_{n,n,n}^{(3)})$, since the latter is known to be polynomial in $n$ when $H$ is linear.


title: Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contexts

abstract: In the era of large language models, applying techniques such as Retrieval Augmented Generation can better address Open-Domain Question-Answering problems. Due to constraints including model sizes and computing resources, the length of context is often limited, and it becomes challenging to empower the model to cover overlong contexts while answering questions from open domains. This paper proposes a general and convenient method to covering longer contexts in Open-Domain Question-Answering tasks. It leverages a small encoder language model that effectively encodes contexts, and the encoding applies cross-attention with origin inputs. With our method, the origin language models can cover several times longer contexts while keeping the computing requirements close to the baseline. Our experiments demonstrate that after fine-tuning, there is improved performance across two held-in datasets, four held-out datasets, and also in two In Context Learning settings.


title: On the Regret of Recursive Methods for Discrete-Time Adaptive Control with Matched Uncertainty

abstract: Continuous-time adaptive controllers for systems with a matched uncertainty often comprise an online parameter estimator and a corresponding parameterized controller to cancel the uncertainty. However, such methods are often unimplementable, as they depend on an unobserved estimation error. We consider the equivalent discrete-time setting with a causal information structure. We propose a novel, online proximal point method-based adaptive controller, that under a weak persistence of excitation (PE) condition is asymptotically stable and achieves finite regret, scaling only with the time required to fulfill the PE condition. We show the same also for the widely-used recursive least squares with exponential forgetting controller under a stronger PE condition.


title: Growth of regular partitions 3: strong regularity and the vertex partition

abstract: This is Part 3 in a series of papers about the growth of regular partitions in $3$-uniform hypergraphs. We consider here the strong regularity for $3$-uniform hypergraphs developed by Frankl, Gowers, Kohayakawa, Nagle, R\"{o}dl, Skokan, and Schacht. This type of regular decomposition comes with two components, a partition of vertices, and a partition of pairs of vertices. We define two corresponding growth functions associated to a hereditary property $\mathcal{H}$ of $3$-uniform hypergraphs: $T_{\mathcal{H}}$ which measures the size of the vertex component, and $L_{\mathcal{H}}$ which measures the size of the pairs component. In this paper, we give an almost complete description of the possible growth rates for $T_{\mathcal{H}}$: constant, polynomial, between single and double exponential, or wowzer. The only existing lower bound constructions for this type of hypergraph regularity were due to Moshkovitz and Shapira, who constructed examples requiring a wowzer-type lower bound on the vertex component in a weaker type of hypergraph regularity. The results of this paper rely crucially on the fact that a slightly simpler construction can be used to produce a wowzer type lower bound for $T_{\mathcal{H}}$. The key ingredient in this simpler example is a lower bound construction for strong graph regularity due to Conlon and Fox.


title: High-precision measurement of the atomic mass of $^{84}$Sr and implications to isotope shift studies

abstract: The absolute mass of $^{84}$Sr was determined using the phase-imaging ion-cyclotron-resonance technique with the JYFLTRAP double Penning trap mass spectrometer. A more precise value for the mass of $^{84}$Sr is essential for providing potential indications of physics beyond the Standard Model through high-precision isotope shift measurements of Sr atomic transition frequencies. The mass excess of $^{84}$Sr was refined to be -80649.229(37) keV/c$^2$ from high-precision cyclotron-frequency-ratio measurements with a relative precision of 4.8$\times$10$^{-10}$. The obtained mass-excess value is in agreement with the adopted value in the Atomic Mass Evaluation 2020, but is 30 times more precise. With this new value, we confirm the previously observed nonlinearity in the study of the isotope shift of strontium. Moreover, the double-beta ($2\beta^{+}$) decay $Q$ value of $^{84}$Sr was directly determined to be 1790.115(37) keV, and the precision was improved by a factor of 30.


title: Infrared nanosensors of pico- to micro-newton forces

abstract: Mechanical force is an essential feature for many physical and biological processes.1-12 Remote measurement of mechanical signals with high sensitivity and spatial resolution is needed for diverse applications, including robotics,13 biophysics,14-20 energy storage,21-24 and medicine.25-27 Nanoscale luminescent force sensors excel at measuring piconewton forces,28-32 while larger sensors have proven powerful in probing micronewton forces.33,34 However, large gaps remain in the force magnitudes that can be probed remotely from subsurface or interfacial sites, and no individual, non-invasive sensor is capable of measuring over the large dynamic range needed to understand many systems.35,36 Here, we demonstrate Tm3+-doped avalanching nanoparticle37 force sensors that can be addressed remotely by deeply penetrating near-infrared (NIR) light and can detect piconewton to micronewton forces with a dynamic range spanning more than four orders of magnitude. Using atomic force microscopy coupled with single-nanoparticle optical spectroscopy, we characterize the mechanical sensitivity of the photon avalanching process and reveal its exceptional force responsiveness. By manipulating the Tm3+ concentrations and energy transfer within the nanosensors, we demonstrate different optical force-sensing modalities, including mechanobrightening and mechanochromism. The adaptability of these nanoscale optical force sensors, along with their multiscale sensing capability, enable operation in the dynamic and versatile environments present in real-world, complex structures spanning biological organisms to nanoelectromechanical systems (NEMS).


title: High-energy neutrinos flavour composition as a probe of neutrino magnetic moments

abstract: Neutrino propagation in the Galactic magnetic field is considered. To describe neutrino flavour and spin oscillations on the galactic scale baselines an approach using wave packets is developed. Evolution equations for the neutrino wave packets in a uniform and non-uniform magnetic field are derived. Analytical expressions for neutrino flavour and spin oscillations probabilities accounting for damping due to wave packet separation are obtained for the case of uniform magnetic field. It is shown that for oscillations on magnetic frequencies $\omega_i^B = \mu_i B_\perp$ the coherence lengths that characterizes the damping scale is proportional to the cube of neutrino average momentum $p_0^3$. Probabilities of flavour and spin oscillations are calculated numerically for neutrino interacting with the non-uniform Galactic magnetic field. Flavour compositions of high-energy neutrino flux coming from the Galactic centre are calculated accounting for neutrino interaction with the magnetic field. It is shown that for neutrino magnetic moments $\sim 10^{-13} \mu_B$ and larger these flavour compositions significantly differ from ones predicted by the vacuum neutrino oscillations scenario.


title: QUSL: Quantum Unsupervised Image Similarity Learning with Enhanced Performance

abstract: Leveraging quantum advantages to enhance machine learning capabilities has become a primary focus of research, particularly for complex tasks such as image similarity detection. To fully exploit the potential of quantum computing, it is essential to design quantum circuits tailored to the specific characteristics of the task at hand. In response to this challenge, we propose a novel quantum unsupervised similarity learning method,QUSL. Building upon the foundation of similarity detection triplets and generating positive samples through perturbations of anchor images, QUSL operates independently of classical oracles. By leveraging the performance of triplets and the characteristics of quantum circuits, QUSL systematically explores high-performance quantum circuit architectures customized for dataset features using metaheuristic algorithms, thereby achieving efficient quantum feature extraction with reduced circuit costs. Comprehensive numerical simulations and experiments on quantum computers demonstrate QUSL's remarkable performance compared to state-of-the-art quantum methods. QUSL achieves reductions exceeding 50% in critical quantum resource utilization while also realizing an enhancement of up to 19.5% in similarity detection correlation across the DISC21, COCO, and landscape datasets. This enables efficient quantum similarity modeling for large-scale unlabeled image data with reduced quantum resource utilization.


title: Enhancing Portfolio Optimization with Transformer-GAN Integration: A Novel Approach in the Black-Litterman Framework

abstract: This study presents an innovative approach to portfolio optimization by integrating Transformer models with Generative Adversarial Networks (GANs) within the Black-Litterman (BL) framework. Capitalizing on Transformers' ability to discern long-range dependencies and GANs' proficiency in generating accurate predictive models, our method enhances the generation of refined predictive views for BL portfolio allocations. This fusion of our model with BL's structured method for merging objective views with market equilibrium offers a potent tool for modern portfolio management, outperforming traditional forecasting methods. Our integrated approach not only demonstrates the potential to improve investment decision-making but also contributes a new approach to capture the complexities of financial markets for robust portfolio optimization.


title: Growth of regular partitions 4: strong regularity and the pairs partition

abstract: This is the fourth in a series of papers on the growth of regular partitions in $3$-uniform hypergraphs. In this paper, we consider a form of regularity for $3$-uniform hypergraphs which was developed by Frankl, Gowers, Kohayakawa, Nagle, R\"{o}dl, Skokan, and Schacht. Regular decompositions of this type involve two components, a partition on the vertex set and a partition on the pairs of vertices. To each hereditary property $\mathcal{H}$ of $3$-uniform hypergraphs, we associate two corresponding growth functions: $T_{\mathcal{H}}$ for the size of the vertex component, and $L_{\mathcal{H}}$ for the size of the pairs component. In this paper we consider the behavior of the function $L_{\mathcal{H}}$. We show any such function is either constant, bounded above and below by a polynomial, or bounded below by an exponential.


title: Using the Empirical Attainment Function for Analyzing Single-objective Black-box Optimization Algorithms

abstract: A widely accepted way to assess the performance of iterative black-box optimizers is to analyze their empirical cumulative distribution function (ECDF) of pre-defined quality targets achieved not later than a given runtime. In this work, we consider an alternative approach, based on the empirical attainment function (EAF) and we show that the target-based ECDF is an approximation of the EAF. We argue that the EAF has several advantages over the target-based ECDF. In particular, it does not require defining a priori quality targets per function, captures performance differences more precisely, and enables the use of additional summary statistics that enrich the analysis. We also show that the average area over the convergence curves is a simpler-to-calculate, but equivalent, measure of anytime performance. To facilitate the accessibility of the EAF, we integrate a module to compute it into the IOHanalyzer platform. Finally, we illustrate the use of the EAF via synthetic examples and via the data available for the BBOB suite.


title: Exploring Spin Polarization of Heavy Quarks in Magnetic Fields and Hot Medium

abstract: Relativistic heavy-ion collisions give rise to the formation of both deconfined QCD matter and a strong magnetic field. The spin of heavy quarks is influenced by interactions with the external magnetic field as well as by random scatterings with thermal light partons. The presence of QCD matter comprising charged quarks can extend the lifetime and strength of the magnetic field, thereby enhancing the degree of heavy quark polarization. However, the random scatterings with QCD matter tend to diminish heavy quark polarization. In this study, we utilize the Landau-Lifshitz-Gilbert (LLG) equation to investigate both these contributions. Taking into account the realistic evolutions of medium temperatures and the in-medium magnetic fields at the Relativistic Heavy-Ion Collider (RHIC) and the Large Hadron Collider (LHC), we observe that heavy quark polarization is limited by the short lifetime of the magnetic field and the high temperatures of the medium. Furthermore, we explore the mass dependence of quark polarization, revealing that the polarization degree of strange quarks is much larger than that of charm quarks.


title: Search for $C$-even states decaying to $D_{s}^{\pm}D_{s}^{*\mp}$ with masses between $4.08$ and $4.32$ $\rm GeV/{\it c}^{2}$

abstract: Six $C$-even states, denoted as $X$, with quantum numbers $J^{PC}=0^{-+}$, $1^{\pm+}$, or $2^{\pm+}$, are searched for via the $e^+e^-\to\gamma D_{s}^{\pm}D_{s}^{*\mp}$ process using $(1667.39\pm8.84)~\mathrm{pb}^{-1}$ of $e^+e^-$ collision data collected with the BESIII detector operating at the BEPCII storage ring at center-of-mass energy of $\sqrt{s}=(4681.92\pm0.30)~\mathrm{MeV}$. No statistically significant signal is observed in the mass range from $4.08$ to $4.32~\mathrm{GeV}/c^{2}$. The upper limits of $\sigma[e^+e^-\to\gamma X]\cdot \mathcal{B}[X \to D_{s}^{\pm}D_{s}^{*\mp}]$ at a $90\%$ confidence level are determined.


title: How much symmetry do symmetric measurements need for efficient operational applications?

abstract: We introduce a generalization of symmetric measurements to collections of unequinumerous positive, operator-valued measures (POVMs). For informationally complete sets, we propose construction methods from orthonormal Hermitian operator bases. The correspondence between operator bases and measurements can be as high as four-to-four, with a one-to-one correspondence following only under additional assumptions. Importantly, it turns out that some of the symmetry properties, lost in the process of generalization, can be recovered without fixing the same number of elements for all POVMs. In particular, for a wide class of unequinumerous symmetric measurements that are conical 2-designs, we derive the index of coincidence, entropic uncertainty relations, and separability criteria for bipartite quantum states.


title: Ram pressure stripping in clusters: Gravity can bind the ISM but not the CGM

abstract: We explore the survival of a galaxy's circumgalactic medium (CGM) as it experiences ram pressure stripping (RPS) moving through the intracluster medium (ICM). For a satellite galaxy, the CGM is often assumed to be entirely stripped/evaporated, an assumption that may not always be justified. We carry out 3D-hydrodynamics simulations of RPS of the interstellar medium (ISM) and the CGM of a galaxy with mass and size comparable to the jellyfish galaxy JO201. We find that the CGM can survive long at cluster outskirts ($\gtrsim 2$ Gyr). However, at smaller cluster-centric distances, 90\% of the CGM mass is lost within $\sim 500$ Myr. Our simulations suggest that the gravitational restoring force on the CGM is mostly negligible and the CGM-ICM interaction is analogous to 'cloud-wind interaction'. The CGM stripping timescale depends not on the ram pressure but on $\chi$, the ratio of CGM to ICM density. Two distinct regimes emerge for CGM stripping: the $\chi >1$ regime, which is the well-known 'cloud-crushing' problem, and the $\chi < 1$ regime, which we refer to as the (relatively unexplored) 'bubble-drag' problem. The cloud-crushing regime ($\chi >1$) suggests a CGM stripping timescale proportional to the drag time $t_{\rm drag} \sim \chi R/v_{\rm rel}$ ($R$ is the CGM size, $v_{\rm rel}$ is the relative velocity). The bubble-drag regime ($\chi < 1$) is qualitatively different and gives a shorter stripping timescale comparable to the crossing time -- $t_{\rm drag} \sim R/v_{\rm rel}$, independent of $\chi$. The ISM stripping criterion unlike the CGM, still depends on the ram pressure $\rho_{\rm ICM} v_{\rm rel}^2$ (the classic Gunn and Gott 1972 condition). The stripped tails of satellites contain contributions from both the disk and its trailing CGM. Overall, we identify novel physical mechanisms and previously unexplored stripping regimes.


title: Analytic conjugation between planar differential systems and potential systems

abstract: In this article it is proved that an analytical planar vector field with a non-degenerate center at $(0,0)$ is analytically conjugate, in a neighborhood of $(0,0)$, to a Hamiltonian vector field of the form $y\frac{\partial}{\partial x}-V'(x)\frac{\partial}{\partial y}$, where $V$ is an analytic function defined in a neighborhood of the origin such that $V(0)=V'(0)=0$ and $V''(0)>0.$


title: MultiParaDetox: Extending Text Detoxification with Parallel Data to New Languages

abstract: Text detoxification is a textual style transfer (TST) task where a text is paraphrased from a toxic surface form, e.g. featuring rude words, to the neutral register. Recently, text detoxification methods found their applications in various task such as detoxification of Large Language Models (LLMs) (Leong et al., 2023; He et al., 2024; Tang et al., 2023) and toxic speech combating in social networks (Deng et al., 2023; Mun et al., 2023; Agarwal et al., 2023). All these applications are extremely important to ensure safe communication in modern digital worlds. However, the previous approaches for parallel text detoxification corpora collection -- ParaDetox (Logacheva et al., 2022) and APPADIA (Atwell et al., 2022) -- were explored only in monolingual setup. In this work, we aim to extend ParaDetox pipeline to multiple languages presenting MultiParaDetox to automate parallel detoxification corpus collection for potentially any language. Then, we experiment with different text detoxification models -- from unsupervised baselines to LLMs and fine-tuned models on the presented parallel corpora -- showing the great benefit of parallel corpus presence to obtain state-of-the-art text detoxification models for any language.


title: The Huge Magnetic Toroids in the Milky Way Halo

abstract: The magnetic fields in our Milky Way can be revealed by the distribution of Faraday rotation measures (RMs) of radio sources behind the Galaxy and of radio pulsars inside the Galaxy. Based on the antisymmetry of the Faraday sky in the inner Galaxy to the Galactic coordinates, the magnetic field toroids above and below the Galactic plane with reversed field directions exist in the Galactic halo and have been included in almost all models for the global magnetic structure in the Milky Way. However, the quantitative parameters, such as the field strength, the scale height, and the scale radius of the toroids are hard to determine from observational data. It has long been argued that the RM antisymmetry could be dominated by the local contributions of the interstellar medium. Here we discount the local RM contributions measured by pulsars mostly located within 5 kpc and get the first quantitative estimate of the size of magnetic toroids in the Galactic halo. They are huge, starting from a Galactocentric radius of less than 2 kpc to at least 15 kpc without field direction reversals. Such magnetic toroids in the Galactic halo should naturally constrain the physical processes in galaxies.


title: A Survey on Large Language Model-Based Game Agents

abstract: The development of game agents holds a critical role in advancing towards Artificial General Intelligence (AGI). The progress of LLMs and their multimodal counterparts (MLLMs) offers an unprecedented opportunity to evolve and empower game agents with human-like decision-making capabilities in complex computer game environments. This paper provides a comprehensive overview of LLM-based game agents from a holistic viewpoint. First, we introduce the conceptual architecture of LLM-based game agents, centered around six essential functional components: perception, memory, thinking, role-playing, action, and learning. Second, we survey existing representative LLM-based game agents documented in the literature with respect to methodologies and adaptation agility across six genres of games, including adventure, communication, competition, cooperation, simulation, and crafting & exploration games. Finally, we present an outlook of future research and development directions in this burgeoning field. A curated list of relevant papers is maintained and made accessible at: https://github.com/git-disl/awesome-LLM-game-agent-papers.


title: Transformers as Transducers

abstract: We study the sequence-to-sequence mapping capacity of transformers by relating them to finite transducers, and find that they can express surprisingly large classes of transductions. We do so using variants of RASP, a programming language designed to help people "think like transformers," as an intermediate representation. We extend the existing Boolean variant B-RASP to sequence-to-sequence functions and show that it computes exactly the first-order rational functions (such as string rotation). Then, we introduce two new extensions. B-RASP[pos] enables calculations on positions (such as copying the first half of a string) and contains all first-order regular functions. S-RASP adds prefix sum, which enables additional arithmetic operations (such as squaring a string) and contains all first-order polyregular functions. Finally, we show that masked average-hard attention transformers can simulate S-RASP. A corollary of our results is a new proof that transformer decoders are Turing-complete.


title: SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimation

abstract: We present a new self-supervised approach, SelfPose3d, for estimating 3d poses of multiple persons from multiple camera views. Unlike current state-of-the-art fully-supervised methods, our approach does not require any 2d or 3d ground-truth poses and uses only the multi-view input images from a calibrated camera setup and 2d pseudo poses generated from an off-the-shelf 2d human pose estimator. We propose two self-supervised learning objectives: self-supervised person localization in 3d space and self-supervised 3d pose estimation. We achieve self-supervised 3d person localization by training the model on synthetically generated 3d points, serving as 3d person root positions, and on the projected root-heatmaps in all the views. We then model the 3d poses of all the localized persons with a bottleneck representation, map them onto all views obtaining 2d joints, and render them using 2d Gaussian heatmaps in an end-to-end differentiable manner. Afterwards, we use the corresponding 2d joints and heatmaps from the pseudo 2d poses for learning. To alleviate the intrinsic inaccuracy of the pseudo labels, we propose an adaptive supervision attention mechanism to guide the self-supervision. Our experiments and analysis on three public benchmark datasets, including Panoptic, Shelf, and Campus, show the effectiveness of our approach, which is comparable to fully-supervised methods. Code: https://github.com/CAMMA-public/SelfPose3D. Video demo: https://youtu.be/GAqhmUIr2E8.


title: Root Graded Groups

abstract: We define and study root graded groups, that is, groups graded by finite root systems. This notion generalises several existing concepts in the literature, including in particular Jacques Tits' notion of RGD-systems. The most prominent examples of root graded groups are Chevalley groups over commutative associative rings. Our main result is that every root graded group of rank at least 3 is coordinatised by some algebraic structure satisfying a variation of the Chevalley commutator formula. This result can be regarded as a generalisation of Tits' classification of thick irreducible spherical buildings of rank at least 3 to the case of non-division algebraic structures. All coordinatisation results in this book are proven in a characteristic-free way. This is made possible by a new computational method that we call the blueprint technique.


title: Ukrainian Texts Classification: Exploration of Cross-lingual Knowledge Transfer Approaches

abstract: Despite the extensive amount of labeled datasets in the NLP text classification field, the persistent imbalance in data availability across various languages remains evident. Ukrainian, in particular, stands as a language that still can benefit from the continued refinement of cross-lingual methodologies. Due to our knowledge, there is a tremendous lack of Ukrainian corpora for typical text classification tasks. In this work, we leverage the state-of-the-art advances in NLP, exploring cross-lingual knowledge transfer methods avoiding manual data curation: large multilingual encoders and translation systems, LLMs, and language adapters. We test the approaches on three text classification tasks -- toxicity classification, formality classification, and natural language inference -- providing the "recipe" for the optimal setups.


title: Impact of repetitive, ultra-short soft X-ray pulses from processing of steel with ultrafast lasers on human cell cultures

abstract: Ultrafast lasers, with pulse durations below a few picoseconds, are of significant interest to the industry, offering a cutting-edge approach to enhancing manufacturing processes and enabling the fabrication of intricate components with unparalleled accuracy. When processing metals at irradiances exceeding the evaporation threshold of about 10^10 W/cm2 these processes can generate ultra-short, soft X-ray pulses with photon energies above 5 keV. This has prompted extensive discussions and regulatory measures on radiation safety. However, the impact of these ultra-short X-ray pulses on molecular pathways in the context of living cells, has not been investigated so far. Using laser pulses of 250 fs and 6.7 ps, along with pulse repetition rates exceeding 10 kHz, we conducted the first molecular characterization of epithelial cell responses to ultra-short soft X-ray pulses generated during processing of steel with ultrafast lasers. Ambient exposure of vitro human cell cultures, followed by imaging of the DNA damage response and fitting of the data to an experimentally calibrated model of dose rate estimation, revealed a linear increase in the DNA damage response relative to the exposure dose. This is in line with findings from work using continuous wave soft X-ray sources and suggests that the ultra-short X-ray pulses do not generate additional hazard. This research contributes valuable insights into the biological effects of ultrafast laser processes and their potential implications for user safety.


title: Combining magneto-hydrostatic constraints with Stokes profile inversions. IV. Imposing $\nabla\cdot{\bf B}=0$ condition

abstract: Inferences of the magnetic field in the solar atmosphere by means of spectropolarimetric inversions (i.e., Stokes inversion codes) yield magnetic fields that are non-solenoidal($\nabla\cdot{\bf B} \ne 0$). Because of this, results obtained by such methods are sometimes put into question. We aim to develop and implement a new technique that can retrieve magnetic fields that are simultaneously consistent with observed polarization signals and with the null divergence condition. The method used in this work strictly imposes $\nabla\cdot{\bf B}=0$ by determining the vertical component of the magnetic field ($B_{\rm z}$) from the horizontal ones ($B_{\rm x},B_{\rm y}$). We implement this solenoidal inversion into the FIRTEZ Stokes inversion code and apply it to spectropolarimetric observations of a sunspot observed with the Hinode/SP instrument. We show that the solenoidal inversion retrieves a vertical component of the magnetic field that is consistent with the vertical component of the magnetic field inferred from the non-solenoidal one. We demonstrate that the solenoidal inversion is capable of a better overall fitting to the observed Stokes vector than the non-solenoidal inversion. In fact, the solenoidal magnetic field fits Stokes $V$ worse, but this is compensated by a better fit to Stokes $I$. We find a direct correlation between the worsening in the fit to the circular polarization profiles by the solenoidal inversion and the deviations in the inferred $B_{\rm z}$ with respect to the non-solenoidal inversion. These results support the idea that common Stokes inversion techniques fail to reproduce $\nabla\cdot{\bf B}=0$ mainly as a consequence of the uncertainties in the determination of the individual components of the magnetic field.


title: Causality-based Transfer of Driving Scenarios to Unseen Intersections

abstract: Scenario-based testing of automated driving functions has become a promising method to reduce time and cost compared to real-world testing. In scenario-based testing automated functions are evaluated in a set of pre-defined scenarios. These scenarios provide information about vehicle behaviors, environmental conditions, or road characteristics using parameters. To create realistic scenarios, parameters and parameter dependencies have to be fitted utilizing real-world data. However, due to the large variety of intersections and movement constellations found in reality, data may not be available for certain scenarios. This paper proposes a methodology to systematically analyze relations between parameters of scenarios. Bayesian networks are utilized to analyze causal dependencies in order to decrease the amount of required data and to transfer causal patterns creating unseen scenarios. Thereby, infrastructural influences on movement patterns are investigated to generate realistic scenarios on unobserved intersections. For evaluation, scenarios and underlying parameters are extracted from the inD dataset. Movement patterns are estimated, transferred and checked against recorded data from those initially unseen intersections.


title: Universal representations for financial transactional data: embracing local, global, and external contexts

abstract: Effective processing of financial transactions is essential for banking data analysis. However, in this domain, most methods focus on specialized solutions to stand-alone problems instead of constructing universal representations suitable for many problems. We present a representation learning framework that addresses diverse business challenges. We also suggest novel generative models that account for data specifics, and a way to integrate external information into a client's representation, leveraging insights from other customers' actions. Finally, we offer a benchmark, describing representation quality globally, concerning the entire transaction history; locally, reflecting the client's current state; and dynamically, capturing representation evolution over time. Our generative approach demonstrates superior performance in local tasks, with an increase in ROC-AUC of up to 14\% for the next MCC prediction task and up to 46\% for downstream tasks from existing contrastive baselines. Incorporating external information improves the scores by an additional 20\%.


title: Dynamical study of $D^{*}DK$ and $D^{*}D \bar{D}$ systems at quark level

abstract: Inspired by that Belle\uppercase\expandafter{\romannumeral2} Collaboration recently reported $T_{cc}$, which can be interpreted as a molecular $DD^{*}$, we investigated the trihadron system of $T_{cc}$ partner with $IJ^{P}$=$01^{-}$ in the framework of a chiral quark model. It's widely accepted that the main component of $X(3872)$ contains the molecular $\bar{D}D^{*}$, while the main component of $D_{s0}^{*}(2317)$ is molecular $DK$. Based on these three well-known exotic states, $T_{cc} (DD^{*})$, $X(3872) (\bar{D}D^{*})$ and $D_{s0}^{*}(2317) (DK)$, we dynamically investigate $D^{*}DK$ and $DD^{*}\bar{D}$ systems at quark level to search for possible bound states. The results show that both of them are bound states, in which the binding energy of the molecular state $DD^*K$ is relatively small, only 0.8 MeV, while the binding energy of $DD^*\bar{D}$ is up to 1.9 MeV. According to the calculation results of the Root-square-mean distances, the spatial structure of the two systems shows obvious ($DD^*$)-($\bar{D}$/$K$) structure, in which $D$ is close to $D^*$ while $DD^*$ as a whole is relatively distant from the third hadron ($\bar{D}$/$K$), which are similar to the nucleon-electron structure. As a result, we strongly recommend that these bound states $DD^*\bar{D}$ and $DD^*K$ are searched for experimentally.


title: Small-scale magnetohydrodynamic dynamos: from deterministic chaos to turbulence

abstract: It is shown, using results of numerical simulations, and geophysical and solar observations, that the transition from deterministic chaos to hard turbulence in the magnetic field generated by the small-scale MHD dynamos occurs through a randomization process. This randomization process has been described using the notion of distributed chaos and the main parameter of distributed chaos has been used for quantifying the degree of randomization. The dissipative (Loitsianskii and Birkhoff-Saffman integrals) and ideal (magnetic helicity) magnetohydrodynamic invariants control the randomization process and determine the degree of randomization in different MHD flows, directly or through the Kolmogorov-Iroshnikov phenomenology (the magneto-inertial range of scales as a precursor of hard turbulence). Despite the considerable differences in the scales and physical parameters, the results of numerical simulations are in quantitative agreement with the geophysical and solar observations in the frames of this approach. The Hall magnetohydrodynamic dynamo has been also briefly discussed in this context.


title: Classification of superpotentials for cohomogeneity one Ricci solitons

abstract: We classify superpotentials for the Hamiltonian system corresponding to the cohomogeneity one gradient Ricci soliton equations. Aside from recovering known examples of superpotentials for steady solitons, we find a new superpotential on a specific case of the B\'erard-Bergery-Calabi ansatz. The latter is used to obtain an explicit formula for a steady complete soliton with an equidistant family of hypersurfaces given by circle bundles over $S^2\times S^2$. There are no superpotentials in the non-steady case in dimensions greater than 2, even if polynomial coefficients are allowed. We also briefly discuss generalised first integrals and the limitations of some known methods of finding them.


title: The Thousand-Pulsar-Array programme on MeerKAT XIII: Timing, flux density, rotation measure and dispersion measure timeseries of 597 pulsars

abstract: We report here on the timing of 597 pulsars over the last four years with the MeerKAT telescope. We provide Times-of-Arrival, pulsar ephemeris files and per-epoch measurements of the flux density, dispersion measure (DM) and rotation measure (RM) for each pulsar. In addition we use a Gaussian process to model the timing residuals to measure the spin frequency derivative at each epoch. We also report the detection of 11 glitches in 9 individual pulsars. We find significant DM and RM variations in 87 and 76 pulsars respectively. We find that the DM variations scale approximately linearly with DM, which is broadly in agreement with models of the ionised interstellar medium. The observed RM variations seem largely independent of DM, which may suggest that the RM variations are dominated by variations in the interstellar magnetic field on the line of sight, rather than varying electron density. We also find that normal pulsars have around 5 times greater amplitude of DM variability compared to millisecond pulsars, and surmise that this is due to the known difference in their velocity distributions.


title: Noise Masking Attacks and Defenses for Pretrained Speech Models

abstract: Speech models are often trained on sensitive data in order to improve model performance, leading to potential privacy leakage. Our work considers noise masking attacks, introduced by Amid et al. 2022, which attack automatic speech recognition (ASR) models by requesting a transcript of an utterance which is partially replaced with noise. They show that when a record has been seen at training time, the model will transcribe the noisy record with its memorized sensitive transcript. In our work, we extend these attacks beyond ASR models, to attack pretrained speech encoders. Our method fine-tunes the encoder to produce an ASR model, and then performs noise masking on this model, which we find recovers private information from the pretraining data, despite the model never having seen transcripts at pretraining time! We show how to improve the precision of these attacks and investigate a number of countermeasures to our attacks.


title: BERTopic-Driven Stock Market Predictions: Unraveling Sentiment Insights

abstract: This paper explores the intersection of Natural Language Processing (NLP) and financial analysis, focusing on the impact of sentiment analysis in stock price prediction. We employ BERTopic, an advanced NLP technique, to analyze the sentiment of topics derived from stock market comments. Our methodology integrates this sentiment analysis with various deep learning models, renowned for their effectiveness in time series and stock prediction tasks. Through comprehensive experiments, we demonstrate that incorporating topic sentiment notably enhances the performance of these models. The results indicate that topics in stock market comments provide implicit, valuable insights into stock market volatility and price trends. This study contributes to the field by showcasing the potential of NLP in enriching financial analysis and opens up avenues for further research into real-time sentiment analysis and the exploration of emotional and contextual aspects of market sentiment. The integration of advanced NLP techniques like BERTopic with traditional financial analysis methods marks a step forward in developing more sophisticated tools for understanding and predicting market behaviors.


title: Deconstructing In-Context Learning: Understanding Prompts via Corruption

abstract: The ability of large language models (LLMs) to $``$learn in context$"$ based on the provided prompt has led to an explosive growth in their use, culminating in the proliferation of AI assistants such as ChatGPT, Claude, and Bard. These AI assistants are known to be robust to minor prompt modifications, mostly due to alignment techniques that use human feedback. In contrast, the underlying pre-trained LLMs they use as a backbone are known to be brittle in this respect. Building high-quality backbone models remains a core challenge, and a common approach to assessing their quality is to conduct few-shot evaluation. Such evaluation is notorious for being highly sensitive to minor prompt modifications, as well as the choice of specific in-context examples. Prior work has examined how modifying different elements of the prompt can affect model performance. However, these earlier studies tended to concentrate on a limited number of specific prompt attributes and often produced contradictory results. Additionally, previous research either focused on models with fewer than 15 billion parameters or exclusively examined black-box models like GPT-3 or PaLM, making replication challenging. In the present study, we decompose the entire prompt into four components: task description, demonstration inputs, labels, and inline instructions provided for each demonstration. We investigate the effects of structural and semantic corruptions of these elements on model performance. We study models ranging from 1.5B to 70B in size, using ten datasets covering classification and generation tasks. We find that repeating text within the prompt boosts model performance, and bigger models ($\geq$30B) are more sensitive to the semantics of the prompt. Finally, we observe that adding task and inline instructions to the demonstrations enhances model performance even when the instructions are semantically corrupted.


title: On Hamiltonian Structures of Partial Difference Equations

abstract: We first introduce the notion of Hamiltonian structure for a partial difference equation. Then we construct some infinite quivers, and realize the discrete KdV equation, the Hirota-Miwa equation and its various reductions as the mutation relations of the corresponding cluster algebras. Finally, we show that the log-canonical Poisson structures associated to these cluster algebras give the Hamiltonian structures or the bihamiltonian structures of these partial difference equations.


title: Multitask-based Evaluation of Open-Source LLM on Software Vulnerability

abstract: This paper proposes a pipeline for quantitatively evaluating interactive LLMs using publicly available datasets. We carry out an extensive technical evaluation of LLMs using Big-Vul covering four different common software vulnerability tasks. We evaluate the multitask and multilingual aspects of LLMs based on this dataset. We find that the existing state-of-the-art methods are generally superior to LLMs in software vulnerability detection. Although LLMs improve accuracy when providing context information, they still have limitations in accurately predicting severity ratings for certain CWE types. In addition, LLMs demonstrate some ability to locate vulnerabilities for certain CWE types, but their performance varies among different CWE types. Finally, LLMs show uneven performance in generating CVE descriptions for various CWE types, with limited accuracy in a few-shot setting. Overall, though LLMs perform well in some aspects, they still need improvement in understanding the subtle differences in code vulnerabilities and the ability to describe vulnerabilities to fully realize their potential. Our evaluation pipeline provides valuable insights for further enhancing LLMs' software vulnerability handling capabilities.


title: Uniformity in nonreduced rings via Noetherian operators

abstract: We prove a differential version of the Artin-Rees lemma with the use of Noetherian differential operators. As a consequence, we obtain several uniformity results for nonreduced rings.


title: Generalizable, Fast, and Accurate DeepQSPR with fastprop Part 1: Framework and Benchmarks

abstract: Quantitative Structure Property Relationship studies aim to define a mapping between molecular structure and arbitrary quantities of interest. This was historically accomplished via the development of descriptors which requires significant domain expertise and struggles to generalize. Thus the field has morphed into Molecular Property Prediction and been given over to learned representations which are highly generalizable. The paper introduces fastprop, a DeepQSPR framework which uses a cogent set of molecular level descriptors to meet and exceed the performance of learned representations on diverse datasets in dramatically less time. fastprop is freely available on github at github.com/JacksonBurns/fastprop.


title: IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFT

abstract: Multimodal foundation models are transformative in sequential recommender systems, leveraging powerful representation learning capabilities. While Parameter-efficient Fine-tuning (PEFT) is commonly used to adapt foundation models for recommendation tasks, most research prioritizes parameter efficiency, often overlooking critical factors like GPU memory efficiency and training speed. Addressing this gap, our paper introduces IISAN (Intra- and Inter-modal Side Adapted Network for Multimodal Representation), a simple plug-and-play architecture using a Decoupled PEFT structure and exploiting both intra- and inter-modal adaptation. IISAN matches the performance of full fine-tuning (FFT) and state-of-the-art PEFT. More importantly, it significantly reduces GPU memory usage - from 47GB to just 3GB for multimodal sequential recommendation tasks. Additionally, it accelerates training time per epoch from 443s to 22s compared to FFT. This is also a notable improvement over the Adapter and LoRA, which require 37-39 GB GPU memory and 350-380 seconds per epoch for training. Furthermore, we propose a new composite efficiency metric, TPME (Training-time, Parameter, and GPU Memory Efficiency) to alleviate the prevalent misconception that "parameter efficiency represents overall efficiency". TPME provides more comprehensive insights into practical efficiency comparisons between different methods. Besides, we give an accessible efficiency analysis of all PEFT and FFT approaches, which demonstrate the superiority of IISAN. We release our codes and other materials at https://github.com/GAIR-Lab/IISAN.


title: Long-context LLMs Struggle with Long In-context Learning

abstract: Large Language Models (LLMs) have made significant strides in handling long sequences. Some models like Gemini could even to be capable of dealing with millions of tokens. However, their performance evaluation has largely been confined to metrics like perplexity and synthetic tasks, which may not fully capture their true abilities in more challenging, real-world scenarios. We introduce a benchmark (LongICLBench) for long in-context learning in extreme-label classification using six datasets with 28 to 174 classes and input lengths from 2K to 50K tokens. Our benchmark requires LLMs to comprehend the entire input to recognize the massive label spaces to make correct predictions. We evaluate on 15 long-context LLMs and find that they perform well on less challenging classification tasks with smaller label space and shorter demonstrations. However, they struggle with more challenging task like Discovery with 174 labels, suggesting a gap in their ability to process long, context-rich sequences. Further analysis reveals a bias towards labels presented later in the sequence and a need for improved reasoning over multiple pieces of information. Our study reveals that long context understanding and reasoning is still a challenging task for the existing LLMs. We believe LongICLBench could serve as a more realistic evaluation for the future long-context LLMs.


title: SRG/ART-XC Galactic Bulge deep survey. I. Maximum likelihood source detection algorithm for X-ray surveys

abstract: We describe an X-ray source detection method entirely based on the maximum likelihood analysis, in application to observations with the ART-XC telescope onboard the Spectrum Roentgen Gamma observatory. The method optimally combines the data taken at different conditions, a situation commonly found in scanning surveys or mosaic observations with a telescope with a significant off-axis PSF distortion. The method can be naturally extended to include additional information from the X-ray photon energies, detector grades, etc. The likelihood-based source detection naturally results in a stable and uniform definition of detection thresholds under different observing conditions (PSF, background level). This greatly simplifies the statistical calibration of the survey needed to, e.g., obtain the $\log N - \log S$ distribution of detected sources or their luminosity function. The method can be applied to the data from any imaging X-ray telescope.


title: Digital Forgetting in Large Language Models: A Survey of Unlearning Methods

abstract: The objective of digital forgetting is, given a model with undesirable knowledge or behavior, obtain a new model where the detected issues are no longer present. The motivations for forgetting include privacy protection, copyright protection, elimination of biases and discrimination, and prevention of harmful content generation. Effective digital forgetting has to be effective (meaning how well the new model has forgotten the undesired knowledge/behavior), retain the performance of the original model on the desirable tasks, and be scalable (in particular forgetting has to be more efficient than retraining from scratch on just the tasks/data to be retained). This survey focuses on forgetting in large language models (LLMs). We first provide background on LLMs, including their components, the types of LLMs, and their usual training pipeline. Second, we describe the motivations, types, and desired properties of digital forgetting. Third, we introduce the approaches to digital forgetting in LLMs, among which unlearning methodologies stand out as the state of the art. Fourth, we provide a detailed taxonomy of machine unlearning methods for LLMs, and we survey and compare current approaches. Fifth, we detail datasets, models and metrics used for the evaluation of forgetting, retaining and runtime. Sixth, we discuss challenges in the area. Finally, we provide some concluding remarks.


title: SPMamba: State-space model is all you need in speech separation

abstract: In speech separation, both CNN- and Transformer-based models have demonstrated robust separation capabilities, garnering significant attention within the research community. However, CNN-based methods have limited modelling capability for long-sequence audio, leading to suboptimal separation performance. Conversely, Transformer-based methods are limited in practical applications due to their high computational complexity. Notably, within computer vision, Mamba-based methods have been celebrated for their formidable performance and reduced computational requirements. In this paper, we propose a network architecture for speech separation using a state-space model, namely SPMamba. We adopt the TF-GridNet model as the foundational framework and substitute its Transformer component with a bidirectional Mamba module, aiming to capture a broader range of contextual information. Our experimental results reveal an important role in the performance aspects of Mamba-based models. SPMamba demonstrates superior performance with a significant advantage over existing separation models in a dataset built on Librispeech. Notably, SPMamba achieves a substantial improvement in separation quality, with a 2.42 dB enhancement in SI-SNRi compared to the TF-GridNet. The source code for SPMamba is publicly accessible at https://github.com/JusperLee/SPMamba .


title: QDarts: A Quantum Dot Array Transition Simulator for finding charge transitions in the presence of finite tunnel couplings, non-constant charging energies and sensor dots

abstract: We present QDarts, an efficient simulator for realistic charge stability diagrams of quantum dot array (QDA) devices in equilibrium states. It allows for pinpointing the location of concrete charge states and their transitions in a high-dimensional voltage space (via arbitrary two-dimensional cuts through it), and includes effects of finite tunnel coupling, non-constant charging energy and a simulation of noisy sensor dots. These features enable close matching of various experimental results in the literature, and the package hence provides a flexible tool for testing QDA experiments, as well as opening the avenue for developing new methods of device tuning.


title: Multi-Level Label Correction by Distilling Proximate Patterns for Semi-supervised Semantic Segmentation

abstract: Semi-supervised semantic segmentation relieves the reliance on large-scale labeled data by leveraging unlabeled data. Recent semi-supervised semantic segmentation approaches mainly resort to pseudo-labeling methods to exploit unlabeled data. However, unreliable pseudo-labeling can undermine the semi-supervision processes. In this paper, we propose an algorithm called Multi-Level Label Correction (MLLC), which aims to use graph neural networks to capture structural relationships in Semantic-Level Graphs (SLGs) and Class-Level Graphs (CLGs) to rectify erroneous pseudo-labels. Specifically, SLGs represent semantic affinities between pairs of pixel features, and CLGs describe classification consistencies between pairs of pixel labels. With the support of proximate pattern information from graphs, MLLC can rectify incorrectly predicted pseudo-labels and can facilitate discriminative feature representations. We design an end-to-end network to train and perform this effective label corrections mechanism. Experiments demonstrate that MLLC can significantly improve supervised baselines and outperforms state-of-the-art approaches in different scenarios on Cityscapes and PASCAL VOC 2012 datasets. Specifically, MLLC improves the supervised baseline by at least 5% and 2% with DeepLabV2 and DeepLabV3+ respectively under different partition protocols.


title: On the stability of $\ddot x(t)+\alpha(t)\dot x(t)+\beta(t) x(t)=0$

abstract: Our main goal is to understand the stability of second order linear homogeneous differential equations $\ddot x(t)+\alpha(t)\dot x(t)+\beta(t)x(t)=0$ for $C^0$-generic values of the variable parameters $\alpha(t)$ and $\beta(t)$. For that we embed the problem into the framework of the general theory of continuous-time linear cocycles induced by the random ODE $\ddot x(t)+\alpha(\varphi^t(\omega))\dot x(t)+\beta(\varphi^t(\omega))x(t)=0$, where the coefficients $\alpha$ and $\beta$ evolve along the $\varphi^t$-orbit for $\omega\in M$, and $\varphi^t: M\to M$ is a flow defined on a compact Hausdorff space $M$ preserving a probability measure $\mu$. Considering $y=\dot x$, the above random ODE can be rewritten as $\dot X=A(\varphi^t (\omega))X$, with $X=(x,y)^\top$, having a kinetic linear cocycle as fundamental solution. We prove that for a $C^0$-generic choice of parameters $\alpha$ and $\beta$ and for $\mu$-almost all $\omega\in M$ either the Lyapunov exponents of the linear cocycle are equal ($\lambda_1(\omega)=\lambda_2(\omega)$), or else the orbit of $\omega$ displays a dominated splitting. Applying to dissipative systems ($\alpha<0$) we obtain a dichotomy: either $\lambda_1(\omega)=\lambda_2(\omega)<0$, attesting the stability of the solution of the random ODE above, or else the orbit of $\omega$ displays a dominated splitting. Applying to frictionless systems ($\alpha=0$) we obtain a dichotomy: either $\lambda_1(\omega)=\lambda_2(\omega)=0$, attesting the asymptotic neutrality of the solution of the random ODE above, or else the orbit of $\omega$ displays a hyperbolic splitting attesting the \emph{uniform} instability of the solution of the ODE above. This last result implies also an analog result for the 1-d continuous aperiodic Schr\"odinger equation. Furthermore, all results hold for $L^\infty$-generic parameters $\alpha$ and $\beta$.


title: Red-Teaming Segment Anything Model

abstract: Foundation models have emerged as pivotal tools, tackling many complex tasks through pre-training on vast datasets and subsequent fine-tuning for specific applications. The Segment Anything Model is one of the first and most well-known foundation models for computer vision segmentation tasks. This work presents a multi-faceted red-teaming analysis that tests the Segment Anything Model against challenging tasks: (1) We analyze the impact of style transfer on segmentation masks, demonstrating that applying adverse weather conditions and raindrops to dashboard images of city roads significantly distorts generated masks. (2) We focus on assessing whether the model can be used for attacks on privacy, such as recognizing celebrities' faces, and show that the model possesses some undesired knowledge in this task. (3) Finally, we check how robust the model is to adversarial attacks on segmentation masks under text prompts. We not only show the effectiveness of popular white-box attacks and resistance to black-box attacks but also introduce a novel approach - Focused Iterative Gradient Attack (FIGA) that combines white-box approaches to construct an efficient attack resulting in a smaller number of modified pixels. All of our testing methods and analyses indicate a need for enhanced safety measures in foundation models for image segmentation.


title: Using Interpretation Methods for Model Enhancement

abstract: In the age of neural natural language processing, there are plenty of works trying to derive interpretations of neural models. Intuitively, when gold rationales exist during training, one can additionally train the model to match its interpretation with the rationales. However, this intuitive idea has not been fully explored. In this paper, we propose a framework of utilizing interpretation methods and gold rationales to enhance models. Our framework is very general in the sense that it can incorporate various interpretation methods. Previously proposed gradient-based methods can be shown as an instance of our framework. We also propose two novel instances utilizing two other types of interpretation methods, erasure/replace-based and extractor-based methods, for model enhancement. We conduct comprehensive experiments on a variety of tasks. Experimental results show that our framework is effective especially in low-resource settings in enhancing models with various interpretation methods, and our two newly-proposed methods outperform gradient-based methods in most settings. Code is available at https://github.com/Chord-Chen-30/UIMER.


title: Multivariate Bernstein-type Polynomials of Finitely Generated D-Modules

abstract: We generalize the Gr\"obner basis method for free D-modules to the case of several term orderings induced by a partition of the set of basic variables. Using this generalized Gr\"obner basis technique we prove the existence and give a method of computation of a dimension polynomial in several variables associated with a finitely generated D-module. We show that this dimension polynomial carries more invariants of a D-module than the classical (univariate) Bernstein polynomial. We also show that the introduced multivariate dimension polynomial can be used for characterization of holonomic D-modules.


title: Asymptotics of resampling without replacement in robust and logistic regression

abstract: This paper studies the asymptotics of resampling without replacement in the proportional regime where dimension $p$ and sample size $n$ are of the same order. For a given dataset $(X,y)\in \mathbb{R}^{n\times p}\times \mathbb{R}^n$ and fixed subsample ratio $q\in(0,1)$, the practitioner samples independently of $(X,y)$ iid subsets $I_1,...,I_M$ of $\{1,...,n\}$ of size $q n$ and trains estimators $\hat{\beta}(I_1),...,\hat{\beta}(I_M)$ on the corresponding subsets of rows of $(X, y)$. Understanding the performance of the bagged estimate $\bar{\beta} = \frac1M\sum_{m=1}^M \hat{\beta}(I_1),...,\hat{\beta}(I_M)$, for instance its squared error, requires us to understand correlations between two distinct $\hat{\beta}(I_m)$ and $\hat{\beta}(I_{m'})$ trained on different subsets $I_m$ and $I_{m'}$. In robust linear regression and logistic regression, we characterize the limit in probability of the correlation between two estimates trained on different subsets of the data. The limit is characterized as the unique solution of a simple nonlinear equation. We further provide data-driven estimators that are consistent for estimating this limit. These estimators of the limiting correlation allow us to estimate the squared error of the bagged estimate $\bar{\beta}$, and for instance perform parameter tuning to choose the optimal subsample ratio $q$. As a by-product of the proof argument, we obtain the limiting distribution of the bivariate pair $(x_i^T \hat{\beta}(I_m), x_i^T \hat{\beta}(I_{m'}))$ for observations $i\in I_m\cap I_{m'}$, i.e., for observations used to train both estimates.


title: Granular aqueous suspensions with controlled inter-particular friction and adhesion

abstract: We present a simple route to obtain large quantities of suspensions of non-Brownian particles with stimuli-responsive surface properties to study the relation between their flow and interparticle interactions. We perform an alkaline hydrolysis reaction on poly(methyl methacrylate) (PMMA) particles to obtain poly(sodium methacrylate) (PMAA-Na) particles. We characterize the quasi-static macroscopic frictional response of their aqueous suspensions using a rotating drum. The suspensions are frictionless when the particles are dispersed in pure water. We relate this state to the presence of electrosteric repulsion between the charged surfaces of the ionized PMAA-Na particles in water. Then we add monovalent and multivalent ions (Na+, Ca2+, La3+) and we observe that the suspensions become frictional whatever the valency. For divalent and trivalent ions, the quasi-static avalanche angle {\theta}c at large ionic strength is greater than that of frictional PMMA particles in water, suggesting the presence of adhesion. Finally, a decrease in the pH of the suspending solution leads to a transition between a frictionless plateau and a frictional one. We perform Atomic Force Microscopy (AFM) to relate our macroscopic observations to the surface features of the particles. In particular, we show that the increase in friction in the presence of multivalent ions or under acidic conditions is driven by a nanoscopic phase separation and the bundling of polyelectrolyte chains at the surface of the particle. Our results highlight the importance of surface interactions in the rheology of granular suspensions. Our particles provide a simple, yet flexible platform to study frictional suspension flows.


title: EGTR: Extracting Graph from Transformer for Scene Graph Generation

abstract: Scene Graph Generation (SGG) is a challenging task of detecting objects and predicting relationships between objects. After DETR was developed, one-stage SGG models based on a one-stage object detector have been actively studied. However, complex modeling is used to predict the relationship between objects, and the inherent relationship between object queries learned in the multi-head self-attention of the object detector has been neglected. We propose a lightweight one-stage SGG model that extracts the relation graph from the various relationships learned in the multi-head self-attention layers of the DETR decoder. By fully utilizing the self-attention by-products, the relation graph can be extracted effectively with a shallow relation extraction head. Considering the dependency of the relation extraction task on the object detection task, we propose a novel relation smoothing technique that adjusts the relation label adaptively according to the quality of the detected objects. By the relation smoothing, the model is trained according to the continuous curriculum that focuses on object detection task at the beginning of training and performs multi-task learning as the object detection performance gradually improves. Furthermore, we propose a connectivity prediction task that predicts whether a relation exists between object pairs as an auxiliary task of the relation extraction. We demonstrate the effectiveness and efficiency of our method for the Visual Genome and Open Image V6 datasets. Our code is publicly available at https://github.com/naver-ai/egtr.


title: Linear distortion and rescaling for quasiregular values

abstract: Sobolev mappings exhibiting only pointwise quasiregularity-type bounds have arisen in various applications, leading to a recently developed theory of quasiregular values. In this article, we show that by using rescaling, one obtains a direct bridge between this theory and the classical theory of quasiregular maps. More precisely, we prove that a non-constant mapping $f \colon \Omega \to \mathbb{R}^n$ with a $(K, \Sigma)$-quasiregular value at $f(x_0)$ can be rescaled at $x_0$ to a non-constant $K$-quasiregular mapping. Our proof of this fact involves establishing a quasiregular values -version of the linear distortion bound of quasiregular mappings. A quasiregular values variant of the small $K$ -theorem is obtained as an immediate corollary of our main result.


title: Results of the 2022 ECFA Early-Career Researchers Panel survey on career prospects and diversity

abstract: This document presents the outcomes of a comprehensive survey conducted among early career researchers (ECRs) in academic particle physics. Running from September 24, 2022, to March 3, 2023, the survey gathered responses from 759 ECRs employed in 39 countries. The study aimed to gain insights into the career prospects and experiences of ECRs while also delving into diversity and sociological aspects within particle physics research. The survey results are presented in a manner consistent with the survey choices. The document offers insights for the particle physics community, and provides a set of recommendations for enhancing career prospects, fostering diversity, and addressing sociological dimensions within this field.

categories: physics.soc-ph hep-ex hep-th physics.acc-ph physics.ins-det


title: The Online Observation Quality System Implementation for the ASTRI Mini-Array Project

abstract: The ASTRI Mini-Array project, led by the Italian National Institute for Astrophysics, aims to construct and operate nine Imaging Atmospheric Cherenkov Telescopes for high-energy gamma-ray source study and stellar intensity interferometry. Located at the Teide Astronomical Observatory in Tenerife, the project's software is essential for remote operation, emphasizing the need for prompt feedback on observations. This contribution introduces the Online Observation Quality System (OOQS) as part of the Supervisory Control And Data Acquisition (SCADA) software. OOQS performs real-time data quality checks on data from Cherenkov cameras and Intensity Interferometry instruments. It provides feedback to SCADA and operators, highlighting abnormal conditions and ensuring quick corrective actions for optimal observations. Results are archived for operator visualization and further analysis. The OOQS data quality pipeline prototype utilizes a distributed application with three main components to handle the maximum array data rate of 1.15 Gb/s. The first is a Kafka consumer that manages the data stream from the Array Data Acquisition System through Apache Kafka, handling the data serialization and deserialization involved in the transmission. The data stream is divided into batches of data written in files. The second component monitors new files and conducts analyses using the Slurm workload scheduler, leveraging its parallel processing capabilities and scalability. Finally, the process results are collected by the last component and stored in the Quality Archive.


title: Green Measures for a Class of non-Markov Processes

abstract: In this paper, we investigate the Green measure for a class of non-Gaussian processes in $\mathbb{R}^{d}$. These measures are associated with the family of generalized grey Brownian motions $B_{\beta,\alpha}$, $0<\beta\le1$, $0<\alpha\le2$. This family includes both fractional Brownian motion, Brownian motion, and other non-Gaussian processes. We show that the perpetual integral exists with probability $1$ for $d\alpha>2$ and $1<\alpha\le2$. The Green measure then generalizes those measures of all these classes.


title: Energy-Optimized Planning in Non-Uniform Wind Fields with Fixed-Wing Aerial Vehicles

abstract: Fixed-wing small uncrewed aerial vehicles (sUAVs) possess the capability to remain airborne for extended durations and traverse vast distances. However, their operation is susceptible to wind conditions, particularly in regions of complex terrain where high wind speeds may push the aircraft beyond its operational limitations, potentially raising safety concerns. Moreover, wind impacts the energy required to follow a path, especially in locations where the wind direction and speed are not favorable. Incorporating wind information into mission planning is essential to ensure both safety and energy efficiency. In this paper, we propose a sampling-based planner using the kinematic Dubins aircraft paths with respect to the ground, to plan energy-efficient paths in non-uniform wind fields. We study the planner characteristics with synthetic and real-world wind data and compare its performance against baseline cost and path formulations. We demonstrate that the energy-optimized planner effectively utilizes updrafts to minimize energy consumption, albeit at the expense of increased travel time. The ground-relative path formulation facilitates the generation of safe trajectories onboard sUAVs within reasonable computational timeframes.


title: Advancing LLM Reasoning Generalists with Preference Trees

abstract: We introduce Eurus, a suite of large language models (LLMs) optimized for reasoning. Finetuned from Mistral-7B and CodeLlama-70B, Eurus models achieve state-of-the-art results among open-source models on a diverse set of benchmarks covering mathematics, code generation, and logical reasoning problems. Notably, Eurus-70B beats GPT-3.5 Turbo in reasoning through a comprehensive benchmarking across 12 tests covering five tasks, and achieves a 33.3% pass@1 accuracy on LeetCode and 32.6% on TheoremQA, two challenging benchmarks, substantially outperforming existing open-source models by margins more than 13.3%. The strong performance of Eurus can be primarily attributed to UltraInteract, our newly-curated large-scale, high-quality alignment dataset specifically designed for complex reasoning tasks. UltraInteract can be used in both supervised fine-tuning and preference learning. For each instruction, it includes a preference tree consisting of (1) reasoning chains with diverse planning strategies in a unified format, (2) multi-turn interaction trajectories with the environment and the critique, and (3) pairwise data to facilitate preference learning. UltraInteract allows us to conduct an in-depth exploration of preference learning for reasoning tasks. Our investigation reveals that some well-established preference learning algorithms may be less suitable for reasoning tasks compared to their effectiveness in general conversations. Inspired by this, we derive a novel reward modeling objective which, together with UltraInteract, leads to a strong reward model.


title: Coherent Control of an Optical Quantum Dot Using Phonons and Photons

abstract: Genuine quantum-mechanical effects are readily observable in modern optomechanical systems comprising bosonic ("classical") optical resonators. Here we describe unique features and advantages of optical two-level systems, or qubits, for optomechanics. The qubit state can be coherently controlled using both phonons and resonant or detuned photons. We experimentally demonstrate this using charge-controlled InAs quantum dots (QDs) in surface-acoustic-wave resonators. Time-correlated single-photon counting measurements reveal the control of QD population dynamics using engineered optical pulses and mechanical motion. As a first example, at moderate acoustic drive strengths, we demonstrate the potential of this technique to maximize fidelity in quantum microwave-to-optical transduction. Specifically, we tailor the scheme so that mechanically assisted photon scattering is enhanced over the direct detuned photon scattering from the QD. Spectral analysis reveals distinct scattering channels related to Rayleigh scattering and luminescence in our pulsed excitation measurements which lead to time-dependent scattering spectra. Quantum-mechanical calculations show good agreement with our experimental results, together providing a comprehensive description of excitation, scattering and emission in a coupled QD-phonon optomechanical system.


title: Generic Properties of Conjugate Points in Optimal Control Problems

abstract: The first part of the paper studies a class of optimal control problems in Bolza form, where the dynamics is linear w.r.t.~the control function. A necessary condition is derived, for the optimality of a trajectory which starts at a conjugate point. The second part is concerned with a classical problem in the Calculus of Variations, with free terminal point. For a generic terminal cost $\psi\in \C^4(\mathbb{R}^n)$, applying the previous necessary condition we show that the set of conjugate points is contained in the image of an $(n-2)$-dimensional manifold, and has locally bounded $(n-2)$-dimensional Hausdorff measure.


title: Explainability in JupyterLab and Beyond: Interactive XAI Systems for Integrated and Collaborative Workflows

abstract: Explainable AI (XAI) tools represent a turn to more human-centered and human-in-the-loop AI approaches that emphasize user needs and perspectives in machine learning model development workflows. However, while the majority of ML resources available today are developed for Python computational environments such as JupyterLab and Jupyter Notebook, the same has not been true of interactive XAI systems, which are often still implemented as standalone interfaces. In this paper, we address this mismatch by identifying three design patterns for embedding front-end XAI interfaces into Jupyter, namely: 1) One-way communication from Python to JavaScript, 2) Two-way data synchronization, and 3) Bi-directional callbacks. We also provide an open-source toolkit, bonXAI, that demonstrates how each design pattern might be used to build interactive XAI tools for a Pytorch text classification workflow. Finally, we conclude with a discussion of best practices and open questions. Our aims for this paper are to discuss how interactive XAI tools might be developed for computational notebooks, and how they can better integrate into existing model development workflows to support more collaborative, human-centered AI.


title: WcDT: World-centric Diffusion Transformer for Traffic Scene Generation

abstract: In this paper, we introduce a novel approach for autonomous driving trajectory generation by harnessing the complementary strengths of diffusion probabilistic models (a.k.a., diffusion models) and transformers. Our proposed framework, termed the "World-Centric Diffusion Transformer" (WcDT), optimizes the entire trajectory generation process, from feature extraction to model inference. To enhance the scene diversity and stochasticity, the historical trajectory data is first preprocessed and encoded into latent space using Denoising Diffusion Probabilistic Models (DDPM) enhanced with Diffusion with Transformer (DiT) blocks. Then, the latent features, historical trajectories, HD map features, and historical traffic signal information are fused with various transformer-based encoders. The encoded traffic scenes are then decoded by a trajectory decoder to generate multimodal future trajectories. Comprehensive experimental results show that the proposed approach exhibits superior performance in generating both realistic and diverse trajectories, showing its potential for integration into automatic driving simulation systems.


title: A Stabilized Parametric Finite Element Method for Surface Diffusion with an Arbitrary Surface Energy

abstract: We proposed a structure-preserving stabilized parametric finite element method (SPFEM) for the evolution of closed curves under anisotropic surface diffusion with an arbitrary surface energy $\hat{\gamma}(\theta)$. By introducing a non-negative stabilizing function $k(\theta)$ depending on $\hat{\gamma}(\theta)$, we obtained a novel stabilized conservative weak formulation for the anisotropic surface diffusion. A SPFEM is presented for the discretization of this weak formulation. We construct a comprehensive framework to analyze and prove the unconditional energy stability of the SPFEM under a very mild condition on $\hat{\gamma}(\theta)$. This method can be applied to simulate solid-state dewetting of thin films with arbitrary surface energies, which are characterized by anisotropic surface diffusion and contact line migration. Extensive numerical results are reported to demonstrate the efficiency, accuracy and structure-preserving properties of the proposed SPFEM with anisotropic surface energies $\hat{\gamma}(\theta)$ arising from different applications.


title: Adaptive Feature Fusion Neural Network for Glaucoma Segmentation on Unseen Fundus Images

abstract: Fundus image segmentation on unseen domains is challenging, especially for the over-parameterized deep models trained on the small medical datasets. To address this challenge, we propose a method named Adaptive Feature-fusion Neural Network (AFNN) for glaucoma segmentation on unseen domains, which mainly consists of three modules: domain adaptor, feature-fusion network, and self-supervised multi-task learning. Specifically, the domain adaptor helps the pretrained-model fast adapt from other image domains to the medical fundus image domain. Feature-fusion network and self-supervised multi-task learning for the encoder and decoder are introduced to improve the domain generalization ability. In addition, we also design the weighted-dice-loss to improve model performance on complex optic-cup segmentation tasks. Our proposed method achieves a competitive performance over existing fundus segmentation methods on four public glaucoma datasets.


title: On the model uncertainties for the predicted muon content of extensive air showers

abstract: Motivated by the excess of the muon content of cosmic ray induced extensive air showers (EAS), relative to EAS modeling, observed by the Pierre Auger Observatory, and by the tension between Auger data and air shower simulations on the maximal muon production depth $X^{\mu}_{\max}$, we investigate the possibility to modify the corresponding EAS simulation results, within the Standard Model of particle physics. We start by specifying the kinematic range for secondary hadron production, which is of relevance for such predictions. We further investigate the impact on the predicted EAS muon number and on $X^{\mu}_{\max}$ of various modifications of the treatment of hadronic interactions, in the framework of the QGSJET-III model, in particular the model calibration to accelerator data, the amount of the "glue" in the pion, and the energy dependence of the pion exchange process. None of the considered modifications of the model allowed us to enhance the EAS muon content by more than 10\%. On the other hand, for the maximal muon production depth, some of the studied modifications of particle production give rise up to $\sim 10$ g/cm$^2$ larger $X^{\mu}_{\max}$ values, which increases the difference with Auger observations.


title: Regularity results for almost-minimizers of anisotropic free interface problem with H\"older dependence on the position

abstract: We establish regularity results for almost-minimizers of a class of variational problems involving both bulk and interface energies. The bulk energy is of Dirichlet type. The surface energy exhibits anisotropic behaviour and is defined by means of an ellipsoidal density that is H\"older continuous with respect to the position variable.


title: Extreme plasmons

abstract: Nanosciences largely rely on plasmons which are quasiparticles constituted by collective oscillations of quantum electron gas composed of conduction band electrons that occupy discrete quantum states. Our work has introduced non-perturbative plasmons with oscillation amplitudes that approach the extreme limit set by breakdown in characteristic coherence. In contrast, conventional plasmons are small-amplitude oscillations. Controlled excitation of extreme plasmons modeled in our work unleashes unprecedented Petavolts per meter fields. In this work, an analytical model of this new class of plasmons is developed based on quantum kinetic framework. A controllable extreme plasmon, the surface "crunch-in" plasmon, is modeled here using a modified independent electron approximation which takes into account the quantum oscillation frequency. Key characteristics of such realizable extreme plasmons that unlock unparalleled possibilities, are obtained.

categories: cond-mat.mes-hall physics.acc-ph physics.plasm-ph quant-ph


title: LastResort at SemEval-2024 Task 3: Exploring Multimodal Emotion Cause Pair Extraction as Sequence Labelling Task

abstract: Conversation is the most natural form of human communication, where each utterance can range over a variety of possible emotions. While significant work has been done towards the detection of emotions in text, relatively little work has been done towards finding the cause of the said emotions, especially in multimodal settings. SemEval 2024 introduces the task of Multimodal Emotion Cause Analysis in Conversations, which aims to extract emotions reflected in individual utterances in a conversation involving multiple modalities (textual, audio, and visual modalities) along with the corresponding utterances that were the cause for the emotion. In this paper, we propose models that tackle this task as an utterance labeling and a sequence labeling problem and perform a comparative study of these models, involving baselines using different encoders, using BiLSTM for adding contextual information of the conversation, and finally adding a CRF layer to try to model the inter-dependencies between adjacent utterances more effectively. In the official leaderboard for the task, our architecture was ranked 8th, achieving an F1-score of 0.1759 on the leaderboard.


title: Spatially Resolved Kinematics of Post-starburst Galaxies

abstract: Star-forming galaxies can reach quiescence via rapid transition through merger-triggered starbursts that consequently affect both their kinematics and star formation rates. In this work, we analyze the spatially-resolved kinematics of 92 post-starburst galaxies (PSBs) with data from the MaNGA survey and place them in context with early-type galaxies (ETGs) to study the impact of merger history on galaxy kinematics. We measure the specific angular momentum to characterize them as slow or fast rotators. We find that the MaNGA PSB sample has $5\%$ slow rotators, which is less than the $14\%$ slow rotators in the ATLAS$^{3D}$ ETG sample and $22\%$ slow rotators in the MaNGA ETGs. The PSBs have lower specific angular momentum than the star-forming galaxies (SFs) and a greater fraction of slow rotators. This implies that for the PSBs to evolve into the ETGs, they must still lose some angular momentum. While ETGs with higher stellar mass tend to be slow rotators, PSBs do not follow this trend. We find significant correlations between specific angular momentum and mass-weighted age for the SF and ETG samples, but do not see any significant trends within the short PSB phase. These results indicate that significant evolution in angular momentum must continue to take place as the galaxy ages after the PSB phase. For PSBs to evolve directly into ETGs, they must undergo dry mergers to shed excess angular momentum without causing further epochs of star formation.


title: Already Moderate Population Sizes Provably Yield Strong Robustness to Noise

abstract: Experience shows that typical evolutionary algorithms can cope well with stochastic disturbances such as noisy function evaluations. In this first mathematical runtime analysis of the $(1+\lambda)$ and $(1,\lambda)$ evolutionary algorithms in the presence of prior bit-wise noise, we show that both algorithms can tolerate constant noise probabilities without increasing the asymptotic runtime on the OneMax benchmark. For this, a population size $\lambda$ suffices that is at least logarithmic in the problem size $n$. The only previous result in this direction regarded the less realistic one-bit noise model, required a population size super-linear in the problem size, and proved a runtime guarantee roughly cubic in the noiseless runtime for the OneMax benchmark. Our significantly stronger results are based on the novel proof argument that the noiseless offspring can be seen as a biased uniform crossover between the parent and the noisy offspring. We are optimistic that the technical lemmas resulting from this insight will find applications also in future mathematical runtime analyses of evolutionary algorithms.


title: Field-induced spin polarization in lightly Cr-substituted layered antiferromagnet NiPS3

abstract: Tuning magnetic properties in layered magnets is an important route to realize novel phenomenon related to two-dimensional (2D) magnetism. Recently, tuning antiferromagnetic (AFM) properties through substitution and intercalation techniques have been widely studied in MPX3 compounds. Interesting phenomena, such as diverse AFM structures and even the signatures of ferrimagnetism, have been reported. However, long-range ferromagnetic (FM) ordering has remained elusive. In this work, we explored the magnetic properties of the previously unreported Cr-substituted NiPS3. We found that Cr substitution is extremely efficient in controlling spin orientation in NiPS3. Our study reveals a field-induced spin polarization in lightly (9%) Cr-substituted NiPS3, which is likely attributed to the attenuation of AFM interactions and magnetic anisotropy due to Cr doping. Our work provides a possible strategy to achieve FM phase in AFM MPX3, which could be useful for investigating 2D magnetism as well as potential device applications.


title: Optimal Bell inequalities for qubit-qudit systems

abstract: We evaluate the maximal Bell violation for a generic qubit-qudit system, obtaining easily computable expressions in arbitrary qudit dimension. This work generalizes the well-known Horodeckis's result for a qubit-qubit system. We also give simple lower and upper bounds on that violation and study the possibility of improving the amount of Bell-violation by embedding the qudit Hilbert space in one of larger dimension. The results are illustrated with a family of density matrices in the context of a qubit-qutrit system.


title: High-dimensional covariance regression with application to co-expression QTL detection

abstract: While covariance matrices have been widely studied in many scientific fields, relatively limited progress has been made on estimating conditional covariances that permits a large covariance matrix to vary with high-dimensional subject-level covariates. In this paper, we present a new sparse multivariate regression framework that models the covariance matrix as a function of subject-level covariates. In the context of co-expression quantitative trait locus (QTL) studies, our method can be used to determine if and how gene co-expressions vary with genetic variations. To accommodate high-dimensional responses and covariates, we stipulate a combined sparsity structure that encourages covariates with non-zero effects and edges that are modulated by these covariates to be simultaneously sparse. We approach parameter estimation with a blockwise coordinate descent algorithm, and investigate the $\ell_2$ convergence rate of the estimated parameters. In addition, we propose a computationally efficient debiased inference procedure for uncertainty quantification. The efficacy of the proposed method is demonstrated through numerical experiments and an application to a gene co-expression network study with brain cancer patients.


title: $S$-nodes, factorisation of spectral matrix functions and corresponding inequalities

abstract: Using factorisation and Arov-Krein inequality results, we derive important inequalities (in terms of $S$-nodes) in interpolation problems.


title: Interplay between the Lyapunov exponents and phase transitions of charged AdS black holes

abstract: We study the relationship between the standard or extended thermodynamic phase structure of various AdS black holes and the Lyapunov exponents associated with the null and time-like geodesics. We consider dyonic, Bardeen, Gauss-Bonnet, and Lorentz-symmetry breaking massive gravity black holes and calculate the Lyapunov exponents of massless and massive particles in unstable circular geodesics close to the black hole. We find that the thermal profile of the Lyapunov exponents exhibits distinct behaviour in the small and large black hole phases and can encompass certain aspects of the van der Waals type small/large black hole phase transition. We further analyse the properties of Lyapunov exponents as an order parameter and find that its critical exponent is $1/2$, near the critical point for all black holes considered here.


title: Searching for new physics in the solar system with tetrahedral spacecraft formations

abstract: Tetrahedral configurations of spacecraft on unperturbed heliocentric orbits allow for highly precise observations of small spatial changes in the gravitational field, especially those affecting the gravity gradient tensor (GGT). The resulting high sensitivity may be used to search for new physics that could manifest itself via deviations from general relativistic behavior yielding a non-vanishing trace[GGT]. We study the feasibility of recovering the trace[GGT] with the sensitivity of O(1e-24 s^(-2)) -- the level where some of the recently proposed cosmological models may have observable effects in the solar system. We consider how local measurements provided by precision laser ranging and atom-wave interferometry can be used for that purpose. We report on a preliminary study of such an experiment and precision that may be reached in measuring the trace[GGT], with the assumption of drag-compensated spacecraft by atom interferometer measurements. For that, we study the dynamical behavior of a tetrahedral formation established by four spacecraft on heliocentric nearby elliptical orbits. We formulate the observational equations to measure the trace[GGT] relying only on the observables available within the formation: laser ranging and the Sagnac interferometry. We demonstrate that Sagnac observable is a mission enabling and allows to measure the angular frequency of the tetrahedral rotation with respect to an inertial reference frame with an accuracy much higher than that available from any other modern navigational techniques. We show that the quality of the science measurements is affected by the changes in tetrahedron's orientation and shape as spacecraft follow their orbits. We present the preliminary mission and instrument requirements needed to measure the trace[GGT] to the required accuracy and demonstrate the feasibility of satisfying the science objectives.

categories: gr-qc astro-ph.CO astro-ph.IM physics.ins-det


title: Observations of the Polarized Solar Corona during the Annular Eclipse of October 14, 2023

abstract: We present results of a dual eclipse expedition to observe the solar corona from two sites during the annular solar eclipse of 2023 October 14, using a novel coronagraph designed to be accessible for amateurs and students to build and deploy. The coronagraph "CATEcor" builds on the standardized eclipse observing equipment developed for the Citizen CATE 2024 experiment. The observing sites were selected for likelihood of clear observations, for historic relevance (near the Climax site in the Colorado Rocky Mountains), and for centrality to the annular eclipse path (atop Sandia Peak above Albuquerque, New Mexico). The novel portion of CATEcor is an external occulter assembly that slips over the front of a conventional dioptric telescope, forming a "shaded-truss" externally occulted coronagraph. CATEcor is specifically designed to be easily constructed in a garage or "makerspace" environment. We successfully observed some bright features in the solar corona to an altitude of approximately 2.25 R$_\odot$ during the annular phases of the eclipse. Future improvements to the design, in progress now, will reduce both stray light and image artifacts; our objective is to develop a design that can be operated successfully by amateur astronomers at sufficient altitude even without the darkened skies of a partial or annular eclipse.


title: BRAVEn: Improving Self-Supervised Pre-training for Visual and Auditory Speech Recognition

abstract: Self-supervision has recently shown great promise for learning visual and auditory speech representations from unlabelled data. In this work, we propose BRAVEn, an extension to the recent RAVEn method, which learns speech representations entirely from raw audio-visual data. Our modifications to RAVEn enable BRAVEn to achieve state-of-the-art results among self-supervised methods in various settings. Moreover, we observe favourable scaling behaviour by increasing the amount of unlabelled data well beyond other self-supervised works. In particular, we achieve 20.0% / 1.7% word error rate for VSR / ASR on the LRS3 test set, with only 30 hours of labelled data and no external ASR models. Our results suggest that readily available unlabelled audio-visual data can largely replace costly transcribed data.


title: One-dimensional Fermi polaron after a kick: two-sided singularity of the momentum distribution, Bragg reflection and other exact results

abstract: A mobile impurity particle immersed in a quantum fluid forms a polaron - a quasiparticle consisting of the impurity and a local disturbance of the fluid around it. We ask what happens to a one-dimensional polaron after a kick, i.e. an abrupt application of a force that instantly delivers a finite impulse to the impurity. In the framework of an integrable model describing an impurity in a one-dimensional gas of fermions or hard-core bosons, we calculate the distribution of the polaron momentum established when the post-kick relaxation is over. A remarkable feature of this distribution is a two-sided power-law singularity. It emerges due to one of two processes. In the first process, the whole impulse is transferred to the polaron, without creating phonon-like excitations of the fluid. In the second process, the impulse is shared between the polaron and the center-of-mass motion of the fluid, again without creating any fluid excitations. The latter process is, in fact, a Bragg reflection at the edge of the emergent Brillouin zone. We carefully analyze the conditions for each of the two processes. The asymptotic form of the distribution in the vicinity of the singularity is derived.


title: Analysis Facilities White Paper

abstract: This white paper presents the current status of the R&D for Analysis Facilities (AFs) and attempts to summarize the views on the future direction of these facilities. These views have been collected through the High Energy Physics (HEP) Software Foundation's (HSF) Analysis Facilities forum, established in March 2022, the Analysis Ecosystems II workshop, that took place in May 2022, and the WLCG/HSF pre-CHEP workshop, that took place in May 2023. The paper attempts to cover all the aspects of an analysis facility.