title: Fast Inference Using Automatic Differentiation and Neural Transport in Astroparticle Physics

abstract: Multi-dimensional parameter spaces are commonly encountered in astroparticle physics theories that attempt to capture novel phenomena. However, they often possess complicated posterior geometries that are expensive to traverse using techniques traditional to this community. Effectively sampling these spaces is crucial to bridge the gap between experiment and theory. Several recent innovations, which are only beginning to make their way into this field, have made navigating such complex posteriors possible. These include GPU acceleration, automatic differentiation, and neural-network-guided reparameterization. We apply these advancements to astroparticle physics experimental results in the context of novel neutrino physics and benchmark their performances against traditional nested sampling techniques. Compared to nested sampling alone, we find that these techniques increase performance for both nested sampling and Hamiltonian Monte Carlo, accelerating inference by factors of $\sim 100$ and $\sim 60$, respectively. As nested sampling also evaluates the Bayesian evidence, these advancements can be exploited to improve model comparison performance while retaining compatibility with existing implementations that are widely used in the natural sciences.


title: Trojan globular clusters: radial migration via trapping in bar resonances

abstract: We search for globular clusters (GCs) trapped in resonances with the bar of the Milky Way. By integrating their orbits in a potential with a decelerating bar, we select 10 whose orbits are significantly changed by its presence. Most of these are trapped in the corotation resonance (CR), including M22 and 47 Tuc. The decelerating bar is capable of transporting these GCs to their current positions from much lower energies, angular momenta, and radii. Our results indicate that the bar is likely to have reshaped the Milky Way's globular cluster system via its resonances. We also discuss implications for the origins of specific GCs, including the possible nuclear star cluster M22. Finally, we consider the effects of the bar on the tidal tails of a trapped GC, by running simulations of stars stripped from 47 Tuc. Instead of forming narrow tails, the stripped stars make up a diffuse extended halo around the cluster, consistent with observations of 47 Tuc.


title: Universal Robustness via Median Randomized Smoothing for Real-World Super-Resolution

abstract: Most of the recent literature on image Super-Resolution (SR) can be classified into two main approaches. The first one involves learning a corruption model tailored to a specific dataset, aiming to mimic the noise and corruption in low-resolution images, such as sensor noise. However, this approach is data-specific, tends to lack adaptability, and its accuracy diminishes when faced with unseen types of image corruptions. A second and more recent approach, referred to as Robust Super-Resolution (RSR), proposes to improve real-world SR by harnessing the generalization capabilities of a model by making it robust to adversarial attacks. To delve further into this second approach, our paper explores the universality of various methods for enhancing the robustness of deep learning SR models. In other words, we inquire: "Which robustness method exhibits the highest degree of adaptability when dealing with a wide range of adversarial attacks ?". Our extensive experimentation on both synthetic and real-world images empirically demonstrates that median randomized smoothing (MRS) is more general in terms of robustness compared to adversarial learning techniques, which tend to focus on specific types of attacks. Furthermore, as expected, we also illustrate that the proposed universal robust method enables the SR model to handle standard corruptions more effectively, such as blur and Gaussian noise, and notably, corruptions naturally present in real-world images. These results support the significance of shifting the paradigm in the development of real-world SR methods towards RSR, especially via MRS.


title: Arresting Quantum Chaos Dynamically in Transmon Arrays

abstract: Ergodic quantum many-body systems evolving under unitary time dynamics typically lose memory of their initial state via information scrambling. Here we consider a paradigmatic translationally invariant many-body Hamiltonian of interacting bosons -- a Josephson junction array in the transmon regime -- in the presence of a strong Floquet drive. Generically, such a time-dependent drive is expected to heat the system to an effectively infinite temperature, featureless state in the late-time limit. However, using numerical exact-diagonalization we find evidence of special ratios of the drive amplitude and frequency where the system develops {\it emergent} conservation laws, and {\it approximate} integrability. Remarkably, at these same set of points, the Lyapunov exponent associated with the semi-classical dynamics for the coupled many-body equations of motion drops by orders of magnitude, arresting the growth of chaos. We supplement our numerical results with an analytical Floquet-Magnus expansion that includes higher-order corrections, and capture the slow dynamics that controls decay away from exact freezing.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.quant-gas cond-mat.stat-mech hep-th


title: Local and nonlocal stochastic control of quantum chaos: Measurement- and control-induced criticality

abstract: We theoretically study the topology of the phase diagram of a family of quantum models inspired by the classical Bernoulli map under stochastic control. The quantum models inherit a control-induced phase transition from the classical model and also manifest an entanglement phase transition intrinsic to the quantum setting. This measurement-induced phase transition has been shown in various settings to either coincide or split off from the control transition, but a systematic understanding of the necessary and sufficient conditions for the two transitions to coincide in this case has so far been lacking. In this work, we generalize the control map to allow for either local or global control action. While this does not affect the classical aspects of the control transition that is described by a random walk, it significantly influences the quantum dynamics, leading to the universality class of the measurement-induced transition being dependent on the locality of the control operation. In the presence of a global control map, the two transitions coincide and the control-induced phase transition dominates the measurement-induced phase transition. Contrarily, the two transitions split in the presence of the local control map or additional projective measurements and generically take on distinct universality classes. For local control, the measurement-induced phase transition recovers the Haar logarithmic conformal field theory universality class found in feedback-free models. However, for global control, a novel universality class with correlation length exponent $\nu \approx 0.7$ emerges from the interplay of control and projective measurements. This work provides a more refined understanding of the relationship between the control- and measurement-induced phase transitions.


title: Is the low-energy tail of shock-accelerated protons responsible for over-ionized plasma in supernova remnants?

abstract: Over-ionized, recombining plasma is an emerging class of X-ray bright supernova remnants (SNRs). This unique thermal state where the ionization temperature ($T_{\rm z}$) is significantly higher than the electron temperature ($T_{\rm e}$) is not expected from the standard evolution model assuming a point explosion in a uniform interstellar medium, requiring a new scenario for the dynamical and thermal evolution. A recently proposed idea attributes the over-ionization state to additional ionization contribution from the low-energy tail of shock-accelerated protons. However, this new scenario has been left untested, especially from the atomic physics point of view. We report calculation results of the proton impact ionization rates of heavy-element ions in ejecta of SNRs. We conservatively estimate the requirement for accelerated protons, and find that their relative number density to thermal electrons needs to be higher than $5~(T_{\rm e}/{\rm 1~keV})\%$ in order to explain the observed over-ionization degree at $T_{\rm z}/T_{\rm e} \ge 2$ for K-shell emission. We conclude that the proton ionization scenario is not feasible because such a high abundance of accelerated protons is prohibited by the injection fraction from thermal to non-thermal energies, which is expected to be $\sim 1\%$ at largest.


title: The Supersonic Project: Early Star Formation with the Streaming Velocity

abstract: At high redshifts ($z\gtrsim12$), the relative velocity between baryons and dark matter (the so-called streaming velocity) significantly affects star formation in low-mass objects. Streaming substantially reduces the abundance of low-mass gas objects while simultaneously allowing for the formation of supersonically-induced gas objects (SIGOs) and their associated star clusters outside of dark matter halos. Here, we present a study of the population-level effects of streaming on star formation within both halos and SIGOs in a set of simulations with and without streaming. Notably, we find that streaming actually enhances star formation within individual halos of all masses at redshifts between $z=12$ and $z=20$. This is demonstrated both as an increased star formation rate per object as well as an enhancement of the Kennicutt-Schmidt relation for objects with streaming. We find that our simulations are consistent with some observations at high redshift, but on a population level, they continue to under-predict star formation relative to the majority of observations. However, simulations of overdense regions (both with and without streaming) agree with observations, suggesting a strategy for extracting information about the overdensity and streaming velocity in a given survey volume in future observations.


title: Realizing triality and $p$-ality by lattice twisted gauging in (1+1)d quantum spin systems

abstract: In this paper, we study the twisted gauging on the (1+1)d lattice and construct various non-local mappings on the lattice operators. To be specific, we define the twisted Gauss law operator and implement the twisted gauging of the finite group on the lattice motivated by the orbifolding procedure in the conformal field theory, which involves the data of non-trivial element in the second cohomology group of the gauge group. We show the twisted gauging is equivalent to the two-step procedure of first applying the SPT entangler and then untwisted gauging. We use the twisted gauging to construct the triality (order 3) and $p$-ality (order $p$) mapping on the $\mathbb{Z}_p\times \mathbb{Z}_p$ symmetric Hamiltonians, where $p$ is a prime. Such novel non-local mappings generalize Kramers-Wannier duality and they preserve the locality of symmetric operators but map charged operators to non-local ones. We further construct quantum process to realize these non-local mappings and analyze the induced mappings on the phase diagrams. For theories that are invariant under these non-local mappings, they admit the corresponding non-invertible symmetries. The non-invertible symmetry will constrain the theory at the multicritical point between the gapped phases. We further give the condition when the non-invertible symmetry can have symmetric gapped phase with a unique ground state.


title: Interaction-induced strong zero modes in short quantum dot chains with time-reversal symmetry

abstract: We theoretically explore the emergence of strong zero modes in a two-site chain consisting of two quantum dots coupled due to a central dot that mediates electron hopping and singlet superconducting pairing. In the presence of time-reversal symmetry, the on-site Coulomb interaction leads to a three-fold ground-state degeneracy when tuning the system to a sweet spot as a function of the inter-dot couplings. This degeneracy is protected against changes of the dot energies in the same way as "poor man's'' Majorana bound states in short Kitaev chains. In the limit of strong interactions, this protection is maximal and the entire spectrum becomes triply degenerate, indicating the emergence of a ''poor man's'' version of a strong zero mode. We explain the degeneracy and protection by constructing corresponding Majorana Kramers-pair operators and $\mathbb{Z}_3$-parafermion operators. The strong zero modes share many properties of Majorana bound states in short Kitaev chains, including the stability of zero-bias peaks in the conductance and the behavior upon coupling to an additional quantum dot. However, they can be distinguished through finite-bias spectroscopy and the exhibit a different behavior when scaling to longer chains.


title: The NANOGrav 15 yr Data Set: Chromatic Gaussian Process Noise Models for Six Pulsars

abstract: Pulsar timing arrays (PTAs) are designed to detect low-frequency gravitational waves (GWs). GWs induce achromatic signals in PTA data, meaning that the timing delays do not depend on radio-frequency. However, pulse arrival times are also affected by radio-frequency dependent "chromatic" noise from sources such as dispersion measure (DM) and scattering delay variations. Furthermore, the characterization of GW signals may be influenced by the choice of chromatic noise model for each pulsar. To better understand this effect, we assess if and how different chromatic noise models affect achromatic noise properties in each pulsar. The models we compare include existing DM models used by NANOGrav and noise models used for the European PTA Data Release 2 (EPTA DR2). We perform this comparison using a subsample of six pulsars from the NANOGrav 15 yr data set, selecting the same six pulsars as from the EPTA DR2 six-pulsar dataset. We find that the choice of chromatic noise model noticeably affects the achromatic noise properties of several pulsars. This is most dramatic for PSR J1713+0747, where the amplitude of its achromatic red noise lowers from $\log_{10}A_{\text{RN}} = -14.1^{+0.1}_{-0.1}$ to $-14.7^{+0.3}_{-0.5}$, and the spectral index broadens from $\gamma_{\text{RN}} = 2.6^{+0.5}_{-0.4}$ to $\gamma_{\text{RN}} = 3.5^{+1.2}_{-0.9}$. We also compare each pulsar's noise properties with those inferred from the EPTA DR2, using the same models. From the discrepancies, we identify potential areas where the noise models could be improved. These results highlight the potential for custom chromatic noise models to improve PTA sensitivity to GWs.


title: Mapping 1+1-dimensional black hole thermodynamics to finite volume effects

abstract: Both black hole thermodynamics and finite volume effects in quantum field theory violate the null energy condition. Motivated by this, we compare thermodynamic features between two 1+1-dimensional systems: (i) a scalar field confined to a periodic spatial interval of length $a$ and tunneling between two degenerate vacua; (ii) a dilatonic black hole at temperature $T$ in the presence of matter fields. If we identify $a\propto T^{-1}$, we find similar thermodynamic behaviours, which suggests some deeper connection arising from the presence of non-trivial boundary conditions in both systems.


title: SDSS-V Local Volume Mapper (LVM): A Glimpse into Orion

abstract: The Orion Molecular Cloud complex, one of the nearest (D~400 pc) and most extensively studied massive star-forming regions, is ideal for constraining the physics of stellar feedback, but its ~12 deg diameter on the sky requires a dedicated approach to mapping ionized gas structures within and around the nebula. The Sloan Digital Sky Survey (SDSS-V) Local Volume Mapper (LVM) is a new optical integral field unit (IFU) that will map the ionized gas within the Milky Way and Local Group galaxies, covering 4300 deg^2 of the sky with the new LVM Instrument (LVM-I). We showcase optical emission line maps from LVM covering 12 deg^2 inside of the Orion belt region, with 195,000 individual spectra combined to produce images at 0.07 pc (35.3 arcsec) resolution. This is the largest IFU map made (to date) of the Milky Way, and contains well-known nebulae (the Horsehead Nebula, Flame Nebula, IC 434, and IC 432), as well as ionized interfaces with the neighboring dense Orion B molecular cloud. We resolve the ionization structure of each nebula, and map the increase in both the [SII]/Ha and [NII]/Ha line ratios at the outskirts of nebulae and along the ionization front with Orion B. [OIII] line emission is only spatially resolved within the center of the Flame Nebula and IC 434, and our ~0.1 pc scale line ratio diagrams show how variations in these diagnostics are lost as we move from the resolved to the integrated view of each nebula. We detect ionized gas emission associated with the dusty bow wave driven ahead of the star sigma Orionis, where the stellar wind interacts with the ambient interstellar medium. The Horsehead Nebula is seen as a dark occlusion of the bright surrounding photo-disassociation region. This small glimpse into Orion only hints at the rich science that will be enabled by the LVM.


title: Galaxy Groups in the presence of Cosmological Constant: Re-Mapping the close-by galaxies

abstract: Boundaries of galaxy groups and clusters are defined by the interplay between the Newtonian attractive force and the local repulsion force caused by the expansion of the Universe. This research extends the definition of zero radial acceleration surface (ZRAS) and the turnaround surface (TS) for a general distribution of the masses in an expanding background, governed by the cosmological constant. We apply these definitions for different galaxy groups in the local Universe, mapping these groups up to ten megaparsec. We discuss the dipole and the quadrupole rate for the Local Group of Galaxies and the implementations for Hubble diagram correction and galaxy groups viralization. With these definitions, we indicate the surfaces showing the interplay between the local expansion vs the local Newtonian attraction for galaxy groups in the local Universe. The results show that it is important to include the cosmological constant in analyzing the Cosmic Flow of the local Universe.

categories: astro-ph.GA astro-ph.CO gr-qc hep-ph hep-th


title: Residual eccentricity as a systematic uncertainty on the formation channels of binary black holes

abstract: Resolving the formation channel(s) of merging binary black holes is a key goal in gravitational-wave astronomy. The orbital eccentricity is believed to be a precious tracer of the underlying formation pathway, but is largely dissipated during the usually long inspiral between black-hole formation and merger. Most gravitational-wave sources are thus expected to enter the sensitivity windows of current detectors on configurations that are compatible with quasi-circular orbits. In this paper, we investigate the impact of "negligible" residual eccentricity -- lower than currently detectable by LIGO/Virgo -- on our ability to infer the formation history of binary black holes, focusing in particular on their spin orientations. We trace the evolution of both observed and synthetic gravitational-wave events backward in time, while resampling their residual eccentricities to values that are below the detectability threshold. Eccentricities in-band as low as $\sim 10^{-4}$ can lead to significant biases when reconstructing the spin directions, especially in the case of loud, highly precessing systems. Residual eccentricity thus act like a systematic uncertainty for our astrophysical inference. As a mitigation strategy, one can marginalize the posterior distribution over the residual eccentricity using astrophysical predictions.


title: Diffuse Boosted Cosmic Neutrino Background

abstract: Energetic cosmic rays scatter off the cosmic neutrino background throughout the history of the Universe, yielding a diffuse flux of cosmic relic neutrinos boosted to high energies. We calculate this flux under different assumptions of the cosmic-ray flux spectral slope and redshift evolution. The non-observation of the diffuse flux of boosted relic neutrinos with current high-energy neutrino experiments already excludes an average cosmic neutrino background overdensity larger than $\sim 10^{4}$ over cosmological distances. We discuss the future detectability of the diffuse flux of boosted relic neutrinos in light of neutrino overdensity estimates and cosmogenic neutrino backgrounds.


title: Operational Framework for a Quantum Database

abstract: Databases are an essential component of modern computing infrastructures and allow efficient access to data stored persistently. Their structure depends on the type and relationships of the stored data elements and on the access pattern. Extending the concept of databases to the quantum domain is expected to increase both the storage efficiency and the access parallelism through quantum superposition. In addition, quantum databases may be seen as the result of a prior state preparation ready to be used by quantum algorithms when needed. On the other hand, limiting factors exist and include entanglement creation, the impossibility of perfect copying due to the no-cloning theorem, and the impossibility of coherently erasing a quantum state. In this work, we introduce quantum databases within the broader context of data structures using classical and quantum data and indexing. In particular, we are interested in quantum databases practical implementation and usability, focusing on the definition of the basic operations needed to create and manipulate data stored in a superposition state. Specifically, we address the case of quantum indexing in combination with classical data. For this scenario, we define the operations for database preparation, extension, removal of indices, writing, and read-out of data, as well as index permutation. We present their algorithmic implementation and highlight their advantages and limitations. Finally, we introduce steps toward defining the same operations in the more general context of quantum indexing and quantum data.


title: Properties of Nuclear Star Clusters in Low Surface Brightness Galaxies

abstract: Using the SMUDGes and SDSS catalogs, and our own reprocessing of the Legacy Surveys imaging, we investigate the properties of nuclear star clusters (NSCs) in galaxies having central surface brightnesses as low as 27 mag arcsec$^{-2}$. We identify 273 (123 with known redshift) and 32 NSC-bearing galaxies in the two samples, respectively, where we require candidate NSCs to have a separation of less than 0.10$r_e$ from the galaxy center. We find that galaxies with low central surface brightness ($\mu_{0,g} > 24$ mag arcsec$^{-2}$) are more likely to contain an NSC if 1) they have a higher stellar mass, 2) a higher stellar to total mass ratio, 3) a brighter central surface brightness, 4) a larger axis ratio, or 5) lie in a denser environment. Because of the correlations among these various quantities, it is likely that only one or two are true physical drivers. We also find scaling relations for the NSC mass with stellar mass ($M_{NSC}/$\Msol$ = 10^{6.02\pm0.03}(M_{*,gal}/10^{8} $\Msol$)^{0.77\pm0.04}$) and halo mass ($M_{NSC}/$\Msol$ = 10^{6.11\pm0.05}(M_{h,gal}/10^{10} $\Msol$)^{0.92\pm0.05}$), although it is the scaling with halo mass that is consistent with a direct proportionality. In galaxies with an NSC, $M_{NSC} \approx 10^{-4}M_{h,gal}$. This proportionality echoes the finding of a direct proportionality between the mass (or number) of globular clusters (GCs) in galaxies and the galaxy's total mass. These findings favor a related origin for GCs and NSCs.


title: Lieb-Schultz-Mattis Theorem with Long-Range Interactions

abstract: We prove the Lieb-Schultz-Mattis theorem in $d$-dimensional spin systems exhibiting $SO(3)$ spin rotation and lattice translation symmetries in the presence of interactions decaying as $\sim 1/r^\alpha$ with distance $r$. Two types of Hamiltonians are considered: Type I comprises long-range spin-spin couplings, while Type II features long-range couplings between $SO(3)$ symmetric local operators. For spin-$\frac{1}{2}$ systems, it is shown that Type I cannot have a unique ground state with a nonzero excitation gap when the interaction decays sufficiently fast, i.e., when $\alpha>\max(3d,4d-2)$. For Type II, the condition becomes $\alpha>\max(3d-1,4d-3)$. In $1d$, this ingappability condition is improved to $\alpha>2$ for Type I and $\alpha>0$ for Type II by examining the energy of a state with a uniform $2\pi$ twist. Notably, in $2d$, a Type II Hamiltonian with van der Waals interaction is subject to the constraint of the theorem.


title: Critical exponents of correlated percolation of sites not visited by a random walk

abstract: We consider a $d$-dimensional correlated percolation problem of sites {\em not} visited by a random walk on a hypercubic lattice $L^d$ for $d=3$, 4 and 5. The length of the random walk is ${\cal N}=uL^d$. Close to the critical value $u=u_c$, many geometrical properties of the problem can be described as powers (critical exponents) of $u_c-u$, such as $\beta$, which controls the strength of the spanning cluster, and $\gamma$, which characterizes the behavior of the mean finite cluster size $S$. We show that at $u_c$ the ratio between the mean mass of the largest cluster $M_1$ and the mass of the second largest cluster $M_2$ is independent of $L$ and can be used to find $u_c$. We calculate $\beta$ from the $L$-dependence of $M_2$ and $\gamma$ from the finite size scaling of $S$. The resulting exponent $\beta$ remains close to 1 in all dimensions. The exponent $\gamma$ decreases from $\approx 3.9$ in $d=3$ to $\approx1.9$ in $d=4$ and $\approx 1.3$ in $d=5$ towards $\gamma=1$ expected in $d=6$, which is close to $\gamma=4/(d-2)$.


title: Quantum-assisted Rendezvous on Graphs: Explicit Algorithms and Quantum Computer Simulations

abstract: We study quantum advantage in one-step rendezvous games on simple graphs analytically, numerically, and using noisy intermediate-scale quantum (NISQ) processors. Our protocols realise the recently discovered [arXiv:2207.14404] optimal bounds for small cycle graphs and cubic graphs. In the case of cycle graphs, we generalise the protocols to arbitrary graph size. The NISQ processor experiments realise the expected quantum advantage with high accuracy for rendezvous on the complete graph K3. In contrast, for the graph 2K4, formed by two disconnected 4-vertex complete graphs, the performance of the NISQ hardware is sub-classical, consistent with the deeper circuit and known qubit decoherence and gate error rates.


title: First detection of X-ray pulsations and spectrum of the high Galactic latitude pulsar PSR J0837-2454 and direct Urca cooling implications

abstract: PSR J0837-2454 is a young 629 ms radio pulsar whose uncertain distance has important implications. A large distance would place the pulsar far out of the Galactic plane and suggest it is the result of a runaway star, while a short distance would mean the pulsar is extraordinarily cold. Here we present further radio observations and the first deep X-ray observation of PSR J0837-2454. Data from the Parkes Murriyang telescope show flux variations over short and long timescales and also yield an updated timing model, while the position and proper motion (and, less strongly, parallax) of the pulsar are constrained by a number of low-significance detections with the Very Long Baseline Array. XMM-Newton data enable detection of X-ray pulsations for the first time from this pulsar and yield a spectrum that is thermal and blackbody-like, with a cool blackbody temperature ~70 eV or atmosphere temperature ~50 eV, as well as a small hotspot. The spectrum also indicates the pulsar is at a small distance of <~1 kpc, which is compatible with the marginal VLBA parallax constraint that favours a distance of >~330 pc. The low implied X-ray luminosity (~3x10^31 erg s^-1 at 0.9 kpc) suggests PSR J0837-2454 has a mass high enough that fast neutrino emission from direct Urca reactions operates in this young star and points to a nuclear equation of state that allows for direct Urca reactions at the highest densities present in neutron star cores.


title: Mallows-DPO: Fine-Tune Your LLM with Preference Dispersions

abstract: Direct Preference Optimization (DPO) has recently emerged as a popular approach to improve reinforcement learning with human feedback (RLHF), leading to better techniques to fine-tune large language models (LLM). A weakness of DPO, however, lies in its lack of capability to characterize the diversity of human preferences. Inspired by Mallows' theory of preference ranking, we develop in this paper a new approach, the Mallows-DPO. A distinct feature of this approach is a dispersion index, which reflects the dispersion of human preference to prompts. We show that existing DPO models can be reduced to special cases of this dispersion index, thus unified with Mallows-DPO. More importantly, we demonstrate (empirically) how to use this dispersion index to enhance the performance of DPO in a broad array of benchmark tasks, from synthetic bandit selection to controllable generations and dialogues, while maintaining great generalization capabilities.


title: Revealing Quadrupolar Excitations with Non-Linear Spectroscopy

abstract: Local moments with a spin $S>1/2$ can exhibit a rich variety of elementary quasiparticle excitations, such as quadrupolar excitations, that go beyond the dipolar magnons of conventional spin-$1/2$ systems. However, the experimental observation of such quadrupolar excitations is often challenging due to the dipolar selection rules of many linear response probes, rendering them invisible. Here we show that non-linear spectroscopy, in the form of two-dimensional coherent spectroscopy (2DCS), can be used to reveal quadrupolar excitations. Considering a family of spin-1 Heisenberg ferromagnets with single-ion easy-axis anisotropy as an example, we explicitly calculate their 2DCS signature by combining exact diagonalization and generalized spin wave theory. We further demonstrate that 2DCS can provide access to the quadrupolar weight of an excitation, analogous to how linear response provides access to the dipolar weight. Our work highlights the potential of non-linear spectroscopy as a powerful tool to diagnose multipolar excitations in quantum magnets.


title: Detector requirements: some challenges for the present

abstract: Astrophysics demands higher precision in measurements across photometry, spectroscopy, and astrometry. Several science cases necessitate not only precision but also a high level of accuracy. We highlight the challenges involved, particularly in achieving spectral fidelity, which refers to our ability to accurately replicate the input spectrum of an astrophysical source. Beyond wavelength calibration, this encompasses correcting observed spectra for atmospheric, telescope, and instrumental signatures. Elevating spectral fidelity opens avenues for addressing fundamental questions in physics and astrophysics. We delve into specific science cases, critically analyzing the prerequisites for conducting crucial observations. Special attention is given to the requirements for spectrograph detectors, their calibrations and data reduction. Importantly, these considerations align closely with the needs of photometry and astrometry.


title: Interpretable and Editable Programmatic Tree Policies for Reinforcement Learning

abstract: Deep reinforcement learning agents are prone to goal misalignments. The black-box nature of their policies hinders the detection and correction of such misalignments, and the trust necessary for real-world deployment. So far, solutions learning interpretable policies are inefficient or require many human priors. We propose INTERPRETER, a fast distillation method producing INTerpretable Editable tRee Programs for ReinforcEmenT lEaRning. We empirically demonstrate that INTERPRETER compact tree programs match oracles across a diverse set of sequential decision tasks and evaluate the impact of our design choices on interpretability and performances. We show that our policies can be interpreted and edited to correct misalignments on Atari games and to explain real farming strategies.


title: Understanding the dynamics of the frequency bias in neural networks

abstract: Recent works have shown that traditional Neural Network (NN) architectures display a marked frequency bias in the learning process. Namely, the NN first learns the low-frequency features before learning the high-frequency ones. In this study, we rigorously develop a partial differential equation (PDE) that unravels the frequency dynamics of the error for a 2-layer NN in the Neural Tangent Kernel regime. Furthermore, using this insight, we explicitly demonstrate how an appropriate choice of distributions for the initialization weights can eliminate or control the frequency bias. We focus our study on the Fourier Features model, an NN where the first layer has sine and cosine activation functions, with frequencies sampled from a prescribed distribution. In this setup, we experimentally validate our theoretical results and compare the NN dynamics to the solution of the PDE using the finite element method. Finally, we empirically show that the same principle extends to multi-layer NNs.


title: Dirichlet Scalar Determinants On Two-Dimensional Constant Curvature Disks

abstract: We compute exactly the scalar determinants $\det(\Delta+M^{2})$ on the two-dimensional round disks of constant curvature $R=0$, $\mp 2$, for any finite boundary length $\ell$ and mass $M$, with Dirichlet boundary conditions, using the $\zeta$-function prescription. When $M^{2}=\pm q(q+1)$, $q\in\mathbb N$, a simple expression involving only elementary functions and the Euler $\Gamma$ function is found. Applications to two-dimensional Liouville and Jackiw-Teitelboim quantum gravity are presented in a separate paper.


title: EvGGS: A Collaborative Learning Framework for Event-based Generalizable Gaussian Splatting

abstract: Event cameras offer promising advantages such as high dynamic range and low latency, making them well-suited for challenging lighting conditions and fast-moving scenarios. However, reconstructing 3D scenes from raw event streams is difficult because event data is sparse and does not carry absolute color information. To release its potential in 3D reconstruction, we propose the first event-based generalizable 3D reconstruction framework, called EvGGS, which reconstructs scenes as 3D Gaussians from only event input in a feedforward manner and can generalize to unseen cases without any retraining. This framework includes a depth estimation module, an intensity reconstruction module, and a Gaussian regression module. These submodules connect in a cascading manner, and we collaboratively train them with a designed joint loss to make them mutually promote. To facilitate related studies, we build a novel event-based 3D dataset with various material objects and calibrated labels of grayscale images, depth maps, camera poses, and silhouettes. Experiments show models that have jointly trained significantly outperform those trained individually. Our approach performs better than all baselines in reconstruction quality, and depth/intensity predictions with satisfactory rendering speed.


title: Studies of Ni-Cr complexation in FLiBe molten salt using machine learning interatomic potentials

abstract: In nuclear and/or solar applications that involve molten salts, impurities frequently enter the salt as either fission products or via corrosion. Impurities can interact and make complexes, but the impact of such complexation on the properties of the salts and corrosion rates has not been understood. Common impurities in molten salts, such as FLiBe, include Cr, Ni, and Fe. Here, we investigate the complexation of Cr and Ni in FLiBe using molecular dynamics based on a machine learning interatomic potential (MLIP) fitted using the atomic cluster expansion (ACE) method. The MLIP allows us to overcome the challenges of simultaneously needing accurate energetics and long time scale to study complexation. We demonstrate that impurity behavior is more difficult to capture than that of concentrated elements with MLIPs due to less sampling in training data, but that this can be overcome by using active learning strategies to obtain a robust fit. Our findings suggest that there is a weak but potentially significant binding free energy between CrF2 and NiF2 in eutectic FLiBe of -0.112 eV. Under certain conditions this binding creates a significant short-range order between the species and lowers the redox potential of NiF2 in the presence of CrF2 in FLiBe, making Ni dissolution more favorable in the presence of Cr as compared to its dissolution in pure FLiBe. However, we find little impact of this complexation on the diffusivity of Ni and Cr. Overall, the methodology presented here suggests an approach to modeling complexation with MLIPs and suggests that interactions between dissolved cations could be playing a significant role in some salt thermophysical properties.


title: SFDDM: Single-fold Distillation for Diffusion models

abstract: While diffusion models effectively generate remarkable synthetic images, a key limitation is the inference inefficiency, requiring numerous sampling steps. To accelerate inference and maintain high-quality synthesis, teacher-student distillation is applied to compress the diffusion models in a progressive and binary manner by retraining, e.g., reducing the 1024-step model to a 128-step model in 3 folds. In this paper, we propose a single-fold distillation algorithm, SFDDM, which can flexibly compress the teacher diffusion model into a student model of any desired step, based on reparameterization of the intermediate inputs from the teacher model. To train the student diffusion, we minimize not only the output distance but also the distribution of the hidden variables between the teacher and student model. Extensive experiments on four datasets demonstrate that our student model trained by the proposed SFDDM is able to sample high-quality data with steps reduced to as little as approximately 1%, thus, trading off inference time. Our remarkable performance highlights that SFDDM effectively transfers knowledge in single-fold distillation, achieving semantic consistency and meaningful image interpolation.


title: Data Augmentation Method Utilizing Template Sentences for Variable Definition Extraction

abstract: The extraction of variable definitions from scientific and technical papers is essential for understanding these documents. However, the characteristics of variable definitions, such as the length and the words that make up the definition, differ among fields, which leads to differences in the performance of existing extraction methods across fields. Although preparing training data specific to each field can improve the performance of the methods, it is costly to create high-quality training data. To address this challenge, this study proposes a new method that generates new definition sentences from template sentences and variable-definition pairs in the training data. The proposed method has been tested on papers about chemical processes, and the results show that the model trained with the definition sentences generated by the proposed method achieved a higher accuracy of 89.6%, surpassing existing models.


title: Scale-dependent chirality as a smoking gun for Abelian gauge fields during inflation

abstract: Axion-inflation models are a compelling candidate as a mechanism behind the accelerated expansion in the early universe in light of the possibility to embed them in higher dimensional UV complete theories and the exciting prospect of testing them with next-generation cosmological probes. Adding an Abelian gauge sector to axion-inflation models makes for a rich, interesting, phenomenology spanning from primordial black holes to gravitational waves (GWs). Several recent studies employ an approximate analytic (Gaussian) template to characterize the effect of gauge field production on cosmological perturbations. In this work we go beyond such approximation and numerically study particle production and the ensuing scalar and tensor spectra. We find a significant deviation from results based on log-normally distributed vector field excitations. As an important phenomenological application of the improved method, we study the expected chirality and spectral index of the sourced GW background at scales relevant for current and next-generation GW detectors. One striking feature is that of a scale-dependent chirality. We derive a consistency relation between these two observables that can serve as an important tool in identifying key signatures of multi-field dynamics in axion inflation.


title: Black Start Operation of Grid-Forming Converters Based on Generalized Three-phase Droop Control Under Unbalanced Conditions

abstract: This paper focuses on the challenging task of bottom-up restoration in a complete blackout system using Grid-forming (GFM) converters. Challenges arise due to the limited current capability of power converters, resulting in distinct dynamic responses and fault current characteristics compared to synchronous generators. Additionally, GFM control needs to address the presence of unbalanced conditions commonly found in distribution systems. To address these challenges, this paper explores the black start capability of GFM converters with a generalized three-phase GFM droop control. This approach integrates GFM controls individually for each phase, incorporating phase-balancing feedback and enabling current limiting for each phase during unbalanced faults or overloading. The introduction of a phase-balancing gain provides flexibility to trade-off between voltage and power imbalances. The study further investigates bottom-up black start operations using GFM converters, incorporating advanced load relays into breakers for gradual load energization without central coordination. The effectiveness of bottom-up black start operations with GFM converters, utilizing the generalized three-phase GFM droop, is evaluated through electromagnetic transient (EMT) simulations in MATLAB/Simulink. The results confirm the performance and effectiveness of this approach in achieving successful black start operations under unbalanced conditions.


title: Transverse Momentum Dependent PDFs in Chiral Effective Theory

abstract: We develop a theoretical framework to match transverse momentum dependent parton distribution functions (TMD PDFs) onto chiral effective theory operators. In this framework the TMD PDF is expressed as a convolution of TMD hadronic distribution functions, which describe fluctuations of initial states into intermediate hadrons in chiral perturbation theory, and short distance matching coefficients, which are the TMD PDFs of intermediate hadrons in the chiral limit. The various limits of the matching condition are explored and an operator product expansion is applied to the high energy TMD matching coefficients, allowing them to be written in terms of the collinear valence PDFs of intermediate hadrons. As an example, we calculate the isovector TMD hadronic distribution functions for the proton at leading order in the chiral expansion.


title: Creativity and Markov Decision Processes

abstract: Creativity is already regularly attributed to AI systems outside specialised computational creativity (CC) communities. However, the evaluation of creativity in AI at large typically lacks grounding in creativity theory, which can promote inappropriate attributions and limit the analysis of creative behaviour. While CC researchers have translated psychological theory into formal models, the value of these models is limited by a gap to common AI frameworks. To mitigate this limitation, we identify formal mappings between Boden's process theory of creativity and Markov Decision Processes (MDPs), using the Creative Systems Framework as a stepping stone. We study three out of eleven mappings in detail to understand which types of creative processes, opportunities for (aberrations), and threats to creativity (uninspiration) could be observed in an MDP. We conclude by discussing quality criteria for the selection of such mappings for future work and applications.


title: Magnetic single wall CrI3 nanotubes encapsulated within multiwall Carbon Nanotubes

abstract: CrI3 is a layered ferromagnetic insulator that has recently attracted enormous interest as it was the first example of a stand-alone monolayer ferromagnet, paving the way towards the study of two-dimensional magnetic materials and their use as building blocks of hybrid van der Waals layered heterostructures. Here we go one step down in the dimensionality ladder and report the synthesis and characterization of a tubular one-dimensional van der Waals heterostructure where CrI3 nanotubes are encapsulated within multiwall carbon nanotubes, integrating a magnetic insulator and a conductor. By means of the capillary filling of multi-wall carbon nanotubes (MWCNT), we obtained single-wall CrI3 nanotubes with diameters ranging between 2 nm and 10 nm, with an average of 5.3 nm. Using aberration corrected electron microscopy in combination with spectroscopic techniques we confirm the structure and chemical composition of the nanotubes. SQUID measurements, combined with element-specific X-ray magnetic circular dichroism (XMCD) indicate unequivocally that the Cr atoms in encapsulated CrI3 nanotubes are magnetic with a collective state compatible with a radial magnetization state predicted both by first-principles calculations and a model Hamiltonian. Our results represent a step forward in establishing 1D van der Waals heterostructures as a playground for the exploration of non-collinear magnetic states arising from the interplay between magnetic anisotropy and curvature in tubular geometries.


title: Compound Mutations in the Abl1 Kinase Cause Inhibitor Resistance by Shifting DFG Flip Mechanisms and Relative State Populations

abstract: The intrinsic dynamics of most proteins are central to their function. Protein tyrosine kinases such as Abl1 undergo significant conformational changes that modulate their activity in response to different stimuli. These conformational changes constitute a conserved mechanism for self-regulation that dramatically impacts kinases' affinities for inhibitors. Few studies have attempted to extensively sample the pathways and elucidate the mechanisms that underlie kinase inactivation. Seeking to bridge this knowledge gap, we present a thorough analysis of the ``DFG flip'' inactivation pathway in Abl1 kinase. By leveraging the power of the Weighted Ensemble methodology, which accelerates sampling without the use of biasing forces, we have comprehensively simulated DFG flip events in Abl1 and its inhibitor-resistant variants, revealing a rugged landscape punctuated by potentially druggable intermediate states. Through our strategy, we successfully simulated dozens of uncorrelated DFG flip events distributed along two principal pathways, identified the molecular mechanisms that govern them, and measured their relative probabilities. Further, we show that the compound Glu255Lys/Val Thr315Ile Abl1 variants owe their inhibitor resistance phenotype to an increase in the free energy barrier associated with completing the DFG flip. This barrier stabilizes Abl1 variants in conformations that can lead to loss of binding for Type-II inhibitors such as Imatinib or Ponatinib. Finally, we contrast our Abl1 observations with the relative state distributions and propensity for undergoing a DFG flip of evolutionarily-related protein tyrosine kinases with diverging Type-II inhibitor binding affinities. Altogether, we expect that our work will be of significant importance for protein tyrosine kinase inhibitor discovery.


title: Mechanical ventilator development during COVID-19 crisis: Preclinical data analysis from porcine bio-model

abstract: This paper describe a mechanical ventilator prototype with preclinical test performed on 10 bioporcine models, where results have shown the capabilities to maintain physiological parameter for each subject under test and present also the capability of monitoring the pulmonary parameters, compliance (C), where this is the unique proposed prototype to present this capability at this extended subject samples.


title: P4Control: Line-Rate Cross-Host Attack Prevention via In-Network Information Flow Control Enabled by Programmable Switches and eBPF

abstract: Modern targeted attacks such as Advanced Persistent Threats use multiple hosts as stepping stones and move laterally across them to gain deeper access to the network. However, existing defenses lack end-to-end information flow visibility across hosts and cannot block cross-host attack traffic in real time. In this paper, we propose P4Control, a network defense system that precisely confines end-to-end information flows in a network and prevents cross-host attacks at line rate. P4Control introduces a novel in-network decentralized information flow control (DIFC) mechanism and is the first work that enforces DIFC at the network level at network line rate. This is achieved through: (1) an in-network primitive based on programmable switches for tracking inter-host information flows and enforcing line-rate DIFC policies; (2) a lightweight eBPF-based primitive deployed on hosts for tracking intra-host information flows. P4Control also provides an expressive policy framework for specifying DIFC policies against different attack scenarios. We conduct extensive evaluations to show that P4Control can effectively prevent cross-host attacks in real time, while maintaining line-rate network performance and imposing minimal overhead on the network and host machines. It is also noteworthy that P4Control can facilitate the realization of a zero trust architecture through its fine-grained least-privilege network access control.


title: Timelike Kasner singularities and Floquet States in 2+1d AdS/CFT

abstract: We consider a model of a holographic 2+1d CFT interacting with an oscillating background gauge field. It is solved by an AdS-Vaidya metric describing Ohmic heating of the boundary field theory. However, we also show that if timelike singularities of Kasner type are permitted then a time independent solution that may be interpreted as a Floquet state of the system can be constructed. In this state the system exhibits either Hall conductivity or kinetic induction, and we numerically evaluate the Kasner exponents for a range of boundary conditions. This model may contribute to the ongoing discussion on the validity and meaning of the Kasner metric in the AdS/CFT correspondence and its application in cosmology.


title: Higher rank series and root puzzles for plumbed 3-manifolds

abstract: For a triple consisting of a weakly negative definite plumbed 3-manifold, a root lattice, and a generalized $\mathrm{Spin}^c$-structure, we construct a family of invariants in the form of a Laurent series. Each series is an invariant of the triple up to orientation preserving homeomorphisms and the action of the Weyl group. We show that there are infinitely many such series for irreducible root lattices of rank at least 2, with each series depending on a solution to a combinatorial puzzle defined on the root lattice. Our series recover certain related series recently defined by Gukov-Pei-Putrov-Vafa, Gukov-Manolescu, Park and Ri as special cases. Explicit computations are given for Brieskorn homology spheres, for which the series may be expressed as modified higher rank false theta functions.


title: Two-Stage ML-Guided Decision Rules for Sequential Decision Making under Uncertainty

abstract: Sequential Decision Making under Uncertainty (SDMU) is ubiquitous in many domains such as energy, finance, and supply chains. Some SDMU applications are naturally modeled as Multistage Stochastic Optimization Problems (MSPs), but the resulting optimizations are notoriously challenging from a computational standpoint. Under assumptions of convexity and stage-wise independence of the uncertainty, the resulting optimization can be solved efficiently using Stochastic Dual Dynamic Programming (SDDP). Two-stage Linear Decision Rules (TS-LDRs) have been proposed to solve MSPs without the stage-wise independence assumption. TS-LDRs are computationally tractable, but using a policy that is a linear function of past observations is typically not suitable for non-convex environments arising, for example, in energy systems. This paper introduces a novel approach, Two-Stage General Decision Rules (TS-GDR), to generalize the policy space beyond linear functions, making them suitable for non-convex environments. TS-GDR is a self-supervised learning algorithm that trains the nonlinear decision rules using stochastic gradient descent (SGD); its forward passes solve the policy implementation optimization problems, and the backward passes leverage duality theory to obtain closed-form gradients. The effectiveness of TS-GDR is demonstrated through an instantiation using Deep Recurrent Neural Networks named Two-Stage Deep Decision Rules (TS-DDR). The method inherits the flexibility and computational performance of Deep Learning methodologies to solve SDMU problems generally tackled through large-scale optimization techniques. Applied to the Long-Term Hydrothermal Dispatch (LTHD) problem using actual power system data from Bolivia, the TS-DDR not only enhances solution quality but also significantly reduces computation times by several orders of magnitude.


title: LOVA3: Learning to Visual Question Answering, Asking and Assessment

abstract: Question answering, asking, and assessment are three innate human traits crucial for understanding the world and acquiring knowledge. By enhancing these capabilities, humans can more effectively utilize data, leading to better comprehension and learning outcomes. However, current Multimodal Large Language Models (MLLMs) primarily focus on question answering, often neglecting the full potential of questioning and assessment skills. In this study, we introduce LOVA3, an innovative framework named ``Learning tO Visual Question Answering, Asking and Assessment,'' designed to equip MLLMs with these additional capabilities. Our approach involves the creation of two supplementary training tasks GenQA and EvalQA, aiming at fostering the skills of asking and assessing questions in the context of images. To develop the questioning ability, we compile a comprehensive set of multimodal foundational tasks. For assessment, we introduce a new benchmark called EvalQABench, comprising 64,000 training samples (split evenly between positive and negative samples) and 5,000 testing samples. We posit that enhancing MLLMs with the capabilities to answer, ask, and assess questions will improve their multimodal comprehension and lead to better performance. We validate our hypothesis by training an MLLM using the LOVA3 framework and testing it on 10 multimodal benchmarks. The results demonstrate consistent performance improvements, thereby confirming the efficacy of our approach.


title: Surveilling the Masses with Wi-Fi-Based Positioning Systems

abstract: Wi-Fi-based Positioning Systems (WPSes) are used by modern mobile devices to learn their position using nearby Wi-Fi access points as landmarks. In this work, we show that Apple's WPS can be abused to create a privacy threat on a global scale. We present an attack that allows an unprivileged attacker to amass a worldwide snapshot of Wi-Fi BSSID geolocations in only a matter of days. Our attack makes few assumptions, merely exploiting the fact that there are relatively few dense regions of allocated MAC address space. Applying this technique over the course of a year, we learned the precise locations of over 2 billion BSSIDs around the world. The privacy implications of such massive datasets become more stark when taken longitudinally, allowing the attacker to track devices' movements. While most Wi-Fi access points do not move for long periods of time, many devices -- like compact travel routers -- are specifically designed to be mobile. We present several case studies that demonstrate the types of attacks on privacy that Apple's WPS enables: We track devices moving in and out of war zones (specifically Ukraine and Gaza), the effects of natural disasters (specifically the fires in Maui), and the possibility of targeted individual tracking by proxy -- all by remotely geolocating wireless access points. We provide recommendations to WPS operators and Wi-Fi access point manufacturers to enhance the privacy of hundreds of millions of users worldwide. Finally, we detail our efforts at responsibly disclosing this privacy vulnerability, and outline some mitigations that Apple and Wi-Fi access point manufacturers have implemented both independently and as a result of our work.


title: Impact of Network Geometry on Large Networks with Intelligent Reflecting Surfaces

abstract: In wireless networks assisted by intelligent reflecting surfaces (IRSs), jointly modeling the signal received over the direct and indirect (reflected) paths is a difficult problem. In this work, we show that the network geometry (locations of serving base station, IRS, and user) can be captured using the so-called triangle parameter $\Delta$. We introduce a decomposition of the effect of the combined link into a signal amplification factor and an effective channel power coefficient $G$. The amplification factor is monotonically increasing with both the number of IRS elements $N$ and $\Delta$. For $G$, since an exact characterization of the distribution seems unfeasible, we propose three approximations depending on the value of the product $N\Delta$ for Nakagami fading and the special case of Rayleigh fading. For two relevant models of IRS placement, we prove that their performance is identical if $\Delta$ is the same given an $N$. We also show that no gains are achieved from IRS deployment if $N$ and $\Delta$ are both small. We further compute bounds on the diversity gain to quantify the channel hardening effect of IRSs. Hence only with a judicious selection of IRS placement and other network parameters, non-trivial gains can be obtained.


title: A Lost Opportunity for Vision-Language Models: A Comparative Study of Online Test-time Adaptation for Vision-Language Models

abstract: In the realm of deep learning, maintaining model robustness against distribution shifts is critical. This paper investigates test-time adaptation strategies for vision-language models, with a specific focus on CLIP and its variants. Through a systematic exploration of prompt-based techniques and existing test-time adaptation methods, the study aims to enhance the adaptability and robustness of vision-language models in diverse real-world scenarios. The investigation includes an analysis of prompt engineering strategies, such as hand-crafted prompts, prompt ensembles, and prompt learning techniques. We introduce a vision-text-space ensemble that significantly boosts the average performance compared to a text-space-only ensemble. Additionally, our comparative study delves into leveraging existing test-time adaptation methods originally designed for image classification tasks. Experimental evaluations conducted across various datasets and model architectures demonstrate the efficacy of different adaptation strategies. We further give insights into the importance of updating the vision encoder and whether it is beneficial to update the text encoder. Code is available at https://github.com/mariodoebler/test-time-adaptation


title: Analog or Digital In-memory Computing? Benchmarking through Quantitative Modeling

abstract: In-Memory Computing (IMC) has emerged as a promising paradigm for energy-efficient, throughput-efficient and area-efficient machine learning at the edge. However, the differences in hardware architectures, array dimensions, and fabrication technologies among published IMC realizations have made it difficult to grasp their relative strengths. Moreover, previous studies have primarily focused on exploring and benchmarking the peak performance of a single IMC macro rather than full system performance on real workloads. This paper aims to address the lack of a quantitative comparison of Analog In-Memory Computing (AIMC) and Digital In-Memory Computing (DIMC) processor architectures. We propose an analytical IMC performance model that is validated against published implementations and integrated into a system-level exploration framework for comprehensive performance assessments on different workloads with varying IMC configurations. Our experiments show that while DIMC generally has higher computational density than AIMC, AIMC with large macro sizes may have better energy efficiency than DIMC on convolutional-layers and pointwise-layers, which can exploit high spatial unrolling. On the other hand, DIMC with small macro size outperforms AIMC on depthwise-layers, which feature limited spatial unrolling opportunities inside a macro.


title: CraftsMan: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refiner

abstract: We present a novel generative 3D modeling system, coined CraftsMan, which can generate high-fidelity 3D geometries with highly varied shapes, regular mesh topologies, and detailed surfaces, and, notably, allows for refining the geometry in an interactive manner. Despite the significant advancements in 3D generation, existing methods still struggle with lengthy optimization processes, irregular mesh topologies, noisy surfaces, and difficulties in accommodating user edits, consequently impeding their widespread adoption and implementation in 3D modeling software. Our work is inspired by the craftsman, who usually roughs out the holistic figure of the work first and elaborates the surface details subsequently. Specifically, we employ a 3D native diffusion model, which operates on latent space learned from latent set-based 3D representations, to generate coarse geometries with regular mesh topology in seconds. In particular, this process takes as input a text prompt or a reference image and leverages a powerful multi-view (MV) diffusion model to generate multiple views of the coarse geometry, which are fed into our MV-conditioned 3D diffusion model for generating the 3D geometry, significantly improving robustness and generalizability. Following that, a normal-based geometry refiner is used to significantly enhance the surface details. This refinement can be performed automatically, or interactively with user-supplied edits. Extensive experiments demonstrate that our method achieves high efficacy in producing superior-quality 3D assets compared to existing methods. HomePage: https://craftsman3d.github.io/, Code: https://github.com/wyysf-98/CraftsMan


title: Active Galactic Nuclei and Host Galaxies in COSMOS-Web. II. First Look at the Kpc-scale Dual and Offset AGN Population

abstract: Kpc-scale dual and offset Active Galactic Nuclei (AGNs) are signposts of accreting supermassive black holes (SMBHs) triggered during late-stage galaxy mergers, offering crucial insights into the coevolution of SMBHs and galaxies. However, robustly confirmed systems at high redshift (e.g., $z>1$) are scarce and biased towards the most luminous and unobscured systems. In this study, we systematically search for kpc-scale (projected separation $<15$ kpc) dual and offset AGNs around 571 moderate-luminosity, X-ray-selected AGNs including the obscured population, utilizing deep HST ACS/F814W and multiband JWST NIRCam imaging from the COSMOS-Web survey. We identify 59 dual and 30 offset AGN candidates in late stage major mergers based on spatially-resolved spectral energy distribution analyses. This translates to $\sim28$ and $\sim10$ bona-fide dual and offset AGNs using a probabilistic pair counting scheme to minimize chance superpositions. Notably, the fraction of dual and offset AGNs among moderate-luminosity ($L_{\rm bol}\sim10^{43}-10^{46}\ \rm erg\ s^{-1}$), obscured AGNs is nearly two orders of magnitude higher than that of the most luminous, unobscured quasar pairs. We find tentative evidence for an increasing pair fraction among AGNs with redshift (from a few percent at $z\sim 0.5$ to $\sim22.9_{-17.7}^{+27.5}\%$ at $z\sim4.5$) and a higher occurrence rate of dual over offset AGNs. There is no pileup of dual/offset AGNs below $\sim 2~{\rm kpc}$ separations. These results generally align with predictions from the ASTRID and Horizon-AGN cosmological simulations when matching sample selection criteria, implying a high probability of both BHs being active simultaneously in late-stage major mergers.


title: MaSS: Multi-attribute Selective Suppression for Utility-preserving Data Transformation from an Information-theoretic Perspective

abstract: The growing richness of large-scale datasets has been crucial in driving the rapid advancement and wide adoption of machine learning technologies. The massive collection and usage of data, however, pose an increasing risk for people's private and sensitive information due to either inadvertent mishandling or malicious exploitation. Besides legislative solutions, many technical approaches have been proposed towards data privacy protection. However, they bear various limitations such as leading to degraded data availability and utility, or relying on heuristics and lacking solid theoretical bases. To overcome these limitations, we propose a formal information-theoretic definition for this utility-preserving privacy protection problem, and design a data-driven learnable data transformation framework that is capable of selectively suppressing sensitive attributes from target datasets while preserving the other useful attributes, regardless of whether or not they are known in advance or explicitly annotated for preservation. We provide rigorous theoretical analyses on the operational bounds for our framework, and carry out comprehensive experimental evaluations using datasets of a variety of modalities, including facial images, voice audio clips, and human activity motion sensor signals. Results demonstrate the effectiveness and generalizability of our method under various configurations on a multitude of tasks.


title: In-context Time Series Predictor

abstract: Recent Transformer-based large language models (LLMs) demonstrate in-context learning ability to perform various functions based solely on the provided context, without updating model parameters. To fully utilize the in-context capabilities in time series forecasting (TSF) problems, unlike previous Transformer-based or LLM-based time series forecasting methods, we reformulate "time series forecasting tasks" as input tokens by constructing a series of (lookback, future) pairs within the tokens. This method aligns more closely with the inherent in-context mechanisms, and is more parameter-efficient without the need of using pre-trained LLM parameters. Furthermore, it addresses issues such as overfitting in existing Transformer-based TSF models, consistently achieving better performance across full-data, few-shot, and zero-shot settings compared to previous architectures.


title: The Solar Origin of an Intense Geomagnetic Storm on 2023 December 1st: Successive Slipping and Eruption of Multiple Magnetic Flux Ropes

abstract: The solar eruption that occurred on 2023 November 28 (SOL2023-11-28) triggered an intense geomagnetic storm on Earth on 2023 December 1. The associated Earth's auroras manifested at the most southern latitudes in the northern hemisphere observed in the past two decades. In order to explore the profound geoeffectiveness of this event, we conducted a comprehensive analysis of its solar origin to offer potential factors contributing to its impact. Magnetic flux ropes (MFRs) are twisted magnetic structures recognized as significant contributors to coronal mass ejections (CMEs), thereby impacting space weather greatly. In this event, we identified multiple MFRs in the solar active region and observed distinct slipping processes of the three MFRs: MFR1, MFR2, and MFR3. All three MFRs exhibit slipping motions at a speed of 40--137 km s$^{-1}$, extending beyond their original locations. Notably, the slipping of MFR2 extends to $\sim$30 Mm and initiate the eruption of MFR3. Ultimately, MFR1's eruption results in an M3.4-class flare and a CME, while MFR2 and MFR3 collectively produce an M9.8-class flare and another halo CME. This study shows the slipping process in a multi-MFR system, showing how one MFR's slipping can trigger the eruption of another MFR. We propose that the CME--CME interactions caused by multiple MFR eruptions may contribute to the significant geoeffectiveness.


title: Lensing Constraints on PBHs: Substellar to Intermediate Masses

abstract: Gravitational microlensing is a robust tool to detect and directly measure the abundance and mass of any kind of compact objects, either in our galaxy or in the extragalatic domain. On basis to generic, broadly applicable arguments, it is concluded that the observed microlensing magnifications are too small and the microlensing events less frequent than the expectations for a significant population of compact objects (other than normal stars). The detection of chromatic effects of microlensing, neither supports the presence of BHs. Detailed statistical studies of the observed microlensing magnifications and events frequency impose strict upper limits to the fraction of total mass of BHs ($\ltsim$ 1\%) from $10^{-7}M_\odot$ to indefinitely large masses. These results hold even when the BHs are distributed according to a mass spectrum or are forming clusters.


title: Implicit degree bias in the link prediction task

abstract: Link prediction -- a task of distinguishing actual hidden edges from random unconnected node pairs -- is one of the quintessential tasks in graph machine learning. Despite being widely accepted as a universal benchmark and a downstream task for representation learning, the validity of the link prediction benchmark itself has been rarely questioned. Here, we show that the common edge sampling procedure in the link prediction task has an implicit bias toward high-degree nodes and produces a highly skewed evaluation that favors methods overly dependent on node degree, to the extent that a ``null'' link prediction method based solely on node degree can yield nearly optimal performance. We propose a degree-corrected link prediction task that offers a more reasonable assessment that aligns better with the performance in the recommendation task. Finally, we demonstrate that the degree-corrected benchmark can more effectively train graph machine-learning models by reducing overfitting to node degrees and facilitating the learning of relevant structures in graphs.


title: Hand bone age estimation using divide and conquer strategy and lightweight convolutional neural networks

abstract: Estimating the Bone Age of children is very important for diagnosing growth defects, and related diseases, and estimating the final height that children reach after maturity. For this reason, it is widely used in different countries. Traditional methods for estimating bone age are performed by comparing atlas images and radiographic images of the left hand, which is time-consuming and error-prone. To estimate bone age using deep neural network models, a lot of research has been done, our effort has been to improve the accuracy and speed of this process by using the introduced approach. After creating and analyzing our initial model, we focused on preprocessing and made the inputs smaller, and increased their quality. we selected small regions of hand radiographs and estimated the age of the bone only according to these regions. by doing this we improved bone age estimation accuracy even further than what was achieved in related works, without increasing the required computational resource. We reached a Mean Absolute Error (MAE) of 3.90 months in the range of 0-20 years and an MAE of 3.84 months in the range of 1-18 years on the RSNA test set.


title: Simultaneous quantum identity authentication scheme utilizing entanglement swapping with secret key preservation

abstract: Unconditional security in quantum key distribution (QKD) relies on authenticating the identities of users involved in key distribution. While classical identity authentication schemes were initially utilized in QKD implementations, concerns regarding their vulnerability have prompted the exploration of quantum identity authentication (QIA) protocols. In this study, we introduce a new protocol for QIA, derived from the concept of controlled secure direct quantum communication. Our proposed scheme facilitates simultaneous authentication between two users, Alice and Bob, leveraging Bell states with the assistance of a third party, Charlie. Through rigorous security analysis, we demonstrate that the proposed protocol withstands various known attacks, including impersonation, intercept and resend and impersonated fraudulent attacks. Additionally, we establish the relevance of the proposed protocol by comparing it with the existing protocols of similar type.


title: CMB lensing and Ly\alpha\ forest cross bispectrum from DESI's first-year quasar sample

abstract: The squeezed cross-bispectrum \bispeconed\ between the gravitational lensing in the Cosmic Microwave Background and the 1D \lya\ forest power spectrum can constrain bias parameters and break degeneracies between $\sigma_8$ and other cosmological parameters. We detect \bispeconed\ with $4.8\sigma$ significance at an effective redshift $z_\mathrm{eff}=2.4$ using Planck PR3 lensing map and over 280,000 quasar spectra from the Dark Energy Spectroscopic Instrument's first-year data. We test our measurement against metal contamination and foregrounds such as Galactic extinction and clusters of galaxies by deprojecting the thermal Sunyaev-Zeldovich effect. We compare our results to a tree-level perturbation theory calculation and find reasonable agreement between the model and measurement.


title: Linearized Boundary Control Method for Density Reconstruction in Acoustic Wave Equations

abstract: We develop a linearized boundary control method for the inverse boundary value problem of determining a density in the acoustic wave equation. The objective is to reconstruct an unknown perturbation in a known background density from the linearized Neumann-to-Dirichlet map. A key ingredient in the derivation is a linearized Blagovescenskii's identity with a free parameter. When the linearization is at a constant background density, we derive two reconstructive algorithms with stability estimates based on the boundary control method. When the linearization is at a non-constant background density, we establish an increasing stability estimate for the recovery of the density perturbation. The proposed reconstruction algorithms are implemented and validated with several numerical experiments to demonstrate the feasibility.


title: Dispersion Modeling in Zero-inflated Tweedie Models with Applications to Insurance Claim Data Analysis

abstract: The Tweedie generalized linear models are commonly applied in the insurance industry to analyze semicontinuous claim data. For better prediction of the aggregated claim size, the mean and dispersion of the Tweedie model are often estimated together using the double generalized linear models. In some actuarial applications, it is common to observe an excessive percentage of zeros, which often results in a decline in the performance of the Tweedie model. The zero-inflated Tweedie model has been recently considered in the literature, which draws inspiration from the zero-inflated Poisson model. In this article, we consider the problem of dispersion modeling of the Tweedie state in the zero-inflated Tweedie model, in addition to the mean modeling. We also model the probability of the zero state based on the generalized expectation-maximization algorithm. To potentially incorporate nonlinear and interaction effects of the covariates, we estimate the mean, dispersion, and zero-state probability using decision-tree-based gradient boosting. We conduct extensive numerical studies to demonstrate the improved performance of our method over existing ones.


title: Dynamically Sharded Ledgers on a Distributed Hash Table

abstract: Distributed ledger technology such as blockchain is considered essential for supporting large numbers of micro-transactions in the Machine Economy, which is envisioned to involve billions of connected heterogeneous and decentralized cyber-physical systems. This stresses the need for performance and scalability of distributed ledger technologies. Sharding divides the blockchain network into multiple committees and is a common approach to improve scalability. However, with current sharding approaches, costly cross-shard verification is needed to prevent double-spending. This paper proposes a novel and more scalable distributed ledger method named ScaleGraph that implements dynamic sharding by using routing and logical proximity concepts from distributed hash tables. ScaleGraph addresses cyber security in terms of integrity, availability, and trust, to support frequent micro-transactions between autonomous devices. Benefits of ScaleGraph include a total storage space complexity of O(t), where t is the global number of transactions (assuming a constant replication degree). This space is sharded over n nodes so that each node needs O(t/n) storage, which provides a high level of concurrency and data localization as compared to other delegated consensus proposals. ScaleGraph allows for a dynamic grouping of validators which are selected based on a distance metric. We analyze the consensus requirements in such a dynamic setting and show that a synchronous consensus protocol allows shards to be smaller than an asynchronous one, and likely yields better performance. Moreover, we provide an experimental analysis of security aspects regarding the required size of the consensus groups with ScaleGraph. Our analysis shows that dynamic sharding based on proximity concepts brings attractive scalability properties in general, especially when the fraction of corrupt nodes is small.


title: Linking In-context Learning in Transformers to Human Episodic Memory

abstract: Understanding the connections between artificial and biological intelligent systems can reveal fundamental principles underlying general intelligence. While many artificial intelligence (AI) models have a neuroscience counterpart, such connections are largely missing in Transformer models and the self-attention mechanism. Here, we examine the relationship between attention heads and human episodic memory. We focus on the induction heads, which contribute to the in-context learning capabilities of Transformer-based large language models (LLMs). We demonstrate that induction heads are behaviorally, functionally, and mechanistically similar to the contextual maintenance and retrieval (CMR) model of human episodic memory. Our analyses of LLMs pre-trained on extensive text data show that CMR-like heads often emerge in the intermediate model layers and that their behavior qualitatively mirrors the memory biases seen in humans. Our findings uncover a parallel between the computational mechanisms of LLMs and human memory, offering valuable insights into both research fields.


title: SoK: A Defense-Oriented Evaluation of Software Supply Chain Security

abstract: The software supply chain comprises a highly complex set of operations, processes, tools, institutions and human factors involved in creating a piece of software. A number of high-profile attacks that exploit a weakness in this complex ecosystem have spurred research in identifying classes of supply chain attacks. Yet, practitioners often lack the necessary information to understand their security posture and implement suitable defenses against these attacks. We argue that the next stage of software supply chain security research and development will benefit greatly from a defense-oriented approach that focuses on holistic bottom-up solutions. To this end, this paper introduces the AStRA model, a framework for representing fundamental software supply chain elements and their causal relationships. Using this model, we identify software supply chain security objectives that are needed to mitigate common attacks and systematize knowledge on recent and well-established security techniques for their ability to meet these objectives. We validate our model against prior attacks and taxonomies. Finally, we identify emergent research gaps and propose opportunities to develop novel software development tools and systems that are secure-by-design.


title: Combining Euclidean Alignment and Data Augmentation for BCI decoding

abstract: Automated classification of electroencephalogram (EEG) signals is complex due to their high dimensionality, non-stationarity, low signal-to-noise ratio, and variability between subjects. Deep neural networks (DNNs) have shown promising results for EEG classification, but the above challenges hinder their performance. Euclidean Alignment (EA) and Data Augmentation (DA) are two promising techniques for improving DNN training by permitting the use of data from multiple subjects, increasing the data, and regularizing the available data. In this paper, we perform a detailed evaluation of the combined use of EA and DA with DNNs for EEG decoding. We trained individual models and shared models with data from multiple subjects and showed that combining EA and DA generates synergies that improve the accuracy of most models and datasets. Also, the shared models combined with fine-tuning benefited the most, with an overall increase of 8.41\% in classification accuracy.


title: Lower Bound on the Greedy Approximation Ratio for Adaptive Submodular Cover

abstract: We show that the greedy algorithm for adaptive-submodular cover has approximation ratio at least 1.3*(1+ln Q). Moreover, the instance demonstrating this gap has Q=1. So, it invalidates a prior result in the paper ``Adaptive Submodularity: A New Approach to Active Learning and Stochastic Optimization'' by Golovin-Krause, that claimed a (1+ln Q)^2 approximation ratio for the same algorithm.


title: Generalized Pseudo-Anosov Maps and Hubbard Trees

abstract: In this project, we develop a new connection between the dynamics of quadratic polynomials on the complex plane and the dynamics of homeomorphisms of surfaces. In particular, given a quadratic polynomial, we investigate whether one can construct an extension of it which is a generalized pseudo-Anosov homeomorphism. Generalized pseudo-Anosov means it preserves a pair of foliations with infinitely many singularities that accumulate on finitely many points. We determine for which quadratic polynomials such an extension exists. The construction is related to the dynamics on the Hubbard tree, which is a forward invariant subset of the filled Julia set containing the critical orbit. We define a type of Hubbard trees, which we call crossing-free, and show that these are precisely the Hubbard trees for which one can construct a generalized pseudo-Anosov map.


title: Metabelian distributions and sub-Riemannian geodesics

abstract: We begin by characterizing metabelian distributions in terms of principal bundle structures. Then, we prove that in sub-Riemannian manifolds with metabelian distributions of rank $r$, the projection of strictly singular trajectories to some $r$-dimensional manifold must remain within an analytic variety. As a consequence, for rank-2 metabelian distributions, geodesics are of class $C^1$.


title: Emergence of Synchronization-Induced Patterns in Two-dimensional Magnetic Rod Systems under Rotating Magnetic Fields

abstract: We investigate the dynamics of two-dimensional assemblies of rod-shaped magnetic colloids under the influence of an external rotating magnetic field. Using Molecular Dynamics, we simulate the formation of patterns that emerge based on the synchronization degree between the magnetic rods and the rotating field. We then explore the structural and dynamic characteristics of the resulting steady states, examining their evolution as a function of changes in the rods' aspect ratio, the strength of the external magnetic field, and its rotation frequency. Three distinct synchronization regimes of the rods with the magnetic field are clearly observed. A detailed set of phase diagrams illustrates the complex relationship between the magnitude of the external magnetic field and its rotation frequency and how these parameters govern the formation of unique self-organized structures.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech physics.comp-ph


title: The Impact of Social Media on Music Demand: Evidence from a Quasi-Natural Experiment

abstract: The digital age has significantly changed how music is consumed, promoted, and monetized. Social media platforms like TikTok are playing a pivotal role in this transformation. This shift has sparked a debate within the music industry: While some stakeholders see social media platforms like TikTok as opportunities to boost songs to viral status, others raise concerns about potential cannibalization effects, fearing that such exposure might reduce revenue from streaming services like Spotify. In this paper, we evaluate the effect of a song's presence - or absence - on social media on its demand on music streaming services using a quasi-natural experiment: Universal Music Group's (UMG) - one of "The Big 3" record labels - decision to remove its entire content library from TikTok in February 2024. We use representative samples covering close to 50% of the US and 94% of the German streaming markets, employing a difference-in-differences approach to compare the streaming consumption of songs that were removed from TikTok with those that were not. We find that UMG's removal of music from TikTok led to a 2-3% increase in streams on audio platforms for affected songs, indicating substitution effects. However, this average treatment effect masks significant heterogeneity: older songs and songs with less promotional support elsewhere saw a decrease in streaming consumption, suggesting that TikTok helps consumers discover or rediscover content that is not top of mind for consumers.


title: Signed representing measures (Berger-type charges) in subnormality and related properties of weighted shifts

abstract: In the study of the geometrically regular weighted shifts (GRWS) -- see [5] -- signed power representing measures (which we call Berger-type charges) played an important role. Motivated by their utility in that context, we establish a general theory for Berger-type charges. We give the first result of which we are aware showing that k-hyponormality alone (as opposed to subnormality) yields measure/charge-related information. More precisely, for signed countably atomic measures with a decreasing sequence of atoms we prove that k-hyponormality of the associated shift forces positivity of the densities of the largest k+1 atoms. Further, for certain completely hyperexpansive weighed shifts, we exhibit a Berger-type charge representation, in contrast (but related) to the classical L\'{e}vy-Khinchin representation. We use Berger-type charges to investigate when a non-subnormal GRWS weighted shift may be scaled to become conditionally positive definite, and close with an example indicating a distinction between the study of moment sequences and the study of weighted shifts.


title: On Concatenations of Two $ k $-Generalized Fibonacci Numbers

abstract: Let $ k \geq 2 $ be an integer. The $ k- $generalized Fibonacci sequence is a sequence defined by the recurrence relation $ F_{n}^{(k)}=F_{n-1}^{(k)} + \cdots + F_{n-k}^{(k)}$ for all $ n \geq 2$ with the initial values $ F_{i}^{(k)}=0 $ for $ i=2-k, \ldots, 0 $ and $ F_{1}^{(k)}=1.$ In 2020, Banks and Luca, among other things, determined all Fibonacci numbers which are concatenations of two Fibonacci numbers. In this paper, we consider the analogue of this problem by taking into account $ k-$generalized Fibonacci numbers as concatenations of two terms of the same sequence. We completely solve this problem for all $ k \geq 3.


title: Private Regression via Data-Dependent Sufficient Statistic Perturbation

abstract: Sufficient statistic perturbation (SSP) is a widely used method for differentially private linear regression. SSP adopts a data-independent approach where privacy noise from a simple distribution is added to sufficient statistics. However, sufficient statistics can often be expressed as linear queries and better approximated by data-dependent mechanisms. In this paper we introduce data-dependent SSP for linear regression based on post-processing privately released marginals, and find that it outperforms state-of-the-art data-independent SSP. We extend this result to logistic regression by developing an approximate objective that can be expressed in terms of sufficient statistics, resulting in a novel and highly competitive SSP approach for logistic regression. We also make a connection to synthetic data for machine learning: for models with sufficient statistics, training on synthetic data corresponds to data-dependent SSP, with the overall utility determined by how well the mechanism answers these linear queries.


title: A Bayesian Approach to GRAPPA Parallel FMRI Image Reconstruction Increases SNR and Power of Task Detection

abstract: In fMRI, capturing brain activation during a task is dependent on how quickly k-space arrays are obtained. Acquiring full k-space arrays, which are reconstructed into images using the inverse Fourier transform (IFT), that make up volume images can take a considerable amount of scan time. Under-sampling k-space reduces the acquisition time, but results in aliased, or "folded," images. GeneRalized Autocalibrating Partial Parallel Acquisition (GRAPPA) is a parallel imaging technique that yields full images from subsampled arrays of k-space. GRAPPA uses localized interpolation weights, which are estimated per-scan and fixed over time, to fill in the missing spatial frequencies of the subsampled k-space. Hence, we propose a Bayesian approach to GRAPPA (BGRAPPA) where space measurement uncertainty are assessed from the a priori calibration k-space arrays. The prior information is utilized to estimate the missing spatial frequency values from the posterior distribution and reconstruct into full field-of-view images. Our BGRAPPA technique successfully reconstructed both a simulated and experimental single slice image with less artifacts, reduced noise leading to an increased signal-to-noise ratio (SNR), and stronger power of task detection.


title: On induced subgraphs of $H(n,3)$ with maximum degree $1$

abstract: In this paper, we consider induced subgraphs of the Hamming graph $H(n,3)$. We show that if $U \subseteq \mathbb{Z}_3^n$ and $U$ induces a subgraph of $H(n,3)$ with maximum degree at most $1$ then 1. If $U$ is disjoint from a maximum size independent set of $H(n,3)$ then $|U| \leq 3^{n-1}+1$. Moreover, all such $U$ with size $3^{n-1}+1$ are isomorphic to each other. 2. For $n \geq 6$, there exists such a $U$ with size $|U| = 3^{n-1}+18$ and this is optimal for $n = 6$. 3. If $U \cap \{x, x+e_1, x+2e_1\} \ne \phi$ for all $x \in \mathbb{Z}_3^n$ then $|U| \leq 3^{n-1} + 729$.


title: ReachBot Field Tests in a Mojave Desert Lava Tube as a Martian Analog

abstract: ReachBot is a robot concept for the planetary exploration of caves and lava tubes, which are often inaccessible with traditional robot locomotion methods. It uses extendable booms as appendages, with grippers mounted at the end, to grasp irregular rock surfaces and traverse these difficult terrains. We have built a partial ReachBot prototype consisting of a single boom and gripper, mounted on a tripod. We present the details on the design and field test of this partial ReachBot prototype in a lava tube in the Mojave Desert. The technical requirements of the field testing, implementation details, and grasp performance results are discussed. The planning and preparation of the field test and lessons learned are also given.


title: Path-metrics, pruning, and generalization

abstract: Analyzing the behavior of ReLU neural networks often hinges on understanding the relationships between their parameters and the functions they implement. This paper proves a new bound on function distances in terms of the so-called path-metrics of the parameters. Since this bound is intrinsically invariant with respect to the rescaling symmetries of the networks, it sharpens previously known bounds. It is also, to the best of our knowledge, the first bound of its kind that is broadly applicable to modern networks such as ResNets, VGGs, U-nets, and many more. In contexts such as network pruning and quantization, the proposed path-metrics can be efficiently computed using only two forward passes. Besides its intrinsic theoretical interest, the bound yields not only novel theoretical generalization bounds, but also a promising proof of concept for rescaling-invariant pruning.


title: RE-Adapt: Reverse Engineered Adaptation of Large Language Models

abstract: We introduce RE-Adapt, an approach to fine-tuning large language models on new domains without degrading any pre-existing instruction-tuning. We reverse engineer an adapter which isolates what an instruction-tuned model has learned beyond its corresponding pretrained base model. Importantly, this requires no additional data or training. We can then fine-tune the base model on a new domain and readapt it to instruction following with the reverse engineered adapter. RE-Adapt and our low-rank variant LoRE-Adapt both outperform other methods of fine-tuning, across multiple popular LLMs and datasets, even when the models are used in conjunction with retrieval-augmented generation.


title: An Empirical Study on the Characteristics of Database Access Bugs in Java Applications

abstract: Database-backed applications rely on the database access code to interact with the underlying database management systems (DBMSs). Although many prior studies aim at database access issues like SQL anti-patterns or SQL code smells, there is a lack of study of database access bugs during the maintenance of database-backed applications. In this paper, we empirically investigate 423 database access bugs collected from seven large-scale Java open source applications that use relational database management systems (e.g., MySQL or PostgreSQL). We study the characteristics (e.g., occurrence and root causes) of the bugs by manually examining the bug reports and commit histories. We find that the number of reported database and non-database access bugs share a similar trend but their modified files in bug fixing commits are different. Additionally, we generalize categories of the root causes of database access bugs, containing five main categories (SQL queries, Schema, API, Configuration, SQL query result) and 25 unique root causes. We find that the bugs pertaining to SQL queries, Schema, and API cover 84.2% of database access bugs across all studied applications. In particular, SQL queries bug (54%) and API bug (38.7%) are the most frequent issues when using JDBC and Hibernate, respectively. Finally, we provide a discussion on the implications of our findings for developers and researchers.


title: Spectral radii for subsets of Hilbert $C^*$-modules and spectral properties of positive maps

abstract: The notions of joint and outer spectral radii are extended to the setting of Hilbert $C^*$-bimodules. A Rota-Strang type characterisation is proved for the joint spectral radius. In this general setting, an approximation result for the joint spectral radius in terms of the outer spectral radius has been established. This work leads to a new proof of the Wielandt-Friedland's formula for the spectral radius of positive maps. Following an idea of J. E. Pascoe, a positive map called the maximal part has been associated to any positive map with non-zero spectral radius, on finite dimensional $C^*$-algebras. This provides a constructive treatment of the Perron-Frobenius theorem. It is seen that the maximal part of a completely positive map has a very simple structure and it is irreducible if and only if the original map is irreducible. It is observed that algebras generated by tuples of matrices can be determined and their dimensions can be computed by realizing them as linear span of Choi-Kraus coefficients of some easily computable completely positive maps.


title: Polyak Meets Parameter-free Clipped Gradient Descent

abstract: Gradient descent and its variants are de facto standard algorithms for training machine learning models. As gradient descent is sensitive to its hyperparameters, we need to tune the hyperparameters carefully using a grid search, but it is time-consuming, especially when multiple hyperparameters exist. Recently, parameter-free methods that adjust the hyperparameters on the fly have been studied. However, the existing work only studied parameter-free methods for the stepsize, and parameter-free methods for other hyperparameters have not been explored. For instance, the gradient clipping threshold is also a crucial hyperparameter in addition to the stepsize to prevent gradient explosion issues, but none of the existing studies investigated the parameter-free methods for clipped gradient descent. In this work, we study the parameter-free methods for clipped gradient descent. Specifically, we propose Inexact Polyak Stepsize, which converges to the optimal solution without any hyperparameters tuning, and its convergence rate is asymptotically independent of L under L-smooth and $(L_0, L_1)$-smooth assumptions of the loss function as that of clipped gradient descent with well-tuned hyperparameters. We numerically validated our convergence results using a synthetic function and demonstrated the effectiveness of our proposed methods using LSTM, Nano-GPT, and T5.