title: The properties of AGN in dwarf galaxies identified via SED fitting

abstract: Given their dominance of the galaxy number density, dwarf galaxies are central to our understanding of galaxy formation. While the incidence of AGN and their impact on galaxy evolution has been extensively studied in massive galaxies, much less is known about the role of AGN in the evolution of dwarfs. We search for radiatively-efficient AGN in the nearby (0.1 < z < 0.3) dwarf (10^8 MSun < M < 10^10 MSun) population, using SED fitting (via Prospector) applied to deep ultraviolet to mid-infrared photometry of 508 dwarf galaxies. Around a third (32 +/- 2 per cent) of our dwarfs show signs of AGN activity. We compare the properties of our dwarf AGN to control samples, constructed from non-AGN, which have the same distributions of redshift and stellar mass as their AGN counterparts. KS tests between the AGN and control distributions indicates that the AGN do not show differences in their distances to nodes, filaments and nearby massive galaxies from their control counterparts. This indicates that AGN triggering in the dwarf regime is not strongly correlated with local environment. The fraction of AGN hosts with early-type morphology and those that are interacting are also indistinguishable from the controls within the uncertainties, suggesting that interactions do not play a significant role in inducing AGN activity in our sample. Finally, the star formation activity in dwarf AGN is only slightly lower than that in their control counterparts, suggesting that the presence of radiatively-efficient AGN does not lead to significant, prompt quenching of star formation in these systems.


title: Lepton Collider as a window to Reheating

abstract: We propose a search strategy for MeV-scale feebly interacting massive particle (FIMP) dark matter (DM) at the $e^+e^-$ collider. We argue, detection of a mono-$\gamma$ signal plus missing energy can indicate to an MeV-scale reheating temperature of the Universe, after addressing observed DM abundance and other relevant constraints.


title: Dualities and Categorical Structures from 2D Up

abstract: The present work consists of the author's PhD Thesis. For the official version, submitted for dissertation in January 2024, please see https://www.repository.cam.ac.uk/items/1b4cfbcf-7fcf-415d-a252-ba60f7586899

categories: hep-th math-ph math.AG math.CT math.MP math.QA


title: Be careful in multi-messenger inference of the Hubble constant: A path forward for robust inference

abstract: Multi-messenger observations of coalescing binary neutron stars (BNSs) are a direct probe of the expansion history of the universe and carry the potential to shed light on the disparity between low- and high-redshift measurements of the Hubble constant $H_0$. To measure the value of $H_0$ with such observations requires pristine inference of the luminosity distance and the true source redshift with minimal impact from systematics. In this analysis, we carry out joint inference on mock gravitational wave (GW) signals and their electromagnetic (EM) afterglows from BNS coalescences and find that the inclination angle inferred from the afterglow light curve and apparent superluminal motion can be precise, but need not be accurate and is subject to systematic uncertainty that could be as large as $1.5\sigma$. This produces a disparity between the EM and GW inferred inclination angles, which if not carefully treated when combining observations can bias the inferred value of $H_0$. We also find that already small misalignments of $3^{\circ}-6^{\circ}$ between the inherent system inclinations for the GW and EM emission can bias the inference by $\mathcal{O}(1-2\sigma)$ if not taken into account. As multi-messenger BNS observations are rare, we must make the most out of a small number of events and harness the increased precision, while avoiding reduced accuracy. We demonstrate how to mitigate these potential sources of bias by jointly inferring the mismatch between the GW- and EM-based inclination angles and $H_0$.


title: Weak-Lensing Shear-Selected Galaxy Clusters from the Hyper Suprime-Cam Subaru Strategic Program: I. Cluster Catalog, Selection Function and Mass--Observable Relation

abstract: We present the first step towards deriving cosmological constraints through the abundances of galaxy clusters selected in a $510\,\mathrm{deg}^2$ weak-lensing aperture mass map, constructed with the Year-Three shear catalog from the Hyper Suprime-Cam Subaru Strategic Program. We adopt a conservative source galaxy selection to construct a sample of $129$ weak-lensing peaks with a signal-to-noise ratio above $4.7$. We use semi-analytical injection simulations to derive the selection function and the mass--observable relation of our sample. These results take into account complicated uncertainties associated with weak-lensing measurements, such as the non-uniform survey depth and the complex survey geometry, projection effects from uncorrelated large-scale structures, and the intrinsic alignment of source galaxies. We also propose a novel modeling framework to make parts of the mass--observable relation insensitive to assumed cosmological parameters. Such a framework not only offers a great computational advantage to cosmological studies, but can also benefit future astrophysical studies using shear-selected clusters. Our results are an important step towards utilizing these cluster samples that are constructed nearly independent of any baryonic assumptions in upcoming deep-and-wide lensing surveys from the Vera Rubin Observatory, Euclid, and the Nancy Grace Roman Space Telescope.


title: Elf autoencoder: unsupervised exploration of flat-band materials using electronic band structure fingerprints

abstract: Two-dimensional materials with flat electronic bands are promising for realizing exotic quantum phenomena such as unconventional superconductivity and nontrivial topology, but exploring their vast chemical space remains challenging. Here, we introduce an unsupervised convolutional autoencoder agent (elf) that operates on electronic band structure images and is capable of mapping band features and extracting the latent space representation as a fingerprint, enabling autonomous clustering of materials with common electronic properties beyond traditional chemical paradigms. Unsupervised visualisation of the latent space then helps to uncover hidden chemical trends and identify promising candidates based on similarities to well-studied exemplars. Our framework paves the way for the accelerated discovery of novel flat-band materials with desirable electronic characteristics. It complements high-throughput ab initio methods by rapidly screening candidates and guides further investigations into the mechanisms governing the emergence of flat-band physics. We believe the elf autoencoder will be a valuable tool for the autonomous discovery of previously unexplored flat-band materials, aiding in the unbiased identification of compounds with desirable electronic properties in vast 2D chemical space.


title: [OIII] emission in z=2 quasars with and without Broad Absorption Lines

abstract: Understanding the links between different phases of outflows from active galactic nuclei is a key goal in extragalactic astrophysics. Here we compare [OIII] $\lambda\lambda$4960,5008 outflow signatures in quasars with and without Broad Absorption Lines (BALs), aiming to test how the broad absorption troughs seen in the rest-frame ultraviolet are linked to the narrow line region outflows seen in the rest-frame optical. We present new near-infrared spectra from Magellan/FIRE which cover [OIII] in 12 quasars with 2.1 < z < 2.3, selected to have strong outflow signatures in CIV $\lambda$1550. Combining with data from the literature, we build a sample of 73 BAL, 115 miniBAL and 125 non-BAL QSOs with 1.5 < z < 2.6. The strength and velocity width of [OIII] correlate strongly with the CIV emission properties, but no significant difference is seen in the [OIII] emission-line properties between the BALs, non-BALs and miniBALs once the dependence on CIV emission is taken into account. A weak correlation is observed between the velocities of CIV BALs and [OIII] emission, which is accounted for by the fact that both outflow signatures correlate with the underlying CIV emission properties. Our results add to the growing evidence that BALs and non-BALs are drawn from the same parent population and are consistent with a scenario wherein BAL troughs are intermittent tracers of persistent quasar outflows, with a part of such outflow becoming optically thick along our line-of-sight for sporadic periods of time within which BALs are observed.


title: Probing quantum chaos through singular-value correlations in sparse non-Hermitian SYK model

abstract: Utilizing singular value decomposition, our investigation focuses on the spectrum of the singular values within a sparse non-Hermitian Sachdev-Ye-Kitaev (SYK) model. Unlike the complex eigenvalues typical of non-Hermitian systems, singular values are inherently real and positive. Our findings reveal a congruence between the statistics of singular values and those of the analogous Hermitian Gaussian ensembles. An increase in sparsity results in the non-Hermitian SYK model deviating from its chaotic behavior, a phenomenon precisely captured by the singular value ratios. Our analysis of the singular form factor ({\upsigma}FF), analogous to the spectral form factor (SFF) indicates the disappearance of the linear ramp with increased sparsity. Additionally, we define singular complexity, inspired by the spectral complexity in Hermitian systems, whose saturation provides a critical threshold of sparseness. Such disintegration is likely associated with the breakdown of the existing holographic dual for non-Hermitian systems.

categories: quant-ph cond-mat.dis-nn cond-mat.str-el hep-th


title: Weak-lensing Shear-selected Galaxy Clusters from the Hyper Suprime-Cam Subaru Strategic Program: II. Cosmological Constraints from the Cluster Abundance

abstract: We present cosmological constraints using the abundance of weak-lensing shear-selected galaxy clusters in the Hyper Suprime-Cam (HSC) Subaru Strategic Program. The clusters are selected on the mass maps constructed using the three-year (Y3) weak-lensing data with an area of $\approx500~$deg$^2$, resulting in a sample size of $129$ clusters with high signal-to-noise ratios $\nu$ of $\nu\geq4.7$. Owing to the deep, wide-field, and uniform imaging of the HSC survey, this is by far the largest sample of shear-selected clusters, in which the selection solely depends on gravity and is free from any assumptions about the dynamical state. Informed by the optical counterparts, the shear-selected clusters span a redshift range of $z\lesssim0.7$ with a median of $z\approx0.3$. The lensing sources are securely selected at $z\gtrsim0.7$ with a median of $z\approx1.3$, leading to nearly zero cluster member contamination. We carefully account for (1) the bias in the photometric redshift of sources, (2) the bias and scatter in the weak-lensing mass using a simulation-based calibration, and (3) the measurement uncertainty that is directly estimated on the mass maps using an injection-based method developed in a companion paper (Chen et al. submitted). In a blind analysis, the fully marginalized posteriors of the cosmological parameters are obtained as $\Omega_{\mathrm{m}} = 0.50^{+0.28}_{-0.24}$, $\sigma_8 = 0.685^{+0.161}_{-0.088}$, $\hat{S}_{8}\equiv\sigma_8\left(\Omega_{\mathrm{m}}/0.3\right)^{0.25} = 0.835^{+0.041}_{-0.044}$, and $\sigma_8\sqrt{\Omega_{\mathrm{m}}/0.3} = 0.993^{+0.084}_{-0.126}$ in a flat $\Lambda$CDM model. We compare our cosmological constraints with other studies, including those based on cluster abundances, galaxy-galaxy lensing and clustering, and Cosmic Microwave Background observed by $Planck$, and find good agreement at levels of $\lesssim2\sigma$. [abridged]


title: Cavity QED materials: Comparison and validation of two linear response theories at arbitrary light-matter coupling strengths

abstract: We develop a linear response theory for materials collectively coupled to a cavity that is valid in all regimes of light-matter coupling, including symmetry-broken phases. We present and compare two different approaches. First, using a coherent path integral formulation for the partition function to obtain thermal Green functions. This approach relies on a saddle point expansion for the action, that can be truncated in the thermodynamic limit. Second, by formulating the equations of motion for the retarded Green functions and solving them. We use a mean-field decoupling of high-order Green functions in order to obtain a closed, solvable system of equations. Both approaches yield identical results in the calculation of response functions for the cavity and material. These are obtained in terms of the bare cavity and material responses. In combination, the two techniques clarify the validity of a mean-field decoupling in correlated light-matter systems and provide complementary means to compute finite-size corrections to the thermodynamic limit. The theory is formulated for a general model that encompasses most of the systems typically considered in the field of cavity QED materials, within a long-wavelength approximation. Finally, we provide a detailed application of the theory to the Quantum Hall effect and to a collection of magnetic models. We validate our predictions against analytical and finite-size exact-diagonalization results.


title: Mapping the Inner 0.1 pc of a Supermassive Black Hole Environment with the Tidal Disruption Event and Extreme Coronal Line Emitter AT 2022upj

abstract: Extreme coronal line emitters (ECLEs) are objects showing transient high-ionization lines in the centers of galaxies. They have been attributed to echoes of high-energy flares of ionizing radiation, such as those produced by tidal disruption events (TDEs), but have only recently been observed within hundreds of days after an optical transient was detected. AT 2022upj is a nuclear UV-optical flare at z=0.054 with spectra showing [Fe X] {\lambda}6375 and [Fe XIV] {\lambda}5303 during the optical peak, the earliest presence of extreme coronal lines during an ongoing transient. AT 2022upj is also the second ever ECLE (and first with a concurrent flare) to show broad He II {\lambda}4686 emission, a key signature of optical/UV TDEs. We also detect X-ray emission during the optical transient phase, which may be related to the source of ionizing photons for the extreme coronal lines. Finally, we analyze the spectroscopic evolution of each emission line and find that [Fe X] and [Fe XIV] weaken within 400d of optical peak, while [Fe VII] {\lambda}5720, [Fe VII] {\lambda}6087, and [O III] {\lambda}{\lambda}4959,5007 emerge over the same period. The velocities of the iron lines indicate circumnuclear gas within 0.1pc of the central supermassive black hole (SMBH), while a dust echo inferred from NEOWISE data indicates that circumnuclear dust lies at a minimum of 0.4pc away, providing evidence of stratified material around a SMBH. AT 2022upj is the first confirmed ECLE-TDE with clear signatures of both classes. This event's spectroscopic evolution on a $\sim$year unveils the impact of highly energetic flares such as TDEs on the complex environments around SMBHs.


title: Density Fluctuations in the Intracluster Medium: An Attempt to Constrain Viscosity with Cosmological Simulations

abstract: The impact of viscosity in the Intracluster Medium (ICM) is still an open question in astrophysics. To address this problem, we have run a set of cosmological simulations of three galaxy clusters with a mass larger than $M_{\mathrm{Vir}} > 10^{15} $M$_{\odot}$ at $z=0$ using the SPMHD-code OpenGadget3. We aim to quantify the influence of viscosity and constrain its value in the ICM. Our results show significant morphological differences at small scales, temperature variations, and density fluctuations induced by viscosity. We observe a suppression of instabilities at small scales, resulting in a more filamentary structure and a larger amount of small structures due to the lack of mixing with the medium. The conversion from kinetic to internal energy leads to an increase of the virial temperature of the cluster of $\sim$5% - 10%, while the denser regions remain cold. The amplitude of density fluctuations is found to increase with viscosity, as well as the velocity fluctuations. However, comparison with observational data indicates consistency with observed density fluctuations, challenging the direct constraint of viscosity solely through density fluctuations. Furthermore, the ratio of density to velocity fluctuations remains close to 1 regardless of the amount of viscosity, in agreement with the theoretical expectations. Our results show for the first time in a cosmological simulation of a galaxy cluster the effect of viscosity in the ICM, a study that is currently missing in the literature.


title: Operator-based quantum thermodynamic uncertainty relations

abstract: The Heisenberg uncertainty relation, which links the uncertainties of the position and momentum of a particle, has an important footprint on the quantum behavior of a physical system. Motivated by this principle, we propose that thermodynamic currents associated with work, heat, and internal energy are described by well-defined Hermitian operators; i.e., we associate physical observables to quantum thermodynamic flows. First, we show that, in principle, it is possible to perform single-point measurements to compute average thermodynamic rates. These rates, or currents, differ from their classical counterparts due to the non-commutativity of the corresponding operators. Using the Robertson-Schr\"odinger uncertainty relation, we then obtain various thermodynamic uncertainty relationships between them. In particular, we connect the fluctuations in heat rate and thermodynamic power with those in internal energy. We further illustrate this approach by applying it to quantum batteries, where we derive an energy-power uncertainty relationship and show how measurements affect the fluctuations.


title: Uncovering sequence diversity from a known protein structure

abstract: We present InvMSAFold, a method for generating a diverse set of protein sequences that fold into a single structure. For a given structure, InvMSAFold defines a probability distribution over the space of sequences, capturing the amino acid covariances observed in Multiple Sequence Alignments (MSA) of homologous proteins. This allows for the generation of highly diverse protein sequences while preserving structural and functional integrity. We show that the higher diversity of sampled sequences translates into higher diversity in biochemical properties, pointing to exciting prospects for the applicability of our method in fields like protein design by providing diverse starting points.


title: Inevitable First Order Phase Transitions in 3D Quantum Hall Systems

abstract: Recent experiments suggest that low carrier density three-dimensional (3D) metals ZrTe$_5$ and HfTe$_5$ exhibit the 3D quantum Hall (QH) effect with Hall resistivity plateaus and a metal-insulator transition in strong magnetic fields. The conventional 3D QH theory requires a fixed period charge density wave (CDW), which is however not observed experimentally. We investigate alternative non-CDW mechanisms by considering a 3D metal in strong magnetic fields with electrons coupled to a boson (e.g., phonon) field. We show that the model exhibits inevitable first order phase transitions at jumps of the number of occupied Landau level bands, which do not involve CDW. These transitions may drive the system into a phase separation state with percolation transitions. We further show this can lead to Hall resistivity quasi-plateaus similar to that observed experimentally, and can provide a natural explanation for the metal-insulator transition.


title: Reframing linguistic bootstrapping as joint inference using visually-grounded grammar induction models

abstract: Semantic and syntactic bootstrapping posit that children use their prior knowledge of one linguistic domain, say syntactic relations, to help later acquire another, such as the meanings of new words. Empirical results supporting both theories may tempt us to believe that these are different learning strategies, where one may precede the other. Here, we argue that they are instead both contingent on a more general learning strategy for language acquisition: joint learning. Using a series of neural visually-grounded grammar induction models, we demonstrate that both syntactic and semantic bootstrapping effects are strongest when syntax and semantics are learnt simultaneously. Joint learning results in better grammar induction, realistic lexical category learning, and better interpretations of novel sentence and verb meanings. Joint learning makes language acquisition easier for learners by mutually constraining the hypotheses spaces for both syntax and semantics. Studying the dynamics of joint inference over many input sources and modalities represents an important new direction for language modeling and learning research in both cognitive sciences and AI, as it may help us explain how language can be acquired in more constrained learning settings.


title: Dialogue Action Tokens: Steering Language Models in Goal-Directed Dialogue with a Multi-Turn Planner

abstract: We present an approach called Dialogue Action Tokens (DAT) that adapts language model agents to plan goal-directed dialogues. The core idea is to treat each utterance as an action, thereby converting dialogues into games where existing approaches such as reinforcement learning can be applied. Specifically, we freeze a pretrained language model and train a small planner model that predicts a continuous action vector, used for controlled generation in each round. This design avoids the problem of language degradation under reward optimization. When evaluated on the Sotopia platform for social simulations, the DAT-steered LLaMA model surpasses GPT-4's performance. We also apply DAT to steer an attacker language model in a novel multi-turn red-teaming setting, revealing a potential new attack surface.


title: Constrained dynamics and confinement in the two-dimensional quantum Ising model

abstract: We investigate the dynamics of the quantum Ising model on two-dimensional square lattices up to $16 \times 16$ spins. In the ordered phase, the model is predicted to exhibit dynamically constrained dynamics, leading to confinement of elementary excitations and slow thermalization. After demonstrating the signatures of confinement, we probe the dynamics of interfaces in the constrained regime through sudden quenches of product states with domains of opposite magnetization. We find that the nature of excitations can be captured by perturbation theory throughout the confining regime, and identify the crossover to the deconfining regime. We systematically explore the effect of the transverse field on the modes propagating along flat interfaces and investigate the crossover from resonant to diffusive melting of a square of flipped spins embedded in a larger lattice.


title: Prompt Design Matters for Computational Social Science Tasks but in Unpredictable Ways

abstract: Manually annotating data for computational social science tasks can be costly, time-consuming, and emotionally draining. While recent work suggests that LLMs can perform such annotation tasks in zero-shot settings, little is known about how prompt design impacts LLMs' compliance and accuracy. We conduct a large-scale multi-prompt experiment to test how model selection (ChatGPT, PaLM2, and Falcon7b) and prompt design features (definition inclusion, output type, explanation, and prompt length) impact the compliance and accuracy of LLM-generated annotations on four CSS tasks (toxicity, sentiment, rumor stance, and news frames). Our results show that LLM compliance and accuracy are highly prompt-dependent. For instance, prompting for numerical scores instead of labels reduces all LLMs' compliance and accuracy. The overall best prompting setup is task-dependent, and minor prompt changes can cause large changes in the distribution of generated labels. By showing that prompt design significantly impacts the quality and distribution of LLM-generated annotations, this work serves as both a warning and practical guide for researchers and practitioners.


title: Quiescent black hole X-ray binaries as multi-messenger sources

abstract: Galactic cosmic rays (CRs) are of unknown origin, even though they have traditionally been connected to supernovae due to energetic arguments. In the last decades, Galactic black holes in X-ray binaries (BHXBs) have been proposed as candidate sources of CRs revising the CR paradigm. BHXBs launch two relativistic jets during outbursts, but recent observations suggest that such jets may be launched even during quiescence. A0620-00 is such a well-studied object that shows hints of jet emission. In this work, we study the simultaneous radio-to-X-ray spectrum detected from this source while in quiescence to better constrain the jet dynamics. Given that the majority of BHXBs spend their lifetime in quiescence (qBHXBs), we use the jet dynamics of A0620-00 to study a population of 100000 such sources distributed throughout the Galactic disc, and a further 10000 located in the Boxy Bulge around the Galactic centre. While the contribution to the CR spectrum is suppressed, we find that the cumulative intrinsic emission of qBHXBs from both the Boxy Bulge and the Galactic disc adds to the diffuse emission that various facilities detect from radio to TeV gamma rays. We examine the contribution of qBHXBs to the Galactic diffuse emission and investigate the possibility of SKA, INTEGRAL and CTAO to detect individual sources in the future. Finally, we compare the predicted neutrino flux to the recently presented Galactic diffuse neutrino emission by IceCube.


title: Nonlinear photocurrent in quantum materials for broadband photodetection

abstract: Unlocking the vast potential of optical sensing technology has long been hindered by the challenges of achieving fast, sensitive, and broadband photodetection at ambient temperatures. In this review, we summarize recent progress in the study of nonlinear photocurrent in topological quantum materials, and its application in broadband photodetection without the use of p-n junction based semiconductor diodes. The intrinsic quadratic transverse current-input voltage relation is used to rectify the alternating electric field from incident radio, terahertz or infrared waves into a direct current, without a bias voltage and at zero magnetic field. We review novel photocurrents in several material systems, including topological Weyl semimetals, chiral crystals, ferroelectric materials, and low dimensional topological insulators. These quantum materials hold tremendous promise for broadband high-frequency rectification and photodetection, featuring substantial responsivity and detectivity.


title: SDSS1335+0728: The awakening of a $\sim 10^6 M_{\odot}$ black hole

abstract: The galaxy SDSS1335+0728, which had exhibited no prior optical variations during the preceding two decades, began showing significant nuclear variability in the Zwicky Transient Facility (ZTF) alert stream from December 2019 (as ZTF19acnskyy). Its behaviour suggests that SDSS1335+0728 hosts a $\sim 10^6 M_{\odot}$ black hole (BH) that is currently in the process of `turning on'. We present a multi-wavelength photometric analysis and spectroscopic follow-up performed with the aim of better understanding the origin of the nuclear variations detected in SDSS1335+0728. We used archival photometry and spectroscopic data to study the state of SDSS1335+0728 prior to December 2019, and new observations from Swift, SOAR/Goodman, VLT/X-shooter, and Keck/LRIS taken after its turn-on to characterise its current state. We find that: (a) since 2021, the UV flux is four times brighter than the flux reported by GALEX in 2004; (b) since June 2022, the mid-infrared flux has risen more than two times, and the W1-W2 WISE colour has become redder; (c) since February 2024, the source has begun showing X-ray emission; (d) the narrow emission line ratios are now consistent with a more energetic ionising continuum; (e) broad emission lines are not detected; and (f) the [OIII] line increased its flux $\sim 3.6$ years after the first ZTF alert, which implies a relatively compact narrow-line-emitting region. We conclude that the variations observed in SDSS1335+0728 could be either explained by an AGN that is just turning on or by an exotic tidal disruption event (TDE). If the former is true, SDSS1335+0728 is one of the strongest cases of an AGN observed in the process of activating. If the latter, it would correspond to the longest and faintest TDE ever observed (or another class of still unknown nuclear transient). Future observations of SDSS1335+0728 are crucial to further understand its behaviour.


title: Online Pareto-Optimal Decision-Making for Complex Tasks using Active Inference

abstract: When a robot autonomously performs a complex task, it frequently must balance competing objectives while maintaining safety. This becomes more difficult in uncertain environments with stochastic outcomes. Enhancing transparency in the robot's behavior and aligning with user preferences are also crucial. This paper introduces a novel framework for multi-objective reinforcement learning that ensures safe task execution, optimizes trade-offs between objectives, and adheres to user preferences. The framework has two main layers: a multi-objective task planner and a high-level selector. The planning layer generates a set of optimal trade-off plans that guarantee satisfaction of a temporal logic task. The selector uses active inference to decide which generated plan best complies with user preferences and aids learning. Operating iteratively, the framework updates a parameterized learning model based on collected data. Case studies and benchmarks on both manipulation and mobile robots show that our framework outperforms other methods and (i) learns multiple optimal trade-offs, (ii) adheres to a user preference, and (iii) allows the user to adjust the balance between (i) and (ii).


title: Close Encounter of Three Black Holes III

abstract: We revisit the three black hole scenario with numerical relativity techniques to study hierarchical configurations where the inner binary contains highly spinning black holes. We find that the merger time of the binary gets a delay (with a number of orbits to merger increase), depending strongly with the distance to the orbiting third hole $D$ as $\sim1/D^{1.6\pm0.1}$. Notably, a different dependence from what we had found in the nonspinning case, $\sim1/D^{2.5}$. We interpret this effect as mostly due to a spin-orbit coupling between the third hole and the closest member of the binary in the successive approaches. This lead us next to study scattering configurations of the third hole with the binary in order to evaluate the extent of this ``sudden'' interactions, finding also a correlation of the delay in merger times with the closest distance, even for the nonspinning cases. We then explore the mass ratio dependence of the triple system by modeling binaries orbiting a larger black hole bearing masses ratios 8:1:1 and 18:1:1 in co-orbiting or counter-orbiting configurations, finding merger times increasing with increasing mass ratios and for the counter-orbiting cases.


title: Quasi-normal mode frequencies and gravitational perturbations of black holes with any subextremal spin in modified gravity through METRICS: the scalar-Gauss-Bonnet gravity case

abstract: The gravitational waves emitted in the ringdown phase of binary black-hole coalescence are a unique probe of strong gravity. Understanding how deviations from general relativity affect the ringdown phase of black holes, however, is extremely challenging, as it requires solving highly-coupled and sometimes higher-order partial differential equations. We here extend a novel approach, \textit{Metric pErTuRbations wIth speCtral methodS} (METRICS), to study the metric perturbations and the quasinormal mode frequencies of ringing black holes in modified gravity. We first derive the asymptotic behavior of metric perturbations at the event horizon and spatial infinity for rotating black holes beyond general relativity. We then extend the eigenvalue-perturbation theory approach of METRICS to allow us to compute the leading-order modified gravity corrections to the quasinormal-mode frequencies and metric perturbations. We apply METRICS to rotating black holes in scalar-Gauss-Bonnet gravity. Without decoupling or simplifying the linearized field equations in this theory, we compute the leading-order corrections to the quasinormal frequencies of the axial and polar perturbations of the $nlm = 022$, 021 and 033 modes of black holes of $a \leq 0.85$. The numerical accuracy of the METRICS frequencies is $\leq 10^{-5}$ for $a \leq 0.6$, $\lesssim 10^{-4}$ for $0.6 < a \leq 0.7 $, and $\lesssim 10^{-2}$ for $0.7 < a \leq 0.85 $ for all modes studied. We fit the frequencies as a polynomial in spin, whose coefficients (up to second order in spin) are consistent with those obtained in previous slow-rotating approximations. These results are the first accurate computations of the gravitational quasinormal-mode frequencies of rapidly rotating black holes (of $a \sim 0.85$) in scalar-Gauss-Bonnet gravity.

categories: gr-qc astro-ph.CO astro-ph.HE astro-ph.IM


title: The Nearly Universal Disk Galaxy Rotation Curve

abstract: The Universal Rotation Curve (URC) of disk galaxies was originally proposed to predict the shape and amplitude of any rotation curve (RC) based solely on photometric data. Here, the URC is investigated with an extensive set of spatially-resolved rotation curves drawn from the PROBES-I, PROBES-II, and MaNGA data bases with matching multi-band surface brightness profiles from the DESI-LIS and WISE surveys for 3,846 disk galaxies. Common URC formulations fail to achieve an adequate level of accuracy to qualify as truly universal over fully sampled RCs. We develop neural network (NN) equivalents for the proposed URCs which predict RCs with higher accuracy, showing that URC inaccuracies are not due to insufficient data but rather non-optimal formulations or sampling effects. This conclusion remains even if the total RC sample is pruned for symmetry. The latest URC prescriptions and their NN equivalents trained on our sub-sample of 579 disk galaxies with symmetric RCs perform similarly to the URC/NN trained on the complete data sample. We conclude that a URC with an acceptable level of accuracy ($\Delta V_{\rm circ} \lesssim15$ per cent) at all radii would require a detailed modelling of a galaxy's central regions and outskirts (e.g., for baryonic effects leading to contraction or expansion of any dark-matter-only halo).


title: Decomposed evaluations of geographic disparities in text-to-image models

abstract: Recent work has identified substantial disparities in generated images of different geographic regions, including stereotypical depictions of everyday objects like houses and cars. However, existing measures for these disparities have been limited to either human evaluations, which are time-consuming and costly, or automatic metrics evaluating full images, which are unable to attribute these disparities to specific parts of the generated images. In this work, we introduce a new set of metrics, Decomposed Indicators of Disparities in Image Generation (Decomposed-DIG), that allows us to separately measure geographic disparities in the depiction of objects and backgrounds in generated images. Using Decomposed-DIG, we audit a widely used latent diffusion model and find that generated images depict objects with better realism than backgrounds and that backgrounds in generated images tend to contain larger regional disparities than objects. We use Decomposed-DIG to pinpoint specific examples of disparities, such as stereotypical background generation in Africa, struggling to generate modern vehicles in Africa, and unrealistically placing some objects in outdoor settings. Informed by our metric, we use a new prompting structure that enables a 52% worst-region improvement and a 20% average improvement in generated background diversity.


title: Advancing Stellar Streams as a Dark Matter Probe -- I: Evolution of the CDM subhalo population

abstract: Stellar streams, long thin streams of stars, have been used as sensitive probes of dark matter substructure for over two decades. Gravitational interactions between dark matter substructures and streams lead to the formation of low density "gaps" in streams, with any given stream typically containing no more than a few such gaps. Prior models for the statistics of such gaps have relied on several simplifying assumptions for the properties of the subhalo population in the cold dark matter scenario. With the expected forthcoming increase in the number of streams, and gaps, observed, in this work we develop a more detailed model for the statistics of subhalos interacting with streams, and test some of the assumptions made in prior works. Instead of using simple fits to N-body estimates of subhalo population statistics at z = 0 as in previous work, we make use of realizations of time-dependent subhalo populations generated from a fully physical model, incorporating structure formation, and subhalo orbital evolution, including tidal heating and stripping physics, which has been carefully calibrated to match results of cosmological N-body simulations. We find that this model predicts up to 60% more gaps on average in Pal-5-like streams than prior works.


title: Geometry of Invariant Almost Semi K\"ahler Submanifolds of Flag Manifolds

abstract: In this paper we discuss the geometry of homogeneous spaces witch are almost Hermitian submanifolds of flag manifolds. We prove that such spaces are necessarily minimal submanifolds and in the case where these submanifolds are also flag manifolds, they are totally geodesic.


title: Identifying trivial and Majorana zero-energy modes using the Majorana polarization

abstract: In this work we consider superconductor-semiconductor hybrids containing both trivial and Majorana zero modes and explore their signatures in the Majorana polarization. In particular, we consider trivial zero energy states due to confinement and disorder, which seem to be very likely experimental scenarios. We show that the Majorana polarization is able to characterize the topological phase transition as well as the emergence of Majorana zero modes even when trivial zero-energy states proliferate. Notably, the Majorana polarization inherits direct information about spatial correlations which are then the key for distinguishing Majorana and trivial zero-modes. We demonstrate the utility of the Majorana polarization in normal-superconductor junctions and superconductor-normal-superconductor Josephson junctions. Our results support the interpretation of the Majorana polarization as a real space topological indicator.


title: Modeling optical systematics for the Taurus CMB experiment

abstract: We simulate a variety of optical systematics for Taurus, a balloon-borne cosmic microwave background (CMB) polarisation experiment, to assess their impact on large-scale E-mode polarisation measurements and constraints of the optical depth to reionisation {\tau}. We model a one-month flight of Taurus from Wanaka, New Zealand aboard a super-pressure balloon (SPB). We simulate night-time scans of both the CMB and dust foregrounds in the 150GHz band, one of Taurus's four observing bands. We consider a variety of possible systematics that may affect Taurus's observations, including non-gaussian beams, pointing reconstruction error, and half-wave plate (HWP) non-idealities. For each of these, we evaluate the residual power in the difference between maps simulated with and without the systematic, and compare this to the expected signal level corresponding to Taurus's science goals. Our results indicate that most of the HWP-related systematics can be mitigated to be smaller than sample variance by calibrating with Planck's TT spectrum and using an achromatic HWP model, with a preference for five layers of sapphire to ensure good systematic control. However, additional beam characterization will be required to mitigate far-sidelobe pickup from dust on larger scales.


title: Delay Embedding Theory of Neural Sequence Models

abstract: To generate coherent responses, language models infer unobserved meaning from their input text sequence. One potential explanation for this capability arises from theories of delay embeddings in dynamical systems, which prove that unobserved variables can be recovered from the history of only a handful of observed variables. To test whether language models are effectively constructing delay embeddings, we measure the capacities of sequence models to reconstruct unobserved dynamics. We trained 1-layer transformer decoders and state-space sequence models on next-step prediction from noisy, partially-observed time series data. We found that each sequence layer can learn a viable embedding of the underlying system. However, state-space models have a stronger inductive bias than transformers-in particular, they more effectively reconstruct unobserved information at initialization, leading to more parameter-efficient models and lower error on dynamics tasks. Our work thus forges a novel connection between dynamical systems and deep learning sequence models via delay embedding theory.


title: Witnessing network steerability of every bipartite entangled state without inputs

abstract: Entanglement and nonlocality are key resources for most of the quantum information protocols. It is well-established now that every entangled state is nonlocal with respect to semi-quantum games. However, there is a lack of witnesses that can used to observe any form of nonlocality of every entangled state. In this work, we focus on the swap-steering scenario without inputs and find linear witnesses of network steerability corresponding to any negative partial transpose (NPT) bipartite state and a large class of bipartite states that violate the computable cross-norm (CCN) criterion. Furthermore, by considering that the trusted party can perform tomography of the incoming subsystems, we construct linear inequalities to witness swap-steerability of every bipartite entangled state. Consequently, for every bipartite entangled state one can now observe a form of quantum nonlocality.


title: Exploring Gamification in Quantum Computing: The Qubit Factory

abstract: Gamification of quantum theory can provide new inroads into the subject: by allowing users to experience simulated worlds that manifest obvious quantum behaviors they can potentially build intuition for quantum phenomena. The Qubit Factory is an engineering-style puzzle game based on a gamified quantum circuit simulator that is designed to provide an introduction to qubits and quantum computing, while being approachable to those with no prior background in the area. It introduces an intuitive visual language for representing quantum states, gates and circuits, further enhanced by animations to aid in visualization. The Qubit Factory presents a hierarchy of increasingly difficult tasks for the user to solve, where each task requires the user to construct and run an appropriate classical/quantum circuit built from a small selection of components. Earlier tasks cover the fundamentals of qubits, quantum gates, superpositions and entanglement. Later tasks cover important quantum algorithms and protocols including superdense coding, quantum teleportation, entanglement distillation, classical and quantum error correction, state tomography, the Bernstein-Vazirani algorithm, quantum repeaters and more.


title: The Lamplighter groups and Thompson's group $F$ have infinite weak-cop number

abstract: The weak-cop number of a graph, introduced by Lee et al (2023), is a quasi-isometry invariant of graphs and hence of finitely generated groups. While for any $m\in\mathbb{Z}_+\cup\infty$ there exists graphs with weak-cop number $m$, it is an open question whether there exists finitely generated groups whose weak-cop number is different than $1$ and $\infty$. We prove that wreath products of nontrivial groups by infinite groups, as well as Thompson's group $F$, have infinite weak-cop number. The argument for Thompson's group relies on the representation of its elements by Belk and Brown Forest diagrams.


title: JADES: Physical properties of Ly$\alpha$ and non-Ly$\alpha$ emitters at z ~ 4.8-9.6

abstract: We investigate the physical properties of Lyman-alpha emitters (LAEs) and non-Lyman-alpha emitters (non-LAEs) at z$\sim$4.8--9.6 via a stacking analysis of 253 JWST/NIRSpec spectra of galaxies observed as part of the JWST Advanced Deep Extragalactic Survey (JADES). We identify a sample of 42 LAEs with the equivalent width of Ly$\alpha$ $\gtrsim$20\AA and a sample of 211 non-LAEs, divide each sample further via the median redshift of the LAEs (z~6.3), and create composite spectra using the low and medium resolution spectra from NIRSpec. We estimate physical quantities such as dust extinction, UV continuum slope $\beta$, electron temperatures, ionization parameter, escape fraction of Ly$\alpha$ and Lyman Continuum, and the photon production rate for each bin/stack. The existing dust-extinction laws do not appear to be valid at these epochs. The emission line ratio analyses show that active galactic nuclei might dominate all sub-samples, irrespective of Ly$\alpha$ emission. LAEs show much higher [OIII]/[OII] and low [OII]/H$\delta$ at z$\lesssim$6.3 compared to non-LAEs, but these line ratios are not sufficient to distinguish the two populations at z$>$6.3. However, the LAEs samples show large EW([OIII]4959, 5007) ($>$1000\AA) compared to the non-LAEs sample at all redshifts. CIV/Ly$\alpha$ and CIV/CIII] for LAE population at z$\lesssim$6.3 is $\sim$a factor of 5 larger than that for LAE population at z$>$6.3. The ionizing radiation for LAEs is hard, as revealed from several diagnostics, including CIV detection, high [OIII]/[OII] ($>$8), and large values of $\xi^{\star}_{ion}$.


title: Stability of Persistent Path Diagrams

abstract: In real-world systems, the relationships and connections between components are highly complex. Real systems are often described as networks, where nodes represent objects in the system and edges represent relationships or connections between nodes. With the deepening of research, networks have been endowed with richer structures, such as directed edges, edge weights, and even hyperedges involving multiple nodes. Persistent homology is an algebraic method for analyzing data. It helps us understand the intrinsic structure and patterns of data by tracking the death and birth of topological features at different scale parameters.The original persistent homology is not suitable for directed networks. However, the introduction of path homology established on digraphs solves this problem. This paper studies complex networks represented as weighted digraphs or edge-weighted path complexes and their persistent path homology. We use the homotopy theory of digraphs and path complexes, along with the interleaving property of persistent modules and bottleneck distance, to prove the stability of persistent path diagram with respect to weighted digraphs or edge-weighted path complexes. Therefore, persistent path homology has practical application value.


title: Supersaturation of Tree Posets

abstract: A well-known result of Bukh shows that if $P$ is a tree poset of height $k$, then any subset of the Boolean lattice $\mathcal{F}\subseteq \mathcal{B}_n$ of size at least $(k-1+\varepsilon){n\choose \lceil n/2\rceil}$ contains at least one copy of $P$. This was extended by Boehnlein and Jiang to induced copies. We strengthen both results by showing that for any integer $q\ge k$, any family $\mathcal{F}$ of size at least $(q-1+\varepsilon){n\choose \lceil n/2\rceil}$ contains on the order of as many induced copies of $P$ as is contained in the $q$ middle layers of the Boolean lattice. This answers a conjecture of Gerbner, Nagy, Patk\'os, and Vizer in a strong form for tree posets.


title: Look Further Ahead: Testing the Limits of GPT-4 in Path Planning

abstract: Large Language Models (LLMs) have shown impressive capabilities across a wide variety of tasks. However, they still face challenges with long-horizon planning. To study this, we propose path planning tasks as a platform to evaluate LLMs' ability to navigate long trajectories under geometric constraints. Our proposed benchmark systematically tests path-planning skills in complex settings. Using this, we examined GPT-4's planning abilities using various task representations and prompting approaches. We found that framing prompts as Python code and decomposing long trajectory tasks improve GPT-4's path planning effectiveness. However, while these approaches show some promise toward improving the planning ability of the model, they do not obtain optimal paths and fail at generalizing over extended horizons.


title: Reflection Positivity and Chern-Simons Functional Integrals

abstract: We show that a mathematical version of the formal Chern-Simons functional integral of Witten for manifolds equipped with a reflection may be constructed in terms of a reflection positive functional, associated to the quadratic term in the Chern-Simons Lagrangian, on an algebra of functions on a Banach space ${\bf A}$ of connections on the underlying 3-manifold. This construction yields a Hilbert space associated to a surface preserved by the reflection. A version of the cubic Bosonic interaction term in the Chern-Simons Lagrangian gives a self-adjoint operator on this Hilbert space, and by exponentiation, a unitary one parameter subgroup of operators. The vacuum expectation value of this one parameter subgroup is combined with an additional term associated to the ghost fields and their interaction, and an appropriate weak limit gives a partition function for the quantum field theory. This construction is nonperturbative. The theory is finite and does not require renormalization, as may be expected from perturbation theory. It is natural to ask whether the resulting partition function is related to the manifold invariants of Witten and Reshetikhin-Turaev, or whether a more elaborate construction may be needed.


title: Modeling, Inference, and Prediction in Mobility-Based Compartmental Models for Epidemiology

abstract: Classical compartmental models in epidemiology often struggle to accurately capture real-world dynamics due to their inability to address the inherent heterogeneity of populations. In this paper, we introduce a novel approach that incorporates heterogeneity through a mobility variable, transforming the traditional ODE system into a system of integro-differential equations that describe the dynamics of population densities across different compartments. Our results show that, for the same basic reproduction number, our mobility-based model predicts a smaller final pandemic size compared to classic compartmental models, whose population densities are represented as Dirac delta functions in our density-based framework. This addresses the overestimation issue common in many classical models. Additionally, we demonstrate that the time series of the infected population is sufficient to uniquely identify the mobility distribution. We reconstruct this distribution using a machine-learning-based framework, providing both theoretical and algorithmic support to effectively constrain the mobility-based model with real-world data.

categories: q-bio.PE cs.LG cs.NA math.NA physics.soc-ph


title: P3GNN: A Privacy-Preserving Provenance Graph-Based Model for APT Detection in Software Defined Networking

abstract: Software Defined Networking (SDN) has brought significant advancements in network management and programmability. However, this evolution has also heightened vulnerability to Advanced Persistent Threats (APTs), sophisticated and stealthy cyberattacks that traditional detection methods often fail to counter, especially in the face of zero-day exploits. A prevalent issue is the inadequacy of existing strategies to detect novel threats while addressing data privacy concerns in collaborative learning scenarios. This paper presents P3GNN (privacy-preserving provenance graph-based graph neural network model), a novel model that synergizes Federated Learning (FL) with Graph Convolutional Networks (GCN) for effective APT detection in SDN environments. P3GNN utilizes unsupervised learning to analyze operational patterns within provenance graphs, identifying deviations indicative of security breaches. Its core feature is the integration of FL with homomorphic encryption, which fortifies data confidentiality and gradient integrity during collaborative learning. This approach addresses the critical challenge of data privacy in shared learning contexts. Key innovations of P3GNN include its ability to detect anomalies at the node level within provenance graphs, offering a detailed view of attack trajectories and enhancing security analysis. Furthermore, the models unsupervised learning capability enables it to identify zero-day attacks by learning standard operational patterns. Empirical evaluation using the DARPA TCE3 dataset demonstrates P3GNNs exceptional performance, achieving an accuracy of 0.93 and a low false positive rate of 0.06.


title: Magnetoresistance of a bulk sample of FeSi

abstract: The magnetoresistance, MR of a well-characterized bulk FeSi sample was studied. It is shown that after a chaotic behavior at temperatures below 6 K, the magnetoresistance of FeSi becomes regular functions of temperature and magnetic field. The observations suggest that the mean free path of carriers defines along with the unknown negative component the negative values of magnetoresistance of FeSi then approaching zero values at high temperatures.


title: Ultra-low frequency LOFAR spectral indices of cluster radio halos

abstract: A fraction of galaxy clusters harbor diffuse radio sources known as radio halos. The currently adopted scenario for their formation is based on second-order Fermi re-acceleration of seed electrons that is driven by merger-driven turbulence in the intra-cluster medium. This mechanism is expected to be inefficient, which implies that a significant fraction of halos should have very steep ($\alpha < -1.5$) energy spectra. We start investigating the potential and current limitations of the combination of the two surveys conducted by LOFAR, LoTSS (144 MHz) and LoLSS (54 MHz), to probe the origin of radio halos. We follow up the 20 radio halos detected in the DR1 of LoTSS, which covers the HETDEX field, with the LoLSS survey, and we study their spectral properties between 54 and 144 MHz. After the removal of compact sources, 9 halos were excluded due to unreliable halo flux density measurements at 54 MHz. Our main finding is that 7 out of 11 ($\sim$ 64%) exhibit an ultra-steep spectrum ($\alpha < -1.5$), which is a key prediction of turbulent re-acceleration models. We also note a tentative trend for more massive systems to host flatter halos, although the currently poor statistics does not allow for a deeper analysis. Our sample suffers from low angular resolution at 54 MHz, which limits the accuracy of the compact-sources subtraction. Nevertheless, this study is the first step towards providing compelling evidence for the existence of a large fraction of radio halos with very steep spectrum, which is a fundamental prediction of turbulent re-acceleration models. In this regard, the forthcoming second data release of LoLSS, along with the integration of LOFAR international stations and the instrumental upgrade to LOFAR2.0, will improve both the statistics and the low-frequency angular resolution, allowing to conclusively determine the origin of radio halos in galaxy clusters.


title: Lexidate: Model Evaluation and Selection with Lexicase

abstract: Automated machine learning streamlines the task of finding effective machine learning pipelines by automating model training, evaluation, and selection. Traditional evaluation strategies, like cross-validation (CV), generate one value that averages the accuracy of a pipeline's predictions. This single value, however, may not fully describe the generalizability of the pipeline. Here, we present Lexicase-based Validation (lexidate), a method that uses multiple, independent prediction values for selection. Lexidate splits training data into a learning set and a selection set. Pipelines are trained on the learning set and make predictions on the selection set. The predictions are graded for correctness and used by lexicase selection to identify parent pipelines. Compared to 10-fold CV, lexicase reduces the training time. We test the effectiveness of three lexidate configurations within the Tree-based Pipeline Optimization Tool 2 (TPOT2) package on six OpenML classification tasks. In one configuration, we detected no difference in the accuracy of the final model returned from TPOT2 on most tasks compared to 10-fold CV. All configurations studied here returned similar or less complex final pipelines compared to 10-fold CV.


title: Supervised binary classification of small-scale digits images with a trapped-ion quantum processor

abstract: Here we present the results of benchmarking of a quantum processor based on trapped $^{171}$Yb$^{+}$ ions by performing basic quantum machine learning algorithms. Specifically, we carry out a supervised binary classification of small-scale digits images, which are intentionally chosen so that they can be classified with 100% accuracy, using a quantum-enhanced Support Vector Machine algorithm with up to four qubits. In our work, we specifically consider different types of quantum encodings of the dataset and different levels of transpilation optimizations for the corresponding quantum circuits. For each quantum encoding, we obtain a classifier that is of 100% accuracy on both training and test sets, which demonstrates that the quantum processor can correctly solve the basic classification task considered. As we expect, with the increase of the capabilities quantum processors, they can become a useful tool for machine learning.


title: QC-Forest: a Classical-Quantum Algorithm to Provably Speedup Retraining of Random Forest

abstract: Random Forest (RF) is a popular tree-ensemble method for supervised learning, prized for its ease of use and flexibility. Online RF models require to account for new training data to maintain model accuracy. This is particularly important in applications where data is periodically and sequentially generated over time in data streams, such as auto-driving systems, and credit card payments. In this setting, performing periodic model retraining with the old and new data accumulated is beneficial as it fully captures possible drifts in the data distribution over time. However, this is unpractical with state-of-the-art classical algorithms for RF as they scale linearly with the accumulated number of samples. We propose QC-Forest, a classical-quantum algorithm designed to time-efficiently retrain RF models in the streaming setting for multi-class classification and regression, achieving a runtime poly-logarithmic in the total number of accumulated samples. QC-Forest leverages Des-q, a quantum algorithm for single tree construction and retraining proposed by Kumar et al. by expanding to multi-class classification, as the original proposal was limited to binary classes, and introducing an exact classical method to replace an underlying quantum subroutine incurring a finite error, while maintaining the same poly-logarithmic dependence. Finally, we showcase that QC-Forest achieves competitive accuracy in comparison to state-of-the-art RF methods on widely used benchmark datasets with up to 80,000 samples, while significantly speeding up the model retrain.


title: FinTruthQA: A Benchmark Dataset for Evaluating the Quality of Financial Information Disclosure

abstract: Accurate and transparent financial information disclosure is crucial in the fields of accounting and finance, ensuring market efficiency and investor confidence. Among many information disclosure platforms, the Chinese stock exchanges' investor interactive platform provides a novel and interactive way for listed firms to disclose information of interest to investors through an online question-and-answer (Q&A) format. However, it is common for listed firms to respond to questions with limited or no substantive information, and automatically evaluating the quality of financial information disclosure on large amounts of Q&A pairs is challenging. This paper builds a benchmark FinTruthQA, that can evaluate advanced natural language processing (NLP) techniques for the automatic quality assessment of information disclosure in financial Q&A data. FinTruthQA comprises 6,000 real-world financial Q&A entries and each Q&A was manually annotated based on four conceptual dimensions of accounting. We benchmarked various NLP techniques on FinTruthQA, including statistical machine learning models, pre-trained language model and their fine-tuned versions, as well as the large language model GPT-4. Experiments showed that existing NLP models have strong predictive ability for real question identification and question relevance tasks, but are suboptimal for answer relevance and answer readability tasks. By establishing this benchmark, we provide a robust foundation for the automatic evaluation of information disclosure, significantly enhancing the transparency and quality of financial reporting. FinTruthQA can be used by auditors, regulators, and financial analysts for real-time monitoring and data-driven decision-making, as well as by researchers for advanced studies in accounting and finance, ultimately fostering greater trust and efficiency in the financial markets.


title: Criteria for the integrality of $n$th roots of power series

abstract: Heninger, Rains and Sloane raised the question of which power series with integer coefficients can be written as the $n$th power of another power series with integer coefficients and constant term $1$. We provide necessary and sufficient conditions, as well as compare with a general integrality criterion due to Dieudonn\'e and Dwork that can be applied to this question as well.


title: The Benefits and Risks of Transductive Approaches for AI Fairness

abstract: Recently, transductive learning methods, which leverage holdout sets during training, have gained popularity for their potential to improve speed, accuracy, and fairness in machine learning models. Despite this, the composition of the holdout set itself, particularly the balance of sensitive sub-groups, has been largely overlooked. Our experiments on CIFAR and CelebA datasets show that compositional changes in the holdout set can substantially influence fairness metrics. Imbalanced holdout sets exacerbate existing disparities, while balanced holdouts can mitigate issues introduced by imbalanced training data. These findings underline the necessity of constructing holdout sets that are both diverse and representative.


title: Highly Efficient Superconducting Diodes and Rectifiers for Quantum Circuitry

abstract: Superconducting electronics is essential for energy-efficient quantum and classical high-end computing applications. Towards this goal, non-reciprocal superconducting circuit elements, such as superconducting diodes (SDs) can fulfill many critical needs. SDs have been the subject of multiple studies, but integrating several SDs in a superconducting circuit remains a challenge. Here we implement the first SD bridge with multiple SDs exhibiting reproducible characteristics operating at temperatures of a few Kelvin. We demonstrate its functionality as a full wave rectifier using elemental superconductors and insulating ferromagnets, with efficiency up to 43%, and ac to dc signal conversion capabilities at frequencies up to 40 kHz. Our results show a pathway with a highly scalable thin film platform for nonreciprocal superconducting circuits. They could significantly reduce energy consumption as well as decohering thermal and electromagnetic noise in quantum computing.


title: Convergence rates of S.O.S hierarchies for polynomial semidefinite programs

abstract: We introduce a S.O.S hierarchy of lower bounds for a polynomial optimization problem whose constraint is expressed as a matrix polynomial semidefinite condition. Our approach involves utilizing a penalty function framework to directly address the matrix-based constraint, making it applicable to both discrete and continuous polynomial optimization problems. We investigate the convergence rates of these bounds in both problem types. The proposed method yields a variation of Putinar's theorem tailored for positive polynomials within a compact semidefinite set, defined by a matrix polynomial semidefinite constraint. More specifically, we derive novel insights into the convergence rates and degree of additional terms in the representation within this modified version of Putinar's theorem, based on the Jackson's theorem and a version of {\L}ojasiewicz inequality.


title: An IXPE-Led X-ray Spectro-Polarimetric Campaign on the Soft State of Cygnus X-1: X-ray Polarimetric Evidence for Strong Gravitational Lensing

abstract: We present the first X-ray spectropolarimetric results for Cygnus X-1 in its soft state from a campaign of five IXPE observations conducted during 2023 May-June. Companion multiwavelength data during the campaign are likewise shown. The 2-8 keV X-rays exhibit a net polarization degree PD=1.99%+/-0.13% (68% confidence). The polarization signal is found to increase with energy across IXPE's 2-8 keV bandpass. The polarized X-rays exhibit an energy-independent polarization angle of PA=-25.7+/-1.8 deg. East of North (68% confidence). This is consistent with being aligned to Cyg X-1's AU-scale compact radio jet and its pc-scale radio lobes. In comparison to earlier hard-state observations, the soft state exhibits a factor of 2 lower polarization degree, but a similar trend with energy and a similar (also energy-independent) position angle. When scaling by the natural unit of the disk temperature, we find the appearance of a consistent trendline in the polarization degree between soft and hard states. Our favored polarimetric model indicates Cyg X-1's spin is likely high (a* above ~0.96). The substantial X-ray polarization in Cyg X-1's soft state is most readily explained as resulting from a large portion of X-rays emitted from the disk returning and reflecting off the disk surface, generating a high polarization degree and a polarization direction parallel to the black hole spin axis and radio jet. In IXPE's bandpass, the polarization signal is dominated by the returning reflection emission. This constitutes polarimetric evidence for strong gravitational lensing of X-rays close to the black hole.


title: Effects of non-commutative geometry on black hole properties

abstract: In this study, we investigate the signatures of a non-commutative black hole solution. Initially, we calculate the thermodynamic properties of the system, including entropy, heat capacity, and Hawking radiation. For the latter quantity, we employ two distinct methods: surface gravity and the topological approach. Additionally, we examine the emission rate and remnant mass within this context. Remarkably, the lifetime of the black hole, after reaching its final state due to the evaporation process, is expressed analytically up to a grey-body factor. We estimate the lifetime for specific initial and final mass configurations. Also, we analyze the tensorial quasinormal modes using the 6th-order WKB method. Finally, we study the deflection angle, i.e., gravitational lensing, in both the weak and strong deflection limits.


title: Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization

abstract: Despite recent advances in LLM quantization, activation quantization remains to be challenging due to the activation outliers. Conventional remedies, e.g., mixing precisions for different channels, introduce extra overhead and reduce the speedup. In this work, we develop a simple yet effective strategy to facilitate per-tensor activation quantization by preventing the generation of problematic tokens. Precisely, we propose a method to find a set of key-value cache, coined CushionCache, which mitigates outliers in subsequent tokens when inserted as a prefix. CushionCache works in two steps: First, we greedily search for a prompt token sequence that minimizes the maximum activation values in subsequent tokens. Then, we further tune the token cache to regularize the activations of subsequent tokens to be more quantization-friendly. The proposed method successfully addresses activation outliers of LLMs, providing a substantial performance boost for per-tensor activation quantization methods. We thoroughly evaluate our method over a wide range of models and benchmarks and find that it significantly surpasses the established baseline of per-tensor W8A8 quantization and can be seamlessly integrated with the recent activation quantization method.


title: Sparsity-Constraint Optimization via Splicing Iteration

abstract: Sparsity-constraint optimization has wide applicability in signal processing, statistics, and machine learning. Existing fast algorithms must burdensomely tune parameters, such as the step size or the implementation of precise stop criteria, which may be challenging to determine in practice. To address this issue, we develop an algorithm named Sparsity-Constraint Optimization via sPlicing itEration (SCOPE) to optimize nonlinear differential objective functions with strong convexity and smoothness in low dimensional subspaces. Algorithmically, the SCOPE algorithm converges effectively without tuning parameters. Theoretically, SCOPE has a linear convergence rate and converges to a solution that recovers the true support set when it correctly specifies the sparsity. We also develop parallel theoretical results without restricted-isometry-property-type conditions. We apply SCOPE's versatility and power to solve sparse quadratic optimization, learn sparse classifiers, and recover sparse Markov networks for binary variables. The numerical results on these specific tasks reveal that SCOPE perfectly identifies the true support set with a 10--1000 speedup over the standard exact solver, confirming SCOPE's algorithmic and theoretical merits. Our open-source Python package skscope based on C++ implementation is publicly available on GitHub, reaching a ten-fold speedup on the competing convex relaxation methods implemented by the cvxpy library.


title: CItruS: Chunked Instruction-aware State Eviction for Long Sequence Modeling

abstract: Long sequence modeling has gained broad interest as large language models (LLMs) continue to advance. Recent research has identified that a large portion of hidden states within the key-value caches of Transformer models can be discarded (also termed evicted) without affecting the perplexity performance in generating long sequences. However, we show that these methods, despite preserving perplexity performance, often drop information that is important for solving downstream tasks, a problem which we call information neglect. To address this issue, we introduce Chunked Instruction-aware State Eviction (CItruS), a novel modeling technique that integrates the attention preferences useful for a downstream task into the eviction process of hidden states. In addition, we design a method for chunked sequence processing to further improve efficiency. Our training-free method exhibits superior performance on long sequence comprehension and retrieval tasks over several strong baselines under the same memory budget, while preserving language modeling perplexity.


title: Hacking Encrypted Wireless Power: Cyber-Security of Dynamic Charging

abstract: Recently, energy encryption for wireless power transfer has been developed for energy safety, which is important in public places to suppress unauthorized energy extraction. Most techniques vary the frequency so that unauthorized receivers cannot extract energy because of non-resonance. However, this strategy is unreliable. To stimulate the progress of energy encryption technology and point out security holes, this paper proposes a decryption method for the fundamental principle of encrypted frequency-varying wireless power transfer. The paper uses an auxiliary coil to detect the frequency and a switched-capacitor array to adaptively compensate the receiver for a wide frequency range. The switched-capacitor array contains two capacitors and one semi-conductor switch. One capacitor compensates the receiver all the time while the other's active time during one wireless power transfer cycle is regulated by the switch. Thus, the proposed hacking receiver controls the equivalent capacitance of the compensation and steals energy. Finally, a detailed simulation model and experimental results prove the effectiveness of the attack on frequency-hopping energy encryption. Although any nonnegligible energy extracted would be problematic, we achieved to steal 78% to 84% of the energy an authorized receiver could get. When the frequency changes, the interceptor is coarsely tuned very quickly, which can hack fast frequency-varying encrypted system.


title: When Box Meets Graph Neural Network in Tag-aware Recommendation

abstract: Last year has witnessed the re-flourishment of tag-aware recommender systems supported by the LLM-enriched tags. Unfortunately, though large efforts have been made, current solutions may fail to describe the diversity and uncertainty inherent in user preferences with only tag-driven profiles. Recently, with the development of geometry-based techniques, e.g., box embedding, diversity of user preferences now could be fully modeled as the range within a box in high dimension space. However, defect still exists as these approaches are incapable of capturing high-order neighbor signals, i.e., semantic-rich multi-hop relations within the user-tag-item tripartite graph, which severely limits the effectiveness of user modeling. To deal with this challenge, in this paper, we propose a novel algorithm, called BoxGNN, to perform the message aggregation via combination of logical operations, thereby incorporating high-order signals. Specifically, we first embed users, items, and tags as hyper-boxes rather than simple points in the representation space, and define two logical operations to facilitate the subsequent process. Next, we perform the message aggregation mechanism via the combination of logical operations, to obtain the corresponding high-order box representations. Finally, we adopt a volume-based learning objective with Gumbel smoothing techniques to refine the representation of boxes. Extensive experiments on two publicly available datasets and one LLM-enhanced e-commerce dataset have validated the superiority of BoxGNN compared with various state-of-the-art baselines. The code is released online


title: Block Matrix and Tensor Randomized Kaczmarz Methods for Linear Feasibility Problems

abstract: The randomized Kaczmarz methods are a popular and effective family of iterative methods for solving large-scale linear systems of equations, which have also been applied to linear feasibility problems. In this work, we propose a new block variant of the randomized Kaczmarz method, B-MRK, for solving linear feasibility problems defined by matrices. We show that B-MRK converges linearly in expectation to the feasible region.Furthermore, we extend the method to solve tensor linear feasibility problems defined under the tensor t-product. A tensor randomized Kaczmarz (TRK) method, TRK-L, is proposed for solving linear feasibility problems that involve mixed equality and inequality constraints. Additionally, we introduce another TRK method, TRK-LB, specifically tailored for cases where the feasible region is defined by linear equality constraints coupled with bound constraints on the variables. We show that both of the TRK methods converge linearly in expectation to the feasible region. Moreover, the effectiveness of our methods is demonstrated through numerical experiments on various Gaussian random data and applications in image deblurring.


title: Constructing Ancestral Recombination Graphs through Reinforcement Learning

abstract: Over the years, many approaches have been proposed to build ancestral recombination graphs (ARGs), graphs used to represent the genetic relationship between individuals. Among these methods, many rely on the assumption that the most likely graph is among the shortest ones. In this paper, we propose a new approach to build short ARGs: Reinforcement Learning (RL). We exploit the similarities between finding the shortest path between a set of genetic sequences and their most recent common ancestor and finding the shortest path between the entrance and exit of a maze, a classic RL problem. In the maze problem, the learner, called the agent, must learn the directions to take in order to escape as quickly as possible, whereas in our problem, the agent must learn the actions to take between coalescence, mutation, and recombination in order to reach the most recent common ancestor as quickly as possible. Our results show that RL can be used to build ARGs as short as those built with a heuristic algorithm optimized to build short ARGs, and sometimes even shorter. Moreover, our method allows to build a distribution of short ARGs for a given sample, and can also generalize learning to new samples not used during the learning process.


title: LiLiuM: eBay's Large Language Models for e-commerce

abstract: We introduce the LiLiuM series of large language models (LLMs): 1B, 7B, and 13B parameter models developed 100% in-house to fit eBay's specific needs in the e-commerce domain. This gives eBay full control over all aspects of the models including license, data, vocabulary, and architecture. We expect these models to be used as a foundation for fine-tuning and instruction-tuning, eliminating dependencies to external models. The LiLiuM LLMs have been trained on 3 trillion tokens of multilingual text from general and e-commerce domain. They perform similar to the popular LLaMA-2 models on English natural language understanding (NLU) benchmarks. At the same time, we outperform LLaMA-2 on non-English NLU tasks, machine translation and on e-commerce specific downstream tasks. As part of our data mixture, we utilize the newly released RedPajama-V2 dataset for training and share our insights regarding data filtering and deduplication. We also discuss in detail how to serialize structured data for use in autoregressive language modeling. We provide insights on the effects of including code and parallel machine translation data in pre-training. Furthermore, we develop our own tokenizer and model vocabulary, customized towards e-commerce. This way, we can achieve up to 34% speed-up in text generation on eBay-specific downstream tasks compared to LLaMA-2. Finally, in relation to LLM pretraining, we show that checkpoint averaging can further improve over the best individual model checkpoint.


title: On the irreducibility of Hessian loci of cubic hypersurfaces

abstract: We study the problem of the irreducibility of the Hessian variety $\mathcal{H}_f$ associated with a smooth cubic hypersurface $V(f)\subset \mathbb{P}^n$. We prove that when $n\leq5$, $\mathcal{H}_f$ is normal and irreducible if and only if $f$ is not of Thom-Sebastiani type, i.e., roughly, one can not separate its variables. This also generalizes a result of Beniamino Segre dealing with the case of cubic surfaces. The geometric approach is based on the study of the singular locus of the Hessian variety and on infinitesimal computations arising from a particular description of these singularities.


title: A 260 pc resolution ALMA map of HCN(1-0) in the galaxy NGC 4321

abstract: The star formation rate (SFR) is tightly connected to the amount of dense gas in molecular clouds. However, it is not fully understood how the relationship between dense molecular gas and star formation varies within galaxies and in different morphological environments. In this work, we study dense gas and star formation in the nearby spiral galaxy NGC 4321 to test how the amount of dense gas and its ability to form stars varies with environmental properties at 260 pc scales. We present new ALMA observations of HCN(1-0) line emission. Combined with existing CO(2-1) observations from ALMA, and H-alpha from MUSE, as well as F2100W from JWST to trace the SFR, we measure the HCN/CO line ratio, a proxy for the dense gas fraction and SFR/HCN, a proxy for the star formation efficiency of the dense gas. Towards the centre of the galaxy, HCN/CO systematically increases while SFR/HCN decreases, but these ratios stay roughly constant throughout the disc. Spiral arms, interarm regions, and bar ends show similar HCN/CO and SFR/HCN. On the bar, there is a significantly lower SFR/HCN at a similar HCN/CO. We conclude that the centres of galaxies show the strongest environmental influence on dense gas and star formation, suggesting either that clouds couple strongly to the surrounding pressure or that HCN is tracing more of the bulk molecular gas that is less efficiently converted into stars. On the contrary, across the disc of NGC 4321, where the ISM pressure is typically low, SFR/HCN does not show large variations (< 0.3 dex) in agreement with Galactic observations of molecular clouds. Despite the large variations across environments and physical conditions, HCN/CO is a good predictor of the mean molecular gas surface density at 260 pc scales.


title: Systematic literature review on forecasting and prediction of technical debt evolution

abstract: Context: Technical debt (TD) refers to the additional costs incurred due to compromises in software quality, providing short-term advantages during development but potentially compromising long-term quality. Accurate TD forecasting and prediction are vital for informed software maintenance and proactive management. However, this research area lacks comprehensive documentation on the available forecasting techniques. Objective: This study aims to explore existing knowledge in software engineering to gain insights into approaches proposed in research and industry for forecasting TD evolution. Methods: To achieve this objective, we conducted a Systematic Literature Review encompassing 646 distinct papers published until 2023. Following established methodology in software engineering, we identified and included 14 primary studies for analysis. Result: Our analysis unveiled various approaches for TD evolution forecasting. Notably, random forest and temporal convolutional networks demonstrated superior performance compared to other methods based on the result from the primary studies. However, these approaches only address two of the fifteen identified TD types, specifically Code debt and Architecture debt, while disregarding the remaining types. Conclusion: Our findings indicate that research on TD evolution forecasting is still in its early stages, leaving numerous challenges unaddressed. Therefore, we propose several research directions that require further investigation to bridge the existing gaps. Keywords: Systematic literature review, Technical debt, Technical debt prediction, Technical debt forecasting, Technical debt metrics


title: Adversarial Perturbations Cannot Reliably Protect Artists From Generative AI

abstract: Artists are increasingly concerned about advancements in image generation models that can closely replicate their unique artistic styles. In response, several protection tools against style mimicry have been developed that incorporate small adversarial perturbations into artworks published online. In this work, we evaluate the effectiveness of popular protections -- with millions of downloads -- and show they only provide a false sense of security. We find that low-effort and "off-the-shelf" techniques, such as image upscaling, are sufficient to create robust mimicry methods that significantly degrade existing protections. Through a user study, we demonstrate that all existing protections can be easily bypassed, leaving artists vulnerable to style mimicry. We caution that tools based on adversarial perturbations cannot reliably protect artists from the misuse of generative AI, and urge the development of alternative non-technological solutions.


title: Mixed-resolution hybrid modeling in an element-based framework

abstract: Computational modeling of a complex system is limited by the parts of the system with the least information. While detailed models and high-resolution data may be available for parts of a system, abstract relationships are often necessary to connect the parts and model the full system. For example, modeling food security necessitates the interaction of climate and socioeconomic factors, with models of system components existing at different levels of information in terms of granularity and resolution. Connecting these models is an ongoing challenge. In this work, we demonstrate methodology to quantize and integrate information from data and detailed component models alongside abstract relationships in a hybrid element-based modeling and simulation framework. In a case study of modeling food security, we apply quantization methods to generate (1) time-series model input from climate data and (2) a discrete representation of a component model (a statistical emulator of crop yield), which we then incorporate as an update rule in the hybrid element-based model, bridging differences in model granularity and resolution. Simulation of the hybrid element-based model recapitulated the trends of the original emulator, supporting the use of this methodology to integrate data and information from component models to simulate complex systems.


title: Study on relativistic transformations for thermodynamic quantities: Temperature of a moving system of quark-gluon plasma

abstract: Thermodynamics of systems moving with relativistic velocities is directly derived from the Lorentz transformation of four-momentum. It is shown that eight different perspectives on relativistic thermodynamics can be determined in the framework of the fundamental ensemble. However, only two sets of relativistic transformations for the physical thermodynamic quantities are consistent with the requirements of the special theory of relativity and the Hamiltonian and Lagrangian mechanics. These relativistic transformations are equivalent and correspond exactly to the Planck transformations for physical temperature and physical chemical potential. Other six sets of relativistic transformations of thermodynamic quantities are either unphysical due to the dependence of rest energy of the thermodynamic system on 3-velocity and 3-momentum or forbidden by the Hamiltonian and Lagrangian mechanics. It is found that the relativistic transformations for unphysical thermodynamic quantities corresponding to Planck's and Ott's transformations are unphysical and contradict the requirements of the special theory of relativity. The four classes of the obtained relativistic transformations of the physical thermodynamic quantities are compared by studying the thermodynamic properties of a relativistically moving system of the quark-gluon plasma (QGP).


title: SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Model

abstract: The emergence of Vision Language Models (VLMs) has brought unprecedented advances in understanding multimodal information. The combination of textual and visual semantics in VLMs is highly complex and diverse, making the safety alignment of these models challenging. Furthermore, due to the limited study on the safety alignment of VLMs, there is a lack of large-scale, high-quality datasets. To address these limitations, we propose a Safety Preference Alignment dataset for Vision Language Models named SPA-VL. In terms of breadth, SPA-VL covers 6 harmfulness domains, 13 categories, and 53 subcategories, and contains 100,788 samples of the quadruple (question, image, chosen response, rejected response). In terms of depth, the responses are collected from 12 open- (e.g., QwenVL) and closed-source (e.g., Gemini) VLMs to ensure diversity. The experimental results indicate that models trained with alignment techniques on the SPA-VL dataset exhibit substantial improvements in harmlessness and helpfulness while maintaining core capabilities. SPA-VL, as a large-scale, high-quality, and diverse dataset, represents a significant milestone in ensuring that VLMs achieve both harmlessness and helpfulness. We have made our code https://github.com/EchoseChen/SPA-VL-RLHF and SPA-VL dataset url https://huggingface.co/datasets/sqrti/SPA-VL publicly available.


title: Large Scale Transfer Learning for Tabular Data via Language Modeling

abstract: Tabular data -- structured, heterogeneous, spreadsheet-style data with rows and columns -- is widely used in practice across many domains. However, while recent foundation models have reduced the need for developing task-specific datasets and predictors in domains such as language modeling and computer vision, this transfer learning paradigm has not had similar impact in the tabular domain. In this work, we seek to narrow this gap and present TabuLa-8B, a language model for tabular prediction. We define a process for extracting a large, high-quality training dataset from the TabLib corpus, proposing methods for tabular data filtering and quality control. Using the resulting dataset, which comprises over 1.6B rows from 3.1M unique tables, we fine-tune a Llama 3-8B large language model (LLM) for tabular data prediction (classification and binned regression) using a novel packing and attention scheme for tabular prediction. Through evaluation across a test suite of 329 datasets, we find that TabuLa-8B has zero-shot accuracy on unseen tables that is over 15 percentage points (pp) higher than random guessing, a feat that is not possible with existing state-of-the-art tabular prediction models (e.g. XGBoost, TabPFN). In the few-shot setting (1-32 shots), without any fine-tuning on the target datasets, TabuLa-8B is 5-15 pp more accurate than XGBoost and TabPFN models that are explicitly trained on equal, or even up to 16x more data. We release our model, code, and data along with the publication of this paper.


title: Balancing Embedding Spectrum for Recommendation

abstract: Modern recommender systems heavily rely on high-quality representations learned from high-dimensional sparse data. While significant efforts have been invested in designing powerful algorithms for extracting user preferences, the factors contributing to good representations have remained relatively unexplored. In this work, we shed light on an issue in the existing pair-wise learning paradigm (i.e., the embedding collapse problem), that the representations tend to span a subspace of the whole embedding space, leading to a suboptimal solution and reducing the model capacity. Specifically, optimization on observed interactions is equivalent to a low pass filter causing users/items to have the same representations and resulting in a complete collapse. While negative sampling acts as a high pass filter to alleviate the collapse by balancing the embedding spectrum, its effectiveness is only limited to certain losses, which still leads to an incomplete collapse. To tackle this issue, we propose a novel method called DirectSpec, acting as a reliable all pass filter to balance the spectrum distribution of the embeddings during training, ensuring that users/items effectively span the entire embedding space. Additionally, we provide a thorough analysis of DirectSpec from a decorrelation perspective and propose an enhanced variant, DirectSpec+, which employs self-paced gradients to optimize irrelevant samples more effectively. Moreover, we establish a close connection between DirectSpec+ and uniformity, demonstrating that contrastive learning (CL) can alleviate the collapse issue by indirectly balancing the spectrum. Finally, we implement DirectSpec and DirectSpec+ on two popular recommender models: MF and LightGCN. Our experimental results demonstrate its effectiveness and efficiency over competitive baselines.


title: Unveiling and Mitigating Bias in Mental Health Analysis with Large Language Models

abstract: The advancement of large language models (LLMs) has demonstrated strong capabilities across various applications, including mental health analysis. However, existing studies have focused on predictive performance, leaving the critical issue of fairness underexplored, posing significant risks to vulnerable populations. Despite acknowledging potential biases, previous works have lacked thorough investigations into these biases and their impacts. To address this gap, we systematically evaluate biases across seven social factors (e.g., gender, age, religion) using ten LLMs with different prompting methods on eight diverse mental health datasets. Our results show that GPT-4 achieves the best overall balance in performance and fairness among LLMs, although it still lags behind domain-specific models like MentalRoBERTa in some cases. Additionally, our tailored fairness-aware prompts can effectively mitigate bias in mental health predictions, highlighting the great potential for fair analysis in this field.


title: Self-MoE: Towards Compositional Large Language Models with Self-Specialized Experts

abstract: We present Self-MoE, an approach that transforms a monolithic LLM into a compositional, modular system of self-specialized experts, named MiXSE (MiXture of Self-specialized Experts). Our approach leverages self-specialization, which constructs expert modules using self-generated synthetic data, each equipped with a shared base LLM and incorporating self-optimized routing. This allows for dynamic and capability-specific handling of various target tasks, enhancing overall capabilities, without extensive human-labeled data and added parameters. Our empirical results reveal that specializing LLMs may exhibit potential trade-offs in performances on non-specialized tasks. On the other hand, our Self-MoE demonstrates substantial improvements over the base LLM across diverse benchmarks such as knowledge, reasoning, math, and coding. It also consistently outperforms other methods, including instance merging and weight merging, while offering better flexibility and interpretability by design with semantic experts and routing. Our findings highlight the critical role of modularity and the potential of self-improvement in achieving efficient, scalable, and adaptable systems.


title: Socially Interactive Agents for Robotic Neurorehabilitation Training: Conceptualization and Proof-of-concept Study

abstract: Individuals with diverse motor abilities often benefit from intensive and specialized rehabilitation therapies aimed at enhancing their functional recovery. Nevertheless, the challenge lies in the restricted availability of neurorehabilitation professionals, hindering the effective delivery of the necessary level of care. Robotic devices hold great potential in reducing the dependence on medical personnel during therapy but, at the same time, they generally lack the crucial human interaction and motivation that traditional in-person sessions provide. To bridge this gap, we introduce an AI-based system aimed at delivering personalized, out-of-hospital assistance during neurorehabilitation training. This system includes a rehabilitation training device, affective signal classification models, training exercises, and a socially interactive agent as the user interface. With the assistance of a professional, the envisioned system is designed to be tailored to accommodate the unique rehabilitation requirements of an individual patient. Conceptually, after a preliminary setup and instruction phase, the patient is equipped to continue their rehabilitation regimen autonomously in the comfort of their home, facilitated by a socially interactive agent functioning as a virtual coaching assistant. Our approach involves the integration of an interactive socially-aware virtual agent into a neurorehabilitation robotic framework, with the primary objective of recreating the social aspects inherent to in-person rehabilitation sessions. We also conducted a feasibility study to test the framework with healthy patients. The results of our preliminary investigation indicate that participants demonstrated a propensity to adapt to the system. Notably, the presence of the interactive agent during the proposed exercises did not act as a source of distraction; instead, it positively impacted users' engagement.


title: MedCalc-Bench: Evaluating Large Language Models for Medical Calculations

abstract: As opposed to evaluating computation and logic-based reasoning, current benchmarks for evaluating large language models (LLMs) in medicine are primarily focused on question-answering involving domain knowledge and descriptive reasoning. While such qualitative capabilities are vital to medical diagnosis, in real-world scenarios, doctors frequently use clinical calculators that follow quantitative equations and rule-based reasoning paradigms for evidence-based decision support. To this end, we propose MedCalc-Bench, a first-of-its-kind dataset focused on evaluating the medical calculation capability of LLMs. MedCalc-Bench contains an evaluation set of over 1000 manually reviewed instances from 55 different medical calculation tasks. Each instance in MedCalc-Bench consists of a patient note, a question requesting to compute a specific medical value, a ground truth answer, and a step-by-step explanation showing how the answer is obtained. While our evaluation results show the potential of LLMs in this area, none of them are effective enough for clinical settings. Common issues include extracting the incorrect entities, not using the correct equation or rules for a calculation task, or incorrectly performing the arithmetic for the computation. We hope our study highlights the quantitative knowledge and reasoning gaps in LLMs within medical settings, encouraging future improvements of LLMs for various clinical calculation tasks.