title: See More Details: Efficient Image Super-Resolution by Experts Mining

abstract: Reconstructing high-resolution (HR) images from low-resolution (LR) inputs poses a significant challenge in image super-resolution (SR). While recent approaches have demonstrated the efficacy of intricate operations customized for various objectives, the straightforward stacking of these disparate operations can result in a substantial computational burden, hampering their practical utility. In response, we introduce SeemoRe, an efficient SR model employing expert mining. Our approach strategically incorporates experts at different levels, adopting a collaborative methodology. At the macro scale, our experts address rank-wise and spatial-wise informative features, providing a holistic understanding. Subsequently, the model delves into the subtleties of rank choice by leveraging a mixture of low-rank experts. By tapping into experts specialized in distinct key factors crucial for accurate SR, our model excels in uncovering intricate intra-feature details. This collaborative approach is reminiscent of the concept of "see more", allowing our model to achieve an optimal performance with minimal computational costs in efficient settings. The source will be publicly made available at https://github.com/eduardzamfir/seemoredetails


title: Perceptual Video Quality Assessment: A Survey

abstract: Perceptual video quality assessment plays a vital role in the field of video processing due to the existence of quality degradations introduced in various stages of video signal acquisition, compression, transmission and display. With the advancement of internet communication and cloud service technology, video content and traffic are growing exponentially, which further emphasizes the requirement for accurate and rapid assessment of video quality. Therefore, numerous subjective and objective video quality assessment studies have been conducted over the past two decades for both generic videos and specific videos such as streaming, user-generated content (UGC), 3D, virtual and augmented reality (VR and AR), high frame rate (HFR), audio-visual, etc. This survey provides an up-to-date and comprehensive review of these video quality assessment studies. Specifically, we first review the subjective video quality assessment methodologies and databases, which are necessary for validating the performance of video quality metrics. Second, the objective video quality assessment algorithms for general purposes are surveyed and concluded according to the methodologies utilized in the quality measures. Third, we overview the objective video quality assessment measures for specific applications and emerging topics. Finally, the performances of the state-of-the-art video quality assessment measures are compared and analyzed. This survey provides a systematic overview of both classical works and recent progresses in the realm of video quality assessment, which can help other researchers quickly access the field and conduct relevant research.


title: An end-to-end deep learning pipeline to derive blood input with partial volume corrections for automated parametric brain PET mapping

abstract: Dynamic 2-[18F] fluoro-2-deoxy-D-glucose positron emission tomography (dFDG-PET) for human brain imaging has considerable clinical potential, yet its utilization remains limited. A key challenge in the quantitative analysis of dFDG-PET is characterizing a patient-specific blood input function, traditionally reliant on invasive arterial blood sampling. This research introduces a novel approach employing non-invasive deep learning model-based computations from the internal carotid arteries (ICA) with partial volume (PV) corrections, thereby eliminating the need for invasive arterial sampling. We present an end-to-end pipeline incorporating a 3D U-Net based ICA-net for ICA segmentation, alongside a Recurrent Neural Network (RNN) based MCIF-net for the derivation of a model-corrected blood input function (MCIF) with PV corrections. The developed 3D U-Net and RNN was trained and validated using a 5-fold cross-validation approach on 50 human brain FDG PET datasets. The ICA-net achieved an average Dice score of 82.18% and an Intersection over Union of 68.54% across all tested scans. Furthermore, the MCIF-net exhibited a minimal root mean squared error of 0.0052. The application of this pipeline to ground truth data for dFDG-PET brain scans resulted in the precise localization of seizure onset regions, which contributed to a successful clinical outcome, with the patient achieving a seizure-free state after treatment. These results underscore the efficacy of the ICA-net and MCIF-net deep learning pipeline in learning the ICA structure's distribution and automating MCIF computation with PV corrections. This advancement marks a significant leap in non-invasive neuroimaging.


title: Cutoff for mixtures of permuted Markov chains: general case

abstract: We investigate the mixing properties of a finite Markov chain in random environment defined as a mixture of a deterministic chain and a chain whose state space has been permuted uniformly at random. This work is the counterpart of a companion paper where we focused on a reversible model, which allowed for a few simplifications in the proof. We consider here the general case. Under mild assumptions on the base Markov chains, we prove that with high probability the resulting chain exhibits the cutoff phenomenon at entropic time $\log n / h$, $h$ being some constant related to the entropy of the chain, when the chain is started from a typical state. However contrary to the reversible case uniform cutoff at entropic time does not hold, as we provide an example where the worst-case mixing time has at least polylogarithmic order. We also provide a polylogarithmic upper bound on the worst-case mixing time, which in fact plays a crucial role in deriving the main result for typical states. Incidentally, our proof gives a clear picture of when to expect uniform cutoff at entropic time: it appears as the consequence of a uniform transience property for the covering Markov chain used throughout the proof, which lies on an infinite state space and projects back onto the initial chain.


title: A hyperbolastic type-I diffusion process: Parameter estimation bymeans of the firefly algorithm

abstract: A stochastic diffusion process, whose mean function is a hyperbolastic curve of type I, is presented. Themain characteristics of the process are studied and the problem of maximum likelihood estimation forthe parameters of the process is considered. To this end, the firefly metaheuristic optimization algo-rithm is applied after bounding the parametric space by a stagewise procedure. Some examples basedon simulated sample paths and real data illustrate this development.


title: A Computer Vision Based Approach for Stalking Detection Using a CNN-LSTM-MLP Hybrid Fusion Model

abstract: Criminal and suspicious activity detection has become a popular research topic in recent years. The rapid growth of computer vision technologies has had a crucial impact on solving this issue. However, physical stalking detection is still a less explored area despite the evolution of modern technology. Nowadays, stalking in public places has become a common occurrence with women being the most affected. Stalking is a visible action that usually occurs before any criminal activity begins as the stalker begins to follow, loiter, and stare at the victim before committing any criminal activity such as assault, kidnapping, rape, and so on. Therefore, it has become a necessity to detect stalking as all of these criminal activities can be stopped in the first place through stalking detection. In this research, we propose a novel deep learning-based hybrid fusion model to detect potential stalkers from a single video with a minimal number of frames. We extract multiple relevant features, such as facial landmarks, head pose estimation, and relative distance, as numerical values from video frames. This data is fed into a multilayer perceptron (MLP) to perform a classification task between a stalking and a non-stalking scenario. Simultaneously, the video frames are fed into a combination of convolutional and LSTM models to extract the spatio-temporal features. We use a fusion of these numerical and spatio-temporal features to build a classifier to detect stalking incidents. Additionally, we introduce a dataset consisting of stalking and non-stalking videos gathered from various feature films and television series, which is also used to train the model. The experimental results show the efficiency and dynamism of our proposed stalker detection system, achieving 89.58% testing accuracy with a significant improvement as compared to the state-of-the-art approaches.


title: On symmetries and conservation laws of a Gardner equation involving arbitrary functions

abstract: In this work we study a generalized variable-coefficient Gardner equation from the point of view of Lie symmetries in partial differential equations. We find conservation laws by using the multipliers method of Anco and Bluman which does not require the use of a variational principle. We also construct conservation laws using Ibragimov theorem which is based on the concept of adjoint equation for nonlinear differential equations.


title: Cold Gas Subgrid Model (CGSM): A Two-Fluid Framework for Modeling Unresolved Cold Gas in Galaxy Simulations

abstract: The cold ($\sim 10^{4}\,{\rm K}$) component of the circumgalactic medium (CGM) accounts for a significant fraction of all galactic baryons. However, using current galaxy-scale simulations to determine the origin and evolution of cold CGM gas poses a significant challenge, since it is computationally infeasible to directly simulate a galactic halo alongside the sub-pc scales that are crucial for understanding the interactions between cold CGM gas and the surrounding ''hot'' medium. In this work, we introduce a new approach: the Cold Gas Subgrid Model (CGSM), which models unresolved cold gas as a second fluid in addition to the standard ''normal'' gas fluid. The CGSM tracks the total mass density and bulk momentum of unresolved cold gas, deriving the properties of its unresolved cloudlets from the resolved gas phase. The interactions between the subgrid cold fluid and the resolved fluid are modeled by prescriptions from high-resolution simulations of ''cloud crushing'' and thermal instability. Through a series of idealized tests, we demonstrate the CGSM's ability to overcome the resolution limitations of traditional hydrodynamics simulations, successfully capturing the correct cold gas mass, its spatial distribution, and the timescales for cloud destruction and growth. We discuss the implications of using this model in cosmological simulations to more accurately represent the microphysics that govern the galactic baryon cycle.


title: MUSE-ALMA Haloes X: The stellar masses of gas-rich absorbing galaxies

abstract: The physical processes by which gas is accreted onto galaxies, transformed into stars and then expelled from galaxies are of paramount importance to galaxy evolution studies. Observationally constraining each of these baryonic components in the same systems however, is challenging. Furthermore, simulations indicate that the stellar mass of galaxies is a key factor influencing CGM properties. Indeed, absorption lines detected against background quasars offer the most compelling way to study the cold gas in the circumgalactic medium (CGM). The MUSE-ALMA Haloes survey is composed of quasar fields covered with VLT/MUSE observations, comprising 32 \ion{H}{i} absorbers at 0.2 $<$ $z$ $<$ 1.4 and 79 associated galaxies, with available or upcoming molecular gas measurements from ALMA. We use a dedicated 40-orbit HST UVIS and IR WFC3 broad-band imaging campaign to characterise the stellar content of these galaxies. By fitting their spectral energy distribution, we establish they probe a wide range of stellar masses: 8.1 $<$ log($M_*$/M$_{\odot}$) $<$ 12.4. Given their star-formation rates, most of these objects lie on the main sequence of galaxies. We also confirm a previously reported anti-correlation between the stellar masses and CGM hydrogen column density N(\ion{H}{i}), indicating an evolutionary trend where higher mass galaxies are less likely to host large amounts of \ion{H}{i} gas in their immediate vicinity up to 120 kpc. Together with other studies from the MUSE-ALMA Haloes survey, these data provide stellar masses of absorber hosts, a key component of galaxy formation and evolution, and observational constraints on the relation between galaxies and their surrounding medium.


title: Coherent collisional decoherence

abstract: We study the decoherence of a system of $N$ non-interacting heavy particles (atoms) due to coherent scattering with a background gas. We introduce a new framework for computing the induced phase shift and loss of contrast for arbitrary preparations of $N$-particle quantum states. We find new phase shifts that are inherently $(N\geq 2)$-body effects and may be searched for in future experiments. We analyze simple setups, including a two-mode approximation of an interferometer. We study fully entangled $N00N$ states, which resemble the correlated positions in a matter interferometer, as well as totally uncorrelated product states that are representative of a typical state in an atom interferometer. We find that the extent to which coherent enhancements increase the rate of decoherence depends on the observable of interest, state preparation, and details of the experimental design.

categories: quant-ph cond-mat.quant-gas hep-ph physics.atom-ph


title: The Heterogeneous Surface of Asteroid (16) Psyche

abstract: Main-belt asteroid (16) Psyche is the largest M-type asteroid, a class of object classically thought to be the metal cores of differentiated planetesimals and the parent bodies of the iron meteorites. de Kleer, Cambioni, and Shepard (2021, https://doi.org/10.3847/psj/ac01ec) presented new data from the Atacama Large Millimeter Array (ALMA), from which they derived a global best-fit thermal inertia and dielectric constant for Psyche, proxies for regolith particle size, porosity, and/or metal content, and observed thermal anomalies that could not be explained by surface albedo variations only. Motivated by this, here we fit a model to the same ALMA data set that allows dielectric constant and thermal inertia to vary across the surface. We find that Psyche has a heterogeneous surface in both dielectric constant and thermal inertia but, intriguingly, we do not observe a direct correlation between these two properties over the surface. We explain the heterogeneity in dielectric constant as being due to variations in the relative abundance of metal and silicates. Furthermore, we observe that the lowlands of a large depression in Psyche's shape have distinctly lower thermal inertia than the surrounding highlands. We propose that the latter could be explained by a thin mantle of fine regolith, fractured bedrock, and/or implanted silicate-rich materials covering an otherwise metal-rich surface. All these scenarios are indicative of a collisionally evolved world.


title: Do Red Galaxies Form More Stars Than Blue Galaxies?

abstract: A new model is proposed in which typical galaxies form most of their stellar mass in a phase with an intrinsically red stellar population. In the standard picture, galaxies with intrinsically red stellar populations are believed to have old stellar populations, so that only galaxies with blue stellar populations have significant star formation, and subsequent changes to the stellar population come from predominantly from aging and merging populations which have already formed. However, several observational puzzles have developed which are difficult to reconcile with this standard scenario. The most massive blue star-forming galaxies, presumed to be at the end of their stellar mass growth, are $\sim 1$ dex less massive, have a $\sim 1$ dex lower $M_*/M_{BH}$ ratio, and have a bottom-lighter IMF than local quiescent galaxies. Here, a new solution is proposed: at low temperature and high metallicity, galaxies can continue to form stars efficiently without being able to form O and B stars. These red star-forming galaxies would have many of the same properties of the population currently described as post-starburst galaxies, allowing a new interpretation of their origin. Finally, additional falsifiable observational predictions of this model are also discussed.


title: Discrete Global Symmetries: Gauging and Twisted Compactification

abstract: Discrete global symmetries of 4d $\mathcal{N}=2$ SCFTs are studied via two operations: gauging and twisted compactification. We consider gauging of discrete symmetries in several well-known 4d $\mathcal{N}=2$ SCFTs, including $\mathrm{SU}(n)$ SQCD with $2n$ flavors, theories of class $\mathcal{S}$ of type $A_{2n-1}$, and Argyres--Douglas theories of type $(A_N, A_N)$, as well as propose new 4d SCFTs as a result. The wreathing technique, which involves gauging a subgroup of the automorphism group of the quiver diagram of the corresponding 3d mirror theory, is exploited. This allows us to understand several properties of discretely gauged theories, including moduli spaces and how discrete gauging affects the mixed 't Hooft anomaly between the 1-form symmetry and the 0-form flavor symmetry. Many examples are viewed through the lens of the Argyres--Seiberg duality and its generalization. We also examine discrete gauging of $\mathrm{SU}(2)$ SQCD with 4 flavors by various $\mathbb{Z}_2$ and $\mathbb{Z}_2 \times \mathbb{Z}_2$ subgroups of the permutation group $S_4$ using the superconformal index. Regarding compactification, we propose a magnetic quiver for 4d $\mathcal{N}=2$ $\mathrm{SU}(n)$ SQCD with $2n$ flavors compactified on a circle with a $\mathbb{Z}_2$ twist. The twisted compactification by non-invertible symmetries of the 4d $\mathcal{N}=4$ SYM theory with gauge group $\mathrm{SU}(N)$ is revisited. The non-invertible symmetry naturally gives rise to a $\mathbb{Z}_k$ action on the scalar fields parametrizing the moduli space. Upon examining the $\mathbb{Z}_k$ invariant chiral ring of the Higgs branch, we find that, in addition to the largest branch of the moduli space that is expected to be captured by the ABJ(M) theory, there exist in general nilpotent operators that lead to a branch of the moduli space which is a radical ideal.


title: Cryptographic Censorship

abstract: We formulate and take two large strides towards proving a quantum version of the weak cosmic censorship conjecture. We first prove "Cryptographic Censorship": a theorem showing that when the time evolution operator of a holographic CFT is approximately pseudorandom (or Haar random) on some code subspace, then there must be an event horizon in the corresponding bulk dual. This result provides a general condition that guarantees (in finite time) event horizon formation, with minimal assumptions about the global spacetime structure. Our theorem relies on an extension of a recent quantum learning no-go theorem and is proved using new techniques of pseudorandom measure concentration. To apply this result to cosmic censorship, we separate singularities into classical, semi-Planckian, and Planckian types. We illustrate that classical and semi-Planckian singularities are compatible with approximately pseudorandom CFT time evolution; thus, if such singularities are indeed approximately pseudorandom, by Cryptographic Censorship, they cannot exist in the absence of event horizons. This result provides a sufficient condition guaranteeing that seminal holographic results on quantum chaos and thermalization, whose general applicability relies on typicality of horizons, will not be invalidated by the formation of naked singularities in AdS/CFT.


title: Primordial Black Holes from Axion Domain Wall Collapse

abstract: The QCD axion can solve the Strong CP Problem and be the dark matter of our universe. If the PQ symmetry breaking scale associated with the axion is below the inflationary reheating temperature, axion strings and domain walls populate the universe. Most of these strings and walls decay away into axion dark matter, but a small subset of the walls will be self-enclosed surfaces that are not attached to any strings. These enclosed walls can collapse in on themselves, compressing a large amount of energy into a small volume and potentially forming primordial black holes (PBHs). We study the number density and dynamics of these self-enclosed walls, taking into account their size distribution, Hubble expansion, asphericities, and all stages of domain wall dynamics using a combination of semi-analytic and numerical approaches. We find that axion models with a high axion decay constant $f_a$, such as those of interest in early matter-dominated cosmologies, yield a PBH abundance potentially observable by future gravitational lensing surveys. We note that the formalism developed here is also useful for predicting relic PBH abundances in other models that exhibit unstable domain walls.


title: BAO cosmology in non-spatially flat background geometry from BOSS+eBOSS and lessons for future surveys

abstract: We study the impact of the assumption of a non-flat fiducial cosmology on the measurement, analysis and interpretation of BAO distance variables, along and across the line-of-sight. The assumption about cosmology enters in the choice of the base template, as well as on the transformation of tracer's redshifts into distances (the catalog cosmology): here we focus on the curvature assumption, separately and jointly, on both. We employ BOSS and eBOSS publicly available data and show that for the statistical precision of this data set, distance measures and thus cosmological inference are robust to assumptions about curvature both of the template and the catalog. Thus the usual assumptions of flat fiducial cosmologies (but also assumptions of non-flat cosmologies) do not produce any detectable systematic effects. For forthcoming large-volume surveys, however, small but appreciable residual systematic shifts can be generated which may require some care. These are mostly driven by the choice of catalog cosmology if it is significantly different from true cosmology. In particular, the catalog (and template) cosmology should be chosen, possibly iteratively, in such a way that the recovered BAO scaling variables are sufficiently close to unity. At this level of precision, however, other previously overlooked effects become relevant, such as a mismatch between the sound horizon as seen in the BAO and the actual sound horizon in the early Universe. If unaccounted for, such effect may be misinterpreted as cosmological and thus bias the curvature (and cosmology) constraints. We present best practices to avoid this.


title: Explaining the high nitrogen abundances observed in high-z galaxies via population III stars of a few thousand solar masses

abstract: The chemical enrichment of the early Universe is a crucial element in the formation and evolution of galaxies, and Population III (PopIII) stars must play a vital role in this process. In this study, we examine metal enrichment from massive stars in the early Universe's embryonic galaxies. Using radiation hydrodynamic simulations and stellar evolution modelling, we calculated the expected metal yield from these stars. Specifically, we applied accretion rates from a previous radiation-hydrodynamic simulation to inform our stellar evolution modelling, executed with the Geneva code, across 11 selected datasets, with final stellar masses between 500 and 9000 Msol. Our results demonstrate that the first generation of Pop III stars within a mass range of 2000 to 9000 Msol result in N/O, C/O and O/H ratios compatible with the values observed in very high-z galaxies GN-z11 and CEERS 1019. The ejecta of these Pop III stars are predominantly composed of He, H, and N. Our Pop III chemical enrichment model of the halo can accurately reproduce the observed N/O and C/O ratios, and, by incorporating a hundred times more zero-metallicity interstellar material with the stellar ejecta, it accurately attains the observed O/H ratio. Thus, a sub-population of extremely massive PopIII stars, with masses surpassing approximately 2000 Msol, effectively reproduces the CNO elemental abundances observed in high-z JWST galaxies to date.


title: Microscopic inclusion statistics in a discrete 1-body spectrum

abstract: We present the microscopic formulation of inclusion statistics, a counterpoint to exclusion statistics in which particles tend to coalesce more than ordinary bosons. We derive the microscopic occupation multiplicities of 1-body quantum states and show that they factorize into a product of clusters of neighbouring occupied states with enhanced statistical weights. Applying this statistics to a one-dimensional gas of particles in a harmonic well leads to a Calogero-like n-body inclusion spectrum with interesting physical properties.


title: Collisionless relaxation from near equilibrium configurations: Linear theory and application to tidal stripping

abstract: Placed slightly out of dynamical equilibrium, an isolated stellar system quickly returns towards a steady virialized state. We study this process of collisionless relaxation using the matrix method of linear response theory. We show that the full phase space distribution of the final virialized state can be recovered directly from the disequilibrium initial conditions, without the need to compute the time evolution of the system. This shortcut allows us to determine the final virialized configuration with minimal computational effort. Complementing this result, we develop tools to model the system's full time evolution in the linear approximation. In particular, we show that moments of the velocity distribution can be efficiently computed using a generalized moment matrix. We apply our linear methods to study the relaxation of energy-truncated Hernquist spheres, mimicking the tidal stripping of a cuspy dark matter subhalo. Comparison of our linear predictions against controlled, isolated $N$-body simulations shows agreement at per cent level for the parts of the system where a linear response to the perturbation is expected. We find that relaxation generates a tangential velocity anisotropy in the intermediate regions, despite the initial disequilibrium state having isotropic kinematics. We further confirm that relaxation is responsible for depleting the amplitude of the density cusp, without affecting its asymptotic slope. Finally, we compare the linear theory against $N$-body simulation of tidal stripping on a radial orbit, confirming that the theory still accurately predicts density and velocity dispersion profiles for most of the system.


title: Probing Earth-Bound Dark Matter with Nuclear Reactors

abstract: Strongly-interacting dark matter can be accumulated in large quantities inside the Earth, and for dark matter particles in a few GeV mass range, it can exist in large quantities near the Earth's surface. We investigate the constraints imposed on such dark matter properties by its upscattering by fast neutrons in nuclear reactors with subsequent scattering in nearby well-shielded dark matter detectors, schemes which are already used for searches of the coherent reactor neutrino scattering. We find that the existing experiments cover new parameter space on the spin-dependent interaction between dark matter and the nucleon. Similar experiments performed with research reactors, and lesser amount of shielding, may provide additional sensitivity to strongly-interacting dark matter.


title: SRF Cavity as Galactic Dark Photon Telescope

abstract: Dark photons, aside from constituting non-relativistic dark matter, can also be generated relativistically through the decay or annihilation of other dark matter candidates, contributing to a galactic dark photon background. The production of dark photons tends to favor specific polarization modes, determined by the microscopic coupling between dark matter and dark photons. We leverage data obtained from previous searches for dark photon dark matter using a superconducting radio-frequency cavity to explore galactic dark photon fluxes. The interplay of anisotropic directions and Earth's rotation introduces a diurnal modulation of signals within the cavities, manifesting distinct variation patterns for longitudinal and transverse modes. Our findings highlight the efficacy of superconducting radio-frequency cavities, characterized by significantly high-quality factors, as powerful telescopes for detecting galactic dark photons, unveiling a novel avenue in the indirect search for dark matter through multi-messenger astronomy.

categories: hep-ph astro-ph.HE gr-qc hep-ex physics.acc-ph


title: Sequential Adiabatic Generation of Chiral Topological States

abstract: In previous work, it was shown that non-trivial gapped states can be generated from a product state using a sequential quantum circuit. Explicit circuit constructions were given for a variety of gapped states at exactly solvable fixed points. In this paper, we show that a similar generation procedure can be established for chiral topological states as well, despite the fact that they lack an exactly solvable form. Instead of sequentially applying local unitary gates, we sequentially evolve the Hamiltonian by changing local terms in one subregion and then the next. The Hamiltonian remains gapped throughout the process, giving rise to an adiabatic evolution mapping the ground state from a product state to a chiral topological state. We demonstrate such a sequential adiabatic generation process for free fermion chiral states like the Chern Insulator and the $p+ip$ superconductor. Moreover, we show that coupling a quantum state to a discrete gauge group can be achieved through a sequential quantum circuit, thereby generating interacting chiral topological states from the free fermion ones.


title: Quantum mechanical bootstrap on the interval: obtaining the exact spectrum

abstract: We show that for a particular model, the quantum mechanical bootstrap is capable of finding exact results. We consider a solvable system with Hamiltonian $H=SZ(1-Z)S$, where $Z$ and $S$ satisfy canonical commutation relations. While this model may appear unusual, using an appropriate coordinate transformation, the Schr\"odinger equation can be cast into a standard form with a P\"oschl-Teller-type potential. Since the system is defined on an interval, it is well-known that $S$ is not self-adjoint. Nevertheless, the bootstrap method can still be implemented, producing an infinite set of positivity constraints. Using a certain operator ordering, the energy eigenvalues are only constrained into bands. With an alternative ordering, however, we find that a finite number of constraints is sufficient to fix the low-lying energy levels exactly.


title: Psychological Assessments with Large Language Models: A Privacy-Focused and Cost-Effective Approach

abstract: This study explores the use of Large Language Models (LLMs) to analyze text comments from Reddit users, aiming to achieve two primary objectives: firstly, to pinpoint critical excerpts that support a predefined psychological assessment of suicidal risk; and secondly, to summarize the material to substantiate the preassigned suicidal risk level. The work is circumscribed to the use of "open-source" LLMs that can be run locally, thereby enhancing data privacy. Furthermore, it prioritizes models with low computational requirements, making it accessible to both individuals and institutions operating on limited computing budgets. The implemented strategy only relies on a carefully crafted prompt and a grammar to guide the LLM's text completion. Despite its simplicity, the evaluation metrics show outstanding results, making it a valuable privacy-focused and cost-effective approach. This work is part of the Computational Linguistics and Clinical Psychology (CLPsych) 2024 shared task.


title: Euclid preparation. Optical emission-line predictions of intermediate-z galaxy populations in GAEA for the Euclid Deep and Wide Surveys

abstract: In anticipation of the Euclid Wide and Deep Surveys, we present optical emission-line predictions at intermediate redshifts from 0.4 to 2.5. Our approach combines a mock light cone from the GAEA semi-analytic model to self-consistently model nebular emission from HII regions, narrow-line regions of active galactic nuclei (AGN), and evolved stellar populations. Our analysis focuses on seven optical emission lines: H$\alpha$, H$\beta$, [SII]$\lambda\lambda 6717, 6731$, [NII]$\lambda 6584$, [OI]$\lambda 6300$, [OIII]$\lambda 5007$, and [OII]$\lambda\lambda 3727, 3729$. We find that Euclid will predominantly observe massive, star-forming, and metal-rich line-emitters. Interstellar dust, modelled using a Calzetti law with mass-dependent scaling, may decrease observable percentages by a further 20-30% with respect to our underlying emission-line populations from GAEA. We predict Euclid to observe around 30-70% of H$\alpha$-, [NII]-, [SII]-, and [OIII]-emitting galaxies at redshift below 1 and under 10% at higher redshift. Observability of H$\beta$-, [OII]-, and [OI]- emission is limited to below 5%. For the Euclid-observable sample, we find that BPT diagrams can effectively distinguish between different galaxy types up to around redshift 1.8, attributed to the bias toward metal-rich systems. Moreover, we show that the relationships of H$\alpha$ and [OIII]+H$\beta$ to the star-formation rate, and the [OIII]-AGN luminosity relation, exhibit minimal changes with increasing redshift. Based on line ratios [NII]/H$\alpha$, [NII]/[OII], and [NII]/[SII], we further propose novel z-invariant tracers for the black hole accretion rate-to-star formation rate ratio. Lastly, we find that commonly used metallicity estimators display gradual shifts in normalisations with increasing redshift, while maintaining the overall shape of local calibrations. This is in tentative agreement with recent JWST data.


title: Associahedra as moment polytopes

abstract: Generalized associahedra are a well-studied family of polytopes associated to a finite-type cluster algebra and choice of starting cluster. We show that the generalized associahedra constructed by Padrol, Palu, Pilaud, and Plamondon, building on ideas from Arkani-Hamed, Bai, He, and Yan, can be naturally viewed as moment polytopes for an open patch of the quotient of the cluster A-variety with universal coefficients by its maximal natural torus action. We prove our result by showing that the construction of Padrol, Palu, Pilaud, and Plamondon can be understood on the basis of the way that moment polytopes behave under symplectic reduction.


title: Quantum Decoherence Effects: a complete treatment

abstract: Physical systems in real life are inextricably linked to their surroundings and never completely separated from them. Truly closed systems do not exist. The phenomenon of decoherence, which is brought about by the interaction with the environment, removes the relative phase of quantum states in superposition and makes them incoherent. In neutrino physics, decoherence, although extensively studied has only been analyzed thus far, exclusively in terms of its dissipative characteristics. While it is true that dissipation, or the exponential suppression, eventually is the main observable effect, the exchange of energy between the medium and the system, is an important factor that has been overlooked up until now. In this work, we introduce this term and analyze its consequences.


title: Nonlocal growth of quantum conditional mutual information under decoherence

abstract: Local measurements cannot create entanglement, but they can convert short-range entanglement to long-range entanglement, as in quantum teleportation. This phenomenon of measurement-induced entanglement (MIE) has been widely discussed in recent work on measurement-induced entanglement phase transitions and related phenomena. Here, we situate MIE in a broader context of the growth of long-range conditional mutual information (CMI) under decoherence. We upper-bound the rate at which decoherence can generate long-range CMI, and derive a characterization of states that saturate this bound. We point out that the structure of states saturating the CMI upper bound can be very different under different decoherent dynamics and provide explicit examples. We additionally explore the dynamics of CMI in random quantum circuits subject to random local decoherence, as a function of circuit depth. We argue that the universality class of the finite-depth teleportation transition, as well as its lower critical dimension, are different for erasures than for measurements.


title: Improved reconstruction of solar magnetic fields from imaging spectropolarimetry through spatio-temporal regularisation

abstract: Determination of solar magnetic fields with a spatial resolution set by the diffraction limit of a telescope is difficult because the time required to measure the Stokes vector with sufficient signal-to-noise is long compared to the solar evolution timescale. This difficulty gets worse with increasing telescope size as the photon flux per diffraction-limited resolution element remains constant but the evolution timescale decreases linearly with the diffraction-limited resolution. We aim to improve magnetic field reconstruction at the diffraction limit without averaging the observations in time or space, and without applying noise filtering. The magnetic field vector tends to evolve slower than the temperature, velocity and microturbulence. We exploit this by adding temporal regularisation terms for the magnetic field to the linear least-squares fitting used in the weak-field approximation, as well as to the Levenberg-Marquardt algorithm used in inversions. The other model parameters are allowed to change in time without constraints. We infer the chromospheric magnetic field from Ca II 854.2 nm observations using the weak field approximation and the photospheric magnetic field from Fe I 617.3 nm observations using Milne-Eddington inversions, both with and without temporal regularisation. Temporal regularisation reduce the noise in the reconstructed maps of the magnetic field and provides a better coherency in time in both the weak-field approximation and Milne-Eddington inversions. Temporal regularisation markedly improves magnetic field determination from spatially and temporally resolved observations.


title: Eccentricity Distribution Beyond the Snow Line and Implications for Planetary Habitability

abstract: A fundamental question in the study of planetary system demographics is: how common is the solar system architecture? The primary importance of this question lies in the potential of planetary systems to create habitable environments, and dissecting the various components of solar system evolution that contributed to a sustainable temperate surface for Earth. One important factor in that respect is volatile delivery to the inner system and the dependence on giant planets beyond the snow line as scattering agents, particularly as such cold giant planets are relatively rare. Here, we provide an investigation of the eccentricity distribution for giant planet populations both interior and exterior to their system snow lines. We show that the median eccentricity for cold giants is 0.23, compared with a far more circular orbital regime for inner planets. We further present the results of a dynamical simulation that explores the particle scattering potential for a Jupiter analog in comparison with a Jupiter whose eccentricity matches that of the median cold giant eccentricity. These simulations demonstrate that the capacity for such an eccentric cold giant system to scatter volatiles interior to the snow line is significantly increased compared with the Jupiter analog case, resulting in a far greater volume of Earth-crossing volatiles. Thus, many of the known systems with cold giant planets may harbor water worlds interior to the snow line.


title: Nematic heavy fermions and coexisting magnetic order in CeSiI

abstract: Motivated by the recent discovery of magnetism and heavy quasiparticles in van der Waals material CeSiI, we develop an effective model that incorporates the conduction electrons residing at the silicene layer interacting with the local moments of the Ce ions. Ce sites are arranged on two layers of triangular lattices, above and below the silicene layer, and they are located at the center of the honeycomb lattice. This arrangement results in an effective extended Kondo interaction along with a predominant ferromagnetic RKKY interaction. Via mean-field theory of Abrikosov fermions, our analysis indicates that the ground state of the monolayer can exhibit a non-magnetic nematic heavy fermion phase that breaks $C_6$ rotational symmetry for small Heisenberg exchange and a magnetically ordered phase for large Heisenberg exchange. For intermediate values, a coexistence of magnetic order and a uniform heavy Fermi liquid is stabilized where they reside on separate Ce layers. We show that this phase can further be enhanced by an external electric field. Our results provide a natural mechanism for the coexistence of magnetic order and heavy fermions in CeSiI and highlight the possibility of unconventional non-magnetic heavy fermions with broken rotational symmetry.


title: Strong lensing of tidal disruption events: Detection rates in imaging surveys

abstract: Tidal disruption events (TDEs) are multi-messenger transients in which a star is tidally destroyed by a supermassive black hole at the center of galaxies. The Rubin Observatory Legacy Survey of Space and Time (LSST) is anticipated to annually detect hundreds to thousands of TDEs, such that the first gravitationally lensed TDE may be observed in the coming years. Using Monte-Carlo simulations, we quantify the rate of both unlensed and lensed TDEs as a function of limiting magnitudes in four different optical bands ($u$, $g$, $r$, and $i$) for a range of TDE temperatures that match observations. Dependent on the temperature and luminosity model, we find that $g$ and $r$ bands are the most promising bands with unlensed TDE detections that can be as high as ${\sim}10^{4}$ annually. By populating a cosmic volume with realistic distributions of TDEs and galaxies that can act as gravitational lenses, we estimate that a few lensed TDEs (depending on the TDE luminosity model) can be detected annually in $g$ or $r$ bands in the LSST survey, with TDE redshifts in the range of ${\sim}0.5$ to ${\sim}2$. The ratio of lensed to unlensed detections indicates that we may detect ${\sim}1$ lensed event for every $10^{4}$ unlensed events, which is independent of the luminosity model. The number of lensed TDEs decreases as a function of the image separations and time delays, and most of the lensed TDE systems are expected to have image separations below ${\sim}3"$ and time delays within ${\sim}30$ days. At fainter limiting magnitudes, the $i$ band becomes notably more successful. These results suggest that strongly lensed TDEs are likely to be observed within the coming years and such detections will enable us to study the demographics of black holes at higher redshifts through the lensing magnifications.


title: Straightening laws for Chow rings of matroids

abstract: We give elementary and non-inductive proofs of three fundamental theorems about Chow rings of matroids: the standard monomial basis, Poincare duality, and the dragon-Hall-Rado formula. Our approach, which also works for augmented Chow rings of matroids, is based on a straightening law. This approach also gives a decomposition of the Chow ring of a matroid into pieces indexed by flats.


title: Denoising Diffusion via Image-Based Rendering

abstract: Generating 3D scenes is a challenging open problem, which requires synthesizing plausible content that is fully consistent in 3D space. While recent methods such as neural radiance fields excel at view synthesis and 3D reconstruction, they cannot synthesize plausible details in unobserved regions since they lack a generative capability. Conversely, existing generative methods are typically not capable of reconstructing detailed, large-scale scenes in the wild, as they use limited-capacity 3D scene representations, require aligned camera poses, or rely on additional regularizers. In this work, we introduce the first diffusion model able to perform fast, detailed reconstruction and generation of real-world 3D scenes. To achieve this, we make three contributions. First, we introduce a new neural scene representation, IB-planes, that can efficiently and accurately represent large 3D scenes, dynamically allocating more capacity as needed to capture details visible in each image. Second, we propose a denoising-diffusion framework to learn a prior over this novel 3D scene representation, using only 2D images without the need for any additional supervision signal such as masks or depths. This supports 3D reconstruction and generation in a unified architecture. Third, we develop a principled approach to avoid trivial 3D solutions when integrating the image-based rendering with the diffusion model, by dropping out representations of some images. We evaluate the model on several challenging datasets of real and synthetic images, and demonstrate superior results on generation, novel view synthesis and 3D reconstruction.


title: Entanglement asymmetry in CFT and its relation to non-topological defects

abstract: The entanglement asymmetry is an information based observable that quantifies the degree of symmetry breaking in a region of an extended quantum system. We investigate this measure in the ground state of one dimensional critical systems described by a CFT. Employing the correspondence between global symmetries and defects, the analysis of the entanglement asymmetry can be formulated in terms of partition functions on Riemann surfaces with multiple non-topological defect lines inserted at their branch cuts. For large subsystems, these partition functions are determined by the scaling dimension of the defects. This leads to our first main observation: at criticality, the entanglement asymmetry acquires a subleading contribution scaling as $\log \ell / \ell$ for large subsystem length $\ell$. Then, as an illustrative example, we consider the XY spin chain, which has a critical line described by the massless Majorana fermion theory and explicitly breaks the $U(1)$ symmetry associated with rotations about the $z$-axis. In this situation the corresponding defect is marginal. Leveraging conformal invariance, we relate the scaling dimension of these defects to the ground state energy of the massless Majorana fermion on a circle with equally-spaced point defects. We exploit this mapping to derive our second main result: the exact expression for the scaling dimension associated with $n$ of defects of arbitrary strengths. Our result generalizes a known formula for the $n=1$ case derived in several previous works. We then use this exact scaling dimension to derive our third main result: the exact prefactor of the $\log \ell/\ell$ term in the asymmetry of the critical XY chain.


title: Challenges in Variable Importance Ranking Under Correlation

abstract: Variable importance plays a pivotal role in interpretable machine learning as it helps measure the impact of factors on the output of the prediction model. Model agnostic methods based on the generation of "null" features via permutation (or related approaches) can be applied. Such analysis is often utilized in pharmaceutical applications due to its ability to interpret black-box models, including tree-based ensembles. A major challenge and significant confounder in variable importance estimation however is the presence of between-feature correlation. Recently, several adjustments to marginal permutation utilizing feature knockoffs were proposed to address this issue, such as the variable importance measure known as conditional predictive impact (CPI). Assessment and evaluation of such approaches is the focus of our work. We first present a comprehensive simulation study investigating the impact of feature correlation on the assessment of variable importance. We then theoretically prove the limitation that highly correlated features pose for the CPI through the knockoff construction. While we expect that there is always no correlation between knockoff variables and its corresponding predictor variables, we prove that the correlation increases linearly beyond a certain correlation threshold between the predictor variables. Our findings emphasize the absence of free lunch when dealing with high feature correlation, as well as the necessity of understanding the utility and limitations behind methods in variable importance estimation.


title: Decentralized Sporadic Federated Learning: A Unified Algorithmic Framework with Convergence Guarantees

abstract: Decentralized federated learning (DFL) captures FL settings where both (i) model updates and (ii) model aggregations are exclusively carried out by the clients without a central server. Existing DFL works have mostly focused on settings where clients conduct a fixed number of local updates between local model exchanges, overlooking heterogeneity and dynamics in communication and computation capabilities. In this work, we propose Decentralized Sporadic Federated Learning (DSpodFL), a DFL methodology built on a generalized notion of sporadicity in both local gradient and aggregation processes. DSpodFL subsumes many existing decentralized optimization methods under a unified algorithmic framework by modeling the per-iteration (i) occurrence of gradient descent at each client and (ii) exchange of models between client pairs as arbitrary indicator random variables, thus capturing heterogeneous and time-varying computation/communication scenarios. We analytically characterize the convergence behavior of DSpodFL for both convex and non-convex models, for both constant and diminishing learning rates, under mild assumptions on the communication graph connectivity, data heterogeneity across clients, and gradient noises, and show how our bounds recover existing results as special cases. Experiments demonstrate that DSpodFL consistently achieves improved training speeds compared with baselines under various system settings.


title: Extending RAIM with a Gaussian Mixture of Opportunistic Information

abstract: GNSS are indispensable for various applications, but they are vulnerable to spoofing attacks. The original receiver autonomous integrity monitoring (RAIM) was not designed for securing GNSS. In this context, RAIM was extended with wireless signals, termed signals of opportunity (SOPs), or onboard sensors, typically assumed benign. However, attackers might also manipulate wireless networks, raising the need for a solution that considers untrustworthy SOPs. To address this, we extend RAIM by incorporating all opportunistic information, i.e., measurements from terrestrial infrastructures and onboard sensors, culminating in one function for robust GNSS spoofing detection. The objective is to assess the likelihood of GNSS spoofing by analyzing locations derived from extended RAIM solutions, which include location solutions from GNSS pseudorange subsets and wireless signal subsets of untrusted networks. Our method comprises two pivotal components: subset generation and location fusion. Subsets of ranging information are created and processed through positioning algorithms, producing temporary locations. Onboard sensors provide speed, acceleration, and attitude data, aiding in location filtering based on motion constraints. The filtered locations, modeled with uncertainty, are fused into a composite likelihood function normalized for GNSS spoofing detection. Theoretical assessments of GNSS-only and multi-infrastructure scenarios under uncoordinated and coordinated attacks are conducted. The detection of these attacks is feasible when the number of benign subsets exceeds a specific threshold. A real-world dataset from the Kista area is used for experimental validation. Comparative analysis against baseline methods shows a significant improvement in detection accuracy achieved by our Gaussian Mixture RAIM approach. Moreover, we discuss leveraging RAIM results for plausible location recovery.


title: Recommendation Fairness in Social Networks Over Time

abstract: In social recommender systems, it is crucial that the recommendation models provide equitable visibility for different demographic groups, such as gender or race. Most existing research has addressed this problem by only studying individual static snapshots of networks that typically change over time. To address this gap, we study the evolution of recommendation fairness over time and its relation to dynamic network properties. We examine three real-world dynamic networks by evaluating the fairness of six recommendation algorithms and analyzing the association between fairness and network properties over time. We further study how interventions on network properties influence fairness by examining counterfactual scenarios with alternative evolution outcomes and differing network properties. Our results on empirical datasets suggest that recommendation fairness improves over time, regardless of the recommendation method. We also find that two network properties, minority ratio, and homophily ratio, exhibit stable correlations with fairness over time. Our counterfactual study further suggests that an extreme homophily ratio potentially contributes to unfair recommendations even with a balanced minority ratio. Our work provides insights into the evolution of fairness within dynamic networks in social science. We believe that our findings will help system operators and policymakers to better comprehend the implications of temporal changes and interventions targeting fairness in social networks.


title: Non-zero to zero curvature transition: Operators along hybrid curves with no quadratic (quasi-)resonances

abstract: Building on arXiv:1902.03807, this paper develops a unifying study on the boundedness properties of several representative classes of hybrid operators, i.e. operators that enjoy both zero and non-zero curvature features. Specifically, via the LGC-method, we provide suitable $L^p$ bounds for three classes of operators: (1) Carleson-type operators, (2) Hilbert transform along variable curves, and, taking the center stage, (3) Bilinear Hilbert transform and bilinear maximal operators along curves. All these classes of operators will be studied in the context of hybrid curves with no quadratic resonances. The above study is interposed between two naturally derived topics: i) A prologue providing a first rigorous account on how the presence/absence of a higher order modulation invariance property interacts with and determines the nature of the method employed for treating operators with such a property. ii) An epilogue revealing how several key ingredients within our present study can blend and inspire a short, intuitive new proof of the smoothing inequality that plays the central role in the analysis of the curved version of the triangular Hilbert transform treated in arXiv:2008.10140.


title: Nanosecond stochastic operation in perpendicular superparamagnetic tunnel junctions

abstract: We demonstrate the miniaturization of perpendicularly magnetized superparamagnetic tunnel junctions (SMTJs) down to 50 nm in diameter. We experimentally show stochastic reversals in those junctions, with tunable mean dwell times down to a few nanoseconds through applied magnetic field and voltage. The mean dwell times measured at negligible bias voltage agree with our simulations based on Langer's theory. We shed light on an Arrhenius prefactor $\tau_0$ of a few femtoseconds, implying that the rates of thermally-activated magnetic transitions exceed the GHz-to-THz limitation of macrospin models, whereby $\tau_0\sim1$ ns. We explain the small prefactor values by a Meyer-Neldel compensation phenomenon, where the prefactor exhibits a large entropic contribution with an exponential dependence on the activation energy. These findings pave the way towards the development of ultrafast, low-power unconventional computing schemes operating by leveraging thermal noise in perpendicular SMTJs, which are scalable below 20 nm.


title: Ward Identities for Superamplitudes

abstract: We introduce Ward identities for superamplitudes in D-dimensional N-extended supergravities. These identities help to clarify the relation between linearized superinvariants and superamplitudes. The solutions of these Ward identities for an $n$-partice superamplitude take a simple universal form for half-BPS and non-BPS amplitudes. These solutions involve arbitrary functions of spinor helicity and Grassmann variables for each of the $n$ superparticles. The dimension of these functions at a given loop order is exactly the same as the dimension of the relevant superspace Lagrangians depending on half-BPS or non-BPS superfields, given by $(D-2) L +2- N$ or $(D-2) L +2- 2 N$, respectively. This explains why soft limits predictions from superamplitudes and from superspace linearized superinvariants agree.


title: Dependence on laser intensity of the number-weighted angular distribution of Compton-scattered photon beams

abstract: Inverse Compton scattering of an ultra-relativistic electron in the field of a high-intensity laser produces photon beams with angular and spectral distributions that are strongly dependent on the laser intensity. Here, we show that the laser intensity at the interaction point can be accurately inferred from the measurement of the angular number-density distribution of Compton-scattered photon beams. The theory, corroborated by numerical simulations, is accurate to within 10\% in a wide range of laser intensities (dimensionless intensity $5 \leq a_0 \leq 50$) and electron energies (250 MeV $\leq E \leq $ 15 GeV), and accounts for experimental features such as the finite transverse size of the electron beam, low-energy cut-offs in the photon detector, and the possibility of a transverse misalignment between the electron beam and the laser focus.


title: Median and Small Parsimony Problems on RNA trees

abstract: Motivation: Non-coding RNAs (ncRNAs) express their functions by adopting molecular structures. Specifically, RNA secondary structures serve as a relatively stable intermediate step before tertiary structures, offering a reliable signature of molecular function. Consequently, within an RNA functional family, secondary structures are generally more evolutionarily conserved than sequences. Conversely, homologous RNA families grouped within an RNA clan share ancestors but typically exhibit structural differences. Inferring the evolution of RNA structures within RNA families and clans is crucial for gaining insights into functional adaptations over time and providing clues about the Ancient RNA World Hypothesis. Results: We introduce the median problem and the small parsimony problem for ncRNA families, where secondary structures are represented as leaf-labelled trees. We utilize the Robinson-Foulds (RF) tree distance, which corresponds to a specific edit distance between RNA trees, and a new metric called the Internal-Leafset (IL) distance. While the RF tree distance compares sets of leaves descending from internal nodes of two RNA trees, the IL distance compares the collection of leaf-children of internal nodes. The latter is better at capturing differences in structural elements of RNAs than the RF distance, which is more focused on base pairs. We also consider a more general tree edit distance that allows the mapping of base pairs that are not perfectly aligned. We study the theoretical complexity of the median problem and the small parsimony problem under the three distance metrics and various biologically-relevant constraints, and we present polynomial-time maximum parsimony algorithms for solving some versions of the problems. Our algorithms are applied to ncRNA families from the RFAM database, illustrating their practical utility


title: Constrained Multiview Representation for Self-supervised Contrastive Learning

abstract: Representation learning constitutes a pivotal cornerstone in contemporary deep learning paradigms, offering a conduit to elucidate distinctive features within the latent space and interpret the deep models. Nevertheless, the inherent complexity of anatomical patterns and the random nature of lesion distribution in medical image segmentation pose significant challenges to the disentanglement of representations and the understanding of salient features. Methods guided by the maximization of mutual information, particularly within the framework of contrastive learning, have demonstrated remarkable success and superiority in decoupling densely intertwined representations. However, the effectiveness of contrastive learning highly depends on the quality of the positive and negative sample pairs, i.e. the unselected average mutual information among multi-views would obstruct the learning strategy so the selection of the views is vital. In this work, we introduce a novel approach predicated on representation distance-based mutual information (MI) maximization for measuring the significance of different views, aiming at conducting more efficient contrastive learning and representation disentanglement. Additionally, we introduce an MI re-ranking strategy for representation selection, benefiting both the continuous MI estimating and representation significance distance measuring. Specifically, we harness multi-view representations extracted from the frequency domain, re-evaluating their significance based on mutual information across varying frequencies, thereby facilitating a multifaceted contrastive learning approach to bolster semantic comprehension. The statistical results under the five metrics demonstrate that our proposed framework proficiently constrains the MI maximization-driven representation selection and steers the multi-view contrastive learning process.


title: Efficient and Interpretable Traffic Destination Prediction using Explainable Boosting Machines

abstract: Developing accurate models for traffic trajectory predictions is crucial for achieving fully autonomous driving. Various deep neural network models have been employed to address this challenge, but their black-box nature hinders transparency and debugging capabilities in a deployed system. Glass-box models offer a solution by providing full interpretability through methods like \ac{GAM}. In this study, we evaluate an efficient additive model called \ac{EBM} for traffic prediction on three popular mixed traffic datasets: \ac{SDD}, \ac{InD}, and Argoverse. Our results show that the \ac{EBM} models perform competitively in predicting pedestrian destinations within \ac{SDD} and \ac{InD} while providing modest predictions for vehicle-dominant Argoverse dataset. Additionally, our transparent trained models allow us to analyse feature importance and interactions, as well as provide qualitative examples of predictions explanation. The full training code will be made public upon publication.


title: Exact solutions via equivalence transformations of variable-coefficient fifth-order KdV equations

abstract: In this paper, a family of variable-coefficient fifth-order KdV equations has been considered. By using an infinitesimal method based on the determination of the equivalence group, differential invariants and invariant equations are obtained. Invariants provide an alternative way to find equations from the family which may be equivalent to a specific subclass of the same family and the invertible transformation which maps both equivalent equations. Here, differential invariants are applied to obtain exact solutions.


title: Hybrid Smoothing for Anomaly Detection in Time Series

abstract: Many industrial and engineering processes monitored as times series have smooth trends that indicate normal behavior and occasionally anomalous patterns that can indicate a problem. This kind of behavior can be modeled by a smooth trend such as a spline or Gaussian process and a disruption based on a sparser representation. Our approach is to expand the process signal into two sets of basis functions: one set uses $L_2$ penalties on the coefficients and the other set uses $L_1$ penalties to control sparsity. From a frequentist perspective, this results in a hybrid smoother that combines cubic smoothing splines and the LASSO, and as a Bayesian hierarchical model (BHM), this is equivalent to priors giving a Gaussian process and a Laplace distribution for anomaly coefficients. For the hybrid smoother we propose two new ways of determining the penalty parameters that use effective degrees of freedom and contrast this with the BHM that uses loosely informative inverse gamma priors. Several reformulations are used to make sampling the BHM posterior more efficient including some novel features in orthogonalizing and regularizing the model basis functions. This methodology is motivated by a substantive application, monitoring the water treatment process for the Denver Metropolitan area. We also test the methods with a Monte Carlo study designed around the kind of anomalies expected in this application. Both the hybrid smoother and the full BHM give comparable results with small false positive and false negative rates. Besides being successful in the water treatment application, this work can be easily extended to other Gaussian process models and other features that represent process disruptions.


title: Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts

abstract: Mixture-of-Experts (MoEs) can scale up beyond traditional deep learning models by employing a routing strategy in which each input is processed by a single "expert" deep learning model. This strategy allows us to scale up the number of parameters defining the MoE while maintaining sparse activation, i.e., MoEs only load a small number of their total parameters into GPU VRAM for the forward pass depending on the input. In this paper, we provide an approximation and learning-theoretic analysis of mixtures of expert MLPs with (P)ReLU activation functions. We first prove that for every error level $\varepsilon>0$ and every Lipschitz function $f:[0,1]^n\to \mathbb{R}$, one can construct a MoMLP model (a Mixture-of-Experts comprising of (P)ReLU MLPs) which uniformly approximates $f$ to $\varepsilon$ accuracy over $[0,1]^n$, while only requiring networks of $\mathcal{O}(\varepsilon^{-1})$ parameters to be loaded in memory. Additionally, we show that MoMLPs can generalize since the entire MoMLP model has a (finite) VC dimension of $\tilde{O}(L\max\{nL,JW\})$, if there are $L$ experts and each expert has a depth and width of $J$ and $W$, respectively.

categories: stat.ML cs.LG cs.NA cs.NE math.CO math.NA


title: Effect of CLIQ on training of HL-LHC quadrupole magnets

abstract: The high-luminosity LHC upgrade requires stronger than LHC low-beta quadrupole magnets to reach the luminosity goals of the project. The project is well advanced and HL-LHC quadrupole magnets are currently being commissioned in US Labs (MQXFA magnets) and CERN (MQXFB magnets). Those are the first Nb3Sn magnets to be used in any large particle accelerator. At development stages, many Nb3Sn accelerator sub-scale models showed relatively slow training and MQXFA magnets were projected to have low tens of quenches before reaching operational field. Recently it was shown that dedicated capacitor-based devices can affect Nb3Sn magnet training, and it was suggested that CLIQ, a capacitor-based device intended for quench protection, can do too. The present paper investigates effects on training likely induced by CLIQ, using the base fact that only half the coils in a quadrupole experience upward current modulation at quench because of capacitor discharge. The study encompasses all MQXFA production magnets trained at BNL to date. No other high-statistics data from identical magnets (series) with CLIQ protection exist so far. Implications and opportunities stemming from data analysis are discussed and conclusions drawn.


title: Transfer-printed multiple Ge$_{0.89}$Sn$_{0.11}$ membrane mid-infrared photodetectors

abstract: Due to their narrow band gap and compatibility with silicon processing, germanium-tin (Ge$_{1-x}$Sn$_x$) alloys are a versatile platform for scalable integrated mid-infrared photonics. These semiconductors are typically grown on silicon wafers using Ge as an interlayer. However, the large lattice mismatch in this heteroepitaxy protocol leads to the build-up of compressive strain in the grown layers. This compressive strain limits the material quality and its thermal stability besides expanding the band gap, thereby increasing the Sn content needed to cover a broader range in the mid-infrared. Released Ge$_{1-x}$Sn$_x$ membranes provide an effective way to mitigate these harmful effects of the epitaxial strain and control the band gap energy while enabling the hybrid integration onto different substrates. With this perspective, herein strain-relaxed Ge$_{0.89}$Sn$_{0.11}$ membranes are fabricated and subsequently transfer-printed with metal contacts to create multiple photodetectors in a single transfer step. The resulting photodetectors exhibit an extended photodetection cutoff reaching a wavelength of $3.1 \,\mu$m, coupled with a significant reduction in the dark current of two orders of magnitude as compared to as-grown photoconductive devices. The latter yields a reduced cutoff of $2.8 \,\mu$m due to the inherent compressive strain. Furthermore, the impact of chemical treatment and annealing on the device performance was also investigated showing a further reduction in the dark current. The demonstrated transfer printing, along with the use of an adhesive layer, would allow the transfer of multiple GeSn membranes onto virtually any substrate. This approach paves the way for scalable fabrication of hybrid optoelectronic devices leveraging the tunable band gap of Ge$_{1-x}$Sn$_x$ in the mid-wave infrared range.


title: Addendum to: Constraints on the quartic Higgs self-coupling from double-Higgs production at future hadron colliders

abstract: We study inclusive double-Higgs boson production at the LHC and at the HL-LHC including variations of the trilinear and of the quartic Higgs boson self-couplings at next-to-leading order (NLO) in QCD with full top quark mass dependence. Our results include the two-loop contributions to the $gg \rightarrow HH$ amplitudes that involve a modified $h_4$ vertex calculated in arXiv:1810.04665. We present results at 13, 13.6 and 14 TeV centre-of-mass energies. The implementation of the calculation is made publicly available in the POWHEG-BOX-V2 Monte Carlo framework.


title: A Fuzzy Approach to Record Linkages

abstract: Record Linkage is the process of identifying and unifying records from various independent data sources. Existing strategies, which can be either deterministic or probabilistic, often fail to link records satisfactorily under uncertainty. This paper describes an indigenously (locally) developed fuzzy linkage method, based on fuzzy set techniques, which can effectively account for this uncertainty prevalent in the disparate data sources and address the shortcomings of the existing approaches. Extensive testing, evaluation and comparisons have demonstrated the efficacy of this fuzzy approach for record linkages.


title: Stitching the Spectrum: Semantic Spectrum Segmentation with Wideband Signal Stitching

abstract: Spectrum has become an extremely scarce and congested resource. As a consequence, spectrum sensing enables the coexistence of different wireless technologies in shared spectrum bands. Most existing work requires spectrograms to classify signals. Ultimately, this implies that images need to be continuously created from I/Q samples, thus creating unacceptable latency for real-time operations. In addition, spectrogram-based approaches do not achieve sufficient granularity level as they are based on object detection performed on pixels and are based on rectangular bounding boxes. For this reason, we propose a completely novel approach based on semantic spectrum segmentation, where multiple signals are simultaneously classified and localized in both time and frequency at the I/Q level. Conversely from the state-of-the-art computer vision algorithm, we add non-local blocks to combine the spatial features of signals, and thus achieve better performance. In addition, we propose a novel data generation approach where a limited set of easy-to-collect real-world wireless signals are ``stitched together'' to generate large-scale, wideband, and diverse datasets. Experimental results obtained on multiple testbeds (including the Arena testbed) using multiple antennas, multiple sampling frequencies, and multiple radios over the course of 3 days show that our approach classifies and localizes signals with a mean intersection over union (IOU) of 96.70% across 5 wireless protocols while performing in real-time with a latency of 2.6 ms. Moreover, we demonstrate that our approach based on non-local blocks achieves 7% more accuracy when segmenting the most challenging signals with respect to the state-of-the-art U-Net algorithm. We will release our 17 GB dataset and code.


title: Physics-Encoded Graph Neural Networks for Deformation Prediction under Contact

abstract: In robotics, it's crucial to understand object deformation during tactile interactions. A precise understanding of deformation can elevate robotic simulations and have broad implications across different industries. We introduce a method using Physics-Encoded Graph Neural Networks (GNNs) for such predictions. Similar to robotic grasping and manipulation scenarios, we focus on modeling the dynamics between a rigid mesh contacting a deformable mesh under external forces. Our approach represents both the soft body and the rigid body within graph structures, where nodes hold the physical states of the meshes. We also incorporate cross-attention mechanisms to capture the interplay between the objects. By jointly learning geometry and physics, our model reconstructs consistent and detailed deformations. We've made our code and dataset public to advance research in robotic simulation and grasping.


title: Stochastic Modified Flows for Riemannian Stochastic Gradient Descent

abstract: We give quantitative estimates for the rate of convergence of Riemannian stochastic gradient descent (RSGD) to Riemannian gradient flow and to a diffusion process, the so-called Riemannian stochastic modified flow (RSMF). Using tools from stochastic differential geometry we show that, in the small learning rate regime, RSGD can be approximated by the solution to the RSMF driven by an infinite-dimensional Wiener process. The RSMF accounts for the random fluctuations of RSGD and, thereby, increases the order of approximation compared to the deterministic Riemannian gradient flow. The RSGD is build using the concept of a retraction map, that is, a cost efficient approximation of the exponential map, and we prove quantitative bounds for the weak error of the diffusion approximation under assumptions on the retraction map, the geometry of the manifold, and the random estimators of the gradient.


title: Exact Tensor Completion Powered by Arbitrary Linear Transforms

abstract: In this work, a tensor completion problem is studied, which aims to perfectly recover the tensor from partial observations. Existing theoretical guarantee requires the involved transform to be orthogonal, which hinders its applications. In this paper, jumping out of the constraints of isotropy or self-adjointness, the theoretical guarantee of exact tensor completion with arbitrary linear transforms is established. To that end, we define a new tensor-tensor product, which leads us to a new definition of the tensor nuclear norm. Equipped with these tools, an efficient algorithm based on alternating direction of multipliers is designed to solve the transformed tensor completion program and the theoretical bound is obtained. Our model and proof greatly enhance the flexibility of tensor completion and extensive experiments validate the superiority of the proposed method.


title: Rethinking the Role of Proxy Rewards in Language Model Alignment

abstract: Learning from human feedback via proxy reward modeling has been studied to align Large Language Models (LLMs) with human values. However, achieving reliable training through that proxy reward model (RM) is not a trivial problem, and its behavior remained as a black-box. In this paper, we study the role of proxy rewards in the LLM alignment via `reverse reward engineering' by composing interpretable features as a white-box reward function. We aim to replicate the ground truth (gold) reward signal by achieving a monotonic relationship between the proxy and gold reward signals after training the model using the proxy reward in reinforcement learning (RL). Our findings indicate that successfully emulating the gold reward requires generating responses that are relevant with enough length to open-ended questions, while also ensuring response consistency in closed-ended questions. Furthermore, resulting models optimizing our devised white-box reward show competitive performances with strong open-source RMs in alignment benchmarks. We highlight its potential usage as a simple but strong reward baseline for the LLM alignment, not requiring explicit human feedback dataset and RM training. Our code is available at https://github.com/naver-ai/rethinking-proxy-reward.


title: A Study Guide for "A Restriction Estimate using Polynomial Partitioning"

abstract: This manuscript is intended as an accompaniment to Guth's "A restriction estimate using polynomial partitioning". We begin by summarizing the core ideas of the proof, elaborating the history and development of the techniques therein. From there, we provide supplementary details on some of the standard methods and more technical arguments which may be unfamiliar or less accessible to readers not yet acquainted with the paper. We also provide a summary of some more recent developments since the publication of Guth's work.


title: The Information of Large Language Model Geometry

abstract: This paper investigates the information encoded in the embeddings of large language models (LLMs). We conduct simulations to analyze the representation entropy and discover a power law relationship with model sizes. Building upon this observation, we propose a theory based on (conditional) entropy to elucidate the scaling law phenomenon. Furthermore, we delve into the auto-regressive structure of LLMs and examine the relationship between the last token and previous context tokens using information theory and regression techniques. Specifically, we establish a theoretical connection between the information gain of new tokens and ridge regression. Additionally, we explore the effectiveness of Lasso regression in selecting meaningful tokens, which sometimes outperforms the closely related attention weights. Finally, we conduct controlled experiments, and find that information is distributed across tokens, rather than being concentrated in specific "meaningful" tokens alone.


title: Efficient prescription to search for linear gravitational wave memory from hyperbolic black hole encounters and its application to the NANOGrav 12.5-year dataset

abstract: Burst with memory events are potential transient gravitational wave sources for the maturing pulsar timing array (PTA) efforts. We provide a computationally efficient prescription to model pulsar timing residuals induced by supermassive black hole pairs in general relativistic hyperbolic trajectories employing a Keplerian-type parametric solution. Injection studies have been pursued on the resulting bursts with linear GW memory (LGWM) events with simulated datasets to test the performance of our pipeline, followed by its application to the publicly available NANOGrav 12.5-year (NG12.5) dataset. Given the absence of any evidence of LGWM events within the real NG12.5 dataset, we impose $95\%$ upper limits on the PTA signal amplitude as a function of the sky location of the source and certain characteristic frequency ($n$) of the signal. The upper limits are computed using a signal model that takes into account the presence of intrinsic timing noise specific to each pulsar, as well as a common, spatially uncorrelated red noise, alongside the LGWM signal. Our investigations reveal that the $95\%$ upper limits on LGWM amplitude, marginalized over all other parameters, is 3.48 $\pm 0.51 \ \mu$s for $n>3.16$ nHz. This effort should be relevant for constraining both burst and memory events in the upcoming International Pulsar Timing Array data releases.


title: Assessing the Efficacy of Invisible Watermarks in AI-Generated Medical Images

abstract: AI-generated medical images are gaining growing popularity due to their potential to address the data scarcity challenge in the real world. However, the issue of accurate identification of these synthetic images, particularly when they exhibit remarkable realism with their real copies, remains a concern. To mitigate this challenge, image generators such as DALLE and Imagen, have integrated digital watermarks aimed at facilitating the discernment of synthetic images' authenticity. These watermarks are embedded within the image pixels and are invisible to the human eye while remains their detectability. Nevertheless, a comprehensive investigation into the potential impact of these invisible watermarks on the utility of synthetic medical images has been lacking. In this study, we propose the incorporation of invisible watermarks into synthetic medical images and seek to evaluate their efficacy in the context of downstream classification tasks. Our goal is to pave the way for discussions on the viability of such watermarks in boosting the detectability of synthetic medical images, fortifying ethical standards, and safeguarding against data pollution and potential scams.


title: Active Region-based Flare Forecasting with Sliding Window Multivariate Time Series Forest Classifiers

abstract: Over the past few decades, many applications of physics-based simulations and data-driven techniques (including machine learning and deep learning) have emerged to analyze and predict solar flares. These approaches are pivotal in understanding the dynamics of solar flares, primarily aiming to forecast these events and minimize potential risks they may pose to Earth. Although current methods have made significant progress, there are still limitations to these data-driven approaches. One prominent drawback is the lack of consideration for the temporal evolution characteristics in the active regions from which these flares originate. This oversight hinders the ability of these methods to grasp the relationships between high-dimensional active region features, thereby limiting their usability in operations. This study centers on the development of interpretable classifiers for multivariate time series and the demonstration of a novel feature ranking method with sliding window-based sub-interval ranking. The primary contribution of our work is to bridge the gap between complex, less understandable black-box models used for high-dimensional data and the exploration of relevant sub-intervals from multivariate time series, specifically in the context of solar flare forecasting. Our findings demonstrate that our sliding-window time series forest classifier performs effectively in solar flare prediction (with a True Skill Statistic of over 85\%) while also pinpointing the most crucial features and sub-intervals for a given learning task.


title: Power Savings for Counting (Twisted) Abelian Extensions of Number Fields

abstract: We prove significant power savings for the error term when counting abelian extensions of number fields (as well as the twisted version of these results for nontrivial Galois modules). In some cases over $\mathbb{Q}$, these results reveal lower order terms following the same structure as the main term that were not previously known. Assuming the generalized Lindel\"of hypothesis for Hecke $L$-functions, we prove square root power savings for the error compared to the order of the main term.


title: CT Material Decomposition using Spectral Diffusion Posterior Sampling

abstract: In this work, we introduce a new deep learning approach based on diffusion posterior sampling (DPS) to perform material decomposition from spectral CT measurements. This approach combines sophisticated prior knowledge from unsupervised training with a rigorous physical model of the measurements. A faster and more stable variant is proposed that uses a jumpstarted process to reduce the number of time steps required in the reverse process and a gradient approximation to reduce the computational cost. Performance is investigated for two spectral CT systems: dual-kVp and dual-layer detector CT. On both systems, DPS achieves high Structure Similarity Index Metric Measure(SSIM) with only 10% of iterations as used in the model-based material decomposition(MBMD). Jumpstarted DPS (JSDPS) further reduces computational time by over 85% and achieves the highest accuracy, the lowest uncertainty, and the lowest computational costs compared to classic DPS and MBMD. The results demonstrate the potential of JSDPS for providing relatively fast and accurate material decomposition based on spectral CT data.


title: Arabic Synonym BERT-based Adversarial Examples for Text Classification

abstract: Text classification systems have been proven vulnerable to adversarial text examples, modified versions of the original text examples that are often unnoticed by human eyes, yet can force text classification models to alter their classification. Often, research works quantifying the impact of adversarial text attacks have been applied only to models trained in English. In this paper, we introduce the first word-level study of adversarial attacks in Arabic. Specifically, we use a synonym (word-level) attack using a Masked Language Modeling (MLM) task with a BERT model in a black-box setting to assess the robustness of the state-of-the-art text classification models to adversarial attacks in Arabic. To evaluate the grammatical and semantic similarities of the newly produced adversarial examples using our synonym BERT-based attack, we invite four human evaluators to assess and compare the produced adversarial examples with their original examples. We also study the transferability of these newly produced Arabic adversarial examples to various models and investigate the effectiveness of defense mechanisms against these adversarial examples on the BERT models. We find that fine-tuned BERT models were more susceptible to our synonym attacks than the other Deep Neural Networks (DNN) models like WordCNN and WordLSTM we trained. We also find that fine-tuned BERT models were more susceptible to transferred attacks. We, lastly, find that fine-tuned BERT models successfully regain at least 2% in accuracy after applying adversarial training as an initial defense mechanism.


title: Hyper-Diffusion: Estimating Epistemic and Aleatoric Uncertainty with a Single Model

abstract: Estimating and disentangling epistemic uncertainty (uncertainty that can be reduced with more training data) and aleatoric uncertainty (uncertainty that is inherent to the task at hand) is critically important when applying machine learning (ML) to high-stakes applications such as medical imaging and weather forecasting. Conditional diffusion models' breakthrough ability to accurately and efficiently sample from the posterior distribution of a dataset now makes uncertainty estimation conceptually straightforward: One need only train and sample from a large ensemble of diffusion models. Unfortunately, training such an ensemble becomes computationally intractable as the complexity of the model architecture grows. In this work we introduce a new approach to ensembling, hyper-diffusion, which allows one to accurately estimate epistemic and aleatoric uncertainty with a single model. Unlike existing Monte Carlo dropout based single-model ensembling methods, hyper-diffusion offers the same prediction accuracy as multi-model ensembles. We validate our approach on two distinct tasks: x-ray computed tomography (CT) reconstruction and weather temperature forecasting.


title: DRED: Zero-Shot Transfer in Reinforcement Learning via Data-Regularised Environment Design

abstract: Autonomous agents trained using deep reinforcement learning (RL) often lack the ability to successfully generalise to new environments, even when these environments share characteristics with the ones they have encountered during training. In this work, we investigate how the sampling of individual environment instances, or levels, affects the zero-shot generalisation (ZSG) ability of RL agents. We discover that, for deep actor-critic architectures sharing their base layers, prioritising levels according to their value loss minimises the mutual information between the agent's internal representation and the set of training levels in the generated training data. This provides a novel theoretical justification for the regularisation achieved by certain adaptive sampling strategies. We then turn our attention to unsupervised environment design (UED) methods, which assume control over level generation. We find that existing UED methods can significantly shift the training distribution, which translates to low ZSG performance. To prevent both overfitting and distributional shift, we introduce data-regularised environment design (DRED). DRED generates levels using a generative model trained to approximate the ground truth distribution of an initial set of level parameters. Through its grounding, DRED achieves significant improvements in ZSG over adaptive level sampling strategies and UED methods. Our code and experimental data are available at https://github.com/uoe-agents/dred.


title: Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision

abstract: Deep learning methods are transforming research, enabling new techniques, and ultimately leading to new discoveries. As the demand for more capable AI models continues to grow, we are now entering an era of Trillion Parameter Models (TPM), or models with more than a trillion parameters -- such as Huawei's PanGu-$\Sigma$. We describe a vision for the ecosystem of TPM users and providers that caters to the specific needs of the scientific community. We then outline the significant technical challenges and open problems in system design for serving TPMs to enable scientific research and discovery. Specifically, we describe the requirements of a comprehensive software stack and interfaces to support the diverse and flexible requirements of researchers.


title: FINEST: Stabilizing Recommendations by Rank-Preserving Fine-Tuning

abstract: Modern recommender systems may output considerably different recommendations due to small perturbations in the training data. Changes in the data from a single user will alter the recommendations as well as the recommendations of other users. In applications like healthcare, housing, and finance, this sensitivity can have adverse effects on user experience. We propose a method to stabilize a given recommender system against such perturbations. This is a challenging task due to (1) the lack of a ``reference'' rank list that can be used to anchor the outputs; and (2) the computational challenges in ensuring the stability of rank lists with respect to all possible perturbations of training data. Our method, FINEST, overcomes these challenges by obtaining reference rank lists from a given recommendation model and then fine-tuning the model under simulated perturbation scenarios with rank-preserving regularization on sampled items. Our experiments on real-world datasets demonstrate that FINEST can ensure that recommender models output stable recommendations under a wide range of different perturbations without compromising next-item prediction accuracy.


title: On time-fractional partial differential equations of time-dependent piecewise constant order

abstract: This contribution considers the time-fractional subdiffusion with a time-dependent variable-order fractional operator of order $\beta(t)$. It is assumed that $\beta(t)$ is a piecewise constant function with a finite number of jumps. A proof technique based on the Fourier method and results from constant-order fractional subdiffusion equations has been designed. This novel approach results in the well-posedness of the problem.


title: SWAG: Storytelling With Action Guidance

abstract: Automated long-form story generation typically employs long-context large language models (LLMs) for one-shot creation, which can produce cohesive but not necessarily engaging content. We introduce Storytelling With Action Guidance (SWAG), a novel approach to storytelling with LLMs. Our approach reduces story writing to a search problem through a two-model feedback loop: one LLM generates story content, and another auxiliary LLM is used to choose the next best "action" to steer the story's future direction. Our results show that SWAG can substantially outperform previous end-to-end story generation techniques when evaluated by GPT-4 and through human evaluation, and our SWAG pipeline using only open-source models surpasses GPT-3.5-Turbo.


title: Harnessing PubMed User Query Logs for Post Hoc Explanations of Recommended Similar Articles

abstract: Searching for a related article based on a reference article is an integral part of scientific research. PubMed, like many academic search engines, has a "similar articles" feature that recommends articles relevant to the current article viewed by a user. Explaining recommended items can be of great utility to users, particularly in the literature search process. With more than a million biomedical papers being published each year, explaining the recommended similar articles would facilitate researchers and clinicians in searching for related articles. Nonetheless, the majority of current literature recommendation systems lack explanations for their suggestions. We employ a post hoc approach to explaining recommendations by identifying relevant tokens in the titles of similar articles. Our major contribution is building PubCLogs by repurposing 5.6 million pairs of coclicked articles from PubMed's user query logs. Using our PubCLogs dataset, we train the Highlight Similar Article Title (HSAT), a transformer-based model designed to select the most relevant parts of the title of a similar article, based on the title and abstract of a seed article. HSAT demonstrates strong performance in our empirical evaluations, achieving an F1 score of 91.72 percent on the PubCLogs test set, considerably outperforming several baselines including BM25 (70.62), MPNet (67.11), MedCPT (62.22), GPT-3.5 (46.00), and GPT-4 (64.89). Additional evaluations on a separate, manually annotated test set further verifies HSAT's performance. Moreover, participants of our user study indicate a preference for HSAT, due to its superior balance between conciseness and comprehensiveness. Our study suggests that repurposing user query logs of academic search engines can be a promising way to train state-of-the-art models for explaining literature recommendation.


title: Attention Meets Post-hoc Interpretability: A Mathematical Perspective

abstract: Attention-based architectures, in particular transformers, are at the heart of a technological revolution. Interestingly, in addition to helping obtain state-of-the-art results on a wide range of applications, the attention mechanism intrinsically provides meaningful insights on the internal behavior of the model. Can these insights be used as explanations? Debate rages on. In this paper, we mathematically study a simple attention-based architecture and pinpoint the differences between post-hoc and attention-based explanations. We show that they provide quite different results, and that, despite their limitations, post-hoc methods are capable of capturing more useful insights than merely examining the attention weights.


title: Early prediction of onset of sepsis in Clinical Setting

abstract: This study proposes the use of Machine Learning models to predict the early onset of sepsis using deidentified clinical data from Montefiore Medical Center in Bronx, NY, USA. A supervised learning approach was adopted, wherein an XGBoost model was trained utilizing 80\% of the train dataset, encompassing 107 features (including the original and derived features). Subsequently, the model was evaluated on the remaining 20\% of the test data. The model was validated on prospective data that was entirely unseen during the training phase. To assess the model's performance at the individual patient level and timeliness of the prediction, a normalized utility score was employed, a widely recognized scoring methodology for sepsis detection, as outlined in the PhysioNet Sepsis Challenge paper. Metrics such as F1 Score, Sensitivity, Specificity, and Flag Rate were also devised. The model achieved a normalized utility score of 0.494 on test data and 0.378 on prospective data at threshold 0.3. The F1 scores were 80.8\% and 67.1\% respectively for the test data and the prospective data for the same threshold, highlighting its potential to be integrated into clinical decision-making processes effectively. These results bear testament to the model's robust predictive capabilities and its potential to substantially impact clinical decision-making processes.


title: Shooting Methods for Fractional Dirichlet-Type Boundary Value Problems of Order $\alpha \in (1,2)$ With Caputo Derivatives

abstract: For the numerical solution of Dirichlet-type boundary value problems associated to nonlinear fractional differential equations of order $\alpha \in (1,2)$ that use Caputo derivatives, we suggest to employ shooting methods. In particular, we demonstrate that the so-called proportional secting technique for selecting the required initial values leads to numerical schemes that converge to high accuracy in a very small number of shooting iterations, and we provide an explanation of the analytical background for this favourable numerical behaviour.