title: Diversity in Fermi/GBM Gamma Ray Bursts: New insights from Machine Learning

abstract: Classification of gamma-ray bursts (GRBs) has been a long-standing puzzle in high-energy astrophysics. Recent observations challenge the traditional short vs. long viewpoint, where long GRBs are thought to originate from the collapse of massive stars and short GRBs from compact binary mergers. Machine learning (ML) algorithms have been instrumental in addressing this problem, revealing five distinct GRB groups within the Swift/BAT light curve data, two of which are associated with kilonovae (KNe). We corroborate these five classes by extending this analysis to the Fermi/GBM data using unsupervised ML techniques. These five clusters are well separated in fluence-duration plane, hinting at a potential link between fluence, duration and complexities (or structures) in the light curves of GRBs. Further, we confirm two distinct classes of KN-associated GRBs. The presence of GRB 170817A in one of the two KNe-associated clusters lends evidence to the hypothesis that this class of GRBs could potentially be produced by binary neutron star (BNS) mergers. The second KN-associated GRB cluster could potentially originate from NS-BH mergers. Future multimessenger observations of compact binaries in gravitational waves (GWs) and electromagnetic waves can be paramount in understanding these clusters better.


title: Clarifying Myths About the Relationship Between Shape Bias, Accuracy, and Robustness

abstract: Deep learning models can perform well when evaluated on images from the same distribution as the training set. However, applying small perturbations in the forms of noise, artifacts, occlusions, blurring, etc. to a model's input image and feeding the model with out-of-distribution (OOD) data can significantly drop the model's accuracy, making it not applicable to real-world scenarios. Data augmentation is one of the well-practiced methods to improve model robustness against OOD data; however, examining which augmentation type to choose and how it affects the OOD robustness remains understudied. There is a growing belief that augmenting datasets using data augmentations that improve a model's bias to shape-based features rather than texture-based features results in increased OOD robustness for Convolutional Neural Networks trained on the ImageNet-1K dataset. This is usually stated as ``an increase in the model's shape bias results in an increase in its OOD robustness". Based on this hypothesis, some works in the literature aim to find augmentations with higher effects on model shape bias and use those for data augmentation. By evaluating 39 types of data augmentations on a widely used OOD dataset, we demonstrate the impact of each data augmentation on the model's robustness to OOD data and further show that the mentioned hypothesis is not true; an increase in shape bias does not necessarily result in higher OOD robustness. By analyzing the results, we also find some biases in the ImageNet-1K dataset that can easily be reduced using proper data augmentation. Our evaluation results further show that there is not necessarily a trade-off between in-domain accuracy and OOD robustness, and choosing the proper augmentations can help increase both in-domain accuracy and OOD robustness simultaneously.


title: Slow and Stored Light via Electromagnetically Induced Transparency Using A $\Lambda$-type Superconducting Artificial Atom

abstract: Recent progresses in Josephson-junction-based superconducting circuits have propelled quantum information processing forward. However, the lack of a metastable state in most superconducting artificial atoms hinders the development of photonic quantum memory in this platform. Here, we use a single superconducting qubit-resonator system to realize a desired $\Lambda$-type artificial atom, and to demonstrate slow light with a group velocity of 3.6 km/s and the microwave storage with a memory time extending to several hundred nanoseconds via electromagnetically induced transparency. Our results highlight the potential of achieving microwave quantum memory, promising substantial advancements in quantum information processing within superconducting circuits.


title: Generative diffusion models for synthetic trajectories of heavy and light particles in turbulence

abstract: Heavy and light particles are commonly found in many natural phenomena and industrial processes, such as suspensions of bubbles, dust, and droplets in incompressible turbulent flows. Based on a recent machine learning approach using a diffusion model that successfully generated single tracer trajectories in three-dimensional turbulence and passed most statistical benchmarks across time scales, we extend this model to include heavy and light particles. Given the particle type - tracer, light, or heavy - the model can generate synthetic, realistic trajectories with correct fat-tail distributions for acceleration, anomalous power laws, and scale dependent local slope properties. This work paves the way for future exploration of the use of diffusion models to produce high-quality synthetic datasets for different flow configurations, potentially allowing interpolation between different setups and adaptation to new conditions.


title: Nonlinear effects on charge fractionalization in critical chains

abstract: We investigate the generic transport in a one-dimensional strongly correlated fermionic chain beyond linear response. Starting from a Gaussian wave packet with positive momentum on top of the ground state, we find that the numerical time evolution splits the signal into at least three distinct fractional charges moving with different velocities. A fractional left-moving charge is expected from conventional Luttinger liquid theory, but for the prediction of the two separate right-moving packets the nonlinearity of the dispersion must also be taken into account. This out-of-equilibrium protocol therefore allows a direct measurement of nonlinear interaction parameters, which also govern threshold singularities of dynamic response functions. The nonlinear Luttinger Liquid theory also predicts the correct dynamics at low energies, where it agrees with the conventional Luttinger liquid. Moreover, at high energies, the wave packet dynamics reveals signatures of composite excitations containing two-particle bound states. Our results uncover a simple strategy to probe the nonlinear regime in time-resolved experiments in quantum wires and ultracold-atom platforms.


title: Testing common invariant subspace of multilayer networks

abstract: Graph (or network) is a mathematical structure that has been widely used to model relational data. As real-world systems get more complex, multilayer (or multiple) networks are employed to represent diverse patterns of relationships among the objects in the systems. One active research problem in multilayer networks analysis is to study the common invariant subspace of the networks, because such common invariant subspace could capture the fundamental structural patterns and interactions across all layers. Many methods have been proposed to estimate the common invariant subspace. However, whether real-world multilayer networks share the same common subspace remains unknown. In this paper, we first attempt to answer this question by means of hypothesis testing. The null hypothesis states that the multilayer networks share the same subspace, and under the alternative hypothesis, there exist at least two networks that do not have the same subspace. We propose a Weighted Degree Difference Test, derive the limiting distribution of the test statistic and provide an analytical analysis of the power. Simulation study shows that the proposed test has satisfactory performance, and a real data application is provided.


title: ComplexityMeasures.jl: scalable software to unify and accelerate entropy and complexity timeseries analysis

abstract: In the nonlinear timeseries analysis literature, countless quantities have been presented as new "entropy" or "complexity" measures, often with similar roles. The ever-increasing pool of such measures makes creating a sustainable and all-encompassing software for them difficult both conceptually and pragmatically. Such a software however would be an important tool that can aid researchers make an informed decision of which measure to use and for which application, as well as accelerate novel research. Here we present ComplexityMeasures.jl, an easily extendable and highly performant open-source software that implements a vast selection of complexity measures. The software provides 1530 measures with 3,834 lines of source code, averaging only 2.5 lines of code per exported quantity (version 3.5). This is made possible by its mathematically rigorous composable design. In this paper we discuss the software design and demonstrate how it can accelerate complexity-related research in the future. We carefully compare it with alternative software and conclude that ComplexityMeasures.jl outclasses the alternatives in several objective aspects of comparison, such as computational performance, overall amount of measures, reliability, and extendability. ComplexityMeasures.jl is also a component of the DynamicalSystems.jl library for nonlinear dynamics and nonlinear timeseries analysis and follows open source development practices for creating a sustainable community of developers.


title: TrendLSW: Trend and Spectral Estimation of Nonstationary Time Series in R

abstract: The TrendLSW R package has been developed to provide users with a suite of wavelet-based techniques to analyse the statistical properties of nonstationary time series. The key components of the package are (a) two approaches for the estimation of the evolutionary wavelet spectrum in the presence of trend; and (b) wavelet-based trend estimation in the presence of locally stationary wavelet errors via both linear and nonlinear wavelet thresholding; and (c) the calculation of associated pointwise confidence intervals. Lastly, the package directly implements boundary handling methods that enable the methods to be performed on data of arbitrary length, not just dyadic length as is common for wavelet-based methods, ensuring no pre-processing of data is necessary. The key functionality of the package is demonstrated through two data examples, arising from biology and activity monitoring.


title: CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search

abstract: In this paper, we study how open-source large language models (LLMs) can be effectively deployed for improving query rewriting in conversational search, especially for ambiguous queries. We introduce CHIQ, a two-step method that leverages the capabilities of LLMs to resolve ambiguities in the conversation history before query rewriting. This approach contrasts with prior studies that predominantly use closed-source LLMs to directly generate search queries from conversation history. We demonstrate on five well-established benchmarks that CHIQ leads to state-of-the-art results across most settings, showing highly competitive performances with systems leveraging closed-source LLMs. Our study provides a first step towards leveraging open-source LLMs in conversational search, as a competitive alternative to the prevailing reliance on commercial LLMs. Data, models, and source code will be publicly available upon acceptance at https://github.com/fengranMark/CHIQ.


title: Root Cause Analysis of Outliers with Missing Structural Knowledge

abstract: Recent work conceptualized root cause analysis (RCA) of anomalies via quantitative contribution analysis using causal counterfactuals in structural causal models (SCMs). The framework comes with three practical challenges: (1) it requires the causal directed acyclic graph (DAG), together with an SCM, (2) it is statistically ill-posed since it probes regression models in regions of low probability density, (3) it relies on Shapley values which are computationally expensive to find. In this paper, we propose simplified, efficient methods of root cause analysis when the task is to identify a unique root cause instead of quantitative contribution analysis. Our proposed methods run in linear order of SCM nodes and they require only the causal DAG without counterfactuals. Furthermore, for those use cases where the causal DAG is unknown, we justify the heuristic of identifying root causes as the variables with the highest anomaly score.


title: Quantum Alternating Operator Ansatz for the Preparation and Detection of Long-Lived Singlet States in NMR

abstract: Designing efficient and robust quantum control strategies is vital for developing quantum technologies. One recent strategy is the Quantum Alternating Operator Ansatz (QAOA) sequence that alternatively propagates under two noncommuting Hamiltonians, whose control parameters can be optimized to generate a gate or prepare a state. Here, we describe the design of the QAOA sequence and their variants to prepare long-lived singlet states (LLS) from the thermal state in NMR. With extraordinarily long lifetimes exceeding the spin-lattice relaxation time constant $T_1$, LLS have been of great interest for various applications, from spectroscopy to medical imaging. Accordingly, designing sequences for efficiently preparing LLS in a general spin system is crucial. Using numerical analysis, we study the efficiency and robustness of the QAOA sequences over a wide range of errors in the control parameters. Using a two-qubit NMR register, we conduct an experimental study to benchmark QAOA sequences against other prominent methods of LLS preparation and observe the significantly superior performance of the QAOA sequences.


title: Nano-Focusing of Vortex Beams with Hyperbolic Metamaterials

abstract: The synergy of judiciously engineered nanostructures and complex topology of light creates unprecedented opportunities for tailoring light-matter interactions on the nanoscale. Electromagnetic waves can carry multiple units of angular momentum per photon, stemming from both spin and orbital angular momentum contributions, offering a potential route for modifying the optical transition selection rules. However, the size difference between a vortex beam and quantum objects limits the interaction strength and the angular momentum exchange. Here, we demonstrate the sub-diffraction-limited focusing of a vortex beam using the high in-plane wave number modes present in hyperbolic metamaterials. The spin-orbit interaction within the hyperbolic structure gives rise to the formation of an optical skyrmion with a deep subwavelength structure, which may enable the exploration of new light-matter interaction phenomena.


title: Adaptively Learning to Select-Rank in Online Platforms

abstract: Ranking algorithms are fundamental to various online platforms across e-commerce sites to content streaming services. Our research addresses the challenge of adaptively ranking items from a candidate pool for heterogeneous users, a key component in personalizing user experience. We develop a user response model that considers diverse user preferences and the varying effects of item positions, aiming to optimize overall user satisfaction with the ranked list. We frame this problem within a contextual bandits framework, with each ranked list as an action. Our approach incorporates an upper confidence bound to adjust predicted user satisfaction scores and selects the ranking action that maximizes these adjusted scores, efficiently solved via maximum weight imperfect matching. We demonstrate that our algorithm achieves a cumulative regret bound of $O(d\sqrt{NKT})$ for ranking $K$ out of $N$ items in a $d$-dimensional context space over $T$ rounds, under the assumption that user responses follow a generalized linear model. This regret alleviates dependence on the ambient action space, whose cardinality grows exponentially with $N$ and $K$ (thus rendering direct application of existing adaptive learning algorithms -- such as UCB or Thompson sampling -- infeasible). Experiments conducted on both simulated and real-world datasets demonstrate our algorithm outperforms the baseline.


title: An update on supersphere non linear sigma model on the lattice

abstract: We consider the discretized version of the sigma-model with supersphere target space $OSp(N+2m|2m)/OSp(N+2m-1|2m)$ and present a preliminary numerical study of bosonic and fermionic two-point functions for the cases $OSp(3|2)$ and $OSp(5|2)$. We observe consistency with the expectations of this supersymmetric setup and discuss the sign problem.


title: Predictability Limit of the 2021 Pacific Northwest Heatwave from Deep-Learning Sensitivity Analysis

abstract: The traditional method for estimating weather forecast sensitivity to initial conditions uses adjoint models, which are limited to short lead times due to linearization around a control forecast. The advent of deep-learning frameworks enables a new approach using backpropagation and gradient descent to iteratively optimize initial conditions to minimize forecast errors. We apply this approach to forecasts of the June 2021 Pacific Northwest heatwave using the GraphCast model, yielding over 90% reduction in 10-day forecast errors over the Pacific Northwest. Similar improvements are found for Pangu-Weather model forecasts initialized with the GraphCast-derived optimal, suggesting that model error is not an important part of the initial perturbations. Eliminating small scales from the initial perturbations also yields similar forecast improvements. Extending the length of the optimization window, we find forecast improvement to about 23 days, suggesting atmospheric predictability at the upper end of recent estimates.


title: Scaling up Probabilistic PDE Simulators with Structured Volumetric Information

abstract: Modeling real-world problems with partial differential equations (PDEs) is a prominent topic in scientific machine learning. Classic solvers for this task continue to play a central role, e.g. to generate training data for deep learning analogues. Any such numerical solution is subject to multiple sources of uncertainty, both from limited computational resources and limited data (including unknown parameters). Gaussian process analogues to classic PDE simulation methods have recently emerged as a framework to construct fully probabilistic estimates of all these types of uncertainty. So far, much of this work focused on theoretical foundations, and as such is not particularly data efficient or scalable. Here we propose a framework combining a discretization scheme based on the popular Finite Volume Method with complementary numerical linear algebra techniques. Practical experiments, including a spatiotemporal tsunami simulation, demonstrate substantially improved scaling behavior of this approach over previous collocation-based techniques.


title: From cryptomarkets to the surface web: Scouting eBay for counterfeits

abstract: Detecting counterfeits on online marketplaces is challenging, and current methods struggle with the volume of sales on platforms like eBay, while cryptomarkets openly sell counterfeits. Leveraging information from 453 cryptomarket counterfeits, we automated a search for corresponding products on eBay, utilizing image and text similarity metrics. We collected data twice over 4-months to analyze changes with an average of 159 eBay products per cryptomarket item, totaling 134k products. We found identical products, which would warrant further investigation as to whether they are counterfeits. Results indicate increasing difficulty finding similar products over time, moderated by product type and origin. Future improved versions of the current system could be used to examine possible connections between cryptomarket and surface web listings more closely and could hold practical value in supporting the detection of counterfeits on the surface web.


title: An Approximate Version of the Strong Nine Dragon Tree Conjecture

abstract: We prove the Strong Nine Dragon Tree Conjecture is true if we replace $d$ with $d + \frac{k}{2} \cdot (\big\lceil{\frac{d}{k+1}} \big\rceil - 1) \big\lceil{\frac{d}{k+1}} \big\rceil$. More precisely: let $G$ be a graph and let $d$ and $k$ be positive integers. If $\gamma(G) \leq k + \frac{d}{d + k + 1}$, then there is a partition into $k + 1$ forests, where in one forest every connected component has at most $d + \frac{k}{2} \cdot (\big\lceil{\frac{d}{k+1}} \big\rceil - 1) \big\lceil{\frac{d}{k+1}} \big\rceil$ edges.


title: GANetic Loss for Generative Adversarial Networks with a Focus on Medical Applications

abstract: Generative adversarial networks (GANs) are machine learning models that are used to estimate the underlying statistical structure of a given dataset and as a result can be used for a variety of tasks such as image generation or anomaly detection. Despite their initial simplicity, designing an effective loss function for training GANs remains challenging, and various loss functions have been proposed aiming to improve the performance and stability of the generative models. In this study, loss function design for GANs is presented as an optimization problem solved using the genetic programming (GP) approach. Initial experiments were carried out using small Deep Convolutional GAN (DCGAN) model and the MNIST dataset, in order to search experimentally for an improved loss function. The functions found were evaluated on CIFAR10, with the best function, named GANetic loss, showing exceptionally better performance and stability compared to the losses commonly used for GAN training. To further evalute its general applicability on more challenging problems, GANetic loss was applied for two medical applications: image generation and anomaly detection. Experiments were performed with histopathological, gastrointestinal or glaucoma images to evaluate the GANetic loss in medical image generation, resulting in improved image quality compared to the baseline models. The GANetic Loss used for polyp and glaucoma images showed a strong improvement in the detection of anomalies. In summary, the GANetic loss function was evaluated on multiple datasets and applications where it consistently outperforms alternative loss functions. Moreover, GANetic loss leads to stable training and reproducible results, a known weak spot of GANs.


title: Wave functions of multiquark hadrons from representations of the symmetry groups $S_n$

abstract: Construction of the wave functions of multiquark hadrons by traditional method based on tensor products of colors, flavors, spins (and orbital) parts becomes quite complex when quark numbers grow $n=5,6...12$, as it gets difficult to satisfy requirements of Fermi statistics. Our novel approach is focused directly on representations of the permutation symmetry generators. After showing how $C_3$ is manifested in the wave functions of (excited) baryons, we use it to construct the wave functions for a set of pentaquarks and hexaquarks (n=5,6). We also have some partial results for larger systems, with $n=9$ and 12, and even beyond that as far as $n=24$.


title: Unraveling Trace Anomaly of Supradense Matter via Neutron Star Compactness Scaling

abstract: The trace anomaly $\Delta\equiv 1/3-P/\varepsilon$ quantifies the possibly broken conformal symmetry in supradense matter under pressure $P$ at energy density $\varepsilon$. Perturbative QCD (pQCD) predicts a vanishing $\Delta$ at extremely high energy or baryon densities when the conformal symmetry is realized but its behavior at intermediate densities reachable in neutron stars (NSs) are still very uncertain. The extraction of $\Delta$ from NS observations strongly depends on the employed model for nuclear Equation of State (EOS). Based on the analytical results from perturbatively analyzing the dimensionless Tolman-Oppenheimer-Volkoff (TOV) equations that are further verified numerically by using $10^5$ EOSs generated randomly with a meta-model in a very broad EOS parameter space constrained by terrestrial nuclear experiments and astrophysical observations, here we first show that the compactness $\xi\equiv M_{\rm{NS}}/R$ of a NS with mass $M_{\rm{NS}}$ and radius $R$ scales very accurately with $\Pi_{\rm{c}}\equiv\mathrm{X}/(1+3\mathrm{X}^2+4\mathrm{X})$ where $\mathrm{X}\equiv P_{\rm{c}}/\varepsilon_{\rm{c}}$ is the ratio of pressure over energy density at NS centers. The scaling of NS compactness thus enables one to readily read off the central trace anomaly $\Delta_{\rm{c}}=1/3-\mathrm{X}$ directly from the observational data of either the mass-radius or red-shift measurements. We then demonstrate indeed that the available NS data themselves from recent X-ray and gravitational wave observations can determine model-independently the trace anomaly as a function of energy density in NS cores, providing a stringent test of existing NS models and a clear guidance in a new direction for further understanding the nature and EOS of supradense matter.

categories: astro-ph.HE hep-ph hep-th nucl-ex nucl-th


title: Higher-order modeling of face-to-face interactions

abstract: The most fundamental social interactions among humans occur face to face. Their features have been extensively studied in recent years, owing to the availability of high-resolution data on individuals' proximity. Mathematical models based on mobile agents have been crucial to understand the spatio-temporal organization of face-to-face interactions. However, these models focus on dyadic relationships only, failing to characterize interactions in larger groups of individuals. Here, we propose a model in which agents interact with each other by forming groups of different sizes. Each group has a degree of social attractiveness, based on which neighboring agents decide whether to join. Our framework reproduces different properties of groups in face-to-face interactions, including their distribution, the correlation in their number, and their persistence in time, which cannot be replicated by dyadic models. Furthermore, it captures homophilic patterns at the level of higher-order interactions, going beyond standard pairwise approaches. Our work sheds light on the higher-order mechanisms at the heart of human face-to-face interactions, paving the way for further investigation of how group dynamics at a microscopic scale affects social phenomena at a macroscopic scale.


title: Optimizing Automatic Differentiation with Deep Reinforcement Learning

abstract: Computing Jacobians with automatic differentiation is ubiquitous in many scientific domains such as machine learning, computational fluid dynamics, robotics and finance. Even small savings in the number of computations or memory usage in Jacobian computations can already incur massive savings in energy consumption and runtime. While there exist many methods that allow for such savings, they generally trade computational efficiency for approximations of the exact Jacobian. In this paper, we present a novel method to optimize the number of necessary multiplications for Jacobian computation by leveraging deep reinforcement learning (RL) and a concept called cross-country elimination while still computing the exact Jacobian. Cross-country elimination is a framework for automatic differentiation that phrases Jacobian accumulation as ordered elimination of all vertices on the computational graph where every elimination incurs a certain computational cost. We formulate the search for the optimal elimination order that minimizes the number of necessary multiplications as a single player game which is played by an RL agent. We demonstrate that this method achieves up to 33% improvements over state-of-the-art methods on several relevant tasks taken from diverse domains. Furthermore, we show that these theoretical gains translate into actual runtime improvements by providing a cross-country elimination interpreter in JAX that can efficiently execute the obtained elimination orders.


title: Goal-Oriented Error Estimation and Adaptivity for Stochastic Collocation FEM

abstract: We propose and analyze a general goal-oriented adaptive strategy for approximating quantities of interest (QoIs) associated with solutions to linear elliptic partial differential equations with random inputs. The QoIs are represented by bounded linear or continuously G\^ateaux differentiable nonlinear goal functionals, and the approximations are computed using the sparse grid stochastic collocation finite element method (SC-FEM). The proposed adaptive strategy relies on novel reliable a posteriori estimates of the errors in approximating QoIs. One of the key features of our error estimation approach is the introduction of a correction term into the approximation of QoIs in order to compensate for the lack of (global) Galerkin orthogonality in the SC-FEM setting. Computational results generated using the proposed adaptive algorithm are presented in the paper for representative elliptic problems with affine and nonaffine parametric coefficient dependence and for a range of linear and nonlinear goal functionals.


title: Kondo Screening and Indirect Magnetic Exchange through a Conventional Superconductor Studied by the Density-Matrix Renormalization Group

abstract: The competition between the Kondo screening and indirect magnetic exchange in systems with two magnetic impurities coupled to a conventional s-wave superconductor gives rise to a nontrivial ground-state phase diagram. Here, we utilize the density-matrix renormalization group (DMRG) method and exploit the non-abelian spin-SU(2) symmetry to study the phase diagram for two quantum-spin-$\frac12$ impurities locally exchange coupled to large one-dimensional chains. The nonlocal inter-impurity exchange is treated as an emergent Ruderman-Kittel-Kasuya-Yosida (RKKY) coupling. We find qualitatively different phase diagrams for impurity spins coupled to sites with odd or even distances $d$ on the chain and a partial-Kondo-screened spin-doublet phase that extends over the whole range of local exchange couplings $J$ in the limit of weak superconducting pairing strength $\Delta$. Our numerical studies are complemented by exact diagonalization of small (quantum-box) systems and by perturbative-in-$J$ computations of the $d$ and $\Delta$ dependent RKKY interaction. It is thereby demonstrated that the specific system geometry is essential for our understanding of magnetic impurity interactions in superconducting hosts, and thus for insights into the control of quantum-state properties in nanoparticle systems and topological superconductivity.


title: Stochastic simulation of dissipative quantum oscillators

abstract: Generic open quantum systems are notoriously difficult to simulate unless one looks at specific regimes. In contrast, classical dissipative systems can often be effectively described by stochastic processes, which are generally less computationally expensive. Here, we use the paradigmatic case of a dissipative quantum oscillator to give a pedagogic introduction into the modelling of open quantum systems using quasiclassical methods, i.e. classical stochastic methods that use a 'quantum' noise spectrum to capture the influence of the environment on the system. Such quasiclassical methods have the potential to offer insights into the impact of the quantum nature of the environment on the dynamics of the system of interest whilst still being computationally tractable.


title: Unified view of scalar and vector dark matter solitons

abstract: The existence of solitons -- stable, long-lived, and localized field configurations -- is a generic prediction for ultralight dark matter. These solitons, known by various names such as boson stars, axion stars, oscillons, and Q-balls depending on the context, are typically treated as distinct entities in the literature. This study aims to provide a unified perspective on these solitonic objects for real or complex, scalar or vector dark matter, considering self-interactions and nonminimal gravitational interactions. We demonstrate that these solitons share universal nonrelativistic properties, such as conserved charges, mass-radius relations, stability and profiles. Without accounting for alternative interactions or relativistic effects, distinguishing between real and complex scalar dark matter is challenging. However, self-interactions differentiate real and complex vector dark matter due to their different dependencies on the macroscopic spin density of dark matter waves. Furthermore, gradient-dependent nonminimal gravitational interactions impose an upper bound on soliton amplitudes, influencing their mass distribution and phenomenology in the present-day universe.


title: Dynamical Schwinger Effect in Lead-Halide Perovskites

abstract: We observe strong photoluminescence of a lead-halide perovskite driven by deep sub-gap irradiation. Using the quasi-adiabatic Landau-Dykhne approach, we interpret this observation in terms of the dynamical Schwinger effect -- tunneling ionization in strong fields. Further, the exponential sensitivity of the Schwinger effect to driving fields allows us to measure the local frozen-in fields in a nominally cubic MAPbBr$_3$ single crystal at room temperature. Finally, we demonstrate an AC analogue of biasing in our system -- the cooperation between two time-dependent fields simultaneously driving the sample. Our results (i) establish lead-halide perovskites as an excellent platform for simulating effects of strong fields on Dirac fields, (ii) contribute to the on-going discussion about inversion-breaking in MAPbBr$_3$ single crystal, and (iii) pave the way for a mid-infrared light detection with lead-halide perovskites.


title: Gradient Descent on Logistic Regression with Non-Separable Data and Large Step Sizes

abstract: We study gradient descent (GD) dynamics on logistic regression problems with large, constant step sizes. For linearly-separable data, it is known that GD converges to the minimizer with arbitrarily large step sizes, a property which no longer holds when the problem is not separable. In fact, the behaviour can be much more complex -- a sequence of period-doubling bifurcations begins at the critical step size $2/\lambda$, where $\lambda$ is the largest eigenvalue of the Hessian at the solution. Using a smaller-than-critical step size guarantees convergence if initialized nearby the solution: but does this suffice globally? In one dimension, we show that a step size less than $1/\lambda$ suffices for global convergence. However, for all step sizes between $1/\lambda$ and the critical step size $2/\lambda$, one can construct a dataset such that GD converges to a stable cycle. In higher dimensions, this is actually possible even for step sizes less than $1/\lambda$. Our results show that although local convergence is guaranteed for all step sizes less than the critical step size, global convergence is not, and GD may instead converge to a cycle depending on the initialization.


title: Multiple peaks in gravitational waves induced from primordial curvature perturbations with non-Gaussianity

abstract: First-order primordial curvature perturbations are known to induce gravitational waves at the second-order, which can in turn probe the small-scale curvature perturbations near the end of the inflation. In this work, we extend the previous analysis in the Gaussian case into the non-Gaussian case, with particular efforts to obtain some thumb rules of sandwiching the associated peaks in gravitational waves induced from multiple peaks of non-Gaussian curvature perturbations.


title: Scenarios and Approaches for Situated Natural Language Explanations

abstract: Large language models (LLMs) can be used to generate natural language explanations (NLE) that are adapted to different users' situations. However, there is yet to be a quantitative evaluation of the extent of such adaptation. To bridge this gap, we collect a benchmarking dataset, Situation-Based Explanation. This dataset contains 100 explanandums. Each explanandum is paired with explanations targeted at three distinct audience types-such as educators, students, and professionals-enabling us to assess how well the explanations meet the specific informational needs and contexts of these diverse groups e.g. students, teachers, and parents. For each "explanandum paired with an audience" situation, we include a human-written explanation. These allow us to compute scores that quantify how the LLMs adapt the explanations to the situations. On an array of pretrained language models with varying sizes, we examine three categories of prompting methods: rule-based prompting, meta-prompting, and in-context learning prompting. We find that 1) language models can generate prompts that result in explanations more precisely aligned with the target situations, 2) explicitly modeling an "assistant" persona by prompting "You are a helpful assistant..." is not a necessary prompt technique for situated NLE tasks, and 3) the in-context learning prompts only can help LLMs learn the demonstration template but can't improve their inference performance. SBE and our analysis facilitate future research towards generating situated natural language explanations.


title: TimeSieve: Extracting Temporal Dynamics through Information Bottlenecks

abstract: Time series forecasting has become an increasingly popular research area due to its critical applications in various real-world domains such as traffic management, weather prediction, and financial analysis. Despite significant advancements, existing models face notable challenges, including the necessity of manual hyperparameter tuning for different datasets, and difficulty in effectively distinguishing signal from redundant features in data characterized by strong seasonality. These issues hinder the generalization and practical application of time series forecasting models. To solve this issues, we propose an innovative time series forecasting model TimeSieve designed to address these challenges. Our approach employs wavelet transforms to preprocess time series data, effectively capturing multi-scale features without the need for additional parameters or manual hyperparameter tuning. Additionally, we introduce the information bottleneck theory that filters out redundant features from both detail and approximation coefficients, retaining only the most predictive information. This combination reduces significantly improves the model's accuracy. Extensive experiments demonstrate that our model outperforms existing state-of-the-art methods on 70\% of the datasets, achieving higher predictive accuracy and better generalization across diverse datasets. Our results validate the effectiveness of our approach in addressing the key challenges in time series forecasting, paving the way for more reliable and efficient predictive models in practical applications. The code for our model is available at https://github.com/xll0328/TimeSieve.


title: Linear stability analysis for a system of singular amplitude equations arising in biomorphology

abstract: We study linear stability of exponential periodic solutions of a system of singular amplitude equations associated with convective Turing bifurcation in the presence of conservation laws, as arises in modern biomorphology models, binary fluids, and elsewhere. Consisting of a complex Ginzburg-Landau equation coupled with a singular convection-diffusion equation in "mean modes" associated with conservation laws, these were shown previously by the authors to admit a constant-coefficient linearized stability analysis as in the classical Ginzburg-Landau case -- albeit now singular in wave amplitude epsilon -- yielding useful necessary conditions for stability, both of the exponential functions as solutions of the amplitude equations, and of the associated periodic pattern solving the underlying PDE. Here, we show by a delicate two-parameter matrix perturbation analysis that (strict) satisfaction of these necessary conditions is also sufficient for diffusive stability in the sense of Schneider, yielding a corresponding result, and nonlinear stability, for the underlying PDE. Moreover, we show that they may be interpreted as stability along a non-normally hyperbolic slow manifold approximated by Darcy-type reduction, together with attraction along transverse mean modes, connecting with finite-time approximation theorems of Hacker-Schneider-Zimmerman.


title: Efficient 3D Shape Generation via Diffusion Mamba with Bidirectional SSMs

abstract: Recent advancements in sequence modeling have led to the development of the Mamba architecture, noted for its selective state space approach, offering a promising avenue for efficient long sequence handling. However, its application in 3D shape generation, particularly at high resolutions, remains underexplored. Traditional diffusion transformers (DiT) with self-attention mechanisms, despite their potential, face scalability challenges due to the cubic complexity of attention operations as input length increases. This complexity becomes a significant hurdle when dealing with high-resolution voxel sizes. To address this challenge, we introduce a novel diffusion architecture tailored for 3D point clouds generation-Diffusion Mamba (DiM-3D). This architecture forgoes traditional attention mechanisms, instead utilizing the inherent efficiency of the Mamba architecture to maintain linear complexity with respect to sequence length. DiM-3D is characterized by fast inference times and substantially lower computational demands, quantified in reduced Gflops, thereby addressing the key scalability issues of prior models. Our empirical results on the ShapeNet benchmark demonstrate that DiM-3D achieves state-of-the-art performance in generating high-fidelity and diverse 3D shapes. Additionally, DiM-3D shows superior capabilities in tasks like 3D point cloud completion. This not only proves the model's scalability but also underscores its efficiency in generating detailed, high-resolution voxels necessary for advanced 3D shape modeling, particularly excelling in environments requiring high-resolution voxel sizes. Through these findings, we illustrate the exceptional scalability and efficiency of the Diffusion Mamba framework in 3D shape generation, setting a new standard for the field and paving the way for future explorations in high-resolution 3D modeling technologies.


title: Bootstrapping Referring Multi-Object Tracking

abstract: Referring multi-object tracking (RMOT) aims at detecting and tracking multiple objects following human instruction represented by a natural language expression. Existing RMOT benchmarks are usually formulated through manual annotations, integrated with static regulations. This approach results in a dearth of notable diversity and a constrained scope of implementation. In this work, our key idea is to bootstrap the task of referring multi-object tracking by introducing discriminative language words as much as possible. In specific, we first develop Refer-KITTI into a large-scale dataset, named Refer-KITTI-V2. It starts with 2,719 manual annotations, addressing the issue of class imbalance and introducing more keywords to make it closer to real-world scenarios compared to Refer-KITTI. They are further expanded to a total of 9,758 annotations by prompting large language models, which create 617 different words, surpassing previous RMOT benchmarks. In addition, the end-to-end framework in RMOT is also bootstrapped by a simple yet elegant temporal advancement strategy, which achieves better performance than previous approaches. The source code and dataset is available at https://github.com/zyn213/TempRMOT.


title: Structured physics-guided neural networks for electromagnetic commutation applied to industrial linear motors

abstract: Mechatronic systems are described by an interconnection of the electromagnetic part, i.e., a static position-dependent nonlinear relation between currents and forces, and the mechanical part, i.e., a dynamic relation from forces to position. Commutation inverts a model of the electromagnetic part of the system, and thereby removes the electromagnetic part from the position control problem. Typical commutation algorithms rely on simplified models derived from physics-based knowledge, which do not take into account position dependent parasitic effects. In turn, these commutation related model errors translate into position tracking errors, which limit the system performance. Therefore, in this work, we develop a data-driven approach to commutation using physics-guided neural networks (PGNNs). A novel PGNN model is proposed which structures neural networks (NNs) to learn specific motor dependent parasitic effects. The PGNN is used to identify a model of the electromagnetic part using force measurements, after which it is analytically inverted to obtain a PGNN-based commutation algorithm. Motivated by industrial applications, we develop an input transformation to deal with systems with fixed commutation, i.e., when the currents cannot be controlled. Real-life experiments on an industrial coreless linear motor (CLM) demonstrate a factor 10 improvement in the commutation error in driving direction and a factor 4 improvement in the position error with respect to classical commutation in terms of the mean--squared error (MSE).


title: Online Frequency Scheduling by Learning Parallel Actions

abstract: Radio Resource Management is a challenging topic in future 6G networks where novel applications create strong competition among the users for the available resources. In this work we consider the frequency scheduling problem in a multi-user MIMO system. Frequency resources need to be assigned to a set of users while allowing for concurrent transmissions in the same sub-band. Traditional methods are insufficient to cope with all the involved constraints and uncertainties, whereas reinforcement learning can directly learn near-optimal solutions for such complex environments. However, the scheduling problem has an enormous action space accounting for all the combinations of users and sub-bands, so out-of-the-box algorithms cannot be used directly. In this work, we propose a scheduler based on action-branching over sub-bands, which is a deep Q-learning architecture with parallel decision capabilities. The sub-bands learn correlated but local decision policies and altogether they optimize a global reward. To improve the scaling of the architecture with the number of sub-bands, we propose variations (Unibranch, Graph Neural Network-based) that reduce the number of parameters to learn. The parallel decision making of the proposed architecture allows to meet short inference time requirements in real systems. Furthermore, the deep Q-learning approach permits online fine-tuning after deployment to bridge the sim-to-real gap. The proposed architectures are evaluated against relevant baselines from the literature showing competitive performance and possibilities of online adaptation to evolving environments.


title: Digital Twins of the EM Environment: Benchmark for Ray Launching Models

abstract: Digital Twin has emerged as a promising paradigm for accurately representing the electromagnetic (EM) wireless environments. The resulting virtual representation of the reality facilitates comprehensive insights into the propagation environment, empowering multi-layer decision-making processes at the physical communication level. This paper investigates the digitization of wireless communication propagation, with particular emphasis on the indispensable aspect of ray-based propagation simulation for real-time Digital Twins. A benchmark for ray-based propagation simulations is presented to evaluate computational time, with two urban scenarios characterized by different mesh complexity, single and multiple wireless link configurations, and simulations with/without diffuse scattering. Exhaustive empirical analyses are performed showing and comparing the behavior of different ray-based solutions. By offering standardized simulations and scenarios, this work provides a technical benchmark for practitioners involved in the implementation of real-time Digital Twins and optimization of ray-based propagation models.


title: Quantitative convergence guarantees for the mean-field dispersion process

abstract: We study the dispersion process on the complete graph introduced in the recent work \cite{de_dispersion_2023} under the mean-field framework. In contrast to the probabilistic approach taken in \cite{de_dispersion_2023} and many other related works, our focus is on the investigation of the large time behavior of solutions of the associated kinetic mean-field system of nonlinear ordinary differential equations (ODEs). We establish various analytical and quantitative convergence results for the long time behaviour of the mean-field system and related numerical illustrations are also provided.


title: The formation and survival of cold gas in a magnetized cool-core galaxy cluster

abstract: Filaments of cold gas ($T\leq 10^{4}$ K) are found in the inner regions of many cool-core clusters. These structures are thought to play a major role in the regulation of feedback from active galactic nuclei (AGN). We study the morphology of the filaments, their formation, and their impact on the propagation of the outflowing AGN jets. We present a set of GPU-accelerated 3D (magneto)hydrodynamical simulations of an idealized Perseus-like cluster using the performance portable code AthenaPK. We include radiative cooling, and a self-regulated AGN feedback model that redistributes accreted material through kinetic, thermal and magnetic feedback. We confirm that magnetic fields play an important role in both the formation and evolution of the cold material. These suppress the formation of massive cold disks and favor magnetically supported filaments over clumpy structures. Achieving resolutions of $25-50$ pc, we find that filaments are not monolithic as they contain numerous and complex magnetically--supported substructures. We find that the mass distribution of these clumps follows a power law for all investigated filaments, consistent with previous cloud-crushing simulations of individual clumps. Studying the evolution of individual filaments, we find that their formation pathways can be diverse. We find examples of filaments forming through a combination of cold gas uplifting and condensation, as well as systems of purely infalling clumps condensing out of the intracluster medium. The density contrast between the cold gas and the outflowing hot material leads to recurring deflections of the jets, favoring inflation of bubbles.


title: A Tensor Decomposition Perspective on Second-order RNNs

abstract: Second-order Recurrent Neural Networks (2RNNs) extend RNNs by leveraging second-order interactions for sequence modelling. These models are provably more expressive than their first-order counterparts and have connections to well-studied models from formal language theory. However, their large parameter tensor makes computations intractable. To circumvent this issue, one approach known as MIRNN consists in limiting the type of interactions used by the model. Another is to leverage tensor decomposition to diminish the parameter count. In this work, we study the model resulting from parameterizing 2RNNs using the CP decomposition, which we call CPRNN. Intuitively, the rank of the decomposition should reduce expressivity. We analyze how rank and hidden size affect model capacity and show the relationships between RNNs, 2RNNs, MIRNNs, and CPRNNs based on these parameters. We support these results empirically with experiments on the Penn Treebank dataset which demonstrate that, with a fixed parameter budget, CPRNNs outperforms RNNs, 2RNNs, and MIRNNs with the right choice of rank and hidden size.


title: The Dark Energy Survey Supernova Program: Light curves and 5-Year data release

abstract: We present $griz$ photometric light curves for the full 5 years of the Dark Energy Survey Supernova program (DES-SN), obtained with both forced Point Spread Function (PSF) photometry on Difference Images (DIFFIMG) performed during survey operations, and Scene Modelling Photometry (SMP) on search images processed after the survey. This release contains $31,636$ DIFFIMG and $19,706$ high-quality SMP light curves, the latter of which contains $1635$ photometrically-classified supernovae that pass cosmology quality cuts. This sample spans the largest redshift ($z$) range ever covered by a single SN survey ($0.1<z<1.13$) and is the largest single sample from a single instrument of SNe ever used for cosmological constraints. We describe in detail the improvements made to obtain the final DES-SN photometry and provide a comparison to what was used in the DES-SN3YR spectroscopically-confirmed SN Ia sample. We also include a comparative analysis of the performance of the SMP photometry with respect to the real-time DIFFIMG forced photometry and find that SMP photometry is more precise, more accurate, and less sensitive to the host-galaxy surface brightness anomaly. The public release of the light curves and ancillary data can be found at https://github.com/des-science/DES-SN5YR. Finally, we discuss implications for future transient surveys, such as the forthcoming Vera Rubin Observatory Legacy Survey of Space and Time (LSST).


title: The Dark Energy Survey : Detection of weak lensing magnification of supernovae and constraints on dark matter haloes

abstract: The residuals of the distance moduli of Type Ia supernovae (SN Ia) relative to a Hubble diagram fit contain information about the inhomogeneity of the universe, due to weak lensing magnification by foreground matter. By correlating the residuals of the Dark Energy Survey Year 5 SN Ia sample (DES-SN5YR) with extra-galactic foregrounds from the DES Y3 Gold catalog, we detect the presence of lensing at $6.0 \sigma$ significance. This is the first detection with a significance level above $5\sigma$. Constraints on the effective mass-to-light ratios and radial profiles of dark-matter haloes surrounding individual galaxies are also obtained. We show that the scatter of SNe Ia around the Hubble diagram is reduced by modifying the standardisation of the distance moduli to include an easily calculable de-lensing (i.e., environmental) term. We use the de-lensed distance moduli to recompute cosmological parameters derived from SN Ia, finding in Flat $w$CDM a difference of $\Delta \Omega_{\rm M} = +0.036$ and $\Delta w = -0.056$ compared to the unmodified distance moduli, a change of $\sim 0.3\sigma$. We argue that our modelling of SN Ia lensing will lower systematics on future surveys with higher statistical power. We use the observed dispersion of lensing in DES-SN5YR to constrain $\sigma_8$, but caution that the fit is sensitive to uncertainties at small scales. Nevertheless, our detection of SN Ia lensing opens a new pathway to study matter inhomogeneity that complements galaxy-galaxy lensing surveys and has unrelated systematics.


title: The Dark Energy Survey Supernova Program: Investigating Beyond-$\Lambda$CDM

abstract: We report constraints on a variety of non-standard cosmological models using the full 5-year photometrically-classified type Ia supernova sample from the Dark Energy Survey (DES-SN5YR). Both Akaike Information Criterion (AIC) and Suspiciousness calculations find no strong evidence for or against any of the non-standard models we explore. When combined with external probes, the AIC and Suspiciousness agree that 11 of the 15 models are moderately preferred over Flat-$\Lambda$CDM suggesting additional flexibility in our cosmological models may be required beyond the cosmological constant. We also provide a detailed discussion of all cosmological assumptions that appear in the DES supernova cosmology analyses, evaluate their impact, and provide guidance on using the DES Hubble diagram to test non-standard models. An approximate cosmological model, used to perform bias corrections to the data holds the biggest potential for harbouring cosmological assumptions. We show that even if the approximate cosmological model is constructed with a matter density shifted by $\Delta\Omega_m\sim0.2$ from the true matter density of a simulated data set the bias that arises is sub-dominant to statistical uncertainties. Nevertheless, we present and validate a methodology to reduce this bias.


title: The Dark Energy Survey Supernova Program: An updated measurement of the Hubble constant using the Inverse Distance Ladder

abstract: We measure the current expansion rate of the Universe, Hubble's constant $H_0$, by calibrating the absolute magnitudes of supernovae to distances measured by Baryon Acoustic Oscillations. This `inverse distance ladder' technique provides an alternative to calibrating supernovae using nearby absolute distance measurements, replacing the calibration with a high-redshift anchor. We use the recent release of 1829 supernovae from the Dark Energy Survey spanning $0.01\lt z \lt1.13$ anchored to the recent Baryon Acoustic Oscillation measurements from DESI spanning $0.30 \lt z_{\mathrm{eff}} \lt 2.33$. To trace cosmology to $z=0$, we use the third-, fourth- and fifth-order cosmographic models, which, by design, are agnostic about the energy content and expansion history of the universe. With the inclusion of the higher-redshift DESI-BAO data, the third-order model is a poor fit to both data sets, with the fourth-order model being preferred by the Akaike Information Criterion. Using the fourth-order cosmographic model, we find $H_0=67.19^{+0.66}_{-0.64}\mathrm{~km} \mathrm{~s}^{-1} \mathrm{~Mpc}^{-1}$, in agreement with the value found by Planck without the need to assume Flat-$\Lambda$CDM. However the best-fitting expansion history differs from that of Planck, providing continued motivation to investigate these tensions.


title: The Dark Energy Survey Supernova Program: Slow supernovae show cosmological time dilation out to $z \sim 1$

abstract: We present a precise measurement of cosmological time dilation using the light curves of 1504 type Ia supernovae from the Dark Energy Survey spanning a redshift range $0.1\lesssim z\lesssim 1.2$. We find that the width of supernova light curves is proportional to $(1+z)$, as expected for time dilation due to the expansion of the Universe. Assuming type Ia supernovae light curves are emitted with a consistent duration $\Delta t_{\rm em}$, and parameterising the observed duration as $\Delta t_{\rm obs}=\Delta t_{\rm em}(1+z)^b$, we fit for the form of time dilation using two methods. Firstly, we find that a power of $b \approx 1$ minimises the flux scatter in stacked subsamples of light curves across different redshifts. Secondly, we fit each target supernova to a stacked light curve (stacking all supernovae with observed bandpasses matching that of the target light curve) and find $b=1.003\pm0.005$ (stat) $\pm\,0.010$ (sys). Thanks to the large number of supernovae and large redshift-range of the sample, this analysis gives the most precise measurement of cosmological time dilation to date, ruling out any non-time-dilating cosmological models at very high significance.


title: Modelling the impact of host galaxy dust on type Ia supernova distance measurements

abstract: Type Ia Supernovae (SNe Ia) are a critical tool in measuring the accelerating expansion of the universe. Recent efforts to improve these standard candles have focused on incorporating the effects of dust on distance measurements with SNe Ia. In this paper, we use the state-of-the-art Dark Energy Survey 5 year sample to evaluate two different families of dust models: empirical extinction models derived from SNe Ia data, and physical attenuation models from the spectra of galaxies. Among the SNe Ia-derived models, we find that a logistic function of the total-to-selective extinction RV best recreates the correlations between supernova distance measurements and host galaxy properties, though an additional 0.02 magnitudes of grey scatter are needed to fully explain the scatter in SNIa brightness in all cases. These empirically-derived extinction distributions are highly incompatible with the physical attenuation models from galactic spectral measurements. From these results, we conclude that SNe Ia must either preferentially select extreme ends of galactic dust distributions, or that the characterisation of dust along the SNe Ia line-of-sight is incompatible with that of galactic dust distributions.


title: Column generation for multistage stochastic mixed-integer nonlinear programs with discrete state variables

abstract: Stochastic programming provides a natural framework for modeling sequential optimization problems under uncertainty; however, the efficient solution of large-scale multistage stochastic programs remains a challenge, especially in the presence of discrete decisions and nonlinearities. In this work, we consider multistage stochastic mixed-integer nonlinear programs (MINLPs) with discrete state variables, which exhibit a decomposable structure that allows its solution using a column generation approach. Following a Dantzig-Wolfe reformulation, we apply column generation such that each pricing subproblem is an MINLP of much smaller size, making it more amenable to global MINLP solvers. We further propose a method for generating additional columns that satisfy the nonanticipativity constraints, leading to significantly improved convergence and optimal or near-optimal solutions for many large-scale instances in a reasonable computation time. The effectiveness of the tailored column generation algorithm is demonstrated via computational case studies on a multistage blending problem and a problem involving the routing of mobile generators in a power distribution network.


title: Hints-In-Browser: Benchmarking Language Models for Programming Feedback Generation

abstract: Generative AI and large language models hold great promise in enhancing programming education by generating individualized feedback and hints for learners. Recent works have primarily focused on improving the quality of generated feedback to achieve human tutors' quality. While quality is an important performance criterion, it is not the only criterion to optimize for real-world educational deployments. In this paper, we benchmark language models for programming feedback generation across several performance criteria, including quality, cost, time, and data privacy. The key idea is to leverage recent advances in the new paradigm of in-browser inference that allow running these models directly in the browser, thereby providing direct benefits across cost and data privacy. To boost the feedback quality of small models compatible with in-browser inference engines, we develop a fine-tuning pipeline based on GPT-4 generated synthetic data. We showcase the efficacy of fine-tuned Llama3-8B and Phi3-3.8B 4-bit quantized models using WebLLM's in-browser inference engine on three different Python programming datasets. We will release the full implementation along with a web app and datasets to facilitate further research on in-browser language models.


title: Prototype Correlation Matching and Class-Relation Reasoning for Few-Shot Medical Image Segmentation

abstract: Few-shot medical image segmentation has achieved great progress in improving accuracy and efficiency of medical analysis in the biomedical imaging field. However, most existing methods cannot explore inter-class relations among base and novel medical classes to reason unseen novel classes. Moreover, the same kind of medical class has large intra-class variations brought by diverse appearances, shapes and scales, thus causing ambiguous visual characterization to degrade generalization performance of these existing methods on unseen novel classes. To address the above challenges, in this paper, we propose a \underline{\textbf{P}}rototype correlation \underline{\textbf{M}}atching and \underline{\textbf{C}}lass-relation \underline{\textbf{R}}easoning (i.e., \textbf{PMCR}) model. The proposed model can effectively mitigate false pixel correlation matches caused by large intra-class variations while reasoning inter-class relations among different medical classes. Specifically, in order to address false pixel correlation match brought by large intra-class variations, we propose a prototype correlation matching module to mine representative prototypes that can characterize diverse visual information of different appearances well. We aim to explore prototype-level rather than pixel-level correlation matching between support and query features via optimal transport algorithm to tackle false matches caused by intra-class variations. Meanwhile, in order to explore inter-class relations, we design a class-relation reasoning module to segment unseen novel medical objects via reasoning inter-class relations between base and novel classes. Such inter-class relations can be well propagated to semantic encoding of local query features to improve few-shot segmentation performance. Quantitative comparisons illustrates the large performance improvement of our model over other baseline methods.


title: Robustness Assessment of Mathematical Reasoning in the Presence of Missing and Contradictory Conditions

abstract: Large language models (LLMs) have demonstrated impressive performance on reasoning tasks, which can be further improved through few-shot prompting techniques. However, the current evaluation primarily focuses on carefully constructed benchmarks and neglects the consideration of real-world reasoning problems that present missing and contradictory conditions, known as ill-defined problems. Our observations suggest that existing few-shot prompting techniques are ineffective in such scenarios, often providing overconfident answers or hallucination. To further study this problem, we develop a benchmark called Problems with Missing and Contradictory conditions (PMC) and introduce two novel metrics to evaluate the performance of few-shot prompting methods in these scenarios. Our analysis using the PMC benchmark reveals a trade-off dilemma between the performance of mathematical reasoning for well-defined problems and the ability to recognize ill-defined problems. To address the challenges posed by PMC, we propose a novel few-shot prompting method called SMT-LIB Prompting (SLP), which utilizes the SMT-LIB language to model the problems instead of solving them directly. Subsequently, a double-check solving strategy checks the satisfiability and uniqueness of the solution and provides final feedback. Extensive experiments demonstrate the superiority of our SLP approach compared to existing few-shot prompting methods when dealing with problems with missing and contradictory conditions. We will open-source our benchmark and code to facilitate future research.


title: ${l}^2$ Decoupling for certain degenerate surfaces in $\mathbb{R}^4$

abstract: In this article, we aim to study decoupling inequality for a specific degenerate hypersurface in $\mathbb{R}^4$. Inspired by the work of Bourgain--Demeter and Li--Zheng, we consider the hypersurface $\mathcal{S}^3_{4}:=\{(\xi_1,\xi_2,\xi_3,\xi^4_1+\xi^4_2+\xi^4_3):0\leq \xi_j\leq1, \text{for}~j=1,2,3\}$ in $\mathbb{R}^4$ and study decoupling estimates.


title: Planar chemical reaction systems with algebraic and non-algebraic limit cycles

abstract: The Hilbert number $H(n)$ is defined as the maximum number of limit cycles of a planar autonomous system of ordinary differential equations (ODEs) with right-hand sides containing polynomials of degree at most $n \in {\mathbb N}$. The dynamics of chemical reaction systems with two chemical species can be (under mass-action kinetics) described by such planar autonomous ODEs, where $n$ is equal to the maximum order of the chemical reactions in the system. Generalizations of the Hilbert number $H(n)$ to three different classes of chemical reaction networks are investigated: (i) chemical systems with reactions up to the $n$-th order; (ii) systems with up to $n$-molecular chemical reactions; and (iii) weakly reversible chemical reaction networks. In each case (i), (ii) and (iii), the question on the number of limit cycles is considered. Lower bounds on the generalized Hilbert numbers are provided for both algebraic and non-algebraic limit cycles. Furthermore, given a general algebraic curve $h(x,y)=0$ of degree $n_h \in {\mathbb N}$ and containing one or more ovals in the positive quadrant, a chemical system is constructed which has the oval(s) as its stable algebraic limit cycle(s). The ODEs describing the dynamics of the constructed chemical system contain polynomials of degree at most $n=2\,n_h+1.$ Considering $n_h \ge 4,$ the algebraic curve $h(x,y)=0$ can contain multiple closed components with the maximum number of ovals given by Harnack's curve theorem as $1+(n_h-1)(n_h-2)/2$, which is equal to 4 for $n_h=4.$ Algebraic curve $h(x,y)=0$ with $n_h=4$ and the maximum number of four ovals is used to construct a chemical system which has four stable algebraic limit cycles.


title: Accurate stochastic simulation algorithm for multiscale models of infectious diseases

abstract: In the infectious disease literature, significant effort has been devoted to studying dynamics at a single scale. For example, compartmental models describing population-level dynamics are often formulated using differential equations. In cases where small numbers or noise play a crucial role, these differential equations are replaced with memoryless Markovian models, where discrete individuals can be members of a compartment and transition stochastically. Classic stochastic simulation algorithms, such as Gillespie's algorithm and the next reaction method, can be employed to solve these Markovian models exactly. The intricate coupling between models at different scales underscores the importance of multiscale modelling in infectious diseases. However, several computational challenges arise when the multiscale model becomes non-Markovian. In this paper, we address these challenges by developing a novel exact stochastic simulation algorithm. We apply it to a showcase multiscale system where all individuals share the same deterministic within-host model while the population-level dynamics are governed by a stochastic formulation. We demonstrate that as long as the within-host information is harvested at a reasonable resolution, the novel algorithm we develop will always be accurate. Moreover, the novel algorithm we develop is general and can be easily applied to other multiscale models in (or outside) the realm of infectious diseases.


title: GenHeld: Generating and Editing Handheld Objects

abstract: Grasping is an important human activity that has long been studied in robotics, computer vision, and cognitive science. Most existing works study grasping from the perspective of synthesizing hand poses conditioned on 3D or 2D object representations. We propose GenHeld to address the inverse problem of synthesizing held objects conditioned on 3D hand model or 2D image. Given a 3D model of hand, GenHeld 3D can select a plausible held object from a large dataset using compact object representations called object codes.The selected object is then positioned and oriented to form a plausible grasp without changing hand pose. If only a 2D hand image is available, GenHeld 2D can edit this image to add or replace a held object. GenHeld 2D operates by combining the abilities of GenHeld 3D with diffusion-based image editing. Results and experiments show that we outperform baselines and can generate plausible held objects in both 2D and 3D. Our experiments demonstrate that our method achieves high quality and plausibility of held object synthesis in both 3D and 2D.


title: The JADES Transient Survey: Discovery and Classification of Supernovae in the JADES Deep Field

abstract: The JWST Advanced Deep Extragalactic Survey (JADES) is a multi-cycle JWST program that has taken among the deepest near-infrared images to date (down to $\sim$30.5 ABmag) over $\sim$25 arcmin$^2$ in the GOODS-S field in two sets of observations with one year of separation. This presented the first opportunity to systematically search for transients, mostly supernovae (SNe), out to $z>$2. We found 79 SNe: 38 at $z<$2, 23 at 2$<z<$3, 8 at 3$<z<$4, 7 at 4$<z<$5, and 3 with undetermined redshifts, where the redshifts are predominantly based on spectroscopic or highly reliable JADES photometric redshifts of the host galaxies. At this depth, the detection rate is $\sim$1-2 per arcmin$^2$ per year, demonstrating the power of JWST as a supernova discovery machine. We also conducted multi-band follow-up NIRCam observations of a subset of the SNe to better constrain their light curves and classify their types. Here, we present the survey, sample, search parameters, spectral energy distributions (SEDs), light curves, and classifications. Even at $z\geq$2, the NIRCam data quality is such that we can perform multi-epoch light-curve fitting to classify supernovae with a reasonable degree of confidence. The multi-epoch SN sample includes a Type Ia SN at $z_{spec}= $ 2.91, Type IIP SN at $z_{spec}= $ 3.61, and a Type Ic-BL SN at $z_{spec}= $ 2.845. We also found that two $z\sim$16 galaxy candidates from the first imaging epoch were actually transients that faded in the second epoch, illustrating the possibility that moderate/high-redshift SNe could mimic high-redshift dropout galaxies.


title: Progressive Entropic Optimal Transport Solvers

abstract: Optimal transport (OT) has profoundly impacted machine learning by providing theoretical and computational tools to realign datasets. In this context, given two large point clouds of sizes $n$ and $m$ in $\mathbb{R}^d$, entropic OT (EOT) solvers have emerged as the most reliable tool to either solve the Kantorovich problem and output a $n\times m$ coupling matrix, or to solve the Monge problem and learn a vector-valued push-forward map. While the robustness of EOT couplings/maps makes them a go-to choice in practical applications, EOT solvers remain difficult to tune because of a small but influential set of hyperparameters, notably the omnipresent entropic regularization strength $\varepsilon$. Setting $\varepsilon$ can be difficult, as it simultaneously impacts various performance metrics, such as compute speed, statistical performance, generalization, and bias. In this work, we propose a new class of EOT solvers (ProgOT), that can estimate both plans and transport maps. We take advantage of several opportunities to optimize the computation of EOT solutions by dividing mass displacement using a time discretization, borrowing inspiration from dynamic OT formulations, and conquering each of these steps using EOT with properly scheduled parameters. We provide experimental evidence demonstrating that ProgOT is a faster and more robust alternative to standard solvers when computing couplings at large scales, even outperforming neural network-based approaches. We also prove statistical consistency of our approach for estimating optimal transport maps.


title: The wind-shade roughness model for turbulent wall-bounded flows

abstract: To aid in prediction of turbulent boundary layer flows over rough surfaces, a new model is proposed to estimate hydrodynamic roughness based solely on geometric surface information. The model is based on a fluid-mechanics motivated geometric parameter called the wind-shade factor. Sheltering is included using a rapid algorithm adapted from the landscape shadow literature, while local pressure drag is estimated using a piecewise potential flow approximation. Similarly to evaluating traditional surface parameters such as skewness or average slope magnitude, the wind-shade factor is purely geometric and can be evaluated efficiently from knowing the surface elevation map and the mean flow direction. The wind-shade roughness model is applied to over 100 different surfaces available in a public roughness database and some others, and the predicted sandgrain-roughness heights are compared to measured values. Effects of various model ingredients are analyzed, and transitionally rough surfaces are treated by adding a term representing the viscous stress component.


title: Are Large Language Models More Empathetic than Humans?

abstract: With the emergence of large language models (LLMs), investigating if they can surpass humans in areas such as emotion recognition and empathetic responding has become a focal point of research. This paper presents a comprehensive study exploring the empathetic responding capabilities of four state-of-the-art LLMs: GPT-4, LLaMA-2-70B-Chat, Gemini-1.0-Pro, and Mixtral-8x7B-Instruct in comparison to a human baseline. We engaged 1,000 participants in a between-subjects user study, assessing the empathetic quality of responses generated by humans and the four LLMs to 2,000 emotional dialogue prompts meticulously selected to cover a broad spectrum of 32 distinct positive and negative emotions. Our findings reveal a statistically significant superiority of the empathetic responding capability of LLMs over humans. GPT-4 emerged as the most empathetic, marking approximately 31% increase in responses rated as "Good" compared to the human benchmark. It was followed by LLaMA-2, Mixtral-8x7B, and Gemini-Pro, which showed increases of approximately 24%, 21%, and 10% in "Good" ratings, respectively. We further analyzed the response ratings at a finer granularity and discovered that some LLMs are significantly better at responding to specific emotions compared to others. The suggested evaluation framework offers a scalable and adaptable approach for assessing the empathy of new LLMs, avoiding the need to replicate this study's findings in future research.


title: Pretraining Decision Transformers with Reward Prediction for In-Context Multi-task Structured Bandit Learning

abstract: In this paper, we study multi-task structured bandit problem where the goal is to learn a near-optimal algorithm that minimizes cumulative regret. The tasks share a common structure and the algorithm exploits the shared structure to minimize the cumulative regret for an unseen but related test task. We use a transformer as a decision-making algorithm to learn this shared structure so as to generalize to the test task. The prior work of pretrained decision transformers like DPT requires access to the optimal action during training which may be hard in several scenarios. Diverging from these works, our learning algorithm does not need the knowledge of optimal action per task during training but predicts a reward vector for each of the actions using only the observed offline data from the diverse training tasks. Finally, during inference time, it selects action using the reward predictions employing various exploration strategies in-context for an unseen test task. Our model outperforms other SOTA methods like DPT, and Algorithmic Distillation over a series of experiments on several structured bandit problems (linear, bilinear, latent, non-linear). Interestingly, we show that our algorithm, without the knowledge of the underlying problem structure, can learn a near-optimal policy in-context by leveraging the shared structure across diverse tasks. We further extend the field of pre-trained decision transformers by showing that they can leverage unseen tasks with new actions and still learn the underlying latent structure to derive a near-optimal policy. We validate this over several experiments to show that our proposed solution is very general and has wide applications to potentially emergent online and offline strategies at test time. Finally, we theoretically analyze the performance of our algorithm and obtain generalization bounds in the in-context multi-task learning setting.


title: Emo-bias: A Large Scale Evaluation of Social Bias on Speech Emotion Recognition

abstract: The rapid growth of Speech Emotion Recognition (SER) has diverse global applications, from improving human-computer interactions to aiding mental health diagnostics. However, SER models might contain social bias toward gender, leading to unfair outcomes. This study analyzes gender bias in SER models trained with Self-Supervised Learning (SSL) at scale, exploring factors influencing it. SSL-based SER models are chosen for their cutting-edge performance. Our research pioneering research gender bias in SER from both upstream model and data perspectives. Our findings reveal that females exhibit slightly higher overall SER performance than males. Modified CPC and XLS-R, two well-known SSL models, notably exhibit significant bias. Moreover, models trained with Mandarin datasets display a pronounced bias toward valence. Lastly, we find that gender-wise emotion distribution differences in training data significantly affect gender bias, while upstream model representation has a limited impact.


title: Efficient Centroid-Linkage Clustering

abstract: We give an efficient algorithm for Centroid-Linkage Hierarchical Agglomerative Clustering (HAC), which computes a $c$-approximate clustering in roughly $n^{1+O(1/c^2)}$ time. We obtain our result by combining a new Centroid-Linkage HAC algorithm with a novel fully dynamic data structure for nearest neighbor search which works under adaptive updates. We also evaluate our algorithm empirically. By leveraging a state-of-the-art nearest-neighbor search library, we obtain a fast and accurate Centroid-Linkage HAC algorithm. Compared to an existing state-of-the-art exact baseline, our implementation maintains the clustering quality while delivering up to a $36\times$ speedup due to performing fewer distance comparisons.


title: Affine $\imath$quantum groups and twisted Yangians in Drinfeld presentations

abstract: We formulate a family of algebras, twisted Yangians (of split type) in current generators and relations, via a degeneration of the Drinfeld presentation of affine $\imath$quantum groups (associated with split Satake diagrams). These new algebras admit PBW type bases and are shown to be a deformation of twisted current algebras; presentations for twisted current algebras are also provided. For type AI, it matches with the Drinfeld presentation of twisted Yangian obtained via Gauss decomposition. We conjecture that our split twisted Yangians are isomorphic to the corresponding ones in RTT presentation.


title: Classification Metrics for Image Explanations: Towards Building Reliable XAI-Evaluations

abstract: Decision processes of computer vision models - especially deep neural networks - are opaque in nature, meaning that these decisions cannot be understood by humans. Thus, over the last years, many methods to provide human-understandable explanations have been proposed. For image classification, the most common group are saliency methods, which provide (super-)pixelwise feature attribution scores for input images. But their evaluation still poses a problem, as their results cannot be simply compared to the unknown ground truth. To overcome this, a slew of different proxy metrics have been defined, which are - as the explainability methods themselves - often built on intuition and thus, are possibly unreliable. In this paper, new evaluation metrics for saliency methods are developed and common saliency methods are benchmarked on ImageNet. In addition, a scheme for reliability evaluation of such metrics is proposed that is based on concepts from psychometric testing. The used code can be found at https://github.com/lelo204/ClassificationMetricsForImageExplanations .


title: Harder-Narasimhan filtrations of persistence modules: metric stability

abstract: The Harder-Narasimhan types are a family of discrete isomorphism invariants for representations of finite quivers. Previously (arXiv:2303.16075), we evaluated their discriminating power in the context of persistence modules over a finite poset, including multiparameter persistence modules (over a finite grid). In particular, we introduced the skyscraper invariant and proved it was strictly finer than the rank invariant. In order to study the stability of the skyscraper invariant, we extend its definition from the finite to the infinite setting and consider multiparameter persistence modules over $\mathbb Z ^n$ and $\mathbb R^n$. We then establish an erosion-type stability result for this version of the skyscraper invariant.


title: Targeted Mining Precise-positioning Episode Rules

abstract: The era characterized by an exponential increase in data has led to the widespread adoption of data intelligence as a crucial task. Within the field of data mining, frequent episode mining has emerged as an effective tool for extracting valuable and essential information from event sequences. Various algorithms have been developed to discover frequent episodes and subsequently derive episode rules using the frequency function and anti-monotonicity principles. However, currently, there is a lack of algorithms specifically designed for mining episode rules that encompass user-specified query episodes. To address this challenge and enable the mining of target episode rules, we introduce the definition of targeted precise-positioning episode rules and formulate the problem of targeted mining precise-positioning episode rules. Most importantly, we develop an algorithm called Targeted Mining Precision Episode Rules (TaMIPER) to address the problem and optimize it using four proposed strategies, leading to significant reductions in both time and space resource requirements. As a result, TaMIPER offers high accuracy and efficiency in mining episode rules of user interest and holds promising potential for prediction tasks in various domains, such as weather observation, network intrusion, and e-commerce. Experimental results on six real datasets demonstrate the exceptional performance of TaMIPER.


title: Massively Multiagent Minigames for Training Generalist Agents

abstract: We present Meta MMO, a collection of many-agent minigames for use as a reinforcement learning benchmark. Meta MMO is built on top of Neural MMO, a massively multiagent environment that has been the subject of two previous NeurIPS competitions. Our work expands Neural MMO with several computationally efficient minigames. We explore generalization across Meta MMO by learning to play several minigames with a single set of weights. We release the environment, baselines, and training code under the MIT license. We hope that Meta MMO will spur additional progress on Neural MMO and, more generally, will serve as a useful benchmark for many-agent generalization.


title: Linearization Turns Neural Operators into Function-Valued Gaussian Processes

abstract: Modeling dynamical systems, e.g. in climate and engineering sciences, often necessitates solving partial differential equations. Neural operators are deep neural networks designed to learn nontrivial solution operators of such differential equations from data. As for all statistical models, the predictions of these models are imperfect and exhibit errors. Such errors are particularly difficult to spot in the complex nonlinear behaviour of dynamical systems. We introduce a new framework for approximate Bayesian uncertainty quantification in neural operators using function-valued Gaussian processes. Our approach can be interpreted as a probabilistic analogue of the concept of currying from functional programming and provides a practical yet theoretically sound way to apply the linearized Laplace approximation to neural operators. In a case study on Fourier neural operators, we show that, even for a discretized input, our method yields a Gaussian closure--a structured Gaussian process posterior capturing the uncertainty in the output function of the neural operator, which can be evaluated at an arbitrary set of points. The method adds minimal prediction overhead, can be applied post-hoc without retraining the neural operator, and scales to large models and datasets. We showcase the efficacy of our approach through applications to different types of partial differential equations.


title: Reconstruction of phase-amplitude dynamics from electrophysiological signals

abstract: Signals from interacting brain regions display transient synchronization of phases and amplitudes in different frequencies. Commonly, the interaction between regions of the brain is quantitatively described by either analyzing the correlations of amplitudes of the measured signals or by calculating phase-synchronization measures. However, for a complete picture of the interactions it is important to analyze the dynamics of both the amplitude and the phase. In this work, we present a new method for finding the coupling between brain regions by reconstructing the phase-amplitude dynamics directly from the measured electrophysiological signals. For this purpose, we use the recent advances in the field of phase-amplitude reduction of oscillatory systems, which allow the representation of an uncoupled oscillatory system as a phase-amplitude oscillator in a unique form using transformations (parametrizations) related to the eigenfunctions of the Koopman operator. By combining the parametrization method and the Fourier-Laplace averaging method of finding the eigenfunctions of the Koopman operator, we developed a novel method of assessing the transformation functions from the signals of the interacting oscillatory systems. The resulting reconstructed dynamical system is a network of phase-amplitude oscillators with the interactions between them represented as coupling functions in phase and amplitude coordinates. Using synthetic signals generated from several models with known and unknown theoretical phase-amplitude reduced forms, we demonstrate that our method is capable of finding the proper unique dynamic form of these oscillatory systems in the reduced phase-amplitude space. Our method can be applied to describe any network of interacting oscillators as a dynamical system using signals of the network elements.


title: Hibou: A Family of Foundational Vision Transformers for Pathology

abstract: Pathology, the microscopic examination of diseased tissue, is critical for diagnosing various medical conditions, particularly cancers. Traditional methods are labor-intensive and prone to human error. Digital pathology, which converts glass slides into high-resolution digital images for analysis by computer algorithms, revolutionizes the field by enhancing diagnostic accuracy, consistency, and efficiency through automated image analysis and large-scale data processing. Foundational transformer pretraining is crucial for developing robust, generalizable models as it enables learning from vast amounts of unannotated data. This paper introduces the Hibou family of foundational vision transformers for pathology, leveraging the DINOv2 framework to pretrain two model variants, Hibou-B and Hibou-L, on a proprietary dataset of over 1 million whole slide images (WSIs) representing diverse tissue types and staining techniques. Our pretrained models demonstrate superior performance on both patch-level and slide-level benchmarks, surpassing existing state-of-the-art methods. Notably, Hibou-L achieves the highest average accuracy across multiple benchmark datasets. To support further research and application in the field, we have open-sourced the Hibou-B model, which can be accessed at https://github.com/HistAI/hibou


title: Diving Deep into the Motion Representation of Video-Text Models

abstract: Videos are more informative than images because they capture the dynamics of the scene. By representing motion in videos, we can capture dynamic activities. In this work, we introduce GPT-4 generated motion descriptions that capture fine-grained motion descriptions of activities and apply them to three action datasets. We evaluated several video-text models on the task of retrieval of motion descriptions. We found that they fall far behind human expert performance on two action datasets, raising the question of whether video-text models understand motion in videos. To address it, we introduce a method of improving motion understanding in video-text models by utilizing motion descriptions. This method proves to be effective on two action datasets for the motion description retrieval task. The results draw attention to the need for quality captions involving fine-grained motion information in existing datasets and demonstrate the effectiveness of the proposed pipeline in understanding fine-grained motion during video-text retrieval.


title: Discovery of a Relativistic Stripped Envelope Type Ic-BL Supernova at z = 2.83 with JWST

abstract: We present JWST NIRCam and NIRSpec observations of a Type Ic supernova (SN Ic) and its host galaxy (JADES-GS+53.13533-27.81457) at $z = 2.83$. This SN (named SN 2023adta) was identified in deep James Webb Space Telescope (JWST)/NIRCam imaging from the JWST Advanced Deep Extragalactic Survey (JADES) Program. Follow-up observations with JWST/NIRSpec provided a spectroscopic redshift of $z = 2.83$ and the classification as a SN Ic-BL. The light curve of SN 2023adta matches well with other stripped envelope supernovae and we find a high peak luminosity, $M_V = -19.0 \pm 0.2$ mag, based on the distribution of best-fit SNe. The broad absorption features in its spectrum are consistent with other SNe Ic-BL 1-3 weeks after peak brightness. We measure a Ca II NIR triplet expansion velocity of $29{,}000 \pm 2{,}000$ km s$^{-1}$. The host galaxy of SN 2023adta is irregular, and modeling of its spectral energy distribution (SED) indicates a metallicity of $Z = 0.35^{+0.16}_{-0.08} Z_{\odot}$. This environment is consistent with the population of low-$z$ SNe Ic-BL which prefer lower metallicities relative to other stripped envelope supernovae, and track long duration $\gamma$-ray burst (LGRB) environments. We do not identify any GRBs that are coincident with SN 2023adta. Given the rarity of SNe Ic-BL in the local universe, the detection of a SN Ic-BL at $z = 2.83$ could indicate that their rates are enhanced at high redshift.


title: Improved Mechanisms and Prophet Inequalities for Graphical Dependencies

abstract: Over the past two decades, significant strides have been made in stochastic problems such as revenue-optimal auction design and prophet inequalities, traditionally modeled with $n$ independent random variables to represent the values of $n$ items. However, in many applications, this assumption of independence often diverges from reality. Given the strong impossibility results associated with arbitrary correlations, recent research has pivoted towards exploring these problems under models of mild dependency. In this work, we study the optimal auction and prophet inequalities problems within the framework of the popular graphical model of Markov Random Fields (MRFs), a choice motivated by its ability to capture complex dependency structures. Specifically, for the problem of selling $n$ items to a single buyer to maximize revenue, we show that the max of SRev and BRev is an $O(\Delta)$-approximation to the optimal revenue for subadditive buyers, where $\Delta$ is the maximum weighted degree of the underlying MRF. This is a generalization as well as an exponential improvement on the $\exp(O(\Delta))$-approximation results of Cai and Oikonomou (EC 2021) for additive and unit-demand buyers. We also obtain a similar exponential improvement for the prophet inequality problem, which is asymptotically optimal as we show a matching upper bound.


title: Enhancing LEO Mega-Constellations with Inter-Satellite Links: Vision and Challenges

abstract: Low Earth orbit (LEO) satellites have been envisioned as a significant component of the sixth generation (6G) network architecture for achieving ubiquitous coverage and seamless access. However, the implementation of LEO satellites is largely restricted by the deployment of ground stations. Inter-satellite links (ISLs) have been regarded as a promising technique to fully exploit the potentials of LEO mega constellations by concatenating multiple satellites to constitute an autonomous space network. In this article, we present the merits of implementing ISLs in LEO mega constellations and the representative applications empowered/inspired by ISLs. Moreover, we outline several key technical challenges as well as potential solutions related to LEO satellite networks with ISLs, including performance analysis for system design, routing and load balancing, and resource allocation. Particularly, the potential of using ISLs in enhancing in-flight connectivity is showcased with a preliminary performance evaluation. Finally, some open issues are discussed to inspire future research.


title: SUMIE: A Synthetic Benchmark for Incremental Entity Summarization

abstract: No existing dataset adequately tests how well language models can incrementally update entity summaries - a crucial ability as these models rapidly advance. The Incremental Entity Summarization (IES) task is vital for maintaining accurate, up-to-date knowledge. To address this, we introduce SUMIE, a fully synthetic dataset designed to expose real-world IES challenges. This dataset effectively highlights problems like incorrect entity association and incomplete information presentation. Unlike common synthetic datasets, ours captures the complexity and nuances found in real-world data. We generate informative and diverse attributes, summaries, and unstructured paragraphs in sequence, ensuring high quality. The alignment between generated summaries and paragraphs exceeds 96%, confirming the dataset's quality. Extensive experiments demonstrate the dataset's difficulty - state-of-the-art LLMs struggle to update summaries with an F1 higher than 80.4%. We will open source the benchmark and the evaluation metrics to help the community make progress on IES tasks.