title: Code Repair with LLMs gives an Exploration-Exploitation Tradeoff

abstract: Iteratively improving and repairing source code with large language models (LLMs), known as refinement, has emerged as a popular way of generating programs that would be too complex to construct in one shot. Given a bank of test cases, together with a candidate program, an LLM can improve that program by being prompted with failed test cases. But it remains an open question how to best iteratively refine code, with prior work employing simple greedy or breadth-first strategies. We show here that refinement exposes an explore-exploit tradeoff: exploit by refining the program that passes the most test cases, or explore by refining a lesser considered program. We frame this as an arm-acquiring bandit problem, which we solve with Thompson Sampling. The resulting LLM-based program synthesis algorithm is broadly applicable: Across loop invariant synthesis, visual reasoning puzzles, and competition programming problems, we find that our new method can solve more problems using fewer language model calls.


title: Effects of external field and potential on non-relativistic quantum particles in disclinations background

abstract: In this work, we investigate the behavior of non-relativistic quantum particles immersed in a cosmic string space-time background. Our study involves the examination of these particles as they interact with a range of influences, including potential, magnetic, and quantum flux fields. We employ analytical methods to solve the associated wave equation, leading to the derivation of eigenvalue solutions for this quantum system. Subsequently, we leverage these eigenvalue solutions to scrutinize several potential models. For each model, we present and engage in a thorough discussion of the corresponding eigenvalue solutions. In an extension of our investigation, we explore the thermodynamic and magnetic properties of the quantum system when it is exposed to non-zero temperature conditions, denoted by $T \neq 0$. Our analysis encompasses the calculation of essential parameters such as the partition function for the system and other pertinent functions. Following these calculations, we meticulously examine and interpret the outcomes, shedding light on the system's behavior and characteristics in the presence of temperature variations. Furthermore, we calculate entropic information to investigate the location of particles in the system.


title: Predicting Rental Price of Lane Houses in Shanghai with Machine Learning Methods and Large Language Models

abstract: Housing has emerged as a crucial concern among young individuals residing in major cities, including Shanghai. Given the unprecedented surge in property prices in this metropolis, young people have increasingly resorted to the rental market to address their housing needs. This study utilizes five traditional machine learning methods: multiple linear regression (MLR), ridge regression (RR), lasso regression (LR), decision tree (DT), and random forest (RF), along with a Large Language Model (LLM) approach using ChatGPT, for predicting the rental prices of lane houses in Shanghai. It applies these methods to examine a public data sample of about 2,609 lane house rental transactions in 2021 in Shanghai, and then compares the results of these methods. In terms of predictive power, RF has achieved the best performance among the traditional methods. However, the LLM approach, particularly in the 10-shot scenario, shows promising results that surpass traditional methods in terms of R-Squared value. The three performance metrics: mean squared error (MSE), mean absolute error (MAE), and R-Squared, are used to evaluate the models. Our conclusion is that while traditional machine learning models offer robust techniques for rental price prediction, the integration of LLM such as ChatGPT holds significant potential for enhancing predictive accuracy.


title: Subspace Node Pruning

abstract: A significant increase in the commercial use of deep neural network models increases the need for efficient AI. Node pruning is the art of removing computational units such as neurons, filters, attention heads, or even entire layers while keeping network performance at a maximum. This can significantly reduce the inference time of a deep network and thus enhance its efficiency. Few of the previous works have exploited the ability to recover performance by reorganizing network parameters while pruning. In this work, we propose to create a subspace from unit activations which enables node pruning while recovering maximum accuracy. We identify that for effective node pruning, a subspace can be created using a triangular transformation matrix, which we show to be equivalent to Gram-Schmidt orthogonalization, which automates this procedure. We further improve this method by reorganizing the network prior to subspace formation. Finally, we leverage the orthogonal subspaces to identify layer-wise pruning ratios appropriate to retain a significant amount of the layer-wise information. We show that this measure outperforms existing pruning methods on VGG networks. We further show that our method can be extended to other network architectures such as residual networks.


title: Enhancing Sustainable Urban Mobility Prediction with Telecom Data: A Spatio-Temporal Framework Approach

abstract: Traditional traffic prediction, limited by the scope of sensor data, falls short in comprehensive traffic management. Mobile networks offer a promising alternative using network activity counts, but these lack crucial directionality. Thus, we present the TeltoMob dataset, featuring undirected telecom counts and corresponding directional flows, to predict directional mobility flows on roadways. To address this, we propose a two-stage spatio-temporal graph neural network (STGNN) framework. The first stage uses a pre-trained STGNN to process telecom data, while the second stage integrates directional and geographic insights for accurate prediction. Our experiments demonstrate the framework's compatibility with various STGNN models and confirm its effectiveness. We also show how to incorporate the framework into real-world transportation systems, enhancing sustainable urban mobility.


title: Unveiling the Secrets: How Masking Strategies Shape Time Series Imputation

abstract: In this study, we explore the impact of different masking strategies on time series imputation models. We evaluate the effects of pre-masking versus in-mini-batch masking, normalization timing, and the choice between augmenting and overlaying artificial missingness. Using three diverse datasets, we benchmark eleven imputation models with different missing rates. Our results demonstrate that masking strategies significantly influence imputation accuracy, revealing that more sophisticated and data-driven masking designs are essential for robust model evaluation. We advocate for refined experimental designs and comprehensive disclosureto better simulate real-world patterns, enhancing the practical applicability of imputation models.


title: Reference Neural Operators: Learning the Smooth Dependence of Solutions of PDEs on Geometric Deformations

abstract: For partial differential equations on domains of arbitrary shapes, existing works of neural operators attempt to learn a mapping from geometries to solutions. It often requires a large dataset of geometry-solution pairs in order to obtain a sufficiently accurate neural operator. However, for many industrial applications, e.g., engineering design optimization, it can be prohibitive to satisfy the requirement since even a single simulation may take hours or days of computation. To address this issue, we propose reference neural operators (RNO), a novel way of implementing neural operators, i.e., to learn the smooth dependence of solutions on geometric deformations. Specifically, given a reference solution, RNO can predict solutions corresponding to arbitrary deformations of the referred geometry. This approach turns out to be much more data efficient. Through extensive experiments, we show that RNO can learn the dependence across various types and different numbers of geometry objects with relatively small datasets. RNO outperforms baseline models in accuracy by a large lead and achieves up to 80% error reduction.


title: Thom's gradient conjecture for nonlinear evolution equations

abstract: R. Thom's gradient conjecture states that if a gradient flow of an analytic function converges to a limit, it does so along a unique limiting direction. In this paper, we extend and settle this conjecture in the context of infinite dimensional problems. Building on the foundational works of {\L}ojasiewicz, L. Simon, and the resolution of the conjecture for finite dimensional cases by Kurdyka-Mostowski-Parusinski, we focus on nonlinear evolutions on Riemannian manifolds as studied by L. Simon. This framework includes geometric PDEs such as minimal surface, harmonic map, mean curvature flow, and normalized Yamabe flow. Our main result not only confirms the uniqueness of the limiting direction but also characterizes the rate of convergence and possible limiting directions for both classical and infinite dimensional settings.


title: On the Analogy of Gauge Theory of Plasticity and Economics

abstract: We demonstrated the analogy between Economics and Gauge Theory of Plasticity and used it to describe the relationship between money supply and inflation at the economic market. The received equations of economical dynamics in phase space are similar to the plasticity equations and economic variables - choice, competition and profit correspond to the state of the market with inflation. We described the meaning of equations and the role of its variables in the stabilization mechanism of the market with inflation. The equation of market equilibrium including the Profit turnover, time changes of competition, capital and choice was discussed in detail.


title: On Fairness of Low-Rank Adaptation of Large Models

abstract: Low-rank adaptation of large models, particularly LoRA, has gained traction due to its computational efficiency. This efficiency, contrasted with the prohibitive costs of full-model fine-tuning, means that practitioners often turn to LoRA and sometimes without a complete understanding of its ramifications. In this study, we focus on fairness and ask whether LoRA has an unexamined impact on utility, calibration, and resistance to membership inference across different subgroups (e.g., genders, races, religions) compared to a full-model fine-tuning baseline. We present extensive experiments across vision and language domains and across classification and generation tasks using ViT-Base, Swin-v2-Large, Llama-2 7B, and Mistral 7B. Intriguingly, experiments suggest that while one can isolate cases where LoRA exacerbates model bias across subgroups, the pattern is inconsistent -- in many cases, LoRA has equivalent or even improved fairness compared to the base model or its full fine-tuning baseline. We also examine the complications of evaluating fine-tuning fairness relating to task design and model token bias, calling for more careful fairness evaluations in future work.


abstract: We establish large sets of Anderson localized states for the quasi-periodic nonlinear Schr\"odinger equation on $\mathbb Z^d$, thus extending Anderson localization from the linear (cf. Bourgain [GAFA 17(3), 682--706, 2007]) to a nonlinear setting, and the random (cf. Bourgain-Wang [JEMS 10(1), 1--45, 2008]) to a deterministic setting. Among the main ingredients are a new Diophantine estimate of quasi-periodic functions in arbitrarily dimensional phase space, and the application of Bourgain's geometric lemma in [GAFA 17(3), 682--706, 2007].


title: AbstractBeam: Enhancing Bottom-Up Program Synthesis using Library Learning

abstract: LambdaBeam is a state-of-the-art execution-guided algorithm for program synthesis that incorporates higher-order functions, lambda functions, and iterative loops into the Domain-Specific Language (DSL). LambdaBeam generates every program from the start. Yet, many program blocks or subprograms occur frequently in a given domain, e.g., loops to traverse a list. Thus, repeating programs can be used to enhance the synthesis algorithm. However, LambdaBeam fails to leverage this potential. For this purpose, we introduce AbstractBeam: A novel program synthesis framework that employs Library Learning to identify such program repetitions, integrates them into the DSL, and thus utilizes their potential to boost LambdaBeam's synthesis algorithm. Our experimental evaluations demonstrate that AbstractBeam significantly improves LambdaBeam's performance in the LambdaBeam integer list manipulation domain. Additionally, AbstractBeam's program generation is more efficient compared to LambdaBeam's synthesis. Finally, our findings indicate that Library Learning is effective in domains not specifically crafted to highlight its benefits.


title: EPI-VALID : Validation of an algorithm for identifying patients with epilepsy in the SNDS using data from the CONSTANCES cohort

abstract: Introduction: The HAS conducted a study in 2018 using the French National Health Data System (SNDS) on the care pathway of patients with epilepsy. This study used 2 algorithms to identify patients with epilepsy, based on hospitalization for epilepsy, insurance for chronic severe epilepsy, and antiepileptic drug (AE) dispensing, with exclusion of AEs not specific to epilepsy offering a low population estimate, or exclusion of dispensing in a context other than epilepsy (migraine, neuropathic pain, bipolar disorder, alcohol dependence, anxiety) offering a high population estimate. To study the characteristics of these 2 algorithms (low and high populations), we used data from CONSTANCES, a French generalist cohort and its control sample, which are matched to SNDS data. Method: This is a validation study of a method for identifying patients with epilepsy in the SNDS. The study population was patients identified as epileptic according to the algorithms defined in the introduction, applied over the year 2018 and the reference population was all patients for whom there is a mention of epilepsy (free text field) in the inclusion and/or follow-up questionnaires of the CONSTANCES cohort for the years prior to 2019. Results: Among 156,819 patients present in the CONSTANCES cohort in 2018, 689 patients mentioned epilepsy in one of the questionnaires (0.4%). This number is lower than expected: in the literature, the prevalence of epilepsy in the general population is estimated at 0.6-0.7% in adults. This is due to under-reporting and lack of representativeness of epilepsy in the cohort, which we were able to estimate from the control sample data. Aware of these two limitations, we compared the characteristics of the algorithms with those of a control algorithm using insurance for chronic severe epilepsy and/or hospitalization for epilepsy as inclusion criteria in the SNDS. The accuracy of our SNDS algorithms is not very high (17.8% and 35% respectively in high and low populations) compared with the control algorithm (58.1%). However, they do improve sensitivity (+33 and +14 points respectively), with little loss of specificity (-1.2 and -0.3 points respectively). Discussion: The analysis of false-positive patients has enabled us to identify ways of improving the algorithms. Indeed, some AE drugs could be excluded from the inclusion criteria, as they are widely used in another indication. For example, eliminating pregabalin and gabapentin from the high-population algorithm would significantly improve its accuracy (45.3% vs. 17.8%).


title: Time Elastic Neural Networks

abstract: We introduce and detail an atypical neural network architecture, called time elastic neural network (teNN), for multivariate time series classification. The novelty compared to classical neural network architecture is that it explicitly incorporates time warping ability, as well as a new way of considering attention. In addition, this architecture is capable of learning a dropout strategy, thus optimizing its own architecture.Behind the design of this architecture, our overall objective is threefold: firstly, we are aiming at improving the accuracy of instance based classification approaches that shows quite good performances as far as enough training data is available. Secondly we seek to reduce the computational complexity inherent to these methods to improve their scalability. Ideally, we seek to find an acceptable balance between these first two criteria. And finally, we seek to enhance the explainability of the decision provided by this kind of neural architecture.The experiment demonstrates that the stochastic gradient descent implemented to train a teNN is quite effective. To the extent that the selection of some critical meta-parameters is correct, convergence is generally smooth and fast.While maintaining good accuracy, we get a drastic gain in scalability by first reducing the required number of reference time series, i.e. the number of teNN cells required. Secondly, we demonstrate that, during the training process, the teNN succeeds in reducing the number of neurons required within each cell. Finally, we show that the analysis of the activation and attention matrices as well as the reference time series after training provides relevant information to interpret and explain the classification results.The comparative study that we have carried out and which concerns around thirty diverse and multivariate datasets shows that the teNN obtains results comparable to those of the state of the art, in particular similar to those of a network mixing LSTM and CNN architectures for example.


title: WASH: Train your Ensemble with Communication-Efficient Weight Shuffling, then Average

abstract: The performance of deep neural networks is enhanced by ensemble methods, which average the output of several models. However, this comes at an increased cost at inference. Weight averaging methods aim at balancing the generalization of ensembling and the inference speed of a single model by averaging the parameters of an ensemble of models. Yet, naive averaging results in poor performance as models converge to different loss basins, and aligning the models to improve the performance of the average is challenging. Alternatively, inspired by distributed training, methods like DART and PAPA have been proposed to train several models in parallel such that they will end up in the same basin, resulting in good averaging accuracy. However, these methods either compromise ensembling accuracy or demand significant communication between models during training. In this paper, we introduce WASH, a novel distributed method for training model ensembles for weight averaging that achieves state-of-the-art image classification accuracy. WASH maintains models within the same basin by randomly shuffling a small percentage of weights during training, resulting in diverse models and lower communication costs compared to standard parameter averaging methods.


title: Assessment of Left Atrium Motion Deformation Through Full Cardiac Cycle

abstract: Unlike Right Atrium (RA), Left Atrium (LA) presents distinctive challenges, including much thinner myocardial walls, complex and irregular morphology, as well as diversity in individual's structure, making off-the-shelf methods designed for the Left Ventricle (LV) may not work in the context of the left atrium. To overcome aforementioned challenges, we are the first to present comprehensive technical workflow designed for 4D registration modeling to automatically analyze LA motion using high-resolution 3D Cine MR images. We integrate segmentation network and 4D registration process to precisely delineate LA segmentation throughout the full cardiac cycle. Additionally, an image 4D registration network is employed to extract LA displacement vector fields (DVFs). Our findings show the potential of proposed end to end framework in providing clinicians with novel regional biomarkers for left atrium motion tracking and deformation, carrying significant clinical implications.


title: Symmetry quantification and segmentation in STEM imaging through Zernike moments

abstract: We present a method using Zernike moments for quantifying rotational and reflectional symmetries in scanning transmission electron microscopy (STEM) images, aimed at improving structural analysis of materials at the atomic scale. This technique is effective against common imaging noises and is potentially suited for low-dose imaging and identifying quantum defects. We showcase its utility in the unsupervised segmentation of polytypes in a twisted bilayer TaS$_2$, enabling accurate differentiation of structural phases and monitoring transitions caused by electron beam effects. This approach enhances the analysis of structural variations in crystalline materials, marking a notable advancement in the characterization of structures in materials science.


title: Advancing Medical Image Segmentation with Mini-Net: A Lightweight Solution Tailored for Efficient Segmentation of Medical Images

abstract: Accurate segmentation of anatomical structures and abnormalities in medical images is crucial for computer-aided diagnosis and analysis. While deep learning techniques excel at this task, their computational demands pose challenges. Additionally, some cutting-edge segmentation methods, though effective for general object segmentation, may not be optimised for medical images. To address these issues, we propose Mini-Net, a lightweight segmentation network specifically designed for medical images. With fewer than 38,000 parameters, Mini-Net efficiently captures both high- and low-frequency features, enabling real-time applications in various medical imaging scenarios. We evaluate Mini-Net on various datasets, including DRIVE, STARE, ISIC-2016, ISIC-2018, and MoNuSeg, demonstrating its robustness and good performance compared to state-of-the-art methods.


title: Photonic Bose-Einstein condensation in the continuum limit

abstract: We investigate the properties of the photon Bose-Einstein condensate in the limit of small mode spacing. Alongside the well-known threshold of the phase transition at large mode spacings, we find an emergence of a second threshold for sufficiently small mode spacings, defining the crossover to a fully condensed state. Furthermore, we present our findings for the mode occupations in the precondensate or supercooling region towards the continuum limit.


title: Efficient Model Compression for Hierarchical Federated Learning

abstract: Federated learning (FL), as an emerging collaborative learning paradigm, has garnered significant attention due to its capacity to preserve privacy within distributed learning systems. In these systems, clients collaboratively train a unified neural network model using their local datasets and share model parameters rather than raw data, enhancing privacy. Predominantly, FL systems are designed for mobile and edge computing environments where training typically occurs over wireless networks. Consequently, as model sizes increase, the conventional FL frameworks increasingly consume substantial communication resources. To address this challenge and improve communication efficiency, this paper introduces a novel hierarchical FL framework that integrates the benefits of clustered FL and model compression. We present an adaptive clustering algorithm that identifies a core client and dynamically organizes clients into clusters. Furthermore, to enhance transmission efficiency, each core client implements a local aggregation with compression (LC aggregation) algorithm after collecting compressed models from other clients within the same cluster. Simulation results affirm that our proposed algorithms not only maintain comparable predictive accuracy but also significantly reduce energy consumption relative to existing FL mechanisms.


title: Locally Testing Model Detections for Semantic Global Concepts

abstract: Ensuring the quality of black-box Deep Neural Networks (DNNs) has become ever more significant, especially in safety-critical domains such as automated driving. While global concept encodings generally enable a user to test a model for a specific concept, linking global concept encodings to the local processing of single network inputs reveals their strengths and limitations. Our proposed framework global-to-local Concept Attribution (glCA) uses approaches from local (why a specific prediction originates) and global (how a model works generally) eXplainable Artificial Intelligence (xAI) to test DNNs for a predefined semantical concept locally. The approach allows for conditioning local, post-hoc explanations on predefined semantic concepts encoded as linear directions in the model's latent space. Pixel-exact scoring concerning the global concept usage assists the tester in further understanding the model processing of single data points for the selected concept. Our approach has the advantage of fully covering the model-internal encoding of the semantic concept and allowing the localization of relevant concept-related information. The results show major differences in the local perception and usage of individual global concept encodings and demand for further investigations regarding obtaining thorough semantic concept encodings.


title: Reverse Shock Revisited in Cassiopeia A with Chandra

abstract: Using data from the Chandra X-Ray Observatory, we revisited the reverse shock in the supernova remnant (SNR) Cassiopeia A.Based on the spectroscopic of a series of annuli in the northwest (NW) and southeast (SE), we get the radial profiles of the S/Si K-alpha line flux ratio and Fe K-alpha line centroid energy. They both show monotonic increase, confirming that the Si- and Fe-rich ejecta are heated by the reverse shock.The abrupt change of the S and Si line flux ratio is clearly observed in Cassiopeia A, leading to the determination of the reverse shock location (~1.71+-0.16 arcmin and ~1.35+-0.18 arcmin in the NW and SE, with respect to the central source). By comparing the radial profiles of S and Si line flux, we find that the reverse shock is moving outward in the frame of the observer, and the velocities are ~3950+-210 km/s and ~2900+-260 km/s in the NW and SE, respectively. In contrast, the velocities become ~1150 km/s (NW) and ~1300 km/s (SE) in the ejecta frame. Our measured reverse shock velocities are quite consistent with those obtained from the X-ray and/or optical images. It therefore supplies a crosscheck of the accuracy for the two available methods to measure the reverse shock velocity in SNRs. Both the location and the velocity of the reverse shock show apparent asymmetry, suggesting that the asymmetric explosion of the progenitor plays a key role in the interaction between the reverse shock and the ejecta, ultimately shaping complex features observed in SNRs.


title: SmoothGNN: Smoothing-based GNN for Unsupervised Node Anomaly Detection

abstract: The smoothing issue leads to indistinguishable node representations, which poses a significant challenge in the field of graph learning. However, this issue also presents an opportunity to reveal underlying properties behind different types of nodes, which have been overlooked in previous studies. Through empirical and theoretical analysis of real-world node anomaly detection (NAD) datasets, we observe that anomalous and normal nodes show different patterns in the smoothing process, which can be leveraged to enhance NAD tasks. Motivated by these findings, in this paper, we propose a novel unsupervised NAD framework. Specifically, according to our theoretical analysis, we design a Smoothing Learning Component. Subsequently, we introduce a Smoothing-aware Spectral Graph Neural Network, which establishes the connection between the spectral space of graphs and the smoothing process. Additionally, we demonstrate that the Dirichlet Energy, which reflects the smoothness of a graph, can serve as coefficients for node representations across different dimensions of the spectral space. Building upon these observations and analyses, we devise a novel anomaly measure for the NAD task. Extensive experiments on 9 real-world datasets show that SmoothGNN outperforms the best rival by an average of 14.66% in AUC and 7.28% in Precision, with 75x running time speed-up, which validates the effectiveness and efficiency of our framework.


title: Heavy-Ion Collisions as Probes of Nuclear Structure

abstract: In this work, we perform a model-to-data comparison for U+U and Au+Au collisions performed at RHIC at $\sqrt{s_{\rm NN}}$ = $193$ GeV and $200$ GeV, using a multistage framework. Model calculations for various configurations of $^{238}$U and $^{197}$Au are used to compare with measurements of $\rho(v_n\{2\}^2,\left\langle p_T \right\rangle)$, the elliptic-flow-momentum correlator, for the first time. It is found that momentum-flow correlations measured in high-energy nuclear collisions, combined with the flow harmonics themselves, are excellent probes of nuclear deformation and of nuclear structure in general.


title: Unisolver: PDE-Conditional Transformers Are Universal PDE Solvers

abstract: Deep models have recently emerged as a promising tool to solve partial differential equations (PDEs), known as neural PDE solvers. While neural solvers trained from either simulation data or physics-informed loss can solve the PDEs reasonably well, they are mainly restricted to a specific set of PDEs, e.g. a certain equation or a finite set of coefficients. This bottleneck limits the generalizability of neural solvers, which is widely recognized as its major advantage over numerical solvers. In this paper, we present the Universal PDE solver (Unisolver) capable of solving a wide scope of PDEs by leveraging a Transformer pre-trained on diverse data and conditioned on diverse PDEs. Instead of simply scaling up data and parameters, Unisolver stems from the theoretical analysis of the PDE-solving process. Our key finding is that a PDE solution is fundamentally under the control of a series of PDE components, e.g. equation symbols, coefficients, and initial and boundary conditions. Inspired by the mathematical structure of PDEs, we define a complete set of PDE components and correspondingly embed them as domain-wise (e.g. equation symbols) and point-wise (e.g. boundaries) conditions for Transformer PDE solvers. Integrating physical insights with recent Transformer advances, Unisolver achieves consistent state-of-the-art results on three challenging large-scale benchmarks, showing impressive gains and endowing favorable generalizability and scalability.


title: The logistic queue model: theoretical properties and performance evaluation

abstract: The advent of digital twins (DT) for the control and management of communication networks requires accurate and fast methods to estimate key performance indicators (KPI) needed for autonomous decision-making. Among several alternatives, queuing theory can be applied to model a real network as a queue system that propagates entities representing network traffic. By using fluid flow queue simulation and numerical methods, a good trade-off between accuracy and execution time can be obtained. In this work, we present the formal derivation and mathematical properties of a continuous fluid flow queuing model called the logistic queue model. We give novel proofs showing that this queue model has all the theoretical properties one should expect such as positivity of the queue and first-in first-out (FIFO) property. Moreover, extensions are presented in order to model different characteristics of telecommunication networks, including finite buffer sizes and propagation of flows with different priorities. Numerical results are presented to validate the accuracy and improved performance of our approach in contrast to traditional discrete event simulation, using synthetic traffic generated with the characteristics of real captured network traffic. Finally, we evaluate a DT built using a queue system based on the logistic queue model and demonstrate its applicability to estimate KPIs of an emulated real network under different traffic conditions.


title: Clip Body and Tail Separately: High Probability Guarantees for DPSGD with Heavy Tails

abstract: Differentially Private Stochastic Gradient Descent (DPSGD) is widely utilized to preserve training data privacy in deep learning, which first clips the gradients to a predefined norm and then injects calibrated noise into the training procedure. Existing DPSGD works typically assume the gradients follow sub-Gaussian distributions and design various clipping mechanisms to optimize training performance. However, recent studies have shown that the gradients in deep learning exhibit a heavy-tail phenomenon, that is, the tails of the gradient have infinite variance, which may lead to excessive clipping loss to the gradients with existing DPSGD mechanisms. To address this problem, we propose a novel approach, Discriminative Clipping~(DC)-DPSGD, with two key designs. First, we introduce a subspace identification technique to distinguish between body and tail gradients. Second, we present a discriminative clipping mechanism that applies different clipping thresholds for body and tail gradients to reduce the clipping loss. Under the non-convex condition, \ourtech{} reduces the empirical gradient norm from {${\mathbb{O}\left(\log^{\max(0,\theta-1)}(T/\delta)\log^{2\theta}(\sqrt{T})\right)}$} to {${\mathbb{O}\left(\log(\sqrt{T})\right)}$} with heavy-tailed index $\theta\geq 1/2$, iterations $T$, and arbitrary probability $\delta$. Extensive experiments on four real-world datasets demonstrate that our approach outperforms three baselines by up to 9.72\% in terms of accuracy.


title: Universal deterministic patterns in stochastic count data

abstract: We report the existence of deterministic patterns in plots showing the relationship between the mean and the Fano factor (ratio of variance and mean) of stochastic count data. These patterns are found in a wide variety of datasets, including those from genomics, paper citations, commerce, ecology, disease outbreaks, and employment statistics. We develop a theory showing that the patterns naturally emerge when data sampled from discrete probability distributions is organised in matrix form. The theory precisely predicts the patterns and shows that they are a function of only one variable - the sample size.


title: Evolutive Rendering Models

abstract: The landscape of computer graphics has undergone significant transformations with the recent advances of differentiable rendering models. These rendering models often rely on heuristic designs that may not fully align with the final rendering objectives. We address this gap by pioneering \textit{evolutive rendering models}, a methodology where rendering models possess the ability to evolve and adapt dynamically throughout the rendering process. In particular, we present a comprehensive learning framework that enables the optimization of three principal rendering elements, including the gauge transformations, the ray sampling mechanisms, and the primitive organization. Central to this framework is the development of differentiable versions of these rendering elements, allowing for effective gradient backpropagation from the final rendering objectives. A detailed analysis of gradient characteristics is performed to facilitate a stable and goal-oriented elements evolution. Our extensive experiments demonstrate the large potential of evolutive rendering models for enhancing the rendering performance across various domains, including static and dynamic scene representations, generative modeling, and texture mapping.


title: ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidance

abstract: Recent text-to-image customization works have been proven successful in generating images of given concepts by fine-tuning the diffusion models on a few examples. However, these methods tend to overfit the concepts, resulting in failure to create the concept under multiple conditions (e.g. headphone is missing when generating a <sks> dog wearing a headphone'). Interestingly, we notice that the base model before fine-tuning exhibits the capability to compose the base concept with other elements (e.g. a dog wearing a headphone) implying that the compositional ability only disappears after personalization tuning. Inspired by this observation, we present ClassDiffusion, a simple technique that leverages a semantic preservation loss to explicitly regulate the concept space when learning the new concept. Despite its simplicity, this helps avoid semantic drift when fine-tuning on the target concepts. Extensive qualitative and quantitative experiments demonstrate that the use of semantic preservation loss effectively improves the compositional abilities of the fine-tune models. In response to the ineffective evaluation of CLIP-T metrics, we introduce BLIP2-T metric, a more equitable and effective evaluation metric for this particular domain. We also provide in-depth empirical study and theoretical analysis to better understand the role of the proposed loss. Lastly, we also extend our ClassDiffusion to personalized video generation, demonstrating its flexibility.


title: PAE: LLM-based Product Attribute Extraction for E-Commerce Fashion Trends

abstract: Product attribute extraction is an growing field in e-commerce business, with several applications including product ranking, product recommendation, future assortment planning and improving online shopping customer experiences. Understanding the customer needs is critical part of online business, specifically fashion products. Retailers uses assortment planning to determine the mix of products to offer in each store and channel, stay responsive to market dynamics and to manage inventory and catalogs. The goal is to offer the right styles, in the right sizes and colors, through the right channels. When shoppers find products that meet their needs and desires, they are more likely to return for future purchases, fostering customer loyalty. Product attributes are a key factor in assortment planning. In this paper we present PAE, a product attribute extraction algorithm for future trend reports consisting text and images in PDF format. Most existing methods focus on attribute extraction from titles or product descriptions or utilize visual information from existing product images. Compared to the prior works, our work focuses on attribute extraction from PDF files where upcoming fashion trends are explained. This work proposes a more comprehensive framework that fully utilizes the different modalities for attribute extraction and help retailers to plan the assortment in advance. Our contributions are three-fold: (a) We develop PAE, an efficient framework to extract attributes from unstructured data (text and images); (b) We provide catalog matching methodology based on BERT representations to discover the existing attributes using upcoming attribute values; (c) We conduct extensive experiments with several baselines and show that PAE is an effective, flexible and on par or superior (avg 92.5% F1-Score) framework to existing state-of-the-art for attribute value extraction task.


title: SMR: State Memory Replay for Long Sequence Modeling

abstract: Despite the promising performance of state space models (SSMs) in long sequence modeling, limitations still exist. Advanced SSMs like S5 and S6 (Mamba) in addressing non-uniform sampling, their recursive structures impede efficient SSM computation via convolution. To overcome compatibility limitations in parallel convolutional computation, this paper proposes a novel non-recursive non-uniform sample processing strategy. Theoretical analysis of SSMs through the lens of Event-Triggered Control (ETC) theory reveals the Non-Stable State (NSS) problem, where deviations from sampling point requirements lead to error transmission and accumulation, causing the divergence of the SSM's hidden state. Our analysis further reveals that adjustments of input sequences with early memories can mitigate the NSS problem, achieving Sampling Step Adaptation (SSA). Building on this insight, we introduce a simple yet effective plug-and-play mechanism, State Memory Replay (SMR), which utilizes learnable memories to adjust the current state with multi-step information for generalization at sampling points different from those in the training data. This enables SSMs to stably model varying sampling points. Experiments on long-range modeling tasks in autoregressive language modeling and Long Range Arena demonstrate the general effectiveness of the SMR mechanism for a series of SSM models.


title: Calibrated Dataset Condensation for Faster Hyperparameter Search

abstract: Dataset condensation can be used to reduce the computational cost of training multiple models on a large dataset by condensing the training dataset into a small synthetic set. State-of-the-art approaches rely on matching the model gradients between the real and synthetic data. However, there is no theoretical guarantee of the generalizability of the condensed data: data condensation often generalizes poorly across hyperparameters/architectures in practice. This paper considers a different condensation objective specifically geared toward hyperparameter search. We aim to generate a synthetic validation dataset so that the validation-performance rankings of the models, with different hyperparameters, on the condensed and original datasets are comparable. We propose a novel hyperparameter-calibrated dataset condensation (HCDC) algorithm, which obtains the synthetic validation dataset by matching the hyperparameter gradients computed via implicit differentiation and efficient inverse Hessian approximation. Experiments demonstrate that the proposed framework effectively maintains the validation-performance rankings of models and speeds up hyperparameter/architecture search for tasks on both images and graphs.


title: Synchronisation of running sums of automatic sequences

abstract: We investigate the running sums of some well-known automatic sequences to determine whether they are synchronised.


title: BIOSCAN-CLIP: Bridging Vision and Genomics for Biodiversity Monitoring at Scale

abstract: Measuring biodiversity is crucial for understanding ecosystem health. While prior works have developed machine learning models for the taxonomic classification of photographic images and DNA separately, in this work, we introduce a multimodal approach combining both, using CLIP-style contrastive learning to align images, DNA barcodes, and textual data in a unified embedding space. This allows for accurate classification of both known and unknown insect species without task-specific fine-tuning, leveraging contrastive learning for the first time to fuse DNA and image data. Our method surpasses previous single-modality approaches in accuracy by over 11% on zero-shot learning tasks, showcasing its effectiveness in biodiversity studies.


title: Bayesian RG Flow in Neural Network Field Theories

abstract: The Neural Network Field Theory correspondence (NNFT) is a mapping from neural network (NN) architectures into the space of statistical field theories (SFTs). The Bayesian renormalization group (BRG) is an information-theoretic coarse graining scheme that generalizes the principles of the Exact Renormalization Group (ERG) to arbitrarily parameterized probability distributions, including those of NNs. In BRG, coarse graining is performed in parameter space with respect to an information-theoretic distinguishability scale set by the Fisher information metric. In this paper, we unify NNFT and BRG to form a powerful new framework for exploring the space of NNs and SFTs, which we coin BRG-NNFT. With BRG-NNFT, NN training dynamics can be interpreted as inducing a flow in the space of SFTs from the information-theoretic `IR' $\rightarrow$ `UV'. Conversely, applying an information-shell coarse graining to the trained network's parameters induces a flow in the space of SFTs from the information-theoretic `UV' $\rightarrow$ `IR'. When the information-theoretic cutoff scale coincides with a standard momentum scale, BRG is equivalent to ERG. We demonstrate the BRG-NNFT correspondence on two analytically tractable examples. First, we construct BRG flows for trained, infinite-width NNs, of arbitrary depth, with generic activation functions. As a special case, we then restrict to architectures with a single infinitely-wide layer, scalar outputs, and generalized cos-net activations. In this case, we show that BRG coarse-graining corresponds exactly to the momentum-shell ERG flow of a free scalar SFT. Our analytic results are corroborated by a numerical experiment in which an ensemble of asymptotically wide NNs are trained and subsequently renormalized using an information-shell BRG scheme.


title: Emergent Gauge Fields in Band Insulators

abstract: By explicit microscopic construction involving a mapping to a quantum vertex model subject to the `ice rule,' we show that an electronically `trivial' band insulator with suitable vibrational (phonon) degrees of freedom can host a ``resonating valence-bond'' state - a quantum phase with emergent gauge fields. This novel type of band insulator is identifiable by the existence of emergent gapless `photon' modes and deconfined excitations, the latter of which carry non-quantized mobile charges. We suggest that such phases may exist in the quantum regimes of various nearly ferroelectric materials.


title: QCD predictions for vector boson plus hadron production at the LHC

abstract: The identification of a hadron in the final state of hadron-collider events that feature a leptonically decaying vector boson can provide essential information on the parton content of the colliding protons. Moreover, the study of hadrons inside jets can provide deeper insights into the fragmentation dynamics. We provide theoretical predictions for specific observables involving either the production of a $Z$ boson in association with light charged hadrons inside a jet or the production of a $W$ boson together with a charmed hadron. We present results for various fragmentation functions and compare our predictions with measurements by LHCb and ATLAS at $\sqrt{s}=13$ TeV. Our predictions are obtained using the antenna subtraction formalism which has been extended to cope with infrared singularities associated to the fragmentation processes in a hadron-collider environment at NLO accuracy.


title: Approximately-symmetric neural networks for quantum spin liquids

abstract: We propose and analyze a family of approximately-symmetric neural networks for quantum spin liquid problems. These tailored architectures are parameter-efficient, scalable, and significantly out-perform existing symmetry-unaware neural network architectures. Utilizing the mixed-field toric code model, we demonstrate that our approach is competitive with the state-of-the-art tensor network and quantum Monte Carlo methods. Moreover, at the largest system sizes (N=480), our method allows us to explore Hamiltonians with sign problems beyond the reach of both quantum Monte Carlo and finite-size matrix-product states. The network comprises an exactly symmetric block following a non-symmetric block, which we argue learns a transformation of the ground state analogous to quasiadiabatic continuation. Our work paves the way toward investigating quantum spin liquid problems within interpretable neural network architectures

categories: quant-ph cond-mat.dis-nn cond-mat.str-el cs.LG


title: Charting the Conformal Manifold of Holographic CFT$_2$'s

abstract: We construct new continuous families of ${\rm AdS}_3\times S^3\times {\rm T}^4$ and ${\rm AdS}_3\times S^3\times S^3\times S^1$ solutions in heterotic and type II supergravities. These families are found in three-dimensional consistent truncations and controlled by 17 parameters, which include TsT $\beta$ deformations and encompass several supersymmetric sub-families. The different uplifts are constructed in a unified fashion by means of Exceptional Field Theory (ExFT). This allows the computation of the Kaluza-Klein spectra around the deformations, to test the stability of the solutions, and to interpret them holographically and as worldsheet models. To achieve this, we describe how the half-maximal ${\rm SO}(8,8)$ ExFT can be embedded into ${\rm E}_{8(8)}$ ExFT.


title: The MQT Handbook: A Summary of Design Automation Tools and Software for Quantum Computing

abstract: Quantum computers are becoming a reality and numerous quantum computing applications with a near-term perspective (e.g., for finance, chemistry, machine learning, and optimization) and with a long-term perspective (e.g., for cryptography or unstructured search) are currently being investigated. However, designing and realizing potential applications for these devices in a scalable fashion requires automated, efficient, and user-friendly software tools that cater to the needs of end users, engineers, and physicists at every level of the entire quantum software stack. Many of the problems to be tackled in that regard are similar to design problems from the classical realm for which sophisticated design automation tools have been developed in the previous decades. The Munich Quantum Toolkit (MQT) is a collection of software tools for quantum computing developed by the Chair for Design Automation at the Technical University of Munich which explicitly utilizes this design automation expertise. Our overarching objective is to provide solutions for design tasks across the entire quantum software stack. This entails high-level support for end users in realizing their applications, efficient methods for the classical simulation, compilation, and verification of quantum circuits, tools for quantum error correction, support for physical design, and more. These methods are supported by corresponding data structures (such as decision diagrams) and core methods (such as SAT encodings/solvers). All of the developed tools are available as open-source implementations and are hosted on https://github.com/cda-tum.


title: Towards Human-AI Complementarity with Predictions Sets

abstract: Decision support systems based on prediction sets have proven to be effective at helping human experts solve classification tasks. Rather than providing single-label predictions, these systems provide sets of label predictions constructed using conformal prediction, namely prediction sets, and ask human experts to predict label values from these sets. In this paper, we first show that the prediction sets constructed using conformal prediction are, in general, suboptimal in terms of average accuracy. Then, we show that the problem of finding the optimal prediction sets under which the human experts achieve the highest average accuracy is NP-hard. More strongly, unless P = NP, we show that the problem is hard to approximate to any factor less than the size of the label set. However, we introduce a simple and efficient greedy algorithm that, for a large class of expert models and non-conformity scores, is guaranteed to find prediction sets that provably offer equal or greater performance than those constructed using conformal prediction. Further, using a simulation study with both synthetic and real expert predictions, we demonstrate that, in practice, our greedy algorithm finds near-optimal prediction sets offering greater performance than conformal prediction.


title: Adiabatic Hydrodynamization and the Emergence of Attractors: a Unified Description of Hydrodynamization in Kinetic Theory

abstract: "Attractor" solutions for the pre-hydrodynamic, far-from-equilibrium, evolution of the matter produced in relativistic heavy ion collisions have emerged as crucial descriptors of the rapid hydrodynamization of quark-gluon plasma (QGP). Adiabatic Hydrodynamization (AH) has been proposed as a framework with which to describe, explain, and predict attractor behavior that draws upon an analogy to the adiabatic approximation in quantum mechanics. In this work, we systematize the description of pre-hydrodynamic attractors in kinetic theory by showing how to use the AH framework to identify these long-lived solutions to which varied initial conditions rapidly evolve, demonstrating the robustness of this framework. In a simplified QCD kinetic theory in the small-angle scattering limit, we use AH to explain both the early- and late-time scaling behavior of a longitudinally expanding gluon gas in a unified framework. In this context, we show that AH provides a unified description of, and intuition for, all the stages of what in QCD would be bottom-up thermalization, starting from a pre-hydrodynamic attractor and ending with hydrodynamization. We additionally discuss the connection between the notions of scaling behavior and adiabaticity and the crucial role of time-dependent coordinate redefinitions in identifying the degrees of freedom of kinetic theories that give rise to attractor solutions. The tools we present open a path to the intuitive explanation of how attractor behavior arises and how the attractor evolves in all stages of the hydrodynamization of QGP in heavy ion collisions.


title: Complexity is not Enough for Randomness

abstract: We study the dynamical generation of randomness in Brownian systems as a function of the degree of locality of the Hamiltonian. We first express the trace distance to a unitary design for these systems in terms of an effective equilibrium thermal partition function, and provide a set of conditions that guarantee a linear time to design. We relate the trace distance to design to spectral properties of the time-evolution operator. We apply these considerations to the Brownian $p$-SYK model as a function of the degree of locality $p$. We show that the time to design is linear, with a slope proportional to $1/p$. We corroborate that when $p$ is of order the system size this reproduces the behavior of a completely non-local Brownian model of random matrices. For the random matrix model, we reinterpret these results from the point of view of classical Brownian motion in the unitary manifold. Therefore, we find that the generation of randomness typically persists for exponentially long times in the system size, even for systems governed by highly non-local time-dependent Hamiltonians. We conjecture this to be a general property: there is no efficient way to generate approximate Haar random unitaries dynamically, unless a large degree of fine-tuning is present in the ensemble of time-dependent Hamiltonians. We contrast the slow generation of randomness to the growth of quantum complexity of the time-evolution operator. Using known bounds on circuit complexity for unitary designs, we obtain a lower bound determining that complexity grows at least linearly in time for Brownian systems. We argue that these bounds on circuit complexity are far from tight and that complexity grows at a much faster rate, at least for non-local systems.


title: The JWST Resolved Stellar Populations Early Release Science Program VII. Stress Testing the NIRCam Exposure Time Calculator

abstract: We empirically assess estimates from v3.0 of the JWST NIRCam Exposure Time Calculator (ETC) using observations of resolved stars in Local Group targets taken as part of the Resolved Stellar Populations Early Release Science (ERS) Program. For bright stars, we find that: (i) purely Poissonian estimates of the signal-to-noise ratio (SNR) are in good agreement between the ETC and observations, but non-ideal effects (e.g., flat field uncertainties) are the current limiting factor in the photometric precision that can be achieved; (ii) source position offsets, relative to the detector pixels, have a large impact on the ETC saturation predictions and introducing sub-pixel dithers in the observation design can improve the saturation limits by up to ~1 mag. For faint stars, for which the sky dominates the error budget, we find that the choice in ETC extraction strategy (e.g., aperture size relative to point spread function size) can affect the exposure time estimates by up to a factor of 5. We provide guidelines for configuring the ETC aperture photometry to produce SNR predictions in line with the ERS data. Finally, we quantify the effects of crowding on the SNRs over a large dynamic range in stellar density and provide guidelines for approximating the effects of crowding on SNRs predicted by the ETC.


title: Resonant or asymmetric: The status of sub-GeV dark matter

abstract: Sub-GeV dark matter (DM) particles produced via thermal freeze-out evade many of the strong constraints on heavier DM candidates but at the same time face a multitude of new constraints from laboratory experiments, astrophysical observations and cosmological data. In this work we combine all of these constraints in order to perform frequentist and Bayesian global analyses of fermionic and scalar sub-GeV DM coupled to a dark photon with kinetic mixing. For fermionic DM, we find viable parameter regions close to the dark photon resonance, which expand significantly when including a particle-antiparticle asymmetry. For scalar DM, the velocity-dependent annihilation cross section evades the strongest constraints even in the symmetric case. Using Bayesian model comparison, we show that both asymmetric fermionic DM and symmetric scalar DM are preferred over symmetric fermionic DM due to the reduced fine-tuning penalty. Finally, we explore the discovery prospects of near-future experiments both in the full parameter space and for specific benchmark points. We find that the most commonly used benchmark scenarios are already in tension with existing constraints and propose a new benchmark point that can be targeted with future searches.


title: TeV Solar Gamma Rays as a probe for the Solar Internetwork Magnetic Fields

abstract: The magnetic fields that emerge from beneath the solar surface and permeate the solar atmosphere are the key drivers of space weather and, thus, understanding them is important to human society. Direct observations, used to measure magnetic fields, can only probe the magnetic fields in the photosphere and above, far from the regions the magnetic fields are being enhanced by the solar dynamo. Solar gamma rays produced by cosmic rays interacting with the solar atmosphere have been detected from GeV to TeV energy range, and revealed that they are significantly affected by solar magnetic fields. However, much of the observations are yet to be explained by a physical model. Using a semi-analytic model, we show that magnetic fields at and below the photosphere with a large horizontal component could explain the $\sim$1 TeV solar gamma rays observed by HAWC. This could allow high-energy solar gamma rays to be a novel probe for magnetic fields below the photosphere.


title: Resistance Distribution of Decoherent Quantum Hall-Superconductor Edges

abstract: We study the probability distribution of the resistance, or equivalently the charge transmission, of a decoherent quantum Hall-superconductor edge, with the decoherence coming from metallic puddles along the edge. Such metallic puddles may originate from magnetic vortex cores or other superconductivity suppressing perturbations. In contrast to the distribution of a coherent edge which is peaked away from zero charge transmission, we show analytically and numerically that the distribution of a decoherent edge with metallic puddles is always peaked at zero charge transmission, which serves as a probe of coherence of superconducting chiral edge states. We further show that the distribution width decays exponentially in magnetic field and temperature. Our theoretical decoherent distribution agrees well with the recent experimental observation in graphene with superconducting proximity.


title: An explicit estimate of charm rescattering in $B^0 \to K^0 \bar{\ell} \ell$

abstract: We analyze $B^0 \to K^0 \bar{\ell} \ell$ long-distance contributions induced by the rescattering of a pair of charmed and charmed-strange mesons. We present an explicit estimate of these contributions using an effective description in terms of hadronic degrees of freedom, supplemented by data on the $B^0 \to D^*D_s (D^*_sD)$ transition in order to reproduce the corresponding discontinuity in the $B^0 \to K^0 \bar{\ell}\ell$ amplitude. The $D^* D_s(D^*_s D) K$ vertex is estimated using heavy-hadron chiral perturbation theory, obtaining an accurate description of the whole rescattering process in the low-recoil (or high-$q^2$) limit. We also present an extrapolation to the whole kinematical region introducing appropriate form factors. The explicit estimate of the leading $D^*D_s (D^*_sD)$ intermediate state leads to a long-distance amplitude which does not exceed a few percent relative to the short-distance one. The consequences of this result for the extraction of the short-distance coefficient $C_9$ are discussed.


title: The host galaxy of low-luminosity compact sources

abstract: The term 'active galactic nuclei' (AGN) subtends a huge variety of objects, classified on their properties at different wavelengths. Peaked sources (PS) represent a class of AGN at the first stage of evolution, characterised by a peaked radio spectrum. Among these radio sources, low-luminosity compact (LLC) sources can be identified as PS accreting with a high Eddington rate, harbouring low-power jets and hosting low-mass black holes. These properties are also shared by narrow-line Seyfert 1 galaxies (NLS1s). In 2016, LLCs were hypothesised to be the parent population of NLS1s with a flat radio spectrum (F-NLS1s), suggesting the former to be the same objects as the latter, seen at higher inclination. Based on radio luminosity functions and optical spectra analysis, 10 LLCs were identified as valid candidates for F-NLS1s. To account for the missing puzzle piece, verifying if these LLCs could be hosted in late-type galaxies as NLS1s, we performed the photometric decomposition of their Pan-STARRS1 images in all five filters. We used the 2D fitting algorithm GALFIT for the single-band analysis, and its extension GALFITM for the multi-band analysis. Considering that the morphological type and the structural parameters of the host can be dependent on the wavelength, we found six out of ten LLCs hosted in late-type galaxies, probably with pseudo-bulges, three point-like sources and one object of uncertain classification. Although this study is based on a small sample, it represents the first morphological analysis of LLC host galaxies. The results confirm the trend observed in NLS1s, indicating late-type/disc-like host galaxies for LLCs and supporting the validity of the parent population scenario.


title: A black hole effective theory for strongly interacting matter

abstract: We establish a new tool for studying strongly coupled matter: an effective theory of black holes in gravity, which maps to a hydrodynamic description of field theories via the gauge-gravity duality. Our approach is inspired by previously known effective theories found in the limit of high number of dimensions. We argue that the new approach can accurately describe phase transitions in a wide class of theories, such as the Yang-Mills and other nearly critical field theories. As an application, we analyze the interface between confining and deconfining phases in holographic Yang-Mills theory.


title: Stepping into the Forest: Confronting Interacting Radiation Models for the Hubble Tension with Lyman-$\alpha$ Data

abstract: Models of interacting dark radiation have been shown to alleviate the Hubble tension. Extensions incorporating a coupling between dark matter and dark radiation (DM-DR) have been proposed as combined solutions to both the Hubble and $S_8$ tensions. A key feature of these extended models is a break in the matter power spectrum (MPS), suppressing power for modes that enter the horizon before the DM-DR interactions turn off. In scenarios with a massless mediator, modes that enter before matter-radiation equality get suppressed, whereas for massive mediators, the break is determined by the mediator mass, a free parameter. In this work, we test these models against probes of LSS: weak lensing, CMB lensing, full-shape galaxy clustering, and eBOSS measurements of the 1D Ly$\alpha\,$ forest flux power spectrum. The latter are the most constraining since they probe small scales where many models predict the largest deviations. In fact, already within $\Lambda{\rm CDM}\,$, the eBOSS Ly$\alpha\,$ data are in significant tension with Planck CMB data, with the Ly$\alpha\,$ data preferring a steeper slope of the MPS at $k \sim h \mathrm{Mpc}^{-1}$. We find that the simplest dark radiation models, which improve the Hubble tension, worsen the fit to the Ly$\alpha\,$ data. However, models with DM-DR interactions can simultaneously address both tensions.


title: Operator representation of spatiotemporal quantum correlations

abstract: While quantum correlations between two spacelike-separated systems are fully encoded by the bipartite density operator associated with the joint system, we prove that there does not exist an operator representation for general quantum correlations across space and time. This is in stark contrast to the case of classical random variables, which make no distinction between spacelike and timelike correlations. Despite this, we show that in the restricted setting of spatiotemporal correlations between light-touch observables (i.e., observables with only one singular value), there exists a unique operator representation of such spatiotemporal correlations for arbitrary timelike-separated quantum systems. A special case of our result reproduces generalized Pauli observables and pseudo-density matrices, which have, up until now, only been defined for multi-qubit systems. In the case of qutrit systems, we use our results to illustrate an intriguing connection between light-touch observables and symmetric, informationally complete, positive operator-valued measures (SIC-POVMs).


title: Probabilistic Verification of Neural Networks using Branch and Bound

abstract: Probabilistic verification of neural networks is concerned with formally analysing the output distribution of a neural network under a probability distribution of the inputs. Examples of probabilistic verification include verifying the demographic parity fairness notion or quantifying the safety of a neural network. We present a new algorithm for the probabilistic verification of neural networks based on an algorithm for computing and iteratively refining lower and upper bounds on probabilities over the outputs of a neural network. By applying state-of-the-art bound propagation and branch and bound techniques from non-probabilistic neural network verification, our algorithm significantly outpaces existing probabilistic verification algorithms, reducing solving times for various benchmarks from the literature from tens of minutes to tens of seconds. Furthermore, our algorithm compares favourably even to dedicated algorithms for restricted subsets of probabilistic verification. We complement our empirical evaluation with a theoretical analysis, proving that our algorithm is sound and, under mildly restrictive conditions, also complete when using a suitable set of heuristics.


title: The set of Kirkwood-Dirac positive states is almost always minimal

abstract: A central problem in quantum information is determining quantum-classical boundaries. A useful notion of classicality is provided by the quasiprobability formulation of quantum theory. In this framework, a state is called classical if it is represented by a quasiprobability distribution that is positive, and thus a probability distribution. In recent years, the Kirkwood-Dirac (KD) distributions have gained much interest due to their numerous applications in modern quantum-information research. A particular advantage of the KD distributions is that they can be defined with respect to arbitrary observables. Here, we show that if two observables are picked at random, the set of classical states of the resulting KD distribution is a simple polytope of minimal size. When the Hilbert space is of dimension $d$, this polytope is of dimension $2d-1$ and has $2d$ known vertices. Our result implies, $\textit{e.g.}$, that almost all KD distributions have resource theories in which the free states form a small and simple set.


title: Coordinated Followup Could Have Enabled the Discovery of the GW190425 Kilonova

abstract: The discovery of a kilonova associated with the GW170817 binary neutron star merger had far-reaching implications for our understanding of several open questions in physics and astrophysics. Unfortunately, since then, only one robust binary neutron star merger was detected through gravitational waves, GW190425, and no electromagnetic counterpart was identified for it. We analyze all reported electromagnetic followup observations of GW190425 and find that while the gravitational-wave localization uncertainty was large, most of the 90% probability region could have been covered within hours had the search been coordinated. Instead, more than 5 days after the merger, the uncoordinated search covered only 50% of the probability, with some areas observed over 100 times, and some never observed. We further show that, according to some models, it would have been possible to detect the GW190425 kilonova, despite the larger distance and higher component masses compared to GW170817. These results emphasize the importance of coordinating followup of gravitational-wave events, not only to avoid missing future kilonovae, but also to discover them early. Such coordination, which is especially important given the rarity of these events, can be achieved with the Treasure Map, a tool developed specifically for this purpose.


title: New horizon symmetries, hydrodynamics, and quantum chaos

abstract: We generalize the formulation of horizon symmetries presented in previous literature to include diffeomorphisms that can shift the location of the horizon. In the context of the AdS/CFT duality, we show that horizon symmetries can be interpreted on the boundary as emergent low-energy gauge symmetries. In particular, we identify a new class of horizon symmetries that extend the so-called shift symmetry, which was previously postulated for effective field theories of maximally chaotic systems. Additionally, we comment on the connections of horizon symmetries with bulk calculations of out-of-time-ordered correlation functions and the phenomenon of pole-skipping.


title: The Symbiotic X-ray Binary IGR J16194-2810: A Window on the Future Evolution of Wide Neutron Star Binaries From Gaia

abstract: We present optical follow-up of IGR J16194-2810, a hard X-ray source discovered by the INTEGRAL mission. The optical counterpart is a $\sim500\,L_\odot$ red giant at a distance of $2.1$ kpc. We measured 16 radial velocities (RVs) of the giant over a period of $\sim 300$ days. Fitting these RVs with a Keplerian model, we find an orbital period of $P_{\rm orb} = 192.73 \pm 0.01$ days and a companion mass function $f(M_2) = 0.361 \pm 0.005 \,M_{\odot}$. We detect ellipsoidal variability with the same period in optical light curves from the ASAS-SN survey. Joint fitting of the RVs, light curves, and the broadband SED allows us to robustly constrain the masses of both components. We find a giant mass of $M_\star = 1.02\pm 0.01\,M_{\odot}$ and a companion mass of $M_{2} = 1.35^{+0.09}_{-0.07}\,M_{\odot}$, implying that the companion is a neutron star (NS). We recover a $4.06$-hour period in the system's TESS light curve, which we tentatively associate with the NS spin period. The giant does not yet fill its Roche lobe, suggesting that current mass transfer is primarily via winds. MESA evolutionary models predict that the giant will overflow its Roche lobe in $5$-$10$ Myr, eventually forming a recycled pulsar + white dwarf binary with a $\sim 900$ day period. IGR J16194-2810 provides a window on the future evolution of wide NS + main sequence binaries recently discovered via Gaia astrometry. As with those systems, the binary's formation history is uncertain. Before the formation of the NS, it likely survived a common envelope episode with a donor-to-accretor mass ratio $\gtrsim 10$ and emerged in a wide orbit. The NS likely formed with a weak kick ($v_{\rm kick}\lesssim 100\,\rm km\,s^{-1}$), as stronger kicks would have disrupted the orbit.


title: Engineering flux-controlled flat bands and topological states in a Stagome lattice

abstract: We present the Stagome lattice, a variant of the Kagome lattice, where one can make any of the bands completely flat by tuning an externally controllable magnetic flux. This systematically allows the energy of the flat band (FB) to coincide with the Fermi level. We have analytically calculated the compact localized states (CLS) associated to each of these flat bands appearing at different values of the magnetic flux. We also show that, this model features nontrivial topological properties with distinct integer values of the Chern numbers as a function of the magnetic flux. We argue that this mechanism for making any of the bands exactly flat could be of interest to address the FB superconductivity in such a system. Furthermore, we believe that the phenomenon of photonic flat band localization could be studied in the Stagome lattice structure, designed for instance using femtosecond laser induced single-mode waveguide arrays.


title: Angular fractals in thermal QFT

abstract: We show that thermal effective field theory controls the long-distance expansion of the partition function of a $d$-dimensional QFT, with an insertion of any finite-order spatial isometry. Consequently, the thermal partition function on a sphere displays a fractal-like structure as a function of angular twist, reminiscent of the behavior of a modular form near the real line. As an example application, we find that for CFTs, the effective free energy of even-spin minus odd-spin operators at high temperature is smaller than the usual free energy by a factor of $1/2^d$. Near certain rational angles, the partition function receives subleading contributions from "Kaluza-Klein vortex defects" in the thermal EFT, which we classify. We illustrate our results with examples in free and holographic theories, and also discuss nonperturbative corrections from worldline instantons.


title: Driving asymmetric red supergiants winds with binary interactions

abstract: Massive stars in the red supergiant (RSG) phase are known to undergo strong mass loss through winds and observations indicate that a substantial part of this mass loss could be driven by localised and episodic outflows. Various mechanisms have been considered to explain this type of mass loss in RSGs, but these models often focus on single-star evolution. However, massive stars commonly evolve in binary systems, potentially interacting with their companions. Motivated by observations of the highly asymmetric circumstellar ejecta around the RSG VY~CMa, we investigate a scenario where a companion on an eccentric orbit grazes the surface of a red supergiant at periastron. The companion ejects part of the outer RSG envelope, which radiatively cools, reaching the proper conditions for dust condensation and eventually giving rise to dust-driven winds. Using simple treatments for radiative cooling and dust-driven winds, we perform 3D smoothed particle hydrodynamics simulations of this scenario with a $20\,M_\odot$ RSG and a $2\,M_\odot$ companion. We follow the evolution of the binary throughout a total of 14 orbits and observe that the orbit tightens after each interaction, in turn enhancing the mass loss of subsequent interactions. We show that one such grazing interaction yields outflows of $3\times10^{-4}\,M_\odot$, which later results in wide asymmetric dusty ejecta, carrying a total mass of $0.185\,M_\odot$ by the end of simulations. We discuss the implications for the evolution of the binary, potential observational signatures, as well as future improvements of the model required to provide sensible predictions for the evolution of massive binaries.


title: Rescuing thermally under-abundant dark matter with a first-order phase transition

abstract: We propose a novel scenario where thermally under-abundant dark matter (DM) can be revived with a first-order phase transition (FOPT). In the absence of FOPT, thermal DM abundance remains suppressed due to efficient annihilation via mediators. A FOPT brings sharp change to the mass of the mediator at the nucleation temperature such that the final DM relic agrees with observations. We implement this idea in a scenario where DM interacts via a mediator whose initial mass is of same order as DM mass keeping DM annihilation either in allowed or forbidden ballpark. As the mediator mass decreases sharply at the nucleation temperature of the FOPT, the frozen out DM suffers further depletion while keeping final relic within observed limits. DM with sizeable interactions with a light mediator can also give rise to the required self-interactions necessary to solve the small scale structure issues of cold dark matter. While the mechanism is generic to any thermal DM mass, choosing it in the GeV ballpark forces the FOPT to MeV scale which predicts stochastic gravitational waves with nano-Hz frequencies within reach of pulsar timing array (PTA) based experiments like NANOGrav. The existence of light scalar mediator and its mixing with the Higgs keep the scenario verifiable at different particle physics experiments.


title: Wigner's Theorem for stabilizer states and quantum designs

abstract: We describe the symmetry group of the stabilizer polytope for any number $n$ of systems and any prime local dimension $d$. In the qubit case, the symmetry group coincides with the linear and anti-linear Clifford operations. In the case of qudits, the structure is somewhat richer: for $n=1$, it is a wreath product of permutations of bases and permutations of the elements within each basis. For $n>1$, the symmetries are given by affine symplectic similitudes. These are the affine maps that preserve the symplectic form of the underlying discrete phase space up to a non-zero multiplier. We phrase these results with respect to a number of a priori different notions of "symmetry'', including Kadison symmetries (bijections that are compatible with convex combinations), Wigner symmetries (bijections that preserve inner products), and symmetries realized by an action on Hilbert space. Going beyond stabilizer states, we extend an observation of Heinrich and Gross (Ref. [25]) and show that the symmetries of fairly general sets of Hermitian operators are constrained by certain moments. In particular: the symmetries of a set that behaves like a 3-design preserve Jordan products and are therefore realized by conjugation with unitaries or anti-unitaries. (The structure constants of the Jordan algebra are encoded in an order-three tensor, which we connect to the third moments of a design). This generalizes Kadison's formulation of the classic Wigner Theorem on quantum mechanical symmetries.


title: A deep-learning algorithm to disentangle self-interacting dark matter and AGN feedback models

abstract: Different models of dark matter can alter the distribution of mass in galaxy clusters in a variety of ways. However, so can uncertain astrophysical feedback mechanisms. Here we present a Machine Learning method that ''learns'' how the impact of dark matter self-interactions differs from that of astrophysical feedback in order to break this degeneracy and make inferences on dark matter. We train a Convolutional Neural Network on images of galaxy clusters from hydro-dynamic simulations. In the idealised case our algorithm is 80% accurate at identifying if a galaxy cluster harbours collisionless dark matter, dark matter with ${\sigma}_{\rm DM}/m = 0.1$cm$^2/$g or with ${\sigma}_{DM}/m = 1$cm$^2$/g. Whilst we find adding X-ray emissivity maps does not improve the performance in differentiating collisional dark matter, it does improve the ability to disentangle different models of astrophysical feedback. We include noise to resemble data expected from Euclid and Chandra and find our model has a statistical error of < 0.01cm$^2$/g and that our algorithm is insensitive to shape measurement bias and photometric redshift errors. This method represents a new way to analyse data from upcoming telescopes that is an order of magnitude more precise and many orders faster, enabling us to explore the dark matter parameter space like never before.


title: Strategic Code: A Unified Spatio-Temporal Framework for Quantum Error-Correction

abstract: Quantum error-correcting code (QECC) is the central ingredient in fault-tolerant quantum information processing. An emerging paradigm of dynamical QECC shows that one can robustly encode logical quantum information both temporally and spatially in a more resource-efficient manner than traditional QECCs. Nevertheless, an overarching theory of how dynamical QECCs achieve fault-tolerance is lacking. In this work, we bridge this gap by proposing a unified spatio-temporal QECC framework called the ``strategic code'' built around an ``interrogator'' device which sequentially measures and evolves the spatial QECC in an adaptive manner based on the ``quantum combs'' formalism, a generalization of the channel-state duality. The strategic code covers all existing dynamical and static QECC, as well as all physically plausible QECCs to be discovered in the future, including those that involve adaptivity in its operational dynamics. Within this framework, we show an algebraic and an information-theoretic necessary and sufficient error-correction conditions for a strategic code, which consider spatially and temporally correlated errors. These conditions include the analogous known static QECC conditions as a special case. Lastly, we also propose an optimization-theoretic approach to obtain an approximate strategic code adapting to a correlated error.


title: ExtremeMETA: High-speed Lightweight Image Segmentation Model by Remodeling Multi-channel Metamaterial Imagers

abstract: Deep neural networks (DNNs) have heavily relied on traditional computational units like CPUs and GPUs. However, this conventional approach brings significant computational burdens, latency issues, and high power consumption, limiting their effectiveness. This has sparked the need for lightweight networks like ExtremeC3Net. On the other hand, there have been notable advancements in optical computational units, particularly with metamaterials, offering the exciting prospect of energy-efficient neural networks operating at the speed of light. Yet, the digital design of metamaterial neural networks (MNNs) faces challenges such as precision, noise, and bandwidth, limiting their application to intuitive tasks and low-resolution images. In this paper, we propose a large kernel lightweight segmentation model, ExtremeMETA. Based on the ExtremeC3Net, the ExtremeMETA maximizes the ability of the first convolution layer by exploring a larger convolution kernel and multiple processing paths. With the proposed large kernel convolution model, we extend the optic neural network application boundary to the segmentation task. To further lighten the computation burden of the digital processing part, a set of model compression methods is applied to improve model efficiency in the inference stage. The experimental results on three publicly available datasets demonstrate that the optimized efficient design improved segmentation performance from 92.45 to 95.97 on mIoU while reducing computational FLOPs from 461.07 MMacs to 166.03 MMacs. The proposed the large kernel lightweight model ExtremeMETA showcases the hybrid design's ability on complex tasks.


title: Discriminant audio properties in deep learning based respiratory insufficiency detection in Brazilian Portuguese

abstract: This work investigates Artificial Intelligence (AI) systems that detect respiratory insufficiency (RI) by analyzing speech audios, thus treating speech as a RI biomarker. Previous works collected RI data (P1) from COVID-19 patients during the first phase of the pandemic and trained modern AI models, such as CNNs and Transformers, which achieved $96.5\%$ accuracy, showing the feasibility of RI detection via AI. Here, we collect RI patient data (P2) with several causes besides COVID-19, aiming at extending AI-based RI detection. We also collected control data from hospital patients without RI. We show that the considered models, when trained on P1, do not generalize to P2, indicating that COVID-19 RI has features that may not be found in all RI types.


title: Estimating Quantum Gravity Corrections to Correlators near Black Holes

abstract: We analyze the size of quantum gravity effects near black hole horizons. By considering black holes in asymptotically AdS spacetime, we can make use of the "quantum deviation" to estimate the size of quantum gravity corrections to the semiclassical analysis. We find that, in a typical pure state, corrections to correlation functions are typically of order exp(-S/2). Both the magnitude and time dependence of the correlator differ from previous results related to the spectral form factor, which estimated the correlator in a thermal state. Our results severely constrain proposals, such as non-violent unitarization and some versions of fuzzballs, that predict significant corrections to the semiclassical computation of correlation functions near black holes. We point out one possible loophole: our results rely on the standard result that bulk reconstruction is state independent for small perturbations outside the black hole.


title: Bluesky: Network Topology, Polarisation, and Algorithmic Curation

abstract: Bluesky is a nascent ``Twitter-like'' and decentralized social media network with novel features and unprecedented data access. This paper provides a characterization of the network, studying the political leaning, polarization, network structure, and algorithmic curation mechanisms of five million users. The dataset spans from the website's first release in February of 2023. Users of the new social media site are predominantly left-center leaning and share little to no links associated with questionable sources. In contrast to the homogeneous political stance, we find significant issues-based divergence by studying opinions related to the Israel-Palestine conflict. Two clear homophilic clusters emerge: Pro-Palestinian voices make up the plurality of messages related to the conflict and the proportion has increased with a lessening of interest. We investigate multiple layers of the multi-scale Bluesky network based on replies, likes, reposts, and follows, highlighting differences and similarities between the layers. We differentiate between persistent and non-persistent interactions and measure metrics of network topology over time. All networks are heavy-tailed, clustered, and connected by short paths. We showcase all feeds - algorithmic content recommenders - created for and by users. A large number of custom feeds have been created but their uptake by users is limited. Multiple popular feeds aim to provide similar feeds that are neither topical nor chronological. We conclude by claiming that Bluesky - for all its novel features - is very similar in terms of its network structure to existing and larger social media sites and provides unprecedented research opportunities for social scientists, network scientists, and political scientists alike.


title: (Non-)existence of Cannon-Thurston maps for Morse boundaries

abstract: We show that the Morse boundary exhibits interesting examples of both the existence and non-existence of Cannon-Thurston maps for normal subgroups, in contrast with the hyperbolic case.


title: Hamiltonian Mechanics of Feature Learning: Bottleneck Structure in Leaky ResNets

abstract: We study Leaky ResNets, which interpolate between ResNets ($\tilde{L}=0$) and Fully-Connected nets ($\tilde{L}\to\infty$) depending on an 'effective depth' hyper-parameter $\tilde{L}$. In the infinite depth limit, we study 'representation geodesics' $A_{p}$: continuous paths in representation space (similar to NeuralODEs) from input $p=0$ to output $p=1$ that minimize the parameter norm of the network. We give a Lagrangian and Hamiltonian reformulation, which highlight the importance of two terms: a kinetic energy which favors small layer derivatives $\partial_{p}A_{p}$ and a potential energy that favors low-dimensional representations, as measured by the 'Cost of Identity'. The balance between these two forces offers an intuitive understanding of feature learning in ResNets. We leverage this intuition to explain the emergence of a bottleneck structure, as observed in previous work: for large $\tilde{L}$ the potential energy dominates and leads to a separation of timescales, where the representation jumps rapidly from the high dimensional inputs to a low-dimensional representation, move slowly inside the space of low-dimensional representations, before jumping back to the potentially high-dimensional outputs. Inspired by this phenomenon, we train with an adaptive layer step-size to adapt to the separation of timescales.


title: Gluing-orbit property, local stable/unstable sets, and induced dynamics on hyperspace

abstract: We prove that local stable/unstable sets of homeomorphisms of an infinite compact metric space satisfying the gluing-orbit property always contain compact and perfect subsets of the space. As a consequence, we prove that if a positively countably expansive homeomorphism satisfies the gluing-orbit property, then the space is a single periodic orbit. We also prove that there are homeomorphisms with gluing-orbit such that its induced homeomorphism on the hyperspace of compact subsets does not have gluing-orbit, contrasting with the case of the shadowing and specification properties, proving that if the induced map has gluing-orbit, then the base map has gluing-orbit and is topologically mixing.


title: Interpretable Prognostics with Concept Bottleneck Models

abstract: Deep learning approaches have recently been extensively explored for the prognostics of industrial assets. However, they still suffer from a lack of interpretability, which hinders their adoption in safety-critical applications. To improve their trustworthiness, explainable AI (XAI) techniques have been applied in prognostics, primarily to quantify the importance of input variables for predicting the remaining useful life (RUL) using post-hoc attribution methods. In this work, we propose the application of Concept Bottleneck Models (CBMs), a family of inherently interpretable neural network architectures based on concept explanations, to the task of RUL prediction. Unlike attribution methods, which explain decisions in terms of low-level input features, concepts represent high-level information that is easily understandable by users. Moreover, once verified in actual applications, CBMs enable domain experts to intervene on the concept activations at test-time. We propose using the different degradation modes of an asset as intermediate concepts. Our case studies on the New Commercial Modular AeroPropulsion System Simulation (N-CMAPSS) aircraft engine dataset for RUL prediction demonstrate that the performance of CBMs can be on par or superior to black-box models, while being more interpretable, even when the available labeled concepts are limited. Code available at \href{https://github.com/EPFL-IMOS/concept-prognostics/}{\url{github.com/EPFL-IMOS/concept-prognostics/}}.


title: Container pre-marshalling problem minimizing CV@R under uncertainty of ship arrival times

abstract: This paper is concerned with the container pre-marshalling problem, which involves relocating containers in the storage area so that they can be efficiently loaded onto ships without reshuffles. In reality, however, ship arrival times are affected by various external factors, which can cause the order of container retrieval to be different from the initial plan. To represent such uncertainty, we generate multiple scenarios from a multivariate probability distribution of ship arrival times. We derive a mixed-integer linear optimization model to find an optimal container layout such that the conditional value-at-risk is minimized for the number of misplaced containers responsible for reshuffles. Moreover, we devise an exact algorithm based on the cutting-plane method to handle large-scale problems. Numerical experiments using synthetic datasets demonstrate that our method can produce high-quality container layouts compared with the conventional robust optimization model. Additionally, our algorithm can speed up the computation of solving large-scale problems.


title: Local structure theory of Einstein manifolds with boundary

abstract: We study local structure of the moduli space of compact Einstein metrics with respect to the boundary conformal metric and mean curvature. In dimension three, we confirm M. Anderson's conjecture in a strong sense, showing that the map from Einstein metrics to such boundary data is generically a local diffeomorphism. In dimensions greater than three, we obtain similar results for Ricci flat metrics and negative Einstein metrics under new non-degenerate boundary conditions.


title: Cell migration: Beyond Brownian motion

abstract: This brief `New & Notable' (perspectives-type) article contains a mini-review on stochastic modelling of cell migration before elaborating on the article by Klimek et al., arXiv:2311.16753 [Biophys. J. 123, 1173-1183 (2024)].


title: Harnessing Natural Oscillations for High-Speed, Efficient Asymmetrical Locomotion in Quadrupedal Robots

abstract: This study explores the dynamics of asymmetrical bounding gaits in quadrupedal robots, focusing on the integration of torso pitching and hip motion to enhance speed and stability. Traditional control strategies often enforce a fixed posture, minimizing natural body movements to simplify the control problem. However, this approach may overlook the inherent dynamical advantages found in natural locomotion. By considering the robot as two interconnected segments, we concentrate on stance leg motion while allowing passive torso oscillation, drawing inspiration from natural dynamics and underactuated robotics principles. Our control scheme employs Linear Inverted Pendulum (LIP) and Spring-Loaded Inverted Pendulum (SLIP) models to govern front and rear leg movements independently. This approach has been validated through extensive simulations and hardware experiments, demonstrating successful high-speed locomotion with top speeds nearing 4 m/s and reduced ground reaction forces, indicating a more efficient gait. Furthermore, unlike conventional methods, our strategy leverages natural torso oscillations to aid leg circulation and stride length, aligning robot dynamics more closely with biological counterparts. Our findings suggest that embracing the natural dynamics of quadrupedal movement, particularly in asymmetrical gaits like bounding, can lead to more stable, efficient, and high-speed robotic locomotion. This investigation lays the groundwork for future studies on versatile and dynamic quadrupedal gaits and their potential applications in scenarios demanding rapid and effective locomotion.


title: Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes

abstract: The training dynamics of linear networks are well studied in two distinct setups: the lazy regime and balanced/active regime, depending on the initialization and width of the network. We provide a surprisingly simple unyfing formula for the evolution of the learned matrix that contains as special cases both lazy and balanced regimes but also a mixed regime in between the two. In the mixed regime, a part of the network is lazy while the other is balanced. More precisely the network is lazy along singular values that are below a certain threshold and balanced along those that are above the same threshold. At initialization, all singular values are lazy, allowing for the network to align itself with the task, so that later in time, when some of the singular value cross the threshold and become active they will converge rapidly (convergence in the balanced regime is notoriously difficult in the absence of alignment). The mixed regime is the `best of both worlds': it converges from any random initialization (in contrast to balanced dynamics which require special initialization), and has a low rank bias (absent in the lazy dynamics). This allows us to prove an almost complete phase diagram of training behavior as a function of the variance at initialization and the width, for a MSE training task.


title: Tleco: A Toolkit for Modeling Radiative Signatures from Relativistic Outflows

abstract: A wide range of astrophysical sources exhibit extreme and rapidly varying electromagnetic emission indicative of efficient non-thermal particle acceleration. Understanding these sources often involves comparing data with a broad range of theoretical scenarios. To this end, it is beneficial to have tools that enable not only fast and efficient parametric investigation of the predictions of a specific scenario but also the flexibility to explore different theoretical ideas. In this paper, we introduce \texttt{Tleco}, a versatile and lightweight toolkit for developing numerical models of relativistic outflows, including their particle acceleration mechanisms and resultant electromagnetic signature. Built on the Rust programming language and wrapped into a Python library, \texttt{Tleco} offers efficient algorithms for evolving relativistic particle distributions and for solving the resulting emissions in a customizable fashion. \texttt{Tleco} uses a fully implicit discretization algorithm to solve the Fokker-Planck (FP) equation with user-defined diffusion, advection, cooling, injection, and escape, and offers prescriptions for radiative emission and cooling. These include, but are not limited to, synchrotron, inverse-Compton, and self-synchrotron absorption. \texttt{Tleco} is designed to be user-friendly and adaptable to model particle acceleration and the resulting electromagnetic spectrum and temporal variability in a wide variety of astrophysical scenarios, including, but not limited to, gamma-ray bursts, pulsar wind nebulae, and jets from active galactic nuclei. In this work, we outline the core algorithms and proceed to evaluate and demonstrate their effectiveness. The code is open-source and available in the GitHub repository: \href{https://github.com/zkdavis/Tleco