title: Error Estimates for Data-driven Weakly Convex Frame-based Image Regularization

abstract: Inverse problems are fundamental in fields like medical imaging, geophysics, and computerized tomography, aiming to recover unknown quantities from observed data. However, these problems often lack stability due to noise and ill-conditioning, leading to inaccurate reconstructions. To mitigate these issues, regularization methods are employed, introducing constraints to stabilize the inversion process and achieve a meaningful solution. Recent research has shown that the application of regularizing filters to diagonal frame decompositions (DFD) yields regularization methods. These filters dampen some frame coefficients to prevent noise amplification. This paper introduces a non-linear filtered DFD method combined with a learning strategy for determining optimal non-linear filters from training data pairs. In our experiments, we applied this approach to the inversion of the Radon transform using 500 image-sinogram pairs from real CT scans. Although the learned filters were found to be strictly increasing, they did not satisfy the non-expansiveness condition required to link them with convex regularizers and prove stability and convergence in the sense of regularization methods in previous works. Inspired by this, the paper relaxes the non-expansiveness condition, resulting in weakly convex regularization. Despite this relaxation, we managed to derive stability, convergence, and convergence rates with respect to the absolute symmetric Bregman distance for the learned non-linear regularizing filters. Extensive numerical results demonstrate the effectiveness of the proposed method in achieving stable and accurate reconstructions.


title: The Tree of Diffusion Life: Evolutionary Embeddings to Understand the Generation Process of Diffusion Models

abstract: Diffusion models generate high-quality samples by corrupting data with Gaussian noise and iteratively reconstructing it with deep learning, slowly transforming noisy images into refined outputs. Understanding this data evolution is important for interpretability but is complex due to its high-dimensional evolutionary nature. While traditional dimensionality reduction methods like t-distributed stochastic neighborhood embedding (t-SNE) aid in understanding high-dimensional spaces, they neglect evolutionary structure preservation. Hence, we propose Tree of Diffusion Life (TDL), a method to understand data evolution in the generative process of diffusion models. TDL samples a diffusion model's generative space via instances with varying prompts and employs image encoders to extract semantic meaning from these samples, projecting them to an intermediate space. It employs a novel evolutionary embedding algorithm that explicitly encodes the iterations while preserving the high-dimensional relations, facilitating the visualization of data evolution. This embedding leverages three metrics: a standard t-SNE loss to group semantically similar elements, a displacement loss to group elements from the same iteration step, and an instance alignment loss to align elements of the same instance across iterations. We present rectilinear and radial layouts to represent iterations, enabling comprehensive exploration. We assess various feature extractors and highlight TDL's potential with prominent diffusion models like GLIDE and Stable Diffusion with different prompt sets. TDL simplifies understanding data evolution within diffusion models, offering valuable insights into their functioning.


title: A hybrid predictive and prescriptive modelling framework for long-term mental healthcare workforce planning

abstract: Over the past decade, there has been a severe staffing shortage in mental healthcare, exacerbated by increased demand for mental health services due to COVID-19. This demand is projected to increase over the next decade or so, necessitating proactive workforce planning to ensure sufficient staffing for ongoing service delivery. Despite the subject's critical significance, the present literature lacks thorough research dedicated to developing a model that addresses the long-term workforce needs required for efficient mental healthcare planning. Furthermore, our interactions with mental health practitioners within the United Kingdom's National Health Service (NHS) revealed the practical need for such a model. To address this gap, we aim to develop a hybrid predictive and prescriptive modelling framework, which combines long-term probabilistic forecasting with an analytical stock-flow model, designed specifically for mental health workforce planning. Given the vital role of nurses, who account for one-third of the total mental health workforce, we focus on modelling the headcount of nurses, but the proposed model can be generalised to other types of workforce planning in the healthcare sector. Using statistical and machine learning approaches and real-world data from NHS, we first identify factors contributing to variations in workforce requirements, then develop a long-term forecasting model to estimate future workforce needs, and finally integrate it into an analytical stock-flow method to provide policy analysis. Our findings highlight the unsustainable nature of present staffing plans, showing a growing nursing shortage. Furthermore, the policy analysis demonstrates the ineffectiveness of blanket remedies, highlighting the need for regional-level policy developments.


title: Exact results on the dynamics of the stochastic Floquet-East model

abstract: We introduce a stochastic generalisation of the classical deterministic Floquet-East model, a discrete circuit with the same kinetic constraint as the East model of glasses. We prove exactly that, in the limit of long time and large size, this model has a large deviation phase transition between active and inactive dynamical phases. We also compute the finite time and size scaling of general space-time fluctuations, which for the case of inactive regions gives rise to dynamical hydrophobicity. We also discuss how, through the Trotter limit, these exact results also hold for the continuous-time East model, thus proving long-standing observations in kinetically constrained models. Our results here illustrate the applicability of exact tensor network methods for solving problems in many-body stochastic systems.


title: Enhancing Tool Retrieval with Iterative Feedback from Large Language Models

abstract: Tool learning aims to enhance and expand large language models' (LLMs) capabilities with external tools, which has gained significant attention recently. Current methods have shown that LLMs can effectively handle a certain amount of tools through in-context learning or fine-tuning. However, in real-world scenarios, the number of tools is typically extensive and irregularly updated, emphasizing the necessity for a dedicated tool retrieval component. Tool retrieval is nontrivial due to the following challenges: 1) complex user instructions and tool descriptions; 2) misalignment between tool retrieval and tool usage models. To address the above issues, we propose to enhance tool retrieval with iterative feedback from the large language model. Specifically, we prompt the tool usage model, i.e., the LLM, to provide feedback for the tool retriever model in multi-round, which could progressively improve the tool retriever's understanding of instructions and tools and reduce the gap between the two standalone components. We build a unified and comprehensive benchmark to evaluate tool retrieval models. The extensive experiments indicate that our proposed approach achieves advanced performance in both in-domain evaluation and out-of-domain evaluation.


title: Two-Stage Testing in a high dimensional setting

abstract: In a high dimensional regression setting in which the number of variables ($p$) is much larger than the sample size ($n$), the number of possible two-way interactions between the variables is immense. If the number of variables is in the order of one million, which is usually the case in e.g., genetics, the number of two-way interactions is of the order one million squared. In the pursuit of detecting two-way interactions, testing all pairs for interactions one-by-one is computational unfeasible and the multiple testing correction will be severe. In this paper we describe a two-stage testing procedure consisting of a screening and an evaluation stage. It is proven that, under some assumptions, the tests-statistics in the two stages are asymptotically independent. As a result, multiplicity correction in the second stage is only needed for the number of statistical tests that are actually performed in that stage. This increases the power of the testing procedure. Also, since the testing procedure in the first stage is computational simple, the computational burden is lowered. Simulations have been performed for multiple settings and regression models (generalized linear models and Cox PH model) to study the performance of the two-stage testing procedure. The results show type I error control and an increase in power compared to the procedure in which the pairs are tested one-by-one.


title: Early learning of the optimal constant solution in neural networks and humans

abstract: Deep neural networks learn increasingly complex functions over the course of training. Here, we show both empirically and theoretically that learning of the target function is preceded by an early phase in which networks learn the optimal constant solution (OCS) - that is, initial model responses mirror the distribution of target labels, while entirely ignoring information provided in the input. Using a hierarchical category learning task, we derive exact solutions for learning dynamics in deep linear networks trained with bias terms. Even when initialized to zero, this simple architectural feature induces substantial changes in early dynamics. We identify hallmarks of this early OCS phase and illustrate how these signatures are observed in deep linear networks and larger, more complex (and nonlinear) convolutional neural networks solving a hierarchical learning task based on MNIST and CIFAR10. We explain these observations by proving that deep linear networks necessarily learn the OCS during early learning. To further probe the generality of our results, we train human learners over the course of three days on the category learning task. We then identify qualitative signatures of this early OCS phase in terms of the dynamics of true negative (correct-rejection) rates. Surprisingly, we find the same early reliance on the OCS in the behaviour of human learners. Finally, we show that learning of the OCS can emerge even in the absence of bias terms and is equivalently driven by generic correlations in the input data. Overall, our work suggests the OCS as a universal learning principle in supervised, error-corrective learning, and the mechanistic reasons for its prevalence.


title: Tachyonic production of dark relics: classical lattice vs. quantum 2PI in Hartree truncation

abstract: We study the out-of-equilibrium production of non-minimally coupled self-interacting scalar dark matter during reheating using classical lattice simulations. The outcomes of the classical simulations are in qualitative agreement with the previous results obtained using the quantum 2PI approach in the Hartree truncation. In particular, the novel non-linear resonance found in the 2PI Hartee study is present also in the classical lattice simulations and can dominate the final dark matter yield. For the parameters considered, the difference in final value of the scalar two-point function between the two approaches is a factor of O(1).


title: Cross-Modal Spherical Aggregation for Weakly Supervised Remote Sensing Shadow Removal

abstract: Remote sensing shadow removal, which aims to recover contaminated surface information, is tricky since shadows typically display overwhelmingly low illumination intensities. In contrast, the infrared image is robust toward significant light changes, providing visual clues complementary to the visible image. Nevertheless, the existing methods ignore the collaboration between heterogeneous modalities, leading to undesired quality degradation. To fill this gap, we propose a weakly supervised shadow removal network with a spherical feature space, dubbed S2-ShadowNet, to explore the best of both worlds for visible and infrared modalities. Specifically, we employ a modal translation (visible-to-infrared) model to learn the cross-domain mapping, thus generating realistic infrared samples. Then, Swin Transformer is utilized to extract strong representational visible/infrared features. Simultaneously, the extracted features are mapped to the smooth spherical manifold, which alleviates the domain shift through regularization. Well-designed similarity loss and orthogonality loss are embedded into the spherical space, prompting the separation of private visible/infrared features and the alignment of shared visible/infrared features through constraints on both representation content and orientation. Such a manner encourages implicit reciprocity between modalities, thus providing a novel insight into shadow removal. Notably, ground truth is not available in practice, thus S2-ShadowNet is trained by cropping shadow and shadow-free patches from the shadow image itself, avoiding stereotypical and strict pair data acquisition. More importantly, we contribute a large-scale weakly supervised shadow removal benchmark, including 4000 shadow images with corresponding shadow masks.


title: Dynamic Scheduling for Vehicle-to-Vehicle Communications Enhanced Federated Learning

abstract: Leveraging the computing and sensing capabilities of vehicles, vehicular federated learning (VFL) has been applied to edge training for connected vehicles. The dynamic and interconnected nature of vehicular networks presents unique opportunities to harness direct vehicle-to-vehicle (V2V) communications, enhancing VFL training efficiency. In this paper, we formulate a stochastic optimization problem to optimize the VFL training performance, considering the energy constraints and mobility of vehicles, and propose a V2V-enhanced dynamic scheduling (VEDS) algorithm to solve it. The model aggregation requirements of VFL and the limited transmission time due to mobility result in a stepwise objective function, which presents challenges in solving the problem. We thus propose a derivative-based drift-plus-penalty method to convert the long-term stochastic optimization problem to an online mixed integer nonlinear programming (MINLP) problem, and provide a theoretical analysis to bound the performance gap between the online solution and the offline optimal solution. Further analysis of the scheduling priority reduces the original problem into a set of convex optimization problems, which are efficiently solved using the interior-point method. Experimental results demonstrate that compared with the state-of-the-art benchmarks, the proposed algorithm enhances the image classification accuracy on the CIFAR-10 dataset by 3.18% and reduces the average displacement errors on the Argoverse trajectory prediction dataset by 10.21%.


title: Medical Image Segmentation Using Directional Window Attention

abstract: Accurate segmentation of medical images is crucial for diagnostic purposes, including cell segmentation, tumor identification, and organ localization. Traditional convolutional neural network (CNN)-based approaches struggled to achieve precise segmentation results due to their limited receptive fields, particularly in cases involving multi-organ segmentation with varying shapes and sizes. The transformer-based approaches address this limitation by leveraging the global receptive field, but they often face challenges in capturing local information required for pixel-precise segmentation. In this work, we introduce DwinFormer, a hierarchical encoder-decoder architecture for medical image segmentation comprising a directional window (Dwin) attention and global self-attention (GSA) for feature encoding. The focus of our design is the introduction of Dwin block within DwinFormer that effectively captures local and global information along the horizontal, vertical, and depthwise directions of the input feature map by separately performing attention in each of these directional volumes. To this end, our Dwin block introduces a nested Dwin attention (NDA) that progressively increases the receptive field in horizontal, vertical, and depthwise directions and a convolutional Dwin attention (CDA) that captures local contextual information for the attention computation. While the proposed Dwin block captures local and global dependencies at the first two high-resolution stages of DwinFormer, the GSA block encodes global dependencies at the last two lower-resolution stages. Experiments over the challenging 3D Synapse Multi-organ dataset and Cell HMS dataset demonstrate the benefits of our DwinFormer over the state-of-the-art approaches. Our source code will be publicly available at \url{https://github.com/Daniyanaj/DWINFORMER}.


title: UHD-IQA Benchmark Database: Pushing the Boundaries of Blind Photo Quality Assessment

abstract: We introduce a novel Image Quality Assessment (IQA) dataset comprising 6073 UHD-1 (4K) images, annotated at a fixed width of 3840 pixels. Contrary to existing No-Reference (NR) IQA datasets, ours focuses on highly aesthetic photos of high technical quality, filling a gap in the literature. The images, carefully curated to exclude synthetic content, are sufficiently diverse to train general NR-IQA models. The dataset is annotated with perceptual quality ratings obtained through a crowdsourcing study. Ten expert raters, comprising photographers and graphics artists, assessed each image at least twice in multiple sessions spanning several days, resulting in highly reliable labels. Annotators were rigorously selected based on several metrics, including self-consistency, to ensure their reliability. The dataset includes rich metadata with user and machine-generated tags from over 5,000 categories and popularity indicators such as favorites, likes, downloads, and views. With its unique characteristics, such as its focus on high-quality images, reliable crowdsourced annotations, and high annotation resolution, our dataset opens up new opportunities for advancing perceptual image quality assessment research and developing practical NR-IQA models that apply to modern photos. Our dataset is available at https://database.mmsp-kn.de/uhd-iqa-benchmark-database.html


title: TSynD: Targeted Synthetic Data Generation for Enhanced Medical Image Classification

abstract: The usage of medical image data for the training of large-scale machine learning approaches is particularly challenging due to its scarce availability and the costly generation of data annotations, typically requiring the engagement of medical professionals. The rapid development of generative models allows towards tackling this problem by leveraging large amounts of realistic synthetically generated data for the training process. However, randomly choosing synthetic samples, might not be an optimal strategy. In this work, we investigate the targeted generation of synthetic training data, in order to improve the accuracy and robustness of image classification. Therefore, our approach aims to guide the generative model to synthesize data with high epistemic uncertainty, since large measures of epistemic uncertainty indicate underrepresented data points in the training set. During the image generation we feed images reconstructed by an auto encoder into the classifier and compute the mutual information over the class-probability distribution as a measure for uncertainty.We alter the feature space of the autoencoder through an optimization process with the objective of maximizing the classifier uncertainty on the decoded image. By training on such data we improve the performance and robustness against test time data augmentations and adversarial attacks on several classifications tasks.


title: Transformer-based Named Entity Recognition with Combined Data Representation

abstract: This study examines transformer-based models and their effectiveness in named entity recognition tasks. The study investigates data representation strategies, including single, merged, and context, which respectively use one sentence, multiple sentences, and sentences joined with attention to context per vector. Analysis shows that training models with a single strategy may lead to poor performance on different data representations. To address this limitation, the study proposes a combined training procedure that utilizes all three strategies to improve model stability and adaptability. The results of this approach are presented and discussed for four languages (English, Polish, Czech, and German) across various datasets, demonstrating the effectiveness of the combined strategy.


title: Performative Debias with Fair-exposure Optimization Driven by Strategic Agents in Recommender Systems

abstract: Data bias, e.g., popularity impairs the dynamics of two-sided markets within recommender systems. This overshadows the less visible but potentially intriguing long-tail items that could capture user interest. Despite the abundance of research surrounding this issue, it still poses challenges and remains a hot topic in academic circles. Along this line, in this paper, we developed a re-ranking approach in dynamic settings with fair-exposure optimization driven by strategic agents. Designed for the producer side, the execution of agents assumes content creators can modify item features based on strategic incentives to maximize their exposure. This iterative process entails an end-to-end optimization, employing differentiable ranking operators that simultaneously target accuracy and fairness. Joint objectives ensure the performance of recommendations while enhancing the visibility of tail items. We also leveraged the performativity nature of predictions to illustrate how strategic learning influences content creators to shift towards fairness efficiently, thereby incentivizing features of tail items. Through comprehensive experiments on both public and industrial datasets, we have substantiated the effectiveness and dominance of the proposed method especially on unveiling the potential of tail items.


title: Pre-Decoder Processing Functions for a DMC with Mismatched Decoding

abstract: This paper analyzes the effect of adding a pre-decoder processing function to a receiver that contains a fixed mismatched decoder at the output of a discrete memoryless channel. We study properties of the symbolwise pre-processing function and show that it is a simple yet very powerful tool which enables to obtain reliable transmission at a positive rate for almost every metric. We present lower and upper bounds on the capacity of a channel with mismatched decoding and symbolwise(scalar-to-scalar) pre-processing, and show that the optimal pre-processing function for random coding is deterministic. We also characterize achievable error exponents. Finally, we prove that a separation principle holds for vectorwise(vector-to-vector) pre-processing functions and further, that deterministic functions maximize the reliably transmitted rate in this case.


title: Towards Federated Low-Rank Adaptation with Rank-Heterogeneous Communication

abstract: Low-rank adaptation (LoRA) is an attractive alternative of adapting full weights for the federated fine-tuning of large pretrained models, which can significantly reduce the memory and communication burden. In principle, federated LoRA can provide an effective mean to allocate different resources to each client by tuning ranks for each client, which can be useful in achieving a better communication-performance tradeoff. We find, however, that the empirical performance of LoRA is highly unstable with respect to such rank-heterogeneity, severely limiting the applicability to the scenarios where it is desirable or even required to allocate nonuniform communication bandwidth to each client due to constrained total bandwidth. Our investigation reveals that the root cause of this instability is the zero-padding-based aggregation strategy adopted in conventional federated LoRA frameworks, which causes the information from high rank clients to get diluted during the aggregation process. To address this issue, we propose a new replication-based padding strategy, which allows us to better leverage the information from clients with high-quality datasets. This method ensures that valuable information from high rank clients is retained during the aggregation process, accelerating the convergence speed and enhancing the overall prediction quality of the global model.


title: Vanishing viscosity limit for the compressible Navier-Stokes equations with non-linear density dependent viscosities

abstract: In a three-dimensional bounded domain $\Omega$ we consider the compressible Navier-Stokes equations for a barotropic fluid with general non-linear density dependent viscosities and no-slip boundary conditions. A nonlinear drag term is added to the momentum equation. We establish two conditional Kato-type criteria for the convergence of the weak solutions to such a system towards the strong solution of the compressible Euler system when the viscosity coefficient and the drag term parameter tend to zero.


title: A representation-theoretical approach to higher-dimensional Lie--Hamilton systems: The symplectic Lie algebra $\mathfrak{sp}(4, \mathbb{R})$

abstract: A new procedure for the construction of higher-dimensional Lie-Hamilton systems is proposed. This method is based on techniques belonging to the representation theory of Lie algebras and their realization by vector fields. The notion of intrinsic Lie-Hamilton system is defined, and a sufficiency criterion for this property given. Novel four-dimensional Lie-Hamilton systems arising from the fundamental representation of the symplectic Lie algebra $\mathfrak{sp}(4, \mathbb{R})$ are obtained and proved to be intrinsic. Two distinguished subalgebras, the two-photon Lie algebra $\mathfrak{h}_{6}$ and the Lorentz Lie algebra $\mathfrak{so}(1,3)$, are also considered in detail. As applications, coupled time-dependent systems which generalize the Bateman oscillator and the one-dimensional Caldirola-Kanai models are constructed, as well as systems depending on a time-dependent electromagnetic field and generalized coupled oscillators. A superposition rule for these systems, exhibiting interesting symmetry properties, is obtained using the coalgebra method.


title: Free-electron coupling to surface polaritons mediated by small scatterers

abstract: The ability of surface polaritons (SPs) to enhance and manipulate light fields down to deep-subwavelength length scales enables applications in optical sensing and nonlinear optics at the nanoscale. However, the wavelength mismatch between light and SPs prevents direct optical excitation of surface-bound modes, thereby limiting the widespread development of SP-based photonics. Free electrons are a natural choice to directly excite strongly confined SPs because they can supply field components of high momentum at designated positions with subnanometer precision. Here, we theoretically explore free-electron--SP coupling mediated by small scatterers and show that low-energy electrons can efficiently excite surface modes with a maximum probability reached at an optimum surface--scatterer distance. By aligning the electron beam with a periodic array of scatterers placed near a polariton-supporting interface, in-plane Smith--Purcell emission results in the excitation of surface modes along well-defined directions. Our results support using scattering elements to excite SPs with low-energy electrons.


title: The $\Omega(2012)$ as a hadronic molecule

abstract: Recently, a new excited baryon state, $\Omega(2012)$, was observed in the invariant mass spectra of $K^-\Xi^0$ and $K^0_S \Xi^-$ by the Belle Collaboration. This state has a narrow width ($\sim 6$ MeV) compared to other baryon states with a similar mass. In this paper, we provide a mini-review on the $\Omega(2012)$ state from the molecular perspective, where it appears to be a dynamically generated state with spin-parity $3/2^-$ from the coupled-channels interactions of the $\bar{K} \Xi(1530)$ and $\eta \Omega$ in $s$-wave and $\bar{K} \Xi$ in $d$-wave. Additionally, alternative explanations for the $\Omega(2012)$ resonance are also discussed.


title: The Power of Counting Steps in Quantitative Games

abstract: We study deterministic games of infinite duration played on graphs and focus on the strategy complexity of quantitative objectives. Such games are known to admit optimal memoryless strategies over finite graphs, but require infinite-memory strategies in general over infinite graphs. We provide new lower and upper bounds for the strategy complexity of mean-payoff and total-payoff objectives over infinite graphs, focusing on whether step-counter strategies (sometimes called Markov strategies) suffice to implement winning strategies. In particular, we show that over finitely branching arenas, three variants of limsup mean-payoff and total-payoff objectives admit winning strategies that are based either on a step counter or on a step counter and an additional bit of memory. Conversely, we show that for certain liminf total-payoff objectives, strategies resorting to a step counter and finite memory are not sufficient. For step-counter strategies, this settles the case of all classical quantitative objectives up to the second level of the Borel hierarchy.


title: TRIP: Trainable Region-of-Interest Prediction for Hardware-Efficient Neuromorphic Processing on Event-based Vision

abstract: Neuromorphic processors are well-suited for efficiently handling sparse events from event-based cameras. However, they face significant challenges in the growth of computing demand and hardware costs as the input resolution increases. This paper proposes the Trainable Region-of-Interest Prediction (TRIP), the first hardware-efficient hard attention framework for event-based vision processing on a neuromorphic processor. Our TRIP framework actively produces low-resolution Region-of-Interest (ROIs) for efficient and accurate classification. The framework exploits sparse events' inherent low information density to reduce the overhead of ROI prediction. We introduced extensive hardware-aware optimizations for TRIP and implemented the hardware-optimized algorithm on the SENECA neuromorphic processor. We utilized multiple event-based classification datasets for evaluation. Our approach achieves state-of-the-art accuracies in all datasets and produces reasonable ROIs with varying locations and sizes. On the DvsGesture dataset, our solution requires 46x less computation than the state-of-the-art while achieving higher accuracy. Furthermore, TRIP enables more than 2x latency and energy improvements on the SENECA neuromorphic processor compared to the conventional solution.


title: MedCare: Advancing Medical LLMs through Decoupling Clinical Alignment and Knowledge Aggregation

abstract: Large language models (LLMs) have shown substantial progress in natural language understanding and generation, proving valuable especially in the medical field. Despite advancements, challenges persist due to the complexity and diversity inherent in medical tasks, which can be categorized as knowledge-intensive tasks and alignment-required tasks. Previous approaches either ignore the latter task or focus on a minority of tasks and hence lose generalization. To address these drawbacks, we propose a progressive fine-tuning pipeline. This pipeline employs a Knowledge Aggregator and a Noise aggregator to encode diverse knowledge in the first stage and filter out detrimental information. In the second stage, we drop the Noise Aggregator to avoid the interference of suboptimal representation and leverage an additional alignment module optimized towards an orthogonal direction to the knowledge space to mitigate knowledge forgetting. Based on this two-stage paradigm, we proposed a Medical LLM through decoupling Clinical Alignment and Knowledge Aggregation (MedCare), which is designed to achieve state-of-the-art (SOTA) performance on over 20 medical tasks, as well as SOTA results on specific medical alignment tasks. Various model sizes of MedCare (1.8B, 7B, 14B) all demonstrate significant improvements over existing models with similar model sizes.


title: A global proof of the homological excess intersection formula

abstract: We provide a novel proof of the homological excess intersection formula for local complete intersections. The novelty is that the proof makes use of global morphisms comparing the intersections to a self intersection.


title: Universal behaviour of majority bootstrap percolation on high-dimensional geometric graphs

abstract: Majority bootstrap percolation is a monotone cellular automata that can be thought of as a model of infection spreading in networks. Starting with an initially infected set, new vertices become infected once more than half of their neighbours are infected. The average case behaviour of this process was studied on the $n$-dimensional hypercube by Balogh, Bollob\'{a}s and Morris, who showed that there is a phase transition as the typical density of the initially infected set increases: For small enough densities the spread of infection is typically local, whereas for large enough densities typically the whole graph eventually becomes infected. Perhaps surprisingly, they showed that the critical window in which this phase transition occurs is bounded away from $1/2$, and they gave bounds on its width on a finer scale. In this paper we consider the majority bootstrap percolation process on a class of high-dimensional geometric graphs which includes many of the graph families on which percolation processes are typically considered, such as grids, tori and Hamming graphs, as well as other well-studied families of graphs such as (bipartite) Kneser graphs, including the odd graph and the middle layer graph. We show similar quantitative behaviour in terms of the location and width of the critical window for the majority bootstrap percolation process on this class of graphs.


title: Anatomically and mechanically conforming patient-specific spinal fusion cages designed by full-scale topology optimization

abstract: Cage subsidence after instrumented lumbar spinal fusion surgery remains a significant cause of treatment failure, specifically for posterior or transforaminal lumbar interbody fusion. Recent advancements in computational techniques and additive manufacturing, have enabled the development of patient-specific implants and implant optimization to specific functional targets. This study aimed to introduce a novel full-scale topology optimization formulation that takes the structural response of the adjacent bone structures into account in the optimization process. The formulation includes maximum and minimum principal strain constraints that lower strain concentrations in the adjacent vertebrae. This optimization approach resulted in anatomically and mechanically conforming spinal fusion cages. Subsidence risk was quantified in a commercial finite element solver for off-the-shelf, anatomically conforming and the optimized cages, in two representative patients. We demonstrated that the anatomically and mechanically conforming cages reduced subsidence risk by 91% compared to an off-the-shelf implant with the same footprint for a patient with normal bone quality and 54% for a patient with osteopenia. Prototypes of the optimized cage were additively manufactured and mechanically tested to evaluate the manufacturability and integrity of the design and to validate the finite element model.


title: Environmental Variation or Instrumental Drift? A Probabilistic Approach to Gas Sensor Drift Modeling and Evaluation

abstract: Drift is a significant issue that undermines the reliability of gas sensors. This paper introduces a probabilistic model to distinguish between environmental variation and instrumental drift, using low-cost non-dispersive infrared (NDIR) CO2 sensors as a case study. Data from a long-term field experiment is analyzed to evaluate both sensor performance and environmental changes over time. Our approach employs importance sampling to isolate instrumental drift from environmental variation, providing a more accurate assessment of sensor performance. The results show that failing to account for environmental variation can significantly affect the evaluation of sensor drift, leading to improper calibration processes.


title: New asymptotically (Anti)-de Sitter black holes in (super)gravity

abstract: We use the duality between gravitational dynamics and fluids living on dynamical surfaces carrying multiple charges, known as the blackfold approach, to perturbativaly construct new asymptotically global (Anti)-de Sitter multi-spinning, non-extremal, multi-charged black holes in theories of higher-dimensional gravity minimally coupled to a dilaton and higher-form gauge fields in spacetime dimensions $D\ge5$, and new asymptotically AdS$_{l}\times S^{m}$ black holes in type IIB and eleven-dimensional supergravity. These solutions include the generalisation of the Kerr-Newman solution to (A)dS carrying either electric or string charge, generalisations of black rings to higher-dimensions with $\mathbb{S}^p\times \mathbb{S}^{n+1}$ horizon topology, static de Sitter solutions carrying arbitrary $q$-brane charge, as well as various asymptotically AdS$_{l}\times S^{m}$ multi-charged and multi-spinning black hole solutions, some of which correspond to novel thermal states in $\mathcal{N}=4$ Super-Yang-Mills theory.


title: BricksRL: A Platform for Democratizing Robotics and Reinforcement Learning Research and Education with LEGO

abstract: We present BricksRL, a platform designed to democratize access to robotics for reinforcement learning research and education. BricksRL facilitates the creation, design, and training of custom LEGO robots in the real world by interfacing them with the TorchRL library for reinforcement learning agents. The integration of TorchRL with the LEGO hubs, via Bluetooth bidirectional communication, enables state-of-the-art reinforcement learning training on GPUs for a wide variety of LEGO builds. This offers a flexible and cost-efficient approach for scaling and also provides a robust infrastructure for robot-environment-algorithm communication. We present various experiments across tasks and robot configurations, providing built plans and training results. Furthermore, we demonstrate that inexpensive LEGO robots can be trained end-to-end in the real world to achieve simple tasks, with training times typically under 120 minutes on a normal laptop. Moreover, we show how users can extend the capabilities, exemplified by the successful integration of non-LEGO sensors. By enhancing accessibility to both robotics and reinforcement learning, BricksRL establishes a strong foundation for democratized robotic learning in research and educational settings.


title: A Novel Deflation Approach for Topology Optimization and Application for Optimization of Bipolar Plates of Electrolysis Cells

abstract: Topology optimization problems usually feature multiple local minimizers. To guarantee convergence to local minimizers that perform best globally or to find local solutions that are desirable for practical applications due to easy manufacturability or aesthetic designs, it is important to compute multiple local minimizers of topology optimization problems. Existing methods typically rely on Newton-type solvers during the optimization process, which makes them unsuitable for sensitivity-based topology optimization. In this paper, we introduce a novel deflation approach to systematically find multiple local minimizers of general topology optimization problems. The approach is based on a penalization of previously found local solutions in the objective. We validate our approach on the so-called two-pipes five-holes example. Finally, we introduce a model for the topology optimization of bipolar plates of hydrogen electrolysis cells and demonstrate that our deflation approach enables the discovery of novel designs for such plates.


title: Synthesis pathways to thin films of stable layered nitrides

abstract: One of the grand challenges of materials chemistry is the selective synthesis of metastable materials away from equilibrium. Thin film deposition methods with rapid condensation of vapor precursors can readily synthesize metastable phases, but they often struggle to yield the thermodynamic ground state. How can thermodynamically-stable structures for practical applications be grown using kinetically-limited synthesis methods? Here, we reveal a synthesis pathway to thermodynamically-stable ordered layered ternary nitride materials, and we explain why disordered metastable intermediate phases tend to form in the first place. We show that starting from atomically dispersed vapor precursors leads to a 3D long-range disordered MgMoN2 thin film polymorph product, with a layered short-range order that has a low-energy transformation barrier to the layered 2D-like stable structure. We extend this synthesis approach to ScTaN2, MgWN2 and MgTa2N3, opening a door to synthesis of other layered nitride thin films with unique semiconducting and quantum properties.


title: A look at the high energy aspects of the supernova remnant G309.8+00.0 with eROSITA and Fermi-LAT

abstract: Supernova remnant (SNR) detection along the Galactic plane poses a number of challenges. The SNR G309.8+00.0 lies exactly on the Galactic plane, with its center coinciding with galactic latitude (b)=0 deg. In this paper we report the first detection of the SNR G309.8+00.0 in X-rays and $\gamma$ rays, using stacked data from the first four consecutive extended ROentgen Survey Imaging Telescope Array (eROSITA) -- on board the Russian-German Spektrum Roentgen Gamma (SRG) -- all-sky surveys (eRASS:4) and $\sim15.5$ yr of Pass 8 data recorded from Fermi-LAT, respectively. The SNR appears to have an elliptical shape of 0.43 x 0.32 deg in size in both radio synchrotron and X-ray data. The SNR's emission exhibits a shell-like morphology and good spatial correlation in both energy bands. The X-ray emission was solely detected in the 1-2 keV energy band (subject to strong absorption at soft X-rays) and the spectral analysis results of eRASS:4 data present a purely thermal SNR with a high absorption column density $3.1_{-0.5}^{+0.7}\cdot10^{22}~\mathrm{cm^{-2}}$ and a temperature of $0.34\pm0.1$ keV. In combination with optical extinction data, the absorption column density values derived from the remnant's spectral analysis support a remnant's distance greater than 6 kpc, rather than a 3.12 kpc distance as reported in the literature, and yield an age of $1-3.5\cdot10^5$ yr. Employing $\sim15.5$ yr of Fermi-LAT $\gamma$-ray data at and around the remnant's vicinity, we confirm the detection of the to-date unidentified 4FGL J1349.5-6206c source that can either be modeled as a single source or a conglomerate of multiple distinct source components and we argue that the SNR G309.8+00.0 likely represents at least a significant portion (if not all) of the emission from the 4FGL J1349.5-6206c $\gamma$-ray source.


title: Neural Networks for ID Gap Orbit Distortion Compensation in PETRA III

abstract: Undulators are used in storage rings to produce extremely brilliant synchrotron radiation. In the ideal case, a perfectly tuned undulator always has a first and second field integrals equal to zero. But, in practice, field integral changes during gap movements can never be avoided for real-life devices. As they significantly impact the circulating electron beam, there is the need to routinely compensate such effects. Deep Neural Networks can be used to predict the distortion in the closed orbit induced by the undulator gap variations on the circulating electron beam. In this contribution several current state-of-the-art deep learning algorithms were trained on measurements from PETRA~III. The different architecture performances are then compared to identify the best model for the gap-induced distortion compensation.


title: Emergence of Topological Bimerons in Monolayer CrSBr

abstract: The rich and fascinating physics of topological spin textures in van der Waals two-dimensional magnets has motivated recent growing interests, though a comprehensive understanding remains elusive. Here, in atomistic simulations on monolayer CrSBr, we find two magnetic phases emerging under non-equilibrium conditions at distinct temperatures, a standard ferromagnetic transition Tc and a lower temperature T*. Moreover, the real-space analysis of the spin texture reveals the emergence of metastable topological bimeron defects below T*, showing an algebraic-like decaying spin-spin correlation function. The Dzyaloshinskii-Moriya interaction, induced by the local site asymmetry in the centrosymmetric CrSBr monolayer, is proved to be the origin of the bimerons formation. Furthermore, the increasing bimerons density upon increasing the cooling rate follows a Kibble-Zurek behavior, suggesting a handle to drive and control topological bimerons below T*. Our results put forward CrSBr as an important candidate for the investigation of the dynamical behavior of bimerons in vdW magnets.


title: Comparison of the origin of Short Gamma ray Bursts with or without extended emission

abstract: The merger of compact binary stars produces short gamma-ray bursts (sGRBs), involving channels such as neutron star - neutron star (BNS) and neutron star - black hole (NS-BH). The association between sGRB 170817A and gravitational wave GW 170817 provides reliable evidence for the BNS channel. The spatial distribution and merger rate differ between BNS mergers and NS-BH mergers. Some speculations suggest that sGRBs with extended emission (EE) may represent another distinct population. We compared the offset distributions of these two types of samples and found that they follow the same distribution. Utilizing non-parametric methods, we investigated the origin of these burst types in terms of their formation rate. We examined the luminosity function and formation rate of sGRBs without any assuming. The luminosity function can be described as $\psi(L_{0}) \propto L_{0}^{-0.09 \pm 0.01}$ for $L_{0} < L_0^b$ ($\psi(L_{0}) \propto L_{0}^{-0.57 \pm 0.02}$ for $L_{0} > L_0^b$) for standard sGRBs and $\psi(L_{0}) \propto L_{0}^{-0.11 \pm 0.004}$ for $L_{0} < L_0^b$ ($\psi(L_{0}) \propto L_{0}^{-0.61 \pm 0.01}$ for $L_{0} > L_0^b$) for sGRBs with EE. The formation rate is characterized as $\rho(z) \propto (1 + z)^{-4.21 \pm 0.22}$ for $z < 0.8$ and $\rho(z) \propto (1 + z)^{-0.22 \pm 0.74}$ for $0.8 < z < 3$ for standard sGRBs, while for sGRBs with EE, it is $\rho(z) \propto (1 + z)^{-4.30 \pm 0.13}$ for $z < 0.8$ and $\rho(z) \propto (1 + z)^{-0.33 \pm 0.66}$ for $0.8 < z < 3$. Based on these findings, we suggest that there is no significant difference in the progenitor stars of sGRBs with and without EE, considering the spatial offset and formation rate perspectives.


title: Totally ramified subfields of $p$-algebras over discrete valued fields with imperfect residue

abstract: Let $K$ be a complete discrete valued field of characteristic $p$ with residue $k$ which is not necessarily perfect. We prove the Conjecture in \cite{cs} that a $p$-algebra over $K$ contains a totally ramified cyclic maximal subfield if it contains a totally ramified purely inseparable maximal subfield provided $k$ satisfies some conditions on its $p$-rank.


title: Multi-solitons of one-dimensional Boussinesq equation

abstract: The existence of multi-speed solitary waves for the one-dimensional good Boussinesq equation with a power nonlinearity is proven. These solutions are shown to behave at large times as a pair of scalar solitary waves traveling at different speeds. Both subcritical and supercritical cases are treated. The proof is based on the construction of approximations of the multi-speed solitary waves by solving an equivalent system backward in time and using energy methods to obtain uniform estimates.


title: Evaluating and improving the predictive accuracy of mixing enthalpies and volumes in disordered alloys from universal pre-trained machine learning potentials

abstract: The advent of machine learning in materials science opens the way for exciting and ambitious simulations of large systems and long time scales with the accuracy of ab-initio calculations. Recently, several pre-trained universal machine learned interatomic potentials (UPMLIPs) have been published, i.e., potentials distributed with a single set of weights trained to target systems across a very wide range of chemistries and atomic arrangements. These potentials raise the hope of reducing the computational cost and methodological complexity of performing simulations compared to models that require for-purpose training. However, the application of these models needs critical evaluation to assess their usability across material types and properties. In this work, we investigate the application of the following UPMLIPs: MACE, CHGNET, and M3GNET to the context of alloy theory. We calculate the mixing enthalpies and volumes of 21 binary alloy systems and compare the results with DFT calculations to assess the performance of these potentials over different properties and types of materials. We find that small relative energies necessary to correctly predict mixing energies are generally not reproduced by these methods with sufficient accuracy to describe correct mixing behaviors. However, the performance can be significantly improved by supplementing the training data with relevant training data. The potentials can also be used to partially accelerate these calculations by replacing the ab-initio structural relaxation step.


title: Using iterated local alignment to aggregate GPS trajectories into a traffic flow map

abstract: Desire line maps are widely deployed for traffic flow analysis by virtue of their ease of interpretation and computation. They can be considered to be simplified traffic flow maps, whereas the computational challenges in aggregating small scale traffic flows prevent the wider dissemination of high resolution flow maps. GPS trajectories are a promising data source to solve this challenging problem. The solution begins with the alignment (or map matching) of the GPS trajectories to the road network. However even the state-of-the-art map matching APIs produce sub-optimal results with small misalignments. While these misalignments are negligible for large scale flow aggregation in desire line maps, they pose substantial obstacles for small scale flow aggregation in high resolution maps. To remove these remaining misalignments, we introduce innovative local alignment algorithms, where we infer road segments to serve as local reference segments, and proceed to align nearby road segments to them. With each local alignment iteration, the misalignments of the GPS trajectories with each other and with the road network are reduced, and so converge closer to a minimal flow map. By analysing a set of empirical GPS trajectories collected in Hannover, Germany, we confirm that our minimal flow map has high levels of spatial resolution, accuracy and coverage.


title: GUP corrected black holes with cloud of string

abstract: We investigate shadows, deflection angle, quasinormal modes (QNMs), and sparsity of Hawking radiation of the Schwarzschild string cloud black hole's solution after applying quantum corrections required by the Generalised Uncertainty Principle (GUP). First, we explore the shadow's behaviour in the presence of a string cloud using three alternative GUP frameworks: linear quadratic GUP (LQGUP), quadratic GUP (QGUP), and linear GUP. We then used the weak field limit approach to determine the effect of the string cloud and GUP parameters on the light deflection angle, with computation based on the Gauss-Bonnet theorem. Next, to compute the quasinormal modes of Schwarzschild string clouds incorporating quantum correction with GUP, we determine the effective potentials generated by perturbing scalar, electromagnetic and fermionic fields, using the sixth-order WKB approach in conjunction with the appropriate numerical analysis. Our investigation indicates that string and linear GUP parameters have distinct and different effects on QNMs. We find that the greybody factor increases due to the presence of string cloud while the linear GUP parameter shows the opposite. We then examine the radiation spectrum and sparsity in the GUP corrected black hole with the cloud of string framework, which provides additional information about the thermal radiation released by black holes. Finally, our inquiries reveal that the influence of the string parameter and the quadratic GUP parameter on various astrophysical observables is comparable, however the impact of the linear GUP parameter is opposite.


title: A Hybrid Approach to Event Reconstruction for Atmospheric Cherenkov Telescopes Combining Machine Learning and Likelihood Fitting

abstract: The imaging atmospheric Cherenkov technique provides potentially the highest angular resolution achievable in astronomy at energies above the X-ray waveband. High-resolution measurements provide the key to progress on many of the major questions in high-energy astrophysics, including the sites of particle acceleration to PeV energies. The potential of the next-generation CTA observatory in this regard can be realised with the help of improved algorithms for the reconstruction of the air-shower direction and energy. Hybrid methods combining likelihood-fitting techniques with neural networks represent a particularly promising approach and have recently been applied to the reconstruction of astrophysical neutrinos. Here, we present the FreePACT algorithm, a hybrid reconstruction method for IACTs. In this, making use of the neural ratio estimation technique from the field of likelihood-free inference, the analytical likelihood used in traditional image likelihood fitting is replaced by a neural network that approximates the charge probability density function for each pixel in the camera. The performance of this algorithm is demonstrated using simulations of the planned CTA southern array. For this setup, FreePACT provides significant performance improvements over analytical likelihood techniques, with improvements in angular and energy resolution of 25% or more over a wide energy range and an angular resolution as low as 40 arcseconds at energies above 50 TeV for observations at 20 degrees zenith angle. It also yields more accurate estimations of the uncertainties on the reconstructed parameters and speeds up the reconstruction compared to analytical likelihood techniques while showing the same stability with respect to changes in the observation conditions. Therefore, the FreePACT method is a promising upgrade over the current state-of-the-art likelihood event reconstruction techniques.


title: WAVE: Weight Template for Adaptive Initialization of Variable-sized Models

abstract: The expansion of model parameters underscores the significance of pre-trained models; however, the constraints encountered during model deployment necessitate models of variable sizes. Consequently, the traditional pre-training and fine-tuning paradigm fails to address the initialization problem when target models are incompatible with pre-trained models. We tackle this issue from a multitasking perspective and introduce \textbf{WAVE}, which incorporates a set of shared \textbf{W}eight templates for \textbf{A}daptive initialization of \textbf{V}ariable-siz\textbf{E}d Models. During initialization, target models will initialize the corresponding weight scalers tailored to their model size, which are sufficient to learn the connection rules of weight templates based on the Kronecker product from a limited amount of data. For the construction of the weight templates, WAVE utilizes the \textit{Learngene} framework, which structurally condenses common knowledge from ancestry models into weight templates as the learngenes through knowledge distillation. This process allows the integration of pre-trained models' knowledge into structured knowledge according to the rules of weight templates. We provide a comprehensive benchmark for the learngenes, and extensive experiments demonstrate the efficacy of WAVE. The results show that WAVE achieves state-of-the-art performance when initializing models with various depth and width, and even outperforms the direct pre-training of $n$ entire models, particularly for smaller models, saving approximately $n\times$ and $5\times$ in computational and storage resources, respectively. WAVE simultaneously achieves the most efficient knowledge transfer across a series of datasets, specifically achieving an average improvement of 1.8\% and 1.2\% on 7 downstream datasets.


title: The Complexity of Intersection Graphs of Lines in Space and Circle Orders

abstract: We consider the complexity of the recognition problem for two families of combinatorial structures. A graph $G=(V,E)$ is said to be an intersection graph of lines in space if every $v\in V$ can be mapped to a straight line $\ell (v)$ in $\mathbb{R}^3$ so that $vw$ is an edge in $E$ if and only if $\ell(v)$ and $\ell(w)$ intersect. A partially ordered set $(X,\prec)$ is said to be a circle order, or a 2-space-time order, if every $x\in X$ can be mapped to a closed circular disk $C(x)$ so that $y\prec x$ if and only if $C(y)$ is contained in $C(x)$. We prove that the recognition problems for intersection graphs of lines and circle orders are both $\exists\mathbb{R}$-complete, hence polynomial-time equivalent to deciding whether a system of polynomial equalities and inequalities has a solution over the reals. The second result addresses an open problem posed by Brightwell and Luczak.


title: Chebyshev Moment Method for Regular Graphs II: Discrete Trace Formula

abstract: We establish discrete trace formulas on a regular graph to relate its spectrum and non-backtracking walks. Our approach is based on the Chebyshev-type polynomials and we refer to this treatment as Chebyshev moment method. A key fact is that Chebyshev-type polynomials form a complete orthogonal basis with respect to the Kesten-McKay distribution. Based on this method, we further apply Cauchy's integral formula for holomorphic functions to prove the pre-trace formula for all regular graphs and the trace formula for finite regular graphs. We further apply our results to study the resolvent, heat and Schr\"odinger equations, Ihara zeta functions, and combinatorial enumeration problems on regular graphs.


title: Exact worst-case convergence rates of gradient descent: a complete analysis for all constant stepsizes over nonconvex and convex functions

abstract: We consider gradient descent with constant stepsizes and derive exact worst-case convergence rates on the minimum gradient norm of the iterates. Our analysis covers all possible stepsizes and arbitrary upper/lower bounds on the curvature of the objective function, thus including convex, strongly convex and weakly convex (hypoconvex) objective functions. Unlike prior approaches, which rely solely on inequalities connecting consecutive iterations, our analysis employs inequalities involving an iterate and its two predecessors. While this complicates the proofs to some extent, it enables us to achieve, for the first time, an exact full-range analysis of gradient descent for any constant stepsizes (covering, in particular, normalized stepsizes greater than one), whereas the literature contained only conjectured rates of this type. In the nonconvex case, allowing arbitrary bounds on upper and lower curvatures extends existing partial results that are valid only for gradient Lipschitz functions (i.e., where lower and upper bounds on curvature are equal), leading to improved rates for weakly convex functions. From our exact rates, we deduce the optimal constant stepsize for gradient descent. Leveraging our analysis, we also introduce a new variant of gradient descent based on a unique, fixed sequence of variable stepsizes, demonstrating its superiority over any constant stepsize schedule.


title: ACE: A Generative Cross-Modal Retrieval Framework with Coarse-To-Fine Semantic Modeling

abstract: Generative retrieval, which has demonstrated effectiveness in text-to-text retrieval, utilizes a sequence-to-sequence model to directly generate candidate identifiers based on natural language queries. Without explicitly computing the similarity between queries and candidates, generative retrieval surpasses dual-tower models in both speed and accuracy on large-scale corpora, providing new insights for cross-modal retrieval. However, constructing identifiers for multimodal data remains an untapped problem, and the modality gap between natural language queries and multimodal candidates hinders retrieval performance due to the absence of additional encoders. To this end, we propose a pioneering generAtive Cross-modal rEtrieval framework (ACE), which is a comprehensive framework for end-to-end cross-modal retrieval based on coarse-to-fine semantic modeling. We propose combining K-Means and RQ-VAE to construct coarse and fine tokens, serving as identifiers for multimodal data. Correspondingly, we design the coarse-to-fine feature fusion strategy to efficiently align natural language queries and candidate identifiers. ACE is the first work to comprehensively demonstrate the feasibility of generative approach on text-to-image/audio/video retrieval, challenging the dominance of the embedding-based dual-tower architecture. Extensive experiments show that ACE achieves state-of-the-art performance in cross-modal retrieval and outperforms the strong baselines on Recall@1 by 15.27% on average.


title: Emergent pair symmetries in systems with poor man's Majorana modes

abstract: Few-site Kitaev chains are promising for realizing Majorana zero modes without topological protection but fully nonlocal, which are known as poor man's Majorana modes. While several signatures have already been reported both theoretically and experimentally, it still remains unknown what is the nature of superconducting correlations in the presence of poor man's Majorana modes. In this work, we study few-site Kitaev chains and demonstrate that they host pair correlations with distinct symmetries, entirely determined by the underlying quantum numbers. In particular, we find that a two-site Kitaev chain hosts local (odd-frequency) and nonlocal (odd- and even-frequency) pair correlations, both spin polarized and highly tunable by the system parameters. Interestingly, the odd-frequency pair correlations exhibit a divergent behaviour around zero frequency when the nonlocal $p$-wave pair potential and electron tunneling are of the same order, an effect that can be controlled by the onsite energies. Since a divergent odd-frequency pairing is directly connected to the intrinsic spatial nonlocality of Majorana zero modes in topological superconductors, the divergent odd-frequency pairing here reflects the intrinsic Majorana nonlocality of poor man's Majorana modes but without any relation to topology. Our findings could help understanding the emergent pair correlations in few-site Kitaev chains.


title: Affine subgroups of the affine Coxeter group with the same Coxeter number

abstract: Affine subgroups having the same Coxeter number with the affine Coxeter groups W(An), W(Dn), and W(En) are constructed by graph folding technique. The affine groups W(Cn) and W(Bn) are obtained from the Coxeter groups W(A2n-1) and W(D2n-1) respectively. The affine groups W(E6), W(D6) and W(E8) lead to the affine groups W(F4), W(H3), and W(H4) respectively by graph folding. The latter two are the non-crystallographic groups where W(H3) plays a special role in the quasicrystallographic structures with icosahedral symmetry. A general construction of the affine dihedral subgroups is introduced, some of which, describe the existing planar quasicrystallography. In the construction of the root systems, sets of orthonormal vectors are used but a special non-orthogonal set of vectors in the formulation of the root system of W(An) is also introduced which has practical applications in the construction of the lattices An and An* and their Delone and Voronoi cells.


title: Robust and effective ab initio molecular dynamics simulations on the GPU cloud infrastructure using the Schr\"odinger Materials Science Suite

abstract: Ab initio Born-Oppenheimer molecular dynamics (AIMD) is a valuable method for simulating physico-chemical processes of complex systems, including reactive systems, and for training machine learning models and force fields. Speed and stability issues on traditional hardware preclude routine AIMD simulations for larger systems and longer timescales. We postulate that any practically useful AIMD simulation must generate a trajectory of a minimum 1000 MD steps a day on a moderate cloud resource. In this work, we implement a computing workflow that enables routine calculations at this throughput and demonstrate results for several non-trivial atomistic dynamical systems. In particular, we have employed the GPU implementation of the Quantum ESPRESSO code which we will show increases AIMD productivity compared to the CPU version. In order to take advantage of transient servers (which are more cost and energy effective compared to the stable servers), we have implemented automatic restart/continuation of the AIMD runs within the Schr\"odinger Materials Science Suite. Finally, to reduce simulation size and thus reduce compute time when modeling surfaces, we have implemented a wall potential constraint. Our benchmarks using several reactive systems (lithium anode surface/solvent interface, hydrogen diffusion in an iron grain boundary) show a significant speed up when running on a GPU-enabled transient server using our updated implementation.


title: Nanosecond Laser Annealing: impact on superconducting Silicon on Insulator epilayers

abstract: We present superconducting monocrystalline Silicon On Insulator thin 33 nm epilayers. They are obtained by nanosecond laser annealing under ultra-high vacuum on 300 mm wafers heavily pre-implantated with boron ($2.5\times \,10^{16}\, at/cm^2$, 3 keV). Superconductivity is discussed in relation to the structural, electrical and material properties, a step towards the integration of ultra-doped superconducting Si at large scale. In particular, we highlight the effect of the nanosecond laser annealing energy and the impact of multiple laser anneals. Increasing the energy leads to a linear increase of the layer thickness, and to the increase of the superconducting critical temperature $T_c$ from zero ($<35\, mK$) to $0.5\,K$. This value is comparable to superconducting Si layers realised by Gas Immersion Laser Doping where the dopants are incorporated without introducing the deep defects associated to implantation. Superconductivity only appears when the annealed depth is larger than the initial amorphous layer induced by the boron implantation. The number of subsequent anneals results in a more homogeneous doping with reduced amount of structural defects and increased conductivity. The quantitative analysis of $T_c$ concludes on a superconducting/ non superconducting bilayer, with an extremely low resistance interface. This highlights the possibility to couple efficiently superconducting Si to Si channels.


title: Making Tax Smart: Feasibility of Distributed Ledger Technology for building tax compliance functionality to Central Bank Digital Currency

abstract: The latest advancements in Distributed Ledger Technology (DLT), and payment architectures such as the UK's New Payments Architecture, present opportunities for leveraging the hidden informational value and intelligence within payments. In this paper, we present Smart Money, an infrastructure capability for a Central Bank Digital Currency (CBDC) which enables real-time Value Added Tax split payments, oversight, controlled access and smart policy implementation. This capability is implemented as a prototype, called Making Tax Smart (MTS), which is based on the open source R3 Corda framework. The results presented herein confirm that it is feasible to build a MTS capability which is scalable and co-exists with the current payment systems. Smart Money CBDC has the potential to mobilise payments data in order to transform the role of money from a blunt instrument to a government policy sensor and actuator without disrupting the existing money system. DLT, smart contracts and programmable money have a crucial role to play with benefits for government departments, the economy and society as a whole.


title: Benchmarking Mental State Representations in Language Models

abstract: While numerous works have assessed the generative performance of language models (LMs) on tasks requiring Theory of Mind reasoning, research into the models' internal representation of mental states remains limited. Recent work has used probing to demonstrate that LMs can represent beliefs of themselves and others. However, these claims are accompanied by limited evaluation, making it difficult to assess how mental state representations are affected by model design and training choices. We report an extensive benchmark with various LM types with different model sizes, fine-tuning approaches, and prompt designs to study the robustness of mental state representations and memorisation issues within the probes. Our results show that the quality of models' internal representations of the beliefs of others increases with model size and, more crucially, with fine-tuning. We are the first to study how prompt variations impact probing performance on theory of mind tasks. We demonstrate that models' representations are sensitive to prompt variations, even when such variations should be beneficial. Finally, we complement previous activation editing experiments on Theory of Mind tasks and show that it is possible to improve models' reasoning performance by steering their activations without the need to train any probe.


title: Lusztig's Jordan decomposition and a finite field instance of relative Langlands duality

abstract: Lusztig \cite{L5,L6} gave a parametrization for $\rm{Irr}(G^F)$, where $G$ is a reductive algebraic group defined over $\mathbb{F}_q$, with Frobenius map $F$. This parametrization is known as Lusztig's Jordan decomposition or Lusztig correspondence. However, there is not a canonical choice of Lusztig correspondence. In this paper, we consider classical groups. We pick a canonical choice of Lusztig correspondence which is compatible with parabolic induction and is compatible with theta correspondence. This result extends Pan's result in \cite{P3}. As an application, we give a refinement of the results of the finite Gan-Gross-Prasad problem in \cite{Wang1} and prove a duality between Theta correspondence and finite Gan-Gross-Prasad problem, which can be regarded as a finite field instance of relative Langlands duality of Ben-Zvi-Sakellaridis-Venkatesh \cite{BZSV}.


title: Percolation renormalization group analysis of confinement in $\mathbb{Z}_2$ lattice gauge theories

abstract: The analytical study of confinement in lattice gauge theories (LGTs) remains a difficult task to this day. Taking a geometric perspective on confinement, we develop a real-space renormalization group (RG) formalism for $\mathbb{Z}_2$ LGTs using percolation probability as a confinement order parameter. The RG flow we analyze is constituted by both the percolation probability and the coupling parameters. We consider a classical $\mathbb{Z}_2$ LGT in two dimensions, with matter and thermal fluctuations, and analytically derive the confinement phase diagram. We find good agreement with numerical and exact benchmark results and confirm that a finite matter density enforces confinement at $T<\infty$ in the model we consider. Our RG scheme enables future analytical studies of $\mathbb{Z}_2$ LGTs with matter and quantum fluctuations and beyond.

categories: cond-mat.stat-mech cond-mat.str-el hep-lat quant-ph


title: Optimal DC-link Voltage from Weight and Loss Perspective for eVTOLs

abstract: Electric vertical takeoff and landing (eVTOL) aircraft are emerging as a modern transportation solution aimed at reducing urban traffic congestion and improving the carbon footprint. The power architecture in eVTOLs is defined by the dc bus formed by the battery packs and the power converter used to drive eVTOL motors. A high dc bus voltage is preferred for the power architecture since it can reduce the weight of power cables for a given power rating. However, the impact of high dc bus voltage on the efficiency of the drivetrain power converter must be considered, since reduced efficiency leads to poor battery pack utilization. In this paper, a systematic optimization study is performed considering SiC-based inverter for the drivetrain power converter. Optimal value of dc bus voltage is determined considering the flight profile of eVTOLs. A power converter topology is proposed that can provide optimal performance and enhance the lifetime of the batteries along with providing better monitoring, diagnostics and protection. The optimization strategy is validated experimentally, demonstrating the proposed power architecture's ability to maximize efficiency while enhancing the safety of the battery energy storage system in eVTOLs.


title: Preserving Node Distinctness in Graph Autoencoders via Similarity Distillation

abstract: Graph autoencoders (GAEs), as a kind of generative self-supervised learning approach, have shown great potential in recent years. GAEs typically rely on distance-based criteria, such as mean-square-error (MSE), to reconstruct the input graph. However, relying solely on a single reconstruction criterion may lead to a loss of distinctiveness in the reconstructed graph, causing nodes to collapse into similar representations and resulting in sub-optimal performance. To address this issue, we have developed a simple yet effective strategy to preserve the necessary distinctness in the reconstructed graph. Inspired by the knowledge distillation technique, we found that the dual encoder-decoder architecture of GAEs can be viewed as a teacher-student relationship. Therefore, we propose transferring the knowledge of distinctness from the raw graph to the reconstructed graph, achieved through a simple KL constraint. Specifically, we compute pairwise node similarity scores in the raw graph and reconstructed graph. During the training process, the KL constraint is optimized alongside the reconstruction criterion. We conducted extensive experiments across three types of graph tasks, demonstrating the effectiveness and generality of our strategy. This indicates that the proposed approach can be employed as a plug-and-play method to avoid vague reconstructions and enhance overall performance.


title: Enhancing Explainability of Knowledge Learning Paths: Causal Knowledge Networks

abstract: A reliable knowledge structure is a prerequisite for building effective adaptive learning systems and intelligent tutoring systems. Pursuing an explainable and trustworthy knowledge structure, we propose a method for constructing causal knowledge networks. This approach leverages Bayesian networks as a foundation and incorporates causal relationship analysis to derive a causal network. Additionally, we introduce a dependable knowledge-learning path recommendation technique built upon this framework, improving teaching and learning quality while maintaining transparency in the decision-making process.


title: Entropy-Based Decoding for Retrieval-Augmented Large Language Models

abstract: Augmenting Large Language Models (LLMs) with retrieved external knowledge has proven effective for improving the factual accuracy of generated responses. Despite their success, retrieval-augmented LLMs still face the distractibility issue, where the generated responses are negatively influenced by noise from both external and internal knowledge sources. In this paper, we introduce a novel, training-free decoding method guided by entropy considerations to mitigate this issue. Our approach utilizes entropy-based document-parallel ensemble decoding to prioritize low-entropy distributions from retrieved documents, thereby enhancing the extraction of relevant information of context. Additionally, it incorporates a contrastive decoding mechanism that contrasts the obtained low-entropy ensemble distribution with the high-entropy distribution derived from the model's internal knowledge across layers, which ensures a greater emphasis on reliable external information. Extensive experiments on open-domain question answering datasets demonstrate the superiority of our method.


title: Tell Me Where You Are: Multimodal LLMs Meet Place Recognition

abstract: Large language models (LLMs) exhibit a variety of promising capabilities in robotics, including long-horizon planning and commonsense reasoning. However, their performance in place recognition is still underexplored. In this work, we introduce multimodal LLMs (MLLMs) to visual place recognition (VPR), where a robot must localize itself using visual observations. Our key design is to use vision-based retrieval to propose several candidates and then leverage language-based reasoning to carefully inspect each candidate for a final decision. Specifically, we leverage the robust visual features produced by off-the-shelf vision foundation models (VFMs) to obtain several candidate locations. We then prompt an MLLM to describe the differences between the current observation and each candidate in a pairwise manner, and reason about the best candidate based on these descriptions. Our results on three datasets demonstrate that integrating the general-purpose visual features from VFMs with the reasoning capabilities of MLLMs already provides an effective place recognition solution, without any VPR-specific supervised training. We believe our work can inspire new possibilities for applying and designing foundation models, i.e., VFMs, LLMs, and MLLMs, to enhance the localization and navigation of mobile robots.


title: Singular multipliers on multiscale Zygmund sets

abstract: Given an Orlicz space $ L^2 \subseteq X \subseteq L^1$ on $[0,1]$, with submultiplicative Young function ${\mathrm{Y}_X}$, we fully characterize the closed null sets $\Xi$ of the real line with the property that H\"ormander-Mihlin or Marcinkiewicz multiplier operators $\mathrm{T}_m$ with singularities on $\Xi$ obey weak-type endpoint modular bounds on $X$ of the type \[ \left|\left\{x\in \mathbb R : |\mathrm{T}_m f(x)| >\lambda\right\}\right| \leq C \int_{\mathbb R} \mathrm{Y}_X \left(\frac{|f|}{\lambda}\right), \qquad \forall \lambda>0. \] These sets $\Xi$ are exactly those enjoying a scale invariant version of Zygmund's $(L\sqrt{\log L},{L^2})$ improving inequality with $X$ in place of the former space, which is termed multiscale Zygmund property. Our methods actually yield sparse and quantitative weighted estimates for the Fourier multipliers $\mathrm{T}_m$ and for the corresponding square functions. In particular, our framework covers the case of singular sets $\Xi$ of finite lacunary order and thus leads to modular and quantitative weighted versions of the classical endpoint theorems of Tao and Wright for Marcinkiewicz multipliers. Moreover, we obtain a pointwise sparse bound for the Marcinkiewicz square function answering a recent conjecture of Lerner. On the other hand, examples of non-lacunary sets enjoying the multiscale Zygmund property for each $X=L^p$, $1<p\leq 2$ are also covered. The main new ingredient in the proofs is a multi-frequency, multi-scale projection lemma based on Gabor expansion, and possessing independent interest.


title: Spin torque driven electron paramagnetic resonance of a single spin in a pentacene molecule

abstract: Control over quantum systems is typically achieved by time-dependent electric or magnetic fields. Alternatively, electronic spins can be controlled by spin-polarized currents. Here we demonstrate coherent driving of a single spin by a radiofrequency spin-polarized current injected from the tip of a scanning tunneling microscope into an organic molecule. With the excitation of electron paramagnetic resonance, we established dynamic control of single spins by spin torque using a local electric current. In addition our work highlights the dissipative action of the spin-transfer torque, in contrast to the nondissipative action of the magnetic field, which allows for the manipulation of individual spins based on controlled decoherence.


title: On the consistency of hyper-parameter selection in value-based deep reinforcement learning

abstract: Deep reinforcement learning (deep RL) has achieved tremendous success on various domains through a combination of algorithmic design and careful selection of hyper-parameters. Algorithmic improvements are often the result of iterative enhancements built upon prior approaches, while hyper-parameter choices are typically inherited from previous methods or fine-tuned specifically for the proposed technique. Despite their crucial impact on performance, hyper-parameter choices are frequently overshadowed by algorithmic advancements. This paper conducts an extensive empirical study focusing on the reliability of hyper-parameter selection for value-based deep reinforcement learning agents, including the introduction of a new score to quantify the consistency and reliability of various hyper-parameters. Our findings not only help establish which hyper-parameters are most critical to tune, but also help clarify which tunings remain consistent across different training regimes.


title: Joint spectral radius and forbidden products

abstract: We address the problem of finite products that attain the joint spectral radius of a finite number of square matrices. Up to date the problem of existence of "forbidden products" remained open. We prove that the product $AABABABB$ (together with its circular shifts and their mirror images) never delivers the strict maximum to the joint spectral radius if we restrict consideration to pairs $\{A,B\}$ of real $2\by 2$ matrices. Under this restriction circular shifts and their mirror images constitute the class of isospectral products and hence they all have the same spectral radius for any pair $\{A,B\}$ of $2\by 2$ matrices, even complex. For pairs of complex matrices we have numerical evidence that $AABABABB$ is still a fobidden product. A couple of binary words that encode products from this isospectral class also happen to be the shortest forbidden patterns in the parametric family of double rotations.


title: Indications of superconductivities in blend of variant apatite and covellite

abstract: Through heavily doping sulfur into an apatite framework, we synthesize a new blend mainly comprising variant apatite and covellite (copper sulfide). Magnetic measurement exhibits that significant diamagnetism appears at around 260 K and drops dramatically below 30 K implying coexistence of two superconducting phases. The upper critical magnetic field is larger than 1000 Oe at 250 K. Electric measurement manifests that the current-voltage curves deviate from the normal linear lineshape suggesting the presence of zero-resistance effect, and the critical current is around 50 $\mu$A at 140 K. These exotic magnetic and electric features strongly indicate these two components, variant apatite and covellite, individually trigger two superconducting phases at near-room and low temperatures.


title: LumberChunker: Long-Form Narrative Document Segmentation

abstract: Modern NLP tasks increasingly rely on dense retrieval methods to access up-to-date and relevant contextual information. We are motivated by the premise that retrieval benefits from segments that can vary in size such that a content's semantic independence is better captured. We propose LumberChunker, a method leveraging an LLM to dynamically segment documents, which iteratively prompts the LLM to identify the point within a group of sequential passages where the content begins to shift. To evaluate our method, we introduce GutenQA, a benchmark with 3000 "needle in a haystack" type of question-answer pairs derived from 100 public domain narrative books available on Project Gutenberg. Our experiments show that LumberChunker not only outperforms the most competitive baseline by 7.37% in retrieval performance (DCG@20) but also that, when integrated into a RAG pipeline, LumberChunker proves to be more effective than other chunking methods and competitive baselines, such as the Gemini 1.5M Pro. Our Code and Data are available at https://github.com/joaodsmarques/LumberChunker


title: Examples of non-scattering inhomogeneities

abstract: We consider the scattering of waves by a penetrable inclusion embedded in some reference medium. We exhibit examples of materials and geometries for which non-scattering frequencies exist, i.e., for which at some frequencies there are incident fields which produce null scattered fields outside of the inhomogeneity. We show in particular that certain domains with corners or even cusps can support non-scattering frequencies. We relate the latter, for some inclusions, to resonance frequencies for Dirichlet or Neumann cavities. We also find situations where incident non-scattering fields solve the Helmholtz equation in a neighborhood of the inhomogeneity and not in the whole space. Finally, in relation with invisibility, we give examples of inclusions of anisotropic materials which are non-scattering for all real frequencies. We prove that corresponding material indices must have a special structure on the boundary.


title: Playing with Fire? A Mean Field Game Analysis of Fire Sales and Systemic Risk under Regulatory Capital Constraints

abstract: We study the impact of regulatory capital constraints on fire sales and financial stability in a large banking system using a mean field game model. In our model banks adjust their holdings of a risky asset via trading strategies with finite trading rate in order to maximize expected profits. Moreover, a bank is liquidated if it violates a stylized regulatory capital constraint. We assume that the drift of the asset value is affected by the average change in the position of the banks in the system. This creates strategic interaction between the trading behavior of banks and thus leads to a game. The equilibria of this game are characterized by a system of coupled PDEs. We solve this system explicitly for a test case without regulatory constraints and numerically for the regulated case. We find that capital constraints can lead to a systemic crisis where a substantial proportion of the banking system defaults simultaneously. Moreover, we discuss proposals from the literature on macroprudential regulation. In particular, we show that in our setup a systemic crisis does not arise if the banking system is sufficiently well capitalized or if improved mechanisms for the resolution of banks violating the risk capital constraints are in place.


title: Inverse variational problem for equations in the Riccati chain

abstract: The nonstandard Lagrangian representations of Ricatti and Riccati-type equations that exist in the literature cannot be obtained using Helmholtz solution of the inverse problem. In this work we consider Riccati and higher-order Riccati equations and construct their standard Lagrangian representation by using a simple variant of the Helmholtz theory. We make use of the self-adjoint form of the linear equations corresponding to odd-order equations in the Riccati chain to provide a symmetry-based approach for the solution of inverse problem. Explicit results presented for Lagrangians of the first and third-order Riccati equations show that one cannot Hamiltonize the Riccati family of equations by the traditional method used in classical mechanics.


title: Point Tree Transformer for Point Cloud Registration

abstract: Point cloud registration is a fundamental task in the fields of computer vision and robotics. Recent developments in transformer-based methods have demonstrated enhanced performance in this domain. However, the standard attention mechanism utilized in these methods often integrates many low-relevance points, thereby struggling to prioritize its attention weights on sparse yet meaningful points. This inefficiency leads to limited local structure modeling capabilities and quadratic computational complexity. To overcome these limitations, we propose the Point Tree Transformer (PTT), a novel transformer-based approach for point cloud registration that efficiently extracts comprehensive local and global features while maintaining linear computational complexity. The PTT constructs hierarchical feature trees from point clouds in a coarse-to-dense manner, and introduces a novel Point Tree Attention (PTA) mechanism, which follows the tree structure to facilitate the progressive convergence of attended regions towards salient points. Specifically, each tree layer selectively identifies a subset of key points with the highest attention scores. Subsequent layers focus attention on areas of significant relevance, derived from the child points of the selected point set. The feature extraction process additionally incorporates coarse point features that capture high-level semantic information, thus facilitating local structure modeling and the progressive integration of multiscale information. Consequently, PTA empowers the model to concentrate on crucial local structures and derive detailed local information while maintaining linear computational complexity. Extensive experiments conducted on the 3DMatch, ModelNet40, and KITTI datasets demonstrate that our method achieves superior performance over the state-of-the-art methods.


title: Enhancing LLM-Based Human-Robot Interaction with Nuances for Diversity Awareness

abstract: This paper presents a system for diversity-aware autonomous conversation leveraging the capabilities of large language models (LLMs). The system adapts to diverse populations and individuals, considering factors like background, personality, age, gender, and culture. The conversation flow is guided by the structure of the system's pre-established knowledge base, while LLMs are tasked with various functions, including generating diversity-aware sentences. Achieving diversity-awareness involves providing carefully crafted prompts to the models, incorporating comprehensive information about users, conversation history, contextual details, and specific guidelines. To assess the system's performance, we conducted both controlled and real-world experiments, measuring a wide range of performance indicators.


title: Can Large Language Models Understand DL-Lite Ontologies? An Empirical Study

abstract: Large language models (LLMs) have shown significant achievements in solving a wide range of tasks. Recently, LLMs' capability to store, retrieve and infer with symbolic knowledge has drawn a great deal of attention, showing their potential to understand structured information. However, it is not yet known whether LLMs can understand Description Logic (DL) ontologies. In this work, we empirically analyze the LLMs' capability of understanding DL-Lite ontologies covering 6 representative tasks from syntactic and semantic aspects. With extensive experiments, we demonstrate both the effectiveness and limitations of LLMs in understanding DL-Lite ontologies. We find that LLMs can understand formal syntax and model-theoretic semantics of concepts and roles. However, LLMs struggle with understanding TBox NI transitivity and handling ontologies with large ABoxes. We hope that our experiments and analyses provide more insights into LLMs and inspire to build more faithful knowledge engineering solutions.


title: First resolved stellar halo kinematics of a MW-mass galaxy outside the Local Group: A flat counter-rotating halo in NGC 4945

abstract: Stellar halos of galaxies, primarily formed through the accretion of smaller objects, are important to understand the hierarchical mass assembly of galaxies. However, the inner regions of stellar halos in disk galaxies are predicted to have an in-situ component that is expected to be prominent along the major axis. Kinematic information is crucial to disentangle the contribution of the in-situ component from the accreted stellar halos. The low surface brightness of stellar halos makes it inaccessible with traditional integrated light spectroscopy. In this work, using a novel technique, we study the kinematics of the stellar halo of the edge-on galaxy NGC 4945. We couple new deep Multi Unit Spectroscopic Explorer spectroscopic observations with existing Hubble Space Telescope imaging data to spectroscopically measure the line-of-sight (LOS) heliocentric velocity and velocity dispersion in two fields at a galactocentric distance of 12.2 kpc (outer disk field) and 34.6 kpc (stellar halo field) along NGC 4945 major axis, by stacking individual spectra of red giant branch and asymptotic giant branch stars. We obtain a LOS velocity and dispersion of 673+/-11 km/s and 73+/-14 km/s, respectively, for the outer disk field. This is consistent with the mean HI velocity of the disk at that distance. For the halo field we obtain a LOS velocity and dispersion of 519+/-12 km/s and 42+/-22 km/s. The halo fields' velocity measurement is within ~40 km/s from the systemic LOS velocity of NGC 4945, which is 563 km/s, suggesting that its stellar halo at 34.6 kpc along the major axis is counter-rotating and is of likely accretion origin. This provides the first ever kinematic measurement of the stellar halo of a Milky Way-mass galaxy outside the Local Group from its resolved stellar population, and establishes a powerful technique for measuring the velocity field of the stellar halos of nearby galaxies.


title: Retrieval-style In-Context Learning for Few-shot Hierarchical Text Classification

abstract: Hierarchical text classification (HTC) is an important task with broad applications, while few-shot HTC has gained increasing interest recently. While in-context learning (ICL) with large language models (LLMs) has achieved significant success in few-shot learning, it is not as effective for HTC because of the expansive hierarchical label sets and extremely-ambiguous labels. In this work, we introduce the first ICL-based framework with LLM for few-shot HTC. We exploit a retrieval database to identify relevant demonstrations, and an iterative policy to manage multi-layer hierarchical labels. Particularly, we equip the retrieval database with HTC label-aware representations for the input texts, which is achieved by continual training on a pretrained language model with masked language modeling (MLM), layer-wise classification (CLS, specifically for HTC), and a novel divergent contrastive learning (DCL, mainly for adjacent semantically-similar labels) objective. Experimental results on three benchmark datasets demonstrate superior performance of our method, and we can achieve state-of-the-art results in few-shot HTC.


title: Disce aut Deficere: Evaluating LLMs Proficiency on the INVALSI Italian Benchmark

abstract: Recent advancements in Large Language Models (LLMs) have significantly enhanced their ability to generate and manipulate human language, highlighting their potential across various applications. Evaluating LLMs in languages other than English is crucial for ensuring their linguistic versatility, cultural relevance, and applicability in diverse global contexts, thus broadening their usability and effectiveness. We tackle this challenge by introducing a structured benchmark using the INVALSI tests, a set of well-established assessments designed to measure educational competencies across Italy. Our study makes three primary contributions: Firstly, we adapt the INVALSI benchmark for automated LLM evaluation, which involves rigorous adaptation of the test format to suit automated processing while retaining the essence of the original tests. Secondly, we provide a detailed assessment of current LLMs, offering a crucial reference point for the academic community. Finally, we visually compare the performance of these models against human results. Additionally, researchers are invited to submit their models for ongoing evaluation, ensuring the benchmark remains a current and valuable resource.


title: MedMNIST-C: Comprehensive benchmark and improved classifier robustness by simulating realistic image corruptions

abstract: The integration of neural-network-based systems into clinical practice is limited by challenges related to domain generalization and robustness. The computer vision community established benchmarks such as ImageNet-C as a fundamental prerequisite to measure progress towards those challenges. Similar datasets are largely absent in the medical imaging community which lacks a comprehensive benchmark that spans across imaging modalities and applications. To address this gap, we create and open-source MedMNIST-C, a benchmark dataset based on the MedMNIST+ collection covering 12 datasets and 9 imaging modalities. We simulate task and modality-specific image corruptions of varying severity to comprehensively evaluate the robustness of established algorithms against real-world artifacts and distribution shifts. We further provide quantitative evidence that our simple-to-use artificial corruptions allow for highly performant, lightweight data augmentation to enhance model robustness. Unlike traditional, generic augmentation strategies, our approach leverages domain knowledge, exhibiting significantly higher robustness when compared to widely adopted methods. By introducing MedMNIST-C and open-sourcing the corresponding library allowing for targeted data augmentations, we contribute to the development of increasingly robust methods tailored to the challenges of medical imaging. The code is available at https://github.com/francescodisalvo05/medmnistc-api}{github.com/francescodisalvo05/medmnistc-api .