title: YOLOv10: Real-Time End-to-End Object Detection

abstract: Over the past years, YOLOs have emerged as the predominant paradigm in the field of real-time object detection owing to their effective balance between computational cost and detection performance. Researchers have explored the architectural designs, optimization objectives, data augmentation strategies, and others for YOLOs, achieving notable progress. However, the reliance on the non-maximum suppression (NMS) for post-processing hampers the end-to-end deployment of YOLOs and adversely impacts the inference latency. Besides, the design of various components in YOLOs lacks the comprehensive and thorough inspection, resulting in noticeable computational redundancy and limiting the model's capability. It renders the suboptimal efficiency, along with considerable potential for performance improvements. In this work, we aim to further advance the performance-efficiency boundary of YOLOs from both the post-processing and model architecture. To this end, we first present the consistent dual assignments for NMS-free training of YOLOs, which brings competitive performance and low inference latency simultaneously. Moreover, we introduce the holistic efficiency-accuracy driven model design strategy for YOLOs. We comprehensively optimize various components of YOLOs from both efficiency and accuracy perspectives, which greatly reduces the computational overhead and enhances the capability. The outcome of our effort is a new generation of YOLO series for real-time end-to-end object detection, dubbed YOLOv10. Extensive experiments show that YOLOv10 achieves state-of-the-art performance and efficiency across various model scales. For example, our YOLOv10-S is 1.8$\times$ faster than RT-DETR-R18 under the similar AP on COCO, meanwhile enjoying 2.8$\times$ smaller number of parameters and FLOPs. Compared with YOLOv9-C, YOLOv10-B has 46\% less latency and 25\% fewer parameters for the same performance.


title: Semi-Discrete Optimal Transport: Nearly Minimax Estimation With Stochastic Gradient Descent and Adaptive Entropic Regularization

abstract: Optimal Transport (OT) based distances are powerful tools for machine learning to compare probability measures and manipulate them using OT maps. In this field, a setting of interest is semi-discrete OT, where the source measure $\mu$ is continuous, while the target $\nu$ is discrete. Recent works have shown that the minimax rate for the OT map is $\mathcal{O}(t^{-1/2})$ when using $t$ i.i.d. subsamples from each measure (two-sample setting). An open question is whether a better convergence rate can be achieved when the full information of the discrete measure $\nu$ is known (one-sample setting). In this work, we answer positively to this question by (i) proving an $\mathcal{O}(t^{-1})$ lower bound rate for the OT map, using the similarity between Laguerre cells estimation and density support estimation, and (ii) proposing a Stochastic Gradient Descent (SGD) algorithm with adaptive entropic regularization and averaging acceleration. To nearly achieve the desired fast rate, characteristic of non-regular parametric problems, we design an entropic regularization scheme decreasing with the number of samples. Another key step in our algorithm consists of using a projection step that permits to leverage the local strong convexity of the regularized OT problem. Our convergence analysis integrates online convex optimization and stochastic gradient techniques, complemented by the specificities of the OT semi-dual. Moreover, while being as computationally and memory efficient as vanilla SGD, our algorithm achieves the unusual fast rates of our theory in numerical experiments.


title: Detecting slow magnetization relaxation via magnetotransport measurements based on the current-reversal method

abstract: Slow magnetization relaxation processes are an important time-dependent property of many magnetic materials. We show that magnetotransport measurements based on a well-established current-reversal method can be utilized to implement a simple and robust screening scheme for such relaxation processes. We demonstrate our approach considering the anomalous Hall effect in a Pt/Co/AlOx trilayer model system, and then explore relaxation in {\tau} -MnAl films. Compared to magnetotransport experiments based on ac lock-in techniques, we find that the dc current-reversal method is particulary sensitive to relaxation processes with relaxation time scales on the order of seconds, comparable to the current-reversal measurement time scales.


title: A Power Tower Control: A New Sliding Mode Control

abstract: A control based power tower function at order 2 is proposed in this paper. This leads to a new sliding mode control, which allows employing backstepping technique that combines both guaranteed and finite time convergence. The proposed control is applied to a double integrator subject to perturbation $d$. Both guaranteed and finite convergence are ensured by the controller when $d$ is considered constant and bounded, without knowing its upper bound. For the case, when $d$ is variable and bounded with its upper bound known, only a finite time convergence is obtained. Simulation results are given to show the well founded of the proposed novel control.


title: Fermat Principle and weak deflection angle from Lindstedt-Poincare method

abstract: The Fermat principle is used for the analysis of light propagation in the metric of a black hole. It is shown how to apply the Lindstedt-Poincare method of solving perturbatively the nonlinear oscillations to the description of light trajectories in weak deflection regime.


title: Epistemic EFX Allocations Exist for Monotone Valuations

abstract: We study the fundamental problem of fairly dividing a set of indivisible items among agents with (general) monotone valuations. The notion of envy-freeness up to any item (EFX) is considered to be one of the most fascinating fairness concepts in this line of work. Unfortunately, despite significant efforts, existence of EFX allocations is a major open problem in fair division, thereby making the study of approximations and relaxations of EFX a natural line of research. Recently, Caragiannis et al. introduced a promising relaxation of EFX, called epistemic EFX (EEFX). We say an allocation to be EEFX if, for every agent, it is possible to shuffle the items in the remaining bundles so that she becomes "EFX-satisfied". Caragiannis et al. prove existence and polynomial-time computability of EEFX allocations for additive valuations. A natural question asks what happens when we consider valuations more general than additive? We address this important open question and answer it affirmatively by establishing the existence of EEFX allocations for an arbitrary number of agents with general monotone valuations. To the best of our knowledge, EEFX is the only known relaxation of EFX (beside EF1) to have such strong existential guarantees. Furthermore, we complement our existential result by proving computational and information-theoretic lower bounds. We prove that even for an arbitrary number of (more than one) agents with identical submodular valuations, it is PLS-hard to compute EEFX allocations and it requires exponentially-many value queries to do so.


title: On resonant energy sets for Hamiltonian systems with reflections

abstract: We study two uncoupled oscillators, horizontal and vertical, residing in rectilinear polygons (with only vertical and horizontal sides) and impacting elastically from their boundary. The main purpose of the article is to analyze the occurrence of resonance in such systems, depending on the shape of the analytical potentials that determine the oscillators. We define resonant energy levels; roughly speaking, these are levels for which the resonance phenomenon occurs more often than rarely. We focus on unimodal analytic potentials with the minimum at zero. The most important result of the work describes the size of the set of resonance levels in the form of the following trichotomy: it is mostly empty or is one-element or is large, i.e. non-empty and open. We also indicate which classes of potentials each of the three possibilities can occur in. From this point of view, the last case (strongly resonant) is the most interesting. Then, the potentials belong to a special class of potentials, denoted by $\mathcal{SP}$, which seems unknown in the literature. The presented results appear to be new, even in the simplest case, when the uncoupled oscillators are not trapped in any set.


title: Foams with flat connections and algebraic K-theory

abstract: This paper proposes a connection between algebraic K-theory and foam cobordisms, where foams are stratified manifolds with singularities of a prescribed form. We consider $n$-dimensional foams equipped with a flat bundle of finitely-generated projective $R$-modules over each facet of the foam, together with gluing conditions along the subfoam of singular points. In a suitable sense which will become clear, a vertex (or the smallest stratum) of an $n$-dimensional foam replaces an $(n+1)$-simplex with a total ordering of vertices. We show that the first K-theory group of a ring $R$ can be identified with the cobordism group of decorated 1-foams embedded in the plane. A similar relation between the $n$-th algebraic K-theory group of a ring $R$ and the cobordism group of decorated $n$-foams embedded in $\mathbb{R}^{n+1}$ is expected for $n>1$. An analogous correspondence is proposed for arbitrary exact categories. Modifying the embedding and other conditions on the foams may lead to new flavors of K-theory groups.


title: Ultra-cold atoms quantum tunneling through single and double optical barriers

abstract: We realize textbook experiments on Bose-Einstein condensate tunnelling through thin repulsive potential barriers. In particular, we demonstrate atom tunnelling though a single optical barrier in the quantum scattering regime where the De Broglie wavelength of the atoms is larger than the barrier width. Such a beam splitter can be used for atom interferometry and we study the case of two barriers creating an atomic Fabry-P{\'e}rot cavity. Technically, the velocity of the atoms is reduced thanks to the use of a 39K Bose-Einstein condensate with no interactions. The potential barriers are created optically and their width is tunable thanks to the use of a digital micro-mirror device. In addition, our scattering experiments enable in-situ characterization of the optical aberrations of the barrier optical system.


title: Segformer++: Efficient Token-Merging Strategies for High-Resolution Semantic Segmentation

abstract: Utilizing transformer architectures for semantic segmentation of high-resolution images is hindered by the attention's quadratic computational complexity in the number of tokens. A solution to this challenge involves decreasing the number of tokens through token merging, which has exhibited remarkable enhancements in inference speed, training efficiency, and memory utilization for image classification tasks. In this paper, we explore various token merging strategies within the framework of the Segformer architecture and perform experiments on multiple semantic segmentation and human pose estimation datasets. Notably, without model re-training, we, for example, achieve an inference acceleration of 61% on the Cityscapes dataset while maintaining the mIoU performance. Consequently, this paper facilitates the deployment of transformer-based architectures on resource-constrained devices and in real-time applications.


title: Neural Collapse versus Low-rank Bias: Is Deep Neural Collapse Really Optimal?

abstract: Deep neural networks (DNNs) exhibit a surprising structure in their final layer known as neural collapse (NC), and a growing body of works has currently investigated the propagation of neural collapse to earlier layers of DNNs -- a phenomenon called deep neural collapse (DNC). However, existing theoretical results are restricted to special cases: linear models, only two layers or binary classification. In contrast, we focus on non-linear models of arbitrary depth in multi-class classification and reveal a surprising qualitative shift. As soon as we go beyond two layers or two classes, DNC stops being optimal for the deep unconstrained features model (DUFM) -- the standard theoretical framework for the analysis of collapse. The main culprit is a low-rank bias of multi-layer regularization schemes: this bias leads to optimal solutions of even lower rank than the neural collapse. We support our theoretical findings with experiments on both DUFM and real data, which show the emergence of the low-rank structure in the solution found by gradient descent.


title: Generalization of Hamiltonian algorithms

abstract: The paper proves generalization results for a class of stochastic learning algorithms. The method applies whenever the algorithm generates an absolutely continuous distribution relative to some a-priori measure and the Radon Nikodym derivative has subgaussian concentration. Applications are bounds for the Gibbs algorithm and randomizations of stable deterministic algorithms as well as PAC-Bayesian bounds with data-dependent priors.


title: Which Information Matters? Dissecting Human-written Multi-document Summaries with Partial Information Decomposition

abstract: Understanding the nature of high-quality summaries is crucial to further improve the performance of multi-document summarization. We propose an approach to characterize human-written summaries using partial information decomposition, which decomposes the mutual information provided by all source documents into union, redundancy, synergy, and unique information. Our empirical analysis on different MDS datasets shows that there is a direct dependency between the number of sources and their contribution to the summary.


title: Adaptive sampling with PIXL on the Mars Perseverance rover

abstract: Planetary rovers can use onboard data analysis to adapt their measurement plan on the fly, improving the science value of data collected between commands from Earth. This paper describes the implementation of an adaptive sampling algorithm used by PIXL, the X-ray fluorescence spectrometer of the Mars 2020 Perseverance rover. PIXL is deployed using the rover arm to measure X-ray spectra of rocks with a scan density of several thousand points over an area of typically 5 x 7 mm. The adaptive sampling algorithm is programmed to recognize points of interest and to increase the signal-to-noise ratio at those locations by performing longer integrations. Two approaches are used to formulate the sampling rules based on past quantification data: 1) Expressions that isolate particular regions within a ternary compositional diagram, and 2) Machine learning rules that threshold for a high weight percent of particular compounds. The design of the rulesets are outlined and the performance of the algorithm is quantified using measurements from the surface of Mars. To our knowledge, PIXL's adaptive sampling represents the first autonomous decision-making based on real-time compositional analysis by a spacecraft on the surface of another planet.


title: SolNet: Open-source deep learning models for photovoltaic power forecasting across the globe

abstract: Deep learning models have gained increasing prominence in recent years in the field of solar pho-tovoltaic (PV) forecasting. One drawback of these models is that they require a lot of high-quality data to perform well. This is often infeasible in practice, due to poor measurement infrastructure in legacy systems and the rapid build-up of new solar systems across the world. This paper proposes SolNet: a novel, general-purpose, multivariate solar power forecaster, which addresses these challenges by using a two-step forecasting pipeline which incorporates transfer learning from abundant synthetic data generated from PVGIS, before fine-tuning on observational data. Using actual production data from hundreds of sites in the Netherlands, Australia and Belgium, we show that SolNet improves forecasting performance over data-scarce settings as well as baseline models. We find transfer learning benefits to be the strongest when only limited observational data is available. At the same time we provide several guidelines and considerations for transfer learning practitioners, as our results show that weather data, seasonal patterns, amount of synthetic data and possible mis-specification in source location, can have a major impact on the results. The SolNet models created in this way are applicable for any land-based solar photovoltaic system across the planet where simulated and observed data can be combined to obtain improved forecasting capabilities.


title: Poisson Variational Autoencoder

abstract: Variational autoencoders (VAE) employ Bayesian inference to interpret sensory inputs, mirroring processes that occur in primate vision across both ventral (Higgins et al., 2021) and dorsal (Vafaii et al., 2023) pathways. Despite their success, traditional VAEs rely on continuous latent variables, which deviates sharply from the discrete nature of biological neurons. Here, we developed the Poisson VAE (P-VAE), a novel architecture that combines principles of predictive coding with a VAE that encodes inputs into discrete spike counts. Combining Poisson-distributed latent variables with predictive coding introduces a metabolic cost term in the model loss function, suggesting a relationship with sparse coding which we verify empirically. Additionally, we analyze the geometry of learned representations, contrasting the P-VAE to alternative VAE models. We find that the P-VAEencodes its inputs in relatively higher dimensions, facilitating linear separability of categories in a downstream classification task with a much better (5x) sample efficiency. Our work provides an interpretable computational framework to study brain-like sensory processing and paves the way for a deeper understanding of perception as an inferential process.


title: Time Cell Inspired Temporal Codebook in Spiking Neural Networks for Enhanced Image Generation

abstract: This paper presents a novel approach leveraging Spiking Neural Networks (SNNs) to construct a Variational Quantized Autoencoder (VQ-VAE) with a temporal codebook inspired by hippocampal time cells. This design captures and utilizes temporal dependencies, significantly enhancing the generative capabilities of SNNs. Neuroscientific research has identified hippocampal "time cells" that fire sequentially during temporally structured experiences. Our temporal codebook emulates this behavior by triggering the activation of time cell populations based on similarity measures as input stimuli pass through it. We conducted extensive experiments on standard benchmark datasets, including MNIST, FashionMNIST, CIFAR10, CelebA, and downsampled LSUN Bedroom, to validate our model's performance. Furthermore, we evaluated the effectiveness of the temporal codebook on neuromorphic datasets NMNIST and DVS-CIFAR10, and demonstrated the model's capability with high-resolution datasets such as CelebA-HQ, LSUN Bedroom, and LSUN Church. The experimental results indicate that our method consistently outperforms existing SNN-based generative models across multiple datasets, achieving state-of-the-art performance. Notably, our approach excels in generating high-resolution and temporally consistent data, underscoring the crucial role of temporal information in SNN-based generative modeling.


title: MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenes

abstract: While controllable generative models for images and videos have achieved remarkable success, high-quality models for 3D scenes, particularly in unbounded scenarios like autonomous driving, remain underdeveloped due to high data acquisition costs. In this paper, we introduce MagicDrive3D, a novel pipeline for controllable 3D street scene generation that supports multi-condition control, including BEV maps, 3D objects, and text descriptions. Unlike previous methods that reconstruct before training the generative models, MagicDrive3D first trains a video generation model and then reconstructs from the generated data. This innovative approach enables easily controllable generation and static scene acquisition, resulting in high-quality scene reconstruction. To address the minor errors in generated content, we propose deformable Gaussian splatting with monocular depth initialization and appearance modeling to manage exposure discrepancies across viewpoints. Validated on the nuScenes dataset, MagicDrive3D generates diverse, high-quality 3D driving scenes that support any-view rendering and enhance downstream tasks like BEV segmentation. Our results demonstrate the framework's superior performance, showcasing its transformative potential for autonomous driving simulation and beyond.


title: Groups elementarily equivalent to the classical matrix groups

abstract: In this paper we describe all groups that are first-order (elementarily) equivalent to the classical matrix groups such as $GL_n(F), SL_n(F)$ and $T_n(F)$ over a field $F$ provided $n \geq 3$.


title: LiteVAE: Lightweight and Efficient Variational Autoencoders for Latent Diffusion Models

abstract: Advances in latent diffusion models (LDMs) have revolutionized high-resolution image generation, but the design space of the autoencoder that is central to these systems remains underexplored. In this paper, we introduce LiteVAE, a family of autoencoders for LDMs that leverage the 2D discrete wavelet transform to enhance scalability and computational efficiency over standard variational autoencoders (VAEs) with no sacrifice in output quality. We also investigate the training methodologies and the decoder architecture of LiteVAE and propose several enhancements that improve the training dynamics and reconstruction quality. Our base LiteVAE model matches the quality of the established VAEs in current LDMs with a six-fold reduction in encoder parameters, leading to faster training and lower GPU memory requirements, while our larger model outperforms VAEs of comparable complexity across all evaluated metrics (rFID, LPIPS, PSNR, and SSIM).


title: SLIFER: Investigating Performance and Robustness of Malware Detection Pipelines

abstract: As a result of decades of research, Windows malware detection is approached through a plethora of techniques. However, there is an ongoing mismatch between academia -- which pursues an optimal performances in terms of detection rate and low false alarms -- and the requirements of real-world scenarios. In particular, academia focuses on combining static and dynamic analysis within a single or ensemble of models, falling into several pitfalls like (i) firing dynamic analysis without considering the computational burden it requires; (ii) discarding impossible-to-analyse samples; and (iii) analysing robustness against adversarial attacks without considering that malware detectors are complemented with more non-machine-learning components. Thus, in this paper we propose SLIFER, a novel Windows malware detection pipeline sequentially leveraging both static and dynamic analysis, interrupting computations as soon as one module triggers an alarm, requiring dynamic analysis only when needed. Contrary to the state of the art, we investigate how to deal with samples resistance to analysis, showing how much they impact performances, concluding that it is better to flag them as legitimate to not drastically increase false alarms. Lastly, we perform a robustness evaluation of SLIFER leveraging content-injections attacks, and we show that, counter-intuitively, attacks are blocked more by YARA rules than dynamic analysis due to byte artifacts created while optimizing the adversarial strategy.


title: Theory of Generalized Landau Levels and Implication for non-Abelian States

abstract: Quantum geometry is a fundamental concept to characterize the local properties of quantum states. It is recently demonstrated that saturating certain quantum geometric bounds allows a topological Chern band to share many essential features with the lowest Landau level, facilitating fractionalized phases in moir\'e flat bands. In this work, we systematically extend the consequence and universality of saturated geometric bounds to arbitrary Landau levels by introducing a set of single-particle states, which we term as ``generalized Landau levels''. These generalized Landau levels exhibit exactly quantized values of integrated trace of quantum metric determined by their corresponding Landau level indices, regardless of the nonuniformity of their quantum geometric quantities. We derive all geometric quantities for individual and multiple generalized Landau levels, discuss their relations, and understand them in light of the theory of holomorphic curves and moving frames. We further propose a model by superposing few generalized Landau levels which is supposed to capture a large portion of the single-particle Hilbert space of a generic Chern band analogous to the first Landau level. Using this model, we employ exact diagonalization to identify a single-particle geometric criterion for permitting the non-Abelian Moore-Read phase, which is potentially useful for future engineering of moir\'e materials and beyond. We use a double twisted bilayer graphene model with only adjacent layer hopping term to show the existence of first generalized Landau level type narrow band and zero-field Moore-Read state at the second magic angle which serves as a promising starting point for more detailed future studies. We expect that generalized Landau levels will serve as a systematic tool for analyzing topological Chern bands and fractionalized phases therein.

categories: cond-mat.mes-hall cond-mat.quant-gas cond-mat.str-el hep-th math-ph math.MP


title: Scalable Visual State Space Model with Fractal Scanning

abstract: Foundational models have significantly advanced in natural language processing (NLP) and computer vision (CV), with the Transformer architecture becoming a standard backbone. However, the Transformer's quadratic complexity poses challenges for handling longer sequences and higher resolution images. To address this challenge, State Space Models (SSMs) like Mamba have emerged as efficient alternatives, initially matching Transformer performance in NLP tasks and later surpassing Vision Transformers (ViTs) in various CV tasks. To improve the performance of SSMs, one crucial aspect is effective serialization of image patches. Existing methods, relying on linear scanning curves, often fail to capture complex spatial relationships and produce repetitive patterns, leading to biases. To address these limitations, we propose using fractal scanning curves for patch serialization. Fractal curves maintain high spatial proximity and adapt to different image resolutions, avoiding redundancy and enhancing SSMs' ability to model complex patterns accurately. We validate our method in image classification, detection, and segmentation tasks, and the superior performance validates its effectiveness.


title: A logic of judgmental existence and its relation to proof irrelevance

abstract: We introduce a simple natural deduction system for reasoning with judgments of the form "there exists a proof of $\varphi$" to explore the notion of judgmental existence following Martin-L\"{o}f's methodology of distinguishing between judgments and propositions. In this system, the existential judgment can be internalized into a modal notion of propositional existence that is closely related to truncation modality, a key tool for obtaining proof irrelevance, and lax modality. We provide a computational interpretation in the style of the Curry-Howard isomorphism for the existence modality and show that the corresponding system has some desirable properties such as strong normalization or subject reduction.


title: Quantifying Multivariate Graph Dependencies: Theory and Estimation for Multiplex Graphs

abstract: Multiplex graphs, characterised by their layered structure, exhibit informative interdependencies within layers that are crucial for understanding complex network dynamics. Quantifying the interaction and shared information among these layers is challenging due to the non-Euclidean structure of graphs. Our paper introduces a comprehensive theory of multivariate information measures for multiplex graphs. We introduce graphon mutual information for pairs of graphs and expand this to graphon interaction information for three or more graphs, including their conditional variants. We then define graphon total correlation and graphon dual total correlation, along with their conditional forms, and introduce graphon $O-$information. We discuss and quantify the concepts of synergy and redundancy in graphs for the first time, introduce consistent nonparametric estimators for these multivariate graphon information--theoretic measures, and provide their convergence rates. We also conduct a simulation study to illustrate our theoretical findings and demonstrate the relationship between the introduced measures, multiplex graph structure, and higher--order interdependecies. Real-world applications further show the utility of our estimators in revealing shared information and dependence structures in real-world multiplex graphs. This work not only answers fundamental questions about information sharing across multiple graphs but also sets the stage for advanced pattern analysis in complex networks.

categories: math.ST cs.IT math.CO math.IT math.PR stat.TH


title: Resonance coupling in spiral arms: Patterns for flat rotation curve

abstract: To address questions about the physical nature and origin of spiral arms in galaxies, it is necessary to measure their dynamical properties, such as the angular speed, $\Omega_p$, or the corotation radius. Observations suggest that galaxies may contain several independent spiral patterns simultaneously. It was shown that so-called non-linear resonance coupling plays an important role in such systems. We aim to identify cases of independent spiral patterns for galaxies with a flat rotation curve and to investigate what relative pattern velocities they might have for all possible cases of coupling between the main resonances. We solved equations for the main resonance positions (1:1, 2:1, 4:1) and estimated the ratio $\varpi$ of the corotation radii for two subsequent patterns. For six close galaxies with flat rotation curves, we collected the measurements of the corotation radii in the literature, using at least three different methods in each case for credibility. We found at least two independent spiral patterns for each galaxy and measured the $\varpi$ ratios. For three cases, we obtained $\varpi>3$, indicating that it would be difficult to fit two or even more spiral patterns in the disc. These ratios have been used to derive the wind-up time for spirals, estimated to be several galactic rotations. We find that three pairs of coupling cases, including those that have been vastly acknowledged in galaxies, namely, $OLR_{in}=CR_{out} \& CR_{in}=IUHR_{out}$, have very close $\varpi$ ratios; hence, they ought to be found simultaneously, as observed. We find a strongly confirmed apparent resonance coupling for six galaxies and we show that the observed $\varpi$ is in agreement with theory. In two of them, we identified a previously unreported form of simultaneous coupling, namely, $OLR_{in}=OUHR_{out} \& OUHR_{in}=CR_{out}$. This result was also predicted from the proximity of $\varpi$.


title: Novel semi-explicit symplectic schemes for nonseparable stochastic Hamiltonian systems

abstract: In this manuscript, we propose efficient stochastic semi-explicit symplectic schemes tailored for nonseparable stochastic Hamiltonian systems (SHSs). These semi-explicit symplectic schemes are constructed by introducing augmented Hamiltonians and using symmetric projection. In the case of the artificial restraint in augmented Hamiltonians being zero, the proposed schemes also preserve quadratic invariants, making them suitable for developing semi-explicit charge-preserved multi-symplectic schemes for stochastic cubic Schr\"odinger equations with multiplicative noise. Through numerical experiments that validate theoretical results, we demonstrate that the proposed stochastic semi-explicit symplectic scheme, which features a straightforward Newton iteration solver, outperforms the traditional stochastic midpoint scheme in terms of effectiveness and accuracy.


title: Experimental observations of bifurcated power decay lengths in the near Scrape-Off Layer of tokamak plasmas

abstract: The scrape-off layer parallel heat flux decay lengths measured at ST40, a high field, low aspect ratio spherical tokamak, have been observed to bifurcate into two groups. The wide group matches closely with the scale of ion poloidal Larmour radius and follows existing H-mode scalings, while the narrow group falls up to 10 times below scalings, on the scale of ion total Larmour radius. The onset of the narrow scrape-off layer width is observed to be associated with suppressed magnetic fluctuations, suggesting reduced electromagnetic turbulence levels in the SOL.


title: RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models

abstract: Large Language Models (LLMs) have shown impressive capabilities but also a concerning tendency to hallucinate. This paper presents RefChecker, a framework that introduces claim-triplets to represent claims in LLM responses, aiming to detect fine-grained hallucinations. In RefChecker, an extractor generates claim-triplets from a response, which are then evaluated by a checker against a reference. We delineate three task settings: Zero, Noisy and Accurate Context, to reflect various real-world use cases. We curated a benchmark spanning various NLP tasks and annotated 11k claim-triplets from 2.1k responses by seven LLMs. RefChecker supports both proprietary and open-source models as the extractor and checker. Experiments demonstrate that claim-triplets enable superior hallucination detection, compared to other granularities such as response, sentence and sub-sentence level claims. RefChecker outperforms prior methods by 6.8 to 26.1 points on our benchmark and the checking results of RefChecker are strongly aligned with human judgments. This work is open sourced at https://github.com/amazon-science/RefChecker


title: A Comprehensive Overview of Large Language Models (LLMs) for Cyber Defences: Opportunities and Directions

abstract: The recent progression of Large Language Models (LLMs) has witnessed great success in the fields of data-centric applications. LLMs trained on massive textual datasets showed ability to encode not only context but also ability to provide powerful comprehension to downstream tasks. Interestingly, Generative Pre-trained Transformers utilised this ability to bring AI a step closer to human being replacement in at least datacentric applications. Such power can be leveraged to identify anomalies of cyber threats, enhance incident response, and automate routine security operations. We provide an overview for the recent activities of LLMs in cyber defence sections, as well as categorization for the cyber defence sections such as threat intelligence, vulnerability assessment, network security, privacy preserving, awareness and training, automation, and ethical guidelines. Fundamental concepts of the progression of LLMs from Transformers, Pre-trained Transformers, and GPT is presented. Next, the recent works of each section is surveyed with the related strengths and weaknesses. A special section about the challenges and directions of LLMs in cyber security is provided. Finally, possible future research directions for benefiting from LLMs in cyber security is discussed.


title: MoGU: A Framework for Enhancing Safety of Open-Sourced LLMs While Preserving Their Usability

abstract: Large Language Models (LLMs) are increasingly deployed in various applications. As their usage grows, concerns regarding their safety are rising, especially in maintaining harmless responses when faced with malicious instructions. Many defense strategies have been developed to enhance the safety of LLMs. However, our research finds that existing defense strategies lead LLMs to predominantly adopt a rejection-oriented stance, thereby diminishing the usability of their responses to benign instructions. To solve this problem, we introduce the MoGU framework, designed to enhance LLMs' safety while preserving their usability. Our MoGU framework transforms the base LLM into two variants: the usable LLM and the safe LLM, and further employs dynamic routing to balance their contribution. When encountering malicious instructions, the router will assign a higher weight to the safe LLM to ensure that responses are harmless. Conversely, for benign instructions, the router prioritizes the usable LLM, facilitating usable and helpful responses. On various open-sourced LLMs, we compare multiple defense strategies to verify the superiority of our MoGU framework. Besides, our analysis provides key insights into the effectiveness of MoGU and verifies that our designed routing mechanism can effectively balance the contribution of each variant by assigning weights. Our work released the safer Llama2, Vicuna, Falcon, Dolphin, and Baichuan2.


title: End-to-End User-Defined Keyword Spotting using Shifted Delta Coefficients

abstract: Identifying user-defined keywords is crucial for personalizing interactions with smart devices. Previous approaches of user-defined keyword spotting (UDKWS) have relied on short-term spectral features such as mel frequency cepstral coefficients (MFCC) to detect the spoken keyword. However, these features may face challenges in accurately identifying closely related pronunciation of audio-text pairs, due to their limited capability in capturing the temporal dynamics of the speech signal. To address this challenge, we propose to use shifted delta coefficients (SDC) which help in capturing pronunciation variability (transition between connecting phonemes) by incorporating long-term temporal information. The performance of the SDC feature is compared with various baseline features across four different datasets using a cross-attention based end-to-end system. Additionally, various configurations of SDC are explored to find the suitable temporal context for the UDKWS task. The experimental results reveal that the SDC feature outperforms the MFCC baseline feature, exhibiting an improvement of 8.32% in area under the curve (AUC) and 8.69% in terms of equal error rate (EER) on the challenging Libriphrase-hard dataset. Moreover, the proposed approach demonstrated superior performance when compared to state-of-the-art UDKWS techniques.


title: Impact of Non-Standard Unicode Characters on Security and Comprehension in Large Language Models

abstract: The advancement of large language models has significantly improved natural language processing. However, challenges such as jailbreaks (prompt injections that cause an LLM to follow instructions contrary to its intended use), hallucinations (generating incorrect or misleading information), and comprehension errors remain prevalent. In this report, we present a comparative analysis of the performance of fifteen distinct models, with each model undergoing a standardized test comprising 38 queries across three key metrics: jailbreaks, hallucinations, and comprehension errors. The models are assessed based on the total occurrences of jailbreaks, hallucinations, and comprehension errors. Our work exposes these models' inherent vulnerabilities and challenges the notion of human-level language comprehension of these models. We have empirically analysed the impact of non-standard Unicode characters on LLMs and their safeguarding mechanisms on the best-performing LLMs, including GPT-4, Gemini 1.5 Pro, LlaMA-3-70B, and Claude 3 Opus. By incorporating alphanumeric symbols from Unicode outside the standard Latin block and variants of characters in other languages, we observed a reduction in the efficacy of guardrails implemented through Reinforcement Learning Human Feedback (RLHF). Consequently, these models exhibit heightened vulnerability to content policy breaches and prompt leakage. Our study also suggests a need to incorporate non-standard Unicode text in LLM training data to enhance the capabilities of these models.


title: Investigating strangeness enhancement in jet and medium via $\phi$(1020) production in p$-$Pb collisions at $\sqrt{s_{\rm NN}}$ = 5.02 TeV

abstract: This work aims to differentiate strangeness produced from hard processes (jet-like) and softer processes (underlying event) by measuring the angular correlation between a high-momentum trigger hadron (h) acting as a jet-proxy and a produced strange hadron ($\phi(1020)$ meson). Measuring h$-\phi$ correlations at midrapidity in p$-$Pb collisions at $\sqrt{s_{\rm NN}}$ = 5.02 TeV as a function of event multiplicity provides insight into the microscopic origin of strangeness enhancement in small collision systems. The jet-like and the underlying-event-like strangeness production are investigated as a function of event multiplicity. They are also compared between a lower and higher momentum region. The evolution of the per-trigger yields within the near-side (aligned with the trigger hadron) and away-side (in the opposite direction of the trigger hadron) jet is studied separately, allowing for the characterization of two distinct jet-like production regimes. Furthermore, the h$-\phi$ correlations within the underlying event give access to a production regime dominated by soft production processes, which can be compared directly to the in-jet production. Comparisons between h$-\phi$ and dihadron correlations show that the observed strangeness enhancement is largely driven by the underlying event, where the $\phi/\mathrm{h}$ ratio is significantly larger than within the jet regions. As multiplicity increases, the fraction of the total $\phi(1020)$ yield coming from jets decreases compared to the underlying event production, leading to high-multiplicity events being dominated by the increased strangeness production from the underlying event.


title: Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Data

abstract: Gaussian processes are flexible probabilistic regression models which are widely used in statistics and machine learning. However, a drawback is their limited scalability to large data sets. To alleviate this, we consider full-scale approximations (FSAs) that combine predictive process methods and covariance tapering, thus approximating both global and local structures. We show how iterative methods can be used to reduce the computational costs for calculating likelihoods, gradients, and predictive distributions with FSAs. We introduce a novel preconditioner and show that it accelerates the conjugate gradient method's convergence speed and mitigates its sensitivity with respect to the FSA parameters and the eigenvalue structure of the original covariance matrix, and we demonstrate empirically that it outperforms a state-of-the-art pivoted Cholesky preconditioner. Further, we present a novel, accurate, and fast way to calculate predictive variances relying on stochastic estimations and iterative methods. In both simulated and real-world data experiments, we find that our proposed methodology achieves the same accuracy as Cholesky-based computations with a substantial reduction in computational time. Finally, we also compare different approaches for determining inducing points in predictive process and FSA models. All methods are implemented in a free C++ software library with high-level Python and R packages.


title: Minimum Consistent Subset in Interval Graphs and Circle Graphs

abstract: In a connected simple graph G = (V,E), each vertex of V is colored by a color from the set of colors C={c1, c2,..., c_{\alpha}}$. We take a subset S of V, such that for every vertex v in V\S, at least one vertex of the same color is present in its set of nearest neighbors in S. We refer to such a S as a consistent subset. The Minimum Consistent Subset (MCS) problem is the computation of a consistent subset of the minimum size. It is established that MCS is NP-complete for general graphs, including planar graphs. We expand our study to interval graphs and circle graphs in an attempt to gain a complete understanding of the computational complexity of the \mcs problem across various graph classes. This work introduces an (4\alpha+ 2)- approximation algorithm for MCS in interval graphs where \alpha is the number of colors in the interval graphs. Later, we show that in circle graphs, MCS is APX-hard.


title: Entrywise error bounds for low-rank approximations of kernel matrices

abstract: In this paper, we derive entrywise error bounds for low-rank approximations of kernel matrices obtained using the truncated eigen-decomposition (or singular value decomposition). While this approximation is well-known to be optimal with respect to the spectral and Frobenius norm error, little is known about the statistical behaviour of individual entries. Our error bounds fill this gap. A key technical innovation is a delocalisation result for the eigenvectors of the kernel matrix corresponding to small eigenvalues, which takes inspiration from the field of Random Matrix Theory. Finally, we validate our theory with an empirical study of a collection of synthetic and real-world datasets.


title: Spin-orbit torque-assisted detection of the canted phase of magnetization in a CoTb-based ferrimagnet

abstract: The utilization of ferrimagnets in spintronic applications purportedly offers the potential for high-speed and energy-efficient switching of magnetic states, coupled with their notable stability. This collection of characteristics is commonly observed in ferrimagnetic materials that are in close proximity to states of magnetic or angular momentum compensation. This is owing to the presence of two antiparallel ordered magnetic sublattices that exhibit differing responses to variations in temperature or composition. In the vicinity of the magnetic compensation state, an external field has the capacity to disrupt the collinearity between the sublattices, resulting in the codirectionality of the magnetic projections. The existence of the canted phase has been extensively described theoretically, but its experimental investigation remains limited. Here, a violation of antiferromagnetic ordering is detected through a change in the direction of the effective field induced by the spin-orbital torque, without altering the dominant characteristics of the ferrimagnetic structure. This effect is observed both during external heating of the sample and as a consequence of Joule heating with an increase in the transmitted current. In the examined structure of W/Co70Tb30/Ru, the canted phase region is observed at approximately room temperature and at external fields on the order of 0.1 T. Through macrospin modeling and analytical explanations, a correlation between anisotropy, interlattice exchange interaction, and the presence of the canted phase region is established.


title: Hybrid Global Causal Discovery with Local Search

abstract: Learning the unique directed acyclic graph corresponding to an unknown causal model is a challenging task. Methods based on functional causal models can identify a unique graph, but either suffer from the curse of dimensionality or impose strong parametric assumptions. To address these challenges, we propose a novel hybrid approach for global causal discovery in observational data that leverages local causal substructures. We first present a topological sorting algorithm that leverages ancestral relationships in linear structural equation models to establish a compact top-down hierarchical ordering, encoding more causal information than linear orderings produced by existing methods. We demonstrate that this approach generalizes to nonlinear settings with arbitrary noise. We then introduce a nonparametric constraint-based algorithm that prunes spurious edges by searching for local conditioning sets, achieving greater accuracy than current methods. We provide theoretical guarantees for correctness and worst-case polynomial time complexities, with empirical validation on synthetic data.


title: Improving Single Domain-Generalized Object Detection: A Focus on Diversification and Alignment

abstract: In this work, we tackle the problem of domain generalization for object detection, specifically focusing on the scenario where only a single source domain is available. We propose an effective approach that involves two key steps: diversifying the source domain and aligning detections based on class prediction confidence and localization. Firstly, we demonstrate that by carefully selecting a set of augmentations, a base detector can outperform existing methods for single domain generalization by a good margin. This highlights the importance of domain diversification in improving the performance of object detectors. Secondly, we introduce a method to align detections from multiple views, considering both classification and localization outputs. This alignment procedure leads to better generalized and well-calibrated object detector models, which are crucial for accurate decision-making in safety-critical applications. Our approach is detector-agnostic and can be seamlessly applied to both single-stage and two-stage detectors. To validate the effectiveness of our proposed methods, we conduct extensive experiments and ablations on challenging domain-shift scenarios. The results consistently demonstrate the superiority of our approach compared to existing methods. Our code and models are available at: https://github.com/msohaildanish/DivAlign


title: From Stellar Nurseries to Old Stellar Populations: A Multi-wavelength Case of NGC 1055

abstract: Given the complex nature of galaxies' interstellar medium (ISM), multi-wavelength data are required to probe the interplay among gas, dust, and stellar populations. Spiral galaxies are ideal laboratories for such a goal as they are rich in gas and dust. Using carbon monoxide (CO) along with GALEX far-ultraviolet (FUV) and Spitzer near-infrared (NIR) data we probe the correlations amongst the properties of stellar populations, gas, and dust over the disc of the spiral galaxy NGC~1055 at multiple angular resolutions, i.e. 2, 4, and 17 arcsec corresponding to a linear size of 144 pc, 288 pc, and 1.2 kpc, respectively. Our results indicate an asymmetry in the physical conditions along the galaxy's disc, i.e. the gas is slightly more extended and brighter, and molecular gas mass is higher on the disc's eastern side than the western side. All physical properties (i.e. molecular gas mass, CO line ratios, stellar mass, NIR emission) decrease from the centre going outwards in the disc with some exceptions (i.e. the extinction, FUV radiation, and the [3.6]-[4.5] colour). Our analysis indicates that the colour gets bluer (metallicity increases) halfway through the disc, then redder (metallicity decreases) going outwards further in the disc.


title: A rolling horizon heuristic approach for a multi-stage stochastic waste collection problem

abstract: In this paper we present a multi-stage stochastic optimization model to solve an inventory routing problem for recyclable waste collection. The objective is the maximization of the total expected profit of the waste collection company. The decisions are related to the selection of the bins to be visited and the corresponding routing plan in a predefined time horizon. Stochasticity in waste accumulation is modeled through scenario trees generated via conditional density estimation and dynamic stochastic approximation techniques. The proposed formulation is solved through a rolling horizon approach, providing a worst-case analysis on its performance. Extensive computational experiments are carried out on small- and large-sized instances based on real data provided by a large Portuguese waste collection company. The impact of stochasticity on waste generation is examined through stochastic measures, and the performance of the rolling horizon approach is evaluated. Some managerial insights on different configurations of the instances are finally discussed.


title: On the complexity of p-adic continued fractions of rational number

abstract: In this paper, we study the complexity of p-adic continued fractions of a rational number, which is the p-adic analogue of the theorem of Lame. We calculate the length of Browkin expansion, and the length of Schneider expansion. Also, some numerical examples have been given.


title: Population Synthesis Models Indicate a Need for Early and Ubiquitous Disk Substructures

abstract: Large mm surveys of star forming regions enable the study of entire populations of planet-forming disks and reveal correlations between their observable properties. Population studies of disks have shown that the correlation between disk size and millimeter flux could be explained either through disks with strong substructure, or alternatively by the effects of radial inward drift of growing dust particles. This study aims to constrain the parameters and initial conditions of planet-forming disks and address the question of the need for the presence of substructures in disks and, if needed, their predicted characteristics, based on the large samples of disk sizes, millimeter fluxes, and spectral indices available. We performed a population synthesis of the continuum emission of disks, exploiting a two-population model (two-pop-py), considering the influence of viscous evolution, dust growth, fragmentation, and transport varying the initial conditions of the disk and substructure to find the best match to the observed distributions. We show that the observed distributions of spectral indices, sizes, and luminosities together can be best reproduced by disks with significant substructure, namely a perturbation strong enough to be able to trap particles, and that is formed early in the evolution of the disk, that is within 0.4Myr. Agreement is reached by relatively high initial disk masses ($10^{-2.3}M_{\star}\leqslant M_{disk}\leqslant10^{-0.5}M_{\star}$) and moderate levels of turbulence ($10^{-3.5}\leqslant\alpha\leqslant 10^{-2.5}$). Other disk parameters play a weaker role. Only opacities with high absorption efficiency can reproduce the observed spectral indices. Our results extend to the whole population that substructure is likely ubiquitous, so far assessed only in individual disks and implies that most "smooth" disks hide unresolved substructure.


title: DEX: Scalable Range Indexing on Disaggregated Memory [Extended Version]

abstract: Memory disaggregation can potentially allow memory-optimized range indexes such as B+-trees to scale beyond one machine while attaining high hardware utilization and low cost. Designing scalable indexes on disaggregated memory, however, is challenging due to rudimentary caching, unprincipled offloading and excessive inconsistency among servers. This paper proposes DEX, a new scalable B+-tree for memory disaggregation. DEX includes a set of techniques to reduce remote accesses, including logical partitioning, lightweight caching and cost-aware offloading. Our evaluation shows that DEX can outperform the state-of-the-art by 1.7--56.3X, and the advantage remains under various setups, such as cache size and skewness.


title: Radial analysis and scaling of housing prices in French urban areas

abstract: Urban scaling laws summarize how urban attributes evolve with city size. Recent criticism questions notably the aggregate view of this approach, which leads to neglecting the internal structure of cities. This is all the more relevant for housing prices due to their important variations across space. Based on a dataset compiling millions of real estate transactions over the period 2017-2021, we investigate the regularities of the radial (center-periphery) profiles of housing prices across cities, with respect to their size. Results are threefold. First, they corroborate prior findings in the urban scaling literature stating that largest cities agglomerate higher housing prices. Second, we find that housing price radial profiles scale in three dimensions with the power 1/5 of city population. After rescaling, great regularities between radial profiles can be observed, although some locational amenities have a significant impact on prices. Third, it appears that our rescaled profiles approach fails to explain housing price variations in the city center across cities. In fact, prices near the city center rise much faster with city size than those in the periphery. This has strong implications for low-income households seeking homeownership, because prohibitive prices in the center may contribute to pushing them out into peripheral locations.


title: Enhanced Spatiotemporal Prediction Using Physical-guided And Frequency-enhanced Recurrent Neural Networks

abstract: Spatiotemporal prediction plays an important role in solving natural problems and processing video frames, especially in weather forecasting and human action recognition. Recent advances attempt to incorporate prior physical knowledge into the deep learning framework to estimate the unknown governing partial differential equations (PDEs), which have shown promising results in spatiotemporal prediction tasks. However, previous approaches only restrict neural network architectures or loss functions to acquire physical or PDE features, which decreases the representative capacity of a neural network. Meanwhile, the updating process of the physical state cannot be effectively estimated. To solve the above mentioned problems, this paper proposes a physical-guided neural network, which utilizes the frequency-enhanced Fourier module and moment loss to strengthen the model's ability to estimate the spatiotemporal dynamics. Furthermore, we propose an adaptive second-order Runge-Kutta method with physical constraints to model the physical states more precisely. We evaluate our model on both spatiotemporal and video prediction tasks. The experimental results show that our model outperforms state-of-the-art methods and performs best in several datasets, with a much smaller parameter count.


title: Explainable automatic industrial carbon footprint estimation from bank transaction classification using natural language processing

abstract: Concerns about the effect of greenhouse gases have motivated the development of certification protocols to quantify the industrial carbon footprint (CF). These protocols are manual, work-intensive, and expensive. All of the above have led to a shift towards automatic data-driven approaches to estimate the CF, including Machine Learning (ML) solutions. Unfortunately, the decision-making processes involved in these solutions lack transparency from the end user's point of view, who must blindly trust their outcomes compared to intelligible traditional manual approaches. In this research, manual and automatic methodologies for CF estimation were reviewed, taking into account their transparency limitations. This analysis led to the proposal of a new explainable ML solution for automatic CF calculations through bank transaction classification. Consideration should be given to the fact that no previous research has considered the explainability of bank transaction classification for this purpose. For classification, different ML models have been employed based on their promising performance in the literature, such as Support Vector Machine, Random Forest, and Recursive Neural Networks. The results obtained were in the 90 % range for accuracy, precision, and recall evaluation metrics. From their decision paths, the proposed solution estimates the CO2 emissions associated with bank transactions. The explainability methodology is based on an agnostic evaluation of the influence of the input terms extracted from the descriptions of transactions using locally interpretable models. The explainability terms were automatically validated using a similarity metric over the descriptions of the target categories. Conclusively, the explanation performance is satisfactory in terms of the proximity of the explanations to the associated activity sector descriptions.


title: SIAVC: Semi-Supervised Framework for Industrial Accident Video Classification

abstract: Semi-supervised learning suffers from the imbalance of labeled and unlabeled training data in the video surveillance scenario. In this paper, we propose a new semi-supervised learning method called SIAVC for industrial accident video classification. Specifically, we design a video augmentation module called the Super Augmentation Block (SAB). SAB adds Gaussian noise and randomly masks video frames according to historical loss on the unlabeled data for model optimization. Then, we propose a Video Cross-set Augmentation Module (VCAM) to generate diverse pseudo-label samples from the high-confidence unlabeled samples, which alleviates the mismatch of sampling experience and provides high-quality training data. Additionally, we construct a new industrial accident surveillance video dataset with frame-level annotation, namely ECA9, to evaluate our proposed method. Compared with the state-of-the-art semi-supervised learning based methods, SIAVC demonstrates outstanding video classification performance, achieving 88.76\% and 89.13\% accuracy on ECA9 and Fire Detection datasets, respectively. The source code and the constructed dataset ECA9 will be released in \url{https://github.com/AlchemyEmperor/SIAVC}.


title: Unchosen Experts Can Contribute Too: Unleashing MoE Models' Power by Self-Contrast

abstract: Mixture-of-Experts (MoE) has emerged as a prominent architecture for scaling model size while maintaining computational efficiency. In MoE, each token in the input sequence activates a different subset of experts determined by a routing mechanism. However, the unchosen experts in MoE models do not contribute to the output, potentially leading to underutilization of the model's capacity. In this work, we first conduct exploratory studies to demonstrate that increasing the number of activated experts does not necessarily improve and can even degrade the output quality. Then, we show that output distributions from an MoE model using different routing strategies substantially differ, indicating that different experts do not always act synergistically. Motivated by these findings, we propose Self-Contrast Mixture-of-Experts (SCMoE), a training-free strategy that utilizes unchosen experts in a self-contrast manner during inference. In SCMoE, the next-token probabilities are determined by contrasting the outputs from strong and weak activation using the same MoE model. Our method is conceptually simple and computationally lightweight, as it incurs minimal latency compared to greedy decoding. Experiments on several benchmarks (GSM8K, StrategyQA, MBPP and HumanEval) demonstrate that SCMoE can consistently enhance Mixtral 8x7B's reasoning capability across various domains. For example, it improves the accuracy on GSM8K from 61.79 to 66.94. Moreover, combining SCMoE with self-consistency yields additional gains, increasing major@20 accuracy from 75.59 to 78.31.


title: Prediction of cancer dynamics under treatment using Bayesian neural networks: A simulated study

abstract: Predicting cancer dynamics under treatment is challenging due to high inter-patient heterogeneity, lack of predictive biomarkers, and sparse and noisy longitudinal data. Mathematical models can summarize cancer dynamics by a few interpretable parameters per patient. Machine learning methods can then be trained to predict the model parameters from baseline covariates, but do not account for uncertainty in the parameter estimates. Instead, hierarchical Bayesian modeling can model the relationship between baseline covariates to longitudinal measurements via mechanistic parameters while accounting for uncertainty in every part of the model. The mapping from baseline covariates to model parameters can be modeled in several ways. A linear mapping simplifies inference but fails to capture nonlinear covariate effects and scale poorly for interaction modeling when the number of covariates is large. In contrast, Bayesian neural networks can potentially discover interactions between covariates automatically, but at a substantial cost in computational complexity. In this work, we develop a hierarchical Bayesian model of subpopulation dynamics that uses baseline covariate information to predict cancer dynamics under treatment, inspired by cancer dynamics in multiple myeloma (MM), where serum M protein is a well-known proxy of tumor burden. As a working example, we apply the model to a simulated dataset and compare its ability to predict M protein trajectories to a model with linear covariate effects. Our results show that the Bayesian neural network covariate effect model predicts cancer dynamics more accurately than a linear covariate effect model when covariate interactions are present. The framework can also be applied to other types of cancer or other time series prediction problems that can be described with a parametric model.


title: Closed-form estimators for an exponential family derived from likelihood equations

abstract: In this paper, we derive closed-form estimators for the parameters of some probability distributions belonging to the exponential family. A bootstrap bias-reduced version of these proposed closed-form estimators are also derived. A Monte Carlo simulation is performed for the assessment of the estimators. The results are seen to be quite favorable to the proposed bootstrap bias-reduce estimators.


title: Neutron phase filtering for separating phase- and attenuation signal in aluminium and anodic aluminium oxide

abstract: Neutron imaging has gained significant importance as a material characterisation technique and is particularly useful to visualise hydrogenous materials in objects opaque to other radiations. Particular fields of application include investigations of hydrogen in metals as well as metal corrosion, thanks to the fact that neutrons can penetrate metals better than e.g. X-rays and are at the same time highly sensitive to hydrogen. However at interfaces for example those that are prone to corrosion, refraction effects sometimes obscure the attenuation image, which is used to for hydrogen quantification. Refraction, as a differential phase effect, diverts the neutron beam away from the interface in the image which leads to intensity gain and intensity loss regions, which are superimposed to the attenuation image, thus obscuring the interface region and hindering quantitative analyses of e.g. hydrogen content in the vicinity of the interface or in an oxide layer. For corresponding effects in X-ray imaging, a phase filter approach was developed and is generally based on transport-of-intensity considerations. Here, we compare such an approach, that has been adapted to neutrons, with another simulation-based assessment using the ray-tracing software McStas. The latter appears superior and promising for future extensions which enable fitting forward models via simulations in order to separate phase and attenuation effects and thus pave the way for overcoming quantitative limitations at refracting interfaces.


title: Investigating strangeness enhancement with multiplicity in pp collisions using angular correlations

abstract: A study of strange hadron production associated with hard scattering processes and with the underlying event is conducted to investigate the origin of the enhanced production of strange hadrons in small collision systems characterised by large charged-particle multiplicities. For this purpose, the production of the single-strange meson ${\rm K^0_S}$ and the double-strange baryon $\Xi^{\pm}$ is measured, in each event, in the azimuthal direction of the highest-$p_{\rm T}$ particle (``trigger" particle), related to hard scattering processes, and in the direction transverse to it in azimuth, associated with the underlying event, in pp collisions at $\sqrt{s}=5.02$ TeV and $\sqrt{s}=13$ TeV using the ALICE detector at the LHC. The per-trigger yields of ${\rm K^0_S}$ and $\Xi^{\pm}$ are dominated by the transverse-to-leading production (i.e., in the direction transverse to the trigger particle), whose contribution relative to the toward-leading production is observed to increase with the event charged-particle multiplicity. The transverse-to-leading and the toward-leading $\Xi^{\pm}$/${\rm K^0_S}$ yield ratios increase with the multiplicity of charged particles, suggesting that strangeness enhancement with multiplicity is associated with both hard scattering processes and the underlying event. The relative production of $\Xi^{\pm}$ with respect to ${\rm K^0_S}$ is higher in transverse-to-leading processes over the whole multiplicity interval covered by the measurement. The ${\rm K}^{0}_{\rm{S}}$ and $\Xi^{\pm}$ per-trigger yields and yield ratios are compared with predictions of three different phenomenological models, namely PYTHIA 8.2 with the Monash tune, PYTHIA 8.2 with ropes and EPOS LHC. The comparison shows that none of them can quantitatively describe either the transverse-to-leading or the toward-leading yields of ${\rm K}^{0}_{\rm{S}}$ and $\Xi^{\pm}$.


title: Quasi-isotropic UV Emission in the ULX NGC~1313~X--1

abstract: A major prediction of most super-Eddington accretion theories is the presence of anisotropic emission from supercritical disks, but the degree of anisotropy and its dependency with energy remain poorly constrained observationally. A key breakthrough allowing to test such predictions was the discovery of high-excitation photoionized nebulae around Ultraluminous X-ray sources (ULXs). We present efforts to tackle the degree of anisotropy of the UV/EUV emission in super-Eddington accretion flows by studying the emission-line nebula around the archetypical ULX NGC~1313~X--1. We first take advantage of the extensive wealth of optical/near-UV and X-ray data from \textit{Hubble Space Telescope}, \textit{XMM-Newton}, \textit{Swift}-XRT and \textit{NuSTAR} observatories to perform multi-band, state-resolved spectroscopy of the source to constrain the spectral energy distribution (SED) along the line of sight. We then compare spatially-resolved \texttt{Cloudy} predictions using the observed line-of-sight SED with the nebular line ratios to assess whether the nebula `sees' the same SED as observed along the line of sight. We show that to reproduce the line ratios in the surrounding nebula, the photo-ionizing SED must be a factor $\approx 4$ dimmer in ultraviolet emission than along the line-of-sight. Such nearly-iosotropic UV emission may be attributed to the quasi-spherical emission from the wind photosphere. We also discuss the apparent dichotomy in the observational properties of emission-line nebulae around soft and hard ULXs, and suggest only differences in mass-transfer rates can account for the EUV/X-ray spectral differences, as opposed to inclination effects. Finally, our multi-band spectroscopy suggest the optical/near-UV emission is not dominated by the companion star.


title: A Brisk Estimator for the Angular Multipoles (BEAM) of the redshift space bispectrum

abstract: The anisotropy of the redshift space bispectrum depends upon the orientation of the triangles formed by three $\vec{k}$ modes with respect to the line of sight. For a triangle of fixed size ($k_1$) and shape ($\mu,t$), this orientation dependence can be quantified in terms of angular multipoles $B_l^m(k_1,\mu,t)$ which contain a wealth of cosmological information. We propose a fast and efficient FFT-based estimator that computes bispectrum multipole moments $B_l^m$ of a 3D cosmological field for all possible $l$ and $m$ (including $m\neq 0$). The time required by the estimator to compute all multipoles from a gridded data cube of volume $N_g^3$ scales as $\sim N_g^3 \log{(N_g)}$ in contrast to the direct computation technique which requires time $\sim N_g^6$. Here, we demonstrate the formalism and validate othe estimator using a simulated non-Gaussian field for which the analytical expressions for all bispectrum multipoles are known. The estimated results are found to be in good agreement with the analytical predictions for all $16$ non-zero multipoles (up to $\ell= 6, m=6$). We expect the $m \neq 0$ bispectrum multipoles to significantly enhance the information available from galaxy redshift surveys, and future redshifted 21-cm observations.


title: Quantum Mpemba Effect in Random Circuits

abstract: The essence of the Mpemba effect is that non-equilibrium systems may relax faster the further they are from their equilibrium configuration. In the quantum realm, this phenomenon arises in the dynamics of closed systems, where it is witnessed by fundamental features such as symmetry and entanglement. Here, we study the quantum Mpemba effect in charge-preserving random circuits on qudits via entanglement asymmetry, combining extensive numerical simulations and analytical mapping to a classical statistical mechanics problem. We show that the more asymmetric certain classes of initial states (tilted ferromagnets) are, the faster they restore symmetry and reach the grand-canonical ensemble. Conversely, other classes of states (tilted antiferromagnets) do not show the Mpemba effect. Our analysis is based on minimal principles -- locality, unitarity, and symmetry. Consequently, our results represent a significant advancement in clarifying the emergence of Mpemba physics in generic systems, including Hamiltonian and Floquet quantum circuits.


title: Visuo-Tactile Keypoint Correspondences for Object Manipulation

abstract: This paper presents a novel manipulation strategy that uses keypoint correspondences extracted from visuo-tactile sensor images to facilitate precise object manipulation. Our approach uses the visuo-tactile feedback to guide the robot's actions for accurate object grasping and placement, eliminating the need for post-grasp adjustments and extensive training. This method provides an improvement in deployment efficiency, addressing the challenges of manipulation tasks in environments where object locations are not predefined. We validate the effectiveness of our strategy through experiments demonstrating the extraction of keypoint correspondences and their application to real-world tasks such as block alignment and gear insertion, which require millimeter-level precision. The results show an average error margin significantly lower than that of traditional vision-based methods, which is sufficient to achieve the target tasks.


title: Towards Realistic Long-tailed Semi-supervised Learning in an Open World

abstract: Open-world long-tailed semi-supervised learning (OLSSL) has increasingly attracted attention. However, existing OLSSL algorithms generally assume that the distributions between known and novel categories are nearly identical. Against this backdrop, we construct a more \emph{Realistic Open-world Long-tailed Semi-supervised Learning} (\textbf{ROLSSL}) setting where there is no premise on the distribution relationships between known and novel categories. Furthermore, even within the known categories, the number of labeled samples is significantly smaller than that of the unlabeled samples, as acquiring valid annotations is often prohibitively costly in the real world. Under the proposed ROLSSL setting, we propose a simple yet potentially effective solution called dual-stage post-hoc logit adjustments. The proposed approach revisits the logit adjustment strategy by considering the relationships among the frequency of samples, the total number of categories, and the overall size of data. Then, it estimates the distribution of unlabeled data for both known and novel categories to dynamically readjust the corresponding predictive probabilities, effectively mitigating category bias during the learning of known and novel classes with more selective utilization of imbalanced unlabeled data. Extensive experiments on datasets such as CIFAR100 and ImageNet100 have demonstrated performance improvements of up to 50.1\%, validating the superiority of our proposed method and establishing a strong baseline for this task. For further researches, the anonymous link to the experimental code is at \href{https://github.com/heyuanpengpku/ROLSSL}{\textcolor{brightpink}{https://github.com/heyuanpengpku/ROLSSL}}


title: Identity Inference from CLIP Models using Only Textual Data

abstract: The widespread usage of large-scale multimodal models like CLIP has heightened concerns about the leakage of personally identifiable information (PII). Existing methods for identity inference in CLIP models, i.e., to detect the presence of a person's PII used for training a CLIP model, require querying the model with full PII, including textual descriptions of the person and corresponding images (e.g., the name and the face photo of the person). However, this may lead to potential privacy breach of the image, as it may have not been seen by the target model yet. Additionally, traditional membership inference attacks (MIAs) train shadow models to mimic the behaviors of the target model, which incurs high computational costs, especially for large CLIP models. To address these challenges, we propose a textual unimodal detector (TUNI) in CLIP models, a novel method for ID inference that 1) queries the target model with only text data; and 2) does not require training shadow models. Firstly, we develop a feature extraction algorithm, guided by the CLIP model, to extract features from a text description. TUNI starts with randomly generating textual gibberish that were clearly not utilized for training, and leverages their feature vectors to train a system of anomaly detectors. During inference, the feature vector of each test text is fed into the anomaly detectors to determine if the person's PII is in the training set (abnormal) or not (normal). Moreover, TUNI can be further strengthened integrating real images associated with the tested individuals, if available at the detector. Extensive experiments of TUNI across various CLIP model architectures and datasets demonstrate its superior performance over baselines, albeit with only text data.


title: Small Banach bundles and modules

abstract: We characterize those (continuously-normed) Banach bundles $\mathcal{E}\to X$ with compact Hausdorff base whose spaces $\Gamma(\mathcal{E})$ of global continuous sections are topologically finitely-generated over the function algebra $C(X)$, answering a question of I. Gogi\'c's and extending analogous work for metrizable $X$. Conditions equivalent to topological finite generation include: (a) the requirement that $\mathcal{E}$ be locally trivial and of finite type along locally closed and relatively $F_{\sigma}$ strata in a finite stratification of $X$; (b) the decomposability of arbitrary elements in $\ell^p(\Gamma(\mathcal{E}))$, $1\le p<\infty$ as sums of $\le N$ products in $\ell^p(C(X))\cdot \Gamma(\mathcal{E})$ for some fixed $N$; (c) the analogous decomposability requirement for maximal Banach-module tensor products $F\widehat{\otimes}_{C(X)}\Gamma(\mathcal{E})$ or (d) equivalently, only for $F=\ell^1(C(X))$.


title: A New Formulation for Zeroth-Order Optimization of Adversarial EXEmples in Malware Detection

abstract: Machine learning malware detectors are vulnerable to adversarial EXEmples, i.e. carefully-crafted Windows programs tailored to evade detection. Unlike other adversarial problems, attacks in this context must be functionality-preserving, a constraint which is challenging to address. As a consequence heuristic algorithms are typically used, that inject new content, either randomly-picked or harvested from legitimate programs. In this paper, we show how learning malware detectors can be cast within a zeroth-order optimization framework which allows to incorporate functionality-preserving manipulations. This permits the deployment of sound and efficient gradient-free optimization algorithms, which come with theoretical guarantees and allow for minimal hyper-parameters tuning. As a by-product, we propose and study ZEXE, a novel zero-order attack against Windows malware detection. Compared to state-of-the-art techniques, ZEXE provides drastic improvement in the evasion rate, while reducing to less than one third the size of the injected content.


title: Ghost-Stereo: GhostNet-based Cost Volume Enhancement and Aggregation for Stereo Matching Networks

abstract: Depth estimation based on stereo matching is a classic but popular computer vision problem, which has a wide range of real-world applications. Current stereo matching methods generally adopt the deep Siamese neural network architecture, and have achieved impressing performance by constructing feature matching cost volumes and using 3D convolutions for cost aggregation. However, most existing methods suffer from large number of parameters and slow running time due to the sequential use of 3D convolutions. In this paper, we propose Ghost-Stereo, a novel end-to-end stereo matching network. The feature extraction part of the network uses the GhostNet to form a U-shaped structure. The core of Ghost-Stereo is a GhostNet feature-based cost volume enhancement (Ghost-CVE) module and a GhostNet-inspired lightweight cost volume aggregation (Ghost-CVA) module. For the Ghost-CVE part, cost volumes are constructed and fused by the GhostNet-based features to enhance the spatial context awareness. For the Ghost-CVA part, a lightweight 3D convolution bottleneck block based on the GhostNet is proposed to reduce the computational complexity in this module. By combining with the context and geometry fusion module, a classical hourglass-shaped cost volume aggregate structure is constructed. Ghost-Stereo achieves a comparable performance than state-of-the-art real-time methods on several publicly benchmarks, and shows a better generalization ability.


title: Synthetic Data Generation for Intersectional Fairness by Leveraging Hierarchical Group Structure

abstract: In this paper, we introduce a data augmentation approach specifically tailored to enhance intersectional fairness in classification tasks. Our method capitalizes on the hierarchical structure inherent to intersectionality, by viewing groups as intersections of their parent categories. This perspective allows us to augment data for smaller groups by learning a transformation function that combines data from these parent groups. Our empirical analysis, conducted on four diverse datasets including both text and images, reveals that classifiers trained with this data augmentation approach achieve superior intersectional fairness and are more robust to ``leveling down'' when compared to methods optimizing traditional group fairness metrics.


title: Explaining Black-box Model Predictions via Two-level Nested Feature Attributions with Consistency Property

abstract: Techniques that explain the predictions of black-box machine learning models are crucial to make the models transparent, thereby increasing trust in AI systems. The input features to the models often have a nested structure that consists of high- and low-level features, and each high-level feature is decomposed into multiple low-level features. For such inputs, both high-level feature attributions (HiFAs) and low-level feature attributions (LoFAs) are important for better understanding the model's decision. In this paper, we propose a model-agnostic local explanation method that effectively exploits the nested structure of the input to estimate the two-level feature attributions simultaneously. A key idea of the proposed method is to introduce the consistency property that should exist between the HiFAs and LoFAs, thereby bridging the separate optimization problems for estimating them. Thanks to this consistency property, the proposed method can produce HiFAs and LoFAs that are both faithful to the black-box models and consistent with each other, using a smaller number of queries to the models. In experiments on image classification in multiple instance learning and text classification using language models, we demonstrate that the HiFAs and LoFAs estimated by the proposed method are accurate, faithful to the behaviors of the black-box models, and provide consistent explanations.


title: Casimir-Lifshitz force for graphene-covered gratings

abstract: We study the Casimir-Lifshitz force (CLF) between a gold plate and a graphene-covered dielectric grating. Using a scattering matrix (S-matrix) approach derived from the Fourier Modal Method (FMM), we find a significant enhancement in the CLF as compared to a mere dielectric slab coated with graphene, over a wide range of temperatures. Additionally, we demonstrate that the CLF depends strongly on the chemical potential of graphene, with maximal effects observed at lower filling fractions. Finally, we analyse the Casimir force gradient between a gold sphere and a graphene-coated dielectric grating, highlighting potential avenues for experimental measurements.


title: QoE-Aware and Secure UAV-Aided Rate-Splitting Multiple Access Based Communications

abstract: In this work, we address the issue of quality of experience (QoE) in unmanned aerial vehicle (UAV) aided multiuser rate-splitting multiple access (RSMA) networks under secrecy constraints. The problem is formulated as maximization of sum mean opinion scores (MOSs) of the users. The problem is decomposed into two subproblems, beamforming and rate allocation and UAV trajectory subproblem. For, beamforming and rate allocation subproblem, we use the epigraph method, property of polynomials, and the norm-bounded error of channels, we linearize the objective function. Then, applying second-order conic (SOC) and first Taylor expansion, we convexify the remaining nonconvex constraints. For the highly nonconvex UAV trajectory, we unroll the constraints and we apply first Taylor expansion on the unrolled constraints. The simulation results demonstrate the efficiency of the proposed framework.


title: Measurement of the impact-parameter dependent azimuthal anisotropy in coherent $\rho^0$ photoproduction in Pb$-$Pb collisions at $\sqrt{s_{\rm NN}}$ = 5.02 TeV

abstract: The first measurement of the impact-parameter dependent angular anisotropy in the decay of coherently photoproduced $\rho^0$ mesons is presented. The $\rho^0$ mesons are reconstructed through their decay into a pion pair. The measured anisotropy corresponds to the amplitude of the $\cos(2\phi)$ modulation, where $\phi$ is the angle between the two vectors formed by the sum and the difference of the transverse momenta of the pions, respectively. The measurement was performed by the ALICE Collaboration at the LHC using data from ultraperipheral Pb$-$Pb collisions at a center-of-mass energy of $\sqrt{s_{\mathrm{NN}}}~=~5.02$ TeV per nucleon pair. Different impact-parameter regions are selected by classifying the events in nuclear-breakup classes. The amplitude of the $\cos(2\phi)$ modulation is found to increase by about one order of magnitude from large to small impact parameters. Theoretical calculations, which describe the measurement, explain the $\cos(2\phi)$ anisotropy as the result of a quantum interference effect at the femtometer scale that arises from the ambiguity as to which of the nuclei is the source of the photon in the interaction.


title: The formation of Schrodinger cat-like states in the process of spontaneous parametric down-conversion

abstract: The formation of Schrodinger cat-like states during the spontaneous parametric down-conversion process (SPDC) is studied when the pump mode is considered quantum and depleted. The Schrodinger cat-like state is formed in the fundamental and second harmonic modes, and the negativity in both modes is studied for certain initial state conditions and interaction lengths. The Wigner function is used to visualize qualitatively Schrodinger cat-like states.


title: ArchesWeather: An efficient AI weather forecasting model at 1.5{\deg} resolution

abstract: One of the guiding principles for designing AI-based weather forecasting systems is to embed physical constraints as inductive priors in the neural network architecture. A popular prior is locality, where the atmospheric data is processed with local neural interactions, like 3D convolutions or 3D local attention windows as in Pangu-Weather. On the other hand, some works have shown great success in weather forecasting without this locality principle, at the cost of a much higher parameter count. In this paper, we show that the 3D local processing in Pangu-Weather is computationally sub-optimal. We design ArchesWeather, a transformer model that combines 2D attention with a column-wise attention-based feature interaction module, and demonstrate that this design improves forecasting skill. ArchesWeather is trained at 1.5{\deg} resolution and 24h lead time, with a training budget of a few GPU-days and a lower inference cost than competing methods. An ensemble of two of our best models shows competitive RMSE scores with the IFS HRES and outperforms the 1.4{\deg} 50-members NeuralGCM ensemble for one day ahead forecasting. Code and models will be made publicly available at https://github.com/gcouairon/ArchesWeather.


title: Towards Privacy-Aware and Personalised Assistive Robots: A User-Centred Approach

abstract: The global increase in the elderly population necessitates innovative long-term care solutions to improve the quality of life for vulnerable individuals while reducing caregiver burdens. Assistive robots, leveraging advancements in Machine Learning, offer promising personalised support. However, their integration into daily life raises significant privacy concerns. Widely used frameworks like the Robot Operating System (ROS) historically lack inherent privacy mechanisms, complicating data-driven approaches in robotics. This research pioneers user-centric, privacy-aware technologies such as Federated Learning (FL) to advance assistive robotics. FL enables collaborative learning without sharing sensitive data, addressing privacy and scalability issues. This work includes developing solutions for smart wheelchair assistance, enhancing user independence and well-being. By tackling challenges related to non-stationary data and heterogeneous environments, the research aims to improve personalisation and user experience. Ultimately, it seeks to lead the responsible integration of assistive robots into society, enhancing the quality of life for elderly and care-dependent individuals.


title: AnomalyDINO: Boosting Patch-based Few-shot Anomaly Detection with DINOv2

abstract: Recent advances in multimodal foundation models have set new standards in few-shot anomaly detection. This paper explores whether high-quality visual features alone are sufficient to rival existing state-of-the-art vision-language models. We affirm this by adapting DINOv2 for one-shot and few-shot anomaly detection, with a focus on industrial applications. We show that this approach does not only rival existing techniques but can even outmatch them in many settings. Our proposed vision-only approach, AnomalyDINO, is based on patch similarities and enables both image-level anomaly prediction and pixel-level anomaly segmentation. The approach is methodologically simple and training-free and, thus, does not require any additional data for fine-tuning or meta-learning. Despite its simplicity, AnomalyDINO achieves state-of-the-art results in one- and few-shot anomaly detection (e.g., pushing the one-shot performance on MVTec-AD from an AUROC of 93.1% to 96.6%). The reduced overhead, coupled with its outstanding few-shot performance, makes AnomalyDINO a strong candidate for fast deployment, for example, in industrial contexts.


title: Multistable Shape from Shading Emerges from Patch Diffusion

abstract: Models for monocular shape reconstruction of surfaces with diffuse reflection -- shape from shading -- ought to produce distributions of outputs, because there are fundamental mathematical ambiguities of both continuous (e.g., bas-relief) and discrete (e.g., convex/concave) varieties which are also experienced by humans. Yet, the outputs of current models are limited to point estimates or tight distributions around single modes, which prevent them from capturing these effects. We introduce a model that reconstructs a multimodal distribution of shapes from a single shading image, which aligns with the human experience of multistable perception. We train a small denoising diffusion process to generate surface normal fields from $16\times 16$ patches of synthetic images of everyday 3D objects. We deploy this model patch-wise at multiple scales, with guidance from inter-patch shape consistency constraints. Despite its relatively small parameter count and predominantly bottom-up structure, we show that multistable shape explanations emerge from this model for ''ambiguous'' test images that humans experience as being multistable. At the same time, the model produces veridical shape estimates for object-like images that include distinctive occluding contours and appear less ambiguous. This may inspire new architectures for stochastic 3D shape perception that are more efficient and better aligned with human experience.


title: Low-resolution descriptions of model neural activity reveal hidden features and underlying system properties

abstract: The analysis of complex systems such as neural networks is made particularly difficult by the overwhelming number of their interacting components. In the absence of prior knowledge, identifying a small but informative subset of network nodes on which the analysis should focus is a rather difficult task. In this work, we address this problem in the context of a Hopfield model, for which we seek representations given in terms of a subgroup of its neurons with the aim of identifying those that can reveal the largest amount of information about the system. Using a methodology based on concepts from information theory, we reveal that such optimised low-resolution representations are not only informative per se, but rather they also serve as probes of the neural network properties; these results show a tight and potentially fruitful relation between the level of detail at which the network is inspected and the type and amount of information that can be extracted from it.


title: Aligning Embeddings and Geometric Random Graphs: Informational Results and Computational Approaches for the Procrustes-Wasserstein Problem

abstract: The Procrustes-Wasserstein problem consists in matching two high-dimensional point clouds in an unsupervised setting, and has many applications in natural language processing and computer vision. We consider a planted model with two datasets $X,Y$ that consist of $n$ datapoints in $\mathbb{R}^d$, where $Y$ is a noisy version of $X$, up to an orthogonal transformation and a relabeling of the data points. This setting is related to the graph alignment problem in geometric models. In this work, we focus on the euclidean transport cost between the point clouds as a measure of performance for the alignment. We first establish information-theoretic results, in the high ($d \gg \log n$) and low ($d \ll \log n$) dimensional regimes. We then study computational aspects and propose the Ping-Pong algorithm, alternatively estimating the orthogonal transformation and the relabeling, initialized via a Franke-Wolfe convex relaxation. We give sufficient conditions for the method to retrieve the planted signal after one single step. We provide experimental results to compare the proposed approach with the state-of-the-art method of Grave et al. (2019).


title: Hyperlogarithms in the theory of turbulence of infinite dimension

abstract: Parametric integration with hyperlogarithms so far has been successfully used in problems of high energy physics (HEP) and critical statics. In this work, for the first time, it is applied to a problem of critical dynamics, namely, a stochastic model of developed turbulence in high-dimensional spaces, which has a propagator that is non-standard with respect to the HEP: $(-i \omega + \nu k^2)^{-1}$. Adaptation of the hyperlogarithm method is carried out by choosing a proper renormalization scheme and considering an effective dimension of the space. Analytical calculation of the renormalization group functions is performed up to the fourth order of the perturbation theory, $\varepsilon$-expansion of the critical exponent $\omega$ responsible for the infrared stability of the fixed point is obtained.


title: Synchrotron polarization with a partially random magnetic field: general approach, and application to X-ray polarization from SNRs

abstract: Diagnostics based on the polarization properties of the synchrotron emission can provide precious information on both the ordered structure and the random level of the magnetic field. While this issue has been already analysed in the radio, the polarization data recently obtained by the mission IXPE have shown the need to extend this analysis to the X-rays. While our immediate target are young SNRs, the scope of this analysis is wider. We aim at extending the analysis to particle energy distributions more complex than a power law, as well as to investigate a wider range of cases involving a composition of ordered and random magnetic fields. Since only in a limited number of cases an analytical approach is possible, we have devised to this purpose an optimised numerical scheme, and we have directly used it to investigate particle energy distributions in the form of a power law with an exponential, or super-exponential cutoff. We have also considered a general combination of a ordered field plus an anisotropic random component. We have shown that the previously derived analytic formulae, valid for power-law distributions, may be good approximations of the polarization degree also in the more general case with a cutoff, as typically seen in X-rays. We have explicitly analysed the young SNRs SN 1006, Tycho and Cas A. In particular, for SN 1006, we have proved the consistency between the radio and X-ray polarization degrees, favouring the case of predominantly random field, with an anisotropic distribution. In addition, for the power-law case, we have investigated the effect of a compression on both ordered and random magnetic field components, aimed at describing the mid-age radio SNRs. This work allows a more efficient exploitation of radio and X-ray measurements of the synchrotron polarization, and is addressed to present observations with IXPE as well as to future projects.