title: Reproducibility Study on Adversarial Attacks Against Robust Transformer Trackers

abstract: New transformer networks have been integrated into object tracking pipelines and have demonstrated strong performance on the latest benchmarks. This paper focuses on understanding how transformer trackers behave under adversarial attacks and how different attacks perform on tracking datasets as their parameters change. We conducted a series of experiments to evaluate the effectiveness of existing adversarial attacks on object trackers with transformer and non-transformer backbones. We experimented on 7 different trackers, including 3 that are transformer-based, and 4 which leverage other architectures. These trackers are tested against 4 recent attack methods to assess their performance and robustness on VOT2022ST, UAV123 and GOT10k datasets. Our empirical study focuses on evaluating adversarial robustness of object trackers based on bounding box versus binary mask predictions, and attack methods at different levels of perturbations. Interestingly, our study found that altering the perturbation level may not significantly affect the overall object tracking results after the attack. Similarly, the sparsity and imperceptibility of the attack perturbations may remain stable against perturbation level shifts. By applying a specific attack on all transformer trackers, we show that new transformer trackers having a stronger cross-attention modeling achieve a greater adversarial robustness on tracking datasets, such as VOT2022ST and GOT10k. Our results also indicate the necessity for new attack methods to effectively tackle the latest types of transformer trackers. The codes necessary to reproduce this study are available at https://github.com/fatemehN/ReproducibilityStudy.


title: How Does Gradient Descent Learn Features -- A Local Analysis for Regularized Two-Layer Neural Networks

abstract: The ability of learning useful features is one of the major advantages of neural networks. Although recent works show that neural network can operate in a neural tangent kernel (NTK) regime that does not allow feature learning, many works also demonstrate the potential for neural networks to go beyond NTK regime and perform feature learning. Recently, a line of work highlighted the feature learning capabilities of the early stages of gradient-based training. In this paper we consider another mechanism for feature learning via gradient descent through a local convergence analysis. We show that once the loss is below a certain threshold, gradient descent with a carefully regularized objective will capture ground-truth directions. Our results demonstrate that feature learning not only happens at the initial gradient steps, but can also occur towards the end of training.


title: Region-aware Grasp Framework with Normalized Grasp Space for 6-DoF Grasping in Cluttered Scene

abstract: Regional geometric information is crucial for determining grasp poses. A series of region-based methods succeed in extracting regional features and enhancing grasp detection quality. However, faced with a cluttered scene with multiple objects and potential collision, the definition of the grasp-relevant region remains inconsistent among methods, and the relationship between grasps and regional spaces remains incompletely investigated. In this paper, from a novel region-aware and grasp-centric viewpoint, we propose Normalized Grasp Space (NGS), unifying the grasp representation within a normalized regional space. The relationship among the grasp widths, region scales, and gripper sizes is considered and empowers our method to generalize to grippers and scenes with different scales. Leveraging the characteristics of the NGS, we find that 2D CNNs are surprisingly underestimated for complicated 6-DoF grasp detection tasks in clutter scenes and build a highly efficient Region-aware Normalized Grasp Network (RNGNet). Experiments conducted on the public benchmark show that our method achieves the best grasp detection results compared to the previous state-of-the-arts while attaining a real-time inference speed of approximately 50 FPS. Real-world cluttered scene clearance experiments underscore the effectiveness of our method with a higher success rate than other methods. Further human-to-robot handover and moving object grasping experiments demonstrate the potential of our proposed method for closed-loop grasping in dynamic scenarios.


title: TSpec-LLM: An Open-source Dataset for LLM Understanding of 3GPP Specifications

abstract: Understanding telecom standards involves sorting through numerous technical documents, such as those produced by the 3rd Generation Partnership Project (3GPP), which is time-consuming and labor-intensive. While large language models (LLMs) can assist with the extensive 3GPP knowledge base, an inclusive dataset is crucial for their effective pre-training and fine-tuning. In this paper, we introduce \textit{TSpec-LLM}, an open-source comprehensive dataset covering all 3GPP documents from Release 8 to Release 19 (1999--2023). To evaluate its efficacy, we first select a representative sample of 3GPP documents, create corresponding technical questions, and assess the baseline performance of various LLMs. We then incorporate a retrieval-augmented generation (RAG) framework to enhance LLM capabilities by retrieving relevant context from the \textit{TSpec-LLM} dataset. Our evaluation shows that using a naive-RAG framework on \textit{TSpec-LLM} improves the accuracy of GPT-3.5, Gemini 1.0 Pro, and GPT-4 from 44\%, 46\%, and 51\% to 71\%, 75\%, and 72\%, respectively.


title: Provable Optimality of the Square-Tooth Atomic Frequency Comb Quantum Memory

abstract: Atomic frequency comb (AFC) quantum memories are a promising technology for quantum repeater networks because they enable multi-mode, high-fidelity storage of photons with on-demand retrieval. The optimization of the retrieval efficiency of an AFC memory is important because it strongly impacts the entanglement generation rate in quantum networks. Despite initial theoretical analyses and recent experimental demonstrations, a rigorous proof of the universally optimal configuration for the highest AFC retrieval efficiency has not been presented. In this paper we offer a simple analytical proof which shows that the optimized square-tooth AFC provides the highest retrieval efficiency among all possible comb tooth shapes, under the physical constraint of maximal optical depth of an atomic ensemble. The optimality still holds even when the non-zero background absorption and the finite homogeneous broadening of atoms are considered. Our proof provides experimentalists with rigorous arguments how to create optimal AFC under realistic experimental conditions. Finally, we also identify other functional optimization problems where our proof technique is applicable, thus proving the optimality of the square function in more general scenarios.


title: Thermodynamical Aspects of Some Cosmological Models

abstract: The research work in the thesis is focused on the thermodynamic analysis of cosmological models, especially the models that explain late-time cosmic acceleration. According to the cosmological principle, the universe is spatially homogeneous and isotropic. FRW metric is considered to describe it. In the initial chapter, an overview of cosmology is presented. Chapter 2 delves into thermodynamics applied to cosmology, emphasizing the Generalized Second Law. It thoroughly covers Hayward-Kodama temperature and discusses the apparent horizon and the conditions for thermodynamic stability. Chapter 3 presents a thermodynamic comparison of quintessence models, focusing on thawing and freezing scenarios. Chapter 4 examines Brans-Dicke cosmological models in a spatially isotropic and homogeneous universe, assessing their compatibility with the Generalized Second Law of Thermodynamics. Chapter 5 explores the thermodynamic viability of various dark energy models reconstructed using the cosmological jerk parameter. Chapter 6 examines a model in a spatially flat FRW spacetime that mimics the characteristics of the $\Lambda$CDM model, assessing its thermodynamic stability. Chapter 7 serves as the epilogue of this thesis, offering not only the final conclusions but also a brief discussion on the presented work and potential future prospects.


title: LLMs Beyond English: Scaling the Multilingual Capability of LLMs with Cross-Lingual Feedback

abstract: To democratize large language models (LLMs) to most natural languages, it is imperative to make these models capable of understanding and generating texts in many languages, in particular low-resource ones. While recent multilingual LLMs demonstrate remarkable performance in such capabilities, these LLMs still support a limited number of human languages due to the lack of training data for low-resource languages. Moreover, these LLMs are not yet aligned with human preference for downstream tasks, which is crucial for the success of LLMs in English. In this paper, we introduce xLLaMA-100 and xBLOOM-100 (collectively xLLMs-100), which scale the multilingual capabilities of LLaMA and BLOOM to 100 languages. To do so, we construct two datasets: a multilingual instruction dataset including 100 languages, which represents the largest language coverage to date, and a cross-lingual human feedback dataset encompassing 30 languages. We perform multilingual instruction tuning on the constructed instruction data and further align the LLMs with human feedback using the DPO algorithm on our cross-lingual human feedback dataset. We evaluate the multilingual understanding and generating capabilities of xLLMs-100 on five multilingual benchmarks. Experimental results show that xLLMs-100 consistently outperforms its peers across the benchmarks by considerable margins, defining a new state-of-the-art multilingual LLM that supports 100 languages.


title: Homoclinic Solution to Zero of a Non-autonomous, Nonlinear, Second Order Differential Equation with Quadratic Growth on the Derivative

abstract: This work aims to obtain a positive, smooth, even, and homoclinic to zero (i.e zero at infinity) solution to a non-autonomous, second-order, nonlinear differential equation involving quadratic growth on the derivative. We apply Galerkin's method combined with Strauss' approximation on the term involving the first derivative to obtain weak solutions. We also study the regularity of the solutions and the dependence on their existence with a parameter


title: Concurrent normals problem for convex polytopes and Euclidean distance degree

abstract: It is conjectured since long that for any convex body $P\subset \mathbb{R}^n$ there exists a point in its interior which belongs to at least $2n$ normals from different points on the boundary of $P$. The conjecture is known to be true for $n=2,3,4$. We treat the same problem for convex polytopes in $\mathbb{R}^3$. It turns out that the PL concurrent normals problem differs a lot from the smooth one. One almost immediately proves that a convex polytope in $\mathbb{R}^3$ has $8$ normals to its boundary emanating from some point in its interior. Moreover, we conjecture that each simple polytope has a point in its interior with $10$ normals to the boundary. We confirm the conjecture for all tetrahedra and triangular prisms and give a sufficient condition for a simple polytope to have a point with $10$ normals. Other related topics (average number of normals, minimal number of normals from an interior point, other dimensions) are discussed.


title: Efficient Data Distribution Estimation for Accelerated Federated Learning

abstract: Federated Learning(FL) is a privacy-preserving machine learning paradigm where a global model is trained in-situ across a large number of distributed edge devices. These systems are often comprised of millions of user devices and only a subset of available devices can be used for training in each epoch. Designing a device selection strategy is challenging, given that devices are highly heterogeneous in both their system resources and training data. This heterogeneity makes device selection very crucial for timely model convergence and sufficient model accuracy. To tackle the FL client heterogeneity problem, various client selection algorithms have been developed, showing promising performance improvement in terms of model coverage and accuracy. In this work, we study the overhead of client selection algorithms in a large scale FL environment. Then we propose an efficient data distribution summary calculation algorithm to reduce the overhead in a real-world large scale FL environment. The evaluation shows that our proposed solution could achieve up to 30x reduction in data summary time, and up to 360x reduction in clustering time.


title: OLoRA: Orthonormal Low-Rank Adaptation of Large Language Models

abstract: The advent of large language models (LLMs) has revolutionized natural language processing, enabling unprecedented capabilities in understanding and generating human-like text. However, the computational cost and convergence times associated with fine-tuning these models remain significant challenges. Low-Rank Adaptation (LoRA) has emerged as a promising method to mitigate these issues by introducing efficient fine-tuning techniques with a reduced number of trainable parameters. In this paper, we present OLoRA, an enhancement to the LoRA method that leverages orthonormal matrix initialization through QR decomposition. OLoRA significantly accelerates the convergence of LLM training while preserving the efficiency benefits of LoRA, such as the number of trainable parameters and GPU memory footprint. Our empirical evaluations demonstrate that OLoRA not only converges faster but also exhibits improved performance compared to standard LoRA across a variety of language modeling tasks. This advancement opens new avenues for more efficient and accessible fine-tuning of LLMs, potentially enabling broader adoption and innovation in natural language applications.


title: Sharp weighted non-tangential maximal estimates via Carleson-sparse domination

abstract: We prove sharp weighted estimates for the non-tangential maximal function of singular integrals mapping functions from $\mathbf{R}^n$ to the half-space in $\mathbf{R}^{1+n}$ above $\mathbf{R}^n$. The proof is based on pointwise sparse domination of the adjoint singular integrals that map functions from the half-space back to the boundary. It is proved that these map $L_1$ functions in the half-space to weak $L_1$ functions on the boundary. From this a non-standard sparse domination of the singular integrals is established, where averages have been replaced by Carleson averages.


title: Higher order asymptotic expansions for the convection-diffusion equation in the Fujita-subcritical case

abstract: This paper is devoted to the asymptotic expansions of global solutions to the convection-diffusion equation in the Fujita-subcritical case. We improve the result by Zuazua (1993) and establish higher order asymptotic expansions with decay estimates of the remainders. We also discuss the optimality for the decay rate of the remainder.


title: On a conjecture of a P\'olya functional for triangles and rectangles

abstract: We consider the functional given by the product of the first Dirichlet eigenvalue and the torsional rigidity of planar domains normalized by the area. This scale invariant functional was studied by P\'olya and Szeg\H{o} in 1951 who showed that it is bounded above by 1 for all domains. It has been conjectured that within the class of bounded convex planar domains the functional is bounded below by $\pi^{2}/24$ and above by $\pi^{2}/12$ and that these bounds are sharp. Remarkably, the conjecture remains open even within the class of triangles. The purpose of this paper is to prove the conjecture in this case. The conjecture is also proved for rectangles where a stronger monotonicity property is verified. Finally, the upper bound also holds for tangential quadrilateral.


title: NNPDF4.0 aN$^3$LO PDFs with QED corrections

abstract: We review recent progress in the global determination of the collinear parton distributions (PDFs) of the proton within the NNPDF framework. This progress includes NNPDF4.0 variants with QED effects and with missing higher order uncertainties (MHOUs) via the theory covariance matrix formalism, as well as PDFs based on QCD calculations at approximate N$^3$LO (aN$^3$LO) accuracy. We present the combination of these theoretical developments resulting into NNPDF4.0 aN$^3$LO variants accounting for QED corrections and with a photon PDF. We compare these aN$^3$LO QED PDFs with analogous results obtained by the MSHT group, and briefly quantify their implications at the level of representative LHC cross-sections.


title: Best Practices for Developing Computational and Data-Intensive (CDI) Applications

abstract: High-quality computational and data-intensive (CDI) applications are critical for advancing research frontiers in almost all disciplines. Despite their importance, there is a significant gap due to the lack of comprehensive best practices for developing such applications. CDI projects, characterized by specialized computational needs, high data volumes, and the necessity for cross-disciplinary collaboration, often involve intricate scientific software engineering processes. The interdisciplinary nature necessitates collaboration between domain scientists and CDI professionals (Xperts), who may come from diverse backgrounds. This paper aims to close the above gap by describing practices specifically applicable to CDI applications. They include general software engineering practices to the extent that they exhibit substantial differences from those already described in the literature as well as practices that have been called pivotal by Xperts in the field. The practices were evaluated using three main metrics: (1) participants' experience with each practice, (2) their perceived impact, and (3) their ease of application during development. The evaluations involved participants with varying levels of experience in adopting these practices. Despite differing experience levels, the evaluation results consistently showed high impact and usability for all practices. By establishing a best-practices guide for CDI research, the ultimate aim of this paper is to enhance CDI software quality, improve approaches to computational and data-intensive challenges, foster interdisciplinary collaboration, and thus accelerate scientific innovation and discovery.


title: DEFT: Efficient Finetuning of Conditional Diffusion Models by Learning the Generalised $h$-transform

abstract: Generative modelling paradigms based on denoising diffusion processes have emerged as a leading candidate for conditional sampling in inverse problems. In many real-world applications, we often have access to large, expensively trained unconditional diffusion models, which we aim to exploit for improving conditional sampling. Most recent approaches are motivated heuristically and lack a unifying framework, obscuring connections between them. Further, they often suffer from issues such as being very sensitive to hyperparameters, being expensive to train or needing access to weights hidden behind a closed API. In this work, we unify conditional training and sampling using the mathematically well-understood Doob's h-transform. This new perspective allows us to unify many existing methods under a common umbrella. Under this framework, we propose DEFT (Doob's h-transform Efficient FineTuning), a new approach for conditional generation that simply fine-tunes a very small network to quickly learn the conditional $h$-transform, while keeping the larger unconditional network unchanged. DEFT is much faster than existing baselines while achieving state-of-the-art performance across a variety of linear and non-linear benchmarks. On image reconstruction tasks, we achieve speedups of up to 1.6$\times$, while having the best perceptual quality on natural images and reconstruction performance on medical images.


title: Multi-agent assignment via state augmented reinforcement learning

abstract: We address the conflicting requirements of a multi-agent assignment problem through constrained reinforcement learning, emphasizing the inadequacy of standard regularization techniques for this purpose. Instead, we recur to a state augmentation approach in which the oscillation of dual variables is exploited by agents to alternate between tasks. In addition, we coordinate the actions of the multiple agents acting on their local states through these multipliers, which are gossiped through a communication network, eliminating the need to access other agent states. By these means, we propose a distributed multi-agent assignment protocol with theoretical feasibility guarantees that we corroborate in a monitoring numerical experiment.


title: Unitary Dynamics for Open Quantum Systems with Density-Matrix Purification

abstract: Accurate modeling of quantum systems interacting with environments requires addressing non-unitary dynamics, which significantly complicates computational approaches. In this work, we enhance an open quantum system (OQS) theory using density-matrix purification, enabling a unitary description of dynamics by entangling the system with an environment of equal dimension. We first establish the connection between density-matrix purification and conventional OQS methods. We then demonstrate the standalone applicability of purification theory by deriving system-environment interactions from fundamental design principles. Using model systems, we show that the purification approach extends beyond the complete positivity condition and effectively models both Markovian and non-Markovian dynamics. Finally, we implement density-matrix purification on a quantum simulator, illustrating its capability to map non-unitary OQS dynamics onto a unitary framework suitable for quantum computers.


title: Dependence of the Reconstructed Core-Collapse Supernova Gravitational Wave High-Frequency Feature on the Nuclear Equation of State, in Real Interferometric Data

abstract: We present an analysis of gravitational wave (GW) predictions from five two-dimensional Core Collapse Supernova (CCSN) simulations that varied only in the Equation of State (EOS) implemented. The GW signals from these simulations are used to produce spectrograms in the absence of noise, and the emergent high-frequency feature (HFF) is found to differ quantitatively between simulations. Below 1 kHz, the HFF is well approximated by a first-order polynomial in time. The resulting slope was found to vary between 10-50% across all models. Further, using real interferometric noise we investigated the current capabilities of GW detectors to resolve these differences in HFF slope for a Galactic CCSN. We find that for distances up to 1 kpc, current detectors can resolve HFF slopes that vary by at least 30%. For further Galactic distances, current detectors are capable of distinguishing the upper and lower bounds of the HFF slope for groupings of our models that varied in EOS. With the higher sensitivity of future GW detectors, and with improved analysis of the HFF, our ability to resolve properties of the HFF will improve for all Galactic distances. This study shows the potential of using the HFF of CCSN produced GWs to provide insight into the physical processes occurring deep within CCSN during collapse, and in particular its potential to further constrain the EOS through GW detection.


title: Tumbling elimination induced by permeability: an experimental approach

abstract: Archetypal falling behaviors of impervious objects are classified into four modes: fluttering, tumbling, steady descent and chaotic motion. The classical scenario predicts these behaviors to be affected by two dimensionless quantities: dimensionless inertia and Reynolds number. In this article we explore experimentally the effect of permeability and porosity on the falling regimes of porous plates. By drilling several hole distributions in rectangular plates, both permeability and porosity are varied systematically. We discover that the introduction of porosity affects the stability of the falling regimes eliminating tumbling. Using a phenomenological model we show that a decrease in circulation induced by the introduction of holes is the primary mechanism for stabilizing the plates' trajectories.


title: Recent Advances in Data-Driven Business Process Management

abstract: The rapid development of cutting-edge technologies, the increasing volume of data and also the availability and processability of new types of data sources has led to a paradigm shift in data-based management and decision-making. Since business processes are at the core of organizational work, these developments heavily impact BPM as a crucial success factor for organizations. In view of this emerging potential, data-driven business process management has become a relevant and vibrant research area. Given the complexity and interdisciplinarity of the research field, this position paper therefore presents research insights regarding data-driven BPM.


title: Bosonization of 2+1 dimensional fermions on the surface of topological insulators

abstract: Three-dimensional topological insulators can be described by an effective field theory involving two `hydrodynamic' Abelian gauge fields. The action contains a bulk topological BF term and a surface term, called loop model. This describes the massless 2+1 dimensional excitations and provides them with a semiclassical, yet non-trivial conformal invariant dynamics. Given that topological insulators are originally fermionic, this physical setting is ideal for realizing the bosonization of massless fermions in terms of gauge fields. Building on earlier analyses of the loop model, we find that fermions belong to the solitonic spectrum and can be described by Wilson lines, through the generalization of 1+1 dimensional vertex operators. Their correlation functions agree with conformal invariance. The bosonic loop model is then mapped into a fermionic theory by using the general construction of fermionic topological phases described in the literature. It requires the identification of the characteristic one-form $Z_2$ symmetry of the bosonic theory and its gauging, which originates the fermion number $(-1)^F$, the spin sectors and the time reversal symmetry obeying ${\cal T}^2=(-1)^F$. These results are detailed for the effective action and the partition function on the geometry $S^2\times S^1$.


title: RSMM: A Framework to Assess Maturity of Research Software Project

abstract: The organizations and researchers producing research software face a common problem of making their software sustainable beyond funding provided by a single research project. This is addressed by research software engineers through building communities around their software, providing appropriate licensing, creating reliable and reproducible research software, making it sustainable and impactful, promoting, and ensuring that the research software is easy to adopt in research workflows, etc. As a result, numerous practices and guidelines exist to enhance research software quality, reusability, and sustainability. However, there is a lack of a unified framework to systematically integrate these practices and help organizations and research software developers refine their development and management processes. Our paper aims at bridging this gap by introducing a novel framework: RSMM. It is designed through systematic literature review and insights from interviews with research software project experts. In short, RSMM offers a structured pathway for evaluating and refining research software project management by categorizing 79 best practices into 17 capabilities across 4 focus areas. From assessing code quality and security to measuring impact, sustainability, and reproducibility, the model provides a complete evaluation of a research software project maturity. With RSMM, individuals as well as organizations involved in research software development gain a systematic approach to tackling various research software engineering challenges. By utilizing RSMM as a comprehensive checklist, organizations can systematically evaluate and refine their project management practices and organizational structure.


title: AI-based Classification of Customer Support Tickets: State of the Art and Implementation with AutoML

abstract: Automation of support ticket classification is crucial to improve customer support performance and shortening resolution time for customer inquiries. This research aims to test the applicability of automated machine learning (AutoML) as a technology to train a machine learning model (ML model) that can classify support tickets. The model evaluation conducted in this research shows that AutoML can be used to train ML models with good classification performance. Moreover, this paper fills a research gap by providing new insights into developing AI solutions without a dedicated professional by utilizing AutoML, which makes this technology more accessible for companies without specialized AI departments and staff.


title: The bunkbed conjecture is not robust to generalisation

abstract: The bunkbed conjecture, which has featured in the folklore of probability theory since at least 1985, concerns bond percolation on the product graph $G\Box K_2$. We have two copies $G_0$ and $G_1$ of $G$, and if $x^{(0)}$ and $x^{(1)}$ are the copies of a vertex $x\in V(G)$ in $G_0$ and $G_1$ respectively, then edge $x^{(0)}x^{(1)}$ is present. The conjecture states that, for vertices $u,v\in V(G)$, percolation from $u^{(0)}$ to $v^{(0)}$ is at least as likely as percolation from $u^{(0)}$ to $v^{(1)}$. While the conjecture is widely expected to be true, having attracted significant attention, a general proof has not been forthcoming. In this paper we consider three natural generalisations of the bunkbed conjecture; to site percolation, to hypergraphs, and to directed graphs. Our main aim is to show that all these generalisations are false, and to this end we construct a sequence of counterexamples to these statements. However, we also consider under what extra conditions these generalisations might hold, and give some classes of graph for which the bunkbed conjecture for site percolation does hold.


title: Hybrid-Learning Video Moment Retrieval across Multi-Domain Labels

abstract: Video moment retrieval (VMR) is to search for a visual temporal moment in an untrimmed raw video by a given text query description (sentence). Existing studies either start from collecting exhaustive frame-wise annotations on the temporal boundary of target moments (fully-supervised), or learn with only the video-level video-text pairing labels (weakly-supervised). The former is poor in generalisation to unknown concepts and/or novel scenes due to restricted dataset scale and diversity under expensive annotation costs; the latter is subject to visual-textual mis-correlations from incomplete labels. In this work, we introduce a new approach called hybrid-learning video moment retrieval to solve the problem by knowledge transfer through adapting the video-text matching relationships learned from a fully-supervised source domain to a weakly-labelled target domain when they do not share a common label space. Our aim is to explore shared universal knowledge between the two domains in order to improve model learning in the weakly-labelled target domain. Specifically, we introduce a multiplE branch Video-text Alignment model (EVA) that performs cross-modal (visual-textual) matching information sharing and multi-modal feature alignment to optimise domain-invariant visual and textual features as well as per-task discriminative joint video-text representations. Experiments show EVA's effectiveness in exploring temporal segment annotations in a source domain to help learn video moment retrieval without temporal labels in a target domain.


title: The SemGuS Toolkit

abstract: Semantics-Guided Synthesis (SemGuS) is a programmable framework for defining synthesis problems in a domain- and solver-agnostic way. This paper presents the standardized SemGuS format, together with an open-source toolkit that provides a parser, a verifier, and enumerative SemGuS solvers. The paper also describes an initial set of SemGuS benchmarks, which form the basis for comparing SemGuS solvers, and presents an evaluation of the baseline enumerative solvers.


title: Towards the Transferability of Rewards Recovered via Regularized Inverse Reinforcement Learning

abstract: Inverse reinforcement learning (IRL) aims to infer a reward from expert demonstrations, motivated by the idea that the reward, rather than the policy, is the most succinct and transferable description of a task [Ng et al., 2000]. However, the reward corresponding to an optimal policy is not unique, making it unclear if an IRL-learned reward is transferable to new transition laws in the sense that its optimal policy aligns with the optimal policy corresponding to the expert's true reward. Past work has addressed this problem only under the assumption of full access to the expert's policy, guaranteeing transferability when learning from two experts with the same reward but different transition laws that satisfy a specific rank condition [Rolland et al., 2022]. In this work, we show that the conditions developed under full access to the expert's policy cannot guarantee transferability in the more practical scenario where we have access only to demonstrations of the expert. Instead of a binary rank condition, we propose principal angles as a more refined measure of similarity and dissimilarity between transition laws. Based on this, we then establish two key results: 1) a sufficient condition for transferability to any transition laws when learning from at least two experts with sufficiently different transition laws, and 2) a sufficient condition for transferability to local changes in the transition law when learning from a single expert. Furthermore, we also provide a probably approximately correct (PAC) algorithm and an end-to-end analysis for learning transferable rewards from demonstrations of multiple experts.


title: It Takes Two: A Peer-Prediction Solution for Blockchain Verifier's Dilemma

abstract: The security of blockchain systems is fundamentally based on the decentralized consensus in which the majority of parties behave honestly, and the process of content verification is essential to keep the robustness of blockchain systems. However, the phenomenon that a secure blockchain system with few or no cheaters could not provide sufficient incentive for verifiers to honestly perform the costly verification, referred to as the Verifier's Dilemma, could severely undermine the fundamental security of blockchain systems. While existing works have attempted to insert deliberate errors to disincentivize lazy verification, the decentralized environment makes it impossible to judge the correctness of verification or detect malicious verifiers directly. In this paper, we initiate the research that leverages the peer prediction approach towards the design of Bayesian truthful mechanisms for the decentralized verification game among multiple verifiers, incentivizing all verifiers to perform honest verification without access to the ground truth even in the presence of noisy observations in the verification process. With theoretically guaranteed truthfulness of our mechanism for the verification game, our work provides a framework of verification mechanisms that enhances the security and robustness of the blockchain and potentially other decentralized systems.


title: Video Coding with Cross-Component Sample Offset

abstract: Beyond the exploration of traditional spatial, temporal and subjective visual signal redundancy in image and video compression, recent research has focused on leveraging cross-color component redundancy to enhance coding efficiency. Cross-component coding approaches are motivated by the statistical correlations among different color components, such as those in the Y'CbCr color space, where luma (Y) color component typically exhibits finer details than chroma (Cb/Cr) color components. Inspired by previous cross-component coding algorithms, this paper introduces a novel in-loop filtering approach named Cross-Component Sample Offset (CCSO). CCSO utilizes co-located and neighboring luma samples to generate correction signals for both luma and chroma reconstructed samples. It is a multiplication-free, non-linear mapping process implemented using a look-up-table. The input to the mapping is a group of reconstructed luma samples, and the output is an offset value applied on the center luma or co-located chroma sample. Experimental results demonstrate that the proposed CCSO can be applied to both image and video coding, resulting in improved coding efficiency and visual quality. The method has been adopted into an experimental next-generation video codec beyond AV1 developed by the Alliance for Open Media (AOMedia), achieving significant objective coding gains up to 3.5\,\% and 1.8\,\% for PSNR and VMAF quality metrics, respectively, under random access configuration. Additionally, CCSO notably improves the subjective visual quality.


title: Unveiling gas phase H2NCO radical: Laboratory rotational spectroscopy and interstellar search toward IRAS 16293-2422

abstract: Context. The carbamoyl radical (H2NCO) is believed to play a central role in the ice-grain chemistry of crucial interstellar complex organic molecules as formamide and acetamide. Yet, little is known about this radical that remains elusive in laboratory gas-phase experiments. Aims. In order to enable interstellar searches of H2NCO, we have undertaken a mandatory laboratory characterisation of its pure rotational spectrum. Methods. We report the gas-phase laboratory detection of H2NCO, produced by H-atom abstraction from formamide, using pure rotational spectroscopy at millimetre and submillimetre wavelengths. Millimetre-wave data were acquired using chirped-pulse Fourier-transform spectroscopy while submillimetre-wave ones were obtained using Zeeman-modulated spectroscopy. Experimental measurements were guided by quantum-chemical calculations at the $\omega$B97X-D/cc-pVQZ level of theory. Interstellar searches for the radical have been undertaken on the Protostellar Interferometric Line Survey (PILS) towards the solar-type protostar IRAS 16293-2422. Results. From the assignment and fit of experimental transitions up to 660 GHz, reliable spectroscopic parameters for H2NCO in its ground vibrational state have been derived, enabling accurate spectral predictions. No transitions of the radical were detected on the PILS survey. The inferred upper limit shows that H2NCO abundance is at least 60 times below that of formamide and 160 times below that of HNCO in this source; a value that is in agreement with predictions from a physico-chemical model of this young protostar.


title: The Empirical Impact of Forgetting and Transfer in Continual Visual Odometry

abstract: As robotics continues to advance, the need for adaptive and continuously-learning embodied agents increases, particularly in the realm of assistance robotics. Quick adaptability and long-term information retention are essential to operate in dynamic environments typical of humans' everyday lives. A lifelong learning paradigm is thus required, but it is scarcely addressed by current robotics literature. This study empirically investigates the impact of catastrophic forgetting and the effectiveness of knowledge transfer in neural networks trained continuously in an embodied setting. We focus on the task of visual odometry, which holds primary importance for embodied agents in enabling their self-localization. We experiment on the simple continual scenario of discrete transitions between indoor locations, akin to a robot navigating different apartments. In this regime, we observe initial satisfactory performance with high transferability between environments, followed by a specialization phase where the model prioritizes current environment-specific knowledge at the expense of generalization. Conventional regularization strategies and increased model capacity prove ineffective in mitigating this phenomenon. Rehearsal is instead mildly beneficial but with the addition of a substantial memory cost. Incorporating action information, as commonly done in embodied settings, facilitates quicker convergence but exacerbates specialization, making the model overly reliant on its motion expectations and less adept at correctly interpreting visual cues. These findings emphasize the open challenges of balancing adaptation and memory retention in lifelong robotics and contribute valuable insights into the application of a lifelong paradigm on embodied agents.


title: Huge BPS Operators and Fluid Dynamics in $\mathcal{N}=4$ SYM

abstract: In the bulk dual of holography, huge operators correspond to sources so heavy that they fully backreact on the space-time geometry. Here we study the correlation function of three such huge operators when they are given by $1/2$ BPS operators in $\mathcal{N}=4$ SYM theory, dual to IIB Strings in $AdS_5 \times S^5$. We unveil simple matrix model representations for these correlators which we can sometimes solve analytically. For general huge operators, we translate these matrix model expressions into a $1+1$ dimensional hydrodynamical fluid problem. This fluid is integrable thus unveiling a novel integrable sector of the $AdS/CFT$ duality in a full fledged gravitational regime, very far from the usual free string planar regime where integrability reigns supreme. We explain how an adiabatic deformation method can be developed to yield the solution to an integrable discrete formulation of these fluids -- the rational Calogero-Moser Model -- so we can access the general three point correlation functions of generic huge $1/2$-BPS operators. Everything will be done on the gauge theory side of the duality. It would be fascinating to find the holographic dual of these matrix models and fluids.


title: Online Control in Population Dynamics

abstract: The study of population dynamics originated with early sociological works but has since extended into many fields, including biology, epidemiology, evolutionary game theory, and economics. Most studies on population dynamics focus on the problem of prediction rather than control. Existing mathematical models for control in population dynamics are often restricted to specific, noise-free dynamics, while real-world population changes can be complex and adversarial. To address this gap, we propose a new framework based on the paradigm of online control. We first characterize a set of linear dynamical systems that can naturally model evolving populations. We then give an efficient gradient-based controller for these systems, with near-optimal regret bounds with respect to a broad class of linear policies. Our empirical evaluations demonstrate the effectiveness of the proposed algorithm for control in population dynamics even for non-linear models such as SIR and replicator dynamics.


title: Projective and Carrollian geometry at time/space-like infinity on projectively compact Ricci flat Einstein manifolds

abstract: In this article we discuss how to construct canonical \emph{strong} Carrollian geometries at time/space like infinity of projectively compact Ricci flat Einstein manifolds $(M,g)$ and discuss the links between the underlying projective structure of the metric $g$. The obtained Carrollian geometries are determined by the data of the projective compactification. The key idea to achieve this is to consider a new type of Cartan geometry based on a non-effective homogeneous model for projective geometry. We prove that this structure is a general feature of projectively compact Ricci flat Einstein manifolds.


title: Fearless Stochasticity in Expectation Propagation

abstract: Expectation propagation (EP) is a family of algorithms for performing approximate inference in probabilistic models. The updates of EP involve the evaluation of moments -- expectations of certain functions -- which can be estimated from Monte Carlo (MC) samples. However, the updates are not robust to MC noise when performed naively, and various prior works have attempted to address this issue in different ways. In this work, we provide a novel perspective on the moment-matching updates of EP; namely, that they perform natural-gradient-based optimisation of a variational objective. We use this insight to motivate two new EP variants, with updates that are particularly well-suited to MC estimation; they remain stable and are most sample-efficient when estimated with just a single sample. These new variants combine the benefits of their predecessors and address key weaknesses. In particular, they are easier to tune, offer an improved speed-accuracy trade-off, and do not rely on the use of debiasing estimators. We demonstrate their efficacy on a variety of probabilistic inference tasks.


title: Motion Planning for Hybrid Dynamical Systems: Framework, Algorithm Template, and a Sampling-based Approach

abstract: This paper focuses on the motion planning problem for the systems exhibiting both continuous and discrete behaviors, which we refer to as hybrid dynamical systems. Firstly, the motion planning problem for hybrid systems is formulated using the hybrid equation framework, which is general to capture most hybrid systems. Secondly, a propagation algorithm template is proposed that describes a general framework to solve the motion planning problem for hybrid systems. Thirdly, a rapidly-exploring random trees (RRT) implementation of the proposed algorithm template is designed to solve the motion planning problem for hybrid systems. At each iteration, the proposed algorithm, called HyRRT, randomly picks a state sample and extends the search tree by flow or jump, which is also chosen randomly when both regimes are possible. Through a definition of concatenation of functions defined on hybrid time domains, we show that HyRRT is probabilistically complete, namely, the probability of failing to find a motion plan approaches zero as the number of iterations of the algorithm increases. This property is guaranteed under mild conditions on the data defining the motion plan, which include a relaxation of the usual positive clearance assumption imposed in the literature of classical systems. The motion plan is computed through the solution of two optimization problems, one associated with the flow and the other with the jumps of the system. The proposed algorithm is applied to an actuated bouncing ball system and a walking robot system so as to highlight its generality and computational features.


title: The clustering of Lyman Alpha Emitting galaxies at z=2-3

abstract: We measure the clustering of Lyman Alpha Emitting galaxies (LAEs) selected from the One-hundred-square-degree DECam Imaging in Narrowbands (ODIN) survey, with spectroscopic follow-up from Dark Energy Spectroscopic Instrument (DESI). We use DESI spectroscopy to optimize our selection and to constrain the interloper fraction and redshift distribution of our narrow-band selected sources. We select samples at z=2.45 and 3.1 in the COSMOS field with median Ly-alpha fluxes of 10^{-16}erg/s/cm2. Covariances and cosmological inferences are obtained from a series of mock catalogs built upon high-resolution N-body simulations that match the footprint, number density, redshift distribution and observed clustering of the sample. We find that both samples have a correlation length of r_0=3.0+/-0.2 Mpc/h. Within our fiducial cosmology these correspond to 3D number densities of 10^{-3}h3/Mpc3 and, from our mock catalogs, biases of 1.7 and 2.0 at z=2.45 and 3.1, respectively. We discuss the implications of these measurements for the use of LAEs as large-scale structure tracers for high-redshift cosmology.


title: Leader-Follower Density Control of Spatial Dynamics in Large-Scale Multi-Agent Systems

abstract: We address the problem of controlling the density of a large ensemble of follower agents by acting on group of leader agents that interact with them. We formulate the problem as a system of coupled partial integro-differential equations describing for the dynamics of the leaders' and followers' densities. We define feasibility conditions and propose two control architectures for exponential global stability. The first architecture is a feed-forward scheme for the followers. It adjusts the leaders' density via a feedback loop, which leverages information about leaders and a fixed reference density, to direct followers towards a target distribution. The second, dual feedback strategy employs a reference-governor to dynamically adapt the leaders' reference density based on measurements on both leaders and followers. Initially analyzed in one dimension, our methods are expanded to multi-dimensional applications. Numerical validations and an application in continuification-based control of leader-follower multiagent systems confirm the effectiveness of our approaches.


title: TabMDA: Tabular Manifold Data Augmentation for Any Classifier using Transformers with In-context Subsetting

abstract: Tabular data is prevalent in many critical domains, yet it is often challenging to acquire in large quantities. This scarcity usually results in poor performance of machine learning models on such data. Data augmentation, a common strategy for performance improvement in vision and language tasks, typically underperforms for tabular data due to the lack of explicit symmetries in the input space. To overcome this challenge, we introduce TabMDA, a novel method for manifold data augmentation on tabular data. This method utilises a pre-trained in-context model, such as TabPFN, to map the data into a manifold space. TabMDA performs label-invariant transformations by encoding the data multiple times with varied contexts. This process explores the manifold of the underlying in-context models, thereby enlarging the training dataset. TabMDA is a training-free method, making it applicable to any classifier. We evaluate TabMDA on five standard classifiers and observe significant performance improvements across various tabular datasets. Our results demonstrate that TabMDA provides an effective way to leverage information from pre-trained in-context models to enhance the performance of downstream classifiers.


title: Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generation

abstract: The advent of large language models (LLMs) has dramatically advanced the state-of-the-art in numerous natural language generation tasks. For LLMs to be applied reliably, it is essential to have an accurate measure of their confidence. Currently, the most commonly used confidence score function is the likelihood of the generated sequence, which, however, conflates semantic and syntactic components. For instance, in question-answering (QA) tasks, an awkward phrasing of the correct answer might result in a lower probability prediction. Additionally, different tokens should be weighted differently depending on the context. In this work, we propose enhancing the predicted sequence probability by assigning different weights to various tokens using attention values elicited from the base LLM. By employing a validation set, we can identify the relevant attention heads, thereby significantly improving the reliability of the vanilla sequence probability confidence measure. We refer to this new score as the Contextualized Sequence Likelihood (CSL). CSL is easy to implement, fast to compute, and offers considerable potential for further improvement with task-specific prompts. Across several QA datasets and a diverse array of LLMs, CSL has demonstrated significantly higher reliability than state-of-the-art baselines in predicting generation quality, as measured by the AUROC or AUARC.


title: Magnetic field evolution for crystallization-driven dynamos in C/O white dwarfs

abstract: We investigate the evolution of magnetic fields generated by the crystallization-driven dynamo in carbon-oxygen white dwarfs (WDs) with masses $\lesssim1.05\ M_{\odot}$. We use scalings for the dynamo to demonstrate that the initial magnetic field strength ($B_{0}$) has an upper limit that depends on the initial convection zone size ($R_{\mathrm{out},0}$) and the WD mass. We solve the induction equation to follow the magnetic field evolution after the dynamo phase ends. We show that the predicted surface magnetic field strength ($B_{\mathrm{surf}}$) differs from $B_{0}$ by at least a factor of $\sim$0.3. This reduction depends on $R_{\mathrm{out},0}$, where values smaller than half of the star radius give $B_{\mathrm{surf}}\lesssim0.01\ B_{0}$. We implement electrical conductivities that account for the solid phase effect on the Ohmic diffusion. We observe that the conductivity increases as the solid core grows, freezing in the magnetic field at a certain point of the evolution and slowing its outwards transport. We study the effect of turbulent magnetic diffusivity induced by the convection and find that for a small $R_{\mathrm{out},0}$, $B_{\mathrm{surf}}$ is stronger than the non-turbulent diffusion cases because of the more rapid transport, but still orders of magnitude smaller than $B_{0}$. Given these limitations, the crystallization-driven dynamo theory could explain only magnetic C/O WDs with field strengths less than a few MG for the mass range 0.45-1.05 $M_{\odot}$. Our results also suggest that a buried fossil field must be at least 100 times stronger than observed surface fields if crystallization-driven convection is responsible for its transport to the surface.


title: In-Context Learning of Physical Properties: Few-Shot Adaptation to Out-of-Distribution Molecular Graphs

abstract: Large language models manifest the ability of few-shot adaptation to a sequence of provided examples. This behavior, known as in-context learning, allows for performing nontrivial machine learning tasks during inference only. In this work, we address the question: can we leverage in-context learning to predict out-of-distribution materials properties? However, this would not be possible for structure property prediction tasks unless an effective method is found to pass atomic-level geometric features to the transformer model. To address this problem, we employ a compound model in which GPT-2 acts on the output of geometry-aware graph neural networks to adapt in-context information. To demonstrate our model's capabilities, we partition the QM9 dataset into sequences of molecules that share a common substructure and use them for in-context learning. This approach significantly improves the performance of the model on out-of-distribution examples, surpassing the one of general graph neural network models.


title: Use the 4S (Signal-Safe Speckle Subtraction): Explainable Machine Learning reveals the Giant Exoplanet AF Lep b in High-Contrast Imaging Data from 2011

abstract: The main challenge of exoplanet high-contrast imaging (HCI) is to separate the signal of exoplanets from their host stars, which are many orders of magnitude brighter. HCI for ground-based observations is further exacerbated by speckle noise originating from perturbations in the Earth's atmosphere and imperfections in the telescope optics. Various data post-processing techniques are used to remove this speckle noise and reveal the faint planet signal. Often, however, a significant part of the planet signal is accidentally subtracted together with the noise. In the present work, we use explainable machine learning to investigate the reason for the loss of the planet signal for one of the most used post-processing methods: Principal Component Analysis (PCA). We find that PCA learns the shape of the telescope point spread function for high numbers of PCA components. This representation of the noise captures not only the speckle noise, but also the characteristic shape of the planet signal. Building upon these insights, we develop a new post-processing method (4S) that constrains the noise model to minimize this signal loss. We apply our model to 11 archival HCI datasets from the VLT-NACO instrument in the L'-band and find that our model consistently outperforms PCA. The improvement is largest at close separations to the star ($\leq 4 \lambda /D$) providing up to 1.5 magnitudes deeper contrast. This enhancement enables us to detect the exoplanet AF Lep b in data from 2011, 11 years before its subsequent discovery. We present updated orbital parameters for this object.


title: The Modular Isomorphism Problem -- the alternative perspective on counterexamples

abstract: As a result of impressive research arXiv:2106.07231, D.~Garcia-Lucas, A. del Rio and L. Margolis defined an infinite series of non-isomorphic $2$-groups $G$ and $H$, whose group algebras $\mathbb{F}G$ and $\mathbb{F}H$ over the field $\mathbb{F}=\mathbb{F}_2$ are isomorphic, solving negatively the long-standing Modular Isomorphism Problem (MIP). In this note we give a different perspective on their examples and show that they are special cases of a more general construction. We also show that this type of construction for $p>2$ does not provide a similar counterexample to the MIP.


title: A Game-Theoretic Approach to Privacy-Utility Tradeoff in Sharing Genomic Summary Statistics

abstract: The advent of online genomic data-sharing services has sought to enhance the accessibility of large genomic datasets by allowing queries about genetic variants, such as summary statistics, aiding care providers in distinguishing between spurious genomic variations and those with clinical significance. However, numerous studies have demonstrated that even sharing summary genomic information exposes individual members of such datasets to a significant privacy risk due to membership inference attacks. While several approaches have emerged that reduce privacy risks by adding noise or reducing the amount of information shared, these typically assume non-adaptive attacks that use likelihood ratio test (LRT) statistics. We propose a Bayesian game-theoretic framework for optimal privacy-utility tradeoff in the sharing of genomic summary statistics. Our first contribution is to prove that a very general Bayesian attacker model that anchors our game-theoretic approach is more powerful than the conventional LRT-based threat models in that it induces worse privacy loss for the defender who is modeled as a von Neumann-Morgenstern (vNM) decision-maker. We show this to be true even when the attacker uses a non-informative subjective prior. Next, we present an analytically tractable approach to compare the Bayesian attacks with arbitrary subjective priors and the Neyman-Pearson optimal LRT attacks under the Gaussian mechanism common in differential privacy frameworks. Finally, we propose an approach for approximating Bayes-Nash equilibria of the game using deep neural network generators to implicitly represent player mixed strategies. Our experiments demonstrate that the proposed game-theoretic framework yields both stronger attacks and stronger defense strategies than the state of the art.


title: Memory Capacity Analysis of Time-delay Reservoir Computing Based on Silicon Microring Resonator Nonlinearities

abstract: Silicon microring resonators (MRRs) have shown strong potential in acting as the nonlinear nodes of photonic reservoir computing (RC) schemes. By using nonlinearities within a silicon MRR, such as the ones caused by free-carrier dispersion (FCD) and thermo-optic (TO) effects, it is possible to map the input data of the RC to a higher dimensional space. Furthermore, by adding an external waveguide between the through and add ports of the MRR, it is possible to implement a time-delay RC (TDRC) with enhanced memory. The input from the through port is fed back into the add port of the ring with the delay applied by the external waveguide effectively adding memory. In a TDRC, the nodes are multiplexed in time, and their respective time evolutions are detected at the drop port. The performance of MRR-based TDRC is highly dependent on the amount of nonlinearity in the MRR. The nonlinear effects, in turn, are dependent on the physical properties of the MRR as they determine the lifetime of the effects. Another factor to take into account is the stability of the MRR response, as strong time-domain discontinuities at the drop port are known to emerge from FCD nonlinearities due to self-pulsing (high nonlinear behaviour). However, quantifying the right amount of nonlinearity that RC needs for a certain task in order to achieve optimum performance is challenging. Therefore, further analysis is required to fully understand the nonlinear dynamics of this TDRC setup. Here, we quantify the nonlinear and linear memory capacity of the previously described microring-based TDRC scheme, as a function of the time constants of the generated carriers and the thermal of the TO effects. We analyze the properties of the TDRC dynamics that generate the parameter space, in terms of input signal power and frequency detuning range, over which conventional RC tasks can be satisfactorily performed by the TDRC scheme.


title: Diffusion Boosted Trees

abstract: Combining the merits of both denoising diffusion probabilistic models and gradient boosting, the diffusion boosting paradigm is introduced for tackling supervised learning problems. We develop Diffusion Boosted Trees (DBT), which can be viewed as both a new denoising diffusion generative model parameterized by decision trees (one single tree for each diffusion timestep), and a new boosting algorithm that combines the weak learners into a strong learner of conditional distributions without making explicit parametric assumptions on their density forms. We demonstrate through experiments the advantages of DBT over deep neural network-based diffusion models as well as the competence of DBT on real-world regression tasks, and present a business application (fraud detection) of DBT for classification on tabular data with the ability of learning to defer.


title: ZAPP! Zonotope Agreement of Prediction and Planning for Continuous-Time Collision Avoidance with Discrete-Time Dynamics

abstract: The past few years have seen immense progress on two fronts that are critical to safe, widespread mobile robot deployment: predicting uncertain motion of multiple agents, and planning robot motion under uncertainty. However, the numerical methods required on each front have resulted in a mismatch of representation for prediction and planning. In prediction, numerical tractability is usually achieved by coarsely discretizing time, and by representing multimodal multi-agent interactions as distributions with infinite support. On the other hand, safe planning typically requires very fine time discretization, paired with distributions with compact support, to reduce conservativeness and ensure numerical tractability. The result is, when existing predictors are coupled with planning and control, one may often find unsafe motion plans. This paper proposes ZAPP (Zonotope Agreement of Prediction and Planning) to resolve the representation mismatch. ZAPP unites a prediction-friendly coarse time discretization and a planning-friendly zonotope uncertainty representation; the method also enables differentiating through a zonotope collision check, allowing one to integrate prediction and planning within a gradient-based optimization framework. Numerical examples show how ZAPP can produce safer trajectories compared to baselines in interactive scenes.


title: Deep asymmetric mixture model for unsupervised cell segmentation

abstract: Automated cell segmentation has become increasingly crucial for disease diagnosis and drug discovery, as manual delineation is excessively laborious and subjective. To address this issue with limited manual annotation, researchers have developed semi/unsupervised segmentation approaches. Among these approaches, the Deep Gaussian mixture model plays a vital role due to its capacity to facilitate complex data distributions. However, these models assume that the data follows symmetric normal distributions, which is inapplicable for data that is asymmetrically distributed. These models also obstacles weak generalization capacity and are sensitive to outliers. To address these issues, this paper presents a novel asymmetric mixture model for unsupervised cell segmentation. This asymmetric mixture model is built by aggregating certain multivariate Gaussian mixture models with log-likelihood and self-supervised-based optimization functions. The proposed asymmetric mixture model outperforms (nearly 2-30% gain in dice coefficient, p<0.05) the existing state-of-the-art unsupervised models on cell segmentation including the segment anything.


title: Categories of quantum cpos

abstract: This paper unites two research lines. The first involves finding categorical models of quantum programming languages and their type systems. The second line concerns the program of quantization of mathematical structures, which amounts to finding noncommutative generalizations (also called quantum generalizations) of these structures. Using a quantization method called discrete quantization, which essentially amounts to the internalization of structures in a category of von Neumann algebras and quantum relations, we find a noncommutative generalization of $\omega$-complete partial orders (cpos), called quantum cpos. Cpos are central in domain theory, and are widely used to construct categorical models of programming languages. We show that quantum cpos have similar categorical properties to cpos and are therefore suitable for the construction of categorical models for quantum programming languages, which is illustrated with some examples. For this reason, quantum cpos may form the backbone of a future quantum domain theory.

categories: math-ph cs.LO math.CT math.MP math.OA quant-ph


title: Managing the Growing Complexity of Multi-Messenger Transient Events with Astro-COLIBRI

abstract: Observations of transient phenomena, such as GRBs, FRBs, novae/supernovae explosions, coupled with the detection of cosmic messengers like high-energy neutrinos and gravitational waves, have transformed astrophysics. Maximizing the discovery potential necessitates tools for swiftly acquiring an overview of the most relevant information for each new detection. Introducing Astro-COLIBRI, a comprehensive platform designed to meet this challenge. Astro-COLIBRI features a public API, real-time databases and alert systems, a discussion forum, and a website and iOS/Android apps as user clients. In real time, it evaluates incoming astronomical observation messages from all available alert streams, filters them based on user-defined criteria, and contextualizes them in the multi-wavelength (MWL) and multi-messenger (MM) context. User clients offer a graphical representation, providing a succinct summary for quick identification of interesting phenomena and assessing observing conditions globally.


title: Long-term foehn reconstruction combining unsupervised and supervised learning

abstract: Foehn winds, characterized by abrupt temperature increases and wind speed changes, significantly impact regions on the leeward side of mountain ranges, e.g., by spreading wildfires. Understanding how foehn occurrences change under climate change is crucial. Unfortunately, foehn cannot be measured directly but has to be inferred from meteorological measurements employing suitable classification schemes. Hence, this approach is typically limited to specific periods for which the necessary data are available. We present a novel approach for reconstructing historical foehn occurrences using a combination of unsupervised and supervised probabilistic statistical learning methods. We utilize in-situ measurements (available for recent decades) to train an unsupervised learner (finite mixture model) for automatic foehn classification. These labeled data are then linked to reanalysis data (covering longer periods) using a supervised learner (lasso or boosting). This allows to reconstruct past foehn probabilities based solely on reanalysis data. Applying this method to ERA5 reanalysis data for six stations across Switzerland and Austria achieves accurate hourly reconstructions of north and south foehn occurrence, respectively, dating back to 1940. This paves the way for investigating how seasonal foehn patterns have evolved over the past 83 years, providing valuable insights into climate change impacts on these critical wind events.


title: Bayesian Linear Models: A compact general set of results

abstract: I present all the details in calculating the posterior distribution of the conjugate Normal-Gamma prior in Bayesian Linear Models (BLM), including correlated observations, prediction, model selection and comments on efficient numeric implementations. A Python implementation is also presented. These have been presented and available in many books and texts but, I believe, a general compact and simple presentation is always welcome and not always simple to find. Since correlated observations are also included, these results may also be useful for time series analysis and spacial statistics. Other particular cases presented include regression, Gaussian processes and Bayesian Dynamic Models.


title: Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning

abstract: Recent advances in neural network pruning have shown how it is possible to reduce the computational costs and memory demands of deep learning models before training. We focus on this framework and propose a new pruning at initialization algorithm that leverages the Neural Tangent Kernel (NTK) theory to align the training dynamics of the sparse network with that of the dense one. Specifically, we show how the usually neglected data-dependent component in the NTK's spectrum can be taken into account by providing an analytical upper bound to the NTK's trace obtained by decomposing neural networks into individual paths. This leads to our Path eXclusion (PX), a foresight pruning method designed to preserve the parameters that mostly influence the NTK's trace. PX is able to find lottery tickets (i.e. good paths) even at high sparsity levels and largely reduces the need for additional training. When applied to pre-trained models it extracts subnetworks directly usable for several downstream tasks, resulting in performance comparable to those of the dense counterpart but with substantial cost and computational savings. Code available at: https://github.com/iurada/px-ntk-pruning


title: GPU-Accelerated Rule Evaluation and Evolution

abstract: This paper introduces an innovative approach to boost the efficiency and scalability of Evolutionary Rule-based machine Learning (ERL), a key technique in explainable AI. While traditional ERL systems can distribute processes across multiple CPUs, fitness evaluation of candidate rules is a bottleneck, especially with large datasets. The method proposed in this paper, AERL (Accelerated ERL) solves this problem in two ways. First, by adopting GPU-optimized rule sets through a tensorized representation within the PyTorch framework, AERL mitigates the bottleneck and accelerates fitness evaluation significantly. Second, AERL takes further advantage of the GPUs by fine-tuning the rule coefficients via back-propagation, thereby improving search space exploration. Experimental evidence confirms that AERL search is faster and more effective, thus empowering explainable artificial intelligence.


title: Infection fronts in randomly varying transmission-rate media

abstract: We numerically investigate the geometry and transport properties of infection fronts within the spatial SIR model in two dimensions. The model incorporates short-range correlated quenched random transmission rates. Our findings reveal that the critical average transmission rate for the steady-state propagation of the infection is overestimated by the naive mean-field homogenization. Furthermore, we observe that the velocity, profile, and harmfulness of the fronts, given a specific average transmission, are sensitive to the details of randomness. In particular, we find that the harmfulness of the front is larger the more uniform the transmission-rate is, suggesting potential optimization in vaccination strategies under constraints like fixed average-transmission-rates or limited vaccine resources. The large-scale geometry of the advancing fronts presents nevertheless robust universal features and, for a statistically isotropic and short-range correlated disorder, we get a roughness exponent $\alpha\approx 0.42 \pm 0.10$ and a dynamical exponent $z\approx 1.6 \pm 0.10$, which are roughly compatible with the one-dimensional Kardar-Parisi-Zhang (KPZ) universality class. We find that the KPZ term and the disorder-induced effective noise are present and have a kinematic origin.


title: Causal Discovery with Fewer Conditional Independence Tests

abstract: Many questions in science center around the fundamental problem of understanding causal relationships. However, most constraint-based causal discovery algorithms, including the well-celebrated PC algorithm, often incur an exponential number of conditional independence (CI) tests, posing limitations in various applications. Addressing this, our work focuses on characterizing what can be learned about the underlying causal graph with a reduced number of CI tests. We show that it is possible to a learn a coarser representation of the hidden causal graph with a polynomial number of tests. This coarser representation, named Causal Consistent Partition Graph (CCPG), comprises of a partition of the vertices and a directed graph defined over its components. CCPG satisfies consistency of orientations and additional constraints which favor finer partitions. Furthermore, it reduces to the underlying causal graph when the causal graph is identifiable. As a consequence, our results offer the first efficient algorithm for recovering the true causal graph with a polynomial number of tests, in special cases where the causal graph is fully identifiable through observational data and potentially additional interventions.


title: Error Field Predictability and Consequences for ITER

abstract: ITER coil tolerances are re-evaluated using the modern understanding of coupling to least-stable plasma modes and an updated center-line-traced model of ITER's coil windings. This reassessment finds the tolerances to be conservative through a statistical, linear study of $n=1$ error fields (EFs) due to tilted, shifted misplacements and nominal windings of central solenoid and poloidal field coils within tolerance. We also show that a model-based correction scheme remains effective even when metrology quality is sub-optimal, and compare this to projected empirical correction schemes. We begin with an analysis of the necessity of error field correction (EFC) for daily operation in ITER using scaling laws for the EF penetration threshold. We then consider the predictability of EF dominant mode overlap across early planned ITER scenarios and, as measuring EFs in high power scenarios can pose risks to the device, the potential for extrapolation to the ITER Baseline Scenario (IBS). We find that carefully designing a scenario matching currents proportionally to those of the IBS is far more important than plasma shape or profiles in accurately measuring an optimal correction current set.


title: EMOE: Expansive Matching of Experts for Robust Uncertainty Based Rejection

abstract: Expansive Matching of Experts (EMOE) is a novel method that utilizes support-expanding, extrapolatory pseudo-labeling to improve prediction and uncertainty based rejection on out-of-distribution (OOD) points. We propose an expansive data augmentation technique that generates OOD instances in a latent space, and an empirical trial based approach to filter out augmented expansive points for pseudo-labeling. EMOE utilizes a diverse set of multiple base experts as pseudo-labelers on the augmented data to improve OOD performance through a shared MLP with multiple heads (one per expert). We demonstrate that EMOE achieves superior performance compared to state-of-the-art methods on tabular data.


title: Global existence of solutions to the fully parabolic chemotaxis system with logistic source under nonlinear Neumann boundary conditions

abstract: We study the existence of global boundedness solutions to the fully parabolic chemotaxis systems with logistic sources, $ru- \mu u^2$, under nonlinear Neumann boundary conditions, $\frac{\partial u}{\partial \nu }= |u|^p$ where $p >1 $ in smooth bounded domain $\Omega \subset \mathbb{R}^n$ with $n \geq 2$. A recent study by Le (2023) has shown that the logistic sources can ensure that solutions are global and bounded when $n =2$ with $p < \frac{3}{2}$ and $n=3$ with $p <\frac{7}{5}$. In this paper, we extend the previous findings by demonstrating the existence of global bounded solutions when $p< \frac{3}{2}$ in any spatial dimension $n \geq 2$.


title: Measuring the magnetic dipole moment and magnetospheric fluctuations of accretion-powered pulsars in the Small Magellanic Cloud with an unscented Kalman filter

abstract: Many accretion-powered pulsars rotate in magnetocentrifugal disequilibrium, spinning up or down secularly over multi-year intervals. The magnetic dipole moment $\mu$ of such systems cannot be inferred uniquely from the time-averaged aperiodic X-ray flux $\langle L(t) \rangle$ and pulse period $\langle P(t) \rangle$, because the radiative efficiency of the accretion is unknown and degenerate with the mass accretion rate. Here we circumvent the degeneracy by tracking the fluctuations in the unaveraged time series $L(t)$ and $P(t)$ using an unscented Kalman filter, whereupon $\mu$ can be estimated uniquely, up to the uncertainties in the mass, radius and distance of the star. The analysis is performed on Rossi X-ray Timing Explorer observations for $24$ X-ray transients in the Small Magellanic Cloud, which have been monitored regularly for $\sim 16$ years. As well as independent estimates of $\mu$, the analysis yields time-resolved histories of the mass accretion rate and the Maxwell stress at the disk-magnetosphere boundary for each star, and hence auto- and cross-correlations involving the latter two state variables. The inferred fluctuation statistics convey important information about the complex accretion physics at the disk-magnetosphere boundary.


title: Spectral Flow for the Riemann zeros

abstract: Recently, with Mussardo we defined a quantum mechanical problem of a single particle scattering with impurities wherein the quantized energy levels $E_n (\sigma)$ are exactly equal to the zeros of the Riemann $\zeta (s)$ where $\sigma = \Re (s)$ in the limit $\sigma \to 1/2$. The S-matrix is based on the Euler product and is unitary by construction, thus the underlying hamiltonian is hermitian and all eigenvalues must be real. Motivated by the Hilbert-P\'olya idea we study the spectral flows for $\{ E_n (\sigma) \}$. This leads to a simple criterion for the validity of the Riemann Hypothesis. The spectral flow arguments are simple enough that we present analogous results for the Generalized and Grand Riemann Hypotheses. We also illustrate our results for a counter example where the Riemann Hypothesis is violated since there is no underlying unitary S-matrix due to the lack of an Euler product.

categories: math-ph cond-mat.dis-nn hep-th math.MP math.NT


title: FacAID: A Transformer Model for Neuro-Symbolic Facade Reconstruction

abstract: We introduce a neuro-symbolic transformer-based model that converts flat, segmented facade structures into procedural definitions using a custom-designed split grammar. To facilitate this, we first develop a semi-complex split grammar tailored for architectural facades and then generate a dataset comprising of facades alongside their corresponding procedural representations. This dataset is used to train our transformer model to convert segmented, flat facades into the procedural language of our grammar. During inference, the model applies this learned transformation to new facade segmentations, providing a procedural representation that users can adjust to generate varied facade designs. This method not only automates the conversion of static facade images into dynamic, editable procedural formats but also enhances the design flexibility, allowing for easy modifications and variations by architects and designers. Our approach sets a new standard in facade design by combining the precision of procedural generation with the adaptability of neuro-symbolic learning.


title: Affine vertex operator superalgebra $L_{\widehat{osp(1|2)}}(\mathcal{l},0)$ at admissible level

abstract: Let $L_{\widehat{osp(1|2)}}(\mathcal{l},0)$ be the simple affine vertex operator superalgebra with admissible level $\mathcal{l}$. We prove that the category of weak $L_{\widehat{osp(1|2)}}(\mathcal{l},0)$-modules on which the positive part of $\widehat{osp(1|2)}$ acts locally nilpotent is semisimple. Then we prove that $\mathbb{Q}$-graded vertex operator superalgebras $(L_{\widehat{osp(1|2)}}(\mathcal{l},0),\omega_\xi)$ with new Virasoro elements $\omega_\xi$ are rational and the irreducible modules are exactly the admissible modules for $\widehat{osp(1|2)}$, where $0<\xi<1$ is a rational number. Furthermore, we determine the Zhu's algebras $A(L_{\widehat{osp(1|2)}}(\mathcal{l},0))$ and their bimodules $A(L(\mathcal{l},\mathcal{j}))$ for $(L_{\widehat{osp(1|2)}}(\mathcal{l},0),\omega_\xi)$, where $\mathcal{j}$ is the admissible weight. As an application, we calculate the fusion rules among the irreducible ordinary modules of $(L_{\widehat{osp(1|2)}}(\mathcal{l},0),\omega_\xi)$.


title: Feedback in Emerging Extragalactic Star Clusters (JWST--FEAST): Calibration of Star Formation Rates in the Mid-Infrared with NGC 628

abstract: New JWST near-infrared imaging of the nearby galaxy NGC 628 from the Cycle 1 program JWST-FEAST is combined with archival JWST mid-infrared imaging to calibrate the 21 $\mu$m emission as a star formation rate indicator (SFR) at $\sim$120 pc scales. The Pa$\alpha$ ($\lambda$1.8756 $\mu$m) hydrogen recombination emission line targeted by FEAST provides a reference SFR indicator that is relatively insensitive to dust attenuation, as demonstrated by combining this tracer with the HST H$\alpha$ imaging. Our analysis is restricted to regions that appear compact in nebular line emission and are sufficiently bright to mitigate effects of both age and stochastic sampling of the stellar initial mass function. We find that the 21 $\mu$m emission closely correlates with the nebular line emission, with a power-law with exponent=1.07$\pm$0.01, in agreement with past results. We calibrate a hybrid SFR indicator using a combination of H$\alpha$ and 24 $\mu$m (extrapolated from 21 $\mu$m) tracers and derive the proportionality constant between the two tracers $b=0.095\pm0.007$, which is $\sim$ 3-5 times larger than previous derivations using large regions/entire galaxies. We model these discrepancies as an increasing contribution to the dust heating by progressively older stellar populations for increasing spatial scales, in agreement with earlier findings that star formation is hierarchically distributed in galaxies. Thus, use of hybrid SFR indicators requires prior knowledge of the mean age of the stellar populations dominating the dust heating, which makes their application uncertain. Conversely, non-linear calibrations of SFRs from L(24) alone are more robust, with a factor $\lesssim$2.5 variation across the entire range of L(24) luminosities from HII regions to galaxies.


title: A Robust Filter for Marker-less Multi-person Tracking in Human-Robot Interaction Scenarios

abstract: Pursuing natural and marker-less human-robot interaction (HRI) has been a long-standing robotics research focus, driven by the vision of seamless collaboration without physical markers. Marker-less approaches promise an improved user experience, but state-of-the-art struggles with the challenges posed by intrinsic errors in human pose estimation (HPE) and depth cameras. These errors can lead to issues such as robot jittering, which can significantly impact the trust users have in collaborative systems. We propose a filtering pipeline that refines incomplete 3D human poses from an HPE backbone and a single RGB-D camera to address these challenges, solving for occlusions that can degrade the interaction. Experimental results show that using the proposed filter leads to more consistent and noise-free motion representation, reducing unexpected robot movements and enabling smoother interaction.


title: CAFO: Feature-Centric Explanation on Time Series Classification

abstract: In multivariate time series (MTS) classification, finding the important features (e.g., sensors) for model performance is crucial yet challenging due to the complex, high-dimensional nature of MTS data, intricate temporal dynamics, and the necessity for domain-specific interpretations. Current explanation methods for MTS mostly focus on time-centric explanations, apt for pinpointing important time periods but less effective in identifying key features. This limitation underscores the pressing need for a feature-centric approach, a vital yet often overlooked perspective that complements time-centric analysis. To bridge this gap, our study introduces a novel feature-centric explanation and evaluation framework for MTS, named CAFO (Channel Attention and Feature Orthgonalization). CAFO employs a convolution-based approach with channel attention mechanisms, incorporating a depth-wise separable channel attention module (DepCA) and a QR decomposition-based loss for promoting feature-wise orthogonality. We demonstrate that this orthogonalization enhances the separability of attention distributions, thereby refining and stabilizing the ranking of feature importance. This improvement in feature-wise ranking enhances our understanding of feature explainability in MTS. Furthermore, we develop metrics to evaluate global and class-specific feature importance. Our framework's efficacy is validated through extensive empirical analyses on two major public benchmarks and real-world datasets, both synthetic and self-collected, specifically designed to highlight class-wise discriminative features. The results confirm CAFO's robustness and informative capacity in assessing feature importance in MTS classification tasks. This study not only advances the understanding of feature-centric explanations in MTS but also sets a foundation for future explorations in feature-centric explanations.


title: Multi-Task Learning for Arousal and Sleep Stage Detection Using Fully Convolutional Networks

abstract: Objective. Sleep is a critical physiological process that plays a vital role in maintaining physical and mental health. Accurate detection of arousals and sleep stages is essential for the diagnosis of sleep disorders, as frequent and excessive occurrences of arousals disrupt sleep stage patterns and lead to poor sleep quality, negatively impacting physical and mental health. Polysomnography is a traditional method for arousal and sleep stage detection that is time-consuming and prone to high variability among experts. Approach. In this paper, we propose a novel multi-task learning approach for arousal and sleep stage detection using fully convolutional neural networks. Our model, FullSleepNet, accepts a full-night single-channel EEG signal as input and produces segmentation masks for arousal and sleep stage labels. FullSleepNet comprises four modules: a convolutional module to extract local features, a recurrent module to capture long-range dependencies, an attention mechanism to focus on relevant parts of the input, and a segmentation module to output final predictions. Main results. By unifying the two interrelated tasks as segmentation problems and employing a multi-task learning approach, FullSleepNet achieves state-of-the-art performance for arousal detection with an area under the precision-recall curve of 0.70 on Sleep Heart Health Study and Multi-Ethnic Study of Atherosclerosis datasets. For sleep stage classification, FullSleepNet obtains comparable performance on both datasets, achieving an accuracy of 0.88 on the former and an accuracy of 0.83 on the latter. Significance. Our results demonstrate that FullSleepNet offers improved practicality, efficiency, and accuracy for the detection of arousal and classification of sleep stages using raw EEG signals as input.


title: An Open Multilingual System for Scoring Readability of Wikipedia

abstract: With over 60M articles, Wikipedia has become the largest platform for open and freely accessible knowledge. While it has more than 15B monthly visits, its content is believed to be inaccessible to many readers due to the lack of readability of its text. However, previous investigations of the readability of Wikipedia have been restricted to English only, and there are currently no systems supporting the automatic readability assessment of the 300+ languages in Wikipedia. To bridge this gap, we develop a multilingual model to score the readability of Wikipedia articles. To train and evaluate this model, we create a novel multilingual dataset spanning 14 languages, by matching articles from Wikipedia to simplified Wikipedia and online children encyclopedias. We show that our model performs well in a zero-shot scenario, yielding a ranking accuracy of more than 80% across 14 languages and improving upon previous benchmarks. These results demonstrate the applicability of the model at scale for languages in which there is no ground-truth data available for model fine-tuning. Furthermore, we provide the first overview on the state of readability in Wikipedia beyond English.


title: Scott analysis, linear orders and almost periodic functions

abstract: For any limit ordinal $\lambda$, we construct a linear order $L_\lambda$ whose Scott complexity is $\Sigma_{\lambda+1}$. This completes the classification of the possible Scott sentence complexities of linear orderings. Previously, there was only one known construction of any structure (of any signature) with Scott complexity $\Sigma_{\lambda+1}$, and our construction gives new examples, e.g., rigid structures, of this complexity. Moreover, we can construct the linear orders $L_\lambda$ so that not only does $L_\lambda$ have Scott complexity $\Sigma_{\lambda+1}$, but there are continuum-many structures $M \equiv_\lambda L_\lambda$ and all such structures also have Scott complexity $\Sigma_{\lambda+1}$. In contrast, we demonstrate that there is no structure (of any signature) with Scott complexity $\Pi_{\lambda+1}$ that is only $\lambda$-equivalent to structures with Scott complexity $\Pi_{\lambda+1}$. Our construction is based on functions $f \colon \mathbb{Z}\to \mathbb{N}\cup \{\infty\}$ which are almost periodic but not periodic, such as those arising from shifts of the $p$-adic valuations.


title: Boosting Vision-Language Models with Transduction

abstract: Transduction is a powerful paradigm that leverages the structure of unlabeled data to boost predictive accuracy. We present TransCLIP, a novel and computationally efficient transductive approach designed for Vision-Language Models (VLMs). TransCLIP is applicable as a plug-and-play module on top of popular inductive zero- and few-shot models, consistently improving their performances. Our new objective function can be viewed as a regularized maximum-likelihood estimation, constrained by a KL divergence penalty that integrates the text-encoder knowledge and guides the transductive learning process. We further derive an iterative Block Majorize-Minimize (BMM) procedure for optimizing our objective, with guaranteed convergence and decoupled sample-assignment updates, yielding computationally efficient transduction for large-scale datasets. We report comprehensive evaluations, comparisons, and ablation studies that demonstrate: (i) Transduction can greatly enhance the generalization capabilities of inductive pretrained zero- and few-shot VLMs; (ii) TransCLIP substantially outperforms standard transductive few-shot learning methods relying solely on vision features, notably due to the KL-based language constraint.


title: Learning the Target Network in Function Space

abstract: We focus on the task of learning the value function in the reinforcement learning (RL) setting. This task is often solved by updating a pair of online and target networks while ensuring that the parameters of these two networks are equivalent. We propose Lookahead-Replicate (LR), a new value-function approximation algorithm that is agnostic to this parameter-space equivalence. Instead, the LR algorithm is designed to maintain an equivalence between the two networks in the function space. This value-based equivalence is obtained by employing a new target-network update. We show that LR leads to a convergent behavior in learning the value function. We also present empirical results demonstrating that LR-based target-network updates significantly improve deep RL on the Atari benchmark.


title: Simulation of DAMPE silicon microstrip detectors in the $\rm Allpix^{2}$ framework

abstract: Silicon strip detectors have been widely utilized in space experiments for gamma-ray and cosmic-ray detections thanks to their high spatial resolution and stable performance. For a silicon micro-strip detector, the Monte Carlo simulation is recognized as a practical and cost-effective approach to verify the detector performance. In this study, a technique for the simulation of the silicon micro-strip detector with the $\rm Allpix^{2}$ framework is developed. By incorporating the electric field into the particle transport simulation based on Geant4, this framework could precisely emulate the carrier drift in the silicon micro-strip detector. The simulation results are validated using the beam test data as well as the flight data of the DAMPE experiment, which suggests that the $\rm Allpix^{2}$ framework is a powerful tool to obtain the performance of the silicon micro-strip detector.


title: Hybrid Maximal Filter Spaces

abstract: We introduce a new way of encoding general topology in second order arithmetic that we call hybrid maximal filter (hybrid MF) spaces. This notion is a modification of the notion of a proper MF space introduced by Montalb\'an. We justify the shift by showing that proper MF spaces are not able to code most topological spaces, while hybrid MF spaces can code any second countable MF space. We then answer Montalb\'an's question about metrization of well-behaved MF spaces to this shifted context. To be specific, we show that in stark contrast to the original MF formalization used by Mummert and Simpson, the metrization theorem can be proven for hybrid MF spaces within $\text{ACA}_0$ instead of needing $\Pi_2^1-\text{CA}_0$.


title: Short-range order and local distortions in entropy stabilized oxides

abstract: An idealized high entropy oxide is characterized by perfect chemical disorder and perfect positional order. In this work, we investigate the extent to which short-range order (SRO) and local structural distortions impede that idealized scenario. Working in the entropy stabilized $\alpha$-PbO$_2$ structure, we compare a two-component system, (Ti,Zr)O$_2$, with a four-component system, (Ti,Zr,Hf,Sn)O$_2$, using a combination of experimental and computational approaches. Special quasi-random structures are used in conjunction with density functional theory calculations to investigate the local distortions around specific elements revealing significant local distortions that are relatively insensitive to the number of chemical constituents. Using finite temperature Monte Carlo simulations, we are able to reproduce the previously experimentally observed SRO and transition temperature for the two-component system. However, ideal configurational entropy is never reached, so SRO is expected even at synthesis temperatures. On the other hand, the order-disorder transition temperature is dramatically lower and experimentally inaccessible for the four-component system, while the configurational entropy is closer to ideal and less sensitive to temperature. Total scattering measurements and pair distribution function analysis of slow-cooled and quenched samples support this view. In general, we demonstrate that SRO effects in high entropy materials are less prevalent as more components are added in, provided the pairwise interaction strengths remain comparable, while local distortions are less affected by the number of components.


title: GraphWeaver: Billion-Scale Cybersecurity Incident Correlation

abstract: In the dynamic landscape of large enterprise cybersecurity, accurately and efficiently correlating billions of security alerts into comprehensive incidents is a substantial challenge. Traditional correlation techniques often struggle with maintenance, scaling, and adapting to emerging threats and novel sources of telemetry. We introduce GraphWeaver, an industry-scale framework that shifts the traditional incident correlation process to a data-optimized, geo-distributed graph based approach. GraphWeaver introduces a suite of innovations tailored to handle the complexities of correlating billions of shared evidence alerts across hundreds of thousands of enterprises. Key among these innovations are a geo-distributed database and PySpark analytics engine for large-scale data processing, a minimum spanning tree algorithm to optimize correlation storage, integration of security domain knowledge and threat intelligence, and a human-in-the-loop feedback system to continuously refine key correlation processes and parameters. GraphWeaver is integrated into the Microsoft Defender XDR product and deployed worldwide, handling billions of correlations with a 99% accuracy rate, as confirmed by customer feedback and extensive investigations by security experts. This integration has not only maintained high correlation accuracy but reduces traditional correlation storage requirements by 7.4x. We provide an in-depth overview of the key design and operational features of GraphWeaver, setting a precedent as the first cybersecurity company to openly discuss these critical capabilities at this level of depth.