title: A case study of university student networks and the COVID-19 pandemic using a social network analysis approach in halls of residence

abstract: The COVID-19 pandemic has meant that young university students have had to adapt their learning and have a reduced relational context. Adversity contexts build models of human behaviour based on relationships. However, there is a lack of studies that analyse the behaviour of university students based on their social structure in the context of a pandemic. This information could be useful in making decisions on how to plan collective responses to adversities. The Social Network Analysis (SNA) method has been chosen to address this structural perspective. The aim of our research is to describe the structural behaviour of students in university residences during the COVID-19 pandemic with a more in-depth analysis of student leaders. A descriptive cross-sectional study was carried out at one Spanish Public University, Le\'on, from 23th October 2020 to 20th November 2020. The participation was of 93 students, from four halls of residence. The data were collected from a database created specifically at the university to "track" contacts in the COVID-19 pandemic, SiVeUle. We applied the SNA for the analysis of the data. The leadership on the university residence was measured using centrality measures. The top leaders were analyzed using the Egonetwork and an assessment of the key players. Students with higher social reputations experience higher levels of pandemic contagion in relation to COVID-19 infection. The results were statistically significant between the centrality in the network and the results of the COVID-19 infection. The most leading students showed a high degree of Betweenness, and three students had the key player structure in the network. Networking behaviour of university students in halls of residence could be related to contagion in the COVID-19 pandemic.


title: Textural properties of dense granular pastes produced by kneading

abstract: The efficiency of supported catalysts depends on the porous microstructure of their solid support, which regulates mass transfer, exposure to the active phase, and mechanical strength. Here, we focus on the manufacturing of a specific type of catalytic support, $\gamma$-alumina extrudates, by a kneading-extrusion process. In this process, a paste is initially formed by blending and subsequently kneading a boehmite powder, an aluminum oxide hydroxide precursor of $\gamma$-alumina, with various liquids before undergoing extrusion. The crucial step in this process is the kneading step, which allows control over the textural and mechanical properties of the extrudate. The present experimental study aims to measure the impact of the kneading step on boehmite pastes prepared using a pilot kneader. The pastes are obtained by mixing boehmite powder with an acid and a basic solution in a two-step process known as peptization and neutralization. In this study, kneading is conducted at various mixing speeds and durations while monitoring the torque exerted by the boehmite paste on the kneader blades. Moreover, samples are extracted from the pilot kneader at various stages of the kneading process, and their textural properties are determined by both nitrogen sorption and mercury intrusion porosimetry. Our findings show that, at fixed composition, the textural properties of boehmite pastes are controlled by the overall deformation accumulated during kneading. Conversely, for a fixed accumulated deformation, the pH sets the textural properties. Finally, we identify an empirical control parameter that captures the combined effects of pH and accumulated deformation on the key textural attributes of boehmite pastes. These results set the stage for a systematic design approach of boehmite-based catalyst supports.


title: Spectral Filters, Dark Signals, and Attention Sinks

abstract: Projecting intermediate representations onto the vocabulary is an increasingly popular interpretation tool for transformer-based LLMs, also known as the logit lens. We propose a quantitative extension to this approach and define spectral filters on intermediate representations based on partitioning the singular vectors of the vocabulary embedding and unembedding matrices into bands. We find that the signals exchanged in the tail end of the spectrum are responsible for attention sinking (Xiao et al. 2023), of which we provide an explanation. We find that the loss of pretrained models can be kept low despite suppressing sizable parts of the embedding spectrum in a layer-dependent way, as long as attention sinking is preserved. Finally, we discover that the representation of tokens that draw attention from many tokens have large projections on the tail end of the spectrum.


title: Integrating ytopt and libEnsemble to Autotune OpenMC

abstract: ytopt is a Python machine-learning-based autotuning software package developed within the ECP PROTEAS-TUNE project. The ytopt software adopts an asynchronous search framework that consists of sampling a small number of input parameter configurations and progressively fitting a surrogate model over the input-output space until exhausting the user-defined maximum number of evaluations or the wall-clock time. libEnsemble is a Python toolkit for coordinating workflows of asynchronous and dynamic ensembles of calculations across massively parallel resources developed within the ECP PETSc/TAO project. libEnsemble helps users take advantage of massively parallel resources to solve design, decision, and inference problems and expands the class of problems that can benefit from increased parallelism. In this paper we present our methodology and framework to integrate ytopt and libEnsemble to take advantage of massively parallel resources to accelerate the autotuning process. Specifically, we focus on using the proposed framework to autotune the ECP ExaSMR application OpenMC, an open source Monte Carlo particle transport code. OpenMC has seven tunable parameters some of which have large ranges such as the number of particles in-flight, which is in the range of 100,000 to 8 million, with its default setting of 1 million. Setting the proper combination of these parameter values to achieve the best performance is extremely time-consuming. Therefore, we apply the proposed framework to autotune the MPI/OpenMP offload version of OpenMC based on a user-defined metric such as the figure of merit (FoM) (particles/s) or energy efficiency energy-delay product (EDF) on the OLCF Frontier TDS system Crusher. The experimental results show that we achieve improvement up to 29.49% in FoM and up to 30.44% in EDP.


title: UV-complete 4-derivative scalar field theory

abstract: A scalar field theory with 4-derivative kinetic terms and 4-derivative cubic and quartic couplings is presented as a proxy for quantum quadratic gravity (QQG). The scalar theory is renormalizable and asymptotically free and the remaining key issue is unitarity, or more precisely positivity, just as it is in QQG. We have extended calculations for the optical theorem and for a differential cross section, both in the high energy limit, to show how positivity constrains the theory. The results also show how it is that differential cross sections can have good high energy behavior. Finally we use the scalar theory to extend the Stuckelberg theory of a massive U(1) gauge boson to a renormalizable theory of a self-interacting gauge boson.


title: Prescribing singularities of weak solutions of a nonlinear elliptic system in the plane

abstract: Inspired by Frehse's [1] 1973 work, we show that his elliptic system $\Delta u = F(u, \nabla u)$ in the plane has bounded weak solutions $u$ with arbitrarily prescribed singular sets.


title: Is my Data in your AI Model? Membership Inference Test with Application to Face Images

abstract: This paper introduces the Membership Inference Test (MINT), a novel approach that aims to empirically assess if specific data was used during the training of Artificial Intelligence (AI) models. Specifically, we propose two novel MINT architectures designed to learn the distinct activation patterns that emerge when an audited model is exposed to data used during its training process. The first architecture is based on a Multilayer Perceptron (MLP) network and the second one is based on Convolutional Neural Networks (CNNs). The proposed MINT architectures are evaluated on a challenging face recognition task, considering three state-of-the-art face recognition models. Experiments are carried out using six publicly available databases, comprising over 22 million face images in total. Also, different experimental scenarios are considered depending on the context available of the AI model to test. Promising results, up to 90% accuracy, are achieved using our proposed MINT approach, suggesting that it is possible to recognize if an AI model has been trained with specific data.


title: Directional Convergence Near Small Initializations and Saddles in Two-Homogeneous Neural Networks

abstract: This paper examines gradient flow dynamics of two-homogeneous neural networks for small initializations, where all weights are initialized near the origin. For both square and logistic losses, it is shown that for sufficiently small initializations, the gradient flow dynamics spend sufficient time in the neighborhood of the origin to allow the weights of the neural network to approximately converge in direction to the Karush-Kuhn-Tucker (KKT) points of a neural correlation function that quantifies the correlation between the output of the neural network and corresponding labels in the training data set. For square loss, it has been observed that neural networks undergo saddle-to-saddle dynamics when initialized close to the origin. Motivated by this, this paper also shows a similar directional convergence among weights of small magnitude in the neighborhood of certain saddle points.


title: Maps on self-adjoint operators preserving some relations related to commutativity

abstract: In this paper, we give the complete description of maps on self-adjoint bounded operators on Hilbert space which preserve a triadic relation involving the difference of operators and either commutativity or quasi-commutativity in both directions. We show that those maps are implemented by unitary or antiunitary equivalence and possible additive perturbation by a scalar operator.


title: Efficient Terahertz Generation from CoPt-based Terahertz Emitters via Orbital-to-Charge Conversion

abstract: Orbitronics devices operate by manipulating orbitally-polarized currents. Recent studies have shown that these orbital currents can be excited by femtosecond laser pulses in ferromagnet as Ni and converted into ultrafast charge current via orbital-to-charge conversion. However, the terahertz emission from orbitronic terahertz emitter based on Ni is still much weaker than the typical spintronic terahertz emitter. Here, we report more efficient light-induced generation of orbital current from CoPt alloy and the orbitronic terahertz emission by CoPt/Cu/MgO shows terahertz radiation comparable to that of efficient spintronic terahertz emitters. By varying the concentration of CoPt alloy, the thickness of Cu, and the capping layer, we confirm that THz emission primarily originates from the orbital accumulation generated within CoPt, propagating through Cu and followed by the subsequent orbital-to-charge conversion from the inverse orbital Rashba-Edelstein effect at the Cu/MgO interface. This study provides strong evidence for the very efficient orbital current generation in CoPt alloy, paving the way to efficient orbital terahertz emitters.


title: Invariant conformal Killing forms on almost abelian Lie groups

abstract: We describe completely conformal Killing or conformal Killing-Yano (CKY) $p$-forms on almost abelian metric Lie algebras. In particular we prove that if a $n$-dimensional almost abelian metric Lie algebra admits a non-parallel CKY $p$-form, then $p=1$ or $p=n-1$. In other words, any CKY $p$-form on a metric almost abelian Lie algebra is parallel for $2\leq p\leq n-2$. Moreover, we characterize almost abelian Lie algebras admitting non-parallel CKY $p$-forms, and we classify all Lie algebras with this property up to dimension $5$, distinguishing also those cases where the associated simply connected Lie group admits lattices.


title: Context Composing for Full Line Code Completion

abstract: Code Completion is one of the most used Integrated Development Environment (IDE) features, which affects the everyday life of a software developer. Modern code completion approaches moved from the composition of several static analysis-based contributors to pipelines that involve neural networks. This change allows the proposal of longer code suggestions while maintaining the relatively short time spent on generation itself. At JetBrains, we put a lot of effort into perfecting the code completion workflow so it can be both helpful and non-distracting for a programmer. We managed to ship the Full Line Code Completion feature to PyCharm Pro IDE and proved its usefulness in A/B testing on hundreds of real Python users. The paper describes our approach to context composing for the Transformer model that is a core of the feature's implementation. In addition to that, we share our next steps to improve the feature and emphasize the importance of several research aspects in the area.


title: Investigating Premature Convergence in Co-optimization of Morphology and Control in Evolved Virtual Soft Robots

abstract: Evolving virtual creatures is a field with a rich history and recently it has been getting more attention, especially in the soft robotics domain. The compliance of soft materials endows soft robots with complex behavior, but it also makes their design process unintuitive and in need of automated design. Despite the great interest, evolved virtual soft robots lack the complexity, and co-optimization of morphology and control remains a challenging problem. Prior work identifies and investigates a major issue with the co-optimization process -- fragile co-adaptation of brain and body resulting in premature convergence of morphology. In this work, we expand the investigation of this phenomenon by comparing learnable controllers with proprioceptive observations and fixed controllers without any observations, whereas in the latter case, we only have the optimization of the morphology. Our experiments in two morphology spaces and two environments that vary in complexity show, concrete examples of the existence of high-performing regions in the morphology space that are not able to be discovered during the co-optimization of the morphology and control, yet exist and are easily findable when optimizing morphologies alone. Thus this work clearly demonstrates and characterizes the challenges of optimizing morphology during co-optimization. Based on these results, we propose a new body-centric framework to think about the co-optimization problem which helps us understand the issue from a search perspective. We hope the insights we share with this work attract more attention to the problem and help us to enable efficient brain-body co-optimization.


title: Iterated Straight-Line Programs

abstract: We explore an extension to straight-line programs (SLPs) that outperforms, for some text families, the measure $\delta$ based on substring complexity, a lower bound for most measures and compressors exploiting repetitiveness (which are crucial in areas like Bioinformatics). The extension, called iterated SLPs (ISLPs), allows rules of the form $A \rightarrow \Pi_{i=k_1}^{k_2} B_1^{i^{c_1}}\cdots B_t^{i^{c_t}}$, for which we show how to extract any substring of length $\lambda$, from the represented text $T[1.. n]$, in time $O(\lambda + \log^2 n\log\log n)$. This is the first compressed representation for repetitive texts breaking $\delta$ while, at the same time, supporting direct access to arbitrary text symbols in polylogarithmic time. As a byproduct, we extend Ganardi et al.'s technique to balance any SLP (so it has a derivation tree of logarithmic height) to a wide generalization of SLPs, including ISLPs.


title: Design and Realization of a Benchmarking Testbed for Evaluating Autonomous Platooning Algorithms

abstract: Autonomous vehicle platoons present near- and long-term opportunities to enhance operational efficiencies and save lives. The past 30 years have seen rapid development in the autonomous driving space, enabling new technologies that will alleviate the strain placed on human drivers and reduce vehicle emissions. This paper introduces a testbed for evaluating and benchmarking platooning algorithms on 1/10th scale vehicles with onboard sensors. To demonstrate the testbed's utility, we evaluate three algorithms, linear feedback and two variations of distributed model predictive control, and compare their results on a typical platooning scenario where the lead vehicle tracks a reference trajectory that changes speed multiple times. We validate our algorithms in simulation to analyze the performance as the platoon size increases, and find that the distributed model predictive control algorithms outperform linear feedback on hardware and in simulation.


title: Multi-Hierarchical Surrogate Learning for Structural Dynamical Crash Simulations Using Graph Convolutional Neural Networks

abstract: Crash simulations play an essential role in improving vehicle safety, design optimization, and injury risk estimation. Unfortunately, numerical solutions of such problems using state-of-the-art high-fidelity models require significant computational effort. Conventional data-driven surrogate modeling approaches create low-dimensional embeddings for evolving the dynamics in order to circumvent this computational effort. Most approaches directly operate on high-resolution data obtained from numerical discretization, which is both costly and complicated for mapping the flow of information over large spatial distances. Furthermore, working with a fixed resolution prevents the adaptation of surrogate models to environments with variable computing capacities, different visualization resolutions, and different accuracy requirements. We thus propose a multi-hierarchical framework for structurally creating a series of surrogate models for a kart frame, which is a good proxy for industrial-relevant crash simulations, at different levels of resolution. For multiscale phenomena, macroscale features are captured on a coarse surrogate, whereas microscale effects are resolved by finer ones. The learned behavior of the individual surrogates is passed from coarse to finer levels through transfer learning. In detail, we perform a mesh simplification on the kart model to obtain multi-resolution representations of it. We then train a graph-convolutional neural network-based surrogate that learns parameter-dependent low-dimensional latent dynamics on the coarsest representation. Subsequently, another, similarly structured surrogate is trained on the residual of the first surrogate using a finer resolution. This step can be repeated multiple times. By doing so, we construct multiple surrogates for the same system with varying hardware requirements and increasing accuracy.


title: Some Characterizations of Weakly Uniformly Perfect Sets

abstract: In this paper, the concept of weakly uniform perfectness is considered. As an analogue of the theory of uniform perfectness, we obtain the relationships between weakly uniform perfectness and Bergman kernel, Poincar\'e metric and Hausdorff content. In particular, for a bounded domain $\Omega \subset \mathbb{C}$, we show that the uniform perfectness of $\partial \Omega$ is equivalent to $K_{\Omega}(z) \gtrsim \delta(z)^{-2}$, where $K_{\Omega}(z)$ is the Bergman kernel of $\Omega$ and $\delta(z)$ denotes the boundary distance.


title: Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Models

abstract: To build intelligent machine learning systems, there are two broad approaches. One approach is to build inherently interpretable models, as endeavored by the growing field of causal representation learning. The other approach is to build highly-performant foundation models and then invest efforts into understanding how they work. In this work, we relate these two approaches and study how to learn human-interpretable concepts from data. Weaving together ideas from both fields, we formally define a notion of concepts and show that they can be provably recovered from diverse data. Experiments on synthetic data and large language models show the utility of our unified approach.


title: Weatherproofing Retrieval for Localization with Generative AI and Geometric Consistency

abstract: State-of-the-art visual localization approaches generally rely on a first image retrieval step whose role is crucial. Yet, retrieval often struggles when facing varying conditions, due to e.g. weather or time of day, with dramatic consequences on the visual localization accuracy. In this paper, we improve this retrieval step and tailor it to the final localization task. Among the several changes we advocate for, we propose to synthesize variants of the training set images, obtained from generative text-to-image models, in order to automatically expand the training set towards a number of nameable variations that particularly hurt visual localization. After expanding the training set, we propose a training approach that leverages the specificities and the underlying geometry of this mix of real and synthetic images. We experimentally show that those changes translate into large improvements for the most challenging visual localization datasets. Project page: https://europe.naverlabs.com/ret4loc


title: Mean ergodic and related properties of generalized Ces\`aro operators in BK-sequence spaces

abstract: Recent results concerning the linear dynamics and mean ergodicity of compact operators in Banach spaces, together with additional new results, are employed to investigate various spectral properties of generalized Ces\`aro operators acting in large classes of classical BK-sequence spaces. Of particular interest is to determine the eigenvalues and the corresponding eigenvectors of such operators and to decide whether (or not) the operators are power bounded, mean ergodic and supercyclic.


title: Robust Training of Temporal GNNs using Nearest Neighbours based Hard Negatives

abstract: Temporal graph neural networks Tgnn have exhibited state-of-art performance in future-link prediction tasks. Training of these TGNNs is enumerated by uniform random sampling based unsupervised loss. During training, in the context of a positive example, the loss is computed over uninformative negatives, which introduces redundancy and sub-optimal performance. In this paper, we propose modified unsupervised learning of Tgnn, by replacing the uniform negative sampling with importance-based negative sampling. We theoretically motivate and define the dynamically computed distribution for a sampling of negative examples. Finally, using empirical evaluations over three real-world datasets, we show that Tgnn trained using loss based on proposed negative sampling provides consistent superior performance.


title: Switch EMA: A Free Lunch for Better Flatness and Sharpness

abstract: Exponential Moving Average (EMA) is a widely used weight averaging (WA) regularization to learn flat optima for better generalizations without extra cost in deep neural network (DNN) optimization. Despite achieving better flatness, existing WA methods might fall into worse final performances or require extra test-time computations. This work unveils the full potential of EMA with a single line of modification, i.e., switching the EMA parameters to the original model after each epoch, dubbed as Switch EMA (SEMA). From both theoretical and empirical aspects, we demonstrate that SEMA can help DNNs to reach generalization optima that better trade-off between flatness and sharpness. To verify the effectiveness of SEMA, we conduct comparison experiments with discriminative, generative, and regression tasks on vision and language datasets, including image classification, self-supervised learning, object detection and segmentation, image generation, video prediction, attribute regression, and language modeling. Comprehensive results with popular optimizers and networks show that SEMA is a free lunch for DNN training by improving performances and boosting convergence speeds.


title: Efficient One-stage Video Object Detection by Exploiting Temporal Consistency

abstract: Recently, one-stage detectors have achieved competitive accuracy and faster speed compared with traditional two-stage detectors on image data. However, in the field of video object detection (VOD), most existing VOD methods are still based on two-stage detectors. Moreover, directly adapting existing VOD methods to one-stage detectors introduces unaffordable computational costs. In this paper, we first analyse the computational bottlenecks of using one-stage detectors for VOD. Based on the analysis, we present a simple yet efficient framework to address the computational bottlenecks and achieve efficient one-stage VOD by exploiting the temporal consistency in video frames. Specifically, our method consists of a location-prior network to filter out background regions and a size-prior network to skip unnecessary computations on low-level feature maps for specific frames. We test our method on various modern one-stage detectors and conduct extensive experiments on the ImageNet VID dataset. Excellent experimental results demonstrate the superior effectiveness, efficiency, and compatibility of our method. The code is available at https://github.com/guanxiongsun/vfe.pytorch.


title: Synthesizing Knowledge-enhanced Features for Real-world Zero-shot Food Detection

abstract: Food computing brings various perspectives to computer vision like vision-based food analysis for nutrition and health. As a fundamental task in food computing, food detection needs Zero-Shot Detection (ZSD) on novel unseen food objects to support real-world scenarios, such as intelligent kitchens and smart restaurants. Therefore, we first benchmark the task of Zero-Shot Food Detection (ZSFD) by introducing FOWA dataset with rich attribute annotations. Unlike ZSD, fine-grained problems in ZSFD like inter-class similarity make synthesized features inseparable. The complexity of food semantic attributes further makes it more difficult for current ZSD methods to distinguish various food categories. To address these problems, we propose a novel framework ZSFDet to tackle fine-grained problems by exploiting the interaction between complex attributes. Specifically, we model the correlation between food categories and attributes in ZSFDet by multi-source graphs to provide prior knowledge for distinguishing fine-grained features. Within ZSFDet, Knowledge-Enhanced Feature Synthesizer (KEFS) learns knowledge representation from multiple sources (e.g., ingredients correlation from knowledge graph) via the multi-source graph fusion. Conditioned on the fusion of semantic knowledge representation, the region feature diffusion model in KEFS can generate fine-grained features for training the effective zero-shot detector. Extensive evaluations demonstrate the superior performance of our method ZSFDet on FOWA and the widely-used food dataset UECFOOD-256, with significant improvements by 1.8% and 3.7% ZSD mAP compared with the strong baseline RRFS. Further experiments on PASCAL VOC and MS COCO prove that enhancement of the semantic knowledge can also improve the performance on general ZSD. Code and dataset are available at https://github.com/LanceZPF/KEFS.


title: Exact simulation scheme for the Ornstein-Uhlenbeck driven stochastic volatility model with the Karhunen-Lo\`eve expansions

abstract: This study proposes a new exact simulation scheme of the Ornstein-Uhlenbeck driven stochastic volatility model. With the Karhunen-Lo\`eve expansions, the stochastic volatility path following the Ornstein-Uhlenbeck process is expressed as a sine series, and the time integrals of volatility and variance are analytically derived as the sums of independent normal random variates. The new method is several hundred times faster than Li and Wu [Eur. J. Oper. Res., 2019, 275(2), 768-779] that relies on computationally expensive numerical transform inversion. The simulation algorithm is further improved with the conditional Monte-Carlo method and the martingale-preserving control variate on the spot price.


title: Zero-energy Devices for 6G: Technical Enablers at a Glance

abstract: Low-cost, resource-constrained, maintenance-free, and energy-harvesting (EH) Internet of Things (IoT) devices, referred to as zero-energy devices (ZEDs), are rapidly attracting attention from industry and academia due to their myriad of applications. To date, such devices remain primarily unsupported by modern IoT connectivity solutions due to their intrinsic fabrication, hardware, deployment, and operation limitations, while lacking clarity on their key technical enablers and prospects. Herein, we address this by discussing the main characteristics and enabling technologies of ZEDs within the next generation of mobile networks, specifically focusing on unconventional EH sources, multi-source EH, power management, energy storage solutions, manufacturing material and practices, backscattering, and low-complexity receivers. Moreover, we highlight the need for lightweight and energy-aware computing, communication, and scheduling protocols, while discussing potential approaches related to TinyML, duty cycling, and infrastructure enablers like radio frequency wireless power transfer and wake-up protocols. Challenging aspects and open research directions are identified and discussed in all the cases. Finally, we showcase an experimental ZED proof-of-concept related to ambient cellular backscattering.


title: Overview of the L3DAS23 Challenge on Audio-Visual Extended Reality

abstract: The primary goal of the L3DAS23 Signal Processing Grand Challenge at ICASSP 2023 is to promote and support collaborative research on machine learning for 3D audio signal processing, with a specific emphasis on 3D speech enhancement and 3D Sound Event Localization and Detection in Extended Reality applications. As part of our latest competition, we provide a brand-new dataset, which maintains the same general characteristics of the L3DAS21 and L3DAS22 datasets, but with first-order Ambisonics recordings from multiple reverberant simulated environments. Moreover, we start exploring an audio-visual scenario by providing images of these environments, as perceived by the different microphone positions and orientations. We also propose updated baseline models for both tasks that can now support audio-image couples as input and a supporting API to replicate our results. Finally, we present the results of the participants. Further details about the challenge are available at https://www.l3das.com/icassp2023.


title: Who Plays First? Optimizing the Order of Play in Stackelberg Games with Many Robots

abstract: We consider the multi-agent spatial navigation problem of computing the socially optimal order of play, i.e., the sequence in which the agents commit to their decisions, and its associated equilibrium in an N-player Stackelberg trajectory game. We model this problem as a mixed-integer optimization problem over the space of all possible Stackelberg games associated with the order of play's permutations. To solve the problem, we introduce Branch and Play (B&P), an efficient and exact algorithm that provably converges to a socially optimal order of play and its Stackelberg equilibrium. As a subroutine for B&P, we employ and extend sequential trajectory planning, i.e., a popular multi-agent control approach, to scalably compute valid local Stackelberg equilibria for any given order of play. We demonstrate the practical utility of B&P to coordinate air traffic control, swarm formation, and delivery vehicle fleets. We find that B&P consistently outperforms various baselines, and computes the socially optimal equilibrium.


title: Momentum Approximation in Asynchronous Private Federated Learning

abstract: Asynchronous protocols have been shown to improve the scalability of federated learning (FL) with a massive number of clients. Meanwhile, momentum-based methods can achieve the best model quality in synchronous FL. However, naively applying momentum in asynchronous FL algorithms leads to slower convergence and degraded model performance. It is still unclear how to effective combinie these two techniques together to achieve a win-win. In this paper, we find that asynchrony introduces implicit bias to momentum updates. In order to address this problem, we propose momentum approximation that minimizes the bias by finding an optimal weighted average of all historical model updates. Momentum approximation is compatible with secure aggregation as well as differential privacy, and can be easily integrated in production FL systems with a minor communication and storage cost. We empirically demonstrate that on benchmark FL datasets, momentum approximation can achieve $1.15 \textrm{--}4\times$ speed up in convergence compared to existing asynchronous FL optimizers with momentum.


title: Constants of motion characterizing continuous symmetry-broken phases

abstract: We present a theory characterizing the phases emerging as a consequence of continuous symmetry-breaking in quantum and classical systems. In symmetry-breaking phases, dynamics is restricted due to the existence of a set of conserved charges derived from the order parameter of the phase transition. Their expectation values are determined by the privileged direction appearing in the ordered phase as a consequence of symmetry breaking, and thus they can be used to determine whether this direction is well defined or it has quantum fluctuations. Our theory is numerically exemplified via the two-dimensional limit of the vibron model, a fully connected system invariant under a rotation operator which generates the continuous symmetry-breaking.


title: Exploring the Relationship: Transformative Adaptive Activation Functions in Comparison to Other Activation Functions

abstract: Neural networks are the state-of-the-art approach for many tasks and the activation function is one of the main building blocks that allow such performance. Recently, a novel transformative adaptive activation function (TAAF) allowing for any vertical and horizontal translation and scaling was proposed. This work sets the TAAF into the context of other activation functions. It shows that the TAAFs generalize over 50 existing activation functions and utilize similar concepts as over 70 other activation functions, underscoring the versatility of TAAFs. This comprehensive exploration positions TAAFs as a promising and adaptable addition to neural networks.


title: Validity of using Els\"asser variables to study the interaction of compressible solar wind fluctuations with a coronal mass ejection

abstract: Alfv\'enic fluctuations, as modelled by the non-linear interactions of Alfv\'en waves of various scales, are seen to dominate solar wind turbulence. However, there is also a non-negligible component of non-Alfv\'enic fluctuations. The Els\"asser formalism, which is central to the study of Alfv\'enic turbulence due to its ability to differentiate between parallel and anti-parallel Alfv\'en waves, cannot strictly separate wavemodes in the presence of compressive magnetoacoustic waves. In this study, we analyse the deviations generated in the Els\"asser formalism as density fluctuations are naturally generated through the propagation of a linearly polarised Alfv\'en wave. The study was performed in the context of a coronal mass ejection (CME) propagating through the solar wind, which enables the creation of two solar wind regimes, pristine wind and a shocked CME sheath, where the Els\"asser formalism can be evaluated. In these two regimes we studied the deviations of the Els\"asser formalism in separating parallel and anti-parallel components of Alfv\'enic solar wind perturbations generated by small-amplitude density fluctuations. We used an ideal 2.5D magnetohydrodynamic (MHD) model with an adiabatic equation of state. An Alfv\'en pump wave was injected into the quiet solar wind by perturbing the transverse magnetic field and velocity components. This wave subsequently generates density fluctuations through the ponderomotive force. A CME was injected by inserting a flux-rope modelled as a magnetic island into the quasi-steady solar wind. The presence of density perturbations creates an approximately 10% deviation in the Els\"asser variables and reflection coefficient for the Alfv\'en waves as well as a deviation of approximately 0.1 in the cross helicity in regions containing both parallel and anti-parallel fluctuations.


title: Universal Machine Learning Kohn-Sham Hamiltonian for Materials

abstract: While density functional theory (DFT) serves as a prevalent computational approach in electronic structure calculations, its computational demands and scalability limitations persist. Recently, leveraging neural networks to parameterize the Kohn-Sham DFT Hamiltonian has emerged as a promising avenue for accelerating electronic structure computations. Despite advancements, challenges such as the necessity for computing extensive DFT training data to explore each new system and the complexity of establishing accurate ML models for multi-elemental materials still exist. Addressing these hurdles, this study introduces a universal electronic Hamiltonian model trained on Hamiltonian matrices obtained from first-principles DFT calculations of nearly all crystal structures on the Materials Project. We demonstrate its generality in predicting electronic structures across the whole periodic table, including complex multi-elemental systems, solid-state electrolytes, Moir\'e twisted bilayer heterostructure, and metal-organic frameworks (MOFs). Moreover, we utilize the universal model to conduct high-throughput calculations of electronic structures for crystals in GeNOME datasets, identifying 3,940 crystals with direct band gaps and 5,109 crystals with flat bands. By offering a reliable efficient framework for computing electronic properties, this universal Hamiltonian model lays the groundwork for advancements in diverse fields, such as easily providing a huge data set of electronic structures and also making the materials design across the whole periodic table possible.


title: An asymptotic-preserving scheme for Euler equations I: non-ideal gases

abstract: {We analyze a general Implicit-Explicit (IMEX) time discretization for the compressible Euler equations of gas dynamics, showing that they are asymptotic-preserving (AP) in the low Mach number limit. The analysis is carried out for a general equation of state (EOS). We consider both a single asymptotic length scale and two length scales. We then show that, when coupling these time discretizations with a Discontinuous Galerkin (DG) space discretization with appropriate fluxes, an all Mach number numerical method is obtained. A number of relevant benchmarks for ideal gases and their non-trivial extension to non-ideal EOS validate the performed analysis.


title: Max-Min Fair Energy-Efficient Beam Design for Quantized ISAC LEO Satellite Systems: A Rate-Splitting Approach

abstract: Low earth orbit (LEO) satellite systems with sensing functionality is envisioned to facilitate global-coverage service and emerging applications in 6G. Currently, two fundamental challenges, namely, inter-beam interference among users and power limitation at the LEO satellites, limit the full potential of the joint design of sensing and communication. To effectively control the interference, rate-splitting multiple access (RSMA) scheme is employed as the interference management strategy in the system design. On the other hand, to address the limited power supply at the LEO satellites, we consider low-resolution quantization digital-to-analog converters (DACs) at the transmitter to reduce power consumption, which grows exponentially with the number of quantization bits. Additionally, optimizing the total energy efficiency (EE) of the system is a common practice to save the power. However, this metric lacks fairness among users. To ensure this fairness and further enhance EE, we investigate the max-min fairness EE of the RSMA-assisted integrated sensing and communications (ISAC)-LEO satellite system. In this system, the satellite transmits a quantized dual-functional signal serving downlink users while detecting a target. Specifically, we optimize the precoders for maximizing the minimal EE among all users, considering the power consumption of each radio frequency (RF) chain under communication and sensing constraints. To tackle this optimization problem, we proposed an iterative algorithm based on successive convex approximation (SCA) and Dinkelbach's method. Numerical results illustrate that the proposed design outperforms the strategies that aim to maximize the total EE of the system and conventional space-division multiple access (SDMA) in terms of max-min fairness EE and the communication-sensing trade-off.


title: Monochromatic $k$-connection of graphs

abstract: An edge-coloured path is monochromatic if all of its edges have the same colour. For a $k$-connected graph $G$, the monochromatic $k$-connection number of $G$, denoted by $mc_k(G)$, is the maximum number of colours in an edge-colouring of $G$ such that, any two vertices are connected by $k$ internally vertex-disjoint monochromatic paths. In this paper, we shall study the parameter $mc_k(G)$. We obtain bounds for $mc_k(G)$, for general graphs $G$. We also compute $mc_k(G)$ exactly when $k$ is small, and $G$ is a graph on $n$ vertices, with a spanning $k$-connected subgraph having the minimum possible number of edges, namely $\lceil\frac{kn}{2}\rceil$. We prove a similar result when $G$ is a bipartite graph.


title: On collection schemes and Gaifman's splitting theorem

abstract: We study model theoretic characterizations of various collection schemes over $\mathbf{PA}^-$ from the viewpoint of Gaifman's splitting theorem.


title: Celestial Conformal Primaries in Effective Field Theories

abstract: Scattering amplitudes in $d+2$ dimensions can be recast as correlators of conformal primary operators in a putative holographic CFT$_d$ by working in a basis of boost eigenstates instead of momentum eigenstates. It has been shown previously that conformal primary operators with $\Delta \in \frac{d}{2} + i {\mathbb R}$ form a basis for massless one-particle representations. In this paper, we consider more general conformal primary operators with $\Delta \in {\mathbb C}$ and show that completeness, normalizability, and consistency with CPT implies that we must restrict the scaling dimensions to either $\Delta \in \frac{d}{2} + i {\mathbb R}$ or $\Delta \in {\mathbb R}$. Unlike those with $\Delta \in \frac{d}{2} + i {\mathbb R}$, the conformal primaries with $\Delta \in {\mathbb R}$ can be constructed without knowledge of the UV and can therefore be defined in effective field theories. With additional analyticity assumptions, we can restrict $\Delta \in 2 - {\mathbb Z}_{\geq0}$ or $\Delta \in \frac{1}{2}-{\mathbb Z}_{\geq0}$ for bosonic or fermionic operators, respectively.


title: TDViT: Temporal Dilated Video Transformer for Dense Video Tasks

abstract: Deep video models, for example, 3D CNNs or video transformers, have achieved promising performance on sparse video tasks, i.e., predicting one result per video. However, challenges arise when adapting existing deep video models to dense video tasks, i.e., predicting one result per frame. Specifically, these models are expensive for deployment, less effective when handling redundant frames, and difficult to capture long-range temporal correlations. To overcome these issues, we propose a Temporal Dilated Video Transformer (TDViT) that consists of carefully designed temporal dilated transformer blocks (TDTB). TDTB can efficiently extract spatiotemporal representations and effectively alleviate the negative effect of temporal redundancy. Furthermore, by using hierarchical TDTBs, our approach obtains an exponentially expanded temporal receptive field and therefore can model long-range dynamics. Extensive experiments are conducted on two different dense video benchmarks, i.e., ImageNet VID for video object detection and YouTube VIS for video instance segmentation. Excellent experimental results demonstrate the superior efficiency, effectiveness, and compatibility of our method. The code is available at https://github.com/guanxiongsun/vfe.pytorch.


title: Lorentz canoncial forms of two-qubit states

abstract: The Bloch sphere provides an elegant way of visualizing a qubit. Analogous representation of the simplest composite state of two-qubits has attracted significant attention. Here we present a detailed mathematical analysis of the real-matrix parametrization and associated geometric picturization of arbitrary two-qubit states - up to their local SL2C equivalence, in terms of canonical ellipsoids inscribed within the Bloch sphere.


title: SyntaxShap: Syntax-aware Explainability Method for Text Generation

abstract: To harness the power of large language models in safety-critical domains, we need to ensure the explainability of their predictions. However, despite the significant attention to model interpretability, there remains an unexplored domain in explaining sequence-to-sequence tasks using methods tailored for textual data. This paper introduces SyntaxShap, a local, model-agnostic explainability method for text generation that takes into consideration the syntax in the text data. The presented work extends Shapley values to account for parsing-based syntactic dependencies. Taking a game theoric approach, SyntaxShap only considers coalitions constraint by the dependency tree. We adopt a model-based evaluation to compare SyntaxShap and its weighted form to state-of-the-art explainability methods adapted to text generation tasks, using diverse metrics including faithfulness, coherency, and semantic alignment of the explanations to the model. We show that our syntax-aware method produces explanations that help build more faithful and coherent explanations for predictions by autoregressive models. Confronted with the misalignment of human and AI model reasoning, this paper also highlights the need for cautious evaluation strategies in explainable AI.


title: Evaluating the Experience of LGBTQ+ People Using Large Language Model Based Chatbots for Mental Health Support

abstract: LGBTQ+ individuals are increasingly turning to chatbots powered by large language models (LLMs) to meet their mental health needs. However, little research has explored whether these chatbots can adequately and safely provide tailored support for this demographic. We interviewed 18 LGBTQ+ and 13 non-LGBTQ+ participants about their experiences with LLM-based chatbots for mental health needs. LGBTQ+ participants relied on these chatbots for mental health support, likely due to an absence of support in real life. Notably, while LLMs offer prompt support, they frequently fall short in grasping the nuances of LGBTQ-specific challenges. Although fine-tuning LLMs to address LGBTQ+ needs can be a step in the right direction, it isn't the panacea. The deeper issue is entrenched in societal discrimination. Consequently, we call on future researchers and designers to look beyond mere technical refinements and advocate for holistic strategies that confront and counteract the societal biases burdening the LGBTQ+ community.


title: On Left and Right Semi-B-Fredholm Operators

abstract: To complete the study of Fredholm type operators of [10] and [11], we define in this paper the classes of left and right semi-B-Fredholm operators (Definition 3.1). Then, we prove that an operator $T \in L(X), X$ being a Banach space, is a left( resp. right) semi-B-Fredholm operator if and only if $T$ is the direct sum of left(resp. right) semi-Fredholm operator and a nilpotent one. This result extend the earlier characterization of B-Fredholm operators as the direct sum of a Fredholm operator and a nilpotent one obtained in [4,Theorem 2.7].


title: MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Models

abstract: We introduce MultiMedEval, an open-source toolkit for fair and reproducible evaluation of large, medical vision-language models (VLM). MultiMedEval comprehensively assesses the models' performance on a broad array of six multi-modal tasks, conducted over 23 datasets, and spanning over 11 medical domains. The chosen tasks and performance metrics are based on their widespread adoption in the community and their diversity, ensuring a thorough evaluation of the model's overall generalizability. We open-source a Python toolkit (github.com/corentin-ryr/MultiMedEval) with a simple interface and setup process, enabling the evaluation of any VLM in just a few lines of code. Our goal is to simplify the intricate landscape of VLM evaluation, thus promoting fair and uniform benchmarking of future models.


title: Uncertainty-Aware Transient Stability-Constrained Preventive Redispatch: A Distributional Reinforcement Learning Approach

abstract: Transient stability-constrained preventive redispatch plays a crucial role in ensuring power system security and stability. Since redispatch strategies need to simultaneously satisfy complex transient constraints and the economic need, model-based formulation and optimization become extremely challenging. In addition, the increasing uncertainty and variability introduced by renewable sources start to drive the system stability consideration from deterministic to probabilistic, which further exaggerates the complexity. In this paper, a Graph neural network guided Distributional Deep Reinforcement Learning (GD2RL) method is proposed, for the first time, to solve the uncertainty-aware transient stability-constrained preventive redispatch problem. First, a graph neural network-based transient simulator is trained by supervised learning to efficiently generate post-contingency rotor angle curves with the steady-state and contingency as inputs, which serves as a feature extractor for operating states and a surrogate time-domain simulator during the environment interaction for reinforcement learning. Distributional deep reinforcement learning with explicit uncertainty distribution of system operational conditions is then applied to generate the redispatch strategy to balance the user-specified probabilistic stability performance and economy preferences. The full distribution of the post-control transient stability index is directly provided as the output. Case studies on the modified New England 39-bus system validate the proposed method.


title: UR2M: Uncertainty and Resource-Aware Event Detection on Microcontrollers

abstract: Traditional machine learning techniques are prone to generating inaccurate predictions when confronted with shifts in the distribution of data between the training and testing phases. This vulnerability can lead to severe consequences, especially in applications such as mobile healthcare. Uncertainty estimation has the potential to mitigate this issue by assessing the reliability of a model's output. However, existing uncertainty estimation techniques often require substantial computational resources and memory, making them impractical for implementation on microcontrollers (MCUs). This limitation hinders the feasibility of many important on-device wearable event detection (WED) applications, such as heart attack detection. In this paper, we present UR2M, a novel Uncertainty and Resource-aware event detection framework for MCUs. Specifically, we (i) develop an uncertainty-aware WED based on evidential theory for accurate event detection and reliable uncertainty estimation; (ii) introduce a cascade ML framework to achieve efficient model inference via early exits, by sharing shallower model layers among different event models; (iii) optimize the deployment of the model and MCU library for system efficiency. We conducted extensive experiments and compared UR2M to traditional uncertainty baselines using three wearable datasets. Our results demonstrate that UR2M achieves up to 864% faster inference speed, 857% energy-saving for uncertainty estimation, 55% memory saving on two popular MCUs, and a 22% improvement in uncertainty quantification performance. UR2M can be deployed on a wide range of MCUs, significantly expanding real-time and reliable WED applications.


title: Computational Complexity of Preferred Subset Repairs on Data-Graphs

abstract: Preferences are a pivotal component in practical reasoning, especially in tasks that involve decision-making over different options or courses of action that could be pursued. In this work, we focus on repairing and querying inconsistent knowledge bases in the form of graph databases, which involves finding a way to solve conflicts in the knowledge base and considering answers that are entailed from every possible repair, respectively. Without a priori domain knowledge, all possible repairs are equally preferred. Though that may be adequate for some settings, it seems reasonable to establish and exploit some form of preference order among the potential repairs. We study the problem of computing prioritized repairs over graph databases with data values, using a notion of consistency based on GXPath expressions as integrity constraints. We present several preference criteria based on the standard subset repair semantics, incorporating weights, multisets, and set-based priority levels. We show that it is possible to maintain the same computational complexity as in the case where no preference criterion is available for exploitation. Finally, we explore the complexity of consistent query answering in this setting and obtain tight lower and upper bounds for all the preference criteria introduced.


title: Machine Learning in management of precautionary closures caused by lipophilic biotoxins

abstract: Mussel farming is one of the most important aquaculture industries. The main risk to mussel farming is harmful algal blooms (HABs), which pose a risk to human consumption. In Galicia, the Spanish main producer of cultivated mussels, the opening and closing of the production areas is controlled by a monitoring program. In addition to the closures resulting from the presence of toxicity exceeding the legal threshold, in the absence of a confirmatory sampling and the existence of risk factors, precautionary closures may be applied. These decisions are made by experts without the support or formalisation of the experience on which they are based. Therefore, this work proposes a predictive model capable of supporting the application of precautionary closures. Achieving sensitivity, accuracy and kappa index values of 97.34%, 91.83% and 0.75 respectively, the kNN algorithm has provided the best results. This allows the creation of a system capable of helping in complex situations where forecast errors are more common.


title: Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluation

abstract: Despite showing increasingly human-like abilities, large language models (LLMs) often struggle with factual inaccuracies, i.e. "hallucinations", even when they hold relevant knowledge. To address these hallucinations, current approaches typically necessitate high-quality human factuality annotations. In this work, we explore Self-Alignment for Factuality, where we leverage the self-evaluation capability of an LLM to provide training signals that steer the model towards factuality. Specifically, we incorporate Self-Eval, a self-evaluation component, to prompt an LLM to validate the factuality of its own generated responses solely based on its internal knowledge. Additionally, we design Self-Knowledge Tuning (SK-Tuning) to augment the LLM's self-evaluation ability by improving the model's confidence estimation and calibration. We then utilize these self-annotated responses to fine-tune the model via Direct Preference Optimization algorithm. We show that the proposed self-alignment approach substantially enhances factual accuracy over Llama family models across three key knowledge-intensive tasks on TruthfulQA and BioGEN.


title: Transformers, parallel computation, and logarithmic depth

abstract: We show that a constant number of self-attention layers can efficiently simulate, and be simulated by, a constant number of communication rounds of Massively Parallel Computation. As a consequence, we show that logarithmic depth is sufficient for transformers to solve basic computational tasks that cannot be efficiently solved by several other neural sequence models and sub-quadratic transformer approximations. We thus establish parallelism as a key distinguishing property of transformers.


title: Personalized Large Language Models

abstract: Large language models (LLMs) have significantly advanced Natural Language Processing (NLP) tasks in recent years. However, their universal nature poses limitations in scenarios requiring personalized responses, such as recommendation systems and chatbots. This paper investigates methods to personalize LLMs, comparing fine-tuning and zero-shot reasoning approaches on subjective tasks. Results demonstrate that personalized fine-tuning improves model reasoning compared to non-personalized models. Experiments on datasets for emotion recognition and hate speech detection show consistent performance gains with personalized methods across different LLM architectures. These findings underscore the importance of personalization for enhancing LLM capabilities in subjective text perception tasks.


title: Fast Window-Based Event Denoising with Spatiotemporal Correlation Enhancement

abstract: Previous deep learning-based event denoising methods mostly suffer from poor interpretability and difficulty in real-time processing due to their complex architecture designs. In this paper, we propose window-based event denoising, which simultaneously deals with a stack of events while existing element-based denoising focuses on one event each time. Besides, we give the theoretical analysis based on probability distributions in both temporal and spatial domains to improve interpretability. In temporal domain, we use timestamp deviations between processing events and central event to judge the temporal correlation and filter out temporal-irrelevant events. In spatial domain, we choose maximum a posteriori (MAP) to discriminate real-world event and noise, and use the learned convolutional sparse coding to optimize the objective function. Based on the theoretical analysis, we build Temporal Window (TW) module and Soft Spatial Feature Embedding (SSFE) module to process temporal and spatial information separately, and construct a novel multi-scale window-based event denoising network, named MSDNet. The high denoising accuracy and fast running speed of our MSDNet enables us to achieve real-time denoising in complex scenes. Extensive experimental results verify the effectiveness and robustness of our MSDNet. Our algorithm can remove event noise effectively and efficiently and improve the performance of downstream tasks.


title: Hybrid Machine Learning techniques in the management of harmful algal blooms impact

abstract: Harmful algal blooms (HABs) are episodes of high concentrations of algae that are potentially toxic for human consumption. Mollusc farming can be affected by HABs because, as filter feeders, they can accumulate high concentrations of marine biotoxins in their tissues. To avoid the risk to human consumption, harvesting is prohibited when toxicity is detected. At present, the closure of production areas is based on expert knowledge and the existence of a predictive model would help when conditions are complex and sampling is not possible. Although the concentration of toxin in meat is the method most commonly used by experts in the control of shellfish production areas, it is rarely used as a target by automatic prediction models. This is largely due to the irregularity of the data due to the established sampling programs. As an alternative, the activity status of production areas has been proposed as a target variable based on whether mollusc meat has a toxicity level below or above the legal limit. This new option is the most similar to the actual functioning of the control of shellfish production areas. For this purpose, we have made a comparison between hybrid machine learning models like Neural-Network-Adding Bootstrap (BAGNET) and Discriminative Nearest Neighbor Classification (SVM-KNN) when estimating the state of production areas. The study has been carried out in several estuaries with different levels of complexity in the episodes of algal blooms to demonstrate the generalization capacity of the models in bloom detection. As a result, we could observe that, with an average recall value of 93.41% and without dropping below 90% in any of the estuaries, BAGNET outperforms the other models both in terms of results and robustness.


title: Insights and caveats from mining local and global temporal motifs in cryptocurrency transaction networks

abstract: Distributed ledger technologies have opened up a wealth of fine-grained transaction data from cryptocurrencies like Bitcoin and Ethereum. This allows research into problems like anomaly detection, anti-money laundering, pattern mining and activity clustering (where data from traditional currencies is rarely available). The formalism of temporal networks offers a natural way of representing this data and offers access to a wealth of metrics and models. However, the large scale of the data presents a challenge using standard graph analysis techniques. We use temporal motifs to analyse two Bitcoin datasets and one NFT dataset, using sequences of three transactions and up to three users. We show that the commonly used technique of simply counting temporal motifs over all users and all time can give misleading conclusions. Here we also study the motifs contributed by each user and discover that the motif distribution is heavy-tailed and that the key players have diverse motif signatures. We study the motifs that occur in different time periods and find events and anomalous activity that cannot be seen just by a count on the whole dataset. Studying motif completion time reveals dynamics driven by human behaviour as well as algorithmic behaviour.


title: The McNish and Lincoln Solar Activity Predictions: The Method and its Performance

abstract: The McNish and Lincoln (ML) method, introduced in 1949, was one of the first attempts to produce mid-term forecasts of solar activity, up to 12 months ahead. However, it has been poorly described and evaluated in the past literature, in particular its actual operational implementation by NOAA. Here, we reconstruct the exact formulation of the method, as it was applied since the early 1970s, and we provide a full mathematical derivation of the prediction errors. For bench-marking the method, we also produce monthly predictions over the past 190 years, from 1833 (Cycle 8) to 2023 (Cycle 25), and develop statistics of the differences between the predictions and the observed 13-month smoothed sunspot number (SSN) time series, according to the phase in the solar cycle. Our analysis shows that the ML method is heavily constrained because it is primarily based on the mean of all past cycles, which imposes a fixed amplitude and length and suffers from a temporal smearing that grows towards the end of the solar cycle. We find that predictions are completely unreliable in the first 12 months of the cycle, and over the last two years preceding the ending minimum (around 130 months), and beyond this minimum. By contrast, in the course of the cycle (months 18 to 65), ML predictions prove to be reliable over a time range of up to 50 months (4.2 years), thus much longer than the 12-month conventional range used so far. However, we find that predictions then suffer from systematic under-(over-)estimates for cycles that have a higher (lower) amplitude than the base mean cycle. Overall, we conclude that although the ML method provides valid prediction errors, it suffers from strong limitations, with very little room for improvement, as it indifferently merges all past cycles into a single fixed statistics.


title: Neutrino flavor transformation with moments: application to fast flavor instabilities in neutron star mergers

abstract: Neutrino evolution, of great importance in environments such as neutron star mergers (NSMs) because of their impact on explosive nucleosynthesis, is still poorly understood due to the high complexity and variety of possible flavor conversion mechanisms. In this study, we focus on so-called "fast flavor oscillations", which can occur on timescales of nanoseconds and are connected to the existence of a crossing between the angular distributions of electron (anti)neutrinos. Based on the neutrino radiation field drawn from a three dimensional neutron star merger simulation, we use an extension of the two-moment formalism of neutrino quantum kinetics, and perform a linear stability analysis to determine the characteristics of fast flavor instabilities across the simulation. We compare the results to local (centimeter-scale) three-dimensional two-flavor simulations using either a moment method or a particle-in-cell architecture. We get generally good agreement in the instability growth rate and typical instability lengthscale, although the imperfections of the closure used in moment methods remain to be better understood.


title: The socialisation of the adolescent who carries out team sports: a transversal study of centrality with a social network analysis

abstract: Objectives: This study analyzed adolescent physical activity, its link to overweight, and the social network structure in group sports participants, focusing on centrality measures. Setting: Conducted in 11 classrooms across 5 schools in Ponferrada, Spain. Participants: Included 235 adolescents (49.4% female), categorized as normal weight or overweight. Methods: The Physical Activity Questionnaire for Adolescents (PAQ-A) assessed physical activity levels. Social network analysis evaluated centrality in varying contact degrees. Results: 30.2% were overweight. Males scored higher in PAQ-A and were more likely to engage in group sports. No significant correlation was found between physical activity and weight in the total sample. However, overweight females reported higher exercise levels. Centrality analysis showed gender differences; women in group sports had lower centrality, whereas men had higher. Conclusions: The study highlights the importance of gender and social network centrality in designing future strategies, considering peer interaction intensity


title: Persistence of steady-states for dynamical systems on large networks

abstract: The goal of this work is to identify steady-state solutions to dynamical systems defined on large, random families of networks. We do so by passing to a continuum limit where the adjacency matrix is replaced by a non-local operator with kernel called a graphon. This graphon equation is often more amenable to analysis and provides a single equation to study instead of the infinitely many variations of networks that lead to the limit. Our work establishes a rigorous connection between steady-states of the continuum and network systems. Precisely, we show that if the graphon equation has a steady-state solution whose linearization is invertible, there exists related steady-state solutions to the finite-dimensional networked dynamical system over all sufficiently large graphs converging to the graphon. The proof involves setting up a Newton--Kantorovich type iteration scheme which is shown to be a contraction on a suitable metric space. Interestingly, we show that the first iterate of our defined operator in general fails to be a contraction mapping, but the second iterate is proven to contract on the space. We extend our results to show that linear stability properties further carry over from the graphon system to the graph dynamical system. Our results are applied to twisted states in a Kuramoto model of coupled oscillators, steady-states in a model of neuronal network activity, and a Lotka--Volterra model of ecological interaction.


title: A Modular Deep Learning-based Approach for Diffuse Optical Tomography Reconstruction

abstract: Medical imaging is nowadays a pillar in diagnostics and therapeutic follow-up. Current research tries to integrate established - but ionizing - tomographic techniques with technologies offering reduced radiation exposure. Diffuse Optical Tomography (DOT) uses non-ionizing light in the Near-Infrared (NIR) window to reconstruct optical coefficients in living beings, providing functional indications about the composition of the investigated organ/tissue. Due to predominant light scattering at NIR wavelengths, DOT reconstruction is, however, a severely ill-conditioned inverse problem. Conventional reconstruction approaches show severe weaknesses when dealing also with mildly complex cases and/or are computationally very intensive. In this work we explore deep learning techniques for DOT inversion. Namely, we propose a fully data-driven approach based on a modularity concept: first data and originating signal are separately processed via autoencoders, then the corresponding low-dimensional latent spaces are connected via a bridging network which acts at the same time as a learned regularizer.


title: Disentangling the origin of chemical differences using GHOST

abstract: Aims. We explore different scenarios to explain the chemical difference found in the remarkable giant-giant binary system HD 138202 + CD-30 12303. For the first time, we suggest how to distinguish these scenarios by taking advantage of the extensive convective envelopes of giant stars. Methods. We carried out a high-precision determination of stellar parameters and abundances by applying a full line-by-line differential analysis on GHOST high-resolution spectra. Results. We found a significant chemical difference between the two stars (0.08 dex), which is largely unexpected considering the insensitivity of giant stars to planetary ingestion and diffusion effects. We tested the possibility of engulfment events by using several different combinations of stellar mass, ingested mass, metallicity of the engulfed object and different convective envelopes. However, the planetary ingestion scenario does not seem to explain the observed differences. For the first time, we distinguished the source of chemical differences using a giant-giant binary system. By ruling out other possible scenarios such as planet formation and evolutionary effects between the two stars, we suggest that primordial inhomogeneities might explain the observed differences. This remarkable result implies that the metallicity differences that were observed in at least some main-sequence binary systems might be related to primordial inhomogeneities rather than engulfment events. We also discuss the important implications of finding primordial inhomogeneities, which affect chemical tagging and other fields such as planet formation. We strongly encourage the use of giant-giant pairs. They are a relevant complement to main-sequence pairs for determining the origin of the observed chemical differences in multiple systems. [abridged]


title: Nonreciprocal collective dynamics in a mixture of phoretic Janus colloids

abstract: A multicomponent mixture of Janus colloids with distinct catalytic coats and phoretic mobilities is a promising theoretical system to explore the collective behavior arising from nonreciprocal interactions. An active colloid produces (or consumes) chemicals, self-propels, drifts along chemical gradients, and rotates its intrinsic polarity to align with a gradient. As a result the connection from microscopics to continuum theories through coarse-graining couples densities and polarization fields in unique ways. Focusing on a binary mixture, we show that these couplings render the unpatterned reference state unstable to small perturbations through a variety of instabilities including oscillatory ones which arise on crossing an exceptional point or through a Hopf bifurcation. For fast relaxation of the polar fields, they can be eliminated in favor of the density fields to obtain a microscopic realization of the Nonreciprocal Cahn-Hilliard model for two conserved species with two distinct sources of non-reciprocity, one in the interaction coefficient and the other in the interfacial tension. Our work establishes Janus colloids as a versatile model for a bottom-up approach to both scalar and polar active mixtures.


title: Proton-proton and proton-cluster femtoscopy at the HADES experiment

abstract: This work explores femtoscopic correlations in proton-proton and proton-cluster systems at the HADES experiment, GSI. Through high-precision correlation functions, it reveals the impact of strong interactions between protons and light nuclei (deuteron, triton, Helium-3). For proton-proton interactions, measurements in two centralities and five $k_T$ bins were analyzed. Extracted radii were compared with different Equations of State in UrQMD, providing valuable insights into collision dynamics. This research enhances our understanding of particle interactions and contributes to refining theoretical models in nuclear and particle physics.


title: Synergistic eigenanalysis of covariance and Hessian matrices for enhanced binary classification

abstract: Covariance and Hessian matrices have been analyzed separately in the literature for classification problems. However, integrating these matrices has the potential to enhance their combined power in improving classification performance. We present a novel approach that combines the eigenanalysis of a covariance matrix evaluated on a training set with a Hessian matrix evaluated on a deep learning model to achieve optimal class separability in binary classification tasks. Our approach is substantiated by formal proofs that establish its capability to maximize between-class mean distance and minimize within-class variances. By projecting data into the combined space of the most relevant eigendirections from both matrices, we achieve optimal class separability as per the linear discriminant analysis (LDA) criteria. Empirical validation across neural and health datasets consistently supports our theoretical framework and demonstrates that our method outperforms established methods. Our method stands out by addressing both LDA criteria, unlike PCA and the Hessian method, which predominantly emphasize one criterion each. This comprehensive approach captures intricate patterns and relationships, enhancing classification performance. Furthermore, through the utilization of both LDA criteria, our method outperforms LDA itself by leveraging higher-dimensional feature spaces, in accordance with Cover's theorem, which favors linear separability in higher dimensions. Our method also surpasses kernel-based methods and manifold learning techniques in performance. Additionally, our approach sheds light on complex DNN decision-making, rendering them comprehensible within a 2D space.


title: Leveraging Large Language Models for Enhanced NLP Task Performance through Knowledge Distillation and Optimized Training Strategies

abstract: Emerging Large Language Models (LLMs) like GPT-4 have revolutionized Natural Language Processing (NLP), showing potential in traditional tasks such as Named Entity Recognition (NER). Our study explores a three-phase training strategy that harnesses GPT-4's capabilities to enhance the BERT model's performance on NER. Initially, GPT-4 annotates a subset of the CONLL2003 and additional BBC dataset without fine-tuning. We then train BERT using a mix of original and LLM-annotated data, analyzing the efficacy of LLM annotations against traditional methods. The second phase involves comparative experiments with different training regimens, assessing the synergy between distilled and original data. We observe that sequential strategies, particularly a simple mix of training first with distilled data followed by original data, significantly boost performance. In the third phase, we investigate various data blending techniques, including sigmoid and power decay functions, to optimize the training process further. Our results indicate that a strategic mix of distilled and original data markedly elevates the NER capabilities of BERT. Our approach presents a scalable methodology that reduces manual annotation costs and increases efficiency, making it especially pertinent in resource-limited and closed-network environments. The study concludes that while the 'Simple Mix' strategy yields the best results, understanding its underlying mechanisms requires further research. Future work will also focus on refining prompt designs and enhancing annotation selection processes, aiming to extend our methodology to diverse NLP tasks.


title: Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey

abstract: Large Language Models (LLMs) are now commonplace in conversation applications. However, their risks of misuse for generating harmful responses have raised serious societal concerns and spurred recent research on LLM conversation safety. Therefore, in this survey, we provide a comprehensive overview of recent studies, covering three critical aspects of LLM conversation safety: attacks, defenses, and evaluations. Our goal is to provide a structured summary that enhances understanding of LLM conversation safety and encourages further investigation into this important subject. For easy reference, we have categorized all the studies mentioned in this survey according to our taxonomy, available at: https://github.com/niconi19/LLM-conversation-safety.


title: Smart Cities and Villages: Concept Review and Implementation Perspectives in Developing Cities

abstract: The "Smart City" (SC) concept has been around for decades with deployment scenarios revealed in major cities of developed countries. However, while SC has enhanced the living conditions of city dwellers in the developed world, the concept is still either missing or poorly deployed in the developing world. This paper presents a review of the SC concept from the perspective of its application to cities in developing nations, the opportunities it avails, and challenges related to its applicability to these cities. Building upon a systematic review of literature, this paper shows that there are neither canonical definitions, models or frameworks of references for the SC concept. This paper also aims to bridge the gap between the "smart city" and "smart village" concepts, with the expectation of providing a holistic approach to solving common issues in cities around the world. Drawing inspiration from other authors, we propose a conceptual model for a SC initiative in Africa and demonstrate the need to prioritize research and capacity development. We also discuss the potential opportunities for such SC implementations in sub-Saharan Africa. As a case study, we consider the city of Lubumbashi in the Democratic Republic of Congo and discuss ways of making it a smart city by building around successful smart city initiatives. It is our belief that for Lubumbashi, as with any other city in Sub-Saharan Africa, the first step to developing a smart city is to build knowledge and create an intellectual capital.


title: GraphiQ: Quantum circuit design for photonic graph states

abstract: GraphiQ is a versatile open-source framework for designing photonic graph state generation schemes, with a particular emphasis on photon-emitter hybrid circuits. Built in Python, GraphiQ consists of a suite of design tools, including multiple simulation backends and optimization methods. The library supports scheme optimization in the presence of circuit imperfections, as well as user-defined optimization goals. Our framework thus represents a valuable tool for the development of practical schemes adhering to experimentally-relevant constraints. As graph states are a key resource for measurement-based quantum computing, all-photonic quantum repeaters, and robust quantum metrology, among others, we envision GraphiQ's broad impact for advancing quantum technologies.


title: Nutrition Facts, Drug Facts, and Model Facts: Putting AI Ethics into Practice in Gun Violence Research

abstract: Objective: Firearm injury research necessitates using data from often-exploited vulnerable populations of Black and Brown Americans. In order to minimize distrust, this study provides a framework for establishing AI trust and transparency with the general population. Methods: We propose a Model Facts template that is easily extendable and decomposes accuracy and demographics into standardized and minimally complex values. This framework allows general users to assess the validity and biases of a model without diving into technical model documentation. Examples: We apply the Model Facts template on two previously published models, a violence risk identification model and a suicide risk prediction model. We demonstrate the ease of accessing the appropriate information when the data is structured appropriately. Discussion: The Model Facts template is limited in its current form to human based data and biases. Like nutrition facts, it also will require some educational resources for users to grasp its full utility. Human computer interaction experiments should be conducted to ensure that the interaction between user interface and model interface is as desired. Conclusion: The Model Facts label is the first framework dedicated to establishing trust with end users and general population consumers. Implementation of Model Facts into firearm injury research will provide public health practitioners and those impacted by firearm injury greater faith in the tools the research provides.


title: On the real and imaginary parts of powers of the Volterra operator

abstract: We study the real and imaginary parts of the powers of the Volterra operator on $L^2[0,1]$, specifically their eigenvalues, their norms and their numerical ranges.


title: EcoVal: An Efficient Data Valuation Framework for Machine Learning

abstract: Quantifying the value of data within a machine learning workflow can play a pivotal role in making more strategic decisions in machine learning initiatives. The existing Shapley value based frameworks for data valuation in machine learning are computationally expensive as they require considerable amount of repeated training of the model to obtain the Shapley value. In this paper, we introduce an efficient data valuation framework EcoVal, to estimate the value of data for machine learning models in a fast and practical manner. Instead of directly working with individual data sample, we determine the value of a cluster of similar data points. This value is further propagated amongst all the member cluster points. We show that the overall data value can be determined by estimating the intrinsic and extrinsic value of each data. This is enabled by formulating the performance of a model as a \textit{production function}, a concept which is popularly used to estimate the amount of output based on factors like labor and capital in a traditional free economic market. We provide a formal proof of our valuation technique and elucidate the principles and mechanisms that enable its accelerated performance. We demonstrate the real-world applicability of our method by showcasing its effectiveness for both in-distribution and out-of-sample data. This work addresses one of the core challenges of efficient data valuation at scale in machine learning models.


title: Study of quasi-projectile properties at Fermi energies in 48Ca projectile systems

abstract: The emission of the pre-equilibrium particles during nuclear collisions at moderate beam energies is still an open question. This influences the properties of the compound nucleus but also changes the interpretation of the quasi-fission process. A systematic analysis of the data obtained by the FAZIA collaboration during a recent experiment with a neutron rich projectile is presented. The full range of charged particles detected in the experiment is within the limit of isotopic resolution of the FAZIA detector. Quasi-projectile (QP) fragments were detected in majority thanks to the forward angular acceptance of the experimental setup which was confirmed by introducing cuts based on the HIPSE event generator calculations. The main goal was to compare the experimental results with the HIPSE simulations after introducing these cuts to investigate the influence of the n-rich entrance channel on the QP fragment properties. More specifically, the lowering of N/Z of QP fragments with beam energy was found to be present since the initial phase of the reaction. Thus, pre-equilibrium emissions might be a possible candidate to explain such an effect.


title: Learning Interpretable Policies in Hindsight-Observable POMDPs through Partially Supervised Reinforcement Learning

abstract: Deep reinforcement learning has demonstrated remarkable achievements across diverse domains such as video games, robotic control, autonomous driving, and drug discovery. Common methodologies in partially-observable domains largely lean on end-to-end learning from high-dimensional observations, such as images, without explicitly reasoning about true state. We suggest an alternative direction, introducing the Partially Supervised Reinforcement Learning (PSRL) framework. At the heart of PSRL is the fusion of both supervised and unsupervised learning. The approach leverages a state estimator to distill supervised semantic state information from high-dimensional observations which are often fully observable at training time. This yields more interpretable policies that compose state predictions with control. In parallel, it captures an unsupervised latent representation. These two-the semantic state and the latent state-are then fused and utilized as inputs to a policy network. This juxtaposition offers practitioners a flexible and dynamic spectrum: from emphasizing supervised state information to integrating richer, latent insights. Extensive experimental results indicate that by merging these dual representations, PSRL offers a potent balance, enhancing model interpretability while preserving, and often significantly outperforming, the performance benchmarks set by traditional methods in terms of reward and convergence speed.


title: Rapid spin changes around a magnetar fast radio burst

abstract: Magnetars are neutron stars with extremely high magnetic fields that exhibit various X-ray phenomena such as sporadic sub-second bursts, long-term persistent flux enhancements, and variable rates of rotation period change. In 2020, a fast radio burst (FRB), akin to cosmological millisecond-duration radio bursts, was detected from the Galactic magnetar SGR 1935+2154, confirming the long-suspected association between some FRBs and magnetars. However, the mechanism for FRB generation in magnetars remains unclear. Here we report the X-ray discovery of an unprecedented double glitch in SGR 1935+2154 within a time interval of approximately nine hours, bracketing an FRB that occurred on October 14, 2022. Each glitch involved a significant increase in the magnetar's spin frequency, being among the largest abrupt changes in neutron star rotation ever observed. Between the glitches, the magnetar exhibited a rapid spin-down phase, accompanied by a profound increase and subsequent decline in its persistent X-ray emission and burst rate. We postulate that a strong, ephemeral, magnetospheric wind provides the torque that rapidly slows the star's rotation. The trigger for the first glitch couples the star's crust to its magnetosphere, enhances the various X-ray signals, and spawns the wind that alters magnetospheric conditions that might produce the FRB.


title: New proof of the Gaussian integral using the residue theorem with links to the Riemann Zeta function

abstract: In this paper the Gaussian integral is proven using contour integration on $\frac{1}{e^{x^2}+1}$ and linking it using a limit to said Gaussian integral. The limit is alsorelated to the Riemann Zeta function using a few manipulations. This new and original proof comes as an addition to the already many pre-existing proofs of the Gaussian integral.


title: On the monogenity of totally complex pure octic fields

abstract: Let $0,1\ne m\in Z$ and $\alpha=\sqrt[8]{m}$. According to the results of I. Ga\'al and L. El Fadil, $\alpha$ generates a power integral basis in $K=Q(\alpha)$, if and only if $m$ is square-free and $m\not\equiv 1\;(\bmod\; 4)$. In the present paper we consider totally complex pure octic fields, that is the case $m<0$, with $m$ satisfiying the above property. In this case $(1,\alpha,\alpha^2,\ldots,\alpha^7)$ is an integral basis. Our purpose is to investigate whether $K$ admits any other generators of power integral bases, inequivalent to $\alpha$. We present an efficient method to calculate generators of power integral bases in this type of fields with coefficients $<10^{200}$ in the above integral basis. We report on the results of our calculation for this type of fields with $0>m>-5000$, which yields 2024 fields.


title: The impact of load placement on grid resonances during grid restoration

abstract: As inverter-based generation is being massively deployed in the grid, these type of units have to take over the current roles of conventional generation, including the capability of restoring the grid. In this context, the resonances of the grid during the first steps of a black start can be concerning, given that the grid is lightly loaded. Especially relevant are the low frequency resonances, that may be excited by the harmonic components of the inverter. A typical strategy to avoid or minimize the effect of such resonances relies on connecting load banks. This was fairly feasible with conventional generation, but given the limited ratings of inverters, the amount of load that can be connected at the beginning is very limited. In this paper we consider the energization of a transmission line, and investigate the optimal location of a load along a line in order to maximize the damping in the system. By analysing the spectral properties as a function of the load location, we formally prove that placing the load in the middle of the transmission line maximizes the damping ratio of the first resonance of the system.


title: Analysis of an Adaptive Safeguarded Newton-Anderson Algorithm with Applications to Fluid Problems

abstract: The purpose of this paper is to develop a practical strategy to accelerate Newton's method in the vicinity of singular points. We do this by developing an adaptive safeguarding scheme, which we call gamma-safeguarding, that one can apply to Anderson accelerated Newton's method when solving problems near singular points. The key features of adaptive gamma-safeguarding are that it converges locally for singular problems, and it can detect nonsingular problems, in which case the Newton-Anderson iterates are scaled towards a standard Newton step. This leads to faster local convergence compared to both Newton's method and Newton-Anderson without safeguarding, at no additional computational cost. We demonstrate three strategies one can use when implementing Newton-Anderson and gamma-safeguarded Newton-Anderson to solve parameter-dependent problems near singular points. For our benchmark problems, we take two parameter-dependent incompressible flow systems: flow in a channel and Rayleigh-Benard convection.


title: Mean eigenvector self-overlap in the real and complex elliptic Ginibre ensembles at strong and weak non-Hermiticity

abstract: We study the mean diagonal overlap of left and right eigenvectors associated with complex eigenvalues in $N\times N$ non-Hermitian random Gaussian matrices. In well known works by Chalker and Mehlig the expectation of this (self-)overlap was computed for the complex Ginibre ensemble as $N\to \infty$. In the present work, we consider the same quantity in the real and complex elliptic Ginibre ensembles characterized by correlations between off-diagonal entries controlled by a parameter $\tau\in[0,1]$, with $\tau=1$ corresponding to the Hermitian limit. We derive exact expressions for the mean diagonal overlap in both ensembles at any finite $N$, for any eigenvalue off the real axis. We further investigate several scaling regimes as $N\rightarrow \infty$, both in the limit of strong non-Hermiticity keeping a fixed $\tau\in[0,1)$ and in the weak non-Hermiticity limit, with $\tau$ approaching unity in such a way that $N(1-\tau)$ remains finite.


title: Reconstructing a state-independent cost function in a mean-field game model

abstract: In this short note, we consider an inverse problem to a mean-field games system where we are interested in reconstructing the state-independent running cost function from observed value-function data. We provide an elementary proof of a uniqueness result for the inverse problem using the standard multilinearization technique. One of the main features of our work is that we insist that the population distribution be a probability measure, a requirement that is not enforced in some of the existing literature on theoretical inverse mean-field games.


title: Minijet quenching in non-equilibrium quark-gluon plasma

abstract: We study the energy deposition and thermalisation of high-momentum on-shell partons (minijets) travelling through a non-equilibrium Quark-Gluon Plasma using QCD kinetic theory. For thermal backgrounds, we show that the parton energy first flows to the soft sector by collinear cascade and then isotropises via elastic scatterings. In contrast, the momentum deposition from a minijet reaches the equilibrium distribution directly. For expanding non-equilibrium QGP, we study the time for a minijet perturbation to lose memory of its initial conditions, namely, the hydrodynamisation time. We show that the minijet evolution scales well with the relaxation time ${\tau}_R \propto {\eta}/s/T ({\tau} )$, where $T ({\tau} )$ is the effective temperature and ${\eta}/s$ is the viscosity over entropy ratio.


title: Trained Without My Consent: Detecting Code Inclusion In Language Models Trained on Code

abstract: Code auditing ensures that the developed code adheres to standards, regulations, and copyright protection by verifying that it does not contain code from protected sources. The recent advent of Large Language Models (LLMs) as coding assistants in the software development process poses new challenges for code auditing. The dataset for training these models is mainly collected from publicly available sources. This raises the issue of intellectual property infringement as developers' codes are already included in the dataset. Therefore, auditing code developed using LLMs is challenging, as it is difficult to reliably assert if an LLM used during development has been trained on specific copyrighted codes, given that we do not have access to the training datasets of these models. Given the non-disclosure of the training datasets, traditional approaches such as code clone detection are insufficient for asserting copyright infringement. To address this challenge, we propose a new approach, TraWiC; a model-agnostic and interpretable method based on membership inference for detecting code inclusion in an LLM's training dataset. We extract syntactic and semantic identifiers unique to each program to train a classifier for detecting code inclusion. In our experiments, we observe that TraWiC is capable of detecting 83.87% of codes that were used to train an LLM. In comparison, the prevalent clone detection tool NiCad is only capable of detecting 47.64%. In addition to its remarkable performance, TraWiC has low resource overhead in contrast to pair-wise clone detection that is conducted during the auditing process of tools like CodeWhisperer reference tracker, across thousands of code snippets.


title: Manipulating a beam of barium fluoride molecules using an electrostatic hexapole

abstract: An electrostatic hexapole lens is used to manipulate the transverse properties of a beam of barium fluoride molecules from a cryogenic buffer gas source. The spatial distribution of the beam is measured by recording state-selective laser-induced fluorescence on an emccd camera, providing insight into the intensity and transverse position spread of the molecular beam. Although the high mass and unfavorable Stark shift of barium fluoride pose a considerable challenge, the number of molecules in the low-field seeking component of the N=1 state that pass a 4 mm diameter aperture 712 mm behind the source is increased by a factor of 12. Furthermore, it is demonstrated that the molecular beam can be displaced by up to +/-5 mm by moving the hexapole lens. Our measurements agree well with numerical trajectory simulations. We discuss how electrostatic lenses may be used to increase the sensitivity of beam experiments such as the search for the electric dipole moment of the electron.


title: Exploring semi-inclusive two-nucleon emission in neutrino scattering: a factorized approximation approach

abstract: The semi-inclusive cross section of two-nucleon emission induced by neutrinos and antineutrinos is computed employing the relativistic mean field model of nuclear matter and the dynamics of meson exchange currents. Within this model we explore a factorization approximation based on the product of an integrated two-hole spectral function and a two-nucleon cross section averaged over hole pairs. We demonstrate that the integrated spectral function of the uncorrelated Fermi gas can be analytically computed, and we derive a simple fully relativistic formula for this function, showcasing its dependency solely on both missing momentum and missing energy. A prescription for the average momenta of the two holes in the factorized two-nucleon cross section is provided, assuming that these momenta are perpendicular to the missing momentum in the center-of-mass system. The validity of the factorized approach is assessed by comparing it with the unfactorized calculation. Our investigation includes the study of the semi-inclusive cross section integrated over the energy of one of the emitted nucleons and the cross section integrated over the emission angles of the two nucleons and the outgoing muon kinematics. A comparison is made with the pure phase-space model and other models from the literature. The results of this analysis offer valuable insights into the influence of the semi-inclusive hadronic tensor on the cross section, providing a deeper understanding of the underlying nuclear processes.