title: Revising Apetrei's bounding volume hierarchy construction algorithm to allow stackless traversal

abstract: Stackless traversal is a technique to speed up range queries by avoiding usage of a stack during the tree traversal. One way to achieve that is to transform a given binary tree to store a left child and a skip-connection (also called an escape index). In general, this operation requires an additional tree traversal during the tree construction. For some tree structures, however, it is possible achieve the same result at a reduced cost. We propose one such algorithm for a GPU hierarchy construction algorithm proposed by Karras in [Karras, 2012]. Furthermore, we show that our algorithm also works with the improved algorithm proposed by Apetrei in [Apetrei, 2014], despite a different ordering of the internal nodes. We achieve that by modifying the Apetrei's algorithm to restore the original Karras' ordering of the internal nodes. Using the modified algorithm, we show how to construct a hierarchy suitable for a stackless traversal in a single bottom-up pass.


title: Nanoscale Control over Magnetic Light-Matter Interactions

abstract: Light-matter interactions are frequently perceived as predominantly influenced by the electric optical field, with the magnetic component of light often overlooked. Nonetheless, the magnetic aspect plays a pivotal role in various optical processes, including chiral light-matter interactions, photon-avalanching, and forbidden photochemistry, underscoring the significance of manipulating magnetic processes in optical phenomena. Here, we explore the ability to control the magnetic light and matter interactions at the nanoscale. In particular, we demonstrate experimentally, using a plasmonic nanostructure, the transfer of energy from the optical magnetic field to a nanoparticle, thanks to the deep subwavelength magnetic confinement allowed by our nano-antenna. This control is made possible by the particular design of our plasmonic nanostructure, which has been optimized to spatially separate the electric and magnetic fields of the localized plasmon. Furthermore, by studying the spontaneous emission from the Lanthanide-ions doped nanoparticle, we observe that the optical field distributions are not spatially correlated with the electric and magnetic near-field quantum environments of this antenna, which seemingly contradicts the reciprocity theorem. We demonstrate that this counter-intuitive observation is in fact, the result of the different optical paths followed by the excitation and emission of the ions, which forbids a direct application of that theorem.


title: Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning

abstract: This paper presents a follow-up study to OpenAI's recent superalignment work on Weak-to-Strong Generalization (W2SG). Superalignment focuses on ensuring that high-level AI systems remain consistent with human values and intentions when dealing with complex, high-risk tasks. The W2SG framework has opened new possibilities for empirical research in this evolving field. Our study simulates two phases of superalignment under the W2SG framework: the development of general superhuman models and the progression towards superintelligence. In the first phase, based on human supervision, the quality of weak supervision is enhanced through a combination of scalable oversight and ensemble learning, reducing the capability gap between weak teachers and strong students. In the second phase, an automatic alignment evaluator is employed as the weak supervisor. By recursively updating this auto aligner, the capabilities of the weak teacher models are synchronously enhanced, achieving weak-to-strong supervision over stronger student models.We also provide an initial validation of the proposed approach for the first phase. Using the SciQ task as example, we explore ensemble learning for weak teacher models through bagging and boosting. Scalable oversight is explored through two auxiliary settings: human-AI interaction and AI-AI debate. Additionally, the paper discusses the impact of improved weak supervision on enhancing weak-to-strong generalization based on in-context learning. Experiment code and dataset will be released at https://github.com/ADaM-BJTU/W2SG.


title: Factor copula models for non-Gaussian longitudinal data

abstract: This article presents factor copula approaches to model temporal dependency of non-Gaussian (continuous/discrete) longitudinal data. Factor copula models are canonical vine copulas which explain the underlying dependence structure of a multivariate data through latent variables, and therefore can be easily interpreted and implemented to unbalanced longitudinal data. We develop regression models for continuous, binary and ordinal longitudinal data including covariates, by using factor copula constructions with subject-specific latent variables. Considering homogeneous within-subject dependence, our proposed models allow for feasible parametric inference in moderate to high dimensional situations, using two-stage (IFM) estimation method. We assess the finite sample performance of the proposed models with extensive simulation studies. In the empirical analysis, the proposed models are applied for analysing different longitudinal responses of two real world data sets. Moreover, we compare the performances of these models with some widely used random effect models using standard model selection techniques and find substantial improvements. Our studies suggest that factor copula models can be good alternatives to random effect models and can provide better insights to temporal dependency of longitudinal data of arbitrary nature.


title: Global solutions of Euler-Maxwell equations with dissipation

abstract: We consider the Cauchy problem for a damped Euler-Maxwell system with no ionic background. For smooth enough data satisfying suitable so-called dispersive conditions, we establish the global in time existence and uniqueness of a strong solution that decays uniformly in time. Our method is inspired by the works of D. Serre and M. Grassin dedicated to the compressible Euler system.


title: ECALL: Expectation-calibrated learning for unsupervised blind deconvolution

abstract: Blind deconvolution aims to recover an original image from a blurred version in the case where the blurring kernel is unknown. It has wide applications in diverse fields such as astronomy, microscopy, and medical imaging. Blind deconvolution is a challenging ill-posed problem that suffers from significant non-uniqueness. Solution methods therefore require the integration of appropriate prior information. Early approaches rely on hand-crafted priors for the original image and the kernel. Recently, deep learning methods have shown excellent performance in addressing this challenge. However, most existing learning methods for blind deconvolution require a paired dataset of original and blurred images, which is often difficult to obtain. In this paper, we present a novel unsupervised learning approach named ECALL (Expectation-CALibrated Learning) that uses separate unpaired collections of original and blurred images. Key features of the proposed loss function are cycle consistency involving the kernel and associated reconstruction operator, and terms that use expectation values of data distributions to obtain information about the kernel. Numerical results are used to support ECALL.


title: Uncertainty-Aware Guidance for Target Tracking subject to Intermittent Measurements using Motion Model Learning

abstract: This letter presents a novel guidance law for target tracking applications where the target motion model is unknown and sensor measurements are intermittent due to unknown environmental conditions and low measurement update rate. In this work, the target motion model is represented by a transformer-based neural network and trained by previous target position measurements. This neural network (NN)-based motion model serves as the prediction step in a particle filter for target state estimation and uncertainty quantification. Then this estimation uncertainty is utilized in the information-driven guidance law to compute a path for the mobile agent to travel to a position with maximum expected entropy reduction (EER). The computation of EER is performed in real-time by approximating the probability distribution of the state using the particle representation from particle filter. Simulation and hardware experiments are performed with a quadcopter agent and TurtleBot target to demonstrate that the presented guidance law outperforms two other baseline guidance methods.


title: Exploring Homogeneous and Heterogeneous Consistent Label Associations for Unsupervised Visible-Infrared Person ReID

abstract: Unsupervised visible-infrared person re-identification (USL-VI-ReID) aims to retrieve pedestrian images of the same identity from different modalities without annotations. While prior work focuses on establishing cross-modality pseudo-label associations to bridge the modality-gap, they ignore maintaining the instance-level homogeneous and heterogeneous consistency in pseudo-label space, resulting in coarse associations. In response, we introduce a Modality-Unified Label Transfer (MULT) module that simultaneously accounts for both homogeneous and heterogeneous fine-grained instance-level structures, yielding high-quality cross-modality label associations. It models both homogeneous and heterogeneous affinities, leveraging them to define the inconsistency for the pseudo-labels and then minimize it, leading to pseudo-labels that maintain alignment across modalities and consistency within intra-modality structures. Additionally, a straightforward plug-and-play Online Cross-memory Label Refinement (OCLR) module is proposed to further mitigate the impact of noisy pseudo-labels while simultaneously aligning different modalities, coupled with a Modality-Invariant Representation Learning (MIRL) framework. Experiments demonstrate that our proposed method outperforms existing USL-VI-ReID methods, highlighting the superiority of our MULT in comparison to other cross-modality association methods. The code will be available.


title: On singular pencils with commuting coefficients

abstract: We investigate the relation between the spectrum of matrix (or operator) polynomials and the Taylor spectrum of its coefficients. We prove that the polynomial of commuting matrices is singular, i.e. its spectrum is the whole complex plane, if and only if (0, 0, ... , 0) belongs to the Taylor spectrum of its coefficients. On the other hand we prove that this equivalence is not longer true if we consider the operators on infinite dimensional Hilbert space as coefficients of polynomial. As a consequence we could propose a new description of (Taylor) spectrum of k-tuple of matrices and we could disprove the conjecture previously proposed in the literature. Additionally, we pointed out the Kronecker forms of the pencils with commuting coefficients.


title: The global Cauchy problem for the Euler-Riesz equations

abstract: We completely resolve the global Cauchy problem for the multi-dimensional Euler-Riesz equations, where the interaction forcing is given by $\nabla (-\Delta)^{-\sigma/2}\rho$ for some $\sigma \in (0,2)$. We construct the global-in-time unique solution to the Euler-Riesz system in a $H^s$ Sobolev space under a smallness assumption on the initial density and a dispersive spectral condition on the initial velocity. Moreover, we investigate the algebraic time decay of convergences for the constructed solutions. Our results cover the both attractive and repulsive cases as well as the whole regime $\sigma \in (0,2)$.


title: On Modular Algorithms and Butterfly Operations in Number Theoretic Transform

abstract: Number theoretic transform (NTT) has been a very useful tool in computations for number theory, algebra and cryptography. Its performance affects some post-quantum cryptosystems. In this paper, we discuss the butterfly operation of NTT. This basic module of NTT requires heavy modular arithmetics. Montgomery reduction is commonly used in this setting. Recently several variants of Montgomery algorithm have been proposed for the purpose of speeding up NTT. We observe that the Chinese remainder theorem (CRT) can be involved in this type of algorithms in natural and transparent ways. In the first part of the paper, a framework of using CRT to model Montgomery type algorithms is described. The derivation of these algorithms as well as their correctness are all treated in the CRT framework. Under our approach, some problems of a modular reduction algorithm (published in IACR Transactions on Cryptographic Hardware and Embedded Systems, doi:10.46586/tches.v2022.i4.614-636 ) are identified, and a counterexample is generated to show that the algorithm is incorrect. In the second part of the paper, we modify a modular multiplication algorithm of Plantard to suite the butterfly structure by Scott, an improved computation of the butterfly module for NTT is obtained. Experiments show that the method performs better compared to NTT implementations using previous popular methods.


title: Deep Robot Sketching: An application of Deep Q-Learning Networks for human-like sketching

abstract: The current success of Reinforcement Learning algorithms for its performance in complex environments has inspired many recent theoretical approaches to cognitive science. Artistic environments are studied within the cognitive science community as rich, natural, multi-sensory, multi-cultural environments. In this work, we propose the introduction of Reinforcement Learning for improving the control of artistic robot applications. Deep Q-learning Neural Networks (DQN) is one of the most successful algorithms for the implementation of Reinforcement Learning in robotics. DQN methods generate complex control policies for the execution of complex robot applications in a wide set of environments. Current art painting robot applications use simple control laws that limits the adaptability of the frameworks to a set of simple environments. In this work, the introduction of DQN within an art painting robot application is proposed. The goal is to study how the introduction of a complex control policy impacts the performance of a basic art painting robot application. The main expected contribution of this work is to serve as a first baseline for future works introducing DQN methods for complex art painting robot frameworks. Experiments consist of real world executions of human drawn sketches using the DQN generated policy and TEO, the humanoid robot. Results are compared in terms of similarity and obtained reward with respect to the reference inputs


title: Neural Policy Style Transfer

abstract: Style Transfer has been proposed in a number of fields: fine arts, natural language processing, and fixed trajectories. We scale this concept up to control policies within a Deep Reinforcement Learning infrastructure. Each network is trained to maximize the expected reward, which typically encodes the goal of an action, and can be described as the content. The expressive power of deep neural networks enables encoding a secondary task, which can be described as the style. The Neural Policy Style Transfer (NPST) algorithm is proposed to transfer the style of one policy to another, while maintaining the content of the latter. Different policies are defined via Deep Q-Network architectures. These models are trained using demonstrations through Inverse Reinforcement Learning. Two different sets of user demonstrations are performed, one for content and other for style. Different styles are encoded as defined by user demonstrations. The generated policy is the result of feeding a content policy and a style policy to the NPST algorithm. Experiments are performed in a catch-ball game inspired by the Deep Reinforcement Learning classical Atari games; and a real-world painting scenario with a full-sized humanoid robot, based on previous works of the authors. The implementation of three different Q-Network architectures (Shallow, Deep and Deep Recurrent Q-Network) to encode the policies within the NPST framework is proposed and the results obtained in the experiments with each of these architectures compared.


title: Real Evaluations Tractability using Continuous Goal-Directed Actions in Smart City Applications

abstract: One of the most important challenges of Smart City Applications is to adapt the system to interact with non-expert users. Robot imitation frameworks aim to simplify and reduce times of robot programming by allowing users to program directly through demonstrations. In classical frameworks, actions are modeled using joint or Cartesian space trajectories. Other features, such as visual ones, are not always well represented with these pure geometrical approaches. Continuous Goal-Directed Actions (CGDA) is an alternative to these methods, as it encodes actions as changes of any feature that can be extracted from the environment. As a consequence of this, the robot joint trajectories for execution must be fully computed to comply with this feature-agnostic encoding. This is achieved using Evolutionary Algorithms (EA), which usually requires too many evaluations to perform this evolution step in the actual robot. Current strategies involve performing evaluations in a simulation, transferring the final joint trajectory to the actual robot. Smart City applications involve working in highly dynamic and complex environments, where having a precise model is not always achievable. Our goal is to study the tractability of performing these evaluations directly in a real-world scenario. Two different approaches to reduce the number of evaluations using EA, are proposed and compared. In the first approach, Particle Swarm Optimization (PSO)-based methods have been studied and compared within CGDA: naive PSO, Fitness Inheritance PSO (FI-PSO), and Adaptive Fuzzy Fitness Granulation with PSO (AFFG-PSO). The second approach studied the introduction of geometrical and velocity constraints within CGDA. The effects of both approaches were analyzed and compared in the wax and paint actions, two CGDA commonly studied use cases. Results from this paper depict an important reduction in the number of evaluations.


title: Potential Vorticity of the South Polar Vortex of Venus

abstract: Venus' atmosphere shows highly variable warm vortices over both of the planet's poles. The nature of the mechanism behind their formation and properties is still unknown. Potential vorticity is a conserved quantity when advective processes dominate over friction and diabatic heating, and is a quantity frequently used to model balanced flows. As a step toward understanding the vortices' dynamics, we present maps of Ertel's potential vorticity (EPV) at Venus' south polar region. We analyze three configurations of the South Polar Vortex at the upper cloud level ($P\sim 240 mbar$; $z\sim 58 km$), based on our previous analyses of cloud motions and thermal structure from data acquired by the VIRTIS instrument onboard Venus Express. Additionally, we tentatively estimate EPV at the lower cloud level ($P\sim 2200 mbar$; $z\sim 43 km$), based on our previous wind measurements and on static stability data from Pioneer Venus and the VIRA model. Values of EPV are on the order of $10^{-6}$ and $10^{-8} K m^2 kg^{-1} s^{-1}$ at the upper and lower cloud levels, respectively, being 3 times larger than the estimated errors. The morphology observed in EPV maps is mainly determined by the structures of the vertical component of the relative vorticity. This is in contrast to the vortex's morphology observed in 3.8 or 5 $\mu m$ images which are related to the thermal structure of the atmosphere at the cloud top. Some of the EPV maps point to a weak ringed structure in the upper cloud while a more homogenous EPV field is found in the lower cloud.


title: LVC-LGMC: Joint Local and Global Motion Compensation for Learned Video Compression

abstract: Existing learned video compression models employ flow net or deformable convolutional networks (DCN) to estimate motion information. However, the limited receptive fields of flow net and DCN inherently direct their attentiveness towards the local contexts. Global contexts, such as large-scale motions and global correlations among frames are ignored, presenting a significant bottleneck for capturing accurate motions. To address this issue, we propose a joint local and global motion compensation module (LGMC) for leaned video coding. More specifically, we adopt flow net for local motion compensation. To capture global context, we employ the cross attention in feature domain for motion compensation. In addition, to avoid the quadratic complexity of vanilla cross attention, we divide the softmax operations in attention into two independent softmax operations, leading to linear complexity. To validate the effectiveness of our proposed LGMC, we integrate it with DCVC-TCM and obtain learned video compression with joint local and global motion compensation (LVC-LGMC). Extensive experiments demonstrate that our LVC-LGMC has significant rate-distortion performance improvements over baseline DCVC-TCM.


title: Sampling-based Stochastic Data-driven Predictive Control under Data Uncertainty

abstract: We present a stochastic output-feedback data-driven predictive control scheme for linear time-invariant systems subject to bounded additive disturbances and probabilistic chance constraints. The approach uses data-driven predictors based on an extension of Willems' fundamental lemma from behavioral systems theory and a single persistently exciting input-output data trajectory. Compared to current state-of-the-art approaches that rely on availability of exact disturbance data, we deterministically approximate the chance constraints in a sampling-based fashion by leveraging a novel parameterization of the unknown disturbance data trajectory, considering consistency with the measured data and the system class. A robust constraint on the first predicted step guarantees recursive feasibility of the proposed controller as well as constraint satisfaction in closed-loop. We show robust asymptotic stability in expectation under further standard assumptions. A numerical example demonstrates the efficiency of the proposed control scheme.


title: Generalised triple homomorphisms and Derivations

abstract: We introduce generalised triple homomorphism between Jordan Banach triple systems as a concept which extends the notion of generalised homomorphism between Banach algebras given by Jarosz and Johnson in 1985 and 1987, respectively. We prove that every generalised triple homomorphism between JB$^*$-triples is automatically continuous. When particularised to C$^*$-algebras, we rediscover one of the main theorems established by Johnson. We shall also consider generalised triple derivations from a Jordan Banach triple $E$ into a Jordan Banach triple $E$-module, proving that every generalised triple derivation from a JB$^*$-triple $E$ into $E^*$ is automatically continuous.


title: WayFASTER: a Self-Supervised Traversability Prediction for Increased Navigation Awareness

abstract: Accurate and robust navigation in unstructured environments requires fusing data from multiple sensors. Such fusion ensures that the robot is better aware of its surroundings, including areas of the environment that are not immediately visible but were visible at a different time. To solve this problem, we propose a method for traversability prediction in challenging outdoor environments using a sequence of RGB and depth images fused with pose estimations. Our method, termed WayFASTER (Waypoints-Free Autonomous System for Traversability with Enhanced Robustness), uses experience data recorded from a receding horizon estimator to train a self-supervised neural network for traversability prediction, eliminating the need for heuristics. Our experiments demonstrate that our method excels at avoiding obstacles, and correctly detects that traversable terrains, such as tall grass, can be navigable. By using a sequence of images, WayFASTER significantly enhances the robot's awareness of its surroundings, enabling it to predict the traversability of terrains that are not immediately visible. This enhanced awareness contributes to better navigation performance in environments where such predictive capabilities are essential.


title: An Investigation of Hardware Security Bug Characteristics in Open-Source Projects

abstract: Hardware security is an important concern of system security as vulnerabilities can arise from design errors introduced throughout the development lifecycle. Recent works have proposed techniques to detect hardware security bugs, such as static analysis, fuzzing, and symbolic execution. However, the fundamental properties of hardware security bugs remain relatively unexplored. To gain a better understanding of hardware security bugs, we perform a deep dive into the popular OpenTitan project, including its bug reports and bug fixes. We manually classify the bugs as relevant to functionality or security and analyze characteristics, such as the impact and location of security bugs, and the size of their bug fixes. We also investigate relationships between security impact and bug management during development. Finally, we propose an abstract syntax tree-based analysis to identify the syntactic characteristics of bug fixes. Our results show that 53% of the bugs in OpenTitan have potential security implications and that 55% of all bug fixes modify only one file. Our findings underscore the importance of security-aware development practices and tools and motivate the development of techniques that leverage the highly localized nature of hardware bugs.


title: Near and full quasi-optimality of finite element approximations of stationary second-order mean field games

abstract: We establish a priori error bounds for monotone stabilized finite element discretizations of stationary second-order mean field games (MFG) on Lipschitz polytopal domains. Under suitable hypotheses, we prove that the approximation is asymptotically nearly quasi-optimal in the $H^1$-norm in the sense that, on sufficiently fine meshes, the error between exact and computed solutions is bounded by the best approximation error of the corresponding finite element space, plus possibly an additional term, due to the stabilization, that is of optimal order with respect to the mesh size. We thereby deduce optimal rates of convergence of the error with respect to the mesh-size for solutions with sufficient regularity. We further show full asymptotic quasi-optimality of the approximation error in the more restricted case of sequences of strictly acute meshes. Our third main contribution is to further show, in the case where the domain is convex, that the convergence rate for the $H^1$-norm error of the value function approximation remains optimal even if the density function only has minimal regularity in $H^1$.


title: Maximum a posteriori testing in statistical inverse problems

abstract: This paper is concerned with a Bayesian approach to testing hypotheses in statistical inverse problems. Based on the posterior distribution $\Pi \left(\cdot |Y = y\right)$, we want to infer whether a feature $\langle\varphi, u^\dagger\rangle$ of the unknown quantity of interest $u^\dagger$ is positive. This can be done by the so-called maximum a posteriori test. We provide a frequentistic analysis of this test's properties such as level and power, and prove that it is a regularized test in the sense of Kretschmann et al. (2024). Furthermore we provide lower bounds for its power under classical spectral source conditions in case of Gaussian priors. Numerical simulations illustrate its superior performance both in moderately and severely ill-posed situations.


title: A Review on the Use of Blockchain for the Internet of Things

abstract: The paradigm of Internet of Things (IoT) is paving the way for a world, where many of our daily objects will be interconnected and will interact with their environment in order to collect information and automate certain tasks. Such a vision requires, among other things, seamless authentication, data privacy, security, robustness against attacks, easy deployment, and self-maintenance. Such features can be brought by blockchain, a technology born with a cryptocurrency called Bitcoin. In this paper, a thorough review on how to adapt blockchain to the specific needs of IoT in order to develop Blockchain-based IoT (BIoT) applications is presented. After describing the basics of blockchain, the most relevant BIoT applications are described with the objective of emphasizing how blockchain can impact traditional cloud-centered IoT applications. Then, the current challenges and possible optimizations are detailed regarding many aspects that affect the design, development, and deployment of a BIoT application. Finally, some recommendations are enumerated with the aim of guiding future BIoT researchers and developers on some of the issues that will have to be tackled before deploying the next generation of BIoT applications.


title: Carrollian $Lw_{1+\infty}$ representation from twistor space

abstract: We construct an explicit realization of the action of the $Lw_{1+\infty}$ loop algebra on fields at null infinity. This action is directly derived by Penrose transform of the geometrical action of $Lw_{1+\infty}$ symmetries in twistor space, ensuring that it forms a representation of the algebra. Finally, we show that this action coincides with the canonical action of $Lw_{1+\infty}$ Noether charges on the asymptotic phase space.


title: Ocassionally Secure: A Comparative Analysis of Code Generation Assistants

abstract: $ $Large Language Models (LLMs) are being increasingly utilized in various applications, with code generations being a notable example. While previous research has shown that LLMs have the capability to generate both secure and insecure code, the literature does not take into account what factors help generate secure and effective code. Therefore in this paper we focus on identifying and understanding the conditions and contexts in which LLMs can be effectively and safely deployed in real-world scenarios to generate quality code. We conducted a comparative analysis of four advanced LLMs--GPT-3.5 and GPT-4 using ChatGPT and Bard and Gemini from Google--using 9 separate tasks to assess each model's code generation capabilities. We contextualized our study to represent the typical use cases of a real-life developer employing LLMs for everyday tasks as work. Additionally, we place an emphasis on security awareness which is represented through the use of two distinct versions of our developer persona. In total, we collected 61 code outputs and analyzed them across several aspects: functionality, security, performance, complexity, and reliability. These insights are crucial for understanding the models' capabilities and limitations, guiding future development and practical applications in the field of automated code generation.


title: On uniform recurrence for hyperbolic automorphisms of the $2$-dimensional torus

abstract: We are interested in studying sets of the form \[ \mathcal{U}(\alpha) := \left\{ x\in X: \ \exists M=M(x) \geq 1 \text{ such that } \forall N\geq M, \ \exists n\leq N \text{ such that } d(T^nx, x) \leq |\lambda|^{-\alpha N} \right\} \] where $(X,T,d)$ is our metric dynamical system and $|\lambda|>1$. Although a lot of results exist for the one dimensional case, not as many are known for systems in higher dimensions and especially in the hyperbolic case. We consider $X=\mathbb{T}^2$, $T(x) = Ax \pmod{1}$, where $A$ is a hyperbolic, area preserving, $2\times 2$ matrix with integer entries and $\lambda$ is the eigenvalue of $A$ of modulus larger than $1$ and we explicitly calculate the Hausdorff dimension of this set.


title: Comparative Study of Large Language Model Architectures on Frontier

abstract: Large language models (LLMs) have garnered significant attention in both the AI community and beyond. Among these, the Generative Pre-trained Transformer (GPT) has emerged as the dominant architecture, spawning numerous variants. However, these variants have undergone pre-training under diverse conditions, including variations in input data, data preprocessing, and training methodologies, resulting in a lack of controlled comparative studies. Here we meticulously examine two prominent open-sourced GPT architectures, GPT-NeoX and LLaMA, leveraging the computational power of Frontier, the world's first Exascale supercomputer. Employing the same materials science text corpus and a comprehensive end-to-end pipeline, we conduct a comparative analysis of their training and downstream performance. Our efforts culminate in achieving state-of-the-art performance on a challenging materials science benchmark. Furthermore, we investigate the computation and energy efficiency, and propose a computationally efficient method for architecture design. To our knowledge, these pre-trained models represent the largest available for materials science. Our findings provide practical guidance for building LLMs on HPC platforms.


title: A Framework for Building Point Cloud Cleaning, Plane Detection and Semantic Segmentation

abstract: This paper presents a framework to address the challenges involved in building point cloud cleaning, plane detection, and semantic segmentation, with the ultimate goal of enhancing building modeling. We focus in the cleaning stage on removing outliers from the acquired point cloud data by employing an adaptive threshold technique based on z-score measure. Following the cleaning process, we perform plane detection using the robust RANSAC paradigm. The goal is to carry out multiple plane segmentations, and to classify segments into distinct categories, such as floors, ceilings, and walls. The resulting segments can generate accurate and detailed point clouds representing the building's architectural elements. Moreover, we address the problem of semantic segmentation, which plays a vital role in the identification and classification of different components within the building, such as walls, windows, doors, roofs, and objects. Inspired by the PointNet architecture, we propose a deep learning architecture for efficient semantic segmentation in buildings. The results demonstrate the effectiveness of the proposed framework in handling building modeling tasks, paving the way for improved accuracy and efficiency in the field of building modelization.


title: In-plane anisotropic magnetoresistance in detwinned $BaFe_{2-x}Ni_{x}As_{2}$ ($x$ = 0, 0.6)

abstract: Understanding the magnetoresistance (MR) of a magnetic material forms the basis for uncovering the orbital mechanisms and charge-spin interactions in the system. Although the parent state of iron-based high-temperature superconductors, including $BaFe_2As_2$, exhibits unusual electron transport properties resulting from spin and charge correlations, there is still valuable insight to be gained by understanding the in-plane MR effect due to twin domains in the orthorhombic antiferromagnetic (AF) ordered state. Here, we study the in-plane magnetoresistance anisotropy in detwinned $BaFe_2As_2$ and compare the results to the non-magnetic Ni-doped sample. We find that in the antiferromagnetically ordered state, $BaFe_2As_2$ exhibits anisotropic MR that becomes large at low temperatures and high fields. Both transverse and longitudinal MRs are highly anisotropic and dependent on the field and current orientations. These results cannot be fully explained by calculations considering only the anisotropic Fermi surface. Instead, the spin orientation of the ordered moment also affects the MR effect, suggesting the presence of a large charge-spin interaction in $BaFe_2As_2$ that is not present in the Ni-doped material.


title: Multiway junction conditions I: booklets and webs

abstract: We explore the construction of gluing together an arbitrary number of spacetimes along a common interface that gives a geometric structure we refer to as the booklet geometry. We derive junction conditions across the interface, in both Einstein gravity and dilaton gravity, using two methods (1) by geometrically introducing an auxiliary reverse extension manifold, and (2) by varying the action of the theory under consideration, and the two methods give the same result. Our junction condition works for both spacelike and timelike interfaces. We also provide simple examples that illustrate applications of the junction condition. We further comment on the geometry of a web of spacetime in the presence of multiple interfaces and its resemblance to Feynman diagrams.


title: Approximating Optimal Morphing Attacks using Template Inversion

abstract: Recent works have demonstrated the feasibility of inverting face recognition systems, enabling to recover convincing face images using only their embeddings. We leverage such template inversion models to develop a novel type ofdeep morphing attack based on inverting a theoretical optimal morph embedding, which is obtained as an average of the face embeddings of source images. We experiment with two variants of this approach: the first one exploits a fully self-contained embedding-to-image inversion model, while the second leverages the synthesis network of a pretrained StyleGAN network for increased morph realism. We generate morphing attacks from several source datasets and study the effectiveness of those attacks against several face recognition networks. We showcase that our method can compete with and regularly beat the previous state of the art for deep-learning based morph generation in terms of effectiveness, both in white-box and black-box attack scenarios, and is additionally much faster to run. We hope this might facilitate the development of large scale deep morph datasets for training detection models.


title: Multi-dimensional state space collapse in non-complete resource pooling scenarios

abstract: The present paper establishes an explicit multi-dimensional state space collapse (SSC) for parallel-processing systems with arbitrary compatibility constraints between servers and job types. This breaks major new ground beyond the SSC results and queue length asymptotics in the literature which are largely restricted to complete resource pooling (CRP) scenarios where the steady-state queue length vector concentrates around a line in heavy traffic. The multi-dimensional SSC that we establish reveals heavy-traffic behavior which is also far more tractable than the pre-limit queue length distribution, yet exhibits a fundamentally more intricate structure than in the one-dimensional case, providing useful insight into the system dynamics. In particular, we prove that the limiting queue length vector lives in a $K$-dimensional cone of which the set of spanning vectors is random in general, capturing the delicate interplay between the various job types and servers. For a broad class of systems we provide a further simplification which shows that the collection of random cones constitutes a fixed $K$-dimensional cone, resulting in a $K$-dimensional SSC. The dimension $K$ represents the number of critically loaded subsystems, or equivalently, capacity bottlenecks in heavy-traffic, with $K=1$ corresponding to conventional CRP scenarios. Our approach leverages probability generating function (PGF) expressions for Markovian systems operating under redundancy policies.


title: Combining Belief Function Theory and Stochastic Model Predictive Control for Multi-Modal Uncertainty in Autonomous Driving

abstract: In automated driving, predicting and accommodating the uncertain future motion of other traffic participants is challenging, especially in unstructured environments in which the high-level intention of traffic participants is difficult to predict. Several possible uncertain future behaviors of traffic participants must be considered, resulting in multi-modal uncertainty. We propose a novel combination of Belief Function Theory and Stochastic Model Predictive Control for trajectory planning of the autonomous vehicle in presence of significant uncertainty about the intention estimation of traffic participants. A misjudgment of the intention of traffic participants may result in dangerous situations. At the same time, excessive conservatism must be avoided. Therefore, the measure of reliability of the estimation provided by Belief Function Theory is used in the design of collision-avoidance safety constraints, in particular to increase safety when the intention of traffic participants is not clear. We discuss two methods to leverage on Belief Function Theory: we introduce a novel belief-to-probability transformation designed not to underestimate unlikely events if the information is uncertain, and a constraint tightening mechanism using the reliability of the estimation. We evaluate our proposal through simulations comparing to state-of-the-art approaches.


title: Time-Series Analysis Approach for Improving Energy Efficiency of a Fixed-Route Vessel in Short-Sea Shipping

abstract: Several approaches have been developed for improving the ship energy efficiency, thereby reducing operating costs and ensuring compliance with climate change mitigation regulations. Many of these approaches will heavily depend on measured data from onboard IoT devices, including operational and environmental information, as well as external data sources for additional navigational data. In this paper, we develop a framework that implements time-series analysis techniques to optimize the vessel's speed profile for improving the vessel's energy efficiency. We present a case study involving a real-world data from a passenger vessel that was collected over a span of 15 months in the south of Sweden. The results indicate that the implemented models exhibit a range of outcomes and adaptability across different scenarios. The findings highlight the effectiveness of time-series analysis approach for optimizing vessel voyages within the context of constrained landscapes, as often seen in short-sea shipping.


title: PeaTMOSS: A Dataset and Initial Analysis of Pre-Trained Models in Open-Source Software

abstract: The development and training of deep learning models have become increasingly costly and complex. Consequently, software engineers are adopting pre-trained models (PTMs) for their downstream applications. The dynamics of the PTM supply chain remain largely unexplored, signaling a clear need for structured datasets that document not only the metadata but also the subsequent applications of these models. Without such data, the MSR community cannot comprehensively understand the impact of PTM adoption and reuse. This paper presents the PeaTMOSS dataset, which comprises metadata for 281,638 PTMs and detailed snapshots for all PTMs with over 50 monthly downloads (14,296 PTMs), along with 28,575 open-source software repositories from GitHub that utilize these models. Additionally, the dataset includes 44,337 mappings from 15,129 downstream GitHub repositories to the 2,530 PTMs they use. To enhance the dataset's comprehensiveness, we developed prompts for a large language model to automatically extract model metadata, including the model's training datasets, parameters, and evaluation metrics. Our analysis of this dataset provides the first summary statistics for the PTM supply chain, showing the trend of PTM development and common shortcomings of PTM package documentation. Our example application reveals inconsistencies in software licenses across PTMs and their dependent projects. PeaTMOSS lays the foundation for future research, offering rich opportunities to investigate the PTM supply chain. We outline mining opportunities on PTMs, their downstream usage, and cross-cutting questions.


title: In-Bed Pose Estimation: A Review

abstract: Human pose estimation, the process of identifying joint positions in a person's body from images or videos, represents a widely utilized technology across diverse fields, including healthcare. One such healthcare application involves in-bed pose estimation, where the body pose of an individual lying under a blanket is analyzed. This task, for instance, can be used to monitor a person's sleep behavior and detect symptoms early for potential disease diagnosis in homes and hospitals. Several studies have utilized unimodal and multimodal methods to estimate in-bed human poses. The unimodal studies generally employ RGB images, whereas the multimodal studies use modalities including RGB, long-wavelength infrared, pressure map, and depth map. Multimodal studies have the advantage of using modalities in addition to RGB that might capture information useful to cope with occlusions. Moreover, some multimodal studies exclude RGB and, this way, better suit privacy preservation. To expedite advancements in this domain, we conduct a review of existing datasets and approaches. Our objectives are to show the limitations of the previous studies, current challenges, and provide insights for future works on the in-bed human pose estimation field.


title: From total destruction to complete survival: Dust processing at different evolutionary stages in the supernova remnant Cassiopeia A

abstract: The expanding ejecta of supernova remnants (SNRs) are believed to form dust in dense clumps of gas. Before the dust can be expelled into the interstellar medium and contribute to the interstellar dust budget, it has to survive the reverse shock that is generated through the interaction of the preceding supernova blast wave with the surrounding medium. The conditions under which the reverse shock hits the clumps change with remnant age and define the dust survival rate. To study the dust destruction in the SNR Cassiopeia A, we conduct magnetohydrodynamical simulations of the evolution of a supernova blast wave and of the reverse shock. In a second step we use these evolving conditions to model clumps that are disrupted by the reverse shock at different remnant ages. Finally, we compute the amount of dust that is destroyed by the impact of the reverse shock. We find that most of the dust in the SNR is hit by the reverse shock within the first 350 yr after the SN explosion. While the dust destruction in the first 200 yr is almost complete, we expect greater dust survival rates at later times and almost total survival for clumps that are first impacted at ages beyond 1000 yr. Integrated over the entire evolution of the SNR, the dust mass shows the lowest survival fraction (17 per cent) for the smallest grains (1 nm) and the highest survival fraction (28 per cent) for the largest grains (1000 nm).


title: ScN/GaN($1\bar{1}00$): a new platform for the epitaxy of twin-free metal-semiconductor heterostructures

abstract: We study the molecular beam epitaxy of rock-salt ScN on the wurtzite GaN($1\bar{1}00$) surface. To this end, ScN is grown on free-standing GaN($1\bar{1}00$) substrates and self-assembled GaN nanowires that exhibit ($1\bar{1}00$) sidewalls. On both substrates, ScN crystallizes twin-free thanks to a specific epitaxial relationship, namely ScN(110)[001]$||$GaN($1\bar{1}00$)[0001], providing a congruent, low-symmetry GaN/ScN interface. The 13.1 % uniaxial lattice mismatch occurring in this orientation mostly relaxes within the first few monolayers of growth by forming a coincidence site lattice, where 7 GaN planes coincide with 8 ScN planes, leaving the ScN surface nearly free of extended defects. Overgrowth of the ScN with GaN leads to a kinetic stabilization of the zinc blende phase, that rapidly develops wurtzite inclusions nucleating on {111} nanofacets, commonly observed during zinc blende GaN growth. Our ScN/GaN($1\bar{1}00$) platform opens a new route for the epitaxy of twin-free metal-semiconductor heterostructures made of closely lattice-matched GaN, ScN, HfN and ZrN compounds.


title: Vehicle Perception from Satellite

abstract: Satellites are capable of capturing high-resolution videos. It makes vehicle perception from satellite become possible. Compared to street surveillance, drive recorder or other equipments, satellite videos provide a much broader city-scale view, so that the global dynamic scene of the traffic are captured and displayed. Traffic monitoring from satellite is a new task with great potential applications, including traffic jams prediction, path planning, vehicle dispatching, \emph{etc.}. Practically, limited by the resolution and view, the captured vehicles are very tiny (a few pixels) and move slowly. Worse still, these satellites are in Low Earth Orbit (LEO) to capture such high-resolution videos, so the background is also moving. Under this circumstance, traffic monitoring from the satellite view is an extremely challenging task. To attract more researchers into this field, we build a large-scale benchmark for traffic monitoring from satellite. It supports several tasks, including tiny object detection, counting and density estimation. The dataset is constructed based on 12 satellite videos and 14 synthetic videos recorded from GTA-V. They are separated into 408 video clips, which contain 7,336 real satellite images and 1,960 synthetic images. 128,801 vehicles are annotated totally, and the number of vehicles in each image varies from 0 to 101. Several classic and state-of-the-art approaches in traditional computer vision are evaluated on the datasets, so as to compare the performance of different approaches, analyze the challenges in this task, and discuss the future prospects. The dataset is available at: https://github.com/Chenxi1510/Vehicle-Perception-from-Satellite-Videos.


title: Measuring, processing, and generating partially coherent light with self-configuring optics

abstract: Optical phenomena always display some degree of partial coherence between their respective degrees of freedom. Partial coherence is of particular interest in multimodal systems, where classical and quantum correlations between spatial, polarization, and spectral degrees of freedom can lead to fascinating phenomena (e.g., entanglement) and be leveraged for advanced imaging and sensing modalities (e.g., in hyperspectral, polarization, and ghost imaging). Here, we present a universal method to analyze, process, and generate spatially partially coherent light in multimode systems by using self-configuring optical networks. Our method relies on cascaded self-configuring layers whose average power outputs are sequentially optimized. Once optimized, the network separates the input light into its mutually incoherent components, which is formally equivalent to a diagonalization of the input density matrix. We illustrate our method with arrays of Mach-Zehnder interferometers and show how this method can be used to perform partially coherent environmental light sensing, generation of multimode partially coherent light with arbitrary coherency matrices, and unscrambling of quantum optical mixtures. We provide guidelines for the experimental realization of this method, paving the way for self-configuring photonic devices that can automatically learn optimal modal representations of partially coherent light fields.


title: Combining the Strengths of Dutch Survey and Register Data in a Data Challenge to Predict Fertility (PreFer)

abstract: The social sciences have produced an impressive body of research on determinants of fertility outcomes, or whether and when people have children. However, the strength of these determinants and underlying theories are rarely evaluated on their predictive ability on new data. This prevents us from systematically comparing studies, hindering the evaluation and accumulation of knowledge. In this paper, we present two datasets which can be used to study the predictability of fertility outcomes in the Netherlands. One dataset is based on the LISS panel, a longitudinal survey which includes thousands of variables on a wide range of topics, including individual preferences and values. The other is based on the Dutch register data which lacks attitudinal data but includes detailed information about the life courses of millions of Dutch residents. We provide information about the datasets and the samples, and describe the fertility outcome of interest. We also introduce the fertility prediction data challenge PreFer which is based on these datasets and will start in Spring 2024. We outline the ways in which measuring the predictability of fertility outcomes using these datasets and combining their strengths in the data challenge can advance our understanding of fertility behaviour and computational social science. We further provide details for participants on how to take part in the data challenge.


title: Examples of solvable and nilpotent finite quantum groups

abstract: We prove the solvability and nilpotency of Kac--Paljutkin's finite quantum group and Sekine quantum groups and we classify the solvable series of Kac--Paljutkin's finite quantum group via Cohen--Westreich's Burnside theorem. Some semisimple quasitriangular Hopf algebras of dimensions $2pq$ are also studied. In Appendix A, we give a direct computation of the universal $R$-matrices for Kac--Paljutkin's $8$-dimensional finite quantum group.


title: Non-Exchangeable Conformal Language Generation with Nearest Neighbors

abstract: Quantifying uncertainty in automatically generated text is important for letting humans check potential hallucinations and making systems more reliable. Conformal prediction is an attractive framework to provide predictions imbued with statistical guarantees, however, its application to text generation is challenging since any i.i.d. assumptions are not realistic. In this paper, we bridge this gap by leveraging recent results on non-exchangeable conformal prediction, which still ensures bounds on coverage. The result, non-exchangeable conformal nucleus sampling, is a novel extension of the conformal prediction framework to generation based on nearest neighbors. Our method can be used post-hoc for an arbitrary model without extra training and supplies token-level, calibrated prediction sets equipped with statistical guarantees. Experiments in machine translation and language modeling show encouraging results in generation quality. By also producing tighter prediction sets with good coverage, we thus give a more theoretically principled way to perform sampling with conformal guarantees.


title: Benchmarking human-robot collaborative assembly tasks

abstract: Manufacturing assembly tasks can vary in complexity and level of automation. Yet, achieving full automation can be challenging and inefficient, particularly due to the complexity of certain assembly operations. Human-robot collaborative work, leveraging the strengths of human labor alongside the capabilities of robots, can be a solution for enhancing efficiency. This paper introduces the CT benchmark, a benchmark and model set designed to facilitate the testing and evaluation of human-robot collaborative assembly scenarios. It was designed to compare manual and automatic processes using metrics such as the assembly time and human workload. The components of the model set can be assembled through the most common assembly tasks, each with varying levels of difficulty. The CT benchmark was designed with a focus on its applicability in human-robot collaborative environments, with the aim of ensuring the reproducibility and replicability of experiments. Experiments were carried out to assess assembly performance in three different setups (manual, automatic and collaborative), measuring metrics related to the assembly time and the workload on human operators. The results suggest that the collaborative approach takes longer than the fully manual assembly, with an increase of 70.8%. However, users reported a lower overall workload, as well as reduced mental demand, physical demand, and effort according to the NASA-TLX questionnaire.


title: Towards an autonomous industry 4.0 warehouse: A UAV and blockchain-based system for inventory and traceability applications in big data-driven supply chain management

abstract: In this paper we present the design and evaluation of a UAV-based system aimed at automating inventory tasks and keeping the traceability of industrial items attached to Radio-Frequency IDentification (RFID) tags. To confront current shortcomings, such a system is developed under a versatile, modular and scalable architecture aimed to reinforce cyber security and decentralization while fostering external audits and big data analytics. Therefore, the system uses a blockchain and a distributed ledger to store certain inventory data collected by UAVs, validate them, ensure their trustworthiness and make them available to the interested parties. In order to show the performance of the proposed system, different tests were performed in a real industrial warehouse, concluding that the system is able to obtain the inventory data really fast in comparison to traditional manual tasks, while being also able to estimate the position of the items when hovering over them thanks to their tag's signal strength. In addition, the performance of the proposed blockchain-based architecture was evaluated in different scenarios.


title: CP Violation in B Decays: Recent Developments and Future Perspectives

abstract: CP violation in B decays provides a powerful tool to probe physics from beyond the Standard Model. A theoretical overview of recent developments of benchmark channels is given, ranging from non-leptonic to rare leptonic and semileptonic modes, opening up exciting perspectives for the future high-precision era of flavour physics and the pursuit of New Physics.


title: Explaining Text Classifiers with Counterfactual Representations

abstract: One well motivated explanation method for classifiers leverages counterfactuals which are hypothetical events identical to real observations in all aspects except for one categorical feature. Constructing such counterfactual poses specific challenges for texts, however, as some attribute values may not necessarily align with plausible real-world events. In this paper we propose a simple method for generating counterfactuals by intervening in the space of text representations which bypasses this limitation. We argue that our interventions are minimally disruptive and that they are theoretically sound as they align with counterfactuals as defined in Pearl's causal inference framework. To validate our method, we conducted experiments first on a synthetic dataset and then on a realistic dataset of counterfactuals. This allows for a direct comparison between classifier predictions based on ground truth counterfactuals - obtained through explicit text interventions - and our counterfactuals, derived through interventions in the representation space. Eventually, we study a real world scenario where our counterfactuals can be leveraged both for explaining a classifier and for bias mitigation.


title: ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Prediction

abstract: Accurate prediction of climate in the subseasonal-to-seasonal scale is crucial for disaster preparedness and robust decision making amidst climate change. Yet, forecasting beyond the weather timescale is challenging because it deals with problems other than initial conditions, including boundary interaction, butterfly effect, and our inherent lack of physical understanding. At present, existing benchmarks tend to have shorter forecasting range of up-to 15 days, do not include a wide range of operational baselines, and lack physics-based constraints for explainability. Thus, we propose ChaosBench, a challenging benchmark to extend the predictability range of data-driven weather emulators to S2S timescale. First, ChaosBench is comprised of variables beyond the typical surface-atmospheric ERA5 to also include ocean, ice, and land reanalysis products that span over 45 years to allow for full Earth system emulation that respects boundary conditions. We also propose physics-based, in addition to deterministic and probabilistic metrics, to ensure a physically-consistent ensemble that accounts for butterfly effect. Furthermore, we evaluate on a diverse set of physics-based forecasts from four national weather agencies as baselines to our data-driven counterpart such as ClimaX, PanguWeather, GraphCast, and FourCastNetV2. Overall, we find methods originally developed for weather-scale applications fail on S2S task: their performance simply collapse to an unskilled climatology. Nonetheless, we outline and demonstrate several strategies that can potentially extend the predictability range of existing weather emulators, including the use of ensembles and robust control of error propagation. Our benchmark, datasets, and instructions are available at https://leap-stc.github.io/ChaosBench.


title: Distribution-uniform strong laws of large numbers

abstract: We revisit the question of whether the strong law of large numbers (SLLN) holds uniformly in a rich family of distributions, culminating in a distribution-uniform generalization of the Marcinkiewicz-Zygmund SLLN. These results can be viewed as extensions of Chung's distribution-uniform SLLN to random variables with uniformly integrable $q^\text{th}$ absolute central moments for $0 < q < 2;\ q \neq 1$. Furthermore, we show that uniform integrability of the $q^\text{th}$ moment is both sufficient and necessary for the SLLN to hold uniformly at the Marcinkiewicz-Zygmund rate of $n^{1/q - 1}$. These proofs centrally rely on distribution-uniform analogues of some familiar almost sure convergence results including the Khintchine-Kolmogorov convergence theorem, Kolmogorov's three-series theorem, a stochastic generalization of Kronecker's lemma, and the Borel-Cantelli lemmas. The non-identically distributed case is also considered.


title: Neutral carbon in diffuse interstellar medium: abundance matching with H2 for DLAs at high redshifts

abstract: We present the study of CI/H$_2$ relative abundance in the diffuse cold neutral medium. Using the chemical and thermal balance model we calculated the dependence of CI/H$_2$ on the main parameters of the medium: hydrogen number density, metallicity, strength of the UV field, and cosmic ray ionization rate (CRIR). We show that observed relative CI and H$_2$ column densities in damped Lyman alpha systems (DLAs) at high redshifts can be reproduced within our model assuming the typically expected conditions in the diffuse cold neutral medium (CNM). Using the additional observed information the on metallicity, HI column density, and excitation of CI fine-structure levels, as well as temperature we estimated for a wide range metallicities in the CNM at high redshifts that CRIRs to be in the range from $\sim10^{-16}$ to $\rm few \times 10^{-15}\rm s^{-1}$, hydrogen number densities to be in range $\sim10 - 10^3$cm$^{-3}$, and UV field in range from $10^{-2}$ to $\rm few \times 10^2$ of Mathis field. We argue, that since the observed quantities used in this work are quite homogeneous and much less affected by the radiative transfer effects (in comparison with e.g. dissociation of HD and UV pumping of H$_2$ rotational levels) our estimates are quite robust against the assumption of the exact geometrical model of the cloud and local sources of the UV field.


title: Intent Assurance using LLMs guided by Intent Drift

abstract: Intent-Based Networking (IBN) presents a paradigm shift for network management, by promising to align intents and business objectives with network operations--in an automated manner. However, its practical realization is challenging: 1) processing intents, i.e., translate, decompose and identify the logic to fulfill the intent, and 2) intent conformance, that is, considering dynamic networks, the logic should be adequately adapted to assure intents. To address the latter, intent assurance is tasked with continuous verification and validation, including taking the necessary actions to align the operational and target states. In this paper, we define an assurance framework that allows us to detect and act when intent drift occurs. To do so, we leverage AI-driven policies, generated by Large Language Models (LLMs) which can quickly learn the necessary in-context requirements, and assist with the fulfillment and assurance of intents.


title: A census of genus 6 curves over $\mathbb{F}_2$

abstract: We compile a complete list of isomorphism class representatives of curves of genus 6 over $\mathbb{F}_2$. We use explicit descriptions of canonical curves in each stratum of the Brill--Noether stratification of the moduli space $\mathcal{M}_6$, due to Mukai in the generic case. Our computed value of $\#\mathcal{M}_6(\mathbb{F}_2)$ agrees with the Lefschetz trace formula as recently computed by Bergstrom--Canning--Petersen--Schmitt.


title: Sensitivity Analysis of Separation Time Along Weak Stability Boundary Transfers

abstract: This study analyzes the sensitivity of the dynamics around Weak Stability Boundary Transfers (WSBT) in the elliptical restricted three-body problem. With WSBTs increasing popularity for cislunar transfers, understanding its inherently chaotic dynamics becomes pivotal for guiding and navigating cooperative spacecrafts as well as detecting non-cooperative objects. We introduce the notion of separation time to gauge the deviation of a point near a nominal WSBT from the trajectory's vicinity. Employing the Cauchy-Green tensor to identify stretching directions in position and velocity, the separation time, along with the Finite-Time Lyapunov Exponent are studied within a ball of state uncertainty scaled to typical orbit determination performances.


title: Investigation of fluorescence versus transmission readout for three-photon Rydberg excitation used in electrometry

abstract: We present a three-photon based fluorescence readout method where the strength of the fluorescence scales with the strength of the radio-frequency (RF) field being applied. We compare this method to conventional three-photon electromagnetically-induced transparency (EIT) and electromagnetically-induced absorption (EIA). Our demonstrated EIA/EIT sensitivity in the collinear three-photon Cesium system is the best reported to date at roughly 30 uVm^{-1}Hz^{-1/2}. The fluorescence is nearly 4 fold better in sensitivity compared to EIA/EIT readout.


title: Orientation-aware Incremental Potential Contact

abstract: The Incremental Potential Contact (IPC) method enables robust complex simulations of deformable objects with contact and friction. The key to IPC's robustness is its strict adherence to geometric constraints, avoiding intersections, which are a common cause of robustness issues in contact mechanics. A key element of the IPC approach to contact is a geometric barrier function, which is defined directly in the discrete setting. While IPC achieves its main goal of providing guarantees for contact constraints, its parameters need to be chosen carefully to avoid significant simulation artifacts and inaccuracies. We present a systematic derivation of an IPC-like continuum potential defined for smooth and piecewise smooth surfaces, starting from identifying a set of natural requirements for contact potentials, including the barrier property, locality, differentiable dependence of shape, and absence of forces in rest configurations, based on the idea of candidate sets. Our potential is formulated in a way independent of surface discretization. This new potential is suitable for piecewise-linear surfaces and its efficiency is similar to standard IPC. We demonstrate its behavior and compare it to IPC on a range of challenging contact examples.


title: 2.5-MHD models of circumstellar discs around FS~CMa post-mergers : II. Stationary accretion stage

abstract: We study the star-disc interaction in the presence of the strong magnetic field ($B_\star=6.2kG$) of a slowly rotating star. This situation describes a post-merger of the spectral type B and has not been previously investigated. We perform a set of resistive and viscosity $2.5D$-magnetohydrodynamical simulations using the PLUTO code. Based on our previous work, we consider the initial gas disc density $\rho_{d0}=10^{-13}\mathrm{gcm}^{-3}$ since it describes the conditions around IRAS 17449+2320 well. We find that the fall of gas towards the star occurs in the mid-plane, and remarkably, intermittent backflow takes place in the mid-plane in all of our models for $R\geq10R_\star$. However, we do not rule out that the funnel effect may occur and cause the accretion closer to the poles. Also, when larger values of viscosity ($\alpha_\nu=1$) and stellar rotation rate ($\delta_\star=0.2$) are considered, we find that the disc exhibits a thickening which is characteristic of FS~CMa-type stellar objects. Additionally, we find that the poloidal magnetic field lines twist over short periods of time, leading to magnetic reconnection causing coronal heating that could explain the presence of the Raman lines found observationally in several FS~CMa stars. Lastly, we find the formation of several knots in the magnetic field lines near and in the mid-plane of the disc which produce perturbations in the density and velocity components, as well as the formation of shallow gaps whose position depends on the inflation of the magnetic field lines.


title: Multi-scale magnetic field investigation of the M-dwarf eclipsing binary CU Cancri

abstract: We aim to characterise the magnetic field of the eclipsing binary CU Cnc. The determination of magnetic field parameters of this target enables comparisons with both observations of similar stars and theoretical predictions of the magnetic field strength for CU Cnc. The target is therefore providing an excellent opportunity to test our understanding of the generation of magnetic fields in low-mass stars and its impact on stellar structure. We use spectropolarimetric observations obtained with ESPaDOnS to investigate the magnetic properties of CU Cnc. We generate average line profiles with LSD, which are used to extract information about the radial velocities of the components, expanding the number of radial velocity measurements available and allowing for a determination of orbital parameters. Stokes V LSD profiles are used with ZDI to obtain large-scale magnetic field structures on both components. We also use polarised radiative transfer modelling to investigate the small-scale fields by utilising Zeeman splitting of magnetically sensitive Ti I lines in non-polarised spectra. The large-scale fields are dominantly poloidal and have an average strength of ~100 G on both components. This analysis of the large-scale fields likely suffers from some amount of hemisphere degeneracy due to the high inclination of the target. Both components also show unusual magnetic field configurations compared to stars with similar parameters, the primary is weakly axisymmetric (~10%) and the secondary has a strong torroidal contribution (~20%). The small-scale fields are significantly stronger, at 3.1 and 3.6 kG for the primary and secondary respectively. This measurement is in excellent agreement with surface field strength predictions for CU Cnc from magnetoconvective stellar evolution models. These results indicates that magnetic fields play a significant role in radius inflation of active stars.


title: Neural Style Transfer with Twin-Delayed DDPG for Shared Control of Robotic Manipulators

abstract: Neural Style Transfer (NST) refers to a class of algorithms able to manipulate an element, most often images, to adopt the appearance or style of another one. Each element is defined as a combination of Content and Style: the Content can be conceptually defined as the what and the Style as the how of said element. In this context, we propose a custom NST framework for transferring a set of styles to the motion of a robotic manipulator, e.g., the same robotic task can be carried out in an angry, happy, calm, or sad way. An autoencoder architecture extracts and defines the Content and the Style of the target robot motions. A Twin Delayed Deep Deterministic Policy Gradient (TD3) network generates the robot control policy using the loss defined by the autoencoder. The proposed Neural Policy Style Transfer TD3 (NPST3) alters the robot motion by introducing the trained style. Such an approach can be implemented either offline, for carrying out autonomous robot motions in dynamic environments, or online, for adapting at runtime the style of a teleoperated robot. The considered styles can be learned online from human demonstrations. We carried out an evaluation with human subjects enrolling 73 volunteers, asking them to recognize the style behind some representative robotic motions. Results show a good recognition rate, proving that it is possible to convey different styles to a robot using this approach.


title: Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoders

abstract: Achieving precise semantic control over the latent spaces of Variational AutoEncoders (VAEs) holds significant value for downstream tasks in NLP as the underlying generative mechanisms could be better localised, explained and improved upon. Recent research, however, has struggled to achieve consistent results, primarily due to the inevitable loss of semantic information in the variational bottleneck and limited control over the decoding mechanism. To overcome these challenges, we investigate discrete latent spaces in Vector Quantized Variational AutoEncoders (VQVAEs) to improve semantic control and generation in Transformer-based VAEs. In particular, We propose T5VQVAE, a novel model that leverages the controllability of VQVAEs to guide the self-attention mechanism in T5 at the token-level, exploiting its full generalization capabilities. Experimental results indicate that T5VQVAE outperforms existing state-of-the-art VAE models, including Optimus, in terms of controllability and preservation of semantic information across different tasks such as auto-encoding of sentences and mathematical expressions, text transfer, and inference. Moreover, T5VQVAE exhibits improved inference capabilities, suggesting potential applications for downstream natural language and symbolic reasoning tasks.


title: Automatic Segmentation of the Spinal Cord Nerve Rootlets

abstract: Precise identification of spinal nerve rootlets is relevant to delineate spinal levels for the study of functional activity in the spinal cord. The goal of this study was to develop an automatic method for the semantic segmentation of spinal nerve rootlets from T2-weighted magnetic resonance imaging (MRI) scans. Images from two open-access MRI datasets were used to train a 3D multi-class convolutional neural network using an active learning approach to segment C2-C8 dorsal nerve rootlets. Each output class corresponds to a spinal level. The method was tested on 3T T2-weighted images from datasets unseen during training to assess inter-site, inter-session, and inter-resolution variability. The test Dice score was 0.67 +- 0.16 (mean +- standard deviation across testing images and rootlets levels), suggesting a good performance. The method also demonstrated low inter-vendor and inter-site variability (coefficient of variation <= 1.41 %), as well as low inter-session variability (coefficient of variation <= 1.30 %) indicating stable predictions across different MRI vendors, sites, and sessions. The proposed methodology is open-source and readily available in the Spinal Cord Toolbox (SCT) v6.2 and higher.


title: Quantum Nonlocality: how does Nature do it?

abstract: In his article in Science, Nicolas Gisin claimed that quantum correlations emerge from outside space time. We explain that they are due to space time symmetries. This paper is a critical review of metaphysical conclusions found in many recent articles. It advocates the importance of contextuality, Einstein causality and global symmetries. Bell tests allow only rejecting probabilistic coupling provided by a local hidden variable model, but they do not justify metaphysical speculations about quantum nonlocality and objects which know about each other state, even when separated by large distances. The violation of Bell inequalities in physics and in cognitive science can be explained using the notion of Bohr contextuality. If contextual variables, describing varying experimental contexts, are correctly incorporated into a probabilistic model, then the Bell and CHSH inequalities cannot be proven and nonlocal correlations may be explained in an intuitive way. We also elucidate the meaning of statistical independence assumption incorrectly called free choice, measurement independence or no conspiracy. Since correlation does not imply causation, the violation of statistical independence should be called contextuality and it does not restrict the experimenter freedom of choice. Therefore, contrary to what is believed, closing the freedom of choice loophole does not close the contextuality loophole.


title: A Bi-Objective Optimization Based Acquisition Strategy for Batch Bayesian Global Optimization

abstract: In this paper, we deal with batch Bayesian Optimization (Bayes-Opt) problems over a box and we propose a novel bi-objective optimization (BOO) acquisition strategy to sample points where to evaluate the objective function. The BOO problem involves the Gaussian Process posterior mean and variance functions, which, in most of the acquisition strategies from the literature, are generally used in combination, frequently through scalarization. However, such scalarization could compromise the Bayes-Opt process performance, as getting the desired trade-off between exploration and exploitation is not trivial in most cases. We instead aim to reconstruct the Pareto front of the BOO problem based on optimizing both the posterior mean as well as the variance, thus generating multiple trade-offs without any a priori knowledge. The reconstruction is performed through the Non-dominated Sorting Memetic Algorithm (NSMA), recently proposed in the literature and proved to be effective in solving hard MOO problems. Finally, we present two clustering approaches, each of them operating on a different space, to select potentially optimal points from the Pareto front. We compare our methodology with well-known acquisition strategies from the literature, showing its effectiveness on a wide set of experiments.


title: 95 GeV excess in a $CP$-violating $\mu$-from-$\nu$ SSM

abstract: The CMS and ATLAS have recently reported their results searching for light Higgs boson with mass around 95 GeV, based on the full Run 2 data set. In the framework of the CP-violating (CPV) $\mu\nu$SSM, we discuss a $\sim$ 2.9$\sigma$ (local) excess at 95 GeV in the light Higgs boson search in the diphoton decay mode as reported by ATLAS and CMS, together with a $\sim$ 2$\sigma$ excess (local) in the $b\bar{b}$ final state at LEP in the same mass range. By introducing CPV phases as well as by mixing CP-even Higgs and CP-odd Higgs, a lighter Higgs boson in the $\mu\nu$SSM can be produced, which can account for the "di-photon excess".


title: Dropout-Based Rashomon Set Exploration for Efficient Predictive Multiplicity Estimation

abstract: Predictive multiplicity refers to the phenomenon in which classification tasks may admit multiple competing models that achieve almost-equally-optimal performance, yet generate conflicting outputs for individual samples. This presents significant concerns, as it can potentially result in systemic exclusion, inexplicable discrimination, and unfairness in practical applications. Measuring and mitigating predictive multiplicity, however, is computationally challenging due to the need to explore all such almost-equally-optimal models, known as the Rashomon set, in potentially huge hypothesis spaces. To address this challenge, we propose a novel framework that utilizes dropout techniques for exploring models in the Rashomon set. We provide rigorous theoretical derivations to connect the dropout parameters to properties of the Rashomon set, and empirically evaluate our framework through extensive experimentation. Numerical results show that our technique consistently outperforms baselines in terms of the effectiveness of predictive multiplicity metric estimation, with runtime speedup up to $20\times \sim 5000\times$. With efficient Rashomon set exploration and metric estimation, mitigation of predictive multiplicity is then achieved through dropout ensemble and model selection.


title: Profiling and Modeling of Power Characteristics of Leadership-Scale HPC System Workloads

abstract: In the exascale era in which application behavior has large power & energy footprints, per-application job-level awareness of such impression is crucial in taking steps towards achieving efficiency goals beyond performance, such as energy efficiency, and sustainability. To achieve these goals, we have developed a novel low-latency job power profiling machine learning pipeline that can group job-level power profiles based on their shapes as they complete. This pipeline leverages a comprehensive feature extraction and clustering pipeline powered by a generative adversarial network (GAN) model to handle the feature-rich time series of job-level power measurements. The output is then used to train a classification model that can predict whether an incoming job power profile is similar to a known group of profiles or is completely new. With extensive evaluations, we demonstrate the effectiveness of each component in our pipeline. Also, we provide a preliminary analysis of the resulting clusters that depict the power profile landscape of the Summit supercomputer from more than 60K jobs sampled from the year 2021.


title: Gravitational Wave Emission from Close-in Strange Quark Planets Around Strange Stars with Magnetic Interactions

abstract: According to the strange quark matter hypothesis, strange planets may exist, which are planetary mass objects composed of almost equal numbers of up, down and strange quarks. A strange planet can revolve around its host strange star in a very close-in orbit. When it finally merges with the host, strong gravitational wave emissions will be generated. Here the gravitational waveforms are derived for the merging process, taking into account the effects of the strange star's magnetic field on the dynamics. Effects of the inclination angle are also considered. Templates of the gravitational waveforms are derived. It is found that the magnetic interactions significantly speed up the merging process. Coalescence events of such strange planetary systems occurring in our Galaxy as well as in local galaxies can be effectively detected by current and future gravitational experiments, which may hopefully provide a new method to test the strange quark matter hypothesis and probe the magnetic field of compact stars.


title: Resource-efficient and loss-aware photonic graph state preparation using an array of quantum emitters, and application to all-photonic quantum repeaters

abstract: Multi-qubit photonic graph states are necessary for quantum communication and computation. Preparing photonic graph states using probabilistic stitching of single photons using linear optics results in a formidable resource requirement due to the need of multiplexing. Quantum emitters present a viable solution to prepare photonic graph states, as they enable controlled production of photons entangled with the emitter qubit, and deterministic two-qubit interactions among emitters. A handful of emitters often suffice to generate useful photonic graph states that would otherwise require millions of single photon sources using the linear-optics method. But, photon loss poses an impediment to this method due to the large depth, i.e., age of the oldest photon, of the graph state, given the typically large number of slow and noisy two-qubit CNOT gates required on emitters. We propose an algorithm that can trade the number of emitters with the graph-state depth, while minimizing the number of emitter CNOTs. We apply our algorithm to generating a repeater graph state (RGS) for all-photonic repeaters. We find that our scheme achieves a far superior rate-vs.-distance performance than using the least number of emitters needed to generate the RGS. Yet, our scheme is able to get the same performance as the linear-optics method of generating the RGS where each emitter is used as a single-photon source, but with orders of magnitude fewer emitters.


title: MobilityDL: A Review of Deep Learning From Trajectory Data

abstract: Trajectory data combines the complexities of time series, spatial data, and (sometimes irrational) movement behavior. As data availability and computing power have increased, so has the popularity of deep learning from trajectory data. This review paper provides the first comprehensive overview of deep learning approaches for trajectory data. We have identified eight specific mobility use cases which we analyze with regards to the deep learning models and the training data used. Besides a comprehensive quantitative review of the literature since 2018, the main contribution of our work is the data-centric analysis of recent work in this field, placing it along the mobility data continuum which ranges from detailed dense trajectories of individual movers (quasi-continuous tracking data), to sparse trajectories (such as check-in data), and aggregated trajectories (crowd information).


title: High Resolution Rovibrational and Rotational Spectroscopy of H$_2$CCCH$^+$

abstract: The rovibrational spectrum of the molecular ion H$_2$CCCH$^+$ was investigated in a 4~K cryogenic ion trap instrument employing the leak-out spectroscopy method. Transitions within the fundamental $\nu_1$ (C-H stretch) and the combination band $\nu_3$+$\nu_5$ (C-C stretches) were detected, the search aided by high level quantum chemical calculations. The analysis of the rovibrational measurements enabled us to predict the rotational structure of the ground state. Using a rotational-vibrational double-resonance scheme, 14 pure rotational transitions were measured. This, in turn, led to the radio astronomical detection of H$_2$CCCH$^+$ in the interstellar medium, as recently reported (Silva et al., Astron. Astrophys. 676, L1, 2023).


title: BIOMERO: BioImage analysis in OMERO

abstract: In the rapidly evolving field of bioimaging, the integration and orchestration of Findable, Accessible, Interoperable, and Reusable (FAIR) image analysis workflows remains a challenge. We introduce BIOMERO, a bridge connecting OMERO, a renowned bioimaging data management platform, FAIR workflows and high-performance computing (HPC) environments. BIOMERO, featuring our opensource Python library "OMERO Slurm Client", facilitates seamless execution of FAIR workflows, particularly for large datasets from High Content or High Throughput Screening. BIOMERO empowers researchers by eliminating the need for specialized knowledge, enabling scalable image processing directly from OMERO. BIOMERO notably supports the sharing and utilization of FAIR workflows between OMERO, Cytomine/BIAFLOWS, and other bioimaging communities. BIOMERO will promote the widespread adoption of FAIR workflows, emphasizing reusability, across the realm of bioimaging research. Its user-friendly interface will empower users, including those without technical expertise, to seamlessly apply these workflows to their datasets, democratizing the utilization of AI by the broader research community.


title: An Analytical Approach for Intermodal Urban Transportation Network Equilibrium including Shared Mobility Services

abstract: Shared Mobility Services (SMSs) are reshaping urban transportation systems by providing flexible mobility options. With their capacity to decrease the number of cars on the roads, these services can potentially improve the transportation system's performance in terms of travel times and emissions. This emphasizes the importance of analyzing and understanding their impacts on the system and users' choices, especially when integrated into a complex multi-modal system, including public transport (PT). Many studies overlook the synergies between SMSs and PT, leading to inaccurate traffic estimations and planning. This research offers an exhaustive review of multi-modal transportation system models involving SMSs. We then introduce a traffic assignment analytical model framed as a Mixed-Integer Quadratic Problem (MIQP). This model comprises diverse travel possibilities, including SMSs, and handles intermodality by allowing commuters to combine modes to optimize time and monetary expense. An in-depth examination of commuters' behavior on two test cases and an analysis of the price of anarchy highlights the disparities between user equilibrium and system optimum in such intricate systems.


title: Global sampling of Feynman's diagrams through Normalizing Flow

abstract: Normalizing Flows (NF) are powerful generative models with increasing applications in augmenting Monte Carlo algorithms due to their high flexibility and expressiveness. In this work we explore the integration of NF in Diagrammatic Monte Carlo (DMC), presenting an architecture designed to sample the intricate multidimensional space of Feynman's diagrams through dimensionality reduction. By decoupling the sampling of diagram order and interaction times, the flow focuses on one interaction at a time. This enables constructing a general diagram by employing the same unsupervised model iteratively, dressing a zero-order diagram with interactions determined by the previously sampled order. The resulting NF-augmented DMC is tested on the widely used single-site Holstein polaron model in the entire electron-phonon coupling regime. The obtained data show that the model accurately reproduces the diagram distribution reducing sample correlation and statistical error for observables such as the polaron binding energy and the interacting Green's function.


title: Localization of point scatterers via sparse optimization on measures

abstract: We consider the inverse scattering problem for time-harmonic acoustic waves in a medium with pointwise inhomogeneities. In the Foldy-Lax model, the estimation of the scatterers' locations and intensities from far field measurements can be recast as the recovery of a discrete measure from nonlinear observations. We propose a "linearize and locally optimize" approach to perform this reconstruction. We first solve a convex program in the space of measures (known as the Beurling LASSO), which involves a linearization of the forward operator (the far field pattern in the Born approximation). Then, we locally minimize a second functional involving the nonlinear forward map, using the output of the first step as initialization. We provide guarantees that the output of the first step is close to the sought-after measure when the scatterers have small intensities and are sufficiently separated. We also provide numerical evidence that the second step still allows for accurate recovery in settings that are more involved.


title: FM3Q: Factorized Multi-Agent MiniMax Q-Learning for Two-Team Zero-Sum Markov Game

abstract: Many real-world applications involve some agents that fall into two teams, with payoffs that are equal within the same team but of opposite sign across the opponent team. The so-called two-team zero-sum Markov games (2t0sMGs) can be resolved with reinforcement learning in recent years. However, existing methods are thus inefficient in light of insufficient consideration of intra-team credit assignment, data utilization and computational intractability. In this paper, we propose the individual-global-minimax (IGMM) principle to ensure the coherence between two-team minimax behaviors and the individual greedy behaviors through Q functions in 2t0sMGs. Based on it, we present a novel multi-agent reinforcement learning framework, Factorized Multi-Agent MiniMax Q-Learning (FM3Q), which can factorize the joint minimax Q function into individual ones and iteratively solve for the IGMM-satisfied minimax Q functions for 2t0sMGs. Moreover, an online learning algorithm with neural networks is proposed to implement FM3Q and obtain the deterministic and decentralized minimax policies for two-team players. A theoretical analysis is provided to prove the convergence of FM3Q. Empirically, we use three environments to evaluate the learning efficiency and final performance of FM3Q and show its superiority on 2t0sMGs.


title: p-adically convergent loci in varieties arising from periodic continued fractions

abstract: Inspired by several alternative definitions of continued fraction expansions for elements in $\mathbb Q_p$, we study $p$-adically convergent periodic continued fractions with partial quotients in $\mathbb Z[1/p]$. To this end, following a previous work by Brock, Elkies, and Jordan, we consider certain algebraic varieties whose points represent formal periodic continued fractions with period and preperiod of fixed lengths, satisfying a given quadratic equation. We then focus on the $p$-adically convergent loci of these varieties, characterizing the zero and one-dimensional cases.


title: DRSM: efficient neural 4d decomposition for dynamic reconstruction in stationary monocular cameras

abstract: With the popularity of monocular videos generated by video sharing and live broadcasting applications, reconstructing and editing dynamic scenes in stationary monocular cameras has become a special but anticipated technology. In contrast to scene reconstructions that exploit multi-view observations, the problem of modeling a dynamic scene from a single view is significantly more under-constrained and ill-posed. Inspired by recent progress in neural rendering, we present a novel framework to tackle 4D decomposition problem for dynamic scenes in monocular cameras. Our framework utilizes decomposed static and dynamic feature planes to represent 4D scenes and emphasizes the learning of dynamic regions through dense ray casting. Inadequate 3D clues from a single-view and occlusion are also particular challenges in scene reconstruction. To overcome these difficulties, we propose deep supervised optimization and ray casting strategies. With experiments on various videos, our method generates higher-fidelity results than existing methods for single-view dynamic scene representation.


title: Axion Dark Matter from Cosmic String Network

abstract: We perform the lattice simulation to estimate the axion dark matter abundance radiated from the global cosmic strings in the post-inflationary scenario. The independent numerical confirmation on the recently observed logarithmic growth in both the number of strings per Hubble patch and the spectral index of the power law scaling for the axion spectrum is reported. These logarithmic scalings are checked against two different prescriptions for generating initial random field configurations, namely fat-string type and thermal phase transition. We discuss a possible strong correlation between the axion spectrum and the string evolutions with different initial conditions to support the insensitivity of scaling behaviors against different initial data and we provide a qualitative understanding of it. The impact of various combinations of the power law of the axion spectrum, nonlinearities around the QCD scale, and average inter-string distances on the axion abundance is discussed. Additionally, we introduce a new novel string identification method, based on the tetrahedralization of the space, which guarantees the connectedness of the strings and provides a convenient way of assigning the core location. Finally we derive the lower bound on the axion mass.


title: Transforming and Combining Rewards for Aligning Large Language Models

abstract: A common approach for aligning language models to human preferences is to first learn a reward model from preference data, and then use this reward model to update the language model. We study two closely related problems that arise in this approach. First, any monotone transformation of the reward model preserves preference ranking; is there a choice that is ``better'' than others? Second, we often wish to align language models to multiple properties: how should we combine multiple reward models? Using a probabilistic interpretation of the alignment procedure, we identify a natural choice for transformation for (the common case of) rewards learned from Bradley-Terry preference models. This derived transformation has two important properties. First, it emphasizes improving poorly-performing outputs, rather than outputs that already score well. This mitigates both underfitting (where some prompts are not improved) and reward hacking (where the model learns to exploit misspecification of the reward model). Second, it enables principled aggregation of rewards by linking summation to logical conjunction: the sum of transformed rewards corresponds to the probability that the output is ``good'' in all measured properties, in a sense we make precise. Experiments aligning language models to be both helpful and harmless using RLHF show substantial improvements over the baseline (non-transformed) approach.


title: Theoretical Understanding of In-Context Learning in Shallow Transformers with Unstructured Data

abstract: Large language models (LLMs) are powerful models that can learn concepts at the inference stage via in-context learning (ICL). While theoretical studies, e.g., \cite{zhang2023trained}, attempt to explain the mechanism of ICL, they assume the input $x_i$ and the output $y_i$ of each demonstration example are in the same token (i.e., structured data). However, in real practice, the examples are usually text input, and all words, regardless of their logic relationship, are stored in different tokens (i.e., unstructured data \cite{wibisono2023role}). To understand how LLMs learn from the unstructured data in ICL, this paper studies the role of each component in the transformer architecture and provides a theoretical understanding to explain the success of the architecture. In particular, we consider a simple transformer with one/two attention layers and linear regression tasks for the ICL prediction. We observe that (1) a transformer with two layers of (self-)attentions with a look-ahead attention mask can learn from the prompt in the unstructured data, and (2) positional encoding can match the $x_i$ and $y_i$ tokens to achieve a better ICL performance.