title: PAC-Bayesian Adversarially Robust Generalization Bounds for Graph Neural Network

abstract: Graph neural networks (GNNs) have gained popularity for various graph-related tasks. However, similar to deep neural networks, GNNs are also vulnerable to adversarial attacks. Empirical studies have shown that adversarially robust generalization has a pivotal role in establishing effective defense algorithms against adversarial attacks. In this paper, we contribute by providing adversarially robust generalization bounds for two kinds of popular GNNs, graph convolutional network (GCN) and message passing graph neural network, using the PAC-Bayesian framework. Our result reveals that spectral norm of the diffusion matrix on the graph and spectral norm of the weights as well as the perturbation factor govern the robust generalization bounds of both models. Our bounds are nontrivial generalizations of the results developed in (Liao et al., 2020) from the standard setting to adversarial setting while avoiding exponential dependence of the maximum node degree. As corollaries, we derive better PAC-Bayesian robust generalization bounds for GCN in the standard setting, which improve the bounds in (Liao et al., 2020) by avoiding exponential dependence on the maximum node degree.


title: Electric Field Induced Associations in the Double Layer of Salt-in-Ionic-Liquid Electrolytes

abstract: Ionic liquids (ILs) are an extremely exciting class of electrolytes for energy storage applications because of their unique combination of properties. Upon dissolving alkali metal salts, such as Li or Na based salts, with the same anion as the IL, an intrinsically asymmetric electrolyte can be created for use in batteries, known as a salt-in-ionic liquid (SiIL). These SiILs have been well studied in the bulk, where negative transference numbers of the alkali metal cation have been observed from the formation of small, negatively charged clusters. The properties of these SiILs at electrified interfaces, however, have received little to no attention. Here, we develop a theory for the electrical double layer (EDL) of SiILs where we consistently account for the thermoreversible association of ions into Cayley tree aggregates. The theory predicts that the IL cations first populate the EDL at negative voltages, as they are not strongly bound to the anions. However at large negative voltages which are strong enough to break the alkali metal cation-anion associations, these IL cations are exchanged for the alkali metal cation because of their higher charge density. At positive voltages, we find that the SiIL actually becomes $\textit{more aggregated while screening the electrode charge}$ from the formation of large, negatively charged aggregates. Therefore, in contrast to conventional intuition of associations in the EDL, SiILs appear to become more associated in certain electric fields. We present these theoretical predictions to be verified by molecular dynamics simulations and experimental measurements.


title: Status of R-parity violating SUSY

abstract: In this article, we discuss various phenomenological implications of possible R-parity violating (RPV) supersymmetric scenarios. In this context, the implications of both bilinear and trilinear RPV terms are reviewed from the viewpoint of neutrino physics, anomalous muon magnetic moment, different flavor observables, and collider physics. Apart from discussing the distinctive phenomenological implications of the RPV scenarios, we also survey the updated results from different studies to highlight the present status of the RPV couplings.


title: A discrete model of competing species sharing a parasite

abstract: In this work we develop a discrete model of competing species affected by a common parasite. We analyze the influence of the fast development of the shared disease on the community dynamics. The model is presented under the form of a two time scales discrete system with four variables. Thus, it becomes analytically tractable with the help of the appropriate reduction method. The 2-dimensional reduced system, that has the same the asymptotic behaviour of the full model, is a generalization of the Leslie-Gower competition model. It has the unfrequent property in this kind of models of including multiple equilibrium attractors of mixed type. The analysis of the reduced system shows that parasites can completely alter the outcome of competition depending on the parasite's basic reproductive number R0. In some cases, initial conditions decide among several exclusion or coexistence scenarios.


title: Universal entanglement spectrum in gapless symmetry protected topological states

abstract: Quantum entanglement marks a definitive feature of topological states. However, the entanglement spectrum remains insufficiently explored for topological states without a bulk energy gap. Using a combination of field theory and numerical techniques, we accurately calculate and analyze the entanglement spectrum of gapless symmetry protected topological states in one dimension. We highlight that the universal entanglement spectrum not only encodes the nontrivial edge degeneracy, generalizing the Li-Haldane conjecture to gapless topological states, but also contains the operator content of the underlying boundary conformal field theory. This implies that the bulk wave function can act as a fingerprint of both quantum criticality and topology in gapless symmetry protected topological states. We also identify a symmetry enriched conformal boundary condition that goes beyond the conventional conformal boundary condition.


title: A residual-based non-orthogonality correction for force-balanced unstructured Volume-of-Fluid methods

abstract: Non-orthogonality errors in unstructured Finite Volume methods for simulating incompressible two-phase flows may break the force-balanced discretization. We show that applying the same explicit non-orthogonality correction for all gradient terms in the context of segregated solution algorithms is not sufficient to achieve force balance. To ensure force balance, we introduce a straightforward and deterministic residual-based control of the non-orthogonality correction, which removes the number of non-orthogonality corrections as a free parameter from the simulation. Our method is directly applicable to different unstructured finite-volume two-phase flow simulation methods as long as they discretize the one-field formulation of incompressible two-phase Navier-Stokes equations. We demonstrate force balance for the surface tension force and the gravity force near linear solver tolerance for an algebraic and a geometric Volume-of-Fluid method using the stationary droplet and stationary water column verification cases on polyhedral unstructured meshes with varying levels of non-orthogonality.


title: Interlaboratory comparison of particle filtration efficiency testing equipment

abstract: This work presents the results of two interlaboratory comparisons of particle filtration efficiency measurements performed by a network of laboratories across Canada and Australia. Testing across multiple layers of a common verification material demonstrates a constant size-resolved quality factor when layering uncharged materials. Size-resolved filtration curves also match expectations, with increasingly size-dependent curves and a predictable increase in the PFE. Candidate reference materials with controlled material properties were also tested across multiple laboratories. Each set of materials sharing a common charge level show specific trends with the material basis weight. Respirators showed more consistency between the laboratories than the other filters. However, across a majority of the tests, dark uncertainties, which are otherwise unexplained variability between laboratories, are significant. This leaves room to improve the test method by developing improved verification procedures and additional reference materials.


title: Mission Planning and Safety Assessment for Pipeline Inspection Using Autonomous Underwater Vehicles: A Framework based on Behavior Trees

abstract: The recent advance in autonomous underwater robotics facilitates autonomous inspection tasks of offshore infrastructure. However, current inspection missions rely on predefined plans created offline, hampering the flexibility and autonomy of the inspection vehicle and the mission's success in case of unexpected events. In this work, we address these challenges by proposing a framework encompassing the modeling and verification of mission plans through Behavior Trees (BTs). This framework leverages the modularity of BTs to model onboard reactive behaviors, thus enabling autonomous plan executions, and uses BehaVerify to verify the mission's safety. Moreover, as a use case of this framework, we present a novel AI-enabled algorithm that aims for efficient, autonomous pipeline camera data collection. In a simulated environment, we demonstrate the framework's application to our proposed pipeline inspection algorithm. Our framework marks a significant step forward in the field of autonomous underwater robotics, promising to enhance the safety and success of underwater missions in practical, real-world applications. https://github.com/remaro-network/pipe_inspection_mission


title: Generative Modeling of Graphs via Joint Diffusion of Node and Edge Attributes

abstract: Graph generation is integral to various engineering and scientific disciplines. Nevertheless, existing methodologies tend to overlook the generation of edge attributes. However, we identify critical applications where edge attributes are essential, making prior methods potentially unsuitable in such contexts. Moreover, while trivial adaptations are available, empirical investigations reveal their limited efficacy as they do not properly model the interplay among graph components. To address this, we propose a joint score-based model of nodes and edges for graph generation that considers all graph components. Our approach offers two key novelties: (i) node and edge attributes are combined in an attention module that generates samples based on the two ingredients; and (ii) node, edge and adjacency information are mutually dependent during the graph diffusion process. We evaluate our method on challenging benchmarks involving real-world and synthetic datasets in which edge features are crucial. Additionally, we introduce a new synthetic dataset that incorporates edge values. Furthermore, we propose a novel application that greatly benefits from the method due to its nature: the generation of traffic scenes represented as graphs. Our method outperforms other graph generation methods, demonstrating a significant advantage in edge-related measures.


title: Does $E=mc^2$ Require Relativity?

abstract: It is universally believed that with his 1905 paper "Does the inertia of a body depend on its energy content?" Einstein first demonstrated the equivalence of mass and energy by making use of his special theory of relativity. In the final step of that paper, however, Einstein equates the kinetic energy of a body to its Newtonian value, indicating that his result is at best a low-velocity approximation. Today, several characters debate whether a mid-nineteenth century physicist, employing only physics available at the time, could plausibly arrive at the celebrated result. In other words, is Einsteinian relativity necessary to derive ${\mc E}=mc^2$?


title: A nodal ghost method based on variational formulation and regular square grid for elliptic problems on arbitrary domains in two space dimensions

abstract: This paper focuses on the numerical solution of elliptic partial differential equations (PDEs) with Dirichlet and mixed boundary conditions, specifically addressing the challenges arising from irregular domains. Both finite element method (FEM) and finite difference method (FDM), face difficulties in dealing with arbitrary domains. The paper introduces a novel nodal symmetric ghost finite element method approach, which combines the advantages of FEM and FDM. The method employs bilinear finite elements on a structured mesh, and provides a detailed implementation description. A rigorous a priori convergence rate analysis is also presented. The convergence rates are validated with many numerical experiments, in both one and two space dimensions.


title: Systematic Biases in LLM Simulations of Debates

abstract: Recent advancements in natural language processing, especially the emergence of Large Language Models (LLMs), have opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. However, LLMs are complex statistical learners without straightforward deductive rules, making them prone to unexpected behaviors. In this study, we highlight the limitations of LLMs in simulating human interactions, particularly focusing on LLMs' ability to simulate political debates. Our findings indicate a tendency for LLM agents to conform to the model's inherent social biases despite being directed to debate from certain political perspectives. This tendency results in behavioral patterns that seem to deviate from well-established social dynamics among humans. We reinforce these observations using an automatic self-fine-tuning method, which enables us to manipulate the biases within the LLM and demonstrate that agents subsequently align with the altered biases. These results underscore the need for further research to develop methods that help agents overcome these biases, a critical step toward creating more realistic simulations.


title: Connecting the Dots: Collaborative Fine-tuning for Black-Box Vision-Language Models

abstract: With the emergence of pretrained vision-language models (VLMs), considerable efforts have been devoted to fine-tuning them for downstream tasks. Despite the progress made in designing efficient fine-tuning methods, such methods require access to the model's parameters, which can be challenging as model owners often opt to provide their models as a black box to safeguard model ownership. This paper proposes a \textbf{C}ollabo\textbf{ra}tive \textbf{F}ine-\textbf{T}uning (\textbf{CraFT}) approach for fine-tuning black-box VLMs to downstream tasks, where one only has access to the input prompts and the output predictions of the model. CraFT comprises two modules, a prompt generation module for learning text prompts and a prediction refinement module for enhancing output predictions in residual style. Additionally, we introduce an auxiliary prediction-consistent loss to promote consistent optimization across these modules. These modules are optimized by a novel collaborative training algorithm. Extensive experiments on few-shot classification over 15 datasets demonstrate the superiority of CraFT. The results show that CraFT achieves a decent gain of about 12\% with 16-shot datasets and only 8,000 queries. Moreover, CraFT trains faster and uses only about 1/80 of the memory footprint for deployment, while sacrificing only 1.62\% compared to the white-box method. Our code is publicly available at https://github.com/mrflogs/CraFT .


title: Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching

abstract: Recently, Ainsworth et al. showed that using weight matching (WM) to minimize the $L_2$ distance in a permutation search of model parameters effectively identifies permutations that satisfy linear mode connectivity (LMC), in which the loss along a linear path between two independently trained models with different seeds remains nearly constant. This paper provides a theoretical analysis of LMC using WM, which is crucial for understanding stochastic gradient descent's effectiveness and its application in areas like model merging. We first experimentally and theoretically show that permutations found by WM do not significantly reduce the $L_2$ distance between two models and the occurrence of LMC is not merely due to distance reduction by WM in itself. We then provide theoretical insights showing that permutations can change the directions of the singular vectors, but not the singular values, of the weight matrices in each layer. This finding shows that permutations found by WM mainly align the directions of singular vectors associated with large singular values across models. This alignment brings the singular vectors with large singular values, which determine the model functionality, closer between pre-merged and post-merged models, so that the post-merged model retains functionality similar to the pre-merged models, making it easy to satisfy LMC. Finally, we analyze the difference between WM and straight-through estimator (STE), a dataset-dependent permutation search method, and show that WM outperforms STE, especially when merging three or more models.


title: The impact of nebular Lyman-Continuum on ionising photons budget and escape fractions from galaxies

abstract: Several Lyman Continuum (LyC) emitters have been detected so far, but their observed ionising spectra sometimes differ from attenuated stellar spectra predicted by stellar population synthesis modelling. This discrepancy may be due to a significant contribution of LyC nebular emission. We aim to quantify the importance this emission in LyC leakers: its contribution to the ionising photons budget, and to measurements of LyC escape. To estimate the nebular contribution to the LyC spectra of galaxies, we run photoionisation models with Cloudy for a range of BPASS templates, varying the column density of the surrounding gas, from density-bounded (log(NH$_{\rm{stop}}$/cm$^{-2}$)=16) to ionisation-bounded (log(NH$_{\rm{stop}}$/cm$^{-2}$)=19) regimes. In the limits of very optically thin (f$_{\rm{esc}}$ = 1), or thick configurations (f$_{\rm{esc}}$ = 0), there is no nebular contribution to the emergent LyC spectra. This contribution matters only at intermediate LyC opacities ($0 <$ f$_{\rm{esc}}$ $< 1$), where it alters the shape of the LyC spectrum chromatically, so that escape fractions estimates are highly sensitive to the wavelength range over which they are calculated. We propose a formula to estimate integrated escape fractions using f$_{\lambda 700}$/f$_{\lambda 1100}$ flux ratios, since this wavelength range is not affected by nebular emission. Regarding simulations, the boost of hydrogen ionising photons escaping galaxies is inversely proportional to the stellar escape fractions, but since typical simulated escape fractions are low, LyC photons escape is important. Nebular LyC is a non-negligible additional source of ionising photons from galaxies, which contribution has been overlooked so far in observations and in cosmic reionisation simulations.


title: Ramification filtration via deformations, II

abstract: Let $\mathcal K$ be a field of formal Laurent series with coefficients in a finite field of characteristic $p$. For $M\in\mathbb{N}$, let $\mathcal G_{<p,M}$ be the maximal quotient of the Galois group of $\mathcal K$ of period $p^M$ and nilpotent class $<p$ and $\{\mathcal G_{<p,M}^{(v)}\}_{v\geqslant 0}$ -- the filtration by ramification subgroups in upper numbering. Let $\mathcal G_{<p,M}=G(\mathcal L)$ be the identification of nilpotent Artin-Schreier theory: here $G(\mathcal L)$ is the group obtained from a profinite Lie $\mathbb{Z}/p^M$-algebra $\mathcal L$ via the Campbell-Hausdorff composition law. We obtain a "geometrical" construction of the ideals $\mathcal L^{(v)}$ such that $G(\mathcal L^{(v)})=\mathcal G_{<p,M}^{(v)}$. Given $v_0\geqslant 1$, we construct a decreasing central filtration $\mathcal L(w)$, $1\leqslant w\leqslant p$, on $\mathcal L$, an epimorphism of Lie $\mathbb{Z}/p^M$-algebras $\bar{\mathcal V}: \bar{\mathcal L}^{\dag }\to \bar{\mathcal L}:=\mathcal L/\mathcal L(p)$ and unipotent action $\Omega $ of $\mathbb{Z} /p^M$, on $\bar{\mathcal L}^{\dag }$. Suppose $d\Omega =B^{\dag }$ and $\bar{\mathcal L}^{\dag [v_0]}$ is the ideal of $\bar{\mathcal L}^{\dag }$ generated by $B^{\dag }(\bar{\mathcal L}^{\dag })$. The main result states that $\mathcal L^{(v_0)}$ appears as the preimage of the ideal in $\bar{\mathcal L}$ generated by $\bar{\mathcal V}B^{\dag }(\bar{\mathcal L}^{\dag [v_0]})$. The results of this paper generalise (and also considerably simplify) the author results in the context of the maximal quotient $\mathcal{G}_{<p,1}$ of period $p$.


title: More Flexible PAC-Bayesian Meta-Learning by Learning Learning Algorithms

abstract: We introduce a new framework for studying meta-learning methods using PAC-Bayesian theory. Its main advantage over previous work is that it allows for more flexibility in how the transfer of knowledge between tasks is realized. For previous approaches, this could only happen indirectly, by means of learning prior distributions over models. In contrast, the new generalization bounds that we prove express the process of meta-learning much more directly as learning the learning algorithm that should be used for future tasks. The flexibility of our framework makes it suitable to analyze a wide range of meta-learning mechanisms and even design new mechanisms. Other than our theoretical contributions we also show empirically that our framework improves the prediction quality in practical meta-learning mechanisms.


title: Teleparallel Geroch geometry

abstract: We construct the teleparallel dynamics for extended geometry where the structure algebra is (an extension of) an untwisted affine Kac-Moody algebra. This provides a geometrisation of the Geroch symmetry appearing on dimensional reduction of a gravitational theory to two dimensions. The formalism is adapted to the underlying tensor hierarchy algebra, and will serve as a stepping stone towards the geometrisation of other infinite-dimensional, e.g. hyperbolic, symmetries.


title: Collaborative Deep Reinforcement Learning for Resource Optimization in Non-Terrestrial Networks

abstract: Non-terrestrial networks (NTNs) with low-earth orbit (LEO) satellites have been regarded as promising remedies to support global ubiquitous wireless services. Due to the rapid mobility of LEO satellite, inter-beam/satellite handovers happen frequently for a specific user equipment (UE). To tackle this issue, earth-fixed cell scenarios have been under studied, in which the LEO satellite adjusts its beam direction towards a fixed area within its dwell duration, to maintain stable transmission performance for the UE. Therefore, it is required that the LEO satellite performs real-time resource allocation, which however is unaffordable by the LEO satellite with limited computing capability. To address this issue, in this paper, we propose a two-time-scale collaborative deep reinforcement learning (DRL) scheme for beam management and resource allocation in NTNs, in which LEO satellite and UE with different control cycles update their decision-making policies through a sequential manner. Specifically, UE updates its policy subject to improving the value functions of both the agents. Furthermore, the LEO satellite only makes decisions through finite-step rollouts with a reference decision trajectory received from the UE. Simulation results show that the proposed scheme can effectively balance the throughput performance and computational complexity over traditional greedy-searching schemes.


title: Latitudinal Variation of Clouds' Structure Responsible for Venus' Cold Collar

abstract: Global Climate Models (GCM) are very useful tools to study theoretically the general dynamics and specific phenomena in planetary atmospheres. In the case of Venus, several GCMs succeeded in reproducing the atmosphere's superrotation and the global temperature field. However, the highly variable polar temperature and the permanent cold collar have not been reproduced satisfactorily yet. Here we improve the radiative transfer scheme of the Institut Pierre Simon Laplace Venus GCM in order to numerically simulate the polar thermal features in Venus atmosphere. The main difference with the previous model is that we now take into account the latitudinal variation of the cloud structure. Both solar heating rates and infrared cooling rates have been modified to consider the cloud top's altitude decrease toward the poles and the variation in latitude of the different particle modes' abundances. A new structure that closely resembles the observed cold collar appears in the average temperature field at $2\times10^{4} - 4\times10^{3}$~Pa ($\sim62 - 66$~km) altitude range and $60^{\circ} - 90^{\circ}$ latitude band. It is not isolated from the pole as in the observation-based maps, but the obtained temperature values (220~K) are in good agreement with observed values. Temperature polar maps across this region show an inner warm region where the polar vortex is observed, but the obtained 230~K average value is colder than the observed mean value and the simulated horizontal structure does not show the fine-scale features present within the vortex. Our study shows that the cloud structure is essential in the cold collar formation. Although our analysis focuses on the improvement of the radiative forcing and the variations it causes in the thermal structure, polar dynamics is definitely affected by this modified environment and a noteworthy upwelling motion is found in the cold collar area.


title: A Digital Twin Design Methodology for Control, Simulation, and Monitoring of Fluidic Circuits

abstract: We propose a synthesis method for the design of digital twins applicable to various systems (pneumatic, hydraulic, electrical/electronic circuits). The methodology allows representing the operation of these systems through an active digital twin, thereby enabling a more suitable and easier computer-aided design, simulation, control, and monitoring. Furthermore, our methodology enables the detection of a system's actions on its own inputs (for example, in pneumatics: backflow of gases trapped in part of a fluidic system onto its own inputs). During the simulation or monitoring phase, the approach also facilitates real-time diagnosis of the controlled system. The outputs, on the controlled physical system or its digital twin, do not depend only on the current inputs but also on the history of the inputs and the history of internal states and variables. In other words, the underlying sequential logic has a memory while an only combinational logic approach does not. These capabilities can contribute to the digital transformation of the factory of the future.


title: Deep Learning for Multivariate Time Series Imputation: A Survey

abstract: The ubiquitous missing values cause the multivariate time series data to be partially observed, destroying the integrity of time series and hindering the effective time series data analysis. Recently deep learning imputation methods have demonstrated remarkable success in elevating the quality of corrupted time series data, subsequently enhancing performance in downstream tasks. In this paper, we conduct a comprehensive survey on the recently proposed deep learning imputation methods. First, we propose a taxonomy for the reviewed methods, and then provide a structured review of these methods by highlighting their strengths and limitations. We also conduct empirical experiments to study different methods and compare their enhancement for downstream tasks. Finally, the open issues for future research on multivariate time series imputation are pointed out. All code and configurations of this work, including a regularly maintained multivariate time series imputation paper list, can be found in the GitHub repository~\url{https://github.com/WenjieDu/Awesome\_Imputation}.


title: iSLAT: the Interactive Spectral-Line Analysis Tool for JWST and beyond

abstract: We present iSLAT (the Interactive Spectral-Line Analysis Tool), a python-based graphical tool that allows users to interactively explore and manually fit line emission observed in molecular spectra. iSLAT adopts a simple slab model that simulates emission spectra with a small set of parameters (temperature, emitting area, column density, and line broadening) that users can adjust in real time for multiple molecules or multiple thermal components of a same molecule. A central feature of iSLAT is the possibility to interactively inspect individual lines or line clusters to visualize their properties at high resolution and identify them in the population diagram. iSLAT provides a number of additional features, including the option to identify lines that are not blended at the instrumental resolution, the possibility to save custom line lists selected by the user, and to fit and measure their properties (line flux, width, and centroid) for later analysis. In this paper we launch the tool and demonstrate it on infrared spectra from the James Webb Space Telescope and ground-based instruments that provide higher resolving power. We also share curated line lists that are useful for the analysis of the forest of water emission lines observed from protoplanetary disks. iSLAT is shared with the community on GitHub.


title: TopoNav: Topological Navigation for Efficient Exploration in Sparse Reward Environments

abstract: Autonomous robots exploring unknown environments face a significant challenge: navigating effectively without prior maps and with limited external feedback. This challenge intensifies in sparse reward environments, where traditional exploration techniques often fail. In this paper, we present TopoNav, a novel topological navigation framework that integrates active mapping, hierarchical reinforcement learning, and intrinsic motivation to enable efficient goal-oriented exploration and navigation in sparse-reward settings. TopoNav dynamically constructs a topological map of the environment, capturing key locations and pathways. A two-level hierarchical policy architecture, comprising a high-level graph traversal policy and low-level motion control policies, enables effective navigation and obstacle avoidance while maintaining focus on the overall goal. Additionally, TopoNav incorporates intrinsic motivation to guide exploration toward relevant regions and frontier nodes in the topological map, addressing the challenges of sparse extrinsic rewards. We evaluate TopoNav both in the simulated and real-world off-road environments using a Clearpath Jackal robot, across three challenging navigation scenarios: goal-reaching, feature-based navigation, and navigation in complex terrains. We observe an increase in exploration coverage by 7- 20%, in success rates by 9-19%, and reductions in navigation times by 15-36% across various scenarios, compared to state-of-the-art methods


title: Link Prediction with Relational Hypergraphs

abstract: Link prediction with knowledge graphs has been thoroughly studied in graph machine learning, leading to a rich landscape of graph neural network architectures with successful applications. Nonetheless, it remains challenging to transfer the success of these architectures to relational hypergraphs, where the task of link prediction is over $k$-ary relations, which is substantially harder than link prediction with knowledge graphs. In this paper, we propose a framework for link prediction with relational hypergraphs, unlocking applications of graph neural networks to fully relational structures. Theoretically, we conduct a thorough analysis of the expressive power of the resulting model architectures via corresponding relational Weisfeiler-Leman algorithms and also via logical expressiveness. Empirically, we validate the power of the proposed model architectures on various relational hypergraph benchmarks. The resulting model architectures substantially outperform every baseline for inductive link prediction, and lead to state-of-the-art results for transductive link prediction.


title: Evidence of temperature-dependent interplay between spin and orbital moment in van der Waals ferromagnet VI3

abstract: Van der Waals materials provide a versatile toolbox for the emergence of new quantum phenomena and the fabrication of functional heterostructures. Among them, the trihalide VI3 stands out for its unique magnetic and structural landscape. Here we investigate the spin and orbital magnetic degrees of freedom in the layered ferromagnet VI3 by means of temperature-dependent x-ray absorption spectroscopy and x-ray magnetic circular and linear dichroism. We detect localized electronic states and reduced magnetic dimensionality, due to electronic correlations. We furthermore provide experimental evidence of (a) an unquenched orbital magnetic moment (up to 0.66(7)) in the ferromagnetic state, and (b) an instability of the orbital moment in proximity of the spin reorientation transition. Our results support a coherent picture where electronic correlations give rise to a strong magnetic anisotropy and a large orbital moment, and establish VI3 as a prime candidate for the study of orbital quantum effects.


title: Multi-class Road Defect Detection and Segmentation using Spatial and Channel-wise Attention for Autonomous Road Repairing

abstract: Road pavement detection and segmentation are critical for developing autonomous road repair systems. However, developing an instance segmentation method that simultaneously performs multi-class defect detection and segmentation is challenging due to the textural simplicity of road pavement image, the diversity of defect geometries, and the morphological ambiguity between classes. We propose a novel end-to-end method for multi-class road defect detection and segmentation. The proposed method comprises multiple spatial and channel-wise attention blocks available to learn global representations across spatial and channel-wise dimensions. Through these attention blocks, more globally generalised representations of morphological information (spatial characteristics) of road defects and colour and depth information of images can be learned. To demonstrate the effectiveness of our framework, we conducted various ablation studies and comparisons with prior methods on a newly collected dataset annotated with nine road defect classes. The experiments show that our proposed method outperforms existing state-of-the-art methods for multi-class road defect detection and segmentation methods.


title: Mice with Woodin cardinals from a Reinhardt

abstract: Suppose there is a Reinhardt cardinal. Then (1) $M_n(X)$ exists and is fully iterable (above $X$) for every transitive set $X$ and every $n<\omega$ (here $M_n(X)$ denotes the canonical minimal proper class inner model containing $X$ and having $n$ Woodin cardinals above the rank of $X$); and (2) Projective Determinacy holds in every set generic extension.


title: On the Modelling of Ship Wakes in S-Band SAR Images and an Application to Ship Identification

abstract: We present a novel ship wake simulation system for generating S-band Synthetic Aperture Radar (SAR) images, and demonstrate the use of such imagery for the classification of ships based on their wake signatures via a deep learning approach. Ship wakes are modeled through the linear superposition of wind-induced sea elevation and the Kelvin wakes model of a moving ship. Our SAR imaging simulation takes into account frequency-dependent radar parameters, i.e., the complex dielectric constant ($\varepsilon$) and the relaxation rate ($\mu$) of seawater. The former was determined through the Debye model while the latter was estimated for S-band SAR based on pre-existing values for the L, C, and X-bands. The results show good agreement between simulated and real imagery upon visual inspection. The results of implementing different training strategies are also reported, showcasing a notable improvement in accuracy of classifier achieved by integrating real and simulated SAR images during the training.


title: So's conjecture for integral circulant graphs of $4$ types

abstract: In [Discrete Mathematics 306 (2005) 153-158], So proposed a conjecture saying that integral circulant graphs with different connection sets have different spectra. This conjecture is still open. We prove that this conjecture holds for integral circulant graphs whose orders have prime factorization of $4$ types.


title: Retrieve to Explain: Evidence-driven Predictions with Language Models

abstract: Language models hold incredible promise for enabling scientific discovery by synthesizing massive research corpora. Many complex scientific research questions have multiple plausible answers, each supported by evidence of varying strength. However, existing language models lack the capability to quantitatively and faithfully compare answer plausibility in terms of supporting evidence. To address this issue, we introduce Retrieve to Explain (R2E), a retrieval-based language model. R2E scores and ranks all possible answers to a research question based on evidence retrieved from a document corpus. The architecture represents each answer only in terms of its supporting evidence, with the answer itself masked. This allows us to extend feature attribution methods, such as Shapley values, to transparently attribute each answer's score back to its supporting evidence at inference time. The architecture also allows R2E to incorporate new evidence without retraining, including non-textual data modalities templated into natural language. We assess on the challenging task of drug target identification from scientific literature, a human-in-the-loop process where failures are extremely costly and explainability is paramount. When predicting whether drug targets will subsequently be confirmed as efficacious in clinical trials, R2E not only matches non-explainable literature-based models but also surpasses a genetics-based target identification approach used throughout the pharmaceutical industry.


title: Hermitian stochastic methodology for X-ray superfluorescence

abstract: A recently introduced theoretical framework for modeling the dynamics of X-ray amplified spontaneous emission is based on stochastic sampling of the density matrix of quantum emitters and the radiation field, similarly to other phase-space sampling techniques. While based on first principles and providing valuable theoretical insights, the original stochastic differential equations exhibit divergences and numerical instabilities. Here, we resolve this issue by accounting the stochastic components perturbatively. The refined formalism accurately reproduces the properties of spontaneous emission and proves universally applicable for describing all stages of collective X-ray emission in paraxial geometry, including spontaneous emission, amplified spontaneous emission, and the non-linear regime. Through numerical examples, we analyze key features of superfluorescence in one-dimensional approximation. Importantly, single realizations of the underlying stochastic equations can be fully interpreted as individual experimental observations of superfluorescence.


title: Spatial Assisted Human-Drone Collaborative Navigation and Interaction through Immersive Mixed Reality

abstract: Aerial robots have the potential to play a crucial role in assisting humans with complex and dangerous tasks. Nevertheless, the future industry demands innovative solutions to streamline the interaction process between humans and drones to enable seamless collaboration and efficient co-working. In this paper, we present a novel tele-immersive framework that promotes cognitive and physical collaboration between humans and robots through Mixed Reality (MR). This framework incorporates a novel bi-directional spatial awareness and a multi-modal virtual-physical interaction approaches. The former seamlessly integrates the physical and virtual worlds, offering bidirectional egocentric and exocentric environmental representations. The latter, leveraging the proposed spatial representation, further enhances the collaboration combining a robot planning algorithm for obstacle avoidance with a variable admittance control. This allows users to issue commands based on virtual forces while maintaining compatibility with the environment map. We validate the proposed approach by performing several collaborative planning and exploration tasks involving a drone and an user equipped with a MR headset.


title: Bulk Universality for Real Matrices with Independent and Identically Distributed Entries

abstract: We consider real, Gauss-divisible matrices $A_{t}=A+\sqrt{t}B$, where $B$ is from the real Ginibre ensemble. We prove that the bulk correlation functions converge to a universal limit for $t=O(N^{-1/3+\epsilon})$ if $A$ satisfies certain local laws. If $A=\frac{1}{\sqrt{N}}(\xi_{jk})_{j,k=1}^{N}$ with $\xi_{jk}$ independent and identically distributed real random variables having zero mean, unit variance and finite moments, the Gaussian component can be removed using local laws proven by Bourgade--Yau--Yin, Alt--Erd\H{o}s--Kr\"{u}ger and Cipolloni--Erd\H{o}s--Schr\"{o}der and the four moment theorem of Tao--Vu.


title: Coupling between magnetic and thermodynamic properties in $R$Rh$_2$Si$_2$ ($R$ = Dy, Ho)

abstract: Single crystals of DyRh$_2$Si$_2$ and HoRh$_2$Si$_2$ were investigated by thermal expansion and magnetostriction. The different types of magnetic order can clearly be seen in these measurements, particularly the canting of the moments away from the crystallographic $c$ direction below about 12~K and the spin-flip for magnetic field applied along the $c$ direction. For HoRh$_2$Si$_2$, an additional transition just below $T_{\rm N}$ is analyzed by means of the Gr\"{u}neisen ratio and is likely caused by a change of the magnetic structure. Our results nicely corroborate findings from other magnetic and thermodynamic measurements on these materials and provide further evidence suggesting the formation of magnetic domains.


title: $D^+ \to K_s^0 \pi^+ \eta$ reaction and $a_0(980)^+$

abstract: We study the $D^+ \to \bar K^0 \pi^+ \eta$ reaction where the $a_0(980)$ excitation plays a dominant role. We consider mechanisms of external and internal emission at the quark level, hadronize the $q \bar q$ components into two mesons and allow these mesons to undergo final state interaction where the $a_0(980)$ state is generated. While the $a_0(980)$ production is the dominant term, we also find other terms in the reaction that interfere with this production mode and, through interference with it, lead to a shape of the $a_0(980)$ significantly different from the one observed in other experiments, with an apparently much larger width.


title: Mean-Square Stability and Stabilizability for LTI and Stochastic Systems Connected in Feedback

abstract: In this paper, the feedback stabilization of a linear time-invariant (LTI) multiple-input multiple-output (MIMO) system cascaded by a linear stochastic system is studied in the mean-square sense. Here, the linear stochastic system can model a class of correlated stochastic uncertainties such as channel uncertainties induced by packet loss and random transmission delays in networked systems. By proposing a key parameter called coefficient of frequency variation to characterize the correlation of the stochastic uncertainties, we present a necessary and sufficient condition of the mean-square stability for this MIMO stochastic feedback system. After then a necessary and sufficient condition for the mean-square stabilizability is provided, which reveals a fundamental limit imposed by the system's unstable poles, nonminimum-phase (NMP) zeros, relative degrees (input delays), and the coefficient of frequency variation of the stochastic uncertainties. A numerical example is presented to illustrate the fundamental constraints in the mean-square stabilizability of MIMO networked systems with parallel communication channels.


title: Iterative Prompt Refinement for Radiation Oncology Symptom Extraction Using Teacher-Student Large Language Models

abstract: This study introduces a novel teacher-student architecture utilizing Large Language Models (LLMs) to improve prostate cancer radiotherapy symptom extraction from clinical notes. Mixtral, the student model, initially extracts symptoms, followed by GPT-4, the teacher model, which refines prompts based on Mixtral's performance. This iterative process involved 294 single symptom clinical notes across 12 symptoms, with up to 16 rounds of refinement per epoch. Results showed significant improvements in extracting symptoms from both single and multi-symptom notes. For 59 single symptom notes, accuracy increased from 0.51 to 0.71, precision from 0.52 to 0.82, recall from 0.52 to 0.72, and F1 score from 0.49 to 0.73. In 375 multi-symptom notes, accuracy rose from 0.24 to 0.43, precision from 0.6 to 0.76, recall from 0.24 to 0.43, and F1 score from 0.20 to 0.44. These results demonstrate the effectiveness of advanced prompt engineering in LLMs for radiation oncology use.


title: Fractional Sobolev spaces on Riemannian manifolds

abstract: This article studies the canonical Hilbert energy $H^{s/2}(M)$ on a Riemannian manifold for $s\in(0,2)$, with particular focus on the case of closed manifolds. Several equivalent definitions for this energy and the fractional Laplacian on a manifold are given, and they are shown to be identical up to explicit multiplicative constants. Moreover, the precise behavior of the kernel associated with the singular integral definition of the fractional Laplacian is obtained through an in-depth study of the heat kernel on a Riemannian manifold. Furthermore, a monotonicity formula for stationary points of functionals of the type $$ \mathcal E(v)=[v]^2_{H^{s/2}(M)}+\int_M F(v) \, dV \,, \,\,\, F \ge 0 \,, $$ is given, which includes, in particular, the case of nonlocal $s$-minimal surfaces. Finally, we prove some estimates for the Caffarelli-Silvestre extension problem, which are of general interest. This work is motivated by a recent article by the authors, which proves the nonlocal version of a conjecture of Yau.


title: Synthetic aperture holographic third harmonic generation microscopy

abstract: Third harmonic generation (THG) provides a valuable, label-free approach to imaging biological systems. To date, THG microscopy has been performed using point scanning methods that rely on intensity measurements lacking phase information of the complex field. We report the first demonstration of THG holographic microscopy and the reconstruction of the complex THG signal field with spatial synthetic aperture imaging. Phase distortions arising from measurement-to-measurement fluctuations and imaging components cause optical aberrations in the reconstructed THG field. We have developed an aberration-correction algorithm that estimates and corrects for these phase distortions to reconstruct the spatial synthetic aperture THG field without optical aberrations.


title: A metronome spin stabilizes time-crystalline dynamics

abstract: We investigate a disorder-free quantum Ising chain subject to a time-periodic drive that rotates each spin by an angle $\pi(1-\epsilon_i)$. In case all spins experience the same deviation $\epsilon$ and the system is initialized in a fully polarized state, the dynamics is known to be time-crystalline: the magnetization of the system exhibits period-doubled oscillations for timescales that grow exponentially with the length of the chain. In this work, we study the effect of a deviation $\epsilon$ that differs between spins. We find that reducing $\epsilon$ for a single spin drastically enhances the lifetime of spatio-temporal order, suggesting the name ``metronome" spin. Employing perturbative arguments in an average Hamiltonian picture, we explain this observation for initial states with macroscopic bulk magnetization. Furthermore, in the case of random bitstring initial states, we report the enhancement of the lifetime of a topological edge mode, which can also be understood in the same picture. Finally, we discuss an altered geometry in which the metronome spin is not directly part of the chain, affecting the dynamics in different ways in the two scenarios considered. Our findings unveil the intricate dynamics that emerge in Floquet systems under the influence of a spatially varying drive, thereby uncovering new avenues for Floquet engineering.


title: Design and implementation of a real-time onboard system for a stratospheric balloon mission using commercial off-the-self components and a model-based approach

abstract: Stratospheric balloons have emerged as an affordable and flexible alternative to traditional spacecrafts as they are implemented using commercial off-the-shelf (COTS) equipment without following strict methodologies. HERCCULES is a stratospheric balloon mission that aims to characterize the convective heat and radiative environment in the stratosphere. The purpose of this article is to present the HERCCULES onboard software (OBSW) whose design and complexity is comparable to that of satellite systems, since it must control about sixty COTS equipment using a single Raspberry Pi 4B as onboard computer and ensure the real-time requirements. Compared to similar systems, novel contributions are presented as the OBSW is developed following modelbased and component-based approaches using the TASTE toolchain from the European Space Agency (ESA) for automatic code generation. Besides, the OBSW is verified and validated following the ESA standards and the results obtained demonstrate the suitability and efficiency of the solution and the selected methodologies.


title: Entropy-regularized Diffusion Policy with Q-Ensembles for Offline Reinforcement Learning

abstract: This paper presents advanced techniques of training diffusion policies for offline reinforcement learning (RL). At the core is a mean-reverting stochastic differential equation (SDE) that transfers a complex action distribution into a standard Gaussian and then samples actions conditioned on the environment state with a corresponding reverse-time SDE, like a typical diffusion policy. We show that such an SDE has a solution that we can use to calculate the log probability of the policy, yielding an entropy regularizer that improves the exploration of offline datasets. To mitigate the impact of inaccurate value functions from out-of-distribution data points, we further propose to learn the lower confidence bound of Q-ensembles for more robust policy improvement. By combining the entropy-regularized diffusion policy with Q-ensembles in offline RL, our method achieves state-of-the-art performance on most tasks in D4RL benchmarks. Code is available at \href{https://github.com/ruoqizzz/Entropy-Regularized-Diffusion-Policy-with-QEnsemble}{https://github.com/ruoqizzz/Entropy-Regularized-Diffusion-Policy-with-QEnsemble}.


title: Improved Generalization of Weight Space Networks via Augmentations

abstract: Learning in deep weight spaces (DWS), where neural networks process the weights of other neural networks, is an emerging research direction, with applications to 2D and 3D neural fields (INRs, NeRFs), as well as making inferences about other types of neural networks. Unfortunately, weight space models tend to suffer from substantial overfitting. We empirically analyze the reasons for this overfitting and find that a key reason is the lack of diversity in DWS datasets. While a given object can be represented by many different weight configurations, typical INR training sets fail to capture variability across INRs that represent the same object. To address this, we explore strategies for data augmentation in weight spaces and propose a MixUp method adapted for weight spaces. We demonstrate the effectiveness of these methods in two setups. In classification, they improve performance similarly to having up to 10 times more data. In self-supervised contrastive learning, they yield substantial 5-10% gains in downstream classification.


title: An Optimal House Price Prediction Algorithm: XGBoost

abstract: An accurate prediction of house prices is a fundamental requirement for various sectors including real estate and mortgage lending. It is widely recognized that a property value is not solely determined by its physical attributes but is significantly influenced by its surrounding neighbourhood. Meeting the diverse housing needs of individuals while balancing budget constraints is a primary concern for real estate developers. To this end, we addressed the house price prediction problem as a regression task and thus employed various machine learning techniques capable of expressing the significance of independent variables. We made use of the housing dataset of Ames City in Iowa, USA to compare support vector regressor, random forest regressor, XGBoost, multilayer perceptron and multiple linear regression algorithms for house price prediction. Afterwards, we identified the key factors that influence housing costs. Our results show that XGBoost is the best performing model for house price prediction.


title: Cooperation and profit allocation in distribution chains

abstract: We study the coordination of actions and the allocation of profit in supply chains under decentralized control in which a single supplier supplies several retailers with goods for replenishment of stocks. The goal of the supplier and the retailers is to maximize their individual profits. Since the outcome under decentralized control is inefficient, cooperation among firms by means of coordination of actions may improve the individual profits. Cooperation is studied by means of cooperative game theory. Among others we show that the corresponding games are balanced and we propose a stable solution concept for these games.


title: Provably learning a multi-head attention layer

abstract: The multi-head attention layer is one of the key components of the transformer architecture that sets it apart from traditional feed-forward models. Given a sequence length $k$, attention matrices $\mathbf{\Theta}_1,\ldots,\mathbf{\Theta}_m\in\mathbb{R}^{d\times d}$, and projection matrices $\mathbf{W}_1,\ldots,\mathbf{W}_m\in\mathbb{R}^{d\times d}$, the corresponding multi-head attention layer $F: \mathbb{R}^{k\times d}\to \mathbb{R}^{k\times d}$ transforms length-$k$ sequences of $d$-dimensional tokens $\mathbf{X}\in\mathbb{R}^{k\times d}$ via $F(\mathbf{X}) \triangleq \sum^m_{i=1} \mathrm{softmax}(\mathbf{X}\mathbf{\Theta}_i\mathbf{X}^\top)\mathbf{X}\mathbf{W}_i$. In this work, we initiate the study of provably learning a multi-head attention layer from random examples and give the first nontrivial upper and lower bounds for this problem: - Provided $\{\mathbf{W}_i, \mathbf{\Theta}_i\}$ satisfy certain non-degeneracy conditions, we give a $(dk)^{O(m^3)}$-time algorithm that learns $F$ to small error given random labeled examples drawn uniformly from $\{\pm 1\}^{k\times d}$. - We prove computational lower bounds showing that in the worst case, exponential dependence on $m$ is unavoidable. We focus on Boolean $\mathbf{X}$ to mimic the discrete nature of tokens in large language models, though our techniques naturally extend to standard continuous settings, e.g. Gaussian. Our algorithm, which is centered around using examples to sculpt a convex body containing the unknown parameters, is a significant departure from existing provable algorithms for learning feedforward networks, which predominantly exploit algebraic and rotation invariance properties of the Gaussian distribution. In contrast, our analysis is more flexible as it primarily relies on various upper and lower tail bounds for the input distribution and "slices" thereof.


title: On Gauss Calendar Formula: An Application of Modular Arithmetic

abstract: In this recreative piece of work, we present Gauss' calendar formula with some examples to demonstrate how it is applied. Then, based on it, we give a formula for determining dates of particular week days of a given month, and some examples are also given to demonstrate how it is applied. The key mathematical concept behind the formulas is modular arithmetic.


title: Quantum correlations under decoherence

abstract: Taking a system of two coupled qubits described by a X-shaped state and interacting through an anisotropic Heisenberg XY interaction, we examine the evolution of quantum entanglement and a few quantum correlations beyond entanglement, local quantum uncertainty and measurement-induced nonlocality, under the environmental decoherence both for zero and finite temperatures. The relation between concurrence and log negativity as two well-known quantifiers of entanglement is argued. It will be proven that measurement-induced nonlocality equals correlated coherence. The interaction of qubits with the environment causes quantum entanglement to suddenly die for independent qubits, but other correlations do not experience this phenomenon. The time of entanglement sudden death is calculated analytically for zero temperature, while numerically for finite temperatures. Contrary to its usual destructive role, the environment plays a constructive role in some situations, inducing quantum correlations even when the initial quantum correlations are zero. The steady state quantum correlations, being independent of the initial state, are found to remain all non-zero for low, finite temperatures. It is found that quantum correlations beyond entanglement are more robust against temperature than entanglement. The zero-temperature steady state exhibits less local quantum uncertainty than the other correlations.


title: A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation

abstract: Contrastive Language-Image Pretraining (CLIP) has gained popularity for its remarkable zero-shot capacity. Recent research has focused on developing efficient fine-tuning methods, such as prompt learning and adapter, to enhance CLIP's performance in downstream tasks. However, these methods still require additional training time and computational resources, which is undesirable for devices with limited resources. In this paper, we revisit a classical algorithm, Gaussian Discriminant Analysis (GDA), and apply it to the downstream classification of CLIP. Typically, GDA assumes that features of each class follow Gaussian distributions with identical covariance. By leveraging Bayes' formula, the classifier can be expressed in terms of the class means and covariance, which can be estimated from the data without the need for training. To integrate knowledge from both visual and textual modalities, we ensemble it with the original zero-shot classifier within CLIP. Extensive results on 17 datasets validate that our method surpasses or achieves comparable results with state-of-the-art methods on few-shot classification, imbalanced learning, and out-of-distribution generalization. In addition, we extend our method to base-to-new generalization and unsupervised learning, once again demonstrating its superiority over competing approaches. Our code is publicly available at \url{https://github.com/mrflogs/ICLR24}.


title: The Use of a Large Language Model for Cyberbullying Detection

abstract: The dominance of social media has added to the channels of bullying for perpetrators. Unfortunately, cyberbullying (CB) is the most prevalent phenomenon in todays cyber world, and is a severe threat to the mental and physical health of citizens. This opens the need to develop a robust system to prevent bullying content from online forums, blogs, and social media platforms to manage the impact in our society. Several machine learning (ML) algorithms have been proposed for this purpose. However, their performances are not consistent due to high class imbalance and generalisation issues. In recent years, large language models (LLMs) like BERT and RoBERTa have achieved state-of-the-art (SOTA) results in several natural language processing (NLP) tasks. Unfortunately, the LLMs have not been applied extensively for CB detection. In our paper, we explored the use of these models for cyberbullying (CB) detection. We have prepared a new dataset (D2) from existing studies (Formspring and Twitter). Our experimental results for dataset D1 and D2 showed that RoBERTa outperformed other models.


title: Large Volume Scenario from Schoen Manifold with de Sitter under Swampland Conjecture

abstract: To naturally allow for string compactification with duality manifested, here we investigate in the self-mirror large volume scenarios from Schoen Calabi-Yau manifold. We explicitly study the geometry of Schoen Calabi-Yau threefold and complete its triple intersection from both ambient and non-ambient spaces. Based on these, we study the large volume scenario of self-mirror Calabi-Yau compactification with Schoen type. Moreover, by studying the leading non-perturbative terms of the effective scalar potential, we find special uplift terms in order of F-term $\mathcal{O}(\frac{1}{\mathcal{V}^2})$ arising from self-mirror large volume scenario. In particular, the quotient Schoen and Schoen Calabi-Yau large volume scenarios both give rise to de Sitter vacua. In addition, we discussed on the criteria to the effective scalar potential derived from self-mirror large volume scenario according to the swampland conjecture with the constraints fulfilled.


title: Acceleration and energy consumption optimization in cascading classifiers for face detection on low-cost ARM big.LITTLE asymmetric architectures

abstract: This paper proposes a mechanism to accelerate and optimize the energy consumption of a face detection software based on Haar-like cascading classifiers, taking advantage of the features of low-cost Asymmetric Multicore Processors (AMPs) with limited power budget. A modelling and task scheduling/allocation is proposed in order to efficiently make use of the existing features on big.LITTLE ARM processors, including: (I) source-code adaptation for parallel computing, which enables code acceleration by applying the OmpSs programming model, a task-based programming model that handles data-dependencies between tasks in a transparent fashion; (II) different OmpSs task allocation policies which take into account the processor asymmetry and can dynamically set processing resources in a more efficient way based on their particular features. The proposed mechanism can be efficiently applied to take advantage of the processing elements existing on low-cost and low-energy multi-core embedded devices executing object detection algorithms based on cascading classifiers. Although these classifiers yield the best results for detection algorithms in the field of computer vision, their high computational requirements prevent them from being used on these devices under real-time requirements. Finally, we compare the energy efficiency of a heterogeneous architecture based on asymmetric multicore processors with a suitable task scheduling, with that of a homogeneous symmetric architecture.


title: Sudden cosmological singularities in Aether scalar-tensor theories

abstract: In this work we analyze the possibility of sudden cosmological singularities, also known as type-II singularities, in the background of a Friedmann-Lema\^itre-Robertson-Walker (FLRW) geometry in an extension of General Relativity (GR) known as Aether scalar-tensor theories (AeST). Similarly to several scalar-tensor theories, we observe that sudden singularities may occur in certain AeST models at the level of the second-order time derivative of the scale factor. These singularities can either be induced by AeST's scalar field itself in the absence of a fluid matter component, or by a divergence of the pressure component of the fluid. In the latter case, one observes that the second-order time derivative of the scalar field $Q$ is also divergent at the instant the sudden singularity happens. We show that the sudden singularities can be prevented by an appropriate choice of the action, for which a divergence in the scalar field compensates the divergence in the pressure component of the matter fluid, thus preserving the regularity of the scale factor and all its time derivatives. For the models featuring a sudden singularity in the second-order time derivative of the scale factor, an analysis of the cosmographic parameters, namely the Hubble and the deceleration parameters, indicates that cosmological models featuring sudden singularities are allowed by the current cosmological measurements. Furthermore, an analysis of the jerk parameter favours cosmological models that attain a sudden singularity at a faster rate, up to a time of at most $t_s\sim 1.2 t_0$, where $t_0$ is the current age of the universe, and with negative values for the cosmological snap parameter.


title: Macroscopic Fluctuation Theory versus large-deviation-induced GENERIC

abstract: Recent developments in Macroscopic Fluctuation Theory show that many interacting particle systems behave macroscopically as a combination of a gradient flow with Hamiltonian dynamics. This observation leads to the natural question how these structures compare to the GENERIC framework. This paper serves as a brief survey of both fields and a comparison between them, including a number of example models to which the comparison results are applied.


title: Robust projective measurements through measuring code-inspired observables

abstract: Quantum measurements are ubiquitous in quantum information processing tasks, but errors can render their outputs unreliable. Here, we present a scheme that implements a robust projective measurement through measuring code-inspired observables. Namely, given a projective POVM, a classical code and a constraint on the number of measurement outcomes each observable can have, we construct commuting observables whose measurement is equivalent to the projective measurement in the noiseless setting. Moreover, we can correct $t$ errors on the classical outcomes of the observables' measurement if the classical code corrects $t$ errors. Since our scheme does not require the encoding of quantum data onto a quantum error correction code, it can help construct robust measurements for near-term quantum algorithms that do not use quantum error correction. Moreover, our scheme works for any projective POVM, and hence can allow robust syndrome extraction procedures in non-stabilizer quantum error correction codes.


title: Stochastic theta methods for free stochastic differential equations

abstract: We introduce free probability analogues of the stochastic theta methods for free stochastic differential equations, which generalize the free Euler-Maruyama method introduced by Schl\"{u}chtermann and Wibmer [27]. Under some mild conditions, we prove the strong convergence and exponential stability in mean square of the numerical solution. The free stochastic theta method with $\theta=1$ can inherit the exponential stability of original equations for any given step size. Our method can offer better stability and efficiency than the free Euler-Maruyama method. Moreover, numerical results are reported to confirm these theoretical findings.


title: Two-step growth mechanism of the solid electrolyte interphase in argyrodyte/Li-metal contacts

abstract: The structure and growth of the Solid Electrolyte Interphase (SEI) region between an electrolyte and an electrode is one of the most fundamental, yet less-well understood phenomena in solid-state batteries. We present a parameter-free atomistic simulation of the SEI growth for one of the currently promising solid electrolytes (Li$_6$PS$_5$Cl), based on \textit{ab initio} trained machine learning (ML) interatomic potentials, for over 30,000 atoms during 10 ns, well-beyond the capabilities of conventional MD. This unveils a two-step growth mechanism: Li-argyrodite chemical reaction leading to the formation of an amorphous phase, followed by a kinetically slower crystallization of the reaction products into a 5Li$_2$SLi$_3$PLiCl solid solution. The simulation results support the recent, experimentally founded hypothesis of an indirect pathway of electrolyte reduction. These findings shed light on the intricate processes governing SEI evolution, providing a valuable foundation for the design and optimization of next-generation solid-state batteries.


title: New Physical Mechanism for Lightning

abstract: The article is devoted to electromagnetic phenomena in the atmosphere. The set of experimental data on the thunderstorm activity is analyzed. It helps to identify a possible physical mechanism of lightning flashes. This mechanism can involve the formation of metallic bonds in thunderclouds. The analysis of the problem is performed at a microphysical level within the framework of quantum mechanics. The mechanism of appearance of metallic conductivity includes the resonant tunneling of electrons along resonance-percolation trajectories. Such bonds allow the charges from the vast cloud charged subsystems concentrate quickly in lightning channel. The formation of metal bonds in the thunderstorm cloudiness is described as the second-order phase transition. A successive mechanism for the process of formation and development of the lightning channel is suggested. This mechanism is associated with the change in the orientation of crystals in growing electric field. Possible consequences of the quantum-mechanical mechanism under discussion are compared with the results of observations.


title: Analysis of Deep Image Prior and Exploiting Self-Guidance for Image Reconstruction

abstract: The ability of deep image prior (DIP) to recover high-quality images from incomplete or corrupted measurements has made it popular in inverse problems in image restoration and medical imaging including magnetic resonance imaging (MRI). However, conventional DIP suffers from severe overfitting and spectral bias effects. In this work, we first provide an analysis of how DIP recovers information from undersampled imaging measurements by analyzing the training dynamics of the underlying networks in the kernel regime for different architectures. This study sheds light on important underlying properties for DIP-based recovery. Current research suggests that incorporating a reference image as network input can enhance DIP's performance in image reconstruction compared to using random inputs. However, obtaining suitable reference images requires supervision, and raises practical difficulties. In an attempt to overcome this obstacle, we further introduce a self-driven reconstruction process that concurrently optimizes both the network weights and the input while eliminating the need for training data. Our method incorporates a novel denoiser regularization term which enables robust and stable joint estimation of both the network input and reconstructed image. We demonstrate that our self-guided method surpasses both the original DIP and modern supervised methods in terms of MR image reconstruction performance and outperforms previous DIP-based schemes for image inpainting.


title: Random L\'evy Looptrees and L\'evy Maps

abstract: What is the analogue of L\'evy processes for random surfaces? Motivated by scaling limits of random planar maps in random geometry, we introduce and study L\'evy looptrees and L\'evy maps. They are defined using excursions of general L\'evy processes with no negative jump and extend the known stable looptrees and stable maps, associated with stable processes. We compute in particular their fractal dimensions in terms of the upper and lower Blumenthal-Getoor exponents of the coding L\'evy process. In a second part, we consider excursions of stable processes with a drift and prove that the corresponding looptrees interpolate continuously as the drift varies from $-\infty$ to $\infty$, or as the self-similarity index varies from $1$ to $2$, between a circle and the Brownian tree, whereas the corresponding maps interpolate between the Brownian tree and the Brownian sphere.


title: Bayesian sensitivity of binary pulsars to ultra-light dark matter

abstract: Ultra-light dark matter perturbs the orbital motion of binary pulsars, in particular by causing peculiar time variations of a binary's orbital parameters, which then induce variations in the pulses' times-of-arrival. Binary pulsars have therefore been shown to be promising detectors of ultra-light dark matter. To date, the sensitivity of binary pulsars to ultra-light dark matter has only been studied for dark matter masses in a narrow resonance band around a multiple of the binary pulsar orbital frequency. In this study we devise a two-step, bayesian method that enables us to compute semi-analytically the sensitivity for all masses, also away from the resonance, and to combine several observed binaries into one global sensitivity curve. We then apply our method to the case of a universal, linearly-coupled, scalar ultra-light dark matter. We find that with next-generation radio observatories the sensitivity to the ultra-light dark matter coupling will surpass that of solar-system constraints for a decade in mass around $m\sim10^{-21}$ $\text{eV}$, even beyond resonance.


title: A programmable photonic memory

abstract: The significant advancements in integrated photonics have enabled high-speed and energy efficient systems for various applications from data communications and high-performance computing, to medical diagnosis, sensing and ranging. However, data storage in these systems has been dominated by electronic memories which necessitates signal conversion between optical and electrical as well as analog and digital domains, and data movement between processor and memory that reduce the speed and energy efficiency. To date, a scalable optical memory with optical control has remained an open problem. Here we report an integrated photonic set-reset latch as a fundamental optical static memory unit based on universal optical logic gates. While the proposed memory is compatible with different photonic platforms, its functionality is demonstrated on a programmable silicon photonic chip as a proof of concept. Optical set, reset, and complementary outputs, scalability to a large number of memory units via the independent latch supply light, and compatibility with different photonic platforms enable more efficient and lower latency optical processing systems.


title: VRMM: A Volumetric Relightable Morphable Head Model

abstract: In this paper, we introduce the Volumetric Relightable Morphable Model (VRMM), a novel volumetric and parametric facial prior for 3D face modeling. While recent volumetric prior models offer improvements over traditional methods like 3D Morphable Models (3DMMs), they face challenges in model learning and personalized reconstructions. Our VRMM overcomes these by employing a novel training framework that efficiently disentangles and encodes latent spaces of identity, expression, and lighting into low-dimensional representations. This framework, designed with self-supervised learning, significantly reduces the constraints for training data, making it more feasible in practice. The learned VRMM offers relighting capabilities and encompasses a comprehensive range of expressions. We demonstrate the versatility and effectiveness of VRMM through various applications like avatar generation, facial reconstruction, and animation. Additionally, we address the common issue of overfitting in generative volumetric models with a novel prior-preserving personalization framework based on VRMM. Such an approach enables high-quality 3D face reconstruction from even a single portrait input. Our experiments showcase the potential of VRMM to significantly enhance the field of 3D face modeling.


title: Use of Multi-CNNs for Section Analysis in Static Malware Detection

abstract: Existing research on malware detection focuses almost exclusively on the detection rate. However, in some cases, it is also important to understand the results of our algorithm, or to obtain more information, such as where to investigate in the file for an analyst. In this aim, we propose a new model to analyze Portable Executable files. Our method consists in splitting the files in different sections, then transform each section into an image, in order to train convolutional neural networks to treat specifically each identified section. Then we use all these scores returned by CNNs to compute a final detection score, using models that enable us to improve our analysis of the importance of each section in the final score.


title: An Exploration of Clustering Algorithms for Customer Segmentation in the UK Retail Market

abstract: Recently, peoples awareness of online purchases has significantly risen. This has given rise to online retail platforms and the need for a better understanding of customer purchasing behaviour. Retail companies are pressed with the need to deal with a high volume of customer purchases, which requires sophisticated approaches to perform more accurate and efficient customer segmentation. Customer segmentation is a marketing analytical tool that aids customer-centric service and thus enhances profitability. In this paper, we aim to develop a customer segmentation model to improve decision-making processes in the retail market industry. To achieve this, we employed a UK-based online retail dataset obtained from the UCI machine learning repository. The retail dataset consists of 541,909 customer records and eight features. Our study adopted the RFM (recency, frequency, and monetary) framework to quantify customer values. Thereafter, we compared several state-of-the-art (SOTA) clustering algorithms, namely, K-means clustering, the Gaussian mixture model (GMM), density-based spatial clustering of applications with noise (DBSCAN), agglomerative clustering, and balanced iterative reducing and clustering using hierarchies (BIRCH). The results showed the GMM outperformed other approaches, with a Silhouette Score of 0.80.


title: A Godunov--type scheme for a scalar conservation law with space-time flux discontinuity

abstract: We present and analyze a new finite volume scheme of Gudonov-type for a nonlinear scalar conservation law whose flux function has a discontinuous coefficient due to time-dependent changes in its sign along a Lipschitz continuous curve.


title: Measuring Implicit Bias in Explicitly Unbiased Large Language Models

abstract: Large language models (LLMs) can pass explicit social bias tests but still harbor implicit biases, similar to humans who endorse egalitarian beliefs yet exhibit subtle biases. Measuring such implicit biases can be a challenge: as LLMs become increasingly proprietary, it may not be possible to access their embeddings and apply existing bias measures; furthermore, implicit biases are primarily a concern if they affect the actual decisions that these systems make. We address both challenges by introducing two new measures of bias: LLM Implicit Bias, a prompt-based method for revealing implicit bias; and LLM Decision Bias, a strategy to detect subtle discrimination in decision-making tasks. Both measures are based on psychological research: LLM Implicit Bias adapts the Implicit Association Test, widely used to study the automatic associations between concepts held in human minds; and LLM Decision Bias operationalizes psychological results indicating that relative evaluations between two candidates, not absolute evaluations assessing each independently, are more diagnostic of implicit biases. Using these measures, we found pervasive stereotype biases mirroring those in society in 8 value-aligned models across 4 social categories (race, gender, religion, health) in 21 stereotypes (such as race and criminality, race and weapons, gender and science, age and negativity). Our prompt-based LLM Implicit Bias measure correlates with existing language model embedding-based bias methods, but better predicts downstream behaviors measured by LLM Decision Bias. These new prompt-based measures draw from psychology's long history of research into measuring stereotype biases based on purely observable behavior; they expose nuanced biases in proprietary value-aligned LLMs that appear unbiased according to standard benchmarks.


title: Hybrid moir\'e excitons and trions in twisted MoTe$_2$-MoSe$_2$ heterobilayers

abstract: We report experimental and theoretical studies of MoTe$_2$-MoSe$_2$ heterobilayers with rigid moir\'e superlattices controlled by the twist angle. Using an effective continuum model that combines resonant interlayer electron tunneling with stacking-dependent moir\'e potentials, we identify the nature of moir\'e excitons and the dependence of their energies, oscillator strengths and Land\'e $g$-factors on the twist angle. Within the same framework, we interpret distinct signatures of bound complexes among electrons and moir\'e excitons in nearly collinear heterostacks. Our work provides fundamental understanding of hybrid moir\'e excitons and trions in MoTe$_2$-MoSe$_2$ heterobilayers, and establishes the material system as a prime candidate for optical studies of correlated phenomena in moir\'e lattices.


title: Casimir energy of hyperbolic elements

abstract: The contribution, E, of hyperbolic elements to the scalar Casimir energy on a compact quotient of the upper half hyperbolic plane is computed for a propagation operator conformal in three dimensions. Due to the proliferation of prime closed geodesics, the series form for the Casimir energy has an IR divergence. The expression for E is given as a sum of polylogarithms which allows the divergence to be isolated and rendered finite by an {\it ad hoc} Ramanujan renormalisation. The remaining part of E is computed using the specific lower length spectrum of the (2,3,7) triangle and a universal asymptotic form for larger lengths. The tentative value of E found is such as to make the total conformal Casimir energy on the triangle probably negative.


title: Hierarchical Delay Attribution Classification using Unstructured Text in Train Management Systems

abstract: EU directives stipulate a systematic follow-up of train delays. In Sweden, the Swedish Transport Administration registers and assigns an appropriate delay attribution code. However, this delay attribution code is assigned manually, which is a complex task. In this paper, a machine learning-based decision support for assigning delay attribution codes based on event descriptions is investigated. The text is transformed using TF-IDF, and two models, Random Forest and Support Vector Machine, are evaluated against a random uniform classifier and the classification performance of the Swedish Transport Administration. Further, the problem is modeled as both a hierarchical and flat approach. The results indicate that a hierarchical approach performs better than a flat approach. Both approaches perform better than the random uniform classifier but perform worse than the manual classification.


title: Predominantly electric storage ring with nuclear spin control capability

abstract: A predominantly electric E\&m storage ring, with weak superimposed magnetic bending, is shown to be capable of storing two different particle type bunches, such as helion (h) and deuteron (d), or h and electron ($e^-$), co-traveling with different velocities on the same central orbit. Rear-end collisions occurring periodically in a full acceptance particle detector/polarimeter, allow the (previously inaccessible) direct measurement of the spin dependence of nuclear transmutation for center of mass (CM) kinetic energies (KE) ranging from hundreds of keV up toward pion production thresholds. With the nuclear process occurring in a semi-relativistic moving frame, all initial and final state particles have convenient laboratory frame KEs in the tens to hundreds of MeV. The rear-end collisions occur as faster stored bunches pass through slower bunches. An inexpensive facility capable of meeting these requirements is described, with several nuclear channels as examples. Especially noteworthy are the $e^{+/-}$-induced weak interaction triton (t) $\beta$-decay processes, t + $e^+ \rightarrow$ h + $\nu$ and h + $e^- \rightarrow$ t + $\nu$. Experimental capability of measurement of the spin dependence of the induced triton case is emphasized. For cosmological nuclear physics, the experimental improvement will be produced by the storage ring's capability to investigate the spin dependence of nuclear transmutation processes at reduced kinetic energies compared to what can be obtained with fixed target geometry.


title: Behind the Screen: Investigating ChatGPT's Dark Personality Traits and Conspiracy Beliefs

abstract: ChatGPT is notorious for its intransparent behavior. This paper tries to shed light on this, providing an in-depth analysis of the dark personality traits and conspiracy beliefs of GPT-3.5 and GPT-4. Different psychological tests and questionnaires were employed, including the Dark Factor Test, the Mach-IV Scale, the Generic Conspiracy Belief Scale, and the Conspiracy Mentality Scale. The responses were analyzed computing average scores, standard deviations, and significance tests to investigate differences between GPT-3.5 and GPT-4. For traits that have shown to be interdependent in human studies, correlations were considered. Additionally, system roles corresponding to groups that have shown distinct answering behavior in the corresponding questionnaires were applied to examine the models' ability to reflect characteristics associated with these roles in their responses. Dark personality traits and conspiracy beliefs were not particularly pronounced in either model with little differences between GPT-3.5 and GPT-4. However, GPT-4 showed a pronounced tendency to believe in information withholding. This is particularly intriguing given that GPT-4 is trained on a significantly larger dataset than GPT-3.5. Apparently, in this case an increased data exposure correlates with a greater belief in the control of information. An assignment of extreme political affiliations increased the belief in conspiracy theories. Test sequencing affected the models' responses and the observed correlations, indicating a form of contextual memory.


title: Vector Approximate Message Passing With Arbitrary I.I.D. Noise Priors

abstract: Approximate message passing (AMP) algorithms are devised under the Gaussianity assumption of the measurement noise vector. In this work, we relax this assumption within the vector AMP (VAMP) framework to arbitrary independent and identically distributed (i.i.d.) noise priors. We do so by rederiving the linear minimum mean square error (LMMSE) to accommodate both the noise and signal estimations within the message passing steps of VAMP. Numerical results demonstrate how our proposed algorithm handles non-Gaussian noise models as compared to VAMP. This extension to general noise priors enables the use of AMP algorithms in a wider range of engineering applications where non-Gaussian noise models are more appropriate.


title: The open XYZ spin 1/2 chain: Separation of Variables and scalar products for boundary fields related by a constraint

abstract: We consider the open XYZ spin chain with boundary fields. We solve the model by the new Separation of Variables approach introduced in arXiv:1904.00852. In this framework, the transfer matrix eigenstates are obtained as a particular sub-class of the class of so-called separate states. We consider the problem of computing scalar products of such separate states. As usual, they can be represented as determinants with rows labelled by the inhomogeneity parameters of the model. We notably focus on the special case in which the boundary parameters parametrising the two boundary fields satisfy one constraint, hence enabling for the description of part of the transfer matrix spectrum and eigenstates in terms of some elliptic polynomial Q-solution of a usual TQ-equation. In this case, we show how to transform the aforementioned determinant for the scalar product into some more convenient form for the consideration of the homogeneous and thermodynamic limits: as in the open XXX or XXZ cases, our result can be expressed as some generalisation of the so-called Slavnov determinant.


title: TESS and ESPRESSO discover a super-Earth and a mini-Neptune orbiting the K-dwarf TOI-238

abstract: The number of super-Earth and mini-Neptune planet discoveries has increased significantly in the last two decades thanks to transit and radial velocity surveys. When it is possible to apply both techniques, we can characterise the internal composition of exoplanets, which in turn provides unique insights on their architecture, formation and evolution. We performed a combined photometric and radial velocity analysis of TOI-238 (TYC 6398-132-1), which has one short-orbit super-Earth planet candidate announced by NASA's TESS team. We aim to confirm its planetary nature using radial velocities taken with the ESPRESSO and HARPS spectrographs, to measure its mass and to detect the presence of other possible planetary companions. We carried out a joint analysis by including Gaussian processes and Keplerian orbits to account for the stellar activity and planetary signals simultaneously. We detected the signal induced by TOI-238 b in the radial velocity time-series, and the presence of a second transiting planet, TOI-238 c, whose signal appears in RV and TESS data. TOI-238 b is a planet with a radius of 1.402$^{+0.084}_{-0.086}$ R$_{\oplus}$ and a mass of 3.40$^{+0.46}_{-0.45}$ M$_{\oplus}$. It orbits at a separation of 0.02118 $\pm$ 0.00038 AU of its host star, with an orbital period of 1.2730988 $\pm$ 0.0000029 days, and has an equilibrium temperature of 1311 $\pm$ 28 K. TOI-238 c has a radius of 2.18$\pm$ 0.18 R$_{\oplus}$ and a mass of 6.7 $\pm$ 1.1 M$_{\oplus}$. It orbits at a separation of 0.0749 $\pm$ 0.0013 AU of its host star, with an orbital period of 8.465652 $\pm$ 0.000031 days, and has an equilibrium temperature of 696 $\pm$ 15 K. The mass and radius of planet b are fully consistent with an Earth-like composition, making it likely a rocky super-Earth. Planet c could be a water-rich planet or a rocky planet with a small H-He atmosphere.


title: SCAFFLSA: Taming Heterogeneity in Federated Linear Stochastic Approximation and TD Learning

abstract: In this paper, we analyze the sample and communication complexity of the federated linear stochastic approximation (FedLSA) algorithm. We explicitly quantify the effects of local training with agent heterogeneity. We show that the communication complexity of FedLSA scales polynomially with the inverse of the desired accuracy $\epsilon$. To overcome this, we propose SCAFFLSA a new variant of FedLSA that uses control variates to correct for client drift, and establish its sample and communication complexities. We show that for statistically heterogeneous agents, its communication complexity scales logarithmically with the desired accuracy, similar to Scaffnew. An important finding is that, compared to the existing results for Scaffnew, the sample complexity scales with the inverse of the number of agents, a property referred to as linear speed-up. Achieving this linear speed-up requires completely new theoretical arguments. We apply the proposed method to federated temporal difference learning with linear function approximation and analyze the corresponding complexity improvements.


title: Twin-core fiber sensor integrated in laser cavity

abstract: In this work, we report on a twin-core fiber sensor system that provides improved spectral efficiency, allows for multiplexing and gives low level of crosstalk. Pieces of the referred strongly coupled multicore fiber are used as sensors in a laser cavity incorporating a pulsed semiconductor optical amplifier (SOA). Each sensor has its unique cavity length and can be addressed individually by electrically matching the periodic gating of the SOA to the sensors cavity roundtrip time. The interrogator acts as a laser and provides a narrow spectrum with high signal-to-noise ratio. Furthermore, it allows distinguishing the response of individual sensors even in the case of overlapping spectra. Potentially, the number of interrogated sensors can be increased significantly, which is an appealing feature for multipoint sensing.


title: Origami Nano-gap Electrodes for Reversible Nanoparticle Trapping

abstract: We present a facile desktop fabrication method for origami-based nano-gap indium tin oxide (ITO) electrokinetic particle traps, providing a simplified approach compared to traditional lithographic techniques and effectively trapping of nanoparticles. Our approach involves bending ITO thin films on optically transparent polyethylene terephthalate (PET), creating an array of parallel nano-gaps. By strategically introducing weak points through cut-sharp edges, we successfully controlled the spread of nano-cracks. A single crack spanning the constriction width and splitting the conductive layers forms a nano-gap that can effectively trap small nanoparticles after applying an alternating electric potential across the nanogap. We analyze the conditions for reversible trapping and optimal performance of the nano-gap ITO electrodes with optical microscopy and electrokinetic impedance spectroscopy. Our findings highlight the potential of this facile fabrication method for the use of ITO at active electro-actuated traps in microfluidic systems.


title: Optimization of Neumann Eigenvalues under convexity and geometric constraints

abstract: In this paper we study optimization problems for Neumann eigenvalues $\mu_k$ among convex domains with a constraint on the diameter or the perimeter. We work mainly in the plane, though some results are stated in higher dimension. We study the existence of an optimal domain in all considered cases. We also consider the case of the unit disk, giving values of the index $k$ for which it can be or cannot be extremal. We give some numerical examples for small values of $k$ that lead us to state some conjectures.


title: An explicit Euler method for the continuity equation with Sobolev velocity fields

abstract: We prove a stability estimate, in a suitable expected value, of the $1$-Wasserstein distance between the solution of the continuity equation under a Sobolev velocity field and a measure obtained by pushing forward Dirac deltas whose centers belong to a partition of the domain by a (sort of) explicit forward Euler method. The main tool is a $L^\infty_t (L^p_x)$ estimate on the difference between the regular Lagrangian flow of the velocity field and an explicitly constructed approximation of such flow. Although our result only gives estimates in expected value, it has the advantage of being easily parallelizable and of not relying on any particular structure on the mesh. At the end, we also provide estimates with a logarithmic Wasserstein distance, already used in other works on this particular problem.


title: Scientific Language Modeling: A Quantitative Review of Large Language Models in Molecular Science

abstract: Efficient molecular modeling and design are crucial for the discovery and exploration of novel molecules, and the incorporation of deep learning methods has revolutionized this field. In particular, large language models (LLMs) offer a fresh approach to tackle scientific problems from a natural language processing (NLP) perspective, introducing a research paradigm called scientific language modeling (SLM). However, two key issues remain: how to quantify the match between model and data modalities and how to identify the knowledge-learning preferences of models. To address these challenges, we propose a multi-modal benchmark, named ChEBI-20-MM, and perform 1263 experiments to assess the model's compatibility with data modalities and knowledge acquisition. Through the modal transition probability matrix, we provide insights into the most suitable modalities for tasks. Furthermore, we introduce a statistically interpretable approach to discover context-specific knowledge mapping by localized feature filtering. Our pioneering analysis offers an exploration of the learning mechanism and paves the way for advancing SLM in molecular science.


title: Feynman rules and loop structure of Carrollian amplitude

abstract: In this paper, we derive the Carrollian amplitude in the framework of bulk reduction. The Carrollian amplitude is shown to relate to the scattering amplitude by a Fourier transform in this method. We propose Feynman rules to calculate the Carrollian amplitude where the Fourier transforms emerge as the integral representation of the external lines in the Carrollian space. Then we study the four-point Carrollian amplitude at loop level in massless $\Phi^4$ theory. As a consequence of Poincar\'e invariance, the four-point Carrollian amplitude can be transformed to the amplitude that only depends on the cross ratio $z$ of the celestial sphere and a variable $\chi$ invariant under translation. The four-point Carrollian amplitude is a polynomial of the two-point Carrollian amplitude whose argument is replaced with $\chi$. The coefficients of the polynomial have branch cuts in the complex $z$ plane. We also show that the renormalized Carrollian amplitude obeys the Callan-Symanzik equation. Moreover, we initiate a generalized $\Phi^4$ theory by designing the Feynman rules for more general Carrollian amplitude.


title: Multivariable generalizations of bivariate means via invariance

abstract: For a given $p$-variable mean $M \colon I^p \to I$ ($I$ is a subinterval of $\mathbb{R}$), following (Horwitz, 2002) and (Lawson and Lim, 2008), we can define (under certain assumption) its $(p+1)$-variable $\beta$-invariant extension as the unique solution $K \colon I^{p+1} \to I$ of the functional equation \begin{align*} K\big(M(x_2,\dots,x_{p+1})&,M(x_1,x_3,\dots,x_{p+1}),\dots,M(x_1,\dots,x_p)\big)\\ &=K(x_1,\dots,x_{p+1}), \text{ for all }x_1,\dots,x_{p+1} \in I \end{align*} in the family of means. Applying this procedure iteratively we can obtain a mean which is defined for vectors of arbitrary lengths starting from the bivariate one. The aim of this paper is to study the properties of such extensions.


title: Long time stability for cubic nonlinear Schr\"odinger equations on non-rectangular flat tori

abstract: We consider nonlinear Schr\"odinger equations on flat tori satisfying a simple and explicit Diophantine non-degeneracy condition. Provided that the nonlinearity contains a cubic term, we prove the almost global existence and stability of most of the small solutions in high regularity Sobolev spaces. To this end, we develop a normal form approach designed to handle general resonant Hamiltonian partial differential equations for which it is possible to modulate the frequencies by using the initial data.


title: Hot vs cold hidden sectors and their effects on thermal relics

abstract: A variety of possibilities exist for dark matter aside from WIMPS, such as hidden sector dark matter. We discuss synchronous thermal evolution of visible and hidden sectors and show that the density of thermal relics can change $O(100\%)$ and $\Delta N_{\rm eff}$ by a factor of up to $10^5$ depending of whether the hidden sector was hot or cold at the reheat temperature. It is also shown that the approximation of using separate entropy conservation for the visible and hidden sectors is invalid even for a very feeble coupling between the two.