title: Multi-wavelength analysis of the galactic PeVatron candidate LHAASO J2108+5157

abstract: LHAASO J2108+5157 is a recently discovered source, detected in the Ultra-High-Energy band by the LHAASO collaboration. Two molecular clouds were identified in the direction coincident with LHAASO J2108+5157 and, from the spectra reported by LHAASO, there is no sign of an energy cutoff up to 200 TeV. This source makes a promising galactic PeVatron candidate. In 2021, the Large-Sized Telescope prototype (LST-1) of the Cherenkov Telescope Array (CTA) Observatory, collected about 50 hours of quality-selected data on LHAASO J2108+5157. Through these observations, we managed to compute stringent upper limits on the source emission in the multi-TeV band. Together with the analysis of XMM-Newton data and 12 years of Fermi-LAT data, we performed a multi-wavelength study of the source, investigating different possible scenarios of particle acceleration. In this contribution, we will present the results of the analysis, as well as the multi-wavelength modeling, and consequent interpretation of different possible scenarios of emission.


title: Surface segregation in high-entropy alloys from alchemical machine learning

abstract: High-entropy alloys (HEAs), containing several metallic elements in near-equimolar proportions, have long been of interest for their unique mechanical properties. More recently, they have emerged as a promising platform for the development of novel heterogeneous catalysts, because of the large design space, and the synergistic effects between their components. In this work we use a machine-learning potential that can model simultaneously up to 25 transition metals to study the tendency of different elements to segregate at the surface of a HEA. We use as a starting point a potential that was previously developed using exclusively crystalline bulk phases, and show that, thanks to the physically-inspired functional form of the model, adding a much smaller number of defective configurations makes it capable of describing surface phenomena. We then present several computational studies of surface segregation, including both a simulation of a 25-element alloy, that provides a rough estimate of the relative surface propensity of the various elements, and targeted studies of CoCrFeMnNi and IrFeCoNiCu, which provide further validation of the model, and insights to guide the modeling and design of alloys for heterogeneous catalysis.


title: Split Knockoffs for Multiple Comparisons: Controlling the Directional False Discovery Rate

abstract: Multiple comparisons in hypothesis testing often encounter structural constraints in various applications. For instance, in structural Magnetic Resonance Imaging for Alzheimer's Disease, the focus extends beyond examining atrophic brain regions to include comparisons of anatomically adjacent regions. These constraints can be modeled as linear transformations of parameters, where the sign patterns play a crucial role in estimating directional effects. This class of problems, encompassing total variations, wavelet transforms, fused LASSO, trend filtering, and more, presents an open challenge in effectively controlling the directional false discovery rate. In this paper, we propose an extended Split Knockoff method specifically designed to address the control of directional false discovery rate under linear transformations. Our proposed approach relaxes the stringent linear manifold constraint to its neighborhood, employing a variable splitting technique commonly used in optimization. This methodology yields an orthogonal design that benefits both power and directional false discovery rate control. By incorporating a sample splitting scheme, we achieve effective control of the directional false discovery rate, with a notable reduction to zero as the relaxed neighborhood expands. To demonstrate the efficacy of our method, we conduct simulation experiments and apply it to two real-world scenarios: Alzheimer's Disease analysis and human age comparisons.


title: Low-lying zeros of a large orthogonal family of automorphic $L$-functions

abstract: We study a new orthogonal family of $L$-functions associated with holomorphic Hecke newforms of level $q$, averaged over $q \asymp Q$. To illustrate our methods, we prove a one level density result for this family with the support of the Fourier transform of the test function being extended to be inside $(-4, 4)$. The main techniques developed in this paper will be useful in developing further results for this family, including estimates for high moments, information on the vertical distribution of zeros, as well as critical line theorems.


title: An Explicit Local Space-Time Adaptive Framework for Monodomain Models

abstract: We present a new explicit local space-time adaptive framework to decrease the time required for monodomain simulations for cardiac electrophysiology. Based on the localized structure of the steep activation wavefront in solutions to monodomain problems, the proposed framework adopts small time steps and a tree-based adaptive mesh refinement scheme only in the regions necessary to resolve these localized structures. The time step and mesh adaptation selection process is fully controlled by a combination of local error indicators. The main contributions of this work consist in the introduction of a primal symmetric interior penalty formulation of the monodomain model and an efficient algorithmic strategy to manage local time stepping for its temporal discretization. In a first serial implementation of this framework, we report decreases in wall-clock time between 2 and 20 times with respect to an optimized implementation of a commonly used numerical scheme, showing that this framework is a promising candidate to accelerate monodomain simulations of cardiac electrophysiology.


title: Leader-Follower Formation Control of Perturbed Nonholonomic Agents along Parametric Curves with Directed Communication

abstract: In this paper, we propose a novel formation controller for nonholonomic agents to form general parametric curves. First, we derive a unified parametric representation for both open and closed curves. Then, a leader-follower formation controller is designed to form the parametric curves. We consider directed communications and constant input disturbances rejection in the controller design. Rigorous Lyapunov-based stability analysis proves the asymptotic stability of the proposed controller. Detailed numerical simulations and experimental studies are conducted to verify the performance of the proposed method.


title: QACHECK: A Demonstration System for Question-Guided Multi-Hop Fact-Checking

abstract: Fact-checking real-world claims often requires complex, multi-step reasoning due to the absence of direct evidence to support or refute them. However, existing fact-checking systems often lack transparency in their decision-making, making it challenging for users to comprehend their reasoning process. To address this, we propose the Question-guided Multi-hop Fact-Checking (QACHECK) system, which guides the model's reasoning process by asking a series of questions critical for verifying a claim. QACHECK has five key modules: a claim verifier, a question generator, a question-answering module, a QA validator, and a reasoner. Users can input a claim into QACHECK, which then predicts its veracity and provides a comprehensive report detailing its reasoning process, guided by a sequence of (question, answer) pairs. QACHECK also provides the source of evidence supporting each question, fostering a transparent, explainable, and user-friendly fact-checking process. A recorded video of QACHECK is at https://www.youtube.com/watch?v=ju8kxSldM64


title: A criterion for double sliceness

abstract: We describe a condition involving noncommutative Alexander modules which ensures that a knot with Alexander module $\mathbb{Z}[t^{\pm 1}]/(t-2) \oplus \mathbb{Z}[t^{\pm 1}]/(t^{-1}- 2)$ is topologically doubly slice. As an application, we show that a satellite knot $R_\eta(K)$ is doubly slice if the pattern $R$ has Alexander module $\mathbb{Z}[t^{\pm 1}]/(t- 2) \oplus \mathbb{Z}[t^{\pm 1}]/(t^{-1}- 2)$ and satisfies this condition, and if the infection curve $\eta \subset S^3 \setminus R$ lies in the second derived subgroup $\pi_1(S^3 \setminus R)^{(2)}.$


title: Democratizing LLMs: An Exploration of Cost-Performance Trade-offs in Self-Refined Open-Source Models

abstract: The dominance of proprietary LLMs has led to restricted access and raised information privacy concerns. High-performing open-source alternatives are crucial for information-sensitive and high-volume applications but often lag behind in performance. To address this gap, we propose (1) A untargeted variant of iterative self-critique and self-refinement devoid of external influence. (2) A novel ranking metric - Performance, Refinement, and Inference Cost Score (PeRFICS) - to find the optimal model for a given task considering refined performance and cost. Our experiments show that SoTA open source models of varying sizes from 7B - 65B, on average, improve 8.2% from their baseline performance. Strikingly, even models with extremely small memory footprints, such as Vicuna-7B, show a 11.74% improvement overall and up to a 25.39% improvement in high-creativity, open ended tasks on the Vicuna benchmark. Vicuna-13B takes it a step further and outperforms ChatGPT post-refinement. This work has profound implications for resource-constrained and information-sensitive environments seeking to leverage LLMs without incurring prohibitive costs, compromising on performance and privacy. The domain-agnostic self-refinement process coupled with our novel ranking metric facilitates informed decision-making in model selection, thereby reducing costs and democratizing access to high-performing language models, as evidenced by case studies.


title: PHYDI: Initializing Parameterized Hypercomplex Neural Networks as Identity Functions

abstract: Neural models based on hypercomplex algebra systems are growing and prolificating for a plethora of applications, ranging from computer vision to natural language processing. Hand in hand with their adoption, parameterized hypercomplex neural networks (PHNNs) are growing in size and no techniques have been adopted so far to control their convergence at a large scale. In this paper, we study PHNNs convergence and propose parameterized hypercomplex identity initialization (PHYDI), a method to improve their convergence at different scales, leading to more robust performance when the number of layers scales up, while also reaching the same performance with fewer iterations. We show the effectiveness of this approach in different benchmarks and with common PHNNs with ResNets- and Transformer-based architecture. The code is available at https://github.com/ispamm/PHYDI.


title: Reinforcement Learning-based Knowledge Graph Reasoning for Explainable Fact-checking

abstract: Fact-checking is a crucial task as it ensures the prevention of misinformation. However, manual fact-checking cannot keep up with the rate at which false information is generated and disseminated online. Automated fact-checking by machines is significantly quicker than by humans. But for better trust and transparency of these automated systems, explainability in the fact-checking process is necessary. Fact-checking often entails contrasting a factual assertion with a body of knowledge for such explanations. An effective way of representing knowledge is the Knowledge Graph (KG). There have been sufficient works proposed related to fact-checking with the usage of KG but not much focus is given to the application of reinforcement learning (RL) in such cases. To mitigate this gap, we propose an RL-based KG reasoning approach for explainable fact-checking. Extensive experiments on FB15K-277 and NELL-995 datasets reveal that reasoning over a KG is an effective way of producing human-readable explanations in the form of paths and classifications for fact claims. The RL reasoning agent computes a path that either proves or disproves a factual claim, but does not provide a verdict itself. A verdict is reached by a voting mechanism that utilizes paths produced by the agent. These paths can be presented to human readers so that they themselves can decide whether or not the provided evidence is convincing or not. This work will encourage works in this direction for incorporating RL for explainable fact-checking as it increases trustworthiness by providing a human-in-the-loop approach.


title: Automorphisms of the Rado meet-tree

abstract: We prove that the group of automorphisms of the generic meet-tree expansion of an infinite non-unary free Fra\"{\i}ss\'{e} limit over a finite relational language is simple. As a prototypical case, the group of automorphism of the Rado meet-tree (i.e. the Fra\"{\i}ss\'{e} limit of finite graphs which are also meet-trees) is simple.


title: Complex Pathways to Cooperation Emergent from Asymmetry in Heterogeneous Populations

abstract: Cooperation within asymmetric populations has garnered significant attention in evolutionary games. This paper explores cooperation evolution in populations with weak and strong players, using a game model where players choose between cooperation and defection. Asymmetry stems from different benefits for strong and weak cooperators, with their benefit ratio indicating the degree of asymmetry. Varied rankings of parameters including the asymmetry degree, cooperation costs, and benefits brought by weak players give rise to scenarios including the prisoner's dilemma (PDG) for both player types, the snowdrift game (SDG), and mixed PDG-SDG interactions. Our results indicate that in an infinite well-mixed population, defection remains the dominant strategy when strong players engage in the prisoner's dilemma game. However, if strong players play snowdrift games, global cooperation increases with the proportion of strong players. In this scenario, strong cooperators can prevail over strong defectors when the proportion of strong players is low, but the prevalence of cooperation among strong players decreases as their proportion increases. In contrast, within a square lattice, the optimum global cooperation emerges at intermediate proportions of strong players with moderate degrees of asymmetry. Additionally, weak players protect cooperative clusters from exploitation by strong defectors. This study highlights the complex dynamics of cooperation in asymmetric interactions, contributing to the theory of cooperation in asymmetric games.


title: On the spectral radius properties of a key matrix in periodic impulse control

abstract: In this work, we consider the periodic impulse control of a system modeled as a set of linear differential equations. We define a matrix that governs the qualitative behavior of the controlled system. This matrix depends on the period and effects of the control interventions. We investigate properties of the spectral radius of this matrix and in particular, how it depends on the period of the interventions. Our main result is on the convexity of the spectral radius with respect to this period. We discuss implications of this convexity on establishing an optimal and maximum period for effective control. Finally, we provide an example motivated from a real-life scenario.


title: VQE-inspired optimization for spin chains work extraction

abstract: The energy extraction from quantum sources is a key task to develop new quantum devices such as Quantum Batteries (QB). In this context, one of the main figures of merit is the ergotropy, which measures the maximal amount of energy (as work) that can be extracted from the quantum source by means of unitary operations. One of the main issues to fully extract energy from the quantum source is the assumption that any unitary operation can be done on the system. This assumption, in general, fails in practice since the operations that can be done are limited and depend on the quantum hardware (experimental platform) one has available. In this work, we propose a new approach to optimize the extractable energy inspired by the Variational Quantum Eigensolver (VQE) algorithm. In this approach, we explicitly take into account a limited set of unitaries by using the Hardware Efficient Ansatz (HEA) class of parameterized quantum circuits. As a QB we use an 1D spin chain described by a family of paradigmatic first neighbour hamiltonians such as the XXX, XXZ, XYZ, XX, XY and Transverse Ising models. By building our parameterized quantum circuits assuming that different types of connectivity may be available depending on the quantum hardware, we numerically compare the efficiency of work extraction for each model. Our results show that the best efficiency is generally obtained with quantum circuits that have connectivity between first neighbour spins.


title: Multi-particle Integral and Differential Correlation Functions

abstract: This paper formalizes the use of integral and differential cumulants for measurements of multi-particle event-by-event transverse momentum fluctuations, rapidity fluctuations, as well as net charge fluctuations. This enables the introduction of multi-particle balance functions, defined based on differential correlation functions (factorial cumulants), that suppress two and three prong resonance decays effects and enable measurements of underlying long range correlations obeying quantum number conservation constraints. These multi-particle balance functions satisfy simple sum rules determined by quantum number conservation. It is additionally shown that these multi-particle balance functions arise as an intrinsic component of high-order net charge cumulants. This implies that the magnitude of these cumulants, measured in a specific experimental acceptance, is strictly constrained by charge conservation and primarily determined by the rapidity and momentum width of these balance functions. The paper also presents techniques to reduce the computation time of differential correlation functions up to order $n=$10 based on the methods of moments.


title: Latent Su-Schrieffer-Heeger models

abstract: The Su-Schrieffer-Heeger (SSH) chain is the reference model of a one-dimensional topological insulator. Its topological nature can be explained by the quantization of the Zak phase, due to reflection symmetry of the unit cell, or of the winding number, due to chiral symmetry. Here, we harness recent graph-theoretical results to construct families of setups whose unit cell features neither of these symmetries, but instead a so-called latent or hidden reflection symmetry. This causes the isospectral reduction -- akin to an effective Hamiltonian -- of the resulting lattice to have the form of an SSH model. As we show, these latent SSH models exhibit features such as multiple topological transitions and edge states, as well as a quantized Zak phase. Relying on a generally applicable discrete framework, we experimentally validate our findings using electric circuits.


title: Quantum interference and entanglement in ultracold atom-exchange reactions

abstract: Coherent superpositions and entanglement are hallmarks of quantum mechanics, but they are fragile and can easily be perturbed by their environment. Selected isolated physical systems can maintain coherence and generate entanglement using well-controlled interactions. Chemical reactions, where bonds break and form, are highly dynamic quantum processes. A fundamental question is whether coherence can be preserved in chemical reactions and then harnessed to generate entangled products. Here we investigate this question by studying the 2KRb $\rightarrow$ K$_2$ + Rb$_2$ reaction at 500 nK, focusing on the the nuclear spin degrees of freedom. We prepare the initial nuclear spins in KRb in an entangled state and characterize the preserved coherence in nuclear spin wavefunction after the reaction. The data are consistent with full coherence at the end of the reaction. This suggests that entanglement can be prepared within the reactants, followed by a chemical reaction that produces separate, entangled molecules. We additionally demonstrate control of the reaction product state distribution by deliberately decohering the reactants.


title: AG-CVG: Coverage Planning with a Mobile Recharging UGV and an Energy-Constrained UAV

abstract: In this paper, we present an approach for coverage path planning for a team of an energy-constrained Unmanned Aerial Vehicle (UAV) and an Unmanned Ground Vehicle (UGV). Both the UAV and the UGV have predefined areas that they have to cover. The goal is to perform complete coverage by both robots while minimizing the coverage time. The UGV can also serve as a mobile recharging station. The UAV and UGV need to occasionally rendezvous for recharging. We propose a heuristic method to address this NP-Hard planning problem. Our approach involves initially determining coverage paths without factoring in energy constraints. Subsequently, we cluster segments of these paths and employ graph matching to assign UAV clusters to UGV clusters for efficient recharging management. We perform numerical analysis on real-world coverage applications and show that compared with a greedy approach our method reduces rendezvous overhead on average by 11.33%. We demonstrate proof-of-concept with a team of a VOXL m500 drone and a Clearpath Jackal ground vehicle, providing a complete system from the offline algorithm to the field execution.


title: Time-Resolved Reconstruction of Motion, Force, and Stiffness using Spectro-Dynamic MRI

abstract: Measuring the dynamics and mechanical properties of muscles and joints is important to understand the (patho)physiology of muscles. However, acquiring dynamic time-resolved MRI data is challenging. We have previously developed Spectro-Dynamic MRI which allows the characterization of dynamical systems at a high spatial and temporal resolution directly from k-space data. This work presents an extended Spectro-Dynamic MRI framework that reconstructs 1) time-resolved MR images, 2) time-resolved motion fields, 3) dynamical parameters, and 4) an activation force, at a temporal resolution of 11 ms. An iterative algorithm solves a minimization problem containing four terms: a motion model relating the motion to the fully-sampled k-space data, a dynamical model describing the expected type of dynamics, a data consistency term describing the undersampling pattern, and finally a regularization term for the activation force. We acquired MRI data using a dynamic motion phantom programmed to move like an actively driven linear elastic system, from which all dynamic variables could be accurately reconstructed, regardless of the sampling pattern. The proposed method performed better than a two-step approach, where time-resolved images were first reconstructed from the undersampled data without any information about the motion, followed by a motion estimation step.


title: Dual Quaternion Rotational and Translational Equivariance in 3D Rigid Motion Modelling

abstract: Objects' rigid motions in 3D space are described by rotations and translations of a highly-correlated set of points, each with associated $x,y,z$ coordinates that real-valued networks consider as separate entities, losing information. Previous works exploit quaternion algebra and their ability to model rotations in 3D space. However, these algebras do not properly encode translations, leading to sub-optimal performance in 3D learning tasks. To overcome these limitations, we employ a dual quaternion representation of rigid motions in the 3D space that jointly describes rotations and translations of point sets, processing each of the points as a single entity. Our approach is translation and rotation equivariant, so it does not suffer from shifts in the data and better learns object trajectories, as we validate in the experimental evaluations. Models endowed with this formulation outperform previous approaches in a human pose forecasting application, attesting to the effectiveness of the proposed dual quaternion formulation for rigid motions in 3D space.


title: Surgery Constructions for 3d Theories, Part I: Matter Circles and Links

abstract: We try to give a geometric construction of 3d $\mathcal{N}=2$ gauge theories using three-manifolds and Dehn surgeries. It is known that wrapping M5-branes on plumbing three-manifolds leads to 3d theories with mixed Chern-Simons levels. We find that this construction can be extended by adding Lagrangian defects on the tangent bundles of three-manifolds. After wrapping M5-branes on these defects and through M-theory/IIB string duality, one can get D5-branes that introduce chiral multiplets. This is analogous to Ooguri-Vafa construction of Wilson loop operators along knots on the three-sphere. In this note, we only consider unknotted matter circles, which are intersections between defect M5-branes and plumbing manifolds. After introducing matters, mirror dualities of 3d theories match with Kirby moves of plumbing manifolds. We also find the dictionary between various structures of three-manifolds and physical aspects of 3d gauge theories.


title: Cybersecurity as a Crosscutting Concept Across an Undergrad Computer Science Curriculum: An Experience Report

abstract: Although many Computer Science (CS) programs offer cybersecurity courses, they are typically optional and placed at the periphery of the program. We advocate to integrate cybersecurity as a crosscutting concept in CS curricula, which is also consistent with latest cybersecurity curricular guidelines, e.g., CSEC2017. We describe our experience of implementing this crosscutting intervention across three undergraduate core CS courses at a leading technical university in Europe between 2018 and 2023, collectively educating over 2200 students. The security education was incorporated within CS courses using a partnership between the responsible course instructor and a security expert, i.e., the security expert (after consultation with course instructors) developed and taught lectures covering multiple CSEC2017 knowledge areas. This created a complex dynamic between three stakeholders: the course instructor, the security expert, and the students. We reflect on our intervention from the perspective of the three stakeholders -- we conducted a post-course survey to collect student perceptions, and semi-supervised interviews with responsible course instructors and the security expert to gauge their experience. We found that while the students were extremely enthusiastic about the security content and retained its impact several years later, the misaligned incentives for the instructors and the security expert made it difficult to sustain this intervention without organizational support. By identifying limitations in our intervention, we suggest ideas for sustaining it.


title: Learning of Sea Surface Height Interpolation from Multi-variate Simulated Satellite Observations

abstract: Satellite-based remote sensing missions have revolutionized our understanding of the Ocean state and dynamics. Among them, space-borne altimetry provides valuable Sea Surface Height (SSH) measurements, used to estimate surface geostrophic currents. Due to the sensor technology employed, important gaps occur in SSH observations. Complete SSH maps are produced using linear Optimal Interpolations (OI) such as the widely-used Data Unification and Altimeter Combination System (DUACS). On the other hand, Sea Surface Temperature (SST) products have much higher data coverage and SST is physically linked to geostrophic currents through advection. We propose a new multi-variate Observing System Simulation Experiment (OSSE) emulating 20 years of SSH and SST satellite observations. We train an Attention-Based Encoder-Decoder deep learning network (\textsc{abed}) on this data, comparing two settings: one with access to ground truth during training and one without. On our OSSE, we compare ABED reconstructions when trained using either supervised or unsupervised loss functions, with or without SST information. We evaluate the SSH interpolations in terms of eddy detection. We also introduce a new way to transfer the learning from simulation to observations: supervised pre-training on our OSSE followed by unsupervised fine-tuning on satellite data. Based on real SSH observations from the Ocean Data Challenge 2021, we find that this learning strategy, combined with the use of SST, decreases the root mean squared error by 24% compared to OI.


title: Cosmology from LOFAR Two-metre Sky Survey Data Release 2: Angular Clustering of Radio Sources

abstract: Covering $\sim$5600 deg$^2$ to rms sensitivities of $\sim$70$-$100 $\mu$Jy beam$^{-1}$, the LOFAR Two-metre Sky Survey Data Release 2 (LoTSS-DR2) provides the largest low-frequency ($\sim$150 MHz) radio catalogue to date, making it an excellent tool for large-area radio cosmology studies. In this work, we use LoTSS-DR2 sources to investigate the angular two-point correlation function of galaxies within the survey. We discuss systematics in the data and an improved methodology for generating random catalogues, compared to that used for LoTSS-DR1, before presenting the angular clustering for $\sim$900,000 sources $\geq$$1.5$ mJy and a peak signal-to-noise $\geq$$7.5$ across $\sim$$80\%$ of the observed area. Using the clustering we infer the bias assuming two evolutionary models. When fitting {angular scales of $0.5 \leq\theta<5\,\deg$, using a linear bias model, we find LoTSS-DR2 sources are biased tracers of the underlying matter, with a bias of $b_{C}= 2.14^{+0.22}_{-0.20}$ (assuming constant bias) and $b_{E}(z=0)= 1.79^{+0.15}_{-0.14}$ (for an evolving model, inversely proportional to the growth factor), corresponding to $b_E= 2.81^{+0.24}_{-0.22}$ at the median redshift of our sample, assuming the LoTSS Deep Fields redshift distribution is representative of our data. This reduces to $b_{C}= 2.02^{+0.17}_{-0.16}$ and $b_{E}(z=0)= 1.67^{+0.12}_{-0.12}$ when allowing preferential redshift distributions from the Deep Fields to model our data. Whilst the clustering amplitude is slightly lower than LoTSS-DR1 ($\geq$2 mJy), our study benefits from larger samples and improved redshift estimates.


title: The relative Brauer group of $K(1)$-local spectra

abstract: Using profinite Galois descent, we compute the Brauer group of the $K(1)$-local category relative to Morava E-theory. At odd primes this group is generated by a cyclic algebra formed using any primitive $(p-1)$st root of unity, but at the prime two is a group of order $32$ with nontrivial extensions; we give explicit descriptions of the generators, and consider their images in the Brauer group of $KO$. Along the way, we compute the relative Brauer group of completed $KO$, using the \'etale locally trivial Brauer group of Antieau, Meier and Stojanoska.


title: The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values

abstract: Human feedback is increasingly used to steer the behaviours of Large Language Models (LLMs). However, it is unclear how to collect and incorporate feedback in a way that is efficient, effective and unbiased, especially for highly subjective human preferences and values. In this paper, we survey existing approaches for learning from human feedback, drawing on 95 papers primarily from the ACL and arXiv repositories.First, we summarise the past, pre-LLM trends for integrating human feedback into language models. Second, we give an overview of present techniques and practices, as well as the motivations for using feedback; conceptual frameworks for defining values and preferences; and how feedback is collected and from whom. Finally, we encourage a better future of feedback learning in LLMs by raising five unresolved conceptual and practical challenges.


title: Differentiable Euler Characteristic Transforms for Shape Classification

abstract: The Euler Characteristic Transform (ECT) has proven to be a powerful representation, combining geometrical and topological characteristics of shapes and graphs. However, the ECT was hitherto unable to learn task-specific representations. We overcome this issue and develop a novel computational layer that enables learning the ECT in an end-to-end fashion. Our method, the Differentiable Euler Characteristic Transform (DECT), is fast and computationally efficient, while exhibiting performance on a par with more complex models in both graph and point cloud classification tasks. Moreover, we show that this seemingly simple statistic provides the same topological expressivity as more complex topological deep learning layers.


title: Graph Transformer Network for Flood Forecasting with Heterogeneous Covariates

abstract: Floods can be very destructive causing heavy damage to life, property, and livelihoods. Global climate change and the consequent sea-level rise have increased the occurrence of extreme weather events, resulting in elevated and frequent flood risk. Therefore, accurate and timely flood forecasting in coastal river systems is critical to facilitate good flood management. However, the computational tools currently used are either slow or inaccurate. In this paper, we propose a Flood prediction tool using Graph Transformer Network (FloodGTN) for river systems. More specifically, FloodGTN learns the spatio-temporal dependencies of water levels at different monitoring stations using Graph Neural Networks (GNNs) and an LSTM. It is currently implemented to consider external covariates such as rainfall, tide, and the settings of hydraulic structures (e.g., outflows of dams, gates, pumps, etc.) along the river. We use a Transformer to learn the attention given to external covariates in computing water levels. We apply the FloodGTN tool to data from the South Florida Water Management District, which manages a coastal area prone to frequent storms and hurricanes. Experimental results show that FloodGTN outperforms the physics-based model (HEC-RAS) by achieving higher accuracy with 70% improvement while speeding up run times by at least 500x.


title: Prompt Backdoors in Visual Prompt Learning

abstract: Fine-tuning large pre-trained computer vision models is infeasible for resource-limited users. Visual prompt learning (VPL) has thus emerged to provide an efficient and flexible alternative to model fine-tuning through Visual Prompt as a Service (VPPTaaS). Specifically, the VPPTaaS provider optimizes a visual prompt given downstream data, and downstream users can use this prompt together with the large pre-trained model for prediction. However, this new learning paradigm may also pose security risks when the VPPTaaS provider instead provides a malicious visual prompt. In this paper, we take the first step to explore such risks through the lens of backdoor attacks. Specifically, we propose BadVisualPrompt, a simple yet effective backdoor attack against VPL. For example, poisoning $5\%$ CIFAR10 training data leads to above $99\%$ attack success rates with only negligible model accuracy drop by $1.5\%$. In particular, we identify and then address a new technical challenge related to interactions between the backdoor trigger and visual prompt, which does not exist in conventional, model-level backdoors. Moreover, we provide in-depth analyses of seven backdoor defenses from model, prompt, and input levels. Overall, all these defenses are either ineffective or impractical to mitigate our BadVisualPrompt, implying the critical vulnerability of VPL.


title: Attention-Map Augmentation for Hypercomplex Breast Cancer Classification

abstract: Breast cancer is the most widespread neoplasm among women and early detection of this disease is critical. Deep learning techniques have become of great interest to improve diagnostic performance. However, distinguishing between malignant and benign masses in whole mammograms poses a challenge, as they appear nearly identical to an untrained eye, and the region of interest (ROI) constitutes only a small fraction of the entire image. In this paper, we propose a framework, parameterized hypercomplex attention maps (PHAM), to overcome these problems. Specifically, we deploy an augmentation step based on computing attention maps. Then, the attention maps are used to condition the classification step by constructing a multi-dimensional input comprised of the original breast cancer image and the corresponding attention map. In this step, a parameterized hypercomplex neural network (PHNN) is employed to perform breast cancer classification. The framework offers two main advantages. First, attention maps provide critical information regarding the ROI and allow the neural model to concentrate on it. Second, the hypercomplex architecture has the ability to model local relations between input dimensions thanks to hypercomplex algebra rules, thus properly exploiting the information provided by the attention map. We demonstrate the efficacy of the proposed framework on both mammography images as well as histopathological ones. We surpass attention-based state-of-the-art networks and the real-valued counterpart of our approach. The code of our work is available at https://github.com/ispamm/AttentionBCS.


title: FeAmGen.jl: A Julia Program for Feynman Amplitude Generation

abstract: FeAmGen.jl is a Julia package designed to generate Feynman diagrams and their corresponding amplitudes for various processes in particle physics. Utilizing the models in the Universal Feynman Output (UFO) format and Qgraf for diagram generation, it also employs SymEngine.jl and Form for amplitude generation. Additionally, the package offers functions for constructing Feynman integral topologies. In conclusion, FeAmGen.jl provides usability and versatility for the high precision calculations of the perturbative quantum field theory in the Standard Model or in the extensions beyond it. The corresponding codes are available at https://code.ihep.ac.cn/IHEP-Multiloop/FeAmGen.jl.git.


title: Gaussian deconvolution and the lace expansion

abstract: We give conditions on a real-valued function $F$ on $\mathbb{Z}^d$, for $d>2$, which ensure that the solution $G$ to the convolution equation $(F*G)(x) = \delta_{0,x}$ has Gaussian decay $|x|^{-(d-2)}$ for large $|x|$. Precursors of our results were obtained in the 2000s, using intricate Fourier analysis. In 2022, a very simple deconvolution theorem was proved, but its applicability was limited. We extend the 2022 theorem to remove its limitations while maintaining its simplicity -- our main tools are H\"older's inequality and basic Fourier theory in $L^p$ space. Our motivation comes from critical phenomena in equilibrium statistical mechanics, where the convolution equation is provided by the lace expansion and the deconvolution $G$ is a critical two-point function. Our results significantly simplify existing proofs of critical $|x|^{-(d-2)}$ decay in high dimensions for self-avoiding walk, Ising and $\varphi^4$ models, percolation, and lattice trees and lattice animals. We also improve previous error estimates.


title: Proof of Hofer-Wysocki-Zehnder's two or infinity conjecture

abstract: We prove that every Reeb flow on a closed connected three-manifold has either two or infinitely many simple periodic orbits, assuming that the associated contact structure has torsion first Chern class. As a special case, we prove a conjecture of Hofer-Wysocki-Zehnder published in 2003 asserting that a smooth and autonomous Hamiltonian flow on $\mathbb{R}^4$ has either two or infinitely many simple periodic orbits on any regular compact connected energy level that is transverse to the radial vector field. Other corollaries settle some old problems about Finsler metrics: we show that every Finsler metric on $S^2$ has either two or infinitely many prime closed geodesics; and we show that a Finsler metric on $S^2$ with at least one closed geodesic that is not irrationally elliptic must have infinitely many prime closed geodesics. The novelty of our work is that we do not make any nondegeneracy hypotheses.


title: OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

abstract: Information Technology (IT) Operations (Ops), particularly Artificial Intelligence for IT Operations (AIOps), is the guarantee for maintaining the orderly and stable operation of existing information systems. According to Gartner's prediction, the use of AI technology for automated IT operations has become a new trend. Large language models (LLMs) that have exhibited remarkable capabilities in NLP-related tasks, are showing great potential in the field of AIOps, such as in aspects of root cause analysis of failures, generation of operations and maintenance scripts, and summarizing of alert information. Nevertheless, the performance of current LLMs in Ops tasks is yet to be determined. In this paper, we present OpsEval, a comprehensive task-oriented Ops benchmark designed for LLMs. For the first time, OpsEval assesses LLMs' proficiency in various crucial scenarios at different ability levels. The benchmark includes 7184 multi-choice questions and 1736 question-answering (QA) formats in English and Chinese. By conducting a comprehensive performance evaluation of the current leading large language models, we show how various LLM techniques can affect the performance of Ops, and discussed findings related to various topics, including model quantification, QA evaluation, and hallucination issues. To ensure the credibility of our evaluation, we invite dozens of domain experts to manually review our questions. At the same time, we have open-sourced 20% of the test QA to assist current researchers in preliminary evaluations of their OpsLLM models. The remaining 80% of the data, which is not disclosed, is used to eliminate the issue of the test set leakage. Additionally, we have constructed an online leaderboard that is updated in real-time and will continue to be updated, ensuring that any newly emerging LLMs will be evaluated promptly. Both our dataset and leaderboard have been made public.


title: Context-Enhanced Detector For Building Detection From Remote Sensing Images

abstract: The field of building detection from remote sensing images has made significant progress, but faces challenges in achieving high-accuracy detection due to the diversity in building appearances and the complexity of vast scenes. To address these challenges, we propose a novel approach called Context-Enhanced Detector (CEDet). Our approach utilizes a three-stage cascade structure to enhance the extraction of contextual information and improve building detection accuracy. Specifically, we introduce two modules: the Semantic Guided Contextual Mining (SGCM) module, which aggregates multi-scale contexts and incorporates an attention mechanism to capture long-range interactions, and the Instance Context Mining Module (ICMM), which captures instance-level relationship context by constructing a spatial relationship graph and aggregating instance features. Additionally, we introduce a semantic segmentation loss based on pseudo-masks to guide contextual information extraction. Our method achieves state-of-the-art performance on three building detection benchmarks, including CNBuilding-9P, CNBuilding-23P, and SpaceNet.


title: Guidance of ultraviolet light down to 190 nm in a hollow-core optical fibre

abstract: We report an anti-resonant hollow core fibre with ultraviolet transmission down to 190 nm, covering the entire UV-A, UV-B and much of the UV-C band. Guidance from 190 - 400 nm is achieved apart for a narrow high loss resonance band at 245 - 265 nm. The minimum attenuation is 0.13 dB/m at 235 nm and 0.16 dB/m at 325 nm. With an inscribed core diameter of ~ 12 $\mu$m, the fibre's bend loss at 325 nm was 0.22 dB per turn for a bend radius of 3 cm at 325 nm.


title: Gaussian deconvolution and the lace expansion for spread-out models

abstract: We present a new proof of $|x|^{-(d-2)}$ decay of critical two-point functions for spread-out statistical mechanical models on $\mathbb{Z}^d$ above the upper critical dimension, based on the lace expansion and assuming appropriate diagrammatic estimates. Applications include spread-out models of the Ising model and self-avoiding walk in dimensions $d>4$, and spread-out percolation for $d>6$. The proof is based on an extension of the new Gaussian deconvolution theorem we obtained in a recent paper. It provides a technically simpler and conceptually more transparent approach than the method of Hara, van der Hofstad and Slade (2003).


title: Evaluating Large Language Models at Evaluating Instruction Following

abstract: As research in large language models (LLMs) continues to accelerate, LLM-based evaluation has emerged as a scalable and cost-effective alternative to human evaluations for comparing the ever increasing list of models. This paper investigates the efficacy of these ``LLM evaluators'', particularly in using them to assess instruction following, a metric that gauges how closely generated text adheres to the given instruction. We introduce a challenging meta-evaluation benchmark, LLMBar, designed to test the ability of an LLM evaluator in discerning instruction-following outputs. The authors manually curated 419 pairs of outputs, one adhering to instructions while the other diverging, yet may possess deceptive qualities that mislead an LLM evaluator, e.g., a more engaging tone. Contrary to existing meta-evaluation, we discover that different evaluators (i.e., combinations of LLMs and prompts) exhibit distinct performance on LLMBar and even the highest-scoring ones have substantial room for improvement. We also present a novel suite of prompting strategies that further close the gap between LLM and human evaluators. With LLMBar, we hope to offer more insight into LLM evaluators and foster future research in developing better instruction-following models.


title: Cosmology from LOFAR Two-metre Sky Survey Data Release 2: Cross-correlation with the cosmic microwave background

abstract: We combine the LOw-Frequency ARray (LOFAR) Two-metre Sky Survey (LoTSS) second data release (DR2) catalogue with gravitational lensing maps from the Cosmic Microwave Background (CMB) to place constraints on the bias evolution of LoTSS radio galaxies, and on the amplitude of matter perturbations. We construct a flux-limited catalogue, and analyse its harmonic-space cross-correlation with CMB lensing maps from Planck, $C_\ell^{g\kappa}$, as well as its auto-correlation, $C_\ell^{gg}$. We explore the models describing the redshift evolution of the large-scale radio galaxy bias, discriminating between them through the combination of both $C_\ell^{g\kappa}$ and $C_\ell^{gg}$. Fixing the bias evolution, we then use these data to place constraints on the amplitude of large scale density fluctuations. We report the significance of the $C_\ell^{g\kappa}$ signal at a level of $26.6\sigma$. We determine that a linear bias evolution of the form $b_g(z) = b_{g,D} / D(z)$, where $D(z)$ is the growth rate, is able to provide a good description of the data, and measure $b_{g,D} = 1.41 \pm 0.06$ for a sample flux-limited at $1.5\,{\rm mJy}$, for scales $\ell < 250$ for $C_\ell^{gg}$, and $\ell < 500$ for $C_\ell^{g\kappa}$. At the sample's median redshift, we obtain $b(z = 0.82) = 2.34 \pm 0.10$. Using $\sigma_8$ as a free parameter, while keeping other cosmological parameters fixed to the Planck values, we find fluctuations of $\sigma_8 = 0.75^{+0.05}_{-0.04}$. The result is in agreement with weak lensing surveys, and at $1\sigma$ difference with Planck CMB constraints. We also attempt to detect the late-time integrated Sachs-Wolfe effect with LOFAR, but with the current sky coverage, the cross-correlation with CMB temperature maps is consistent with zero. Our results are an important step towards constraining cosmology with radio continuum surveys from LOFAR and other future large radio surveys.


title: Impacts of Riding Comfort on the Attitudes of Riders, Drivers, and Pedestrians Toward Autonomous Shuttles

abstract: Automated vehicle (AV) shuttles are emerging mobility technologies that have been widely piloted and deployed. Public attitude is critical to the deployment progress and the overall social benefits of automated vehicle (AV) technologies. The AV shuttle demonstration was regarded as a good way for possible attitude improvements. However, not all existing AV shuttle technologies are mature and reliable enough. Some frustrating uncomfort issues in AV shuttle demonstrations may adversely affect public attitudes of AV technologies. Studying the impact of the comfort of the demonstration on attitudinal change can help us provide guidance for future demonstrations. Thanks to the AV shuttle project piloted at Dunedin, Florida, this paper interviewed 161 people before and after taking an open road AV shuttle ride. In addition to the participant's demographic information, driving-related information and psychological-related information, we collected the AV shuttles' operation status (e.g., abrupt brake). A series of discrete outcome models were employed to estimate the factors influencing people's initial opinions before the AV shuttle ride and people's attitudes change after the ride. The most important finding is that an unsatisfactory riding experience could negatively affect participants' attitudes toward AV shuttles. Particularly, the number of abrupt brakes raises more concerns when the participants are drivers who share the rights of way with the AV shuttle compared to when the participants are pedestrians or AV shuttle riders. Moreover, the participants' attitudes toward sharing public space with AV shuttles as pedestrians and human drivers exhibited more negative changes compared with simply riding on AV shuttles. These results improve our understanding of public attitudes toward the existing AV technologies and help identify new opportunities to improve AV technology adoption.


title: Rethinking the BERT-like Pretraining for DNA Sequences

abstract: With the success of large-scale pretraining in NLP, there is an increasing trend of applying it to the domain of life sciences. In particular, pretraining methods based on DNA sequences have garnered growing attention due to their potential to capture generic information about genes. However, existing pretraining methods for DNA sequences largely rely on direct adoptions of BERT pretraining from NLP, lacking a comprehensive understanding and a specifically tailored approach. To address this research gap, we first conducted a series of exploratory experiments and gained several insightful observations: 1) In the fine-tuning phase of downstream tasks, when using K-mer overlapping tokenization instead of K-mer non-overlapping tokenization, both overlapping and non-overlapping pretraining weights show consistent performance improvement.2) During the pre-training process, using K-mer overlapping tokenization quickly produces clear K-mer embeddings and reduces the loss to a very low level, while using K-mer non-overlapping tokenization results in less distinct embeddings and continuously decreases the loss. 3) Using overlapping tokenization causes the self-attention in the intermediate layers of pre-trained models to tend to overly focus on certain tokens, reflecting that these layers are not adequately optimized. In summary, overlapping tokenization can benefit the fine-tuning of downstream tasks but leads to inadequate pretraining with fast convergence. To unleash the pretraining potential, we introduce a novel approach called RandomMask, which gradually increases the task difficulty of BERT-like pretraining by continuously expanding its mask boundary, forcing the model to learn more knowledge. RandomMask is simple but effective, achieving top-tier performance across 26 datasets of 28 datasets spanning 7 downstream tasks.


title: Solutions of the Schr\"odinger equation with Quarkonium potential to predict the mass-spectra of the heavy mesons via series expansion method

abstract: In this study, a quarkonium potential is adopted as the quark-antiquark interaction potential for predicting the mass spectra of heavy mesons. We solved the radial Schr\"odinger equation analytically using the series expansion method and obtained the energy eigenvalues. The present results are applied for predicting the mass spectra of heavy mesons such as charmonium and bottomonium. The present potential provides satisfying results in comparison with experimental data and the work of other researchers with a maximum error of 0.058 GeV


title: LEO Satellite Networking Relaunched: Survey and Current Research Challenges

abstract: This document surveys recent and current developments in LEO satellite networking. It presents a brief overview of satellite networking in order to contextualize the issue. It then focuses on current research work in emerging domains, such as Machine Learning, SDN, low latency networking, green networking, Information-Centric Networks, etc. For each, it presents recent works and a direction of the research community within that emerging domain. The paper also describes the current state of standardization efforts in 3GPP and in IETF for LEO satellite networking. In particular, we present in some detail the direction these standards body are pointing towards for LEO networking with inter-satellites links. Finally, some future challenges and interesting research directions are described and motivated. This is an overview of the current state of the LEO satellite research in both academic and industrial standardization environments which we believe will be helpful to understand the current state of the art.


title: Generation of isolated flat bands with tunable numbers through Moir\'e engineering

abstract: Unlike the spin-1/2 fermions, the Lieb and Dice lattices both host triply-degenerate low-energy excitations. Here, we discuss Moir\'e structures involving twisted bilayers of these lattices, which are shown to exhibit a tunable number of isolated flat bands near the Fermi level. These flat bands remain isolated from the high-energy bands even in the presence of small higher-order terms and chiral-symmetry-breaking interlayer tunneling. At small twist angles, thousands of flat bands can be generated to substantially amplify flat band physics. We demonstrate that these flat bands carry substantial quantum weight so that upon adding a BCS-type pairing potential, the associated superfluid weight would also be large, and the critical superconducting temperature would be tunable. Our study suggests a new pathway for flat-band engineering based on twisted bilayer Lieb and Dice lattices.


title: Hypercomplex Multimodal Emotion Recognition from EEG and Peripheral Physiological Signals

abstract: Multimodal emotion recognition from physiological signals is receiving an increasing amount of attention due to the impossibility to control them at will unlike behavioral reactions, thus providing more reliable information. Existing deep learning-based methods still rely on extracted handcrafted features, not taking full advantage of the learning ability of neural networks, and often adopt a single-modality approach, while human emotions are inherently expressed in a multimodal way. In this paper, we propose a hypercomplex multimodal network equipped with a novel fusion module comprising parameterized hypercomplex multiplications. Indeed, by operating in a hypercomplex domain the operations follow algebraic rules which allow to model latent relations among learned feature dimensions for a more effective fusion step. We perform classification of valence and arousal from electroencephalogram (EEG) and peripheral physiological signals, employing the publicly available database MAHNOB-HCI surpassing a multimodal state-of-the-art network. The code of our work is freely available at https://github.com/ispamm/MHyEEG.


title: Automated Layout Design and Control of Robust Cooperative Grasped-Load Aerial Transportation Systems

abstract: We present a novel approach to cooperative aerial transportation through a team of drones, using optimal control theory and a hierarchical control strategy. We assume the drones are connected to the payload through rigid attachments, essentially transforming the whole system into a larger flying object with "thrust modules" at the attachment locations of the drones. We investigate the optimal arrangement of the thrust modules around the payload, so that the resulting system is robust to disturbances. We choose the $\mathcal{H}_2$ norm as a measure of robustness, and propose an iterative optimization routine to compute the optimal layout of the vehicles around the object. We experimentally validate our approach using four drones and comparing the disturbance rejection performances achieved by two different layouts (the optimal one and a sub-optimal one), and observe that the results match our predictions.


title: Variational quantum eigensolver for closed-shell molecules with non-bosonic corrections

abstract: The realization of quantum advantage with noisy-intermediate-scale quantum (NISQ) machines has become one of the major challenges in computational sciences. Maintaining coherence of a physical system with more than ten qubits is a critical challenge that motivates research on compact system representations to reduce algorithm complexity. Toward this end, quantum simulations based on the variational quantum eigensolver (VQE) is considered to be one of the most promising algorithms for quantum chemistry in the NISQ era. We investigate reduced mapping of one spatial orbital to a single qubit to analyze the ground state energy in a way that the Pauli operators of qubits are mapped to the creation/annihilation of singlet pairs of electrons. To include the effect of non-bosonic (or non-paired) excitations, we introduce a simple correction scheme in the electron correlation model approximated by the geometrical mean of the bosonic (or paired) terms. Employing it in a VQE algorithm, we assess ground state energies of H2O, N2, and Li2O in good agreements with full configuration interaction (FCI) models respectively, using only 6, 8, and 12 qubits with quantum gate depths proportional to the squares of the qubit counts. With the adopted seniority-zero approximation that uses only one half of the qubit counts of a conventional VQE algorithm, we find our non-bosonic correction method reaches reliable quantum chemistry simulations at least for the tested systems.


title: Polytopal discontinuous Galerkin discretization of brain multiphysics flow dynamics

abstract: A comprehensive mathematical model of the multiphysics flow of blood and Cerebrospinal Fluid (CSF) in the brain can be expressed as the coupling of a poromechanics system and Stokes' equations: the first describes fluids filtration through the cerebral tissue and the tissue's elastic response, while the latter models the flow of the CSF in the brain ventricles. This model describes the functioning of the brain's waste clearance mechanism, which has been recently discovered to play an essential role in the progress of neurodegenerative diseases. To model the interactions between different scales in the porous medium, we propose a physically consistent coupling between Multi-compartment Poroelasticity (MPE) equations and Stokes' equations. In this work, we introduce a numerical scheme for the discretization of such coupled MPE-Stokes system, employing a high-order discontinuous Galerkin method on polytopal grids to efficiently account for the geometric complexity of the domain. We analyze the stability and convergence of the space semidiscretized formulation, we prove a-priori error estimates, and we present a temporal discretization based on a combination of Newmark's $\beta$-method for the elastic wave equation and the $\theta$-method for the other equations of the model. Numerical simulations carried out on test cases with manufactured solutions validate the theoretical error estimates. We also present numerical results on a two-dimensional slice of a patient-specific brain geometry reconstructed from diagnostic images, to test in practice the advantages of the proposed approach.


title: LLM4Vis: Explainable Visualization Recommendation using ChatGPT

abstract: Data visualization is a powerful tool for exploring and communicating insights in various domains. To automate visualization choice for datasets, a task known as visualization recommendation has been proposed. Various machine-learning-based approaches have been developed for this purpose, but they often require a large corpus of dataset-visualization pairs for training and lack natural explanations for their results. To address this research gap, we propose LLM4Vis, a novel ChatGPT-based prompting approach to perform visualization recommendation and return human-like explanations using very few demonstration examples. Our approach involves feature description, demonstration example selection, explanation generation, demonstration example construction, and inference steps. To obtain demonstration examples with high-quality explanations, we propose a new explanation generation bootstrapping to iteratively refine generated explanations by considering the previous generation and template-based hint. Evaluations on the VizML dataset show that LLM4Vis outperforms or performs similarly to supervised learning models like Random Forest, Decision Tree, and MLP in both few-shot and zero-shot settings. The qualitative evaluation also shows the effectiveness of explanations generated by LLM4Vis. We make our code publicly available at \href{https://github.com/demoleiwang/LLM4Vis}{https://github.com/demoleiwang/LLM4Vis}.


title: Mini-DALLE3: Interactive Text to Image by Prompting Large Language Models

abstract: The revolution of artificial intelligence content generation has been rapidly accelerated with the booming text-to-image (T2I) diffusion models. Within just two years of development, it was unprecedentedly of high-quality, diversity, and creativity that the state-of-the-art models could generate. However, a prevalent limitation persists in the effective communication with these popular T2I models, such as Stable Diffusion, using natural language descriptions. This typically makes an engaging image hard to obtain without expertise in prompt engineering with complex word compositions, magic tags, and annotations. Inspired by the recently released DALLE3 - a T2I model directly built-in ChatGPT that talks human language, we revisit the existing T2I systems endeavoring to align human intent and introduce a new task - interactive text to image (iT2I), where people can interact with LLM for interleaved high-quality image generation/edit/refinement and question answering with stronger images and text correspondences using natural language. In addressing the iT2I problem, we present a simple approach that augments LLMs for iT2I with prompting techniques and off-the-shelf T2I models. We evaluate our approach for iT2I in a variety of common-used scenarios under different LLMs, e.g., ChatGPT, LLAMA, Baichuan, and InternLM. We demonstrate that our approach could be a convenient and low-cost way to introduce the iT2I ability for any existing LLMs and any text-to-image models without any training while bringing little degradation on LLMs' inherent capabilities in, e.g., question answering and code generation. We hope this work could draw broader attention and provide inspiration for boosting user experience in human-machine interactions alongside the image quality of the next-generation T2I systems.


title: Audio-Visual Neural Syntax Acquisition

abstract: We study phrase structure induction from visually-grounded speech. The core idea is to first segment the speech waveform into sequences of word segments, and subsequently induce phrase structure using the inferred segment-level continuous representations. We present the Audio-Visual Neural Syntax Learner (AV-NSL) that learns phrase structure by listening to audio and looking at images, without ever being exposed to text. By training on paired images and spoken captions, AV-NSL exhibits the capability to infer meaningful phrase structures that are comparable to those derived by naturally-supervised text parsers, for both English and German. Our findings extend prior work in unsupervised language acquisition from speech and grounded grammar induction, and present one approach to bridge the gap between the two topics.


title: On the diameter of semigroups of transformations and partitions

abstract: For a semigroup $S$ whose universal right congruence is finitely generated (or, equivalently, a semigroup satisfying the homological finiteness property of being type right-$FP_1$), the right diameter of $S$ is a parameter that expresses how `far apart' elements of $S$ can be from each other, in a certain sense. To be more precise, for each finite generating set $U$ for the universal right congruence on $S,$ we have a metric space $(S,d_U)$ where $d_U(a,b)$ is the minimum length of derivations for $(a,b)$ as a consequence of pairs in $U$; the right diameter of $S$ with respect to $U$ is the diameter of this metric space. The right diameter of $S$ is then the minimum of the set of all right diameters with respect to finite generating sets. We investigate whether various natural infinite semigroups of transformations and partitions have a finitely generated universal right/left congruence, and for those that do, we determine their right/left diameter. Among other results, for an arbitrary infinite set $X$ we prove the following. Each of the monoids of all binary relations on $X,$ of all partial transformations on $X,$ and of all full transformations on $X,$ as well as the partition and partial Brauer monoids on $X,$ have right diameter 1 and left diameter 1. The symmetric inverse monoid on $X$ has right diameter 2 and left diameter 2. The monoid of all injective mappings on $X$ has right diameter 4, and its minimal ideal (called the Baer-Levi semigroup on $X$) has right diameter 3, but neither of these two semigroups has a finitely generated universal left congruence. On the other hand, the semigroup of all surjective mappings on $X$ has left diameter 4, and its minimal ideal has left diameter 2, but neither of these semigroups has a finitely generated universal right congruence.


title: Optimizing Throughput and Makespan of Queuing Systems by Information Design

abstract: We study the optimal provision of information for two natural performance measures of queuing systems: throughput and makespan. A set of parallel links is equipped with deterministic capacities and stochastic travel times where the latter depend on a realized scenario. A continuum of flow particles arrives at the system at a constant rate. A system operator knows the realization of the scenario and may (partially) reveal this information via a public signaling scheme to the flow particles. Upon arrival, the flow particles observe the signal issued by the system operator, form an updated belief about the realized scenario, and decide on a link to use. Inflow into a link exceeding the link's capacity builds up in a queue that increases the travel time on the link. Dynamic inflow rates are in a Bayesian dynamic equilibrium when the expected travel time along all links with positive inflow is equal at every point in time. We provide an additive polynomial time approximation scheme (PTAS) that approximates the optimal throughput by an arbitrary additive constant $\epsilon>0$. The algorithm solves a Langrangian dual of the signaling problem with the Ellipsoid method whose separation oracle is implemented by a cell decomposition technique. We also provide a multiplicative fully polynomial time approximation scheme (FPTAS) that does not rely on strong duality and, thus, allows to compute also the optimal signals. It uses a different cell decomposition technique together with a piece-wise convex under-estimator of the optimal value function. Finally, we consider the makespan of a Bayesian dynamic equilibrium which is defined as the last point in time when a total given value of flow leaves the system. Using a variational inequality argument, we show that full information revelation is a public signaling scheme that minimizes the makespan.


title: RF-ICE: large-scale gigahertz readout of frequency-multiplexed microwave kinetic inductance detectors

abstract: We present RF-ICE, a novel readout platform for microwave kinetic inductance detectors (MKIDs), optimized for use on millimeter-wavelength telescopes. The RF-ICE system extends ICE, a versatile, mature signal processing platform currently in use on telescopes around the world, into a new operational domain with MKIDs biased with gigahertz carriers. The system couples the FPGA-based ICE motherboard with a radio-frequency digitization daughterboard to enable direct digital synthesis from 0 to 6 GHz without the need for external mixing. The system operates two independent readout modules, each with 1024 frequency-multiplexed readout channels spaced across 500 MHz of carrier bandwidth. The system, which is under active development, is in operation with prototype detector wafers and will be deployed for the upcoming SPT-SLIM and SPT-3G+ experiments.


title: The First Pathloss Radio Map Prediction Challenge

abstract: To foster research and facilitate fair comparisons among recently proposed pathloss radio map prediction methods, we have launched the ICASSP 2023 First Pathloss Radio Map Prediction Challenge. In this short overview paper, we briefly describe the pathloss prediction problem, the provided datasets, the challenge task and the challenge evaluation methodology. Finally, we present the results of the challenge.


title: Well Begun is Half Done: Generator-agnostic Knowledge Pre-Selection for Knowledge-Grounded Dialogue

abstract: Accurate knowledge selection is critical in knowledge-grounded dialogue systems. Towards a closer look at it, we offer a novel perspective to organize existing literature, i.e., knowledge selection coupled with, after, and before generation. We focus on the third under-explored category of study, which can not only select knowledge accurately in advance, but has the advantage to reduce the learning, adjustment, and interpretation burden of subsequent response generation models, especially LLMs. We propose GATE, a generator-agnostic knowledge selection method, to prepare knowledge for subsequent response generation models by selecting context-related knowledge among different knowledge structures and variable knowledge requirements. Experimental results demonstrate the superiority of GATE, and indicate that knowledge selection before generation is a lightweight yet effective way to facilitate LLMs (e.g., ChatGPT) to generate more informative responses.


title: Search for heavy neutral leptons in electron-positron and neutral-pion final states with the MicroBooNE detector

abstract: We present the first search for heavy neutral leptons (HNL) decaying into $\nu e^+e^-$ or $\nu\pi^0$ final states in a liquid-argon time projection chamber using data collected with the MicroBooNE detector. The data were recorded synchronously with the NuMI neutrino beam from Fermilab's Main Injector corresponding to a total exposure of $7.01 \times 10^{20}$ protons on target. We set upper limits at the $90\%$ confidence level on the mixing parameter $\lvert U_{\mu 4}\rvert^2$ in the mass ranges $10\le m_{\rm HNL}\le 150$ MeV for the $\nu e^+e^-$ channel and $150\le m_{\rm HNL}\le 245$ MeV for the $\nu\pi^0$ channel, assuming $\lvert U_{e 4}\rvert^2 = \lvert U_{\tau 4}\rvert^2 = 0$. These limits represent the most stringent constraints in the mass range $35<m_{\rm HNL}<175$ MeV and the first constraints from a direct search for $\nu\pi^0$ decays.


title: Constraints on Bianchi-I type universe with SH0ES anchored Pantheon+ SNIa data

abstract: We study the Bianchi-I cosmological model motivated by signals of statistical isotropy violation seen in cosmic microwave background (CMB) observations and others. To that end, we consider various kinds of anisotropic matter that source anisotropy in our model, specifically Cosmic strings, Magnetic fields, Domain walls and Lorentz violation generated magnetic fields. These anisotropic matter sources, taking one at a time, are studied for their co-evolution with standard model (isotropic) sources viz., dust-like (dark/normal) matter, and dark energy modelled as cosmological constant. We constrain the Hubble parameter, density fractions of anisotropic matter, cold dark matter (CDM), and dark energy ($\Lambda$) in a Bianchi-I universe with planar symmetry i.e., which has a global ellipsoidal geometry, and try to find signatures of a cosmic preferred axis if any. The latest compilation of Type Ia Supernova (SNIa) data from Pantheon+SH0ES collaboration is used in our analysis to obtain constraints on cosmological parameters and any preferred axis for our universe. In our analysis, we found mild evidence for a cosmic preferred axis. It is interesting to note that this preferred axis lies broadly in the vicinity of other prominent cosmic anisotropy axes reported in the literature from diverse data sets. Also we find some evidence for non-zero (negative) cosmic shear and eccentricity that characterize different expansion rates in different directions and deviation from an isotropic scale factor respectively. The energy density fractions of two of the sources considered are found to be non-zero at a $2\sigma$ confidence level. To be more conclusive, we require more SNIa host galaxy data for tighter constraints on distance and absolute magnitude calibration which are expected to be available from the future JWST observations and others.


title: Numerical stability of the symplectic $LL^T$ factorization

abstract: In this paper we give the detailed error analysis of two algorithms (denoted as $W_1$ and $W_2$) for computing the symplectic factorization of a symmetric positive definite and symplectic matrix $A \in \mathbb R^{2n \times 2n}$ in the form $A=LL^T$, where $L \in \mathbb R^{2n \times 2n}$ is a symplectic block lower triangular matrix. Algorithm $W_1$ is an implementation of the $HH^T$ factorization from [Dopico et al., 2009]. Algorithm $W_2$, proposed in [Bujok et al., 2023], uses both Cholesky and Reverse Cholesky decompositions of symmetric positive definite matrix blocks that appear during the factorization. We prove that Algorithm $W_2$ is numerically stable for a broader class of symmetric positive definite matrices $A \in \mathbb R^{2n \times 2n}$, producing the computed factors $\tilde L$ in floating-point arithmetic with machine precision $u$, such that $||A-\tilde L {\tilde L}^T||_2= {\cal O}(u ||A||_2)$. However, Algorithm $W_1$ is unstable in general for symmetric positive definite and symplectic matrix $A$. This was confirmed by numerical experiments in [Bujok et al., 2023]. In this paper we give corresponding bounds also for Algorithm $W_1$ that are weaker, since we show that the factorization error depends on the size of the inverse of the principal submatrix $A_{11}$. The tests performed in MATLAB illustrate that our error bounds for considered algorithms are reasonably sharp.


title: Deep Video Inpainting Guided by Audio-Visual Self-Supervision

abstract: Humans can easily imagine a scene from auditory information based on their prior knowledge of audio-visual events. In this paper, we mimic this innate human ability in deep learning models to improve the quality of video inpainting. To implement the prior knowledge, we first train the audio-visual network, which learns the correspondence between auditory and visual information. Then, the audio-visual network is employed as a guider that conveys the prior knowledge of audio-visual correspondence to the video inpainting network. This prior knowledge is transferred through our proposed two novel losses: audio-visual attention loss and audio-visual pseudo-class consistency loss. These two losses further improve the performance of the video inpainting by encouraging the inpainting result to have a high correspondence to its synchronized audio. Experimental results demonstrate that our proposed method can restore a wider domain of video scenes and is particularly effective when the sounding object in the scene is partially blinded.


title: Accelerating Vision Transformers Based on Heterogeneous Attention Patterns

abstract: Recently, Vision Transformers (ViTs) have attracted a lot of attention in the field of computer vision. Generally, the powerful representative capacity of ViTs mainly benefits from the self-attention mechanism, which has a high computation complexity. To accelerate ViTs, we propose an integrated compression pipeline based on observed heterogeneous attention patterns across layers. On one hand, different images share more similar attention patterns in early layers than later layers, indicating that the dynamic query-by-key self-attention matrix may be replaced with a static self-attention matrix in early layers. Then, we propose a dynamic-guided static self-attention (DGSSA) method where the matrix inherits self-attention information from the replaced dynamic self-attention to effectively improve the feature representation ability of ViTs. On the other hand, the attention maps have more low-rank patterns, which reflect token redundancy, in later layers than early layers. In a view of linear dimension reduction, we further propose a method of global aggregation pyramid (GLAD) to reduce the number of tokens in later layers of ViTs, such as Deit. Experimentally, the integrated compression pipeline of DGSSA and GLAD can accelerate up to 121% run-time throughput compared with DeiT, which surpasses all SOTA approaches.


title: Deep Backtracking Counterfactuals for Causally Compliant Explanations

abstract: Counterfactuals answer questions of what would have been observed under altered circumstances and can therefore offer valuable insights. Whereas the classical interventional interpretation of counterfactuals has been studied extensively, backtracking constitutes a less studied alternative where all causal laws are kept intact. In the present work, we introduce a practical method called deep backtracking counterfactuals (DeepBC) for computing backtracking counterfactuals in structural causal models that consist of deep generative components. We propose two distinct versions of our method--one utilizing Langevin Monte Carlo sampling and the other employing constrained optimization--to generate counterfactuals for high-dimensional data. As a special case, our formulation reduces to methods in the field of counterfactual explanations. Compared to these, our approach represents a causally compliant, versatile and modular alternative. We demonstrate these properties experimentally on a modified version of MNIST and CelebA.


title: Torelli theorem for the moduli stack of vector bundles with fixed determinant

abstract: Given any irreducible smooth complex projective curve X, of genus at least two, consider the moduli stack of vector bundles on X of fixed rank and determinant. It is proved that the isomorphism class of the stack uniquely determines the isomorphism class of the curve X and the rank of the vector bundles.


title: Global Minima, Recoverability Thresholds, and Higher-Order Structure in GNNS

abstract: We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case adversarial analysis, by connecting the performance of GNNs to typical-case properties of the training data. First, we theoretically characterize the nodewise accuracy of one- and two-layer GCNs relative to the contextual stochastic block model (cSBM) and related models. We additionally prove that GCNs cannot beat linear models under certain circumstances. Second, we numerically map the recoverability thresholds, in terms of accuracy, of four diverse GNN architectures (GCN, GAT, SAGE, and Graph Transformer) under a variety of assumptions about the data. Sample results of this second analysis include: heavy-tailed degree distributions enhance GNN performance, GNNs can work well on strongly heterophilous graphs, and SAGE and Graph Transformer can perform well on arbitrarily noisy edge data, but no architecture handled sufficiently noisy feature data well. Finally, we show how both specific higher-order structures in synthetic data and the mix of empirical structures in real data have dramatic effects (usually negative) on GNN performance.


title: GRaMuFeN: Graph-based Multi-modal Fake News Detection in Social Media

abstract: The proliferation of social media platforms such as Twitter, Instagram, and Weibo has significantly enhanced the dissemination of false information. This phenomenon grants both individuals and governmental entities the ability to shape public opinions, highlighting the need for deploying effective detection methods. In this paper, we propose GraMuFeN, a model designed to detect fake content by analyzing both the textual and image content of news. GraMuFeN comprises two primary components: a text encoder and an image encoder. For textual analysis, GraMuFeN treats each text as a graph and employs a Graph Convolutional Neural Network (GCN) as the text encoder. Additionally, the pre-trained ResNet-152, as a Convolutional Neural Network (CNN), has been utilized as the image encoder. By integrating the outputs from these two encoders and implementing a contrastive similarity loss function, GraMuFeN achieves remarkable results. Extensive evaluations conducted on two publicly available benchmark datasets for social media news indicate a 10 % increase in micro F1-Score, signifying improvement over existing state-of-the-art models. These findings underscore the effectiveness of combining GCN and CNN models for detecting fake news in multi-modal data, all while minimizing the additional computational burden imposed by model parameters.


title: HaarNet: Large-scale Linear-Morphological Hybrid Network for RGB-D Semantic Segmentation

abstract: Signals from different modalities each have their own combination algebra which affects their sampling processing. RGB is mostly linear; depth is a geometric signal following the operations of mathematical morphology. If a network obtaining RGB-D input has both kinds of operators available in its layers, it should be able to give effective output with fewer parameters. In this paper, morphological elements in conjunction with more familiar linear modules are used to construct a mixed linear-morphological network called HaarNet. This is the first large-scale linear-morphological hybrid, evaluated on a set of sizeable real-world datasets. In the network, morphological Haar sampling is applied to both feature channels in several layers, which splits extreme values and high-frequency information such that both can be processed to improve both modalities. Moreover, morphologically parameterised ReLU is used, and morphologically-sound up-sampling is applied to obtain a full-resolution output. Experiments show that HaarNet is competitive with a state-of-the-art CNN, implying that morphological networks are a promising research direction for geometry-based learning tasks.


title: On regularity for Griffith almost-minimizers in the plane

abstract: We present regularity results for the crack set of a minimizer for the Griffith fracture energy, arising in the variational modeling of brittle materials. In the planar setting, we prove an epsilon-regularity result showing that the crack is locally a $C^{1,1/2}$ curve outside of a singular set of zero Hausdorff measure. The main novelty is that, in contrast to previous results, no topological constraints on the crack are required. Afterwards, we show that the crack is uniformly rectifiable which in turn allows us to prove that the singular set has dimension strictly less than 1. The results also apply to almost-minimizers. As a byproduct, we prove higher integrability for the gradient of local minimizers of the Griffith energy, providing a positive answer to the analogue of De Giorgi's conjecture for the Mumford-Shah functional.


title: Discovery of Novel Reticular Materials for Carbon Dioxide Capture using GFlowNets

abstract: Artificial intelligence holds promise to improve materials discovery. GFlowNets are an emerging deep learning algorithm with many applications in AI-assisted discovery. By using GFlowNets, we generate porous reticular materials, such as metal organic frameworks and covalent organic frameworks, for applications in carbon dioxide capture. We introduce a new Python package (matgfn) to train and sample GFlowNets. We use matgfn to generate the matgfn-rm dataset of novel and diverse reticular materials with gravimetric surface area above 5000 m$^2$/g. We calculate single- and two-component gas adsorption isotherms for the top-100 candidates in matgfn-rm. These candidates are novel compared to the state-of-art ARC-MOF dataset and rank in the 90th percentile in terms of working capacity compared to the CoRE2019 dataset. We discover 15 materials outperforming all materials in CoRE2019.


title: Stabilizing Estimates of Shapley Values with Control Variates

abstract: Shapley values are among the most popular tools for explaining predictions of blackbox machine learning models. However, their high computational cost motivates the use of sampling approximations, inducing a considerable degree of uncertainty. To stabilize these model explanations, we propose ControlSHAP, an approach based on the Monte Carlo technique of control variates. Our methodology is applicable to any machine learning model and requires virtually no extra computation or modeling effort. On several high-dimensional datasets, we find it can produce dramatic reductions in the Monte Carlo variability of Shapley estimates.


title: Thermal rectification in mass-asymmetric one-dimensional anharmonic oscillator lattices with and without a ballistic spacer

abstract: In this work we perform a systematic analysis of various structural parameters that have influence on the thermal rectification effect, i.e. asymmetrical heat flow, and the negative differential thermal resistance -- reduction of the heat flux as the applied thermal bias is increased -- present in a one-dimensional, segmented mass-graded system consisting of a coupled nearest-neighbor harmonic oscillator lattice (ballistic spacer) and two diffusive leads (modeled by a substrate potential) attached to the lattice at both boundaries. At variance with previous works, we consider the size of the spacer as smaller than that of the leads. Also considered is the case where the leads are connected along the whole length of the oscillator lattice; that is, in the absence of the ballistic spacer. Upon variation of the system's parameters it was determined that the performance of the device, as quantified by the spectral properties, is largely enhanced in the absence of the ballistic spacer for the small system-size limit herein considered.


title: Accelerated gradient descent: A guaranteed bound for a heuristic restart strategy

abstract: The $O(1/k^2)$ convergence rate in function value of accelerated gradient descent is optimal, but there are many modifications that have been used to speed up convergence in practice. Among these modifications are restarts, that is, starting the algorithm with the current iteration being considered as the initial point. We focus on the adaptive restart techniques introduced by O'Donoghue and Cand\`es, specifically their gradient restart strategy. While the gradient restart strategy is a heuristic in general, we prove that applying gradient restarts preserves and in fact improves the $O(1/k^2)$ bound, hence establishing function value convergence, for one-dimensional functions. Applications of our results to separable and nearly separable functions are presented.


title: Super-twisting based sliding mode control of hydraulic actuator without velocity state

abstract: This paper provides a novel surface design and experimental evaluation of a super-twisting algorithm (STA) based control for hydraulic cylinder actuators. The proposed integral sliding surface allows to track a sufficiently smooth reference without using the velocity state which is hardly accessible in the noisy hydraulic systems. A design methodology based on LMI's is given, and the STA gains are designed to be adjusted by only one free parameter. The feasibility and effectiveness of the proposed control method are shown on a standard hydraulic test bench with one linear degree of freedom and passive load, where a typical motion profile is tracked with a bounded average error below 1 % from the total drive effective output.


title: Composite Backdoor Attacks Against Large Language Models

abstract: Large language models (LLMs) have demonstrated superior performance compared to previous methods on various tasks, and often serve as the foundation models for many researches and services. However, the untrustworthy third-party LLMs may covertly introduce vulnerabilities for downstream tasks. In this paper, we explore the vulnerability of LLMs through the lens of backdoor attacks. Different from existing backdoor attacks against LLMs, ours scatters multiple trigger keys in different prompt components. Such a Composite Backdoor Attack (CBA) is shown to be stealthier than implanting the same multiple trigger keys in only a single component. CBA ensures that the backdoor is activated only when all trigger keys appear. Our experiments demonstrate that CBA is effective in both natural language processing (NLP) and multimodal tasks. For instance, with $3\%$ poisoning samples against the LLaMA-7B model on the Emotion dataset, our attack achieves a $100\%$ Attack Success Rate (ASR) with a False Triggered Rate (FTR) below $2.06\%$ and negligible model accuracy degradation. Our work highlights the necessity of increased security research on the trustworthiness of foundation LLMs.


title: Exact variable selection in sparse nonparametric models

abstract: We study the problem of adaptive variable selection in a Gaussian white noise model of intensity $\varepsilon$ under certain sparsity and regularity conditions on an unknown regression function $f$. The $d$-variate regression function $f$ is assumed to be a sum of functions each depending on a smaller number $k$ of variables ($1 \leq k \leq d$). These functions are unknown to us and only few of them are nonzero. We assume that $d=d_\varepsilon \to \infty$ as $\varepsilon \to 0$ and consider the cases when $k$ is fixed and when $k=k_\varepsilon \to \infty$, $k=o(d)$ as $\varepsilon \to 0$. In this work, we introduce an adaptive selection procedure that, under some model assumptions, identifies exactly all nonzero $k$-variate components of $f$. In addition, we establish conditions under which exact identification of the nonzero components is impossible. These conditions ensure that the proposed selection procedure is the best possible in the asymptotically minimax sense with respect to the Hamming risk.


title: Explainable Image Similarity: Integrating Siamese Networks and Grad-CAM

abstract: With the proliferation of image-based applications in various domains, the need for accurate and interpretable image similarity measures has become increasingly critical. Existing image similarity models often lack transparency, making it challenging to understand the reasons why two images are considered similar. In this paper, we propose the concept of explainable image similarity, where the goal is the development of an approach, which is capable of providing similarity scores along with visual factual and counterfactual explanations. Along this line, we present a new framework, which integrates Siamese Networks and Grad-CAM for providing explainable image similarity and discuss the potential benefits and challenges of adopting this approach. In addition, we provide a comprehensive discussion about factual and counterfactual explanations provided by the proposed framework for assisting decision making. The proposed approach has the potential to enhance the interpretability, trustworthiness and user acceptance of image-based systems in real-world image similarity applications. The implementation code can be found in https://github.com/ioannislivieris/Grad_CAM_Siamese.git.


title: Biased dynamics of the miscible-immiscible quantum phase transition in a binary Bose-Einstein condensate

abstract: A quantum phase transition from the miscible to the immiscible phase of a quasi-one-dimensional binary Bose-Einstein condensate is driven by ramping down the coupling amplitude of its two hyperfine states. It results in a random pattern of spatial domains where the symmetry is broken separated by defects. In distinction to previous studies [J. Sabbatini et al., Phys. Rev. Lett. 107, 230402 (2011), New J. Phys. 14 095030 (2012)], we include nonzero detuning between the light field and the energy difference of the states, which provides a bias towards one of the states. Using the truncated Wigner method, we test the biased version of the quantum Kibble-Zurek mechanism [M. Rams et al., Phys. Rev. Lett. 123, 130603 (2019)] and observe a crossover to the adiabatic regime when the quench is sufficiently fast to dominate the effect of the bias. We verify a universal power law for the population imbalance in the nonadiabatic regime both at the critical point and by the end of the ramp. Shrinking and annihilation of domains of the unfavourable phase after the ramp, that is, already in the broken symmetry phase, enlarges the defect-free sections by the end of the ramp. The consequences of this phase-ordering effect can be captured by a phenomenological power law.


title: Hamiltonian Dynamics of Bayesian Inference Formalised by Arc Hamiltonian Systems

abstract: This paper advances theoretical understanding of infinite-dimensional geometrical properties associated with Bayesian inference. First, we introduce a novel class of infinite-dimensional Hamiltonian systems for saddle Hamiltonian functions whose domains are metric spaces. A flow of this system is generated by a Hamiltonian arc field, an analogue of Hamiltonian vector fields formulated based on (i) the first variation of Hamiltonian functions and (ii) the notion of arc fields that extends vector fields to metric spaces. We establish that this system obeys the conservation of energy. We derive a condition for the existence of the flow, which reduces to local Lipschitz continuity of the first variation under sufficient regularity. Second, we present a system of a Hamiltonian function, called the minimum free energy, whose domain is a metric space of negative log-likelihoods and probability measures. The difference of the posterior and the prior of Bayesian inference is characterised as the first variation of the minimum free energy. Our result shows that a transition from the prior to the posterior defines an arc field on a space of probability measures, which forms a Hamiltonian arc field together with another corresponding arc field on a space of negative log-likelihoods. This reveals the underlying invariance of the free energy behind the arc field.


title: Murmurations

abstract: We establish a case of the surprising correlation phenomenon observed in the recent works of He, Lee, Oliver, Pozdnyakov, and Sutherland between Fourier coefficients of families of modular forms and their root numbers.


title: Prediction of MET Overexpression in Non-Small Cell Lung Adenocarcinomas from Hematoxylin and Eosin Images

abstract: MET protein overexpression is a targetable event in non-small cell lung cancer (NSCLC) and is the subject of active drug development. Challenges in identifying patients for these therapies include lack of access to validated testing, such as standardized immunohistochemistry (IHC) assessment, and consumption of valuable tissue for a single gene/protein assay. Development of pre-screening algorithms using routinely available digitized hematoxylin and eosin (H&E)-stained slides to predict MET overexpression could promote testing for those who will benefit most. While assessment of MET expression using IHC is currently not routinely performed in NSCLC, next-generation sequencing is common and in some cases includes RNA expression panel testing. In this work, we leveraged a large database of matched H&E slides and RNA expression data to train a weakly supervised model to predict MET RNA overexpression directly from H&E images. This model was evaluated on an independent holdout test set of 300 over-expressed and 289 normal patients, demonstrating an ROC-AUC of 0.70 (95th percentile interval: 0.66 - 0.74) with stable performance characteristics across different patient clinical variables and robust to synthetic noise on the test set. These results suggest that H&E-based predictive models could be useful to prioritize patients for confirmatory testing of MET protein or MET gene expression status.


title: Controllable Data Generation Via Iterative Data-Property Mutual Mappings

abstract: Deep generative models have been widely used for their ability to generate realistic data samples in various areas, such as images, molecules, text, and speech. One major goal of data generation is controllability, namely to generate new data with desired properties. Despite growing interest in the area of controllable generation, significant challenges still remain, including 1) disentangling desired properties with unrelated latent variables, 2) out-of-distribution property control, and 3) objective optimization for out-of-distribution property control. To address these challenges, in this paper, we propose a general framework to enhance VAE-based data generators with property controllability and ensure disentanglement. Our proposed objective can be optimized on both data seen and unseen in the training set. We propose a training procedure to train the objective in a semi-supervised manner by iteratively conducting mutual mappings between the data and properties. The proposed framework is implemented on four VAE-based controllable generators to evaluate its performance on property error, disentanglement, generation quality, and training time. The results indicate that our proposed framework enables more precise control over the properties of generated samples in a short training time, ensuring the disentanglement and keeping the validity of the generated samples.