title: On the Generalization Capability of Temporal Graph Learning Algorithms: Theoretical Insights and a Simpler Method

abstract: Temporal Graph Learning (TGL) has become a prevalent technique across diverse real-world applications, especially in domains where data can be represented as a graph and evolves over time. Although TGL has recently seen notable progress in algorithmic solutions, its theoretical foundations remain largely unexplored. This paper aims at bridging this gap by investigating the generalization ability of different TGL algorithms (e.g., GNN-based, RNN-based, and memory-based methods) under the finite-wide over-parameterized regime. We establish the connection between the generalization error of TGL algorithms and "the number of layers/steps" in the GNN-/RNN-based TGL methods and "the feature-label alignment (FLA) score", where FLA can be used as a proxy for the expressive power and explains the performance of memory-based methods. Guided by our theoretical analysis, we propose Simplified-Temporal-Graph-Network, which enjoys a small generalization error, improved overall performance, and lower model complexity. Extensive experiments on real-world datasets demonstrate the effectiveness of our method. Our theoretical findings and proposed algorithm offer essential insights into TGL from a theoretical standpoint, laying the groundwork for the designing practical TGL algorithms in future studies.


title: Uncertainty Quantification in Anomaly Detection with Cross-Conformal $p$-Values

abstract: Given the growing significance of reliable, trustworthy, and explainable machine learning, the requirement of uncertainty quantification for anomaly detection systems has become increasingly important. In this context, effectively controlling Type I error rates ($\alpha$) without compromising the statistical power ($1-\beta$) of these systems can build trust and reduce costs related to false discoveries, particularly when follow-up procedures are expensive. Leveraging the principles of conformal prediction emerges as a promising approach for providing respective statistical guarantees by calibrating a model's uncertainty. This work introduces a novel framework for anomaly detection, termed cross-conformal anomaly detection, building upon well-known cross-conformal methods designed for prediction tasks. With that, it addresses a natural research gap by extending previous works in the context of inductive conformal anomaly detection, relying on the split-conformal approach for model calibration. Drawing on insights from conformal prediction, we demonstrate that the derived methods for calculating cross-conformal $p$-values strike a practical compromise between statistical efficiency (full-conformal) and computational efficiency (split-conformal) for uncertainty-quantified anomaly detection on benchmark datasets.


title: MoZIP: A Multilingual Benchmark to Evaluate Large Language Models in Intellectual Property

abstract: Large language models (LLMs) have demonstrated impressive performance in various natural language processing (NLP) tasks. However, there is limited understanding of how well LLMs perform in specific domains (e.g, the intellectual property (IP) domain). In this paper, we contribute a new benchmark, the first Multilingual-oriented quiZ on Intellectual Property (MoZIP), for the evaluation of LLMs in the IP domain. The MoZIP benchmark includes three challenging tasks: IP multiple-choice quiz (IPQuiz), IP question answering (IPQA), and patent matching (PatentMatch). In addition, we also develop a new IP-oriented multilingual large language model (called MoZi), which is a BLOOMZ-based model that has been supervised fine-tuned with multilingual IP-related text data. We evaluate our proposed MoZi model and four well-known LLMs (i.e., BLOOMZ, BELLE, ChatGLM and ChatGPT) on the MoZIP benchmark. Experimental results demonstrate that MoZi outperforms BLOOMZ, BELLE and ChatGLM by a noticeable margin, while it had lower scores compared with ChatGPT. Notably, the performance of current LLMs on the MoZIP benchmark has much room for improvement, and even the most powerful ChatGPT does not reach the passing level. Our source code, data, and models are available at \url{https://github.com/AI-for-Science/MoZi}.


title: Information Theory Unification of Epidemiological and Population Dynamics

abstract: We reformulate models in epidemiology and population dynamics in terms of probability distributions. This allows us to construct the Fisher information, which we interpret as the metric of a one-dimensional differentiable manifold. For systems that can be effectively described by a single degree of freedom, we show that their time evolution is fully captured by this metric. In this way, we discover universal features across seemingly very different models. This further motivates a reorganisation of the dynamics around zeroes of the Fisher metric, corresponding to extrema of the probability distribution. Concretely, we propose a simple form of the metric for which we can analytically solve the dynamics of the system that well approximates the time evolution of various established models in epidemiology and population dynamics, thus providing a unifying framework.


title: Quality Assurance for Artificial Intelligence: A Study of Industrial Concerns, Challenges and Best Practices

abstract: Quality Assurance (QA) aims to prevent mistakes and defects in manufactured products and avoid problems when delivering products or services to customers. QA for AI systems, however, poses particular challenges, given their data-driven and non-deterministic nature as well as more complex architectures and algorithms. While there is growing empirical evidence about practices of machine learning in industrial contexts, little is known about the challenges and best practices of quality assurance for AI systems (QA4AI). In this paper, we report on a mixed-method study of QA4AI in industry practice from various countries and companies. Through interviews with fifteen industry practitioners and a validation survey with 50 practitioner responses, we studied the concerns as well as challenges and best practices in ensuring the QA4AI properties reported in the literature, such as correctness, fairness, interpretability and others. Our findings suggest correctness as the most important property, followed by model relevance, efficiency and deployability. In contrast, transferability (applying knowledge learned in one task to another task), security and fairness are not paid much attention by practitioners compared to other properties. Challenges and solutions are identified for each QA4AI property. For example, interviewees highlighted the trade-off challenge among latency, cost and accuracy for efficiency (latency and cost are parts of efficiency concern). Solutions like model compression are proposed. We identified 21 QA4AI practices across each stage of AI development, with 10 practices being well recognized and another 8 practices being marginally agreed by the survey practitioners.


title: Placing Objects in Context via Inpainting for Out-of-distribution Segmentation

abstract: When deploying a semantic segmentation model into the real world, it will inevitably be confronted with semantic classes unseen during training. Thus, to safely deploy such systems, it is crucial to accurately evaluate and improve their anomaly segmentation capabilities. However, acquiring and labelling semantic segmentation data is expensive and unanticipated conditions are long-tail and potentially hazardous. Indeed, existing anomaly segmentation datasets capture a limited number of anomalies, lack realism or have strong domain shifts. In this paper, we propose the Placing Objects in Context (POC) pipeline to realistically add any object into any image via diffusion models. POC can be used to easily extend any dataset with an arbitrary number of objects. In our experiments, we present different anomaly segmentation datasets based on POC-generated data and show that POC can improve the performance of recent state-of-the-art anomaly fine-tuning methods in several standardized benchmarks. POC is also effective to learn new classes. For example, we use it to edit Cityscapes samples by adding a subset of Pascal classes and show that models trained on such data achieve comparable performance to the Pascal-trained baseline. This corroborates the low sim-to-real gap of models trained on POC-generated images.


title: Communication Optimal Unbalanced Private Set Union

abstract: We consider the private set union (PSU) problem, where two parties each hold a private set of elements, and they want one of the parties (the receiver) to learn the union of the two sets and nothing else. Our protocols are targeted for the unbalanced case where the receiver's set size is larger than the sender's set size, with the goal of minimizing the costs for the sender both in terms of communication volume and local computation time. This setting is motivated by applications where the receiver has significantly more data (input set size) and computational resources than the sender which might be realized on a small, low-power device. Asymptotically, we achieve communication cost linear in the sender's (smaller) set size, and computation costs for sender and receiver which are nearly-linear in their respective set sizes. To our knowledge, ours is the first algorithm to achieve nearly-linear communication and computation for PSU in this unbalanced setting. Our protocols utilize fully homomorphic encryption (FHE) and, optionally, linearly homomorphic encryption (LHE) to perform the necessary computations while preserving privacy. The underlying computations are based on univariate polynomial arithmetic realized within homomorphic encryption, namely fast multiplication, modular reduction, and multi-point evaluation. These asymptotically fast HE polynomial arithmetic algorithms may be of independent interest.


title: Audio-Visual Speech Enhancement in Noisy Environments via Emotion-Based Contextual Cues

abstract: In real-world environments, background noise significantly degrades the intelligibility and clarity of human speech. Audio-visual speech enhancement (AVSE) attempts to restore speech quality, but existing methods often fall short, particularly in dynamic noise conditions. This study investigates the inclusion of emotion as a novel contextual cue within AVSE, hypothesizing that incorporating emotional understanding can improve speech enhancement performance. We propose a novel emotion-aware AVSE system that leverages both auditory and visual information. It extracts emotional features from the facial landmarks of the speaker and fuses them with corresponding audio and visual modalities. This enriched data serves as input to a deep UNet-based encoder-decoder network, specifically designed to orchestrate the fusion of multimodal information enhanced with emotion. The network iteratively refines the enhanced speech representation through an encoder-decoder architecture, guided by perceptually-inspired loss functions for joint learning and optimization. We train and evaluate the model on the CMU Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI) dataset, a rich repository of audio-visual recordings with annotated emotions. Our comprehensive evaluation demonstrates the effectiveness of emotion as a contextual cue for AVSE. By integrating emotional features, the proposed system achieves significant improvements in both objective and subjective assessments of speech quality and intelligibility, especially in challenging noise environments. Compared to baseline AVSE and audio-only speech enhancement systems, our approach exhibits a noticeable increase in PESQ and STOI, indicating higher perceptual quality and intelligibility. Large-scale listening tests corroborate these findings, suggesting improved human understanding of enhanced speech.


title: Quantum Decoherence effects on precision measurements at DUNE and T2HK

abstract: We investigate the potential impact of neutrino quantum decoherence on the precision measurements of standard neutrino oscillation parameters in the DUNE and T2HK experiments. We show that the measurement of $\delta_\text{CP}$, $\sin^2\theta_{13}$ and $\sin^2\theta_{23}$ is stronger effected in DUNE than in T2HK. On the other hand, DUNE would have a better sensitivity than T2HK to observe decoherence effects. By performing a combined analysis of DUNE and T2HK we show that a robust measurement of standard parameters would be possible, which is not guaranteed with DUNE data alone.


title: Recurrence and transience of step-reinforced random walks

abstract: We solve a conjecture raised by Bertoin (personal communication) on the step-reinforced random walk, a non-Markovian process generalizing the elephant random walk. We show that, under a 2+$\delta$-th moment condition, it undergoes a phase transition in dimensions $d=1,2$ between recurrence and transience, and that it is transient for all parameters in dimension $d\geq 3$.


title: Investigating Deep Watermark Security: An Adversarial Transferability Perspective

abstract: The rise of generative neural networks has triggered an increased demand for intellectual property (IP) protection in generated content. Deep watermarking techniques, recognized for their flexibility in IP protection, have garnered significant attention. However, the surge in adversarial transferable attacks poses unprecedented challenges to the security of deep watermarking techniques-an area currently lacking systematic investigation. This study fills this gap by introducing two effective transferable attackers to assess the vulnerability of deep watermarks against erasure and tampering risks. Specifically, we initially define the concept of local sample density, utilizing it to deduce theorems on the consistency of model outputs. Upon discovering that perturbing samples towards high sample density regions (HSDR) of the target class enhances targeted adversarial transferability, we propose the Easy Sample Selection (ESS) mechanism and the Easy Sample Matching Attack (ESMA) method. Additionally, we propose the Bottleneck Enhanced Mixup (BEM) that integrates information bottleneck theory to reduce the generator's dependence on irrelevant noise. Experiments show a significant enhancement in the success rate of targeted transfer attacks for both ESMA and BEM-ESMA methods. We further conduct a comprehensive evaluation using ESMA and BEM-ESMA as measurements, considering model architecture and watermark encoding length, and achieve some impressive findings.


title: Efficient Continuous-Time Ego-Motion Estimation for Asynchronous Event-based Data Associations

abstract: Event cameras are bio-inspired vision sensors that asynchronously measure per-pixel brightness changes. The high temporal resolution and asynchronicity of event cameras offer great potential for estimating the robot motion state. Recent works have adopted the continuous-time ego-motion estimation methods to exploit the inherent nature of event cameras. However, most of the adopted methods have poor real-time performance. To alleviate it, a lightweight Gaussian Process (GP)-based estimation framework is proposed to efficiently estimate motion trajectory from asynchronous event-driven data associations. Concretely, an asynchronous front-end pipeline is designed to adapt event-driven feature trackers and generate feature trajectories from event streams; a parallel dynamic sliding-window back-end is presented within the framework of sparse GP regression on SE(3). Notably, a specially designed state marginalization strategy is employed to ensure the consistency and sparsity of this GP regression. Experiments conducted on synthetic and real-world datasets demonstrate that the proposed method achieves competitive precision and superior robustness compared to the state-of-the-art. Furthermore, the evaluations on three 60 s trajectories show that the proposal outperforms the ISAM2-based method in terms of computational efficiency by 2.64, 4.22, and 11.70 times, respectively.


title: Analysis of Embeddings Learned by End-to-End Machine Learning Eye Movement-driven Biometrics Pipeline

abstract: This paper expands on the foundational concept of temporal persistence in biometric systems, specifically focusing on the domain of eye movement biometrics facilitated by machine learning. Unlike previous studies that primarily focused on developing biometric authentication systems, our research delves into the embeddings learned by these systems, particularly examining their temporal persistence, reliability, and biometric efficacy in response to varying input data. Utilizing two publicly available eye-movement datasets, we employed the state-of-the-art Eye Know You Too machine learning pipeline for our analysis. We aim to validate whether the machine learning-derived embeddings in eye movement biometrics mirror the temporal persistence observed in traditional biometrics. Our methodology involved conducting extensive experiments to assess how different lengths and qualities of input data influence the performance of eye movement biometrics more specifically how it impacts the learned embeddings. We also explored the reliability and consistency of the embeddings under varying data conditions. Three key metrics (kendall's coefficient of concordance, intercorrelations, and equal error rate) were employed to quantitatively evaluate our findings. The results reveal while data length significantly impacts the stability of the learned embeddings, however, the intercorrelations among embeddings show minimal effect.


title: Quantitative Propagation of Chaos for Mean Field Interacting Particle System

abstract: In this paper, quantitative propagation of chaos in $L^\eta$($\eta\in(0,1)$)-Wasserstein distance for mean field interacting particle system is derived, where the diffusion coefficient is allowed to be interacting and the initial distribution of interacting particle system converges to that of the limit equation in $L^1$-Wasserstein distance. The non-degenerate and degenerate cases are investigated respectively and the main tool relies on the gradient estimate of the decoupled SDEs.


title: A Stationary Equilibrium Model of Green Technology Adoption with Endogenous Carbon Price

abstract: This paper proposes and analyzes a stationary equilibrium model for a competitive industry which endogenously determines the carbon price necessary to achieve a given emission target. In the model, firms are identified by their level of technology and make production, entry, and abatement decisions. Polluting firms are subject to a carbon price and abatement is formulated as an irreversible investment, which entails a sunk cost and results in the firms switching to a carbon neutral technology. In equilibrium, we identify a carbon price and a stationary distribution of incumbent, polluting firms, that guarantee the compliance with a certain emission target. Our general theoretical framework is complemented with a case study with Brownian technology shocks, in which we discuss some implications of our model. We observe that a carbon pricing system alongside installation subsidies and tax benefits for green firms trigger earlier investment, while higher income taxes for polluting firms may be distorting. Moreover, we discuss the role of a welfare maximizing regulator, who, by optimally setting the emission target, may mitigate or revert some parameters' effects observed in the model with fixed limit.


title: Graph Learning with Distributional Edge Layouts

abstract: Graph Neural Networks (GNNs) learn from graph-structured data by passing local messages between neighboring nodes along edges on certain topological layouts. Typically, these topological layouts in modern GNNs are deterministically computed (e.g., attention-based GNNs) or locally sampled (e.g., GraphSage) under heuristic assumptions. In this paper, we for the first time pose that these layouts can be globally sampled via Langevin dynamics following Boltzmann distribution equipped with explicit physical energy, leading to higher feasibility in the physical world. We argue that such a collection of sampled/optimized layouts can capture the wide energy distribution and bring extra expressivity on top of WL-test, therefore easing downstream tasks. As such, we propose Distributional Edge Layouts (DELs) to serve as a complement to a variety of GNNs. DEL is a pre-processing strategy independent of subsequent GNN variants, thus being highly flexible. Experimental results demonstrate that DELs consistently and substantially improve a series of GNN baselines, achieving state-of-the-art performance on multiple datasets.


title: Entropy production for diffusion processes across a semipermeable interface

abstract: The emerging field of stochastic thermodynamics extends classical ideas of entropy, heat and work to non-equilibrium systems. One notable finding is that the second law of thermodynamics typically only holds after taking appropriate averages with respect to an ensemble of stochastic trajectories. The resulting average rate of entropy production then quantifies the degree of departure from thermodynamic equilibrium. In this paper we investigate how the presence of a semipermeable interface increases the average entropy production of a single diffusing particle. Starting from the Gibbs-Shannon entropy for the particle probability density, we show that a semipermeable interface or membrane $\calS$ increases the average rate of entropy production by an amount that is equal to the product of the flux through the interface and the logarithm of the ratio of the probability density on either side of the interface, integrated along $\calS$. The entropy production rate thus vanishes at thermodynamic equilibrium, but can be nonzero during the relaxation to equilibrium, or if there exists a nonzero stationary equilibrium state (NESS). We illustrate the latter using the example of diffusion with stochastic resetting on a circle, and show that the average rate of interfacial entropy production is a nonmonotonic function of the resetting rate and the permeability. Finally, we give a probabilistic interpretation of the interfacial entropy production rate using so-called snapping out Brownian motion. This also allows us to construct a stochastic version of entropy production.


title: Exploring spatial dispersion in helical wired media: An effective field theory approach

abstract: The propagation of electromagnetic waves in helical media with spatial dispersion is investigated. The general form of the permittivity tensor with spatial dispersion obeying the helical symmetry is derived. Its particular form describing the medium made of conducting spiral wires with pitch $2\pi/|q|$ is studied in detail. The solution of the corresponding Maxwell equations is obtained in the paraxial limit. The dispersion law of the electromagnetic field modes, their polarization, and the integral curves of the Poynting vector are analyzed. The dispersion law of photons in such a medium possesses polarization dependent forbidden bands. The widths of these gaps and their positions are tunable in a wide range of energies. If the helix angle $\alpha$ is not close to $\pi/2$ and the plasma frequency $\omega_p\ll|q|$, then there are two chiral forbidden bands. The energies of one chiral forbidden band are near the plasma frequency $\omega_p$ and the width of this gap is of order $|q|$. The other chiral forbidden band is narrow and is located near the photon energy $|q|$. In the case $\alpha\approx\pi/2$, the first chiral forbidden band becomes a total forbidden band. If, additionally, the plasma frequency $\omega_p\gg|q|$, then the second forbidden band turns into a wide polarization dependent forbidden band. For the energies belonging to this interval the photons with only one linear polarization are transmitted through the medium and the polarization plane of transmitted photons is rotated. In the nonparaxial regime, the solution of the Maxwell equations is obtained in the shortwave approximation. The dispersion law of the electromagnetic field modes, their polarization, and the integral curves of the Poynting vector are found. Scattering of the electromagnetic waves by a slab made of the helical wired medium is considered.


title: Performance of Double-Stacked Intelligent Metasurface-Assisted Multiuser Massive MIMO Communications in the Wave Domain

abstract: Although reconfigurable intelligent surface (RIS) is a promising technology for shaping the propagation environment, it consists of a single-layer structure within inherent limitations regarding the number of beam steering patterns. Based on the recently revolutionary technology, denoted as stacked intelligent metasurface (SIM), we propose its implementation not only on the base station (BS) side in a massive multiple-input multiple-output (mMIMO) setup but also in the intermediate space between the base station and the users to adjust the environment further as needed. For the sake of convenience, we call the former BS SIM (BSIM), and the latter channel SIM (CSIM). Hence, we achieve wave-based combining at the BS and wave-based configuration at the intermediate space. Specifically, we propose a channel estimation method with reduced overhead, being crucial for SIMassisted communications. Next, we derive the uplink sum spectral efficiency (SE) in closed form in terms of statistical channel state information (CSI). Notably, we optimize the phase shifts of both BSIM and CSIM simultaneously by using the projected gradient ascent method (PGAM). Compared to previous works on SIMs, we study the uplink transmission, a mMIMO setup, channel estimation in a single phase, a second SIM at the intermediate space, and simultaneous optimization of the two SIMs. Simulation results show the impact of various parameters on the sum SE, and demonstrate the superiority of our optimization approach compared to the alternating optimization (AO) method.


title: From RAGs to riches: Using large language models to write documents for clinical trials

abstract: Clinical trials require numerous documents to be written -- protocols, consent forms, clinical study reports and others. Large language models (LLMs) offer the potential to rapidly generate first versions of these documents, however there are concerns about the quality of their output Here we report an evaluation of LLMs in generating parts of one such document, clinical trial protocols. We find that an offthe-shelf LLM delivers reasonable results, especially when assessing content relevance and the correct use of terminology. However, deficiencies remain: specifically clinical thinking and logic, and appropriate use of references. To improve performance, we used retrieval-augmented generation (RAG) to prompt an LLM with accurate up-to-date information. As a result of using RAG, the writing quality of the LLM improves substantially, which has implications for the practical useability of LLMs in clinical trial-related writing.


title: CMC: Few-shot Novel View Synthesis via Cross-view Multiplane Consistency

abstract: Neural Radiance Field (NeRF) has shown impressive results in novel view synthesis, particularly in Virtual Reality (VR) and Augmented Reality (AR), thanks to its ability to represent scenes continuously. However, when just a few input view images are available, NeRF tends to overfit the given views and thus make the estimated depths of pixels share almost the same value. Unlike previous methods that conduct regularization by introducing complex priors or additional supervisions, we propose a simple yet effective method that explicitly builds depth-aware consistency across input views to tackle this challenge. Our key insight is that by forcing the same spatial points to be sampled repeatedly in different input views, we are able to strengthen the interactions between views and therefore alleviate the overfitting problem. To achieve this, we build the neural networks on layered representations (\textit{i.e.}, multiplane images), and the sampling point can thus be resampled on multiple discrete planes. Furthermore, to regularize the unseen target views, we constrain the rendered colors and depths from different input views to be the same. Although simple, extensive experiments demonstrate that our proposed method can achieve better synthesis quality over state-of-the-art methods.


title: Stable Training of Normalizing Flows for High-dimensional Variational Inference

abstract: Variational inference with normalizing flows (NFs) is an increasingly popular alternative to MCMC methods. In particular, NFs based on coupling layers (Real NVPs) are frequently used due to their good empirical performance. In theory, increasing the depth of normalizing flows should lead to more accurate posterior approximations. However, in practice, training deep normalizing flows for approximating high-dimensional posterior distributions is often infeasible due to the high variance of the stochastic gradients. In this work, we show that previous methods for stabilizing the variance of stochastic gradient descent can be insufficient to achieve stable training of Real NVPs. As the source of the problem, we identify that, during training, samples often exhibit unusual high values. As a remedy, we propose a combination of two methods: (1) soft-thresholding of the scale in Real NVPs, and (2) a bijective soft log transformation of the samples. We evaluate these and other previously proposed modification on several challenging target distributions, including a high-dimensional horseshoe logistic regression model. Our experiments show that with our modifications, stable training of Real NVPs for posteriors with several thousand dimensions is possible, allowing for more accurate marginal likelihood estimation via importance sampling. Moreover, we evaluate several common training techniques and architecture choices and provide practical advise for training NFs for high-dimensional variational inference.


title: Renormalisation Group Methods for Effective Epidemiological Models

abstract: Epidemiological models describe the spread of an infectious disease within a population. They capture microscopic details on how the disease is passed on among individuals in various different ways, while making predictions about the state of the entirety of the population. However, the type and structure of the specific model considered typically depend on the size of the population under consideration. To analyse this effect, we study a family of effective epidemiological models in space and time that are related to each other through scaling transformations. Inspired by a similar treatment of diffusion processes, we interpret the latter as renormalisation group transformations, both at the level of the underlying differential equations and their solutions. We show that in the large scale limit, the microscopic details of the infection process become irrelevant, safe for a simple real number, which plays the role of the infection rate in a basic compartmental model.


title: First principles construction of symmetry-informed quantum metrologies

abstract: Combining quantum and Bayesian principles leads to optimality in metrology, but the optimisation equations involved are often hard to solve. This work mitigates this problem with a novel class of measurement strategies for quantities isomorphic to location parameters, which are shown to admit a closed-form optimisation. The resulting framework admits any parameter range, prior information, or state, and the associated estimators apply to finite samples. As an example, the metrology of relative weights is formulated from first principles and shown to require hyperbolic errors. The primary advantage of this approach lies in its simplifying power: it reduces the search for good strategies to identifying which symmetry leaves a state of maximum ignorance invariant. This will facilitate the application of quantum metrology to fundamental physics, where symmetries play a key role.

categories: quant-ph math-ph math.MP physics.data-an


title: Direct excitation of Kelvin waves on quantized vortices

abstract: Helices and spirals, prevalent across various systems, play a crucial role in characterizing symmetry, describing dynamics, and imparting unique functionalities, attributed to their inherent simplicity and chiral nature. A helical excitation on a quantized vortex, an example of a one-dimensional topological defect, emerges as a Nambu-Goldstone mode following spontaneous symmetry breaking, known as a Kelvin wave. Kelvin waves play a vital role in energy dissipation within inviscid quantum fluids. However, deliberately exciting Kelvin waves has proven to be challenging. Here, we introduce a controlled method for exciting Kelvin waves on a quantized vortex in superfluid helium-4. We used a charged nanoparticle, oscillated by a time-varying electric field, to stimulate Kelvin waves on the vortex. A major breakthrough in our research is the confirmation of the helical nature of Kelvin waves through three-dimensional image reconstruction, providing visual evidence of their complex dynamics. Additionally, we determined the dispersion relation and the phase velocity of the Kelvin wave and identified the vorticity direction, enhancing our understanding of quantum fluid behavior. This work elucidates the dynamics of Kelvin waves and pioneers a novel approach for manipulating and observing quantized vortices in three dimensions, thereby opening new avenues for exploring quantum fluidic systems.


title: TOTEM: TOkenized Time Series EMbeddings for General Time Series Analysis

abstract: The field of general time series analysis has recently begun to explore unified modeling, where a common architectural backbone can be retrained on a specific task for a specific dataset. In this work, we approach unification from a complementary vantage point: unification across tasks and domains. To this end, we explore the impact of discrete, learnt, time series data representations that enable generalist, cross-domain training. Our method, TOTEM, or TOkenized Time Series EMbeddings, proposes a simple tokenizer architecture that embeds time series data from varying domains using a discrete vectorized representation learned in a self-supervised manner. TOTEM works across multiple tasks and domains with minimal to no tuning. We study the efficacy of TOTEM with an extensive evaluation on 17 real world time series datasets across 3 tasks. We evaluate both the specialist (i.e., training a model on each domain) and generalist (i.e., training a single model on many domains) settings, and show that TOTEM matches or outperforms previous best methods on several popular benchmarks. The code can be found at: https://github.com/SaberaTalukder/TOTEM.


title: AI-enabled STAR-RIS aided MISO ISAC Secure Communications

abstract: A simultaneous transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) aided integrated sensing and communication (ISAC) dual-secure communication system is studied in this paper. The sensed target and legitimate users (LUs) are situated on the opposite sides of the STAR-RIS, and the energy splitting and time switching protocols are applied in the STAR-RIS, respectively. The long-term average security rate for LUs is maximized by the joint design of the base station (BS) transmit beamforming and receive filter, along with the STAR-RIS transmitting and reflecting coefficients, under guarantying the echo signal-to-noise ratio thresholds and rate constraints for the LUs. Since the channel information changes over time, conventional convex optimization techniques cannot provide the optimal performance for the system, and result in excessively high computational complexity in the exploration of the long-term gains for the system. Taking continuity control decisions into account, the deep deterministic policy gradient and soft actor-critic algorithms based on off-policy are applied to address the complex non-convex problem. Simulation results comprehensively evaluate the performance of the proposed two reinforcement learning algorithms and demonstrate that STAR-RIS is remarkably better than the two benchmarks in the ISAC system.


title: Cumulant Green's function methods for molecules

abstract: The cumulant expansion of the Green's function is a computationally efficient beyond-$GW$ approach renowned for its significant enhancement of satellite features in materials. In contrast to the ubiquitous $GW$ approximation of many-body perturbation theory, \textit{ab initio} cumulant expansions performed on top of $GW$ ($GW$+C) have demonstrated the capability to handle multi-particle processes by incorporating higher-order correlation effects or vertex corrections, yielding better agreements between experiment and theory for satellite structures. While widely employed in condensed matter physics, very few applications of $GW$+C have been published on molecular systems. Here, we assess the performance of this scheme on a series of 10-electron molecular systems (\ce{Ne}, \ce{HF}, \ce{H2O}, \ce{NH3}, and \ce{CH4}) where full configuration interaction estimates of the outer-valence quasiparticle and satellite energies are available.

categories: physics.chem-ph cond-mat.mtrl-sci cond-mat.str-el nucl-th


title: Achievable Rate Optimization for Stacked Intelligent Metasurface-Assisted Holographic MIMO Communications

abstract: Stacked intelligent metasurfaces (SIM) is a revolutionary technology, which can outperform its single-layer counterparts by performing advanced signal processing relying on wave propagation. In this work, we exploit SIM to enable transmit precoding and receiver combining in holographic multiple-input multiple-output (HMIMO) communications, and we study the achievable rate by formulating a joint optimization problem of the SIM phase shifts at both sides of the transceiver and the covariance matrix of the transmitted signal. Notably, we propose its solution by means of an iterative optimization algorithm that relies on the projected gradient method, and accounts for all optimization parameters simultaneously. We also obtain the step size guaranteeing the convergence of the proposed algorithm. Simulation results provide fundamental insights such the performance improvements compared to the single-RIS counterpart and conventional MIMO system. Remarkably, the proposed algorithm results in the same achievable rate as the alternating optimization (AO) benchmark but with a less number of iterations.


title: Two-stage Information Spreading Evolution on The Control Role of Announcements

abstract: Modern social media networks have become an important platform for information competition among countries, regions, companies and other parties. This paper utilizes the research method of spread dynamics to investigate the influence of the control role of announcements in social networks on the spreading process. This paper distinguishes two spreading phases using the authentication intervention as a boundary: the unconfirmed spreading phase and the confirmed spreading phase. Based on the actual rules of spreading in online social networks, two kinds of verification results are defined: true information and false information. The Two-stage information spreading dynamics model is developed to analyze the changes in spreading effects due to different validation results. The impact of the intervention time on the overall spread process is analyzed by combining important control factors such as response cost and time-sensitivity. The validity of the model is verified by comparing the model simulation results with real cases and the adaptive capacity experiments. This work is analyzed and visualized from multiple perspectives, providing more quantitative results. The research content will provide a scientific basis for the intervention behavior of information management control by relevant departments or authorities.


title: Measurement of beauty-quark production in pp collisions at $\sqrt{s}=13$ TeV via non-prompt D mesons

abstract: The $p_{\rm T}$-differential production cross sections of non-prompt ${\rm D^0}$, ${\rm D^+}$, and ${\rm D_s^+}$ mesons originating from beauty-hadron decays are measured in proton$-$proton collisions at a centre-of-mass energy $\sqrt{s}$ of 13 TeV. The measurements are performed at midrapidity, $|y| < 0.5$, with the data sample collected by ALICE from 2016 to 2018. The results are in agreement with predictions from several perturbative QCD calculations. The fragmentation fraction of beauty quarks to strange mesons divided by the one to non-strange mesons, $f_{\rm{s}}/(f_{\rm{u}} + f_{\rm{d}})$, is found to be $0.114 \pm 0.016~{\rm (stat.)} \pm 0.006~{\rm (syst.)} \pm 0.003~{\rm (BR)} \pm 0.003~{\rm (extrap.)}$. This value is compatible with previous measurements at lower centre-of-mass energies and in different collision systems in agreement with the assumption of universality of fragmentation functions. In addition, the dependence of the non-prompt D meson production on the centre-of-mass energy is investigated by comparing the results obtained at $\sqrt{s} = 5.02$ and 13 TeV, showing a hardening of the non-prompt D-meson $p_{\rm T}$-differential production cross section at higher $\sqrt{s}$. Finally, the ${\rm b\overline{b}}$ production cross section per unit of rapidity at midrapidity is calculated from the non-prompt ${\rm D^0}$, ${\rm D^+}$, ${\rm D_s^+}$, and $\Lambda_{\rm c}^+$ hadron measurements, obtaining ${\rm d}\sigma/{\rm d}y = 75.2\pm 3.2~(\mathrm{stat.}) \pm 5.2~(\mathrm{syst.})^{+12.3}_{-3.2} ~(\mathrm{extrap.})\text{ } \rm \mu b \;.$


title: Higher-dimensional multifractal analysis for the cusp winding process on hyperbolic surfaces

abstract: We perform a multifractal analysis of the growth rate of the number of cusp windings for the geodesic flow on hyperbolic surfaces with $m \geq 1$ cusps. Our main theorem establishes a conditional variational principle for the Hausdorff dimension spectrum of the multi-cusp winding process. Moreover, we show that the dimension spectrum defined on $\mathbb{R}_{>0}^m$ is real analytic. To prove the main theorem we use a countable Markov shift with a finitely primitive transition matrix and thermodynamic formalism.


title: On the spectral extremal problem of planar graphs

abstract: The spectral extremal problem of planar graphs has aroused a lot of interest over the past three decades. In 1991, Boots and Royle [Geogr. Anal. 23(3) (1991) 276--282] (and Cao and Vince [Linear Algebra Appl. 187 (1993) 251--257] independently) conjectured that $K_2 + P_{n-2}$ is the unique graph attaining the maximum spectral radius among all planar graphs on $n$ vertices, where $K_2 + P_{n-2}$ is the graph obtained from $K_2\cup P_{n-2}$ by adding all possible edges between $K_2$ and $P_{n-2}$. In 2017, Tait and Tobin [J. Combin. Theory Ser. B 126 (2017) 137--161] confirmed this conjecture for all sufficiently large $n$. In this paper, we consider the spectral extremal problem for planar graphs without specified subgraphs. For a fixed graph $F$, let $\mathrm{SPEX}_{\mathcal{P}}(n,F)$ denote the set of graphs attaining the maximum spectral radius among all $F$-free planar graphs on $n$ vertices. We describe a rough sturcture for the connected extremal graphs in $\mathrm{SPEX}_{\mathcal{P}}(n,F)$ when $F$ is a planar graph not contained in $K_{2,n-2}$. As applications, we determine the extremal graphs in $\mathrm{SPEX}_{\mathcal{P}}(n,W_k)$, $\mathrm{SPEX}_{\mathcal{P}}(n,F_k)$ and $\mathrm{SPEX}_{\mathcal{P}}(n,(k+1)K_2)$ for all sufficiently large $n$, where $W_k$, $F_k$ and $(k+1)K_2$ are the wheel graph of order $k$, the friendship graph of order $2k+1$ and the disjoint union of $k+1$ copies of $K_2$, respectively.


title: Predicting Sustainable Development Goals Using Course Descriptions -- from LLMs to Conventional Foundation Models

abstract: We present our work on predicting United Nations sustainable development goals (SDG) for university courses. We use an LLM named PaLM 2 to generate training data given a noisy human-authored course description input as input. We use this data to train several different smaller language models to predict SDGs for university courses. This work contributes to better university level adaptation of SDGs. The best performing model in our experiments was BART with an F1-score of 0.786.


title: Outline-Guided Object Inpainting with Diffusion Models

abstract: Instance segmentation datasets play a crucial role in training accurate and robust computer vision models. However, obtaining accurate mask annotations to produce high-quality segmentation datasets is a costly and labor-intensive process. In this work, we show how this issue can be mitigated by starting with small annotated instance segmentation datasets and augmenting them to effectively obtain a sizeable annotated dataset. We achieve that by creating variations of the available annotated object instances in a way that preserves the provided mask annotations, thereby resulting in new image-mask pairs to be added to the set of annotated images. Specifically, we generate new images using a diffusion-based inpainting model to fill out the masked area with a desired object class by guiding the diffusion through the object outline. We show that the object outline provides a simple, but also reliable and convenient training-free guidance signal for the underlying inpainting model that is often sufficient to fill out the mask with an object of the correct class without further text guidance and preserve the correspondence between generated images and the mask annotations with high precision. Our experimental results reveal that our method successfully generates realistic variations of object instances, preserving their shape characteristics while introducing diversity within the augmented area. We also show that the proposed method can naturally be combined with text guidance and other image augmentation techniques.


title: Bayesian nonparametric statistics, St-Flour lecture notes

abstract: These are lecture notes of the 51st Saint-Flour summer school, July 2023, on the topic of Bayesian nonparametric statistics


title: Sharp blow-up stability for self-similar solutions of the modified Korteweg-de Vries equation

abstract: We consider the modified Korteweg-de Vries equation. Given a self-similar solution, and a subcritical perturbation of any size, we prove that there exists a unique solution to the equation which behaves at blow-up time as the self-similar solution plus the perturbation. To this end, we develop the first robust analysis in spaces of functions with bounded Fourier transforms. To begin, we prove the local well-posedness in subcritical spaces through an appropriate restriction norm method. As this method is not sufficient to capture the critical self-similar dynamics, we develop an infinite normal form reduction (INFR) to derive time-dependent a priori $L^\infty$ bounds in frequency variables. Both approaches rely on frequency-restricted estimates, which are specific positive multiplier estimates capable of capturing the oscillatory nature of the equation. As a consequence of our analysis, we also prove local well-posedness for small subcritical perturbations of self-similar solutions at positive time.


title: COMAE: COMprehensive Attribute Exploration for Zero-shot Hashing

abstract: Zero-shot hashing (ZSH) has shown excellent success owing to its efficiency and generalization in large-scale retrieval scenarios. While considerable success has been achieved, there still exist urgent limitations. Existing works ignore the locality relationships of representations and attributes, which have effective transferability between seeable classes and unseeable classes. Also, the continuous-value attributes are not fully harnessed. In response, we conduct a COMprehensive Attribute Exploration for ZSH, named COMAE, which depicts the relationships from seen classes to unseen ones through three meticulously designed explorations, i.e., point-wise, pair-wise and class-wise consistency constraints. By regressing attributes from the proposed attribute prototype network, COMAE learns the local features that are relevant to the visual attributes. Then COMAE utilizes contrastive learning to comprehensively depict the context of attributes, rather than instance-independent optimization. Finally, the class-wise constraint is designed to cohesively learn the hash code, image representation, and visual attributes more effectively. Experimental results on the popular ZSH datasets demonstrate that COMAE outperforms state-of-the-art hashing techniques, especially in scenarios with a larger number of unseen label classes.


title: The Bombieri-Vinogradov theorem for primes of the form $\mathbf{p=x^2+y^2+1}$

abstract: In this paper, we establish a Bombieri-Vinogradov type result for prime numbers of the form $p=x^2+y^2+1$. The proof is based on the enveloping sieve.


title: Band-limited wavelets beyond Gevrey regularity

abstract: It is known that a smooth function of exponential decay at infinity can not be an orthonormal wavelet. Dziuba\'nski and Hern\'andez constructed smooth orthonormal wavelets of Gevrey type subexponential decay. We weaken the Gevrey type decay and construct orthonormal wavelets of subexponential decay related to the so-called extended Gevrey classes. The virtue of our construction is that prescise asymptotics of functions from such classes can be given in terms of the Lambert $W$ function.


title: Electronic phase transitions and superconductivity in ferroelectric Sn$_2$P$_2$Se$_6$ under pressure

abstract: Since there is both strong electron-phonon coupling during a ferroelectric/FE transition and superconducting/SC transition, it has been an important topic to explore superconductivity from the FE instability. Sn$_2$P$_2$Se$_6$ arouses broad attention due to its unique FE properties. Here, we reported the electronic phase transitions and superconductivity in this compound based on high-pressure electrical transport measurement, optical absorption spectroscopy and Raman based structural analysis. Upon compression, the conductivity of Sn$_2$P$_2$Se$_6$ was elevated monotonously, an electronic phase transition occurred near 5.4 GPa, revealed by optical absorption spectroscopy, and the insulating state is estimated to be fully suppressed near 15 GPa. Then, it started to show the signature of superconductivity near 15.3 GPa. The zero-resistance state was presented from 19.4 GPa, and the superconductivity was enhanced with pressure continuously. The magnetic field effect further confirmed the SC behavior and this compound had a $T_c$ of 5.4 K at 41.8 GPa with a zero temperature upper critical field of 6.55 T. The Raman spectra confirmed the structural origin of the electronic transition near 5.4 GPa, which should due to the transition from the paraelectric phase to the incommensurate phase, and suggested a possible first-order phase transition when the sample underwent the semiconductor-metal transition near 15 GPa. This work demonstrates the versatile physical properties in ferroelectrics and inspires the further investigation on the correlation between FE instability and SC in M$_2$P$_2$X$_6$ family.


title: Closed form solution to zero coupon bond using a linear stochastic delay differential equation

abstract: We present a short rate model that satisfies a stochastic delay differential equation. The model can be considered a delayed version of the Merton model (Merton 1970, 1973) or the Vasi\v{c}ek model (Vasi\v{c}ek 1977). Using the same technique as the one used by Flore and Nappo (2019), we show that the bond price is an affine function of the short rate, whose coefficients satisfy a system of delay differential equations. We give an analytical solution to this system of delay differential equations, obtaining a closed formula for the zero coupon bond price. Under this model, we can show that the distribution of the short rate is a normal distribution whose mean depends on past values of the short rate. Based on the results of K\"uchler and Mensch (1992), we prove the existence of stationary and limiting distributions.


title: Effect of utterance duration and phonetic content on speaker identification using second-order statistical methods

abstract: Second-order statistical methods show very good results for automatic speaker identification in controlled recording conditions. These approaches are generally used on the entire speech material available. In this paper, we study the influence of the content of the test speech material on the performances of such methods, i.e. under a more analytical approach. The goal is to investigate on the kind of information which is used by these methods, and where it is located in the speech signal. Liquids and glides together, vowels, and more particularly nasal vowels and nasal consonants, are found to be particularly speaker specific: test utterances of 1 second, composed in majority of acoustic material from one of these classes provide better speaker identification results than phonetically balanced test utterances, even though the training is done, in both cases, with 15 seconds of phonetically balanced speech. Nevertheless, results with other phoneme classes are never dramatically poor. These results tend to show that the speaker-dependent information captured by long-term second-order statistics is consistently common to all phonetic classes, and that the homogeneity of the test material may improve the quality of the estimates.


title: Improving behavior based authentication against adversarial attack using XAI

abstract: In recent years, machine learning models, especially deep neural networks, have been widely used for classification tasks in the security domain. However, these models have been shown to be vulnerable to adversarial manipulation: small changes learned by an adversarial attack model, when applied to the input, can cause significant changes in the output. Most research on adversarial attacks and corresponding defense methods focuses only on scenarios where adversarial samples are directly generated by the attack model. In this study, we explore a more practical scenario in behavior-based authentication, where adversarial samples are collected from the attacker. The generated adversarial samples from the model are replicated by attackers with a certain level of discrepancy. We propose an eXplainable AI (XAI) based defense strategy against adversarial attacks in such scenarios. A feature selector, trained with our method, can be used as a filter in front of the original authenticator. It filters out features that are more vulnerable to adversarial attacks or irrelevant to authentication, while retaining features that are more robust. Through comprehensive experiments, we demonstrate that our XAI based defense strategy is effective against adversarial attacks and outperforms other defense strategies, such as adversarial training and defensive distillation.


title: RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions

abstract: Large Language Models (LLMs) have showcased remarkable capabilities in following human instructions. However, recent studies have raised concerns about the robustness of LLMs when prompted with instructions combining textual adversarial samples. In this paper, drawing inspiration from recent works that LLMs are sensitive to the design of the instructions, we utilize instructions in code style, which are more structural and less ambiguous, to replace typically natural language instructions. Through this conversion, we provide LLMs with more precise instructions and strengthen the robustness of LLMs. Moreover, under few-shot scenarios, we propose a novel method to compose in-context demonstrations using both clean and adversarial samples (\textit{adversarial context method}) to further boost the robustness of the LLMs. Experiments on eight robustness datasets show that our method consistently outperforms prompting LLMs with natural language instructions. For example, with gpt-3.5-turbo, our method achieves an improvement of 5.68\% in test set accuracy and a reduction of 5.66 points in Attack Success Rate (ASR).


title: On the existence of KKL observers with nonlinear contracting dynamics (Long Version)

abstract: KKL (Kazantzis-Kravaris/Luenberger) observers are based on the idea of immersing a given nonlinear system into a target system that is a linear stable filter of the measured output. In the present paper, we extend this theory by allowing this target system to be a nonlinear contracting filter of the output. We prove, under a differential observability condition, the existence of these new KKL observers. We motivate their introduction by showing numerically the possibility of combining convergence speed and robustness to noise, unlike what is known for linear filtering.


title: Data-Driven Acceleration of Multi-Physics Simulations

abstract: Multi-physics simulations play a crucial role in understanding complex systems. However, their computational demands are often prohibitive due to high dimensionality and complex interactions, such that actual calculations often rely on approximations. To address this, we introduce a data-driven approach to approximate interactions among degrees of freedom of no direct interest and thus significantly reduce computational costs. Focusing on a semiconductor laser as a case study, we demonstrate the superiority of this method over traditional analytical approximations in both accuracy and efficiency. Our approach streamlines simulations, offering promise for complex multi-physics systems, especially for scenarios requiring a large number of individual simulations.


title: Optimization of the Downlink Spectral- and Energy-Efficiency of RIS-aided Multi-user URLLC MIMO Systems

abstract: Modern wireless communication systems are expected to provide improved latency and reliability. To meet these expectations, a short packet length is needed, which makes the first-order Shannon rate an inaccurate performance metric for such communication systems. A more accurate approximation of the achievable rates of finite-block-length (FBL) coding regimes is known as the normal approximation (NA). It is therefore of substantial interest to study the optimization of the FBL rate in multi-user multiple-input multiple-output (MIMO) systems, in which each user may transmit and/or receive multiple data streams. Hence, we formulate a general optimization problem for improving the spectral and energy efficiency of multi-user MIMO-aided ultra-reliable low-latency communication (URLLC) systems, which are assisted by reconfigurable intelligent surfaces (RISs). We show that a RIS is capable of substantially improving the performance of multi-user MIMO-aided URLLC systems. Moreover, the benefits of RIS increase as the packet length and/or the tolerable bit error rate are reduced. This reveals that RISs can be even more beneficial in URLLC systems for improving the FBL rates than in conventional systems approaching Shannon rates.


title: Training Implicit Generative Models via an Invariant Statistical Loss

abstract: Implicit generative models have the capability to learn arbitrary complex data distributions. On the downside, training requires telling apart real data from artificially-generated ones using adversarial discriminators, leading to unstable training and mode-dropping issues. As reported by Zahee et al. (2017), even in the one-dimensional (1D) case, training a generative adversarial network (GAN) is challenging and often suboptimal. In this work, we develop a discriminator-free method for training one-dimensional (1D) generative implicit models and subsequently expand this method to accommodate multivariate cases. Our loss function is a discrepancy measure between a suitably chosen transformation of the model samples and a uniform distribution; hence, it is invariant with respect to the true distribution of the data. We first formulate our method for 1D random variables, providing an effective solution for approximate reparameterization of arbitrary complex distributions. Then, we consider the temporal setting (both univariate and multivariate), in which we model the conditional distribution of each sample given the history of the process. We demonstrate through numerical simulations that this new method yields promising results, successfully learning true distributions in a variety of scenarios and mitigating some of the well-known problems that state-of-the-art implicit methods present.


title: The quadruple spectroheliograph of Meudon observatory (1909-1959)

abstract: The spectroheliograph was invented independently by Henri Deslandres (France) and George Hale (USA) in 1892, following the spectroscopic method suggested by Jules Janssen in 1869. This instrument is dedicated to the production of monochromatic images of the Sun in order to reveal the structures of the photosphere and the chromosphere at various altitudes. Sporadic observations started in Paris, but Deslandres moved soon to Meudon and designed, with Lucien d'Azambuja, an universal and powerful instrument, the quadruple spectroheliograph. It was devoted to systematic observations of the Sun (the long-term activity survey since 1908) and scientific research in solar physics. This paper describes the instrument and presents some original observations made with the high dispersion 7-metre spectrograph. It was dismantled in the sixties, but the solar patrol continued with the 3-metre chambers with H$\alpha$ and CaII K lines, and is still working today with the numerical version of the spectroheliograph.


title: Herbrandized modified realizability

abstract: Realizability notions in mathematical logic have a long history, which can be traced back to the work of Stephen Kleene in the 1940s, aimed at exploring the foundations of intuitionistic logic. Kleene's initial realizability laid the ground for more sophisticated notions such as Kreisel's modified realizability and various modern approaches. In this context, our work aligns with the lineage of realizability strategies that emphasize the accumulation, rather than the propagation of precise witnesses. In this paper, we introduce a new notion of realizability, namely herbrandized modified realizability. This novel form of (cumulative) realizability, presented within the framework of semi-intuitionistic logic is based on a recently developed star combinatory calculus, which enables the gathering of witnesses into nonempty finite sets. We also show that the previous analysis can be extended from logic to (Heyting) arithmetic.


title: Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models

abstract: Large language models (LLMs) demonstrate remarkable multilingual capabilities without being pre-trained on specially curated multilingual parallel corpora. It remains a challenging problem to explain the underlying mechanisms by which LLMs process multilingual texts. In this paper, we delve into the composition of Transformer architectures in LLMs to pinpoint language-specific regions. Specially, we propose a novel detection method, language activation probability entropy (LAPE), to identify language-specific neurons within LLMs. Based on LAPE, we conduct comprehensive experiments on several representative LLMs, such as LLaMA-2, BLOOM, and Mistral. Our findings indicate that LLMs' proficiency in processing a particular language is predominantly due to a small subset of neurons, primarily situated in the models' top and bottom layers. Furthermore, we showcase the feasibility to "steer" the output language of LLMs by selectively activating or deactivating language-specific neurons. Our research provides important evidence to the understanding and exploration of the multilingual capabilities of LLMs.


title: Solving Nonlinear Absolute Value Equations

abstract: In this work we show that several problems naturally modeled as Nonlinear Absolute Value Equations (NAVE), can be restated as Nonlinear Complementarity Problems (NCP) and solved efficiently using smoothing regularizing techniques under mild assumptions. Applications include ridge optimization and resolution of nonlinear ordinary differential equations.


title: Retrouver l'inventeur-auteur : la lev{\'e}e d'homonymies d'autorat entre les brevets et les publications scientifiques

abstract: Patents and scientific papers provide an essential source for measuring science and technology output, to be used as a basis for the most varied scientometric analyzes. Authors' and inventors' names are the key identifiers to carry out these analyses, which however, run up against the issue of disambiguation. By extension identifying inventors who are also academic authors is a non-trivial challenge. We propose a method using the International Patent Classification (IPC) and the IPCCAT API to assess the degree of similarity of patents and papers abstracts of a given inventor, in order to match both types of documents. The method is developed and manually qualified based on three corpora of patents extracted from the international EPO database Espacenet. Among a set of 4679 patents and 7720 inventors, we obtain 2501 authors. The proposed algorithm solves the general problem of disambiguation with an error rate lower than 5%.


title: Neutrino oscillations with atmospheric neutrinos at large liquid argon TPCs

abstract: We propose to study atmospheric neutrino interactions with a unique event topology to distinguish neutrinos and anti-neutrinos using a liquid argon time projection chamber in an experiment such as DUNE. The detection of CC1P and CC0P events will allow to access neutrino oscillation physics complementary to accelerator based beam neutrinos. Our analysis shows that a sensitivity to the mass-ordering can be achieved with a significance close to 4{\sigma} and a CP violation sensitivity with more than 2{\sigma} with a data sample of 140 kt-yr of atmospheric neutrinos in the DUNE detector.


title: On Distributed Larger-Than-Memory Subset Selection With Pairwise Submodular Functions

abstract: Many learning problems hinge on the fundamental problem of subset selection, i.e., identifying a subset of important and representative points. For example, selecting the most significant samples in ML training cannot only reduce training costs but also enhance model quality. Submodularity, a discrete analogue of convexity, is commonly used for solving subset selection problems. However, existing algorithms for optimizing submodular functions are sequential, and the prior distributed methods require at least one central machine to fit the target subset. In this paper, we relax the requirement of having a central machine for the target subset by proposing a novel distributed bounding algorithm with provable approximation guarantees. The algorithm iteratively bounds the minimum and maximum utility values to select high quality points and discard the unimportant ones. When bounding does not find the complete subset, we use a multi-round, partition-based distributed greedy algorithm to identify the remaining subset. We show that these algorithms find high quality subsets on CIFAR-100 and ImageNet with marginal or no loss in quality compared to centralized methods, and scale to a dataset with 13 billion points.


title: Towards inferring reactor operations from high-level waste

abstract: Nuclear archaeology research provides scientific methods to reconstruct the operating histories of fissile material production facilities to account for past fissile material production. While it has typically focused on analyzing material in permanent reactor structures, spent fuel or high-level waste also hold information about the reactor operation. In this computational study, we explore a Bayesian inference framework for reconstructing the operational history from measurements of isotope ratios from a sample of nuclear waste . We investigate two different inference models. The first model discriminates between three potential reactors of origin (Magnox, PWR, and PHWR) while simultaneously reconstructing the fuel burnup, time since irradiation, initial enrichment, and average power density. The second model reconstructs the fuel burnup and time since irradiation of two batches of waste in a mixed sample. Each of the models is applied to a set of simulated test data, and the performance is evaluated by comparing the highest posterior density regions to the corresponding parameter values of the test dataset. Both models perform well on the simulated test cases, which highlights the potential of the Bayesian inference framework and opens up avenues for further investigation


title: ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors

abstract: The safety of Large Language Models (LLMs) has gained increasing attention in recent years, but there still lacks a comprehensive approach for detecting safety issues within LLMs' responses in an aligned, customizable and explainable manner. In this paper, we propose ShieldLM, an LLM-based safety detector, which aligns with general human safety standards, supports customizable detection rules, and provides explanations for its decisions. To train ShieldLM, we compile a large bilingual dataset comprising 14,387 query-response pairs, annotating the safety of responses based on various safety standards. Through extensive experiments, we demonstrate that ShieldLM surpasses strong baselines across four test sets, showcasing remarkable customizability and explainability. Besides performing well on standard detection datasets, ShieldLM has also been shown to be effective in real-world situations as a safety evaluator for advanced LLMs. We release ShieldLM at \url{https://github.com/thu-coai/ShieldLM} to support accurate and explainable safety detection under various safety standards, contributing to the ongoing efforts to enhance the safety of LLMs.


title: ProLLaMA: A Protein Large Language Model for Multi-Task Protein Language Processing

abstract: Large Language Models (LLMs), including GPT-x and LLaMA2, have achieved remarkable performance in multiple Natural Language Processing (NLP) tasks. Under the premise that protein sequences constitute the protein language, Protein Large Language Models (ProLLMs) trained on protein corpora excel at de novo protein sequence generation. However, as of now, unlike LLMs in NLP, no ProLLM is capable of multiple tasks in the Protein Language Processing (PLP) field. This prompts us to delineate the inherent limitations in current ProLLMs: (i) the lack of natural language capabilities, (ii) insufficient instruction understanding, and (iii) high training resource demands. To address these challenges, we introduce a training framework to transform any general LLM into a ProLLM capable of handling multiple PLP tasks. Specifically, our framework utilizes low-rank adaptation and employs a two-stage training approach, and it is distinguished by its universality, low overhead, and scalability. Through training under this framework, we propose the ProLLaMA model, the first known ProLLM to handle multiple PLP tasks simultaneously. Experiments show that ProLLaMA achieves state-of-the-art results in the unconditional protein sequence generation task. In the controllable protein sequence generation task, ProLLaMA can design novel proteins with desired functionalities. In the protein property prediction task, ProLLaMA achieves nearly 100\% accuracy across many categories. The latter two tasks are beyond the reach of other ProLLMs. Code is available at \url{https://github.com/Lyu6PosHao/ProLLaMA}.


title: Indoor Localization of Smartphones Thanks to Zero-Energy-Devices Beacons

abstract: In this paper, we present a new ultra-low power method of indoor localization of smartphones (SM) based on zero-energy-devices (ZEDs) beacons instead of active wireless beacons. Each ZED is equipped with a unique identification number coded into a bit-sequence, and its precise position on the map is recorded. An SM inside the building is assumed to have access to the map of ZEDs. The ZED backscatters ambient waves from base stations (BSs) of the cellular network. The SM detects the ZED message in the variations of the received ambient signal from the BS. We accurately simulate the ambient waves from a BS of Orange 4G commercial network, inside an existing large building covered with ZED beacons, thanks to a ray-tracing-based propagation simulation tool. Our first performance evaluation study shows that the proposed localization system enables us to determine in which room a SM is located, in a realistic and challenging propagation scenario.


title: Distortion-Controlled Dithering with Reduced Recompression Rate

abstract: Dithering is a technique that can improve human perception of low-resolution data by reducing quantization artifacts. In this work we formalize and analytically justify two metrics for quantization artifact prominence, using them to design a novel dithering method for distortion-controlled data compression. We present theoretical entropy calculations for this dither and experimentally validate its performance on a low-rate image compression task. The result is a drastic improvement in the perceptual quality of quantized images with a lower recompression entropy than any state-of-the-art dither technique, achieving 45 points lower PIQUE at the same rate or 40% lower rate at the same PIQUE. The proposed dither is an adaptable tool applicable for use in any lossy compression system, permitting precise control of rate-distortion characteristics for both compression and recompression.


title: WetLinks: a Large-Scale Longitudinal Starlink Dataset with Contiguous Weather Data

abstract: Low Orbit Satellite (LEO) networks such as Starlink promise Internet access everywhere around the world. In this paper, we present WetLinks - a large and publicly available trace-based dataset of Starlink measurements. The measurements were concurrently collected from two European vantage points over a span of six months. Consisting of approximately 140,000 measurements, the dataset comprises all relevant network parameters such as the upload and download throughputs, the RTT, packet loss, and traceroutes. We further augment the dataset with concurrent data from professional weather stations placed next to both Starlink terminals. Based on our dataset, we analyse Starlink performance, including its susceptibility to weather conditions. We use this to validate our dataset by replicating the results of earlier smaller-scale studies. We release our datasets and all accompanying tooling as open data. To the best of our knowledge, ours is the largest Starlink dataset to date.


title: Online Efficient Safety-Critical Control for Mobile Robots in Unknown Dynamic Multi-Obstacle Environments

abstract: This paper proposes a LiDAR-based goal-seeking and exploration framework, addressing the efficiency of online obstacle avoidance in unstructured environments populated with static and moving obstacles. This framework addresses two significant challenges associated with traditional dynamic control barrier functions (D-CBFs): their online construction and the diminished real-time performance caused by utilizing multiple D-CBFs. To tackle the first challenge, the framework's perception component begins with clustering point clouds via the DBSCAN algorithm, followed by encapsulating these clusters with the minimum bounding ellipses (MBEs) algorithm to create elliptical representations. By comparing the current state of MBEs with those stored from previous moments, the differentiation between static and dynamic obstacles is realized, and the Kalman filter is utilized to predict the movements of the latter. Such analysis facilitates the D-CBF's online construction for each MBE. To tackle the second challenge, we introduce buffer zones, generating Type-II D-CBFs online for each identified obstacle. Utilizing these buffer zones as activation areas substantially reduces the number of D-CBFs that need to be activated. Upon entering these buffer zones, the system prioritizes safety, autonomously navigating safe paths, and hence referred to as the exploration mode. Exiting these buffer zones triggers the system's transition to goal-seeking mode. We demonstrate that the system's states under this framework achieve safety and asymptotic stabilization. Experimental results in simulated and real-world environments have validated our framework's capability, allowing a LiDAR-equipped mobile robot to efficiently and safely reach the desired location within dynamic environments containing multiple obstacles.


title: A post-group theoretic perspective on the operator-valued S-transform in free probability

abstract: We investigate the algebraic structure underlying Voiculescu's S-transform in the setting of operator-valued free probability. We show that its twisted factorisation property gives rise to post-groups, crossed morphisms, as well as pre- and post-Lie algebras.


title: The Neumann sieve problem revisited

abstract: Let $\Omega\subset\mathbb{R}^n$ be a domain, $\Gamma$ be a hyperplane intersecting it. Let $\varepsilon>0$, and $\Omega_\varepsilon=\Omega\setminus\overline{\Sigma_\varepsilon}$, where $\Sigma_\varepsilon$ ("sieve") is an $\varepsilon$-neighbourhood of $\Gamma$ punctured by many narrow passages. When $\varepsilon\to0$, the number of passages tends to infinity, while the diameters of their cross-sections tend to zero. For the case of identical straight periodically distributed and appropriately scaled passages T. Del Vecchio (1987) proved that the Neumann Laplacian on $\Omega_\varepsilon$ converges in a strong resolvent sense to the Laplacian on $\Omega\setminus\Gamma$ subject to the so-called $\delta'$-conditions on $\Gamma$. We will refine this result by deriving estimates on the rate of convergence in terms of various operator norms, and providing the estimate for the distance between the spectra. The assumptions we impose on the passages are rather general. For $n=2$ the results of T. Del Vecchio are not complete, some cases remain as open problems, and in this work we will fill these gaps.


title: Multiscale Experiments and Predictive Modelling for Inverse Design and Failure Mitigation in Additively Manufactured Lattices

abstract: Additive manufacturing (AM) enables the development of high-performance architected cellular materials, emphasizing the growing importance of establishing programmable and predictable energy absorption capabilities. This study evaluates the impact of a precisely tuned fused filament fabrication (FFF) AM process on the energy absorption and failure characteristics of thermoplastic lattice materials through multiscale experiments and predictive modelling. Lattices with four distinct unit cell topologies and three varying relative densities are manufactured, and their in-plane mechanical response under quasi-static compression is measured. Macroscale testing and micro-CT imaging reveal relative density-dependent damage mechanisms and failure modes, prompting the development of a robust predictive modelling framework to capture process-induced performance variation and damage. For lower relative density lattices, an FE model based on the extended Drucker-Prager material model, incorporating Bridgman correction with crazing failure criteria, accurately captures the crushing response. As lattice density increases, interfacial damage along bead-bead interfaces becomes predominant, necessitating the enrichment of the model with a microscale cohesive zone model to capture interfacial debonding. All proposed models are validated, highlighting inter-bead damage as the primary factor limiting energy absorption performance in FFF-printed lattices. Finally, the predictive modelling introduces an enhancement factor, providing a straightforward approach to assess the influence of the AM process on energy absorption performance, facilitating the inverse design of FFF-printed lattices. This approach enables a critical evaluation of how FFF processes can be improved to achieve the highest attainable performance and mitigate failures in architected cellular materials.


title: Intelligent Reflecting Surfaces and Next Generation Wireless Systems

abstract: Intelligent reflecting surface (IRS) is a potential candidate for massive multiple-input multiple-output (MIMO) 2.0 technology due to its low cost, ease of deployment, energy efficiency and extended coverage. This chapter investigates the slot-by-slot IRS reflection pattern design and two-timescale reflection pattern design schemes, respectively. For the slot-by-slot reflection optimization, we propose exploiting an IRS to improve the propagation channel rank in mmWave massive MIMO systems without need to increase the transmit power budget. Then, we analyze the impact of the distributed IRS on the channel rank. To further reduce the heavy overhead of channel training, channel state information (CSI) estimation, and feedback in time-varying MIMO channels, we present a two-timescale reflection optimization scheme, where the IRS is configured relatively infrequently based on statistical CSI (S-CSI) and the active beamformers and power allocation are updated based on quickly outdated instantaneous CSI (I-CSI) per slot. The achievable average sum-rate (AASR) of the system is maximized without excessive overhead of cascaded channel estimation. A recursive sampling particle swarm optimization (PSO) algorithm is developed to optimize the large-timescale IRS reflection pattern efficiently with reduced samplings of channel samples.


title: Autonomous Integration of TSN-unaware Applications with QoS Requirements in TSN Networks

abstract: Modern industrial networks transport both best-effort and real-time traffic. Time-Sensitive Networking (TSN) was introduced by the IEEE TSN Task Group as an enhancement to Ethernet to provide high quality of service (QoS) for real-time traffic. In a TSN network, applications signal their QoS requirements to the network before transmitting data. The network then allocates resources to meet these requirements. However, TSN-unaware applications can neither perform this registration process nor profit from TSN's QoS benefits. The contributions of this paper are twofold. First, we introduce a novel network architecture in which an additional device autonomously signals the QoS requirements of TSN-unaware applications to the network. Second, we propose a processing method to detect real-time streams in a network and extract the necessary information for the TSN stream signaling. It leverages a Deep Recurrent Neural Network (DRNN) to detect periodic traffic, extracts an accurate traffic description, and uses traffic classification to determine the source application. As a result, our proposal allows TSN-unaware applications to benefit from TSNs QoS guarantees. Our evaluations underline the effectiveness of the proposed architecture and processing method.


title: Performance Comparison of Surrogate-Assisted Evolutionary Algorithms on Computational Fluid Dynamics Problems

abstract: Surrogate-assisted evolutionary algorithms (SAEAs) are recently among the most widely studied methods for their capability to solve expensive real-world optimization problems. However, the development of new methods and benchmarking with other techniques still relies almost exclusively on artificially created problems. In this paper, we use two real-world computational fluid dynamics problems to compare the performance of eleven state-of-the-art single-objective SAEAs. We analyze the performance by investigating the quality and robustness of the obtained solutions and the convergence properties of the selected methods. Our findings suggest that the more recently published methods, as well as the techniques that utilize differential evolution as one of their optimization mechanisms, perform significantly better than the other considered methods.


title: Formal Degrees and Parabolic Induction: the Maximal Generic Case

abstract: We study the compatibility of the formal degree conjecture and the parabolic induction process in the simplest nontrivial case for quasi-split $p$-adic groups. For a generic discrete series $\pi$ induced from an irreducible supercuspidal $\sigma$ of a maximal Levi subgroup, we compute the quotient $d(\pi)/d(\sigma)$ of formal degrees under some assumptions. As an application, we verify the conjecture for discrete series of split $\mathrm{G}_2$ supported on maximal Levi subgroups.


title: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering

abstract: Adaptive retrieval-augmented generation (ARAG) aims to dynamically determine the necessity of retrieval for queries instead of retrieving indiscriminately to enhance the efficiency and relevance of the sourced information. However, previous works largely overlook the evaluation of ARAG approaches, leading to their effectiveness being understudied. This work presents a benchmark, RetrievalQA, comprising 1,271 short-form questions covering new world and long-tail knowledge. The knowledge necessary to answer the questions is absent from LLMs; therefore, external information must be retrieved to answer correctly. This makes RetrievalQA a suitable testbed to evaluate existing ARAG methods. We observe that calibration-based methods heavily rely on threshold tuning, while vanilla prompting is inadequate for guiding LLMs to make reliable retrieval decisions. Based on our findings, we propose Time-Aware Adaptive Retrieval (TA-ARE), a simple yet effective method that helps LLMs assess the necessity of retrieval without calibration or additional training. The dataset and code will be available at https://github.com/hyintell/RetrievalQA


title: ID-XCB: Data-independent Debiasing for Fair and Accurate Transformer-based Cyberbullying Detection

abstract: Swear words are a common proxy to collect datasets with cyberbullying incidents. Our focus is on measuring and mitigating biases derived from spurious associations between swear words and incidents occurring as a result of such data collection strategies. After demonstrating and quantifying these biases, we introduce ID-XCB, the first data-independent debiasing technique that combines adversarial training, bias constraints and debias fine-tuning approach aimed at alleviating model attention to bias-inducing words without impacting overall model performance. We explore ID-XCB on two popular session-based cyberbullying datasets along with comprehensive ablation and generalisation studies. We show that ID-XCB learns robust cyberbullying detection capabilities while mitigating biases, outperforming state-of-the-art debiasing methods in both performance and bias mitigation. Our quantitative and qualitative analyses demonstrate its generalisability to unseen data.


title: Defending LLMs against Jailbreaking Attacks via Backtranslation

abstract: Although many large language models (LLMs) have been trained to refuse harmful requests, they are still vulnerable to jailbreaking attacks which rewrite the original prompt to conceal its harmful intent. In this paper, we propose a new method for defending LLMs against jailbreaking attacks by ``backtranslation''. Specifically, given an initial response generated by the target LLM from an input prompt, our backtranslation prompts a language model to infer an input prompt that can lead to the response. The inferred prompt is called the backtranslated prompt which tends to reveal the actual intent of the original prompt, since it is generated based on the LLM's response and not directly manipulated by the attacker. We then run the target LLM again on the backtranslated prompt, and we refuse the original prompt if the model refuses the backtranslated prompt. We explain that the proposed defense provides several benefits on its effectiveness and efficiency. We empirically demonstrate that our defense significantly outperforms the baselines, in the cases that are hard for the baselines, and our defense also has little impact on the generation quality for benign input prompts. Our implementation is based on our library for LLM jailbreaking defense algorithms at \url{https://github.com/YihanWang617/llm-jailbreaking-defense}, and the code for reproducing our experiments is available at \url{https://github.com/YihanWang617/LLM-Jailbreaking-Defense-Backtranslation}.


title: Search for Wormhole Candidates: Accreting Wormholes with Monopole Magnetic Fields

abstract: The existence of even the simplest magnetized wormholes may lead to observable consequences. In the case where both the wormhole and the magnetic field around its mouths are static and spherically symmetric, and gas in the region near the wormhole falls radially into it, the former's spectrum contains bright cyclotron or synchrotron lines due to the interaction of charged plasma particles with the magnetic field. At the same time, due to spherical symmetry, the radiation is non-polarized. The emission of this just-described exotic type (non-thermal, but non-polarized) may be a wormhole signature. Also, in this scenario, the formation of an accretion disk is still quite possible at some distance from the wormhole, but a monopole magnetic field could complicate this process and lead to the emergence of asymmetrical and one-sided relativistic jets.


title: Matrix weighted modulation spaces

abstract: Given a matrix-weight $W$ in the Muckenhoupt class $\mathbf{A}_p(\mathbb{R}^n)$, $1\leq p<\infty$, we introduce corresponding vector-valued continuous and discrete $\alpha$-modulation spaces $M^{s,\alpha}_{p,q}(W)$ and $m^{s,\alpha}_{p,q}(W)$ and prove their equivalence through the use of adapted tight frames. Compatible notions of molecules and almost diagonal matrices are also introduced, and an application to the study of pseudo-differential operators on vector valued spaces is given.


title: Enabling Communication and Control Co-Design in 6G Networks

abstract: Networked control systems (NCSs), which are feedback control loops closed over a communication network, have been a popular research topic over the past decades. Numerous works in the literature propose novel algorithms and protocols with joint consideration of communication and control. However, the vast majority of the recent research results, which have shown remarkable performance improvements if a cross-layer methodology is followed, have not been widely adopted by the industry. In this work, we review the shortcomings of today's mobile networks that render cross-layer solutions, such as semantic and goal-oriented communications, very challenging in practice. To tackle this, we propose a new framework for 6G user plane design that simplifies the adoption of recent research results in networked control, thereby facilitating the joint communication and control design in next-generation mobile networks.


title: Learning to Schedule Online Tasks with Bandit Feedback

abstract: Online task scheduling serves an integral role for task-intensive applications in cloud computing and crowdsourcing. Optimal scheduling can enhance system performance, typically measured by the reward-to-cost ratio, under some task arrival distribution. On one hand, both reward and cost are dependent on task context (e.g., evaluation metric) and remain black-box in practice. These render reward and cost hard to model thus unknown before decision making. On the other hand, task arrival behaviors remain sensitive to factors like unpredictable system fluctuation whereby a prior estimation or the conventional assumption of arrival distribution (e.g., Poisson) may fail. This implies another practical yet often neglected challenge, i.e., uncertain task arrival distribution. Towards effective scheduling under a stationary environment with various uncertainties, we propose a double-optimistic learning based Robbins-Monro (DOL-RM) algorithm. Specifically, DOL-RM integrates a learning module that incorporates optimistic estimation for reward-to-cost ratio and a decision module that utilizes the Robbins-Monro method to implicitly learn task arrival distribution while making scheduling decisions. Theoretically, DOL-RM achieves convergence gap and no regret learning with a sub-linear regret of $O(T^{3/4})$, which is the first result for online task scheduling under uncertain task arrival distribution and unknown reward and cost. Our numerical results in a synthetic experiment and a real-world application demonstrate the effectiveness of DOL-RM in achieving the best cumulative reward-to-cost ratio compared with other state-of-the-art baselines.


title: Quantum intersection numbers and the Gromov-Witten invariants of $\mathbb{CP}^1$

abstract: The notion of a quantum tau-function for a natural quantization of the KdV hierarchy was introduced in a work of Dubrovin, Gu\'er\'e, Rossi, and the second author. A certain natural choice of a quantum tau-function was then described by the first author, the coefficients of the logarithm of this series are called the quantum intersection numbers. Because of the Kontsevich-Witten theorem, a part of the quantum intersection numbers coincides with the classical intersection numbers of psi-classes on the moduli spaces of stable algebraic curves. In this paper, we relate the quantum intersection numbers to the stationary relative Gromov-Witten invariants of $(\mathbb{CP}^1,0,\infty)$ with an insertion of a Hodge class. Using the Okounkov-Pandharipande approach to such invariants (with the trivial Hodge class) through the infinite wedge formalism, we then give a short proof of an explicit formula for the ``purely quantum'' part of the quantum intersection numbers, found by the first author, which in particular relates these numbers to the one-part double Hurwitz numbers.


title: Training Classical Neural Networks by Quantum Machine Learning

abstract: In recent years, advanced deep neural networks have required a large number of parameters for training. Therefore, finding a method to reduce the number of parameters has become crucial for achieving efficient training. This work proposes a training scheme for classical neural networks (NNs) that utilizes the exponentially large Hilbert space of a quantum system. By mapping a classical NN with $M$ parameters to a quantum neural network (QNN) with $O(\text{polylog} (M))$ rotational gate angles, we can significantly reduce the number of parameters. These gate angles can be updated to train the classical NN. Unlike existing quantum machine learning (QML) methods, the results obtained from quantum computers using our approach can be directly used on classical computers. Numerical results on the MNIST and Iris datasets are presented to demonstrate the effectiveness of our approach. Additionally, we investigate the effects of deeper QNNs and the number of measurement shots for the QNN, followed by the theoretical perspective of the proposed method. This work opens a new branch of QML and offers a practical tool that can greatly enhance the influence of QML, as the trained QML results can benefit classical computing in our daily lives.


title: Parameterized and approximation algorithms for coverings points with segments in the plane

abstract: We study parameterized and approximation algorithms for a variant of Set Cover, where the universe of elements to be covered consists of points in the plane and the sets with which the points should be covered are segments. We call this problem Segment Set Cover. We also consider a relaxation of the problem called $\delta$-extension, where we need to cover the points by segments that are extended by a tiny fraction, but we compare the solution's quality to the optimum without extension. For the unparameterized variant, we prove that Segment Set Cover does not admit a PTAS unless $\mathsf{P}=\mathsf{NP}$, even if we restrict segments to be axis-parallel and allow $\frac{1}{2}$-extension. On the other hand, we show that parameterization helps for the tractability of Segment Set Cover: we give an FPT algorithm for unweighted Segment Set Cover parameterized by the solution size $k$, a parameterized approximation scheme for Weighted Segment Set Cover with $k$ being the parameter, and an FPT algorithm for Weighted Segment Set Cover with $\delta$-extension parameterized by $k$ and $\delta$. In the last two results, relaxing the problem is probably necessary: we prove that Weighted Segment Set Cover without any relaxation is $\mathsf{W}[1]$-hard and, assuming ETH, there does not exist an algorithm running in time $f(k)\cdot n^{o(k / \log k)}$. This holds even if one restricts attention to axis-parallel segments.


title: Exploratory Landscape Analysis for Mixed-Variable Problems

abstract: Exploratory landscape analysis and fitness landscape analysis in general have been pivotal in facilitating problem understanding, algorithm design and endeavors such as automated algorithm selection and configuration. These techniques have largely been limited to search spaces of a single domain. In this work, we provide the means to compute exploratory landscape features for mixed-variable problems where the decision space is a mixture of continuous, binary, integer, and categorical variables. This is achieved by utilizing existing encoding techniques originating from machine learning. We provide a comprehensive juxtaposition of the results based on these different techniques. To further highlight their merit for practical applications, we design and conduct an automated algorithm selection study based on a hyperparameter optimization benchmark suite. We derive a meaningful compartmentalization of these benchmark problems by clustering based on the used landscape features. The identified clusters mimic the behavior the used algorithms exhibit. Meaning, the different clusters have different best performing algorithms. Finally, our trained algorithm selector is able to close the gap between the single best and the virtual best solver by 57.5% over all benchmark problems.


title: Integrated Sensing and Communications with Affine Frequency Division Multiplexing

abstract: Integrated sensing and communications (ISAC) is regarded as a key technology in next-generation (6G) mobile communication systems. Affine frequency division multiplexing (AFDM) is a recently proposed waveform that achieves optimal diversity gain in high mobility scenarios and has appealing properties in high-frequency communication. In this letter, we present an AFDM-based ISAC system. We first show that in order to identify all delay and Doppler components associated with the propagation medium, either the full AFDM signal or only its pilot part consisting of one discrete affine Fourier transform (DAFT) domain symbol and its guard interval can be used. Our results show that using one pilot symbol achieves almost the same sensing performance as using the entire AFDM frame. Furthermore, due to the chirp nature of AFDM, sensing with one pilot provides a unique feature allowing for simple self-interference cancellation, thus avoiding the need for expensive full duplex methods.