title: Large fluctuations in NSPT computations: a lesson from $O(N)$ non-linear sigma models

abstract: In the last three decades, Numerical Stochastic Perturbation Theory (NSPT) has proven to be an excellent tool for calculating perturbative expansions in theories such as Lattice QCD, for which standard, diagrammatic perturbation theory is known to be cumbersome. Despite the significant success of this stochastic method and the improvements made in recent years, NSPT apparently cannot be successfully implemented in low-dimensional models due to the emergence of huge statistical fluctuations: as the perturbative order gets higher, the signal to noise ratio is simply not good enough. This does not come as a surprise, but on very general grounds, one would expect that the larger the number of degrees of freedom, the less severe the fluctuations will be. By simulating $2D$ $O(N)$ non-linear sigma models for different values of $N$, we show that indeed the fluctuations are tamed in the large $N$ limit, meeting our expectations. Having established this, we conclude discussing interesting applications of NSPT in the context of these theories.


title: An equivalent formulation of Sonine condition

abstract: Sonine kernel is characterized by the Sonine condition (denoted by SC) and is an important class of kernels in nonlocal differential equations and integral equations. This work proposes a SC with a more general form (denoted by gSC), which is more convenient than SC to accommodate complex kernels and equations. A typical kernel is given, and the first-kind Volterra integral equation under gSC is accordingly transformed and then analyzed. Based on these results, it is finally proved that the gSC is indeed equivalent to the original SC, which indicates that the Sonine kernel may be essentially characterized by the behavior of its convolution with the associated kernel at the starting point.


title: A note on some bounds between cubic spline interpolants depending on the boundary conditions: Application to a monotonicity property

abstract: In the context of cubic splines, the authors have contributed to a recent paper dealing with the computation of nonlinear derivatives at the interior nodes so that monotonicity is enforced while keeping the order of approximation of the spline as high as possible. During the review process of that paper, one of the reviewers raised the question of whether a cubic spline interpolating monotone data could be forced to preserve monotonicity by imposing suitable values of the first derivative at the endpoints. Albeit a negative answer appears to be intuitive, we have found no results regarding this fact. In this short work we prove that the answer to that question is actually negative.


title: Unveiling the early stage evolution of local atomic structures in the crystallization process of a metallic glass

abstract: The early stage evolution of local atomic structures in a multicomponent metallic glass during its crystallization process has been investigated via molecular dynamics simulation. It is found that the initial thermal stability and earliest stage evolution of the local atomic clusters show no strong correlation with their initial short-range orders, and this leads to an observation of a novel symmetry convergence phenomenon, which can be understood as an atomic structure manifestation of the ergodicity. Furthermore, in our system we have quantitatively proved that the crucial factor for the thermal stability against crystallization exhibited by the metallic glass, is not the total amount of icosahedral clusters, but the degree of global connectivity among them.


title: Adaptive multi-criteria-based load balancing technique for resource allocation in fog-cloud environments

abstract: Recently, to deliver services directly to the network edge, fog computing, an emerging and developing technology, acts as a layer between the cloud and the IoT worlds. The cloud or fog computing nodes could be selected by IoTs applications to meet their resource needs. Due to the scarce resources of fog devices that are available, as well as the need to meet user demands for low latency and quick reaction times, resource allocation in the fog-cloud environment becomes a difficult problem. In this problem, the load balancing between several fog devices is the most important element in achieving resource efficiency and preventing overload on fog devices. In this paper, a new adaptive resource allocation technique for load balancing in a fog-cloud environment is proposed. The proposed technique ranks each fog device using hybrid multi-criteria decision-making approaches Fuzzy Analytic Hierarchy Process (FAHP) and Fuzzy Technique for Order Performance by Similarity to Ideal Solution (FTOPSIS), then selects the most effective fog device based on the resulting ranking set. The simulation results show that the proposed technique outperforms existing techniques in terms of load balancing, response time, resource utilization, and energy consumption. The proposed technique decreases the number of fog nodes by 11%, load balancing variance by 69% and increases resource utilization to 90% which is comparatively higher than the comparable methods.


title: Supervised Algorithmic Fairness in Distribution Shifts: A Survey

abstract: Supervised fairness-aware machine learning under distribution shifts is an emerging field that addresses the challenge of maintaining equitable and unbiased predictions when faced with changes in data distributions from source to target domains. In real-world applications, machine learning models are often trained on a specific dataset but deployed in environments where the data distribution may shift over time due to various factors. This shift can lead to unfair predictions, disproportionately affecting certain groups characterized by sensitive attributes, such as race and gender. In this survey, we provide a summary of various types of distribution shifts and comprehensively investigate existing methods based on these shifts, highlighting six commonly used approaches in the literature. Additionally, this survey lists publicly available datasets and evaluation metrics for empirical studies. We further explore the interconnection with related research fields, discuss the significant challenges, and identify potential directions for future studies.


title: Emerging topological states in EuMn$_2$Bi$_2$: A first principles prediction

abstract: New materials with magnetic order driven topological phases are hugely sought after for their immense application potential. In this work, we propose a new compound EuMn$_2$Bi$_2$ from our first principles density functional theory calculations to host novel topological phases such as Dirac/Weyl semimetal and topological insulator in its different magnetic states which are energetically close to one another. We started with an isostructural compound EuMn$_2$As$_2$ where the magnetic structure has been studied experimentally. From our calculations we could explain the nature of two magnetic transitions observed experimentally in this system and could also establish the correct magnetic ground state. Our electronic structure calculations reveal the insulating nature of the ground state consistent with the experiments. By replacing all As by Bi in EuMn$_2$As$_2$ and by optimizing the new structure, we obtained the new compound EuMn$_2$Bi$_2$. We observe this compound to be dynamically stable from our phonon calculations supporting its experimental preparation in future. By comparing the total energies of various possible magnetic structures we identified the ground state. Though the magnetic ground state is found to be insulating in nature with tiny band gap which is an order of magnitude less than the same in EuMn$_2$As$_2$, there were other magnetic states energetically very close to the ground state which display remarkable non-trivial band topology such as Dirac/Weyl points close to the Fermi level and topological insulator state. The energetic proximity of these magnetic order driven topological phases makes them tunable via external handle which indicates that the proposed new material EuMn$_2$Bi$_2$ would be a very versatile magnetic topological material.


title: AD$^+$ implies that $\omega_1$ is a $\Theta$-Berkeley cardinal

abstract: Following \cite{bagaria2019large}, given cardinals $\kappa<\lambda$, we say $\kappa$ is a club $\lambda$-Berkeley cardinal if for every transitive set $N$ of size $<\lambda$ such that $\kappa\subseteq N$, there is a club $C\subseteq \kappa$ with the property that for every $\eta\in C$ there is an elementary embedding $j: N\rightarrow N$ with crit$(j)=\eta$. We say $\kappa$ is $\nu$-club $\lambda$-Berkeley if $C\subseteq \kappa$ as above is a $\nu$-club. We say $\kappa$ is $\lambda$-Berkeley if $C$ is unbounded in $\kappa$. We show that under AD$^+$, (1) every regular Suslin cardinal is $\omega$-club $\Theta$-Berkeley (see \rthm{main theorem}), (2) $\omega_1$ is club $\Theta$-Berkeley (see \rthm{main theorem lr} and \rthm{main theorem}), and (3) the ${\tilde\delta}^1_{2n}$'s are $\Theta$-Berkeley -- in particular, $\omega_2$ is $\Theta$-Berkeley (see \rrem{omega2}). Along the way, we represent regular Suslin cardinals in direct limits as cutpoint cardinals (see \rthm{char extenders}). This topic has been studied in \cite{MPSC} and \cite{jackson2022suslin}, albeit from a different point of view. We also show that, assuming $V=L(\mathbb{R})+{\mathrm{AD}}$, $\omega_1$ is not $\Theta^+$-Berkeley, so the result stated in the title is optimal (see \rthm{lr optimal} and \rthm{thetareg optimal}).


title: Video Semantic Communication with Major Object Extraction and Contextual Video Encoding

abstract: This paper studies an end-to-end video semantic communication system for massive communication. In the considered system, the transmitter must continuously send the video to the receiver to facilitate character reconstruction in immersive applications, such as interactive video conference. However, transmitting the original video information with substantial amounts of data poses a challenge to the limited wireless resources. To address this issue, we reduce the amount of data transmitted by making the transmitter extract and send the semantic information from the video, which refines the major object and the correlation of time and space in the video. Specifically, we first develop a video semantic communication system based on major object extraction (MOE) and contextual video encoding (CVE) to achieve efficient video transmission. Then, we design the MOE and CVE modules with convolutional neural network based motion estimation, contextual extraction and entropy coding. Simulation results show that compared to the traditional coding schemes, the proposed method can reduce the amount of transmitted data by up to 25% while increasing the peak signal-to-noise ratio (PSNR) of the reconstructed video by up to 14%.


title: A general framework for rotation invariant point cloud analysis

abstract: We propose a general method for deep learning based point cloud analysis, which is invariant to rotation on the inputs. Classical methods are vulnerable to rotation, as they usually take aligned point clouds as input. Principle Component Analysis (PCA) is a practical approach to achieve rotation invariance. However, there are still some gaps between theory and practical algorithms. In this work, we present a thorough study on designing rotation invariant algorithms for point cloud analysis. We first formulate it as a permutation invariant problem, then propose a general framework which can be combined with any backbones. Our method is beneficial for further research such as 3D pre-training and multi-modal learning. Experiments show that our method has considerable or better performance compared to state-of-the-art approaches on common benchmarks. Code is available at https://github.com/luoshuqing2001/RI_framework.


title: Solitons, dispersive shock waves and Noel Fredrick Smyth

abstract: Noel Frederick Smyth (NFS), a Fellow of the Australian Mathematical Society and a Professor of Nonlinear Waves in the School of Mathematics at the University of Edinburgh, passed away on February 5, 2023. NFS was a prominent figure among applied mathematicians who worked on nonlinear wave theory in a broad range of areas. Throughout his academic career, which spanned nearly forty years, NFS developed mathematical models, ideas, and techniques that have had a large impact on the understanding of wave motion in diverse media. His major research emphasis primarily involved the propagation of solitary waves, or solitons, and dispersive shock waves, or undular bores, in various media, including optical fibers, liquid crystals, shallow waters and atmosphere. Several approaches he developed have proven effective in analyzing the dynamics and modulations of related wave phenomena. This tribute in the journal of Wave Motion aims to provide a brief biographical sketch of NFS, discuss his major research achievements, showcase his scientific competence, untiring mentorship and unwavering dedication, as well as share final thoughts from his former students, colleagues, friends, and family. The authors had a special connection with NFS on both on personal and professional levels and hold deep gratitude for him and his invaluable work. In recognition of his achievements in applied mathematics, Wave Motion hosts a Special Issue entitled "Modelling Nonlinear Wave Phenomena: From Theory to Applications," which presents the recent advancements in this field.


title: The Moran model with random resampling rates

abstract: In this paper we consider the two-type Moran model with $N$ individuals. Each individual is assigned a resampling rate, drawn independently from a probability distribution ${\mathbb P}$ on ${\mathbb R}_+$, and a type, either $1$ or $0$. Each individual resamples its type at its assigned rate, by adopting the type of an individual drawn uniformly at random. Let $Y^N(t)$ denote the empirical distribution of the resampling rates of the individuals with type $1$ at time $Nt$. We show that if ${\mathbb P}$ has countable support and satisfies certain tail and moment conditions, then in the limit as $N\to\infty$ the process $(Y^N(t))_{t \geq 0}$ converges in law to the process $(S(t)\,\P)_{t \geq 0}$, in the so-called Meyer-Zheng topology, where $(S(t))_{t \geq 0}$ is the Fisher-Wright diffusion with diffusion constant $D$ given by $1/D = \int_{{\mathbb R}_+} (1/r)\,{\mathbb P}(\mathrm{d} r)$.


title: Weak decays of the triply heavy baryons in the three-quark picture with the light-front quark model

abstract: We investigate the weak decays of the triply heavy baryon $\Omega_{QQQ}$ in the light-front quark model. Since $\Omega_{QQQ}$ consists of three indistinguishable identical heavy quarks, the commonly adopted quark-diquark picture does not seem to be valid anymore. Instead, we employ the three-quark picture for baryons where the three quarks are regarded as individual quarks. We calculate the hadronic form factors for the transitions and give predictions for the decay widths of the semi-leptonic decay modes $\Omega_{ccc}\to \Xi_{cc}/ \Omega_{cc}+ l\bar{\nu}_l$, $\Omega_{bbb}\to \Xi _{bb}+ l \bar{\nu}_l$ and the non-leptonic decay modes $\Omega_{ccc}\to \Xi_{cc}/\Omega_{cc}+ M$, $\Omega_{bbb}\to \Xi_{bb}+ M$. Our study can be a guide for future experiments to discover the triply heavy baryons.


title: Simulator-Free Visual Domain Randomization via Video Games

abstract: Domain randomization is an effective computer vision technique for improving transferability of vision models across visually distinct domains exhibiting similar content. Existing approaches, however, rely extensively on tweaking complex and specialized simulation engines that are difficult to construct, subsequently affecting their feasibility and scalability. This paper introduces BehAVE, a video understanding framework that uniquely leverages the plethora of existing commercial video games for domain randomization, without requiring access to their simulation engines. Under BehAVE (1) the inherent rich visual diversity of video games acts as the source of randomization and (2) player behavior -- represented semantically via textual descriptions of actions -- guides the *alignment* of videos with similar content. We test BehAVE on 25 games of the first-person shooter (FPS) genre across various video and text foundation models and we report its robustness for domain randomization. BehAVE successfully aligns player behavioral patterns and is able to zero-shot transfer them to multiple unseen FPS games when trained on just one FPS game. In a more challenging setting, BehAVE manages to improve the zero-shot transferability of foundation models to unseen FPS games (up to 22%) even when trained on a game of a different genre (Minecraft). Code and dataset can be found at https://github.com/nrasajski/BehAVE.


title: Measurements of the branching fraction ratio $\cal{B}(\phi \to \mu^+\mu^-)/\cal{B}(\phi \to e^+e^-)$ with charm meson decays

abstract: Measurements of the branching fraction ratio ${\cal{B}(\phi \to \mu^+ \mu^-)/\cal{B}(\phi\to e^+e^-)}$ with ${D_{s}^{+} \to \pi^{+} \phi}$ and ${D^{+} \to \pi^{+} \phi}$ decays, denoted $R^{s}_{\phi \pi}$ and $R^{d}_{\phi \pi}$, are presented. The analysis is performed using a dataset corresponding to an integrated luminosity of 5.4$\,\rm{fb}^{-1}$ of $pp$ collision data collected with the LHCb experiment. The branching fractions are normalised with respect to the ${B^{+} \to K^{+} J/\psi(\to e^+e^-)}$ and ${B^{+} \to K^{+} J/\psi(\to \mu^+\mu^-)}$ decay modes. The combination of the results yields $$ R_{\phi \pi} = 1.022 \pm 0.012 \,({\rm stat}) \, \pm 0.048 \,({\rm syst}). $$ The result is compatible with previous measurements of the $\phi \to \ell^{+}\ell^{-}$ branching fractions and predictions based on the Standard Model.


title: Convergence rates for Backward SDEs driven by L\'evy processes

abstract: We consider L\'evy processes that are approximated by compound Poisson processes and, correspondingly, BSDEs driven by L\'evy processes that are approximated by BSDEs driven by their compound Poisson approximations. We are interested in the rate of convergence of the approximate BSDEs to the ones driven by the L\'evy processes. The rate of convergence of the L\'evy processes depends on the Blumenthal--Getoor index of the process. We derive the rate of convergence for the BSDEs in the $\mathbb L^2$-norm and in the Wasserstein distance, and show that, in both cases, this equals the rate of convergence of the corresponding L\'evy process, and thus is optimal.


title: Inferring the Langevin Equation with Uncertainty via Bayesian Neural Networks

abstract: Pervasive across diverse domains, stochastic systems exhibit fluctuations in processes ranging from molecular dynamics to climate phenomena. The Langevin equation has served as a common mathematical model for studying such systems, enabling predictions of their temporal evolution and analyses of thermodynamic quantities, including absorbed heat, work done on the system, and entropy production. However, inferring the Langevin equation from observed trajectories remains challenging, particularly for nonlinear and high-dimensional systems. In this study, we present a comprehensive framework that employs Bayesian neural networks for inferring Langevin equations in both overdamped and underdamped regimes. Our framework first provides the drift force and diffusion matrix separately and then combines them to construct the Langevin equation. By providing a distribution of predictions instead of a single value, our approach allows us to assess prediction uncertainties, which can prevent potential misunderstandings and erroneous decisions about the system. We demonstrate the effectiveness of our framework in inferring Langevin equations for various scenarios including a neuron model and microscopic engine, highlighting its versatility and potential impact.

categories: cond-mat.stat-mech cond-mat.soft cs.LG physics.bio-ph


title: Improving Sequential Recommendations with LLMs

abstract: The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays introducing disruptive effects in many AI-based applications, can be used to build or improve sequential recommendation approaches. Specifically, we design three orthogonal approaches and hybrids of those to leverage the power of LLMs in different ways. In addition, we investigate the potential of each approach by focusing on its comprising technical aspects and determining an array of alternative choices for each one. We conduct extensive experiments on three datasets and explore a large variety of configurations, including different language models and baseline recommendation models, to obtain a comprehensive picture of the performance of each approach. Among other observations, we highlight that initializing state-of-the-art sequential recommendation models such as BERT4Rec or SASRec with embeddings obtained from an LLM can lead to substantial performance gains in terms of accuracy. Furthermore, we find that fine-tuning an LLM for recommendation tasks enables it to learn not only the tasks, but also concepts of a domain to some extent. We also show that fine-tuning OpenAI GPT leads to considerably better performance than fine-tuning Google PaLM 2. Overall, our extensive experiments indicate a huge potential value of leveraging LLMs in future recommendation approaches. We publicly share the code and data of our experiments to ensure reproducibility.


title: SignSGD with Federated Defense: Harnessing Adversarial Attacks through Gradient Sign Decoding

abstract: Distributed learning is an effective approach to accelerate model training using multiple workers. However, substantial communication delays emerge between workers and a parameter server due to massive costs associated with communicating gradients. SignSGD with majority voting (signSGD-MV) is a simple yet effective optimizer that reduces communication costs through one-bit quantization, yet the convergence rates considerably decrease as adversarial workers increase. In this paper, we show that the convergence rate is invariant as the number of adversarial workers increases, provided that the number of adversarial workers is smaller than that of benign workers. The key idea showing this counter-intuitive result is our novel signSGD with federated defense (signSGD-FD). Unlike the traditional approaches, signSGD-FD exploits the gradient information sent by adversarial workers with the proper weights, which are obtained through gradient sign decoding. Experimental results demonstrate signSGD-FD achieves superior convergence rates over traditional algorithms in various adversarial attack scenarios.


title: Fundamental Properties of Causal Entropy and Information Gain

abstract: Recent developments enable the quantification of causal control given a structural causal model (SCM). This has been accomplished by introducing quantities which encode changes in the entropy of one variable when intervening on another. These measures, named causal entropy and causal information gain, aim to address limitations in existing information theoretical approaches for machine learning tasks where causality plays a crucial role. They have not yet been properly mathematically studied. Our research contributes to the formal understanding of the notions of causal entropy and causal information gain by establishing and analyzing fundamental properties of these concepts, including bounds and chain rules. Furthermore, we elucidate the relationship between causal entropy and stochastic interventions. We also propose definitions for causal conditional entropy and causal conditional information gain. Overall, this exploration paves the way for enhancing causal machine learning tasks through the study of recently-proposed information theoretic quantities grounded in considerations about causality.


title: Training-time Neuron Alignment through Permutation Subspace for Improving Linear Mode Connectivity and Model Fusion

abstract: In deep learning, stochastic gradient descent often yields functionally similar yet widely scattered solutions in the weight space even under the same initialization, causing barriers in the Linear Mode Connectivity (LMC) landscape. Overcoming these barriers is crucial for understanding deep learning dynamics and enhancing model-fusion algorithms. Previous studies highlight the role of permutation symmetry in reducing post-training barriers through network permutation. However, these post-hoc methods, demanding extra computations, are less effective for larger, complex models (e.g., ViT, LLM) due to numerous permutation matrices. Thus, in this paper, we study training-time neuron alignment. Our hypothesis suggests that training-time permutation subspace can reduce LMC barriers for free. We find that pruning at initialization supports this. Beyond pruning, we introduce TNA-PFN, a simple yet lossless algorithm using a partial gradient mask during training. TNA-PFN is theoretically and empirically validated for reducing LMC barriers. It excels in wide model fusion applications, especially in federated learning, two algorithms based on TNA-FPN that are proposed to show its prospects even under heterogeneous datasets. Moreover, TNA-PFN can enhance the generalization of model soup for vision transformers and ColD fusion for pretrained language models.


title: Shapelet-based Model-agnostic Counterfactual Local Explanations for Time Series Classification

abstract: In this work, we propose a model-agnostic instance-based post-hoc explainability method for time series classification. The proposed algorithm, namely Time-CF, leverages shapelets and TimeGAN to provide counterfactual explanations for arbitrary time series classifiers. We validate the proposed method on several real-world univariate time series classification tasks from the UCR Time Series Archive. The results indicate that the counterfactual instances generated by Time-CF when compared to state-of-the-art methods, demonstrate better performance in terms of four explainability metrics: closeness, sensibility, plausibility, and sparsity.


title: Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networks

abstract: This paper presents a new bi-Lipschitz invertible neural network, the BiLipNet, which has the ability to smoothly control both its Lipschitzness (output sensitivity to input perturbations) and inverse Lipschitzness (input distinguishability from different outputs). The second main contribution is a new scalar-output network, the PLNet, which is a composition of a BiLipNet and a quadratic potential. We show that PLNet satisfies the Polyak-Lojasiewicz condition and can be applied to learn non-convex surrogate losses with a unique and efficiently-computable global minimum. The central technical element in these networks is a novel invertible residual layer with certified strong monotonicity and Lipschitzness, which we compose with orthogonal layers to build the BiLipNet. The certification of these properties is based on incremental quadratic constraints, resulting in much tighter bounds than can be achieved with spectral normalization. Moreover, we formulate the calculation of the inverse of a BiLipNet -- and hence the minimum of a PLNet -- as a series of three-operator splitting problems, for which fast algorithms can be applied.


title: Skip \n: A Simple Method to Reduce Hallucination in Large Vision-Language Models

abstract: Recent advancements in large vision-language models (LVLMs) have demonstrated impressive capability in visual information understanding with human language. Despite these advances, LVLMs still face challenges with multimodal hallucination, such as generating text descriptions of objects that are not present in the visual information. However, the underlying fundamental reasons of multimodal hallucinations remain poorly explored. In this paper, we propose a new perspective, suggesting that the inherent biases in LVLMs might be a key factor in hallucinations. Specifically, we systematically identify a semantic shift bias related to paragraph breaks (\n\n), where the content before and after '\n\n' in the training data frequently exhibit significant semantic changes. This pattern leads the model to infer that the contents following '\n\n' should be obviously different from the preceding contents with less hallucinatory descriptions, thereby increasing the probability of hallucinatory descriptions subsequent to the '\n\n'. We have validated this hypothesis on multiple publicly available LVLMs. Besides, we find that deliberately inserting '\n\n' at the generated description can induce more hallucinations. A simple method is proposed to effectively mitigate the hallucination of LVLMs by skipping the output of '\n'.


title: The extremal generalised Randi\'c index for a given degree range

abstract: O and Shi proved that the Randi\'c index of any graph $G$ with minimum degree at least $\delta$ and maximum degree at most $\Delta$ is at least $\frac{\sqrt{\delta\Delta}}{\delta+\Delta}|G|$, with equality if and only if the graph is $(\delta,\Delta)$-biregular. In this note we give a short proof via a more general statement. We apply the latter to classify the graphs in any given degree range which minimise (or maximise) the generalised Randi\'c index for any exponent, and describe the transitions between different types of behaviour precisely.


title: Quantum Griffiths singularity in three-dimensional MoTiN superconducting films

abstract: Quantum Griffiths singularity (QGS) has been experimentally observed in a range of two-dimensional (2D) superconducting systems. Although it is theoretically suggested that the QGS also exists in three-dimensional (3D) superconductors, there is almost no experimental support to the theoretical prediction. In the present paper, we observe the occurrence of QGS in a series of $\sim$80-nm-thick Mo$_{0.8}$Ti$_{0.2}$N$_x$ ($0.84 \lesssim x \lesssim 1.12$) superconducting films near the field-driven superconductor-metal transition (SMT). These films have a NaCl structure and are 3D with respect to the superconductivity. For each film, the low-temperature magnetoresistance isotherms, measured at magnetic fields being perpendicular or parallel to the film plane, do not cross at a single point but at a clear wide region. The dynamical critical exponents $z\nu_{\perp}$ (for perpendicular field) and $z\nu_{\parallel}$ (for parallel field) obtained by analyzing the related magnetoresistance isotherms increase with decreasing temperature and tend to diverge as $T\rightarrow 0$ K. In addition, the effective resistivity data for the perpendicular and parallel field in the vicinity of the SMTs both obey an activated scaling based on the random transverse-field Ising model. We also fabricate a $\sim$80-nm-thick (Mo$_{0.8}$Ti$_{0.2}$)$_2$N$_{1.06}$ superconducting film with face-centered cubic structure at low nitrogen partial pressure. It is found that the low-temperature magnetoresistance isotherms for the perpendicular (parallel) field cross at a single point and the resistivity data for the perpendicular (parallel) field in the vicinity of the field-induced SMT obey the power-law scaling deduced from the dirty-boson model. Our results provide unambigous experimental evidence for the existence of QGS in 3D superconductors.


title: CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay

abstract: This paper introduces a novel perspective to significantly mitigate catastrophic forgetting in continuous learning (CL), which emphasizes models' capacity to preserve existing knowledge and assimilate new information. Current replay-based methods treat every task and data sample equally and thus can not fully exploit the potential of the replay buffer. In response, we propose COgnitive REplay (CORE), which draws inspiration from human cognitive review processes. CORE includes two key strategies: Adaptive Quantity Allocation and Quality-Focused Data Selection. The former adaptively modulates the replay buffer allocation for each task based on its forgetting rate, while the latter guarantees the inclusion of representative data that best encapsulates the characteristics of each task within the buffer. Our approach achieves an average accuracy of 37.95% on split-CIFAR10, surpassing the best baseline method by 6.52%. Additionally, it significantly enhances the accuracy of the poorest-performing task by 6.30% compared to the top baseline. Code is available at https://github.com/sterzhang/CORE.


title: Beyond the Answers: Reviewing the Rationality of Multiple Choice Question Answering for the Evaluation of Large Language Models

abstract: In the field of natural language processing (NLP), Large Language Models (LLMs) have precipitated a paradigm shift, markedly enhancing performance in natural language generation tasks. Despite these advancements, the comprehensive evaluation of LLMs remains an inevitable challenge for the community. Recently, the utilization of Multiple Choice Question Answering (MCQA) as a benchmark for LLMs has gained considerable traction. This study first investigates the limitations of MCQA as an evaluation method for LLMs and then analyzes the fundamental reason for the limitations of MCQA, that while LLMs may select the correct answers, it is possible that they also recognize other wrong options as correct. Finally, we propose a dataset augmenting method for Multiple-Choice Questions (MCQs), MCQA+, that can more accurately reflect the performance of the model, which underscores the need for more robust evaluation mechanisms in assessing the performance of LLMs.


title: pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning

abstract: Federated learning (FL) has been widely adopted for collaborative training on decentralized data. However, it faces the challenges of data, system, and model heterogeneity. This has inspired the emergence of model-heterogeneous personalized federated learning (MHPFL). Nevertheless, the problem of ensuring data and model privacy, while achieving good model performance and keeping communication and computation costs low remains open in MHPFL. To address this problem, we propose a model-heterogeneous personalized Federated learning with Mixture of Experts (pFedMoE) method. It assigns a shared homogeneous small feature extractor and a local gating network for each client's local heterogeneous large model. Firstly, during local training, the local heterogeneous model's feature extractor acts as a local expert for personalized feature (representation) extraction, while the shared homogeneous small feature extractor serves as a global expert for generalized feature extraction. The local gating network produces personalized weights for extracted representations from both experts on each data sample. The three models form a local heterogeneous MoE. The weighted mixed representation fuses generalized and personalized features and is processed by the local heterogeneous large model's header with personalized prediction information. The MoE and prediction header are updated simultaneously. Secondly, the trained local homogeneous small feature extractors are sent to the server for cross-client information fusion via aggregation. Overall, pFedMoE enhances local model personalization at a fine-grained data level, while supporting model heterogeneity.


title: Production of hypernuclei from antiproton capture within a relativistic transport model

abstract: Production yields of single-$\Lambda$ hypernuclei from simulated peripheral annihilations of antiprotons after capture on various target nuclei are reported. The initial annihilation process and the production of excited hypernuclei are estimated within the GiBUU transport framework, while their deexcitation process is treated with the ABLA++ code. The yield of excited hypernuclei range from $\sim$ 0.3% for $^{16}$O to $\sim$ 1.2% for $^{132}$Xe per annihilation, consistent with previous measurements at LEAR, CERN. The yield of specific ground state hypernuclei after deexcitation reaches up to a few 10$^{-4}$ per annihilation. The hypernuclei are produced in strangeness exchange reactions occuring between a nucleon of the target and the kaons originating from the annihilation in $\sim$ 80% of the cases, while the strangeness pair production in secondary pion-nucleon collision contributes to the remaining $\sim$ 20%. The simulations indicate that antiproton annihilations at rest on different nuclei could populate a wide range of so-far unexplored hypernuclei.


title: Describing Images $\textit{Fast and Slow}$: Quantifying and Predicting the Variation in Human Signals during Visuo-Linguistic Processes

abstract: There is an intricate relation between the properties of an image and how humans behave while describing the image. This behavior shows ample variation, as manifested in human signals such as eye movements and when humans start to describe the image. Despite the value of such signals of visuo-linguistic variation, they are virtually disregarded in the training of current pretrained models, which motivates further investigation. Using a corpus of Dutch image descriptions with concurrently collected eye-tracking data, we explore the nature of the variation in visuo-linguistic signals, and find that they correlate with each other. Given this result, we hypothesize that variation stems partly from the properties of the images, and explore whether image representations encoded by pretrained vision encoders can capture such variation. Our results indicate that pretrained models do so to a weak-to-moderate degree, suggesting that the models lack biases about what makes a stimulus complex for humans and what leads to variations in human outputs.


title: Efficient compilation of expressive problem space specifications to neural network solvers

abstract: Recent work has described the presence of the embedding gap in neural network verification. On one side of the gap is a high-level specification about the network's behaviour, written by a domain expert in terms of the interpretable problem space. On the other side are a logically-equivalent set of satisfiability queries, expressed in the uninterpretable embedding space in a form suitable for neural network solvers. In this paper we describe an algorithm for compiling the former to the latter. We explore and overcome complications that arise from targeting neural network solvers as opposed to standard SMT solvers.


title: Forecasting Volatility of Oil-based Commodities: The Model of Dynamic Persistence

abstract: Time variation and persistence are crucial properties of volatility that are often studied separately in oil-based volatility forecasting models. Here, we propose a novel approach that allows shocks with heterogeneous persistence to vary smoothly over time, and thus model the two together. We argue that this is important because such dynamics arise naturally from the dynamic nature of shocks in oil-based commodities. We identify such dynamics from the data using localised regressions and build a model that significantly improves volatility forecasts. Such forecasting models, based on a rich persistence structure that varies smoothly over time, outperform state-of-the-art benchmark models and are particularly useful for forecasting over longer horizons.


title: FindingEmo: An Image Dataset for Emotion Recognition in the Wild

abstract: We introduce FindingEmo, a new image dataset containing annotations for 25k images, specifically tailored to Emotion Recognition. Contrary to existing datasets, it focuses on complex scenes depicting multiple people in various naturalistic, social settings, with images being annotated as a whole, thereby going beyond the traditional focus on faces or single individuals. Annotated dimensions include Valence, Arousal and Emotion label, with annotations gathered using Prolific. Together with the annotations, we release the list of URLs pointing to the original images, as well as all associated source code.


title: Algebraic properties of the ring $C(X)_\mathcal{P}$

abstract: Our aim is to study certain algebraic properties of the ring $C(X)_\mathcal{P}$ of real-valued functions on $X$ whose closure of discontinuity set is in an ideal of closed sets. We characterize $\mathcal{P}P$-spaces using $z$-ideals and essential ideals of $C(X)_\mathcal{P}$ and also almost $\mathcal{P}P$-spaces using $z^0$-ideals of $C(X)_\mathcal{P}$ and a topology finer than the original topology on $X$. We deduce that each maximal ideal of $C(X)_F$ \cite{GGT2018} (resp. $T'(X)$ \cite{A2010}) is a $z^0$-ideal. We establish that the notions of clean ring, weakly clean ring, semiclean ring, almost clean ring and exchange ring coincide in the ring $C(X)_\mathcal{P}$. End of this paper, we also characterize $\mathcal{P}P$-spaces and almost $\mathcal{P}P$-spaces using certain ideals having depth zero. We exhibit a condition on $\mathcal{P}$ under which prime and essential ideals of $C(X)_\mathcal{P}$ have depth zero.


title: Holographic complexity of the extended Schwarzschild-de Sitter space

abstract: According to static patch holography, de Sitter space admits a unitary quantum description in terms of a dual theory living on the stretched horizon, that is a timelike surface close to the cosmological horizon. In this manuscript, we compute several holographic complexity conjectures in a periodic extension of the Schwarzschild-de Sitter black hole. We consider multiple configurations of the stretched horizons to which geometric objects are anchored. The holographic complexity proposals admit a hyperfast growth when the gravitational observables only lie in the cosmological patch, except for a class of complexity=anything observables that admit a linear growth. All the complexity conjectures present a linear increase when restricted to the black hole patch, similar to the AdS case. When both the black hole and the cosmological regions are probed, codimension-zero proposals are time-independent, while codimension-one proposals can have non-trivial evolution with linear increase at late times. As a byproduct of our analysis, we find that codimension-one spacelike surfaces are highly constrained in Schwarzschild-de Sitter space. Therefore, different locations of the stretched horizon give rise to different behaviours of the complexity conjectures.


title: A criterion for a normal subgroup to be hypercentral based on class sizes

abstract: Let $G$ be a finite group and $N$ a normal subgroup of $G$. We prove that the knowledge of the sizes of the conjugacy classes of $G$ that are contained in $N$ and of their multiplicities provides information of $N$ in relation to the structure of $G$. Among other results, we obtain a criterion to determine whether a Sylow $p$-subgroup of $N$ lies in the hypercentre of $G$ for a fixed prime $p$, and therefore, whether the whole subgroup $N$ is hypercentral in $G$.


title: TESSERACT: Eliminating Experimental Bias in Malware Classification across Space and Time (Extended Version)

abstract: Machine learning (ML) plays a pivotal role in detecting malicious software. Despite the high F1-scores reported in numerous studies reaching upwards of 0.99, the issue is not completely solved. Malware detectors often experience performance decay due to constantly evolving operating systems and attack methods, which can render previously learned knowledge insufficient for accurate decision-making on new inputs. This paper argues that commonly reported results are inflated due to two pervasive sources of experimental bias in the detection task: spatial bias caused by data distributions that are not representative of a real-world deployment; and temporal bias caused by incorrect time splits of data, leading to unrealistic configurations. To address these biases, we introduce a set of constraints for fair experiment design, and propose a new metric, AUT, for classifier robustness in real-world settings. We additionally propose an algorithm designed to tune training data to enhance classifier performance. Finally, we present TESSERACT, an open-source framework for realistic classifier comparison. Our evaluation encompasses both traditional ML and deep learning methods, examining published works on an extensive Android dataset with 259,230 samples over a five-year span. Additionally, we conduct case studies in the Windows PE and PDF domains. Our findings identify the existence of biases in previous studies and reveal that significant performance enhancements are possible through appropriate, periodic tuning. We explore how mitigation strategies may support in achieving a more stable and better performance over time by employing multiple strategies to delay performance decay.


title: What Makes Medical Claims (Un)Verifiable? Analyzing Entity and Relation Properties for Fact Verification

abstract: Biomedical claim verification fails if no evidence can be discovered. In these cases, the fact-checking verdict remains unknown and the claim is unverifiable. To improve upon this, we have to understand if there are any claim properties that impact its verifiability. In this work we assume that entities and relations define the core variables in a biomedical claim's anatomy and analyze if their properties help us to differentiate verifiable from unverifiable claims. In a study with trained annotation experts we prompt them to find evidence for biomedical claims, and observe how they refine search queries for their evidence search. This leads to the first corpus for scientific fact verification annotated with subject-relation-object triplets, evidence documents, and fact-checking verdicts (the BEAR-Fact corpus). We find (1) that discovering evidence for negated claims (e.g., X-does-not-cause-Y) is particularly challenging. Further, we see that annotators process queries mostly by adding constraints to the search and by normalizing entities to canonical names. (2) We compare our in-house annotations with a small crowdsourcing setting where we employ medical experts and laypeople. We find that domain expertise does not have a substantial effect on the reliability of annotations. Finally, (3), we demonstrate that it is possible to reliably estimate the success of evidence retrieval purely from the claim text~(.82\F), whereas identifying unverifiable claims proves more challenging (.27\F). The dataset is available at http://www.ims.uni-stuttgart.de/data/bioclaim.


title: To the Max: Reinventing Reward in Reinforcement Learning

abstract: In reinforcement learning (RL), different rewards can define the same optimal policy but result in drastically different learning performance. For some, the agent gets stuck with a suboptimal behavior, and for others, it solves the task efficiently. Choosing a good reward function is hence an extremely important yet challenging problem. In this paper, we explore an alternative approach to using rewards for learning. We introduce max-reward RL, where an agent optimizes the maximum rather than the cumulative reward. Unlike earlier works, our approach works for deterministic and stochastic environments and can be easily combined with state-of-the-art RL algorithms. In the experiments, we study the performance of max-reward RL algorithms in two goal-reaching environments from Gymnasium-Robotics and demonstrate its benefits over standard RL. The code is publicly available.


title: Catching thermal avalanches in the disordered XXZ model

abstract: We study the XXZ model with a random magnetic field in contact with a weakly disordered spin chain, acting as a finite thermal bath. We revise Fermi's golden rule description of the interaction between the thermal bath and the XXZ spin chain, contrasting it with a nonperturbative quantum avalanche scenario for the thermalization of the system. We employ two-point correlation functions to define the extent $\xi_d$ of the thermalized region next to the bath. Unbounded growth of $\xi_d$ proportional to the logarithm of time or faster is a signature of an avalanche. Such behavior signifies the thermalization of the system, as we confirm numerically for a generic initial state in the ergodic and critical regimes of the XXZ spin chain. In the many-body localized regime, a clear termination of avalanches is observed for specifically prepared initial states and, surprisingly, is not visible for generic initial product states. Additionally, we extract the localization length of the local integrals of motion and show that a bath made out of a weakly disordered XXZ chain has a similar effect on the system as a bath modeled by a Hamiltonian from a Gaussian orthogonal ensemble of random matrices. We also comment on the result of the earlier study (Phys. Rev. B 108, L020201 (2023)), arguing that the observed thermalization is due to external driving of the system and does not occur in the autonomous model. Our work reveals experimentally accessible signatures of quantum avalanches and identifies conditions under which termination of the avalanches may be observed.


title: Bribe & Fork: Cheap Bribing Attacks via Forking Threat

abstract: In this work, we reexamine the vulnerability of Payment Channel Networks (PCNs) to bribing attacks, where an adversary incentivizes blockchain miners to deliberately ignore a specific transaction to undermine the punishment mechanism of PCNs. While previous studies have posited a prohibitive cost for such attacks, we show that this cost may be dramatically reduced (to approximately \$125), thereby increasing the likelihood of these attacks. To this end, we introduce Bribe & Fork, a modified bribing attack that leverages the threat of a so-called feather fork which we analyze with a novel formal model for the mining game with forking. We empirically analyze historical data of some real-world blockchain implementations to evaluate the scale of this cost reduction. Our findings shed more light on the potential vulnerability of PCNs and highlight the need for robust solutions.


title: Continual Learning for Large Language Models: A Survey

abstract: Large language models (LLMs) are not amenable to frequent re-training, due to high training costs arising from their massive scale. However, updates are necessary to endow LLMs with new skills and keep them up-to-date with rapidly evolving human knowledge. This paper surveys recent works on continual learning for LLMs. Due to the unique nature of LLMs, we catalog continue learning techniques in a novel multi-staged categorization scheme, involving continual pretraining, instruction tuning, and alignment. We contrast continual learning for LLMs with simpler adaptation methods used in smaller models, as well as with other enhancement strategies like retrieval-augmented generation and model editing. Moreover, informed by a discussion of benchmarks and evaluation, we identify several challenges and future work directions for this crucial task.


title: $p$-adic non-abelian Hodge theory for curves via moduli stacks

abstract: For a smooth projective curve $X$ over $\mathbb C_p$ and any reductive group $G$, we show that the moduli stack of $G$-Higgs bundles on $X$ is a twist of the moduli stack of v-topological $G$-bundles on $X_v$ in a canonical way. We explain how a choice of an exponential trivialises this twist on points. This yields a geometrisation of Faltings' $p$-adic Simpson correspondence for $X$, which we recover as a homeomorphism between the points of moduli spaces. We also show that our twisted isomorphism sends the stack of $p$-adic representations of $\pi_1(X)$ to an open substack of the stack of semi-stable Higgs bundles of degree $0$.


title: MagicTac: A Novel High-Resolution 3D Multi-layer Grid-Based Tactile Sensor

abstract: Accurate robotic control over interactions with the environment is fundamentally grounded in understanding tactile contacts. In this paper, we introduce MagicTac, a novel high-resolution grid-based tactile sensor. This sensor employs a 3D multi-layer grid-based design, inspired by the Magic Cube structure. This structure can help increase the spatial resolution of MagicTac to perceive external interaction contacts. Moreover, the sensor is produced using the multi-material additive manufacturing technique, which simplifies the manufacturing process while ensuring repeatability of production. Compared to traditional vision-based tactile sensors, it offers the advantages of i) high spatial resolution, ii) significant affordability, and iii) fabrication-friendly construction that requires minimal assembly skills. We evaluated the proposed MagicTac in the tactile reconstruction task using the deformation field and optical flow. Results indicated that MagicTac could capture fine textures and is sensitive to dynamic contact information. Through the grid-based multi-material additive manufacturing technique, the affordability and productivity of MagicTac can be enhanced with a minimum manufacturing cost of 4.76 GBP and a minimum manufacturing time of 24.6 minutes.


title: Periodicity and pure periodicity in alternate base systems

abstract: We study the Cantor real base numeration system which is a common generalization of two positional systems, namely the Cantor system with a sequence of integer bases and the R\'enyi system with one real base. We focus on the so-called alternate base $B$ given by a purely periodic sequence of real numbers greater than 1. We answer an open question of Charlier et al. on the set of numbers with eventually periodic $B$-expansions. We also investigate for which bases all sufficiently small rationals have a purely periodic $B$-expansion.


title: LIR: A Lightweight Baseline for Image Restoration

abstract: Recently, there have been significant advancements in Image Restoration based on CNN and transformer. However, the inherent characteristics of the Image Restoration task are often overlooked in many works. They, instead, tend to focus on the basic block design and stack numerous such blocks to the model, leading to parameters redundant and computations unnecessary. Thus, the efficiency of the image restoration is hindered. In this paper, we propose a Lightweight Baseline network for Image Restoration called LIR to efficiently restore the image and remove degradations. First of all, through an ingenious structural design, LIR removes the degradations existing in the local and global residual connections that are ignored by modern networks. Then, a Lightweight Adaptive Attention (LAA) Block is introduced which is mainly composed of proposed Adaptive Filters and Attention Blocks. The proposed Adaptive Filter is used to adaptively extract high-frequency information and enhance object contours in various IR tasks, and Attention Block involves a novel Patch Attention module to approximate the self-attention part of the transformer. On the deraining task, our LIR achieves the state-of-the-art Structure Similarity Index Measure (SSIM) and comparable performance to state-of-the-art models on Peak Signal-to-Noise Ratio (PSNR). For denoising, dehazing, and deblurring tasks, LIR also achieves a comparable performance to state-of-the-art models with a parameter size of about 30\%. In addition, it is worth noting that our LIR produces better visual results that are more in line with the human aesthetic.


title: Cheating Suffix: Targeted Attack to Text-To-Image Diffusion Models with Multi-Modal Priors

abstract: Diffusion models have been widely deployed in various image generation tasks, demonstrating an extraordinary connection between image and text modalities. However, they face challenges of being maliciously exploited to generate harmful or sensitive images by appending a specific suffix to the original prompt. Existing works mainly focus on using single-modal information to conduct attacks, which fails to utilize multi-modal features and results in less than satisfactory performance. Integrating multi-modal priors (MMP), i.e. both text and image features, we propose a targeted attack method named MMP-Attack in this work. Specifically, the goal of MMP-Attack is to add a target object into the image content while simultaneously removing the original object. The MMP-Attack shows a notable advantage over existing works with superior universality and transferability, which can effectively attack commercial text-to-image (T2I) models such as DALL-E 3. To the best of our knowledge, this marks the first successful attempt of transfer-based attack to commercial T2I models. Our code is publicly available at \url{https://github.com/ydc123/MMP-Attack}.


title: CC-VPSTO: Chance-Constrained Via-Point-based Stochastic Trajectory Optimisation for Safe and Efficient Online Robot Motion Planning

abstract: Safety in the face of uncertainty is a key challenge in robotics. We introduce a real-time capable framework to generate safe and task-efficient robot motions for stochastic control problems. We frame this as a chance-constrained optimisation problem constraining the probability of the controlled system to violate a safety constraint to be below a set threshold. To estimate this probability we propose a Monte--Carlo approximation. We suggest several ways to construct the problem given a fixed number of uncertainty samples, such that it is a reliable over-approximation of the original problem, i.e. any solution to the sample-based problem adheres to the original chance-constraint with high confidence. To solve the resulting problem, we integrate it into our motion planner VP-STO and name the enhanced framework Chance-Constrained (CC)-VPSTO. The strengths of our approach lie in i) its generality, without assumptions on the underlying uncertainty distribution, system dynamics, cost function, or the form of inequality constraints; and ii) its applicability to MPC-settings. We demonstrate the validity and efficiency of our approach on both simulation and real-world robot experiments.


title: Two-Timescale Critic-Actor for Average Reward MDPs with Function Approximation

abstract: In recent years, there has been a lot of research activity focused on carrying out non-asymptotic convergence analyses for actor-critic algorithms. Recently a two-timescale critic-actor algorithm has been presented for the discounted cost setting in the look-up table case where the timescales of the actor and the critic are reversed and only asymptotic convergence shown. In our work, we present the first two-timescale critic-actor algorithm with function approximation in the long-run average reward setting and present the first finite-time non-asymptotic as well as asymptotic convergence analysis for such a scheme. We obtain optimal learning rates and prove that our algorithm achieves a sample complexity of $\mathcal{\tilde{O}}(\epsilon^{-2.08})$ for the mean squared error of the critic to be upper bounded by $\epsilon$ which is better than the one obtained for two-timescale actor-critic in a similar setting. A notable feature of our analysis is that unlike recent single-timescale actor-critic algorithms, we present a complete asymptotic convergence analysis of our scheme in addition to the finite-time bounds that we obtain and show that the (slower) critic recursion converges asymptotically to the attractor of an associated differential inclusion with actor parameters corresponding to local maxima of a perturbed average reward objective. We also show the results of numerical experiments on three benchmark settings and observe that our critic-actor algorithm performs on par and is in fact better than the other algorithms considered.


title: The Freeness Problem for Automaton Semigroups

abstract: We show that the freeness problems for automaton semigroups and for automaton monoids are undecidable by giving a reduction from Post's Correspondence Problem. This construction seems to be quite versatile and we also immediately obtain that the problems of testing whether a given automaton semigroup (monoid) is (left) cancellative or whether it is equidivisible are undecidable. We also obtain that it is undecidable whether a given map extends into a homomorphism of automaton semigroups. Finally, we adapt our construction to show that it is undecidable whether a given automaton generates a free monoid whose basis is given by the states (but where we allow one state to act as the identity). In the semigroup case, we show a weaker version of this statement.


title: cmaes : A Simple yet Practical Python Library for CMA-ES

abstract: The covariance matrix adaptation evolution strategy (CMA-ES) has been highly effective in black-box continuous optimization, as demonstrated by its success in both benchmark problems and various real-world applications. To address the need for an accessible yet potent tool in this domain, we developed cmaes, a simple and practical Python library for CMA-ES. cmaes is characterized by its simplicity, offering intuitive use and high code readability. This makes it suitable for quickly using CMA-ES, as well as for educational purposes and seamless integration into other libraries. Despite its simplistic design, cmaes maintains enhanced functionality. It incorporates recent advancements in CMA-ES, such as learning rate adaptation for challenging scenarios, transfer learning, and mixed-integer optimization capabilities. These advanced features are accessible through a user-friendly API, ensuring that cmaes can be easily adopted in practical applications. We regard cmaes as the first choice for a Python CMA-ES library among practitioners. The software is available under the MIT license at https://github.com/CyberAgentAILab/cmaes.


title: A micro-opto-mechanical glass interferometer for megahertz modulation of optical signals

abstract: Waveguide-based interferometric circuits are widely employed in optical communications, sensing and computing applications. In particular, glass-based devices are appealing due to the transparency and bio-compatibility of this substrate, or where low-loss interfacing with fiber networks is required. However, fast electro-optic phase modulation is hard to achieve in glass materials. Here, we demonstrate an optical phase and intensity modulator in glass, working in the megahertz range. This modulator exploits the elasto-optic effect inside a mechanical microstructure, brought to oscillation at resonance, and is entirely realized by femtosecond laser micromachining. In detail, we demonstrate 23-dB optical intensity modulation at 1.17 MHz, with an internal optical loss of the phase-modulator component as low as 0.04 dB.


title: Dive into the Chasm: Probing the Gap between In- and Cross-Topic Generalization

abstract: Pre-trained language models (LMs) perform well in In-Topic setups, where training and testing data come from the same topics. However, they face challenges in Cross-Topic scenarios where testing data is derived from distinct topics -- such as Gun Control. This study analyzes various LMs with three probing-based experiments to shed light on the reasons behind the In- vs. Cross-Topic generalization gap. Thereby, we demonstrate, for the first time, that generalization gaps and the robustness of the embedding space vary significantly across LMs. Additionally, we assess larger LMs and underscore the relevance of our analysis for recent models. Overall, diverse pre-training objectives, architectural regularization, or data deduplication contribute to more robust LMs and diminish generalization gaps. Our research contributes to a deeper understanding and comparison of language models across different generalization scenarios.


title: LoTR: Low Tensor Rank Weight Adaptation

abstract: In this paper we generalize and extend an idea of low-rank adaptation (LoRA) of large language models (LLMs) based on Transformer architecture. Widely used LoRA-like methods of fine-tuning LLMs are based on matrix factorization of gradient update. We introduce LoTR, a novel approach for parameter-efficient fine-tuning of LLMs which represents a gradient update to parameters in a form of tensor decomposition. Low-rank adapter for each layer is constructed as a product of three matrices, and tensor structure arises from sharing left and right multipliers of this product among layers. Simultaneous compression of a sequence of layers with low-rank tensor representation allows LoTR to archive even better parameter efficiency then LoRA especially for deep models. Moreover, the core tensor does not depend on original weight dimension and can be made arbitrary small, which allows for extremely cheap and fast downstream fine-tuning.


title: Shifts on trees versus classical shifts in chain recurrence

abstract: We construct continuous (and even invertible) linear operators acting on Banach (even Hilbert) spaces whose restrictions to their respective closed linear subspaces of chain recurrent vectors are not chain recurrent operators. This construction completely solves in the negative a problem posed by Nilson C. Bernardes Jr. and Alfred Peris on chain recurrence in Linear Dynamics. In particular: we show that the non-invertible case can be directly solved via relatively simple weighted backward shifts acting on certain unrooted directed trees; then we modify the non-invertible counterexample to address the invertible case, but falling outside the class of weighted shift operators; and we finally show that this behaviour cannot be achieved via classical (unilateral neither bilateral) weighted backward sifts (acting on $\mathbb{N}$ and $\mathbb{Z}$ respectively) by noticing that a classical shift is a chain recurrent operator whenever it admits a non-zero chain recurrent vector.


title: On the geometry of zero sets of central quaternionic polynomials

abstract: Let R be the ring of polynomials in n central variables over the real quaternion algebra H, and let I be a left ideal in R. We prove that if a polynomial p in R vanishes at all the common zeros of I in H^n with commuting coordinates, then as a slice regular quaternionic function, p vanishes at all common zeros of I in H^n. This confirms a conjecture of Gori, Sarfatti and Vlacci, who settled the two dimensional case.


title: Regularized boosting with an increasing coefficient magnitude stop criterion as meta-learner in hyperparameter optimization stacking ensemble

abstract: In Hyperparameter Optimization (HPO), only the hyperparameter configuration with the best performance is chosen after performing several trials, then, discarding the effort of training all the models with every hyperparameter configuration trial and performing an ensemble of all them. This ensemble consists of simply averaging the model predictions or weighting the models by a certain probability. Recently, other more sophisticated ensemble strategies, such as the Caruana method or the stacking strategy has been proposed. On the one hand, the Caruana method performs well in HPO ensemble, since it is not affected by the effects of multicollinearity, which is prevalent in HPO. It just computes the average over a subset of predictions with replacement. But it does not benefit from the generalization power of a learning process. On the other hand, stacking methods include a learning procedure since a meta-learner is required to perform the ensemble. Yet, one hardly finds advice about which meta-learner is adequate. Besides, some meta-learners may suffer from the effects of multicollinearity or need to be tuned to reduce them. This paper explores meta-learners for stacking ensemble in HPO, free of hyperparameter tuning, able to reduce the effects of multicollinearity and considering the ensemble learning process generalization power. At this respect, the boosting strategy seems promising as a stacking meta-learner. In fact, it completely removes the effects of multicollinearity. This paper also proposes an implicit regularization in the classical boosting method and a novel non-parametric stop criterion suitable only for boosting and specifically designed for HPO. The synergy between these two improvements over boosting exhibits competitive and promising predictive power performance compared to other existing meta-learners and ensemble approaches for HPO other than the stacking ensemble.


title: Efficient Dynamic-NeRF Based Volumetric Video Coding with Rate Distortion Optimization

abstract: Volumetric videos, benefiting from immersive 3D realism and interactivity, hold vast potential for various applications, while the tremendous data volume poses significant challenges for compression. Recently, NeRF has demonstrated remarkable potential in volumetric video compression thanks to its simple representation and powerful 3D modeling capabilities, where a notable work is ReRF. However, ReRF separates the modeling from compression process, resulting in suboptimal compression efficiency. In contrast, in this paper, we propose a volumetric video compression method based on dynamic NeRF in a more compact manner. Specifically, we decompose the NeRF representation into the coefficient fields and the basis fields, incrementally updating the basis fields in the temporal domain to achieve dynamic modeling. Additionally, we perform end-to-end joint optimization on the modeling and compression process to further improve the compression efficiency. Extensive experiments demonstrate that our method achieves higher compression efficiency compared to ReRF on various datasets.


title: Spatial-Sign based Maxsum Test for High Dimensional Location Parameters

abstract: In this study, we explore a robust testing procedure for the high-dimensional location parameters testing problem. Initially, we introduce a spatial-sign based max-type test statistic, which exhibits excellent performance for sparse alternatives. Subsequently, we demonstrate the asymptotic independence between this max-type test statistic and the spatial-sign based sum-type test statistic (Feng and Sun, 2016). Building on this, we propose a spatial-sign based max-sum type testing procedure, which shows remarkable performance under varying signal sparsity. Our simulation studies underscore the superior performance of the procedures we propose.


title: Emergence of heavy tails in homogenized stochastic gradient descent

abstract: It has repeatedly been observed that loss minimization by stochastic gradient descent (SGD) leads to heavy-tailed distributions of neural network parameters. Here, we analyze a continuous diffusion approximation of SGD, called homogenized stochastic gradient descent, show that it behaves asymptotically heavy-tailed, and give explicit upper and lower bounds on its tail-index. We validate these bounds in numerical experiments and show that they are typically close approximations to the empirical tail-index of SGD iterates. In addition, their explicit form enables us to quantify the interplay between optimization parameters and the tail-index. Doing so, we contribute to the ongoing discussion on links between heavy tails and the generalization performance of neural networks as well as the ability of SGD to avoid suboptimal local minima.


title: LLM-based NLG Evaluation: Current Status and Challenges

abstract: Evaluating natural language generation (NLG) is a vital but challenging problem in artificial intelligence. Traditional evaluation metrics mainly capturing content (e.g. n-gram) overlap between system outputs and references are far from satisfactory, and large language models (LLMs) such as ChatGPT have demonstrated great potential in NLG evaluation in recent years. Various automatic evaluation methods based on LLMs have been proposed, including metrics derived from LLMs, prompting LLMs, and fine-tuning LLMs with labeled evaluation data. In this survey, we first give a taxonomy of LLM-based NLG evaluation methods, and discuss their pros and cons, respectively. We also discuss human-LLM collaboration for NLG evaluation. Lastly, we discuss several open problems in this area and point out future research directions.


title: The M{\o}ller-Plesset Adiabatic Connection at Large Coupling Strengths for Open-shell Systems

abstract: We study the adiabatic connection that has as weak-coupling expansion the M{\o}ller-Plesset perturbation series, generalizing to the open-shell case previous closed-shell results for the large-coupling limit. We first focus on the hydrogen atom with fractional spins, providing results along the adiabatic connection, from small to large coupling strengths. We reveal an intriguing phase diagram, and an equation for the large-coupling leading order that has closed-form solutions for specific choices of its relevant quantum numbers. We then show that the hydrogen atom results provide variational estimates for the large-coupling leading terms for the general many-electron open-shell case in terms of functionals of the Hartree-Fock {\alpha}-spin and {\beta}-spin densities.


title: Del Visual al Auditivo: Sonorizaci\'on de Escenas Guiada por Imagen

abstract: Recent advances in image, video, text and audio generative techniques, and their use by the general public, are leading to new forms of content generation. Usually, each modality was approached separately, which poses limitations. The automatic sound recording of visual sequences is one of the greatest challenges for the automatic generation of multimodal content. We present a processing flow that, starting from images extracted from videos, is able to sound them. We work with pre-trained models that employ complex encoders, contrastive learning, and multiple modalities, allowing complex representations of the sequences for their sonorization. The proposed scheme proposes different possibilities for audio mapping and text guidance. We evaluated the scheme on a dataset of frames extracted from a commercial video game and sounds extracted from the Freesound platform. Subjective tests have evidenced that the proposed scheme is able to generate and assign audios automatically and conveniently to images. Moreover, it adapts well to user preferences, and the proposed objective metrics show a high correlation with the subjective ratings.


title: Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

abstract: Recent advancements in Large Language Models (LLMs) have enabled collaborative human-bot interactions in Software Engineering (SE), similar to many other professions. However, the potential benefits and implications of incorporating LLMs into qualitative data analysis in SE have not been completely explored. For instance, conducting qualitative data analysis manually can be a time-consuming, effort-intensive, and error-prone task for researchers. LLM-based solutions, such as generative AI models trained on massive datasets, can be utilized to automate tasks in software development as well as in qualitative data analysis. To this end, we utilized LLMs to automate and expedite the qualitative data analysis processes. We employed a multi-agent model, where each agent was tasked with executing distinct, individual research related activities. Our proposed model interpreted large quantities of textual documents and interview transcripts to perform several common tasks used in qualitative analysis. The results show that this technical assistant speeds up significantly the data analysis process, enabling researchers to manage larger datasets much more effectively. Furthermore, this approach introduces a new dimension of scalability and accuracy in qualitative research, potentially transforming data interpretation methodologies in SE.


title: On a homology of foliations defined by non-singular Morse-Smale flows

abstract: We propose a definition of a homology of a one-dimensional foliation defined by a non-singular Morse-Smale flow. We also show the calculation of the homology of such a foliation which is naturally associated with Seifert fibration.


title: Lower bounds for high derivatives of smooth functions with given zeros

abstract: Let $f: B^n \rightarrow {\mathbb R}$ be a $d+1$ times continuously differentiable function on the unit ball $B^n$, with $\max_{z\in B^n} |f(z)|=1$. A well-known fact is that if $f$ vanishes on a set $Z\subset B^n$ with a non-empty interior, then for each $k=1,\ldots,d+1$ the norm of the $k$-th derivative $\|f^{(k)}\|$ is at least $M=M(n,k)>0$. A natural question to ask is: What happens for other sets $Z$? In particular, for finite, but sufficiently dense sets?} This question was partially answered in ([16],[20-22]). This study can be naturally related to a certain special settings of the classical Whitney's smooth extension problem. Our goal in the present paper is threefold: first, to provide an overview of the relevant questions and existing results in the general Whitney's problem. Second, we provide an overview of our specific setting and some available results. Third, we provide some new results in our direction. These new results extend the recent result of [21], where an answer to the above question is given via the topological information on $Z$.


title: SiMA-Hand: Boosting 3D Hand-Mesh Reconstruction by Single-to-Multi-View Adaptation

abstract: Estimating 3D hand mesh from RGB images is a longstanding track, in which occlusion is one of the most challenging problems. Existing attempts towards this task often fail when the occlusion dominates the image space. In this paper, we propose SiMA-Hand, aiming to boost the mesh reconstruction performance by Single-to-Multi-view Adaptation. First, we design a multi-view hand reconstructor to fuse information across multiple views by holistically adopting feature fusion at image, joint, and vertex levels. Then, we introduce a single-view hand reconstructor equipped with SiMA. Though taking only one view as input at inference, the shape and orientation features in the single-view reconstructor can be enriched by learning non-occluded knowledge from the extra views at training, enhancing the reconstruction precision on the occluded regions. We conduct experiments on the Dex-YCB and HanCo benchmarks with challenging object- and self-caused occlusion cases, manifesting that SiMA-Hand consistently achieves superior performance over the state of the arts. Code will be released on https://github.com/JoyboyWang/SiMA-Hand Pytorch.


title: Symmetric Petz-R\'enyi relative entropy uncertainty relation

abstract: Holevo introduced a fidelity between quantum states that is symmetric and as effective as the trace norm in evaluating their similarity. This fidelity is bounded by a function of the trace norm, a relationship to which we will refer as Holevo's inequality. More broadly, Holevo's fidelity is part of a one-parameter family of symmetric Petz-R\'enyi relative entropies, which in turn satisfy a Pinsker's-like inequality with respect to the trace norm. Although Holevo's inequality is tight, Pinsker's inequality is loose for this family. We show that the symmetric Petz-R\'enyi relative entropies satisfy a tight inequality with respect to the trace norm, improving Pinsker's and reproducing Holevo's as a specific case. Additionally, we show how this result emerges from a symmetric Petz-R\'enyi uncertainty relation, a result that encompasses several relations in quantum and stochastic thermodynamics.


title: StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback

abstract: The advancement of large language models (LLMs) has significantly propelled the field of code generation. Previous work integrated reinforcement learning (RL) with compiler feedback for exploring the output space of LLMs to enhance code generation quality. However, the lengthy code generated by LLMs in response to complex human requirements makes RL exploration a challenge. Also, since the unit tests may not cover the complicated code, optimizing LLMs by using these unexecuted code snippets is ineffective. To tackle these challenges, we introduce StepCoder, a novel RL framework for code generation, consisting of two main components: CCCS addresses the exploration challenge by breaking the long sequences code generation task into a Curriculum of Code Completion Subtasks, while FGO only optimizes the model by masking the unexecuted code segments to provide Fine-Grained Optimization. In addition, we furthermore construct the APPS+ dataset for RL training, which is manually verified to ensure the correctness of unit tests. Experimental results show that our method improves the ability to explore the output space and outperforms state-of-the-art approaches in corresponding benchmarks. Our dataset APPS+ and StepCoder are available online.


title: ATLAS Run 2 searches for electroweak production of supersymmetric particles interpreted within the pMSSM

abstract: A summary of the constraints from searches performed by the ATLAS Collaboration for the electroweak production of charginos and neutralinos is presented. Results from eight separate ATLAS searches are considered, each using 140 fb$^{-1}$ of proton-proton data at a centre-of-mass energy of $\sqrt{s}$=13 TeV collected at the Large Hadron Collider during its second data-taking run. The results are interpreted in the context of the 19-parameter phenomenological minimal supersymmetric standard model, where R-parity conservation is assumed and the lightest supersymmetric particle is assumed to be the lightest neutralino. Constraints from previous electroweak, flavour and dark matter related measurements are also considered. The results are presented in terms of constraints on supersymmetric particle masses and are compared with limits from simplified models. Also shown is the impact of ATLAS searches on parameters such as the dark matter relic density and the spin-dependent and spin-independent scattering cross-sections targeted by direct dark matter detection experiments. The Higgs boson and Z boson `funnel regions', where a low-mass neutralino would not oversaturate the dark matter relic abundance, are almost completely excluded by the considered constraints. Example spectra for non-excluded supersymmetric models with light charginos and neutralinos are also presented.


title: ALERT-Transformer: Bridging Asynchronous and Synchronous Machine Learning for Real-Time Event-based Spatio-Temporal Data

abstract: We seek to enable classic processing of continuous ultra-sparse spatiotemporal data generated by event-based sensors with dense machine learning models. We propose a novel hybrid pipeline composed of asynchronous sensing and synchronous processing that combines several ideas: (1) an embedding based on PointNet models -- the ALERT module -- that can continuously integrate new and dismiss old events thanks to a leakage mechanism, (2) a flexible readout of the embedded data that allows to feed any downstream model with always up-to-date features at any sampling rate, (3) exploiting the input sparsity in a patch-based approach inspired by Vision Transformer to optimize the efficiency of the method. These embeddings are then processed by a transformer model trained for object and gesture recognition. Using this approach, we achieve performances at the state-of-the-art with a lower latency than competitors. We also demonstrate that our asynchronous model can operate at any desired sampling rate.


title: Methanation of carbon dioxide over ceria-praseodymia promoted Ni-alumina catalysts. Influence of metal loading, promoter composition and alumina modifier

abstract: Two series of ceria-praseodymia promoted Ni-alumina catalysts were prepared from two different commercial modified alumina supports by the incipient wetness impregnation method in two successive steps.The resulting materials were characterized in terms of their physico-chemical properties. Furthermore, the as-prepared catalysts were tested for the CO2 methanation reaction. The influence of the nominal Ni loading, molar composition of the Ce-Pr mixed oxide promoter and alumina modifier on the catalytic performance was carefully analyzed. Among these three composition parameters, the alumina dopant and especially the Ni content appear to have by far a much more pronounced effect on both the CO2 conversion and CH4 selectivity as compared to the Ce-Pr mixed oxide composition.


title: Dark Matter-Electron Scattering Search Using Cryogenic Light Detectors

abstract: The CSC (cryogenic scintillating calorimeter) technology devoted to rare event searches is reaching the sensitivity level required for the hunt of dark matter-electron scatterings. Dark matter-electron interactions in scintillating targets are expected to stimulate the emission of single photons, each of energy equal to the target electronic band gap. The electronic band gap in scintillators like NaI/GaAs is of O(eV). The search for this signal can be done by an array of cryogenic light detectors with eV/sub-eV energy resolution. In this work, we describe the detection principle, the detector response and the envisioned detector design to search for dark matter interacting with electrons via the measurement of the scintillation light at millikelvin. First sensitivity projections are provided, which show the potential of this research.


title: The $(\infty,2)$-category of internal $(\infty,1)$-categories

abstract: We define and study the $(\infty,2)$-category $\mathbf{Cat}_{\infty}(\mathcal{C})$ of $(\infty,1)$-categories internal to an $(\infty,1)$-category $\mathcal{C}$ via an associated externalization construction. In the first part, we show various formal closure properties of $\mathbf{Cat}_{\infty}(\mathcal{C})$ regarding limits, tensors, cotensors and internal mapping objects under the assumption of various suitable closure properties of $\mathcal{C}$. In particular, we show that $\mathbf{Cat}_{\infty}(\mathcal{C})$ defines a cartesian closed full sub-$\infty$-cosmos of the $\infty$-cosmos $\mathbf{Fun}(\mathcal{C}^{op},\mathbf{Cat}_{\infty})$ of $\mathcal{C}$-indexed $(\infty,1)$-categories under suitable assumptions on $\mathcal{C}$. We furthermore characterize the objects of $\mathbf{Cat}_{\infty}(\mathcal{C})$ by means of a Yoneda lemma that expresses indexed diagrams of internal shape over $\mathcal{C}$ in terms of an $(\infty,1)$-categorical totalization. In the second part, we relate the general theory developed to this point to results in the model categorical literature. We show that every model category $\mathbb{M}$ gives rise to a "hands-on" $\infty$-cosmos $\mathbf{Cat}_{\infty}(\mathbb{M})$ (of not-necessarily cofibrant objects) directly by restriction of the Reedy model structure on $\mathbb{M}^{\Delta^{op}}$. We then define an according right derived model categorical externalization functor, and use it to show that the $(\infty,1)$-categorical and the model categorical constructions correspond to one another whenever $\mathcal{C}$ is presentable and $\mathbb{M}$ is a suitable presentation thereof.


title: A survey on robustness in trajectory prediction for autonomous vehicles

abstract: Autonomous vehicles rely on accurate trajectory prediction to inform decision-making processes related to navigation and collision avoidance. However, current trajectory prediction models show signs of overfitting, which may lead to unsafe or suboptimal behavior. To address these challenges, this paper presents a comprehensive framework that categorizes and assesses the definitions and strategies used in the literature on evaluating and improving the robustness of trajectory prediction models. This involves a detailed exploration of various approaches, including data slicing methods, perturbation techniques, model architecture changes, and post-training adjustments. In the literature, we see many promising methods for increasing robustness, which are necessary for safe and reliable autonomous driving.


title: penalizedclr: an R package for penalized conditional logistic regression for integration of multiple omics layers

abstract: The matched case-control design, up until recently mostly pertinent to epidemiological studies, is becoming customary in biomedical applications as well. For instance, in omics studies, it is quite common to compare cancer and healthy tissue from the same patient. Furthermore, researchers today routinely collect data from various and variable sources that they wish to relate to the case-control status. This highlights the need to develop and implement statistical methods that can take these tendencies into account. We present an R package penalizedclr, that provides an implementation of the penalized conditional logistic regression model for analyzing matched case-control studies. It allows for different penalties for different blocks of covariates, and it is therefore particularly useful in the presence of multi-source omics data. Both L1 and L2 penalties are implemented. Additionally, the package implements stability selection for variable selection in the considered regression model. The proposed method fills a gap in the available software for fitting high-dimensional conditional logistic regression model accounting for the matched design and block structure of predictors/features. The output consists of a set of selected variables that are significantly associated with case-control status. These features can then be investigated in terms of functional interpretation or validation in further, more targeted studies.


title: A Probabilistic Model behind Self-Supervised Learning

abstract: In self-supervised learning (SSL), representations are learned via an auxiliary task without annotated labels. A common task is to classify augmentations or different modalities of the data, which share semantic content (e.g. an object in an image) but differ in style (e.g. the object's location). Many approaches to self-supervised learning have been proposed, e.g. SimCLR, CLIP, and VicREG, which have recently gained much attention for their representations achieving downstream performance comparable to supervised learning. However, a theoretical understanding of self-supervised methods eludes. Addressing this, we present a generative latent variable model for self-supervised learning and show that several families of discriminative SSL, including contrastive methods, induce a comparable distribution over representations, providing a unifying theoretical framework for these methods. The proposed model also justifies connections drawn to mutual information and the use of a "projection head". Learning representations by fitting the model generatively (termed SimVAE) improves performance over discriminative and other VAE-based methods on simple image benchmarks and significantly narrows the gap between generative and discriminative representation learning in more complex settings. Importantly, as our analysis predicts, SimVAE outperforms self-supervised learning where style information is required, taking an important step toward understanding self-supervised methods and achieving task-agnostic representations.


title: Query-Efficient Correlation Clustering with Noisy Oracle

abstract: We study a general clustering setting in which we have $n$ elements to be clustered, and we aim to perform as few queries as possible to an oracle that returns a noisy sample of the similarity between two elements. Our setting encompasses many application domains in which the similarity function is costly to compute and inherently noisy. We propose two novel formulations of online learning problems rooted in the paradigm of Pure Exploration in Combinatorial Multi-Armed Bandits (PE-CMAB): fixed confidence and fixed budget settings. For both settings, we design algorithms that combine a sampling strategy with a classic approximation algorithm for correlation clustering and study their theoretical guarantees. Our results are the first examples of polynomial-time algorithms that work for the case of PE-CMAB in which the underlying offline optimization problem is NP-hard.


title: An Information Theoretic Approach to Machine Unlearning

abstract: To comply with AI and data regulations, the need to forget private or copyrighted information from trained machine learning models is increasingly important. The key challenge in unlearning is forgetting the necessary data in a timely manner, while preserving model performance. In this work, we address the zero-shot unlearning scenario, whereby an unlearning algorithm must be able to remove data given only a trained model and the data to be forgotten. We explore unlearning from an information theoretic perspective, connecting the influence of a sample to the information gain a model receives by observing it. From this, we derive a simple but principled zero-shot unlearning method based on the geometry of the model. Our approach takes the form of minimising the gradient of a learned function with respect to a small neighbourhood around a target forget point. This induces a smoothing effect, causing forgetting by moving the boundary of the classifier. We explore the intuition behind why this approach can jointly unlearn forget samples while preserving general model performance through a series of low-dimensional experiments. We perform extensive empirical evaluation of our method over a range of contemporary benchmarks, verifying that our method is competitive with state-of-the-art performance under the strict constraints of zero-shot unlearning.


title: A comparison study of supervised learning techniques for the approximation of high dimensional functions and feedback control

abstract: Approximation of high dimensional functions is in the focus of machine learning and data-based scientific computing. In many applications, empirical risk minimisation techniques over nonlinear model classes are employed. Neural networks, kernel methods and tensor decomposition techniques are among the most popular model classes. We provide a numerical study comparing the performance of these methods on various high-dimensional functions with focus on optimal control problems, where the collection of the dataset is based on the application of the State-Dependent Riccati Equation.


title: Pseudoredundancy for the Bit-Flipping Algorithm

abstract: The analysis of the decoding failure rate of the bit-flipping algorithm has received increasing attention. For a binary linear code we consider the minimum number of rows in a parity-check matrix such that the bit-flipping algorithm is able to correct errors up to the minimum distance without any decoding failures. We initiate a study of this bit-flipping redundancy, which is akin to the stopping set, trapping set or pseudocodeword redundancy of binary linear codes, and focus in particular on codes based on finite geometries.


title: On Measuring Context Utilization in Document-Level MT Systems

abstract: Document-level translation models are usually evaluated using general metrics such as BLEU, which are not informative about the benefits of context. Current work on context-aware evaluation, such as contrastive methods, only measure translation accuracy on words that need context for disambiguation. Such measures cannot reveal whether the translation model uses the correct supporting context. We propose to complement accuracy-based evaluation with measures of context utilization. We find that perturbation-based analysis (comparing models' performance when provided with correct versus random context) is an effective measure of overall context utilization. For a finer-grained phenomenon-specific evaluation, we propose to measure how much the supporting context contributes to handling context-dependent discourse phenomena. We show that automatically-annotated supporting context gives similar conclusions to human-annotated context and can be used as alternative for cases where human annotations are not available. Finally, we highlight the importance of using discourse-rich datasets when assessing context utilization.


title: Gas Phase Ions in Protoplanetary Disks from Collisions of Solids

abstract: Ionization is important for magnetohydrodynamics and chemistry in protoplanetary disks but known ionization sources are often weak along the midplane. We present, for the first time, data from a laboratory experiment, where we measure ions from colliding mm-basalt grains emitted into the surrounding gas phase. This positive detection implies that very basic collisions in early phases of planet formation are sources of ionization. The midplane of protoplanetary disks might be ionized despite the lack of intense radiation sources.


title: On the stability and exponential decay of the 3D MHD system with mixed partial dissipation near a equilibrium state

abstract: A main result of this paper establishes the global stability of the 3D MHD equations with mixed partial dissipation near a background magnetic field in the domain $\Omega=\mathbb{T}^2\times\mathbb{R}$ with $\mathbb{T}^2=[0, 1]^2$. More precisely, each velocity equation lacks its own directional dissipation, and the magnetic equation lacks vertical dissipation in the MHD system. The key point to obtain the stability result is that we decompose the solution $(u,b)$ into the zeroth horizontal mode and the non-zeroth modes and complete the desired bound with the strong Poincar\'{e} type inequalities in the treatment of several nonlinear terms. Then we focus on the large-time behavior of the solution, where the non-zeroth modes decay exponentially in $H^2$, and the solution converges to its zeroth horizontal mode.


title: Classification and Construction of Planar, 3-Connected Kronecker Products

abstract: We give a complete classification of the Kronecker (i.e. direct) product graphs that are planar and $3$-connected (i.e. $3$-polytopal). They are all of the form \[H\wedge K_2,\] where $H$ is a $2$-connected graph, possibly non-planar, and satisfying specific properties that we will describe. Our proof is constructive, in the sense that we prescribe how to obtain all such graphs $H$, by adding a few edges in a specific way to a given planar, bipartite graph, that is either $3$-connected, or semi-hyper-$2$-connected. Moreover, for $H$ planar, we also give a more precise characterisation of this graph, regarding the number of its odd regions, and how they intersect. If $H\wedge K_2$ is a $3$-polytope, then we have $\delta(H\wedge K_2)=3$, so that the connectivity of $H\wedge K_2$ is $3$, and the connectivity of $H$ is either $2$ or $3$. We also briefly discuss which Cartesian and strong products are $3$-polytopal.