title: The intricate path of energy conservation in Quantum Mechanics: exploring Coherent Population Return and laser-matter interaction

abstract: This manuscript explores how a seemingly straightforward inquiry, emerging from the widely accepted semiclassical description of laser-matter interaction, concretely from a well-known adiabatic technique as Coherent Population Return (CPR), can pose a challenge to our comprehension of a fundamental principle in Physics like energy conservation. Throughout our investigation to resolve this apparent paradox, we have delved into fundamental concepts, thereby deepening our understanding of the aspects inherent to the formalism of Quantum Mechanics. We emphasize that the significance of attaining a conclusive answer extends beyond the answer itself, encompassing the illuminating journey undertaken to reach it. Consequently, our work holds educational value as it aims to foster a deeper understanding of the phenomenon by elucidating the process employed. This approach not only aids students in grasping the subject matter but also enhances our own understanding of laser-matter interaction and the counterintuitive phenomena that continuously defied our understanding of Quantum Mechanics.


title: Laser patterning of magnonic structure via local crystallization of Yittrium Iron Garnet

abstract: The fabrication and integration of high-quality structures of Yttrium Iron Garnet (YIG) is critical for magnonics.Films with excellent properties are obtained only on single crystal Gadolinium Gallium Garnet (GGG) substrates using high-temperature processes. The subsequent realization of magnonic structures via lithography and etching is not straightforward as it requires a tight control of the edge roughness, to avoid magnon scattering, and planarization in case of multilayer devices. In this work we describe a different approach based on local laser annealing of amorphous YIG films, avoiding the need for subjecting the entire sample to high thermal budgets and for physical etching. Starting from amorphous and paramagnetic YIG films grown by pulsed laser deposition at room temperature on GGG, a 405 nm laser is used for patterning arbitrary shaped ferrimagnetic structures by local crystallization. In thick films (160 nm) the laser induced surface corrugation prevents the propagation of spin-wave modes in patterned conduits. For thinner films (80 nm) coherent propagation is observed in 1.2 micron wide conduits displaying an attenuation length of 5 micron which is compatible with a damping coefficient of about 5e-3. Possible routes to achieve damping coefficients compatible with state-of-the art epitaxial YIG films are discussed.


title: Rare-earth doped yttrium silicate (Y2SiO5) thin films grown by chemical vapour deposition for quantum technologies

abstract: Yttrium orthosilicate (Y2SiO5 - YSO) is one of the most promising crystals to host rare-earth (RE) ions for quantum technologies applications. In this matrix, they indeed exhibit narrow optical and spin linewidths that can be exploited to develop quantum memories or quantum information processing capabilities. In this paper, we propose a new method to grow RE doped silicate thin films on silicon wafers based on direct liquid injection chemical vapour deposition (DLI-CVD). We optimize the deposition and annealing conditions to achieve formation of the high temperature X2-YSO phase. The phase purity and crystalline quality of the films are assessed by evaluating the optical properties of Eu3+ ions embedded in this oxide matrix. In view of the results, we discuss the possible phase formation mechanisms, and the potential of this new wafer-compatible form of YSO for quantum technologies applications.


title: Model-Based Reinforcement Learning Control of Reaction-Diffusion Problems

abstract: Mathematical and computational tools have proven to be reliable in decision-making processes. In recent times, in particular, machine learning-based methods are becoming increasingly popular as advanced support tools. When dealing with control problems, reinforcement learning has been applied to decision-making in several applications, most notably in games. The success of these methods in finding solutions to complex problems motivates the exploration of new areas where they can be employed to overcome current difficulties. In this paper, we explore the use of automatic control strategies to initial boundary value problems in thermal and disease transport. Specifically, in this work, we adapt an existing reinforcement learning algorithm using a stochastic policy gradient method and we introduce two novel reward functions to drive the flow of the transported field. The new model-based framework exploits the interactions between a reaction-diffusion model and the modified agent. The results show that certain controls can be implemented successfully in these applications, although model simplifications had to be assumed.

categories: math.OC cs.LG cs.SY eess.SY math-ph math.DS math.MP


title: Observation of Surface State Suppression in Magnetic Weyl Semimetal NdAlSi

abstract: Understanding and mastering the control of surface states in topological materials are crucial steps for the development of future electronic devices and technologies that leverage the unique properties of these materials. Here, using angle-resolved photoemission spectroscopy, we provide a good case study of this by visualizing the electronic structure of a magnetic Weyl semimetal on both flat and uneven surfaces. Our observations reveal that the preparation of an uneven sample surface can effectively suppress all surface states in the Weyl semimetal NdAlSi, including topological surface Fermi arcs. This results in the observation of pure bulk states devoid of any Fermi energy shift. This discovery not only opens up a new avenue to directly study the pure bulk states of a Weyl semimetal using low photon energies in ARPES but also provides key insights into the control of the surface states in topological materials.


title: On the torsion function for simply connected, open sets in $\R^2$

abstract: For an open set $\Om \subset \R^2$ let $\lambda(\Om)$ denote the bottom of the spectrum of the Dirichlet Laplacian acting in $L^2(\Om)$. Let $w_\Om$ be the torsion function for $\Om$, and let $\|.\|_p$ denote the $L^p$ norm. It is shown there exists $\eta>0$ such that $\|w_{\Om}\|_{\infty} \lambda(\Om)\ge 1+\eta$ for any non-empty, open, simply connected set $\Om\subset \R^2$ with $\lb(\Om) >0$. Moreover, if the measure $|\Om|$ of $\Om$ is finite, then $\|w_{\Om}\|_1\lambda(\Om)\le (1-\eta)|\Om|$.


title: On decentralized computation of the leader's strategy in bi-level games

abstract: Motivated by the omnipresence of hierarchical structures in many real-world applications, this study delves into the intricate realm of bi-level games, with a specific focus on exploring local Stackelberg equilibria as a solution concept. While existing literature offers various methods tailored to specific game structures featuring one leader and multiple followers, a comprehensive framework providing formal convergence guarantees to a local Stackelberg equilibrium appears to be lacking. Drawing inspiration from sensitivity results for nonlinear programs and guided by the imperative to maintain scalability and preserve agent privacy, we propose a decentralized approach based on the projected gradient descent with the Armijo stepsize rule. The main challenge here lies in assuring the existence and well-posedness of Jacobians that describe the leader's decision's influence on the achieved equilibrium of the followers. By meticulous tracking of the Implicit Function Theorem requirements at each iteration, we establish formal convergence guarantees to a local Stackelberg equilibrium for a broad class of bi-level games. Building on our prior work on quadratic aggregative Stackelberg games, we also introduce a decentralized warm-start procedure based on the consensus alternating direction method of multipliers addressing the previously reported initialization issues. Finally, we provide empirical validation through two case studies in smart mobility, showcasing the effectiveness of our general method in handling general convex constraints, and the effectiveness of its extension in tackling initialization issues.


title: Bayesian games with nested information

abstract: We prove that any Bayesian game (\'a la Aumann) with a general state space, compact metric action spaces, and nested information admits a Harsanyi $\varepsilon$-equilibrium for every $\varepsilon> 0$. When, in addition, the action spaces and the payoffs are discrete, there is a Bayesian $\varepsilon$-equilibrium. To this end, we develop a new finite approximation of information structures, which has independent interest. We also put forth several open problems, including the existence of a $0$-equilibrium (Harsanyi or Bayesian) in Bayesian games with nested information, the existence of a Harsanyi $\varepsilon$-equilibrium in multi-stage Bayesian games with nested information, and the canonical structure of the universal belief space when the information structure is nested.


title: One-dimensional proximity superconductivity in the quantum Hall regime

abstract: Extensive efforts have been undertaken to combine superconductivity and the quantum Hall effect so that Cooper-pair transport between superconducting electrodes in Josephson junctions is mediated by one-dimensional edge states. This interest has been motivated by prospects of finding new physics, including topologically-protected quasiparticles, but also extends into metrology and device applications. So far it has proven challenging to achieve detectable supercurrents through quantum Hall conductors. Here we show that domain walls in minimally twisted bilayer graphene support exceptionally robust proximity superconductivity in the quantum Hall regime, allowing Josephson junctions to operate in fields close to the upper critical field of superconducting electrodes. The critical current is found to be non-oscillatory and practically unchanging over the entire range of quantizing fields, with its value being limited by the quantum conductance of ballistic, strictly one-dimensional electronic channels residing within the domain walls. The system described is unique in its ability to support Andreev bound states at quantizing fields and offers many interesting directions for further exploration.


title: Rough statistical convergence of sequences in a partial metric space

abstract: In this paper, using the concept of natural density, we have introduced the notion of rough statistical convergence which is an extension of the notion of rough convergence in a partial metric space. We have defined the set of rough statistical limit points of a sequence in a partial metric space and proved that this set is closed and bounded. Finally, we have found out the relationship between the set of statistical cluster points and the set of rough statistical limit points of sequences in a partial metric space.


title: Do LLMs Implicitly Determine the Suitable Text Difficulty for Users?

abstract: Education that suits the individual learning level is necessary to improve students' understanding. The first step in achieving this purpose by using large language models (LLMs) is to adjust the textual difficulty of the response to students. This work analyzes how LLMs can implicitly adjust text difficulty between user input and its generated text. To conduct the experiments, we created a new dataset from Stack-Overflow to explore the performance of question-answering-based conversation. Experimental results on the Stack-Overflow dataset and the TSCC dataset, including multi-turn conversation show that LLMs can implicitly handle text difficulty between user input and its generated response. We also observed that some LLMs can surpass humans in handling text difficulty and the importance of instruction-tuning.


title: CCPA: Long-term Person Re-Identification via Contrastive Clothing and Pose Augmentation

abstract: Long-term Person Re-Identification (LRe-ID) aims at matching an individual across cameras after a long period of time, presenting variations in clothing, pose, and viewpoint. In this work, we propose CCPA: Contrastive Clothing and Pose Augmentation framework for LRe-ID. Beyond appearance, CCPA captures body shape information which is cloth-invariant using a Relation Graph Attention Network. Training a robust LRe-ID model requires a wide range of clothing variations and expensive cloth labeling, which is lacked in current LRe-ID datasets. To address this, we perform clothing and pose transfer across identities to generate images of more clothing variations and of different persons wearing similar clothing. The augmented batch of images serve as inputs to our proposed Fine-grained Contrastive Losses, which not only supervise the Re-ID model to learn discriminative person embeddings under long-term scenarios but also ensure in-distribution data generation. Results on LRe-ID datasets demonstrate the effectiveness of our CCPA framework.


title: "It Must Be Gesturing Towards Me": Gesture-Based Interaction between Autonomous Vehicles and Pedestrians

abstract: Interacting with pedestrians understandably and efficiently is one of the toughest challenges faced by autonomous vehicles (AVs) due to the limitations of current algorithms and external human-machine interfaces (eHMIs). In this paper, we design eHMIs based on gestures inspired by the most popular method of interaction between pedestrians and human drivers. Eight common gestures were selected to convey AVs' yielding or non-yielding intentions at uncontrolled crosswalks from previous literature. Through a VR experiment (N1 = 31) and a following online survey (N2 = 394), we discovered significant differences in the usability of gesture-based eHMIs compared to current eHMIs. Good gesture-based eHMIs increase the efficiency of pedestrian-AV interaction while ensuring safety. Poor gestures, however, cause misinterpretation. The underlying reasons were explored: ambiguity regarding the recipient of the signal and whether the gestures are precise, polite, and familiar to pedestrians. Based on this empirical evidence, we discuss potential opportunities and provide valuable insights into developing comprehensible gesture-based eHMIs in the future to support better interaction between AVs and other road users.


title: VLPose: Bridging the Domain Gap in Pose Estimation with Language-Vision Tuning

abstract: Thanks to advances in deep learning techniques, Human Pose Estimation (HPE) has achieved significant progress in natural scenarios. However, these models perform poorly in artificial scenarios such as painting and sculpture due to the domain gap, constraining the development of virtual reality and augmented reality. With the growth of model size, retraining the whole model on both natural and artificial data is computationally expensive and inefficient. Our research aims to bridge the domain gap between natural and artificial scenarios with efficient tuning strategies. Leveraging the potential of language models, we enhance the adaptability of traditional pose estimation models across diverse scenarios with a novel framework called VLPose. VLPose leverages the synergy between language and vision to extend the generalization and robustness of pose estimation models beyond the traditional domains. Our approach has demonstrated improvements of 2.26% and 3.74% on HumanArt and MSCOCO, respectively, compared to state-of-the-art tuning strategies.


title: Annotation and Classification of Relevant Clauses in Terms-and-Conditions Contracts

abstract: In this paper, we propose a new annotation scheme to classify different types of clauses in Terms-and-Conditions contracts with the ultimate goal of supporting legal experts to quickly identify and assess problematic issues in this type of legal documents. To this end, we built a small corpus of Terms-and-Conditions contracts and finalized an annotation scheme of 14 categories, eventually reaching an inter-annotator agreement of 0.92. Then, for 11 of them, we experimented with binary classification tasks using few-shot prompting with a multilingual T5 and two fine-tuned versions of two BERT-based LLMs for Italian. Our experiments showed the feasibility of automatic classification of our categories by reaching accuracies ranging from .79 to .95 on validation tasks.


title: NLAS-multi: A Multilingual Corpus of Automatically Generated Natural Language Argumentation Schemes

abstract: Some of the major limitations identified in the areas of argument mining, argument generation, and natural language argument analysis are related to the complexity of annotating argumentatively rich data, the limited size of these corpora, and the constraints that represent the different languages and domains in which these data is annotated. To address these limitations, in this paper we present the following contributions: (i) an effective methodology for the automatic generation of natural language arguments in different topics and languages, (ii) the largest publicly available corpus of natural language argumentation schemes, and (iii) a set of solid baselines and fine-tuned models for the automatic identification of argumentation schemes.


title: Machine Learning Reveals Large-scale Impact of Posidonia Oceanica on Mediterranean Sea Water

abstract: Posidonia oceanica is a protected endemic seagrass of Mediterranean sea that fosters biodiversity, stores carbon, releases oxygen, and provides habitat to numerous sea organisms. Leveraging augmented research, we collected a comprehensive dataset of 174 features compiled from diverse data sources. Through machine learning analysis, we discovered the existence of a robust correlation between the exact location of P. oceanica and water biogeochemical properties. The model's feature importance, showed that carbon-related variables as net biomass production and downward surface mass flux of carbon dioxide have their values altered in the areas with P. oceanica, which in turn can be used for indirect location of P. oceanica meadows. The study provides the evidence of the plant's ability to exert a global impact on the environment and underscores the crucial role of this plant in sea ecosystems, emphasizing the need for its conservation and management.


title: Reframing the Expected Free Energy: Four Formulations and a Unification

abstract: Active inference is a leading theory of perception, learning and decision making, which can be applied to neuroscience, robotics, psychology, and machine learning. Active inference is based on the expected free energy, which is mostly justified by the intuitive plausibility of its formulations, e.g., the risk plus ambiguity and information gain / pragmatic value formulations. This paper seek to formalize the problem of deriving these formulations from a single root expected free energy definition, i.e., the unification problem. Then, we study two settings, each one having its own root expected free energy definition. In the first setting, no justification for the expected free energy has been proposed to date, but all the formulations can be recovered from it. However, in this setting, the agent cannot have arbitrary prior preferences over observations. Indeed, only a limited class of prior preferences over observations is compatible with the likelihood mapping of the generative model. In the second setting, a justification of the root expected free energy definition is known, but this setting only accounts for two formulations, i.e., the risk over states plus ambiguity and entropy plus expected energy formulations.


title: S^2Former-OR: Single-Stage Bimodal Transformer for Scene Graph Generation in OR

abstract: Scene graph generation (SGG) of surgical procedures is crucial in enhancing holistically cognitive intelligence in the operating room (OR). However, previous works have primarily relied on the multi-stage learning that generates semantic scene graphs dependent on intermediate processes with pose estimation and object detection, which may compromise model efficiency and efficacy, also impose extra annotation burden. In this study, we introduce a novel single-stage bimodal transformer framework for SGG in the OR, termed S^2Former-OR, aimed to complementally leverage multi-view 2D scenes and 3D point clouds for SGG in an end-to-end manner. Concretely, our model embraces a View-Sync Transfusion scheme to encourage multi-view visual information interaction. Concurrently, a Geometry-Visual Cohesion operation is designed to integrate the synergic 2D semantic features into 3D point cloud features. Moreover, based on the augmented feature, we propose a novel relation-sensitive transformer decoder that embeds dynamic entity-pair queries and relational trait priors, which enables the direct prediction of entity-pair relations for graph generation without intermediate steps. Extensive experiments have validated the superior SGG performance and lower computational cost of S^2Former-OR on 4D-OR benchmark, compared with current OR-SGG methods, e.g., 3% Precision increase and 24.2M reduction in model parameters. We further compared our method with generic single-stage SGG methods with broader metrics for a comprehensive evaluation, with consistently better performance achieved. The code will be made available.


title: Dichotomy between Level Broadening and Level Coupling to Electrodes in Large Area EGaIn Molecular Junctions

abstract: Choosing self-assembled monolayers (SAM) of fluorine terminated oligophenylenes adsorbed on gold as illustration, we show that a single level (molecular orbital, MO) model can excellently reproduce full I-V curves measured for large area junctions fabricated with top EGaIn contact. In addition, this model unravels a surprising dichotomy between MO coupling to electrodes and the MO broadening. Importantly for the coherence of the microscopic description, the latter is found to correlate with the SAM coverage and molecular and pi* orbital tilt angles.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.chem-ph physics.comp-ph


title: Dust Accumulation near the Magnetospheric Truncation of Protoplanetary Discs. II. The Effects of Opacity and Thermal Evolution

abstract: Dust trapping in the global pressure bump induced by magnetospheric truncation offers a promising formation mechanism for close-in super-Earths/sub-Neptunes. These planets likely form in evolved protoplanetary discs, where the gas temperature at the expanding truncation radius become amiable to refractory solids. However, dust accumulation may alter the disc opacity such that thermal evolution is inevitable. To better understand how thermodynamics affects this planet formation pathway, we conduct a suite of local dust evolution simulations in an idealized inner disc model. Our calculations take into account self-consistent opacity-dependent temperature changes as well as dust evaporation and vapour condensation. We find that disc thermal evolution regulates dust growth and evolution, discouraging any accumulation of small particles that drives the increase of opacity and temperature. Significant retention of dust mass takes place when the disc environments allow runaway growth of large solids beyond the fragmentation barrier, where small particles are then swept up and preserved. Our results further validate dust accumulation near disc truncation as a promising mechanism to form close-in planets.


title: NeRF-Det++: Incorporating Semantic Cues and Perspective-aware Depth Supervision for Indoor Multi-View 3D Detection

abstract: NeRF-Det has achieved impressive performance in indoor multi-view 3D detection by innovatively utilizing NeRF to enhance representation learning. Despite its notable performance, we uncover three decisive shortcomings in its current design, including semantic ambiguity, inappropriate sampling, and insufficient utilization of depth supervision. To combat the aforementioned problems, we present three corresponding solutions: 1) Semantic Enhancement. We project the freely available 3D segmentation annotations onto the 2D plane and leverage the corresponding 2D semantic maps as the supervision signal, significantly enhancing the semantic awareness of multi-view detectors. 2) Perspective-aware Sampling. Instead of employing the uniform sampling strategy, we put forward the perspective-aware sampling policy that samples densely near the camera while sparsely in the distance, more effectively collecting the valuable geometric clues. 3)Ordinal Residual Depth Supervision. As opposed to directly regressing the depth values that are difficult to optimize, we divide the depth range of each scene into a fixed number of ordinal bins and reformulate the depth prediction as the combination of the classification of depth bins as well as the regression of the residual depth values, thereby benefiting the depth learning process. The resulting algorithm, NeRF-Det++, has exhibited appealing performance in the ScanNetV2 and ARKITScenes datasets. Notably, in ScanNetV2, NeRF-Det++ outperforms the competitive NeRF-Det by +1.9% in mAP@0.25 and +3.5% in mAP@0.50$. The code will be publicly at https://github.com/mrsempress/NeRF-Detplusplus.


title: Lightlike conformal reduction of 6d $(1,0)$ theories

abstract: We study 6d $(1,0)$ superconformal theories. These have a natural lightlike conformal Killing vector, the Dirac current. We perform a conformal dimensional reduction along the Dirac current down to five-dimensions in such a way that we always preserve at least two real supercharges


title: Magnitude homology is a derived functor

abstract: We prove that the magnitude (co)homology of an enriched category can, under some technical assumptions, be described in terms of derived functors between certain abelian categories. We show how this statement is specified for the cases of quasimetric spaces, finite quasimetric spaces, and finite digraphs. For quasimetric spaces, we define the notion of a distance module over a quasimetric space, define the functor of (co)invariants of a distance module and show that the magnitude (co)homology can be presented via its derived functors. As a corollary we obtain that the magnitude cohomology of a quasimetric space can be presented in terms of Ext functors in the category of distance modules. For finite quasimetric spaces, we show that magnitude (co)homology can be presented in terms of Tor and Ext functors over a certain graded algebra, called the distance algebra of the quasimetric space. For finite digraphs, the distance algebra is a bound quiver algebra. In addition, we show that the magnitude cohomology algebra of a finite quasimetric space can be described as a Yoneda algebra.


title: Production of $P^\Lambda_{\psi s}(4338)$ from $\Xi_b$ decay

abstract: In the present work, we investigate the production of the newly observed $P^\Lambda_{\psi s}(4338)$ state in $\Xi_b^-$ decay, where the $P^\Lambda_{\psi s}(4338)$ is assigned as a $\Xi_c \bar{D}$ molecular state. By using an effective Lagrangian approach, we evaluate the branching fractions of $\Xi_b^-\rightarrow P^\Lambda_{\psi s}(4338)K^-$ via the triangle loop mechanism. The branching fractions of $\Xi_b^-\rightarrow P^\Lambda_{\psi s}(4338)K^-$ are in the order of $10^{-4}$; the result is compared with our previous work of $\Xi_b^-\rightarrow P^\Lambda_{\psi s}(4459)K^-$. We also predict the ratio of $P^\Lambda_{\psi s}(4459)$ and $P^\Lambda_{\psi s}(4338)$ productions in the decay $\Xi_b^- \to P^\Lambda_{\psi s} K^- \to J/\psi \Lambda K^-$. The predicted branching fractions and their ratios could be tested experimentally, which may be helpful for understanding the molecular picture of $P^\Lambda_{\psi s}(4338)$ as well as other hidden-charm pentaquark states with strangeness. Moreover, the experimental potential of observing $P^\Lambda_{\psi s}(4338)$ in the $\Xi^-_b\to K^- J/\psi \Lambda$ is discussed.


title: Baryogenesis and leptogenesis with relativistic bubble walls

abstract: In this talk, we study the impact of first order phase transitions with fast bubble walls on mechanisms of leptogenesis and baryogenesis. We begin our exploration with the usual leptogenesis where the breaking of $B-L$ occurs via a PT with fast walls. Then we move to a more exotic case where the $B-L$ breaking phase transition creates heavy particles in the plasma and catalizes the leptogenesis. Finally, we apply the same production mechanism to the EWPT at low energy and build a new model of EWBG. Those models are all original and contain crucial new phenomenological aspects like the emission of large amount of Gravitational waves.


title: Reimagining Anomalies: What If Anomalies Were Normal?

abstract: Deep learning-based methods have achieved a breakthrough in image anomaly detection, but their complexity introduces a considerable challenge to understanding why an instance is predicted to be anomalous. We introduce a novel explanation method that generates multiple counterfactual examples for each anomaly, capturing diverse concepts of anomalousness. A counterfactual example is a modification of the anomaly that is perceived as normal by the anomaly detector. The method provides a high-level semantic explanation of the mechanism that triggered the anomaly detector, allowing users to explore "what-if scenarios." Qualitative and quantitative analyses across various image datasets show that the method applied to state-of-the-art anomaly detectors can achieve high-quality semantic explanations of detectors.


title: The limit law of certain discrete multivariate distributions

abstract: Let $X_1,\,X_2,\,\ldots,\,X_N$, $N\in\mathbb{N}$ be independent but not necessarily identically distributed discrete and integer-valued random variables. Assume that $X_1\geqslant m_1$, $X_2\geqslant m_2$, $\ldots$, $X_N\geqslant m_N$ almost surely, where $m_1,\,m_2,\ldots,\,m_N$ are some integer numbers such that $m_1+m_2+\ldots+m_N<0$, and $X_k$ is identically distributed as $X_{k+N}$, for all $k\in\mathbb{N}$ in the sequence $X_1,\,X_2,\,\ldots$ In this communication, we make use of some of the known results to provide the closed-form expression of the limit multivariate distribution function $\mathbb{P}(X_1\leqslant x,\,X_1+X_2\leqslant x,\,\ldots)$, $x\in\mathbb{Z}$ via: (1) inclusion-exclusion principle based product of the roots of $G_{N}(s)=1$, where $G_{N}(s)$ is the probability generating function of $S_N=X_1+X_2+\ldots+X_N$, (2) the probability mass function of $S_N$, and (3) the expectation $\mathbb{E}S_N$.


title: BUGFIX: towards a common language and framework for the AutomaticProgram Repair community

abstract: Techniques of Automatic Program Repair (APR) have the potential of thoroughly facilitating the task of producing quality software. After a promising start, however, progress in making APR practical has been hindered by the lack of a common framework to support the multiplicity of APR ideas and tools, and of target programming languages and environments. In this position paper we outline a general framework to enable the APR community to benefit from each other\'s advances, in particular through a standard language for describing bugs and their fixes. Such a common framework (which is also applicable to work on fault seeding) could be a tremendous benefit to researchers and developers of Interactive Development Environments (IDEs) who are working to make APR an effective part of the practical experience of software developers.


title: Mid-Infrared Properties of Narrow-Line Seyfert 1 Galaxies Detected by LoTSS DR2

abstract: Narrow-line Seyfert 1 galaxies (NLS1s), a subclass of active galactic nuclei (AGNs) at early stage of accretion process, are also found to host relativistic jets. However, currently known jetted NLS1s are rare. The majority of NLS1s are undetected at radio band. The radio detection rate of NLS1s raises with the LOFAR Two-metre Sky Survey (LoTSS), which gives a good opportunity to find more jetted NLS1s. The better sensitivity brings another question of whether the radio emission of NLS1s with low radio luminosity originates from jet activity. In order to clarify the origin of radio emission for NLS1s, and search for more jetted NLS1s, we explore the mid-infrared properties of LoTSS detected NLS1s by comparing them with known jetted AGNs and star forming galaxies (SFGs), which locate above and on the well studied radio/far-infrared correlation, respectively. The majority of NLS1s show mid-infrared (MIR) excess compared with SFGs. Their radio emission shows significant correlation with MIR emission. In MIR color-color diagram, NLS1s are overlapped with flat spectrum radio quasars, but well separated from SFGs and optically selected radio galaxies. The flux ratio between radio and MIR emission of these NLS1s is also similar with a radio quiet quasar with weak jet. These results imply substantial contributions from AGN activities for both radio and MIR emission of NLS1s. A small fraction of NLS1s with relatively higher radio luminosity locate in similar region with blazars in radio-MIR diagram, which suggests that the radio emission of these NLS1s is dominated by jet. We obtain a sample of jetted NLS1 candidates through their radio excess in radio-MIR diagram.


title: Personalized Behavior-Aware Transformer for Multi-Behavior Sequential Recommendation

abstract: Sequential Recommendation (SR) captures users' dynamic preferences by modeling how users transit among items. However, SR models that utilize only single type of behavior interaction data encounter performance degradation when the sequences are short. To tackle this problem, we focus on Multi-Behavior Sequential Recommendation (MBSR) in this paper, which aims to leverage time-evolving heterogeneous behavioral dependencies for better exploring users' potential intents on the target behavior. Solving MBSR is challenging. On the one hand, users exhibit diverse multi-behavior patterns due to personal characteristics. On the other hand, there exists comprehensive co-influence between behavior correlations and item collaborations, the intensity of which is deeply affected by temporal factors. To tackle these challenges, we propose a Personalized Behavior-Aware Transformer framework (PBAT) for MBSR problem, which models personalized patterns and multifaceted sequential collaborations in a novel way to boost recommendation performance. First, PBAT develops a personalized behavior pattern generator in the representation layer, which extracts dynamic and discriminative behavior patterns for sequential learning. Second, PBAT reforms the self-attention layer with a behavior-aware collaboration extractor, which introduces a fused behavior-aware attention mechanism for incorporating both behavioral and temporal impacts into collaborative transitions. We conduct experiments on three benchmark datasets and the results demonstrate the effectiveness and interpretability of our framework. Our implementation code is released at https://github.com/TiliaceaeSU/PBAT.


title: Data Science with LLMs and Interpretable Models

abstract: Recent years have seen important advances in the building of interpretable models, machine learning models that are designed to be easily understood by humans. In this work, we show that large language models (LLMs) are remarkably good at working with interpretable models, too. In particular, we show that LLMs can describe, interpret, and debug Generalized Additive Models (GAMs). Combining the flexibility of LLMs with the breadth of statistical patterns accurately described by GAMs enables dataset summarization, question answering, and model critique. LLMs can also improve the interaction between domain experts and interpretable models, and generate hypotheses about the underlying phenomenon. We release \url{https://github.com/interpretml/TalkToEBM} as an open-source LLM-GAM interface.


title: DynGMA: a robust approach for learning stochastic differential equations from data

abstract: Learning unknown stochastic differential equations (SDEs) from observed data is a significant and challenging task with applications in various fields. Current approaches often use neural networks to represent drift and diffusion functions, and construct likelihood-based loss by approximating the transition density to train these networks. However, these methods often rely on one-step stochastic numerical schemes, necessitating data with sufficiently high time resolution. In this paper, we introduce novel approximations to the transition density of the parameterized SDE: a Gaussian density approximation inspired by the random perturbation theory of dynamical systems, and its extension, the dynamical Gaussian mixture approximation (DynGMA). Benefiting from the robust density approximation, our method exhibits superior accuracy compared to baseline methods in learning the fully unknown drift and diffusion functions and computing the invariant distribution from trajectory data. And it is capable of handling trajectory data with low time resolution and variable, even uncontrollable, time step sizes, such as data generated from Gillespie's stochastic simulations. We then conduct several experiments across various scenarios to verify the advantages and robustness of the proposed method.


title: Quantifying neural network uncertainty under volatility clustering

abstract: Time-series with time-varying variance pose a unique challenge to uncertainty quantification (UQ) methods. Time-varying variance, such as volatility clustering as seen in financial time-series, can lead to large mismatch between predicted uncertainty and forecast error. Building on recent advances in neural network UQ literature, we extend and simplify Deep Evidential Regression and Deep Ensembles into a unified framework to deal with UQ under the presence of volatility clustering. We show that a Scale Mixture Distribution is a simpler alternative to the Normal-Inverse-Gamma prior that provides favorable complexity-accuracy trade-off. To illustrate the performance of our proposed approach, we apply it to two sets of financial time-series exhibiting volatility clustering: cryptocurrencies and U.S. equities.


title: Pressure tunable magnetic skyrmion phase in Co8Zn8Mn4 single crystals

abstract: In a magnetic skyrmion phase, magnetic moments form vortex-like topological textures which are of both fundamental and industrial interests. In $\beta$-Mn-type Co-Zn-Mn alloys, chrial magnetic skyrmions emerge above room temperature, providing a unique system for studying the skrymion physics and exploring spintronics applications. However, the magnetic skyrmion phase is typically confined in a narrow and limited temperature ($T$) and magnetic field ($H$) range. Here, we demonstrate that hydrostatic pressure can expand the skyrmion phase in the $T-H$ phase diagram of single-crystalline Co$_8$Zn$_8$Mn$_4$. At ambient pressure, signatures of skyrmions are seen within $T\sim302-308$ K and $H\sim50-100$ Oe. Applying a moderate pressure of 6 kbar extends this range to $T\sim300-310$ K and $H\sim50-150$ Oe. However, further escalation of pressure to 10 kbar results in a slight contraction of the skyrmion phase. These findings underscore the sensitivity of the skyrmion phase in Co$_8$Zn$_8$Mn$_4$ to external pressures, and hint at the potential of strain engineering, particularly in $\beta$-Mn-type Co-Zn-Mn thin films, as a promising avenue to customize the skyrmion phase.


title: A KAM theorem of symplectic algorithms for nearly integrabel Hamiltonian systems

abstract: In this paper we prove a KAM-like theorem of symplectic algorithms for nearly integrable Hamiltonian systems which generalises the result of \cite{r1} and \cite{r6} for the case of integrable systems.


title: Existence and upper semicontinuity of pullback attractors for Kirchhoff wave equations in time-dependent spaces

abstract: In this paper, we shall investigate the existence and upper semicontinuity of pullback attractors for non-autonomous Kirchhoff wave equations with a strong damping in the time-dependent space $X_t$. After deriving the existence and uniqueness of solutions by the Faedo-Galerkin approximation method, we establish the existence of pullback attractors. Later on, we prove the upper semicontinuity of pullback attractors between the Kirchhoff-type wave equations with $\delta \geq 0$ and the conventional wave equations with $\delta=0$ by a series of complex energy estimates.


title: MeTMaP: Metamorphic Testing for Detecting False Vector Matching Problems in LLM Augmented Generation

abstract: Augmented generation techniques such as Retrieval-Augmented Generation (RAG) and Cache-Augmented Generation (CAG) have revolutionized the field by enhancing large language model (LLM) outputs with external knowledge and cached information. However, the integration of vector databases, which serve as a backbone for these augmentations, introduces critical challenges, particularly in ensuring accurate vector matching. False vector matching in these databases can significantly compromise the integrity and reliability of LLM outputs, leading to misinformation or erroneous responses. Despite the crucial impact of these issues, there is a notable research gap in methods to effectively detect and address false vector matches in LLM-augmented generation. This paper presents MeTMaP, a metamorphic testing framework developed to identify false vector matching in LLM-augmented generation systems. We derive eight metamorphic relations (MRs) from six NLP datasets, which form our method's core, based on the idea that semantically similar texts should match and dissimilar ones should not. MeTMaP uses these MRs to create sentence triplets for testing, simulating real-world LLM scenarios. Our evaluation of MeTMaP over 203 vector matching configurations, involving 29 embedding models and 7 distance metrics, uncovers significant inaccuracies. The results, showing a maximum accuracy of only 41.51\% on our tests compared to the original datasets, emphasize the widespread issue of false matches in vector matching methods and the critical need for effective detection and mitigation in LLM-augmented applications.


title: Towards Automated Causal Discovery: a case study on 5G telecommunication data

abstract: We introduce the concept of Automated Causal Discovery (AutoCD), defined as any system that aims to fully automate the application of causal discovery and causal reasoning methods. AutoCD's goal is to deliver all causal information that an expert human analyst would and answer a user's causal queries. We describe the architecture of such a platform, and illustrate its performance on synthetic data sets. As a case study, we apply it on temporal telecommunication data. The system is general and can be applied to a plethora of causal discovery problems.


title: SpanSeq: Similarity-based sequence data splitting method for improved development and assessment of deep learning projects

abstract: The use of deep learning models in computational biology has increased massively in recent years, and is expected to do so further with the current advances in fields like Natural Language Processing. These models, although able to draw complex relations between input and target, are also largely inclined to learn noisy deviations from the pool of data used during their development. In order to assess their performance on unseen data (their capacity to generalize), it is common to randomly split the available data in development (train/validation) and test sets. This procedure, although standard, has lately been shown to produce dubious assessments of generalization due to the existing similarity between samples in the databases used. In this work, we present SpanSeq, a database partition method for machine learning that can scale to most biological sequences (genes, proteins and genomes) in order to avoid data leakage between sets. We also explore the effect of not restraining similarity between sets by reproducing the development of the state-of-the-art model DeepLoc, not only confirming the consequences of randomly splitting databases on the model assessment, but expanding those repercussions to the model development. SpanSeq is available for downloading and installing at https://github.com/genomicepidemiology/SpanSeq.


title: MR-ARL: Model Reference Adaptive Reinforcement Learning for Robustly Stable On-Policy Data-Driven LQR

abstract: This article introduces a novel framework for data-driven linear quadratic regulator (LQR) design. First, we introduce a reinforcement learning paradigm for on-policy data-driven LQR, where exploration and exploitation are simultaneously performed while guaranteeing robust stability of the whole closed-loop system encompassing the plant and the control/learning dynamics. Then, we propose Model Reference Adaptive Reinforcement Learning (MR-ARL), a control architecture integrating tools from reinforcement learning and model reference adaptive control. The approach stands on a variable reference model containing the currently identified value function. Then, an adaptive stabilizer is used to ensure convergence of the applied policy to the optimal one, convergence of the plant to the optimal reference model, and overall robust closed-loop stability. The proposed framework provides theoretical robustness certificates against real-world perturbations such as measurement noise, plant nonlinearities, or slowly varying parameters. The effectiveness of the proposed architecture is validated via realistic numerical simulations.


title: Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysis

abstract: Causality is fundamental in human cognition and has drawn attention in diverse research fields. With growing volumes of textual data, discerning causalities within text data is crucial, and causal text mining plays a pivotal role in extracting meaningful patterns. This study conducts comprehensive evaluations of ChatGPT's causal text mining capabilities. Firstly, we introduce a benchmark that extends beyond general English datasets, including domain-specific and non-English datasets. We also provide an evaluation framework to ensure fair comparisons between ChatGPT and previous approaches. Finally, our analysis outlines the limitations and future challenges in employing ChatGPT for causal text mining. Specifically, our analysis reveals that ChatGPT serves as a good starting point for various datasets. However, when equipped with a sufficient amount of training data, previous models still surpass ChatGPT's performance. Additionally, ChatGPT suffers from the tendency to falsely recognize non-causal sequences as causal sequences. These issues become even more pronounced with advanced versions of the model, such as GPT-4. In addition, we highlight the constraints of ChatGPT in handling complex causality types, including both intra/inter-sentential and implicit causality. The model also faces challenges with effectively leveraging in-context learning and domain adaptation. We release our code to support further research and development in this field.


title: Machine-Checked Categorical Diagrammatic Reasoning

abstract: This paper describes a formal proof library, developed using the Coq proof assistant, designed to assist users in writing correct diagrammatic proofs, for 1-categories. This library proposes a deep-embedded, domain-specific formal language, which features dedicated proof commands to automate the synthesis, and the verification, of the technical parts often eluded in the literature.


title: Are Bounded Contracts Learnable and Approximately Optimal?

abstract: This paper considers the hidden-action model of the principal-agent problem, in which a principal incentivizes an agent to work on a project using a contract. We investigate whether contracts with bounded payments are learnable and approximately optimal. Our main results are two learning algorithms that can find a nearly optimal bounded contract using a polynomial number of queries, under two standard assumptions in the literature: a costlier action for the agent leads to a better outcome distribution for the principal, and the agent's cost/effort has diminishing returns. Our polynomial query complexity upper bound shows that standard assumptions are sufficient for achieving an exponential improvement upon the known lower bound for general instances. Unlike the existing algorithms, which relied on discretizing the contract space, our algorithms directly learn the underlying outcome distributions. As for the approximate optimality of bounded contracts, we find that they could be far from optimal in terms of multiplicative or additive approximation, but satisfy a notion of mixed approximation.


title: Mathematical Modeling and Hyers-Ulam Stability for a Nonlinear Epidemiological Model with $\Phi_p$ Operator and Mittag-Leffler Kernel

abstract: This paper investigates a novel nonlinear singular fractional SI model with the $\Phi_p$ operator and the Mittag-Leffler kernel. The initial investigation includes the existence, uniqueness, boundedness, and non-negativity of the solution. We then establish Hyers-Ulam stability for the proposed model in Banach space. Optimal control analysis is performed to minimize the spread of infection and maximize the population of susceptible individuals. Finally, the theoretical results are supported by numerical simulations.


title: Does the Generator Mind its Contexts? An Analysis of Generative Model Faithfulness under Context Transfer

abstract: The present study introduces the knowledge-augmented generator, which is specifically designed to produce information that remains grounded in contextual knowledge, regardless of alterations in the context. Previous research has predominantly focused on examining hallucinations stemming from static input, such as in the domains of summarization or machine translation. However, our investigation delves into the faithfulness of generative question answering in the presence of dynamic knowledge. Our objective is to explore the existence of hallucinations arising from parametric memory when contextual knowledge undergoes changes, while also analyzing the underlying causes for their occurrence. In order to efficiently address this issue, we propose a straightforward yet effective measure for detecting such hallucinations. Intriguingly, our investigation uncovers that all models exhibit a tendency to generate previous answers as hallucinations. To gain deeper insights into the underlying causes of this phenomenon, we conduct a series of experiments that verify the critical role played by context in hallucination, both during training and testing, from various perspectives.


title: A Class of Topological Pseudodistances for Fast Comparison of Persistence Diagrams

abstract: Persistence diagrams (PD)s play a central role in topological data analysis, and are used in an ever increasing variety of applications. The comparison of PD data requires computing comparison metrics among large sets of PDs, with metrics which are accurate, theoretically sound, and fast to compute. Especially for denser multi-dimensional PDs, such comparison metrics are lacking. While on the one hand, Wasserstein-type distances have high accuracy and theoretical guarantees, they incur high computational cost. On the other hand, distances between vectorizations such as Persistence Statistics (PS)s have lower computational cost, but lack the accuracy guarantees and in general they are not guaranteed to distinguish PDs (i.e. the two PS vectors of different PDs may be equal). In this work we introduce a class of pseudodistances called Extended Topological Pseudodistances (ETD)s, which have tunable complexity, and can approximate Sliced and classical Wasserstein distances at the high-complexity extreme, while being computationally lighter and close to Persistence Statistics at the lower complexity extreme, and thus allow users to interpolate between the two metrics. We build theoretical comparisons to show how to fit our new distances at an intermediate level between persistence vectorizations and Wasserstein distances. We also experimentally verify that ETDs outperform PSs in terms of accuracy and outperform Wasserstein and Sliced Wasserstein distances in terms of computational complexity.


title: Imbalanced Data Clustering using Equilibrium K-Means

abstract: Centroid-based clustering algorithms, such as hard K-means (HKM) and fuzzy K-means (FKM), have suffered from learning bias towards large clusters. Their centroids tend to be crowded in large clusters, compromising performance when the true underlying data groups vary in size (i.e., imbalanced data). To address this, we propose a new clustering objective function based on the Boltzmann operator, which introduces a novel centroid repulsion mechanism, where data points surrounding the centroids repel other centroids. Larger clusters repel more, effectively mitigating the issue of large cluster learning bias. The proposed new algorithm, called equilibrium K-means (EKM), is simple, alternating between two steps; resource-saving, with the same time and space complexity as FKM; and scalable to large datasets via batch learning. We substantially evaluate the performance of EKM on synthetic and real-world datasets. The results show that EKM performs competitively on balanced data and significantly outperforms benchmark algorithms on imbalanced data. Deep clustering experiments demonstrate that EKM is a better alternative to HKM and FKM on imbalanced data as more discriminative representation can be obtained. Additionally, we reformulate HKM, FKM, and EKM in a general form of gradient descent and demonstrate how this general form facilitates a uniform study of K-means algorithms.


title: Search for long-lived particles decaying to final states with a pair of muons in proton-proton collisions at $\sqrt{s}$ = 13.6 TeV

abstract: An inclusive search for long-lived exotic particles (LLPs) decaying to final states with a pair of muons is presented. The search uses data corresponding to an integrated luminosity of 36.6 fb$^{-1}$ collected by the CMS experiment from the proton-proton collisions at $\sqrt{s}$ = 13.6 TeV in 2022, the first year of Run 3 of the CERN LHC. The experimental signature is a pair of oppositely charged muons originating from a common vertex spatially separated from the proton-proton interaction point by distances ranging from several hundred $\mu$m to several meters. The sensitivity of the search benefits from new triggers for displaced dimuons developed for Run 3. The results are interpreted in the framework of the hidden Abelian Higgs model, in which the Higgs boson decays to a pair of long-lived dark photons, and of an $R$-parity violating supersymmetry model, in which long-lived neutralinos decay to a pair of muons and a neutrino. The limits set on these models are the most stringent to date in wide regions of lifetimes for LLPs with masses larger than 10 GeV.


title: Towards Robust Instruction Tuning on Multimodal Large Language Models

abstract: Fine-tuning large language models (LLMs) on multi-task instruction-following data has been proven to be a powerful learning paradigm for improving their zero-shot capabilities on new tasks. Recent works about high-quality instruction-following data generation and selection require amounts of human labor to conceive model-understandable instructions for the given tasks and carefully filter the LLM-generated data. In this work, we introduce an automatic instruction augmentation method named INSTRAUG in multimodal tasks. It starts from a handful of basic and straightforward meta instructions but can expand an instruction-following dataset by 30 times. Results on two popular multimodal instructionfollowing benchmarks MULTIINSTRUCT and InstructBLIP show that INSTRAUG can significantly improve the alignment of multimodal large language models (MLLMs) across 12 multimodal tasks, which is even equivalent to the benefits of scaling up training data multiple times.


title: An Improved Pseudopolynomial Time Algorithm for Subset Sum

abstract: We investigate pseudo-polynomial time algorithms for Subset Sum. Given a multi-set $X$ of $n$ positive integers and a target $t$, Subset Sum asks whether some subset of $X$ sums to $t$. Bringmann proposes an $\tilde{O}(n + t)$-time algorithm [Bringmann SODA'17], and an open question has naturally arisen: can Subset Sum be solved in $O(n + w)$ time? Here $w$ is the maximum integer in $X$. We make a progress towards resolving the open question by proposing an $\tilde{O}(n + \sqrt{wt})$-time algorithm.


title: Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Task

abstract: In a realistic dialogue system, the input information from users is often subject to various types of input perturbations, which affects the slot-filling task. Although rule-based data augmentation methods have achieved satisfactory results, they fail to exhibit the desired generalization when faced with unknown noise disturbances. In this study, we address the challenges posed by input perturbations in slot filling by proposing Noise-BERT, a unified Perturbation-Robust Framework with Noise Alignment Pre-training. Our framework incorporates two Noise Alignment Pre-training tasks: Slot Masked Prediction and Sentence Noisiness Discrimination, aiming to guide the pre-trained language model in capturing accurate slot information and noise distribution. During fine-tuning, we employ a contrastive learning loss to enhance the semantic representation of entities and labels. Additionally, we introduce an adversarial attack training strategy to improve the model's robustness. Experimental results demonstrate the superiority of our proposed approach over state-of-the-art models, and further analysis confirms its effectiveness and generalization ability.


title: Fundamental bounds for parameter estimation with few measurements

abstract: Bounding the optimal precision in parameter estimation tasks is of central importance for technological applications. In the regime of a small number of measurements, or that of low signal-to-noise ratios, the meaning of common frequentist bounds such as the Cram\'er-Rao bound (CRB) become questionable. Here, we discuss different linear (Barankin-like) conditions that can be imposed on estimators and analyze when these conditions admit an optimal estimator with finite variance, for any number of measurement repetitions. We show that, if the number of imposed conditions is larger than the number of measurement outcomes, there generally does not exist a corresponding estimator with finite variance. We analyze this result from different viewpoints and examples and elaborate on connections to the shot-noise limit and the Kitaev phase estimation algorithm. We then derive an extended Cram\'er-Rao bound that is compatible with a finite variance in situations where the Barankin bound is undefined. Finally, we show an exemplary numerical confrontation between frequentist and Bayesian approaches to parameter estimation.


title: First-principle tight-binding approach to angle-resolved photoemission spectroscopy simulations: importance of light-matter gauge and ubiquitous interference effects

abstract: Angle-resolved photoemission spectroscopy (ARPES) is one of the most powerful techniques to study the electronic structure of materials. To go beyond the paradigm of band mapping and extract aspects of the Bloch wave-functions, the intricate interplay of experimental geometry, crystal structure, and photon polarization needs to be understood. In this work we discuss several model approaches to computing ARPES signals in a unified fashion. While we represent the Bloch wave-functions by first-principle Wannier functions, we introduce different approximations to the final states and discuss the implications for the predictive power. We also introduce various light-matter gauges and explain the role of the inevitable breaking of gauge invariance.Finally, we benchmark the different models for the two-dimensional semiconductor WSe$_2$, known for its strong Berry curvature, orbital angular momentum (OAM), and nontrivial orbital texture. The models are compared based on their ability to simulate photoemission intensity and interpret circular dichroism in ARPES (CD-ARPES). We show that interference effects are crucial to understanding the circular dichroism, and explain their photon-energy dependence. Our in-depth analysis provides insights into the advantages and limitations of various model approaches in clarifying the complex interplay between experimental observables and underlying orbital texture in materials.


title: A Sparse Bayesian Committee Machine Potential for Hydrocarbons

abstract: Accurate and scalable universal interatomic potentials are key for understanding material properties at the atomic level, a task often hindered by the steep computational scaling. Although recent developments of machine learning potential has made significant progress, the flexibility and expansion to a wide range of compounds within a single model seems still challenging to build in particular for the kernel-based models. Here, we introduce the Bayesian Committee Machine (BCM) potential to handle a wide array of hydrocarbons in various phases (gas, clusters, liquid, and solid). The BCM potential leverages the committee approach to bypass the poor scaling of kernel regressors when dealing with large datasets. Its committee-based structure allows for easy and cost-effective expansion, maintaining both transferrability and scalability. Demonstrating its robustness, the BCM accurately models challenging examples like the Diels-Alder reaction, structural strains, and pi-pi interactions. Our systematic benchmarking positions the sparse BCM potential as a promising candidate in the quest for a universal ab initio machine learning potential.


title: A Collision-Aware Cable Grasping Method in Cluttered Environment

abstract: We introduce a Cable Grasping-Convolutional Neural Network designed to facilitate robust cable grasping in cluttered environments. Utilizing physics simulations, we generate an extensive dataset that mimics the intricacies of cable grasping, factoring in potential collisions between cables and robotic grippers. We employ the Approximate Convex Decomposition technique to dissect the non-convex cable model, with grasp quality autonomously labeled based on simulated grasping attempts. The CG-CNN is refined using this simulated dataset and enhanced through domain randomization techniques. Subsequently, the trained model predicts grasp quality, guiding the optimal grasp pose to the robot controller for execution. Grasping efficacy is assessed across both synthetic and real-world settings. Given our model implicit collision sensitivity, we achieved commendable success rates of 92.3% for known cables and 88.4% for unknown cables, surpassing contemporary state-of-the-art approaches. Supplementary materials can be found at https://leizhang-public.github.io/cg-cnn/ .


title: "My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models

abstract: The open-ended nature of language generation makes the evaluation of autoregressive large language models (LLMs) challenging. One common evaluation approach uses multiple-choice questions (MCQ) to limit the response space. The model is then evaluated by ranking the candidate answers by the log probability of the first token prediction. However, first-tokens may not consistently reflect the final response output, due to model's diverse response styles such as starting with "Sure" or refusing to answer. Consequently, MCQ evaluation is not indicative of model behaviour when interacting with users. But by how much? We evaluate how aligned first-token evaluation is with the text output along several dimensions, namely final option choice, refusal rate, choice distribution and robustness under prompt perturbation. Our results show that the two approaches are severely misaligned on all dimensions, reaching mismatch rates over 60%. Models heavily fine-tuned on conversational or safety data are especially impacted. Crucially, models remain misaligned even when we increasingly constrain prompts, i.e., force them to start with an option letter or example template. Our findings i) underscore the importance of inspecting the text output, too and ii) caution against relying solely on first-token evaluation.


title: Constructions of normal numbers with infinitely many digits

abstract: Let $L=(L_d)_{d \in \mathbb N}$ be any ordered probability sequence, i.e., satisfying $0 < L_{d+1} \le L_d$ for each $d \in \mathbb N$ and $\sum_{d \in \mathbb N} L_d =1$. We construct sequences $A = (a_i)_{i \in \mathbb N}$ on the countably infinite alphabet $\mathbb N$ in which each possible block of digits $\alpha_1, \ldots, \alpha_k \in \mathbb N$, $k \in \mathbb N$, occurs with frequency $\prod_{d=1}^k L_{\alpha_d}$. In other words, we construct $L$-normal sequences. These sequences can then be projected to normal numbers in various affine number systems, such as real numbers $x \in [0,1]$ that are normal in GLS number systems that correspond to the sequence $L$ or higher dimensional variants. In particular, this construction provides a family of numbers that have a normal L\"uroth expansion.


title: Cluster Categorification of Rank 2 Webs

abstract: The homogeneous coordinate ring of the Grassmannian $\rm{Gr}(k,n)$ has a well-known cluster structure. There is a categorification of this cluster structure via a category of modules for a ring $\mathcal{A}_{k,n}$ due to Jensen-King-Su, building on work of Geiss-Leclerc-Schr\"oer, in which cluster variables correspond to indecomposable rigid modules. We give a combinatorial description of modules that correspond to rank $2$ cluster variables by using webs. This conjecturally gives the categorification of all rank $2$ cluster variables.


title: Ferroelectric texture of individual barium titanate nanocrystals

abstract: Ferroelectric materials display exotic polarization textures at the nanoscale that could be used to improve the energetic efficiency of electronic components. The vast majority of studies were conducted in two dimensions on thin films, that can be further nanostructured, but very few studies address the situation of individual isolated nanocrystals synthesized in solution, while such structures could open other field of applications. In this work, we experimentally and theoretically studied the polarization texture of ferroelectric barium titanate (BaTiO$_3$, BTO) nanocrystals (NC) attached to a conductive substrate and surrounded by air. We synthesized NC of well defined quasi-cubic shape and 160 nm average size, that conserve the tetragonal structure of BTO at room temperature. We then investigated the inverse piezoelectric properties of such pristine individual NC by piezoresponse force microscopy (PFM), taking particular care of suppressing electrostatic artifacts. In all the NC studied, we could not detect any vertical PFM signal, and the maps of the lateral response all displayed larger displacements on the edges. Using field-phase simulations dedicated to ferroelectric nanostructures, we were able to predict the equilibrium polarization texture. These simulations revealed that the NC core is composed of 180{\deg} up and down domains defining the polar axis, that rotate by 90{\deg} in the two facets orthogonal to this axis, eventually lying within these planes forming a layer of about 10 nm thickness mainly composed of 180{\deg} domains along an edge. From this polarization distribution we predicted the lateral PFM response, that revealed to be in very good qualitative agreement with the experimental observations. This work positions PFM as a relevant tool to evaluate the potential of complex ferroelectric nanostructures to be used as sensors.


title: Understanding Human-AI Collaboration in Music Therapy Through Co-Design with Therapists

abstract: The rapid development of musical AI technologies has expanded the creative potential of various musical activities, ranging from music style transformation to music generation. However, little research has investigated how musical AIs can support music therapists, who urgently need new technology support. This study used a mixed method, including semi-structured interviews and a participatory design approach. By collaborating with music therapists, we explored design opportunities for musical AIs in music therapy. We presented the co-design outcomes involving the integration of musical AIs into a music therapy process, which was developed from a theoretical framework rooted in emotion-focused therapy. After that, we concluded the benefits and concerns surrounding music AIs from the perspective of music therapists. Based on our findings, we discussed the opportunities and design implications for applying musical AIs to music therapy. Our work offers valuable insights for developing human-AI collaborative music systems in therapy involving complex procedures and specific requirements.


title: On A Tautological Relation Conjectured By Buryak-Shadrin

abstract: Buryak and Shadrin conjectured a tautological relation on moduli spaces of curves $\overline{\mathcal{M}}_{g,n}$ which has the form $B^m_{g, \textbf{d}}=0$ for certain tautological classes $B^m_{g, \textbf{d}}$ where $m \geq 2, n \geq 1$ and $|\textbf{d}| \geq 2g+m-1$. In this paper we prove that this conjecture holds if it is true for the $m=2$ and $|\textbf{d}| = 2g+1$ case. This result reduces the proof of this conjecture to checking finitely many cases for each genus $g$. We will also prove this conjecture for the $g=1$ case.


title: Towards Seamless Adaptation of Pre-trained Models for Visual Place Recognition

abstract: Recent studies show that vision models pre-trained in generic visual learning tasks with large-scale data can provide useful feature representations for a wide range of visual perception problems. However, few attempts have been made to exploit pre-trained foundation models in visual place recognition (VPR). Due to the inherent difference in training objectives and data between the tasks of model pre-training and VPR, how to bridge the gap and fully unleash the capability of pre-trained models for VPR is still a key issue to address. To this end, we propose a novel method to realize seamless adaptation of pre-trained models for VPR. Specifically, to obtain both global and local features that focus on salient landmarks for discriminating places, we design a hybrid adaptation method to achieve both global and local adaptation efficiently, in which only lightweight adapters are tuned without adjusting the pre-trained model. Besides, to guide effective adaptation, we propose a mutual nearest neighbor local feature loss, which ensures proper dense local features are produced for local matching and avoids time-consuming spatial verification in re-ranking. Experimental results show that our method outperforms the state-of-the-art methods with less training data and training time, and uses about only 3% retrieval runtime of the two-stage VPR methods with RANSAC-based spatial verification. It ranks 1st on the MSLS challenge leaderboard (at the time of submission). The code is released at https://github.com/Lu-Feng/SelaVPR.


title: Enhancing Rolling Horizon Production Planning Through Stochastic Optimization Evaluated by Means of Simulation

abstract: Production planning must account for uncertainty in a production system, arising from fluctuating demand forecasts. Therefore, this article focuses on the integration of updated customer demand into the rolling horizon planning cycle. We use scenario-based stochastic programming to solve capacitated lot sizing problems under stochastic demand in a rolling horizon environment. This environment is replicated using a discrete event simulation-optimization framework, where the optimization problem is periodically solved, leveraging the latest demand information to continually adjust the production plan. We evaluate the stochastic optimization approach and compare its performance to solving a deterministic lot sizing model, using expected demand figures as input, as well as to standard Material Requirements Planning (MRP). In the simulation study, we analyze three different customer behaviors related to forecasting, along with four levels of shop load, within a multi-item and multi-stage production system. We test a range of significant parameter values for the three planning methods and compute the overall costs to benchmark them. The results show that the production plans obtained by MRP are outperformed by deterministic and stochastic optimization. Particularly, when facing tight resource restrictions and rising uncertainty in customer demand, the use of stochastic optimization becomes preferable compared to deterministic optimization.


title: Amalgams of rational unipotent groups and residual nilpotence

abstract: We provide sufficient conditions for a free amalgamated product of torsionfree nilpotent groups to be residually nilpotent. We also characterise the residual nilpotence of certain higher-dimensional amalgams of unipotent groups over the rationals (known as KMS groups) in terms of their defining Cartan matrix. As an application, we give a normal form for the elements of a minimal Kac-Moody group over the rationals.


title: Shifts on the lamplighter group

abstract: We prove that the lamplighter group admits strongly aperiodic SFTs, has undecidable tiling problem, and the entropies of its SFTs are exactly the upper semicomputable nonnegative real numbers, and some other results. These results follow from two relatively general simulation theorems, which show that for a large class of effective subshifts on the sea-level subgroup, their induction to the lamplighter group is sofic; and the pullback of every effective Cantor system on the integers admits an SFT cover. We exhibit a concrete strongly aperiodic set with $1488$ tetrahedra. We show that metabelian Baumslag-Solitar groups are intersimulable with lamplighter groups, and thus we obtain the same characterization for their entropies.


title: Deep vessel segmentation based on a new combination of vesselness filters

abstract: Vascular segmentation represents a crucial clinical task, yet its automation remains challenging. Because of the recent strides in deep learning, vesselness filters, which can significantly aid the learning process, have been overlooked. This study introduces an innovative filter fusion method crafted to amplify the effectiveness of vessel segmentation models. Our investigation seeks to establish the merits of a filter-based learning approach through a comparative analysis. Specifically, we contrast the performance of a U-Net model trained on CT images with an identical U-Net configuration trained on vesselness hyper-volumes using matching parameters. Our findings, based on two vascular datasets, highlight improved segmentations, especially for small vessels, when the model's learning is exposed to vessel-enhanced inputs.


title: Voltage tunable sign inversion of magnetoresistance in van der Waals Fe3GeTe2/MoSe2/Fe3GeTe2 tunnel junctions

abstract: The magnetic tunnel junctions (MTJ) based on van der Waals (vdW) materials possess atomically smooth interfaces with minimal element intermixing. This characteristic ensures that spin polarization is well maintained during transport, leading to the emergence of richer magnetoresistance behaviors. Here, using all 2D vdW MTJs based on magnetic metal Fe3GeTe2 and non-magnetic semiconductor MoSe2, we demonstrate that the magnitude and even sign of the magnetoresistance can be tuned by the applied voltage. The sign inversion of the magnetoresistance is observed in a wide temperature range below the Curie temperature. This tunable magnetoresistance sign may be attributed to the spin polarizations of the tunneling carriers and the band structure of the two ferromagnetic electrodes. Such robust electrical tunability of magnetoresistance extends the functionalities of low-dimensional spintronics and makes it more appealing for next-generation spintronics with all-vdW MTJs.


title: Realization of the Pascal based on Argon using a Fabry-P\'erot refractometer

abstract: Based on a recent experimental determination of the static polarizability and a first-principles calculation of the frequency-dependent dipole polarizability of argon, this work presents, by use of a Fabry-P\'erot refractometer operated at 1550 nm, a realization of the SI unit of pressure, the pascal, for pressures up to 100 kPa, with an uncertainty of [(0.98 mPa)$^2 + (5.8 \times 10^{-6} P)^2 + (26\times10^{-12}P^2)^2]^{1/2}$. The work also presents a value of the molar polarizability of N$_2$ at 1550 nm of 4.396572(26)$\times 10^{-6}$m$^{3}$/mol, which agrees well with previously determined ones in the literature.


title: Running Coupling and Beta-Functions for HQCD with Heavy and Light Quarks: Isotropic case

abstract: We consider running coupling constant and beta-function in holographic models supported by Einstein-dilaton-Maxwell action for heavy and light quarks. To obtain the dependence of the running coupling constant $\alpha$ on temperature and chemical potential we impose boundary conditions on the dilaton field that depend on the position of the horizon. We use two types of boundary conditions: a simple boundary condition with the dilaton field vanishing at the horizon, and a boundary condition that ensures agreement with lattice calculations of string tension between quarks at zero chemical potential. The location of the first-order phase transitions in $(T,\mu)$-plane does not depend on the dilaton boundary conditions for light and heavy quarks. At these phase transitions, the functions $\alpha$ and $\beta$ undergo jumps depending on temperature and chemical potential. We also show that for the second boundary conditions the running coupling decreases with increasing temperature and the dependence on temperature and chemical potential for both light and heavy quarks are actually specified by functions of one variable, demonstrating in this sense auto-model behavior.


title: Chern-Simons gravity and PT Symmetry

abstract: This paper considers a string inspired effective axion anomalously coupled to Abelian gauge fields and gravity. By considering the renormalisation group flows in the flat space limit it is observed that a Hermitian parity symmetric phase of the theory can flow into a non-Hermitian parity-time symmetric phase. This behavior has implications for Chern-Simons gravity. The repulsive nature of gravity, usually attributed to the existence of a positive cosmological constant, is reinterpreted at large scales as a flow from a Hermitian (attractive) gravitational theory, to a PT-symmetric (repulsive) gravity in the infrared. The discussion here is presented in the context of a Chern-Simons gravitational theory but it may be valid more generally in gravity with torsion. The validity of such a scenario in realistic theories might alleviate the need for de Sitter phases in the current epoch of the cosmological evolution, thus avoiding their associated conceptual and technical complications.


title: Detecting the F\'eeton Fifth Force by Superconducting Josephson Junctions

abstract: The intriguing $U(1)_{B-L}$ extension of the standard model predicts a fifth force between particles carrying $B-L$ charges. The mediator is the $B-L$ gauge boson called F\'eeton. In this letter, we propose a novel experimental design to detect the quantum phase difference caused by this fifth force using a superconducting Josephson junction. We find that the experiment has the best sensitivity to the gauge coupling when the gauge boson is within the mass range of $10^{-2}\,$eV to $100\,$eV.


title: Spectral invariance and maximality properties of the frequency spectrum of quantum neural networks

abstract: Quantum Neural Networks (QNNs) are a popular approach in Quantum Machine Learning due to their close connection to Variational Quantum Circuits, making them a promising candidate for practical applications on Noisy Intermediate-Scale Quantum (NISQ) devices. A QNN can be expressed as a finite Fourier series, where the set of frequencies is called the frequency spectrum. We analyse this frequency spectrum and prove, for a large class of models, various maximality results. Furthermore, we prove that under some mild conditions there exists a bijection between classes of models with the same area $A = RL$ that preserves the frequency spectrum, where $R$ denotes the number of qubits and $L$ the number of layers, which we consequently call spectral invariance under area-preserving transformations. With this we explain the symmetry in $R$ and $L$ in the results often observed in the literature and show that the maximal frequency spectrum depends only on the area $A = RL$ and not on the individual values of $R$ and $L$. Moreover, we extend existing results and specify the maximum possible frequency spectrum of a QNN with arbitrarily many layers as a function of the spectrum of its generators. If the generators of the QNN can be further decomposed into 2-dimensional sub-generators, then this specification follows from elementary number-theoretical considerations. In the case of arbitrary dimensional generators, we extend existing results based on the so-called Golomb ruler and introduce a second novel approach based on a variation of the turnpike problem, which we call the relaxed turnpike problem.


title: Upper bounds on the genus of Albanese fibrations

abstract: Let $S$ be a minimal irregular surface of general type, whose Albanese map induces a hyperelliptic fibration $f:\,S \to B$ of genus $g$.We prove a quadratic upper bound on the genus $g$, i.e., $g\leq h\big(\chi(\mathcal{O}_S)\big)$, where $h$ is a quadratic function. We also construct examples showing that the quadratic upper bounds can not be improved to the linear ones. In the special case when $p_g(S)=q(S)=1$, we show that $g\leq 14$.


title: The elliptical invariant tori of nearly integrable Hamiltonian system through symplectic algorithms

abstract: In this paper we apply symplectic algorithms to nearly integrable Hamiltonian system, and prove it can maintain lots of elliptic lower dimensional invariant tori. We are committed to consider the elliptic lower dimensional invariant tori for symplectic mapping with a small twist under the R\"{u}ssmann's non-degenerate condition, and focus on its measure estimation. And then apply it to the nearly integrable Hamiltonian system to obtain lots of elliptic lower dimensional invariant tori.


title: Bulk Boundary Paradox in the Surface Reconstructed Magnetic Weyl Semimetal NdAlSi

abstract: The bulk boundary correspondence in the context of Weyl semimetals is a fundamental topological principle that establishes a connection between the bulk properties of the material and the emergence of specific surface states. In Weyl semimetals, the bulk boundary correspondence is manifested by the presence of surface Fermi arcs connecting pairs of Weyl nodes with opposite chirality. Here we demonstrate that this bulk boundary correspondence is challenged in the case of the surface selectively reconstructed noncentrosymmetric magnetic Weyl semimetal NdAlSi. By comparing angle-resolved photoemission spectroscopy measurements with surface projected density functional theory calculations and scanning tunneling microscope measurements, the existence of surface selective spontaneous reconstruction is demonstrated. The surface reconstruction in NdAlSi not only leads to the reconstruction of the surface Fermi arcs, but also generates new surface Fermi arcs that do not connect corresponding Weyl nodes. This observation challenges the conventional view of the bulk boundary correspondence in Weyl semimetals.


title: Strong-ARM Dynamic Latch Comparators: Design and Analyses on CAD Platform

abstract: Strong-ARM Dynamic Latch Comparators are widely used in high-speed analog-to-digital converters (ADCs), sense amplifiers in memory, RFID applications, and data receivers. This paper presents different methods to improve the performance of Strong-Arm latch-based comparators. The comparator's significant features such as power dissipation, propagation delay, offset voltage, clock feedthrough, area, and kickback noises are discussed and compared with state-of-the-art candidate topologies. Simulation results show that the new comparator topologies of Strong-ARM Dynamic Latch proposed by these authors gave the best results. The proposed designs are tested. The simulations are carried out using UMC 180nm double metal, double poly standard CMOS process technology, for a 100 MHz clock, at 1.8V supply-rail on the Cadence Virtuoso EDA platform.


title: Auxiliary Calculations for Graphene-Based Quantum Hall Arrays Using Partially Recursive Star-Mesh Transformations

abstract: A previous mathematical approach adopted for optimizing the number of total device elements required for obtaining high effective quantized resistances in graphene-based quantum Hall array devices (QHARS) has been further explored with partial recursion patterns. Designs would assume the use of epitaxial graphene elements, whose quantized Hall resistance at the {\nu}=2 plateau (R_H \approx 12906.4 \Ohm) becomes the building block for larger effective, quantized resistances. Auxiliary calculations suggest the importance of applying full recursions at least once to maximize the reduction of total QHARS elements needed for high resistances.


title: Malaysian English News Decoded: A Linguistic Resource for Named Entity and Relation Extraction

abstract: Standard English and Malaysian English exhibit notable differences, posing challenges for natural language processing (NLP) tasks on Malaysian English. Unfortunately, most of the existing datasets are mainly based on standard English and therefore inadequate for improving NLP tasks in Malaysian English. An experiment using state-of-the-art Named Entity Recognition (NER) solutions on Malaysian English news articles highlights that they cannot handle morphosyntactic variations in Malaysian English. To the best of our knowledge, there is no annotated dataset available to improvise the model. To address these issues, we constructed a Malaysian English News (MEN) dataset, which contains 200 news articles that are manually annotated with entities and relations. We then fine-tuned the spaCy NER tool and validated that having a dataset tailor-made for Malaysian English could improve the performance of NER in Malaysian English significantly. This paper presents our effort in the data acquisition, annotation methodology, and thorough analysis of the annotated dataset. To validate the quality of the annotation, inter-annotator agreement was used, followed by adjudication of disagreements by a subject matter expert. Upon completion of these tasks, we managed to develop a dataset with 6,061 entities and 3,268 relation instances. Finally, we discuss on spaCy fine-tuning setup and analysis on the NER performance. This unique dataset will contribute significantly to the advancement of NLP research in Malaysian English, allowing researchers to accelerate their progress, particularly in NER and relation extraction. The dataset and annotation guideline has been published on Github.


title: Towards Unified Task Embeddings Across Multiple Models: Bridging the Gap for Prompt-Based Large Language Models and Beyond

abstract: Task embedding, a meta-learning technique that captures task-specific information, has become prevalent, especially in areas such as multi-task learning, model editing, and interpretability. However, it faces challenges with the emergence of prompt-guided Large Language Models (LLMs) operating in a gradientfree manner. Existing task embedding methods rely on fine-tuned, task-specific language models, which hinders the adaptability of task embeddings across diverse models, especially prompt-based LLMs. To unleash the power of task embedding in the era of LLMs, we propose a framework for unified task embeddings (FUTE), harmonizing task embeddings from various models, including smaller language models and LLMs with varied prompts, within a single vector space. Such uniformity enables the comparison and analysis of similarities amongst different models, extending the scope and utility of existing task embedding methods in addressing multi-model scenarios, whilst maintaining their performance to be comparable to architecture-specific methods.


title: Daisy-TTS: Simulating Wider Spectrum of Emotions via Prosody Embedding Decomposition

abstract: We often verbally express emotions in a multifaceted manner, they may vary in their intensities and may be expressed not just as a single but as a mixture of emotions. This wide spectrum of emotions is well-studied in the structural model of emotions, which represents variety of emotions as derivative products of primary emotions with varying degrees of intensity. In this paper, we propose an emotional text-to-speech design to simulate a wider spectrum of emotions grounded on the structural model. Our proposed design, Daisy-TTS, incorporates a prosody encoder to learn emotionally-separable prosody embedding as a proxy for emotion. This emotion representation allows the model to simulate: (1) Primary emotions, as learned from the training samples, (2) Secondary emotions, as a mixture of primary emotions, (3) Intensity-level, by scaling the emotion embedding, and (4) Emotions polarity, by negating the emotion embedding. Through a series of perceptual evaluations, Daisy-TTS demonstrated overall higher emotional speech naturalness and emotion perceiveability compared to the baseline.


title: Simulations and Performance Studies of a MAPS in 65 nm CMOS Imaging Technology

abstract: Monolithic active pixel sensors (MAPS) produced in a 65 nm CMOS imaging technology are being investigated for applications in particle physics. The MAPS design has a small collection electrode characterized by an input capacitance of ~fF, granting a high signal-to-noise ratio and low power consumption. Additionally, the 65 nm CMOS imaging technology brings a reduction in material budget and improved logic density of the readout circuitry, compared to previously studied technologies. Given these features, this technology was chosen by the TANGERINE project to develop the next generation of silicon pixel sensors. The sensor design targets temporal and spatial resolutions compatible with the requirements for a vertex detector at future lepton colliders. Simulations and test-beam characterization of technology demonstrators have been carried out in close collaboration with the CERN EP R&D program and the ALICE ITS3 upgrade. TCAD device simulations using generic doping profiles and Monte Carlo simulations have been used to build an understanding of the technology and predict the performance parameters of the sensor. Technology demonstrators of a 65 nm CMOS MAPS with a small collection electrode have been characterized in laboratory and test-beam facilities by studying performance parameters such as cluster size, charge collection, and efficiency. This work compares simulation results to test-beam data. The experimental results establish this technology as a promising candidate for a vertex detector at future lepton colliders and give valuable information for improving the simulation approach.


title: Kinematically Constrained Human-like Bimanual Robot-to-Human Handovers

abstract: Bimanual handovers are crucial for transferring large, deformable or delicate objects. This paper proposes a framework for generating kinematically constrained human-like bimanual robot motions to ensure seamless and natural robot-to-human object handovers. We use a Hidden Semi-Markov Model (HSMM) to reactively generate suitable response trajectories for a robot based on the observed human partner's motion. The trajectories are adapted with task space constraints to ensure accurate handovers. Results from a pilot study show that our approach is perceived as more human--like compared to a baseline Inverse Kinematics approach.


title: Balanced Data Sampling for Language Model Training with Clustering

abstract: Data plays a fundamental role in the training of Large Language Models (LLMs). While attention has been paid to the collection and composition of datasets, determining the data sampling strategy in training remains an open question. Most LLMs are trained with a simple strategy, random sampling. However, this sampling strategy ignores the unbalanced nature of training data distribution, which can be sub-optimal. In this paper, we propose ClusterClip Sampling to balance the text distribution of training data for better model training. Specifically, ClusterClip Sampling utilizes data clustering to reflect the data distribution of the training set and balances the common samples and rare samples during training based on the cluster results. A repetition clip operation is introduced to mitigate the overfitting issue led by samples from certain clusters. Extensive experiments validate the effectiveness of ClusterClip Sampling, which outperforms random sampling and other cluster-based sampling variants under various training datasets and large language models.


title: Federated Learning on Transcriptomic Data: Model Quality and Performance Trade-Offs

abstract: Machine learning on large-scale genomic or transcriptomic data is important for many novel health applications. For example, precision medicine tailors medical treatments to patients on the basis of individual biomarkers, cellular and molecular states, etc. However, the data required is sensitive, voluminous, heterogeneous, and typically distributed across locations where dedicated machine learning hardware is not available. Due to privacy and regulatory reasons, it is also problematic to aggregate all data at a trusted third party.Federated learning is a promising solution to this dilemma, because it enables decentralized, collaborative machine learning without exchanging raw data. In this paper, we perform comparative experiments with the federated learning frameworks TensorFlow Federated and Flower. Our test case is the training of disease prognosis and cell type classification models. We train the models with distributed transcriptomic data, considering both data heterogeneity and architectural heterogeneity. We measure model quality, robustness against privacy-enhancing noise, computational performance and resource overhead. Each of the federated learning frameworks has different strengths. However, our experiments confirm that both frameworks can readily build models on transcriptomic data, without transferring personal raw data to a third party with abundant computational resources.


title: ACE : Off-Policy Actor-Critic with Causality-Aware Entropy Regularization

abstract: The varying significance of distinct primitive behaviors during the policy learning process has been overlooked by prior model-free RL algorithms. Leveraging this insight, we explore the causal relationship between different action dimensions and rewards to evaluate the significance of various primitive behaviors during training. We introduce a causality-aware entropy term that effectively identifies and prioritizes actions with high potential impacts for efficient exploration. Furthermore, to prevent excessive focus on specific primitive behaviors, we analyze the gradient dormancy phenomenon and introduce a dormancy-guided reset mechanism to further enhance the efficacy of our method. Our proposed algorithm, ACE: Off-policy Actor-critic with Causality-aware Entropy regularization, demonstrates a substantial performance advantage across 29 diverse continuous control tasks spanning 7 domains compared to model-free RL baselines, which underscores the effectiveness, versatility, and efficient sample efficiency of our approach. Benchmark results and videos are available at https://ace-rl.github.io/.


title: Groups having minimal covering number 2 of diagonal type

abstract: Garonzi and Lucchini~\cite{GL} explored finite groups $G$ possessing a normal $2$-covering, where no proper quotient of $G$ exhibits such a covering. Their investigation offered a comprehensive overview of these groups, delineating that such groups fall into distinct categories: almost simple, affine, product action, or diagonal. In this paper, we focus on the family falling under the diagonal type. Specifically, we present a thorough classification of finite diagonal groups possessing a normal $2$-covering, with the attribute that no proper quotient of $G$ has such a covering.


title: Quantum dynamical maps for single-qubit gates under non-Markovian phase noise

abstract: Noise is both ubiquitous and generally deleterious in settings where precision is required. This is especially true in the quantum technology sector where system utility typically decays rapidly under its influence. Understanding the noise in quantum devices is thus a prerequisite for efficient strategies to mitigate or even eliminate its harmful effects. However, this requires resources that are often prohibitive, such that the typically-used noise models rely on simplifications that sometimes depart from experimental reality. Here we derive a compact microscopic error model for single-qubit gates that only requires a single experimental input -the noise power spectral density. Our model goes beyond standard depolarizing or Pauli-twirled noise models, explicitly including non-Clifford and non-Markovian contributions to the dynamical error map. We gauge our predictions for experimentally relevant metrics against established characterization techniques run on a trapped-ion quantum computer. In particular, we find that experimental estimates of average gate errors measured through randomized benchmarking and reconstructed via quantum process tomography are tightly lower-bounded by our analytical estimates, while the depolarizing model overestimates the gate error. Our noise modeling including non-Markovian contributions can be readily applied to established frameworks such as dynamical decoupling and dynamically-corrected gates, or to provide more realistic thresholds for quantum error correction.