title: Imperceptible Rhythm Backdoor Attacks: Exploring Rhythm Transformation for Embedding Undetectable Vulnerabilities on Speech Recognition

abstract: Speech recognition is an essential start ring of human-computer interaction, and recently, deep learning models have achieved excellent success in this task. However, when the model training and private data provider are always separated, some security threats that make deep neural networks (DNNs) abnormal deserve to be researched. In recent years, the typical backdoor attacks have been researched in speech recognition systems. The existing backdoor methods are based on data poisoning. The attacker adds some incorporated changes to benign speech spectrograms or changes the speech components, such as pitch and timbre. As a result, the poisoned data can be detected by human hearing or automatic deep algorithms. To improve the stealthiness of data poisoning, we propose a non-neural and fast algorithm called Random Spectrogram Rhythm Transformation (RSRT) in this paper. The algorithm combines four steps to generate stealthy poisoned utterances. From the perspective of rhythm component transformation, our proposed trigger stretches or squeezes the mel spectrograms and recovers them back to signals. The operation keeps timbre and content unchanged for good stealthiness. Our experiments are conducted on two kinds of speech recognition tasks, including testing the stealthiness of poisoned samples by speaker verification and automatic speech recognition. The results show that our method has excellent effectiveness and stealthiness. The rhythm trigger needs a low poisoning rate and gets a very high attack success rate.


title: Improving Adversarial Robustness via Decoupled Visual Representation Masking

abstract: Deep neural networks are proven to be vulnerable to fine-designed adversarial examples, and adversarial defense algorithms draw more and more attention nowadays. Pre-processing based defense is a major strategy, as well as learning robust feature representation has been proven an effective way to boost generalization. However, existing defense works lack considering different depth-level visual features in the training process. In this paper, we first highlight two novel properties of robust features from the feature distribution perspective: 1) \textbf{Diversity}. The robust feature of intra-class samples can maintain appropriate diversity; 2) \textbf{Discriminability}. The robust feature of inter-class samples should ensure adequate separation. We find that state-of-the-art defense methods aim to address both of these mentioned issues well. It motivates us to increase intra-class variance and decrease inter-class discrepancy simultaneously in adversarial training. Specifically, we propose a simple but effective defense based on decoupled visual representation masking. The designed Decoupled Visual Feature Masking (DFM) block can adaptively disentangle visual discriminative features and non-visual features with diverse mask strategies, while the suitable discarding information can disrupt adversarial noise to improve robustness. Our work provides a generic and easy-to-plugin block unit for any former adversarial training algorithm to achieve better protection integrally. Extensive experimental results prove the proposed method can achieve superior performance compared with state-of-the-art defense approaches. The code is publicly available at \href{https://github.com/chenboluo/Adversarial-defense}{https://github.com/chenboluo/Adversarial-defense}.


title: Beyond Answers: Large Language Model-Powered Tutoring System in Physics Education for Deep Learning and Precise Understanding

abstract: The integration of artificial intelligence (AI) in education has shown significant promise, yet the effective personalization of learning, particularly in physics education, remains a challenge. This paper proposes Physics-STAR, a framework for large language model (LLM)- powered tutoring system designed to address this gap by providing personalized and adaptive learning experiences for high school students. Our study evaluates Physics-STAR against traditional teacher-led lectures and generic LLM tutoring through a controlled experiment with 12 high school sophomores. Results showed that Physics-STAR increased students' average scores and efficiency on conceptual, computational, and on informational questions. In particular, students' average scores on complex information problems increased by 100% and their efficiency increased by 5.95%. By facilitating step-by-step guidance and reflective learning, Physics-STAR helps students develop critical thinking skills and a robust comprehension of abstract concepts. The findings underscore the potential of AI-driven personalized tutoring systems to transform physics education. As LLM continues to advance, the future of student-centered AI in education looks promising, with the potential to significantly improve learning outcomes and efficiency.


title: Pick-or-Mix: Dynamic Channel Sampling for ConvNets

abstract: Channel pruning approaches for convolutional neural networks (ConvNets) deactivate the channels, statically or dynamically, and require special implementation. In addition, channel squeezing in representative ConvNets is carried out via 1x1 convolutions which dominates a large portion of computations and network parameters. Given these challenges, we propose an effective multi-purpose module for dynamic channel sampling, namely Pick-or-Mix (PiX), which does not require special implementation. PiX divides a set of channels into subsets and then picks from them, where the picking decision is dynamically made per each pixel based on the input activations. We plug PiX into prominent ConvNet architectures and verify its multi-purpose utilities. After replacing 1x1 channel squeezing layers in ResNet with PiX, the network becomes 25% faster without losing accuracy. We show that PiX allows ConvNets to learn better data representation than widely adopted approaches to enhance networks' representation power (e.g., SE, CBAM, AFF, SKNet, and DWP). We also show that PiX achieves state-of-the-art performance on network downscaling and dynamic channel pruning applications.


title: Statistical description of mobile oscillators in embryonic pattern formation

abstract: Synchronization of mobile oscillators occurs in numerous contexts, including physical, chemical, biological and engineered systems. In vertebrate embryonic development, a segmental body structure is generated by a population of mobile oscillators. Cells in this population produce autonomous gene expression rhythms, and interact with their neighbors through local signaling. These cells form an extended tissue where frequency and cell mobility gradients coexist. Gene expression kinematic waves travel through this tissue and pattern the segment boundaries. It has been shown that oscillator mobility promotes global synchronization. However, in vertebrate segment formation, mobility may also introduce local fluctuations in kinematic waves and impair segment boundaries. Here we derive a general framework for mobile oscillators that relates local mobility fluctuations to synchronization dynamics and pattern robustness. We formulate a statistical description of mobile phase oscillators in terms of a probability density. We obtain and solve diffusion equations for the average phase and variance, revealing the relationship between local fluctuations and global synchronization in a homogeneous population of oscillators. Analysis of the probability density for large mobility identifies a mean-field transition, where locally coupled oscillators start behaving as if each oscillator was coupled with all the others. We extend the statistical description to inhomogeneous systems to address the gradients present in the vertebrate segmenting tissue. The theory relates pattern stability to mobility, coupling and pattern wavelength. The general approach of the statistical description may be applied to mobile oscillators in other contexts, as well as to other patterning systems where mobility is present.


title: Understanding Understanding: A Pragmatic Framework Motivated by Large Language Models

abstract: Motivated by the rapid ascent of Large Language Models (LLMs) and debates about the extent to which they possess human-level qualities, we propose a framework for testing whether any agent (be it a machine or a human) understands a subject matter. In Turing-test fashion, the framework is based solely on the agent's performance, and specifically on how well it answers questions. Elements of the framework include circumscribing the set of questions (the "scope of understanding"), requiring general competence ("passing grade"), avoiding "ridiculous answers", but still allowing wrong and "I don't know" answers to some questions. Reaching certainty about these conditions requires exhaustive testing of the questions which is impossible for nontrivial scopes, but we show how high confidence can be achieved via random sampling and the application of probabilistic confidence bounds. We also show that accompanying answers with explanations can improve the sample complexity required to achieve acceptable bounds, because an explanation of an answer implies the ability to answer many similar questions. According to our framework, current LLMs cannot be said to understand nontrivial domains, but as the framework provides a practical recipe for testing understanding, it thus also constitutes a tool for building AI agents that do understand.


title: DET-LSH: A Locality-Sensitive Hashing Scheme with Dynamic Encoding Tree for Approximate Nearest Neighbor Search

abstract: Locality-sensitive hashing (LSH) is a well-known solution for approximate nearest neighbor (ANN) search in high-dimensional spaces due to its robust theoretical guarantee on query accuracy. Traditional LSH-based methods mainly focus on improving the efficiency and accuracy of the query phase by designing different query strategies, but pay little attention to improving the efficiency of the indexing phase. They typically fine-tune existing data-oriented partitioning trees to index data points and support their query strategies. However, their strategy to directly partition the multi-dimensional space is time-consuming, and performance degrades as the space dimensionality increases. In this paper, we design an encoding-based tree called Dynamic Encoding Tree (DE-Tree) to improve the indexing efficiency and support efficient range queries based on Euclidean distance. Based on DE-Tree, we propose a novel LSH scheme called DET-LSH. DET-LSH adopts a novel query strategy, which performs range queries in multiple independent index DE-Trees to reduce the probability of missing exact NN points, thereby improving the query accuracy. Our theoretical studies show that DET-LSH enjoys probabilistic guarantees on query accuracy. Extensive experiments on real-world datasets demonstrate the superiority of DET-LSH over the state-of-the-art LSH-based methods on both efficiency and accuracy. While achieving better query accuracy than competitors, DET-LSH achieves up to 6x speedup in indexing time and 2x speedup in query time over the state-of-the-art LSH-based methods. This paper was published in PVLDB 2024.


title: On the Existence of Weighted-cscK Metrics

abstract: In this paper, we prove that on a smooth K\"ahler manifold, the $\mathbb{G}$-coercivity of the weighted Mabuchi functional implies the existence of weighted-cscK (extremal) metric (firstly studied in \cite{Lah19}), e.g, cscK metric, K\"ahler--Ricci soliton. Furthermore, we generalize this result to the case of $\mathbb{G}$-equivariant $\mathbb{Q}$-Gorenstein smoothable projective klt varieties.


title: Towards augmented data quality management: Automation of Data Quality Rule Definition in Data Warehouses

abstract: In the contemporary data-driven landscape, ensuring data quality (DQ) is crucial for deriving actionable insights from vast data repositories. The objective of this study is to explore the potential for automating data quality management within data warehouses as data repository commonly used by large organizations. By conducting a systematic review of existing DQ tools available in the market and academic literature, the study assesses their capability to automatically detect and enforce data quality rules. The review encompassed 151 tools from various sources, revealing that most current tools focus on data cleansing and fixing in domain-specific databases rather than data warehouses. Only a limited number of tools, specifically ten, demonstrated the capability to detect DQ rules, not to mention implementing this in data warehouses. The findings underscore a significant gap in the market and academic research regarding AI-augmented DQ rule detection in data warehouses. This paper advocates for further development in this area to enhance the efficiency of DQ management processes, reduce human workload, and lower costs. The study highlights the necessity of advanced tools for automated DQ rule detection, paving the way for improved practices in data quality management tailored to data warehouse environments. The study can guide organizations in selecting data quality tool that would meet their requirements most.


title: Near-Field Localization and Sensing with Large-Aperture Arrays: From Signal Modeling to Processing

abstract: The signal processing community is currently witnessing a growing interest in near-field signal processing, driven by the trend towards the use of large aperture arrays with high spatial resolution in the fields of communication, localization, sensing, imaging, etc. From the perspective of localization and sensing, this trend breaks the basic far-field assumptions that have dominated the array signal processing research in the past, presenting new challenges and promising opportunities.


title: Effective Generative AI: The Human-Algorithm Centaur

abstract: Advanced analytics science methods have enabled combining the power of artificial and human intelligence, creating \textit{centaurs} that allow superior decision-making. Centaurs are hybrid human-algorithm AI models that combine both formal analytics and human intuition in a symbiotic manner within their learning and reasoning process. We argue that the future of AI development and use in many domains needs to focus on centaurs as opposed to traditional AI approaches. This paradigm shift from traditional AI methods to centaur-based AI methods raises some fundamental questions: How are centaurs different from traditional human-in-the-loop methods? What are the most effective methods for creating centaurs? When should centaurs be used, and when should the lead be given to traditional AI models? Doesn't the incorporation of human intuition -- which at times can be misleading -- in centaurs' decision-making process degrade its performance compared to traditional AI methods? This work aims to address these fundamental questions, focusing on recent advancements in generative AI, and especially in Large Language Models (LLMs), as a main case study to illustrate centaurs' critical essentiality to future AI endeavors.


title: Rectified Iterative Disparity for Stereo Matching

abstract: Both uncertainty-assisted and iteration-based methods have achieved great success in stereo matching. However, existing uncertainty estimation methods take a single image and the corresponding disparity as input, which imposes higher demands on the estimation network. In this paper, we propose Cost volume-based disparity Uncertainty Estimation (UEC). Based on the rich similarity information in the cost volume coming from the image pairs, the proposed UEC can achieve competitive performance with low computational cost. Secondly, we propose two methods of uncertainty-assisted disparity estimation, Uncertainty-based Disparity Rectification (UDR) and Uncertainty-based Disparity update Conditioning (UDC). These two methods optimise the disparity update process of the iterative-based approach without adding extra parameters. In addition, we propose Disparity Rectification loss that significantly improves the accuracy of small amount of disparity updates. We present a high-performance stereo architecture, DR Stereo, which is a combination of the proposed methods. Experimental results from SceneFlow, KITTI, Middlebury 2014, and ETH3D show that DR-Stereo achieves very competitive disparity estimation performance.


title: Testing unified models for the origin of ultrahigh-energy cosmic rays and neutrinos:Multimessenger approaches with x-ray observations

abstract: The unified models of astrophysical sources to account for ultrahigh-energy cosmic rays (UHECRs) and high-energy cosmic neutrinos with energies greater than 100 TeV have been discussed. Based on model-independent arguments, we argue that if the photomeson production is the dominant mechanism, the most probable candidate sources are x-ray transient objects, allowing for the semi-transparency for the photomeson production. We develop a generic model of high-energy neutrino emitters accompanied by x-ray emission, and present how multimessenger observations can place significant constraints on the source parameters that characterize the common sources of neutrinos and UHECRs, such as the cosmic-ray loading factor. The requirements of UHECR acceleration, escape, and energetics further constrain the magnetic field and the bulk Lorentz factor of the sources. The resulting bounds provide diagnoses of the unified models, which demonstrates the importance of current and future x-ray facilities such as MAXI and Einstein Probe.


title: Tilt stability of Ky-Fan $\kappa$-norm composite optimization

abstract: This paper concerns the tilt stability for the minimization of the sum of a twice continuously differentiable matrix-valued function and the Ky-Fan $\kappa$-norm. By using the expression of second subderivative of the Ky-Fan $\kappa$-norm, we derive a verifiable criterion to identify the tilt stability of a local minimum for this class of nonconvex and nonsmooth problems. As a byproduct, a practical criterion is achieved for the tilt stable solution of the nuclear-norm regularized minimization.


title: Extracting $\alpha_\mathrm{S}$ at future $e^+e^{-}$ Higgs factory with energy correlators

abstract: The prospected sensitivity in $\alpha_\mathrm{S}$ determination using an event shape observable, ratio of energy correlators at future electron-positron collider is presented. The study focuses on the collinear region which has suffered from large theoretical and hadronization uncertainty in the past. The ratio effectively reduces the impacts of the uncertainties. With the amount of data that future electron-positron collider could produce in 1 minute (40 $\text{pb}^{-1}$) and 0.5 hour (1 $\text{fb}^{-1}$), a 1% and 0.2% precision of $\alpha_\mathrm{S}$ could be reached.


title: The algebraic and geometric classification of compatible Pre-Lie algebras

abstract: In this paper, we develop a method to obtain the algebraic classification of compatible pre-Lie algebras from the classification of pre-Lie algebras of the same dimension. We use this method to obtain the algebraic classification of complex $2$-dimensional compatible pre-Lie algebras. As a byproduct, we obtain the classification of complex $2$-dimensional compatible commutative associative, compatible associative, and compatible Novikov algebras. In addition, we consider the geometric classification of varieties of cited algebras, that is the description of its irreducible components.


title: Incorporating uncertainty quantification into travel mode choice modeling: a Bayesian neural network (BNN) approach and an uncertainty-guided active survey framework

abstract: Existing deep learning approaches for travel mode choice modeling fail to inform modelers about their prediction uncertainty. Even when facing scenarios that are out of the distribution of training data, which implies high prediction uncertainty, these approaches still provide deterministic answers, potentially leading to misguidance. To address this limitation, this study introduces the concept of uncertainty from the field of explainable artificial intelligence into travel mode choice modeling. We propose a Bayesian neural network-based travel mode prediction model (BTMP) that quantifies the uncertainty of travel mode predictions, enabling the model itself to "know" and "tell" what it doesn't know. With BTMP, we further propose an uncertainty-guided active survey framework, which dynamically formulates survey questions representing travel mode choice scenarios with high prediction uncertainty. Through iterative collection of responses to these dynamically tailored survey questions, BTMP is iteratively trained to achieve the desired accuracy faster with fewer questions, thereby reducing survey costs. Experimental validation using synthetic datasets confirms the effectiveness of BTMP in quantifying prediction uncertainty. Furthermore, experiments, utilizing both synthetic and real-world data, demonstrate that the BTMP model, trained with the uncertainty-guided active survey framework, requires 20% to 50% fewer survey responses to match the performance of the model trained on randomly collected survey data. Overall, the proposed BTMP model and active survey framework innovatively incorporate uncertainty quantification into travel mode choice modeling, providing model users with essential insights into prediction reliability while optimizing data collection for deep learning model training in a cost-efficient manner.


title: Pure *-homomorphisms

abstract: We introduce and study a notion of pureness for *-homomorphisms and, more generally, for cpc. order-zero maps. After providing several examples of pureness, such as "$\mathcal{Z}$-stable"-like maps, we focus on the question of when pure maps factor through a pure C*-algebra. We show that, up to Cuntz equivalence, any composition of two pure maps factors through a pure object. This is used to obtain several factorization results at the level of C*-algebras.


title: E-Bench: Towards Evaluating the Ease-of-Use of Large Language Models

abstract: Most large language models (LLMs) are sensitive to prompts, and another synonymous expression or a typo may lead to unexpected results for the model. Composing an optimal prompt for a specific demand lacks theoretical support and relies entirely on human experimentation, which poses a considerable obstacle to popularizing generative artificial intelligence. However, there is no systematic analysis of the stability of LLMs in resisting prompt perturbations in real-world scenarios. In this work, we propose to evaluate the ease-of-use of LLMs and construct E-Bench, simulating the actual situation of human use from synonymous perturbation (including paraphrasing, simplification, and colloquialism) and typographical perturbation (such as typing). On this basis, we also discuss the combination of these two types of perturbation and analyze the main reasons for performance degradation. Experimental results indicate that with the increase of model size, although the ease-of-use are significantly improved, there is still a long way to go to build a sufficiently user-friendly model.


title: Don't Forget Too Much: Towards Machine Unlearning on Feature Level

abstract: Machine unlearning enables pre-trained models to remove the effect of certain portions of training data. Previous machine unlearning schemes have mainly focused on unlearning a cluster of instances or all instances belonging to a specific class. These types of unlearning might have a significant impact on the model utility; and they may be inadequate for situations where we only need to unlearn features within instances, rather than the whole instances. Due to the different granularity, current unlearning methods can hardly achieve feature-level unlearning. To address the challenges of utility and granularity, we propose a refined granularity unlearning scheme referred to as ``feature unlearning". We first explore two distinct scenarios based on whether the annotation information about the features is given: feature unlearning with known annotations and feature unlearning without annotations. Regarding unlearning with known annotations, we propose an adversarial learning approach to automatically remove effects about features. For unlearning without annotations, we initially enable the output of one model's layer to identify different pattern features using model interpretability techniques. We proceed to filter features from instances based on these outputs with identifying ability. So that we can remove the feature impact based on filtered instances and the fine-tuning process. The effectiveness of our proposed approach is demonstrated through experiments involving diverse models on various datasets in different scenarios.


title: Avoiding Copyright Infringement via Machine Unlearning

abstract: Pre-trained Large Language Models (LLMs) have demonstrated remarkable capabilities but also pose risks by learning and generating copyrighted material, leading to significant legal and ethical concerns. To address these issues, it is critical for model owners to be able to unlearn copyrighted content at various time steps. We explore the setting of sequential unlearning, where copyrighted content is removed over multiple time steps - a scenario that has not been rigorously addressed. To tackle this challenge, we propose Stable Sequential Unlearning (SSU), a novel unlearning framework for LLMs, designed to have a more stable process to remove copyrighted content from LLMs throughout different time steps using task vectors, by incorporating additional random labeling loss and applying gradient-based weight saliency mapping. Experiments demonstrate that SSU finds a good balance between unlearning efficacy and maintaining the model's general knowledge compared to existing baselines.


title: Really Unlearned? Verifying Machine Unlearning via Influential Sample Pairs

abstract: Machine unlearning enables pre-trained models to eliminate the effects of partial training samples. Previous research has mainly focused on proposing efficient unlearning strategies. However, the verification of machine unlearning, or in other words, how to guarantee that a sample has been successfully unlearned, has been overlooked for a long time. Existing verification schemes typically rely on machine learning attack techniques, such as backdoor or membership inference attacks. As these techniques are not formally designed for verification, they are easily bypassed when an untrustworthy MLaaS undergoes rapid fine-tuning to merely meet the verification conditions, rather than executing real unlearning. In this paper, we propose a formal verification scheme, IndirectVerify, to determine whether unlearning requests have been successfully executed. We design influential sample pairs: one referred to as trigger samples and the other as reaction samples. Users send unlearning requests regarding trigger samples and use reaction samples to verify if the unlearning operation has been successfully carried out. We propose a perturbation-based scheme to generate those influential sample pairs. The objective is to perturb only a small fraction of trigger samples, leading to the reclassification of reaction samples. This indirect influence will be used for our verification purposes. In contrast to existing schemes that employ the same samples for all processes, our scheme, IndirectVerify, provides enhanced robustness, making it less susceptible to bypassing processes.


title: Towards Efficient Target-Level Machine Unlearning Based on Essential Graph

abstract: Machine unlearning is an emerging technology that has come to attract widespread attention. A number of factors, including regulations and laws, privacy, and usability concerns, have resulted in this need to allow a trained model to forget some of its training data. Existing studies of machine unlearning mainly focus on unlearning requests that forget a cluster of instances or all instances from one class. While these approaches are effective in removing instances, they do not scale to scenarios where partial targets within an instance need to be forgotten. For example, one would like to only unlearn a person from all instances that simultaneously contain the person and other targets. Directly migrating instance-level unlearning to target-level unlearning will reduce the performance of the model after the unlearning process, or fail to erase information completely. To address these concerns, we have proposed a more effective and efficient unlearning scheme that focuses on removing partial targets from the model, which we name "target unlearning". Specifically, we first construct an essential graph data structure to describe the relationships between all important parameters that are selected based on the model explanation method. After that, we simultaneously filter parameters that are also important for the remaining targets and use the pruning-based unlearning method, which is a simple but effective solution to remove information about the target that needs to be forgotten. Experiments with different training models on various datasets demonstrate the effectiveness of the proposed approach.


title: A Double Copy of Geometry

abstract: We propose an extension of the color-kinematics duality for nonlinear sigma models with nonsymmetric cosets. The role of color is played by curvatures in field space. The duality between curvature and kinematics allows for a new double copy: the double copy of the nonlinear sigma model for nonsymmetric cosets is the general Galileon theory. We provide evidence for this new double copy of geometry.


title: Robust Channel Learning for Large-Scale Radio Speaker Verification

abstract: Recent research in speaker verification has increasingly focused on achieving robust and reliable recognition under challenging channel conditions and noisy environments. Identifying speakers in radio communications is particularly difficult due to inherent limitations such as constrained bandwidth and pervasive noise interference. To address this issue, we present a Channel Robust Speaker Learning (CRSL) framework that enhances the robustness of the current speaker verification pipeline, considering data source, data augmentation, and the efficiency of model transfer processes. Our framework introduces an augmentation module that mitigates bandwidth variations in radio speech datasets by manipulating the bandwidth of training inputs. It also addresses unknown noise by introducing noise within the manifold space. Additionally, we propose an efficient fine-tuning method that reduces the need for extensive additional training time and large amounts of data. Moreover, we develop a toolkit for assembling a large-scale radio speech corpus and establish a benchmark specifically tailored for radio scenario speaker verification studies. Experimental results demonstrate that our proposed methodology effectively enhances performance and mitigates degradation caused by radio transmission in speaker verification tasks. The code will be available on Github.


title: Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence

abstract: Direct Preference Optimization (DPO) has emerged as a prominent algorithm for the direct and robust alignment of Large Language Models (LLMs) with human preferences, offering a more straightforward alternative to the complex Reinforcement Learning from Human Feedback (RLHF). Despite its promising efficacy, DPO faces a notable drawback: "verbosity", a common over-optimization phenomenon also observed in RLHF. While previous studies mainly attributed verbosity to biased labels within the data, we propose that the issue also stems from an inherent algorithmic length reliance in DPO. Specifically, we suggest that the discrepancy between sequence-level Kullback-Leibler (KL) divergences between chosen and rejected sequences, used in DPO, results in overestimated or underestimated rewards due to varying token lengths. Empirically, we utilize datasets with different label lengths to demonstrate the presence of biased rewards. We then introduce an effective downsampling approach, named SamPO, to eliminate potential length reliance. Our experimental evaluations, conducted across three LLMs of varying scales and a diverse array of conditional and open-ended benchmarks, highlight the efficacy of SamPO in mitigating verbosity, achieving improvements of 5% to 12% over DPO through debaised rewards. Our codes can be accessed at: https://github.com/LuJunru/SamPO/.


title: City-LEO: Toward Transparent City Management Using LLM with End-to-End Optimization

abstract: Existing operations research (OR) models and tools play indispensable roles in smart-city operations, yet their practical implementation is limited by the complexity of modeling and deficiencies in optimization proficiency. To generate more relevant and accurate solutions to users' requirements, we propose a large language model (LLM)-based agent ("City-LEO") that enhances the efficiency and transparency of city management through conversational interactions. Specifically, to accommodate diverse users' requirements and enhance computational tractability, City-LEO leverages LLM's logical reasoning capabilities on prior knowledge to scope down large-scale optimization problems efficiently. In the human-like decision process, City-LEO also incorporates End-to-end (E2E) model to synergize the prediction and optimization. The E2E framework be conducive to coping with environmental uncertainties and involving more query-relevant features, and then facilitates transparent and interpretable decision-making process. In case study, we employ City-LEO in the operations management of e-bike sharing (EBS) system. The numerical results demonstrate that City-LEO has superior performance when benchmarks against the full-scale optimization problem. With less computational time, City-LEO generates more satisfactory and relevant solutions to the users' requirements, and achieves lower global suboptimality without significantly compromising accuracy. In a broader sense, our proposed agent offers promise to develop LLM-embedded OR tools for smart-city operations management.


title: On Convergence and Rate of Convergence of Policy Improvement Algorithms

abstract: In this paper we provide a simple proof from scratch for the convergence of Policy Improvement Algorithm (PIA) for a continuous time entropy-regularized stochastic control problem. Such convergence has been established by Huang-Wang-Zhou(2023) by using sophisticated PDE estimates for the iterative PDEs involved in the PIA. Our approach builds on some Feynman-Kac type probabilistic representation formulae for solutions of PDEs and their derivatives. Moreover, in the infinite horizon model with a large discount factor and in the finite horizon model, we obtain the exponential rate of convergence with similar arguments. Finally, in the one dimensional setting, we extend the convergence result to the diffusion control case.


title: ESCoT: Towards Interpretable Emotional Support Dialogue Systems

abstract: Understanding the reason for emotional support response is crucial for establishing connections between users and emotional support dialogue systems. Previous works mostly focus on generating better responses but ignore interpretability, which is extremely important for constructing reliable dialogue systems. To empower the system with better interpretability, we propose an emotional support response generation scheme, named $\textbf{E}$motion-Focused and $\textbf{S}$trategy-Driven $\textbf{C}$hain-$\textbf{o}$f-$\textbf{T}$hought ($\textbf{ESCoT}$), mimicking the process of $\textit{identifying}$, $\textit{understanding}$, and $\textit{regulating}$ emotions. Specially, we construct a new dataset with ESCoT in two steps: (1) $\textit{Dialogue Generation}$ where we first generate diverse conversation situations, then enhance dialogue generation using richer emotional support strategies based on these situations; (2) $\textit{Chain Supplement}$ where we focus on supplementing selected dialogues with elements such as emotion, stimuli, appraisal, and strategy reason, forming the manually verified chains. Additionally, we further develop a model to generate dialogue responses with better interpretability. We also conduct extensive experiments and human evaluations to validate the effectiveness of the proposed ESCoT and generated dialogue responses. Our data and code are available at $\href{https://github.com/TeigenZhang/ESCoT}{https://github.com/TeigenZhang/ESCoT}$.


title: Open-Vocabulary X-ray Prohibited Item Detection via Fine-tuning CLIP

abstract: X-ray prohibited item detection is an essential component of security check and categories of prohibited item are continuously increasing in accordance with the latest laws. Previous works all focus on close-set scenarios, which can only recognize known categories used for training and often require time-consuming as well as labor-intensive annotations when learning novel categories, resulting in limited real-world applications. Although the success of vision-language models (e.g. CLIP) provides a new perspectives for open-set X-ray prohibited item detection, directly applying CLIP to X-ray domain leads to a sharp performance drop due to domain shift between X-ray data and general data used for pre-training CLIP. To address aforementioned challenges, in this paper, we introduce distillation-based open-vocabulary object detection (OVOD) task into X-ray security inspection domain by extending CLIP to learn visual representations in our specific X-ray domain, aiming to detect novel prohibited item categories beyond base categories on which the detector is trained. Specifically, we propose X-ray feature adapter and apply it to CLIP within OVOD framework to develop OVXD model. X-ray feature adapter containing three adapter submodules of bottleneck architecture, which is simple but can efficiently integrate new knowledge of X-ray domain with original knowledge, further bridge domain gap and promote alignment between X-ray images and textual concepts. Extensive experiments conducted on PIXray and PIDray datasets demonstrate that proposed method performs favorably against other baseline OVOD methods in detecting novel categories in X-ray scenario. It outperforms previous best result by 15.2 AP50 and 1.5 AP50 on PIXray and PIDray with achieving 21.0 AP50 and 27.8 AP50 respectively.


title: SynthTree: Co-supervised Local Model Synthesis for Explainable Prediction

abstract: Explainable machine learning (XML) has emerged as a major challenge in artificial intelligence (AI). Although black-box models such as Deep Neural Networks and Gradient Boosting often exhibit exceptional predictive accuracy, their lack of interpretability is a notable drawback, particularly in domains requiring transparency and trust. This paper tackles this core AI problem by proposing a novel method to enhance explainability with minimal accuracy loss, using a Mixture of Linear Models (MLM) estimated under the co-supervision of black-box models. We have developed novel methods for estimating MLM by leveraging AI techniques. Specifically, we explore two approaches for partitioning the input space: agglomerative clustering and decision trees. The agglomerative clustering approach provides greater flexibility in model construction, while the decision tree approach further enhances explainability, yielding a decision tree model with linear or logistic regression models at its leaf nodes. Comparative analyses with widely-used and state-of-the-art predictive models demonstrate the effectiveness of our proposed methods. Experimental results show that statistical models can significantly enhance the explainability of AI, thereby broadening their potential for real-world applications. Our findings highlight the critical role that statistical methodologies can play in advancing explainable AI.


title: On boundary points of minimal continuously Hutchinson invariant sets

abstract: A linear differential operator $T=Q(z)\frac{d}{dz}+P(z)$ with polynomial coefficients defines a continuous family of Hutchinson operators when acting on the space of positive powers of linear forms. In this context, $T$ has a unique minimal Hutchinson-invariant set $M_{CH}^{T}$ in the complex plane. Using a geometric interpretation of its boundary in terms of envelops of certain families of rays, we subdivide this boundary into local and global arcs (the former being portions of integral curves of the rational vector field $\frac{Q(z)}{P(z)}\partial_{z}$), and singular points of different types which we classify below. The latter decomposition of the boundary of $M_{CH}^{T}$ is largely determined by its intersection with the plane algebraic curve formed by the inflection points of trajectories of the field $\frac{Q(z)}{P(z)}\partial_{z}$. We provide an upper bound for the number of local arcs in terms of degrees of $P$ and $Q$. As an application of our classification, we obtain a number of global geometric properties of minimal Hutchinson-invariant sets.


title: Ontology Embedding: A Survey of Methods, Applications and Resources

abstract: Ontologies are widely used for representing domain knowledge and meta data, playing an increasingly important role in Information Systems, the Semantic Web, Bioinformatics and many other domains. However, logical reasoning that ontologies can directly support are quite limited in learning, approximation and prediction. One straightforward solution is to integrate statistical analysis and machine learning. To this end, automatically learning vector representation for knowledge of an ontology i.e., ontology embedding has been widely investigated in recent years. Numerous papers have been published on ontology embedding, but a lack of systematic reviews hinders researchers from gaining a comprehensive understanding of this field. To bridge this gap, we write this survey paper, which first introduces different kinds of semantics of ontologies, and formally defines ontology embedding from the perspectives of both mathematics and machine learning, as well as its property of faithfulness. Based on this, it systematically categorises and analyses a relatively complete set of over 80 papers, according to the ontologies and semantics that they aim at, and their technical solutions including geometric modeling, sequence modeling and graph propagation. This survey also introduces the applications of ontology embedding in ontology engineering, machine learning augmentation and life sciences, presents a new library mOWL, and discusses the challenges and future directions.


title: DocNet: Semantic Structure in Inductive Bias Detection Models

abstract: News will have biases so long as people have opinions. However, as social media becomes the primary entry point for news and partisan gaps increase, it is increasingly important for informed citizens to be able to identify bias. People will be able to take action to avoid polarizing echo chambers if they know how the news they are consuming is biased. In this paper, we explore an often overlooked aspect of bias detection in documents: the semantic structure of news articles. We present DocNet, a novel, inductive, and low-resource document embedding and bias detection model that outperforms large language models. We also demonstrate that the semantic structure of news articles from opposing partisan sides, as represented in document-level graph embeddings, have significant similarities. These results can be used to advance bias detection in low-resource environments. Our code and data are made available at https://github.com/nlpresearchanon.


title: Connectedness and integrally closed local overrings of two-dimensional regular local rings

abstract: Let $D$ be a two-dimensional regular local ring. We prove there is a one-to-one correspondence between closed connected sets in the space of valuation overrings of $D$ that dominate $D$ and the integrally closed local overrings of $D$ that are not essential valuation rings or divisorial valuation rings of $D$.


title: A note on entanglement entropy and topological defects in symmetric orbifold CFTs

abstract: In this brief note we calculate the entanglement entropy in $M^{\otimes N}/S_N$ symmetric orbifold CFTs in the presence of topological defects, which were recently constructed in \cite{Gutperle:2024vyp,Knighton:2024noc}. We consider both universal defects which realize $Rep(S_N)$ non-invertible symmetry and non-universal defects. We calculate the sub-leading defect entropy/g-factor for defects at the boundary entangling surface as well as inside it.


title: Black Hole Singularity and Timelike Entanglement

abstract: We study timelike and conventional entanglement entropy as potential probes of black hole singularities via the AdS/CFT correspondence. Using an analytically tractable example, we find characteristic behavior of holographic timelike entanglement entropy when the geometry involves a curvature singularity. We also observe interesting phenomena that, in some particular setups, holographic timelike and conventional entanglement entropy are determined from multiple complex saddle points, which fall outside the assumptions of the Lewkowycz-Maldacena type argument.


title: The 95GeV Excesses in the $\mathbb{Z}_3$-symmetric Next-to Minimal Supersymmetric Standard Model

abstract: Recent analyses by CMS and ATLAS suggest a deviation in the di-photon channel at approximately 95 GeV, alongside a previously observed excess in $b\bar{b}$ signals at a similar mass by LEP, potentially hinting at a new scalar particle. This study explores this possibility within the framework of the well-established $\mathbb{Z}_3$-symmetric Next-to-Minimal Supersymmetric Standard Model. A comprehensive parameter scan was conducted, integrating constraints from dark matter relic density, direct detection experiments, and the properties of the observed 125 GeV Higgs boson. The results demonstrate that the model can accommodate the observed excesses with a singlet-dominated CP-even Higgs boson near 95 GeV. The model accurately predicts signal strengths of the di-photon and $b\bar{b}$ channels at a level of $1\sigma$. Furthermore, it accounts for the measured dark matter relic abundance through Bino-dominated neutralinos co-annihilation with Wino-like electroweakinos, all while remaining consistent with existing LHC constraints. These findings pave the way for future validation at the high-luminosity LHC and linear colliders, which may offer crucial tests of the model's predictions.


title: Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generation

abstract: We present JASCO, a temporally controlled text-to-music generation model utilizing both symbolic and audio-based conditions. JASCO can generate high-quality music samples conditioned on global text descriptions along with fine-grained local controls. JASCO is based on the Flow Matching modeling paradigm together with a novel conditioning method. This allows music generation controlled both locally (e.g., chords) and globally (text description). Specifically, we apply information bottleneck layers in conjunction with temporal blurring to extract relevant information with respect to specific controls. This allows the incorporation of both symbolic and audio-based conditions in the same text-to-music model. We experiment with various symbolic control signals (e.g., chords, melody), as well as with audio representations (e.g., separated drum tracks, full-mix). We evaluate JASCO considering both generation quality and condition adherence, using both objective metrics and human studies. Results suggest that JASCO is comparable to the evaluated baselines considering generation quality while allowing significantly better and more versatile controls over the generated music. Samples are available on our demo page https://pages.cs.huji.ac.il/adiyoss-lab/JASCO.


title: Small ball probabilities for the passage time in planar first-passage percolation

abstract: We study planar first-passage percolation with independent weights whose common distribution is supported on $(0,\infty)$ and is absolutely continuous with respect to Lebesgue measure. We prove that the passage time from $x$ to $y$ denoted by $T(x,y)$ satisfies $$\max _{a\ge 0} \mathbb P \big( T(x,y)\in [a,a+1] \big) \le \frac{C}{\sqrt{\log \|x-y\|}},$$ answering a question posed by of Ahlberg and de la Riva. This estimate recovers earlier results on the fluctuations of the passage time by Newman and Piza, Pemantle and Peres, and Chatterjee.


title: Endogenous Identity in a Social Network

abstract: Interaction with individuals from other socioeconomic classes has been shown to be a main driver for social mobility. We employ tools of social identity theory and network analysis to show how exposure to individuals of different social identities can lead to interactions with them, and an adoption of their identity, creating social mobility. We find that even if all individuals have the same ability, they may endogenously choose different identities, leading to different classes and actions. In particular, we derive a sufficient condition for such an equilibrium to exist, which equates to a novel measure of cohesion. Furthermore, we show that the most socially mobile individuals (changing their identity) are those who either have few connections or a more heterogeneous mix of identities in their connections. Finally, we show that upward social mobility increases action levels in society, but not necessarily welfare.


title: ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts

abstract: Parameter-efficient fine-tuning (PEFT) techniques such as low-rank adaptation (LoRA) can effectively adapt large pre-trained foundation models to downstream tasks using only a small fraction (0.1%-10%) of the original trainable weights. An under-explored question of PEFT is in extending the pre-training phase without supervised labels; that is, can we adapt a pre-trained foundation model to a new domain via efficient self-supervised pre-training on this new domain? In this work, we introduce ExPLoRA, a highly effective technique to improve transfer learning of pre-trained vision transformers (ViTs) under domain shifts. Initializing a ViT with pre-trained weights on large, natural-image datasets such as from DinoV2 or MAE, ExPLoRA continues the unsupervised pre-training objective on a new domain. In this extended pre-training phase, ExPLoRA only unfreezes 1-2 pre-trained ViT blocks and all normalization layers, and then tunes all other layers with LoRA. Finally, we fine-tune the resulting model only with LoRA on this new domain for supervised learning. Our experiments demonstrate state-of-the-art results on satellite imagery, even outperforming fully pre-training and fine-tuning ViTs. Using the DinoV2 training objective, we demonstrate up to 7% improvement in linear probing top-1 accuracy on downstream tasks while using <10% of the number of parameters that are used in prior fully-tuned state-of-the art approaches. Our ablation studies confirm the efficacy of our approach over other baselines, including PEFT and simply unfreezing more transformer blocks.


title: Towards Supporting Legal Argumentation with NLP: Is More Data Really All You Need?

abstract: Modeling legal reasoning and argumentation justifying decisions in cases has always been central to AI & Law, yet contemporary developments in legal NLP have increasingly focused on statistically classifying legal conclusions from text. While conceptually simpler, these approaches often fall short in providing usable justifications connecting to appropriate legal concepts. This paper reviews both traditional symbolic works in AI & Law and recent advances in legal NLP, and distills possibilities of integrating expert-informed knowledge to strike a balance between scalability and explanation in symbolic vs. data-driven approaches. We identify open challenges and discuss the potential of modern NLP models and methods that integrate


title: Internally heated convection with rotation: bounds and scaling laws for heat transport

abstract: This work investigates heat transport in rotating internally heated convection, for a horizontally periodic fluid between parallel plates under no-slip and isothermal boundary conditions. The main results are the proof of bounds on the mean temperature, $\overline{\langle T \rangle }$, and the heat flux out of the bottom boundary, $\mathcal{F}_B$ at infinite Prandtl numbers where the Prandtl number is the nondimensional ratio of viscous to thermal diffusion. The lower bounds are functions of a Rayleigh number quantifying the ratio of internal heating to diffusion and the Ekman number, $E$, which quantifies the ratio of viscous diffusion to rotation. We utilise two different estimates on the vertical velocity, $w$, one pointwise in the domain (Yan 2004, J. Math. Phys., vol. 45(7), pp. 2718-2743) and the other an integral estimate over the domain (Constantin et al . 1999, Phys. D: Non. Phen., vol. 125, pp. 275-284), resulting in bounds valid for different regions of buoyancy-to-rotation dominated convection. Furthermore, we demonstrate that similar to rotating Rayleigh-B\'enard convection, for small $E$, the critical Rayleigh number for the onset of convection asymptotically scales as $E^{-4/3}$.This result is combined with heuristic arguments for internally heated and rotating convection to arrive at scaling laws for $\overline{\langle T \rangle }$ and $\mathcal{F}_B$ valid for arbitrary Prandtl numbers.


title: Promoting Data and Model Privacy in Federated Learning through Quantized LoRA

abstract: Conventional federated learning primarily aims to secure the privacy of data distributed across multiple edge devices, with the global model dispatched to edge devices for parameter updates during the learning process. However, the development of large language models (LLMs) requires substantial data and computational resources, rendering them valuable intellectual properties for their developers and owners. To establish a mechanism that protects both data and model privacy in a federated learning context, we introduce a method that just needs to distribute a quantized version of the model's parameters during training. This method enables accurate gradient estimations for parameter updates while preventing clients from accessing a model whose performance is comparable to the centrally hosted one. Moreover, we combine this quantization strategy with LoRA, a popular and parameter-efficient fine-tuning method, to significantly reduce communication costs in federated learning. The proposed framework, named \textsc{FedLPP}, successfully ensures both data and model privacy in the federated learning context. Additionally, the learned central model exhibits good generalization and can be trained in a resource-efficient manner.


title: Toward Optimal LLM Alignments Using Two-Player Games

abstract: The standard Reinforcement Learning from Human Feedback (RLHF) framework primarily focuses on optimizing the performance of large language models using pre-collected prompts. However, collecting prompts that provide comprehensive coverage is both tedious and challenging, and often fails to include scenarios that LLMs need to improve on the most. In this paper, we investigate alignment through the lens of two-agent games, involving iterative interactions between an adversarial and a defensive agent. The adversarial agent's task at each step is to generate prompts that expose the weakness of the defensive agent. In return, the defensive agent seeks to improve its responses to these newly identified prompts it struggled with, based on feedback from the reward model. We theoretically demonstrate that this iterative reinforcement learning optimization converges to a Nash Equilibrium for the game induced by the agents. Experimental results in safety scenarios demonstrate that learning in such a competitive environment not only fully trains agents but also leads to policies with enhanced generalization capabilities for both adversarial and defensive agents.


title: Local wealth condensation for yard-sale models with wealth-dependent biases

abstract: In Chakraborti's yard-sale model of an economy, identical agents engage in pairwise trades, resulting in wealth exchanges that conserve each agent's expected wealth. Doob's martingale convergence theorem immediately implies almost sure wealth condensation, i.e., convergence to a state in which a single agent owns the entire economy. If some pairs of agents are not allowed to trade with each other, the martingale convergence theorem still implies local wealth condensation, i.e., convergence to a state in which some agents are wealthy, while all their trading partners are impoverished. In this note, we propose a new, more elementary proof of this result. Unlike the proof based on the martingale convergence theorem, our argument applies to models with a wealth-acquired advantage, and even to certain models with a poverty-acquired advantage.


title: Collisional whistler instability and electron temperature staircase in inhomogeneous plasma

abstract: High-beta magnetized plasmas often exhibit anomalously structured temperature profiles, as seen from galaxy cluster observations and recent experiments. It is well known that when such plasmas are collisionless, temperature gradients along the magnetic field can excite whistler waves that efficiently scatter electrons to limit their heat transport. Only recently has it been shown that parallel temperature gradients can excite whistler waves also in collisional plasmas. Here we develop a Wigner--Moyal theory for the collisional whistler instability starting from Braginskii-like fluid equations in a slab geometry. This formalism is necessary because, for a large region in parameter space, the fastest-growing whistler waves have wavelengths comparable to the background temperature gradients. We find additional damping terms in the expression for the instability growth rate involving inhomogeneous Nernst advection and resistivity. They (i) enable whistler waves to re-arrange the electron temperature profile via growth, propagation, and subsequent dissipation, and (ii) allow non-constant temperature profiles to exist stably. For high-beta plasmas, the marginally stable solutions take the form of a temperature staircase along the magnetic field lines. The electron heat flux can also be suppressed by the Ettingshausen effect when the whistler intensity profile is sufficiently peaked and oriented opposite the background temperature gradient. This mechanism allows cold fronts without magnetic draping, might reduce parallel heat losses in inertial fusion experiments, and generally demonstrates that whistler waves can regulate transport even in the collisional limit.


title: Density-dependent relativistic mean-field model for $ \Xi^{-} $ hypernuclei

abstract: In hypernuclear systems, interactions involving nucleons and hyperons are intricately influenced by the surrounding particles, particularly by the density and isospin feature of the nuclear medium. In this work, the relativistic mean-field (RMF) theory is adopted to describe the structure of several typical $ \Xi^{-} $ hypernuclei. New sets of $\Xi N$ effective interactions, by taking a density-dependent meson-nucleon/hyperon coupling perspective, are developed by fitting experimental data on the $\Xi^{-}$ hyperon $1s$ and $1p$ state separation energy of $^{15}_{\Xi^{-}}$C. It is found that the density-dependent behavior of meson-hyperon coupling strengths sensitively affects the description of hyperon single-particle levels, which play a crucial role in the consistent description of the theoretical and experimental separation energies of $\Xi^{-}$ $1s$ and $1p$ states in $^{15}_{\Xi^{-}}$C. In fact, the density-dependent meson-baryon coupling strengths introduce additional rearrangement contributions in the hyperon self-energy. Correspondingly, detailed forms of density dependence in these coupling strengths and different consideration of meson-baryon coupling channels will impact the hyperon single-particle properties within hypernuclei. Especially with the additional inclusion of isovector scalar $\delta$ meson, the significant enhancement of rearrangement terms in the effective interaction DD-ME$ \delta $ impacts the shape of the hyperon potential and alters the characteristics of the isovector channel dynamics balance in the effective nuclear force. Such effects may be crucial for describing hyperon separation energies in specific $\Xi^{-}$ hypernuclei such as $^{12}_{\Xi^{-}}$Be and in hypernuclei with higher mass numbers. Relevant research underscores the importance of precisely accounting for medium effects in hyperon-nucleon interactions.


title: ViD-GPT: Introducing GPT-style Autoregressive Generation in Video Diffusion Models

abstract: With the advance of diffusion models, today's video generation has achieved impressive quality. But generating temporal consistent long videos is still challenging. A majority of video diffusion models (VDMs) generate long videos in an autoregressive manner, i.e., generating subsequent clips conditioned on last frames of previous clip. However, existing approaches all involve bidirectional computations, which restricts the receptive context of each autoregression step, and results in the model lacking long-term dependencies. Inspired from the huge success of large language models (LLMs) and following GPT (generative pre-trained transformer), we bring causal (i.e., unidirectional) generation into VDMs, and use past frames as prompt to generate future frames. For Causal Generation, we introduce causal temporal attention into VDM, which forces each generated frame to depend on its previous frames. For Frame as Prompt, we inject the conditional frames by concatenating them with noisy frames (frames to be generated) along the temporal axis. Consequently, we present Video Diffusion GPT (ViD-GPT). Based on the two key designs, in each autoregression step, it is able to acquire long-term context from prompting frames concatenated by all previously generated frames. Additionally, we bring the kv-cache mechanism to VDMs, which eliminates the redundant computation from overlapped frames, significantly boosting the inference speed. Extensive experiments demonstrate that our ViD-GPT achieves state-of-the-art performance both quantitatively and qualitatively on long video generation. Code will be available at https://github.com/Dawn-LX/Causal-VideoGen.


title: Ergodic repeated interaction quantum systems: Steady states and reducibility theory

abstract: We consider the time evolution of an open quantum system subject to a sequence of random quantum channels with a stationary distribution. This incorporates disorder into the repeated interactions (or, quantum collision models) approach to understanding open quantum dynamics. In the literature, various specific models of disorder in repeated interaction models have been considered, including the cases where the sequence of quantum channels form either i.i.d. or Markovian stochastic processes. In the present paper we consider the general structure of such models without any specific assumptions on the probability distribution, aside from stationarity (i.e., time-translation invariance). In particular, arbitrarily strong correlations between time steps are allowed. In 2021, Movassagh and Schenker (MS) introduced a unified framework in which one may study such randomized quantum dynamics, and, under a key strong decoherence assumption proved an ergodic theorem for a large class of physically relevant examples. Here, we recognize the decoherence assumption of MS as a kind of irreducibility and develop a reducibility theory for general stationary random repeated interaction models without this condition. Within this framework, we establish ergodic theorems extending of those obtained by MS to the general stationary setting.


title: Expressibility of linear combination of ansatz circuits

abstract: Variational Quantum Eigensolver is considered promising for medium-scale noisy quantum computers. Expressibility is an important metric for measuring the capability of a variational quantum Ansatz circuit. A commonly used method to increase expressibility is to increase the circuit depth. However, increasing the circuit depth also introduces more noise. We propose to use a linear combination of ansatzes to improve the expressibility of variational circuits, thus avoiding the increase of circuit depth. Concurrently, we introduce a novel measurement strategy that circumvents the necessity for the Hadamard test, thereby significantly diminishing the reliance on two-qubit gates, which are presently the predominant contributors to quantum noise. We also provide a corresponding gradient calculation method, which makes it convenient to update the parameters. Compared with the method of increasing the circuit depth, our method of improving expressibility is more practical. Numerical simulations demonstrate the effectiveness of our method.


title: Revisiting Cosine Similarity via Normalized ICA-transformed Embeddings

abstract: Cosine similarity is widely used to measure the similarity between two embeddings, while interpretations based on angle and correlation coefficient are common. In this study, we focus on the interpretable axes of embeddings transformed by Independent Component Analysis (ICA), and propose a novel interpretation of cosine similarity as the sum of semantic similarities over axes. To investigate this, we first show experimentally that unnormalized embeddings contain norm-derived artifacts. We then demonstrate that normalized ICA-transformed embeddings exhibit sparsity, with a few large values in each axis and across embeddings, thereby enhancing interpretability by delineating clear semantic contributions. Finally, to validate our interpretation, we perform retrieval experiments using ideal embeddings with and without specific semantic components.


title: Taking a Deep Breath: Enhancing Language Modeling of Large Language Models with Sentinel Tokens

abstract: Large language models (LLMs) have shown promising efficacy across various tasks, becoming powerful tools in numerous aspects of human life. However, Transformer-based LLMs suffer a performance degradation when modeling long-term contexts due to they discard some information to reduce computational overhead. In this work, we propose a simple yet effective method to enable LLMs to take a deep breath, encouraging them to summarize information contained within discrete text chunks. Specifically, we segment the text into multiple chunks and insert special token <SR> at the end of each chunk. We then modify the attention mask to integrate the chunk's information into the corresponding <SR> token. This facilitates LLMs to interpret information not only from historical individual tokens but also from the <SR> token, aggregating the chunk's semantic information. Experiments on language modeling and out-of-domain downstream tasks validate the superiority of our approach.


title: Hyperbolic Metric Spaces and Stochastic Embeddings

abstract: Stochastic embeddings of finite metric spaces into graph-theoretic trees have proven to be a vital tool for constructing approximation algorithms in theoretical computer science. In the present work, we build out some of the basic theory of stochastic embeddings in the infinite setting with an aim towards applications to Lipschitz free space theory. We prove that proper metric spaces stochastically embedding into $\mathbb{R}$-trees have Lipschitz free spaces isomorphic to $L^1$-spaces. We then undergo a systematic study of stochastic embeddability of Gromov hyperbolic metric spaces into $\mathbb{R}$-trees by way of stochastic embeddability of their boundaries into ultrametric spaces. The following are obtained as our main results: (1) Every snowflake of a compact, finite Nagata-dimensional metric space stochastically embeds into an ultrametric space and has Lipschitz free space isomorphic to $\ell^1$. (2) The Lipschitz free space over hyperbolic $n$-space is isomorphic to the Lipschitz free space over Euclidean $n$-space. (3) Every infinite, finitely generated hyperbolic group stochastically embeds into an $\mathbb{R}$-tree, has Lipschitz free space isomorphic to $\ell^1$, and admits a proper, uniformly Lipschitz affine action on $\ell^1$.


title: Inequalities for $k$-regular partitions

abstract: We build upon the work by Bessenrodt and Ono, as well as Beckwith and Bessenrodt concerning the combined additive and multiplicative behavior of the $k$-regular partition functions $p_k(n)$. Our focus is on addressing the solutions of the Bessenrodt--Ono inequality \begin{equation*} p_k(a) \, p_k(b) > p_k(a+b). \end{equation*} We determine the sets $E_k$ and $F_k$ consisting of all pairs $(a,b)$, where we have equality or the opposite inequality. Bessenrodt and Ono previously determined the exception sets $E_{\infty}$ and $F_{\infty}$ for the partition function $p(n)$. We prove by induction that $E_k=E_{\infty}$ and $F_k=F_{\infty}$ if and only if $k \geq 10$. Beckwith and Bessenrodt used analytic methods to consider $2 \leq k \leq 6$, while Alanazi, Gagola, and Munagi studied the case $k=2$ using combinatorial methods. Finally, we present a precise and comprehensive conjecture on the log-concavity of the $k$-regular partition function extending previous speculations by Craig and Pun. The case $k=2$ was recently proven by Dong and Ji.


title: Quantum coupon collector with mixed-state encoding

abstract: The coupon collector is a prototypical model for evaluating the number of samples for identifying a set. By superposing all elements in the set as a pure quantum state, a quantum version of the coupon collector aims to learn the state, which is shown to reduce the sample complexity. Here we propose a quantum coupon collector by encoding the set into a mixed state, where the information of missing elements are labelled with Pauli strings. Remarkably, the encoded mixed state has no quantum entangled state and is easy to prepare. With such mixed-state encoding, it can be efficient to learn the set by performing Bell measurements on two copies and then extracting the missing element by solving a series of equations obtained from the measurements. Our protocol further reduces the sample complexity from $O(n)$ in the case of pure-state encoding to $O(\log n)$ when the missing element is one, where $n$ is the number of elements in the set. The mixed-state encoding scheme provides a new avenue for quantum learning and enlarges the realm for exploring quantum advantages.


title: Predicting the Understandability of Computational Notebooks through Code Metrics Analysis

abstract: Computational notebooks have become the primary coding environment for data scientists. However, research on their code quality is still emerging, and the code shared is often of poor quality. Given the importance of maintenance and reusability, understanding the metrics that affect notebook code comprehensibility is crucial. Code understandability, a qualitative variable, is closely tied to user opinions. Traditional approaches to measuring it either use limited questionnaires to review a few code pieces or rely on metadata such as likes and votes in software repositories. Our approach enhances the measurement of Jupyter notebook understandability by leveraging user comments related to code understandability. As a case study, we used 542,051 Kaggle Jupyter notebooks from our previous research, named DistilKaggle. We employed a fine-tuned DistilBERT transformer to identify user comments associated with code understandability. We established a criterion called User Opinion Code Understandability (UOCU), which considers the number of relevant comments, upvotes on those comments, total notebook views, and total notebook upvotes. UOCU proved to be more effective than previous methods. Furthermore, we trained machine learning models to predict notebook code understandability based solely on their metrics. We collected 34 metrics for 132,723 final notebooks as features in our dataset, using UOCU as the label. Our predictive model, using the Random Forest classifier, achieved 89% accuracy in predicting the understandability levels of computational notebooks.


title: McVittie-Plummer Spacetime: Plummer Sphere Immersed in the FLRW Universe

abstract: The McVittie-Plummer spacetime is a spherically symmetric inhomogeneous cosmological model that represents a spherical star system embedded in a standard FLRW cosmological model. We study the main physical properties of this gravitational field. Regarding the interplay between the physics of the local system and the expanding background, we employ the Misner-Sharp mass-energy function to show that there is a relatively weak time-dependent general relativistic coupling between the astrophysical system and the background FLRW cosmological model. The coupling term is proportional to the inverse of the scale factor and decreases as the universe expands.


title: Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers

abstract: Query rewriting is a crucial technique for passage retrieval in open-domain conversational question answering (CQA). It decontexualizes conversational queries into self-contained questions suitable for off-the-shelf retrievers. Existing methods attempt to incorporate retriever's preference during the training of rewriting models. However, these approaches typically rely on extensive annotations such as in-domain rewrites and/or relevant passage labels, limiting the models' generalization and adaptation capabilities. In this paper, we introduce AdaQR ($\textbf{Ada}$ptive $\textbf{Q}$uery $\textbf{R}$ewriting), a framework for training query rewriting models with limited rewrite annotations from seed datasets and completely no passage label. Our approach begins by fine-tuning compact large language models using only ~$10\%$ of rewrite annotations from the seed dataset training split. The models are then utilized to generate rewrite candidates for each query instance. A novel approach is then proposed to assess retriever's preference for these candidates by the probability of answers conditioned on the conversational query by marginalizing the Top-$K$ passages. This serves as the reward for optimizing the rewriter further using Direct Preference Optimization (DPO), a process free of rewrite and retrieval annotations. Experimental results on four open-domain CQA datasets demonstrate that AdaQR not only enhances the in-domain capabilities of the rewriter with limited annotation requirement, but also adapts effectively to out-of-domain datasets.


title: Extending Structures for Dendriform Algebras

abstract: In this paper, we devote to extending structures for dendriform algebras. First, we define extending datums and unified products of dendriform algebras, and theoretically solve the extending structure problem. As an application, we consider flag datums as a special case of extending structures, and give an example of the extending structure problem. Second, we introduce matched pairs and bicrossed products of dendriform algebras and theoretically solve the factorization problem for dendriform algebras. Moreover, we also introduce cocycle semidirect products and nonabelian semidirect products as special cases of unified products. Finally, we define the deformation map on a dendriform extending structure (more general case), not necessary a matched pair, which is more practical in the classifying complements problem.


title: CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleaving

abstract: Code-switching is a widely prevalent linguistic phenomenon in multilingual societies like India. Building speech-to-text models for code-switched speech is challenging due to limited availability of datasets. In this work, we focus on the problem of spoken translation (ST) of code-switched speech in Indian languages to English text. We present a new end-to-end model architecture COSTA that scaffolds on pretrained automatic speech recognition (ASR) and machine translation (MT) modules (that are more widely available for many languages). Speech and ASR text representations are fused using an aligned interleaving scheme and are fed further as input to a pretrained MT module; the whole pipeline is then trained end-to-end for spoken translation using synthetically created ST data. We also release a new evaluation benchmark for code-switched Bengali-English, Hindi-English, Marathi-English and Telugu- English speech to English text. COSTA significantly outperforms many competitive cascaded and end-to-end multimodal baselines by up to 3.5 BLEU points.


title: Charged drop impinging on particles dispersed over a metallic plate: A method of particle cleaning

abstract: An electric field applied to a droplet impinging on a hydrophobic surface has an extensive variety of applications, including ant-icing, heat transfer enhancement, self-cleaning, droplet manipulation, and electrostatic spraying. The present study demonstrates an effective method of particle removal using a charged droplet. This method employs a pin-plate electrode setup to investigate the dynamics of a charged droplet impact on the surface covered with particles. The particles of different properties such as wettability, electrical conductivity, etc. have been used. Silane-coated glass beads, carbon black, and glass beads are dispersed over the ground copper electrode. The applied potential is also varied from 2 kV to 4 kV. A high-speed imaging is employed to visualize the drop motion, dynamic behavior, and self-cleaning phenomenon. The experimental results indicate that drop generation and impact occur at applied potentials of 2.5, 3, and 3.5 kV, in contrast, at 2 kV, there is no droplet pinch-off. At 4 kV, electric breakdown and bridging of the droplet between the capillary and ground electrode are observed. The drop impact on the silane-coated glass bead leads to their attachment due to the adhesiveness of the particles and the droplet. The silane-coated particles are removed from the droplet surface due to the deformation of the drop and the electric repulsive force. In the case of carbon black and glass beads, the particles are captured by the droplet due to the electrostatic force of attraction. Higher electric potentials lead to an increased spreading diameter of the droplet. The higher electric field enhances the contact area between the droplet and the particles, thereby removing more particles.


title: Concept-skill Transferability-based Data Selection for Large Vision-Language Models

abstract: Instruction tuning, or supervised finetuning on extensive task-specific data, is necessary for Large Vision-Language Models (LVLMs) to generalize well across a broad range of vision-language (VL) tasks. However, training on large VL datasets can become prohibitively expensive. In this work, we introduce COINCIDE, an effective and scalable data selection technique that uses a small model as a reference model to select visual instruction tuning data for efficient finetuning of a target LVLM, focusing on diversity and transferability. Specifically, we cluster the training data using internal activations from a small model, which identifies VL concept-skill compositions needed by a target LVLM. We then sample data from these diverse clusters by considering their density and transferability, or the ability to transfer well to other concept-skill compositions. This approach ensures the diversity of these compositions, which is vital for LVLM generalization. Extensive experiments demonstrate that COINCIDE achieves superior performance and data selection efficiency against 8 strong baselines on two distinct datasets: LLaVA-1.5 and Vision-Flan. Using only 20% of the LLaVA-1.5 dataset, COINCIDE achieves performance comparable to the LVLM finetuned on the whole dataset, with 70% reduction of the wall-clock running time. On the Vision-Flan dataset, our method achieves superior results with only 16.7% of the training data.


title: THEANINE: Revisiting Memory Management in Long-term Conversations with Timeline-augmented Response Generation

abstract: Large language models (LLMs) are capable of processing lengthy dialogue histories during prolonged interaction with users without additional memory modules; however, their responses tend to overlook or incorrectly recall information from the past. In this paper, we revisit memory-augmented response generation in the era of LLMs. While prior work focuses on getting rid of outdated memories, we argue that such memories can provide contextual cues that help dialogue systems understand the development of past events and, therefore, benefit response generation. We present Theanine, a framework that augments LLMs' response generation with memory timelines -- series of memories that demonstrate the development and causality of relevant past events. Along with Theanine, we introduce TeaFarm, a counterfactual-driven question-answering pipeline addressing the limitation of G-Eval in long-term conversations. Supplementary videos of our methods and the TeaBag dataset for TeaFarm evaluation are in https://theanine-693b0.web.app/.


title: Two-level overlapping additive Schwarz preconditioner for training scientific machine learning applications

abstract: We introduce a novel two-level overlapping additive Schwarz preconditioner for accelerating the training of scientific machine learning applications. The design of the proposed preconditioner is motivated by the nonlinear two-level overlapping additive Schwarz preconditioner. The neural network parameters are decomposed into groups (subdomains) with overlapping regions. In addition, the network's feed-forward structure is indirectly imposed through a novel subdomain-wise synchronization strategy and a coarse-level training step. Through a series of numerical experiments, which consider physics-informed neural networks and operator learning approaches, we demonstrate that the proposed two-level preconditioner significantly speeds up the convergence of the standard (LBFGS) optimizer while also yielding more accurate machine learning models. Moreover, the devised preconditioner is designed to take advantage of model-parallel computations, which can further reduce the training time.


title: History-enhanced ICT For Sustainability education: Learning together with Business Computing students

abstract: This research explores the use of History to enhance education in the field of ICT For Sustainability ICT4S in response to a challenge from the ICT4S 2023 conference. No previous studies were found in ICT4S but the literature on History and Education for Sustainable Development is reviewed. An ICT4S lecturer collaborated with History lecturers to add an historic parallel to each weeks teaching on a Sustainable Business and Computing unit for final year undergraduate BSc Business Computing students. A list of the topics and rationale is provided. Student perceptions were surveyed before and after the teaching and semi-structured interviews carried out. A majority of students saw relevance to their degree and career. There was an increase in the proportion of students with interest in History. The paper explores the lessons learned from the interdisciplinary collaboration, including topic choice, format and perceived value. The project has enhanced the way we approach our subjects as computing and history educators. We believe this is the first empirical, survey-based study of the use of history to enhance ICT4S education. The team will extend the research to a larger unit covering a wider range of computing degrees.


title: Not All Bias is Bad: Balancing Rational Deviations and Cognitive Biases in Large Language Model Reasoning

abstract: This paper investigates the nuanced role of biases in the decision-making processes of large language models (LLMs). While conventional research typically aims to eliminate all biases, our study reveals that not all biases are detrimental. By examining rational deviations, involving heuristic shortcuts that enhance decision-making efficiency, we highlight their potential benefits when properly balanced. We introduce the concepts of heuristic moderation and an abstention option, allowing LLMs to abstain from answering when uncertain, thereby reducing error rates and improving decision accuracy. Using our newly developed BRD (Balance Rational Deviations) dataset, our findings demonstrate that appropriately scaled bias inspection enhances model performance and aligns LLM decision-making more closely with human reasoning. This balance improves the reliability and trustworthiness of LLMs and suggests new strategies for future enhancements. Our work offers a fresh perspective on leveraging biases constructively to enhance the practical applications of LLMs, from conversational agents to decision support systems and beyond.


title: High-Frequency Two-Dimensional Asymptotic Standing Coastal-Trapped Waves in Nearly Integrable Case

abstract: This paper is a continuation of research started in [7] devoted to explicit asymptotic formulas for standing coastal-trapped waves. Our main goal is to construct formal asymptotic eigenfunctions of the wave operator $\langle \nabla, D(x)\nabla\rangle$ (the spatial part of the wave operator) corresponding to the eigenvalue $\omega\to\infty$ in a nearly integrable case.


title: Symmetries and Interactions of $\mathcal{N}=1$ SUGRA: from Constructive and BCFW to KLT formulations

abstract: In this paper, we study the couplings of the gravity supermultiplet (graviton and gravitino) of minimal $\mathcal{N}=1$ SUGRA following a constructive approach. Firstly, we use the master formulae that follows from considering the scaling behavior of the spinor variables under the little group. Secondly, we derive the 4-point couplings using BFCW. Then, we verify these results for the general 3-point interactions that can be derived using the KLT-type relations, i.e., they can be written as the square of the coupling of the gluons and gluinos. Finally, we consider SUGRA Compton effect for graviton-gravitino. For completeness, we present in the appendix the $\mathcal{N}=1$ Sugra lagrangian in the 2-component Weyl formalism, including the proofs of SUSY and gauge invariance.


title: Enhancing Class Diagram Dynamics: A Natural Language Approach with ChatGPT

abstract: Integrating artificial intelligence (AI) into software engineering can transform traditional practices by enhancing efficiency, accuracy, and innovation. This study explores using ChatGPT, an advanced AI language model, to enhance UML class diagrams dynamically, an underexplored area. Traditionally, creating and maintaining class diagrams are manual, time-consuming, and error-prone processes. This research leverages natural language processing (NLP) techniques to automate the extraction of methods and interactions from detailed use case tables and integrate them into class diagrams. The methodology involves several steps: (1) developing detailed natural language use case tables by master's degree students for a "Waste Recycling Platform," (2) creating an initial static class diagram based on these tables, (3) iteratively enriching the class diagram through ChatGPT integration to analyze use cases and suggest methods, (4) reviewing and incorporating these methods into the class diagram, and (5) dynamically updating the PlantUML \cite{plantuml} class diagram, followed by evaluation and refinement. Findings indicate that the AI-driven approach significantly improves the accuracy and completeness of the class diagram. Additionally, dynamic enhancement aligns well with Agile development practices, facilitating rapid iterations and continuous improvement. Key contributions include demonstrating the feasibility and benefits of integrating AI into software modeling tasks, providing a comprehensive representation of system behaviors and interactions, and highlighting AI's potential to streamline and improve existing software engineering processes. Future research should address identified limitations and explore AI applications in other software models.


title: 3D Gaze Tracking for Studying Collaborative Interactions in Mixed-Reality Environments

abstract: This study presents a novel framework for 3D gaze tracking tailored for mixed-reality settings, aimed at enhancing joint attention and collaborative efforts in team-based scenarios. Conventional gaze tracking, often limited by monocular cameras and traditional eye-tracking apparatus, struggles with simultaneous data synchronization and analysis from multiple participants in group contexts. Our proposed framework leverages state-of-the-art computer vision and machine learning techniques to overcome these obstacles, enabling precise 3D gaze estimation without dependence on specialized hardware or complex data fusion. Utilizing facial recognition and deep learning, the framework achieves real-time, tracking of gaze patterns across several individuals, addressing common depth estimation errors, and ensuring spatial and identity consistency within the dataset. Empirical results demonstrate the accuracy and reliability of our method in group environments. This provides mechanisms for significant advances in behavior and interaction analysis in educational and professional training applications in dynamic and unstructured environments.


title: Data-driven study of the enthalpy of mixing in the liquid phase

abstract: The enthalpy of mixing in the liquid phase is a thermodynamic property reflecting interactions between elements that is key to predict phase transformations. Widely used models exist to predict it, but they have never been systematically evaluated. To address this, we collect a large amount of enthalpy of mixing data in binary liquids from a review of about 1000 thermodynamic evaluations. This allows us to clarify the prediction accuracy of Miedema's model which is state-of-the-art. We show that more accurate predictions can be obtained from a machine learning model based on LightGBM, and we provide them in 2415 binary systems. The data we collect also allows us to evaluate another empirical model to predict the excess heat capacity that we apply to 2211 binary liquids. We then extend the data collection to ternary metallic liquids and find that, when mixing is exothermic, extrapolations from the binary systems by Muggianu's model systematically lead to slight overestimations of roughly 10% close to the equimolar composition. Therefore, our LightGBM model can provide reasonable estimates for ternary alloys and, by extension, for multicomponent alloys. Our findings extracted from rich datasets can be used to feed thermodynamic, empirical and machine learning models for material development.


title: Back to Bohr: Quantum Jumps in Schroedinger's Wave Mechanics

abstract: The measurement problem of quantum mechanics concerns the question under which circumstances coherent wave evolution becomes disrupted to produce eigenstates of observables, instead of evolving superpositions of eigenstates. The problem needs to be addressed already within wave mechanics, before second quantization, because low-energy interactions can be dominated by particle-preserving potential interactions. We discuss a scattering array of harmonic oscillators which can detect particles penetrating the array through interaction with a short-range potential. Evolution of the wave function of scattered particles, combined with Heisenberg's assertion that quantum jumps persist in wave mechanics, indicates that the wave function will collapse around single oscillator sites if the scattering is inelastic, while it will not collapse around single sites for elastic scattering. The Born rule for position observation is then equivalent to the statement that the wave function for inelastic scattering amounts to an epistemic superposition of possible scattering states, in the sense that it describes a sum of probability amplitudes for inelastic scattering off different scattering centers, whereas at most one inelastic scattering event can happen at any moment in time. Within this epistemic interpretation of the wave function, the actual underlying inelastic scattering event corresponds to a quantum jump, whereas the continuously evolving wave function only describes the continuous evolution of probability amplitudes for scattering off different sites. Quantum jumps then yield definite position observations as defined by the spatial resolution of the oscillator array.


title: SPEAR: Receiver-to-Receiver Acoustic Neural Warping Field

abstract: We present SPEAR, a continuous receiver-to-receiver acoustic neural warping field for spatial acoustic effects prediction in an acoustic 3D space with a single stationary audio source. Unlike traditional source-to-receiver modelling methods that require prior space acoustic properties knowledge to rigorously model audio propagation from source to receiver, we propose to predict by warping the spatial acoustic effects from one reference receiver position to another target receiver position, so that the warped audio essentially accommodates all spatial acoustic effects belonging to the target position. SPEAR can be trained in a data much more readily accessible manner, in which we simply ask two robots to independently record spatial audio at different positions. We further theoretically prove the universal existence of the warping field if and only if one audio source presents. Three physical principles are incorporated to guide SPEAR network design, leading to the learned warping field physically meaningful. We demonstrate SPEAR superiority on both synthetic, photo-realistic and real-world dataset, showing the huge potential of SPEAR to various down-stream robotic tasks.


title: Threat Modelling and Risk Analysis for Large Language Model (LLM)-Powered Applications

abstract: The advent of Large Language Models (LLMs) has revolutionized various applications by providing advanced natural language processing capabilities. However, this innovation introduces new cybersecurity challenges. This paper explores the threat modeling and risk analysis specifically tailored for LLM-powered applications. Focusing on potential attacks like data poisoning, prompt injection, SQL injection, jailbreaking, and compositional injection, we assess their impact on security and propose mitigation strategies. We introduce a framework combining STRIDE and DREAD methodologies for proactive threat identification and risk assessment. Furthermore, we examine the feasibility of an end-to-end threat model through a case study of a custom-built LLM-powered application. This model follows Shostack's Four Question Framework, adjusted for the unique threats LLMs present. Our goal is to propose measures that enhance the security of these powerful AI tools, thwarting attacks, and ensuring the reliability and integrity of LLM-integrated systems.


title: Unclonable Secret Sharing

abstract: Unclonable cryptography utilizes the principles of quantum mechanics to addresses cryptographic tasks that are impossible classically. We introduce a novel unclonable primitive in the context of secret sharing, called unclonable secret sharing (USS). In a USS scheme, there are $n$ shareholders, each holding a share of a classical secret represented as a quantum state. They can recover the secret once all parties (or at least $t$ parties) come together with their shares. Importantly, it should be infeasible to copy their own shares and send the copies to two non-communicating parties, enabling both of them to recover the secret. Our work initiates a formal investigation into the realm of unclonable secret sharing, shedding light on its implications, constructions, and inherent limitations. ** Connections: We explore the connections between USS and other quantum cryptographic primitives such as unclonable encryption and position verification, showing the difficulties to achieve USS in different scenarios. **Limited Entanglement: In the case where the adversarial shareholders do not share any entanglement or limited entanglement, we demonstrate information-theoretic constructions for USS. **Large Entanglement: If we allow the adversarial shareholders to have unbounded entanglement resources (and unbounded computation), we prove that unclonable secret sharing is impossible. On the other hand, in the quantum random oracle model where the adversary can only make a bounded polynomial number of queries, we show a construction secure even with unbounded entanglement. Furthermore, even when these adversaries possess only a polynomial amount of entanglement resources, we establish that any unclonable secret sharing scheme with a reconstruction function implementable using Cliffords and logarithmically many T-gates is also unattainable.


title: Causal feedback strategies for controlled stochastic Volterra systems: a unified treatment

abstract: This paper is concerned with a unified treatment of linear quadratic control problem for stochastic Volterra integral equations (SVIEs), motivated by the various approaches and scattered results in the existing literature. A novel class of optimal causal feedback strategy is introduced and characterized by means of a new Riccati system. To this end, a fundamental function space and an appropriate multiplicative rule among functions are defined for the first time. In contrast with the existing works, our unified treatment not only provides a new approach, but also extends or improves the known conclusions in stochastic differential equations, convolution SVIEs, stochastic Volterra integro-differential equations (VIDEs), deterministic VIEs, deterministic VIDEs. In addition, an interesting phenomenon is reveal by the current study: for SVIEs the conventional structure of state feedback is replaced by a suitable causal form, and the original state process no longer plays indispensable role in the feedbacks while an auxiliary state process does.