title: Leveraging Image-Text Similarity and Caption Modification for the DataComp Challenge: Filtering Track and BYOD Track

abstract: Large web crawl datasets have already played an important role in learning multimodal features with high generalization capabilities. However, there are still very limited studies investigating the details or improvements of data design. Recently, a DataComp challenge has been designed to propose the best training data with the fixed models. This paper presents our solution to both filtering track and BYOD track of the DataComp challenge. Our solution adopts large multimodal models CLIP and BLIP-2 to filter and modify web crawl data, and utilize external datasets along with a bag of tricks to improve the data quality. Experiments show our solution significantly outperforms DataComp baselines (filtering track: 6.6% improvement, BYOD track: 48.5% improvement).


title: Free probability of type B prime

abstract: Free probability of type B was invented by Biane--Goodman--Nica, and then it was generalized by Belinschi--Shlyakhtenko and F\'evrier--Nica to infinitesimal free probability. The latter found its applications to eigenvalues of perturbed random matrices in the work of Shlyakhtenko and C\'ebron--Dahlqvist--Gabriel. This paper offers a new framework, called ``free probability of type B${}^\prime$'', which appears in the large size limit of independent unitarily invariant random matrices with perturbations. Our framework is related to boolean, free, (anti)monotone, cyclic-(anti)monotone and conditionally free independences. We then apply the new framework to the principal minor of unitarily invariant random matrices, which leads to the definition of a multivariate inverse Markov--Krein transform.


title: JointMatch: A Unified Approach for Diverse and Collaborative Pseudo-Labeling to Semi-Supervised Text Classification

abstract: Semi-supervised text classification (SSTC) has gained increasing attention due to its ability to leverage unlabeled data. However, existing approaches based on pseudo-labeling suffer from the issues of pseudo-label bias and error accumulation. In this paper, we propose JointMatch, a holistic approach for SSTC that addresses these challenges by unifying ideas from recent semi-supervised learning and the task of learning with noise. JointMatch adaptively adjusts classwise thresholds based on the learning status of different classes to mitigate model bias towards current easy classes. Additionally, JointMatch alleviates error accumulation by utilizing two differently initialized networks to teach each other in a cross-labeling manner. To maintain divergence between the two networks for mutual learning, we introduce a strategy that weighs more disagreement data while also allowing the utilization of high-quality agreement data for training. Experimental results on benchmark datasets demonstrate the superior performance of JointMatch, achieving a significant 5.13% improvement on average. Notably, JointMatch delivers impressive results even in the extremely-scarce-label setting, obtaining 86% accuracy on AG News with only 5 labels per class. We make our code available at https://github.com/HenryPengZou/JointMatch.


title: Extremal subsets and atom-positivity

abstract: Demazure crystals give a combinatorial framework in which to study Demazure modules. They are extremal, in that they satisfy Kashiwara's string property, and they are Demazure atom-positive, in that they decompose naturally into subsets called crystal Demazure atoms. The properties of extremality and atom-positivity are further linked by a conjecture of Polo, which concerns the structure of the tensor product of two Demazure modules. We study these two properties in isolation - first providing a recursive formula for generating crystal Demazure atoms which generalizes a result of Lascoux-Sch\"{u}tzenberger, and then examining the structure of extremal subsets and their characters - before commenting on the connection (or lack thereof) between them.


title: Observation of the $\psi(3686)$ decays into $\Sigma^{+}\bar{\Sigma}^{-}\omega$ and $\Sigma^{+}\bar{\Sigma}^{-}{\mathcal{\phi}}$

abstract: Based on $(27.08\pm 0.14)\times10^{8}$ $\psi(3686)$ events collected with the BESIII detector operating at the BEPCII collider, the $\psi(3686)\to\Sigma^{+}\bar{\Sigma}^{-}\omega$ and $\Sigma^{+}\bar{\Sigma}^{-}\phi$ decays are observed for the first time with statistical significances of 13.8$\sigma$ and 7.6$\sigma$, respectively. The corresponding branching fractions are measured to be $\mathcal{B}(\psi(3686)\to\Sigma^{+}\bar{\Sigma}^{-}\omega)=(1.90 \pm 0.18 \pm 0.21) \times 10^{-5}$ and $\mathcal{B}(\psi(3686)\to\Sigma^{+}\bar{\Sigma}^{-}\phi)=(2.96 \pm 0.54 \pm 0.41) \times 10^{-6}$, where the first uncertainties are statistical and the second systematic.


title: GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without Labels

abstract: Evaluating the performance of graph neural networks (GNNs) is an essential task for practical GNN model deployment and serving, as deployed GNNs face significant performance uncertainty when inferring on unseen and unlabeled test graphs, due to mismatched training-test graph distributions. In this paper, we study a new problem, GNN model evaluation, that aims to assess the performance of a specific GNN model trained on labeled and observed graphs, by precisely estimating its performance (e.g., node classification accuracy) on unseen graphs without labels. Concretely, we propose a two-stage GNN model evaluation framework, including (1) DiscGraph set construction and (2) GNNEvaluator training and inference. The DiscGraph set captures wide-range and diverse graph data distribution discrepancies through a discrepancy measurement function, which exploits the outputs of GNNs related to latent node embeddings and node class predictions. Under the effective training supervision from the DiscGraph set, GNNEvaluator learns to precisely estimate node classification accuracy of the to-be-evaluated GNN model and makes an accurate inference for evaluating GNN model performance. Extensive experiments on real-world unseen and unlabeled test graphs demonstrate the effectiveness of our proposed method for GNN model evaluation.


title: Large Search Model: Redefining Search Stack in the Era of LLMs

abstract: Modern search engines are built on a stack of different components, including query understanding, retrieval, multi-stage ranking, and question answering, among others. These components are often optimized and deployed independently. In this paper, we introduce a novel conceptual framework called large search model, which redefines the conventional search stack by unifying search tasks with one large language model (LLM). All tasks are formulated as autoregressive text generation problems, allowing for the customization of tasks through the use of natural language prompts. This proposed framework capitalizes on the strong language understanding and reasoning capabilities of LLMs, offering the potential to enhance search result quality while simultaneously simplifying the existing cumbersome search stack. To substantiate the feasibility of this framework, we present a series of proof-of-concept experiments and discuss the potential challenges associated with implementing this approach within real-world search systems.


title: AESOPUS 2.0: Low-Temperature Opacities with Solid Grains

abstract: In this study we compute the equation of state and Rosseland mean opacity from temperatures of T~30000 K down to T~400 K, pushing the capabilities of the AESOPUS code (Marigo et al., 2022; Marigo & Aringer, 2009) into the regime where solid grains can form. The GGchem code (Woitke et al. 2018) is used to solve the chemistry for temperatures less than ~3000 K. Atoms, molecules, and dust grains in thermodynamic equilibrium are all included in the equation of state. To incorporate monochromatic atomic and molecular cross sections, an optimized opacity sampling technique is used. The Mie theory is employed to calculate the opacity of 43 grain species. Tables of Rosseland mean opacities for scaled-solar compositions are provided. Based on our computing resources, opacities for other chemical patterns, as well as various grain sizes, porosity, and shapes, can be easily computed upon user request to the corresponding author.


title: Real eigenvector distributions of random tensors with backgrounds and random deviations

abstract: As in random matrix theories, eigenvector/value distributions are important quantities of random tensors in their applications. Recently, real eigenvector/value distributions of Gaussian random tensors have been explicitly computed by expressing them as partition functions of quantum field theories with quartic interactions. This procedure to compute distributions in random tensors is general, powerful and intuitive, because one can take advantage of well-developed techniques and knowledge of quantum field theories. In this paper we extend the procedure to the cases that random tensors have mean backgrounds and eigenvector equations have random deviations. In particular, we study in detail the case that the background is a rank-one tensor, namely, the case of a spiked tensor. We discuss the condition under which the background rank-one tensor has a visible peak in the eigenvector distribution. We obtain a threshold value, which agrees with a previous result in the literature.


title: Can the Black Lives Matter Movement Reduce Racial Disparities? Evidence from Medical Crowdfunding

abstract: Using high-frequency donation records from a major medical crowdfunding site and careful difference-in-difference analysis, we demonstrate that the 2020 BLM surge decreased the fundraising gap between Black and non-Black beneficiaries by around 50\%. The reduction is largely attributed to non-Black donors. Those beneficiaries in counties with moderate BLM activities were most impacted. We construct innovative instrumental variable approaches that utilize weekends and rainfall to identify the global and local effects of BLM protests. Results suggest a broad social movement has a greater influence on charitable-giving behavior than a local event. Social media significantly magnifies the impact of protests.


title: Distributed MIMO for 6G sub-Networks in the Unlicensed Spectrum

abstract: In this paper, we consider the sixth generation (6G) sub-networks, where hyper reliable low latency communications (HRLLC) requirements are expected to be met. We focus on a scenario where multiple sub-networks are active in the service area and assess the feasibility of using the 6 GHz unlicensed spectrum to operate such deployment, evaluating the impact of listen before talk (LBT). Then, we explore the benefits of using distributed multiple input multiple output (MIMO), where the available antennas in every sub-network are distributed over a number of access points (APs). Specifically, we compare different configurations of distributed MIMO with respect to centralized MIMO, where a single AP with all antennas is located at the center of every sub-network.


title: Pre-Training LiDAR-Based 3D Object Detectors Through Colorization

abstract: Accurate 3D object detection and understanding for self-driving cars heavily relies on LiDAR point clouds, necessitating large amounts of labeled data to train. In this work, we introduce an innovative pre-training approach, Grounded Point Colorization (GPC), to bridge the gap between data and labels by teaching the model to colorize LiDAR point clouds, equipping it with valuable semantic cues. To tackle challenges arising from color variations and selection bias, we incorporate color as "context" by providing ground-truth colors as hints during colorization. Experimental results on the KITTI and Waymo datasets demonstrate GPC's remarkable effectiveness. Even with limited labeled data, GPC significantly improves fine-tuning performance; notably, on just 20% of the KITTI dataset, GPC outperforms training from scratch with the entire dataset. In sum, we introduce a fresh perspective on pre-training for 3D object detection, aligning the objective with the model's intended role and ultimately advancing the accuracy and efficiency of 3D object detection for autonomous vehicles.


title: Enhancing the quantum entanglement and EPR steering of a coupled optomechanical system with a squeezed vacuum field

abstract: Quantum entanglement and Einstein-Podolsky-Rosen (EPR) steering are valuable resources in quantum information processing. How to enhance the quantum entanglement and EPR steering of coupled optomechanical systems with a weak squeezed vacuum field are studied when the displacement of detuning induced by the mechanical mode is considered. Compared with the condition that the system interacts with a vacuum environment, the quantum entanglement and EPR steering are stronger when the squeezed vacuum field is applied. A squeezed vacuum field with a large degree is not beneficial to enhance the quantum entanglement and EPR steering. Rather than the squeezing parameter of the squeezed vacuum field, the reference phase plays a vital role in this model.


title: Photon blockade with a trapped $\Lambda$-type three-level atom in asymmetrical cavity

abstract: We propose a scheme to manipulate strong and nonreciprocal photon blockades in asymmetrical Fabry-Perot cavity with a $\Lambda$-type three-level atom. Utilizing the mechanisms of both conventional and unconventional blockade, the strong photon blockade is achieved by the anharmonic eigenenergy spectrum brought by $\Lambda$-type atom and the destructive quantum interference effect induced by a microwave field. By optimizing the system parameters, the manipulation of strong photon blockade over a wide range of cavity detuning can be realized. Using spatial symmetry breaking introduced by the asymmetry of cavity, the direction-dependent nonreciprocal photon blockade can be achieved, and the nonreciprocity can reach the maximum at optimal cavity detuning. In particular, manipulating the occurring position of nonreciprocal photon blockade can be implemented by simply adjusting the cavity detuning. Our scheme provides feasible access for generating high-quality nonreciprocal single-photon sources.


title: Online Auditing of Information Flow

abstract: Modern social media platforms play an important role in facilitating rapid dissemination of information through their massive user networks. Fake news, misinformation, and unverifiable facts on social media platforms propagate disharmony and affect society. In this paper, we consider the problem of online auditing of information flow/propagation with the goal of classifying news items as fake or genuine. Specifically, driven by experiential studies on real-world social media platforms, we propose a probabilistic Markovian information spread model over networks modeled by graphs. We then formulate our inference task as a certain sequential detection problem with the goal of minimizing the combination of the error probability and the time it takes to achieve correct decision. For this model, we find the optimal detection algorithm minimizing the aforementioned risk and prove several statistical guarantees. We then test our algorithm over real-world datasets. To that end, we first construct an offline algorithm for learning the probabilistic information spreading model, and then apply our optimal detection algorithm. Experimental study show that our algorithm outperforms state-of-the-art misinformation detection algorithms in terms of accuracy and detection time.


title: Learning to Correct Noisy Labels for Fine-Grained Entity Typing via Co-Prediction Prompt Tuning

abstract: Fine-grained entity typing (FET) is an essential task in natural language processing that aims to assign semantic types to entities in text. However, FET poses a major challenge known as the noise labeling problem, whereby current methods rely on estimating noise distribution to identify noisy labels but are confused by diverse noise distribution deviation. To address this limitation, we introduce Co-Prediction Prompt Tuning for noise correction in FET, which leverages multiple prediction results to identify and correct noisy labels. Specifically, we integrate prediction results to recall labeled labels and utilize a differentiated margin to identify inaccurate labels. Moreover, we design an optimization objective concerning divergent co-predictions during fine-tuning, ensuring that the model captures sufficient information and maintains robustness in noise identification. Experimental results on three widely-used FET datasets demonstrate that our noise correction approach significantly enhances the quality of various types of training samples, including those annotated using distant supervision, ChatGPT, and crowdsourcing.


title: Unified description of the $Qs \bar q \bar q$ molecular bound states, molecular resonances and compact tetraquark states in the quark potential model

abstract: We calculate the mass spectrum of the $Qs\bar q \bar q$ $(Q=c, b)$ tetraquark states with $J^P=(0,1,2)^+$ using the AL1 quark potential model, which successfully describes the conventional hadron spectrum. We employ the Gaussian expansion method to solve the four-body Schr\"odinger equation, and use the complex scaling method to identify the resonances. With the notation $T_{Q s, I(J)}^{\text {Theo. }}(M)$, we find several near-threshold bound states and resonances, including $T_{cs,0(0)}^{\mathrm{Theo.}}(2350)$, $T_{cs,0(0)}^{\mathrm{Theo.}}(2906)$, $T_{bs,0(0)}^{\mathrm{Theo.}}(5781)$, $T_{bs,0(1)}^{\mathrm{Theo.}}(5840)$, and $T_{bs,0(0)}^{\mathrm{Theo.}}(6240)$ which are close to the $D\bar{K}$, $D^*\bar{K}^*$, $\bar{B}\bar{K}$, $\bar{B}^*\bar{K}$ and $\bar{B}^*\bar{K}^*$ thresholds, respectively. Furthermore, their spatial structures clearly support their molecular natures. The resonance $T_{cs,0(0)}^{\mathrm{Theo.}}(2906)$ has a mass of $2906$ MeV, a width of $20$ MeV, and quantum numbers $I(J^P)=0(0^+)$, which may serve as a good candidate for the experimental $T_{cs0}(2900)$ state. We strongly urge the experimental search of the predicted states.


title: A comparative study on three modes of s-process nucleosynthesis in extremely metal-poor AGB stars

abstract: Carbon-enhanced metal-poor (CEMP) stars in the Galactic halo have a wide range of neutron-capture element abundance patterns. To identify their origin, we investigated three modes of $s$-process nucleosynthesis that have been proposed to operate in extremely metal-poor (EMP) Asymptotic Giant Branch (AGB) stars: the convective 13C burning, which occurs when hydrogen is engulfed by the helium flash convection in low-mass AGB stars, the convective 22Ne burning, which occurs in the helium flash convection of intermediate-mass AGB stars, and the radiative 13C burning, which occurs in the $^{13}$C pocket that is formed during the inter-pulse periods. We show that the production of $s$-process elements per iron seed ($s$-process efficiency) does not depend on metallicity below $[{\rm Fe}/{\rm H}]=-2$, because 16O in the helium zone dominates the neutron poison. The convective 13C mode can produce a variety of $s$-process efficiencies for Sr, Ba and Pb, including the maxima observed among CEMP stars. The 22Ne mode only produce the lowest end of $s$-process efficiencies among CEMP models. We show that the combination of these two modes can explain the full range of observed enrichment of $s$-process elements in CEMP stars. In contrast, the 13C pocket mode can hardly explain the high level of enrichment observed in some CEMP stars, even if considering star-to-star variations of the mass of the 13C pocket. These results provide a basis for discussing the binary mass transfer origin of CEMP stars and their subgroups.


title: Prefix-Tuning Based Unsupervised Text Style Transfer

abstract: Unsupervised text style transfer aims at training a generative model that can alter the style of the input sentence while preserving its content without using any parallel data. In this paper, we employ powerful pre-trained large language models and present a new prefix-tuning-based method for unsupervised text style transfer. We construct three different kinds of prefixes, i.e., \textit{shared prefix, style prefix}, and \textit{content prefix}, to encode task-specific information, target style, and the content information of the input sentence, respectively. Compared to embeddings used by previous works, the proposed prefixes can provide richer information for the model. Furthermore, we adopt a recursive way of using language models in the process of style transfer. This strategy provides a more effective way for the interactions between the input sentence and GPT-2, helps the model construct more informative prefixes, and thus, helps improve the performance. Evaluations on the well-known datasets show that our method outperforms the state-of-the-art baselines. Results, analysis of ablation studies, and subjective evaluations from humans are also provided for a deeper understanding of the proposed method.


title: NFT formalised

abstract: Non-fungible tokens, NFT, have been used to record ownership of real estate, art, digital assets, and more recently to serve legal notice. They provide an important and accessible non-financial use of cryptocurrency's blockchain but are peculiar because ownership by NFT confers no rights over the asset. This work shows that it is possible to specify that peculiar property by combining functional and epistemic properties. Suitability of the specification is evaluated by proof that the blockchain implementation conforms to it, and by its use in an analysis of serving legal notice.


title: Modeling alpha particle-induced radioluminescence using GEANT4

abstract: Optical detection of alpha particle emitters in the environment by air radioluminescence is a new technology that enables sensing a radiological threat at safe distances, without putting personnel at risk or contaminating equipment. Radioluminescence detection systems need to be fine-tuned to efficiently capture a substantial number of photons while minimizing the contribution from ambient ultraviolet light. The accurate simulation of radioluminescence, in conjunction with ray tracing, facilitates the design and optimization of such detection systems. In this work, an application within the Geant4 framework has been developed to simulate radioluminescence photons emitted in the vicinity of accelerated alpha particles and at the surface of alpha radioactive samples. The application relies on existing scintillation physics implemented in Geant4 classes such as G4OpticalPhysics and G4Scintillation, which are used to simulate radioluminescence photons as scintillations produced during the passage of alpha particles through air. The application computes the ultraviolet image of alpha particles accelerated at energies of 5.1 MeV and 8.3 MeV, as well as an extended alpha source. The application enables optimization of experimental setups for various scenarios, such as radiological emergency management, radiological crime scene investigations, or decommissioning of nuclear facilities, thus minimizing the use of costly resources and exposure to radiation.


title: Generative Pre-trained Transformer for Vietnamese Community-based COVID-19 Question Answering

abstract: Recent studies have provided empirical evidence of the wide-ranging potential of Generative Pre-trained Transformer (GPT), a pretrained language model, in the field of natural language processing. GPT has been effectively employed as a decoder within state-of-the-art (SOTA) question answering systems, yielding exceptional performance across various tasks. However, the current research landscape concerning GPT's application in Vietnamese remains limited. This paper aims to address this gap by presenting an implementation of GPT-2 for community-based question answering specifically focused on COVID-19 related queries in Vietnamese. We introduce a novel approach by conducting a comparative analysis of different Transformers vs SOTA models in the community-based COVID-19 question answering dataset. The experimental findings demonstrate that the GPT-2 models exhibit highly promising outcomes, outperforming other SOTA models as well as previous community-based COVID-19 question answering models developed for Vietnamese.


title: Betelgeuse as a Merger of a Massive Star with a Companion

abstract: We investigate the merger between a 16 solar mass star, on its way to becoming a red supergiant (RSG), and a 4 solar mass main-sequence companion. Our study employs three-dimensional hydrodynamic simulations using the state-of-the-art adaptive mesh refinement code Octo-Tiger. The initially corotating binary undergoes interaction and mass transfer, resulting in the accumulation of mass around the companion and its subsequent loss through the second Lagrangian point (L2). The companion eventually plunges into the envelope of the primary, leading to its spin-up and subsequent merger with the helium core. We examine the internal structural properties of the post-merger star, as well as the merger environment and the outflow driven by the merger. Our findings reveal the ejection of approximately 0.6 solar mass of material in an asymmetric and somewhat bipolar outflow. We import the post-merger stellar structure into the MESA stellar evolution code to model its long-term nuclear evolution. In certain cases, the post-merger star exhibits persistent rapid equatorial surface rotation as it evolves in the H-R diagram towards the observed location of Betelgeuse. These cases demonstrate surface rotation velocities of a similar magnitude to those observed in Betelgeuse, along with a chemical composition resembling that of Betelgeuse. In other cases, efficient rotationally-induced mixing leads to slower surface rotation. This pioneering study aims to model stellar mergers across critical timescales, encompassing dynamical, thermal, and nuclear evolutionary stages.


title: Beyond VaR and CVaR: Topological Risk Measures in Financial Markets

abstract: This paper introduces a novel approach to financial risk assessment by incorporating topological data analysis (TDA), specifically cohomology groups, into the evaluation of equities portfolios. The study aims to go beyond traditional risk measures like Value at Risk (VaR) and Conditional Value at Risk (CVaR), offering a more nuanced understanding of market complexities. Using last one year daily real-world closing price return data for three equities Apple, Microsoft and Google , we developed a new topological riskmeasure, termed Topological VaR Distance (TVaRD). Preliminary results indicate a significant change in the density of the point cloud representing the financial time series during stress conditions, suggesting that TVaRD may offer additional insights into portfolio risk and has the potential to complement existing risk management tools.


title: M2DF: Multi-grained Multi-curriculum Denoising Framework for Multimodal Aspect-based Sentiment Analysis

abstract: Multimodal Aspect-based Sentiment Analysis (MABSA) is a fine-grained Sentiment Analysis task, which has attracted growing research interests recently. Existing work mainly utilizes image information to improve the performance of MABSA task. However, most of the studies overestimate the importance of images since there are many noise images unrelated to the text in the dataset, which will have a negative impact on model learning. Although some work attempts to filter low-quality noise images by setting thresholds, relying on thresholds will inevitably filter out a lot of useful image information. Therefore, in this work, we focus on whether the negative impact of noisy images can be reduced without modifying the data. To achieve this goal, we borrow the idea of Curriculum Learning and propose a Multi-grained Multi-curriculum Denoising Framework (M2DF), which can achieve denoising by adjusting the order of training data. Extensive experimental results show that our framework consistently outperforms state-of-the-art work on three sub-tasks of MABSA.


title: Anisotropies in Scalar-Induced Gravitational-Wave Background from Inflaton-Curvaton Mixed Scenario with Sound Speed Resonance

abstract: We propose a new model to generate large anisotropies in the scalar-induced gravitational wave (SIGW) background via sound speed resonance in the inflaton-curvaton mixed scenario. Cosmological curvature perturbations are not only exponentially amplified at a resonant frequency, but also preserve significant non-Gaussianity of local type described by $f_{\mathrm{nl}}$. Besides a significant enhancement of energy-density fraction spectrum, large anisotropies in SIGWs can be generated, because of super-horizon modulations of the energy density due to existence of primordial non-Gaussianity. A reduced angular power spectrum $\tilde{C}_{\ell}$ could reach an amplitude of $[\ell(\ell+1)\tilde{C}_{\ell}]^{1/2} \sim 10^{-2}$, leading to potential measurements via planned gravitational-wave detectors such as DECIGO. The large anisotropies in SIGWs would serve as a powerful probe of the early universe, shedding new light on the inflationary dynamics, primordial non-Gaussianity, and primordial black hole dark matter.


title: Confronting LLMs with Traditional ML: Rethinking the Fairness of Large Language Models in Tabular Classifications

abstract: Recent literature has suggested the potential of using large language models (LLMs) to make classifications for tabular tasks. However, LLMs have been shown to exhibit harmful social biases that reflect the stereotypes and inequalities present in society. To this end, as well as the widespread use of tabular data in many high-stake applications, it is important to explore the following questions: what sources of information do LLMs draw upon when making classifications for tabular tasks; whether and to what extent are LLM classifications for tabular data influenced by social biases and stereotypes; and what are the consequential implications for fairness? Through a series of experiments, we delve into these questions and show that LLMs tend to inherit social biases from their training data which significantly impact their fairness in tabular classification tasks. Furthermore, our investigations show that in the context of bias mitigation, though in-context learning and finetuning have a moderate effect, the fairness metric gap between different subgroups is still larger than that in traditional machine learning models, such as Random Forest and shallow Neural Networks. This observation emphasizes that the social biases are inherent within the LLMs themselves and inherited from their pretraining corpus, not only from the downstream task datasets. Besides, we demonstrate that label-flipping of in-context examples can significantly reduce biases, further highlighting the presence of inherent bias within LLMs.


title: CAD-DA: Controllable Anomaly Detection after Domain Adaptation by Statistical Inference

abstract: We propose a novel statistical method for testing the results of anomaly detection (AD) under domain adaptation (DA), which we call CAD-DA -- controllable AD under DA. The distinct advantage of the CAD-DA lies in its ability to control the probability of misidentifying anomalies under a pre-specified level $\alpha$ (e.g., 0.05). The challenge within this DA setting is the necessity to account for the influence of DA to ensure the validity of the inference results. Our solution to this challenge leverages the concept of conditional Selective Inference to handle the impact of DA. To our knowledge, this is the first work capable of conducting a valid statistical inference within the context of DA. We evaluate the performance of the CAD-DA method on both synthetic and real-world datasets.


title: Long Short-Term Planning for Conversational Recommendation Systems

abstract: In Conversational Recommendation Systems (CRS), the central question is how the conversational agent can naturally ask for user preferences and provide suitable recommendations. Existing works mainly follow the hierarchical architecture, where a higher policy decides whether to invoke the conversation module (to ask questions) or the recommendation module (to make recommendations). This architecture prevents these two components from fully interacting with each other. In contrast, this paper proposes a novel architecture, the long short-term feedback architecture, to connect these two essential components in CRS. Specifically, the recommendation predicts the long-term recommendation target based on the conversational context and the user history. Driven by the targeted recommendation, the conversational model predicts the next topic or attribute to verify if the user preference matches the target. The balance feedback loop continues until the short-term planner output matches the long-term planner output, that is when the system should make the recommendation.


title: That was the last straw, we need more: Are Translation Systems Sensitive to Disambiguating Context?

abstract: The translation of ambiguous text presents a challenge for translation systems, as it requires using the surrounding context to disambiguate the intended meaning as much as possible. While prior work has studied ambiguities that result from different grammatical features of the source and target language, we study semantic ambiguities that exist in the source (English in this work) itself. In particular, we focus on idioms that are open to both literal and figurative interpretations (e.g., goose egg), and collect TIDE, a dataset of 512 pairs of English sentences containing idioms with disambiguating context such that one is literal (it laid a goose egg) and another is figurative (they scored a goose egg, as in a score of zero). In experiments, we compare MT-specific models and language models for (i) their preference when given an ambiguous subsentence, (ii) their sensitivity to disambiguating context, and (iii) the performance disparity between figurative and literal source sentences. We find that current MT models consistently translate English idioms literally, even when the context suggests a figurative interpretation. On the other hand, LMs are far more context-aware, although there remain disparities across target languages. Our findings underline the potential of LMs as a strong backbone for context-aware translation.


title: Predictive Monitoring against Pattern Regular Languages

abstract: In this paper, we focus on the problem of dynamically analysing concurrent software against high-level temporal specifications. Existing techniques for runtime monitoring against such specifications are primarily designed for sequential software and remain inadequate in the presence of concurrency -- violations may be observed only in intricate thread interleavings, requiring many re-runs of the underlying software. Towards this, we study the problem of predictive runtime monitoring, inspired by the analogous problem of predictive data race detection studied extensively recently. The predictive runtime monitoring question asks, given an execution $\sigma$, if it can be soundly reordered to expose violations of a specification. In this paper, we focus on specifications that are given in regular languages. Our notion of reorderings is trace equivalence, where an execution is considered a reordering of another if it can be obtained from the latter by successively commuting adjacent independent actions. We first show that the problem of predictive admits a super-linear lower bound of $O(n^\alpha)$, where $n$ is the number of events in the execution, and $\alpha$ is a parameter describing the degree of commutativity. As a result, predictive runtime monitoring even in this setting is unlikely to be efficiently solvable. Towards this, we identify a sub-class of regular languages, called pattern languages (and their extension generalized pattern languages). Pattern languages can naturally express specific ordering of some number of (labelled) events, and have been inspired by popular empirical hypotheses, the `small bug depth' hypothesis. More importantly, we show that for pattern (and generalized pattern) languages, the predictive monitoring problem can be solved using a constant-space streaming linear-time algorithm.


title: Triangular solution to the planar elliptic three-body problem in the parametrized post-Newtonian formalism

abstract: A triangular solution [Phys. Rev. D 107, 044005 (2023)] has recently been found to the planar circular three-body problem in the parametrized post-Newtonian (PPN) formalism, for which they focus on a class of fully conservative theories characterized by the Eddington-Robertson parameters $\beta$ and $\gamma$. The present paper extends the PPN triangular solution to quasi-elliptic motion, for which the shape of the triangular configuration changes with time at the PPN order. The periastron shift due to the PPN effects is also obtained.


title: Optimal Modulation Current for Gain-Switching Lasers

abstract: This paper formally shows that an exponentially rising current is optimal in terms of resistive ohmic loss for driving a semiconductor laser into the gain-switching mode. A metric to quantify the quality of laser operation that measures the similarity of a generated optical pulse to the delta function is proposed. Several circuit implementations to approximate exponentially rising current are developed, including using a driver circuit with BJT output stage, a network of RLC circuits, and a saturating inductor. An experimental comparison between a state-of-the-art sinewave resonant driver circuit and a directly driven laser is performed that favors the latest variant of the driver.


title: Efficient Cross-Task Prompt Tuning for Few-Shot Conversational Emotion Recognition

abstract: Emotion Recognition in Conversation (ERC) has been widely studied due to its importance in developing emotion-aware empathetic machines. The rise of pre-trained language models (PLMs) has further pushed the limit of ERC performance. However, most recent works on ERC using PLMs are heavily data-driven, and requires fine-tuning the entire PLMs. To improve both sample and computational efficiency, we propose a derivative-free optimization method called Cross-Task Prompt Tuning (CTPT) for few-shot conversational emotion recognition. Unlike existing methods that learn independent knowledge from individual tasks, CTPT leverages sharable cross-task knowledge by exploiting external knowledge from other source tasks to improve learning performance under the few-shot setting. Moreover, CTPT only needs to optimize a vector under the low intrinsic dimensionality without gradient, which is highly parameter-efficient compared with existing approaches. Experiments on five different contextual conversation datasets demonstrate that our CTPT method has superior results on both few-shot scenarios and zero-shot transfers.


title: Gauge and Gravity theories on a dynamical principal bundle

abstract: In this paper we present original variational formulations of Yang-Mills, Einstein's gravitation and Kaluza-Klein theories, where, in the spirit of General Relativity, the principal bundle structure over the space-time is not fixed a priori but is dynamical. In the Yang-Mills case only a topological fibration is given a priori. In the gravity and the Kaluza-Klein theories no fibration is assumed: any critical point of the action functional defines a foliation of the manifold and the leaves make up the space-time. The latter is naturally equipped with a pseudo-Riemannian metric and, under some hypotheses, this foliation is actually a fibration. In all cases the apparition of a (at least local) principal bundle structure and a connection follows from the dynamics. Moreover the metric and the connection thus constructed are solutions of the Yang-Mills, the Einstein-Cartan or the Yang-Mills-Einstein equations, depending on the model. A crucial point is that we face the difficulty that some Lagrange multiplier fields (which are responsible for the foliation, the principal bundle structure and the connection) create unwanted terms in the equations. This difficulty is overcome by the observation that, if the structure group is compact, these terms miraculously cancel.


title: Rethinking SIGN Training: Provable Nonconvex Acceleration without First- and Second-Order Gradient Lipschitz

abstract: Sign-based stochastic methods have gained attention due to their ability to achieve robust performance despite using only the sign information for parameter updates. However, the current convergence analysis of sign-based methods relies on the strong assumptions of first-order gradient Lipschitz and second-order gradient Lipschitz, which may not hold in practical tasks like deep neural network training that involve high non-smoothness. In this paper, we revisit sign-based methods and analyze their convergence under more realistic assumptions of first- and second-order smoothness. We first establish the convergence of the sign-based method under weak first-order Lipschitz. Motivated by the weak first-order Lipschitz, we propose a relaxed second-order condition that still allows for nonconvex acceleration in sign-based methods. Based on our theoretical results, we gain insights into the computational advantages of the recently developed LION algorithm. In distributed settings, we prove that this nonconvex acceleration persists with linear speedup in the number of nodes, when utilizing fast communication compression gossip protocols. The novelty of our theoretical results lies in that they are derived under much weaker assumptions, thereby expanding the provable applicability of sign-based algorithms to a wider range of problems.


title: Early Planet Formation in Embedded Disks (eDisk) XII: Accretion streamers, protoplanetary disk, and outflow in the Class I source Oph IRS63

abstract: We present ALMA observations of the Class I source Oph IRS63 in the context of the Early Planet Formation in Embedded Disks (eDisk) large program. Our ALMA observations of Oph IRS63 show a myriad of protostellar features, such as a shell-like bipolar outflow (in $^{12}$CO), an extended rotating envelope structure (in $^{13}$CO), a streamer connecting the envelope to the disk (in C$^{18}$O), and several small-scale spiral structures seen towards the edge of the dust continuum (in SO). By analyzing the velocity pattern of $^{13}$CO and C$^{18}$O, we measure a protostellar mass of $\rm M_\star = 0.5 \pm 0.2 $~$\rm M_\odot$ and confirm the presence of a disk rotating at almost Keplerian velocity that extends up to $\sim260$ au. These calculations also show that the gaseous disk is about four times larger than the dust disk, which could indicate dust evolution and radial drift. Furthermore, we model the C$^{18}$O streamer and SO spiral structures as features originating from an infalling rotating structure that continuously feeds the young protostellar disk. We compute an envelope-to-disk mass infall rate of $\sim 10^{-6}$~$\rm M_\odot \, yr^{-1}$ and compare it to the disk-to-star mass accretion rate of $\sim 10^{-8}$~$\rm M_\odot \, yr^{-1}$, from which we infer that the protostellar disk is in a mass build-up phase. At the current mass infall rate, we speculate that soon the disk will become too massive to be gravitationally stable.


title: A Minkowski Functional Analysis of the Cosmic Microwave Background Weak Lensing Convergence

abstract: Minkowski functionals are summary statistics that capture the geometric and morphological properties of fields. They are sensitive to all higher order correlations of the fields and can be used to complement more conventional statistics, such as the power spectrum of the field. We develop a Minkowski functional-based approach for a full likelihood analysis of mildly non-Gaussian sky maps with partial sky coverage. Applying this to the inference of cosmological parameters from the Planck mission's map of the Cosmic Microwave Background's lensing convergence, we find an excellent agreement with results from the power spectrum-based lensing likelihood. While the non-Gaussianity of current CMB lensing maps is dominated by reconstruction noise, a Minkowski functional-based analysis may be able to extract cosmological information from the non-Gaussianity of future lensing maps and thus go beyond what is accessible with a power spectrum-based analysis. We make the numerical code for the calculation of a map's Minkowski functionals, skewness and kurtosis parameters available for download from GitHub.


title: Elastic and inelastic diffraction of fast neon atoms on a LiF surface

abstract: Grazing incidence fast atom diffraction has mainly been investigated with helium atoms, considered as the best possible choice for surface analysis. This article presents experimental diffraction profiles recorded with neon projectile, between 300 eV and 4 keV kinetic energy with incidence angles $\theta_i$ between 0.3$^\circ$ and 1.5$^\circ$ along three different directions of a LiF(001) crystal surface. These correspond to perpendicular energy ranging from a few meV up to almost 1 eV. A careful analysis of the scattering profile allows us to extract the diffracted intensities even when inelastic effects become so large that most quantum signatures have disappeared. The relevance of this approach is discussed in terms of surface topology.


title: Scrambling in Ising spin systems with constant and periodic transverse magnetic fields

abstract: Scrambling of quantum information in both integrable and nonintegrable systems, including the transverse field Ising model (TFIM) and Floquet spin systems are studied. Our study employs tripartite mutual information (TMI), with negative TMI serving as an indicator of scrambling, where a more negative value suggests a higher degree of scrambling. In the integrable and nonintegrable TFIM, we observe pronounced scrambling behavior, with the initial growth following a power-law pattern. However, nonintegrable TFIM exhibits a higher degree of scrambling compared to the integrable version. In the Floquet system, TMI is studied across periods from $0$ to $\pi/2$. Both integrable and nonintegrable Floquet systems display scrambling behavior across all periods, except at $\tau=\pi/4$, featuring power-law growth for small periods and abrupt jumps for larger ones. Nonintegrable Floquet systems exhibit more pronounced scrambling compared to integrable ones across all periods. The degree of scrambling increases as we move towards $\tau = \pi/4$, reaching its peak near $\tau = \pi/4$ (but not at $\tau = \pi/4$), regardless of the initial states. TMI saturation fluctuates less in the Floquet system in comparison to the TFIM. The growth of scrambling in the Floquet system mirrors TFIM for small periods but exhibits notably faster growth for larger periods. For a small period, the degree of scrambling in a Floquet system is comparable to that in the TFIM, but it becomes significantly greater for larger periods.


title: Spiking mode-based neural networks

abstract: Spiking neural networks play an important role in brain-like neuromorphic computations and in studying working mechanisms of neural circuits. One drawback of training a large scale spiking neural network is that updating all weights is quite expensive. Furthermore, after training, all information related to the computational task is hidden into the weight matrix, prohibiting us from a transparent understanding of circuit mechanisms. Therefore, in this work, we address these challenges by proposing a spiking mode-based training protocol, where the recurrent weight matrix is explained as a Hopfield-like multiplication of three matrices: input, output modes and a score matrix. The first advantage is that the weight is interpreted by input and output modes and their associated scores characterizing the importance of each decomposition term. The number of modes is thus adjustable, allowing more degrees of freedom for modeling the experimental data. This significantly reduces the training cost because of significantly reduced space complexity for learning. Training spiking networks is thus carried out in the mode-score space. The second advantage is that one can project the high dimensional neural activity (filtered spike train) in the state space onto the mode space which is typically of a low dimension, e.g., a few modes are sufficient to capture the shape of the underlying neural manifolds. We successfully apply our framework in two computational tasks -- digit classification and selective sensory integration tasks. Our method accelerate the training of spiking neural networks by a Hopfield-like decomposition, and moreover this training leads to low-dimensional attractor structures of high-dimensional neural dynamics.


title: High order asymptotic preserving and well-balanced schemes for the shallow water equations with source terms

abstract: In this study, we investigate the Shallow Water Equations incorporating source terms accounting for Manning friction and a non-flat bottom topology. Our primary focus is on developing and validating numerical schemes that serve a dual purpose: firstly, preserving all steady states within the model, and secondly, maintaining the late-time asymptotic behavior of solutions, which is governed by a diffusion equation and coincides with a long time and stiff friction limit. Our proposed approach draws inspiration from a penalization technique adopted in {\it{[Boscarino et. al, SIAM Journal on Scientific Computing, 2014]}}. By employing an additive implicit-explicit Runge-Kutta method, the scheme can ensure a correct asymptotic behavior for the limiting diffusion equation, without suffering from a parabolic-type time step restriction which often afflicts multiscale problems in the diffusive limit. Numerical experiments are performed to illustrate high order accuracy, asymptotic preserving, and asymptotically accurate properties of the designed schemes.


title: CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Tasks

abstract: While Chain-of-Thought prompting is popular in reasoning tasks, its application to Large Language Models (LLMs) in Natural Language Understanding (NLU) is under-explored. Motivated by multi-step reasoning of LLMs, we propose Coarse-to-Fine Chain-of-Thought (CoF-CoT) approach that breaks down NLU tasks into multiple reasoning steps where LLMs can learn to acquire and leverage essential concepts to solve tasks from different granularities. Moreover, we propose leveraging semantic-based Abstract Meaning Representation (AMR) structured knowledge as an intermediate step to capture the nuances and diverse structures of utterances, and to understand connections between their varying levels of granularity. Our proposed approach is demonstrated effective in assisting the LLMs adapt to the multi-grained NLU tasks under both zero-shot and few-shot multi-domain settings.


title: Joint secure communication and sensing in 6G networks

abstract: Joint communication and sensing is expected to be one of the features introduced by the sixth-generation (6G) wireless systems. This will enable a huge variety of new applications, hence, it is important to find suitable approaches to secure the exchanged information. Conventional security mechanisms may not be able to meet the stringent delay, power, and complexity requirements which opens the challenge of finding new lightweight security solutions. A promising approach coming from the physical layer is the secret key generation (SKG) from channel fading. While SKG has been investigated for several decades, practical implementations of its full protocol are still scarce. The aim of this chapter is to evaluate the SKG rates in real-life setups under a set of different scenarios. We consider a typical radar waveform and present a full implementation of the SKG protocol. Each step is evaluated to demonstrate that generating keys from the physical layer can be a viable solution for future networks. However, we show that there is not a single solution that can be generalized for all cases, instead, parameters should be chosen according to the context.


title: Topological electronic states in holey graphyne

abstract: We unveil that the holey graphyne (HGY), a two-dimensional carbon allotrope where benzene rings are connected by two $-$C$\equiv$C$-$ bonds fabricated recently in a bottom-up way, exhibits topological electronic states. Using first-principles calculations and Wannier tight-binding modeling, we discover a higher-order topological invariant associated with $C_2$ symmetry of the material, and show that the resultant corner modes appear in nanoflakes matching to the structure of precursor reported previously, which are ready for direct experimental observations. In addition, we find that a band inversion between emergent $g$-like and $h$-like orbitals gives rise to a nontrivial topology characterized by $\mathbb{Z}_2$ invariant protected by an energy gap as large as 0.52 eV, manifesting helical edge states mimicking those in the prominent quantum spin Hall effect, which can be accessed experimentally after hydrogenation in HGY. We hope these findings trigger interests towards exploring the topological electronic states in HGY and related future electronics applications.


title: Conversational Recommender System and Large Language Model Are Made for Each Other in E-commerce Pre-sales Dialogue

abstract: E-commerce pre-sales dialogue aims to understand and elicit user needs and preferences for the items they are seeking so as to provide appropriate recommendations. Conversational recommender systems (CRSs) learn user representation and provide accurate recommendations based on dialogue context, but rely on external knowledge. Large language models (LLMs) generate responses that mimic pre-sales dialogues after fine-tuning, but lack domain-specific knowledge for accurate recommendations. Intuitively, the strengths of LLM and CRS in E-commerce pre-sales dialogues are complementary, yet no previous work has explored this. This paper investigates the effectiveness of combining LLM and CRS in E-commerce pre-sales dialogues, proposing two collaboration methods: CRS assisting LLM and LLM assisting CRS. We conduct extensive experiments on a real-world dataset of Ecommerce pre-sales dialogues. We analyze the impact of two collaborative approaches with two CRSs and two LLMs on four tasks of Ecommerce pre-sales dialogue. We find that collaborations between CRS and LLM can be very effective in some cases.


title: CrisisMatch: Semi-Supervised Few-Shot Learning for Fine-Grained Disaster Tweet Classification

abstract: The shared real-time information about natural disasters on social media platforms like Twitter and Facebook plays a critical role in informing volunteers, emergency managers, and response organizations. However, supervised learning models for monitoring disaster events require large amounts of annotated data, making them unrealistic for real-time use in disaster events. To address this challenge, we present a fine-grained disaster tweet classification model under the semi-supervised, few-shot learning setting where only a small number of annotated data is required. Our model, CrisisMatch, effectively classifies tweets into fine-grained classes of interest using few labeled data and large amounts of unlabeled data, mimicking the early stage of a disaster. Through integrating effective semi-supervised learning ideas and incorporating TextMixUp, CrisisMatch achieves performance improvement on two disaster datasets of 11.2\% on average. Further analyses are also provided for the influence of the number of labeled data and out-of-domain results.


title: Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts

abstract: As large language models (LLMs) have shown effectiveness with different prompting methods, such as Chain of Thought, Program of Thought, we find that these methods have formed a great complementarity to each other on math reasoning tasks. In this work, we propose XoT, an integrated problem solving framework by prompting LLMs with diverse reasoning thoughts. For each question, XoT always begins with selecting the most suitable method then executes each method iteratively. Within each iteration, XoT actively checks the validity of the generated answer and incorporates the feedback from external executors, allowing it to dynamically switch among different prompting methods. Through extensive experiments on 10 popular math reasoning datasets, we demonstrate the effectiveness of our proposed approach and thoroughly analyze the strengths of each module. Moreover, empirical results suggest that our framework is orthogonal to recent work that makes improvements on single reasoning methods and can further generalise to logical reasoning domain. By allowing method switching, XoT provides a fresh perspective on the collaborative integration of diverse reasoning thoughts in a unified framework. The code is available at https://github.com/tengxiaoliu/XoT.


title: Making informed decisions in cutting tool maintenance in milling: A KNN based model agnostic approach

abstract: In machining processes, monitoring the condition of the tool is a crucial aspect to ensure high productivity and quality of the product. Using different machine learning techniques in Tool Condition Monitoring TCM enables a better analysis of the large amount of data of different signals acquired during the machining processes. The real time force signals encountered during the process were acquired by performing numerous experiments. Different tool wear conditions were considered during the experimentation. A comprehensive statistical analysis of the data and feature selection using decision trees was conducted, and the KNN algorithm was used to perform classification. Hyperparameter tuning of the model was done to improve the models performance. Much research has been done to employ machine learning approaches in tool condition monitoring systems, however, a model agnostic approach to increase the interpretability of the process and get an in depth understanding of how the decision making is done is not implemented by many. This research paper presents a KNN based white box model, which allows us to dive deep into how the model performs the classification and how it prioritizes the different features included. This approach helps in detecting why the tool is in a certain condition and allows the manufacturer to make an informed decision about the tools maintenance.


title: Schur-Weyl dualities for shifted quantum affine algebras and Ariki-Koike algebras

abstract: We establish a Schur-Weyl duality between a shifted quantum affine algebra and an Ariki-Koike algebra. Then, we realize a cyclotomic $q$-Schur algebra in the context of the Schur-Weyl duality.


title: Optimal Edge Caching For Individualized Demand Dynamics

abstract: The ever-growing end user data demands, and the simultaneous reductions in memory costs are fueling edge-caching deployments. Caching at the edge is substantially different from that at the core and needs to take into account the nature of individual data demands. For example, an individual user may not be interested in requesting the same data item again, if it has recently requested it. Such individual dynamics are not apparent in the aggregated data requests at the core and have not been considered in popularity-driven caching designs for the core. Hence, these traditional caching policies could induce significant inefficiencies when applied at the edges. To address this issue, we develop new edge caching policies optimized for the individual demands that also leverage overhearing opportunities at the wireless edge. With the objective of maximizing the hit ratio, the proposed policies will actively evict the data items that are not likely to be requested in the near future, and strategically bring them back into the cache through overhearing when they are likely to be popular again. Both theoretical analysis and numerical simulations demonstrate that the proposed edge caching policies could outperform the popularity-driven policies that are optimal at the core.


title: Artin groups of type (2,3,n)

abstract: Our main theorem is that the word problem in the Artin group G = <a,b,c | aba=bab, ac=ca, {}_{n}(b,c) = {}_{n}(c,b) > for n >= 5 can be solved using a system R of length preserving rewrite rules that, together with free reduction, can be used to reduce any word over {a,b,c} to a geodesic word in $G$, in quadratic time. This result builds on work of Holt and Rees, and of Blasco, Cumplido and Morris-Wright, which proves the same result for all Artin groups that are either sufficiently large or 3-free. Since every rank 3 Artin group is either spherical or in one of the categories covered by the previous results on which we build, it follows that any rank 3 Artin group has quadratic Dehn function. However we note that this and much more is a consequence of very recent work of Haettel and Huang; our contribution is to provide a particular kind or rewriting solution to the word problem for the non-spherical rank 3 Artin groups (and more).


title: Extending Input Contexts of Language Models through Training on Segmented Sequences

abstract: Effectively training language models on long inputs poses many technical challenges. As a cost consideration, languages models are pretrained on a fixed sequence length before being adapted to longer sequences. We explore various methods for adapting models to longer inputs by training on segmented sequences and an interpolation-based method for extending absolute positional embeddings. We develop a training procedure to extend the input context size of pretrained models with no architectural changes and no additional memory costs than training on the original input lengths. By sub-sampling segments from long inputs while maintaining their original position the model is able to learn new positional interactions. Our method benefits both models trained with absolute positional embeddings, by extending their input contexts, as well as popular relative positional embedding methods showing a reduced perplexity on sequences longer than they were trained on. We demonstrate our method can extend input contexts by a factor of 4x while improving perplexity.


title: Rules and Meaning in Quantum Mechanics

abstract: This book concerns the metasemantics of quantum mechanics (QM). Roughly, it pursues an investigation at an intersection of the philosophy of physics and the philosophy of semantics, and it offers a critical analysis of rival explanations of the semantic facts of standard QM. Two problems for such explanations are discussed: categoricity and permanence of rules. New results include 1) a reconstruction of Einstein's incompleteness argument, which concludes that a local, separable, and categorical QM cannot exist, 2) a reinterpretation of Bohr's principle of correspondence, grounded in the principle of permanence, 3) a meaning-variance argument for quantum logic, which follows a line of critical reflections initiated by Weyl, and 4) an argument for semantic indeterminacy leveled against inferentialism about QM, inspired by Carnap's work in the philosophy of classical logic.


title: Enhanced Microscale Hydrodynamic Near-cloaking using Electro-osmosis

abstract: In this paper, we develop a general mathematical framework for enhanced hydrodynamic near-cloaking of electro-osmotic flow for more complex shapes, which is obtained by simultaneously perturbing the inner and outer boundaries of the perfect cloaking structure. We first derive the asymptotic expansions of perturbed fields and obtain a first-order coupled system. We then establish the representation formula of the solution to the first-order coupled system using the layer potential techniques. Based on the asymptotic analysis, the enhanced hydrodynamic near-cloaking conditions are derived for the control region with general cross-sectional shape. The conditions reveal the inner relationship between the shapes of the object and the control region. Especially, for the shape of a deformed annulus or confocal ellipses cylinder, the cloaking conditions and relationship of shapes are quantified more accurately. Our theoretical findings are validated and supplemented by a variety of numerical results. The results in this paper also provide a mathematical foundation for more complex hydrodynamic cloaking.


title: Multilevel Perception Boundary-guided Network for Breast Lesion Segmentation in Ultrasound Images

abstract: Automatic segmentation of breast tumors from the ultrasound images is essential for the subsequent clinical diagnosis and treatment plan. Although the existing deep learning-based methods have achieved significant progress in automatic segmentation of breast tumor, their performance on tumors with similar intensity to the normal tissues is still not pleasant, especially for the tumor boundaries. To address this issue, we propose a PBNet composed by a multilevel global perception module (MGPM) and a boundary guided module (BGM) to segment breast tumors from ultrasound images. Specifically, in MGPM, the long-range spatial dependence between the voxels in a single level feature maps are modeled, and then the multilevel semantic information is fused to promote the recognition ability of the model for non-enhanced tumors. In BGM, the tumor boundaries are extracted from the high-level semantic maps using the dilation and erosion effects of max pooling, such boundaries are then used to guide the fusion of low and high-level features. Moreover, to improve the segmentation performance for tumor boundaries, a multi-level boundary-enhanced segmentation (BS) loss is proposed. The extensive comparison experiments on both publicly available dataset and in-house dataset demonstrate that the proposed PBNet outperforms the state-of-the-art methods in terms of both qualitative visualization results and quantitative evaluation metrics, with the Dice score, Jaccard coefficient, Specificity and HD95 improved by 0.70%, 1.1%, 0.1% and 2.5% respectively. In addition, the ablation experiments validate that the proposed MGPM is indeed beneficial for distinguishing the non-enhanced tumors and the BGM as well as the BS loss are also helpful for refining the segmentation contours of the tumor.


title: Semantic-Aware Adversarial Training for Reliable Deep Hashing Retrieval

abstract: Deep hashing has been intensively studied and successfully applied in large-scale image retrieval systems due to its efficiency and effectiveness. Recent studies have recognized that the existence of adversarial examples poses a security threat to deep hashing models, that is, adversarial vulnerability. Notably, it is challenging to efficiently distill reliable semantic representatives for deep hashing to guide adversarial learning, and thereby it hinders the enhancement of adversarial robustness of deep hashing-based retrieval models. Moreover, current researches on adversarial training for deep hashing are hard to be formalized into a unified minimax structure. In this paper, we explore Semantic-Aware Adversarial Training (SAAT) for improving the adversarial robustness of deep hashing models. Specifically, we conceive a discriminative mainstay features learning (DMFL) scheme to construct semantic representatives for guiding adversarial learning in deep hashing. Particularly, our DMFL with the strict theoretical guarantee is adaptively optimized in a discriminative learning manner, where both discriminative and semantic properties are jointly considered. Moreover, adversarial examples are fabricated by maximizing the Hamming distance between the hash codes of adversarial samples and mainstay features, the efficacy of which is validated in the adversarial attack trials. Further, we, for the first time, formulate the formalized adversarial training of deep hashing into a unified minimax optimization under the guidance of the generated mainstay codes. Extensive experiments on benchmark datasets show superb attack performance against the state-of-the-art algorithms, meanwhile, the proposed adversarial training can effectively eliminate adversarial perturbations for trustworthy deep hashing-based retrieval. Our code is available at https://github.com/xandery-geek/SAAT.


title: Forget metamaterial: It does not improve sound absorption performance as it claims

abstract: The term `sub-wavelength' is commonly used to describe innovative sound-absorbing structures usually labeled as `metamaterials'. Such structures, however, inherently do not bring groundbreaking advancements. This study addresses the limitations imposed by the thickness criterion of Yang et al. by introducing the concept of equivalent mass-spring-damping parameters within the resonator framework. This innovative approach introduces an index of `half-absorption bandwidth' to effectively overcome the thickness restriction. Four practical cases are then presented to correct prevalent misleading conceptions about low-frequency, broadband absorption as claimed. The phenomenon of mass disappearing in the expression of sound absorption coefficient supports the conclusion that volume is the only determinant factor in sound absorption performance. Any attempts to improve sound absorption solely through geometry and structural designs would inevitably sacrifice the half-absorption bandwidth. Additionally, the concept of negative stiffness or bulk modulus is merely a mathematical convention without any real improvement in absorption performance. Overall, this research focuses on the physical mechanism of sound-absorbing structures by correcting traditional misunderstandings, and offers a comprehensive framework for assessing and enhancing sound absorption.


title: The role of spin-orbit interaction in low thermal conductivity of Mg$_3$Bi$_2$

abstract: Three-dimensional layered Mg$_3$Bi$_2$ has emerged as thermoelectric material due to its high cooling performance at ambient temperature, which benefits from its low lattice thermal conductivity and semimetal character. However, the semimetal character of Mg$_3$Bi$_2$ is sensitive to spin-orbit coupling (SOC). Thus, the underlying origin of low lattice thermal conductivity needs to be clarified in the presence of the SOC. In this work, the first-principles calculations within the two-channel model are employed to investigate the effects of the SOC on the phonon-phonon scattering on the phonon transport of Mg$_3$Bi$_2$. Our results show that the SOC strongly reduces the lattice thermal conductivity (up to $\sim 35$ %). This reduction originates from the influence of the SOC on the transverse acoustic modes involving interlayer shearing, leading to weak interlayer bonding and enhancement anharmonicity around 50 cm$^{-1}$. Our results clarify the mechanism of low thermal conductivity in Mg$_3$Bi$_2$ and support the design of Mg$_3$Bi$_2$-based materials for thermoelectric applications.


title: A multiple time scale approach for anisotropic inertial wave turbulence

abstract: Wave turbulence is the study of the long-time statistical behaviour of equations describing a set of weakly non-linear interacting waves. Such a theory, which has a natural asymptotic closure, allows us to probe the nature of turbulence more deeply than the exact Kolmogorov laws by rigorously proving the direction of the cascade and the existence of an inertial range, predicting stationary spectra for conserved quantities, or evaluating the Kolmogorov constant. An emblematic example is given by fast rotating fluids for which a wave turbulence theory has been derived by Galtier (2003). This work involves nontrivial analytical developments for a problem that is anisotropic by nature. We propose here a new path for the derivation of the kinetic equation by using the anisotropy at the beginning of the analysis. We show that the helicity basis is not necessary to obtain the wave amplitude equation for the canonical variables that involve a combination of poloidal and toroidal fields. The multiple time scale method adapted to this anisotropic problem is then used to derive the kinetic equation which is the same as the original work when anisotropy is eventually taken into account. This result proves the commutativity between asymptotic closure and anisotropy. In addition, the multiple time scale method informs us that the kinetic equation can be derived without imposing restrictions on the probability distribution of the wave amplitude such as quasi-Gaussianity, or on the phase such as random phase approximation which naturally occurs dynamically.


title: Axionic Wormholes with $R^2$ Correction in Metric and Palatini Formulations

abstract: QCD axion models have been proposed as a solution to the strong CP problem. QCD instanton effects explicitly violate the global U(1) Peccei-Quinn (PQ) symmetry, and the axion potential is minimized at the CP conserving points. However, it is expected that the global U(1) PQ symmetry is explicitly violated by quantum gravity. This gravitational violation may potentially undermine the PQ solution to the strong CP problem, which is referred to as the axion quality problem. One source of explicit PQ violation is axionic wormholes, such as the Giddings-Strominger model. Generally speaking, the extent to which the U(1) PQ symmetry is violated depends on models. One straightforward extension of the Einstein gravity involves quadratic scalar curvature, which is motivated in cosmological contexts, such as inflation. The aim of this work is to investigate the effects of $R^2$ corrections on axionic wormholes. In this paper, we compute wormhole solutions and evaluate the size of explicit PQ violation in the models with the $R^2$ term. Furthermore, We illustrate the differences between the metric and Palatini formulations.


title: Relit-NeuLF: Efficient Relighting and Novel View Synthesis via Neural 4D Light Field

abstract: In this paper, we address the problem of simultaneous relighting and novel view synthesis of a complex scene from multi-view images with a limited number of light sources. We propose an analysis-synthesis approach called Relit-NeuLF. Following the recent neural 4D light field network (NeuLF), Relit-NeuLF first leverages a two-plane light field representation to parameterize each ray in a 4D coordinate system, enabling efficient learning and inference. Then, we recover the spatially-varying bidirectional reflectance distribution function (SVBRDF) of a 3D scene in a self-supervised manner. A DecomposeNet learns to map each ray to its SVBRDF components: albedo, normal, and roughness. Based on the decomposed BRDF components and conditioning light directions, a RenderNet learns to synthesize the color of the ray. To self-supervise the SVBRDF decomposition, we encourage the predicted ray color to be close to the physically-based rendering result using the microfacet model. Comprehensive experiments demonstrate that the proposed method is efficient and effective on both synthetic data and real-world human face data, and outperforms the state-of-the-art results. We publicly released our code on GitHub. You can find it here: https://github.com/oppo-us-research/RelitNeuLF


title: Dynamic gain and frequency comb formation in exceptional-point lasers

abstract: Exceptional points (EPs)--singularities in the parameter space of non-Hermitian systems where two nearby eigenmodes coalesce--feature unique properties with applications for microcavity lasers such as sensitivity enhancement and chiral emission. Present EP lasers operate with static populations in the gain medium. Here, we show theoretically that a laser operating sufficiently close to an EP will spontaneously induce a multi-spectral multi-modal instability that creates an oscillating population inversion and generates a frequency comb. The comb formation is enhanced by the non-orthogonality of modes via the Petermann factor. Such an "EP comb" features an ultra-compact size and a widely tunable repetition rate, without requiring external modulators or a continuous-wave pump. We develop an exact ab initio dynamic solution of the space-dependent Maxwell-Bloch equations, describing all steady-state properties of the EP comb. We illustrate this phenomenon in a realistic parity-time-symmetric 5-{\mu}m-long AlGaAs cavity and validate our prediction with finite-difference time-domain simulations. This work reveals the rich physics that connect non-Hermitian degeneracies and the nonlinear dynamics of gain media to fundamentally alter the laser behavior.


title: Multilingual k-Nearest-Neighbor Machine Translation

abstract: k-nearest-neighbor machine translation has demonstrated remarkable improvements in machine translation quality by creating a datastore of cached examples. However, these improvements have been limited to high-resource language pairs, with large datastores, and remain a challenge for low-resource languages. In this paper, we address this issue by combining representations from multiple languages into a single datastore. Our results consistently demonstrate substantial improvements not only in low-resource translation quality (up to +3.6 BLEU), but also for high-resource translation quality (up to +0.5 BLEU). Our experiments show that it is possible to create multilingual datastores that are a quarter of the size, achieving a 5.3x speed improvement, by using linguistic similarities for datastore creation.


title: Temperature-heat uncertainty relation for quantum thermometry

abstract: We investigate the resource theory for temperature estimation. We demonstrate that it is the fluctuation of heat that fundamentally determines temperature precision through the temperature-heat uncertainty relation. Specifically, we find that heat is divided into trajectory heat and correlation heat, which are associated with the heat exchange along thermometer's evolution path and the correlation between the thermometer and the sample, respectively. Based on two type of thermometers, we show that both of these heat terms are resources for enhancing temperature precision. Additionally, we demonstrate that the temperature-heat uncertainty relation is consistent with the well known temperature-energy uncertainty relation in thermodynamics. By clearly distinguishing the resources for enhancing estimation precision, our findings not only explain why various quantum features are crucial for accurate temperature sensing but also provide valuable insights for designing ultrahigh-sensitive quantum thermometers.


title: Dynamics of radial threshold solutions for generalized energy-critical Hartree equation

abstract: In this paper, we study long time dynamics of radial threshold solutions for the focusing, generalized energy-critical Hartree equation and classify all radial threshold solutions. The main arguments are the spectral theory of the linearized operator, the modulational analysis and the concentration compactness rigidity argument developed by T. Duyckaerts and F. Merle to classify all threshold solutions for the energy critical NLS and NLW in \cite{DuyMerle:NLS:ThresholdSolution, DuyMerle:NLW:ThresholdSolution}, later by D. Li and X. Zhang in \cite{LiZh:NLS, LiZh:NLW} in higher dimensions. The new ingredient here is to solve the nondegeneracy of positive bubble solutions with nonlocal structure in $\dot H^1(\R^N)$ (i.e. the spectral assumption in \cite{MiaoWX:dynamic gHartree}) by the nondegeneracy result of positive bubble solution in $L^{\infty}(\R^N)$ in \cite{LLTX:Nondegeneracy} and the Moser iteration method in \cite{DiMeVald:book}, which is related to the spectral analysis of the linearized operator with nonlocal structure, and plays a key role in the construction of the special threshold solutions, and the classification of all threshold solutions.


title: Indicated domination game

abstract: Motivated by the success of domination games and by a variation of the coloring game called the indicated coloring game, we introduce a version of domination games called the indicated domination game. It is played on an arbitrary graph $G$ by two players, Dominator and Staller, where Dominator wants to finish the game in as few rounds as possible while Staller wants just the opposite. In each round, Dominator indicates a vertex $u$ of $G$ that has not been dominated by previous selections of Staller, which, by the rules of the game, forces Staller to select a vertex in the closed neighborhood of $u$. The game is finished when all vertices of $G$ become dominated by the vertices selected by Staller. Assuming that both players are playing optimally according to their goals, the number of selected vertices during the game is the indicated domination number, $\gamma_i(G)$, of $G$. We prove several bounds on the indicated domination number expressed in terms of other graph invariants. In particular, we find a place of the new graph invariant in the well-known domination chain, by showing that $\gamma_i(G)\ge \Gamma(G)$ for all graphs $G$, and by showing that the indicated domination number is incomparable with the game domination number and also with the upper irredundance number. In connection with the trivial upper bound $\gamma_i(G)\le n(G)-\delta(G)$, we characterize the class of graphs $G$ attaining the bound provided that $n(G)\ge 2\delta(G)+2$. We prove that in trees, split graphs and grids the indicated domination number equals the independence number. We also find a formula for the indicated domination number of powers of paths, from which we derive that there exist graphs in which the indicated domination number is arbitrarily larger than the upper irredundance number.


title: Reconfigurable Multifunctional van der Waals Ferroelectric Devices and Logic Circuits

abstract: In this work, we demonstrate the suitability of Reconfigurable Ferroelectric Field-Effect- Transistors (Re-FeFET) for designing non-volatile reconfigurable logic-in-memory circuits with multifunctional capabilities. Modulation of the energy landscape within a homojunction of a 2D tungsten diselenide (WSe$_2$) layer is achieved by independently controlling two split-gate electrodes made of a ferroelectric 2D copper indium thiophosphate (CuInP$_2$S$_6$) layer. Controlling the state encoded in the Program Gate enables switching between p, n and ambipolar FeFET operating modes. The transistors exhibit on-off ratios exceeding 10$^6$ and hysteresis windows of up to 10 V width. The homojunction can change from ohmic-like to diode behavior, with a large rectification ratio of 10$^4$. When programmed in the diode mode, the large built-in p-n junction electric field enables efficient separation of photogenerated carriers, making the device attractive for energy harvesting applications. The implementation of the Re-FeFET for reconfigurable logic functions shows how a circuit can be reconfigured to emulate either polymorphic ferroelectric NAND/AND logic-in-memory or electronic XNOR logic with long retention time exceeding 10$^4$ seconds. We also illustrate how a circuit design made of just two Re-FeFETs exhibits high logic expressivity with reconfigurability at runtime to implement several key non-volatile 2-input logic functions. Moreover, the Re-FeFET circuit demonstrates remarkable compactness, with an up to 80% reduction in transistor count compared to standard CMOS design. The 2D van de Waals Re-FeFET devices therefore exhibit groundbreaking potential for both More-than-Moore and beyond-Moore future of electronics, in particular for an energy-efficient implementation of in-memory computing and machine learning hardware, due to their multifunctionality and design compactness.


title: Multilevel Scalable Solvers for Stochastic Linear and Nonlinear Problems

abstract: This article discusses the uncertainty quantification (UQ) for time-independent linear and nonlinear partial differential equation (PDE)-based systems with random model parameters carried out using sampling-free intrusive stochastic Galerkin method leveraging multilevel scalable solvers constructed combining two-grid Schwarz method and AMG. High-resolution spatial meshes along with a large number of stochastic expansion terms increase the system size leading to significant memory consumption and computational costs. Domain decomposition (DD)-based parallel scalable solvers are developed to this end for linear and nonlinear stochastic PDEs. A generalized minimum residual (GMRES) iterative solver equipped with a multilevel preconditioner consisting of restricted additive Schwarz (RAS) for the fine grid and algebraic multigrid (AMG) for the coarse grid is constructed to improve scalability. Numerical experiments illustrate the scalabilities of the proposed solver for stochastic linear and nonlinear Poisson problems.


title: Asymptotic expansions for the solution of a linear PDE with a multifrequency highly oscillatory potential

abstract: Highly oscillatory differential equations present significant challenges in numerical treatments. The Modulated Fourier Expansion (MFE), used as an ansatz, is a commonly employed tool as a numerical approximation method. In this article, the Modulated Fourier Expansion is analytically derived for a linear partial differential equation with a multifrequency highly oscillatory potential. The solution of the equation is expressed as a convergent Neumann series within the appropriate Sobolev space. The proposed approach enables, firstly, to derive a general formula for the error associated with the approximation of the solution by MFE, and secondly, to determine the coefficients for this expansion -- without the need to solve numerically the system of differential equations to find the coefficients of MFE. Numerical experiments illustrate the theoretical investigations.


title: $\Lambda$-Split: A Privacy-Preserving Split Computing Framework for Cloud-Powered Generative AI

abstract: In the wake of the burgeoning expansion of generative artificial intelligence (AI) services, the computational demands inherent to these technologies frequently necessitate cloud-powered computational offloading, particularly for resource-constrained mobile devices. These services commonly employ prompts to steer the generative process, and both the prompts and the resultant content, such as text and images, may harbor privacy-sensitive or confidential information, thereby elevating security and privacy risks. To mitigate these concerns, we introduce $\Lambda$-Split, a split computing framework to facilitate computational offloading while simultaneously fortifying data privacy against risks such as eavesdropping and unauthorized access. In $\Lambda$-Split, a generative model, usually a deep neural network (DNN), is partitioned into three sub-models and distributed across the user's local device and a cloud server: the input-side and output-side sub-models are allocated to the local, while the intermediate, computationally-intensive sub-model resides on the cloud server. This architecture ensures that only the hidden layer outputs are transmitted, thereby preventing the external transmission of privacy-sensitive raw input and output data. Given the black-box nature of DNNs, estimating the original input or output from intercepted hidden layer outputs poses a significant challenge for malicious eavesdroppers. Moreover, $\Lambda$-Split is orthogonal to traditional encryption-based security mechanisms, offering enhanced security when deployed in conjunction. We empirically validate the efficacy of the $\Lambda$-Split framework using Llama 2 and Stable Diffusion XL, representative large language and diffusion models developed by Meta and Stability AI, respectively. Our $\Lambda$-Split implementation is publicly accessible at https://github.com/nishio-laboratory/lambda_split.


title: Invariant Feature Regularization for Fair Face Recognition

abstract: Fair face recognition is all about learning invariant feature that generalizes to unseen faces in any demographic group. Unfortunately, face datasets inevitably capture the imbalanced demographic attributes that are ubiquitous in real-world observations, and the model learns biased feature that generalizes poorly in the minority group. We point out that the bias arises due to the confounding demographic attributes, which mislead the model to capture the spurious demographic-specific feature. The confounding effect can only be removed by causal intervention, which requires the confounder annotations. However, such annotations can be prohibitively expensive due to the diversity of the demographic attributes. To tackle this, we propose to generate diverse data partitions iteratively in an unsupervised fashion. Each data partition acts as a self-annotated confounder, enabling our Invariant Feature Regularization (INV-REG) to deconfound. INV-REG is orthogonal to existing methods, and combining INV-REG with two strong baselines (Arcface and CIFP) leads to new state-of-the-art that improves face recognition on a variety of demographic groups. Code is available at https://github.com/PanasonicConnect/InvReg.


title: Black holes in massive Einstein-dilaton gravity

abstract: In this paper, we focus on massive Einstein-dilaton gravity including the coupling of dilaton scalar field to massive graviton terms, and then derive static and spherically symmetric solutions of dilatonic black holes in four dimensional spacetime. We find that the dilatonic black hole could possess two horizons (event and cosmological), extreme (Nariai) and naked singularity for the suitably fixed parameters. In addition, we investigate thermodynamic properties of these dilatonic black holes, and check the corresponding first law of black hole thermodynamics. Extending to the massive Einstein-dilaton gravity in high dimensions, we further obtain the dilatonic black hole solutions in $(d+1)$ dimensional spacetime.


title: SPRING-INX: A Multilingual Indian Language Speech Corpus by SPRING Lab, IIT Madras

abstract: India is home to a multitude of languages of which 22 languages are recognised by the Indian Constitution as official. Building speech based applications for the Indian population is a difficult problem owing to limited data and the number of languages and accents to accommodate. To encourage the language technology community to build speech based applications in Indian languages, we are open sourcing SPRING-INX data which has about 2000 hours of legally sourced and manually transcribed speech data for ASR system building in Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Punjabi and Tamil. This endeavor is by SPRING Lab , Indian Institute of Technology Madras and is a part of National Language Translation Mission (NLTM), funded by the Indian Ministry of Electronics and Information Technology (MeitY), Government of India. We describe the data collection and data cleaning process along with the data statistics in this paper.


title: Strongly coupled fermionic probe for nonequilibrium thermometry

abstract: We characterise the measurement sensitivity, quantified by the Quantum Fisher Information (QFI), of a single-fermionic thermometric probe strongly coupled to the sample of interest, a fermionic bath, at temperature $T$. For nonequilibrium protocols, in which the probe is measured before reaching equilibrium with the sample, we find new behaviour of the measurement sensitivity arising due to non-Markovian dynamics. First, we show that the QFI displays a highly non-monotonic behaviour in time, in contrast to the Markovian case where it grows monotonically until equilibrium, so that non-Markovian revivals can be exploited to reach a higher QFI. Second, the QFI rate is maximised at a finite interrogation time $t^*$, which we characterize, in contrast to the solution $t^* \rightarrow 0$ known in the Markovian limit [Quantum 6, 869 (2022)]. Finally, we consider probes make up of few fermions and discuss different collective enhancements in the measurement precision.


title: A graphical representation of hyperelliptic KdV solutions

abstract: The periodic and quasi-periodic solutions of the integrable system have been studied for four decades based on the Riemann theta functions. However, there is a fundamental difficulty in representing the solutions graphically because the Riemann theta function requires several transcendental parameters. This paper presents a novel method for the graphical representation of such solutions from the algebraic treatment of the periodic and quasi-periodic solutions of the Baker-Weierstrass hyperelliptic $\wp$ functions. We demonstrate the graphical representation of the hyperelliptic $\wp$ functions of genus two.


title: Reasoning about Ambiguous Definite Descriptions

abstract: Natural language reasoning plays an increasingly important role in improving language models' ability to solve complex language understanding tasks. An interesting use case for reasoning is the resolution of context-dependent ambiguity. But no resources exist to evaluate how well Large Language Models can use explicit reasoning to resolve ambiguity in language. We propose to use ambiguous definite descriptions for this purpose and create and publish the first benchmark dataset consisting of such phrases. Our method includes all information required to resolve the ambiguity in the prompt, which means a model does not require anything but reasoning to do well. We find this to be a challenging task for recent LLMs. Code and data available at: https://github.com/sfschouten/exploiting-ambiguity


title: CryptoVerif: a Computationally-Sound Security Protocol Verifier (Initial Version with Communications on Channels)

abstract: This document presents the security protocol verifier CryptoVerif.CryptoVerif does not rely on the symbolic, Dolev-Yao model, but on the computational model. It can verify secrecy, correspondence (which include authentication), and indistinguishability properties. It produces proofs presented as sequences of games, like those manually written by cryptographers; these games are formalized in aprobabilistic process calculus. CryptoVerif provides a generic method for specifying security properties of the cryptographic primitives.It produces proofs valid for any number of sessions of the protocol, and provides an upper bound on the probability of success of an attack against the protocol as a function of the probability of breaking each primitive and of the number of sessions. It can work automatically, or the user can guide it with manual proof indications.


title: Predicting Accurate Lagrangian Multipliers for Mixed Integer Linear Programs

abstract: Lagrangian relaxation stands among the most efficient approaches for solving a Mixed Integer Linear Programs (MILP) with difficult constraints. Given any duals for these constraints, called Lagrangian Multipliers (LMs), it returns a bound on the optimal value of the MILP, and Lagrangian methods seek the LMs giving the best such bound. But these methods generally rely on iterative algorithms resembling gradient descent to maximize the concave piecewise linear dual function: the computational burden grows quickly with the number of relaxed constraints. We introduce a deep learning approach that bypasses the descent, effectively amortizing the local, per instance, optimization. A probabilistic encoder based on a graph convolutional network computes high-dimensional representations of relaxed constraints in MILP instances. A decoder then turns these representations into LMs. We train the encoder and decoder jointly by directly optimizing the bound obtained from the predicted multipliers. Numerical experiments show that our approach closes up to 85~\% of the gap between the continuous relaxation and the best Lagrangian bound, and provides a high quality warm-start for descent based Lagrangian methods.


title: On Thompson Groups for Wa\.zewski Dendrites

abstract: We study a family of Thompson-like groups built as rearrangement groups of fractals from [BF19], each acting on a Wa\.zewski dendrite. Each of these is a finitely generated group that is dense in the full group of homeomorphisms of the dendrite (studied in [DM19]) and has infinite-index finitely generated simple commutator subgroup, with a single possible exception. More properties are discussed, including finite subgroups, the conjugacy problem, invariable generation and existence of free subgroups. We discuss many possible generalizations, among which we find the Airplane rearrangement group $T_A$. Despite close connections with Thompson's group $F$, dendrite rearrangement groups seem to share many features with Thompson's group $V$.


title: Tractable MCMC for Private Learning with Pure and Gaussian Differential Privacy

abstract: Posterior sampling, i.e., exponential mechanism to sample from the posterior distribution, provides $\varepsilon$-pure differential privacy (DP) guarantees and does not suffer from potentially unbounded privacy breach introduced by $(\varepsilon,\delta)$-approximate DP. In practice, however, one needs to apply approximate sampling methods such as Markov chain Monte Carlo (MCMC), thus re-introducing the unappealing $\delta$-approximation error into the privacy guarantees. To bridge this gap, we propose the Approximate SAample Perturbation (abbr. ASAP) algorithm which perturbs an MCMC sample with noise proportional to its Wasserstein-infinity ($W_\infty$) distance from a reference distribution that satisfies pure DP or pure Gaussian DP (i.e., $\delta=0$). We then leverage a Metropolis-Hastings algorithm to generate the sample and prove that the algorithm converges in $W_\infty$ distance. We show that by combining our new techniques with a localization step, we obtain the first nearly linear-time algorithm that achieves the optimal rates in the DP-ERM problem with strongly convex and smooth losses.