title: Modelling Political Coalition Negotiations Using LLM-based Agents

abstract: Coalition negotiations are a cornerstone of parliamentary democracies, characterised by complex interactions and strategic communications among political parties. Despite its significance, the modelling of these negotiations has remained unexplored with the domain of Natural Language Processing (NLP), mostly due to lack of proper data. In this paper, we introduce coalition negotiations as a novel NLP task, and model it as a negotiation between large language model-based agents. We introduce a multilingual dataset, POLCA, comprising manifestos of European political parties and coalition agreements over a number of elections in these countries. This dataset addresses the challenge of the current scope limitations in political negotiation modelling by providing a diverse, real-world basis for simulation. Additionally, we propose a hierarchical Markov decision process designed to simulate the process of coalition negotiation between political parties and predict the outcomes. We evaluate the performance of state-of-the-art large language models (LLMs) as agents in handling coalition negotiations, offering insights into their capabilities and paving the way for future advancements in political modelling.


title: Existence of an optimal shape for the first eigenvalue of polyharmonic operators

abstract: We prove the existence of an open set minimizing the first eigenvalue of the Dirichlet polylaplacian of order $m\geq1$ under volume constraint. Moreover, the corresponding eigenfunction is shown to enjoy $C^{m-1,\alpha}$ H\"older regularity. This is performed for dimension $2\leq d\leq 4m$. In particular, our analysis answers the question of the existence of an optimal shape for the clamped plate up to dimension $8$.


title: General characterisation of Hamiltonians generating velocity-independent forces

abstract: Dynamics generated from Hamiltonians enjoy potential pathways to quantisation, but standard Hamiltonians are only capable of generating conservative forces. Classes of Hamiltonians have been proposed in Berry et al. capable of generating non-conservative velocity-independent forces. Such Hamiltonians have been classified in the past, under the strict assumption that they are polynomial in momentum. This assumption is relaxed here to analyticity. In doing so, broader classes of Hamiltonians are discovered. By considering the Hamiltonian as a function of state space without introducing the Lagrangian and constructing a metric-like tensor, we develop strong general constraints on Hamiltonians generating velocity-independent forces and exhibit a surprising dichotomy between classes of such Hamiltonians. These results are applicable to any spatial domain of any dimension admitting well-defined Hamiltonian dynamics. As an example application, we apply these constraints to classify all Hamiltonian velocity-independent forces in two spatial dimensions, as well as all such Hamiltonians which do not generate an isotropic simple harmonic motion. The case of one spatial dimension is also discussed for the sake of completeness.


title: The Gerber-Shiu Expected Discounted Penalty Function: An Application to Poverty Trapping

abstract: In this article, we consider a risk process with deterministic growth and prorated losses to model the capital of a household. Our work focuses on the analysis of the trapping time of such a process, where trapping occurs when a household's capital level falls into the poverty area, a region from which it is difficult to escape without external help. A function analogous to the classical Gerber-Shiu expected discounted penalty function is introduced, which incorporates information on the trapping time, the capital surplus immediately before trapping and the capital deficit at trapping. Given that the remaining proportion of capital upon experiencing a capital loss is $Beta(\alpha,1)-$distributed, closed-form expressions are obtained for quantities typically studied in classical risk theory, including the Laplace transform of the trapping time and the distribution of the capital deficit at trapping. In particular, we derive a model belonging to the generalised beta (GB) distribution family that describes the distribution of the capital deficit at trapping given that trapping occurs. Affinities between the capital deficit at trapping and a class of poverty measures, known as the Foster-Greer-Thorbecke (FGT) index, are presented. The versatility of this model to estimate FGT indices is assessed using household microdata from Burkina Faso's Enqu\^ete Multisectorielle Continue (EMC) 2014.


title: The Price of Abandoning Dark Matter Is Nonlocality

abstract: We consider the classic question posed by Pardo and Spergel about the price of abandoning dark matter in the context of an invariant, metric-based theory of gravity. Our answer is that the price is nonlocality. This has been known for some time in the context of the quasi-static regime. We show that it also applies for cosmology and we exhibit a model which reproduces standard CDM successes such as perturbations in the cosmic microwave background, baryon acoustic oscillations and structure formation.


title: A symmetric function approach to polynomial regression

abstract: We give an explicit solution formula for the polynomial regression problem in terms of Schur polynomials and Vandermonde determinants. We thereby generalize the work of Chang, Deng, and Floater to the case of model functions of the form $\sum _{i=1}^{n} a_{i} x^{d_{i}}$ for some integer exponents $d_{1} >d_{2} >\dotsc >d_{n} \geq 0$ and phrase the results using Schur polynomials. Even though the solution circumvents the well-known problems with the forward stability of the normal equation, it is only of practical value if $n$ is small because the number of terms in the formula grows rapidly with the number $m$ of data points. The formula can be evaluated essentially without rounding.


title: Deployment of Microcells by integrating LTE-U with LTE

abstract: With increasing data requirements of users, cellular operators are finding new ways to fulfil these requirements. These attempts involve the practice of deploying Wi-Fi access points nearer to the user and backhauling it to the nearest eNB (in case of LTE and LTE-A). The paper studies LTE-U, an extension of LTE which works in the unlicensed spectrum, as a potential solution to this problem. It is based on the idea of densification. Network deployments incorporating LTE-U will be able to better cater to the growing data rate demand of voice and video, thus reducing the load on eNB. Further we explore the possibility of LTE-U as an alternative to Wi-Fi or co-existing with Wi-Fi deployments and issues revolving around this idea. We show that LTE-U deployment solves the problem of capacity in both cases.


title: Mixed material point method formulation, stabilization, and validation for a unified analysis of free-surface and seepage flow

abstract: This paper presents a novel stabilized mixed material point method (MPM) designed for the unified modeling of free-surface and seepage flow. The unified formulation integrates the Navier-Stokes equation with the Darcy-Brinkman-Forchheimer equation, effectively capturing flows in both non-porous and porous domains. In contrast to the conventional Eulerian computational fluid dynamics (CFD) solver, which solves the velocity and pressure fields as unknown variables, the proposed method employs a monolithic displacement-pressure formulation adopted from the mixed-form updated-Lagrangian finite element method (FEM). To satisfy the discrete inf-sup stability condition, a stabilization strategy based on the variational multiscale method (VMS) is derived and integrated into the proposed formulation. Another distinctive feature is the implementation of blurred interfaces, which facilitate a seamless and stable transition of flows between free and porous domains, as well as across two distinct porous media. The efficacy of the proposed formulation is verified and validated through several benchmark cases in 1D, 2D, and 3D scenarios. Conducted numerical examples demonstrate enhanced accuracy and stability compared to analytical, experimental, and other numerical solutions.


title: Characterization of NbTiN films with thicknesses below 20 nm for low power kinetic inductance amplifiers

abstract: A quantum-limited amplification chain is a fundamental advantage for any application that may benefit from the detection of very faint signals. Reading out arrays of superconducting detectors (TESs or MKIDs), resonant cavities, or qubits, calls for large bandwidth amplifiers in addition to having the lowest possible noise. At millikelvin temperatures, Kinetic Inductance Traveling-Wave Parametric Amplifiers (KI-TWPAs) working in 3-wave-mixing (3WM) and fabricated from a 20 nm thick NbTiN film have shown promising noise performances, as they can operate close to the quantum limit. However, they still require fairly high pump power. Devices that would require lower pump power would be easier to implement in readout chains, could reach the quantum limit and they would be compatible with qubit readout. A possible solution for obtaining this optimal configuration is to use a thinner superconducting film. In this work we explore the properties of NbTiN films with a thickness less than 20 nm and we report the obtained experimental characterizations in terms of critical temperature, normal resistivity, and kinetic inductance. A new design for a 3WM KI-TWPA amplifier, based on these developed superconducting films, is introduced and discussed.


title: Double-$Q$ and quadruple-$Q$ instabilities at low-symmetric ordering wave vectors under tetragonal symmetry

abstract: Multiple-$Q$ states are expressed as a superposition of spin density waves at multiple ordering wave vectors, which results in unconventional complicated spin textures, such as skyrmion, hedgehog, and vortex. We investigate the multiple-$Q$ instability by focusing on the low-symmetric ordering wave vectors in momentum space. By systematically performing the simulated annealing for effective spin models with various ordering wave vectors on a two-dimensional square lattice, we classify the magnetic phase diagram into four types according to the position of the ordering wave vectors. Three out of four cases lead to a plethora of isotropic multiple-$Q$ instabilities yielding collinear, coplanar, and noncoplanar double-$Q$ and quadruple-$Q$ magnetic phases, while the remaining case leads to an anisotropic double-$Q$ instability when the multiple-spin interaction is introduced. Our results indicate that exotic multiple-$Q$ phases distinct from the skyrmion crystal phase are expected when the ordering wave vectors lie on the low-symmetric positions in the Brillouin zone.


title: Invertible Fourier Neural Operators for Tackling Both Forward and Inverse Problems

abstract: Fourier Neural Operator (FNO) is a popular operator learning method, which has demonstrated state-of-the-art performance across many tasks. However, FNO is mainly used in forward prediction, yet a large family of applications rely on solving inverse problems. In this paper, we propose an invertible Fourier Neural Operator (iFNO) that tackles both the forward and inverse problems. We designed a series of invertible Fourier blocks in the latent channel space to share the model parameters, efficiently exchange the information, and mutually regularize the learning for the bi-directional tasks. We integrated a variational auto-encoder to capture the intrinsic structures within the input space and to enable posterior inference so as to overcome challenges of illposedness, data shortage, noises, etc. We developed a three-step process for pre-training and fine tuning for efficient training. The evaluations on five benchmark problems have demonstrated the effectiveness of our approach.


title: Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models

abstract: Advances in language modeling have paved the way for novel human-AI co-writing experiences. This paper explores how varying levels of scaffolding from large language models (LLMs) shape the co-writing process. Employing a within-subjects field experiment with a Latin square design, we asked participants (N=131) to respond to argumentative writing prompts under three randomly sequenced conditions: no AI assistance (control), next-sentence suggestions (low scaffolding), and next-paragraph suggestions (high scaffolding). Our findings reveal a U-shaped impact of scaffolding on writing quality and productivity (words/time). While low scaffolding did not significantly improve writing quality or productivity, high scaffolding led to significant improvements, especially benefiting non-regular writers and less tech-savvy users. No significant cognitive burden was observed while using the scaffolded writing tools, but a moderate decrease in text ownership and satisfaction was noted. Our results have broad implications for the design of AI-powered writing tools, including the need for personalized scaffolding mechanisms.


title: Large Language Models as Data Augmenters for Cold-Start Item Recommendation

abstract: The reasoning and generalization capabilities of LLMs can help us better understand user preferences and item characteristics, offering exciting prospects to enhance recommendation systems. Though effective while user-item interactions are abundant, conventional recommendation systems struggle to recommend cold-start items without historical interactions. To address this, we propose utilizing LLMs as data augmenters to bridge the knowledge gap on cold-start items during training. We employ LLMs to infer user preferences for cold-start items based on textual description of user historical behaviors and new item descriptions. The augmented training signals are then incorporated into learning the downstream recommendation models through an auxiliary pairwise loss. Through experiments on public Amazon datasets, we demonstrate that LLMs can effectively augment the training signals for cold-start items, leading to significant improvements in cold-start item recommendation for various recommendation models.


title: How Susceptible are Large Language Models to Ideological Manipulation?

abstract: Large Language Models (LLMs) possess the potential to exert substantial influence on public perceptions and interactions with information. This raises concerns about the societal impact that could arise if the ideologies within these models can be easily manipulated. In this work, we investigate how effectively LLMs can learn and generalize ideological biases from their instruction-tuning data. Our findings reveal a concerning vulnerability: exposure to only a small amount of ideologically driven samples significantly alters the ideology of LLMs. Notably, LLMs demonstrate a startling ability to absorb ideology from one topic and generalize it to even unrelated ones. The ease with which LLMs' ideologies can be skewed underscores the risks associated with intentionally poisoned training data by malicious actors or inadvertently introduced biases by data annotators. It also emphasizes the imperative for robust safeguards to mitigate the influence of ideological manipulations on LLMs.


title: Ab-initio investigation of hot electron transfer in CO$_2$ plasmonic photocatalysis in presence of hydroxyl adsorbate

abstract: Photoreduction of carbon dioxide (CO$_2$) on plasmonic structures is of great interest in photocatalysis to aid selectivity. While species commonly found in reaction environments and associated intermediates can steer the reaction down different pathways by altering the potential energy landscape of the system, they are often not addressed when designing efficient plasmonic catalysts. Here, we perform an atomistic study of the effect of the hydroxyl group (OH) on CO$_2$ activation and hot electron generation and transfer using first-principle calculations. We show that the presence of OH is essential in breaking the linear symmetry of CO$_2$, which leads to a charge redistribution and a decrease in the O=C=O angle to 134{\deg}, thereby activating CO$_2$. Analysis of the partial density of states (pDOS) demonstrates that the OH group mediates the orbital hybridization between Au and CO$_2$ resulting in more accessible states, thus facilitating charge transfer. By employing time-dependent density functional theory (TDDFT), we quantify the fraction of hot electrons directly generated into hybridized molecular states at resonance, demonstrating a broader energy distribution and a 11% increase in charge-transfer in the presence of OH groups. We further show that the spectral overlap between excitation energy and plasmon resonance plays a critical role in efficiently modulating electron transfer processes. These findings contribute to the mechanistic understanding of plasmon-mediated reactions and demonstrate the importance of co-adsorbed species in tailoring the electron transfer processes, opening new avenues for enhancing selectivity.


title: A Cartesian Closed Category for Random Variables

abstract: We present a novel, yet rather simple construction within the traditional framework of Scott domains to provide semantics to probabilistic programming, thus obtaining a solution to a long-standing open problem in this area. Unlike current main approaches that employ some probability measures or continuous valuations on non-standard or rather complex structures, we use the Scott domain of random variables from a standard sample space -- the unit interval or the Cantor space -- to any given Scott domain. The map taking any such random variable to its corresponding probability distribution provides an effectively given, Scott continuous surjection onto the probabilistic power domain of the underlying Scott domain, establishing a new basic result in classical domain theory. We obtain a Cartesian closed category by enriching the category of Scott domains to capture the equivalence of random variables on these domains. The construction of the domain of random variables on this enriched category forms a strong commutative monad, which is suitable for defining the semantics of probabilistic programming.


title: Numerical Claim Detection in Finance: A New Financial Dataset, Weak-Supervision Model, and Market Analysis

abstract: In this paper, we investigate the influence of claims in analyst reports and earnings calls on financial market returns, considering them as significant quarterly events for publicly traded companies. To facilitate a comprehensive analysis, we construct a new financial dataset for the claim detection task in the financial domain. We benchmark various language models on this dataset and propose a novel weak-supervision model that incorporates the knowledge of subject matter experts (SMEs) in the aggregation function, outperforming existing approaches. Furthermore, we demonstrate the practical utility of our proposed model by constructing a novel measure ``optimism". Furthermore, we observed the dependence of earnings surprise and return on our optimism measure. Our dataset, models, and code will be made publicly (under CC BY 4.0 license) available on GitHub and Hugging Face.


title: Prospector Heads: Generalized Feature Attribution for Large Models & Data

abstract: Feature attribution, the ability to localize regions of the input data that are relevant for classification, is an important capability for ML models in scientific and biomedical domains. Current methods for feature attribution, which rely on "explaining" the predictions of end-to-end classifiers, suffer from imprecise feature localization and are inadequate for use with small sample sizes and high-dimensional datasets due to computational challenges. We introduce prospector heads, an efficient and interpretable alternative to explanation-based attribution methods that can be applied to any encoder and any data modality. Prospector heads generalize across modalities through experiments on sequences (text), images (pathology), and graphs (protein structures), outperforming baseline attribution methods by up to 26.3 points in mean localization AUPRC. We also demonstrate how prospector heads enable improved interpretation and discovery of class-specific patterns in input data. Through their high performance, flexibility, and generalizability, prospectors provide a framework for improving trust and transparency for ML models in complex domains.


title: Majorana bound state induced drag current in capacitively coupled quantum dots

abstract: We show that nonzero drag current in a double quantum-dot system, consisting of a biased drive dot and an unbiased passive dot coupled capacitively, can be generated by a Majorana bound state located at one of the leads connected to the passive dot. Importantly, the drag current induced by Majorana bound states, either an isolated Majorana bound state or two weakly coupled but spatially separated Majorana modes, shows qualitative differences from that induced by a near-zero-energy Andereev bound state. Thus, other than the tunneling spectroscopy, the proposed setup can serve as a complementary tool to detect Majorana fermions in proximitized Rashba nanowires.


title: Sobolev extension in a simple case

abstract: In this paper, we establish the existence of a bounded, linear extension operator $T: L^{2,p}(E) \to L^{2,p}(\mathbb{R}^2)$ when $1<p<2$ and $E$ is a finite subset of $\mathbb{R}^2$ contained in a line.


title: Dressing Factors for Mixed-Flux $AdS_3\times S^3\times T^4$ Superstrings

abstract: We propose the dressing factors for the scattering of fundamental massive particles on the worldsheet of mixed-flux $AdS_3\times S^3\times T^4$ superstrings. The proposal passes several checks, including comparison with perturbative and semiclassical computations from the string sigma model. We also conjecture the form of the remaining dressing factors of the theory, which completes the worldsheet-integrability construction for this model.


title: The Effectiveness of Random Forgetting for Robust Generalization

abstract: Deep neural networks are susceptible to adversarial attacks, which can compromise their performance and accuracy. Adversarial Training (AT) has emerged as a popular approach for protecting neural networks against such attacks. However, a key challenge of AT is robust overfitting, where the network's robust performance on test data deteriorates with further training, thus hindering generalization. Motivated by the concept of active forgetting in the brain, we introduce a novel learning paradigm called "Forget to Mitigate Overfitting (FOMO)". FOMO alternates between the forgetting phase, which randomly forgets a subset of weights and regulates the model's information through weight reinitialization, and the relearning phase, which emphasizes learning generalizable features. Our experiments on benchmark datasets and adversarial attacks show that FOMO alleviates robust overfitting by significantly reducing the gap between the best and last robust test accuracy while improving the state-of-the-art robustness. Furthermore, FOMO provides a better trade-off between standard and robust accuracy, outperforming baseline adversarial methods. Finally, our framework is robust to AutoAttacks and increases generalization in many real-world scenarios.


title: Solving Data-centric Tasks using Large Language Models

abstract: Large language models (LLMs) are rapidly replacing help forums like StackOverflow, and are especially helpful for non-professional programmers and end users. These users are often interested in data-centric tasks, such as spreadsheet manipulation and data wrangling, which are hard to solve if the intent is only communicated using a natural-language description, without including the data. But how do we decide how much data and which data to include in the prompt? This paper makes two contributions towards answering this question. First, we create a dataset of real-world NL-to-code tasks manipulating tabular data, mined from StackOverflow posts. Second, we introduce a cluster-then-select prompting technique, which adds the most representative rows from the input data to the LLM prompt. Our experiments show that LLM performance is indeed sensitive to the amount of data passed in the prompt, and that for tasks with a lot of syntactic variation in the input table, our cluster-then-select technique outperforms a random selection baseline.


title: LiRaFusion: Deep Adaptive LiDAR-Radar Fusion for 3D Object Detection

abstract: We propose LiRaFusion to tackle LiDAR-radar fusion for 3D object detection to fill the performance gap of existing LiDAR-radar detectors. To improve the feature extraction capabilities from these two modalities, we design an early fusion module for joint voxel feature encoding, and a middle fusion module to adaptively fuse feature maps via a gated network. We perform extensive evaluation on nuScenes to demonstrate that LiRaFusion leverages the complementary information of LiDAR and radar effectively and achieves notable improvement over existing methods.


title: Monte Carlo with kernel-based Gibbs measures: Guarantees for probabilistic herding

abstract: Kernel herding belongs to a family of deterministic quadratures that seek to minimize the worst-case integration error over a reproducing kernel Hilbert space (RKHS). In spite of strong experimental support, it has revealed difficult to prove that this worst-case error decreases at a faster rate than the standard square root of the number of quadrature nodes, at least in the usual case where the RKHS is infinite-dimensional. In this theoretical paper, we study a joint probability distribution over quadrature nodes, whose support tends to minimize the same worst-case error as kernel herding. We prove that it does outperform i.i.d. Monte Carlo, in the sense of coming with a tighter concentration inequality on the worst-case integration error. While not improving the rate yet, this demonstrates that the mathematical tools of the study of Gibbs measures can help understand to what extent kernel herding and its variants improve on computationally cheaper methods. Moreover, we provide early experimental evidence that a faster rate of convergence, though not worst-case, is likely.


title: Compression Repair for Feedforward Neural Networks Based on Model Equivalence Evaluation

abstract: In this paper, we propose a method of repairing compressed Feedforward Neural Networks (FNNs) based on equivalence evaluation of two neural networks. In the repairing framework, a novel neural network equivalence evaluation method is developed to compute the output discrepancy between two neural networks. The output discrepancy can quantitatively characterize the output difference produced by compression procedures. Based on the computed output discrepancy, the repairing method first initializes a new training set for the compressed networks to narrow down the discrepancy between the two neural networks and improve the performance of the compressed network. Then, we repair the compressed FNN by re-training based on the training set. We apply our developed method to the MNIST dataset to demonstrate the effectiveness and advantages of our proposed repair method.


title: Bulk and boundary entanglement transitions in the projective gauge-Higgs model

abstract: In quantum many-body spin systems, the interplay between the entangling effect of multi-qubit Pauli measurements and the disentangling effect of single-qubit Pauli measurements may give rise to two competing effects. By introducing a randomized measurement pattern with such bases, a phase transition can be induced by altering the ratio between them. In this work, we numerically investigate a measurement-based model associated with the $(2+1)$d $\mathbb{Z}_2$ Fradkin-Shenker Hamiltonian model, encompassing the deconfining, confining, and Higgs phases. We determine the phase diagram in our measurement-only model by employing entanglement measures. For the bulk topological order, we use the topological entanglement entropy. We also use the mutual information between separated boundary regions to diagnose the boundary phase transition associated with the Higgs or the bulk SPT phase. We observe the structural similarity between our phase diagram and the one in the standard quantum Hamiltonian formulation of the Fradkin-Shenker model with the open rough boundary. First, a deconfining phase is detected by nonzero and constant topological entanglement entropy. Second, we find a (boundary) phase transition curve separating the Higgs=SPT phase from the rest. In certain limits, the topological phase transitions reside at the critical point of the formation of giant homological cycles in the bulk 3d spacetime lattice, as well as the bond percolation threshold of the boundary 2d spacetime lattice when it is effectively decoupled from the bulk. Additionally, there are analogous mixed-phase properties at a certain region of the phase diagram, emerging from how we terminate the measurement-based procedure. Our findings pave an alternative pathway to study the physics of Higgs=SPT phases on quantum devices in the near future.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el hep-lat


title: A Transition System Abstraction Framework for Neural Network Dynamical System Models

abstract: This paper proposes a transition system abstraction framework for neural network dynamical system models to enhance the model interpretability, with applications to complex dynamical systems such as human behavior learning and verification. To begin with, the localized working zone will be segmented into multiple localized partitions under the data-driven Maximum Entropy (ME) partitioning method. Then, the transition matrix will be obtained based on the set-valued reachability analysis of neural networks. Finally, applications to human handwriting dynamics learning and verification are given to validate our proposed abstraction framework, which demonstrates the advantages of enhancing the interpretability of the black-box model, i.e., our proposed framework is able to abstract a data-driven neural network model into a transition system, making the neural network model interpretable through verifying specifications described in Computational Tree Logic (CTL) languages.


title: Extraction of nonlinearity in neural networks with Koopman operator

abstract: Nonlinearity plays a crucial role in deep neural networks. In this paper, we investigate the degree to which the nonlinearity of the neural network is essential. For this purpose, we employ the Koopman operator, extended dynamic mode decomposition, and the tensor-train format. The Koopman operator approach has been recently developed in physics and nonlinear sciences; the Koopman operator deals with the time evolution in the observable space instead of the state space. Since we can replace the nonlinearity in the state space with the linearity in the observable space, it is a hopeful candidate for understanding complex behavior in nonlinear systems. Here, we analyze learned neural networks for the classification problems. As a result, the replacement of the nonlinear middle layers with the Koopman matrix yields enough accuracy in numerical experiments. In addition, we confirm that the pruning of the Koopman matrix gives sufficient accuracy even at high compression ratios. These results indicate the possibility of extracting some features in the neural networks with the Koopman operator approach.


title: To Store or Not to Store: a graph theoretical approach for Dataset Versioning

abstract: In this work, we study the cost efficient data versioning problem, where the goal is to optimize the storage and reconstruction (retrieval) costs of data versions, given a graph of datasets as nodes and edges capturing edit/delta information. One central variant we study is MinSum Retrieval (MSR) where the goal is to minimize the total retrieval costs, while keeping the storage costs bounded. This problem (along with its variants) was introduced by Bhattacherjee et al. [VLDB'15]. While such problems are frequently encountered in collaborative tools (e.g., version control systems and data analysis pipelines), to the best of our knowledge, no existing research studies the theoretical aspects of these problems. We establish that the currently best-known heuristic, LMG, can perform arbitrarily badly in a simple worst case. Moreover, we show that it is hard to get $o(n)$-approximation for MSR on general graphs even if we relax the storage constraints by an $O(\log n)$ factor. Similar hardness results are shown for other variants. Meanwhile, we propose poly-time approximation schemes for tree-like graphs, motivated by the fact that the graphs arising in practice from typical edit operations are often not arbitrary. As version graphs typically have low treewidth, we further develop new algorithms for bounded treewidth graphs. Furthermore, we propose two new heuristics and evaluate them empirically. First, we extend LMG by considering more potential ``moves'', to propose a new heuristic LMG-All. LMG-All consistently outperforms LMG while having comparable run time on a wide variety of datasets, i.e., version graphs. Secondly, we apply our tree algorithms on the minimum-storage arborescence of an instance, yielding algorithms that are qualitatively better than all previous heuristics for MSR, as well as for another variant BoundedMin Retrieval (BMR).


title: Balanced Data, Imbalanced Spectra: Unveiling Class Disparities with Spectral Imbalance

abstract: Classification models are expected to perform equally well for different classes, yet in practice, there are often large gaps in their performance. This issue of class bias is widely studied in cases of datasets with sample imbalance, but is relatively overlooked in balanced datasets. In this work, we introduce the concept of spectral imbalance in features as a potential source for class disparities and study the connections between spectral imbalance and class bias in both theory and practice. To build the connection between spectral imbalance and class gap, we develop a theoretical framework for studying class disparities and derive exact expressions for the per-class error in a high-dimensional mixture model setting. We then study this phenomenon in 11 different state-of-the-art pretrained encoders and show how our proposed framework can be used to compare the quality of encoders, as well as evaluate and combine data augmentation strategies to mitigate the issue. Our work sheds light on the class-dependent effects of learning, and provides new insights into how state-of-the-art pretrained features may have unknown biases that can be diagnosed through their spectra.


title: Hybrid Online-Offline Learning for Task Offloading in Mobile Edge Computing Systems

abstract: We consider a multi-user multi-server mobile edge computing (MEC) system, in which users arrive on a network randomly over time and generate computation tasks, which will be computed either locally on their own computing devices or be offloaded to one of the MEC servers. Under such a dynamic network environment, we propose a novel task offloading policy based on hybrid online-offline learning, which can efficiently reduce the overall computation delay and energy consumption only with information available at nearest MEC servers from each user. We provide a practical signaling and learning framework that can train deep neural networks for both online and offline learning and can adjust its offloading policy based on the queuing status of each MEC server and network dynamics. Numerical results demonstrate that the proposed scheme significantly reduces the average computation delay for a broad class of network environments compared to the conventional offloading methods. It is further shown that the proposed hybrid online-offline learning framework can be extended to a general cost function reflecting both delay and energy-dependent metrics.


title: Machine-Generated Text Localization

abstract: Machine-Generated Text (MGT) detection aims to identify a piece of text as machine or human written. Prior work has primarily formulated MGT detection as a binary classification task over an entire document, with limited work exploring cases where only part of a document is machine generated. This paper provides the first in-depth study of MGT that localizes the portions of a document that were machine generated. Thus, if a bad actor were to change a key portion of a news article to spread misinformation, whole document MGT detection may fail since the vast majority is human written, but our approach can succeed due to its granular approach. A key challenge in our MGT localization task is that short spans of text, e.g., a single sentence, provides little information indicating if it is machine generated due to its short length. To address this, we leverage contextual information, where we predict whether multiple sentences are machine or human written at once. This enables our approach to identify changes in style or content to boost performance. A gain of 4-13% mean Average Precision (mAP) over prior work demonstrates the effectiveness of approach on five diverse datasets: GoodNews, VisualNews, WikiText, Essay, and WP. We release our implementation at https://github.com/Zhongping-Zhang/MGT_Localization.


title: From Large to Small $\mathcal{N}=(4,4)$ Superconformal Surface Defects in Holographic 6d SCFTs

abstract: Two-dimensional (2d) $\mathcal{N}=(4,4)$ Lie superalgebras can be either "small" or "large", meaning their R-symmetry is either $\mathfrak{so}(4)$ or $\mathfrak{so}(4) \oplus \mathfrak{so}(4)$, respectively. Both cases admit a superconformal extension and fit into the one-parameter family $\mathfrak{d}\left(2,1;\gamma\right)\oplus \mathfrak{d}\left(2,1;\gamma\right)$, with parameter $\gamma \in (-\infty,\infty)$. The large algebra corresponds to generic values of $\gamma$, while the small case corresponds to a degeneration limit with $\gamma \to -\infty$. In 11d supergravity, we study known solutions with superisometry algebra $\mathfrak{d}\left(2,1;\gamma\right)\oplus \mathfrak{d}\left(2,1;\gamma\right)$ that are asymptotically locally AdS$_7 \times S^4$. These solutions are holographically dual to the 6d maximally superconformal field theory with 2d superconformal defects invariant under $\mathfrak{d}\left(2,1;\gamma\right)\oplus \mathfrak{d}\left(2,1;\gamma\right)$. We show that a limit of these solutions, in which $\gamma \to -\infty$, reproduces another known class of solutions, holographically dual to small $\mathcal{N}=(4,4)$ superconformal defects. We then use this limit to generate new small $\mathcal{N}=(4,4)$ solutions with finite Ricci scalar, in contrast to the known small $\mathcal{N}=(4,4)$ solutions. We then use holography to compute the entanglement entropy of a spherical region centered on these small $\mathcal{N}=(4,4)$ defects, which provides a linear combination of defect Weyl anomaly coefficients that characterizes the number of defect-localized degrees of freedom. We also comment on the generalization of our results to include $\mathcal{N}=(0,4)$ surface defects through orbifolding.


title: Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic

abstract: Aligned language models face a significant limitation as their fine-tuning often results in compromised safety. To tackle this, we propose a simple method RESTA that performs LLM safety realignment. RESTA stands for REstoring Safety through Task Arithmetic. At its core, it involves a simple arithmetic addition of a safety vector to the weights of the compromised model. We demonstrate the effectiveness of RESTA in both parameter-efficient and full fine-tuning, covering a wide range of downstream tasks, including instruction following in Chinese, English, and Hindi, as well as problem-solving capabilities in Code and Math. We also showcase the generalizability of RESTA on three existing safety evaluation benchmarks and a multilingual benchmark dataset proposed as a part of this work, consisting of 550 harmful questions covering 11 categories, each with 5 sub-categories of harm. Overall, RESTA decreases the harmfulness of the compromised model from 18.6% to 5.1% and from 9.2% to 1.5% in parameter-efficient and full fine-tuning, respectively, while maintaining most of the model's performance on the task. We release the source codes at: https://github.com/declare-lab/resta.


title: Parameter Efficient Finetuning for Speech Emotion Recognition and Domain Adaptation

abstract: Foundation models have shown superior performance for speech emotion recognition (SER). However, given the limited data in emotion corpora, finetuning all parameters of large pre-trained models for SER can be both resource-intensive and susceptible to overfitting. This paper investigates parameter-efficient finetuning (PEFT) for SER. Various PEFT adaptors are systematically studied for both classification of discrete emotion categories and prediction of dimensional emotional attributes. The results demonstrate that the combination of PEFT methods surpasses full finetuning with a significant reduction in the number of trainable parameters. Furthermore, a two-stage adaptation strategy is proposed to adapt models trained on acted emotion data, which is more readily available, to make the model more adept at capturing natural emotional expressions. Both intra- and cross-corpus experiments validate the efficacy of the proposed approach in enhancing the performance on both the source and target domains.


title: Low-power SNN-based audio source localisation using a Hilbert Transform spike encoding scheme

abstract: Sound source localisation is used in many consumer electronics devices, to help isolate audio from individual speakers and to reject noise. Localization is frequently accomplished by "beamforming" algorithms, which combine microphone audio streams to improve received signal power from particular incident source directions. Beamforming algorithms generally use knowledge of the frequency components of the audio source, along with the known microphone array geometry, to analytically phase-shift microphone streams before combining them. A dense set of band-pass filters is often used to obtain known-frequency "narrowband" components from wide-band audio streams. These approaches achieve high accuracy, but state of the art narrowband beamforming algorithms are computationally demanding, and are therefore difficult to integrate into low-power IoT devices. We demonstrate a novel method for sound source localisation in arbitrary microphone arrays, designed for efficient implementation in ultra-low-power spiking neural networks (SNNs). We use a novel short-time Hilbert transform (STHT) to remove the need for demanding band-pass filtering of audio, and introduce a new accompanying method for audio encoding with spiking events. Our beamforming and localisation approach achieves state-of-the-art accuracy for SNN methods, and comparable with traditional non-SNN super-resolution approaches. We deploy our method to low-power SNN audio inference hardware, and achieve much lower power consumption compared with super-resolution methods. We demonstrate that signal processing approaches can be co-designed with spiking neural network implementations to achieve high levels of power efficiency. Our new Hilbert-transform-based method for beamforming promises to also improve the efficiency of traditional DSP-based signal processing.


title: Evidence of heavy fermion physics in the thermoelectric transport of magic angle twisted bilayer graphene

abstract: It has been recently postulated, that the strongly correlated flat bands of magicangle twisted bilayer graphene (MATBG) can host coexisting heavy and light carriers. While transport and spectroscopic measurements have shown hints of this behavior, a more direct experimental proof is still lacking. Here, we explore the thermoelectric response of MATBG through the photo-thermoelectric (PTE) effect in gate-defined MATBG pn-junctions. At low temperatures, we observe sign-preserving, fillingdependent oscillations of the Seebeck coefficient at non-zero integer fillings of the moir\'e lattice, which suggest the preponderance of one carrier type despite tuning the Fermi level from hole to electron doping of the correlated insulator. Furthermore, at higher temperatures, the thermoelectric response provides distinct evidence of the strong electron correlations in the unordered, normal state. We show that our observations are naturally accounted for by the interplay of light and long-lived and heavy and short-lived electron bands near the Fermi level at non-zero integer fillings. Our observations firmly establish the electron and hole asymmetry of the correlated gaps in MATBG, and shows excellent qualitative agreement with the recently developed topological heavy fermion model (THF).


title: In-Context Learning Demonstration Selection via Influence Analysis

abstract: Large Language Models (LLMs) have showcased their In-Context Learning (ICL) capabilities, enabling few-shot learning without the need for gradient updates. Despite its advantages, the effectiveness of ICL heavily depends on the choice of demonstrations. Selecting the most effective demonstrations for ICL remains a significant research challenge. To tackle this issue, we propose a demonstration selection method named InfICL, which utilizes influence functions to analyze impacts of training samples. By identifying the most influential training samples as demonstrations, InfICL aims to enhance the ICL generalization performance. To keep InfICL cost-effective, we only use the LLM to generate sample input embeddings, avoiding expensive fine-tuning. Through empirical studies on various real-world datasets, we demonstrate advantages of InfICL compared to state-of-the-art baselines.


title: A 4-8 GHz Kinetic Inductance Travelling-Wave Parametric Amplifier Using Four-Wave Mixing with Near Quantum-Limit Noise Performance

abstract: Kinetic inductance traveling-wave parametric amplifiers (KI-TWPA) have a wide instantaneous bandwidth with near quantum-limited performance and a relatively high dynamic range. Because of this, they are suitable readout devices for cryogenic detectors and superconducting qubits and have a variety of applications in quantum sensing. This work discusses the design, fabrication, and performance of a KI-TWPA based on four-wave mixing in a NbTiN microstrip transmission line. This device amplifies a signal band from 4 to 8~GHz without contamination from image tones, which are produced in a separate higher frequency band. The 4 - 8~GHz band is commonly used to read out cryogenic detectors, such as microwave kinetic inductance detectors (MKIDs) and Josephson junction-based qubits. We report a measured maximum gain of over 20 dB using four-wave mixing with a 1-dB gain compression point of -58 dBm at 15 dB of gain over that band. The bandwidth and peak gain are tunable by adjusting the pump-tone frequency and power. Using a Y-factor method, we measure an amplifier-added noise of $ 0.5 \leq N_{added} \leq 1.5$ photons from 4.5 - 8 GHz.


title: Diagonalisation SGD: Fast & Convergent SGD for Non-Differentiable Models via Reparameterisation and Smoothing

abstract: It is well-known that the reparameterisation gradient estimator, which exhibits low variance in practice, is biased for non-differentiable models. This may compromise correctness of gradient-based optimisation methods such as stochastic gradient descent (SGD). We introduce a simple syntactic framework to define non-differentiable functions piecewisely and present a systematic approach to obtain smoothings for which the reparameterisation gradient estimator is unbiased. Our main contribution is a novel variant of SGD, Diagonalisation Stochastic Gradient Descent, which progressively enhances the accuracy of the smoothed approximation during optimisation, and we prove convergence to stationary points of the unsmoothed (original) objective. Our empirical evaluation reveals benefits over the state of the art: our approach is simple, fast, stable and attains orders of magnitude reduction in work-normalised variance.


title: ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMs

abstract: Safety is critical to the usage of large language models (LLMs). Multiple techniques such as data filtering and supervised fine-tuning have been developed to strengthen LLM safety. However, currently known techniques presume that corpora used for safety alignment of LLMs are solely interpreted by semantics. This assumption, however, does not hold in real-world applications, which leads to severe vulnerabilities in LLMs. For example, users of forums often use ASCII art, a form of text-based art, to convey image information. In this paper, we propose a novel ASCII art-based jailbreak attack and introduce a comprehensive benchmark Vision-in-Text Challenge (ViTC) to evaluate the capabilities of LLMs in recognizing prompts that cannot be solely interpreted by semantics. We show that five SOTA LLMs (GPT-3.5, GPT-4, Gemini, Claude, and Llama2) struggle to recognize prompts provided in the form of ASCII art. Based on this observation, we develop the jailbreak attack ArtPrompt, which leverages the poor performance of LLMs in recognizing ASCII art to bypass safety measures and elicit undesired behaviors from LLMs. ArtPrompt only requires black-box access to the victim LLMs, making it a practical attack. We evaluate ArtPrompt on five SOTA LLMs, and show that ArtPrompt can effectively and efficiently induce undesired behaviors from all five LLMs. Our code is available at https://github.com/uw-nsl/ArtPrompt.


title: Attraction Via Prices and Information

abstract: We study the ramifications of increased commitment power for information provision in an oligopolistic market with search frictions. Although prices are posted and, therefore, guide search, if firms cannot commit to information provision policies, there is no active search at equilibrium so consumers visit (and purchase from) at most one firm. If firms can guide search by both their prices and information policies, there exists a unique symmetric equilibrium exhibiting price dispersion and active search. Nevertheless, when the market is thin, consumers prefer the former case, which features intense price competition. Firms always prefer the latter.


title: SPML: A DSL for Defending Language Models Against Prompt Attacks

abstract: Large language models (LLMs) have profoundly transformed natural language applications, with a growing reliance on instruction-based definitions for designing chatbots. However, post-deployment the chatbot definitions are fixed and are vulnerable to attacks by malicious users, emphasizing the need to prevent unethical applications and financial losses. Existing studies explore user prompts' impact on LLM-based chatbots, yet practical methods to contain attacks on application-specific chatbots remain unexplored. This paper presents System Prompt Meta Language (SPML), a domain-specific language for refining prompts and monitoring the inputs to the LLM-based chatbots. SPML actively checks attack prompts, ensuring user inputs align with chatbot definitions to prevent malicious execution on the LLM backbone, optimizing costs. It also streamlines chatbot definition crafting with programming language capabilities, overcoming natural language design challenges. Additionally, we introduce a groundbreaking benchmark with 1.8k system prompts and 20k user inputs, offering the inaugural language and benchmark for chatbot definition evaluation. Experiments across datasets demonstrate SPML's proficiency in understanding attacker prompts, surpassing models like GPT-4, GPT-3.5, and LLAMA. Our data and codes are publicly available at: https://prompt-compiler.github.io/SPML/.


title: MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs

abstract: Generative Large Language Models (LLMs) are widely utilized for their excellence in various tasks. However, their tendency to produce inaccurate or misleading outputs poses a potential risk, particularly in high-stakes environments. Therefore, estimating the correctness of generative LLM outputs is an important task for enhanced reliability. Uncertainty Estimation (UE) in generative LLMs is an evolving domain, where SOTA probability-based methods commonly employ length-normalized scoring. In this work, we propose Meaning-Aware Response Scoring (MARS) as an alternative to length-normalized scoring for UE methods. MARS is a novel scoring function that considers the semantic contribution of each token in the generated sequence in the context of the question. We demonstrate that integrating MARS into UE methods results in a universal and significant improvement in UE performance. We conduct experiments using three distinct closed-book question-answering datasets across five popular pre-trained LLMs. Lastly, we validate the efficacy of MARS on a Medical QA dataset. Code can be found https://github.com/Ybakman/LLM_Uncertainity.


title: Large Language Models for Stemming: Promises, Pitfalls and Failures

abstract: Text stemming is a natural language processing technique that is used to reduce words to their base form, also known as the root form. The use of stemming in IR has been shown to often improve the effectiveness of keyword-matching models such as BM25. However, traditional stemming methods, focusing solely on individual terms, overlook the richness of contextual information. Recognizing this gap, in this paper, we investigate the promising idea of using large language models (LLMs) to stem words by leveraging its capability of context understanding. With this respect, we identify three avenues, each characterised by different trade-offs in terms of computational cost, effectiveness and robustness : (1) use LLMs to stem the vocabulary for a collection, i.e., the set of unique words that appear in the collection (vocabulary stemming), (2) use LLMs to stem each document separately (contextual stemming), and (3) use LLMs to extract from each document entities that should not be stemmed, then use vocabulary stemming to stem the rest of the terms (entity-based contextual stemming). Through a series of empirical experiments, we compare the use of LLMs for stemming with that of traditional lexical stemmers such as Porter and Krovetz for English text. We find that while vocabulary stemming and contextual stemming fail to achieve higher effectiveness than traditional stemmers, entity-based contextual stemming can achieve a higher effectiveness than using Porter stemmer alone, under specific conditions.


title: Conformally rigid graphs

abstract: Given a finite, simple, connected graph $G=(V,E)$ with $|V|=n$, we consider the associated graph Laplacian matrix $L = D - A$ with eigenvalues $0 = \lambda_1 < \lambda_2 \leq \dots \leq \lambda_n$. One can also consider the same graph equipped with positive edge weights $w:E \rightarrow \mathbb{R}_{> 0}$ normalized to $\sum_{e \in E} w_e = |E|$ and the associated weighted Laplacian matrix $L_w$. We say that $G$ is conformally rigid if constant edge-weights maximize the second eigenvalue $\lambda_2(w)$ of $L_w$ over all $w$, and minimize $\lambda_n(w')$ of $L_{w'}$ over all $w'$, i.e., for all $w,w'$, $$ \lambda_2(w) \leq \lambda_2(1) \leq \lambda_n(1) \leq \lambda_n(w').$$ Conformal rigidity requires an extraordinary amount of symmetry in $G$. Every edge-transitive graph is conformally rigid. We prove that every distance-regular graph, and hence every strongly-regular graph, is conformally rigid. Certain special graph embeddings can be used to characterize conformal rigidity. Cayley graphs can be conformally rigid but need not be, we prove a sufficient criterion. We also find a small set of conformally rigid graphs that do not belong into any of the above categories; these include the Hoffman graph, the crossing number graph 6B and others. Conformal rigidity can be certified via semidefinite programming, we provide explicit examples.


title: Lattice QCD and Baryon-Baryon Interactions

abstract: In this chapter, the current status on baryon-baryon interactions such as nuclear forces in lattice Quantum ChromoDynamics (QCD) is reviewed. In studies of baryon-baryon interactions in lattice QCD, the most reliable method so far is the potential method, proposed by the Hadrons to Atomic nuclei from Lattice QCD (HAL QCD) collaboration, whose formulation, properties and extensions are explained in detail. Using the HAL QCD potential method, potentials between nucleons (proton and neutron, denoted by $N$) in the derivative expansion have been extracted in various cases. The lattice QCD results shown in this chapter include a Leading Order (LO) central potential in the parity-even $NN(^1S_0)$ channel, LO central and tensor potentials in the parity-even $NN(^3S_1$-$^3D_1)$ channel, and a Next-to-Leading Order (NLO) spin-orbit potential as well as LO potentials in the parity-odd channels. Preliminary results at the almost physical pion and kaon masses, in addition to exploratory studies on three-nucleon potentials, are presented. Interactions between generic baryons including hyperons, made of one or more strange quarks as well as up and down quarks, have also been investigated. Universal properties of potentials between baryons become manifest in the flavor SU(3) symmetric limit, where masses of three quarks, up, down and strange, are all equal. In particular, it is observed that one bound state, traditionally called the $H$-dibaryon, appears in the flavor singlet representation of SU(3). A fate of the $H$ dibaryon is also discussed with flavor SU(3) breaking taken into account at the almost physical point. Finally, various kinds of dibaryons, bound or resonate states of two baryons, including charmed dibaryons, have been predicted by lattice QCD simulations at the almost physical point.


title: Reinforcement Learning as a Parsimonious Alternative to Prediction Cascades: A Case Study on Image Segmentation

abstract: Deep learning architectures have achieved state-of-the-art (SOTA) performance on computer vision tasks such as object detection and image segmentation. This may be attributed to the use of over-parameterized, monolithic deep learning architectures executed on large datasets. Although such architectures lead to increased accuracy, this is usually accompanied by a large increase in computation and memory requirements during inference. While this is a non-issue in traditional machine learning pipelines, the recent confluence of machine learning and fields like the Internet of Things has rendered such large architectures infeasible for execution in low-resource settings. In such settings, previous efforts have proposed decision cascades where inputs are passed through models of increasing complexity until desired performance is achieved. However, we argue that cascaded prediction leads to increased computational cost due to wasteful intermediate computations. To address this, we propose PaSeR (Parsimonious Segmentation with Reinforcement Learning) a non-cascading, cost-aware learning pipeline as an alternative to cascaded architectures. Through experimental evaluation on real-world and standard datasets, we demonstrate that PaSeR achieves better accuracy while minimizing computational cost relative to cascaded models. Further, we introduce a new metric IoU/GigaFlop to evaluate the balance between cost and performance. On the real-world task of battery material phase segmentation, PaSeR yields a minimum performance improvement of 174% on the IoU/GigaFlop metric with respect to baselines. We also demonstrate PaSeR's adaptability to complementary models trained on a noisy MNIST dataset, where it achieved a minimum performance improvement on IoU/GigaFlop of 13.4% over SOTA models. Code and data are available at https://github.com/scailab/paser .


title: The number of automorphic representations of $\mathrm{GL}_2$ with exceptional eigenvalues

abstract: We obtain an upper bound for the dimension of the cuspidal automorphic forms for $\mathrm{GL}_2$ over a number field, whose archimedean local representations are not tempered. More precisely, we prove the following result. Let $F$ be a number field and $\mathbb{A}_{F}$ be the ring of adeles of $F$. Let $\mathcal{O}_{F}$ be the ring of integers of $F$. Let $\mathfrak{X}_{F,\mathrm{ex}}$ be the set of irreducible cuspidal automorphic representations $\pi$ of $\mathrm{GL}_2(\mathbb{A}_{F})$ with the trivial central character such that for each archimedean place $v$ of $F$, the local representation of $\pi$ at $v$ is an unramified principal series and is not tempered. For an ideal $J$ of $\mathcal{O}_{F}$, let $\mathrm{K}_{0}(J)$ be the subgroup of $\mathrm{GL}_2(\mathbb{A}_{F})$ corresponding to $\Gamma_0(J) \subset \mathrm{SL}_2(\mathcal{O}_F)$. Let $r_1$ be the number of real embeddings of $F$ and $r_2$ be the number of conjugate pairs of complex embeddings of $F$. Using the Arthur-Selberg trace formula, we have \begin{equation*} \sum_{\pi\in \mathfrak{X}_{F,\mathrm{ex}}} \dim \pi^{\mathrm{K}_0(J)} \ll_{F} \frac{[\mathrm{SL}_2(\mathcal{O}_{F}) : \Gamma_0(J)]}{(\log (N_{F/\mathbb{Q}}(J)))^{2r_1+3r_2}} \quad \text{ as } \quad |N_{F/\mathbb{Q}}(J)|\to \infty. \end{equation*} From this result, we obtain the result on an upper bound for the number of Hecke-Maass cusp forms of weight $0$ on $\Gamma_0(N)$ which do not satisfy the Selberg eigenvalue conjecture.


title: Effective Kinetics of Chemical Reaction Networks

abstract: Chemical reaction network theory is a powerful framework to describe and analyze chemical systems. While much about the concentration profile in an equilibrium state can be determined in terms of the graph structure, the overall reaction's time evolution depends on the network's kinetic rate function. In this article, we consider the problem of the effective kinetics of a chemical reaction network regarded as a conversion system from the feeding species to products. We define the notion of effective kinetics as a partial solution of a system of non-autonomous ordinary differential equations determined from a chemical reaction network. Examples of actual calculations include the Michaelis-Menten mechanism, for which it is confirmed that our notion of effective kinetics yields the classical formula. Further, we introduce the notion of straight-line solutions of non-autonomous ordinary differential equations to formalize the situation where a well-defined reaction rate exists and consider its relation with the quasi-stationary state approximation used in microkinetics. Our considerations here give a unified framework to formulate the reaction rate of chemical reaction networks.


title: Autonomous Hyperspectral Characterisation Station: Robotically Assisted Characterisation of Polymer Degradation

abstract: This paper addresses the gap between the capabilities and utilisation of robotics and automation in laboratory settings and builds upon the concept of Self Driving Labs (SDL). %to significantly impact laboratory operations. We introduce an innovative approach to the temporal characterisation of materials. The article discusses the challenges posed by manual methods involving established laboratory equipment and presents an automated hyperspectral characterisation station. This station integrates robot-aided hyperspectral imaging, complex material characterisation modeling, and automated data analysis, offering a non-destructive and comprehensive approach. This work explains how the proposed assembly can automatically measure the half-life of biodegradable polymers with higher throughput and accuracy than manual methods. The investigation explores the effect of pH, number of average molecular weight (Mn), end groups, and blends on the degradation rate of polylactic acid (PLA). The contributions of the paper lie in introducing an adaptable classification station for novel characterisation methods and presenting an innovative methodology for polymer degradation rate measurement. The proposed system has the potential to accelerate the development of high-throughput screening and characterisation methods in material and chemistry laboratories.


title: ChatGPT Based Data Augmentation for Improved Parameter-Efficient Debiasing of LLMs

abstract: Large Language models (LLMs), while powerful, exhibit harmful social biases. Debiasing is often challenging due to computational costs, data constraints, and potential degradation of multi-task language capabilities. This work introduces a novel approach utilizing ChatGPT to generate synthetic training data, aiming to enhance the debiasing of LLMs. We propose two strategies: Targeted Prompting, which provides effective debiasing for known biases but necessitates prior specification of bias in question; and General Prompting, which, while slightly less effective, offers debiasing across various categories. We leverage resource-efficient LLM debiasing using adapter tuning and compare the effectiveness of our synthetic data to existing debiasing datasets. Our results reveal that: (1) ChatGPT can efficiently produce high-quality training data for debiasing other LLMs; (2) data produced via our approach surpasses existing datasets in debiasing performance while also preserving internal knowledge of a pre-trained LLM; and (3) synthetic data exhibits generalizability across categories, effectively mitigating various biases, including intersectional ones. These findings underscore the potential of synthetic data in advancing the fairness of LLMs with minimal retraining cost.


title: Guide to Numerical Experiments on Elections in Computational Social Choice

abstract: We analyze how numerical experiments regarding elections were conducted within the computational social choice literature (focusing on papers published in the IJCAI, AAAI, and AAMAS conferences). We analyze the sizes of the studied elections and the methods used for generating preference data, thereby making previously hidden standards and practices explicit. In particular, we survey a number of statistical cultures for generating elections and their commonly used parameters.


title: Well-Connected Set and Its Application to Multi-Robot Path Planning

abstract: Parking lots and autonomous warehouses for accommodating many vehicles/robots adopt designs in which the underlying graphs are \emph{well-connected} to simplify planning and reduce congestion. In this study, we formulate and delve into the \emph{largest well-connected set} (LWCS) problem and explore its applications in layout design for multi-robot path planning. Roughly speaking, a well-connected set over a connected graph is a set of vertices such that there is a path on the graph connecting any pair of vertices in the set without passing through any additional vertices of the set. Identifying an LWCS has many potential high-utility applications, e.g., for determining parking garage layout and capacity, as prioritized planning can be shown to be complete when start/goal configurations belong to an LWCS. In this work, we establish that computing an LWCS is NP-complete. We further develop optimal and near-optimal LWCS algorithms, with the near-optimal algorithm targeting large maps. A complete prioritized planning method is given for planning paths for multiple robots residing on an LWCS.


title: Decentralized Lifelong Path Planning for Multiple Ackerman Car-Like Robots

abstract: Path planning for multiple non-holonomic robots in continuous domains constitutes a difficult robotics challenge with many applications. Despite significant recent progress on the topic, computationally efficient and high-quality solutions are lacking, especially in lifelong settings where robots must continuously take on new tasks. In this work, we make it possible to extend key ideas enabling state-of-the-art (SOTA) methods for multi-robot planning in discrete domains to the motion planning of multiple Ackerman (car-like) robots in lifelong settings, yielding high-performance centralized and decentralized planners. Our planners compute trajectories that allow the robots to reach precise $SE(2)$ goal poses. The effectiveness of our methods is thoroughly evaluated and confirmed using both simulation and real-world experiments.


title: Targeted Parallelization of Conflict-Based Search for Multi-Robot Path Planning

abstract: Multi-Robot Path Planning (MRPP) on graphs, equivalently known as Multi-Agent Path Finding (MAPF), is a well-established NP-hard problem with critically important applications. As serial computation in (near)-optimally solving MRPP approaches the computation efficiency limit, parallelization offers a promising route to push the limit further, especially in handling hard or large MRPP instances. In this study, we initiated a \emph{targeted} parallelization effort to boost the performance of conflict-based search for MRPP. Specifically, when instances are relatively small but robots are densely packed with strong interactions, we apply a decentralized parallel algorithm that concurrently explores multiple branches that leads to markedly enhanced solution discovery. On the other hand, when instances are large with sparse robot-robot interactions, we prioritize node expansion and conflict resolution. Our innovative multi-threaded approach to parallelizing bounded-suboptimal conflict search-based algorithms demonstrates significant improvements over baseline serial methods in success rate or runtime. Our contribution further pushes the understanding of MRPP and charts a promising path for elevating solution quality and computational efficiency through parallel algorithmic strategies.


title: Connection-Aware P2P Trading: Simultaneous Trading and Peer Selection

abstract: Peer-to-peer (P2P) trading is seen as a viable solution to handle the growing number of distributed energy resources in distribution networks. However, when dealing with large-scale consumers, there are several challenges that must be addressed. One of these challenges is limited communication capabilities. Additionally, prosumers may have specific preferences when it comes to trading. Both can result in serious asynchrony in peer-to-peer trading, potentially impacting the effectiveness of negotiations and hindering convergence before the market closes. This paper introduces a connection-aware P2P trading algorithm designed for extensive prosumer trading. The algorithm facilitates asynchronous trading while respecting prosumer's autonomy in trading peer selection, an often overlooked aspect in traditional models. In addition, to optimize the use of limited connection opportunities, a smart trading peer connection selection strategy is developed to guide consumers to communicate strategically to accelerate convergence. A theoretical convergence guarantee is provided for the connection-aware P2P trading algorithm, which further details how smart selection strategies enhance convergence efficiency. Numerical studies are carried out to validate the effectiveness of the connection-aware algorithm and the performance of smart selection strategies in reducing the overall convergence time.


title: Structured Chain-of-Thought Prompting for Few-Shot Generation of Content-Grounded QA Conversations

abstract: We introduce a structured chain-of-thought (SCoT) prompting approach to generating content-grounded multi-turn question-answer conversations using a pre-trained large language model (LLM). At the core of our proposal is a structured breakdown of the complex task into a number of states in a state machine, so that actions corresponding to various subtasks, e.g., content reading and utterance generation, can be executed in their own dedicated states. Each state leverages a unique set of resources including prompts and (optionally) additional tools to augment the generation process. Our experimental results show that SCoT prompting with designated states for hallucination mitigation increases agent faithfulness to grounding documents by up to 16.8%. When used as training data, our open-domain conversations synthesized from only 6 Wikipedia-based seed demonstrations train strong conversational QA agents; in out-of-domain evaluation, for example, we observe improvements of up to 13.9% over target domain gold data when the latter is augmented with our generated examples.


title: Evaluating the Effectiveness of Index-Based Treatment Allocation

abstract: When resources are scarce, an allocation policy is needed to decide who receives a resource. This problem occurs, for instance, when allocating scarce medical resources and is often solved using modern ML methods. This paper introduces methods to evaluate index-based allocation policies -- that allocate a fixed number of resources to those who need them the most -- by using data from a randomized control trial. Such policies create dependencies between agents, which render the assumptions behind standard statistical tests invalid and limit the effectiveness of estimators. Addressing these challenges, we translate and extend recent ideas from the statistics literature to present an efficient estimator and methods for computing asymptotically correct confidence intervals. This enables us to effectively draw valid statistical conclusions, a critical gap in previous work. Our extensive experiments validate our methodology in practical settings, while also showcasing its statistical power. We conclude by proposing and empirically verifying extensions of our methodology that enable us to reevaluate a past randomized control trial to evaluate different ML allocation policies in the context of a mHealth program, drawing previously invisible conclusions.


title: Kerr optical frequency division with integrated photonics for stable microwave and mmWave generation

abstract: Optical frequency division (OFD) has revolutionized microwave and mmWave generation and set spectral purity records owing to its unique capability to transfer high fractional stability from optical to electronic frequencies. Recently, rapid developments in integrated optical reference cavities and microresonator-based optical frequency combs (microcombs) have created a path to transform OFD technology to chip scale. Here, we demonstrate an ultra-low phase noise mmWave oscillator by leveraging integrated photonic components and Kerr optical frequency division. The oscillator derives its stability from an integrated CMOS-compatible SiN coil cavity, and the optical frequency division is achieved spontaneously through Kerr interaction between the injected reference lasers and soliton microcombs in the integrated SiN microresonator. Besides achieving record-low phase noise for integrated mmWave oscillators, our demonstration greatly simplifies the implementation of integrated OFD oscillators and could be useful in applications of Radar, spectroscopy, and astronomy.


title: Dynamic Multi-Network Mining of Tensor Time Series

abstract: Subsequence clustering of time series is an essential task in data mining, and interpreting the resulting clusters is also crucial since we generally do not have prior knowledge of the data. Thus, given a large collection of tensor time series consisting of multiple modes, including timestamps, how can we achieve subsequence clustering for tensor time series and provide interpretable insights? In this paper, we propose a new method, Dynamic Multi-network Mining (DMM), that converts a tensor time series into a set of segment groups of various lengths (i.e., clusters) characterized by a dependency network constrained with l1-norm. Our method has the following properties. (a) Interpretable: it characterizes the cluster with multiple networks, each of which is a sparse dependency network of a corresponding non-temporal mode, and thus provides visible and interpretable insights into the key relationships. (b) Accurate: it discovers the clusters with distinct networks from tensor time series according to the minimum description length (MDL). (c) Scalable: it scales linearly in terms of the input data size when solving a non-convex problem to optimize the number of segments and clusters, and thus it is applicable to long-range and high-dimensional tensors. Extensive experiments with synthetic datasets confirm that our method outperforms the state-of-the-art methods in terms of clustering accuracy. We then use real datasets to demonstrate that DMM is useful for providing interpretable insights from tensor time series.


title: Network topology mapping of Chemical Compounds Space

abstract: We define bipartite and monopartite relational networks of chemical elements and compounds using two different datasets of inorganic chemical and material compounds, as well as study their topology. We discover that the connectivity between elements and compounds is distributed exponentially for materials, and with a fat tail for chemicals. Compounds networks show similar distribution of degrees, and feature a highly-connected club due to oxygen. Chemical compounds networks appear more modular than material ones, while the communities detected reveal different dominant elements specific to the topology. We successfully reproduce the connectivity of the empirical chemicals and materials networks by using a family of fitness models, where the fitness values are derived from the abundances of the elements in the aggregate compound data. Our results pave the way towards a relational network-based understanding of the inherent complexity of the vast chemical knowledge atlas, and our methodology can be applied to other systems with the ingredient-composite structure.


title: FOD-Swin-Net: angular super resolution of fiber orientation distribution using a transformer-based deep model

abstract: Identifying and characterizing brain fiber bundles can help to understand many diseases and conditions. An important step in this process is the estimation of fiber orientations using Diffusion-Weighted Magnetic Resonance Imaging (DW-MRI). However, obtaining robust orientation estimates demands high-resolution data, leading to lengthy acquisitions that are not always clinically available. In this work, we explore the use of automated angular super resolution from faster acquisitions to overcome this challenge. Using the publicly available Human Connectome Project (HCP) DW-MRI data, we trained a transformer-based deep learning architecture to achieve angular super resolution in fiber orientation distribution (FOD). Our patch-based methodology, FOD-Swin-Net, is able to bring a single-shell reconstruction driven from 32 directions to be comparable to a multi-shell 288 direction FOD reconstruction, greatly reducing the number of required directions on initial acquisition. Evaluations of the reconstructed FOD with Angular Correlation Coefficient and qualitative visualizations reveal superior performance than the state-of-the-art in HCP testing data. Open source code for reproducibility is available at https://github.com/MICLab-Unicamp/FOD-Swin-Net.


title: Early feasibility of an embedded bi-directional brain-computer interface for ambulation

abstract: Current treatments for paraplegia induced by spinal cord injury (SCI) are often limited by the severity of the injury. The accompanying loss of sensory and motor functions often results in reliance on wheelchairs, which in turn causes reduced quality of life and increased risk of co-morbidities. While brain-computer interfaces (BCIs) for ambulation have shown promise in restoring or replacing lower extremity motor functions, none so far have simultaneously implemented sensory feedback functions. Additionally, many existing BCIs for ambulation rely on bulky external hardware that make them ill-suited for non-research settings. Here, we present an embedded bi-directional BCI (BDBCI), that restores motor function by enabling neural control over a robotic gait exoskeleton (RGE) and delivers sensory feedback via direct cortical electrical stimulation (DCES) in response to RGE leg swing. A first demonstration with this system was performed with a single subject implanted with electrocorticography electrodes, achieving an average lag-optimized cross-correlation of 0.80$\pm$0.08 between cues and decoded states over 5 runs.


title: Uncovering Latent Human Wellbeing in Language Model Embeddings

abstract: Do language models implicitly learn a concept of human wellbeing? We explore this through the ETHICS Utilitarianism task, assessing if scaling enhances pretrained models' representations. Our initial finding reveals that, without any prompt engineering or finetuning, the leading principal component from OpenAI's text-embedding-ada-002 achieves 73.9% accuracy. This closely matches the 74.6% of BERT-large finetuned on the entire ETHICS dataset, suggesting pretraining conveys some understanding about human wellbeing. Next, we consider four language model families, observing how Utilitarianism accuracy varies with increased parameters. We find performance is nondecreasing with increased model size when using sufficient numbers of principal components.


title: Towards Theoretical Understandings of Self-Consuming Generative Models

abstract: This paper tackles the emerging challenge of training generative models within a self-consuming loop, wherein successive generations of models are recursively trained on mixtures of real and synthetic data from previous generations. We construct a theoretical framework to rigorously evaluate how this training procedure impacts the data distributions learned by future models, including parametric and non-parametric models. Specifically, we derive bounds on the total variation (TV) distance between the synthetic data distributions produced by future models and the original real data distribution under various mixed training scenarios for diffusion models with a one-hidden-layer neural network score function. Our analysis demonstrates that this distance can be effectively controlled under the condition that mixed training dataset sizes or proportions of real data are large enough. Interestingly, we further unveil a phase transition induced by expanding synthetic data amounts, proving theoretically that while the TV distance exhibits an initial ascent, it declines beyond a threshold point. Finally, we present results for kernel density estimation, delivering nuanced insights such as the impact of mixed data training on error propagation.


title: Affine manifolds: The differential geometry of the multi-dimensionally consistent TED equation

abstract: It is shown that a canonical geometric setting of the integrable TED equation is a Kahlerian tangent bundle of an affine manifold. The remarkable multi-dimensional consistency of this 4+4-dimensional dispersionless partial differential equation arises naturally in this context. In a particular 4-dimensional reduction, the affine manifolds turn out to be self-dual Einstein spaces of neutral signature governed by Plebanski's first heavenly equation. In another reduction, the affine manifolds are Hessian, governed by compatible general heavenly equations. The Legendre invariance of the latter gives rise to a (dual) Hessian structure. Foliations of affine manifolds in terms of self-dual Einstein spaces are also shown to arise in connection with a natural 5-dimensional reduction.


title: CiMNet: Towards Joint Optimization for DNN Architecture and Configuration for Compute-In-Memory Hardware

abstract: With the recent growth in demand for large-scale deep neural networks, compute in-memory (CiM) has come up as a prominent solution to alleviate bandwidth and on-chip interconnect bottlenecks that constrain Von-Neuman architectures. However, the construction of CiM hardware poses a challenge as any specific memory hierarchy in terms of cache sizes and memory bandwidth at different interfaces may not be ideally matched to any neural network's attributes such as tensor dimension and arithmetic intensity, thus leading to suboptimal and under-performing systems. Despite the success of neural architecture search (NAS) techniques in yielding efficient sub-networks for a given hardware metric budget (e.g., DNN execution time or latency), it assumes the hardware configuration to be frozen, often yielding sub-optimal sub-networks for a given budget. In this paper, we present CiMNet, a framework that jointly searches for optimal sub-networks and hardware configurations for CiM architectures creating a Pareto optimal frontier of downstream task accuracy and execution metrics (e.g., latency). The proposed framework can comprehend the complex interplay between a sub-network's performance and the CiM hardware configuration choices including bandwidth, processing element size, and memory size. Exhaustive experiments on different model architectures from both CNN and Transformer families demonstrate the efficacy of the CiMNet in finding co-optimized sub-networks and CiM hardware configurations. Specifically, for similar ImageNet classification accuracy as baseline ViT-B, optimizing only the model architecture increases performance (or reduces workload execution time) by 1.7x while optimizing for both the model architecture and hardware configuration increases it by 3.1x.


title: High-entropy alloy TiV2ZrCrMnFeNi for hydrogen storage at room temperature with full reversibility and good activation

abstract: The development of alloys that are hydrogenated and dehydrogenated quickly and actively at room temperature is a challenge for the safe and compact storage of hydrogen. In this study, a new high-entropy alloy (HEA) with AB-type configuration (A: hydride-forming elements, B: inert-to-hydrogen elements) was designed by considering valence electron concentration, electronegativity difference and atomic-size mismatch of elements. The alloy TiV2ZrCrMnFeNi had dual C14 Laves and BCC phases, in which C14 stored hydrogen and BCC/C14 interphase boundaries contributed to activation. The alloy absorbed 1.6 wt% of hydrogen at room temperature without any activation treatment and exhibited fast kinetics and full reversibility.


title: What Evidence Do Language Models Find Convincing?

abstract: Retrieval-augmented language models are being increasingly tasked with subjective, contentious, and conflicting queries such as "is aspartame linked to cancer". To resolve these ambiguous queries, one must search through a large range of websites and consider "which, if any, of this evidence do I find convincing?". In this work, we study how LLMs answer this question. In particular, we construct ConflictingQA, a dataset that pairs controversial queries with a series of real-world evidence documents that contain different facts (e.g., quantitative results), argument styles (e.g., appeals to authority), and answers (Yes or No). We use this dataset to perform sensitivity and counterfactual analyses to explore which text features most affect LLM predictions. Overall, we find that current models rely heavily on the relevance of a website to the query, while largely ignoring stylistic features that humans find important such as whether a text contains scientific references or is written with a neutral tone. Taken together, these results highlight the importance of RAG corpus quality (e.g., the need to filter misinformation), and possibly even a shift in how LLMs are trained to better align with human judgements.


title: Spatiotemporal Control of Ultrafast Pulses in Multimode Optical Fibers

abstract: Multimode optical fibers represent the ideal platform for transferring multidimensional light states. However, dispersion degrades the correlations between the light's degrees of freedom, thus limiting the effective transport of ultrashort pulses between distant nodes of optical networks. Here, we demonstrate that tailoring the spatiotemporal structure of ultrashort light pulses can overcome the physical limitations imposed by both chromatic and modal dispersion in multimode optical fibers. We synthesize these light states with predefined spatial and chromatic dynamics through applying a sequence of transformations to shape the optical field in all its dimensions. Similar methods can also be used to overcome dispersion processes in other physical settings like acoustics and electron optics. Our results will enable advancements in laser-based technologies, including multimode optical communications, imaging, ultrafast light-matter interactions, and high brightness fiber sources.


title: Significance of interphase boundaries on activation of high-entropy alloys for room-temperature hydrogen storage

abstract: The ability of high-entropy alloys (HEAs) for hydrogen storage is a rather new topic in the hydrogen community. HEAs with the C14 Laves phase have shown a high potential to reversibly store hydrogen at room temperature, but most of these alloys require a high-temperature activation treatment. This study explores the role of interphase boundaries on the easy activation of HEAs at room temperature. Two chemically similar HEAs with single and dual phases, TiV1.5ZrCr0.5MnFeNi (C14 + 4 vol% BCC phases) and TiV1.5Zr1.5CrMnFeNi (single C14 phase), are designed and synthesized. While the dual-phase alloy readily absorbs hydrogen at room temperature without any activation treatment, the single-phase alloy requires a high-temperature activation. It is suggested that interphase boundaries not only provide pathways for easy hydrogen transport and activation of HEAs at room temperature but also act as active sites for heterogeneous nucleation of hydride. This study introduces interphase-boundary generation as an effective strategy to address the activation drawback of HEAs.


title: The construction of multiqubit unextendible product bases

abstract: The unextendible orthogonal matrices (UPBs) can be used for various problems in quantum information. We provide an algorithm to check if two UPBs are non-equivalent to each other. We give a method to construct UPBs and we apply this method to find all $5$-qubit UPBs of size eight. We apply the algorithm to check if the $5$-qubit UPBs of size eight are non-equivalent to each other. Based on all the $5$-qubit UPBs of size eight, we propose a theorem for constructing a new UPB non-equivalent to a given one.


title: Near-coherent quantum emitters in hexagonal boron nitride with discrete polarization axes

abstract: Hexagonal boron nitride (hBN) has recently gained attention as a solid state host of quantum emitters. However, hBN emitters reported to date lack the properties needed for their deployment in scalable quantum technologies. Here we employ spectral hole burning spectroscopy and resonant polarization measurements to observe nearly-coherent hBN quantum emitters, both as singles and in ensembles, with three discrete polarization axes indicative of a C2v symmetry defect. Our results constitute an important milestone towards the implementation of hBN quantum emitters in integrated quantum photonics.


title: Spherical two-distance sets and graph eigenvalues

abstract: Let $N_{\alpha,\beta}(d)$ denote the maximum size of a spherical two-distance set in $\mathbb{R}^d$ such that the inner products of distinct vectors only take $\alpha$ and $\beta$. By considering the correspondence between spherical two-distance sets and graphs with specific spectral properties, we determine $N_{\alpha,\beta}(d)$ for fixed $-1\leq\beta<0\leq\alpha<1$ and sufficiently large $d$, which extends the work in [Equiangular lines with a fixed angle, Ann. Math. 194 (2021) 729-743] and [Spherical two-distance sets and eigenvalues of signed graphs, Combinatorica 43 (2023) 203-232]. The limit $\lim_{d\rightarrow\infty}N_{\alpha,\beta}(d)/d$ is also derived from our work, that is, the problem of determining $\lim_{d\rightarrow\infty}N_{\alpha,\beta}(d)/d$ for any fixed $-1\leq\beta<0\leq\alpha<1$ is completely solved in the spherical $\{\alpha,\beta\}$-code setting.


title: MM-SurvNet: Deep Learning-Based Survival Risk Stratification in Breast Cancer Through Multimodal Data Fusion

abstract: Survival risk stratification is an important step in clinical decision making for breast cancer management. We propose a novel deep learning approach for this purpose by integrating histopathological imaging, genetic and clinical data. It employs vision transformers, specifically the MaxViT model, for image feature extraction, and self-attention to capture intricate image relationships at the patient level. A dual cross-attention mechanism fuses these features with genetic data, while clinical data is incorporated at the final layer to enhance predictive accuracy. Experiments on the public TCGA-BRCA dataset show that our model, trained using the negative log likelihood loss function, can achieve superior performance with a mean C-index of 0.64, surpassing existing methods. This advancement facilitates tailored treatment strategies, potentially leading to improved patient outcomes.


title: Statistical Test for Generated Hypotheses by Diffusion Models

abstract: The enhanced performance of AI has accelerated its integration into scientific research. In particular, the use of generative AI to create scientific hypotheses is promising and is increasingly being applied across various fields. However, when employing AI-generated hypotheses for critical decisions, such as medical diagnoses, verifying their reliability is crucial. In this study, we consider a medical diagnostic task using generated images by diffusion models, and propose a statistical test to quantify its reliability. The basic idea behind the proposed statistical test is to employ a selective inference framework, where we consider a statistical test conditional on the fact that the generated images are produced by a trained diffusion model. Using the proposed method, the statistical reliability of medical image diagnostic results can be quantified in the form of a p-value, allowing for decision-making with a controlled error rate. We show the theoretical validity of the proposed statistical test and its effectiveness through numerical experiments on synthetic and brain image datasets.


title: CoLRIO: LiDAR-Ranging-Inertial Centralized State Estimation for Robotic Swarms

abstract: Collaborative state estimation using different heterogeneous sensors is a fundamental prerequisite for robotic swarms operating in GPS-denied environments, posing a significant research challenge. In this paper, we introduce a centralized system to facilitate collaborative LiDAR-ranging-inertial state estimation, enabling robotic swarms to operate without the need for anchor deployment. The system efficiently distributes computationally intensive tasks to a central server, thereby reducing the computational burden on individual robots for local odometry calculations. The server back-end establishes a global reference by leveraging shared data and refining joint pose graph optimization through place recognition, global optimization techniques, and removal of outlier data to ensure precise and robust collaborative state estimation. Extensive evaluations of our system, utilizing both publicly available datasets and our custom datasets, demonstrate significant enhancements in the accuracy of collaborative SLAM estimates. Moreover, our system exhibits remarkable proficiency in large-scale missions, seamlessly enabling ten robots to collaborate effectively in performing SLAM tasks. In order to contribute to the research community, we will make our code open-source and accessible at \url{https://github.com/PengYu-team/Co-LRIO}.


title: SDGE: Stereo Guided Depth Estimation for 360$^\circ$ Camera Sets

abstract: Depth estimation is a critical technology in autonomous driving, and multi-camera systems are often used to achieve a 360$^\circ$ perception. These 360$^\circ$ camera sets often have limited or low-quality overlap regions, making multi-view stereo methods infeasible for the entire image. Alternatively, monocular methods may not produce consistent cross-view predictions. To address these issues, we propose the Stereo Guided Depth Estimation (SGDE) method, which enhances depth estimation of the full image by explicitly utilizing multi-view stereo results on the overlap. We suggest building virtual pinhole cameras to resolve the distortion problem of fisheye cameras and unify the processing for the two types of 360$^\circ$ cameras. For handling the varying noise on camera poses caused by unstable movement, the approach employs a self-calibration method to obtain highly accurate relative poses of the adjacent cameras with minor overlap. These enable the use of robust stereo methods to obtain high-quality depth prior in the overlap region. This prior serves not only as an additional input but also as pseudo-labels that enhance the accuracy of depth estimation methods and improve cross-view prediction consistency. The effectiveness of SGDE is evaluated on one fisheye camera dataset, Synthetic Urban, and two pinhole camera datasets, DDAD and nuScenes. Our experiments demonstrate that SGDE is effective for both supervised and self-supervised depth estimation, and highlight the potential of our method for advancing downstream autonomous driving technologies, such as 3D object detection and occupancy prediction.


title: SInViG: A Self-Evolving Interactive Visual Agent for Human-Robot Interaction

abstract: Linguistic ambiguity is ubiquitous in our daily lives. Previous works adopted interaction between robots and humans for language disambiguation. Nevertheless, when interactive robots are deployed in daily environments, there are significant challenges for natural human-robot interaction, stemming from complex and unpredictable visual inputs, open-ended interaction, and diverse user demands. In this paper, we present SInViG, which is a self-evolving interactive visual agent for human-robot interaction based on natural languages, aiming to resolve language ambiguity, if any, through multi-turn visual-language dialogues. It continuously and automatically learns from unlabeled images and large language models, without human intervention, to be more robust against visual and linguistic complexity. Benefiting from self-evolving, it sets new state-of-the-art on several interactive visual grounding benchmarks. Moreover, our human-robot interaction experiments show that the evolved models consistently acquire more and more preferences from human users. Besides, we also deployed our model on a Franka robot for interactive manipulation tasks. Results demonstrate that our model can follow diverse user instructions and interact naturally with humans in natural language, despite the complexity and disturbance of the environment.