title: On the contact conditions for the density and charge profiles in the theory of electrical double layer: From planar to spherical and cylindrical geometry

abstract: In this paper, starting from the Bogoliubov-Born-Green-Yvon equations of the liquid-state theory, we formulate two equivalent approaches for the calculation of the total density profile and of the charge density profile of ionic fluids near nonplanar charged surfaces. In the framework of these approaches, we establish exact conditions, that a particular point of these profiles should satisfy, in the form of contact theorems. These contact theorems for the total density profile and the charge density profile are obtained by direct integration of a system of equations derived from the Bogoliubov-Born-Green-Yvon equations. The contact theorems for both profiles have nonlocal character. It is shown that the contact value of the total density profile for uncharged surfaces is characterized by the bulk pressure and the surface tension. The contact theorems are applied to the cases of spherical and cylindrical surfaces. It is shown that the contact theorem for the total density profile coincides with the recent results obtained by W. Silvester-Alcantara, D. Henderson and L.B. Bhuiyan Mol. Phys., 113, 3403, 2015


title: The nullity of the net Laplacian matrix of a signed graph

abstract: Let $\Gamma = (G, \sigma)$ be a signed graph, where $G = (V(G),E(G))$ is an (unsigned) graph, called the underlying graph. The net Laplacian matrix of $\Gamma$ is defined as $L^{\pm}(\Gamma) = D^{\pm}(\Gamma) - A(\Gamma)$, where $D^{\pm}(\Gamma)$ and $A(\Gamma)$ are the diagonal matrix of net-degrees and the adjacency matrix of $\Gamma$, respectively. The nullity of $L^{\pm}(\Gamma)$, written as $ \eta (L^{\pm} (\Gamma))$, is the multiplicity of 0 as an eigenvalue of $L^{\pm}(\Gamma)$. In this paper, we focus our attention on the nullity of the net Laplacian matrix of a connected signed graph $\Gamma$ and prove that $1 \leq \eta (L^{\pm} (\Gamma)) \leq min\{ \beta(\Gamma) + 1, |V(\Gamma)| - 1 \}$, where $\beta(\Gamma) = |E(\Gamma)| - |V(\Gamma)| + 1$ is the cyclomatic number of $\Gamma$. The connected signed graphs with nullity $|V(\Gamma)| - 1$ are completely determined. Moreover, we characterize the signed cactus graphs with nullity $1$ or $\beta(\Gamma) + 1$


title: A Theoretical Approach to Characterize the Accuracy-Fairness Trade-off Pareto Frontier

abstract: While the accuracy-fairness trade-off has been frequently observed in the literature of fair machine learning, rigorous theoretical analyses have been scarce. To demystify this long-standing challenge, this work seeks to develop a theoretical framework by characterizing the shape of the accuracy-fairness trade-off Pareto frontier (FairFrontier), determined by a set of all optimal Pareto classifiers that no other classifiers can dominate. Specifically, we first demonstrate the existence of the trade-off in real-world scenarios and then propose four potential categories to characterize the important properties of the accuracy-fairness Pareto frontier. For each category, we identify the necessary conditions that lead to corresponding trade-offs. Experimental results on synthetic data suggest insightful findings of the proposed framework: (1) When sensitive attributes can be fully interpreted by non-sensitive attributes, FairFrontier is mostly continuous. (2) Accuracy can suffer a \textit{sharp} decline when over-pursuing fairness. (3) Eliminate the trade-off via a two-step streamlined approach. The proposed research enables an in-depth understanding of the accuracy-fairness trade-off, pushing current fair machine-learning research to a new frontier.


title: SYNPA: SMT Performance Analysis and Allocation of Threads to Cores in ARM Processors

abstract: Simultaneous multithreading processors improve throughput over single-threaded processors thanks to sharing internal core resources among instructions from distinct threads. However, resource sharing introduces inter-thread interference within the core, which has a negative impact on individual application performance and can significantly increase the turnaround time of multi-program workloads. The severity of the interference effects depends on the competing co-runners sharing the core. Thus, it can be mitigated by applying a thread-to-core allocation policy that smartly selects applications to be run in the same core to minimize their interference. This paper presents SYNPA, a simple approach that dynamically allocates threads to cores in an SMT processor based on their run-time dynamic behavior. The approach uses a regression model to select synergistic pairs to mitigate intra-core interference. The main novelty of SYNPA is that it uses just three variables collected from the performance counters available in current ARM processors at the dispatch stage. Experimental results show that SYNPA outperforms the default Linux scheduler by around 36%, on average, in terms of turnaround time in 8-application workloads combining frontend bound and backend bound benchmarks.


title: DT/MARS-CycleGAN: Improved Object Detection for MARS Phenotyping Robot

abstract: Robotic crop phenotyping has emerged as a key technology to assess crops' morphological and physiological traits at scale. These phenotypical measurements are essential for developing new crop varieties with the aim of increasing productivity and dealing with environmental challenges such as climate change. However, developing and deploying crop phenotyping robots face many challenges such as complex and variable crop shapes that complicate robotic object detection, dynamic and unstructured environments that baffle robotic control, and real-time computing and managing big data that challenge robotic hardware/software. This work specifically tackles the first challenge by proposing a novel Digital-Twin(DT)MARS-CycleGAN model for image augmentation to improve our Modular Agricultural Robotic System (MARS)'s crop object detection from complex and variable backgrounds. Our core idea is that in addition to the cycle consistency losses in the CycleGAN model, we designed and enforced a new DT-MARS loss in the deep learning model to penalize the inconsistency between real crop images captured by MARS and synthesized images sensed by DT MARS. Therefore, the generated synthesized crop images closely mimic real images in terms of realism, and they are employed to fine-tune object detectors such as YOLOv8. Extensive experiments demonstrated that our new DT/MARS-CycleGAN framework significantly boosts our MARS' crop object/row detector's performance, contributing to the field of robotic crop phenotyping.


title: Continuous Time Locally Stationary Wavelet Processes

abstract: This article introduces the class of continuous time locally stationary wavelet processes. Continuous time models enable us to properly provide scale-based time series models for irregularly-spaced observations for the first time, while also permitting a spectral representation of the process over a continuous range of scales. We derive results for both the theoretical setting, where we assume access to the entire process sample path, and a more practical one, which develops methods for estimating the quantities of interest from sampled time series. The latter estimates are accurately computable in reasonable time by solving the relevant linear integral equation using the iterative thresholding method due to Daubechies, Defrise and De Mol. Appropriate smoothing techniques are also developed and applied in this new setting. We exemplify our new methods by computing spectral and autocovariance estimates on irregularly-spaced heart rate data obtained from a recent sleep-state study.


title: On some integral-geometric quantities related to transversality, curvature and visibility

abstract: We consider some integral-geometric quantities that have recently arisen in harmonic analysis and elsewhere, derive some sharp geometric inequalities relating them, and place them in a wider context.


title: Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detection

abstract: Open-set supervised anomaly detection (OSAD) - a recently emerging anomaly detection area - aims at utilizing a few samples of anomaly classes seen during training to detect unseen anomalies (i.e., samples from open-set anomaly classes), while effectively identifying the seen anomalies. Benefiting from the prior knowledge illustrated by the seen anomalies, current OSAD methods can often largely reduce false positive errors. However, these methods are trained in a closed-set setting and treat the anomaly examples as from a homogeneous distribution, rendering them less effective in generalizing to unseen anomalies that can be drawn from any distribution. This paper proposes to learn heterogeneous anomaly distributions using the limited anomaly examples to address this issue. To this end, we introduce a novel approach, namely Anomaly Heterogeneity Learning (AHL), that simulates a diverse set of heterogeneous anomaly distributions and then utilizes them to learn a unified heterogeneous abnormality model in surrogate open-set environments. Further, AHL is a generic framework that existing OSAD models can plug and play for enhancing their abnormality modeling. Extensive experiments on nine real-world anomaly detection datasets show that AHL can 1) substantially enhance different state-of-the-art OSAD models in detecting seen and unseen anomalies, and 2) effectively generalize to unseen anomalies in new domains. Code is available at https://github.com/mala-lab/AHL.


title: Stability of the one electron atom Schr\"odinger model with magnetic field in two dimensions

abstract: We study the stability of the one electron atom Schr\"odinger model with self-generated magnetic field in two dimensions. The magnetic energy is taken of the general form $K\int_{\mathbb{R}^2} |B|^p$ and we study the stability of the model as a function of the power $p$ and the coupling constant $K$. We show that for $p>3/2$, the model is always stable, and for $p<3/2$, the model is always unstable. In the critical case $p=3/2$, there is a critical stability constant $K_c$, that we characterize in terms of zero modes of the Dirac-Weyl operator. The value of $K_c$ is approximated using analytic and numerical methods.


title: Almost Optimal Locality Sensitive Orderings in Euclidean Space

abstract: $ \newcommand{\Re}{\mathbb{R}} \newcommand{\reals}{\mathbb{R}} \newcommand{\SetX}{\mathsf{X}} \newcommand{\rad}{r} \newcommand{\Eps}{\Mh{\mathcal{E}}} \newcommand{\p}{\Mh{p}} \newcommand{\q}{\Mh{q}} \newcommand{\Mh}[1]{#1} \newcommand{\query}{q} \newcommand{\eps}{\varepsilon} \newcommand{\VorX}[1]{\mathcal{V} \pth{#1}} \newcommand{\Polygon}{\mathsf{P}} \newcommand{\IntRange}[1]{[ #1 ]} \newcommand{\Space}{\overline{\mathsf{m}}} \newcommand{\pth}[2][\!]{#1\left({#2}\right)} \newcommand{\polylog}{\mathrm{polylog}} \newcommand{\N}{\mathbb N} \newcommand{\Z}{\mathbb Z} \newcommand{\pt}{p} \newcommand{\distY}[2]{\left\| {#1} - {#2} \right\|} \newcommand{\ptq}{q} \newcommand{\pts}{s}$ For a parameter $\eps \in (0,1)$, we present a new construction of $\eps$-locality-sensitive orderings (<LSOs) in $\Re^d$ of size $M = O(\Eps^{d-1} \log \Eps)$, where $\Eps = 1/\eps$. This improves over previous work by a factor of $\Eps$, and is optimal up to a factor of $\log \Eps$. Such a set of LSOs has the property that for any two points, $\p, \q \in [0,1]^d$, there exist an order in the set such that all the points between $\p$ and $\q$ in the order are $\eps$-close to either $\p$ or $\q$. The existence of such LSOs is a fundamental property of low dimensional Euclidean space, conceptually similar to the existence of well-separated pairs decomposition, so the question of how to compute (near) optimal construction of LSOs is quite natural. As a consequence we get a flotilla of improved dynamic geometric algorithms, such as maintaining bichromatic closest pair, and spanners, among others. In particular, for geometric dynamic spanners the new result matches (up to the aforementioned $\log \Eps$ factor) the lower bound, Thus offering a near-optimal simple dynamic data-structure for maintaining spanners under insertions and deletions.


title: OODRobustBench: a Benchmark and Large-Scale Analysis of Adversarial Robustness under Distribution Shift

abstract: Existing works have made great progress in improving adversarial robustness, but typically test their method only on data from the same distribution as the training data, i.e. in-distribution (ID) testing. As a result, it is unclear how such robustness generalizes under input distribution shifts, i.e. out-of-distribution (OOD) testing. This omission is concerning as such distribution shifts are unavoidable when methods are deployed in the wild. To address this issue we propose a benchmark named OODRobustBench to comprehensively assess OOD adversarial robustness using 23 dataset-wise shifts (i.e. naturalistic shifts in input distribution) and 6 threat-wise shifts (i.e., unforeseen adversarial threat models). OODRobustBench is used to assess 706 robust models using 60.7K adversarial evaluations. This large-scale analysis shows that: 1) adversarial robustness suffers from a severe OOD generalization issue; 2) ID robustness correlates strongly with OOD robustness in a positive linear way. The latter enables the prediction of OOD robustness from ID robustness. We then predict and verify that existing methods are unlikely to achieve high OOD robustness. Novel methods are therefore required to achieve OOD robustness beyond our prediction. To facilitate the development of these methods, we investigate a wide range of techniques and identify several promising directions. Code and models are available at: https://github.com/OODRobustBench/OODRobustBench.


title: Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization

abstract: Large language models (LLMs) have exhibited considerable cross-lingual generalization abilities, whereby they implicitly transfer knowledge across languages. However, the transfer is not equally successful for all languages, especially for low-resource ones, which poses an ongoing challenge. It is unclear whether we have reached the limits of implicit cross-lingual generalization and if explicit knowledge transfer is viable. In this paper, we investigate the potential for explicitly aligning conceptual correspondence between languages to enhance cross-lingual generalization. Using the syntactic aspect of language as a testbed, our analyses of 43 languages reveal a high degree of alignability among the spaces of structural concepts within each language for both encoder-only and decoder-only LLMs. We then propose a meta-learning-based method to learn to align conceptual spaces of different languages, which facilitates zero-shot and few-shot generalization in concept classification and also offers insights into the cross-lingual in-context learning phenomenon. Experiments on syntactic analysis tasks show that our approach achieves competitive results with state-of-the-art methods and narrows the performance gap between languages, particularly benefiting those with limited resources.


title: Self-triggered Consensus Control of Multi-agent Systems from Data

abstract: This paper considers self-triggered consensus control of unknown linear multi-agent systems (MASs). Self-triggering mechanisms (STMs) are widely used in MASs, thanks to their advantages in avoiding continuous monitoring and saving computing and communication resources. However, existing results require the knowledge of system matrices, which are difficult to obtain in real-world settings. To address this challenge, we present a data-driven approach to designing STMs for unknown MASs building upon the model-based solutions. Our approach leverages a system lifting method, which allows us to derive a data-driven representation for the MAS. Subsequently, a data-driven self-triggered consensus control (STC) scheme is designed, which combines a data-driven STM with a state feedback control law. We establish a data-based stability criterion for asymptotic consensus of the closed-loop MAS in terms of linear matrix inequalities, whose solution provides a matrix for the STM as well as a stabilizing controller gain. In the presence of external disturbances, a model-based STC scheme is put forth for $\mathcal{H}_{\infty}$-consensus of MASs, serving as a baseline for the data-driven STC. Numerical tests are conducted to validate the correctness of the data- and model-based STC approaches. Our data-driven approach demonstrates a superior trade-off between control performance and communication efficiency from finite, noisy data relative to the system identification-based one.


title: Edge of entanglement in non-ergodic states: a complexity parameter formulation

abstract: We analyze the subsystem size scaling of the entanglement entropy of a non-ergodic pure state that can be described by a multi-parametric Gaussian ensemble of complex matrices in a bipartite basis. Our analysis indicates, for a given set of global constraints, the existence of infinite number of universality classes of local complexity, characterized by the complexity parameter, for which the entanglement entropy reveals a universal scaling with subsystem size. A rescaling of the complexity parameter helps us to identify the critical regime for the entanglement entropy of a broad range of pure non-ergodic states.


title: Constraining the formation history of the HAT-P-11 system by atmospheric abundances

abstract: The chemical fingerprint of a planet reveals information about its formation history regarding when and where it formed. The water content of a planet can help to constrain its formation pathway: If the planet formed in the outer regions of the disk and migrated inward, it will be water-rich due to the accretion of water-ice-rich solids. Conversely, formation in the inner disk, where water-ice is not available, will result in a smaller atmospheric water content due to the limited accretion of water vapor. This process complicates with the presence of gap-opening giant planets. A gas giant exerts a pressure bump exterior to its orbit, preventing the further influx of pebbles into the inner system, resulting in a water-poor environment. The different formation scenarios can help to constrain the formation of the HAT-P-11 system, which contains an inner sub-Neptune with a mass of 23.4 $\mathrm{M_{\oplus}}$ and substellar water abundances ($X_\mathrm{H_2O} \approx 0.11$), as well as an outer giant planet orbiting exterior to the water-ice line. Our planet formation model encompasses planetary growth through pebble and gas accretion, along with a pebble drift and evaporation module that enables us to track the chemical composition of the disk and the planets. We find that the presence of the gas giant is necessary to block water-ice-rich material, resulting in a substellar water content for the inner sub-Neptune. If the giant planet forms too early, not enough solid material can enter the inner disk regions, preventing the efficient growth of the inner planet. This highlights the importance of the timing of giant planet formation to explain the inner system structure. Our simulations predict a roughly stellar C/O ratio with superstellar C/H and O/H for HAT-P-11b, providing constraints for future observations that are essential for gaining a more detailed understanding of its formation.


abstract: Language Models (LMs) have demonstrated impressive molecule understanding ability on various 1D text-related tasks. However, they inherently lack 2D graph perception - a critical ability of human professionals in comprehending molecules' topological structures. To bridge this gap, we propose MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter. MolCA enables an LM (e.g., Galactica) to understand both text- and graph-based molecular contents via the cross-modal projector. Specifically, the cross-modal projector is implemented as a Q-Former to connect a graph encoder's representation space and an LM's text space. Further, MolCA employs a uni-modal adapter (i.e., LoRA) for the LM's efficient adaptation to downstream tasks. Unlike previous studies that couple an LM with a graph encoder via cross-modal contrastive learning, MolCA retains the LM's ability of open-ended text generation and augments it with 2D graph information. To showcase its effectiveness, we extensively benchmark MolCA on tasks of molecule captioning, IUPAC name prediction, and molecule-text retrieval, on which MolCA significantly outperforms the baselines. Our codes and checkpoints can be found at https://github.com/acharkq/MolCA.


title: Natural Model Reduction for Kinetic Equations

abstract: A promising approach to investigating high-dimensional problems is to identify their intrinsically low-dimensional features, which can be achieved through recently developed techniques for effective low-dimensional representation of functions such as machine learning. Based on available finite-dimensional approximate solution manifolds, this paper proposes a novel model reduction framework for kinetic equations. The method employs projections onto tangent bundles of approximate manifolds, naturally resulting in first-order hyperbolic systems. Under certain conditions on the approximate manifolds, the reduced models preserve several crucial properties, including hyperbolicity, conservation laws, entropy dissipation, finite propagation speed, and linear stability. For the first time, this paper rigorously discusses the relation between the H-theorem of kinetic equations and the linear stability conditions of reduced systems, determining the choice of Riemannian metrics involved in the model reduction. The framework is widely applicable for the model reduction of many models in kinetic theory.


title: Exploring Graph Neural Networks for Indian Legal Judgment Prediction

abstract: The burdensome impact of a skewed judges-to-cases ratio on the judicial system manifests in an overwhelming backlog of pending cases alongside an ongoing influx of new ones. To tackle this issue and expedite the judicial process, the proposition of an automated system capable of suggesting case outcomes based on factual evidence and precedent from past cases gains significance. This research paper centres on developing a graph neural network-based model to address the Legal Judgment Prediction (LJP) problem, recognizing the intrinsic graph structure of judicial cases and making it a binary node classification problem. We explored various embeddings as model features, while nodes such as time nodes and judicial acts were added and pruned to evaluate the model's performance. The study is done while considering the ethical dimension of fairness in these predictions, considering gender and name biases. A link prediction task is also conducted to assess the model's proficiency in anticipating connections between two specified nodes. By harnessing the capabilities of graph neural networks and incorporating fairness analyses, this research aims to contribute insights towards streamlining the adjudication process, enhancing judicial efficiency, and fostering a more equitable legal landscape, ultimately alleviating the strain imposed by mounting case backlogs. Our best-performing model with XLNet pre-trained embeddings as its features gives the macro F1 score of 75% for the LJP task. For link prediction, the same set of features is the best performing giving ROC of more than 80%


title: Roughness and critical force for depinning at 3-loop order

abstract: A $d$-dimensional elastic manifold at depinning is described by a renormalized field theory, based on the Functional Renormalization Group (FRG). Here we analyze this theory to 3-loop order, equivalent to third order in $\epsilon=4-d$, where $d$ is the internal dimension. The critical exponent reads $\zeta = \frac \epsilon3 + 0.04777 \epsilon^2 -0.068354 \epsilon^3 + {\cal O}(\epsilon^4)$. Using that $\zeta(d=0)=2^-$, we estimate $\zeta(d=1)=1.266(20)$, $\zeta(d=2)=0.752(1)$ and $\zeta(d=3)=0.357(1)$. For Gaussian disorder, the pinning force per site is estimated as $f_{\rm c}= {\cal B} m^{2}\rho_m + f_{\rm c}^0$, where $m^2$ is the strength of the confining potential, $\cal B$ a universal amplitude, $\rho_m$ the correlation length of the disorder, and $f_{\rm c}^0$ a non-universal lattice dependent term. For charge-density waves, we find a mapping to the standard $\phi^4$-theory with $O(n)$ symmetry in the limit of $n\to -2$. This gives $f_{\rm c} = \tilde {\cal A}(d) m^2 \ln (m) + f_{\rm c}^0 $, with $\tilde {\cal A}(d) = -\partial_n \big[\nu(d,n)^{-1}+\eta(d,n)\big]_{n=-2}$, reminiscent of log-CFTs.


title: An effective theory of collective deep learning

abstract: Unraveling the emergence of collective learning in systems of coupled artificial neural networks points to broader implications for machine learning, neuroscience, and society. Here we introduce a minimal model that condenses several recent decentralized algorithms by considering a competition between two terms: the local learning dynamics in the parameters of each neural network unit, and a diffusive coupling among units that tends to homogenize the parameters of the ensemble. We derive an effective theory for linear networks to show that the coarse-grained behavior of our system is equivalent to a deformed Ginzburg-Landau model with quenched disorder. This framework predicts depth-dependent disorder-order-disorder phase transitions in the parameters' solutions that reveal a depth-delayed onset of a collective learning phase and a low-rank microscopic learning path. We validate the theory in coupled ensembles of realistic neural networks trained on the MNIST dataset under privacy constraints. Interestingly, experiments confirm that individual networks -- trained on private data -- can fully generalize to unseen data classes when the collective learning phase emerges. Our work establishes the physics of collective learning and contributes to the mechanistic interpretability of deep learning in decentralized settings.

categories: physics.soc-ph cond-mat.dis-nn cs.AI cs.LG nlin.AO


title: Data Augmentations for Improved (Large) Language Model Generalization

abstract: The reliance of text classifiers on spurious correlations can lead to poor generalization at deployment, raising concerns about their use in safety-critical domains such as healthcare. In this work, we propose to use counterfactual data augmentation, guided by knowledge of the causal structure of the data, to simulate interventions on spurious features and to learn more robust text classifiers. We show that this strategy is appropriate in prediction problems where the label is spuriously correlated with an attribute. Under the assumptions of such problems, we discuss the favorable sample complexity of counterfactual data augmentation, compared to importance re-weighting. Pragmatically, we match examples using auxiliary data, based on diff-in-diff methodology, and use a large language model (LLM) to represent a conditional probability of text. Through extensive experimentation on learning caregiver-invariant predictors of clinical diagnoses from medical narratives and on semi-synthetic data, we demonstrate that our method for simulating interventions improves out-of-distribution (OOD) accuracy compared to baseline invariant learning algorithms.


title: Differentiable Vertex Fitting for Jet Flavour Tagging

abstract: We propose a differentiable vertex fitting algorithm that can be used for secondary vertex fitting, and that can be seamlessly integrated into neural networks for jet flavour tagging. Vertex fitting is formulated as an optimization problem where gradients of the optimized solution vertex are defined through implicit differentiation and can be passed to upstream or downstream neural network components for network training. More broadly, this is an application of differentiable programming to integrate physics knowledge into neural network models in high energy physics. We demonstrate how differentiable secondary vertex fitting can be integrated into larger transformer-based models for flavour tagging and improve heavy flavour jet classification.


title: Detection and Evaluation of bias-inducing Features in Machine learning

abstract: The cause-to-effect analysis can help us decompose all the likely causes of a problem, such as an undesirable business situation or unintended harm to the individual(s). This implies that we can identify how the problems are inherited, rank the causes to help prioritize fixes, simplify a complex problem and visualize them. In the context of machine learning (ML), one can use cause-to-effect analysis to understand the reason for the biased behavior of the system. For example, we can examine the root causes of biases by checking each feature for a potential cause of bias in the model. To approach this, one can apply small changes to a given feature or a pair of features in the data, following some guidelines and observing how it impacts the decision made by the model (i.e., model prediction). Therefore, we can use cause-to-effect analysis to identify the potential bias-inducing features, even when these features are originally are unknown. This is important since most current methods require a pre-identification of sensitive features for bias assessment and can actually miss other relevant bias-inducing features, which is why systematic identification of such features is necessary. Moreover, it often occurs that to achieve an equitable outcome, one has to take into account sensitive features in the model decision. Therefore, it should be up to the domain experts to decide based on their knowledge of the context of a decision whether bias induced by specific features is acceptable or not. In this study, we propose an approach for systematically identifying all bias-inducing features of a model to help support the decision-making of domain experts. We evaluated our technique using four well-known datasets to showcase how our contribution can help spearhead the standard procedure when developing, testing, maintaining, and deploying fair/equitable machine learning systems.


title: DCSI -- An improved measure of cluster separability based on separation and connectedness

abstract: Whether class labels in a given data set correspond to meaningful clusters is crucial for the evaluation of clustering algorithms using real-world data sets. This property can be quantified by separability measures. A review of the existing literature shows that neither classification-based complexity measures nor cluster validity indices (CVIs) adequately incorporate the central aspects of separability for density-based clustering: between-class separation and within-class connectedness. A newly developed measure (density cluster separability index, DCSI) aims to quantify these two characteristics and can also be used as a CVI. Extensive experiments on synthetic data indicate that DCSI correlates strongly with the performance of DBSCAN measured via the adjusted rand index (ARI) but lacks robustness when it comes to multi-class data sets with overlapping classes that are ill-suited for density-based hard clustering. Detailed evaluation on frequently used real-world data sets shows that DCSI can correctly identify touching or overlapping classes that do not form meaningful clusters.


title: A note on the logical inconsistency of the Hotelling Rule: A Revisit from the System's Analysis Perspective

abstract: The "Hotelling rule" (HR) called to be "the fundamental principle of the economics of exhaustible resources" has a logical deficiency which was never paid a sufficient attention to. This deficiency should be taken into account before attempting to explain discrepancies between the price prediction provided by the HR and historically observed prices. Our analysis is focused on the HR in its original form, we do not touch upon other aspects such as varying extraction costs and other ways of upgrading the original model underlying the Hotelling rule. We conclude that HR can not be derived from the simple models as it was claimed, therefore it should be understood as an assumption on its own, and not as a rule derived from other more basic assumptions.


title: Model Merging by Uncertainty-Based Gradient Matching

abstract: Models trained on different datasets can be merged by a weighted-averaging of their parameters, but why does it work and when can it fail? Here, we connect the inaccuracy of weighted-averaging to mismatches in the gradients and propose a new uncertainty-based scheme to improve the performance by reducing the mismatch. The connection also reveals implicit assumptions in other schemes such as averaging, task arithmetic, and Fisher-weighted averaging. Our new method gives consistent improvements for large language models and vision transformers, both in terms of performance and robustness to hyperparameters.


title: Hierarchical Forecasting at Scale

abstract: Existing hierarchical forecasting techniques scale poorly when the number of time series increases. We propose to learn a coherent forecast for millions of time series with a single bottom-level forecast model by using a sparse loss function that directly optimizes the hierarchical product and/or temporal structure. The benefit of our sparse hierarchical loss function is that it provides practitioners a method of producing bottom-level forecasts that are coherent to any chosen cross-sectional or temporal hierarchy. In addition, removing the need for a post-processing step as required in traditional hierarchical forecasting techniques reduces the computational cost of the prediction phase in the forecasting pipeline. On the public M5 dataset, our sparse hierarchical loss function performs up to 10% (RMSE) better compared to the baseline loss function. We implement our sparse hierarchical loss function within an existing forecasting model at bol, a large European e-commerce platform, resulting in an improved forecasting performance of 2% at the product level. Finally, we found an increase in forecasting performance of about 5-10% when evaluating the forecasting performance across the cross-sectional hierarchies that we defined. These results demonstrate the usefulness of our sparse hierarchical loss applied to a production forecasting system at a major e-commerce platform.


title: Accretion flows in the hard state of black hole X-ray binaries: the effect of hot gas condensation

abstract: It is commonly believed that accretion discs are truncated and their inner regions are described by advection dominated accretion flows (ADAFs) in the hard spectral state of black hole X-ray binaries. However, the increasing occurrence of a relativistically blurred Fe K$\alpha$ line together with a hard continuum points to the existence of a thin disc located near the innermost stable circular orbit (ISCO). Assuming the accretion in the hard state is via an ADAF extending to near 100 Schwarzschild radii, which is supplied by either a stellar wind from a companion star or resulting from an evaporated disc, we study the possible condensation of the hot gas during its accretion towards the black hole. It is found that a small fraction of the ADAF condenses into a cold disc as a consequence of efficient radiative cooling at small distances, forming a disc-corona configuration near the ISCO. This takes place for low accretion rates corresponding to luminosities ranging from $\sim 10^{-3}$ to a few per cent of the Eddington luminosity. The coexistence of the weak inner disc and the dominant hot accretion flow provides a natural explanation of the broad K$\alpha$ line in the hard state. Detailed computations demonstrate that such accretion flows produce a hard X-ray spectrum accompanied by a weak disc component with a negative correlation between the 2-10 keV photon index and the Eddington ratio. The predicted spectrum of Cygnus X-1 and the correlation between the photon index and the Eddington ratio are in good agreement with observations.


title: X-ray, Near-Ultraviolet, and Optical Flares Produced By Colliding Magnetospheres in The Young High-Eccentricity Binary DQ Tau

abstract: DQ Tau is a unique young high-eccentricity binary system that exhibits regular magnetic reconnection flares and pulsed accretion near periastron. We conducted NuSTAR, Swift, and Chandra observations during the July 30, 2022 periastron to characterize X-ray, near-ultraviolet (NUV), and optical flaring emissions. Our findings confirm the presence of X-ray super-flares accompanied by substantial NUV and optical flares, consistent with previous discoveries of periastron flares in 2010 and 2021. These observations, supported by new evidence, strongly establish the magnetosphere collision mechanism as the primary driver of magnetic energy release during DQ Tau's periastron flares. The energetics of the observed X-ray super-flares remain consistent across the three periastrons, indicating recurring energy sources during each passage, surpassing the capabilities of single stars. The observed flaring across multiple bands supports the Adams et al. model for magnetosphere interaction in eccentric binaries. Evidence from modeling and past and current observations suggests that both the mm/X-ray periastron flares and tentatively, the magnetic reconnection-related components of the optical/NUV emissions, conform to the classical solar/stellar non-thermal thick-target model, except for the distinctive magnetic energy source. However, our NuSTAR observations suffered from high background levels, hindering the detection of anticipated non-thermal hard X-rays. Furthermore, we report serendipitous discovery of X-ray super-flares occurring away from periastron, potentially associated with interacting magnetospheres. The current study is part of a broader multi-wavelength campaign, which is planned to investigate the influence of DQ Tau's stellar radiation on gas-phase ion chemistry within its circumbinary disk.


title: Systems of Discrete Differential Equations, Constructive Algebraicity of the Solutions

abstract: In this article, we study systems of $n \geq 1$, not necessarily linear, discrete differential equations (DDEs) of order $k \geq 1$ with one catalytic variable. We provide a constructive and elementary proof of algebraicity of the solutions of such equations. This part of the present article can be seen as a generalization of the pioneering work by Bousquet-M\'elou and Jehanne~(2006) who settled down the case $n=1$. Moreover, we obtain effective bounds for the algebraicity degrees of the solutions and provide an algorithm for computing annihilating polynomials of the algebraic series. Finally, we carry out a first analysis in the direction of effectivity for solving systems of DDEs in view of practical applications.


title: Probing modified gravitational-wave propagation with extreme mass-ratio inspirals

abstract: Extreme mass-ratio inspirals (EMRIs), namely binary systems composed of a massive black hole and a compact stellar-mass object, are anticipated to be among the gravitational wave (GW) sources detected by the Laser Interferometer Space Antenna (LISA). Similarly to compact binary mergers detected by current GW detectors, EMRIs can be used as cosmic rulers to probe the expansion of the Universe. Motivated by tensions in current cosmological observations as well as by alternative models of dark energy, modified gravity theories can affect the propagation of GWs across cosmological distances, with modifications commonly parametrised in terms of two phenomenological parameters, $\Xi_0$ and $n$. In this work we adopt a Bayesian approach to constrain for the first time parametrised deviations from General Relativity using the loudest simulated EMRIs detected by LISA as dark sirens with a simulated galaxy catalog. Assuming all the cosmological parameters except $\Xi_0$ are already tightly constrained, our forecasts show that $\Xi_0$ can be constrained to a few percent level (90% C.I.) with 4 years of LISA observations, unless EMRI detection rates turn out to be closer to current pessimistic expectations. These results quickly degrade if additional cosmological parameters are inferred simultaneously, but become more robust with an extended LISA observation period of 10 years. Overall, we find that EMRIs with LISA are better at constraining modified GW propagation than current second-generation ground-based GW detectors, but they will only be comparable to third-generation detectors in the most optimistic scenarios.


title: On Spectrum of Neighbourhood Corona Product of Signed Graphs

abstract: Given two signed graphs $\Gamma_1$ with nodes $\{u_1,u_2,\cdots,u_n\}$ and $\Gamma_2$, the neighbourhood corona, $\Gamma_1*\Gamma_2$ is the signed graph obtained by taking one copy of $\Gamma_1$ and $n_1$ copies of $\Gamma_2$, and joining every neighbour of the $i^{th}$ node with each nodes of the $i^{th}$ copy of $\Gamma_2$ by a new signed edge. In this paper we will determine the condition for $\Gamma_1*\Gamma_2$ to be balanced. We also determine the adjacency spectrum of $\Gamma_1*\Gamma_2$ for arbitrary $\Gamma_1$ and $\Gamma_2$, and Laplacian and signless Laplacian spectrum of $\Gamma_1*\Gamma_2$ for regular $\Gamma_1$ and arbitrary $\Gamma_2$, in terms of the corresponding spectrum of $\Gamma_1$ and $\Gamma_2$.


title: Formalizing and Benchmarking Prompt Injection Attacks and Defenses

abstract: A prompt injection attack aims to inject malicious instruction/data into the input of an LLM-Integrated Application such that it produces results as an attacker desires. Existing works are limited to case studies. As a result, the literature lacks a systematic understanding of prompt injection attacks and their defenses. We aim to bridge the gap in this work. In particular, we propose a framework to formalize prompt injection attacks. Existing attacks are special cases in our framework. Moreover, based on our framework, we design a new attack by combining existing ones. Using our framework, we conduct a systematic evaluation on 5 prompt injection attacks and 10 defenses with 10 LLMs and 7 tasks. Our work provides a common benchmark for quantitatively evaluating future prompt injection attacks and defenses. To facilitate research on this topic, we make our platform public at https://github.com/liu00222/Open-Prompt-Injection.


title: Multi-Robot Local Motion Planning Using Dynamic Optimization Fabrics

abstract: In this paper, we address the problem of real-time motion planning for multiple robotic manipulators that operate in close proximity. We build upon the concept of dynamic fabrics and extend them to multi-robot systems, referred to as Multi-Robot Dynamic Fabrics (MRDF). This geometric method enables a very high planning frequency for high-dimensional systems at the expense of being reactive and prone to deadlocks. To detect and resolve deadlocks, we propose Rollout Fabrics where MRDF are forward simulated in a decentralized manner. We validate the methods in simulated close-proximity pick-and-place scenarios with multiple manipulators, showing high success rates and real-time performance.


title: 2D-3D Interlaced Transformer for Point Cloud Segmentation with Scene-Level Supervision

abstract: We present a Multimodal Interlaced Transformer (MIT) that jointly considers 2D and 3D data for weakly supervised point cloud segmentation. Research studies have shown that 2D and 3D features are complementary for point cloud segmentation. However, existing methods require extra 2D annotations to achieve 2D-3D information fusion. Considering the high annotation cost of point clouds, effective 2D and 3D feature fusion based on weakly supervised learning is in great demand. To this end, we propose a transformer model with two encoders and one decoder for weakly supervised point cloud segmentation using only scene-level class tags. Specifically, the two encoders compute the self-attended features for 3D point clouds and 2D multi-view images, respectively. The decoder implements interlaced 2D-3D cross-attention and carries out implicit 2D and 3D feature fusion. We alternately switch the roles of queries and key-value pairs in the decoder layers. It turns out that the 2D and 3D features are iteratively enriched by each other. Experiments show that it performs favorably against existing weakly supervised point cloud segmentation methods by a large margin on the S3DIS and ScanNet benchmarks. The project page will be available at https://jimmy15923.github.io/mit_web/.


title: Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models

abstract: Parameter-shared pre-trained language models (PLMs) have emerged as a successful approach in resource-constrained environments, enabling substantial reductions in model storage and memory costs without significant performance compromise. However, it is important to note that parameter sharing does not alleviate computational burdens associated with inference, thus impeding its practicality in situations characterized by limited stringent latency requirements or computational resources. Building upon neural ordinary differential equations (ODEs), we introduce a straightforward technique to enhance the inference efficiency of parameter-shared PLMs. Additionally, we propose a simple pre-training technique that leads to fully or partially shared models capable of achieving even greater inference acceleration. The experimental results demonstrate the effectiveness of our methods on both autoregressive and autoencoding PLMs, providing novel insights into more efficient utilization of parameter-shared models in resource-constrained settings.


title: Hybrid Search for Efficient Planning with Completeness Guarantees

abstract: Solving complex planning problems has been a long-standing challenge in computer science. Learning-based subgoal search methods have shown promise in tackling these problems, but they often suffer from a lack of completeness guarantees, meaning that they may fail to find a solution even if one exists. In this paper, we propose an efficient approach to augment a subgoal search method to achieve completeness in discrete action spaces. Specifically, we augment the high-level search with low-level actions to execute a multi-level (hybrid) search, which we call complete subgoal search. This solution achieves the best of both worlds: the practical efficiency of high-level search and the completeness of low-level search. We apply the proposed search method to a recently proposed subgoal search algorithm and evaluate the algorithm trained on offline data on complex planning problems. We demonstrate that our complete subgoal search not only guarantees completeness but can even improve performance in terms of search expansions for instances that the high-level could solve without low-level augmentations. Our approach makes it possible to apply subgoal-level planning for systems where completeness is a critical requirement.


title: A Centralized Voltage Controller for Offshore Wind Plants: NY State Grid Case Study

abstract: This paper proposes a centralized multi-plant reactive power and voltage controller to support voltage control in the interconnected onshore power system. This controller utilizes a hierarchical control structure consisting of a master controller and multiple slave controllers. To validate the proposed method, a realistic planning case of the New York State grid is created for the year 2035, in which nearly 9,500 MW AC or DC connected offshore wind resources are modeled. The performance of the proposed controller is analyzed in the large-scale model under three realistic disturbance scenarios: generator loss, load ramps, and load steps. Results demonstrate how the controller can adequately perform under disturbances to share reactive support proportionally among plants based on their ratings and improve grid voltage stability margins.


title: GestureGPT: Toward Zero-shot Interactive Gesture Understanding and Grounding with Large Language Model Agents

abstract: Current gesture interfaces typically demand users to learn and perform gestures from a predefined set, which leads to a less natural experience. Interfaces supporting user-defined gestures eliminate the learning process, but users still need to demonstrate and associate the gesture to a specific system function themselves. We introduce GestureGPT, a free-form hand gesture understanding framework that does not require users to learn, demonstrate, or associate gestures. Our framework leverages the large language model's (LLM) astute common sense and strong inference ability to understand a spontaneously performed gesture from its natural language descriptions, and automatically maps it to a function provided by the interface. More specifically, our triple-agent framework involves a Gesture Description Agent that automatically segments and formulates natural language descriptions of hand poses and movements based on hand landmark coordinates. The description is deciphered by a Gesture Inference Agent through self-reasoning and querying about the interaction context (e.g., interaction history, gaze data), which a Context Management Agent organizes and provides. Following iterative exchanges, the Gesture Inference Agent discerns user intent, grounding it to an interactive function. We validated our conceptual framework under two real-world scenarios: smart home controlling and online video streaming. The average zero-shot Top-5 grounding accuracies are 83.59% for smart home tasks and 73.44% for video streaming. We also provided an extensive discussion of our framework including model selection rationale, generated description quality, generalizability etc.


title: Generating collective counterfactual explanations in score-based classification via mathematical optimization

abstract: Due to the increasing use of Machine Learning models in high stakes decision making settings, it has become increasingly important to have tools to understand how models arrive at decisions. Assuming a trained Supervised Classification model, explanations can be obtained via counterfactual analysis: a counterfactual explanation of an instance indicates how this instance should be minimally modified so that the perturbed instance is classified in the desired class by the Machine Learning classification model. Most of the Counterfactual Analysis literature focuses on the single-instance single-counterfactual setting, in which the analysis is done for one single instance to provide one single explanation. Taking a stakeholder's perspective, in this paper we introduce the so-called collective counterfactual explanations. By means of novel Mathematical Optimization models, we provide a counterfactual explanation for each instance in a group of interest, so that the total cost of the perturbations is minimized under some linking constraints. Making the process of constructing counterfactuals collective instead of individual enables us to detect the features that are critical to the entire dataset to have the individuals classified in the desired class. Our methodology allows for some instances to be treated individually, performing the collective counterfactual analysis for a fraction of records of the group of interest. This way, outliers are identified and handled appropriately. Under some assumptions on the classifier and the space in which counterfactuals are sought, finding collective counterfactuals is reduced to solving a convex quadratic linearly constrained mixed integer optimization problem, which, for datasets of moderate size, can be solved to optimality using existing solvers. The performance of our approach is illustrated on real-world datasets, demonstrating its usefulness.


title: AgentTuning: Enabling Generalized Agent Abilities for LLMs

abstract: Open large language models (LLMs) with great performance in various tasks have significantly advanced the development of LLMs. However, they are far inferior to commercial models such as ChatGPT and GPT-4 when acting as agents to tackle complex tasks in the real world. These agent tasks employ LLMs as the central controller responsible for planning, memorization, and tool utilization, necessitating both fine-grained prompting methods and robust LLMs to achieve satisfactory performance. Though many prompting methods have been proposed to complete particular agent tasks, there is lack of research focusing on improving the agent capabilities of LLMs themselves without compromising their general abilities. In this work, we present AgentTuning, a simple and general method to enhance the agent abilities of LLMs while maintaining their general LLM capabilities. We construct AgentInstruct, a lightweight instruction-tuning dataset containing high-quality interaction trajectories. We employ a hybrid instruction-tuning strategy by combining AgentInstruct with open-source instructions from general domains. AgentTuning is used to instruction-tune the Llama 2 series, resulting in AgentLM. Our evaluations show that AgentTuning enables LLMs' agent capabilities without compromising general abilities. The AgentLM-70B is comparable to GPT-3.5-turbo on unseen agent tasks, demonstrating generalized agent capabilities. We open source the AgentInstruct and AgentLM-7B, 13B, and 70B models at https://github.com/THUDM/AgentTuning, serving open and powerful alternatives to commercial LLMs for agent tasks.


title: Pressure-induced Superconductivity and Structure Phase Transition in SnAs-based Zintl Compound SrSn2As2

abstract: Layered SnAs-based Zintl compounds exhibit a distinctive electronic structure, igniting extensive research efforts in areas of superconductivity, topological insulators and quantum magnetism. In this paper, we systematically investigate the crystal structures and electronic properties of the Zintl compound SrSn2As2 under high-pressure. At approximately 20.8 GPa, pressure-induced superconductivity is observed in SrSn2As2 with a characteristic dome-like evolution of Tc. Theoretical calculations together with high pressure synchrotron X-ray diffraction and Raman spectroscopy have identified that SrSn2As2 undergoes a structural transformation from a trigonal to a monoclinic structure. Beyond 28.3 GPa, the superconducting transition temperature is suppressed due to a reduction of the density of state at the Fermi level. The discovery of pressure-induced superconductivity, accompanied by structural transitions in SrSn2As2, greatly expands the physical properties of layered SnAs-based compounds and provides a new ground states upon compression.


title: Nonparametric Regression with Dyadic Data

abstract: This paper studies the identification and estimation of a nonparametric nonseparable dyadic model where the structural function and the distribution of the unobservable random terms are assumed to be unknown. The identification and the estimation of the distribution of the unobservable random term are also proposed. I assume that the structural function is continuous and strictly increasing in the unobservable heterogeneity. I propose suitable normalization for the identification by allowing the structural function to have some desirable properties such as homogeneity of degree one in the unobservable random term and some of its observables. The consistency and the asymptotic distribution of the estimators are proposed. The finite sample properties of the proposed estimators in a Monte-Carlo simulation are assessed.


title: A hybrid continuum surface force for the three-phase VOF method

abstract: We propose a hybrid continuum surface force (CSF) formulation to model the interface interaction within the three-phase volume of fluid (VOF) method. Instead of employing the height function globally, we compute the curvature based on a smooth fraction function near the region of the triple contact line. In addition, we apply the isotropic finite difference method to calculate derivatives, and the current scheme readily accommodates adaptive mesh refinement, greatly enhancing efficiency. We rigorously validate the hybrid CSF using two benchmark problems that have received limited attention in previous studies of the three-phase VOF method. Using the hybrid CSF method, we accurately predict the behavior of a liquid lens under specific surface tension ratios. Furthermore, the simulation results of the equilibrium morphology of two contacting droplets are consistent with the theoretical expectations.


title: Privately Answering Queries on Skewed Data via Per Record Differential Privacy

abstract: We consider the problem of the private release of statistics (like aggregate payrolls) where it is critical to preserve the contribution made by a small number of outlying large entities. We propose a privacy formalism, per-record zero concentrated differential privacy (PzCDP), where the privacy loss associated with each record is a public function of that record's value. Unlike other formalisms which provide different privacy losses to different records, PzCDP's privacy loss depends explicitly on the confidential data. We define our formalism, derive its properties, and propose mechanisms which satisfy PzCDP that are uniquely suited to publishing skewed or heavy-tailed statistics, where a small number of records contribute substantially to query answers. This targeted relaxation helps overcome the difficulties of applying standard DP to these data products.


title: Flexible Informed Trees (FIT*): Adaptive Batch-Size Approach in Informed Sampling-Based Path Planning

abstract: In path planning, anytime almost-surely asymptotically optimal planners dominate the benchmark of sampling-based planners. A notable example is Batch Informed Trees (BIT*), where planners iteratively determine paths to batches of vertices within the exploration area. However, utilizing a consistent batch size is inefficient for initial pathfinding and optimal performance, it relies on effective task allocation. This paper introduces Flexible Informed Trees (FIT*), a sampling-based planner that integrates an adaptive batch-size method to enhance the initial path convergence rate. FIT* employs a flexible approach in adjusting batch sizes dynamically based on the inherent dimension of the configuration spaces and the hypervolume of the n-dimensional hyperellipsoid. By applying dense and sparse sampling strategy, FIT* improves convergence rate while finding successful solutions faster with lower initial solution cost. This method enhances the planner's ability to handle confined, narrow spaces in the initial finding phase and increases batch vertices sampling frequency in the optimization phase. FIT* outperforms existing single-query, sampling-based planners on the tested problems in R^2 to R^8, and was demonstrated on a real-world mobile manipulation task.


title: A Microwell-Based Microfluidic Device for Single-Cell Trapping and Magnetic Field Gradient Stimulation

abstract: We develop a microfluidic platform for the long-term cultivation and observation of both THP-1 cells under different physiological conditions. First, we determine optimal seeding conditions and microwell geometry. Next, we observe changes in cell size and circularity. Results show that gradient magnetic forces on the order of 102 T/m results in stunted growth and irregular cell shapes. Finally, we observe the temporal change in ROS signals under control, static and gradient magnetic fields. For exposure to static and gradient magnetic fields, the peak in ROS signals occurs after 24 hours and 36 hours, respectively.


title: Design Considerations for Factorial Adaptive Multi-Arm Multi-Stage (FAST) Clinical Trials

abstract: Multi-Arm, Multi-Stage (MAMS) clinical trial designs allow for multiple therapies to be compared across a spectrum of clinical trial phases. MAMS designs can be categorized into several overarching design groups, including adaptive designs (AD) and multi-arm (MA) designs. Factorial clinical trials designs represent an additional group of designs which can provide increased efficiency relative to fixed, traditional designs. In this work, we explore design choices associated with Factorial Adaptive Multi-Arm Multi-Stage (FAST) designs, which represent the combination of factorial and MAMS designs. This category of trial can potentially offer benefits similar to both MAMS and factorial designs. This work is motivated by a proposed clinical trial under development.


title: Deep Metric Imitation Learning for Stable Motion Primitives

abstract: Imitation Learning (IL) is a powerful technique for intuitive robotic programming. However, ensuring the reliability of learned behaviors remains a challenge. In the context of reaching motions, a robot should consistently reach its goal, regardless of its initial conditions. To meet this requirement, IL methods often employ specialized function approximators that guarantee this property by construction. Although effective, these approaches come with a set of limitations: 1) they are unable to fully exploit the capabilities of modern Deep Neural Network (DNN) architectures, 2) some are restricted in the family of motions they can model, resulting in suboptimal IL capabilities, and 3) they require explicit extensions to account for the geometry of motions that consider orientations. To address these challenges, we introduce a novel stability loss function, drawing inspiration from the triplet loss used in the deep metric learning literature. This loss does not constrain the DNN's architecture and enables learning policies that yield accurate results. Furthermore, it is not restricted to a specific state space geometry; therefore, it can easily incorporate the geometry of the robot's state space. We provide a proof of the stability properties induced by this loss and empirically validate our method in various settings. These settings include Euclidean and non-Euclidean state spaces, as well as first-order and second-order motions, both in simulation and with real robots. More details about the experimental results can be found in: https://youtu.be/ZWKLGntCI6w.


title: Extending the Veblen Function

abstract: This paper serves to define an extension, which we call dimensional Veblen, of Oswald Veblen's system of ordinal functions below the large Veblen ordinal. This is facilitated by iterating derivatives of ordinal functions along multidimensional array structures, and can be viewed as the "maximal" natural extension of the Veblen functions. We then construct an ordinal notation based on it, and provide a conversion algorithm from Buchholz's function below the Bachmann-Howard ordinal.


title: Interpreting Sequence-Levenshtein distance for determining error type and frequency between two embedded sequences of equal length

abstract: Levenshtein distance is a commonly used edit distance metric, typically applied in language processing, and to a lesser extent, in molecular biology analysis. Biological nucleic acid sequences are often embedded in longer sequences and are subject to insertion and deletion errors that introduce frameshift during sequencing. These frameshift errors are due to string context and should not be counted as true biological errors. Sequence-Levenshtein distance is a modification to Levenshtein distance that is permissive of frameshift error without additional penalty. However, in a biological context Levenshtein distance needs to accommodate both frameshift and weighted errors, which Sequence-Levenshtein distance cannot do. Errors are weighted when they are associated with a numerical cost that corresponds to their frequency of appearance. Here, we describe a modification that allows the use of Levenshtein distance and Sequence-Levenshtein distance to appropriately accommodate penalty-free frameshift between embedded sequences and correctly weight specific error types.


title: A minimal Kurepa line

abstract: We show it is consistent with $\ZFC$ that there is an everywhere Kurepa line which is order isomorphic to all of its dense $\aleph_2$-dense suborders. Moreover, this Kurepa line does not contain any Aronszajn suborder. We also show it is consistent with $\ZFC$ that there is a minimal Kurepa line which does not contain any Aronszajn suborder.


title: High Dynamic Range mmWave Massive MU-MIMO with Householder Reflections

abstract: All-digital massive multiuser (MU) multiple-input multiple-output (MIMO) at millimeter-wave (mmWave) frequencies is a promising technology for next-generation wireless systems. Low-resolution analog-to-digital converters (ADCs) can be utilized to reduce the power consumption of all-digital basestation (BS) designs. However, simultaneously transmitting user equipments (UEs) with vastly different BS-side receive powers either drown weak UEs in quantization noise or saturate the ADCs. To address this issue, we propose high dynamic range (HDR) MIMO, a new paradigm that enables simultaneous reception of strong and weak UEs with low-resolution ADCs. HDR MIMO combines an adaptive analog spatial transform with digital equalization: The spatial transform focuses strong UEs on a subset of ADCs in order to mitigate quantization and saturation artifacts; digital equalization is then used for data detection. We demonstrate the efficacy of HDR MIMO in a massive MU-MIMO mmWave scenario that uses Householder reflections as spatial transform.


title: Knowledge-Augmented Language Model Verification

abstract: Recent Language Models (LMs) have shown impressive capabilities in generating texts with the knowledge internalized in parameters. Yet, LMs often generate the factually incorrect responses to the given queries, since their knowledge may be inaccurate, incomplete, and outdated. To address this problem, previous works propose to augment LMs with the knowledge retrieved from an external knowledge source. However, such approaches often show suboptimal text generation performance due to two reasons: 1) the model may fail to retrieve the knowledge relevant to the given query, or 2) the model may not faithfully reflect the retrieved knowledge in the generated text. To overcome these, we propose to verify the output and the knowledge of the knowledge-augmented LMs with a separate verifier, which is a small LM that is trained to detect those two types of errors through instruction-finetuning. Then, when the verifier recognizes an error, we can rectify it by either retrieving new knowledge or generating new text. Further, we use an ensemble of the outputs from different instructions with a single verifier to enhance the reliability of the verification processes. We validate the effectiveness of the proposed verification steps on multiple question answering benchmarks, whose results show that the proposed verifier effectively identifies retrieval and generation errors, allowing LMs to provide more factually correct outputs. Our code is available at https://github.com/JinheonBaek/KALMV.


title: Deep Beamforming for Speech Enhancement and Speaker Localization with an Array Response-Aware Loss Function

abstract: Recent research advances in deep neural network (DNN)-based beamformers have shown great promise for speech enhancement under adverse acoustic conditions. Different network architectures and input features have been explored in estimating beamforming weights. In this paper, we propose a deep beamformer based on an efficient convolutional recurrent network (CRN) trained with a novel ARray RespOnse-aWare (ARROW) loss function. The ARROW loss exploits the array responses of the target and interferer by using the ground truth relative transfer functions (RTFs). The DNN-based beamforming system, trained with ARROW loss through supervised learning, is able to perform speech enhancement and speaker localization jointly. Experimental results have shown that the proposed deep beamformer, trained with the linearly weighted scale-invariant source-to-noise ratio (SI-SNR) and ARROW loss functions, achieves superior performance in speech enhancement and speaker localization compared to two baselines.


title: Impossibility of adversarial self-testing and secure sampling

abstract: Self-testing is the task where spatially separated Alice and Bob cooperate to deduce the inner workings of untrusted quantum devices by interacting with them in a classical manner. We examine the task above where Alice and Bob do not trust each other which we call adversarial self-testing. We show that adversarial self-testing implies secure sampling -- a task that we introduce where mistrustful Alice and Bob wish to sample from a joint probability distribution with the guarantee that an honest party's marginal is not biased. By extending impossibility results in two-party quantum cryptography, we give a simple proof that both of these tasks are impossible in all but trivial settings.


title: Micromagnetic Simulation of Three-dimensional Nanoarchitectures

abstract: The thesis discusses micromagnetic simulation studies on high-frequency magnetic dynamics in three-dimensional ferromagnetic nanoarchitectures made of interconnected magnetic nanowire networks. Such artificial magnetic materials with nanoscale features have recently emerged as a vivid topic of research, as their geometry has a decisive impact on their magnetic properties. By studying their static magnetization structure, we find that these systems display a behavior analogous to that of 3D artificial spin ice lattices, with frustrated interactions and the emergence of monopole-like defect structures at the wires' intersection points. Our simulations reveal a high activity of these defect sites in the magnonic high-frequency spectrum. We study various 3D nanoarchitectures and show that their geometry and magnetization state results in characteristic high-frequency signatures. Controlling these features could open new pathways for magnonics research and reprogrammable magnetic metamaterials.


title: Highlights from the IceCube Neutrino Observatory

abstract: As IceCube surpasses a decade of operation in the full detector configuration, results that drive forward the fields of neutrino astronomy, cosmic ray physics, multi-messenger astronomy, particle physics, and beyond continue to emerge at an accelerated pace. IceCube data is dominated by background events, and thus teasing out the signal is the common challenge to most analyses. Statistical accumulation of data, along with better understanding of the background fluxes, the detector, and continued development of our analysis tools have produced many profound results that were presented at ICRC2023. Highlights covered here include the first neutrino observation of the Galactic Plane, the first observation of a steady emission neutrino point source NGC1068, new characterizations of the cosmic ray flux and its secondary particles, and a possible new era in measuring the energy spectrum of the diffuse astrophysical flux. IceCube is poised to make more discoveries and drive fields forward in the near future with many novel analyses coming online.


title: Direct programming of confined Surface Phonon Polariton Resonators using the plasmonic Phase-Change Material In$_3$SbTe$_2$

abstract: Tailoring light-matter interaction is essential to realize nanophotonic components. It can be achieved with surface phonon polaritons (SPhPs), an excitation of photons coupled with phonons of polar crystals, which also occur in 2d materials such as hexagonal boron nitride or anisotropic crystals. Ultra-confined resonances are observed by restricting the SPhPs to cavities. Phase-change materials (PCMs) enable non-volatile programming of these cavities based on a change in the refractive index. Recently, the new plasmonic PCM In$_3$SbTe$_2$ (IST) was introduced which can be reversibly switched from an amorphous dielectric state to a crystalline metallic one in the entire infrared to realize numerous nanoantenna geometries. However, reconfiguring SPhP resonators to modify the confined polaritons modes remains elusive. Here, we demonstrate direct programming of confined SPhP resonators by phase-switching IST on top of a polar silicon carbide crystal and investigate the strongly confined resonance modes with scanning near-field optical microscopy. Reconfiguring the size of the resonators themselves result in enhanced mode confinements up to a value of $\lambda/35$. Finally, unconventional cavity shapes with complex field patterns are explored as well. This study is a first step towards rapid prototyping of reconfigurable SPhP resonators that can be easily transferred to hyperbolic and anisotropic 2d materials.


title: Model-agnostic variable importance for predictive uncertainty: an entropy-based approach

abstract: In order to trust the predictions of a machine learning algorithm, it is necessary to understand the factors that contribute to those predictions. In the case of probabilistic and uncertainty-aware models, it is necessary to understand not only the reasons for the predictions themselves, but also the reasons for the model's level of confidence in those predictions. In this paper, we show how existing methods in explainability can be extended to uncertainty-aware models and how such extensions can be used to understand the sources of uncertainty in a model's predictive distribution. In particular, by adapting permutation feature importance, partial dependence plots, and individual conditional expectation plots, we demonstrate that novel insights into model behaviour may be obtained and that these methods can be used to measure the impact of features on both the entropy of the predictive distribution and the log-likelihood of the ground truth labels under that distribution. With experiments using both synthetic and real-world data, we demonstrate the utility of these approaches to understand both the sources of uncertainty and their impact on model performance.


title: Local behavior of critical points of isotropic Gaussian random fields

abstract: In this paper we examine isotropic Gaussian random fields defined on $\mathbb R^N$ satisfying certain conditions. Specifically, we investigate the type of a critical point situated within a small vicinity of another critical point, with both points surpassing a given threshold. It is shown that the Hessian of the random field at such a critical point is equally likely to have a positive or negative determinant. Furthermore, as the threshold tends to infinity, almost all the critical points above the threshold are local maxima and the saddle points with index $N-1$. Consequently, we conclude that the closely paired critical points above a high threshold must comprise one local maximum and one saddle point with index $N-1$.


title: Observational Characteristics of solar EUV waves

abstract: Extreme-ultraviolet (EUV) waves are one of the large-scale phenomena on the Sun. They are defined as large propagating fronts in the low corona with speeds ranging from a few tens km/s to a multiple of 1000 km/s. They are often associated with solar filament eruptions, flares, or coronal mass ejections (CMEs). EUV waves show different features, such as, wave and nonwave components, stationary fronts, reflection, refraction, and mode conversion. Apart from these, they can hit the nearby coronal loops and filaments/prominences during their propagation and trigger them to oscillate. These oscillating loops and filaments/prominences enable us to diagnose coronal parameters such as the coronal magnetic field strength. In this article, we present the different observed features of the EUV waves along with existing models.


title: On solution manifolds for algebraic-delay systems

abstract: Differential equations with state-dependent delays define a semiflow of continuously differentiable solution operators in general only on an associated submanifold of the Banach space $C^1([-h,0],\mathbb{R}^n)$. We extend a recent result on simplicity of these {\it solution manifolds} to systems where the delay is given by the state only implicitly in an extra equation. Such algebraic-delay systems arise from various applications. Key words: Delay differential equation, implicit state-dependent delay, solution manifold


title: Physical Information Neural Networks for Solving High-index Differential-algebraic Equation Systems Based on Radau Methods

abstract: As is well known, differential algebraic equations (DAEs), which are able to describe dynamic changes and underlying constraints, have been widely applied in engineering fields such as fluid dynamics, multi-body dynamics, mechanical systems and control theory. In practical physical modeling within these domains, the systems often generate high-index DAEs. Classical implicit numerical methods typically result in varying order reduction of numerical accuracy when solving high-index systems.~Recently, the physics-informed neural network (PINN) has gained attention for solving DAE systems. However, it faces challenges like the inability to directly solve high-index systems, lower predictive accuracy, and weaker generalization capabilities. In this paper, we propose a PINN computational framework, combined Radau IIA numerical method with a neural network structure via the attention mechanisms, to directly solve high-index DAEs. Furthermore, we employ a domain decomposition strategy to enhance solution accuracy. We conduct numerical experiments with two classical high-index systems as illustrative examples, investigating how different orders of the Radau IIA method affect the accuracy of neural network solutions. The experimental results demonstrate that the PINN based on a 5th-order Radau IIA method achieves the highest level of system accuracy. Specifically, the absolute errors for all differential variables remains as low as $10^{-6}$, and the absolute errors for algebraic variables is maintained at $10^{-5}$, surpassing the results found in existing literature. Therefore, our method exhibits excellent computational accuracy and strong generalization capabilities, providing a feasible approach for the high-precision solution of larger-scale DAEs with higher indices or challenging high-dimensional partial differential algebraic equation systems.


title: Correspondence between Color Glass Condensate and High-Twist Formalism

abstract: The Color Glass Condensate (CGC) effective theory and the collinear factorization at high-twist (HT) are two well-known frameworks describing perturbative QCD multiple scatterings in nuclear media. It has long been recognized that these two formalisms have their own domain of validity in different kinematics regions. Taking direct photon production in proton-nucleus collisions as an example, we clarify for the first time the relation between CGC and HT at the level of a physical observable. We show that the CGC formalism beyond shock-wave approximation, and with the Landau-Pomeranchuk-Migdal interference effect is consistent with the HT formalism in the transition region where they overlap. Such a unified picture paves the way for mapping out the phase diagram of parton density in nuclear medium from dilute to dense region.


title: Neural Degradation Representation Learning for All-In-One Image Restoration

abstract: Existing methods have demonstrated effective performance on a single degradation type. In practical applications, however, the degradation is often unknown, and the mismatch between the model and the degradation will result in a severe performance drop. In this paper, we propose an all-in-one image restoration network that tackles multiple degradations. Due to the heterogeneous nature of different types of degradations, it is difficult to process multiple degradations in a single network. To this end, we propose to learn a neural degradation representation (NDR) that captures the underlying characteristics of various degradations. The learned NDR decomposes different types of degradations adaptively, similar to a neural dictionary that represents basic degradation components. Subsequently, we develop a degradation query module and a degradation injection module to effectively recognize and utilize the specific degradation based on NDR, enabling the all-in-one restoration ability for multiple degradations. Moreover, we propose a bidirectional optimization strategy to effectively drive NDR to learn the degradation representation by optimizing the degradation and restoration processes alternately. Comprehensive experiments on representative types of degradations (including noise, haze, rain, and downsampling) demonstrate the effectiveness and generalization capability of our method.


title: Effect of physical and chemical pressure on the superconductivity of caged-type quasiskutterudite Lu5Rh6Sn18

abstract: Lu5Rh6Sn18 is one of the caged-type quasiskutterudite superconductors with superconducting transition temperature Tc = 4.12 K. Here, we investigate the effect of pressure on the superconductivity in Lu5Rh6Sn18 by combining high pressure electrical transport, synchrotron x-ray diffraction (XRD) and chemical doping. Application of high pressure can enhance both the metallicity and the superconducting transition temperature in Lu5Rh6Sn18. Tc is found to show a continuous increase reaching up to 5.50 K at 11.4 GPa. Our high pressure synchrotron XRD measurements demonstrate the stability of the pristine crystal structure up to 12.0 GPa. In contrast, Tc is suppressed after the substitution of La ions in Lu sites, inducing negative chemical pressure. Our study provides valuable insights into the improvement of superconductivity in caged compounds.


title: Pressure-induced Superconductivity and Topological Quantum Phase Transitions in the Topological Semimetal ZrTe2

abstract: Topological transition metal dichalcogenides (TMDCs) have attracted much attention due to its potential applications in spintronics and quantum computations. In this work, we systematically investigate the structural and electronic properties of topological TMDCs candidate ZrTe2 under high pressure. A pressure-induced Lifshitz transition is evidenced by the change of charge carrier type as well as the Fermi surface. Superconductivity was observed at around 8.3 GPa without structural phase transition. A typical dome-shape phase diagram is obtained with the maximum Tc of 5.6 K for ZrTe2. Furthermore, our theoretical calculations suggest the presence of multiple pressure-induced topological quantum phase transitions, which coexists with emergence of superconductivity. The results demonstrate that ZrTe2 with nontrivial topology of electronic states display new ground states upon compression.


title: EmoDiarize: Speaker Diarization and Emotion Identification from Speech Signals using Convolutional Neural Networks

abstract: In the era of advanced artificial intelligence and human-computer interaction, identifying emotions in spoken language is paramount. This research explores the integration of deep learning techniques in speech emotion recognition, offering a comprehensive solution to the challenges associated with speaker diarization and emotion identification. It introduces a framework that combines a pre-existing speaker diarization pipeline and an emotion identification model built on a Convolutional Neural Network (CNN) to achieve higher precision. The proposed model was trained on data from five speech emotion datasets, namely, RAVDESS, CREMA-D, SAVEE, TESS, and Movie Clips, out of which the latter is a speech emotion dataset created specifically for this research. The features extracted from each sample include Mel Frequency Cepstral Coefficients (MFCC), Zero Crossing Rate (ZCR), Root Mean Square (RMS), and various data augmentation algorithms like pitch, noise, stretch, and shift. This feature extraction approach aims to enhance prediction accuracy while reducing computational complexity. The proposed model yields an unweighted accuracy of 63%, demonstrating remarkable efficiency in accurately identifying emotional states within speech signals.


title: Quantum Annealing Solutions for the Closest String Problem with D-Wave Systems

abstract: The Closest String Problem is an NP-complete problem which appears more commonly in bioinformatics and coding theory. Less surprisingly, classical approaches have been pursued with two prominent algorithms being the genetic algorithm and simulated annealing. Latest improvements to quantum computing devices with a specialization in optimization tasks such as DWave systems, suggest that an attempt to embed the problem in a model accepted by such systems is worthwhile. In this work, two QUBO formulations have been proposed, with one being a slight modification over the other. Subsequently, an evaluation based on a few simple test cases had been carried out on both formulations. In this regard, the D-Wave annealers have been used, while providing guidelines for optimality on certain platform-specific concerns. For evaluation purposes, a metric termed Occurrence Ratio (OR) has been defined. With minimal hyperparameter tuning, the expected solutions were obtained for every test case and the optimality was guaranteed. To address practical and implementation issues, an inherent decomposition strategy based on the possibility of having substrings has been elucidated to accommodate the restricted qubit count. Conclusively, the need for further investigation on tuning the hyperparameters is emphasized.


title: Sum-of-squares certificates for copositivity via test states

abstract: In 1995, Reznick showed an important variant of the obvious fact that any positive semidefinite (real) quadratic form is a sum of squares of linear forms: If a form (of arbitrary even degree) is positive definite then it becomes a sum of squares of forms after being multiplied by a sufficiently high power of the sum of its squared variables. If the form is just positive \emph{semi}definite instead of positive definite, this fails badly in general. In this work, we identify however two classes of positive semidefinite even quartic forms for which the statement continues to hold even though they have in general infinitely many projective real zeros. The first class consists of all even quartic positive semidefinite forms in five variables. This provides a natural certificate for a matrix of size five being copositive and answers positively a question asked by Laurent and the second author in 2022. The second class consists of certain quartic positive semidefinite forms that arise from graphs and their stability number. This shows finite convergence of a hierarchy of semidefinite approximations for the stability number of a graph proposed by de Klerk and Pasechnik in 2002. In both cases, the main tool for the proofs is the method of pure states on ideals developed by Burgdorf, Scheiderer and the first author in 2012. We hope to make this method more accessible by introducing the notion of a \emph{test state}.


title: Redundant String Symmetry-Based Error Correction: Experiments on Quantum Devices

abstract: Computational power in measurement-based quantum computing (MBQC) stems from symmetry protected topological (SPT) order of the entangled resource state. But resource states are prone to preparation errors. We introduce a quantum error correction (QEC) approach using redundant non-local symmetry of the resource state. We demonstrate it within a teleportation protocol based on extending the $\mathbb{Z}_2 \times \mathbb{Z}_2$ symmetry of one-dimensional cluster states to other graph states. Qubit ZZ-crosstalk errors, which are prominent in quantum devices, degrade the teleportation fidelity of the usual cluster state. However, as we demonstrate experimentally, once we grow graph states with redundant symmetry, perfect teleportation fidelity is restored. We identify the underlying redundant-SPT order as error-protected degeneracies in the entanglement spectrum.


title: Convective scale and subadiabatic layers in simulations of rotating compressible convection

abstract: (abridged) Context: Rotation is thought to influence the size of convective eddies and the efficiency of convective energy transport in the deep convection zones of stars. Rotationally constrained convection has been invoked to explain the lack of large-scale power in observations of solar flows. Aims: The main aims are to quantify the effects of rotation on the scale of convective eddies and velocity, the depths of convective overshoot, and the subadiabatic Deardorff layers. Methods: Three-dimensional hydrodynamic simulations of rotating convection in Cartesian domains were run. The results were compared with theoretical scaling results that assume a balance between Coriolis, inertial, and buoyancy (Archemedean) forces (CIA balance). Results: The scale of convective eddies decreases as rotation increases, and ultimately reaches a rotationally constrained regime consistent with the CIA balance. Using a new measure of the rotational influence on the system, it is shown that even the deep parts of the solar convection zone are not in the rotationally constrained regime. The simulations capture the slowly and rapidly rotating scaling laws predicted by theory, and the Sun appears to be in between these two regimes. Both, the overshooting depth and the extent of the Deardorff layer, decrease as rotation becomes more rapid. For sufficiently rapid rotation the Deardorff layer is absent. Conclusions: Relating the simulations with the Sun suggests that the convective scale even in the deep parts of the Sun is only mildly affected by rotation and that some other mechanism is needed to explain the lack of strong large-scale flows in the Sun. Taking the current results at face value, the overshoot and Deardorff layers are estimated to span roughly five per cent of the pressure scale height at the base of the convection zone in the Sun.


title: A Narrow Uniform Core with a Wide Structured Wing: Modeling the TeV and Multi-wavelength Afterglows of GRB 221009A

abstract: The TeV afterglow of the BOAT GRB 221009A was interpreted as arising from a narrow jet while the radio to X-ray afterglows were interpreted as arising from a wide structured jet. However, there is no model explaining the TeV and lower-energy multi-wavelength afterglows simultaneously. We here investigate a two-component jet model, including a narrow uniform core with a wide structured wing, to explain both the multi-wavelength afterglows that last up to 100 days. We find that to explain the early TeV afterglow with the inverse-Compton process, we need a circum-burst density higher than $\gtrsim 0.1{\rm cm^{-3}}$, while the radio afterglow and the H.E.S.S. upper limit combine to constrain the density to be lower at larger radii. Thus, a decreasing density profile with radius is favored. Considering that the rising TeV light curve during the afterglow onset favors a constant-density medium, we invoke a stratified density profile, including a constant-density profile at small radii and a wind density profile at large radii. We find that the two-component jet model with such a stratified density profile can explain the TeV, X-ray and optical afterglows of GRB 221009A, although the radio fluxes exceed the observed ones by a factor of two at later epochs. The discrepancy in the radio afterglow could be resolved by invoking some non-standard assumption about the microphysics of afterglow shocks. The total kinetic energy of the two components in our model is $\lesssim 10^{52}{\rm erg}$, significantly smaller than that in the single structured jet models.


title: Lie-Trotter means in JB-algebras

abstract: We initiate the study of Lie-Trotter means in JB-algebras, which is an extension of Lie-Trotter formulas in JB-algebras. We show that two-variable Lie-Trotter means include the weighted arithmetic mean, weighted harmonic mean, weighted geometric mean, and weighted spectral geometric mean. Consequently, several generalized Lie-Trotter formulas in JB-algebras are derived. Additionally, we demonstrate that the Sagae-Tanabe mean and Hansen's induction mean in JB-algebras are multivariable Lie-Trotter means. In the end, using arithmetic-geometric-harmonic mean inequalities we provide a characterization of multivariate Lie-Trotter means.


title: Audio Editing with Non-Rigid Text Prompts

abstract: In this paper, we explore audio-editing with non-rigid text edits. We show that the proposed editing pipeline is able to create audio edits that remain faithful to the input audio. We explore text prompts that perform addition, style transfer, and in-painting. We quantitatively and qualitatively show that the edits are able to obtain results which outperform Audio-LDM, a recently released text-prompted audio generation model. Qualitative inspection of the results points out that the edits given by our approach remain more faithful to the input audio in terms of keeping the original onsets and offsets of the audio events.


title: The Universe is not statistically isotropic

abstract: The standard cosmological model predicts statistically isotropic cosmic microwave background (CMB) fluctuations. However, several summary statistics of CMB isotropy have anomalous values, including: the low level of large-angle temperature correlations, $S_{1/2}$; the excess power in odd versus even low-$\ell$ multipoles, $R^{TT}$; the (low) variance of large-scale temperature anisotropies in the ecliptic north, but not the south, $\sigma^2_{16}$; and the alignment and planarity of the quadrupole and octopole of temperature, $S_{QO}$. Individually, their low $p$-values are weak evidence for violation of statistical isotropy. The correlations of the tail values of these statistics have not to this point been studied. We show that the joint probability of all four of these happening by chance in $\Lambda$CDM is likely $\leq3\times10^{-8}$. This constitutes more than $5\sigma$ evidence for violation of statistical isotropy.


title: Probing LLMs for hate speech detection: strengths and vulnerabilities

abstract: Recently efforts have been made by social media platforms as well as researchers to detect hateful or toxic language using large language models. However, none of these works aim to use explanation, additional context and victim community information in the detection process. We utilise different prompt variation, input information and evaluate large language models in zero shot setting (without adding any in-context examples). We select three large language models (GPT-3.5, text-davinci and Flan-T5) and three datasets - HateXplain, implicit hate and ToxicSpans. We find that on average including the target information in the pipeline improves the model performance substantially (~20-30%) over the baseline across the datasets. There is also a considerable effect of adding the rationales/explanations into the pipeline (~10-20%) over the baseline across the datasets. In addition, we further provide a typology of the error cases where these large language models fail to (i) classify and (ii) explain the reason for the decisions they take. Such vulnerable points automatically constitute 'jailbreak' prompts for these models and industry scale safeguard techniques need to be developed to make the models robust against such prompts.


title: Mathematical theory on dipolar resonances of hard inclusions within a soft elastic material

abstract: The current study is motivated by the paper [Z. Liu, et al., {\it Science}, 289(5485), 2000], which investigates the incorporation of hard inclusions within a soft elastic matrix (HISE). The objective is to attain a negative mass density, which is caused by sub-wavelength dipolar resonances. This paper offers a comprehensive and mathematically rigorous understanding of the dipolar resonances within the HISE structure. Firstly, the original formula for the resonant frequencies of arbitrarily shaped hard inclusions is derived explicitly for the first time. Additionally, we demonstrate that the resonances arise due to the high contrast in Lam\'e parameters between various materials, while the sub-wavelength characteristics of the resonances are attributed to the significant disparities in material densities. Furthermore, the dipolar characterization of the resonances is rigorously justified. To validate our findings, we investigate resonant phenomena within a spherical geometry, offering both an alternative method for calculating resonant frequencies and a confirmation of the results presented in this paper.


title: Fine-Tuning Generative Models as an Inference Method for Robotic Tasks

abstract: Adaptable models could greatly benefit robotic agents operating in the real world, allowing them to deal with novel and varying conditions. While approaches such as Bayesian inference are well-studied frameworks for adapting models to evidence, we build on recent advances in deep generative models which have greatly affected many areas of robotics. Harnessing modern GPU acceleration, we investigate how to quickly adapt the sample generation of neural network models to observations in robotic tasks. We propose a simple and general method that is applicable to various deep generative models and robotic environments. The key idea is to quickly fine-tune the model by fitting it to generated samples matching the observed evidence, using the cross-entropy method. We show that our method can be applied to both autoregressive models and variational autoencoders, and demonstrate its usability in object shape inference from grasping, inverse kinematics calculation, and point cloud completion.


title: A remark on moment-dependent phase transitions in high-dimensional Gaussian approximations

abstract: In this article, we study the critical growth rates of dimension below which Gaussian critical values can be used for hypothesis testing but beyond which they cannot. We are particularly interested in how these growth rates depend on the number of moments that the observations possess.


title: The Locality and Symmetry of Positional Encodings

abstract: Positional Encodings (PEs) are used to inject word-order information into transformer-based language models. While they can significantly enhance the quality of sentence representations, their specific contribution to language models is not fully understood, especially given recent findings that various positional encodings are insensitive to word order. In this work, we conduct a systematic study of positional encodings in \textbf{Bidirectional Masked Language Models} (BERT-style) , which complements existing work in three aspects: (1) We uncover the core function of PEs by identifying two common properties, Locality and Symmetry; (2) We show that the two properties are closely correlated with the performances of downstream tasks; (3) We quantify the weakness of current PEs by introducing two new probing tasks, on which current PEs perform poorly. We believe that these results are the basis for developing better PEs for transformer-based language models. The code is available at \faGithub~ \url{https://github.com/tigerchen52/locality\_symmetry}