title: Spaces of Legendrian cables and Seifert fibered links

abstract: We determine the homotopy type of the spaces of several Legendrian knots and links with the maximal Thurston--Bennequin invariant. In particular, we give a recursive formula of the homotopy type of the space of Legendrian embeddings of sufficiently positive cables, and determine the homotopy type of the space of Legendrian embeddings of Seifert fibered links, which include all torus knots and links, in the standard contact 3-sphere, except when one of the link components is a negative torus knot. In general, we prove that the space of contact structures on the complement of a sufficiently positive Legendrian cable with the maximal Thurston-Bennequin invariant is homotopy equivalent to the space of contact structures on the complement of the underlying Legendrian knot, and prove that the space of contact structures on a Legendrian Seifert fibered space over a compact oriented surface with boundary is contractible. From this result, we find infinitely many new components of the space of Legendrian embeddings in the standard contact 3-sphere that satisfy an injective h-principle. These include the spaces of Legendrian embeddings of an algebraic link with the maximal Thurston--Bennequin invariant. In particular, the inclusion of these Legendrian embedding spaces into the corresponding formal Legendrian embedding spaces is a homotopy injection.


title: Online Learning and Planning in Cognitive Hierarchies

abstract: Complex robot behaviour typically requires the integration of multiple robotic and Artificial Intelligence (AI) techniques and components. Integrating such disparate components into a coherent system, while also ensuring global properties and behaviours, is a significant challenge for cognitive robotics. Using a formal framework to model the interactions between components can be an important step in dealing with this challenge. In this paper we extend an existing formal framework [Clark et al., 2016] to model complex integrated reasoning behaviours of robotic systems; from symbolic planning through to online learning of policies and transition systems. Furthermore the new framework allows for a more flexible modelling of the interactions between different reasoning components.


title: Learning to Optimise Climate Sensor Placement using a Transformer

abstract: The optimal placement of sensors for environmental monitoring and disaster management is a challenging problem due to its NP-hard nature. Traditional methods for sensor placement involve exact, approximation, or heuristic approaches, with the latter being the most widely used. However, heuristic methods are limited by expert intuition and experience. Deep learning (DL) has emerged as a promising approach for generating heuristic algorithms automatically. In this paper, we introduce a novel sensor placement approach focused on learning improvement heuristics using deep reinforcement learning (RL) methods. Our approach leverages an RL formulation for learning improvement heuristics, driven by an actor-critic algorithm for training the policy network. We compare our method with several state-of-the-art approaches by conducting comprehensive experiments, demonstrating the effectiveness and superiority of our proposed approach in producing high-quality solutions. Our work presents a promising direction for applying advanced DL and RL techniques to challenging climate sensor placement problems.


title: Countable modular groups of infinite type surfaces

abstract: We prove that every infinite type surface without boundary and finite genus has a Riemann surface structure such that its modular group of quasiconformal homeomorphisms is countable.


title: Quantum Computing for MIMO Beam Selection Problem: Model and Optical Experimental Solution

abstract: Massive multiple-input multiple-output (MIMO) has gained widespread popularity in recent years due to its ability to increase data rates, improve signal quality, and provide better coverage in challenging environments. In this paper, we investigate the MIMO beam selection (MBS) problem, which is proven to be NP-hard and computationally intractable. To deal with this problem, quantum computing that can provide faster and more efficient solutions to large-scale combinatorial optimization is considered. MBS is formulated in a quadratic unbounded binary optimization form and solved with Coherent Ising Machine (CIM) physical machine. We compare the performance of our solution with two classic heuristics, simulated annealing and Tabu search. The results demonstrate an average performance improvement by a factor of 261.23 and 20.6, respectively, which shows that CIM-based solution performs significantly better in terms of selecting the optimal subset of beams. This work shows great promise for practical 5G operation and promotes the application of quantum computing in solving computationally hard problems in communication.


title: What is the meaning of physical quantity $\nu$ in the expression of photon energy $h\nu$?

abstract: It is well known that, for an incident light of not so high intensity and in a certain range of frequency, the stopping voltage of photoelectric effect is independent of the intensity but dependent on the frequency of the light, which is described by the equation $V = h\nu /e - {W_0}/e$, where $V$ is the stopping voltage, $h$ is the Planck constant, $\nu$ is the frequency of incident light, $e$ is the electron charge, and $W_0$ is the work function. It means that the larger the frequency of incident light, the higher the stopping voltage is. However, the present experiment finds that for a non-monochromatic incident light, the stopping voltage is not determined by the maximum frequency component of the incident light, but by the maximum center frequency of all the wave train components (with different center frequencies) involved in the incident light, that is to say, in the photon energy expression $h\nu$, physical quantity $\nu$ does not refer to the frequency of a monochromatic light, but represents the center frequency of a wave train spectrum. The spectral bandwidth of a wave train component can be as large as 122 nm in visible and near-infrared region. This should arouse more attention in the study of energy exchange between light and matter.


title: Real-time Semiparametric Regression via Sequential Monte Carlo

abstract: We develop and describe online algorithms for performing real-time semiparametric regression analyses. Earlier work on this topic is in Luts, Broderick & Wand (J. Comput. Graph. Statist., 2014) where online mean field variational Bayes was employed. In this article we instead develop sequential Monte Carlo approaches to circumvent well-known inaccuracies inherent in variational approaches. Even though sequential Monte Carlo is not as fast as online mean field variational Bayes, it can be a viable alternative for applications where the data rate is not overly high. For Gaussian response semiparametric regression models our new algorithms share the online mean field variational Bayes property of only requiring updating and storage of sufficient statistics quantities of streaming data. In the non-Gaussian case accurate real-time semiparametric regression requires the full data to be kept in storage. The new algorithms allow for new options concerning accuracy/speed trade-offs for real-time semiparametric regression.


title: Long-lived neutral fermions at the DUNE near detector

abstract: At the Deep Underground Neutrino Experiment (DUNE), a proton beam hits a fixed target leading to large production rates of mesons. These mesons can decay and potentially provide a source of long-lived neutral fermions. Examples of such long-lived fermions are heavy neutral leptons which can mix with the standard-model active neutrinos, and the bino-like lightest neutralino in R-parity-violating supersymmetry. We show that the Standard Model Effective Field Theory extended with right-handed singlet neutrinos can simultaneously describe heavy neutral leptons and bino-like neutralinos in a unified manner. We use the effective-field-theory framework to determine the sensitivity reach of the DUNE near detector in probing various scenarios of long-lived neutral fermions.


title: Deep Learning Techniques for Video Instance Segmentation: A Survey

abstract: Video instance segmentation, also known as multi-object tracking and segmentation, is an emerging computer vision research area introduced in 2019, aiming at detecting, segmenting, and tracking instances in videos simultaneously. By tackling the video instance segmentation tasks through effective analysis and utilization of visual information in videos, a range of computer vision-enabled applications (e.g., human action recognition, medical image processing, autonomous vehicle navigation, surveillance, etc) can be implemented. As deep-learning techniques take a dominant role in various computer vision areas, a plethora of deep-learning-based video instance segmentation schemes have been proposed. This survey offers a multifaceted view of deep-learning schemes for video instance segmentation, covering various architectural paradigms, along with comparisons of functional performance, model complexity, and computational overheads. In addition to the common architectural designs, auxiliary techniques for improving the performance of deep-learning models for video instance segmentation are compiled and discussed. Finally, we discuss a range of major challenges and directions for further investigations to help advance this promising research field.


title: An $O(\log n)$-Competitive Posted-Price Algorithm for Online Matching on the Line

abstract: Motivated by demand-responsive parking pricing systems, we consider posted-price algorithms for the online metric matching problem. We give an $O(\log n)$-competitive posted-price randomized algorithm in the case that the metric space is a line. In particular, in this setting we show how to implement the ubiquitous guess-and-double technique using prices.


title: Closed-Form Diffusion Models

abstract: Score-based generative models (SGMs) sample from a target distribution by iteratively transforming noise using the score function of the perturbed target. For any finite training set, this score function can be evaluated in closed form, but the resulting SGM memorizes its training data and does not generate novel samples. In practice, one approximates the score by training a neural network via score-matching. The error in this approximation promotes generalization, but neural SGMs are costly to train and sample, and the effective regularization this error provides is not well-understood theoretically. In this work, we instead explicitly smooth the closed-form score to obtain an SGM that generates novel samples without training. We analyze our model and propose an efficient nearest-neighbor-based estimator of its score function. Using this estimator, our method achieves sampling times competitive with neural SGMs while running on consumer-grade CPUs.


title: Estimation of mutual information via quantum kernel method

abstract: Recently, the importance of analysing data and collecting valuable insight efficiently has been increasing in various fields. Estimating mutual information (MI) plays a critical role to investigate the relationship among multiple random variables with a nonlinear correlation. Particularly, the task to determine whether they are independent or not is called the independence test, whose core subroutine is estimating MI from given data. It is a fundamental tool in statistics and data analysis that can be applied in a wide range of application such as hypothesis testing, causal discovery and more. In this paper, we propose a method for estimating mutual information using the quantum kernel. We investigate the performance under various problem settings, such as different sample size or the shape of the probability distribution. As a result, the quantum kernel method showed higher performance than the classical one under the situation that the number of samples is small, the variance is large or the variables posses highly non-linear relationships. We discuss this behavior in terms of the central limit theorem and the structure of the corresponding quantum reproducing kernel Hilbert space.


title: GPT-4 Doesn't Know It's Wrong: An Analysis of Iterative Prompting for Reasoning Problems

abstract: There has been considerable divergence of opinion on the reasoning abilities of Large Language Models (LLMs). While the initial optimism that reasoning might emerge automatically with scale has been tempered thanks to a slew of counterexamples, a wide spread belief in their iterative self-critique capabilities persists. In this paper, we set out to systematically investigate the effectiveness of iterative prompting of LLMs in the context of Graph Coloring, a canonical NP-complete reasoning problem that is related to propositional satisfiability as well as practical problems like scheduling and allocation. We present a principled empirical study of the performance of GPT4 in solving graph coloring instances or verifying the correctness of candidate colorings. In iterative modes, we experiment with the model critiquing its own answers and an external correct reasoner verifying proposed solutions. In both cases, we analyze whether the content of the criticisms actually affects bottom line performance. The study seems to indicate that (i) LLMs are bad at solving graph coloring instances (ii) they are no better at verifying a solution--and thus are not effective in iterative modes with LLMs critiquing LLM-generated solutions (iii) the correctness and content of the criticisms--whether by LLMs or external solvers--seems largely irrelevant to the performance of iterative prompting. We show that the observed increase in effectiveness is largely due to the correct solution being fortuitously present in the top-k completions of the prompt (and being recognized as such by an external verifier). Our results thus call into question claims about the self-critiquing capabilities of state of the art LLMs.


title: $X_0(2900)$ and its spin partners production in the $B^+$ decay process

abstract: In the present work, we investigate $X_0(2900)$ and its spin partners productions in the $B^+$ decay processes, where $X_0(2900)$ is regarded as a $\bar{D}^\ast K^\ast$ molecular state. We infer that the initial $B^+$ meson and the final $D^+ X_0(2900)$ are connected through $D_{s1}^+(2460) \bar{D}^{\ast 0} $ mesons by exchanging a $K^{\ast 0}$ meson. The contributions from such a meson loop to the process $B^+ \to D^+ X_0(2900)$ are evaluated and our estimations indicate that the measured branching fraction of $B^+\to D^+ X_0(2900)$ could be well reproduced in a reasonable model parameter range, which indicates that $X_0(2900)$ could be interpreted as a $\bar{D}^\ast K^\ast $ molecular state. In addition, the production processes $B^+ \to D^+ \tilde{X}_{1,2}$, $B^+ \to D^{\ast +} X_0(2900)$, and $B^+ \to D^{\ast +}\tilde{X}_{1,2}$ are investigated, and we find that the fit fraction of $\tilde{X}_1$ in the process $B^+ \to D^{\ast +} D^{\ast -} K^+$ is aobut $6\%$, which should be accessible experimentally.


title: A New Time Series Similarity Measure and Its Smart Grid Applications

abstract: Many smart grid applications involve data mining, clustering, classification, identification, and anomaly detection, among others. These applications primarily depend on the measurement of similarity, which is the distance between different time series or subsequences of a time series. The commonly used time series distance measures, namely Euclidean Distance (ED) and Dynamic Time Warping (DTW), do not quantify the flexible nature of electricity usage data in terms of temporal dynamics. As a result, there is a need for a new distance measure that can quantify both the amplitude and temporal changes of electricity time series for smart grid applications, e.g., demand response and load profiling. This paper introduces a novel distance measure to compare electricity usage patterns. The method consists of two phases that quantify the effort required to reshape one time series into another, considering both amplitude and temporal changes. The proposed method is evaluated against ED and DTW using real-world data in three smart grid applications. Overall, the proposed measure outperforms ED and DTW in accurately identifying the best load scheduling strategy, anomalous days with irregular electricity usage, and determining electricity users' behind-the-meter (BTM) equipment.


title: Solution to Hessian type equations with prescribed singularity on compact Kahler manifold

abstract: Let $(X,\omega)$ be a compact K\"ahler manifold of dimension $n$ and fix an integer $m$ such that $1\leq m\leq n$. We reformulate most relative pluripotential results of Darvas-DiNezza-Lu's survey \cite{DNL23} to the Hessian setting. As an application, we use a slightly different method and give an characterization of finite energy range of the Hessian operator, which cannot be directly reformulated by \cite{DNL23}. Given a model potential $\phi$, we also study degenerate complex Hessian equations of the form $(\omega+dd^c \varphi)^m\wedge\omega^{n-m}=F(x,\varphi)\omega^n$. Under some natrual conditions on $F$, we prove that the solution of this type equation has the same singularity type as $\phi$.


title: Privacy-Preserving Hierarchical Anonymization Framework over Encrypted Data

abstract: Smart cities, which can monitor the real world and provide smart services in a variety of fields, have improved people's living standards as urbanization has accelerated. However, there are security and privacy concerns because smart city applications collect large amounts of privacy-sensitive information from people and their social circles. Anonymization, which generalizes data and reduces data uniqueness is an important step in preserving the privacy of sensitive information. However, anonymization methods frequently require large datasets and rely on untrusted third parties to collect and manage data, particularly in a cloud environment. In this case, private data leakage remains a critical issue, discouraging users from sharing their data and impeding the advancement of smart city services. This problem can be solved if the computational entity can perform the anonymization process without obtaining the original plain text. This study proposed a hierarchical k-anonymization framework using homomorphic encryption and secret sharing composed of two types of domains. Different computing methods are selected flexibly, and two domains are connected hierarchically to obtain higher-level anonymization results in an efficient manner. The experimental results show that connecting two domains can accelerate the anonymization process, indicating that the proposed secure hierarchical architecture is practical and efficient.


title: Sufficient dimension reduction for regression with metric space-valued responses

abstract: Data visualization and dimension reduction for regression between a general metric space-valued response and Euclidean predictors is proposed. Current Fr\'ech\'et dimension reduction methods require that the response metric space be continuously embeddable into a Hilbert space, which imposes restriction on the type of metric and kernel choice. We relax this assumption by proposing a Euclidean embedding technique which avoids the use of kernels. Under this framework, classical dimension reduction methods such as ordinary least squares and sliced inverse regression are extended. An extensive simulation experiment demonstrates the superior performance of the proposed method on synthetic data compared to existing methods where applicable. The real data analysis of factors influencing the distribution of COVID-19 transmission in the U.S. and the association between BMI and structural brain connectivity of healthy individuals are also investigated.


title: Cooperative Minibatching in Graph Neural Networks

abstract: Significant computational resources are required to train Graph Neural Networks (GNNs) at a large scale, and the process is highly data-intensive. One of the most effective ways to reduce resource requirements is minibatch training coupled with graph sampling. GNNs have the unique property that items in a minibatch have overlapping data. However, the commonly implemented Independent Minibatching approach assigns each Processing Element (PE) its own minibatch to process, leading to duplicated computations and input data access across PEs. This amplifies the Neighborhood Explosion Phenomenon (NEP), which is the main bottleneck limiting scaling. To reduce the effects of NEP in the multi-PE setting, we propose a new approach called Cooperative Minibatching. Our approach capitalizes on the fact that the size of the sampled subgraph is a concave function of the batch size, leading to significant reductions in the amount of work per seed vertex as batch sizes increase. Hence, it is favorable for processors equipped with a fast interconnect to work on a large minibatch together as a single larger processor, instead of working on separate smaller minibatches, even though global batch size is identical. We also show how to take advantage of the same phenomenon in serial execution by generating dependent consecutive minibatches. Our experimental evaluations show up to 4x bandwidth savings for fetching vertex embeddings, by simply increasing this dependency without harming model convergence. Combining our proposed approaches, we achieve up to 64% speedup over Independent Minibatching on single-node multi-GPU systems.


title: Loop Copilot: Conducting AI Ensembles for Music Generation and Iterative Editing

abstract: Creating music is iterative, requiring varied methods at each stage. However, existing AI music systems fall short in orchestrating multiple subsystems for diverse needs. To address this gap, we introduce Loop Copilot, a novel system that enables users to generate and iteratively refine music through an interactive, multi-round dialogue interface. The system uses a large language model to interpret user intentions and select appropriate AI models for task execution. Each backend model is specialized for a specific task, and their outputs are aggregated to meet the user's requirements. To ensure musical coherence, essential attributes are maintained in a centralized table. We evaluate the effectiveness of the proposed system through semi-structured interviews and questionnaires, highlighting its utility not only in facilitating music creation but also its potential for broader applications.


title: LoMAE: Low-level Vision Masked Autoencoders for Low-dose CT Denoising

abstract: Low-dose computed tomography (LDCT) offers reduced X-ray radiation exposure but at the cost of compromised image quality, characterized by increased noise and artifacts. Recently, transformer models emerged as a promising avenue to enhance LDCT image quality. However, the success of such models relies on a large amount of paired noisy and clean images, which are often scarce in clinical settings. In the fields of computer vision and natural language processing, masked autoencoders (MAE) have been recognized as an effective label-free self-pretraining method for transformers, due to their exceptional feature representation ability. However, the original pretraining and fine-tuning design fails to work in low-level vision tasks like denoising. In response to this challenge, we redesign the classical encoder-decoder learning model and facilitate a simple yet effective low-level vision MAE, referred to as LoMAE, tailored to address the LDCT denoising problem. Moreover, we introduce an MAE-GradCAM method to shed light on the latent learning mechanisms of the MAE/LoMAE. Additionally, we explore the LoMAE's robustness and generability across a variety of noise levels. Experiments results show that the proposed LoMAE can enhance the transformer's denoising performance and greatly relieve the dependence on the ground truth clean data. It also demonstrates remarkable robustness and generalizability over a spectrum of noise levels.


title: FinEntity: Entity-level Sentiment Classification for Financial Texts

abstract: In the financial domain, conducting entity-level sentiment analysis is crucial for accurately assessing the sentiment directed toward a specific financial entity. To our knowledge, no publicly available dataset currently exists for this purpose. In this work, we introduce an entity-level sentiment classification dataset, called \textbf{FinEntity}, that annotates financial entity spans and their sentiment (positive, neutral, and negative) in financial news. We document the dataset construction process in the paper. Additionally, we benchmark several pre-trained models (BERT, FinBERT, etc.) and ChatGPT on entity-level sentiment classification. In a case study, we demonstrate the practical utility of using FinEntity in monitoring cryptocurrency markets. The data and code of FinEntity is available at \url{https://github.com/yixuantt/FinEntity}


title: Classification-Aided Robust Multiple Target Tracking Using Neural Enhanced Message Passing

abstract: We address the challenge of tracking an unknown number of targets in strong clutter environments using measurements from a radar sensor. Leveraging the range-Doppler spectra information, we identify the measurement classes, which serve as additional information to enhance clutter rejection and data association, thus bolstering the robustness of target tracking. We first introduce a novel neural enhanced message passing approach, where the beliefs obtained by the unified message passing are fed into the neural network as additional information. The output beliefs are then utilized to refine the original beliefs. Then, we propose a classification-aided robust multiple target tracking algorithm, employing the neural enhanced message passing technique. This algorithm is comprised of three modules: a message-passing module, a neural network module, and a Dempster-Shafer module. The message-passing module is used to represent the statistical model by the factor graph and infers target kinematic states, visibility states, and data associations based on the spatial measurement information. The neural network module is employed to extract features from range-Doppler spectra and derive beliefs on whether a measurement is target-generated or clutter-generated. The Dempster-Shafer module is used to fuse the beliefs obtained from both the factor graph and the neural network. As a result, our proposed algorithm adopts a model-and-data-driven framework, effectively enhancing clutter suppression and data association, leading to significant improvements in multiple target tracking performance. We validate the effectiveness of our approach using both simulated and real data scenarios, demonstrating its capability to handle challenging tracking scenarios in practical radar applications.


title: Provable Guarantees for Neural Networks via Gradient Feature Learning

abstract: Neural networks have achieved remarkable empirical performance, while the current theoretical analysis is not adequate for understanding their success, e.g., the Neural Tangent Kernel approach fails to capture their key feature learning ability, while recent analyses on feature learning are typically problem-specific. This work proposes a unified analysis framework for two-layer networks trained by gradient descent. The framework is centered around the principle of feature learning from gradients, and its effectiveness is demonstrated by applications in several prototypical problems, such as mixtures of Gaussians and parity functions. The framework also sheds light on interesting network learning phenomena such as feature learning beyond kernels and the lottery ticket hypothesis.


title: Object-Aware Impedance Control for Human-Robot Collaborative Task with Online Object Parameter Estimation

abstract: Physical human-robot interactions (pHRIs) can improve robot autonomy and reduce physical demands on humans. In this paper, we consider a collaborative task with a considerably long object and no prior knowledge of the object's parameters. An integrated control framework with an online object parameter estimator and a Cartesian object-aware impedance controller is proposed to realize complicated scenarios. During the transportation task, the object parameters are estimated online while a robot and human lift an object. The perturbation motion is incorporated into the null space of the desired trajectory to enhance the estimator accuracy. An object-aware impedance controller is designed using the real-time estimation results to effectively transmit the intended human motion to the robot through the object. Experimental demonstrations of collaborative tasks, including object transportation and assembly tasks, are implemented to show the effectiveness of our proposed method.


title: Crossover from string to cluster dynamics following a field quench in spin ice

abstract: We investigate quench dynamics of spin ice after removal of a strong magnetic field along the [100] crystal direction, using Monte Carlo simulations and theoretical arguments. We show how the early-time relaxation of the magnetization can be understood in terms of nucleation and growth of strings of flipped spins, in agreement with an effective stochastic model that we introduce and solve analytically. We demonstrate a crossover at longer times to a regime dominated by approximately isotropic clusters, which we characterize in terms of their morphology, and present evidence for a percolation transition as a function of magnetization.


title: Online Multi-IMU Calibration Using Visual-Inertial Odometry

abstract: This work presents a centralized multi-IMU filter framework with online intrinsic and extrinsic calibration for unsynchronized inertial measurement units that is robust against changes in calibration parameters. The novel EKF-based method estimates the positional and rotational offsets of the system of sensors as well as their intrinsic biases without the use of rigid body geometric constraints. Additionally, the filter is flexible in the total number of sensors used while leveraging the commonly used MSCKF framework for camera measurements. The filter framework has been validated using Monte Carlo simulation as well as experimentally. In both simulations and experiments, using multiple IMU measurement streams within the proposed filter framework outperforms the use of a single IMU in a filter prediction step while also producing consistent and accurate estimates of initial calibration errors. Compared to current state-of-the-art optimizers, the filter produces similar intrinsic and extrinsic calibration parameters for each sensor. Finally, an open source repository has been provided at https://github.com/unmannedlab/ekf-cal containing both the online estimator and the simulation used for testing and evaluation.


title: Experimental characterization of thermionic surface cooling in thermionic discharge

abstract: In this work, the thermionic cooling effect during thermionic discharges with parallel plate electrodes at 1 Torr is investigated. Time-resolved observation of electron emission and surface temperature is realized in addition to the typical steady state characterization. Surface cooling by the electron emission, initiated by plasma ignition, is directly captured at its onset and an estimated cooling capacity of 1.6 \pm 0.2 MW/m^2 is observed. The present work provides experimental evidence of considerable surface cooling achieved by thermionic cooling. This result indicates that thermionic cooling can be a promising thermal protection method at elevated temperatures, such as those encountered by hypersonic vehicle leading edges in flight.


title: An affine isoperimetric inequality for log-concave functions

abstract: The authors gave an affine isoperimetric inequality \cite{LYZ2010} that gives a lower bound for the volume of a polar body and the equality holds if and only if the body is a simplex. In this paper, we give a functional isoperimetric inequality for log-concave functions that contains the affine isoperimetric inequality of Lutwak, Yang and Zhang in \cite{LYZ2010}.


title: Correlation between the strength of low-temperature T-linear normal-state resistivity and $T_{\rm c}$ in overdoped electron-doped cuprate superconductors

abstract: The recently observed an intimate link between the nature of the strange metallic normal-state and superconductivity in the overdoped electron-doped cuprate superconductors is calling for an explanation. Here the intrinsic correlation between the strength of the low-temperature linear-in-temperature normal-state resistivity and superconducting transition temperature $T_{\rm c}$ in the overdoped electron-doped cuprate superconductors is studied within the framework of the kinetic-energy-driven superconductivity. On the one hand, the main ingredient is identified into a electron pairing mechanism involving {\it the spin excitation}, and then $T_{\rm c}$ has a dome-like shape doping dependence with the maximal $T_{\rm c}$ that occurs at around the optimal electron doping. On the other hand, in the normal-state above $T_{\rm c}$, the low-temperature linear-in-temperature normal-state resistivity in the overdoped regime arises from the momentum relaxation due to the electron umklapp scattering mediated by {\it the same spin excitation}. This {\it same spin excitation} that governs both the electron umklapp scattering responsible for the low-temperature linear-in-temperature normal-state resistivity and electron pairing responsible for superconductivity naturally generates a correlation between the strength of the low-temperature linear-in-temperature normal-state resistivity and $T_{\rm c}$ in the overdoped regime.


title: SURE: A Visualized Failure Indexing Approach using Program Memory Spectrum

abstract: Failure indexing is a longstanding crux in software testing and debugging, the goal of which is to automatically divide failures (e.g., failed test cases) into distinct groups according to the culprit root causes, as such multiple faults in a faulty program can be handled independently and simultaneously. This community has long been plagued by two challenges: 1) The effectiveness of division is still far from promising. Existing techniques only employ a limited source of run-time data (e.g., code coverage) to be failure proximity, which typically delivers unsatisfactory results. 2) The outcome can be hardly comprehensible. A developer who receives the failure indexing result does not know why all failures should be divided the way they are. This leads to difficulties for developers to be convinced by the result, which in turn affects the adoption of the results. To tackle these challenges, in this paper, we propose SURE, a viSUalized failuRe indExing approach using the program memory spectrum. We first collect the run-time memory information at preset breakpoints during the execution of failed test cases, and transform it into human-friendly images (called program memory spectrum, PMS). Then, any pair of PMS images that serve as proxies for two failures is fed to a trained Siamese convolutional neural network, to predict the likelihood of them being triggered by the same fault. Results demonstrate the effectiveness of SURE: It achieves 101.20% and 41.38% improvements in faults number estimation, as well as 105.20% and 35.53% improvements in clustering, compared with the state-of-the-art technique in this field, in simulated and real-world environments, respectively. Moreover, we carry out a human study to quantitatively evaluate the comprehensibility of PMS, revealing that this novel type of representation can help developers better comprehend failure indexing results.


title: Limits of dispersoid size and number density in oxide dispersion strengthened alloys fabricated with powder bed fusion-laser beam

abstract: Previous work on additively-manufactured oxide dispersion strengthened alloys focused on experimental approaches, resulting in larger dispersoid sizes and lower number densities than can be achieved with conventional powder metallurgy. To improve the as-fabricated microstructure, this work integrates experiments with a thermodynamic and kinetic modeling framework to probe the limits of the dispersoid sizes and number densities that can be achieved with powder bed fusion-laser beam. Bulk samples of a Ni-20Cr $+$ 1 wt.% Y$_2$O$_3$ alloy are fabricated using a range of laser power and scanning velocity combinations. Scanning transmission electron microscopy characterization is performed to quantify the dispersoid size distributions across the processing space. The smallest mean dispersoid diameter (29 nm) is observed at 300 W and 1200 mm/s, with a number density of 1.0$\times$10$^{20}$ m$^{-3}$. The largest mean diameter (72 nm) is observed at 200 W and 200 mm/s, with a number density of 1.5$\times$10$^{19}$ m$^{-3}$. Scanning electron microscopy suggests that a considerable fraction of the oxide added to the feedstock is lost during processing, due to oxide agglomeration and the ejection of oxide-rich spatter from the melt pool. After accounting for these losses, the model predictions for the dispersoid diameter and number density align with the experimental trends. The results suggest that the mechanism that limits the final number density is collision coarsening of dispersoids in the melt pool. The modeling framework is leveraged to propose processing strategies to limit dispersoid size and increase number density.


title: Metadata for Scientific Experiment Reporting: A Case Study in Metal-Organic Frameworks

abstract: Research methods and procedures are core aspects of the research process. Metadata focused on these components is critical to supporting the FAIR principles, particularly reproducibility. The research reported on in this paper presents a methodological framework for metadata documentation supporting the reproducibility of research producing Metal Organic Frameworks (MOFs). The MOF case study involved natural language processing to extract key synthesis experiment information from a corpus of research literature. Following, a classification activity was performed by domain experts to identify entity-relation pairs. Results include: 1) a research framework for metadata design, 2) a metadata schema that includes nine entities and two relationships for reporting MOF synthesis experiments, and 3) a growing database of MOF synthesis reports structured by our metadata scheme. The metadata schema is intended to support discovery and reproducibility of metal-organic framework research and the FAIR principles. The paper provides background information, identifies the research goals and objectives, research design, results, a discussion, and the conclusion.


title: The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions

abstract: Recent progress in Large Language Models (LLMs) has produced models that exhibit remarkable performance across a variety of NLP tasks. However, it remains unclear whether the existing focus of NLP research accurately captures the genuine requirements of human users. This paper provides a comprehensive analysis of the divergence between current NLP research and the needs of real-world NLP applications via a large-scale collection of user-GPT conversations. We analyze a large-scale collection of real user queries to GPT. We compare these queries against existing NLP benchmark tasks and identify a significant gap between the tasks that users frequently request from LLMs and the tasks that are commonly studied in academic research. For example, we find that tasks such as ``design'' and ``planning'' are prevalent in user interactions but are largely neglected or different from traditional NLP benchmarks. We investigate these overlooked tasks, dissect the practical challenges they pose, and provide insights toward a roadmap to make LLMs better aligned with user needs.


title: Toward Unbiased Multiple-Target Fuzzing with Path Diversity

abstract: In this paper, we propose a novel directed fuzzing solution named AFLRun, which features target path-diversity metric and unbiased energy assignment. Firstly, we develop a new coverage metric by maintaining extra virgin map for each covered target to track the coverage status of seeds that hit the target. This approach enables the storage of waypoints into the corpus that hit a target through interesting path, thus enriching the path diversity for each target. Additionally, we propose a corpus-level energy assignment strategy that guarantees fairness for each target. AFLRun starts with uniform target weight and propagates this weight to seeds to get a desired seed weight distribution. By assigning energy to each seed in the corpus according to such desired distribution, a precise and unbiased energy assignment can be achieved. We built a prototype system and assessed its performance using a standard benchmark and several extensively fuzzed real-world applications. The evaluation results demonstrate that AFLRun outperforms state-of-the-art fuzzers in terms of vulnerability detection, both in quantity and speed. Moreover, AFLRun uncovers 29 previously unidentified vulnerabilities, including 8 CVEs, across four distinct programs.


title: Revisit a realistic intersecting D6-brane with modified soft SUSY terms

abstract: Because there are a few typos in the supersymmetry breaking sfermion masses and trilinear soft term, regarding the current Large Hadron Collider (LHC) and dark matter searches, we revisit a three-family Pati-Salam model based on intersecting D6-branes in Type IIA string theory on a $\mathbf{T^6/(\Z_2\times \Z_2)}$ orientifold with a realistic phenomenology. We study the viable parameter space and discuss the spectrum consistent with the current LHC Supersymmetry searches along with the dark matter relic density bounds from the Planck 2018 data. For the gluinos and first two generations of sfermions, we observe that the gluino mass is in the range [2, 14] TeV, the squarks mass range is [2, 13] TeV and the sleptons mass is in the range [1, 5] TeV. We achieve the cold dark matter relic density consistent with 5$\sigma$ Planck 2018 bounds via A-funnel and coannihilation channels such as stop-neutralino, stau-neutralino, and chargino-neutralino. Except for a few chargino-neutralino coannihilation solutions, these solutions also satisfy current nucleon-neutralino spin-independent and spin-dependent scattering cross-sections and may be probed by future dark matter searches.


title: Detecting and Mitigating Algorithmic Bias in Binary Classification using Causal Modeling

abstract: This paper proposes the use of causal modeling to detect and mitigate algorithmic bias. We provide a brief description of causal modeling and a general overview of our approach. We then use the Adult dataset, which is available for download from the UC Irvine Machine Learning Repository, to develop (1) a prediction model, which is treated as a black box, and (2) a causal model for bias mitigation. In this paper, we focus on gender bias and the problem of binary classification. We show that gender bias in the prediction model is statistically significant at the 0.05 level. We demonstrate the effectiveness of the causal model in mitigating gender bias by cross-validation. Furthermore, we show that the overall classification accuracy is improved slightly. Our novel approach is intuitive, easy-to-use, and can be implemented using existing statistical software tools such as "lavaan" in R. Hence, it enhances explainability and promotes trust.


title: Low rank approximation method for perturbed linear systems with applications to elliptic type stochastic PDEs

abstract: In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly reduce the computational load and storage requirements associated with matrix inversion without losing accuracy. To demonstrate the versatility and applicability of our method, we apply it to address two crucial uncertainty quantification problems: stochastic elliptic equations and optimal control problems governed by stochastic elliptic PDE constraints. Based on varying dimension reduction ratios, our algorithm exhibits the capability to yield a high precision numerical solution for stochastic partial differential equations, or provides a rough representation of the exact solutions as a pre-processing phase. Meanwhile, our algorithm for solving stochastic optimal control problems allows a diverse range of gradient-based unconstrained optimization methods, rendering it particularly appealing for computationally intensive large-scale problems. Numerical experiments are conducted and the results provide strong validation of the feasibility and effectiveness of our algorithm.


title: Identification of electronic dimensionality reduction in semiconductor quantum well structures

abstract: Two-dimensional (2D) systems, such as high-temperature superconductors, surface states of topological insulators, and layered materials, have been intensively studied using vacuum-ultraviolet (VUV) angle-resolved photoemission spectroscopy (ARPES). In semiconductor films (heterostructures), quantum well (QW) states arise due to electron/hole accumulations at the surface (interface). The quantized states due to quantum confinement can be observed by VUV-ARPES, while the periodic intensity modulations along the surface normal (kz) direction of these quantized states are also observable by varying incident photon energy, resembling three-dimensional (3D) band dispersion. We have conducted soft X-ray (SX) ARPES measurements on thick and ultrathin III-V semiconductor InSb(001) films to investigate the electronic dimensionality reduction in semiconductor QWs. In addition to the dissipation of the kz dispersion, the SX-ARPES observations demonstrate the changes of the symmetry and periodicity of the Brillouin zone in the ultrathin film as 2D QW compared with these of the 3D bulk one, indicating the electronic dimensionality reduction of the 3D bulk band dispersion caused by the quantum confinement. The results provide a critical diagnosis using SX-ARPES for the dimensionality reduction in semiconductor QW structures.


title: Optimal heteroskedasticity testing in nonparametric regression

abstract: Heteroskedasticity testing in nonparametric regression is a classic statistical problem with important practical applications, yet fundamental limits are unknown. Adopting a minimax perspective, this article considers the testing problem in the context of an $\alpha$-H\"{o}lder mean and a $\beta$-H\"{o}lder variance function. For $\alpha > 0$ and $\beta \in (0, 1/2)$, the sharp minimax separation rate $n^{-4\alpha} + n^{-4\beta/(4\beta+1)} + n^{-2\beta}$ is established. To achieve the minimax separation rate, a kernel-based statistic using first-order squared differences is developed. Notably, the statistic estimates a proxy rather than a natural quadratic functional (the squared distance between the variance function and its best $L^2$ approximation by a constant) suggested in previous work. The setting where no smoothness is assumed on the variance function is also studied; the variance profile across the design points can be arbitrary. Despite the lack of structure, consistent testing turns out to still be possible by using the Gaussian character of the noise, and the minimax rate is shown to be $n^{-4\alpha} + n^{-1/2}$. Exploiting noise information happens to be a fundamental necessity as consistent testing is impossible if nothing more than zero mean and unit variance is known about the noise distribution. Furthermore, in the setting where the variance function is $\beta$-H\"{o}lder but heteroskedasticity is measured only with respect to the design points, the minimax separation rate is shown to be $n^{-4\alpha} + n^{-\left((1/2) \vee (4\beta/(4\beta+1))\right)}$ when the noise is Gaussian and $n^{-4\alpha} + n^{-4\beta/(4\beta+1)} + n^{-2\beta}$ when the noise distribution is unknown.


title: Automated Repair of Declarative Software Specifications in the Era of Large Language Models

abstract: The growing adoption of declarative software specification languages, coupled with their inherent difficulty in debugging, has underscored the need for effective and automated repair techniques applicable to such languages. Researchers have recently explored various methods to automatically repair declarative software specifications, such as template-based repair, feedback-driven iterative repair, and bounded exhaustive approaches. The latest developments in large language models provide new opportunities for the automatic repair of declarative specifications. In this study, we assess the effectiveness of utilizing OpenAI's ChatGPT to repair software specifications written in the Alloy declarative language. Unlike imperative languages, specifications in Alloy are not executed but rather translated into logical formulas and evaluated using backend constraint solvers to identify specification instances and counterexamples to assertions. Our evaluation focuses on ChatGPT's ability to improve the correctness and completeness of Alloy declarative specifications through automatic repairs. We analyze the results produced by ChatGPT and compare them with those of leading automatic Alloy repair methods. Our study revealed that while ChatGPT falls short in comparison to existing techniques, it was able to successfully repair bugs that no other technique could address. Our analysis also identified errors in ChatGPT's generated repairs, including improper operator usage, type errors, higher-order logic misuse, and relational arity mismatches. Additionally, we observed instances of hallucinations in ChatGPT-generated repairs and inconsistency in its results. Our study provides valuable insights for software practitioners, researchers, and tool builders considering ChatGPT for declarative specification repairs.


title: MAF: Multi-Aspect Feedback for Improving Reasoning in Large Language Models

abstract: Language Models (LMs) have shown impressive performance in various natural language tasks. However, when it comes to natural language reasoning, LMs still face challenges such as hallucination, generating incorrect intermediate reasoning steps, and making mathematical errors. Recent research has focused on enhancing LMs through self-improvement using feedback. Nevertheless, existing approaches relying on a single generic feedback source fail to address the diverse error types found in LM-generated reasoning chains. In this work, we propose Multi-Aspect Feedback, an iterative refinement framework that integrates multiple feedback modules, including frozen LMs and external tools, each focusing on a specific error category. Our experimental results demonstrate the efficacy of our approach to addressing several errors in the LM-generated reasoning chain and thus improving the overall performance of an LM in several reasoning tasks. We see a relative improvement of up to 20% in Mathematical Reasoning and up to 18% in Logical Entailment.


title: Fast Power Curve Approximation for Posterior Analyses

abstract: Bayesian hypothesis tests leverage posterior probabilities, Bayes factors, or credible intervals to inform data-driven decision making. We propose a framework for power curve approximation with such hypothesis tests. We present a fast approach to explore the approximate sampling distribution of posterior probabilities when the conditions for the Bernstein-von Mises theorem are satisfied. We extend that approach to consider segments of such sampling distributions in a targeted manner for each sample size explored. These sampling distribution segments are used to construct power curves for various types of posterior analyses. Our resulting method for power curve approximation is orders of magnitude faster than conventional power curve estimation for Bayesian hypothesis tests. We also prove the consistency of the corresponding power estimates and sample size recommendations under certain conditions.


title: Towards Enhanced Local Explainability of Random Forests: a Proximity-Based Approach

abstract: We initiate a novel approach to explain the out of sample performance of random forest (RF) models by exploiting the fact that any RF can be formulated as an adaptive weighted K nearest-neighbors model. Specifically, we use the proximity between points in the feature space learned by the RF to re-write random forest predictions exactly as a weighted average of the target labels of training data points. This linearity facilitates a local notion of explainability of RF predictions that generates attributions for any model prediction across observations in the training set, and thereby complements established methods like SHAP, which instead generates attributions for a model prediction across dimensions of the feature space. We demonstrate this approach in the context of a bond pricing model trained on US corporate bond trades, and compare our approach to various existing approaches to model explainability.


title: Reconfigurable Intelligent Surface Assisted High-Speed Train Communications: Coverage Performance Analysis and Placement Optimization

abstract: Reconfigurable intelligent surface (RIS) emerges as an efficient and promising technology for the next wireless generation networks and has attracted a lot of attention owing to the capability of extending wireless coverage by reflecting signals toward targeted receivers. In this paper, we consider a RIS-assisted high-speed train (HST) communication system to enhance wireless coverage and improve coverage probability. First, coverage performance of the downlink single-input-single-output system is investigated, and the closed-form expression of coverage probability is derived. Moreover, travel distance maximization problem is formulated to facilitate RIS discrete phase design and RIS placement optimization, which is subject to coverage probability constraint. Simulation results validate that better coverage performance and higher travel distance can be achieved with deployment of RIS. The impacts of some key system parameters including transmission power, signal-to-noise ratio threshold, number of RIS elements, number of RIS quantization bits, horizontal distance between base station and RIS, and speed of HST on system performance are investigated. In addition, it is found that RIS can well improve coverage probability with limited power consumption for HST communications.


title: DocXChain: A Powerful Open-Source Toolchain for Document Parsing and Beyond

abstract: In this report, we introduce DocXChain, a powerful open-source toolchain for document parsing, which is designed and developed to automatically convert the rich information embodied in unstructured documents, such as text, tables and charts, into structured representations that are readable and manipulable by machines. Specifically, basic capabilities, including text detection, text recognition, table structure recognition and layout analysis, are provided. Upon these basic capabilities, we also build a set of fully functional pipelines for document parsing, i.e., general text reading, table parsing, and document structurization, to drive various applications related to documents in real-world scenarios. Moreover, DocXChain is concise, modularized and flexible, such that it can be readily integrated with existing tools, libraries or models (such as LangChain and ChatGPT), to construct more powerful systems that can accomplish more complicated and challenging tasks. The code of DocXChain is publicly available at:~\url{https://github.com/AlibabaResearch/AdvancedLiterateMachinery/tree/main/Applications/DocXChain}


title: Segment Anything Meets Universal Adversarial Perturbation

abstract: As Segment Anything Model (SAM) becomes a popular foundation model in computer vision, its adversarial robustness has become a concern that cannot be ignored. This works investigates whether it is possible to attack SAM with image-agnostic Universal Adversarial Perturbation (UAP). In other words, we seek a single perturbation that can fool the SAM to predict invalid masks for most (if not all) images. We demonstrate convetional image-centric attack framework is effective for image-independent attacks but fails for universal adversarial attack. To this end, we propose a novel perturbation-centric framework that results in a UAP generation method based on self-supervised contrastive learning (CL), where the UAP is set to the anchor sample and the positive sample is augmented from the UAP. The representations of negative samples are obtained from the image encoder in advance and saved in a memory bank. The effectiveness of our proposed CL-based UAP generation method is validated by both quantitative and qualitative results. On top of the ablation study to understand various components in our proposed method, we shed light on the roles of positive and negative samples in making the generated UAP effective for attacking SAM.


title: CAT: Closed-loop Adversarial Training for Safe End-to-End Driving

abstract: Driving safety is a top priority for autonomous vehicles. Orthogonal to prior work handling accident-prone traffic events by algorithm designs at the policy level, we investigate a Closed-loop Adversarial Training (CAT) framework for safe end-to-end driving in this paper through the lens of environment augmentation. CAT aims to continuously improve the safety of driving agents by training the agent on safety-critical scenarios that are dynamically generated over time. A novel resampling technique is developed to turn log-replay real-world driving scenarios into safety-critical ones via probabilistic factorization, where the adversarial traffic generation is modeled as the multiplication of standard motion prediction sub-problems. Consequently, CAT can launch more efficient physical attacks compared to existing safety-critical scenario generation methods and yields a significantly less computational cost in the iterative learning pipeline. We incorporate CAT into the MetaDrive simulator and validate our approach on hundreds of driving scenarios imported from real-world driving datasets. Experimental results demonstrate that CAT can effectively generate adversarial scenarios countering the agent being trained. After training, the agent can achieve superior driving safety in both log-replay and safety-critical traffic scenarios on the held-out test set. Code and data are available at https://metadriverse.github.io/cat.


title: Spatial Crowdsourcing Task Allocation Scheme for Massive Data with Spatial Heterogeneity

abstract: Spatial crowdsourcing (SC) engages large worker pools for location-based tasks, attracting growing research interest. However, prior SC task allocation approaches exhibit limitations in computational efficiency, balanced matching, and participation incentives. To address these challenges, we propose a graph-based allocation framework optimized for massive heterogeneous spatial data. The framework first clusters similar tasks and workers separately to reduce allocation scale. Next, it constructs novel non-crossing graph structures to model balanced adjacencies between unevenly distributed tasks and workers. Based on the graphs, a bidirectional worker-task matching scheme is designed to produce allocations optimized for mutual interests. Extensive experiments on real-world datasets analyze the performance under various parameter settings.


title: Detailed and high-throughput measurement of composition dependence of magnetoresistance and spin-transfer torque using a composition-gradient film: application to Co$_{x}$Fe$_{1-x}$ (0 $\le$ $\textit{x}$ $\le$ 1) system

abstract: We develop a high-throughput method for measuring the composition dependence of magnetoresistance (MR) and spin-transfer-torque (STT) effects in current-perpendicular-to-plane giant magnetoresistance (CPP-GMR) devices and report its application to the CoFe system. The method is based on the use of composition-gradient films deposited by combinatorial sputtering. This structure allows the fabrication of devices with different compositions on a single substrate, drastically enhancing the throughput in investigating composition dependence. We fabricated CPP-GMR devices on a single GMR film consisting of a Co$_{x}$Fe$_{1-x}$ (0 $\le$ $\textit{x}$ $\le$ 1) composition-gradient layer, a Cu spacer layer, and a NiFe layer. The MR ratio obtained from resistance-field measurements exhibited the maximum in the broad Co concentration range of 0.3 $\le$ $\textit{x}$ $\le$ 0.65. In addition, the STT efficiency was estimated from the current to induce magnetization reversal of the NiFe layer by spin injection from the Co$_{x}$Fe$_{1-x}$ layer. The STT efficiency was also the highest around the same Co concentration range as for the MR ratio, and this correlation was theoretically explained by the change in the spin polarization of the Co$_{x}$Fe$_{1-x}$ layer. The results revealed the Co$_{x}$Fe$_{1-x}$ composition range suitable for spintronic applications, demonstrating the advantages of the developed method.


title: Correlation of coalescence times in a diploid Wright-Fisher model with recombination and selfing

abstract: The correlation among the gene genealogies at different loci is crucial in biology, yet challenging to understand because such correlation depends on many factors including genetic linkage, recombination, natural selection and population structure. Based on a diploid Wright-Fisher model with a single mating type and partial selfing for a constant large population with size $N$, we quantify the combined effect of genetic drift and two competing factors, recombination and selfing, on the correlation of coalescence times at two linked loci for samples of size two. Recombination decouples the genealogies at different loci and decreases the correlation while selfing increases the correlation. We obtain explicit asymptotic formulas for the correlation for four scaling scenarios that depend on whether the selfing probability and the recombination probability are of order $O(1/N)$ or $O(1)$ as $N$ tends to infinity. Our analytical results confirm that the asymptotic lower bound in [King, Wakeley, Carmi (Theor. Popul. Biol. 2018)] is sharp when the loci are unlinked and when there is no selfing, and provide a number of new formulas for other scaling scenarios that have not been considered before. We present asymptotic results for the variance of Tajima's estimator of the population mutation rate for infinitely many loci as $N$ tends to infinity. When the selfing probability is of order $O(1)$ and is equal to a positive constant $s$ for all $N$ and if the samples at both loci are in the same individual, then the variance of the Tajima's estimator tends to $s/2$ (hence remains positive) even when the recombination rate, the number of loci and the population size all tend to infinity.


title: Learning prediction function of prior measures for statistical inverse problems of partial differential equations

abstract: In this paper, we view the statistical inverse problems of partial differential equations (PDEs) as PDE-constrained regression and focus on learning the prediction function of the prior probability measures. From this perspective, we propose general generalization bounds for learning infinite-dimensionally defined prior measures in the style of the probability approximately correct Bayesian learning theory. The theoretical framework is rigorously defined on infinite-dimensional separable function space, which makes the theories intimately connected to the usual infinite-dimensional Bayesian inverse approach. Inspired by the concept of $\alpha$-differential privacy, a generalized condition (containing the usual Gaussian measures employed widely in the statistical inverse problems of PDEs) has been proposed, which allows the learned prior measures to depend on the measured data (the prediction function with measured data as input and the prior measure as output can be introduced). After illustrating the general theories, the specific settings of linear and nonlinear problems have been given and can be easily casted into our general theories to obtain concrete generalization bounds. Based on the obtained generalization bounds, infinite-dimensionally well-defined practical algorithms are formulated. Finally, numerical examples of the backward diffusion and Darcy flow problems are provided to demonstrate the potential applications of the proposed approach in learning the prediction function of the prior probability measures.


title: Optimal Excess Risk Bounds for Empirical Risk Minimization on $p$-Norm Linear Regression

abstract: We study the performance of empirical risk minimization on the $p$-norm linear regression problem for $p \in (1, \infty)$. We show that, in the realizable case, under no moment assumptions, and up to a distribution-dependent constant, $O(d)$ samples are enough to exactly recover the target. Otherwise, for $p \in [2, \infty)$, and under weak moment assumptions on the target and the covariates, we prove a high probability excess risk bound on the empirical risk minimizer whose leading term matches, up to a constant that depends only on $p$, the asymptotically exact rate. We extend this result to the case $p \in (1, 2)$ under mild assumptions that guarantee the existence of the Hessian of the risk at its minimizer.


title: Lie Algebra Classification, Conservation Laws and Invariant Solutions for a Variant of the Levinson-Smith Equation

abstract: We obtain the optimal system's generating operators associated with the kind generalization of the Levinson Smith equation. Using those operators we characterize all invariant solutions associated with this equation. Moreover, we present the variational symmetries and the corresponding conservation laws, using Noether's theorem. Finally, we classify the Lie algebra associated with the given equation.


title: PoisonPrompt: Backdoor Attack on Prompt-based Large Language Models

abstract: Prompts have significantly improved the performance of pretrained Large Language Models (LLMs) on various downstream tasks recently, making them increasingly indispensable for a diverse range of LLM application scenarios. However, the backdoor vulnerability, a serious security threat that can maliciously alter the victim model's normal predictions, has not been sufficiently explored for prompt-based LLMs. In this paper, we present POISONPROMPT, a novel backdoor attack capable of successfully compromising both hard and soft prompt-based LLMs. We evaluate the effectiveness, fidelity, and robustness of POISONPROMPT through extensive experiments on three popular prompt methods, using six datasets and three widely used LLMs. Our findings highlight the potential security threats posed by backdoor attacks on prompt-based LLMs and emphasize the need for further research in this area.


title: Performance Evaluation of Evolutionary Algorithms for Analog Integrated Circuit Design Optimisation

abstract: An automated sizing approach for analog circuits using evolutionary algorithms is presented in this paper. A targeted search of the search space has been implemented using a particle generation function and a repair-bounds function that has resulted in faster convergence to the optimal solution. The algorithms are tuned and modified to converge to a better optimal solution with less standard deviation for multiple runs compared to standard versions. Modified versions of the artificial bee colony optimisation algorithm, genetic algorithm, grey wolf optimisation algorithm, and particle swarm optimisation algorithm are tested and compared for the optimal sizing of two operational amplifier topologies. An extensive performance evaluation of all the modified algorithms showed that the modifications have resulted in consistent performance with improved convergence for all the algorithms. The implementation of parallel computation in the algorithms has reduced run time. Among the considered algorithms, the modified artificial bee colony optimisation algorithm gave the most optimal solution with consistent results across multiple runs.


title: Large-Plaintext Functional Bootstrapping in FHE with Small Bootstrapping Keys

abstract: Functional bootstrapping is a core technique in Fully Homomorphic Encryption (FHE). For large plaintext, to evaluate a general function homomorphically over a ciphertext, in the FHEW/TFHE approach, since the function in look-up table form is encoded in the coefficients of a test polynomial, the degree of the polynomial must be high enough to hold the entire table. This increases the bootstrapping time complexity and memory cost, as the size of bootstrapping keys and keyswitching keys need to be large accordingly. In this paper, we propose to encode the look-up table of any function in a polynomial vector, whose coefficients can hold more data. The corresponding representation of the additive group Zq used in the RGSW-based bootstrapping is the group of monic monomial permutation matrices, which integrates the permutation matrix representation used by Alperin-Sheriff and Peikert in 2014, and the monic monomial representation used in the FHEW/TFHE scheme. We make comprehensive investigation of the new representation, and propose a new bootstrapping algorithm based on it. The new algorithm has the prominent benefit of small bootstrapping key size and small key-switching key size, which leads to polynomial factor improvement in key size, in addition to constant factor improvement in run-time cost.


title: Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layer

abstract: Pretrained transformer models have demonstrated remarkable performance across various natural language processing tasks. These models leverage the attention mechanism to capture long- and short-range dependencies in the sequence. However, the (full) attention mechanism incurs high computational cost - quadratic in the sequence length, which is not affordable in tasks with long sequences, e.g., inputs with 8k tokens. Although sparse attention can be used to improve computational efficiency, as suggested in existing work, it has limited modeling capacity and often fails to capture complicated dependencies in long sequences. To tackle this challenge, we propose MASFormer, an easy-to-implement transformer variant with Mixed Attention Spans. Specifically, MASFormer is equipped with full attention to capture long-range dependencies, but only at a small number of layers. For the remaining layers, MASformer only employs sparse attention to capture short-range dependencies. Our experiments on natural language modeling and generation tasks show that a decoder-only MASFormer model of 1.3B parameters can achieve competitive performance to vanilla transformers with full attention while significantly reducing computational cost (up to 75%). Additionally, we investigate the effectiveness of continual training with long sequence data and how sequence length impacts downstream generation performance, which may be of independent interest.


title: Know Where to Go: Make LLM a Relevant, Responsible, and Trustworthy Searcher

abstract: The advent of Large Language Models (LLMs) has shown the potential to improve relevance and provide direct answers in web searches. However, challenges arise in validating the reliability of generated results and the credibility of contributing sources, due to the limitations of traditional information retrieval algorithms and the LLM hallucination problem. Aiming to create a "PageRank" for the LLM era, we strive to transform LLM into a relevant, responsible, and trustworthy searcher. We propose a novel generative retrieval framework leveraging the knowledge of LLMs to foster a direct link between queries and online sources. This framework consists of three core modules: Generator, Validator, and Optimizer, each focusing on generating trustworthy online sources, verifying source reliability, and refining unreliable sources, respectively. Extensive experiments and evaluations highlight our method's superior relevance, responsibility, and trustfulness against various SOTA methods.


title: Revisiting Sparse Retrieval for Few-shot Entity Linking

abstract: Entity linking aims to link ambiguous mentions to their corresponding entities in a knowledge base. One of the key challenges comes from insufficient labeled data for specific domains. Although dense retrievers have achieved excellent performance on several benchmarks, their performance decreases significantly when only a limited amount of in-domain labeled data is available. In such few-shot setting, we revisit the sparse retrieval method, and propose an ELECTRA-based keyword extractor to denoise the mention context and construct a better query expression. For training the extractor, we propose a distant supervision method to automatically generate training data based on overlapping tokens between mention contexts and entity descriptions. Experimental results on the ZESHEL dataset demonstrate that the proposed method outperforms state-of-the-art models by a significant margin across all test domains, showing the effectiveness of keyword-enhanced sparse retrieval.


title: Supersensitive sensing of quantum reservoirs via breaking antisymmetric coupling

abstract: We investigate the utilization of a single generalized dephasing qubit for sensing a quantum reservoir, where the antisymmetric coupling between the qubit and its reservoir is broken. It is found that in addition to the decay factor encoding channel, the antisymmetric coupling breaking gives rise to another phase factor encoding channel. We introduce an optimal measurement for the generalized dephasing qubit which enables the practical measurement precision to reach the theoretical ultimate precision quantified by the quantum signal-to-noise ratio (QSNR). As an example, the generalized dephasing qubit is employed to estimate the $s$-wave scattering length of an atomic Bose-Einstein condensate. It is found that the phase-induced QSNR caused by the antisymmetric coupling breaking is at least two orders of magnitude higher than the decay-induced QSNR at the millisecond timescale and the optimal relative error can achieve a scaling $\propto 1/t$ with $t$ being the encoding time in long-term encoding. Our work opens a way for supersensitive sensing of quantum reservoirs.


title: Can Electromagnetic Information Theory Improve Wireless Systems? A Channel Estimation Example

abstract: Electromagnetic information theory (EIT) is an emerging interdisciplinary subject that integrates classical Maxwell electromagnetics and Shannon information theory. The goal of EIT is to uncover the information transmission mechanisms from an electromagnetic (EM) perspective in wireless systems. Existing works on EIT are mainly focused on the analysis of EM channel characteristics, degrees-of-freedom, and system capacity. However, these works do not clarify whether EIT can improve wireless communication systems. To fill in this gap, in this paper, we provide a novel example that EIT can improve the performance of classical minimum mean squared error (MMSE) channel estimators by replacing the channel covariance matrix with an EM correlation function (EMCF). Specifically, by averaging the solutions of Maxwell's equations over a tunable angular distribution, we obtain a spatio-temporal correlation function (STCF) of the EM channel, which we name as the EMCF. Since classical MMSE estimators can exploit prior information contained in the channel covariance matrix, the substitution of EMCF for the covariance matrix introduces EM side information into MMSE estimators. Furthermore, we dynamically tune the EMCF parameters to better fit the channel observations. Simulation results show that the proposed EIT-MMSE channel estimator outperforms traditional MMSE estimators, thus proving that EIT is beneficial to wireless communication systems.


title: Constrained Reweighting of Distributions: an Optimal Transport Approach

abstract: We commonly encounter the problem of identifying an optimally weight adjusted version of the empirical distribution of observed data, adhering to predefined constraints on the weights. Such constraints often manifest as restrictions on the moments, tail behaviour, shapes, number of modes, etc., of the resulting weight adjusted empirical distribution. In this article, we substantially enhance the flexibility of such methodology by introducing a nonparametrically imbued distributional constraints on the weights, and developing a general framework leveraging the maximum entropy principle and tools from optimal transport. The key idea is to ensure that the maximum entropy weight adjusted empirical distribution of the observed data is close to a pre-specified probability distribution in terms of the optimal transport metric while allowing for subtle departures. The versatility of the framework is demonstrated in the context of three disparate applications where data re-weighting is warranted to satisfy side constraints on the optimization problem at the heart of the statistical task: namely, portfolio allocation, semi-parametric inference for complex surveys, and ensuring algorithmic fairness in machine learning algorithms.


title: Quantum computer error structure probed by quantum error correction syndrome measurements

abstract: With quantum devices rapidly approaching qualities and scales needed for fault tolerance, the validity of simplified error models underpinning the study of quantum error correction needs to be experimentally evaluated. In this work, we have assessed the performance of IBM superconducting quantum computer devices implementing heavy-hexagon code syndrome measurements with increasing circuit sizes up to 23 qubits, against the error assumptions underpinning code threshold calculations. Circuit operator change rate statistics in the presence of depolarizing and biased noise were modelled using analytic functions of error model parameters. Data from 16 repeated syndrome measurement cycles was found to be inconsistent with a uniform depolarizing noise model, favouring instead biased and inhomogeneous noise models. Spatial-temporal correlations investigated via $Z$ stabilizer measurements revealed significant temporal correlation in detection events. These results highlight the non-trivial structure which may be present in the noise of quantum error correction circuits, revealed by operator measurement statistics, and support the development of noise-tailored codes and decoders to adapt.


title: A Machine Learning Approach to Robustly Determine Director Fields and Analyze Defects in Active Nematics

abstract: Active nematics are dense systems of rodlike particles that consume energy to drive motion at the level of the individual particles. They exist in natural systems like biological tissues and artificial materials such as suspensions of self-propelled colloidal particles or synthetic microswimmers. Active nematics have attracted significant attention in recent years due to their spectacular nonequilibrium collective spatiotemporal dynamics, which may enable applications in fields such as robotics, drug delivery, and materials science. The director field, which measures the direction and degree of alignment of the local nematic orientation, is a crucial characteristic of active nematic and is essential for studying topological defects. However, determining the director field is a significant challenge in many experimental systems. Although director fields can be derived from images of active nematics using traditional imaging processing methods, the accuracy of such methods are highly sensitive to the settings of the algorithms. These settings must be tuned from image-to-image due to experimental noise, intrinsic noise of the imaging technology, and perturbations caused by changes in experimental conditions. This sensitivity currently limits automatic analysis of active nematics. To address this, we developed a machine learning model for extracting reliable director fields from raw experimental images, which enables accurate analysis of topological defects. Application of the algorithm to experimental data demonstrates that the approach is robust and highly generalizable to experimental settings that are different from those in the training data. It could be a promising tool for investigating active nematics and may be generalized to other active matter systems.


title: A Read-and-Select Framework for Zero-shot Entity Linking

abstract: Zero-shot entity linking (EL) aims at aligning entity mentions to unseen entities to challenge the generalization ability. Previous methods largely focus on the candidate retrieval stage and ignore the essential candidate ranking stage, which disambiguates among entities and makes the final linking prediction. In this paper, we propose a read-and-select (ReS) framework by modeling the main components of entity disambiguation, i.e., mention-entity matching and cross-entity comparison. First, for each candidate, the reading module leverages mention context to output mention-aware entity representations, enabling mention-entity matching. Then, in the selecting module, we frame the choice of candidates as a sequence labeling problem, and all candidate representations are fused together to enable cross-entity comparison. Our method achieves the state-of-the-art performance on the established zero-shot EL dataset ZESHEL with a 2.55% micro-average accuracy gain, with no need for laborious multi-phase pre-training used in most of the previous work, showing the effectiveness of both mention-entity and cross-entity interaction.


title: MTS-LOF: Medical Time-Series Representation Learning via Occlusion-Invariant Features

abstract: Medical time series data are indispensable in healthcare, providing critical insights for disease diagnosis, treatment planning, and patient management. The exponential growth in data complexity, driven by advanced sensor technologies, has presented challenges related to data labeling. Self-supervised learning (SSL) has emerged as a transformative approach to address these challenges, eliminating the need for extensive human annotation. In this study, we introduce a novel framework for Medical Time Series Representation Learning, known as MTS-LOF. MTS-LOF leverages the strengths of contrastive learning and Masked Autoencoder (MAE) methods, offering a unique approach to representation learning for medical time series data. By combining these techniques, MTS-LOF enhances the potential of healthcare applications by providing more sophisticated, context-rich representations. Additionally, MTS-LOF employs a multi-masking strategy to facilitate occlusion-invariant feature learning. This approach allows the model to create multiple views of the data by masking portions of it. By minimizing the discrepancy between the representations of these masked patches and the fully visible patches, MTS-LOF learns to capture rich contextual information within medical time series datasets. The results of experiments conducted on diverse medical time series datasets demonstrate the superiority of MTS-LOF over other methods. These findings hold promise for significantly enhancing healthcare applications by improving representation learning. Furthermore, our work delves into the integration of joint-embedding SSL and MAE techniques, shedding light on the intricate interplay between temporal and structural dependencies in healthcare data. This understanding is crucial, as it allows us to grasp the complexities of healthcare data analysis.


title: Not Just Learning from Others but Relying on Yourself: A New Perspective on Few-Shot Segmentation in Remote Sensing

abstract: Few-shot segmentation (FSS) is proposed to segment unknown class targets with just a few annotated samples. Most current FSS methods follow the paradigm of mining the semantics from the support images to guide the query image segmentation. However, such a pattern of `learning from others' struggles to handle the extreme intra-class variation, preventing FSS from being directly generalized to remote sensing scenes. To bridge the gap of intra-class variance, we develop a Dual-Mining network named DMNet for cross-image mining and self-mining, meaning that it no longer focuses solely on support images but pays more attention to the query image itself. Specifically, we propose a Class-public Region Mining (CPRM) module to effectively suppress irrelevant feature pollution by capturing the common semantics between the support-query image pair. The Class-specific Region Mining (CSRM) module is then proposed to continuously mine the class-specific semantics of the query image itself in a `filtering' and `purifying' manner. In addition, to prevent the co-existence of multiple classes in remote sensing scenes from exacerbating the collapse of FSS generalization, we also propose a new Known-class Meta Suppressor (KMS) module to suppress the activation of known-class objects in the sample. Extensive experiments on the iSAID and LoveDA remote sensing datasets have demonstrated that our method sets the state-of-the-art with a minimum number of model parameters. Significantly, our model with the backbone of Resnet-50 achieves the mIoU of 49.58% and 51.34% on iSAID under 1-shot and 5-shot settings, outperforming the state-of-the-art method by 1.8% and 1.12%, respectively. The code is publicly available at https://github.com/HanboBizl/DMNet.


title: Early Planet Formation in Embedded Disks (eDisk). VIII. A Small Protostellar Disk around the Extremely Low-Mass and Young Class 0 Protostar, IRAS 15398-3359

abstract: Protostellar disks are a ubiquitous part of the star formation process and the future sites of planet formation. As part of the Early Planet Formation in Embedded Disks (eDisk) large program, we present high-angular resolution dust continuum ($\sim40\,$mas) and molecular line ($\sim150\,$mas) observations of the Class 0 protostar, IRAS 15398-3359. The dust continuum is small, compact, and centrally peaked, while more extended dust structures are found in the outflow directions. We perform a 2D Gaussian fitting to find the deconvolved size and $2\sigma$ radius of the dust disk to be $4.5\times2.8\,\mathrm{au}$ and $3.8\,\mathrm{au}$, respectively. We estimate the gas+dust disk mass assuming optically thin continuum emission to be $0.6-1.8\,M_\mathrm{jup}$, indicating a very low-mass disk. The CO isotopologues trace components of the outflows and inner envelope, while SO traces a compact, rotating disk-like component. Using several rotation curve fittings on the PV diagram of the SO emission, the lower limits of the protostellar mass and gas disk radius are $0.022\,M_\odot$ and $31.2\,\mathrm{au}$ from our Modified 2 single power-law fitting. A conservative upper limit of the protostellar mass is inferred to be $0.1\,M_\odot$. The protostellar mass-accretion rate and the specific angular momentum at the protostellar disk edge are found to be between $1.3-6.1\times10^{-6}\,M_\odot\,\mathrm{yr^{-1}}$ and $1.2-3.8\times10^{-4}\,\mathrm{km\,s^{-1}\,pc}$, respectively, with an age estimated between $0.4-7.5\times10^{4}\,$yr. At this young age with no clear substructures in the disk, planet formation would likely not yet have started. This study highlights the importance of high-resolution observations and systematic fitting procedures when deriving dynamical properties of deeply embedded Class 0 protostars.


title: Rethinking the Construction of Effective Metrics for Understanding the Mechanisms of Pretrained Language Models

abstract: Pretrained language models are expected to effectively map input text to a set of vectors while preserving the inherent relationships within the text. Consequently, designing a white-box model to compute metrics that reflect the presence of specific internal relations in these vectors has become a common approach for post-hoc interpretability analysis of pretrained language models. However, achieving interpretability in white-box models and ensuring the rigor of metric computation becomes challenging when the source model lacks inherent interpretability. Therefore, in this paper, we discuss striking a balance in this trade-off and propose a novel line to constructing metrics for understanding the mechanisms of pretrained language models. We have specifically designed a family of metrics along this line of investigation, and the model used to compute these metrics is referred to as the tree topological probe. We conducted measurements on BERT-large by using these metrics. Based on the experimental results, we propose a speculation regarding the working mechanism of BERT-like pretrained language models, as well as a strategy for enhancing fine-tuning performance by leveraging the topological probe to improve specific submodules.


title: Auto Search Indexer for End-to-End Document Retrieval

abstract: Generative retrieval, which is a new advanced paradigm for document retrieval, has recently attracted research interests, since it encodes all documents into the model and directly generates the retrieved documents. However, its power is still underutilized since it heavily relies on the "preprocessed" document identifiers (docids), thus limiting its retrieval performance and ability to retrieve new documents. In this paper, we propose a novel fully end-to-end retrieval paradigm. It can not only end-to-end learn the best docids for existing and new documents automatically via a semantic indexing module, but also perform end-to-end document retrieval via an encoder-decoder-based generative model, namely Auto Search Indexer (ASI). Besides, we design a reparameterization mechanism to combine the above two modules into a joint optimization framework. Extensive experimental results demonstrate the superiority of our model over advanced baselines on both public and industrial datasets and also verify the ability to deal with new documents.


title: Lectures on algebraic stacks

abstract: Notes on algebraic stacks, prepared for an 11-lecture course at the NCTS, Taipei, during the fall of 2022.


title: MuseGNN: Interpretable and Convergent Graph Neural Network Layers at Scale

abstract: Among the many variants of graph neural network (GNN) architectures capable of modeling data with cross-instance relations, an important subclass involves layers designed such that the forward pass iteratively reduces a graph-regularized energy function of interest. In this way, node embeddings produced at the output layer dually serve as both predictive features for solving downstream tasks (e.g., node classification) and energy function minimizers that inherit desirable inductive biases and interpretability. However, scaling GNN architectures constructed in this way remains challenging, in part because the convergence of the forward pass may involve models with considerable depth. To tackle this limitation, we propose a sampling-based energy function and scalable GNN layers that iteratively reduce it, guided by convergence guarantees in certain settings. We also instantiate a full GNN architecture based on these designs, and the model achieves competitive accuracy and scalability when applied to the largest publicly-available node classification benchmark exceeding 1TB in size.


title: Confirmation of a Sub-Saturn-size transiting exoplanet orbiting a G dwarf: TOI-1194 b and a very low mass companion star: TOI-1251 B from TESS

abstract: We report the confirmation of a sub-Saturn-size exoplanet, TOI-1194 b with a mass about $0.456_{-0.051}^{+0.055}$ $M_{J}$, and a very low mass companion star with a mass of about $96.5\pm1.5$ $M_J$, TOI-1251 B. Exoplanet candidates provided by the Transiting Exoplanet Survey Satellite (TESS) are suitable for further follow-up observations by ground-based telescopes with small and medium apertures. The analysis is performed based on data from several telescopes worldwide, including telescopes in the Sino-German multiband photometric campaign, which aimed at confirming TESS Objects of Interest (TOIs) using ground-based small-aperture and medium-aperture telescopes, especially for long-period targets. TOI-1194 b is confirmed based on the consistent periodic transits depths from the multiband photometric data. We measure an orbital period of $2.310644\pm0.000001$ d, and radius is $0.767_{-0.041}^{+0.045}$ $R_J$, and amplitude of RV curve is $69.4_{-7.3}^{+7.9}$ m/s. TOI-1251 B is confirmed based on the multiband photometric and high-resolution spectroscopic data, whose orbiting period is $5.963054_{-0.000001}^{+0.000002}$ d, the radius is $0.947_{-0.033}^{+0.035}$ $R_J$, and amplitude of RV curve is $9849_{-40}^{+42}$ m/s.


title: Affective Conversational Agents: Understanding Expectations and Personal Influences

abstract: The rise of AI conversational agents has broadened opportunities to enhance human capabilities across various domains. As these agents become more prevalent, it is crucial to investigate the impact of different affective abilities on their performance and user experience. In this study, we surveyed 745 respondents to understand the expectations and preferences regarding affective skills in various applications. Specifically, we assessed preferences concerning AI agents that can perceive, respond to, and simulate emotions across 32 distinct scenarios. Our results indicate a preference for scenarios that involve human interaction, emotional support, and creative tasks, with influences from factors such as emotional reappraisal and personality traits. Overall, the desired affective skills in AI agents depend largely on the application's context and nature, emphasizing the need for adaptability and context-awareness in the design of affective AI conversational agents.


title: Linear Source Apportionment using Generalized Least Squares

abstract: Motivated by applications to water quality monitoring using fluorescence spectroscopy, we develop the source apportionment model for high dimensional profiles of dissolved organic matter (DOM). We describe simple methods to estimate the parameters of a linear source apportionment model, and show how the estimates are related to those of ordinary and generalized least squares. Using this least squares framework, we analyze the variability of the estimates, and we propose predictors for missing elements of a DOM profile. We demonstrate the practical utility of our results on fluorescence spectroscopy data collected from the Neuse River in North Carolina.


title: Balanced Group Convolution: An Improved Group Convolution Based on Approximability Estimates

abstract: The performance of neural networks has been significantly improved by increasing the number of channels in convolutional layers. However, this increase in performance comes with a higher computational cost, resulting in numerous studies focused on reducing it. One promising approach to address this issue is group convolution, which effectively reduces the computational cost by grouping channels. However, to the best of our knowledge, there has been no theoretical analysis on how well the group convolution approximates the standard convolution. In this paper, we mathematically analyze the approximation of the group convolution to the standard convolution with respect to the number of groups. Furthermore, we propose a novel variant of the group convolution called balanced group convolution, which shows a higher approximation with a small additional computational cost. We provide experimental results that validate our theoretical findings and demonstrate the superior performance of the balanced group convolution over other variants of group convolution.


title: Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights

abstract: In the realm of deep learning, transformers have emerged as a dominant architecture, particularly in natural language processing tasks. However, with their widespread adoption, concerns regarding the security and privacy of the data processed by these models have arisen. In this paper, we address a pivotal question: Can the data fed into transformers be recovered using their attention weights and outputs? We introduce a theoretical framework to tackle this problem. Specifically, we present an algorithm that aims to recover the input data $X \in \mathbb{R}^{d \times n}$ from given attention weights $W = QK^\top \in \mathbb{R}^{d \times d}$ and output $B \in \mathbb{R}^{n \times n}$ by minimizing the loss function $L(X)$. This loss function captures the discrepancy between the expected output and the actual output of the transformer. Our findings have significant implications for the Localized Layer-wise Mechanism (LLM), suggesting potential vulnerabilities in the model's design from a security and privacy perspective. This work underscores the importance of understanding and safeguarding the internal workings of transformers to ensure the confidentiality of processed data.


title: Piecewise frequency model for searches for long-transient gravitational waves from young neutron stars

abstract: In this work we characterise the performance of a new search technique designed to be sensitive to the remnants of binary neutron star systems. Sensitivity estimates of the new method on simulated data are competitive against those of other work. Previous searches for a gravitational-wave signal from a possible neutron star remnant of the binary neutron star merger event GW170817 have focused on short ($<500$~s) and long duration (2.5~hr -- 8~day) signals. To date, no such post-merger signal has been detected. We introduce a new piecewise model which has the flexibility to accurately follow gravitational-wave signals which are rapidly evolving in frequency, such as those which may be emitted from young neutron stars born from binary neutron star mergers or supernovae. We investigate the sensitivity and computational cost of this piecewise model when used in a fully coherent 1800-second $\mathcal{F}$-statistic search on simulated data containing possible signals from the GW170817 remnant. The sensitivity of the search using the piecewise model is determined using simulated data, with noise consistent with the LIGO second observing run. Across a 100--2000~Hz frequency band, the model achieves a peak sensitivity of $h_{\text{rss}}^{50\%} = 4.4 \times 10^{-23} \text{Hz}^{-1/2}$ at 200~Hz, competitive with other methods. The computational cost of conducting the search, over a bank of $1.1 \times 10^{12}$ templates, is estimated at 10 days running on 100 CPU's.