title: Bayesian Design Principles for Frequentist Sequential Learning

abstract: We develop a general theory to optimize the frequentist regret for sequential learning problems, where efficient bandit and reinforcement learning algorithms can be derived from unified Bayesian principles. We propose a novel optimization approach to generate "algorithmic beliefs" at each round, and use Bayesian posteriors to make decisions. The optimization objective to create "algorithmic beliefs," which we term "Algorithmic Information Ratio," represents an intrinsic complexity measure that effectively characterizes the frequentist regret of any algorithm. To the best of our knowledge, this is the first systematical approach to make Bayesian-type algorithms prior-free and applicable to adversarial settings, in a generic and optimal manner. Moreover, the algorithms are simple and often efficient to implement. As a major application, we present a novel algorithm for multi-armed bandits that achieves the "best-of-all-worlds" empirical performance in the stochastic, adversarial, and non-stationary environments. And we illustrate how these principles can be used in linear bandits, bandit convex optimization, and reinforcement learning.


title: The 2021 mutual phenomena involving the Galilean satellites of Jupiter and the inner satellite Thebe

abstract: Astrometric studies and orbital modeling of planetary moons have contributed significantly to advancing our understanding of their orbital dynamics. These studies require precise positions measured over extended periods. In this paper, we present the results of the 2021 Brazilian Jovian mutual phenomena campaign. The data correspond to eight events between Galilean satellites, in addition to a rare eclipse of Thebe, an inner satellite, totaling nine events. A geometric model along with the DE440/JUP365 ephemerides was used to reproduce the events and simulate the light curves. A Monte Carlo method and chi-squared statistics were used to fit the simulated light curves to the observations. The reflectance model adopted for our simulations was the complete version of the Oren-Nayer model. The average uncertainty of the relative positions of the Galilean satellites was 5 mas (15 km) and for the inner Thebe satellite 32 mas (96 km). The seven mutual events (nine independent observations) here analyzed represent and addition of 17% events (10% light curves) with respect to the PHEMU21 international campaign. Furthermore, our result of Thebe eclipse is only the second measurement published to date. Our results contribute to the ephemeris database, being fundamental to improving satellite orbits and thus minimizing their uncertainties.


title: Completing Visual Objects via Bridging Generation and Segmentation

abstract: This paper presents a novel approach to object completion, with the primary goal of reconstructing a complete object from its partially visible components. Our method, named MaskComp, delineates the completion process through iterative stages of generation and segmentation. In each iteration, the object mask is provided as an additional condition to boost image generation, and, in return, the generated images can lead to a more accurate mask by fusing the segmentation of images. We demonstrate that the combination of one generation and one segmentation stage effectively functions as a mask denoiser. Through alternation between the generation and segmentation stages, the partial object mask is progressively refined, providing precise shape guidance and yielding superior object completion results. Our experiments demonstrate the superiority of MaskComp over existing approaches, e.g., ControlNet and Stable Diffusion, establishing it as an effective solution for object completion.


title: Towards Causal Foundation Model: on Duality between Causal Inference and Attention

abstract: Foundation models have brought changes to the landscape of machine learning, demonstrating sparks of human-level intelligence across a diverse array of tasks. However, a gap persists in complex tasks such as causal inference, primarily due to challenges associated with intricate reasoning steps and high numerical precision requirements. In this work, we take a first step towards building causally-aware foundation models for treatment effect estimations. We propose a novel, theoretically justified method called Causal Inference with Attention (CInA), which utilizes multiple unlabeled datasets to perform self-supervised causal learning, and subsequently enables zero-shot causal inference on unseen tasks with new data. This is based on our theoretical results that demonstrate the primal-dual connection between optimal covariate balancing and self-attention, facilitating zero-shot causal inference through the final layer of a trained transformer-type architecture. We demonstrate empirically that CInA effectively generalizes to out-of-distribution datasets and various real-world datasets, matching or even surpassing traditional per-dataset methodologies. These results provide compelling evidence that our method has the potential to serve as a stepping stone for the development of causal foundation models.


title: An inverse analysis of fluid flow through granular media using differentiable lattice Boltzmann method

abstract: Inverse modeling of fluid flow through porous soils and reservoir rocks enables accurate determination of permeability and seepage properties critical for applications such as contaminant filtration, stability assessments, and optimization of hydrocarbon recovery. However, the solution to the inverse problem is ill-posed and sensitive to noise in measurements. Direct simulation of flow through granular media only provides forward predictions rather than inverse characterization. We present an effective method for solving inverse analysis of fluid flow through granular media. The key objectives are accurately determining boundary conditions and characterizing the physical properties of the granular media (e.g., permeability) and fluid viscosity based on the flow state. We develop a fully differentiable lattice Boltzmann Method (LBM) using Automatic Differentiation (AD) to optimize the gradients of the input features with respect to the observations. We implement a GPU-capable AD-LBM using the Domain-Specific Taichi programming language by employing lightweight tape gradients for end-to-end backpropagation. For complex flow paths in porous media, our AD-LBM approach accurately estimates the boundary conditions leading to observed steady-state velocity fields and consequently derives macro-scale permeability and fluid viscosity. Our method demonstrates significant advantages in prediction accuracy and computational efficiency, offering a powerful tool for solving inverse fluid flow problems in various applications.


title: Sparse Backpropagation for MoE Training

abstract: One defining characteristic of Mixture-of-Expert (MoE) models is their capacity for conducting sparse computation via expert routing, leading to remarkable scalability. However, backpropagation, the cornerstone of deep learning, requires dense computation, thereby posting challenges in MoE gradient computations. Here, we introduce SparseMixer, a scalable gradient estimator that bridges the gap between backpropagation and sparse expert routing. Unlike typical MoE training which strategically neglects certain gradient terms for the sake of sparse computation and scalability, SparseMixer provides scalable gradient approximations for these terms, enabling reliable gradient estimation in MoE training. Grounded in a numerical ODE framework, SparseMixer harnesses the mid-point method, a second-order ODE solver, to deliver precise gradient approximations with negligible computational overhead. Applying SparseMixer to Switch Transformer on both pre-training and machine translation tasks, SparseMixer showcases considerable performance gain, accelerating training convergence up to 2 times.


title: A complete convergence theorem for the q-voter model and other voter model perturbations in two dimensions

abstract: The q-voter model is a spin-flip system in which the rate of flipping to type i is given by the qth power of the proportion of nearest neighbours in type i for $i=0,1$. If $q=1$ it reduces to the classical voter model. We show that in the critical 2-dimensional case, for $q<1$ and close enough to 1,for any initial state as $t\to\infty$, the system converges weakly to a mixture of all 0's and all 1's, and a unique invariant law which contains infinitely many sites of both types. This follows as a special case of a general theorem which proves a similar "complete convergence theorem" for cancellative, monotone, finite range voter model perturbations on $\mathbb{Z}^2$ providing a certain parameter, $\Theta_3$, is strictly positive. Similar results follow for the affine and geometric voter models and Lotka-Volterra models, all for parameter values close to the giving the voter model. This kind of asymptotic behavior is quite different from that of the 2-dimensional voter model itself, which undergoes clustering, and converges to a mixture of all 0's and all 1's. The above parameter $\Theta_3$ has an explicit expression in terms of asymptotic coalescing probabilities of 2-dimensional random walk, and we give a rather simple sufficient condition for it to be strictly positive. An important step in the proof is to establish weak convergence of the rescaled spin-flip systems to super-Brownian motion with drift $\Theta_3$. In fact, a convergence result is proved under weaker hypotheses which includes all known such results for 2-dimensional voter model perturbations and a number of new ones, including a rescaled limit theorem for the q-voter model where $q\uparrow $1 with the rescaling.


title: OceanNet: A principled neural operator-based digital twin for regional oceans

abstract: While data-driven approaches demonstrate great potential in atmospheric modeling and weather forecasting, ocean modeling poses distinct challenges due to complex bathymetry, land, vertical structure, and flow non-linearity. This study introduces OceanNet, a principled neural operator-based digital twin for ocean circulation. OceanNet uses a Fourier neural operator and predictor-evaluate-corrector integration scheme to mitigate autoregressive error growth and enhance stability over extended time scales. A spectral regularizer counteracts spectral bias at smaller scales. OceanNet is applied to the northwest Atlantic Ocean western boundary current (the Gulf Stream), focusing on the task of seasonal prediction for Loop Current eddies and the Gulf Stream meander. Trained using historical sea surface height (SSH) data, OceanNet demonstrates competitive forecast skill by outperforming SSH predictions by an uncoupled, state-of-the-art dynamical ocean model forecast, reducing computation by 500,000 times. These accomplishments demonstrate the potential of physics-inspired deep neural operators as cost-effective alternatives to high-resolution numerical ocean models.


title: Quark masses and low energy constants in the continuum from the tadpole improved clover ensembles

abstract: We present the light-flavor quark masses and low energy constants using the 2+1 flavor full-QCD ensembles with stout smeared clover fermion action and Symanzik gauge actions. Both the fermion and gauge actions are tadpole improved self-consistently. The simulations are performed on 11 ensembles at 3 lattice spacings $a\in[0.05,0.11]$ fm, 4 spatial sizes $L\in[2.5, 5.1]$ fm, 7 pion masses $m_{\pi}\in[135,350]$ MeV, and several values of the strange quark mass. The quark mass is defined through the partially conserved axial current (PCAC) relation and renormalized to $\overline{\mathrm{MS}}$ 2 GeV through the intermediate regularization independent momentum subtraction (RI/MOM) scheme. The systematic uncertainty of using the symmetric momentum subtraction (SMOM) scheme is also included. Eventually, we predict $m_u=2.45(22)(20)$ MeV, $m_d=4.74(11)(09)$ MeV, and $m_s=98.8(2.9)(4.7)$ MeV with the systematic uncertainties from lattice spacing determination, continuum extrapolation and renormalization constant included. We also obtain the chiral condensate $\Sigma^{1/3}=268.6(3.6)(0.7)$ MeV and the pion decay constant $F=86.6(7)(1.4) $ MeV in the $N_f=2$ chiral limit, and the next-to-leading order low energy constants $\ell_3=2.43(54)(05)$ and $\ell_4=4.322(75)(96)$.


title: ReAcTable: Enhancing ReAct for Table Question Answering

abstract: Table Question Answering (TQA) presents a substantial challenge at the intersection of natural language processing and data analytics. This task involves answering natural language (NL) questions on top of tabular data, demanding proficiency in logical reasoning, understanding of data semantics, and fundamental analytical capabilities. Due to its significance, a substantial volume of research has been dedicated to exploring a wide range of strategies aimed at tackling this challenge including approaches that leverage Large Language Models (LLMs) through in-context learning or Chain-of-Thought (CoT) prompting as well as approaches that train and fine-tune custom models. Nonetheless, a conspicuous gap exists in the research landscape, where there is limited exploration of how innovative foundational research, which integrates incremental reasoning with external tools in the context of LLMs, as exemplified by the ReAct paradigm, could potentially bring advantages to the TQA task. In this paper, we aim to fill this gap, by introducing ReAcTable (ReAct for Table Question Answering tasks), a framework inspired by the ReAct paradigm that is carefully enhanced to address the challenges uniquely appearing in TQA tasks such as interpreting complex data semantics, dealing with errors generated by inconsistent data and generating intricate data transformations. ReAcTable relies on external tools such as SQL and Python code executors, to progressively enhance the data by generating intermediate data representations, ultimately transforming it into a more accessible format for answering the questions with greater ease. We demonstrate that ReAcTable achieves remarkable performance even when compared to fine-tuned approaches. In particular, it outperforms the best prior result on the WikiTQ benchmark, achieving an accuracy of 68.0% without requiring training a new model or fine-tuning.


title: Sharingan: A Transformer-based Architecture for Gaze Following

abstract: Gaze is a powerful form of non-verbal communication and social interaction that humans develop from an early age. As such, modeling this behavior is an important task that can benefit a broad set of application domains ranging from robotics to sociology. In particular, Gaze Following is defined as the prediction of the pixel-wise 2D location where a person in the image is looking. Prior efforts in this direction have focused primarily on CNN-based architectures to perform the task. In this paper, we introduce a novel transformer-based architecture for 2D gaze prediction. We experiment with 2 variants: the first one retains the same task formulation of predicting a gaze heatmap for one person at a time, while the second one casts the problem as a 2D point regression and allows us to perform multi-person gaze prediction with a single forward pass. This new architecture achieves state-of-the-art results on the GazeFollow and VideoAttentionTarget datasets. The code for this paper will be made publicly available.


title: Learning to Make Adherence-Aware Advice

abstract: As artificial intelligence (AI) systems play an increasingly prominent role in human decision-making, challenges surface in the realm of human-AI interactions. One challenge arises from the suboptimal AI policies due to the inadequate consideration of humans disregarding AI recommendations, as well as the need for AI to provide advice selectively when it is most pertinent. This paper presents a sequential decision-making model that (i) takes into account the human's adherence level (the probability that the human follows/rejects machine advice) and (ii) incorporates a defer option so that the machine can temporarily refrain from making advice. We provide learning algorithms that learn the optimal advice policy and make advice only at critical time stamps. Compared to problem-agnostic reinforcement learning algorithms, our specialized learning algorithms not only enjoy better theoretical convergence properties but also show strong empirical performance.


title: ECG-SL: Electrocardiogram(ECG) Segment Learning, a deep learning method for ECG signal

abstract: Electrocardiogram (ECG) is an essential signal in monitoring human heart activities. Researchers have achieved promising results in leveraging ECGs in clinical applications with deep learning models. However, the mainstream deep learning approaches usually neglect the periodic and formative attribute of the ECG heartbeat waveform. In this work, we propose a novel ECG-Segment based Learning (ECG-SL) framework to explicitly model the periodic nature of ECG signals. More specifically, ECG signals are first split into heartbeat segments, and then structural features are extracted from each of the segments. Based on the structural features, a temporal model is designed to learn the temporal information for various clinical tasks. Further, due to the fact that massive ECG signals are available but the labeled data are very limited, we also explore self-supervised learning strategy to pre-train the models, resulting significant improvement for downstream tasks. The proposed method outperforms the baseline model and shows competitive performances compared with task-specific methods in three clinical applications: cardiac condition diagnosis, sleep apnea detection, and arrhythmia classification. Further, we find that the ECG-SL tends to focus more on each heartbeat's peak and ST range than ResNet by visualizing the saliency maps.


title: Parameter-Efficient Tuning Helps Language Model Alignment

abstract: Aligning large language models (LLMs) with human preferences is essential for safe and useful LLMs. Previous works mainly adopt reinforcement learning (RLHF) and direct preference optimization (DPO) with human feedback for alignment. Nevertheless, they have certain drawbacks. One such limitation is that they can only align models with one preference at the training time (e.g., they cannot learn to generate concise responses when the preference data prefers detailed responses), or have certain constraints for the data format (e.g., DPO only supports pairwise preference data). To this end, prior works incorporate controllable generations for alignment to make language models learn multiple preferences and provide outputs with different preferences during inference if asked. Controllable generation also offers more flexibility with regard to data format (e.g., it supports pointwise preference data). Specifically, it uses different control tokens for different preferences during training and inference, making LLMs behave differently when required. Current controllable generation methods either use a special token or hand-crafted prompts as control tokens, and optimize them together with LLMs. As control tokens are typically much lighter than LLMs, this optimization strategy may not effectively optimize control tokens. To this end, we first use parameter-efficient tuning (e.g., prompting tuning and low-rank adaptation) to optimize control tokens and then fine-tune models for controllable generations, similar to prior works. Our approach, alignMEnt with parameter-Efficient Tuning (MEET), improves the quality of control tokens, thus improving controllable generation quality consistently by an apparent margin on two well-recognized datasets compared with prior works.


title: Determining the Optimal Number of Clusters for Time Series Datasets with Symbolic Pattern Forest

abstract: Clustering algorithms are among the most widely used data mining methods due to their exploratory power and being an initial preprocessing step that paves the way for other techniques. But the problem of calculating the optimal number of clusters (say k) is one of the significant challenges for such methods. The most widely used clustering algorithms like k-means and k-shape in time series data mining also need the ground truth for the number of clusters that need to be generated. In this work, we extended the Symbolic Pattern Forest algorithm, another time series clustering algorithm, to determine the optimal number of clusters for the time series datasets. We used SPF to generate the clusters from the datasets and chose the optimal number of clusters based on the Silhouette Coefficient, a metric used to calculate the goodness of a clustering technique. Silhouette was calculated on both the bag of word vectors and the tf-idf vectors generated from the SAX words of each time series. We tested our approach on the UCR archive datasets, and our experimental results so far showed significant improvement over the baseline.


title: Non-linear oscillators with Kuramoto-like local coupling: Complexity analysis and spatiotemporal pattern generation

abstract: Can a simple oscillator system, as in cellular automata, sustain complex nature upon discretization in time and space? The answer is by no means trivial as even the most simple, two-state, nearest neighbours cellular automata can lead to Universal Turing Machine (UTM) computing power. This study analyses a recently proposed model consisting of a ring of identical excitable Adler-type oscillators with local Kuramoto-like coupling in terms of its complexity. Regions with non-trivial, complex behaviour have been identified, where spatiotemporal maps closely resemble those found in elementary cellular automata, not only from the visual perspective but also from entropic measures characterization. Also, the possibility of enhanced computation at the edge of chaos is explored by monitoring the effective complexity measure, entropy density and informational distance, following previous approaches. Distance matrix, and the corresponding dendrograms, show that in the complex regions, a non-trivial set of hierarchies emerges where local communities can appear and sustain themself in time. The fact that coupled oscillators can be realized through dedicated electronic circuitry or the result of natural processes can make finding such complex dynamics, with potential computational power, an important one in a broad scope of applications and implications.


title: Equivalence of Doubly Periodic Tangles

abstract: Doubly periodic tangles, or \textit{DP tangles}, are embeddings of curves in the thickened plane that are periodically repeated in two directions. They are completely defined by their generating cells, the {\it flat motifs}, which can be chosen in infinitely many ways. DP tangles are used in modelling materials and physical systems of entangled filaments. In this paper we establish the mathematical framework of the topological theory of DP tangles. We first introduce a formal definition of DP tangles as topological objects and proceed with an exhaustive analysis in order to characterize the notion of {\it equivalence} between DP tangles and between their flat motifs. We further generalize our results to other diagrammatic categories, such as framed, virtual, singular, pseudo and bonded DP tangles, which could be used in novel applications.


title: Unveiling the Regulatory Factors for Phase Transitions in Zeolitic Imidazolate Frameworks: A High-Throughout Calculations and Data Mining

abstract: Recently, there have been significant advancements in the study of Metal-Organic Frameworks (MOFs), particularly in the discovery of glassy states in zeolitic imidazolate frameworks (ZIFs), a subset of MOFs. However, the correlation between the glass-forming ability (GFA) of MOFs and their structural characteristics remains poorly understood. To address this gap, we analyze over 20,000 MOFs from the QMOF database, comparing geometric and electronic order parameters between ZIFs and other MOFs. Our findings reveal a set of order parameters that effectively capture the thermal stability and GFA of MOFs, acting as structural genes to predict glass formation. Through molecular dynamics simulations on representative ZIF structures, we validate the reliability of these order parameters, particularly the total bond-order density (TBOD) and the largest cavity diameter (LCD), for screening potential melt-quenched MOFs. Furthermore, we predict that external pressure and electric fields can control the TBOD of MOFs, expanding our understanding of their thermal stability. This work identifies structural genes associated with the melt stability of MOFs,and contributes valuable insights into the prediction and understanding of MOF glass-forming ability.


title: Energy-dissipative spectral renormalization exponential integrator method for gradient flow problems

abstract: In this paper, we present a novel spectral renormalization exponential integrator method for solving gradient flow problems. Our method is specifically designed to simultaneously satisfy discrete analogues of the energy dissipation laws and achieve high-order accuracy in time. To accomplish this, our method first incorporates the energy dissipation law into the target gradient flow equation by introducing a time-dependent spectral renormalization (TDSR) factor. Then, the coupled equations are discretized using the spectral approximation in space and the exponential time differencing (ETD) in time. Finally, the resulting fully discrete nonlinear system is decoupled and solved using the Picard iteration at each time step. Furthermore, we introduce an extra enforcing term into the system for updating the TDSR factor, which greatly relaxes the time step size restriction of the proposed method and enhances its computational efficiency. Extensive numerical tests with various gradient flows are also presented to demonstrate the accuracy and effectiveness of our method as well as its high efficiency when combined with an adaptive time-stepping strategy for long-term simulations.


title: Modeling the Beam of Gravitational Radiation from a Cosmic String Loop

abstract: We investigate exact and approximate techniques to calculate the emission of gravitational radiation from cosmic string loops in order to generate beam models covering the entire celestial sphere for a wide range of modes $m$. One approach entails summing over contributions of stationary and nearly-stationary points of individual, factorized, left- and right-moving modes. This "multipoint method" generalizes traditional methods that rely on expansions around exact stationary points of mode products. A second complementary approach extends the method of steepest descent to generate an asymptotic description of the beam as $m \to \infty$. We present example calculations of the emission of power from cusp-containing loops and compare the results with those obtained by numerically exact techniques as well as by previous approaches. The multipoint method achieves its best results at an intermediate range of modes, improving over previous methods in terms of accuracy. It handles the emission from all regions of the loop not just those near cusps. We demonstrate this capability by making a detailed study of the "pseudocusp" phenomenon.


title: Large Scale Masked Autoencoding for Reducing Label Requirements on SAR Data

abstract: Satellite-based remote sensing is instrumental in the monitoring and mitigation of the effects of anthropogenic climate change. Large scale, high resolution data derived from these sensors can be used to inform intervention and policy decision making, but the timeliness and accuracy of these interventions is limited by use of optical data, which cannot operate at night and is affected by adverse weather conditions. Synthetic Aperture Radar (SAR) offers a robust alternative to optical data, but its associated complexities limit the scope of labelled data generation for traditional deep learning. In this work, we apply a self-supervised pretraining scheme, masked autoencoding, to SAR amplitude data covering 8.7\% of the Earth's land surface area, and tune the pretrained weights on two downstream tasks crucial to monitoring climate change - vegetation cover prediction and land cover classification. We show that the use of this pretraining scheme reduces labelling requirements for the downstream tasks by more than an order of magnitude, and that this pretraining generalises geographically, with the performance gain increasing when tuned downstream on regions outside the pretraining set. Our findings significantly advance climate change mitigation by facilitating the development of task and region-specific SAR models, allowing local communities and organizations to deploy tailored solutions for rapid, accurate monitoring of climate change effects.


title: Analytical proofs for the properties of the probability mass function of the Poisson distribution of order $k$

abstract: The Poisson distribution of order $k$ is a special case of a compound Poisson distribution. For $k=1$ it is the standard Poisson distribution. Our main result is a proof that for sufficiently small values of the rate parameter $\lambda$, the probability mass function (pmf) decreases monotonically for all $n\ge k$ (it is known that the pmf increases strictly for $1\le n \le k$, for fixed $k\ge2$ and all $\lambda>0$). The second main result is a partial proof that the difference (mean $-$ mode) does not exceed $k$. The term `partial proof' signifies that the derivation is conditional on an assumption which, although plausible and supported by numerical evidence, is as yet not proved. This note also presents new inequalities, and sharper bounds for some published inequalities, for the Poisson distribution of order $k$.


title: A Model for Calculating Cost of Applying Electronic Governance and Robotic Process Automation to a Distributed Management System

abstract: Electronic Governance (eGov) and Robotic Process Automation (RPA) are two technological advancements that have the potential to revolutionize the way organizations manage their operations. When applied to Distributed Management (DM), these technologies can further enhance organizational efficiency and effectiveness. In this brief article, we present a mathematical model for calculating the cost of accomplishing a task by applying eGov and RPA in a DM system. This model is one of the first of its kind, and is expected to spark further research on cost analysis for organizational efficiency given the unprecedented advancements in electronic and automation technologies.


title: Online Sensitivity Optimization in Differentially Private Learning

abstract: Training differentially private machine learning models requires constraining an individual's contribution to the optimization process. This is achieved by clipping the $2$-norm of their gradient at a predetermined threshold prior to averaging and batch sanitization. This selection adversely influences optimization in two opposing ways: it either exacerbates the bias due to excessive clipping at lower values, or augments sanitization noise at higher values. The choice significantly hinges on factors such as the dataset, model architecture, and even varies within the same optimization, demanding meticulous tuning usually accomplished through a grid search. In order to circumvent the privacy expenses incurred in hyperparameter tuning, we present a novel approach to dynamically optimize the clipping threshold. We treat this threshold as an additional learnable parameter, establishing a clean relationship between the threshold and the cost function. This allows us to optimize the former with gradient descent, with minimal repercussions on the overall privacy analysis. Our method is thoroughly assessed against alternative fixed and adaptive strategies across diverse datasets, tasks, model dimensions, and privacy levels. Our results indicate that it performs comparably or better in the evaluated scenarios, given the same privacy requirements.


title: Probability Conservation and Localization in a One-Dimensional Non-Hermitian System

abstract: We consider transport through a non-Hermitian conductor connected to a pair of Hermitian leads and analyze the underlying non-Hermitian scattering problem. In a typical non-Hermitian system, such as a Hatano--Nelson-type asymmetric hopping model, the continuity of probability and probability current is broken at a local level. As a result, the notion of transmission and reflection probabilities becomes ill-defined. Instead of these probabilities, we introduce the injection rate $R_{\rm I}=1-|{\cal R}|^2$ and the transmission rate $R_{\rm T}=|{\cal T}|^2$ as relevant physical quantities, where ${\cal T}$ and ${\cal R}$ are the transmission and reflection amplitudes, respectively. In a generic non-Hermitian case, $R_{\rm I}$ and $R_{\rm T}$ have independent information. We provide a modified continuity equation in terms of incoming and outgoing currents, from which we derive a global probability conservation law that relates $R_{\rm I}$ and $R_{\rm T}$. We have tested the usefulness of our probability conservation law in the interpretation of numerical results for non-Hermitian localization and delocalization phenomena.


title: Action Recognition Utilizing YGAR Dataset

abstract: The scarcity of high quality actions video data is a bottleneck in the research and application of action recognition. Although significant effort has been made in this area, there still exist gaps in the range of available data types a more flexible and comprehensive data set could help bridge. In this paper, we present a new 3D actions data simulation engine and generate 3 sets of sample data to demonstrate its current functionalities. With the new data generation process, we demonstrate its applications to image classifications, action recognitions and potential to evolve into a system that would allow the exploration of much more complex action recognition tasks. In order to show off these capabilities, we also train and test a list of commonly used models for image recognition to demonstrate the potential applications and capabilities of the data sets and their generation process.


title: Natural Language Models for Data Visualization Utilizing nvBench Dataset

abstract: Translation of natural language into syntactically correct commands for data visualization is an important application of natural language models and could be leveraged to many different tasks. A closely related effort is the task of translating natural languages into SQL queries, which in turn could be translated into visualization with additional information from the natural language query supplied\cite{Zhong:2017qr}. Contributing to the progress in this area of research, we built natural language translation models to construct simplified versions of data and visualization queries in a language called Vega Zero. In this paper, we explore the design and performance of these sequence to sequence transformer based machine learning model architectures using large language models such as BERT as encoders to predict visualization commands from natural language queries, as well as apply available T5 sequence to sequence models to the problem for comparison.


title: Necessary and Sufficient Watermark for Large Language Models

abstract: In recent years, large language models (LLMs) have achieved remarkable performances in various NLP tasks. They can generate texts that are indistinguishable from those written by humans. Such remarkable performance of LLMs increases their risk of being used for malicious purposes, such as generating fake news articles. Therefore, it is necessary to develop methods for distinguishing texts written by LLMs from those written by humans. Watermarking is one of the most powerful methods for achieving this. Although existing watermarking methods have successfully detected texts generated by LLMs, they significantly degrade the quality of the generated texts. In this study, we propose the Necessary and Sufficient Watermark (NS-Watermark) for inserting watermarks into generated texts without degrading the text quality. More specifically, we derive minimum constraints required to be imposed on the generated texts to distinguish whether LLMs or humans write the texts. Then, we formulate the NS-Watermark as a constrained optimization problem and propose an efficient algorithm to solve it. Through the experiments, we demonstrate that the NS-Watermark can generate more natural texts than existing watermarking methods and distinguish more accurately between texts written by LLMs and those written by humans. Especially in machine translation tasks, the NS-Watermark can outperform the existing watermarking method by up to 30 BLEU scores.


title: Energy-Aware Route Planning for a Battery-Constrained Robot with Multiple Charging Depots

abstract: This paper considers energy-aware route planning for a battery-constrained robot operating in environments with multiple recharging depots. The robot has a battery discharge time $D$, and it should visit the recharging depots at most every $D$ time units to not run out of charge. The objective is to minimize robot's travel time while ensuring it visits all task locations in the environment. We present a $O(\log D)$ approximation algorithm for this problem. We also present heuristic improvements to the approximation algorithm and assess its performance on instances from TSPLIB, comparing it to an optimal solution obtained through Integer Linear Programming (ILP). The simulation results demonstrate that, despite a more than $20$-fold reduction in runtime, the proposed algorithm provides solutions that are, on average, within $31\%$ of the ILP solution.


title: TRAM: Benchmarking Temporal Reasoning for Large Language Models

abstract: Reasoning about time is essential for understanding the nuances of events described in natural language. Previous research on this topic has been limited in scope, characterized by a lack of standardized benchmarks that would allow for consistent evaluations across different studies. In this paper, we introduce TRAM, a temporal reasoning benchmark composed of ten datasets, encompassing various temporal aspects of events such as order, arithmetic, frequency, and duration, designed to facilitate a comprehensive evaluation of the TeR capabilities of large language models (LLMs). We evaluate popular LLMs like GPT-4 and Llama2 in zero-shot and few-shot scenarios, and establish baselines with BERT-based and domain-specific models. Our findings indicate that the best-performing model lags significantly behind human performance. It is our aspiration that TRAM will spur further progress in enhancing the TeR capabilities of LLMs.


title: Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models

abstract: Logical reasoning is fundamental for humans yet presents a substantial challenge in the domain of Artificial Intelligence. Initially, researchers used Knowledge Representation and Reasoning (KR) systems that did not scale and required non-trivial manual effort. Recently, the emergence of large language models (LLMs) has demonstrated the ability to overcome various limitations of formal Knowledge Representation (KR) systems. Consequently, there's a growing interest in using LLMs for logical reasoning via natural language. This work strives to understand the proficiency of LLMs in logical reasoning by offering a brief review of the latest progress in this area; with a focus on the logical reasoning datasets, tasks, and the methods adopted to utilize LLMs for reasoning. To offer a thorough analysis, we have compiled a benchmark titled LogiGLUE. This includes 24 varied datasets encompassing deductive, abductive, and inductive reasoning. Utilizing LogiGLUE as a foundation, we have trained an instruction fine-tuned language model, resulting in LogiT5. We study single-task training, multi-task training, and "chain-of-thought" knowledge distillation fine-tuning technique to assess the performance of model across the different logical reasoning categories. We also assess various LLMs using LogiGLUE, and the findings indicate that LLMs excel most in abductive reasoning, followed by deductive reasoning, while they are least effective at inductive reasoning. We aim to shed light on the capabilities and potential pathways for enhancing logical reasoning proficiency in LLMs, paving the way for more advanced and nuanced developments in this critical field.


title: Helios: An Efficient Out-of-core GNN Training System on Terabyte-scale Graphs with In-memory Performance

abstract: Training graph neural networks (GNNs) on large-scale graph data holds immense promise for numerous real-world applications but remains a great challenge. Several disk-based GNN systems have been built to train large-scale graphs in a single machine. However, they often fall short in terms of performance, especially when training on terabyte-scale graphs. This is because existing disk-based systems either overly focus on minimizing the number of SSD accesses or do not fully overlap SSD accesses with GNN training, thus resulting in substantial unnecessary overhead on the CPU side and then low GPU utilization. To this end, we propose Helios, a system that can train GNN on terabyte graphs in a single machine while achieving throughput comparable with in-memory systems. To achieve this, we first present a GPU-initiated asynchronous disk IO stack, allowing the GPU to directly access graph data on SSD. This design only requires about 30% GPU cores to reach the almost maximal disk IO throughput and wastes no GPU cores between IO submission and IO completion such that the majority of GPU cores are left for other GNN kernels. Second, we design a GPU-managed heterogeneous cache that extends the cache hierarchy to heterogeneous CPU and GPU memory and thus enhances cache lookup throughput significantly by GPU parallelism. Finally, we build a deep GNN-aware pipeline that seamlessly integrates the computation and communication phases of the entire GNN training process, maximizing the utility of GPU computation cycles. Experimental results demonstrate that Helios can match the training throughput of in-memory GNN systems, even for terabyte-scale graphs. Remarkably, Helios surpasses the state-of-the-art GPU-managed baselines by up to 6.43x and exceeds CPU-managed baselines by over 182x on all terabyte-scale graphs.


title: Spin-orbit enabled unconventional Stoner magnetism

abstract: The Stoner instability remains a cornerstone for understanding metallic ferromagnets. This instability captures the interplay of Coulomb repulsion, Pauli exclusion, and two-fold fermionic spin degeneracy. In materials with spin-orbit coupling, this fermionic spin is generalized to a two-fold degenerate pseudospin which is typically believed to have symmetry properties as spin. Here we identify a distinct symmetry of this pseudospin that forbids it to couple to a Zeeman field. This `spinless' property is required to exist in five non-symmorphic space groups and has non-trivial implications for superconductivity and magnetism. With Coulomb repulsion, Fermi surfaces composed primarily of this spinless pseudospin feature give rise to Stoner instabilities into magnetic states that are qualitatively different than ferromagnets. These spinless-pseudospin ferromagnets break time-reversal symmetry, have a vanishing magnetization, are non-collinear, and exhibit altermagnetic-like energy band spin-splittings. In superconductors, for all pairing symmetries and field orientations, this spinless pseudospin extinguishes paramagnetic limiting. We discuss applications to superconducting UCoGe and magnetic NiS$_{2-x}$Se$_x$.


title: Subsurface Characterization using Ensemble-based Approaches with Deep Generative Models

abstract: Estimating spatially distributed properties such as hydraulic conductivity (K) from available sparse measurements is a great challenge in subsurface characterization. However, the use of inverse modeling is limited for ill-posed, high-dimensional applications due to computational costs and poor prediction accuracy with sparse datasets. In this paper, we combine Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP), a deep generative model that can accurately capture complex subsurface structure, and Ensemble Smoother with Multiple Data Assimilation (ES-MDA), an ensemble-based inversion method, for accurate and accelerated subsurface characterization. WGAN-GP is trained to generate high-dimensional K fields from a low-dimensional latent space and ES-MDA then updates the latent variables by assimilating available measurements. Several subsurface examples are used to evaluate the accuracy and efficiency of the proposed method and the main features of the unknown K fields are characterized accurately with reliable uncertainty quantification. Furthermore, the estimation performance is compared with a widely-used variational, i.e., optimization-based, inversion approach, and the proposed approach outperforms the variational inversion method, especially for the channelized and fractured field examples. We explain such superior performance by visualizing the objective function in the latent space: because of nonlinear and aggressive dimension reduction via generative modeling, the objective function surface becomes extremely complex while the ensemble approximation can smooth out the multi-modal surface during the minimization. This suggests that the ensemble-based approach works well over the variational approach when combined with deep generative models at the cost of forward model runs unless convergence-ensuring modifications are implemented in the variational inversion.


title: Error Norm Truncation: Robust Training in the Presence of Data Noise for Text Generation Models

abstract: Text generation models are notoriously vulnerable to errors in the training data. With the wide-spread availability of massive amounts of web-crawled data becoming more commonplace, how can we enhance the robustness of models trained on a massive amount of noisy web-crawled text? In our work, we propose Error Norm Truncation (ENT), a robust enhancement method to the standard training objective that truncates noisy data. Compared to methods that only uses the negative log-likelihood loss to estimate data quality, our method provides a more accurate estimation by considering the distribution of non-target tokens, which is often overlooked by previous work. Through comprehensive experiments across language modeling, machine translation, and text summarization, we show that equipping text generation models with ENT improves generation quality over standard training and previous soft and hard truncation methods. Furthermore, we show that our method improves the robustness of models against two of the most detrimental types of noise in machine translation, resulting in an increase of more than 2 BLEU points over the MLE baseline when up to 50% of noise is added to the data.


title: Drug Discovery with Dynamic Goal-aware Fragments

abstract: Fragment-based drug discovery is an effective strategy for discovering drug candidates in the vast chemical space, and has been widely employed in molecular generative models. However, many existing fragment extraction methods in such models do not take the target chemical properties into account or rely on heuristic rules. Additionally, the existing fragment-based generative models cannot update the fragment vocabulary with goal-aware fragments newly discovered during the generation. To this end, we propose a molecular generative framework for drug discovery, named Goal-aware fragment Extraction, Assembly, and Modification (GEAM). GEAM consists of three modules, each responsible for goal-aware fragment extraction, fragment assembly, and fragment modification. The fragment extraction module identifies important fragments contributing to the desired target properties with the information bottleneck principle, thereby constructing an effective goal-aware fragment vocabulary. Moreover, GEAM can explore beyond the initial vocabulary with the fragment modification module, and the exploration is further enhanced through the dynamic goal-aware vocabulary update. We experimentally demonstrate that GEAM effectively discovers drug candidates through the generative cycle of the three modules in various drug discovery tasks. Our code is available at https://github.com/SeulLee05/GEAM.


title: Time-averaged Dynamics of Compressible Particles in Oscillatory Gradient Flows

abstract: Acoustic fields effect steady transport of suspended particles by rectifying the inertia of primary oscillations. We develop a fully analytic theory that relates this steady particle motion to incident oscillatory (acoustic) flow and the time-averaged force acting on the particle, systematically spanning the entire range between inviscid acoustofluidics and viscous particle hydrodynamics. By applying the Lorentz reciprocal theorem, we obtain a Fax\'{e}n-like relationship that includes nonlinear inertial forces, which depend on (i) the thickness of the oscillatory Stokes layer around the particle, and (ii) the density and compressibility contrast between the particle and the fluid. The framework recovers secondary radiation forces for thin Stokes layers, and predicts a reversal of the motion when the thickness of the Stokes layer is comparable to the particle size. We quantitatively validate the theory using numerical simulations of the timescale-separated hydrodynamics.


title: Prov2vec: Learning Provenance Graph Representation for Unsupervised APT Detection

abstract: Modern cyber attackers use advanced zero-day exploits, highly targeted spear phishing, and other social engineering techniques to gain access and also use evasion techniques to maintain a prolonged presence within the victim network while working gradually towards the objective. To minimize the damage, it is necessary to detect these Advanced Persistent Threats as early in the campaign as possible. This paper proposes, Prov2Vec, a system for the continuous monitoring of enterprise host's behavior to detect attackers' activities. It leverages the data provenance graph built using system event logs to get complete visibility into the execution state of an enterprise host and the causal relationship between system entities. It proposes a novel provenance graph kernel to obtain the canonical representation of the system behavior, which is compared against its historical behaviors and that of other hosts to detect the deviation from the normality. These representations are used in several machine learning models to evaluate their ability to capture the underlying behavior of an endpoint host. We have empirically demonstrated that the provenance graph kernel produces a much more compact representation compared to existing methods while improving prediction ability.


title: Emergence of compact-disordered phase in a polymer Potts model

abstract: One of the central problems in epigenetics is how epigenetic modification patterns and chromatin structure are regulated in the cell nucleus. The polymer Potts model, a recently studied model of chromatins, is introduced with an offset in the interaction energy as a parameter, and the equilibrium properties are investigated using the mean-field analysis of the lattice model and molecular dynamics simulations of the off-lattice model. The results show that in common with both models, a phase emerges, which could be called the compact-disordered phase, in which the polymer conformation is compact and the epigenetic modification pattern is disordered, depending on the offset in the interaction energy and the fraction of the modified nucleosomes.


title: Application of frozen large-scale models to multimodal task-oriented dialogue

abstract: In this study, we use the existing Large Language Models ENnhanced to See Framework (LENS Framework) to test the feasibility of multimodal task-oriented dialogues. The LENS Framework has been proposed as a method to solve computer vision tasks without additional training and with fixed parameters of pre-trained models. We used the Multimodal Dialogs (MMD) dataset, a multimodal task-oriented dialogue benchmark dataset from the fashion field, and for the evaluation, we used the ChatGPT-based G-EVAL, which only accepts textual modalities, with arrangements to handle multimodal data. Compared to Transformer-based models in previous studies, our method demonstrated an absolute lift of 10.8% in fluency, 8.8% in usefulness, and 5.2% in relevance and coherence. The results show that using large-scale models with fixed parameters rather than using models trained on a dataset from scratch improves performance in multimodal task-oriented dialogues. At the same time, we show that Large Language Models (LLMs) are effective for multimodal task-oriented dialogues. This is expected to lead to efficient applications to existing systems.


title: Generalized spectral characterization of signed trees

abstract: Let $T$ be a tree with an irreducible characteristic polynomial $\phi(x)$ over $\mathbb{Q}$. Let $\Delta(T)$ be the discriminant of $\phi(x)$. It is proved that if $2^{-\frac n2}\sqrt{\Delta(T)}$ (which is always an integer) is odd and square free, then every signed tree with underlying graph $T$ is determined by its generalized spectrum.


title: Can Pre-trained Networks Detect Familiar Out-of-Distribution Data?

abstract: Out-of-distribution (OOD) detection is critical for safety-sensitive machine learning applications and has been extensively studied, yielding a plethora of methods developed in the literature. However, most studies for OOD detection did not use pre-trained models and trained a backbone from scratch. In recent years, transferring knowledge from large pre-trained models to downstream tasks by lightweight tuning has become mainstream for training in-distribution (ID) classifiers. To bridge the gap between the practice of OOD detection and current classifiers, the unique and crucial problem is that the samples whose information networks know often come as OOD input. We consider that such data may significantly affect the performance of large pre-trained networks because the discriminability of these OOD data depends on the pre-training algorithm. Here, we define such OOD data as PT-OOD (Pre-Trained OOD) data. In this paper, we aim to reveal the effect of PT-OOD on the OOD detection performance of pre-trained networks from the perspective of pre-training algorithms. To achieve this, we explore the PT-OOD detection performance of supervised and self-supervised pre-training algorithms with linear-probing tuning, the most common efficient tuning method. Through our experiments and analysis, we find that the low linear separability of PT-OOD in the feature space heavily degrades the PT-OOD detection performance, and self-supervised models are more vulnerable to PT-OOD than supervised pre-trained models, even with state-of-the-art detection methods. To solve this vulnerability, we further propose a unique solution to large-scale pre-trained models: Leveraging powerful instance-by-instance discriminative representations of pre-trained models and detecting OOD in the feature space independent of the ID decision boundaries. The code will be available via https://github.com/AtsuMiyai/PT-OOD.


title: Logarithmic Corrections to Kerr Thermodynamics

abstract: Recent work has shown that loop corrections from massless particles generate $\frac{3}{2}\log T_{\text{Hawking}}$ corrections to black hole entropy which dominate the thermodynamics of cold near-extreme charged black holes. Here we adapt this analysis to near-extreme Kerr black holes. Like AdS$_2\times S^2$, the Near-Horizon Extreme Kerr (NHEK) metric has a family of normalizable zero modes corresponding to reparametrizations of boundary time. The path integral over these zero modes leads to an infrared divergence in the one-loop approximation to the Euclidean NHEK partition function. We regulate this divergence by retaining the leading finite temperature correction in the NHEK scaling limit. This "not-NHEK" geometry lifts the eigenvalues of the zero modes, rendering the path integral infrared finite. The quantum-corrected near-extremal entropy exhibits $\frac{3}{2}\log T_{\text{Hawking}}$ behavior characteristic of the Schwarzian model and predicts a lifting of the ground state degeneracy for the extremal Kerr black hole.


title: Programmable order by disorder effect and underlying phases through dipolar quantum simulators

abstract: In this work, we study two different quantum simulators composed of molecules with dipole-dipole interaction through various theoretical and numerical tools. Our first result provides knowledge upon the quantum order by disorder effect of the $S=1/2$ system, which is programmable in a quantum simulator composed of circular Rydberg atoms in the triangular optical lattice with a controllable diagonal anisotropy. When the numbers of up spins and down spins are equal, a set of sub-extensive degenerate ground states is present in the classical limit, composed of continuous strings whose configuration enjoys a large degree of freedom. Adopting the the real space perturbation theory, our calculation demonstrates a lifting of the degeneracy, favoring the stripe configuration. When $J$ becomes larger, we adopt the infinite projected entangled-pair state~(iPEPS) and numerically check the effect of degeneracy lifting. The iPEPS results show that even when the spin exchange coupling is strong the stripe pattern is still favored. Next, we study the dipolar bosonic model with tilted polar angle which can be realized through a quantum simulator composed of cold atomic gas with dipole-dipole interaction in an optical lattice. By placing the atoms in a triangular lattice and tilting the polar angle, the diagonal anisotropy can also be realized in the bosonic system. With our cluster mean-field theory calculation, we provide various phase diagrams with different tilted angles, showing the abundant underlying phases including the supersolid. Our proposal indicates realizable scenarios through quantum simulators in studying the quantum effect as well as extraordinary phases. We believe that our results indicated here can also become a good benchmark for the two-dimensional quantum simulators.


title: Compact Weyl-parallel manifolds

abstract: By ECS manifolds one means pseudo-Riemannian manifolds of dimensions $\,n\ge4\,$ which have parallel Weyl tensor, but not for one of the two obvious reasons: conformal flatness or local symmetry. As shown by Roter [10, 2], they exist for every $\,n\ge4$, and their metrics are always indefinite. The local structure of ECS manifolds has been completely described [3]. Every ECS manifold has an invariant called rank, equal to 1 or 2. Known examples of compact ECS manifolds [4, 6], representing every dimension $\,n\ge5$, are of rank 1. When $\,n\,$ is odd, some further, recently found examples are locally homogeneous [7]. We outline the proof of the author's result, joint with Ivo Terek [5], which states that a compact rank-one ECS manifold, if not locally homogeneous, replaced if necessary by a two-fold isometric covering, must be the total space of a bundle over the circle.


title: High-curvature, high-force, vine robot for inspection

abstract: Robot performance has advanced considerably both in and out of the factory, however in tightly constrained, unknown environments such as inside a jet engine or the human heart, current robots are less adept. In such cases where a borescope or endoscope can't reach, disassembly or surgery are costly. One promising inspection device inspired by plant growth are "vine robots" that can navigate cluttered environments by extending from their tip. Yet, these vine robots are currently limited in their ability to simultaneously steer into tight curvatures and apply substantial forces to the environment. Here, we propose a plant-inspired method of steering by asymmetrically lengthening one side of the vine robot to enable high curvature and large force application. Our key development is the introduction of an extremely anisotropic, composite, wrinkled film with elastic moduli 400x different in orthogonal directions. The film is used as the vine robot body, oriented such that it can stretch over 120% axially, but only 3% circumferentially. With the addition of controlled layer jamming, this film enables a steering method inspired by plants in which the circumference of the robot is inextensible, but the sides can stretch to allow turns. This steering method and body pressure do not work against each other, allowing the robot to exhibit higher forces and tighter curvatures than previous vine robot architectures. This work advances the abilities of vine robots--and robots more generally--to not only access tightly constrained environments, but perform useful work once accessed.


title: Duality and $\chi$-Boundedness of Ordered Graphs

abstract: We shall show that there exists only one duality pair for ordered graphs. We will also define a corresponding definition of $\chi$-boundedness for ordered graphs and show that all ordered graphs are $\chi$-bounded and prove an analogy of Gyarf\'as-Sumner conjecture for ordered graphs. We shall conclude with showing that these results hold for directed ordered graphs, but they do not hold for oriented ordered graphs.


title: Magnetic properties of the quasi-one-dimensional S = 1 spin chain antiferromagnet BaNiTe2O7

abstract: We report a quasi-one-dimensional S = 1 spin chain compound BaNiTe2O7. This magnetic system has been investigated by magnetic susceptibility, specific heat, and neutron powder diffraction. These results indicate that BaNiTe2O7 develops a short-range magnetic correlation around T ~ 22 K. With further cooling, an antiferromagnetic phase transition is observed at TN ~ 5.4 K. Neutron powder diffraction revealed antiferromagnetic noncollinear order with a commensurate propagation vector k = (1/2, 1, 0). The refined magnetic moment size of Ni2+ at 1.5 K is 1.84{\mu}B, and its noncollinear spin texture is confirmed by first-principles calculations. Inelastic neutron-scattering results and density functional theory calculations confirmed the quasi-one-dimensional nature of the spin systems.


title: Regulating CPU Temperature With Thermal-Aware Scheduling Using a Reduced Order Learning Thermal Model

abstract: Modern real-time systems utilize considerable amounts of power while executing computation-intensive tasks. The execution of these tasks leads to significant power dissipation and heating of the device. It therefore results in severe thermal issues like temperature escalation, high thermal gradients, and excessive hot spot formation, which may result in degrading chip performance, accelerating device aging, and premature failure. Thermal-Aware Scheduling (TAS) enables optimization of thermal dissipation to maintain a safe thermal state. In this work, we implement a new TAS algorithm, POD-TAS, which manages the thermal behavior of a multi-core CPU based on a defined set of states and their transitions. We compare the performances of a dynamic RC thermal circuit simulator (HotSpot) and a reduced order Proper Orthogonal Decomposition (POD)-based thermal model and we select the latter for use in our POD-TAS algorithm. We implement a novel simulation-based evaluation methodology to compare TAS algorithms. This methodology is used to evaluate the performance of the proposed POD-TAS algorithm. Additionally, we compare the performance of a state of the art TAS algorithm, RT-TAS, to our proposed POD-TAS algorithm. Furthermore, we utilize the COMBS benchmark suite to provide CPU workloads for task scheduling. Our experimental results on a multi-core processor using a set of 4 benchmarks demonstrate that the proposed POD-TAS method can improve thermal performance by decreasing the peak thermal variance by 53.0% and the peak chip temperature of 29.01%. Using a set of 8 benchmarks, the comparison of the two algorithms shows a decrease of 29.57% in the peak spatial variance of the chip temperature and 26.26% in the peak chip temperature. We also identify several potential future research directions.


title: Equivariant Schubert calculus and geometric Satake

abstract: The main classical result of Schubert calculus is that multiplication rules for the basis of Schubert cycles inside the cohomology ring of the Grassmannian $G(n,m)$ are the same as multiplication rules for the basis of Schur polynomials in the ring of symmetric polynomials. In this paper, we explain how to recover this somewhat mysterious connection by using the geometric Satake correspondence to put the structure of a representation of $GL_m$ on $H^\bullet(G(n,m))$ and comparing it to the Fock space representation on symmetric polynomials. This proof also extends to equivariant Schubert calculus, and gives an explanation of the relationship between torus-equivariant cohomology of Grassmannians and double Schur polynomials.


title: Multi-triplet Feature Augmentation for Ponzi Scheme Detection in Ethereum

abstract: Blockchain technology revolutionizes the Internet, but also poses increasing risks, particularly in cryptocurrency finance. On the Ethereum platform, Ponzi schemes, phishing scams, and a variety of other frauds emerge. Existing Ponzi scheme detection approaches based on heterogeneous transaction graph modeling leverages semantic information between node (account) pairs to establish connections, overlooking the semantic attributes inherent to the edges (interactions). To overcome this, we construct heterogeneous Ethereum interaction graphs with multiple triplet interaction patterns to better depict the real Ethereum environment. Based on this, we design a new framework named multi-triplet augmented heterogeneous graph neural network (MAHGNN) for Ponzi scheme detection. We introduce the Conditional Variational Auto Encoder (CVAE) to capture the semantic information of different triplet interaction patterns, which facilitates the characterization on account features. Extensive experiments demonstrate that MAHGNN is capable of addressing the problem of multi-edge interactions in heterogeneous Ethereum interaction graphs and achieving state-of-the-art performance in Ponzi scheme detection.


title: Massive Scalar Field Perturbations of Black Holes Surrounded by Dark Matter

abstract: We consider scalar field perturbations in the background of black holes immersed in perfect fluid dark matter (PFDM). We find, by using the sixth order Wentzel-Kramers-Brillouin (WKB) approximation, that the longest-lived modes are the ones with higher angular number, for a scalar field mass smaller than a critical value, known as anomalous decay rate of the quasinormal modes, while that beyond this critical value the behaviour is inverted. Moreover, we show that it is possible to recover the real part of the quasinormal frequencies (QNFs), the imaginary part of the QNFs, and the critical scalar field mass, of the Schwarzschild background for different values of the PFDM intensity parameter $k$, respectively. For values of $k$ smaller than these values, the mentioned quantities are greater than the Schwarzschild background. However, beyond of these values of $k$, these quantities are smaller than the Schwarzschild background.


title: Impact of transforming interface geometry on edge states in valley photonic crystals

abstract: Topologically protected edge states arise at the interface of two topologically distinct valley photonic crystals. In this work, we investigate how tailoring the interface geometry, specifically from a zigzag interface to a glide plane, profoundly affects these edge states. Near-field measurements demonstrate how this transformation significantly changes the dispersion relation of the edge mode. We observe a transition from gapless edge states to gapped ones, accompanied by the occurrence of slow light within the Brillouin zone, rather than at its edge. Additionally, we simulate the propagation of the modified edge states through a specially designed valley-conserving defect. The simulations show, by monitoring the transmittance of this defect, how the robustness to backscattering gradually decreases, suggesting a disruption of valley-dependent transport. These findings demonstrate how the gradual emergence of valley-dependent gapless edge states in a valley photonic crystal depends on the geometry of its interface.


title: Some new relativistic charged models for compact objects with anisotropic pressure

abstract: In this paper, we found new classes of solutions to the Einstein-Maxwell field equations with matter anisotropic distribution incorporating a particular form of electric field intensity within the framework of general relativity. We use a metric potential or ansatz that depends on an adjustable parameter in order to get the new solutions. We generated new models of compact stars. Graphical analysis allows us to conclude that the new models satisfy all the physical characteristics for astrophysical objects and can be very useful in the study and description of compact structures. We obtained models consistent with two types of pulsars


title: Surrounded by Giants: Habitable Zone Stability Within the HD 141399 System

abstract: The search for exoplanets has revealed a diversity of planetary system architectures, the vast majority of which diverge significantly from the template of the solar system. In particular, giant planets beyond the snow line are relatively rare, especially for low-mass stars, placing the solar system within a small category of systems with multiple giant planets at large separations. An exoplanetary system of note is that of HD 141399, consisting of a K dwarf host star that harbors four giant planets with separations extending to $\sim$4.5 AU. The architecture of the system creates a complex pattern of mean motion resonances and gravitationally perturbed regions that may exclude the presence of other planets, including within the Habitable Zone of the system. Here, we present the results of dynamical simulations that explore the interaction of the known planets of the system, their apsidal trajectories, resonance locations, and dynamical evolution. We further investigate the results of injecting Earth-mass planets and provide the regions of dynamical viability within the Habitable Zone where terrestrial planets may maintain long-term stability. We discuss these results in the context of the importance of giant planets for volatile delivery and planetary habitability considerations.


title: Degrees of Randomness in Rerandomization Procedures

abstract: Randomized controlled trials are susceptible to imbalance on covariates predictive of the outcome. Rerandomization and deterministic treatment assignment are two proposed solutions. This paper explores the relationship between rerandomization and deterministic assignment, showing how deterministic assignment is an extreme case of rerandomization. The paper argues that in small experiments, both fully randomized and fully deterministic assignment have limitations. Instead, the researcher should consider setting the rerandomization acceptance probability based on an analysis of covariates and assumptions about the data structure to achieve an optimal alignment between randomness and balance. This allows for the calculation of minimum p-values along with valid permutation tests and fiducial intervals. The paper also introduces tools, including a new, open-source R package named fastrerandomize, to implement rerandomization and explore options for optimal rerandomization acceptance thresholds.


title: Shack-Hartmann wavefront sensing: A new approach to time-resolved measurement of stress intensity during dynamic fracture of small brittle specimens

abstract: The stress intensity factor is important for understanding crack initiation and propagation. Because it cannot be measured directly, the characterization of the stress intensity factor relies on the measurement of deformation around a crack tip. Such measurements are challenging for dynamic fracture of brittle materials where the deformation is small and the crack tip velocity can be high (>1 km/s). Digital gradient sensing (DGS) is capable of full-field measurement of surface deformation with sub-microsecond temporal resolution, but it is limited to centimeter-scale specimens and has a spatial resolution of only $\sim 1$mm. This limits its ability to measure deformations close to the crack tip. Here, we demonstrate the potential of Shack-Hartmann wavefront sensing (SHWFS), as an alternative to DGS, for measuring surface deformation during dynamic brittle fracture of millimeter-scale specimens. Using an commercial glass ceramic as an example material, we demonstrate the capability of SHWFS to measure the surface slope evolution induced by a propagating crack on millimeter-scale specimens with a micrometer-scale spatial resolution and a sub-microsecond temporal resolution. The SHWFS apparatus has the additional advantage of being physically more compact than a typical DGS apparatus. We verify our SHWFS measurements by comparing them with analytical predictions and phase-field simulations of the surface slope around a crack tip. Then, fitting the surface slope measurements to the asymptotic crack-tip field solution, we extract the evolution of the apparent stress intensity factor associated with the propagating crack tip. We conclude by discussing potential future enhancements of this technique and how its compactness could enable the integration with other characterization techniques including x-ray phase-contrast imaging (XPCI) toward a multi-modal characterization.


title: Syllable-level lyrics generation from melody exploiting character-level language model

abstract: The generation of lyrics tightly connected to accompanying melodies involves establishing a mapping between musical notes and syllables of lyrics. This process requires a deep understanding of music constraints and semantic patterns at syllable-level, word-level, and sentence-level semantic meanings. However, pre-trained language models specifically designed at the syllable level are publicly unavailable. To solve these challenging issues, we propose to exploit fine-tuning character-level language models for syllable-level lyrics generation from symbolic melody. In particular, our method endeavors to incorporate linguistic knowledge of the language model into the beam search process of a syllable-level Transformer generator network. Additionally, by exploring ChatGPT-based evaluation for generated lyrics, along with human subjective evaluation, we demonstrate that our approach enhances the coherence and correctness of the generated lyrics, eliminating the need to train expensive new language models.


title: Multi-Label Residual Weighted Learning for Individualized Combination Treatment Rule

abstract: Individualized treatment rules (ITRs) have been widely applied in many fields such as precision medicine and personalized marketing. Beyond the extensive studies on ITR for binary or multiple treatments, there is considerable interest in applying combination treatments. This paper introduces a novel ITR estimation method for combination treatments incorporating interaction effects among treatments. Specifically, we propose the generalized $\psi$-loss as a non-convex surrogate in the residual weighted learning framework, offering desirable statistical and computational properties. Statistically, the minimizer of the proposed surrogate loss is Fisher-consistent with the optimal decision rules, incorporating interaction effects at any intensity level - a significant improvement over existing methods. Computationally, the proposed method applies the difference-of-convex algorithm for efficient computation. Through simulation studies and real-world data applications, we demonstrate the superior performance of the proposed method in recommending combination treatments.


title: Data Science at the Singularity

abstract: A purported `AI Singularity' has been in the public eye recently. Mass media and US national political attention focused on `AI Doom' narratives hawked by social media influencers. The European Commission is announcing initiatives to forestall `AI Extinction'. In my opinion, `AI Singularity' is the wrong narrative for what's happening now; recent happenings signal something else entirely. Something fundamental to computation-based research really changed in the last ten years. In certain fields, progress is dramatically more rapid than previously, as the fields undergo a transition to frictionless reproducibility (FR). This transition markedly changes the rate of spread of ideas and practices, affects mindsets, and erases memories of much that came before. The emergence of frictionless reproducibility follows from the maturation of 3 data science principles in the last decade. Those principles involve data sharing, code sharing, and competitive challenges, however implemented in the particularly strong form of frictionless open services. Empirical Machine Learning (EML) is todays leading adherent field, and its consequent rapid changes are responsible for the AI progress we see. Still, other fields can and do benefit when they adhere to the same principles. Many rapid changes from this maturation are misidentified. The advent of FR in EML generates a steady flow of innovations; this flow stimulates outsider intuitions that there's an emergent superpower somewhere in AI. This opens the way for PR to push worrying narratives: not only `AI Extinction', but also the supposed monopoly of big tech on AI research. The helpful narrative observes that the superpower of EML is adherence to frictionless reproducibility practices; these practices are responsible for the striking progress in AI that we see everywhere.


title: Gravity theory in the limit to singularity

abstract: We unravel the structure of gravity theory in the limit to a curvature singularity, approached through a vanishing spatial metric determinant. The resulting canonical formulation is remarkably simple, having no spatial diffeomorphism constraint and exhibiting a purely algebraic Hamiltonian constraint free of the spatial three-curvature. Based on this, we propose a natural resolution to the horizon problem in cosmology. This limit implies a regular approach to singularity and predicts a stiff phase (w = 1) right after the big bang. This suggests an alternate scenario compared to the Belinski-Khalatnikov-Lifshitz (BKL) oscillatory approach. We also find that the Birkhoff theorem is violated in this limit. The essential inequivalence of this limit to the Carrollian limit of gravity, which is shown to share this (last) feature, is elucidated.


title: Do Compressed LLMs Forget Knowledge? An Experimental Study with Practical Implications

abstract: Compressing Large Language Models (LLMs) often leads to reduced performance, especially for knowledge-intensive tasks. In this work, we dive into how compression damages LLMs' inherent knowledge and the possible remedies. We start by proposing two conjectures on the nature of the damage: one is certain knowledge being forgotten (or erased) after LLM compression, hence necessitating the compressed model to (re)learn from data with additional parameters; the other presumes that knowledge is internally displaced and hence one requires merely "inference re-direction" with input-side augmentation such as prompting, to recover the knowledge-related performance. Extensive experiments are then designed to (in)validate the two conjectures. We observe the promise of prompting in comparison to model tuning; we further unlock prompting's potential by introducing a variant called Inference-time Dynamic Prompting (IDP), that can effectively increase prompt diversity without incurring any inference overhead. Our experiments consistently suggest that compared to the classical re-training alternatives such as LoRA, prompting with IDP leads to better or comparable post-compression performance recovery, while saving the extra parameter size by 21x and reducing inference latency by 60%. Our experiments hence strongly endorse the conjecture of "knowledge displaced" over "knowledge forgotten", and shed light on a new efficient mechanism to restore compressed LLM performance. We additionally visualize and analyze the different attention and activation patterns between prompted and re-trained models, demonstrating they achieve performance recovery in two different regimes.


title: RT-GAN: Recurrent Temporal GAN for Adding Lightweight Temporal Consistency to Frame-Based Domain Translation Approaches

abstract: While developing new unsupervised domain translation methods for endoscopy videos, it is typical to start with approaches that initially work for individual frames without temporal consistency. Once an individual-frame model has been finalized, additional contiguous frames are added with a modified deep learning architecture to train a new model for temporal consistency. This transition to temporally-consistent deep learning models, however, requires significantly more computational and memory resources for training. In this paper, we present a lightweight solution with a tunable temporal parameter, RT-GAN (Recurrent Temporal GAN), for adding temporal consistency to individual frame-based approaches that reduces training requirements by a factor of 5. We demonstrate the effectiveness of our approach on two challenging use cases in colonoscopy: haustral fold segmentation (indicative of missed surface) and realistic colonoscopy simulator video generation. The datasets, accompanying code, and pretrained models will be made available at \url{https://github.com/nadeemlab/CEP}.


title: The regularity of the coupled system between an electrical network with fractional dissipation and a plate equation with fractional inertial rotational

abstract: In this work we study a strongly coupled system between the equation of plates with fractional rotational inertial force $\kappa(-\Delta)^\beta u_{tt}$ where the parameter $0 <\beta\leq 1$ and the equation of an electrical network containing a fractional dissipation term $\delta(-\Delta)^\theta v_t$ where the parameter $0\leq \theta\leq 1$, the strong coupling terms are given by the Laplacian of the displacement speed $\gamma \Delta u_t$ and the Laplacian electric potential field $\gamma\Delta v_t$. When $\beta = 1$, we have the Kirchoff-Love plate and when $\beta = 0$, we have the Euler-Bernoulli plate recently studied in Su\'arez-Mendes (2022-Preprinter)\cite{Suarez}. The contributions of this research are: We prove the semigroup $S(t)$ associated with the system is not analytic in $(\theta,\beta)\in [0,1]\times(0,1]-\{( 1,1/2)\}$. We also determine two Gevrey classes: $s_1 >\frac{1}{2\max\{ \frac{1-\beta}{3-\beta}, \frac{\theta}{2+\theta-\beta}\}}$ for $2\leq \theta+2\beta$ and $s_2> \frac{2(2+\theta-\beta)}{\theta}$ when the parameters $\theta$ and $\beta$ lies in the interval $(0, 1)$ and we finish by proving that at the point $(\theta,\beta)=(1,1/2)$ the semigroup $S(t)$ is analytic and with a note about the asymptotic behavior of $S(t)$. We apply semigroup theory, the frequency domain method together with multipliers and the proper decomposition of the system components and Lions' interpolation inequality.


title: F0 analysis of Ghanaian pop singing reveals progressive alignment with equal temperament over the past three decades: a case study

abstract: Contemporary Ghanaian popular singing combines European and traditional Ghanaian influences. We hypothesize that access to technology embedded with equal temperament catalyzed a progressive alignment of Ghanaian singing with equal-tempered scales over time. To test this, we study the Ghanaian singer Daddy Lumba, whose work spans from the earliest Ghanaian electronic style in the late 1980s to the present. Studying a singular musician as a case study allows us to refine our analysis without over-interpreting the findings. We curated a collection of his songs, distributed between 1989 and 2016, to extract F0 values from isolated vocals. We used Gaussian mixture modeling (GMM) to approximate each song's scale and found that the pitch variance has been decreasing over time. We also determined whether the GMM components follow the arithmetic relationships observed in equal-tempered scales, and observed that Daddy Lumba's singing better aligns with equal temperament in recent years. Together, results reveal the impact of exposure to equal-tempered scales, resulting in lessened microtonal content in Daddy Lumba's singing. Our study highlights a potential vulnerability of Ghanaian musical scales and implies a need for research that maps and archives singing styles.


title: COMPOSER: Scalable and Robust Modular Policies for Snake Robots

abstract: Snake robots have showcased remarkable compliance and adaptability in their interaction with environments, mirroring the traits of their natural counterparts. While their hyper-redundant and high-dimensional characteristics add to this adaptability, they also pose great challenges to robot control. Instead of perceiving the hyper-redundancy and flexibility of snake robots as mere challenges, there lies an unexplored potential in leveraging these traits to enhance robustness and generalizability at the control policy level. We seek to develop a control policy that effectively breaks down the high dimensionality of snake robots while harnessing their redundancy. In this work, we consider the snake robot as a modular robot and formulate the control of the snake robot as a cooperative Multi-Agent Reinforcement Learning (MARL) problem. Each segment of the snake robot functions as an individual agent. Specifically, we incorporate a self-attention mechanism to enhance the cooperative behavior between agents. A high-level imagination policy is proposed to provide additional rewards to guide the low-level control policy. We validate the proposed method COMPOSER with five snake robot tasks, including goal reaching, wall climbing, shape formation, tube crossing, and block pushing. COMPOSER achieves the highest success rate across all tasks when compared to a centralized baseline and four modular policy baselines. Additionally, we show enhanced robustness against module corruption and significantly superior zero-shot generalizability in our proposed method. The videos of this work are available on our project page: https://sites.google.com/view/composer-snake/.


title: Effects of Charge and Gravitational Decoupling on Complexity and Isotropization of Anisotropic Models

abstract: This paper constructs two immediate extensions of the existing anisotropic solutions in the context of Einstein-Maxwell framework by employing minimal geometric deformation. To achieve this, we assume a static spherical interior initially filled with anisotropic fluid and call it a seed source. We extend this matter configuration by including a new source whose impact on the self-gravitating system is governed by a decoupling parameter. The charged field equations analogous to the total fluid source are formulated. We then implement a transformation on the radial metric potential that divides the field equations into two new under-determined systems, corresponding to the initial and new sources. The first of them is addressed by taking two well-known metric ansatz so that the number of unknowns can be tackled. Further, the vanishing of total anisotropy and complexity-free constraints are used to solve the second set. The estimated radius and mass of a compact star $4U~1820-30$ is utilized to interpret the resulting solutions graphically for different values of the charge and decoupling parameter $\omega$. We conclude that our both developed models are physically acceptable for all parametric values except $\omega=1$.


title: Deep Neural Networks Tend To Extrapolate Predictably

abstract: Conventional wisdom suggests that neural network predictions tend to be unpredictable and overconfident when faced with out-of-distribution (OOD) inputs. Our work reassesses this assumption for neural networks with high-dimensional inputs. Rather than extrapolating in arbitrary ways, we observe that neural network predictions often tend towards a constant value as input data becomes increasingly OOD. Moreover, we find that this value often closely approximates the optimal constant solution (OCS), i.e., the prediction that minimizes the average loss over the training data without observing the input. We present results showing this phenomenon across 8 datasets with different distributional shifts (including CIFAR10-C and ImageNet-R, S), different loss functions (cross entropy, MSE, and Gaussian NLL), and different architectures (CNNs and transformers). Furthermore, we present an explanation for this behavior, which we first validate empirically and then study theoretically in a simplified setting involving deep homogeneous networks with ReLU activations. Finally, we show how one can leverage our insights in practice to enable risk-sensitive decision-making in the presence of OOD inputs.


title: PC-NeRF: Parent-Child Neural Radiance Fields under Partial Sensor Data Loss in Autonomous Driving Environments

abstract: Reconstructing large-scale 3D scenes is essential for autonomous vehicles, especially when partial sensor data is lost. Although the recently developed neural radiance fields (NeRF) have shown compelling results in implicit representations, the large-scale 3D scene reconstruction using partially lost LiDAR point cloud data still needs to be explored. To bridge this gap, we propose a novel 3D scene reconstruction framework called parent-child neural radiance field (PC-NeRF). The framework comprises two modules, the parent NeRF and the child NeRF, to simultaneously optimize scene-level, segment-level, and point-level scene representations. Sensor data can be utilized more efficiently by leveraging the segment-level representation capabilities of child NeRFs, and an approximate volumetric representation of the scene can be quickly obtained even with limited observations. With extensive experiments, our proposed PC-NeRF is proven to achieve high-precision 3D reconstruction in large-scale scenes. Moreover, PC-NeRF can effectively tackle situations where partial sensor data is lost and has high deployment efficiency with limited training time. Our approach implementation and the pre-trained models will be available at https://github.com/biter0088/pc-nerf.


title: Advances toward high-accuracy gigahertz operation of tunable-barrier single-hole pumps in silicon

abstract: Precise and reproducible current generation is key to realize quantum current standards in metrology. A promising candidate is a tunable-barrier single-charge pump, which can accurately transfer single charges one by one with an error rate of less than ppm level. Although several high-accuracy measurements have revealed such a high performance of the pumps, it is necessary to further pursue the possibility of high-precision operation toward reproducible generation of the pumping current in many devices. Here, we investigate in detail a silicon single-hole pumps, which are potentially expected to have a superior performance to single-electron pumps because of a heavy effective mass of holes. Temperature dependence measurements of current generated by the single-hole pump revealed a high energy selectivity of the tunnel barrier, which is a critical parameter to achieve high-accuracy operation. In addition, we applied the dynamic gate compensation technique to the single-hole pump and confirm the further performance improvement. Furthermore, we demonstrate gigahertz operation of a single-hole pump with an estimated lower bound of an error rate of around 0.01 ppm. These results imply a superior capability of single-hole pumps in silicon toward high-accuracy, high-speed, and stable single-charge pumping appropriate for not only metrological applications but also quantum device applications.


title: Phase Transition of 3D Heisenberg Magnet in Presence of Random-Bond Disorder

abstract: Here we have simulated the random-bond type quenched disorder in 3D Heisenberg magnet.Here we have used classical Monte-Carlo simulation with Heisenberg spin and use 3D simple cubic lattice for this simulation.Here we use Metropolis single spin flipping algorithm.


title: QCFE: An efficient Feature engineering for query cost estimation

abstract: Query cost estimation is a classical task for database management. Recently, researchers apply the AI-driven model to implement query cost estimation for achieving high accuracy. However, two defects of feature design lead to poor cost estimation accuracy-time efficiency. On the one hand, existing works only encode the query plan and data statistics while ignoring some other important variables, like storage structure, hardware, database knobs, etc. These variables also have significant impact on the query cost. On the other hand, due to the straightforward encoding design, existing works suffer heavy representation learning burden on ineffective dimensions of input. To meet the above two problems, we first propose an efficient feature engineering for query cost estimation, called QCFE. Specifically, we design a novel feature called feature snapshot to efficiently integrate the influences of the ignored variables. Further, we propose a difference-propagation feature reduction method for query cost estimation to filter the useless features. The experimental results demonstrate our QCFE could largely improve the time-accuracy efficiency on extensive benchmarks.


title: The generalized 4-connectivity of burnt pancake graphs

abstract: The generalized $k$-connectivity of a graph $G$, denoted by $\kappa_k(G)$, is the minimum number of internally edge disjoint $S$-trees for any $S\subseteq V(G)$ and $|S|=k$. The generalized $k$-connectivity is a natural extension of the classical connectivity and plays a key role in applications related to the modern interconnection networks. An $n$-dimensional burnt pancake graph $BP_n$ is a Cayley graph which posses many desirable properties. In this paper, we try to evaluate the reliability of $BP_n$ by investigating its generalized 4-connectivity. By introducing the notation of inclusive tree and by studying structural properties of $BP_n$, we show that $\kappa_4(BP_n)=n-1$ for $n\ge 2$, that is, for any four vertices in $BP_n$, there exist ($n-1$) internally edge disjoint trees connecting them in $BP_n$.


title: Visual Temporal Fusion Based Free Space Segmentation for Autonomous Surface Vessels

abstract: The use of Autonomous Surface Vessels (ASVs) is growing rapidly. For safe and efficient surface auto-driving, a reliable perception system is crucial. Such systems allow the vessels to sense their surroundings and make decisions based on the information gathered. During the perception process, free space segmentation is essential to distinguish the safe mission zone and segment the operational waterways. However, ASVs face particular challenges in free space segmentation due to nearshore reflection interference, complex water textures, and random motion vibrations caused by the water surface conditions. To deal with these challenges, we propose a visual temporal fusion based free space segmentation model to utilize the previous vision information. In addition, we also introduce a new evaluation procedure and a contour position based loss calculation function, which are more suitable for surface free space segmentation tasks. The proposed model and process are tested on a continuous video segmentation dataset and achieve both high-accuracy and robust results. The dataset is also made available along with this paper.


title: A Bayesian Bootstrap for Mixture Models

abstract: This paper proposes a new nonparametric Bayesian bootstrap for a mixture model, by developing the traditional Bayesian bootstrap. We first reinterpret the Bayesian bootstrap, which uses the P\'olya-urn scheme, as a gradient ascent algorithm which associated one-step solver. The key then is to use the same basic mechanism as the Bayesian bootstrap with the switch from a point mass kernel to a continuous kernel. Just as the Bayesian bootstrap works solely from the empirical distribution function, so the new Bayesian bootstrap for mixture models works off the nonparametric maximum likelihood estimator for the mixing distribution. From a theoretical perspective, we prove the convergence and exchangeability of the sample sequences from the algorithm and also illustrate our results with different models and settings and some real data.


title: Scalable Statistical Inference in Non-parametric Least Squares

abstract: Stochastic approximation (SA) is a powerful and scalable computational method for iteratively estimating the solution of optimization problems in the presence of randomness, particularly well-suited for large-scale and streaming data settings. In this work, we propose a theoretical framework for stochastic approximation (SA) applied to non-parametric least squares in reproducing kernel Hilbert spaces (RKHS), enabling online statistical inference in non-parametric regression models. We achieve this by constructing asymptotically valid pointwise (and simultaneous) confidence intervals (bands) for local (and global) inference of the nonlinear regression function, via employing an online multiplier bootstrap approach to functional stochastic gradient descent (SGD) algorithm in the RKHS. Our main theoretical contributions consist of a unified framework for characterizing the non-asymptotic behavior of the functional SGD estimator and demonstrating the consistency of the multiplier bootstrap method. The proof techniques involve the development of a higher-order expansion of the functional SGD estimator under the supremum norm metric and the Gaussian approximation of suprema of weighted and non-identically distributed empirical processes. Our theory specifically reveals an interesting relationship between the tuning of step sizes in SGD for estimation and the accuracy of uncertainty quantification.