title: KEEC: Embed to Control on An Equivariant Geometry

abstract: This paper investigates how representation learning can enable optimal control in unknown and complex dynamics, such as chaotic and non-linear systems, without relying on prior domain knowledge of the dynamics. The core idea is to establish an equivariant geometry that is diffeomorphic to the manifold defined by a dynamical system and to perform optimal control within this corresponding geometry, which is a non-trivial task. To address this challenge, Koopman Embed to Equivariant Control (KEEC) is proposed for model learning and control. Inspired by Lie theory, KEEC begins by learning a non-linear dynamical system defined on a manifold and embedding trajectories into a Lie group. Subsequently, KEEC formulates an equivariant value function equation in reinforcement learning on the equivariant geometry, ensuring an invariant effect as the value function on the original manifold. By deriving analytical-form optimal actions on the equivariant value function, KEEC theoretically achieves quadratic convergence for the optimal equivariant value function by leveraging the differential information on the equivariant geometry. The effectiveness of KEEC is demonstrated in challenging dynamical systems, including chaotic ones like Lorenz-63. Notably, our results show that isometric functions, which maintain the compactness and completeness of geometry while preserving metric and differential information, consistently outperform loss functions lacking these characteristics.


title: Diverse Entanglement Mechanisms in Multimode Nonlinear Continuous Variables

abstract: Non-Gaussian entangled states play a crucial role in harnessing quantum advantage in continuous-variable quantum information. However, how to fully characterize N-partite (N > 3) non-Gaussian entanglement without quantum state tomography remains elusive, leading to a very limited understanding of the underlying entanglement mechanism. Here, we propose several necessary and sufficient conditions for the positive-partial-transposition separability of multimode nonlinear quantum states resulting from high-order Hamiltonians and successive beam splitting operations. When applied to the initial state, the beam-splitter operations induce the emergence of different types of entanglement mechanisms, including pairwise high-order entanglement, collective high-order entanglement and the crossover between the two. We show numerically that for the four-mode scenario, the threshold for the existence of entanglement for any bipartition does not exceed the entanglement of the original state at fixed high-order moments. These results provide a new perspective for understanding multipartite nonlinear entanglement and will promote their application in quantum information processing.


title: Learning Channel Capacity with Neural Mutual Information Estimator Based on Message Importance Measure

abstract: Channel capacity estimation plays a crucial role in beyond 5G intelligent communications. Despite its significance, this task is challenging for a majority of channels, especially for the complex channels not modeled as the well-known typical ones. Recently, neural networks have been used in mutual information estimation and optimization. They are particularly considered as efficient tools for learning channel capacity. In this paper, we propose a cooperative framework to simultaneously estimate channel capacity and design the optimal codebook. First, we will leverage MIM-based GAN, a novel form of generative adversarial network (GAN) using message importance measure (MIM) as the information distance, into mutual information estimation, and develop a novel method, named MIM-based mutual information estimator (MMIE). Then, we design a generalized cooperative framework for channel capacity learning, in which a generator is regarded as an encoder producing the channel input, while a discriminator is the mutual information estimator that assesses the performance of the generator. Through the adversarial training, the generator automatically learns the optimal codebook and the discriminator estimates the channel capacity. Numerical experiments will demonstrate that compared with several conventional estimators, the MMIE achieves state-of-the-art performance in terms of accuracy and stability.


title: Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear Regression

abstract: We study the fundamental problems of Gaussian mean estimation and linear regression with Gaussian covariates in the presence of Huber contamination. Our main contribution is the design of the first sample near-optimal and almost linear-time algorithms with optimal error guarantees for both of these problems. Specifically, for Gaussian robust mean estimation on $\mathbb{R}^d$ with contamination parameter $\epsilon \in (0, \epsilon_0)$ for a small absolute constant $\epsilon_0$, we give an algorithm with sample complexity $n = \tilde{O}(d/\epsilon^2)$ and almost linear runtime that approximates the target mean within $\ell_2$-error $O(\epsilon)$. This improves on prior work that achieved this error guarantee with polynomially suboptimal sample and time complexity. For robust linear regression, we give the first algorithm with sample complexity $n = \tilde{O}(d/\epsilon^2)$ and almost linear runtime that approximates the target regressor within $\ell_2$-error $O(\epsilon)$. This is the first polynomial sample and time algorithm achieving the optimal error guarantee, answering an open question in the literature. At the technical level, we develop a methodology that yields almost-linear time algorithms for multi-directional filtering that may be of broader interest.


title: Tomographic projection optimization for volumetric additive manufacturing with general band constraint Lp-norm minimization

abstract: Tomographic volumetric additive manufacturing is a rapidly growing fabrication technology that enables rapid production of 3D objects through a single build step. In this process, the design of projections directly impacts geometric resolution, material properties, and manufacturing yield of the final printed part. Herein, we identify the hidden equivalent operations of three major existing projection optimization schemes and reformulate them into a general loss function where the optimization behavior can be systematically studied, and unique capabilities of the individual schemes can coalesce. The loss function formulation proposed in this study unified the optimization for binary and greyscale targets and generalized problem relaxation strategies with local tolerancing and weighting. Additionally, this formulation offers control on error sparsity and consistent dose response mapping throughout initialization, optimization, and evaluation. A parameter-sweep analysis in this study guides users in tuning optimization parameters for application-specific goals.


title: Incentive Non-Compatibility of Optimistic Rollups

abstract: Optimistic rollups are a popular and promising method of increasing the throughput capacity of their underlying chain. These methods rely on economic incentives to guarantee their security. We present a model of optimistic rollups that suggests that the incentives are not necessarily aligned with the expected behavior of the players, thus potentially undermining the security of existing optimistic rollups. We discuss some potential solutions illuminated by our model.


title: Using human and robot synthetic data for training smart hand tools

abstract: The future of work does not require a choice between human and robot. Aside from explicit human-robot collaboration, robotics can play an increasingly important role in helping train workers as well as the tools they may use, especially in complex tasks that may be difficult to automate or effectively roboticize. This paper introduces a form of smart tool for use by human workers and shows how training the tool for task recognition, one of the key requirements, can be accomplished. Machine learning (ML) with purely human-based data can be extremely laborious and time-consuming. First, we show how data synthetically-generated by a robot can be leveraged in the ML training process. Later, we demonstrate how fine-tuning ML models for individual physical tasks and workers can significantly scale up the benefits of using ML to provide this feedback. Experimental results show the effectiveness and scalability of our approach, as we test data size versus accuracy. Smart hand tools of the type introduced here can provide insights and real-time analytics on efficient and safe tool usage and operation, thereby enhancing human participation and skill in a wide range of work environments. Using robotic platforms to help train smart tools will be essential, particularly given the diverse types of applications for which smart hand tools are envisioned for human use.


title: On the potential automorphy and the local-global compatibility for the monodromy operators at $p \neq l$ over CM fields

abstract: Let $F$ be a CM field. In this paper, we prove the local-global compatibility for cohomological cuspidal automorphic representations of $\mathrm{GL}_n(\mathbb{A}_F)$ at $p \neq l$ by using certain potential automorphy theorems in some cases including higher dimensional cases. Moreover, we also prove the Ramanujan conjecture for cohomological cuspidal automorphic representations of $\mathrm{GL}_2(\mathbb{A}_F )$.


title: The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning

abstract: The alignment tuning process of large language models (LLMs) typically involves instruction learning through supervised fine-tuning (SFT) and preference tuning via reinforcement learning from human feedback (RLHF). A recent study, LIMA (Zhou et al. 2023), shows that using merely 1K examples for SFT can achieve significant alignment performance as well, suggesting that the effect of alignment tuning might be "superficial." This raises questions about how exactly the alignment tuning transforms a base LLM. We analyze the effect of alignment tuning by examining the token distribution shift between base LLMs and their aligned counterpart. Our findings reveal that base LLMs and their alignment-tuned versions perform nearly identically in decoding on the majority of token positions. Most distribution shifts occur with stylistic tokens. These direct evidence strongly supports the Superficial Alignment Hypothesis suggested by LIMA. Based on these findings, we rethink the alignment of LLMs by posing the research question: how effectively can we align base LLMs without SFT or RLHF? To address this, we introduce a simple, tuning-free alignment method, URIAL. URIAL achieves effective alignment purely through in-context learning (ICL) with base LLMs, requiring as few as three constant stylistic examples and a system prompt. We conduct a fine-grained and interpretable evaluation on a diverse set of examples, named JUST-EVAL-INSTRUCT. Results demonstrate that base LLMs with URIAL can match or even surpass the performance of LLMs aligned with SFT or SFT+RLHF. We show that the gap between tuning-free and tuning-based alignment methods can be significantly reduced through strategic prompting and ICL. Our findings on the superficial nature of alignment tuning and results with URIAL suggest that deeper analysis and theoretical understanding of alignment is crucial to future LLM research.


title: Emergent electric field induced by current-driven domain wall motion in a room-temperature antiferromagnet FeSn2

abstract: Antiferromagnets have attracted extensive interest as platforms for nanoscale spintronic devices owing to ultrafast spin dynamics and lack of a stray field. One of the crucial missing pieces in antiferromagnets is a quantum-mechanical electric field known as an emergent electric field, which has been observed for the motion of ferromagnetic spin texture. Since this phenomenon allows for the development of novel spintronic devices such as quantum inductors, its identification in antiferromagnets is vital for developing nanoscale spintronic devices. Here, we demonstrate that the motion of antiferromagnetic spin textures generates an emergent electric field. In a room-temperature antiferromagnet FeSn2, we observed large current-nonlinear responses in the imaginary part of the complex impedance at and well above room temperature. This signal is attributed to an emergent electric field resulting from the nonadiabatic electron spin dynamics during the current-induced motion of antiferromagnetic domain walls. Notably, the observed electric response is strongly enhanced as the sample size decreases and robust against magnetic fields. Our finding may pave the way for novel nanoscale quantum spintronic devices.


title: Building Ears for Robots: Machine Hearing in the Age of Autonomy

abstract: This study explores the significance of robot hearing systems, emphasizing their importance for robots operating in diverse and uncertain environments. It introduces the hardware design principles using robotaxis as an example, where exterior microphone arrays are employed to detect sound events such as sirens. The challenges, goals, and test methods are discussed, focusing on achieving a suitable signal-to-noise ratio (SNR). Additionally, it presents a preliminary software framework rooted in probabilistic robotics theory, advocating for the integration of robot hearing into the broader context of perception and decision-making. It discusses various models, including Bayes filters, partially observable Markov decision processes (POMDP), and multiagent systems, highlighting the multifaceted roles that robot hearing can play. In conclusion, as service robots continue to evolve, robot hearing research will expand, offering new perspectives and challenges for future development beyond simple sound event classification.


title: Explainable AI is Responsible AI: How Explainability Creates Trustworthy and Socially Responsible Artificial Intelligence

abstract: Artificial intelligence (AI) has been clearly established as a technology with the potential to revolutionize fields from healthcare to finance - if developed and deployed responsibly. This is the topic of responsible AI, which emphasizes the need to develop trustworthy AI systems that minimize bias, protect privacy, support security, and enhance transparency and accountability. Explainable AI (XAI) has been broadly considered as a building block for responsible AI (RAI), with most of the literature considering it as a solution for improved transparency. This work proposes that XAI and responsible AI are significantly more deeply entwined. In this work, we explore state-of-the-art literature on RAI and XAI technologies. Based on our findings, we demonstrate that XAI can be utilized to ensure fairness, robustness, privacy, security, and transparency in a wide range of contexts. Our findings lead us to conclude that XAI is an essential foundation for every pillar of RAI.


title: Searching Dense Representations with Inverted Indexes

abstract: Nearly all implementations of top-$k$ retrieval with dense vector representations today take advantage of hierarchical navigable small-world network (HNSW) indexes. However, the generation of vector representations and efficiently searching large collections of vectors are distinct challenges that can be decoupled. In this work, we explore the contrarian approach of performing top-$k$ retrieval on dense vector representations using inverted indexes. We present experiments on the MS MARCO passage ranking dataset, evaluating three dimensions of interest: output quality, speed, and index size. Results show that searching dense representations using inverted indexes is possible. Our approach exhibits reasonable effectiveness with compact indexes, but is impractically slow. Thus, while workable, our solution does not provide a compelling tradeoff and is perhaps best characterized today as a "technical curiosity".


title: External Potentials and Ehrenfest Relations in Lagrangian Field Theories

abstract: This paper develops a general method to construct Ehrenfest-like relations for Lagrangian field theories when an external, coordinate-dependent scalar potential is applied. To do so, we derive continuity equations in which the spatial and temporal derivatives of the potential can be interpreted as a source of field momentum and field energy, respectively. For a non-relativistic Schr\"odinger field theory, these continuity equations yield Ehrenfest's theorem for energy, linear momentum, and angular momentum. We then derive a relativistic counterpart for these relations using complex Klein-Gordon fields coupled with an electric potential.


title: Hyperspectral Image Compression Using Sampling and Implicit Neural Representations

abstract: Hyperspectral images, which record the electromagnetic spectrum for a pixel in the image of a scene, often store hundreds of channels per pixel and contain an order of magnitude more information than a similarly-sized RBG color image. Consequently, concomitant with the decreasing cost of capturing these images, there is a need to develop efficient techniques for storing, transmitting, and analyzing hyperspectral images. This paper develops a method for hyperspectral image compression using implicit neural representations where a multilayer perceptron network F with sinusoidal activation functions "learns" to map pixel locations to pixel intensities for a given hyperspectral image I. F thus acts as a compressed encoding of this image, and the original image is reconstructed by evaluating F at each pixel location. We use a sampling method with two factors: window size and sampling rate to reduce the compression time. We have evaluated our method on four benchmarks -- Indian Pines, Jasper Ridge, Pavia University, and Cuprite using PSNR and SSIM -- and we show that the proposed method achieves better compression than JPEG, JPEG2000, and PCA-DCT at low bitrates. Besides, we compare our results with the learning-based methods like PCA+JPEG2000, FPCA+JPEG2000, 3D DCT, 3D DWT+SVR, and WSRC and show the corresponding results in the "Compression Results" section. We also show that our methods with sampling achieve better speed and performance than our method without sampling.


title: Axisymmetric Virtual Elements For Problems of Elasticity and Plasticity

abstract: The virtual element method (VEM) allows discretization of elasticity and plasticity problems with polygons in 2D and polyhedrals in 3D. The polygons (and polyhedrals) can have an arbitrary number of sides and can be concave or convex. These features, among others, are attractive for meshing complex geometries. However, to the author's knowledge axisymmetric virtual elements have not appeared before in the literature. Hence, in this work a novel first order consistent axisymmetric virtual element method is applied to problems of elasticity and plasticity. The VEM specific implementation details and adjustments needed to solve axisymmetric simulations are presented. Representative benchmark problems including pressure vessels and circular plates are illustrated. Examples also show that problems of near incompressibility are solved successfully. Consequently, this research demonstrates that the axisymmetric VEM formulation successfully solves certain classes of solid mechanics problems. The work concludes with a discussion of results for the current formulation and future research directions.


title: RaftGP: Random Fast Graph Partitioning

abstract: Graph partitioning (GP), a.k.a. community detection, is a classic problem that divides the node set of a graph into densely-connected blocks. Following prior work on the IEEE HPEC Graph Challenge benchmark and recent advances in graph machine learning, we propose a novel RAndom FasT Graph Partitioning (RaftGP) method based on an efficient graph embedding scheme. It uses the Gaussian random projection to extract community-preserving features from classic GP objectives. These features are fed into a graph neural network (GNN) to derive low-dimensional node embeddings. Surprisingly, our experiments demonstrate that a randomly initialized GNN even without training is enough for RaftGP to derive informative community-preserving embeddings and support high-quality GP. To enable the derived embeddings to tackle GP, we introduce a hierarchical model selection algorithm that simultaneously determines the number of blocks and the corresponding GP result. We evaluate RaftGP on the Graph Challenge benchmark and compare the performance with five baselines, where our method can achieve a better trade-off between quality and efficiency. In particular, compared to the baseline algorithm of the IEEE HPEC Graph Challenge, our method is 6.68x -- 23.9x faster on graphs with 1E3 -- 5E4 nodes and at least 64.5x faster on larger (1E5 node) graphs on which the baseline takes more than 1E4 seconds. Our method achieves better accuracy on all test cases. We also develop a new graph generator to address some limitations of the original generator in the benchmark.


title: Multi-View Person Matching and 3D Pose Estimation with Arbitrary Uncalibrated Camera Networks

abstract: Cross-view person matching and 3D human pose estimation in multi-camera networks are particularly difficult when the cameras are extrinsically uncalibrated. Existing efforts generally require large amounts of 3D data for training neural networks or known camera poses for geometric constraints to solve the problem. However, camera poses and 3D data annotation are usually expensive and not always available. We present a method, PME, that solves the two tasks without requiring either information. Our idea is to address cross-view person matching as a clustering problem using each person as a cluster center, then obtain correspondences from person matches, and estimate 3D human poses through multi-view triangulation and bundle adjustment. We solve the clustering problem by introducing a "size constraint" using the number of cameras and a "source constraint" using the fact that two people from the same camera view should not match, to narrow the solution space to a small feasible region. The 2D human poses used in clustering are obtained through a pre-trained 2D pose detector, so our method does not require expensive 3D training data for each new scene. We extensively evaluate our method on three open datasets and two indoor and outdoor datasets collected using arbitrarily set cameras. Our method outperforms other methods by a large margin on cross-view person matching, reaches SOTA performance on 3D human pose estimation without using either camera poses or 3D training data, and shows good generalization ability across five datasets of various environment settings.


title: Kernel Alignment for Quantum Support Vector Machines Using Genetic Algorithms

abstract: The data encoding circuits used in quantum support vector machine (QSVM) kernels play a crucial role in their classification accuracy. However, manually designing these circuits poses significant challenges in terms of time and performance. To address this, we leverage the GASP (Genetic Algorithm for State Preparation) framework for gate sequence selection in QSVM kernel circuits. We explore supervised and unsupervised kernel loss functions' impact on encoding circuit optimisation and evaluate them on diverse datasets for binary and multiple-class scenarios. Benchmarking against classical and quantum kernels reveals GA-generated circuits matching or surpassing standard techniques. We analyse the relationship between test accuracy and quantum kernel entropy, with results indicating a positive correlation. Our automated framework reduces trial and error, and enables improved QSVM based machine learning performance for finance, healthcare, and materials science applications.


title: On Monomial Deformations of Generalized Delsarte Polynomials

abstract: By a generalized Delsarte polynomial we mean a Laurent polynomial whose exponent vectors are linearly independent. We consider certain monomial deformations of generalized Delsarte polynomials and study their associated differential modules. We determine the solutions at the origin, which are all classical ${}_kF_{k-1}$-hypergeometric functions with the variable raised to a power. Using standard changes of variable, we also obtain the solutions at infinity.


title: APoLLo: Unified Adapter and Prompt Learning for Vision Language Models

abstract: The choice of input text prompt plays a critical role in the performance of Vision-Language Pretrained (VLP) models such as CLIP. We present APoLLo, a unified multi-modal approach that combines Adapter and Prompt learning for Vision-Language models. Our method is designed to substantially improve the generalization capabilities of VLP models when they are fine-tuned in a few-shot setting. We introduce trainable cross-attention-based adapter layers in conjunction with vision and language encoders to strengthen the alignment between the two modalities. We enforce consistency between the respective encoder branches (receiving augmented inputs) to prevent overfitting in downstream tasks. Our method is evaluated on three representative tasks: generalization to novel classes, cross-dataset evaluation, and unseen domain shifts. In practice, APoLLo achieves a relative gain up to 6.03% over MaPLe (SOTA) on novel classes for 10 diverse image recognition datasets.


title: Finding mixed memberships in categorical data

abstract: Latent class analysis, a fundamental problem in categorical data analysis, often encounters overlapping latent classes that introduce further challenges. This paper presents a solution to this problem by focusing on finding latent mixed memberships of subjects in categorical data with polytomous responses. We employ the Grade of Membership (GoM) model, which assigns each subject a membership score in each latent class. To address this, we propose two efficient spectral algorithms for estimating these mixed memberships and other GoM parameters. Our algorithms are based on the singular value decomposition of a regularized Laplacian matrix. We establish their convergence rates under a mild condition on data sparsity. Additionally, we introduce a metric to evaluate the quality of estimated mixed memberships for real-world categorical data and determine the optimal number of latent classes based on this metric. Finally, we demonstrate the practicality of our methods through experiments on both computer-generated and real-world categorical datasets.


title: Coronary Atherosclerotic Plaque Characterization with Photon-counting CT: a Simulation-based Feasibility Study

abstract: Recent development of photon-counting CT (PCCT) brings great opportunities for plaque characterization with much-improved spatial resolution and spectral imaging capability. While existing coronary plaque PCCT imaging results are based on detectors made of CZT or CdTe materials, deep-silicon photon-counting detectors have unique performance characteristics and promise distinct imaging capabilities. In this work, we report a systematic simulation study of a deep-silicon PCCT scanner with a new clinically-relevant digital plaque phantom with realistic geometrical parameters and chemical compositions. This work investigates the effects of spatial resolution, noise, motion artifacts, radiation dose, and spectral characterization. Our simulation results suggest that the deep-silicon PCCT design provides adequate spatial resolution for visualizing a necrotic core and quantitation of key plaque features. Advanced denoising techniques and aggressive bowtie filter designs can keep image noise to acceptable levels at this resolution while keeping radiation dose comparable to that of a conventional CT scan. The ultrahigh resolution of PCCT also means an elevated sensitivity to motion artifacts. It is found that a tolerance of less than 0.4 mm residual movement range requires the application of accurate motion correction methods for best plaque imaging quality with PCCT.


title: Toward Automated Quantum Variational Machine Learning

abstract: In this work, we address the problem of automating quantum variational machine learning. We develop a multi-locality parallelizable search algorithm, called MUSE, to find the initial points and the sets of parameters that achieve the best performance for quantum variational circuit learning. Simulations with five real-world classification datasets indicate that on average, MUSE improves the detection accuracy of quantum variational classifiers 2.3 times with respect to the observed lowest scores. Moreover, when applied to two real-world regression datasets, MUSE improves the quality of the predictions from negative coefficients of determination to positive ones. Furthermore, the classification and regression scores of the quantum variational models trained with MUSE are on par with the classical counterparts.


title: Multimodal Speech Emotion Recognition Using Modality-specific Self-Supervised Frameworks

abstract: Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and dependable emotion recognition systems supporting optimal human-machine communication are required. Multi-modality (including speech, audio, text, images, and videos) is typically exploited in emotion recognition tasks. Much relevant research is based on merging multiple data modalities and training deep learning models utilizing low-level data representations. However, most existing emotion databases are not large (or complex) enough to allow machine learning approaches to learn detailed representations. This paper explores modalityspecific pre-trained transformer frameworks for self-supervised learning of speech and text representations for data-efficient emotion recognition while achieving state-of-the-art performance in recognizing emotions. This model applies feature-level fusion using nonverbal cue data points from motion capture to provide multimodal speech emotion recognition. The model was trained using the publicly available IEMOCAP dataset, achieving an overall accuracy of 77.58% for four emotions, outperforming state-of-the-art approaches


title: An algebraic combinatorial approach to Sylvester's denumerant

abstract: For a positive integer sequence $\boldsymbol{a}=(a_1, \dots, a_{N+1})$, Sylvester's denumerant $E(\boldsymbol{a}; t)$ counts the number of nonnegative integer solutions to $\sum_{i=1}^{N+1} a_i x_i = t$ for a nonnegative integer $t$. It has been extensively studied and a well-known result asserts that $E(\boldsymbol{a}; t)$ is a quasi-polynomial in $t$ of degree $N$. A milestone is Baldoni et al.'s polynomial algorithm in 2015 for computing the top $k$ coefficients when $k$ is fixed. Their development uses heavily lattice point counting theory in computational geometry. In this paper, we explain their work in the context of algebraic combinatorics and simplify their computation. Our work is based on constant term method, Barvinok's unimodular cone decomposition, and recent results on fast computation of generalized Todd polynomials. We develop the algorithm \texttt{CT-Knapsack}, together with an implementation in \texttt{Maple}. Our algorithm avoids plenty of repeated computations and is hence faster.


title: Parallelizing quantum simulation with decision diagrams

abstract: Recent technological advancements show promise in leveraging quantum mechanical phenomena for computation. This brings substantial speed-ups to problems that are once considered to be intractable in the classical world. However, the physical realization of quantum computers is still far away from us, and a majority of research work is done using quantum simulators running on classical computers. Classical computers face a critical obstacle in simulating quantum algorithms. Quantum states reside in a Hilbert space whose size grows exponentially to the number of subsystems, i.e., qubits. As a result, the straightforward statevector approach does not scale due to the exponential growth of the memory requirement. Decision diagrams have gained attention in recent years for representing quantum states and operations in quantum simulations. The main advantage of this approach is its ability to exploit redundancy. However, mainstream quantum simulators still rely on statevectors or tensor networks. We consider the absence of decision diagrams due to the lack of parallelization strategies. This work explores several strategies for parallelizing decision diagram operations, specifically for quantum simulations. We propose optimal parallelization strategies. Based on the experiment results, our parallelization strategy achieves a 2-3 times faster simulation of Grover's algorithm and random circuits than the state-of-the-art single-thread DD-based simulator DDSIM.


title: How to Configure Good In-Context Sequence for Visual Question Answering

abstract: Inspired by the success of Large Language Models in dealing with new tasks via In-Context Learning (ICL) in NLP, researchers have also developed Large Vision-Language Models (LVLMs) with ICL capabilities. However, when implementing ICL using these LVLMs, researchers usually resort to the simplest way like random sampling to configure the in-context sequence, thus leading to sub-optimal results. To enhance the ICL performance, in this study, we use Visual Question Answering (VQA) as case study to explore diverse in-context configurations to find the powerful ones. Additionally, through observing the changes of the LVLM outputs by altering the in-context sequence, we gain insights into the inner properties of LVLMs, improving our understanding of them. Specifically, to explore in-context configurations, we design diverse retrieval methods and employ different strategies to manipulate the retrieved demonstrations. Through exhaustive experiments on three VQA datasets: VQAv2, VizWiz, and OK-VQA, we uncover three important inner properties of the applied LVLM and demonstrate which strategies can consistently improve the ICL VQA performance. Our code is provided in: https://github.com/GaryJiajia/OFv2_ICL_VQA.


title: Measuring magnetic field coil constants based on atomic magnetometry and fluxgate magnetometry

abstract: In a magnetic field detection system,to achieve high-sensitivity magnetic field measurement, it is necessary to use uniform magnetic field coils to provide a stable working environment, so the measurement of the magnetic field coilsconstant is of great significance. To accurately measure the magnetic field and compare the coil constant, we employed two different methods under good magnetic shielding conditions: the optically-pumped rubidium free-induction decay magnetometry and the fluxgate magnetometry. In terms of measuring coil constant, the optically-pumped rubidium FID magnetometer performs better than fluxgate magnetometer due to its high-sensitivity and good signal-to-noise ratio. We compare the magnetic field measured by the FID magnetometer with that of the fluxgate magnetometer and obtain a calibration factor of 0.9967. The calibration of fluxgate magnetometer with optically-pumped atomic magnetometer is realized. The method is simple and easy to operate for calibrating fluxgate magnetometer.


title: Survey on deep learning in multimodal medical imaging for cancer detection

abstract: The task of multimodal cancer detection is to determine the locations and categories of lesions by using different imaging techniques, which is one of the key research methods for cancer diagnosis. Recently, deep learning-based object detection has made significant developments due to its strength in semantic feature extraction and nonlinear function fitting. However, multimodal cancer detection remains challenging due to morphological differences in lesions, interpatient variability, difficulty in annotation, and imaging artifacts. In this survey, we mainly investigate over 150 papers in recent years with respect to multimodal cancer detection using deep learning, with a focus on datasets and solutions to various challenges such as data annotation, variance between classes, small-scale lesions, and occlusion. We also provide an overview of the advantages and drawbacks of each approach. Finally, we discuss the current scope of work and provide directions for the future development of multimodal cancer detection.


title: Fast Sampling for Linear Inverse Problems of Vectors and Tensors using Multilinear Extensions

abstract: Sampling vector and tensor signals is the process of choosing sites in vectors and tensors to place sensors in order to effectively recover the whole signals from a limited number of observations by solving linear inverse problems (LIPs). Here, we present closed-form multilinear extensions for the frame potential of pruned matrices, and based on these, we develop an algorithm named fast Frank-Wolfe algorithm for sampling vectors and tensors with low complexity. Then we provide the approximation factor of our proposed algorithm for a special class of sampling matrices. Then, we conduct experiments to verify the higher performance and lower complexity of our proposed algorithm. Finally, we demonstrate that FFW sampling and least squares reconstruction yield superior results for image data compared to convCNP completion with random sampling.


title: A Challenging Multimodal Video Summary: Simultaneously Extracting and Generating Keyframe-Caption Pairs from Video

abstract: This paper proposes a practical multimodal video summarization task setting and a dataset to train and evaluate the task. The target task involves summarizing a given video into a predefined number of keyframe-caption pairs and displaying them in a listable format to grasp the video content quickly. This task aims to extract crucial scenes from the video in the form of images (keyframes) and generate corresponding captions explaining each keyframe's situation. This task is useful as a practical application and presents a highly challenging problem worthy of study. Specifically, achieving simultaneous optimization of the keyframe selection performance and caption quality necessitates careful consideration of the mutual dependence on both preceding and subsequent keyframes and captions. To facilitate subsequent research in this field, we also construct a dataset by expanding upon existing datasets and propose an evaluation framework. Furthermore, we develop two baseline systems and report their respective performance.


title: Learning Efficient Unsupervised Satellite Image-based Building Damage Detection

abstract: Existing Building Damage Detection (BDD) methods always require labour-intensive pixel-level annotations of buildings and their conditions, hence largely limiting their applications. In this paper, we investigate a challenging yet practical scenario of BDD, Unsupervised Building Damage Detection (U-BDD), where only unlabelled pre- and post-disaster satellite image pairs are provided. As a pilot study, we have first proposed an advanced U-BDD baseline that leverages pre-trained vision-language foundation models (i.e., Grounding DINO, SAM and CLIP) to address the U-BDD task. However, the apparent domain gap between satellite and generic images causes low confidence in the foundation models used to identify buildings and their damages. In response, we further present a novel self-supervised framework, U-BDD++, which improves upon the U-BDD baseline by addressing domain-specific issues associated with satellite imagery. Furthermore, the new Building Proposal Generation (BPG) module and the CLIP-enabled noisy Building Proposal Selection (CLIP-BPS) module in U-BDD++ ensure high-quality self-training. Extensive experiments on the widely used building damage assessment benchmark demonstrate the effectiveness of the proposed method for unsupervised building damage detection. The presented annotation-free and foundation model-based paradigm ensures an efficient learning phase. This study opens a new direction for real-world BDD and sets a strong baseline for future research.


title: RJHMC-Tree for Exploration of the Bayesian Decision Tree Posterior

abstract: Decision trees have found widespread application within the machine learning community due to their flexibility and interpretability. This paper is directed towards learning decision trees from data using a Bayesian approach, which is challenging due to the potentially enormous parameter space required to span all tree models. Several approaches have been proposed to combat this challenge, with one of the more successful being Markov chain Monte Carlo (MCMC) methods. The efficacy and efficiency of MCMC methods fundamentally rely on the quality of the so-called proposals, which is the focus of this paper. In particular, this paper investigates using a Hamiltonian Monte Carlo (HMC) approach to explore the posterior of Bayesian decision trees more efficiently by exploiting the geometry of the likelihood within a global update scheme. Two implementations of the novel algorithm are developed and compared to existing methods by testing against standard datasets in the machine learning and Bayesian decision tree literature. HMC-based methods are shown to perform favourably with respect to predictive test accuracy, acceptance rate, and tree complexity.


title: The Environments of Fast Radio Bursts Viewed Using Adaptive Optics

abstract: We present GeMS/GSAOI observations of five fast radio burst (FRB) host galaxies with sub-arcsecond localizations. We examine and quantify their spatial distributions and locations with respect to their host galaxy light distributions, finding a median host-normalized offset of 2.09 r_e and in fainter regions of the host. When combined with the FRB sample from Mannings et al. (2021), we find that FRBs are statistically distinct from Ca-rich transients in terms of light and from SGRBs and LGRBs in terms of host-normalized offset. We further find that most FRBs are in regions of elevated local stellar mass surface densities in comparison to the mean global values of their hosts. This, in combination with the combined FRB sample trace the distribution of stellar mass, points towards a possible similarity of the environments of CC-SNe and FRBs. We also find that 4/5 FRB hosts exhibit distinct spiral arm features, and the bursts originating from such hosts tend to appear on or close to the spiral structure of their hosts, with a median distance of 0.53 kpc. With many well-localized FRB detections looming on the horizon, we will be able to better characterize the properties of FRB environments relative to their host galaxies and other transient classes.


title: Enhanced Persistent Orientation of Asymmetric-Top Molecules Induced by Cross-Polarized Terahertz Pulses

abstract: We investigate the persistent orientation of asymmetric-top molecules induced by time-delayed THz pulses that are either collinearly or cross polarized. Our theoretical and numerical results demonstrate that the orthogonal configuration outperforms the collinear one, and a significant degree of persistent orientation - approximately 10% at 5 K and nearly 3% at room temperature - may be achieved through parameter optimization. The dependence of the persistent orientation factor on temperature and field parameters is studied in detail. The proposed application of two orthogonally polarized THz pulses is both practical and efficient. Its applicability under standard laboratory conditions lays a solid foundation for future experimental realization of THz-induced persistent molecular orientation.


title: One-loop Bern-Carrasco-Johansson Numerators on Quadratic Propagators from the Worldsheet

abstract: We introduce a novel approach for deriving one-loop Bern-Carrasco-Johansson (BCJ) numerators and reveal the worldsheet origin of the one-loop double copy. Our work shows that expanding Cachazo-He-Yuan half-integrands into generalized Parke-Taylor factors intrinsically generates BCJ numerators on quadratic propagators satisfying Jacobi identities. We validate our methodology by successfully reproducing one-loop BCJ numerators for Non-Linear Sigma Model as well as those of pure Yang-Mills theory in four dimensions with all-plus or single-minus helicities.


title: Signed Binarization: Unlocking Efficiency Through Repetition-Sparsity Trade-Off

abstract: Efficient inference of Deep Neural Networks (DNNs) on resource-constrained edge devices is essential. Quantization and sparsity are key algorithmic techniques that translate to repetition and sparsity within tensors at the hardware-software interface. This paper introduces the concept of repetition-sparsity trade-off that helps explain computational efficiency during inference. We propose Signed Binarization, a unified co-design framework that synergistically integrates hardware-software systems, quantization functions, and representation learning techniques to address this trade-off. Our results demonstrate that Signed Binarization is more accurate than binarization with the same number of non-zero weights. Detailed analysis indicates that signed binarization generates a smaller distribution of effectual (non-zero) parameters nested within a larger distribution of total parameters, both of the same type, for a DNN block. Finally, our approach achieves a 26% speedup on real hardware, doubles energy efficiency, and reduces density by 2.8x compared to binary methods for ResNet 18, presenting an alternative solution for deploying efficient models in resource-limited environments.


title: Explaining with Contrastive Phrasal Highlighting: A Case Study in Assisting Humans to Detect Translation Differences

abstract: Explainable NLP techniques primarily explain by answering "Which tokens in the input are responsible for this prediction?''. We argue that for NLP models that make predictions by comparing two input texts, it is more useful to explain by answering "What differences between the two inputs explain this prediction?''. We introduce a technique to generate contrastive highlights that explain the predictions of a semantic divergence model via phrase-alignment-guided erasure. We show that the resulting highlights match human rationales of cross-lingual semantic differences better than popular post-hoc saliency techniques and that they successfully help people detect fine-grained meaning differences in human translations and critical machine translation errors.


title: Efficient Collision Detection Oriented Motion Primitives for Path Planning

abstract: Mobile robots in dynamic environments require fast planning, especially when onboard computational resources are limited. While classic potential field based algorithms may suffice in simple scenarios, in most cases algorithms able to escape local minima are necessary. Configuration-space search algorithms have proven to provide a good trade-off between quality of the solutions and search time. Literature presents a wide variety of approaches that speed up this search by reducing the number of edges that need to be inspected. Much less attention was instead given to reducing the time necessary to evaluate the cost of a single edge. This paper addresses this point by associating edges to motion primitives that prioritize fast collision detection. We show how biarcs can be used as motion primitives that enable fast collision detection, while still providing smooth, tangent continuous paths. The proposed approach does not assume a disc shaped hitbox, making it appealing for all robots with very different width and length or for differential drive robots with active wheels located far from the robot's center.


title: Homogenization of Wasserstein gradient flows

abstract: We prove the convergence of a Wasserstein gradient flow of a free energy in an inhomogeneous media. Both the energy and media can depend on the spatial variable in a fast oscillatory manner. In particular, we show that the gradient flow structure is preserved in the limit which is expressed in terms of an effective energy and Wasserstein metric. The gradient flow and its limiting behavior is analyzed through an energy dissipation inequality (EDI). The result is consistent with asymptotic analysis in the realm of homogenization. However, we note that the effective metric is in general different from that obtained from the Gromov-Hausdorff convergence of metric spaces. We apply our framework to a linear Fokker-Planck equation but we believe the approach is robust enough to be applicable in a broader context.


title: OCGEC: One-class Graph Embedding Classification for DNN Backdoor Detection

abstract: Deep neural networks (DNNs) have been found vulnerable to backdoor attacks, raising security concerns about their deployment in mission-critical applications. There are various approaches to detect backdoor attacks, however they all make certain assumptions about the target attack to be detected and require equal and huge numbers of clean and backdoor samples for training, which renders these detection methods quite limiting in real-world circumstances. This study proposes a novel one-class classification framework called One-class Graph Embedding Classification (OCGEC) that uses GNNs for model-level backdoor detection with only a little amount of clean data. First, we train thousands of tiny models as raw datasets from a small number of clean datasets. Following that, we design a ingenious model-to-graph method for converting the model's structural details and weight features into graph data. We then pre-train a generative self-supervised graph autoencoder (GAE) to better learn the features of benign models in order to detect backdoor models without knowing the attack strategy. After that, we dynamically combine the GAE and one-class classifier optimization goals to form classification boundaries that distinguish backdoor models from benign models. Our OCGEC combines the powerful representation capabilities of graph neural networks with the utility of one-class classification techniques in the field of anomaly detection. In comparison to other baselines, it achieves AUC scores of more than 98% on a number of tasks, which far exceeds existing methods for detection even when they rely on a huge number of positive and negative samples. Our pioneering application of graphic scenarios for generic backdoor detection can provide new insights that can be used to improve other backdoor defense tasks. Code is available at https://github.com/jhy549/OCGEC.


title: On the Maximization of Long-Run Reward CVaR for Markov Decision Processes

abstract: This paper studies the optimization of Markov decision processes (MDPs) from a risk-seeking perspective, where the risk is measured by conditional value-at-risk (CVaR). The objective is to find a policy that maximizes the long-run CVaR of instantaneous rewards over an infinite horizon across all history-dependent randomized policies. By establishing two optimality inequalities of opposing directions, we prove that the maximum of long-run CVaR of MDPs over the set of history-dependent randomized policies can be found within the class of stationary randomized policies. In contrast to classical MDPs, we find that there may not exist an optimal stationary deterministic policy for maximizing CVaR. Instead, we prove the existence of an optimal stationary randomized policy that requires randomizing over at most two actions. Via a convex optimization representation of CVaR, we convert the long-run CVaR maximization MDP into a minimax problem, where we prove the interchangeability of minimum and maximum and the related existence of saddle point solutions. Furthermore, we propose an algorithm that finds the saddle point solution by solving two linear programs. These results are then extended to objectives that involve maximizing some combination of mean and CVaR of rewards simultaneously. Finally, we conduct numerical experiments to demonstrate the main results.


title: Scalable and Independent Learning of Nash Equilibrium Policies in $n$-Player Stochastic Games with Unknown Independent Chains

abstract: We study a subclass of $n$-player stochastic games, namely, stochastic games with independent chains and unknown transition matrices. In this class of games, players control their own internal Markov chains whose transitions do not depend on the states/actions of other players. However, players' decisions are coupled through their payoff functions. We assume players can receive only realizations of their payoffs, and that the players can not observe the states and actions of other players, nor do they know the transition probability matrices of their own Markov chain. Relying on a compact dual formulation of the game based on occupancy measures and the technique of confidence set to maintain high-probability estimates of the unknown transition matrices, we propose a fully decentralized mirror descent algorithm to learn an $\epsilon$-NE for this class of games. The proposed algorithm has the desired properties of independence, scalability, and convergence. Specifically, under no assumptions on the reward functions, we show the proposed algorithm converges in polynomial time in a weaker distance (namely, the averaged Nikaido-Isoda gap) to the set of $\epsilon$-NE policies with arbitrarily high probability. Moreover, assuming the existence of a variationally stable Nash equilibrium policy, we show that the proposed algorithm converges asymptotically to the stable $\epsilon$-NE policy with arbitrarily high probability. In addition to Markov potential games and linear-quadratic stochastic games, this work provides another subclass of $n$-player stochastic games that, under some mild assumptions, admit polynomial-time learning algorithms for finding their stationary $\epsilon$-NE policies.


title: ActiveClean: Generating Line-Level Vulnerability Data via Active Learning

abstract: Deep learning vulnerability detection tools are increasing in popularity and have been shown to be effective. These tools rely on large volume of high quality training data, which are very hard to get. Most of the currently available datasets provide function-level labels, reporting whether a function is vulnerable or not vulnerable. However, for a vulnerability detection to be useful, we need to also know the lines that are relevant to the vulnerability. This paper makes efforts towards developing systematic tools and proposes. ActiveClean to generate the large volume of line-level vulnerability data from commits. That is, in addition to function-level labels, it also reports which lines in the function are likely responsible for vulnerability detection. In the past, static analysis has been applied to clean commits to generate line-level data. Our approach based on active learning, which is easy to use and scalable, provide a complementary approach to static analysis. We designed semantic and syntactic properties from commit lines and use them to train the model. We evaluated our approach on both Java and C datasets processing more than 4.3K commits and 119K commit lines. AcitveClean achieved an F1 score between 70-74. Further, we also show that active learning is effective by using just 400 training data to reach F1 score of 70.23. Using ActiveClean, we generate the line-level labels for the entire FFMpeg project in the Devign dataset, including 5K functions, and also detected incorrect function-level labels. We demonstrated that using our cleaned data, LineVul, a SOTA line-level vulnerability detection tool, detected 70 more vulnerable lines and 18 more vulnerable functions, and improved Top 10 accuracy from 66% to 73%.


title: Euclidean Bottleneck Steiner Tree is Fixed-Parameter Tractable

abstract: In the Euclidean Bottleneck Steiner Tree problem, the input consists of a set of $n$ points in $\mathbb{R}^2$ called terminals and a parameter $k$, and the goal is to compute a Steiner tree that spans all the terminals and contains at most $k$ points of $\mathbb{R}^2$ as Steiner points such that the maximum edge-length of the Steiner tree is minimized, where the length of a tree edge is the Euclidean distance between its two endpoints. The problem is well-studied and is known to be NP-hard. In this paper, we give a $k^{O(k)} n^{O(1)}$-time algorithm for Euclidean Bottleneck Steiner Tree, which implies that the problem is fixed-parameter tractable (FPT). This settles an open question explicitly asked by Bae et al. [Algorithmica, 2011], who showed that the $\ell_1$ and $\ell_{\infty}$ variants of the problem are FPT. Our approach can be generalized to the problem with $\ell_p$ metric for any rational $1 \le p \le \infty$, or even other metrics on $\mathbb{R}^2$.


title: Quantum search algorithm on weighted databases

abstract: The Grover algorithm is a crucial solution for addressing unstructured search problems and has emerged as an essential quantum subroutine in various complex algorithms. This research extensively investigates Grover's search methodology within non-uniformly distributed databases, a scenario frequently encountered in practical applications. Our analysis reveals that the behavior of the Grover evolution differs significantly when applied to non-uniform databases compared to uniform or 'unstructured databases'. It is observed that the search process facilitated by this evolution does not consistently result in a speed-up, and we have identified specific criteria for such situations. Furthermore, we have extended this investigation to databases characterized by coherent states, confirming the speed-up achieved through Grover evolution via rigorous numerical verification. In conclusion, our study provides an enhancement to the original Grover algorithm, offering insights to optimize implementation strategies and broaden its range of applications.


title: Integrability and singularities of Harish-Chandra characters

abstract: Let $G$ be a reductive group over a local field $F$ of characteristic $0$. By Harish-Chandra's regularity theorem, every global character $\Theta_{\pi}$ of an irreducible, admissible representation $\pi$ of $G$ is given by a locally integrable function $\theta_{\pi}$ on $G$. It is a natural question whether $\theta_{\pi}$ has better integrability properties, namely, whether it is locally $L^{1+\epsilon}$-integrable for some $\epsilon>0$. It follows from Harish-Chandra's work that the answer is positive, and this gives rise to a new singularity invariant of representations $\epsilon_{\star}(\pi):=\sup\left\{ \epsilon:\theta_{\pi}\in L_{\mathrm{Loc}}^{1+\epsilon}(G)\right\} $, which we explore in this paper. We provide a lower bound on $\epsilon_{\star}(\pi)$ for any $G$, and determine $\epsilon_{\star}(\pi)$ in the case of a $p$-adic $\mathrm{GL}_{n}$. This is done by studying integrability properties of the Fourier transforms $\widehat{\xi_{\mathcal{O}}}$ of stable Richardson nilpotent orbital integrals $\xi_{\mathcal{O}}$. We express $\epsilon_{\star}(\widehat{\xi_{\mathcal{O}}})$ as the log-canonical threshold of a suitable relative Weyl discriminant, and use a resolution of singularities algorithm coming from the theory of hyperplane arrangements, to compute it in terms of the partition associated with the orbit. As an application, we obtain bounds on the multiplicities of $K$-types in irreducible representations of $G$ in the $p$-adic case, where $K$ is an open compact subgroup.


title: Expand BERT Representation with Visual Information via Grounded Language Learning with Multimodal Partial Alignment

abstract: Language models have been supervised with both language-only objective and visual grounding in existing studies of visual-grounded language learning. However, due to differences in the distribution and scale of visual-grounded datasets and language corpora, the language model tends to mix up the context of the tokens that occurred in the grounded data with those that do not. As a result, during representation learning, there is a mismatch between the visual information and the contextual meaning of the sentence. To overcome this limitation, we propose GroundedBERT - a grounded language learning method that enhances the BERT representation with visually grounded information. GroundedBERT comprises two components: (i) the original BERT which captures the contextual representation of words learned from the language corpora, and (ii) a visual grounding module which captures visual information learned from visual-grounded datasets. Moreover, we employ Optimal Transport (OT), specifically its partial variant, to solve the fractional alignment problem between the two modalities. Our proposed method significantly outperforms the baseline language models on various language tasks of the GLUE and SQuAD datasets.


title: Impacts of hexadecapole deformations on the collective energy spectra of axially deformed nuclei

abstract: The hexadecapole deformation, as well as the quadrupole one, influences the low-lying states of finite nuclei. The hexadecapole correlations are often overshadowed by the large quadrupole effects, and hence have not been much investigated. Here we address the relevance of hexadecapole deformations in the calculations of low-energy collective states of heavy nuclei, by using the theoretical framework of the self-consistent mean-field method and the interacting-boson approximation. The interacting-boson Hamiltonian that explicitly includes the quadrupole and hexadecapole collective degrees of freedom is specified by a choice of the energy density functional and pairing interaction. In an illustrative application to axially deformed Gd isotopes, it is shown that the inclusion of the hexadecapole degree of freedom does not affect most of the low-spin and low-lying states qualitatively, but that has notable effects in that it significantly improves the description of high-spin states of the ground-state bands of nearly spherical vibrational nuclei and gives rise to $K^\pi=4^+$ bands exhibiting strong $E4$ transitions in strongly deformed nuclei.


title: Impact of the LZ Experiment on the DM Phenomenology and Naturalness in the MSSM

abstract: This paper uses approximate analytical formulas and numerical results with the bino-dominated dark matter (DM) as an example to analyze the impact of the LUX-ZEPLIN (LZ) experiment on the DM phenomenology and naturalness in the Minimal Supersymmetric Standard Model (MSSM). We conclude that the limitation of the latest LZ experiment worsens the naturalness of the MSSM, as the predictions of the $Z$-boson mass and DM relic density demonstrate, particularly in the regions where the correct DM relic density is obtained by the $Z$- or $h$-mediated resonant annihilations.


title: Negative Magnetization and Magnetic Ordering of Rare Earth and Transition Metal Sublattices in NdFe0.5Cr0.5O3

abstract: We investigate the effect of alloying at the 3d transition metal site of a rare-earth-transition metal oxide, by considering NdFe0.5Cr0.5O3 alloy with two equal and random distribution of 3d ions, Cr and Fe, interacting with an early 4f rare earth ion, Nd. Employing temperature- and field-dependent magnetization measurements, temperature-dependent x-ray diffraction, neutron powder diffraction, and Raman spectroscopy, we characterize its structural and magnetic properties. Our study reveals bipolar magnetic switching (arising from negative magnetization) and magnetocaloric effect which underline the potential of the studied alloy in device application. The neutron diffraction study shows the absence of spin reorientation transition over the entire temperature range of 1.5-320 K, although both parent compounds exhibit spin orientation transition. We discuss the microscopic origin of this curious behavior. The neutron diffraction results also reveal the ordering of Nd spins at an unusually high temperature of about 40 K, which is corroborated by Raman measurements.


title: Statistic electromotive force of solid-state conductor P / polar liquid L / solid-state conductor N capacitor

abstract: Based on the energy conversion of the dynamic electric effect from the solid/liquid contact double electric layer is the dynamic electromotive potential, this paper studies the static appearance and the release of the electric field energy of the solid/liquid contact double electric layer, so a special capacitor (P/L/N capacitor) of solid conductor P / polar liquid L / solid conductor N is constructed. The observations based on experiments are as follows: (i) the contact double electric layer derived from the internal potential difference polarization of the solid conductor / polar liquid is equivalent to the external electric field polarization of the ordinary capacitor. The formation process of the contact double electric layer is the spontaneous charging process of the P/L/N capacitor, and the P/L/N capacitor still shows the electric field energy of the contact double electric layer. (ii) Because the polarized external potential difference of the solid conductor / polar liquid contacting the double electric layer is always less than the internal potential difference, the short-circuit P/L/N capacitor also has a continuous electromotive force after the discharge, statically releasing the electric field energy contacting the double electric layer. (iii) The contact double electric layer of solid conductor / polar liquid is produced spontaneously caused by mutual contact, and it is also a self-organizing process of absorbing the environmental heat energy into the electric field energy of the contact double electric layer. P/L/N capacitors realize thermoelectric conversion by releasing the electric field energy of the contact double electric layer. The above-mentioned phenomenon provides the possibility for the development of self-generated capacitors and self-supplied power supply.


title: SCLIP: Rethinking Self-Attention for Dense Vision-Language Inference

abstract: Recent advances in contrastive language-image pretraining (CLIP) have demonstrated strong capabilities in zero-shot classification by aligning visual representations with target text embeddings in an image level. However, in dense prediction tasks, CLIP often struggles to localize visual features within an image and fails to give accurate pixel-level predictions, which prevents it from functioning as a generalized visual foundation model. In this work, we aim to enhance CLIP's potential for semantic segmentation with minimal modifications to its pretrained models. By rethinking self-attention, we surprisingly find that CLIP can adapt to dense prediction tasks by simply introducing a novel Correlative Self-Attention (CSA) mechanism. Specifically, we replace the traditional self-attention block of CLIP vision encoder's last layer by our CSA module and reuse its pretrained projection matrices of query, key, and value, leading to a training-free adaptation approach for CLIP's zero-shot semantic segmentation. Extensive experiments show the advantage of CSA: we obtain a 38.2% average zero-shot mIoU across eight semantic segmentation benchmarks highlighted in this paper, significantly outperforming the existing SoTA's 33.9% and the vanilla CLIP's 14.1%.


title: Good Questions Help Zero-Shot Image Reasoning

abstract: Aligning the recent large language models (LLMs) with computer vision models leads to large vision-language models (LVLMs), which have paved the way for zero-shot image reasoning tasks. However, LVLMs are usually trained on short high-level captions only referring to sparse focus regions in images. Such a ``tunnel vision'' limits LVLMs to exploring other relevant contexts in complex scenes. To address this challenge, we introduce Question-Driven Visual Exploration (QVix), a novel prompting strategy that enhances the exploratory capabilities of LVLMs in zero-shot reasoning tasks. QVix leverages LLMs' strong language prior to generate input-exploratory questions with more details than the original query, guiding LVLMs to explore visual content more comprehensively and uncover subtle or peripheral details. QVix enables a wider exploration of visual scenes, improving the LVLMs' reasoning accuracy and depth in tasks such as visual question answering and visual entailment. Our evaluations on various challenging zero-shot vision-language benchmarks, including ScienceQA and fine-grained visual classification, demonstrate that QVix significantly outperforms existing methods, highlighting its effectiveness in bridging the gap between complex visual data and LVLMs' exploratory abilities.


title: Representations of the orbifold of parafermion vertex operator algebra $K(osp(1|2),k)$

abstract: This paper is about the orbifold theory of parafermion vertex operator algebras $K(osp(1|2),k)$ associated to the affine vertex operator superalgebra $L_{\widehat{osp(1|2)}}(k,0)$ with any positive integer $k$. Among the main results, we classify the irreducible modules for the orbifold of parafermion vertex operator algebra $K(osp(1|2),k)$.


title: A phenomenological model for interstitial hydrogen absorption in niobium

abstract: A phenomenological model has been developed for hydrogen absorption in niobium. The model has 9 free parameters that have a physical basis. The model provides an excellent fit to the highly accurate isotherm data by Veleckis et al. and has been cross validated by limiting the fitting procedure to a training set. The model makes it possible to extract more information from the data than could be extracted with the computational methods available when the measurements were made. The partial molal enthalpy and partial molal entropy of hydrogen dissolution were calculated using the parameter values corresponding to the best fit to the isotherms. These quantities are consistent with those reported by Veleckis et al. Interpreting the model parameter values reveals insights into the nature of the interaction between hydrogen atoms in niobium. These insights supports our previous analysis of hydrogen interactions in niobium using density functional theory calculations.


title: Local-Global History-aware Contrastive Learning for Temporal Knowledge Graph Reasoning

abstract: Temporal knowledge graphs (TKGs) have been identified as a promising approach to represent the dynamics of facts along the timeline. The extrapolation of TKG is to predict unknowable facts happening in the future, holding significant practical value across diverse fields. Most extrapolation studies in TKGs focus on modeling global historical fact repeating and cyclic patterns, as well as local historical adjacent fact evolution patterns, showing promising performance in predicting future unknown facts. Yet, existing methods still face two major challenges: (1) They usually neglect the importance of historical information in KG snapshots related to the queries when encoding the local and global historical information; (2) They exhibit weak anti-noise capabilities, which hinders their performance when the inputs are contaminated with noise.To this end, we propose a novel \blue{Lo}cal-\blue{g}lobal history-aware \blue{C}ontrastive \blue{L}earning model (\blue{LogCL}) for TKG reasoning, which adopts contrastive learning to better guide the fusion of local and global historical information and enhance the ability to resist interference. Specifically, for the first challenge, LogCL proposes an entity-aware attention mechanism applied to the local and global historical facts encoder, which captures the key historical information related to queries. For the latter issue, LogCL designs four historical query contrast patterns, effectively improving the robustness of the model. The experimental results on four benchmark datasets demonstrate that LogCL delivers better and more robust performance than the state-of-the-art baselines.


title: Quantum Time Series Similarity Measures and Quantum Temporal Kernels

abstract: This article presents a quantum computing approach to designing of similarity measures and kernels for classification of stochastic symbolic time series. In the area of machine learning, kernels are important components of various similarity-based classification, clustering, and regression algorithms. An effective strategy for devising problem-specific kernels is leveraging existing generative models of the example space. In this study we assume that a quantum generative model, known as quantum hidden Markov model (QHMM), describes the underlying distributions of the examples. The sequence structure and probability are determined by transitions within model's density operator space. Consequently, the QHMM defines a mapping from the example space into the broader quantum space of density operators. Sequence similarity is evaluated using divergence measures such as trace and Bures distances between quantum states. We conducted extensive simulations to explore the relationship between the distribution of kernel-estimated similarity and the dimensionality of the QHMMs Hilbert space. As anticipated, a higher dimension of the Hilbert space corresponds to greater sequence distances and a more distinct separation of the examples. To empirically evaluate the performance of the kernels, we defined classification tasks based on a simplified generative model of directional price movement in the stock market. We implemented two widely-used kernel-based algorithms - support vector machines and k-nearest neighbors - using both classical and quantum kernels. Across all classification task scenarios, the quantum kernels consistently demonstrated superior performance compared to their classical counterparts.


title: On a minimization problem of the maximum generalized eigenvalue: properties and algorithms

abstract: We study properties and algorithms of a minimization problem of the maximum generalized eigenvalue of symmetric-matrix-valued affine functions, which is nonsmooth and quasiconvex, and has application to eigenfrequency optimization of truss structures. We derive an explicit formula of the Clarke subdifferential of the maximum generalized eigenvalue and prove the maximum generalized eigenvalue is a pseudoconvex function, which is a subclass of a quasiconvex function, under suitable assumptions. Then, we consider smoothing methods to solve the problem. We introduce a smooth approximation of the maximum generalized eigenvalue and prove the convergence rate of the smoothing projected gradient method to a global optimal solution in the considered problem. Also, some heuristic techniques to reduce the computational costs, acceleration and inexact smoothing, are proposed and evaluated by numerical experiments.


title: Insights into optical absorption and dark currents of the 6.1{\AA} Type-II superlattice absorbers for MWIR and SWIR applications

abstract: A holistic computational analysis is developed to calculate the quantum efficiency of InAs/GaSb superlattice-based photodetectors. Starting with the electronic band characteristics computed by taking the InSb/GaAs at the interface using the 8-band k.p approach, we demonstrate the impact of InAs and GaSb widths on the bandgap, carrier concentration, and the oscillator strength for type-II superlattice absorbers. Subsequently, the alteration of these characteristics due to the extra AlSb layer in the M superlattice absorber is investigated. Extending our models for determining TE- and TM-polarized optical absorption, our calculations reveal that the TE-polarized absorption shows a substantial influence near the conduction-heavy hole band transition energy, which eventually diminishes, owing to the dominant TM-contribution due to the conduction-light hole band transition. Extending our analysis to the dark currents, we focus mainly on Schokley-Read-Hall recombination and radiative recombination at lower temperatures, and show that Schokley-Read-Hall dominates at low-level injection. We show that short-wavelength and mid-wavelength M superlattice structures exhibit higher quantum efficiency than the corresponding same bandgap type-II superlattice with the lower diffusion dark current. Further, we analyze the density of states blocked by the barrier; crucial for XBp photodetector after absorber examination. Our work thus sets a stage for a holistic and predictive theory aided analysis of the type-II superlattice absorbers, from the atomistic interfacial details all the way to the dark currents and absorption spectra.


title: TextAug: Test time Text Augmentation for Multimodal Person Re-identification

abstract: Multimodal Person Reidentification is gaining popularity in the research community due to its effectiveness compared to counter-part unimodal frameworks. However, the bottleneck for multimodal deep learning is the need for a large volume of multimodal training examples. Data augmentation techniques such as cropping, flipping, rotation, etc. are often employed in the image domain to improve the generalization of deep learning models. Augmenting in other modalities than images, such as text, is challenging and requires significant computational resources and external data sources. In this study, we investigate the effectiveness of two computer vision data augmentation techniques: cutout and cutmix, for text augmentation in multi-modal person re-identification. Our approach merges these two augmentation strategies into one strategy called CutMixOut which involves randomly removing words or sub-phrases from a sentence (Cutout) and blending parts of two or more sentences to create diverse examples (CutMix) with a certain probability assigned to each operation. This augmentation was implemented at inference time without any prior training. Our results demonstrate that the proposed technique is simple and effective in improving the performance on multiple multimodal person re-identification benchmarks.


title: Investigating the ability of deep learning to predict Welding Depth and Pore Volume in Hairpin Welding

abstract: To advance quality assurance in the welding process, this study presents a robust deep learning model that enables the prediction of two critical welds Key Performance Characteristics (KPCs): welding depth and average pore volume. In the proposed approach, a comprehensive range of laser welding Key Input Characteristics (KICs) is utilized, including welding beam geometries, welding feed rates, path repetitions for weld beam geometries, and bright light weld ratios for all paths, all of which were obtained from hairpin welding experiments. Two deep learning networks are employed with multiple hidden dense layers and linear activation functions to showcase the capabilities of deep neural networks in capturing the intricate nonlinear connections inherent within welding KPCs and KICs. Applying deep learning networks to the small numerical experimental hairpin welding dataset has shown promising results, achieving Mean Absolute Error (MAE) values as low as 0.1079 for predicting welding depth and 0.0641 for average pore volume. Additionally, the validity verification demonstrates the reliability of the proposed method. This, in turn, promises significant advantages in controlling welding outcomes, moving beyond the current trend of relying merely on monitoring for defect classification.


title: Monte Carlo Experiments of Network Effects in Randomized Controlled Trials

abstract: I run Monte Carlo simulations of content production over random Watts-Strogatz graphs to show various effects relevant to modeling and understanding Randomized Controlled Trials on social networks: the network effect, spillover effect, experiment dampening effect, intrinsic dampening effect, clustering effect, degree distribution effect and the experiment size effect. I will also define some simple metrics to measure their strength. When running experiments these potentially unexpected effects must be understood and controlled for in some manner, such as modeling the underlying graph structure to establish a baseline.


title: A Variation Problem for Mappings between Statistical Manifolds

abstract: We present statistical biharmonic maps, a new class of mappings between statistical manifolds naturally derived from a variation problem. We give the Euler-Lagrange equation of this problem and prove that improper affine hyperspheres induce examples of such maps.


title: Smoothing Accelerated Proximal Gradient Method with Fast Convergence Rate for Nonsmooth Multi-objective Optimization

abstract: This paper introduces a novel approach to nonsmooth multiobjective optimization through the proposal of a Smoothing Accelerated Proximal Gradient Method with Extrapolation Term (SAPGM). Leveraging the foundation of smoothing methods and the accelerated algorithm for multiobjective optimization by Tanabe et al., our method exhibits a refined convergence rate. Specifically, we establish that the convergence rate of our proposed method can be enhanced from $O(1/k^2)$ to $o(1/k^2)$ by incorporating a distinct extrapolation term \(\frac{k-1}{k + \alpha -1}\) with \(\alpha > 3\).Moreover, we prove that the iterates sequence is convergent to an optimal solution of the problem. Furthermore, we present an effective strategy for solving the subproblem through its dual representation, validating the efficacy of the proposed method through a series of numerical experiments.


title: Accelerated Parallel Magnetic Resonance Imaging with Compressed Sensing using Structured Sparsity

abstract: Compressed sensing is an imaging paradigm that allows one to invert an underdetermined linear system by imposing the a priori knowledge that the sought after solution is sparse (i.e., mostly zeros). Previous works have shown that if one also knows something about the sparsity pattern (the locations where non-zero entries exist), one can take advantage of this structure to improve the quality of the result. A significant application of compressed sensing is magnetic resonance imaging (MRI), where samples are acquired in the Fourier domain. Compressed sensing allows one to reconstruct a high-quality image with fewer samples which can be collected with a faster scan. This increases the robustness of MRI to patient motion since less motion is possible during the shorter scan. Parallel imaging, where multiple coils are used to gather data, is another an more ubiquitously used method for accelerating MRI. Existing combinations of these acceleration methods, such as Sparse SENSE, yield high quality images with an even shorter scan time than either technique alone. In this work, we show how to modify Sparse SENSE with structured sparsity to reconstruct a high quality image with even fewer samples.


title: Focusing solutions of Vlasov-Poisson equation on a spherical shell

abstract: We study smooth, spherically-symmetric solutions to the Vlasov-Poisson system and relativistic Vlasov-Poisson system in the plasma physical case. In particular, we construct solutions that initially possess arbitrarily small charge densities and electric fields, but attain arbitrarily large value of these quantities and concentrate on any given spherical shell at some later time.


title: xNeuSM: Explainable Neural Subgraph Matching with Graph Learnable Multi-hop Attention Networks

abstract: Subgraph matching is a challenging problem with a wide range of applications in database systems, biochemistry, and cognitive science. It involves determining whether a given query graph is present within a larger target graph. Traditional graph-matching algorithms provide precise results but face challenges in large graph instances due to the NP-complete problem, limiting their practical applicability. In contrast, recent neural network-based approximations offer more scalable solutions, but often lack interpretable node correspondences. To address these limitations, this article presents xNeuSM: Explainable Neural Subgraph Matching which introduces Graph Learnable Multi-hop Attention Networks (GLeMA) that adaptively learns the parameters governing the attention factor decay for each node across hops rather than relying on fixed hyperparameters. We provide a theoretical analysis establishing error bounds for GLeMA's approximation of multi-hop attention as a function of the number of hops. Additionally, we prove that learning distinct attention decay factors for each node leads to a correct approximation of multi-hop attention. Empirical evaluation on real-world datasets shows that xNeuSM achieves substantial improvements in prediction accuracy of up to 34% compared to approximate baselines and, notably, at least a seven-fold faster query time than exact algorithms. The source code of our implementation is available at https://github.com/martinakaduc/xNeuSM.


title: Local Cohomology Modules of Binomial Edge Ideals of Complements of Connected Graphs of Girth at Least 5

abstract: We calculate the local cohomology modules of the binomial edge ideals of the complements of connected graphs of girth at least 5 using the tools introduced by \`Alvarez Montaner in arXiv:1901.08645. We then use this calculation to compute the depth, dimension, and regularity of these binomial edge ideals.


title: Three-Dimensional Quantum Anomalous Hall Effect in Magnetic Topological Insulator Trilayers of Hundred-Nanometer Thickness

abstract: Magnetic topological states refer to a class of exotic phases in magnetic materials with their non-trivial topological property determined by magnetic spin configurations. An example of such states is the quantum anomalous Hall (QAH) state, which is a zero magnetic field manifestation of the quantum Hall effect. Current research in this direction focuses on QAH insulators with a thickness of less than 10nm. The thick QAH insulators in the three-dimensional(3D) regime are limited, largely due to inevitable bulk carriers being introduced in thick magnetic TI samples. Here, we employ molecular beam epitaxy (MBE) to synthesize magnetic TI trilayers with a thickness of up to ~106 nm. We find these samples exhibit well-quantized Hall resistance and vanishing longitudinal resistance at zero magnetic field. By varying magnetic dopants, gate voltages, temperature, and external magnetic fields, we examine the properties of these thick QAH insulators and demonstrate the robustness of the 3D QAH effect. The realization of the well-quantized 3D QAH effect indicates that the nonchiral side surface states of our thick magnetic TI trilayers are gapped and thus do not affect the QAH quantization. The 3D QAH insulators of hundred-nanometer thickness provide a promising platform for the exploration of fundamental physics, including axion physics and image magnetic monopole, and the advancement of electronic and spintronic devices to circumvent Moore's law.


title: Generalized weighted composition operators on Hardy space $H^2(\mathbb{D}^n)$

abstract: In this paper, we explore the complex symmetrical characteristics of weighted composition operators $W_{u, v}$ and weighted composition-differentiation operators $W_{u, v, k_1, k_2, \ldots, k_n}$ on the Hardy space $H^2(\mathbb{D}^n)$ over the Polydisk $\mathbb{D}^n$, with respect to the standard conjugation $\mathcal{J}$. We specify explicit conditions that confirm the Hermitian characteristics of the operator $W_{u, v, k_1, k_2, \ldots, k_n}$ and describe the conditions necessary for it to exhibit normal behavior. Additionally, we identify the kernels of the generalized weighted composition-differentiation operators and their corresponding adjoint operators.


title: SchurVINS: Schur Complement-Based Lightweight Visual Inertial Navigation System

abstract: Accuracy and computational efficiency are the most important metrics to Visual Inertial Navigation System (VINS). The existing VINS algorithms with either high accuracy or low computational complexity, are difficult to provide the high precision localization in resource-constrained devices. To this end, we propose a novel filter-based VINS framework named SchurVINS, which could guarantee both high accuracy by building a complete residual model and low computational complexity with Schur complement. Technically, we first formulate the full residual model where Gradient, Hessian and observation covariance are explicitly modeled. Then Schur complement is employed to decompose the full model into ego-motion residual model and landmark residual model. Finally, Extended Kalman Filter (EKF) update is implemented in these two models with high efficiency. Experiments on EuRoC and TUM-VI datasets show that our method notably outperforms state-of-the-art (SOTA) methods in both accuracy and computational complexity. The experimental code of SchurVINS is available at https://github.com/bytedance/SchurVINS.


title: Heroes: Lightweight Federated Learning with Neural Composition and Adaptive Local Update in Heterogeneous Edge Networks

abstract: Federated Learning (FL) enables distributed clients to collaboratively train models without exposing their private data. However, it is difficult to implement efficient FL due to limited resources. Most existing works compress the transmitted gradients or prune the global model to reduce the resource cost, but leave the compressed or pruned parameters under-optimized, which degrades the training performance. To address this issue, the neural composition technique constructs size-adjustable models by composing low-rank tensors, allowing every parameter in the global model to learn the knowledge from all clients. Nevertheless, some tensors can only be optimized by a small fraction of clients, thus the global model may get insufficient training, leading to a long completion time, especially in heterogeneous edge scenarios. To this end, we enhance the neural composition technique, enabling all parameters to be fully trained. Further, we propose a lightweight FL framework, called Heroes, with enhanced neural composition and adaptive local update. A greedy-based algorithm is designed to adaptively assign the proper tensors and local update frequencies for participating clients according to their heterogeneous capabilities and resource budgets. Extensive experiments demonstrate that Heroes can reduce traffic consumption by about 72.05\% and provide up to 2.97$\times$ speedup compared to the baselines.


title: Equations driven by fast-oscillating functions of a Wiener process

abstract: We study systems of differential equations driven by fast-oscillating functions of a Wiener process. In the limit when the frequency of oscillations goes to infinity, we identify the limiting SDE systems which are driven by several independent Wiener processes. The solutions of the original equations converge to those of the limiting system in law. The limiting equations include additional drift terms which have the form of Stratonovich corrections. Our result can thus be interpreted as a reqularization of SDE systems. The systems we study are motivated by experimental work on the motion of light-sensitive robots and on motility-induced phase separation in bacterial colonies.


title: How Many Validation Labels Do You Need? Exploring the Design Space of Label-Efficient Model Ranking

abstract: This paper presents LEMR (Label-Efficient Model Ranking) and introduces the MoraBench Benchmark. LEMR is a novel framework that minimizes the need for costly annotations in model selection by strategically annotating instances from an unlabeled validation set. To evaluate LEMR, we leverage the MoraBench Benchmark, a comprehensive collection of model outputs across diverse scenarios. Our extensive evaluation across 23 different NLP tasks in semi-supervised learning, weak supervision, and prompt selection tasks demonstrates LEMR's effectiveness in significantly reducing labeling costs. Key findings highlight the impact of suitable ensemble methods, uncertainty sampling strategies, and model committee selection in enhancing model ranking accuracy. LEMR, supported by the insights from MoraBench, provides a cost-effective and accurate solution for model selection, especially valuable in resource-constrained environments.


title: The Laplace Beltrami operator on the ellipsoid

abstract: The Laplace-Beltrami operator on a triaxial ellipsoid admits a sequence of real eigenvalues diverging to plus infinity. By introducing ellipsoidal coordinates this eigenvalue problem for a partial differential operator is reduced to a two-parameter regular Sturm-Liouville problem involving ordinary differential operators. This two-parameter eigenvalue problem has two families of eigencurves whose intersection points determine the eigenvalues of the Laplace-Beltrami operator. Eigenvalues are approximated numerically through eigenvalues of generalized matrix eigenvalue problems. Ellipsoids close to spheres are studied employing Lam\'e polynomials.


title: Simple L\'evy-$\alpha$ stable model analysis of elastic $pp$ and $p\bar p$ low-$|t|$ data from SPS to LHC energies

abstract: A simple L\'evy-$\alpha$ stable (SL) model is used to describe the data on elastic $pp$ and $p\bar p$ scattering at low-$|t|$ from SPS energies up to LHC energies. The SL model is demonstrated to describe the data with a strong non-exponential feature in a statistically acceptable manner. The energy dependence of the parameters of the model is determined and analyzed. The L\'evy $\alpha$ parameter of the model has an energy-independent value of 1.959 $\pm$ 0.002 following from the strong non-exponential behavior of the data. We strengthen the conclusion that the discrepancy between TOTEM and ATLAS elastic $pp$ differential cross section measurements arises only in the normalization and not in the shape of the distribution of the data as a function of $t$. We find that the slope parameter has different values for $pp$ and $p\bar p$ elastic scattering at LHC energies. This may be the effect of the odderon exchange or the jump in the energy dependence of the slope parameter in the energy interval 3 GeV $\lesssim \sqrt s \lesssim$ 4 GeV.


title: Unique determination of cost functions in a multipopulation mean field game model

abstract: This paper studies an inverse problem for a multipopulation mean field game (MFG) system where the objective is to reconstruct the running and terminal cost functions of the system that couples the dynamics of different populations. We derive uniqueness results for the inverse problem with different types of available data. In particular, we show that it is possible to uniquely reconstruct some simplified forms of the cost functions from data measured only on a single population component under mild additional assumptions on the coupling mechanism. The proofs are based on the standard multilinearization technique that allows us to reduce the inverse problems into simplified forms.


title: Universal Segmentation at Arbitrary Granularity with Language Instruction

abstract: This paper aims to achieve universal segmentation of arbitrary semantic level. Despite significant progress in recent years, specialist segmentation approaches are limited to specific tasks and data distribution. Retraining a new model for adaptation to new scenarios or settings takes expensive computation and time cost, which raises the demand for versatile and universal segmentation model that can cater to various granularity. Although some attempts have been made for unifying different segmentation tasks or generalization to various scenarios, limitations in the definition of paradigms and input-output spaces make it difficult for them to achieve accurate understanding of content at arbitrary granularity. To this end, we present UniLSeg, a universal segmentation model that can perform segmentation at any semantic level with the guidance of language instructions. For training UniLSeg, we reorganize a group of tasks from original diverse distributions into a unified data format, where images with texts describing segmentation targets as input and corresponding masks are output. Combined with a automatic annotation engine for utilizing numerous unlabeled data, UniLSeg achieves excellent performance on various tasks and settings, surpassing both specialist and unified segmentation models.


title: GVFs in the Real World: Making Predictions Online for Water Treatment

abstract: In this paper we investigate the use of reinforcement-learning based prediction approaches for a real drinking-water treatment plant. Developing such a prediction system is a critical step on the path to optimizing and automating water treatment. Before that, there are many questions to answer about the predictability of the data, suitable neural network architectures, how to overcome partial observability and more. We first describe this dataset, and highlight challenges with seasonality, nonstationarity, partial observability, and heterogeneity across sensors and operation modes of the plant. We then describe General Value Function (GVF) predictions -- discounted cumulative sums of observations -- and highlight why they might be preferable to classical n-step predictions common in time series prediction. We discuss how to use offline data to appropriately pre-train our temporal difference learning (TD) agents that learn these GVF predictions, including how to select hyperparameters for online fine-tuning in deployment. We find that the TD-prediction agent obtains an overall lower normalized mean-squared error than the n-step prediction agent. Finally, we show the importance of learning in deployment, by comparing a TD agent trained purely offline with no online updating to a TD agent that learns online. This final result is one of the first to motivate the importance of adapting predictions in real-time, for non-stationary high-volume systems in the real world.