title: Multistatic-Radar RCS-Signature Recognition of Aerial Vehicles: A Bayesian Fusion Approach

abstract: Radar Automated Target Recognition (RATR) for Unmanned Aerial Vehicles (UAVs) involves transmitting Electromagnetic Waves (EMWs) and performing target type recognition on the received radar echo, crucial for defense and aerospace applications. Previous studies highlighted the advantages of multistatic radar configurations over monostatic ones in RATR. However, fusion methods in multistatic radar configurations often suboptimally combine classification vectors from individual radars probabilistically. To address this, we propose a fully Bayesian RATR framework employing Optimal Bayesian Fusion (OBF) to aggregate classification probability vectors from multiple radars. OBF, based on expected 0-1 loss, updates a Recursive Bayesian Classification (RBC) posterior distribution for target UAV type, conditioned on historical observations across multiple time steps. We evaluate the approach using simulated random walk trajectories for seven drones, correlating target aspect angles to Radar Cross Section (RCS) measurements in an anechoic chamber. Comparing against single radar Automated Target Recognition (ATR) systems and suboptimal fusion methods, our empirical results demonstrate that the OBF method integrated with RBC significantly enhances classification accuracy compared to other fusion methods and single radar configurations.


title: Constrained Decoding for Code Language Models via Efficient Left and Right Quotienting of Context-Sensitive Grammars

abstract: Large Language Models are powerful tools for program synthesis and advanced auto-completion, but come with no guarantee that their output code is syntactically correct. This paper contributes an incremental parser that allows early rejection of syntactically incorrect code, as well as efficient detection of complete programs for fill-in-the-middle (FItM) tasks. We develop Earley-style parsers that operate over left and right quotients of arbitrary context-free grammars, and we extend our incremental parsing and quotient operations to several context-sensitive features present in the grammars of many common programming languages. The result of these contributions is an efficient, general, and well-grounded method for left and right quotient parsing. To validate our theoretical contributions -- and the practical effectiveness of certain design decisions -- we evaluate our method on the particularly difficult case of FItM completion for Python 3. Our results demonstrate that constrained generation can significantly reduce the incidence of syntax errors in recommended code.


title: Hydrogen bonding in water under extreme confinement unveiled by nanoscale vibrational spectroscopy and simulations

abstract: Fluids under extreme confinement exhibit distinctly new properties compared to their bulk analogs. Understanding the structure and intermolecular bonding of confined water lays the foundation for creating and improving applications at the water-energy nexus. However, probing confined water experimentally at the length scale of intermolecular and surface forces has remained a challenge. Here, we report a combined experiment/theory framework to reveal changes in H-bonding environment and the underlying molecular structure of confined water inside individual carbon nanotubes. H-bonding is directly probed through the O-H stretch frequency with vibrational electron energy-loss spectroscopy and compared to spectra from molecular-dynamics simulations based on density-functional-theory. Experimental spectra show that water in larger carbon nanotubes exhibit the bonded O-H vibrations of bulk water, but at smaller diameters, the frequency blueshifts to near the 'free' O-H stretch found in water vapor and hydrophobic surfaces. The matching simulations reveal that, in addition to steric confinement, the tube's vibrations play a key role in breaking up the H-bond network, resulting in an orientationally-dispersed, non-H-bonded phase. Furthermore, the temperature-dependence of the vibrations is investigated, providing insights into phase transitions and the confined-water density. This research demonstrates the potential of the experiment/theory framework to explore unprecedented aspects of structure and bonding in confined fluids.


title: Data-driven nonlinear turbulent flow scaling with Buckingham Pi variables

abstract: Nonlinear machine learning for turbulent flows can exhibit robust performance even outside the range of training data. This is achieved when machine-learning models can accommodate scale-invariant characteristics of turbulent flow structures. This study presents a data-driven approach to reveal scale-invariant vortical structures across Reynolds numbers that provide insights for supporting nonlinear machine-learning-based studies of turbulent flows. To uncover conditions for which nonlinear models are likely to perform well, we use a Buckingham Pi-based sparse nonlinear scaling to find the influence of the Pi groups on the turbulent flow data. We consider nonlinear scalings of the invariants of the velocity gradient tensor for an example of three-dimensional decaying isotropic turbulence. The present scaling not only enables the identification of vortical structures that are interpolatory and extrapolatory for the given flow field data but also captures non-equilibrium effects of the energy cascade. As a demonstration, the present findings are applied to machine-learning-based super-resolution analysis of three-dimensional isotropic turbulence. We show that machine-learning models reconstruct vortical structures well in the interpolatory space with reduced performance in the extrapolatory space revealed by the nonlinearly scaled invariants. The present approach enables us to depart from labeling turbulent flow data with a single parameter of Reynolds number and comprehensively examine the flow field to support training and testing of nonlinear machine-learning techniques.


title: The fundamental plane of black hole activity for low-luminosity radio active galactic nuclei across 1 < z < 4

abstract: The fundamental plane of black hole activity (BHFP) describes the correlation between radio luminosity ($L_R$), X-ray luminosity ($L_X$), and black hole mass. It reflects a disc-jet connection. However, dependence of BHFP on various physical properties of active galactic nuclei (AGNs) and host galaxies is unclear, especially for low-luminosity AGNs, which is important for understanding accretion physics in AGNs. Here we explore the dependence of BHFP on radio loudness, Eddington ratio ($\lambda_E$), redshift, and galaxy star formation properties at 0.1 < z < 4 for radio AGNs. Based on current deep and large surveys, our studies extend to low luminosities and high redshifts. From GOODS and COSMOS fields, we constructed a homogeneous radio AGN sample including 208 objects. We divided the radio AGN sample into 141 radio-quiet (RQ) AGNs and 67 radio-loud (RL) AGNs according to the radio loudness defined by the $L_R$-to-$L_X$ ratio. This ratio shows a bimodal distribution that is well described by two Gaussian models. Their cross point corresponds to a radio loudness threshold of $\log (L_R/L_X) = -2.73$. RQ and RL AGNs show different BHFPs, indicating a dependence of BHFP on the radio loudness. For both RQ and RL AGNs, BHFP shows a dependence on $\lambda_E$, but no dependence on redshift. BHFP shows a dependence on the galaxy star formation properties for RQ AGNs, while for RL AGNs this dependence disappears. BHFP sheds important light on the accretion physics and X-ray emission origins. X-ray emission of RQ AGNs originates from a combination of advection-dominated accretion flow (ADAF) and synchrotron radiation from jet at $0.01 < \lambda_E < 0.1$, and from jet at $0.1 < \lambda_E < 1$. X-ray emission in RL AGNs originates from a combination of ADAF and jet at $\lambda_E < 0.01$, from jet at $0.01 < \lambda_E < 0.1$, and from a combination of standard thin disc and jet at $\lambda_E > 0.1$.


title: Physics-Informed Machine Learning for Seismic Response Prediction OF Nonlinear Steel Moment Resisting Frame Structures

abstract: There is growing interest in using machine learning (ML) methods for structural metamodeling due to the substantial computational cost of traditional simulations. Purely data-driven strategies often face limitations in model robustness, interpretability, and dependency on extensive data. To address these challenges, this paper introduces a novel physics-informed machine learning (PiML) method that integrates scientific principles and physical laws into deep neural networks to model seismic responses of nonlinear structures. The approach constrains the ML model's solution space within known physical bounds through three main features: dimensionality reduction via combined model order reduction and wavelet analysis, long short-term memory (LSTM) networks, and Newton's second law. Dimensionality reduction addresses structural systems' redundancy and boosts efficiency while extracting essential features through wavelet analysis. LSTM networks capture temporal dependencies for accurate time-series predictions. Manipulating the equation of motion helps learn system nonlinearities and confines solutions within physically interpretable results. These attributes allow for model training with sparse data, enhancing accuracy, interpretability, and robustness. Furthermore, a dataset of archetype steel moment resistant frames under seismic loading, available in the DesignSafe-CI Database [1], is considered for evaluation. The resulting metamodel handles complex data better than existing physics-guided LSTM models and outperforms other non-physics data-driven networks.


title: Size-consistency and orbital-invariance issues revealed by VQE-UCCSD calculations with the FMO scheme

abstract: The fragment molecular orbital (FMO) scheme is one of the popular fragmentation-based methods and has the potential advantage of making the circuit flat in quantum chemical calculations on quantum computers. In this study, we used a GPU-accelerated quantum simulator (cuQuantum) to perform the electron correlation part of the FMO calculation as unitary coupled-cluster singles and doubles (UCCSD) with the variational quantum eigensolver (VQE) for hydrogen-bonded (FH)$_3$ and (FH)$_2$-H$_2$O systems with the STO-3G basis set. VQE-UCCD calculations were performed using both canonical and localized MO sets, and the results were examined from the point of view of size-consistency and orbital-invariance affected by the Trotter error. It was found that the use of localized MO leads to better results, especially for (FH)$_2$-H$_2$O. The GPU acceleration was substantial for the simulations with larger numbers of qubits, and was about a factor of 6.7--7.7 for 18 qubit systems.


title: Quasipolynomial bounds on the inverse theorem for the Gowers $U^{s+1}[N]$-norm

abstract: We prove quasipolynomial bounds on the inverse theorem for the Gowers $U^{s+1}[N]$-norm. The proof is modeled after work of Green, Tao, and Ziegler and uses as a crucial input recent work of the first author regarding the equidistribution of nilsequences. In a companion paper, this result will be used to improve the bounds on Szemer\'{e}di's theorem.


title: Improved Bounds for Szemer\'{e}di's Theorem

abstract: Let $r_k(N)$ denote the size of the largest subset of $[N] = \{1,\ldots,N\}$ with no $k$-term arithmetic progression. We show that for $k\ge 5$, there exists $c_k>0$ such that \[r_k(N)\ll N\exp(-(\log\log N)^{c_k}).\] Our proof is a consequence of recent quasipolynomial bounds on the inverse theorem for the Gowers $U^k$-norm as well as the density increment strategy of Heath-Brown and Szemer\'{e}di as reformulated by Green and Tao.


title: Joint Activity-Delay Detection and Channel Estimation for Asynchronous Massive Random Access: A Free Probability Theory Approach

abstract: Grant-free random access (RA) has been recognized as a promising solution to support massive connectivity due to the removal of the uplink grant request procedures. While most endeavours assume perfect synchronization among users and the base station, this paper investigates asynchronous grant-free massive RA, and develop efficient algorithms for joint user activity detection, synchronization delay detection, and channel estimation. Considering the sparsity on user activity, we formulate a sparse signal recovery problem and propose to utilize the framework of orthogonal approximate message passing (OAMP) to deal with the non-independent and identically distributed (i.i.d.) Gaussian pilot matrices caused by the synchronization delays. In particular, an OAMP-based algorithm is developed to fully harness the common sparsity among received pilot signals from multiple base station antennas. To reduce the computational complexity, we further propose a free probability AMP (FPAMP)-based algorithm, which exploits the rectangular free cumulants to make the cost-effective AMP framework compatible to general pilot matrices. Simulation results demonstrate that the two proposed algorithms outperform various baselines, and the FPAMP-based algorithm reduces 40% of the computations while maintaining comparable detection/estimation accuracy with the OAMP-based algorithm.


title: StaPep: an open-source tool for the structure prediction and feature extraction of hydrocarbon-stapled peptides

abstract: Many tools exist for extracting structural and physiochemical descriptors from linear peptides to predict their properties, but similar tools for hydrocarbon-stapled peptides are lacking.Here, we present StaPep, a Python-based toolkit designed for generating 2D/3D structures and calculating 21 distinct features for hydrocarbon-stapled peptides.The current version supports hydrocarbon-stapled peptides containing 2 non-standard amino acids (norleucine and 2-aminoisobutyric acid) and 6 nonnatural anchoring residues (S3, S5, S8, R3, R5 and R8).Then we established a hand-curated dataset of 201 hydrocarbon-stapled peptides and 384 linear peptides with sequence information and experimental membrane permeability, to showcase StaPep's application in artificial intelligence projects.A machine learning-based predictor utilizing above calculated features was developed with AUC of 0.85, for identifying cell-penetrating hydrocarbon-stapled peptides.StaPep's pipeline spans data retrieval, cleaning, structure generation, molecular feature calculation, and machine learning model construction for hydrocarbon-stapled peptides.The source codes and dataset are freely available on Github: https://github.com/dahuilangda/stapep_package.


title: Jacobian varieties with group algebra decomposition not affordable by Prym varieties

abstract: The action of a finite group $G$ on a compact Riemann surface $X$ naturally induces another action of $G$ on its Jacobian variety $\operatorname{J}(X)$. In many cases, each component of the group algebra decomposition of $\operatorname{J}(X)$ is isogenous to a Prym varieties of an intermediate covering of the Galois covering $\pi_G\colon X \to X/G$; in such a case, we say that the group algebra decomposition is affordable by Prym varieties. In this article, we present an infinite family of groups that act on Riemann surfaces in a manner that the group algebra decomposition of $\operatorname{J}(X)$ is not affordable by Prym varieties; namely, affine groups $\operatorname{Aff}(\mathbb{F}_q)$ with some exceptions: $q = 2$, $q = 9$, $q$ a Fermat prime, $q = 2^n$ with $2^n-1$ a Mersenne prime and some particular cases when $X/G$ has genus $0$ or $1$. In each one of this exceptional cases, we give the group algebra decomposition of $\operatorname{J}(X)$ by Prym varieties.


title: Study of the effects caused by space charge in electron cooling

abstract: In electron cooling, the space charge (SC) is an important effect, which will affect the e-beam velocity distribution and thus the cooling performance. In this paper, we analyse several important effects that due to the space charge field, such like transverse and longitudianl space charge force, drift velocity caused by SC and magnetic field, and longitudinal momentum deviation due to the SC during acceleration.


title: Exact solutions for nonlinear trapped lee waves in the $\beta$-plane approximation

abstract: In this paper, we construct exact solutions that character three-dimensional, nonlinear trapped lee waves propagation superimposed on longitudinal atmospheric currents in the $\beta$-plane approximation. The solutions obtained are presented in Lagrangian coordinates, and are Gerstner-like solutions. In the process, we also derive the dispersion relation and analyze the density, pressure and the vorticity qualitatively.


title: Hilbert Space Fragmentation and Subspace Scar Time-Crystallinity in Driven Homogeneous Central-Spin Models

abstract: We study the stroboscopic non-equilibrium quantum dynamics of periodically kicked Hamiltonians involving homogeneous central-spin interactions. The system exhibits a strong fragmentation of Hilbert space into four-dimensional Floquet-Krylov subspaces, which oscillate between two disjointed two-dimensional subspaces and thus break the discrete time-translation symmetry of the system. Our analytical and numerical analyses reveal that fully polarized states of the satellite spins exhibit fragmentations that are stable against perturbations and have high overlap with Floquet eigenstates of atypically low bipartite entanglement entropy (scar states). We present evidence of robust time-crystalline behavior in the form of a period doubling of the total magnetization of fully polarized satellite spin states that persists over long time scales. We compute non-equilibrium phase diagrams with respect to a magnetic field, coupling terms, and pulse error for various interaction types, including Heisenberg, Ising, XXZ, and XX. We also discuss possible experimental realizations of scar time crystals in color center, quantum dot, and rare-earth ion platforms.


title: Symmetry-aware Reinforcement Learning for Robotic Assembly under Partial Observability with a Soft Wrist

abstract: This study tackles the representative yet challenging contact-rich peg-in-hole task of robotic assembly, using a soft wrist that can operate more safely and tolerate lower-frequency control signals than a rigid one. Previous studies often use a fully observable formulation, requiring external setups or estimators for the peg-to-hole pose. In contrast, we use a partially observable formulation and deep reinforcement learning from demonstrations to learn a memory-based agent that acts purely on haptic and proprioceptive signals. Moreover, previous works do not incorporate potential domain symmetry and thus must search for solutions in a bigger space. Instead, we propose to leverage the symmetry for sample efficiency by augmenting the training data and constructing auxiliary losses to force the agent to adhere to the symmetry. Results in simulation with five different symmetric peg shapes show that our proposed agent can be comparable to or even outperform a state-based agent. In particular, the sample efficiency also allows us to learn directly on the real robot within 3 hours.


title: Infrared Small Target Detection via tensor $L_{2,1}$ norm minimization and ASSTV regularization: A Novel Tensor Recovery Approach

abstract: In recent years, there has been a noteworthy focus on infrared small target detection, given its vital importance in processing signals from infrared remote sensing. The considerable computational cost incurred by prior methods, relying excessively on nuclear norm for noise separation, necessitates the exploration of efficient alternatives. The aim of this research is to identify a swift and resilient tensor recovery method for the efficient extraction of infrared small targets from image sequences. Theoretical validation indicates that smaller singular values predominantly contribute to constructing noise information. In the exclusion process, tensor QR decomposition is employed to reasonably reduce the size of the target tensor. Subsequently, we address a tensor $L_{2,1}$ Norm Minimization via T-QR (TLNMTQR) based method to effectively isolate the noise, markedly improving computational speed without compromising accuracy. Concurrently, by integrating the asymmetric spatial-temporal total variation regularization method (ASSTV), our objective is to augment the flexibility and efficacy of our algorithm in handling time series data. Ultimately, our method underwent rigorous testing with real-world data, affirmatively showcasing the superiority of our algorithm in terms of speed, precision, and robustness.


title: The collisional energy loss of a heavy-quark in a semi-quark-gluon plasma

abstract: By utilizing a background field effective theory, we compute the collisional energy loss of a heavy-quark moving through a semi-quark-gluon plasma characterized by nontrivial holonomy for Polyakov loops. We consider the elastic scatterings between the incident heavy-quark and the thermal partons with both hard and soft momentum transfers. As compared to the energy loss obtained from the perturbation theory, the hard processes get modified through the thermal distribution functions that depend on the background field, while the proper treatment of the soft processes strongly relies on the use of the hard-thermal-loop resummed gluon propagator derived from the background field effective theory. Our results show that the heavy-quark energy loss is significantly suppressed in the semi-quark-gluon plasma due to a background field that is self-consistently generated in the effective theory. On the other hand, the suppression has a strong dependence on the temperature of the plasma which becomes negligible above $2\sim 3 $ times the critical temperature. For a realistic coupling constant, ignoring a relatively weak dependence on the heavy-quark velocity, the suppression on the collisional energy loss can be approximated by an overall factor determined solely by the background field. This simple conclusion is expected to be useful for phenomenological applications in the heavy flavor physics.


title: A Sentiment Consolidation Framework for Meta-Review Generation

abstract: Modern natural language generation systems with Large Language Models (LLMs) exhibit the capability to generate a plausible summary of multiple documents; however, it is uncertain if they truly possess the capability of information consolidation to generate summaries, especially on documents with opinionated information. We focus on meta-review generation, a form of sentiment summarisation for the scientific domain. To make scientific sentiment summarization more grounded, we hypothesize that human meta-reviewers follow a three-layer framework of sentiment consolidation to write meta-reviews. Based on the framework, we propose novel prompting methods for LLMs to generate meta-reviews and evaluation metrics to assess the quality of generated meta-reviews. Our framework is validated empirically as we find that prompting LLMs based on the framework -- compared with prompting them with simple instructions -- generates better meta-reviews.


title: Characterisation of birefringence inhomogeneity of KAGRA sapphire mirrors from transmitted wavefront error measurements

abstract: Cooling down test masses to cryogenic temperatures is a way to reduce the thermal noise of gravitational wave detectors. Crystalline materials are considered the most promising materials for fabricating cryogenic test masses and their coatings because of their excellent thermal and optical properties at low temperatures. However, birefringence owing to local impurities and inhomogeneities in the crystal can degrade the performance of the detector. The birefringence measurement or mapping over a two-dimensional area is thus important. This study describes a method for fast birefringence measurements of a large sample by simply combining a series of transmission wavefront error measurements using linearly polarised light with Fizeau interferometers. Using this method, the birefringence inhomogeneity information of KAGRA's two input test masses with a diameter of 22 cm was fully reconstructed. The birefringence information was then used to calculate the transverse beam shapes of the light fields in orthogonal polarisation directions when passing through the substrate. It was possible to find a calculated beam shape consistent with in-situ measurements using the KAGRA interferometer. This technique is crucial for birefringence characterisation of test masses in future detectors, where even larger sizes are used.


title: Mixer is more than just a model

abstract: Recently, MLP structures have regained popularity, with MLP-Mixer standing out as a prominent example. In the field of computer vision, MLP-Mixer is noted for its ability to extract data information from both channel and token perspectives, effectively acting as a fusion of channel and token information. Indeed, Mixer represents a paradigm for information extraction that amalgamates channel and token information. The essence of Mixer lies in its ability to blend information from diverse perspectives, epitomizing the true concept of "mixing" in the realm of neural network architectures. Beyond channel and token considerations, it is possible to create more tailored mixers from various perspectives to better suit specific task requirements. This study focuses on the domain of audio recognition, introducing a novel model named Audio Spectrogram Mixer with Roll-Time and Hermit FFT (ASM-RH) that incorporates insights from both time and frequency domains. Experimental results demonstrate that ASM-RH is particularly well-suited for audio data and yields promising outcomes across multiple classification tasks. The models and optimal weights files will be published.


title: Fast and Interpretable 2D Homography Decomposition: Similarity-Kernel-Similarity and Affine-Core-Affine Transformations

abstract: In this paper, we present two fast and interpretable decomposition methods for 2D homography, which are named Similarity-Kernel-Similarity (SKS) and Affine-Core-Affine (ACA) transformations respectively. Under the minimal $4$-point configuration, the first and the last similarity transformations in SKS are computed by two anchor points on target and source planes, respectively. Then, the other two point correspondences can be exploited to compute the middle kernel transformation with only four parameters. Furthermore, ACA uses three anchor points to compute the first and the last affine transformations, followed by computation of the middle core transformation utilizing the other one point correspondence. ACA can compute a homography up to a scale with only $85$ floating-point operations (FLOPs), without even any division operations. Therefore, as a plug-in module, ACA facilitates the traditional feature-based Random Sample Consensus (RANSAC) pipeline, as well as deep homography pipelines estimating $4$-point offsets. In addition to the advantages of geometric parameterization and computational efficiency, SKS and ACA can express each element of homography by a polynomial of input coordinates ($7$th degree to $9$th degree), extend the existing essential Similarity-Affine-Projective (SAP) decomposition and calculate 2D affine transformations in a unified way. Source codes are released in https://github.com/cscvlab/SKS-Homography.


title: Impact of Systematic Redshift Errors on the Cross-correlation of the Lyman-$\alpha$ Forest with Quasars at Small Scales Using DESI Early Data

abstract: The Dark Energy Spectroscopic Instrument (DESI) will measure millions of quasar spectra by the end of its 5 year survey. Quasar redshift errors impact the shape of the Lyman-$\alpha$ forest correlation functions, which can affect cosmological analyses and therefore cosmological interpretations. Using data from the DESI Early Data Release and the first two months of the main survey, we measure the systematic redshift error from an offset in the cross-correlation of the Lyman-$\alpha$ forest with quasars. We find evidence for a redshift dependent bias causing redshifts to be underestimated with increasing redshift, stemming from improper modeling of the Lyman-$\alpha$ optical depth in the templates used for redshift estimation. New templates were derived for the DESI Year 1 quasar sample at $z > 1.6$ and we found the redshift dependent bias, $\Delta r_\parallel$, increased from $-1.94 \pm 0.15$ $h^{-1}$ Mpc to $-0.08 \pm 0.04$ $h^{-1}$ Mpc ($-205 \pm 15~\text{km s}^{-1}$ to $-9.0 \pm 4.0~\text{km s}^{-1}$). These new templates will be used to provide redshifts for the DESI Year 1 quasar sample.


title: How to coadd images: II. Anti-aliasing and PSF deconvolution

abstract: We have developed a novel method for co-adding multiple under-sampled images that combines the iteratively reweighted least squares and divide-and-conquer algorithms. Our approach not only allows for the anti-aliasing of the images but also enables PSF deconvolution, resulting in enhanced restoration of extended sources, the highest PSNR, and reduced ringing artefacts. To test our method, we conducted numerical simulations that replicated observation runs of the CSST/VST telescope and compared our results to those obtained using previous algorithms. The simulation showed that our method outperforms previous approaches in several ways, such as restoring the profile of extended sources and minimizing ringing artefacts. Additionally, because our method relies on the inherent advantages of least squares fitting, it is more versatile and does not depend on the local uniformity hypothesis for the PSF. However, the new method consumes much more computation than the other approaches.


title: Representing 3D sparse map points and lines for camera relocalization

abstract: Recent advancements in visual localization and mapping have demonstrated considerable success in integrating point and line features. However, expanding the localization framework to include additional mapping components frequently results in increased demand for memory and computational resources dedicated to matching tasks. In this study, we show how a lightweight neural network can learn to represent both 3D point and line features, and exhibit leading pose accuracy by harnessing the power of multiple learned mappings. Specifically, we utilize a single transformer block to encode line features, effectively transforming them into distinctive point-like descriptors. Subsequently, we treat these point and line descriptor sets as distinct yet interconnected feature sets. Through the integration of self- and cross-attention within several graph layers, our method effectively refines each feature before regressing 3D maps using two simple MLPs. In comprehensive experiments, our indoor localization findings surpass those of Hloc and Limap across both point-based and line-assisted configurations. Moreover, in outdoor scenarios, our method secures a significant lead, marking the most considerable enhancement over state-of-the-art learning-based methodologies. The source code and demo videos of this work are publicly available at: https://thpjp.github.io/pl2map/


title: Diffusion Models as Constrained Samplers for Optimization with Unknown Constraints

abstract: Addressing real-world optimization problems becomes particularly challenging when analytic objective functions or constraints are unavailable. While numerous studies have addressed the issue of unknown objectives, limited research has focused on scenarios where feasibility constraints are not given explicitly. Overlooking these constraints can lead to spurious solutions that are unrealistic in practice. To deal with such unknown constraints, we propose to perform optimization within the data manifold using diffusion models. To constrain the optimization process to the data manifold, we reformulate the original optimization problem as a sampling problem from the product of the Boltzmann distribution defined by the objective function and the data distribution learned by the diffusion model. To enhance sampling efficiency, we propose a two-stage framework that begins with a guided diffusion process for warm-up, followed by a Langevin dynamics stage for further correction. Theoretical analysis shows that the initial stage results in a distribution focused on feasible solutions, thereby providing a better initialization for the later stage. Comprehensive experiments on a synthetic dataset, six real-world black-box optimization datasets, and a multi-objective optimization dataset show that our method achieves better or comparable performance with previous state-of-the-art baselines.


title: A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems

abstract: This survey provides a comprehensive review of research on multi-turn dialogue systems, with a particular focus on multi-turn dialogue systems based on large language models (LLMs). This paper aims to (a) give a summary of existing LLMs and approaches for adapting LLMs to downstream tasks; (b) elaborate recent advances in multi-turn dialogue systems, covering both LLM-based open-domain dialogue (ODD) and task-oriented dialogue (TOD) systems, along with datasets and evaluation metrics; (c) discuss some future emphasis and recent research problems arising from the development of LLMs and the increasing demands on multi-turn dialogue systems.


title: Set-valued Star-Shaped Risk Measures

abstract: In this paper, we introduce a new class of set-valued risk measures, named set-valued star-shaped risk measures. Motivated by the results of scalar monetary and star-shaped risk measures, this paper investigates the representation theorems in the set-valued framework. It is demonstrated that set-valued risk measures can be represented as the union of a family of set-valued convex risk measures, and set-valued normalized star-shaped risk measures can be represented as the union of a family of set-valued normalized convex risk measures. The link between set-valued risk measures and set-valued star-shaped risk measures is also established.


title: Obtaining properly Pareto optimal solutions of multiobjective optimization problems via the branch and bound method

abstract: In multiobjective optimization, most branch and bound algorithms provide the decision maker with the whole Pareto front, and then decision maker could select a single solution finally. However, if the number of objectives is large, the number of candidate solutions may be also large, and it may be difficult for the decision maker to select the most interesting solution. As we argue in this paper, the most interesting solutions are the ones whose trade-offs are bounded. These solutions are usually known as the properly Pareto optimal solutions. We propose a branch-and-bound-based algorithm to provide the decision maker with so-called $\epsilon$-properly Pareto optimal solutions. The discarding test of the algorithm adopts a dominance relation induced by a convex polyhedral cone instead of the common used Pareto dominance relation. In this way, the proposed algorithm excludes the subboxes which do not contain $\epsilon$-properly Pareto optimal solution from further exploration. We establish the global convergence results of the proposed algorithm. Finally, the algorithm is applied to benchmark problems as well as to two real-world optimization problems.


title: User Decision Guidance with Selective Explanation Presentation from Explainable-AI

abstract: This paper addresses the challenge of selecting explanations for XAI (Explainable AI)-based Intelligent Decision Support Systems (IDSSs). IDSSs have shown promise in improving user decisions through XAI-generated explanations along with AI predictions, and the development of XAI made it possible to generate a variety of such explanations. However, how IDSSs should select explanations to enhance user decision-making remains an open question. This paper proposes X-Selector, a method for selectively presenting XAI explanations. It enables IDSSs to strategically guide users to an AI-suggested decision by predicting the impact of different combinations of explanations on a user's decision and selecting the combination that is expected to minimize the discrepancy between an AI suggestion and a user decision. We compared the efficacy of X-Selector with two naive strategies (all possible explanations and explanations only for the most likely prediction) and two baselines (no explanation and no AI support). The results suggest the potential of X-Selector to guide users to AI-suggested decisions and improve task performance under the condition of a high AI accuracy.


title: Hy-DAT: A Tool to Address Hydropower Modeling Gaps Using Interdependency, Efficiency Curves, and Unit Dispatch Models

abstract: As the power system continues to be flooded with intermittent resources, it becomes more important to accurately assess the role of hydro and its impact on the power grid. While hydropower generation has been studied for decades, dependency of power generation on water availability and constraints in hydro operation are not well represented in power system models used in the planning and operation of large-scale interconnection studies. There are still multiple modeling gaps that need to be addressed; if not, they can lead to inaccurate operation and planning reliability studies, and consequently to unintentional load shedding or even blackouts. As a result, it is very important that hydropower is represented correctly in both steady-state and dynamic power system studies. In this paper, we discuss the development and use of the Hydrological Dispatch and Analysis Tool (Hy-DAT) as an interactive graphical user interface, that uses a novel methodology to address the hydropower modeling gaps like water availability and interdependency using a database and algorithms to generate accurate representative models for power system simulation.


title: Communication Efficient ConFederated Learning: An Event-Triggered SAGA Approach

abstract: Federated learning (FL) is a machine learning paradigm that targets model training without gathering the local data dispersed over various data sources. Standard FL, which employs a single server, can only support a limited number of users, leading to degraded learning capability. In this work, we consider a multi-server FL framework, referred to as \emph{Confederated Learning} (CFL), in order to accommodate a larger number of users. A CFL system is composed of multiple networked edge servers, with each server connected to an individual set of users. Decentralized collaboration among servers is leveraged to harness all users' data for model training. Due to the potentially massive number of users involved, it is crucial to reduce the communication overhead of the CFL system. We propose a stochastic gradient method for distributed learning in the CFL framework. The proposed method incorporates a conditionally-triggered user selection (CTUS) mechanism as the central component to effectively reduce communication overhead. Relying on a delicately designed triggering condition, the CTUS mechanism allows each server to select only a small number of users to upload their gradients, without significantly jeopardizing the convergence performance of the algorithm. Our theoretical analysis reveals that the proposed algorithm enjoys a linear convergence rate. Simulation results show that it achieves substantial improvement over state-of-the-art algorithms in terms of communication efficiency.


title: Multifunctional composite magnet for practical transverse thermoelectrics

abstract: Permanent magnets are used in various products and essential for human society. If omnipresent permanent magnets could directly convert heat into electricity, they would lead to innovative energy harvesting and thermal management technologies. However, achieving such "multifunctionality" has been difficult because of the poor thermoelectric performance of conventional magnets. Here, we develop a multifunctional composite magnet that enables giant transverse thermoelectric conversion. The proposed composite material, comprising alternately and obliquely stacked SmCo$_5$/Bi$_{0.2}$Sb$_{1.8}$Te$_3$ multilayers, exhibits large remanent magnetization and coercivity as well as an excellent figure of merit of 0.32 for transverse thermoelectric conversion around room temperature. While having versatile transverse geometry and high mechanical durability, the thermopile module based on these composite magnets generates 204 mW at a temperature difference of 152 K owing to extremely low interfacial electrical and thermal resistances. The corresponding power density per heat transfer area of 56.7 mW/cm$^2$ is not only record-high among all the transverse thermoelectric modules but also comparable to those of commercial longitudinal thermoelectric modules based on the Seebeck effect. The novel functional material enables the integration of thermoelectric conversion capabilities wherever permanent magnets are currently used.


title: Tighter Bounds for Local Differentially Private Core Decomposition and Densest Subgraph

abstract: Computing the core decomposition of a graph is a fundamental problem that has recently been studied in the differentially private setting, motivated by practical applications in data mining. In particular, Dhulipala et al. [FOCS 2022] gave the first mechanism for approximate core decomposition in the challenging and practically relevant setting of local differential privacy. One of the main open problems left by their work is whether the accuracy, i.e., the approximation ratio and additive error, of their mechanism can be improved. We show the first lower bounds on the additive error of approximate and exact core decomposition mechanisms in the centralized and local model of differential privacy, respectively. We also give mechanisms for exact and approximate core decomposition in the local model, with almost matching additive error bounds. Our mechanisms are based on a black-box application of continual counting. They also yield improved mechanisms for the approximate densest subgraph problem in the local model.


title: Online Time-Optimal Trajectory Generation for Two Quadrotors with Multi-Waypoints Constraints

abstract: The autonomous quadrotor's flying speed has kept increasing in the past 5 years, especially in the field of autonomous drone racing. However, the majority of the research mainly focuses on the aggressive flight of a single quadrotor. In this letter, we propose a novel method called Pairwise Model Predictive Control (PMPC) that can guide two quadrotors online to fly through the waypoints with minimum time without collisions. The flight task is first modeled as a nonlinear optimization problem and then an efficient two-step mass point velocity search method is used to provide initial values and references to improve the solving efficiency so that the method can run online with a frequency of 50 Hz and can handle dynamic waypoints. The simulation and real-world experiments validate the feasibility of the proposed method and in the real-world experiments, the two quadrotors can achieve a top speed of 8.1m/s in a 6-waypoint racing track in a compact flying arena of 6m*4m*2m.


title: Gravitational Repulsion in an Expanding Ball of Dust

abstract: In general relativity, there is a velocity dependent term in the gravitational acceleration of a test particle for an observer at infinity. Depending on the direction of motion and the speed, that term can be repulsive. We show that this is also the case in the Parametrized Post-Newtonian (PPN) formalism. We compute the magnitude of that repulsive term for an expanding sphere of dust observed at infinity, and find that it could mimic the effect of a cosmological constant. The time evolution of such an expanding ball of dust for an observer at infinity is calculated, and compared with the standard $\Lambda$CDM model. We find that the so-called coincidence problem does not exist for such a model as the energy density attributed to the expansion is always of the same order as the matter energy density.


title: Do Large Language Models Mirror Cognitive Language Processing?

abstract: Large Language Models (LLMs) have demonstrated remarkable abilities in text comprehension and logical reasoning, indicating that the text representations learned by LLMs can facilitate their language processing capabilities. In cognitive science, brain cognitive processing signals are typically utilized to study human language processing. Therefore, it is natural to ask how well the text embeddings from LLMs align with the brain cognitive processing signals, and how training strategies affect the LLM-brain alignment? In this paper, we employ Representational Similarity Analysis (RSA) to measure the alignment between 23 mainstream LLMs and fMRI signals of the brain to evaluate how effectively LLMs simulate cognitive language processing. We empirically investigate the impact of various factors (e.g., pre-training data size, model scaling, alignment training, and prompts) on such LLM-brain alignment. Experimental results indicate that pre-training data size and model scaling are positively correlated with LLM-brain similarity, and alignment training can significantly improve LLM-brain similarity. Explicit prompts contribute to the consistency of LLMs with brain cognitive language processing, while nonsensical noisy prompts may attenuate such alignment. Additionally, the performance of a wide range of LLM evaluations (e.g., MMLU, Chatbot Arena) is highly correlated with the LLM-brain similarity.


title: Synchronization of Complex Dynamical Networks via Event-Triggered Pinning Impulses

abstract: This article studies the synchronization problem of complex dynamical networks. The impulsive control method is considered with a novel event-triggered pinning algorithm. Sufficient conditions on the network topology are obtained to ensure network synchronization. It is shown that synchronization can be realized with a careful selection of the pinning nodes. Furthermore, an adaptive coupling strength is incorporated into the network to allow network synchronization with an arbitrary selection of the pinning nodes. An example of a network with node dynamics described by the Chen system is studied to demonstrate the theoretical results.


title: Hire a Linguist!: Learning Endangered Languages with In-Context Linguistic Descriptions

abstract: How can large language models (LLMs) process and translate endangered languages? Many languages lack a large corpus to train a decent LLM; therefore existing LLMs rarely perform well in unseen, endangered languages. On the contrary, we observe that 2000 endangered languages, though without a large corpus, have a grammar book or a dictionary. We propose LINGOLLM, a training-free approach to enable an LLM to process unseen languages that hardly occur in its pre-training. Our key insight is to demonstrate linguistic knowledge of an unseen language in an LLM's prompt, including a dictionary, a grammar book, and morphologically analyzed input text. We implement LINGOLLM on top of two models, GPT-4 and Mixtral, and evaluate their performance on 5 tasks across 8 endangered or low-resource languages. Our results show that LINGOLLM elevates translation capability from GPT-4's 0 to 10.5 BLEU for 10 language directions. Our findings demonstrate the tremendous value of linguistic knowledge in the age of LLMs for endangered languages. Our data, code, and model generations can be found at https://github.com/LLiLab/llm4endangeredlang.


title: Characterization of the Astrophysical Diffuse Neutrino Flux using Starting Track Events in IceCube

abstract: A measurement of the diffuse astrophysical neutrino spectrum is presented using IceCube data collected from 2011-2022 (10.3 years). We developed novel detection techniques to search for events with a contained vertex and exiting track induced by muon neutrinos undergoing a charged-current interaction. Searching for these starting track events allows us to not only more effectively reject atmospheric muons but also atmospheric neutrino backgrounds in the southern sky, opening a new window to the sub-100 TeV astrophysical neutrino sky. The event selection is constructed using a dynamic starting track veto and machine learning algorithms. We use this data to measure the astrophysical diffuse flux as a single power law flux (SPL) with a best-fit spectral index of $\gamma = 2.58 ^{+0.10}_{-0.09}$ and per-flavor normalization of $\phi^{\mathrm{Astro}}_{\mathrm{per-flavor}} = 1.68 ^{+0.19}_{-0.22} \times 10^{-18} \times \mathrm{GeV}^{-1} \mathrm{cm}^{-2} \mathrm{s}^{-1} \mathrm{sr}^{-1}$ (at 100 TeV). The sensitive energy range for this dataset is 3 - 550 TeV under the SPL assumption. This data was also used to measure the flux under a broken power law, however we did not find any evidence of a low energy cutoff.


title: Breaking the Black-Box: Confidence-Guided Model Inversion Attack for Distribution Shift

abstract: Model inversion attacks (MIAs) seek to infer the private training data of a target classifier by generating synthetic images that reflect the characteristics of the target class through querying the model. However, prior studies have relied on full access to the target model, which is not practical in real-world scenarios. Additionally, existing black-box MIAs assume that the image prior and target model follow the same distribution. However, when confronted with diverse data distribution settings, these methods may result in suboptimal performance in conducting attacks. To address these limitations, this paper proposes a \textbf{C}onfidence-\textbf{G}uided \textbf{M}odel \textbf{I}nversion attack method called CG-MI, which utilizes the latent space of a pre-trained publicly available generative adversarial network (GAN) as prior information and gradient-free optimizer, enabling high-resolution MIAs across different data distributions in a black-box setting. Our experiments demonstrate that our method significantly \textbf{outperforms the SOTA black-box MIA by more than 49\% for Celeba and 58\% for Facescrub in different distribution settings}. Furthermore, our method exhibits the ability to generate high-quality images \textbf{comparable to those produced by white-box attacks}. Our method provides a practical and effective solution for black-box model inversion attacks.


title: OpenMEDLab: An Open-source Platform for Multi-modality Foundation Models in Medicine

abstract: The emerging trend of advancing generalist artificial intelligence, such as GPTv4 and Gemini, has reshaped the landscape of research (academia and industry) in machine learning and many other research areas. However, domain-specific applications of such foundation models (e.g., in medicine) remain untouched or often at their very early stages. It will require an individual set of transfer learning and model adaptation techniques by further expanding and injecting these models with domain knowledge and data. The development of such technologies could be largely accelerated if the bundle of data, algorithms, and pre-trained foundation models were gathered together and open-sourced in an organized manner. In this work, we present OpenMEDLab, an open-source platform for multi-modality foundation models. It encapsulates not only solutions of pioneering attempts in prompting and fine-tuning large language and vision models for frontline clinical and bioinformatic applications but also building domain-specific foundation models with large-scale multi-modal medical data. Importantly, it opens access to a group of pre-trained foundation models for various medical image modalities, clinical text, protein engineering, etc. Inspiring and competitive results are also demonstrated for each collected approach and model in a variety of benchmarks for downstream tasks. We welcome researchers in the field of medical artificial intelligence to continuously contribute cutting-edge methods and models to OpenMEDLab, which can be accessed via https://github.com/openmedlab.


title: On Galois theory of cluster algebras: general and that from Riemann surfaces

abstract: One of the key points in Galois theory via field extensions is to build up a correspondence between subfields of a field and subgroups of its automorphism group, so as to study fields via methods of groups. As an analogue of the Galois theory, we want to discuss the relations between cluster subalgebras of a cluster algebra and subgroups of its automorphism group and then set up the Galois-like method. In the first part, we build up a Galois map from a skew-symmetrizable cluster algebra $\mathcal A$ to its cluster automorphism group, and introduce notions of Galois-like extensions and Galois extensions. A necessary condition for Galois extensions of a cluster algebra $\mathcal A$ is given, which is also a sufficient condition if $\mathcal A$ has a $\mathcal{D}$-stable basis or stable monomial basis with unique expression. Some properties for Galois-like extensions are discussed. It is shown that two subgroups $H_1$ and $H_2$ of the automorphism group $\text{Aut}\mathcal A$ are conjugate to each other if and only if there exists $ f \in \text{Aut}\mathcal{A} $ and two Galois-like extension subalgebras $\mathcal A(\Sigma_1)$, $\mathcal A(\Sigma_2)$ corresponding to $H_1$ and $H_2$ such that $f$ is an isomorphism between $\mathcal A(\Sigma_1)$ and $\mathcal A(\Sigma_2)$. In the second part, as the answers of two conjectures proposed in the first part, for a cluster algebra from a feasible surface, we prove that Galois-like extension subalgebras corresponding to a subgroup of a cluster automorphism group have the same rank. Moreover, it is shown that there are order-preserving reverse Galois maps for these cluster algebras. We also give examples of $\mathcal{D}$-stable bases and some discussions on the Galois inverse problem in this part.


title: Overcoming set imbalance in data driven parameterization: A case study of gravity wave momentum transport

abstract: Machine learning for the parameterization of subgrid-scale processes in climate models has been widely researched and adopted in a few models. A key challenge in developing data-driven parameterization schemes is how to properly represent rare, but important events that occur in geoscience datasets. We investigate and develop strategies to reduce errors caused by insufficient sampling in the rare data regime, under constraints of no new data and no further expansion of model complexity. Resampling and importance weighting strategies are constructed with user defined parameters that systematically vary the sampling/weighting rates in a linear fashion and curb too much oversampling. Applying this new method to a case study of gravity wave momentum transport reveals that the resampling strategy can successfully improve errors in the rare regime at little to no loss in accuracy overall in the dataset. The success of the strategy, however, depends on the complexity of the model. More complex models can overfit the tails of the distribution when using non-optimal parameters of the resampling strategy.


title: Corpus-Steered Query Expansion with Large Language Models

abstract: Recent studies demonstrate that query expansions generated by large language models (LLMs) can considerably enhance information retrieval systems by generating hypothetical documents that answer the queries as expansions. However, challenges arise from misalignments between the expansions and the retrieval corpus, resulting in issues like hallucinations and outdated information due to the limited intrinsic knowledge of LLMs. Inspired by Pseudo Relevance Feedback (PRF), we introduce Corpus-Steered Query Expansion (CSQE) to promote the incorporation of knowledge embedded within the corpus. CSQE utilizes the relevance assessing capability of LLMs to systematically identify pivotal sentences in the initially-retrieved documents. These corpus-originated texts are subsequently used to expand the query together with LLM-knowledge empowered expansions, improving the relevance prediction between the query and the target documents. Extensive experiments reveal that CSQE exhibits strong performance without necessitating any training, especially with queries for which LLMs lack knowledge.


title: Human Shape and Clothing Estimation

abstract: Human shape and clothing estimation has gained significant prominence in various domains, including online shopping, fashion retail, augmented reality (AR), virtual reality (VR), and gaming. The visual representation of human shape and clothing has become a focal point for computer vision researchers in recent years. This paper presents a comprehensive survey of the major works in the field, focusing on four key aspects: human shape estimation, fashion generation, landmark detection, and attribute recognition. For each of these tasks, the survey paper examines recent advancements, discusses their strengths and limitations, and qualitative differences in approaches and outcomes. By exploring the latest developments in human shape and clothing estimation, this survey aims to provide a comprehensive understanding of the field and inspire future research in this rapidly evolving domain.


title: Efficient Fault Detection Architectures for Modular Exponentiation Targeting Cryptographic Applications Benchmarked on FPGAs

abstract: Whether stemming from malicious intent or natural occurrences, faults and errors can significantly undermine the reliability of any architecture. In response to this challenge, fault detection assumes a pivotal role in ensuring the secure deployment of cryptosystems. Even when a cryptosystem boasts mathematical security, its practical implementation may remain susceptible to exploitation through side-channel attacks. In this paper, we propose a lightweight fault detection architecture tailored for modular exponentiation, a building block of numerous cryptographic applications spanning from classical cryptography to post quantum cryptography. Based on our simulation and implementation results on ARM Cortex-A72 processor, and AMD/Xilinx Zynq Ultrascale+, and Artix-7 FPGAs, our approach achieves an error detection rate close to 100%, all while introducing a modest computational overhead of approximately 7% and area overhead of less than 1% compared to the unprotected architecture. To the best of our knowledge, such an approach benchmarked on ARM processor and FPGA has not been proposed and assessed to date.


title: On the relation between pseudocharacters and Chenevier's determinants

abstract: Consider a commutative unital ring $A$ and a unital $A$-algebra $R$. Let $d$ be a positive integer. Chenevier proved that when $(2d)!$ is invertible in $A$, the map associating to a determinant its trace is a bijection between $A$-valued $d$-dimensional determinants of $R$ and $A$-valued $d$-dimensional pseudocharacters of $R$. In this paper, we show that assuming $d!$ is invertible in $A$ is sufficient. This assumption is already made in the definition of a $d$-dimensional pseudocharacter. Our proof involves establishing a product formula for pseudocharacters, which might be of independent interest.


title: A study of 10 Rotating Radio Transients using Parkes radio telescope

abstract: Rotating Radio Transients (RRATs) are a relatively new subclass of pulsars that emit detectable radio bursts sporadically. We conducted an analysis of 10 RRATs observed using the Parkes telescope, with 8 of these observed via the Ultra-Wideband Receiver. We measured the burst rate and produced integrated profiles spanning multiple frequency bands for 3 RRATs. We also conducted a spectral analysis on both integrated pulses and individual pulses of 3 RRATs. All of their integrated pulses follow a simple power law, consistent with the known range of pulsar spectral indices. Their average spectral indices of single pulses are -0.9, -1.2, and -1.0 respectively, which are within the known range of pulsar spectral indices. Additionally, we find that the spreads of single-pulse spectral indices for these RRATs (ranging from -3.5 to +0.5) are narrower compared to what has been observed in other RRATs (Shapiro-Albert et al. 2018; Xie et al. 2022). It is notable that the average spectral index and scatter of single pulses are both relatively small. For the remaining 5 RRATs observed at the UWL receiver, we also provided the upper limits on fluence and flux density. In addition, we obtained the timing solution of PSR J1709-43. Our analysis shows that PSRs J1919+1745, J1709-43 and J1649-4653 are potentially nulling pulsars or weak pulsars with sparse strong pulses.


title: Water-Vapor Absorption Database using Dual Comb Spectroscopy from 300-1300 K Part II: Air-Broadened H$_2$O, 6600 to 7650 cm$^{-1}$

abstract: We present broadband dual frequency comb laser absorption measurements of 2% H$_2$O (natural isotopic abundance of 99.7% H$_2^{16}$O) in air from 6600-7650 cm$^{-1}$ (1307-1515 nm) with a spectral point spacing of 0.0068 cm$^{-1}$. Twenty-nine datasets were collected at temperatures between 300 and 1300 K ($\pm$0.82% average uncertainty) and pressures ranging from 20 to 600 Torr ($\pm$0.25%) with an average residual absorbance noise of 8.0E-4 across the spectrum for all measurements. We fit measurements using a quadratic speed-dependent Voigt profile to determine 7088 absorption parameters for 3366 individual transitions found in HITRAN2020. These measurements build on the line strength, line center, self-broadening, and self-shift parameters determined in the Part I companion of this work. Here we measure air-broadened width (with temperature- and speed-dependence) and air pressure shift (with temperature dependence) parameters. Various trends are explored for extrapolation to weak transitions that were not covered in this work. Improvements made in this work are predominantly due to the inclusion of air pressure shift temperature dependence values. In aggregate, these updates improved RMS absorbance error by a factor of 4.2 on average, and the remaining residual is predominantly spectral noise. This updated database improves high temperature spectroscopic knowledge across the 6600 7650 cm$^{-1}$ region of H$_2$O absorption.


title: Unveiling NPT bound problem: From Distillability Sets to Inequalities and Multivariable Insights

abstract: Equivalence between Positive Partial Transpose (PPT) entanglement and bound entanglement is a long-standing open problem in quantum information theory. So far limited progress has been made, even on the seemingly simple case of Werner states bound entanglement. The primary challenge is to give a concise mathematical representation of undistillability. To this end, we propose a decomposition of the N-undistillability verification into $log(N)$ repeated steps of 1-undistillability verification. For Werner state N-undistillability verification, a bound for N-undistillability is given, which is independent of the dimensionality of Werner states. Equivalent forms of inequalities for both rank one and two matrices are presented, before transforming the two-undistillability case into a matrix analysis problem. A new perspective is also attempted by seeing it as a non-convex multi-variable function, proving its critical points and conjecturing Hessian positivity, which would make them local minimums.


title: Infrared fixed point in the massless twelve-flavor SU(3) gauge-fermion system

abstract: We present strong numerical evidence for the existence of an infrared fixed point in the renormalization group flow of the SU(3) gauge-fermion system with twelve massless fermions in the fundamental representation. Our numerical simulations using nHYP-smeared staggered fermions with Pauli-Villars improvement do not exhibit any first-order bulk phase transition in the investigated parameter region. We utilize an infinite volume renormalization scheme based on the gradient flow transformation to determine the renormalization group $\beta$ function. We identify an infrared fixed point at $g^2_{\mathrm{GF}\star}=6.60(62)$ in the GF scheme and calculate the leading irrelevant critical exponent $\gamma_{g}^{\star}=0.199(32)$. Our prediction for $\gamma_{g}^{\star}$ is consistent with available literature at the $1\mbox{-}2\sigma$ level.


title: ResLoRA: Identity Residual Mapping in Low-Rank Adaption

abstract: As one of the most popular parameter-efficient fine-tuning (PEFT) methods, low-rank adaptation (LoRA) is commonly applied to fine-tune large language models (LLMs). However, updating the weights of LoRA blocks effectively and expeditiously is challenging due to the long calculation path in the original model. To address this, we propose ResLoRA, an improved framework of LoRA. By adding residual paths during training and using merging approaches to eliminate these extra paths during inference, our method can achieve better results in fewer training steps without any extra trainable parameters or inference cost compared to LoRA. The experiments on NLG, NLU, and text-to-image tasks demonstrate the effectiveness of our method. To the best of our knowledge, ResLoRA is the first work that combines the residual path with LoRA. The code of our method is available at https://github.com/microsoft/LMOps/tree/main/reslora .


title: Automated Discovery of Integral with Deep Learning

abstract: Recent advancements in the realm of deep learning, particularly in the development of large language models (LLMs), have demonstrated AI's ability to tackle complex mathematical problems or solving programming challenges. However, the capability to solve well-defined problems based on extensive training data differs significantly from the nuanced process of making scientific discoveries. Trained on almost all human knowledge available, today's sophisticated LLMs basically learn to predict sequences of tokens. They generate mathematical derivations and write code in a similar way as writing an essay, and do not have the ability to pioneer scientific discoveries in the manner a human scientist would do. In this study we delve into the potential of using deep learning to rediscover a fundamental mathematical concept: integrals. By defining integrals as area under the curve, we illustrate how AI can deduce the integral of a given function, exemplified by inferring $\int_{0}^{x} t^2 dt = \frac{x^3}{3}$ and $\int_{0}^{x} ae^{bt} dt = \frac{a}{b} e^{bx} - \frac{a}{b}$. Our experiments show that deep learning models can approach the task of inferring integrals either through a sequence-to-sequence model, akin to language translation, or by uncovering the rudimentary principles of integration, such as $\int_{0}^{x} t^n dt = \frac{x^{n+1}}{n+1}$.


title: Datasets for Large Language Models: A Comprehensive Survey

abstract: This paper embarks on an exploration into the Large Language Model (LLM) datasets, which play a crucial role in the remarkable advancements of LLMs. The datasets serve as the foundational infrastructure analogous to a root system that sustains and nurtures the development of LLMs. Consequently, examination of these datasets emerges as a critical topic in research. In order to address the current lack of a comprehensive overview and thorough analysis of LLM datasets, and to gain insights into their current status and future trends, this survey consolidates and categorizes the fundamental aspects of LLM datasets from five perspectives: (1) Pre-training Corpora; (2) Instruction Fine-tuning Datasets; (3) Preference Datasets; (4) Evaluation Datasets; (5) Traditional Natural Language Processing (NLP) Datasets. The survey sheds light on the prevailing challenges and points out potential avenues for future investigation. Additionally, a comprehensive review of the existing available dataset resources is also provided, including statistics from 444 datasets, covering 8 language categories and spanning 32 domains. Information from 20 dimensions is incorporated into the dataset statistics. The total data size surveyed surpasses 774.5 TB for pre-training corpora and 700M instances for other datasets. We aim to present the entire landscape of LLM text datasets, serving as a comprehensive reference for researchers in this field and contributing to future studies. Related resources are available at: https://github.com/lmmlzn/Awesome-LLMs-Datasets.


title: Gersten-type conjecture for henselian local rings of normal crossing varieties

abstract: Let $n\geq 0$ be an integer. For a normal crossing variety $Y$ over the spectrum of a field $k$ of positive characteristic $p>0$, K.Sato defined an \'{e}tale logarithmic Hodge-Witt sheaf $\lambda^{n}_{Y, r}$ on the \'{e}tale site $Y_{\mathrm{\acute{e}t}}$ which agrees with $W_{r}\Omega^{n}_{Y, \log}$ in the case where $Y$ is smooth over $\operatorname{Spec}(k)$. In this paper, we prove the Gersten-type conjecture for $\lambda^{n}_{r}$ over the henselization of the local ring $\mathcal{O}_{Y, y}$ of $Y$ at a point $y\in Y$. As an application, we prove the relative version of the Gersten-type conjecture for the $p$-adic \'{e}tale Tate twist $\mathfrak{T}_{1}(n)$ over the henselization of the local ring $\mathcal{O}_{\mathfrak{X}, x}$ of a semistable family $\mathfrak{X}$ over the spectrum of a discrete valuation ring $B$ of mixed characteristic $(0, p)$ at a point $x\in \mathfrak{X}$ in the case where $B$ contains $p$-th roots of unity. Moreover, we prove a generalization of Artin's theorem about the Brauer groups.


title: Crisis talk: analysis of the public debate around the energy crisis and cost of living

abstract: A prominent media topic in the UK in the early 2020s is the energy crisis affecting the UK and most of Europe. It brings into a single public debate issues of energy dependency and sustainability, fair distribution of economic burdens and cost of living, as well as climate change, risk, and sustainability. In this paper, we investigate the public discourse around the energy crisis and cost of living to identify how these pivotal and contradictory issues are reconciled in this debate and to identify which social actors are involved and the role they play. We analyse a document corpus retrieved from UK newspapers from January 2014 to March 2023. We apply a variety of natural language processing and data visualisation techniques to identify key topics, novel trends, critical social actors, and the role they play in the debate, along with the sentiment associated with those actors and topics. We combine automated techniques with manual discourse analysis to explore and validate the insights revealed in this study. The findings verify the utility of these techniques by providing a flexible and scalable pipeline for discourse analysis and providing critical insights for cost of living - energy crisis nexus research.


title: SFTformer: A Spatial-Frequency-Temporal Correlation-Decoupling Transformer for Radar Echo Extrapolation

abstract: Extrapolating future weather radar echoes from past observations is a complex task vital for precipitation nowcasting. The spatial morphology and temporal evolution of radar echoes exhibit a certain degree of correlation, yet they also possess independent characteristics. {Existing methods learn unified spatial and temporal representations in a highly coupled feature space, emphasizing the correlation between spatial and temporal features but neglecting the explicit modeling of their independent characteristics, which may result in mutual interference between them.} To effectively model the spatiotemporal dynamics of radar echoes, we propose a Spatial-Frequency-Temporal correlation-decoupling Transformer (SFTformer). The model leverages stacked multiple SFT-Blocks to not only mine the correlation of the spatiotemporal dynamics of echo cells but also avoid the mutual interference between the temporal modeling and the spatial morphology refinement by decoupling them. Furthermore, inspired by the practice that weather forecast experts effectively review historical echo evolution to make accurate predictions, SFTfomer incorporates a joint training paradigm for historical echo sequence reconstruction and future echo sequence prediction. Experimental results on the HKO-7 dataset and ChinaNorth-2021 dataset demonstrate the superior performance of SFTfomer in short(1h), mid(2h), and long-term(3h) precipitation nowcasting.


title: Multi-FAct: Assessing Multilingual LLMs' Multi-Regional Knowledge using FActScore

abstract: Large Language Models (LLMs) are prone to factuality hallucination, generating text that contradicts established knowledge. While extensive research has addressed this in English, little is known about multilingual LLMs. This paper systematically evaluates multilingual LLMs' factual accuracy across languages and geographic regions. We introduce a novel pipeline for multilingual factuality evaluation, adapting FActScore(Min et al., 2023) for diverse languages. Our analysis across nine languages reveals that English consistently outperforms others in factual accuracy and quantity of generated facts. Furthermore, multilingual models demonstrate a bias towards factual information from Western continents. These findings highlight the need for improved multilingual factuality assessment and underscore geographical biases in LLMs' fact generation.


title: Data augmentation method for modeling health records with applications to clopidogrel treatment failure detection

abstract: We present a novel data augmentation method to address the challenge of data scarcity in modeling longitudinal patterns in Electronic Health Records (EHR) of patients using natural language processing (NLP) algorithms. The proposed method generates augmented data by rearranging the orders of medical records within a visit where the order of elements are not obvious, if any. Applying the proposed method to the clopidogrel treatment failure detection task enabled up to 5.3% absolute improvement in terms of ROC-AUC (from 0.908 without augmentation to 0.961 with augmentation) when it was used during the pre-training procedure. It was also shown that the augmentation helped to improve performance during fine-tuning procedures, especially when the amount of labeled training data is limited.


title: Prosocial and Financial Incentives for Biodiversity Conservation: A Field Experiment Using a Smartphone App

abstract: Ascertaining the number, type, and location of plant, insect, and animal species is essential for biodiversity conservation. However, comprehensively monitoring the situation only through public fixed-point surveys is challenging, and therefore information voluntarily provided by citizens assists in ascertaining the species distribution. To effectively encourage the citizens' data sharing behavior, this study proposed a prosocial incentive scheme in which, if they provide species information, donations are made to activities for saving endangered species. We conducted a field experiment with users (N=830) of a widely-used Japanese smartphone app to which they post species photos and measured the incentive's effect on their posting behavior. In addition, we measured the effect of a financial incentive scheme that provides monetary rewards for posting species photos and compared the two incentives' effects. The analyses revealed that while the prosocial incentive did not increase the number of posts on average, it did change the contents of posts, increasing the proportion of posts on rare species. On the contrary, the financial incentive statistically significantly increased the number of posts, in particular, on less rare and invasive species. Our findings suggest that the prosocial and financial incentives could stimulate different motivations and encourage different posting behaviors.


title: Characterizing Truthfulness in Large Language Model Generations with Local Intrinsic Dimension

abstract: We study how to characterize and predict the truthfulness of texts generated from large language models (LLMs), which serves as a crucial step in building trust between humans and LLMs. Although several approaches based on entropy or verbalized uncertainty have been proposed to calibrate model predictions, these methods are often intractable, sensitive to hyperparameters, and less reliable when applied in generative tasks with LLMs. In this paper, we suggest investigating internal activations and quantifying LLM's truthfulness using the local intrinsic dimension (LID) of model activations. Through experiments on four question answering (QA) datasets, we demonstrate the effectiveness ohttps://info.arxiv.org/help/prep#abstractsf our proposed method. Additionally, we study intrinsic dimensions in LLMs and their relations with model layers, autoregressive language modeling, and the training of LLMs, revealing that intrinsic dimensions can be a powerful approach to understanding LLMs.


title: Performance modeling of public permissionless blockchains: A survey

abstract: Public permissionless blockchains facilitate peer-to-peer digital transactions, yet face performance challenges specifically minimizing transaction confirmation time to decrease energy and time consumption per transaction. Performance evaluation and prediction are crucial in achieving this objective, with performance modeling as a key solution despite the complexities involved in assessing these blockchains. This survey examines prior research concerning the performance modeling blockchain systems, specifically focusing on public permissionless blockchains. Initially, it provides foundational knowledge about these blockchains and the crucial performance parameters for their assessment. Additionally, the study delves into research on the performance modeling of public permissionless blockchains, predominantly considering these systems as bulk service queues. It also examines prior studies on workload and traffic modeling, characterization, and analysis within these blockchain networks. By analyzing existing research, our survey aims to provide insights and recommendations for researchers keen on enhancing the performance of public permissionless blockchains or devising novel mechanisms in this domain.


title: MEGAnno+: A Human-LLM Collaborative Annotation System

abstract: Large language models (LLMs) can label data faster and cheaper than humans for various NLP tasks. Despite their prowess, LLMs may fall short in understanding of complex, sociocultural, or domain-specific context, potentially leading to incorrect annotations. Therefore, we advocate a collaborative approach where humans and LLMs work together to produce reliable and high-quality labels. We present MEGAnno+, a human-LLM collaborative annotation system that offers effective LLM agent and annotation management, convenient and robust LLM annotation, and exploratory verification of LLM labels by humans.


title: Impact of etches on thin-film single-crystal niobium resonators

abstract: A single crystal niobium thin film was grown using molecular beam epitaxy on a c-plane sapphire wafer. Several samples were fabricated into dc resistivity test devices and coplanar waveguide resonator chips using the same microfabrication procedures and solvent cleans. The samples were then subject to different acid cleaning treatments using different combinations of piranha, hydrofluoric acid, and buffered oxide etch solutions. The different samples expressed changes in dc resistivity in the normal and superconducting states such that the low temperature resistivities changed by more than 100\%, and the residual resistivity ratio dropped by a factor of 2. The internal quality factor of coplanar waveguide resonators measured near 5~GHz also showed significant variation at single photon powers ranging from 1.4$\times 10^6$ to less than 60$\times 10^3$. These changes correlate with the formation of surface crystallites that appear to be hydrocarbons. All observations are consistent with hydrogen diffusing into the niobium film at levels below the saturation threshold that is needed to observe niobium hydrides.


title: Galaxy clustering at cosmic dawn from JWST/NIRCam observations to redshift z$\sim$11

abstract: We report measurements of the galaxy two-point correlation function at cosmic dawn, using photometrically-selected sources from the JWST Advanced Deep Extragalactic Survey (JADES). The JWST/NIRCam dataset comprises approximately $N_g \simeq 7000$ photometrically-selected Lyman Break Galaxies (LBGs), spanning from $z=5.5$ up to $z=10.6$. The primary objective of this study is to extend clustering measurements beyond redshift $z>10$, finding a galaxy bias $b=9.6\pm1.7$ for the sample at $\overline{z} = 10.6$. The result suggests that the observed sources are hosted by dark matter halos of approximately $M_{h}\sim 10^{10.5}~\mathrm{M_{\odot}}$, in broad agreement with theoretical and numerical modelling of early galaxy formation during the epoch of reionization. Furthermore, the JWST JADES dataset enables an unprecedented investigation of clustering of dwarf galaxies two orders of magnitude fainter than the characteristic $L_*$ luminosity (i.e. with $M_{F200W}\simeq-14.5$) during the late stages of the epoch of reionization at $z\sim 6$. By measuring clustering versus luminosity, we observe that $b(M_{F200W})$ initially decreases with $M_{F200W}$ as theoretically expected, but a turning point of the relationship is seen at $M_{F200W} \sim -16$. We interpret the rise of clustering of the faintest dwarf as evidence of multiple halo occupation (i.e. as a one-halo term in bias modelling). These initial results demonstrate the potential for further quantitative characterisation of the interplay between assembly of dark matter and light during cosmic dawn that the growing samples of JWST observations are enabling.


title: Note on vertex disjoint rainbow triangles in edge-colored graphs

abstract: Given an edge-colored graph $G$, we denote the number of colors as $c(G)$, and the number of edges as $e(G)$. An edge-colored graph is rainbow if no two edges share the same color. A proper $mK_3$ is a vertex disjoint union of $m$ rainbow triangles. Rainbow problems have been studied extensively in the context of anti-Ramsey theory, and more recently, in the context of Tur\'{a}n problems. B. Li. et al. \textit{European J. Combin. 36 (2014)} found that a graph must contain a rainbow triangle if $e(G)+c(G) \geq \binom{n}{2}+ n$. L. Li. and X. Li. \textit{Discrete Applied Mathematics 318 (2022)} conjectured a lower bound on $e(G)+c(G)$ such that $G$ must contain a proper $mK_3$. In this paper, we provide a construction that disproves the conjecture. We also introduce a result that guarantees the existence of $m$ vertex disjoint rainbow $K_k$ subgraphs in general host graphs, and a sharp result on the existence of proper $mK_3$ in complete graphs.


title: Contextualizing Generated Citation Texts

abstract: Abstractive citation text generation is usually framed as an infilling task, where a sequence-to-sequence model is trained to generate a citation given a reference paper and the context window around the target; the generated citation should be a brief discussion of the reference paper as it relates to the citing context. However, examining a recent LED-based citation generation system, we find that many of the generated citations are generic summaries of the reference papers main contribution, ignoring the citation contexts focus on a different topic. To address this problem, we propose a simple modification to the citation text generation task: the generation target is not only the citation itself, but the entire context window, including the target citation. This approach can be easily applied to any abstractive citation generation system, and our experimental results show that training in this way is preferred by human readers and allows the generation model to make use of contextual clues about what topic to discuss and what stance to take.


title: Varieties with pseudoeffective canonical divisor and their Kodaira dimension

abstract: Let X be a smooth, projective variety over the field of complex numbers. Here we focus on a conjecture attributed to Shigefumi Mori, which claims that X is uniruled if and only if the Kodaira dimension of X is negative.


title: Improvement Of Audiovisual Quality Estimation Using A Nonlinear Autoregressive Exogenous Neural Network And Bitstream Parameters

abstract: With the increasing demand for audiovisual services, telecom service providers and application developers are compelled to ensure that their services provide the best possible user experience. Particularly, services such as videoconferencing are very sensitive to network conditions. Therefore, their performance should be monitored in real time in order to adjust parameters to any network perturbation. In this paper, we developed a parametric model for estimating the perceived audiovisual quality in videoconference services. Our model is developed with the nonlinear autoregressive exogenous (NARX) recurrent neural network and estimates the perceived quality in terms of mean opinion score (MOS). We validate our model using the publicly available INRS bitstream audiovisual quality dataset. This dataset contains bitstream parameters such as loss per frame, bit rate and video duration. We compare the proposed model against state-of-the-art methods based on machine learning and show our model to outperform these methods in terms of mean square error (MSE=0.150) and Pearson correlation coefficient (R=0.931)


title: A scalable cavity-based spin-photon interface in a photonic integrated circuit

abstract: A central challenge in quantum networking is transferring quantum states between different physical modalities, such as between flying photonic qubits and stationary quantum memories. One implementation entails using spin-photon interfaces that combine solid-state spin qubits, such as color centers in diamond, with photonic nanostructures. However, while high-fidelity spin-photon interactions have been demonstrated on isolated devices, building practical quantum repeaters requires scaling to large numbers of interfaces yet to be realized. Here, we demonstrate integration of nanophotonic cavities containing tin-vacancy (SnV) centers in a photonic integrated circuit (PIC). Out of a six-channel quantum micro-chiplet (QMC), we find four coupled SnV-cavity devices with an average Purcell factor of ~7. Based on system analyses and numerical simulations, we find with near-term improvements this multiplexed architecture can enable high-fidelity quantum state transfer, paving the way towards building large-scale quantum repeaters.


title: The classification of the stable factor-representations of the infinite hyperoctahedral group

abstract: The full description of the stable factor-representations of the infinite hyperoctahedral group up to quasi-equivalence obtained.


title: Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Models

abstract: Large language models generate high-quality responses with potential misinformation, underscoring the need for regulation by distinguishing AI-generated and human-written texts. Watermarking is pivotal in this context, which involves embedding hidden markers in texts during the LLM inference phase, which is imperceptible to humans. Achieving both the detectability of inserted watermarks and the semantic quality of generated texts is challenging. While current watermarking algorithms have made promising progress in this direction, there remains significant scope for improvement. To address these challenges, we introduce a novel multi-objective optimization (MOO) approach for watermarking that utilizes lightweight networks to generate token-specific watermarking logits and splitting ratios. By leveraging MOO to optimize for both detection and semantic objective functions, our method simultaneously achieves detectability and semantic integrity. Experimental results show that our method outperforms current watermarking techniques in enhancing the detectability of texts generated by LLMs while maintaining their semantic coherence. Our code is available at https://github.com/mignonjia/TS_watermark.


title: Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions

abstract: LLMs have demonstrated impressive performance in answering medical questions, such as achieving passing scores on medical licensing examinations. However, medical board exam or general clinical questions do not capture the complexity of realistic clinical cases. Moreover, the lack of reference explanations means we cannot easily evaluate the reasoning of model decisions, a crucial component of supporting doctors in making complex medical decisions. To address these challenges, we construct two new datasets: JAMA Clinical Challenge and Medbullets. JAMA Clinical Challenge consists of questions based on challenging clinical cases, while Medbullets comprises simulated clinical questions. Both datasets are structured as multiple-choice question-answering tasks, accompanied by expert-written explanations. We evaluate seven LLMs on the two datasets using various prompts. Experiments demonstrate that our datasets are harder than previous benchmarks. Human and automatic evaluations of model-generated explanations provide insights into the promise and deficiency of LLMs for explainable medical QA.


title: On the use of Silver Standard Data for Zero-shot Classification Tasks in Information Extraction

abstract: The superior performance of supervised classification methods in the information extraction (IE) area heavily relies on a large amount of gold standard data. Recent zero-shot classification methods converted the task to other NLP tasks (e.g., textual entailment) and used off-the-shelf models of these NLP tasks to directly perform inference on the test data without using a large amount of IE annotation data. A potentially valuable by-product of these methods is the large-scale silver standard data, i.e., pseudo-labeled data by the off-the-shelf models of other NLP tasks. However, there is no further investigation into the use of these data. In this paper, we propose a new framework, Clean-LaVe, which aims to utilize silver standard data to enhance the zero-shot performance. Clean-LaVe includes four phases: (1) Obtaining silver data; (2) Identifying relatively clean data from silver data; (3) Finetuning the off-the-shelf model using clean data; (4) Inference on the test data. The experimental results show that Clean-LaVe can outperform the baseline by 5% and 6% on TACRED and Wiki80 dataset in the zero-shot relation classification task, and by 3%-7% on Smile (Korean and Polish) in the zero-shot cross-lingual relation classification task, and by 8% on ACE05-E+ in the zero-shot event argument classification task. The code is share in https://github.com/wjw136/Clean_LaVe.git.


title: Generative AI for Unmanned Vehicle Swarms: Challenges, Applications and Opportunities

abstract: With recent advances in artificial intelligence (AI) and robotics, unmanned vehicle swarms have received great attention from both academia and industry due to their potential to provide services that are difficult and dangerous to perform by humans. However, learning and coordinating movements and actions for a large number of unmanned vehicles in complex and dynamic environments introduce significant challenges to conventional AI methods. Generative AI (GAI), with its capabilities in complex data feature extraction, transformation, and enhancement, offers great potential in solving these challenges of unmanned vehicle swarms. For that, this paper aims to provide a comprehensive survey on applications, challenges, and opportunities of GAI in unmanned vehicle swarms. Specifically, we first present an overview of unmanned vehicles and unmanned vehicle swarms as well as their use cases and existing issues. Then, an in-depth background of various GAI techniques together with their capabilities in enhancing unmanned vehicle swarms are provided. After that, we present a comprehensive review on the applications and challenges of GAI in unmanned vehicle swarms with various insights and discussions. Finally, we highlight open issues of GAI in unmanned vehicle swarms and discuss potential research directions.


title: Invariants of structures

abstract: We give a categorification of the notion of a mathematical structure originally given by Bourbaki in their set theory textbook. We show that any isomorphism-invariant property of a finite structure can be computed by counting the number of isomorphic copies of small substructures it contains. Our main theorem in this direction is a generalization of the classical result of Hilbert about elementary symmetric polynomials generating the algebra of all symmetric polynomials. We also show that, for structures built from sets, the Yoneda functor extends to a canonical embedding of any such category of structures into an associated category of structures in the sense of classical model theory.


title: Automated Testing of Spatially-Dependent Environmental Hypotheses through Active Transfer Learning

abstract: The efficient collection of samples is an important factor in outdoor information gathering applications on account of high sampling costs such as time, energy, and potential destruction to the environment. Utilization of available a-priori data can be a powerful tool for increasing efficiency. However, the relationships of this data with the quantity of interest are often not known ahead of time, limiting the ability to leverage this knowledge for improved planning efficiency. To this end, this work combines transfer learning and active learning through a Multi-Task Gaussian Process and an information-based objective function. Through this combination it can explore the space of hypothetical inter-quantity relationships and evaluate these hypotheses in real-time, allowing this new knowledge to be immediately exploited for future plans. The performance of the proposed method is evaluated against synthetic data and is shown to evaluate multiple hypotheses correctly. Its effectiveness is also demonstrated on real datasets. The technique is able to identify and leverage hypotheses which show a medium or strong correlation to reduce prediction error by a factor of 1.4--3.4 within the first 7 samples, and poor hypotheses are quickly identified and rejected eventually having no adverse effect.


title: A Probabilistic Motion Model for Skid-Steer Wheeled Mobile Robot Navigation on Off-Road Terrains

abstract: Skid-Steer Wheeled Mobile Robots (SSWMRs) are increasingly being used for off-road autonomy applications. When turning at high speeds, these robots tend to undergo significant skidding and slipping. In this work, using Gaussian Process Regression (GPR) and Sigma-Point Transforms, we estimate the non-linear effects of tire-terrain interaction on robot velocities in a probabilistic fashion. Using the mean estimates from GPR, we propose a data-driven dynamic motion model that is more accurate at predicting future robot poses than conventional kinematic motion models. By efficiently solving a convex optimization problem based on the history of past robot motion, the GPR augmented motion model generalizes to previously unseen terrain conditions. The output distribution from the proposed motion model can be used for local motion planning approaches, such as stochastic model predictive control, leveraging model uncertainty to make safe decisions. We validate our work on a benchmark real-world multi-terrain SSWMR dataset. Our results show that the model generalizes to three different terrains while significantly reducing errors in linear and angular motion predictions. As shown in the attached video, we perform a separate set of experiments on a physical robot to demonstrate the robustness of the proposed algorithm.


title: Six-Point Method for Multi-Camera Systems with Reduced Solution Space

abstract: Relative pose estimation using point correspondences (PC) is a widely used technique. A minimal configuration of six PCs is required for generalized cameras. In this paper, we present several minimal solvers that use six PCs to compute the 6DOF relative pose of a multi-camera system, including a minimal solver for the generalized camera and two minimal solvers for the practical configuration of two-camera rigs. The equation construction is based on the decoupling of rotation and translation. Rotation is represented by Cayley or quaternion parametrization, and translation can be eliminated by using the hidden variable technique. Ray bundle constraints are found and proven when a subset of PCs relate the same cameras across two views. This is the key to reducing the number of solutions and generating numerically stable solvers. Moreover, all configurations of six-point problems for multi-camera systems are enumerated. Extensive experiments demonstrate that our solvers are more accurate than the state-of-the-art six-point methods, while achieving better performance in efficiency.


title: A gradient flow method for smooth splines versus least-squares fitting on Riemannian manifolds

abstract: This article presents a novel resolution to the problem of spline interpolation versus least-squares fitting on smooth Riemannian manifolds utilizing the method of gradient flows of networks. This approach represents a contribution to both geometric control theory and statistical shape data analysis. Our work encompasses a rigorous proof for the existence of global solutions in H\"{o}lder spaces for the gradient flow. The asymptotic limits of these solutions establish the existence of the spline interpolation versus least-squares fitting problem on smooth Riemannian manifolds, offering a comprehensive solution. Notably, the constructive nature of the proof suggests potential numerical schemes for finding solutions.


title: SynArtifact: Classifying and Alleviating Artifacts in Synthetic Images via Vision-Language Model

abstract: In the rapidly evolving area of image synthesis, a serious challenge is the presence of complex artifacts that compromise perceptual realism of synthetic images. To alleviate artifacts and improve quality of synthetic images, we fine-tune Vision-Language Model (VLM) as artifact classifier to automatically identify and classify a wide range of artifacts and provide supervision for further optimizing generative models. Specifically, we develop a comprehensive artifact taxonomy and construct a dataset of synthetic images with artifact annotations for fine-tuning VLM, named SynArtifact-1K. The fine-tuned VLM exhibits superior ability of identifying artifacts and outperforms the baseline by 25.66%. To our knowledge, this is the first time such end-to-end artifact classification task and solution have been proposed. Finally, we leverage the output of VLM as feedback to refine the generative model for alleviating artifacts. Visualization results and user study demonstrate that the quality of images synthesized by the refined diffusion model has been obviously improved.