title: Regge trajectories for the light diquarks

abstract: We attempt to present an unified description of the light meson spectra and the light diquark spectra by applying the Regge trajectory approach. However, we find that the direct application of the linear Regge trajectory formula for the light mesons and baryons fails. To address this issue, we fit the experimental data of light meson spectra and the light diquark spectra obtained by other theoretical approaches. By considering the light quark mass and the parameter $C$ in the Cornell potential, we provide a provisional Regge trajectory formula. We also crudely estimate the masses of the light diquarks $(ud)$, $(us)$, and $(ss)$, and find that they agree with other theoretical results. The diquark Regge trajectory not only becomes a new and very simple approach for estimating the spectra of the light diquarks, but also can explicitly show the behavior of the masses with respect to $l$ or $n_r$. Moreover, it is expected that the diquark Regge trajectory can provide a simple method for investigating the $\rho$-mode excitations of baryons, tetraquarks and pentaquarks containing diquarks.


title: Real-Time Measurements of Photonic Microchips with Femtometer-Scale Spectral Precision and Ultra-High Sensitivity

abstract: Photonic integrated circuits (PICs) are enabling major breakthroughs in a number of areas, including quantum computing, neuromorphic processors, wearable devices, and more. Nevertheless, existing PIC measurement methods lack the spectral precision, speed, and sensitivity required for refining current applications and exploring new frontiers such as point-of-care or wearable biosensors. Here, we present the Sweeping Optical Frequency Mixing Method (SOHO), surpassing traditional PIC measurement methods with real-time operation, 30 dB higher sensitivity, and over 100 times better spectral resolution. Leveraging the frequency mixing process with a sweeping laser and custom control software, SOHO excels in simplicity, eliminating the need for advanced optical components and additional calibration procedures. We showcase its superior performance on ultrahigh-quality factor (Q) fiber-loop resonators (Q = 46M) as well as microresonators realized on a new optical waveguide platform. An experimental spectral resolution of 19.1 femtometers is demonstrated using an 85-meter-long unbalanced fiber Mach Zehnder Interferometer, constrained by noise resulting from the extended fiber length, while the theoretical resolution is calculated to be 6.2 femtometers, limited by the linewidth of the reference laser. With its excellent performance metrics, SOHO has the potential to become a vital measurement tool in photonics, excelling in high-speed and high-resolution measurements of weak optical signals.


title: Geometry Aware Field-to-field Transformations for 3D Semantic Segmentation

abstract: We present a novel approach to perform 3D semantic segmentation solely from 2D supervision by leveraging Neural Radiance Fields (NeRFs). By extracting features along a surface point cloud, we achieve a compact representation of the scene which is sample-efficient and conducive to 3D reasoning. Learning this feature space in an unsupervised manner via masked autoencoding enables few-shot segmentation. Our method is agnostic to the scene parameterization, working on scenes fit with any type of NeRF.


title: LocoNeRF: A NeRF-based Approach for Local Structure from Motion for Precise Localization

abstract: Visual localization is a critical task in mobile robotics, and researchers are continuously developing new approaches to enhance its efficiency. In this article, we propose a novel approach to improve the accuracy of visual localization using Structure from Motion (SfM) techniques. We highlight the limitations of global SfM, which suffers from high latency, and the challenges of local SfM, which requires large image databases for accurate reconstruction. To address these issues, we propose utilizing Neural Radiance Fields (NeRF), as opposed to image databases, to cut down on the space required for storage. We suggest that sampling reference images around the prior query position can lead to further improvements. We evaluate the accuracy of our proposed method against ground truth obtained using LIDAR and Advanced Lidar Odometry and Mapping in Real-time (A-LOAM), and compare its storage usage against local SfM with COLMAP in the conducted experiments. Our proposed method achieves an accuracy of 0.068 meters compared to the ground truth, which is slightly lower than the most advanced method COLMAP, which has an accuracy of 0.022 meters. However, the size of the database required for COLMAP is 400 megabytes, whereas the size of our NeRF model is only 160 megabytes. Finally, we perform an ablation study to assess the impact of using reference images from the NeRF reconstruction.


title: Are Emily and Greg Still More Employable than Lakisha and Jamal? Investigating Algorithmic Hiring Bias in the Era of ChatGPT

abstract: Large Language Models (LLMs) such as GPT-3.5, Bard, and Claude exhibit applicability across numerous tasks. One domain of interest is their use in algorithmic hiring, specifically in matching resumes with job categories. Yet, this introduces issues of bias on protected attributes like gender, race and maternity status. The seminal work of Bertrand & Mullainathan (2003) set the gold-standard for identifying hiring bias via field experiments where the response rate for identical resumes that differ only in protected attributes, e.g., racially suggestive names such as Emily or Lakisha, is compared. We replicate this experiment on state-of-art LLMs (GPT-3.5, Bard, Claude and Llama) to evaluate bias (or lack thereof) on gender, race, maternity status, pregnancy status, and political affiliation. We evaluate LLMs on two tasks: (1) matching resumes to job categories; and (2) summarizing resumes with employment relevant information. Overall, LLMs are robust across race and gender. They differ in their performance on pregnancy status and political affiliation. We use contrastive input decoding on open-source LLMs to uncover potential sources of bias.


title: InstructDET: Diversifying Referring Object Detection with Generalized Instructions

abstract: We propose InstructDET, a data-centric method for referring object detection (ROD) that localizes target objects based on user instructions. While deriving from referring expressions (REC), the instructions we leverage are greatly diversified to encompass common user intentions related to object detection. For one image, we produce tremendous instructions that refer to every single object and different combinations of multiple objects. Each instruction and its corresponding object bounding boxes (bbxs) constitute one training data pair. In order to encompass common detection expressions, we involve emerging vision-language model (VLM) and large language model (LLM) to generate instructions guided by text prompts and object bbxs, as the generalizations of foundation models are effective to produce human-like expressions (e.g., describing object property, category, and relationship). We name our constructed dataset as InDET. It contains images, bbxs and generalized instructions that are from foundation models. Our InDET is developed from existing REC datasets and object detection datasets, with the expanding potential that any image with object bbxs can be incorporated through using our InstructDET method. By using our InDET dataset, we show that a conventional ROD model surpasses existing methods on standard REC datasets and our InDET test set. Our data-centric method InstructDET, with automatic data expansion by leveraging foundation models, directs a promising field that ROD can be greatly diversified to execute common object detection instructions.


title: Effects of Annihilation with Low-Energy Neutrinos on High-Energy Neutrinos from Binary Neutron Star Mergers and Rare Core-Collapse Supernovae

abstract: We explore the possibility that high-energy (HE) neutrinos produced from choked jets can be annihilated with low-energy (LE) neutrinos emitted from the accretion disk around a black hole in binary neutron star mergers and rare core-collapse supernovae. For HE neutrinos produced close to the stellar center ($\lesssim 10^{9}-10^{12}$ cm), we find that the emerging all-flavor spectrum for neutrinos of $E\gtrsim 0.1-1$ PeV could be modified by a factor $E^{-n}$ with $n\gtrsim 0.4-0.5$ under realistic conditions. Flavor evolution of LE neutrinos does not affect this result but can change the emerging flavor composition of HE neutrinos. As a consequence, the above annihilation effect may need to be considered for HE neutrinos produced from choked jets at small radii. We briefly discuss the annihilation effects for different HE neutrino production models and point out that such effects could be tested through precise measurements of the diffuse neutrino spectrum and flavor composition.


title: Time-reversal symmetry breaking from lattice dislocations in superconductors

abstract: Spontaneous generation of time-reversal symmetry breaking in unconventional superconductors is currently a topic of considerable interest. While chiral superconducting order is often assumed to be the source of such signatures, they can sometimes also arise from nonmagnetic disorder. Here we perform a theoretical study of the impact of dislocations on the superconducting order parameter within a microscopic one-band model which, in the homogeneous case, features either extended $s$-wave, $d$-wave, or $s+id$-wave superconductivity depending on the electron concentration. We find that the dislocations minimize their impact on the superconducting condensate by inducing localized supercurrents pinned by the dislocations, even well outside the $s+id$ regime. We map out the parameter and density dependence of the induced currents. From these results we conclude that quite generically unconventional superconductors hosting dislocations tend to break time-reversal symmetry locally.


title: Maximizing Utilitarian and Egalitarian Welfare of Fractional Hedonic Games on Tree-like Graphs

abstract: Fractional hedonic games are coalition formation games where a player's utility is determined by the average value they assign to the members of their coalition. These games are a variation of graph hedonic games, which are a class of coalition formation games that can be succinctly represented. Due to their applicability in network clustering and their relationship to graph hedonic games, fractional hedonic games have been extensively studied from various perspectives. However, finding welfare-maximizing partitions in fractional hedonic games is a challenging task due to the nonlinearity of utilities. In fact, it has been proven to be NP-hard and can be solved in polynomial time only for a limited number of graph classes, such as trees. This paper presents (pseudo)polynomial-time algorithms to compute welfare-maximizing partitions in fractional hedonic games on tree-like graphs. We consider two types of social welfare measures: utilitarian and egalitarian. Tree-like graphs refer to graphs with bounded treewidth and block graphs. A hardness result is provided, demonstrating that the pseudopolynomial-time solvability is the best possible under the assumption P$\neq$NP.


title: Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements

abstract: Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of ChatGPT, the application effect of large language models (LLMs) in this field has attracted great attention. This work empirically investigates the performance of LLMs in generating empathetic responses and proposes three improvement methods of semantically similar in-context learning, two-stage interactive generation, and combination with the knowledge base. Extensive experiments show that LLMs can significantly benefit from our proposed methods and is able to achieve state-of-the-art performance in both automatic and human evaluations. Additionally, we explore the possibility of GPT-4 simulating human evaluators.


title: Transferable Availability Poisoning Attacks

abstract: We consider availability data poisoning attacks, where an adversary aims to degrade the overall test accuracy of a machine learning model by crafting small perturbations to its training data. Existing poisoning strategies can achieve the attack goal but assume the victim to employ the same learning method as what the adversary uses to mount the attack. In this paper, we argue that this assumption is strong, since the victim may choose any learning algorithm to train the model as long as it can achieve some targeted performance on clean data. Empirically, we observe a large decrease in the effectiveness of prior poisoning attacks if the victim employs an alternative learning algorithm. To enhance the attack transferability, we propose Transferable Poisoning, which first leverages the intrinsic characteristics of alignment and uniformity to enable better unlearnability within contrastive learning, and then iteratively utilizes the gradient information from supervised and unsupervised contrastive learning paradigms to generate the poisoning perturbations. Through extensive experiments on image benchmarks, we show that our transferable poisoning attack can produce poisoned samples with significantly improved transferability, not only applicable to the two learners used to devise the attack but also to learning algorithms and even paradigms beyond.


title: Secure Short-Packet Transmission with Aerial Relaying: Blocklength and Trajectory Co-Design

abstract: In this paper, we propose a secure short-packet communication (SPC) system involving an unmanned aerial vehicle (UAV)-aided relay in the presence of a terrestrial passive eavesdropper. The considered system, which is applicable to various next-generation Internet-of-Things (IoT) networks, exploits a UAV as a mobile relay, facilitating the reliable and secure exchange of intermittent short packets between a pair of remote IoT devices with strict latency. Our objective is to improve the overall secrecy throughput performance of the system by carefully designing key parameters such as the coding blocklengths and the UAV trajectory. However, this inherently poses a challenging optimization problem that is difficult to solve optimally. To address the issue, we propose a low-complexity algorithm inspired by the block successive convex approximation approach, where we divide the original problem into two subproblems and solve them alternately until convergence. Numerical results demonstrate that the proposed design achieves significant performance improvements relative to other benchmarks, and offer valuable insights into determining appropriate coding blocklengths and UAV trajectory.


title: ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learning

abstract: When personalized federated learning (FL) meets large foundation models, new challenges arise from various limitations in resources. In addition to typical limitations such as data, computation, and communication costs, access to the models is also often limited. This paper endeavors to solve both the challenges of limited resources and personalization. i.e., distribution shifts between clients. To do so, we propose a method named ZOOPFL that uses Zeroth-Order Optimization for Personalized Federated Learning. ZOOPFL avoids direct interference with the foundation models and instead learns to adapt its inputs through zeroth-order optimization. In addition, we employ simple yet effective linear projections to remap its predictions for personalization. To reduce the computation costs and enhance personalization, we propose input surgery to incorporate an auto-encoder with low-dimensional and client-specific embeddings. We provide theoretical support for ZOOPFL to analyze its convergence. Extensive empirical experiments on computer vision and natural language processing tasks using popular foundation models demonstrate its effectiveness for FL on black-box foundation models.


title: Modeling motor control in continuous-time Active Inference: a survey

abstract: The way the brain selects and controls actions is still widely debated. Mainstream approaches based on Optimal Control focus on stimulus-response mappings that optimize cost functions. Ideomotor theory and cybernetics propose a different perspective: they suggest that actions are selected and controlled by activating action effects and by continuously matching internal predictions with sensations. Active Inference offers a modern formulation of these ideas, in terms of inferential mechanisms and prediction-error-based control, which can be linked to neural mechanisms of living organisms. This article provides a technical illustration of Active Inference models in continuous time and a brief survey of Active Inference models that solve four kinds of control problems; namely, the control of goal-directed reaching movements, active sensing, the resolution of multisensory conflict during movement and the integration of decision-making and motor control. Crucially, in Active Inference, all these different facets of motor control emerge from the same optimization process - namely, the minimization of Free Energy - and do not require designing separate cost functions. Therefore, Active Inference provides a unitary perspective on various aspects of motor control that can inform both the study of biological control mechanisms and the design of artificial and robotic systems.


title: NeuralFastLAS: Fast Logic-Based Learning from Raw Data

abstract: Symbolic rule learners generate interpretable solutions, however they require the input to be encoded symbolically. Neuro-symbolic approaches overcome this issue by mapping raw data to latent symbolic concepts using a neural network. Training the neural and symbolic components jointly is difficult, due to slow and unstable learning, hence many existing systems rely on hand-engineered rules to train the network. We introduce NeuralFastLAS, a scalable and fast end-to-end approach that trains a neural network jointly with a symbolic learner. For a given task, NeuralFastLAS computes a relevant set of rules, proved to contain an optimal symbolic solution, trains a neural network using these rules, and finally finds an optimal symbolic solution to the task while taking network predictions into account. A key novelty of our approach is learning a posterior distribution on rules while training the neural network to improve stability during training. We provide theoretical results for a sufficient condition on network training to guarantee correctness of the final solution. Experimental results demonstrate that NeuralFastLAS is able to achieve state-of-the-art accuracy in arithmetic and logical tasks, with a training time that is up to two orders of magnitude faster than other jointly trained neuro-symbolic methods.


title: Large Language Model (LLM) as a System of Multiple Expert Agents: An Approach to solve the Abstraction and Reasoning Corpus (ARC) Challenge

abstract: We attempt to solve the Abstraction and Reasoning Corpus (ARC) Challenge using Large Language Models (LLMs) as a system of multiple expert agents. Using the flexibility of LLMs to be prompted to do various novel tasks using zero-shot, few-shot, context-grounded prompting, we explore the feasibility of using LLMs to solve the ARC Challenge. We firstly convert the input image into multiple suitable text-based abstraction spaces. We then utilise the associative power of LLMs to derive the input-output relationship and map this to actions in the form of a working program, similar to Voyager / Ghost in the MineCraft. In addition, we use iterative environmental feedback in order to guide LLMs to solve the task. Our proposed approach achieves 50 solves out of 111 training set problems (45%) with just three abstraction spaces - grid, object and pixel - and we believe that with more abstraction spaces and learnable actions, we will be able to solve more.


title: Parametric Matroid Interdiction

abstract: We introduce the parametric matroid one-interdiction problem. Given a matroid, each element of its ground set is associated with a weight that depends linearly on a real parameter from a given parameter interval. The goal is to find, for each parameter value, one element that, when being removed, maximizes the weight of a minimum weight basis. The complexity of this problem can be measured by the number of slope changes of the piecewise linear function mapping the parameter to the weight of the optimal solution of the parametric matroid one-interdiction problem. We provide two polynomial upper bounds as well as a lower bound on the number of these slope changes. Using these, we develop algorithms that require a polynomial number of independence tests and analyse their running time in the special case of graphical matroids.


title: An innovative clay metaBrick-based motif to enhance thermal and acoustic insulation

abstract: Metamaterials have gained popularity in recent years as a promising avenue for producing innovative materials with distinctive properties that offer unprecedented features. In this study, we address the thermal and acoustic challenges of building materials. We numerically and experimentally investigate a clay metaBrick, which is an innovative metamaterial design based on the existing hollow brick that has shown strong sound and thermal performances. We evaluate the acoustic and thermal characteristics of the clay metaBrick, including sound transmission and heat resistance, using the finite element method. Furthermore, we validate the results experimentally by investigating the behaviors of the wall built on metaBricks in two tests: sound and thermal. We contrast the findings of the metaBrick based wall with performances of a standard hollow brick wall. The metaBrick offers enhanced acoustic and thermal insulation properties compared to the standard brick, with a compressive strength above standards required in the building materials.


title: Retrieval-Generation Synergy Augmented Large Language Models

abstract: Large language models augmented with task-relevant documents have demonstrated impressive performance on knowledge-intensive tasks. However, regarding how to obtain effective documents, the existing methods are mainly divided into two categories. One is to retrieve from an external knowledge base, and the other is to utilize large language models to generate documents. We propose an iterative retrieval-generation collaborative framework. It is not only able to leverage both parametric and non-parametric knowledge, but also helps to find the correct reasoning path through retrieval-generation interactions, which is very important for tasks that require multi-step reasoning. We conduct experiments on four question answering datasets, including single-hop QA and multi-hop QA tasks. Empirical results show that our method significantly improves the reasoning ability of large language models and outperforms previous baselines.


title: From Data to Dialogue: Leveraging the Structure of Knowledge Graphs for Conversational Exploratory Search

abstract: Exploratory search is an open-ended information retrieval process that aims at discovering knowledge about a topic or domain rather than searching for a specific answer or piece of information. Conversational interfaces are particularly suitable for supporting exploratory search, allowing users to refine queries and examine search results through interactive dialogues. In addition to conversational search interfaces, knowledge graphs are also useful in supporting information exploration due to their rich semantic representation of data items. In this study, we demonstrate the synergistic effects of combining knowledge graphs and conversational interfaces for exploratory search, bridging the gap between structured and unstructured information retrieval. To this end, we propose a knowledge-driven dialogue system for exploring news articles by asking natural language questions and using the graph structure to navigate between related topics. Based on a user study with 54 participants, we empirically evaluate the effectiveness of the graph-based exploratory search and discuss design implications for developing such systems.


title: Sequential linear regression for conditional mean imputation of longitudinal continuous outcomes under reference-based assumptions

abstract: In clinical trials of longitudinal continuous outcomes, reference based imputation (RBI) has commonly been applied to handle missing outcome data in settings where the estimand incorporates the effects of intercurrent events, e.g. treatment discontinuation. RBI was originally developed in the multiple imputation framework, however recently conditional mean imputation (CMI) combined with the jackknife estimator of the standard error was proposed as a way to obtain deterministic treatment effect estimates and correct frequentist inference. For both multiple and CMI, a mixed model for repeated measures (MMRM) is often used for the imputation model, but this can be computationally intensive to fit to multiple data sets (e.g. the jackknife samples) and lead to convergence issues with complex MMRM models with many parameters. Therefore, a step-wise approach based on sequential linear regression (SLR) of the outcomes at each visit was developed for the imputation model in the multiple imputation framework, but similar developments in the CMI framework are lacking. In this article, we fill this gap in the literature by proposing a SLR approach to implement RBI in the CMI framework, and justify its validity using theoretical results and simulations. We also illustrate our proposal on a real data application.


title: Stability of the constant states in the augmented Born-Infeld system

abstract: In this paper, we consider the Born-Infeld system, arising as a nonlinear model of electromagnetism, and its extension introduced by Brenier [Bre04] the so-called "augmented Born-Infeld system". We show that this system enjoys a non-resonance structure and prove global existence and linear asymptotic behaviour of small (admissible) perturbations of arbitrary constant states.


title: A time-varying finance-led model for U.S. business cycles

abstract: This paper empirically assesses predictions of Goodwin's model of cyclical growth regarding demand and distributive regimes when integrating the real and financial sectors. In addition, it evaluates how financial and employment shocks affect the labor market and monetary policy variables over six different U.S. business-cycle peaks. It identifies a parsimonious Time-Varying Vector Autoregressive model with Stochastic Volatility (TVP-VAR-SV) with the labor share of income, the employment rate, residential investment, and the interest rate spread as endogenous variables. Using Bayesian inference methods, key results suggest (i) a combination of profit-led demand and profit-squeeze distribution; (ii) weakening of these regimes during the Great Moderation; and (iii) significant connections between the standard Goodwinian variables and residential investment as well as term spreads. Findings presented here broadly conform to the transition to increasingly deregulated financial and labor markets initiated in the 1980s.


title: Unsupervised deep learning framework for temperature-compensated damage assessment using ultrasonic guided waves on edge device

abstract: Fueled by the rapid development of machine learning (ML) and greater access to cloud computing and graphics processing units (GPUs), various deep learning based models have been proposed for improving performance of ultrasonic guided wave structural health monitoring (GW-SHM) systems, especially to counter complexity and heterogeneity in data due to varying environmental factors (e.g., temperature) and types of damages. Such models typically comprise of millions of trainable parameters, and therefore add to cost of deployment due to requirements of cloud connectivity and processing, thus limiting the scale of deployment of GW-SHM. In this work, we propose an alternative solution that leverages TinyML framework for development of light-weight ML models that could be directly deployed on embedded edge devices. The utility of our solution is illustrated by presenting an unsupervised learning framework for damage detection in honeycomb composite sandwich structure (HCSS) with disbond and delamination type of damages, validated using data generated by finite element (FE) simulations and experiments performed at various temperatures in the range 0{\deg}C to 90{\deg}C. We demonstrate a fully-integrated solution using a Xilinx Artix-7 FPGA for data acquisition and control, and edge-inference of damage.


title: Toolink: Linking Toolkit Creation and Using through Chain-of-Solving on Open-Source Model

abstract: Large Language Models (LLMs) have demonstrated remarkable progress in utilizing tools, but their closed-source nature and high inference costs pose limitations on their adaptability, necessitating a valid method that leverages smaller, open-sourced models. In this paper, we introduce Toolink, a comprehensive framework that performs task-solving by first creating a toolkit and then integrating the planning and calling of tools through a chain-of-solving (CoS) approach. We first validate the efficacy of Toolink in harnessing the model's creativity and CoS ability on ChatGPT. Subsequently, we curate CoS-GPT, a chain-of-solving dataset designed for tool-using, and finetune the LLaMA-7B model. It results in LLaMA-CoS, a powerful open-source model with advanced tool-planning and tool-calling capabilities. Evaluation of diverse tasks from BIG-bench demonstrates its CoS ability matches that of ChatGPT while its performance surpasses the chain-of-thought approach. Further studies highlight the generalization of LLaMA-CoS to unseen tasks and showcase its capability in using toolkits not explicitly tailored for the target task, affirming its robustness in real-world scenarios.


title: Quantitative Propagation of Chaos for 2D Viscous Vortex Model on the Whole Space

abstract: We derive the quantitative estimates of propagation of chaos for the large interacting particle systems in terms of the relative entropy between the joint law of the particles and the tensorized law of the mean field PDE. We resolve this problem for the first time for the viscous vortex model that approximating 2D Navier-Stokes equation in the vorticity formulation on the whole space. We obtain as key tools the Li-Yau-type estimates and Hamilton-type heat kernel estimates for 2D Navier-Stokes in the whole space.


title: MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models

abstract: Large language models (LLMs) have shown nearly saturated performance on many natural language processing (NLP) tasks. As a result, it is natural for people to believe that LLMs have also mastered abilities such as time understanding and reasoning. However, research on the temporal sensitivity of LLMs has been insufficiently emphasized. To fill this gap, this paper constructs Multiple Sensitive Factors Time QA (MenatQA), which encompasses three temporal factors (scope factor, order factor, counterfactual factor) with total 2,853 samples for evaluating the time comprehension and reasoning abilities of LLMs. This paper tests current mainstream LLMs with different parameter sizes, ranging from billions to hundreds of billions. The results show most LLMs fall behind smaller temporal reasoning models with different degree on these factors. In specific, LLMs show a significant vulnerability to temporal biases and depend heavily on the temporal information provided in questions. Furthermore, this paper undertakes a preliminary investigation into potential improvement strategies by devising specific prompts and leveraging external tools. These approaches serve as valuable baselines or references for future research endeavors.


title: ITRE: Low-light Image Enhancement Based on Illumination Transmission Ratio Estimation

abstract: Noise, artifacts, and over-exposure are significant challenges in the field of low-light image enhancement. Existing methods often struggle to address these issues simultaneously. In this paper, we propose a novel Retinex-based method, called ITRE, which suppresses noise and artifacts from the origin of the model, prevents over-exposure throughout the enhancement process. Specifically, we assume that there must exist a pixel which is least disturbed by low light within pixels of same color. First, clustering the pixels on the RGB color space to find the Illumination Transmission Ratio (ITR) matrix of the whole image, which determines that noise is not over-amplified easily. Next, we consider ITR of the image as the initial illumination transmission map to construct a base model for refined transmission map, which prevents artifacts. Additionally, we design an over-exposure module that captures the fundamental characteristics of pixel over-exposure and seamlessly integrate it into the base model. Finally, there is a possibility of weak enhancement when inter-class distance of pixels with same color is too small. To counteract this, we design a Robust-Guard module that safeguards the robustness of the image enhancement process. Extensive experiments demonstrate the effectiveness of our approach in suppressing noise, preventing artifacts, and controlling over-exposure level simultaneously. Our method performs superiority in qualitative and quantitative performance evaluations by comparing with state-of-the-art methods.


title: Ensemble Laplacian Biogeography-Based Sine Cosine Algorithm for Structural Engineering Design Optimization Problems

abstract: In this paper, an ensemble metaheuristic algorithm (denoted as LX-BBSCA) is introduced. It combines the strengths of Laplacian Biogeography-Based Optimization (LX-BBO) and the Sine Cosine Algorithm (SCA) to address structural engineering design optimization problems. Our primary objective is to mitigate the risk of getting stuck in local minima and accelerate the algorithm's convergence rate. We evaluate the proposed LX-BBSCA algorithm on a set of 23 benchmark functions, including both unimodal and multimodal problems of varying complexity and dimensions. Additionally, we apply LX-BBSCA to tackle five real-world structural engineering design problems, comparing the results with those obtained using other metaheuristics in terms of objective function values and convergence behavior. To ensure the statistical validity of our findings, we employ rigorous tests such as the t-test and the Wilcoxon rank test. The experimental outcomes consistently demonstrate that the ensemble LX-BBSCA algorithm outperforms not only the basic versions of BBO, SCA, and LX-BBO but also other state-of-the-art metaheuristic algorithms.


title: Vortex Lattice Formation in Spin-Orbit-Coupled Spin-2 Bose-Einstein Condensate Under Rotation

abstract: We investigate the vortex lattice configuration in a rotating spin orbit-coupled spin-2 Bose-Einstein condensate confined in a quasi-two-dimensional harmonic trap. By considering the interplay between rotation frequency, spin-orbit couplings, and inter atomic interactions, we explore a variety of vortex lattice structures emerging as a ground state solution. Our study focuses on the combined effects of spin-orbit coupling and rotation, analyzed by using the variational method for the single-particle Hamiltonian. We observe that the interplay between rotation and Rashba spin-orbit coupling gives rise to different effective potentials for the bosons. Specifically, at higher rotation frequencies, isotropic spin-orbit coupling leads to an effective toroidal potential, while fully anisotropic spin-orbit coupling results in a symmetric double-well potential. To obtain these findings, we solve the five coupled Gross-Pitaevskii equations for the spin-2 BEC with spin-orbit coupling under rotation. Notably, we find that the antiferromagnetic, cyclic, and ferromagnetic phases exhibit similar behavior at higher rotation.


title: Recurrent Neural Language Models as Probabilistic Finite-state Automata

abstract: Studying language models (LMs) in terms of well-understood formalisms allows us to precisely characterize their abilities and limitations. Previous work has investigated the representational capacity of recurrent neural network (RNN) LMs in terms of their capacity to recognize unweighted formal languages. However, LMs do not describe unweighted formal languages -- rather, they define \emph{probability distributions} over strings. In this work, we study what classes of such probability distributions RNN LMs can represent, which allows us to make more direct statements about their capabilities. We show that simple RNNs are equivalent to a subclass of probabilistic finite-state automata, and can thus model a strict subset of probability distributions expressible by finite-state models. Furthermore, we study the space complexity of representing finite-state LMs with RNNs. We show that, to represent an arbitrary deterministic finite-state LM with $N$ states over an alphabet $\alphabet$, an RNN requires $\Omega\left(N |\Sigma|\right)$ neurons. These results present a first step towards characterizing the classes of distributions RNN LMs can represent and thus help us understand their capabilities and limitations.


title: Energy quantization of the two dimensional Lane-Emden equation with vanishing potentials

abstract: We study the concentration phenomenon of the Lane-Emden equation with vanishing potentials \[\begin{cases} -\Delta u_n=W_n(x)u_n^{p_n},\quad u_n>0,\quad\text{in}~\Omega, u_n=0,\quad\text{on}~\partial\Omega, \int_\Omega p_n W_n(x)u_n^{p_n}dx\le C, \end{cases}\] where $\Omega$ is a smooth bounded domain in $\mathbb{R}^2$, $W_n(x)\geq 0$ are bounded functions with zeros in $\Omega$, and $p_n\to\infty$ as $n\to\infty$. A typical example is $W_n(x)=|x|^{2\alpha}$ with $0\in\Omega$, i.e. the equation turns to be the well-known H\'enon equation. The asymptotic behavior for $\alpha=0$ has been well studied in the literature. While for $\alpha>0$, the problem becomes much more complicated since a singular Liouville equation appears as a limit problem. In this paper, we study the case $\alpha>0$ and prove a quantization property (suppose $0$ is a concentration point) \[p_n|x|^{2\alpha}u_n(x)^{p_n-1+t}\to 8\pi e^{\frac{t}{2}}\sum_{i=1}^k\delta_{a_i}+8\pi(1+\alpha)e^{\frac{t}{2}}c^t\delta_0, \quad t=0,1,2,\] for some $k\ge0$, $a_i\in\Omega\setminus\{0\}$ and some $c\ge1$. Moreover, for $\alpha\not\in\mathbb{N}$, we show that the blow up must be simple, i.e. $c=1$. As applications, we also obtain the complete asymptotic behavior of ground state solutions for the H\'enon equation.


title: An Investigation of LLMs' Inefficacy in Understanding Converse Relations

abstract: Large Language Models (LLMs) have achieved remarkable success in many formal language oriented tasks, such as structural data-to-text and semantic parsing. However current benchmarks mostly follow the data distribution of the pre-training data of LLMs. Therefore, a natural question rises that do LLMs really understand the structured semantics of formal languages. In this paper, we investigate this problem on a special case, converse binary relation. We introduce a new benchmark ConvRe focusing on converse relations, which contains 17 relations and 1240 triples extracted from popular knowledge graph completion datasets. Our ConvRE features two tasks, Re2Text and Text2Re, which are formulated as multi-choice question answering to evaluate LLMs' ability to determine the matching between relations and associated text. For the evaluation protocol, apart from different prompting methods, we further introduce variants to the test text and few-shot example text. We conduct experiments on three popular LLM families and have observed various scaling trends. The results suggest that LLMs often resort to shortcut learning and still face challenges on our proposed benchmark.


title: Observation of WW$\gamma$ production and search for H$\gamma$ production in proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: The observation of WW$\gamma$ production in proton-proton collisions at a center-of-mass energy of 13 TeV with an integrated luminosity of 138 fb$^{-1}$ is presented. The observed (expected) significance is 5.6 (5.1) standard deviations. Events are selected by requiring exactly two leptons (one electron and one muon) of opposite charge, moderate missing transverse momentum, and a photon. The measured fiducial cross section for WW$\gamma$ is 5.9 $\pm$ 0.8 (stat) $\pm$ 0.8 (syst) $\pm$ 0.7 (modeling) fb, in agreement with the next-to-leading order quantum chromodynamics prediction. The analysis is extended with a search for the associated production of the Higgs boson and a photon, which is generated by a coupling of the Higgs boson to light quarks. The result is used to constrain the Higgs boson couplings to light quarks.


title: On the Zero-Shot Generalization of Machine-Generated Text Detectors

abstract: The rampant proliferation of large language models, fluent enough to generate text indistinguishable from human-written language, gives unprecedented importance to the detection of machine-generated text. This work is motivated by an important research question: How will the detectors of machine-generated text perform on outputs of a new generator, that the detectors were not trained on? We begin by collecting generation data from a wide range of LLMs, and train neural detectors on data from each generator and test its performance on held-out generators. While none of the detectors can generalize to all generators, we observe a consistent and interesting pattern that the detectors trained on data from a medium-size LLM can zero-shot generalize to the larger version. As a concrete application, we demonstrate that robust detectors can be built on an ensemble of training data from medium-sized models.


title: A Corrected Expected Improvement Acquisition Function Under Noisy Observations

abstract: Sequential maximization of expected improvement (EI) is one of the most widely used policies in Bayesian optimization because of its simplicity and ability to handle noisy observations. In particular, the improvement function often uses the best posterior mean as the best incumbent in noisy settings. However, the uncertainty associated with the incumbent solution is often neglected in many analytic EI-type methods: a closed-form acquisition function is derived in the noise-free setting, but then applied to the setting with noisy observations. To address this limitation, we propose a modification of EI that corrects its closed-form expression by incorporating the covariance information provided by the Gaussian Process (GP) model. This acquisition function specializes to the classical noise-free result, and we argue should replace that formula in Bayesian optimization software packages, tutorials, and textbooks. This enhanced acquisition provides good generality for noisy and noiseless settings. We show that our method achieves a sublinear convergence rate on the cumulative regret bound under heteroscedastic observation noise. Our empirical results demonstrate that our proposed acquisition function can outperform EI in the presence of noisy observations on benchmark functions for black-box optimization, as well as on parameter search for neural network model compression.


title: Hieros: Hierarchical Imagination on Structured State Space Sequence World Models

abstract: One of the biggest challenges to modern deep reinforcement learning (DRL) algorithms is sample efficiency. Many approaches learn a world model in order to train an agent entirely in imagination, eliminating the need for direct environment interaction during training. However, these methods often suffer from either a lack of imagination accuracy, exploration capabilities, or runtime efficiency. We propose Hieros, a hierarchical policy that learns time abstracted world representations and imagines trajectories at multiple time scales in latent space. Hieros uses an S5 layer-based world model, which predicts next world states in parallel during training and iteratively during environment interaction. Due to the special properties of S5 layers, our method can train in parallel and predict next world states iteratively during imagination. This allows for more efficient training than RNN-based world models and more efficient imagination than Transformer-based world models. We show that our approach outperforms the state of the art in terms of mean and median normalized human score on the Atari 100k benchmark, and that our proposed world model is able to predict complex dynamics very accurately. We also show that Hieros displays superior exploration capabilities compared to existing approaches.


title: Orlicz regrets to consistently bound statistics of random variables with an application to environmental indicators

abstract: Evaluating environmental variables that vary stochastically is the principal topic for designing better environmental management and restoration schemes. Both the upper and lower estimates of these variables, such as water quality indices and flood and drought water levels, are important and should be consistently evaluated within a unified mathematical framework. We propose a novel pair of Orlicz regrets to consistently bound the statistics of random variables both from below and above. Here, consistency indicates that the upper and lower bounds are evaluated with common coefficients and parameter values being different from some of the risk measures proposed thus far. Orlicz regrets can flexibly evaluate the statistics of random variables based on their tail behavior. The explicit linkage between Orlicz regrets and divergence risk measures was exploited to better comprehend them. We obtain sufficient conditions to pose the Orlicz regrets as well as divergence risk measures, and further provide gradient descent-type numerical algorithms to compute them. Finally, we apply the proposed mathematical framework to the statistical evaluation of 31-year water quality data as key environmental indicators in a Japanese river environment.


title: Investigating the Ability of PINNs To Solve Burgers' PDE Near Finite-Time BlowUp

abstract: Physics Informed Neural Networks (PINNs) have been achieving ever newer feats of solving complicated PDEs numerically while offering an attractive trade-off between accuracy and speed of inference. A particularly challenging aspect of PDEs is that there exist simple PDEs which can evolve into singular solutions in finite time starting from smooth initial conditions. In recent times some striking experiments have suggested that PINNs might be good at even detecting such finite-time blow-ups. In this work, we embark on a program to investigate this stability of PINNs from a rigorous theoretical viewpoint. Firstly, we derive generalization bounds for PINNs for Burgers' PDE, in arbitrary dimensions, under conditions that allow for a finite-time blow-up. Then we demonstrate via experiments that our bounds are significantly correlated to the $\ell_2$-distance of the neurally found surrogate from the true blow-up solution, when computed on sequences of PDEs that are getting increasingly close to a blow-up.


title: DeepQTest: Testing Autonomous Driving Systems with Reinforcement Learning and Real-world Weather Data

abstract: Autonomous driving systems (ADSs) are capable of sensing the environment and making driving decisions autonomously. These systems are safety-critical, and testing them is one of the important approaches to ensure their safety. However, due to the inherent complexity of ADSs and the high dimensionality of their operating environment, the number of possible test scenarios for ADSs is infinite. Besides, the operating environment of ADSs is dynamic, continuously evolving, and full of uncertainties, which requires a testing approach adaptive to the environment. In addition, existing ADS testing techniques have limited effectiveness in ensuring the realism of test scenarios, especially the realism of weather conditions and their changes over time. Recently, reinforcement learning (RL) has demonstrated great potential in addressing challenging problems, especially those requiring constant adaptations to dynamic environments. To this end, we present DeepQTest, a novel ADS testing approach that uses RL to learn environment configurations with a high chance of revealing abnormal ADS behaviors. Specifically, DeepQTest employs Deep Q-Learning and adopts three safety and comfort measures to construct the reward functions. To ensure the realism of generated scenarios, DeepQTest defines a set of realistic constraints and introduces real-world weather conditions into the simulated environment. We employed three comparison baselines, i.e., random, greedy, and a state-of-the-art RL-based approach DeepCOllision, for evaluating DeepQTest on an industrial-scale ADS. Evaluation results show that DeepQTest demonstrated significantly better effectiveness in terms of generating scenarios leading to collisions and ensuring scenario realism compared with the baselines. In addition, among the three reward functions implemented in DeepQTest, Time-To-Collision is recommended as the best design according to our study.


title: Multi-Ship Tracking by Robust Similarity metric

abstract: Multi-ship tracking (MST) as a core technology has been proven to be applied to situational awareness at sea and the development of a navigational system for autonomous ships. Despite impressive tracking outcomes achieved by multi-object tracking (MOT) algorithms for pedestrian and vehicle datasets, these models and techniques exhibit poor performance when applied to ship datasets. Intersection of Union (IoU) is the most popular metric for computing similarity used in object tracking. The low frame rates and severe image shake caused by wave turbulence in ship datasets often result in minimal, or even zero, Intersection of Union (IoU) between the predicted and detected bounding boxes. This issue contributes to frequent identity switches of tracked objects, undermining the tracking performance. In this paper, we address the weaknesses of IoU by incorporating the smallest convex shapes that enclose both the predicted and detected bounding boxes. The calculation of the tracking version of IoU (TIoU) metric considers not only the size of the overlapping area between the detection bounding box and the prediction box, but also the similarity of their shapes. Through the integration of the TIoU into state-of-the-art object tracking frameworks, such as DeepSort and ByteTrack, we consistently achieve improvements in the tracking performance of these frameworks.


title: On the Amplification of Cache Occupancy Attacks in Randomized Cache Architectures

abstract: In this work, we explore the applicability of cache occupancy attacks and the implications of secured cache design rationales on such attacks. In particular, we show that one of the well-known cache randomization schemes, MIRAGE, touted to be resilient against eviction-based attacks, amplifies the chances of cache occupancy attack, making it more vulnerable compared to contemporary designs. We leverage MIRAGE's global eviction property to demonstrate covert channel with byte-level granularity, with far less cache occupancy requirement (just $10\%$ of LLC) than other schemes. For instance, ScatterCache (a randomisation scheme with lesser security guarantees than MIRAGE) and generic set-associative caches require $40\%$ and $30\%$ cache occupancy, respectively, to exhibit covert communication. Furthermore, we extend our attack vectors to include side-channel, template-based fingerprinting of workloads in a cross-core setting. We demonstrate the potency of such fingerprinting on both inhouse LLC simulator as well as on SPEC2017 workloads on gem5. Finally, we pinpoint implementation inconsistencies in MIRAGE's publicly available gem5 artifact which motivates a re-evaluation of the performance statistics of MIRAGE with respect to ScatterCache and baseline set-associative cache. We find MIRAGE, in reality, performs worse than what is previously reported in literature, a concern that should be addressed in successor generations of secured caches.


title: On quadratic polynomial mappings from $\mathbb{C}^3$ to $\mathbb{C}^2$

abstract: We classify quadratic polynomial mappings from $\mathbb{C}^3$ to $\mathbb{C}^2$ up to affine equivalence and topological equivalence. This is a part of a larger project, we have already classified mappings from $\mathbb{C}^2$ to $\mathbb{C}^n$ and inted to classify mappings from $\mathbb{C}^3$ to $\mathbb{C}^3$.


title: GSLB: The Graph Structure Learning Benchmark

abstract: Graph Structure Learning (GSL) has recently garnered considerable attention due to its ability to optimize both the parameters of Graph Neural Networks (GNNs) and the computation graph structure simultaneously. Despite the proliferation of GSL methods developed in recent years, there is no standard experimental setting or fair comparison for performance evaluation, which creates a great obstacle to understanding the progress in this field. To fill this gap, we systematically analyze the performance of GSL in different scenarios and develop a comprehensive Graph Structure Learning Benchmark (GSLB) curated from 20 diverse graph datasets and 16 distinct GSL algorithms. Specifically, GSLB systematically investigates the characteristics of GSL in terms of three dimensions: effectiveness, robustness, and complexity. We comprehensively evaluate state-of-the-art GSL algorithms in node- and graph-level tasks, and analyze their performance in robust learning and model complexity. Further, to facilitate reproducible research, we have developed an easy-to-use library for training, evaluating, and visualizing different GSL methods. Empirical results of our extensive experiments demonstrate the ability of GSL and reveal its potential benefits on various downstream tasks, offering insights and opportunities for future research. The code of GSLB is available at: https://github.com/GSL-Benchmark/GSLB.


title: Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity

abstract: Large Language Models (LLMs), renowned for their remarkable performance across diverse domains, present a challenge when it comes to practical deployment due to their colossal model size. In response to this challenge, efforts have been directed toward the application of traditional network pruning techniques to LLMs, uncovering a massive number of parameters that can be pruned in one-shot without hurting performance. Prevailing LLM pruning strategies have consistently adhered to the practice of uniformly pruning all layers at equivalent sparsity, resulting in robust performance. However, this observation stands in contrast to the prevailing trends observed in the field of vision models, where non-uniform layerwise sparsity typically yields stronger results. To understand the underlying reasons for this disparity, we conduct a comprehensive study and discover a strong correlation with the emergence of activation outliers in LLMs. Inspired by this finding, we introduce a novel LLM pruning methodology that incorporates a tailored set of non-uniform layerwise sparsity ratios, termed as Outlier Weighed Layerwise sparsity (OWL). The sparsity ratio of OWL is proportional to the outlier ratio observed within each layer, facilitating a more effective alignment between layerwise weight sparsity and outlier ratios. Our empirical evaluation, conducted across the LLaMA-V1 family and OPT, spanning various benchmarks, demonstrates the distinct advantages offered by OWL over previous methods. For instance, OWL exhibits a remarkable performance gain, surpassing the state-of-the-art Wanda and SparseGPT by 61.22 and 6.80 perplexity at a high sparsity level of 70%, respectively, while delivering 2.6x end-to-end inference speed-up in the DeepSparse inference engine. Codes are available at https://github.com/luuyin/OWL.


title: Intersection of transverse foliations in 3-manifolds: Hausdorff leafspace implies leafwise quasi-geodesic

abstract: Let $\mathcal{F}_1$ and $\mathcal{F}_2$ be transverse two dimensional foliations with Gromov hyperbolic leaves in a closed 3-manifold $M$ whose fundamental group is not solvable, and let $\mathcal{G}$ be the one dimensional foliation obtained by intersection. We show that $\mathcal{G}$ is \emph{leafwise quasigeodesic} in $\mathcal{F}_1$ and $\mathcal{F}_2$ if and only if the foliation $\mathcal{G}_L$ induced by $\mathcal{G}$ in the universal cover $L$ of any leaf of $\mathcal{F}_1$ or $\mathcal{F}_2$ has Hausdorff leaf space. We end up with a discussion on the hypothesis of Gromov hyperbolicity of the leaves.


title: Do Large Language Models Know about Facts?

abstract: Large language models (LLMs) have recently driven striking performance improvements across a range of natural language processing tasks. The factual knowledge acquired during pretraining and instruction tuning can be useful in various downstream tasks, such as question answering, and language generation. Unlike conventional Knowledge Bases (KBs) that explicitly store factual knowledge, LLMs implicitly store facts in their parameters. Content generated by the LLMs can often exhibit inaccuracies or deviations from the truth, due to facts that can be incorrectly induced or become obsolete over time. To this end, we aim to comprehensively evaluate the extent and scope of factual knowledge within LLMs by designing the benchmark Pinocchio. Pinocchio contains 20K diverse factual questions that span different sources, timelines, domains, regions, and languages. Furthermore, we investigate whether LLMs are able to compose multiple facts, update factual knowledge temporally, reason over multiple pieces of facts, identify subtle factual differences, and resist adversarial examples. Extensive experiments on different sizes and types of LLMs show that existing LLMs still lack factual knowledge and suffer from various spurious correlations. We believe this is a critical bottleneck for realizing trustworthy artificial intelligence. The dataset Pinocchio and our codes will be publicly available.


title: Optimizing Large Language Models to Expedite the Development of Smart Contracts

abstract: Programming has always been at the heart of technological innovation in the 21st century. With the advent of blockchain technologies and the proliferation of web3 paradigms of decentralised applications, smart contracts have been very instrumental in enabling developers to build applications that reside on decentralised blockchains. Despite the huge interest and potential of smart contracts, there is still a significant knowledge and skill gap that developers need to cross in order to build web3 applications. In light of this, we introduce MazzumaGPT, a large language model that has been optimised to generate smart contract code and aid developers to scaffold development and improve productivity. As part of this research, we outline the optimisation and fine-tuning parameters, evaluate the model's performance on functional correctness and address the limitations and broader impacts of our research.


title: Distributional Reinforcement Learning with Online Risk-awareness Adaption

abstract: The use of reinforcement learning (RL) in practical applications requires considering sub-optimal outcomes, which depend on the agent's familiarity with the uncertain environment. Dynamically adjusting the level of epistemic risk over the course of learning can tactically achieve reliable optimal policy in safety-critical environments and tackle the sub-optimality of a static risk level. In this work, we introduce a novel framework, Distributional RL with Online Risk Adaption (DRL-ORA), which can quantify the aleatory and epistemic uncertainties compositely and dynamically select the epistemic risk levels via solving a total variation minimization problem online. The risk level selection can be efficiently achieved through grid search using a Follow-The-Leader type algorithm, and its offline oracle is related to "satisficing measure" (in the decision analysis community) under a special modification of the loss function. We show multiple classes of tasks where DRL-ORA outperforms existing methods that rely on either a fixed risk level or manually predetermined risk level adaption. Given the simplicity of our modifications, we believe the framework can be easily incorporated into most RL algorithm variants.


title: Blockchain-Envisioned UAV-Aided Disaster Relief Networks: Challenges and Solutions

abstract: Natural or man-made disasters pose significant challenges for delivering critical relief to affected populations due to disruptions in critical infrastructures and logistics networks. Unmanned aerial vehicles (UAVs)-aided disaster relief networks (UDRNs) leverage UAVs to assist existing ground relief networks by swiftly assessing affected areas and timely delivering lifesaving supplies. To meet the growing demands for collaborative, trust-free, and transparent UDRN services, blockchain-based UDRNs emerge as a promising approach through immutable ledgers and distributed smart contracts. However, several efficiency and security challenges hinder the deployment of blockchain-based UDRNs, including the lack of cooperation between smart contracts, lack of dynamic audit for smart contract vulnerabilities, and low forensics robustness against transaction malleability attacks. Towards efficient and secure blockchain-based UDRNs, this paper presents potential solutions: (i) a series of collaborative smart contracts for coordinated relief management, (ii) a dynamic contract audit mechanism to prevent known/unknown contract vulnerabilities; and (iii) a robust transaction forensics strategy with on/off-chain cooperation to resist transaction malleability attacks. Our prototype implementation and experimental results demonstrate the feasibility and effectiveness of our approach. Lastly, we outline key open research issues crucial to advancing this emerging field.


title: Unified speech and gesture synthesis using flow matching

abstract: As text-to-speech technologies achieve remarkable naturalness in read-aloud tasks, there is growing interest in multimodal synthesis of verbal and non-verbal communicative behaviour, such as spontaneous speech and associated body gestures. This paper presents a novel, unified architecture for jointly synthesising speech acoustics and skeleton-based 3D gesture motion from text, trained using optimal-transport conditional flow matching (OT-CFM). The proposed architecture is simpler than the previous state of the art, has a smaller memory footprint, and can capture the joint distribution of speech and gestures, generating both modalities together in one single process. The new training regime, meanwhile, enables better synthesis quality in much fewer steps (network evaluations) than before. Uni- and multimodal subjective tests demonstrate improved speech naturalness, gesture human-likeness, and cross-modal appropriateness compared to existing benchmarks. Please see https://shivammehta25.github.io/Match-TTSG/ for video examples and code.


title: Nonequilibrium flow simulations using unified gas-kinetic wave-particle method

abstract: Nonequilibrium flows are common in aerospace engineering, and numerical simulations are vital in understanding non-equilibrium flow dynamics in spacecraft flight. The unified gas-kinetic wave-particle (UGKWP) method has been developed for multi-scale flow simulation, which models the coupled particle transport and collision within a numerical time in the flux evaluation across a cell interface. The UGKWP balances precision and efficiency in multiscale flow simulations, particularly in high-speed flow. In this study, the UGKWP method is used to simulate supersonic flow around a sphere, hypersonic flow around a space vehicle, nozzle plume into a vacuum, and side-jet impingement on hypersonic flow. The UGKWP accurately renders the Navier-Stokes solution within the nozzle, extending to free molecular flow in the external environment, all within a singular computation. Complicated structures in flow interaction have been captured by the UGKWP method. All simulation results have been verified through experimental measurements or Direct Simulation Monte Carlo (DSMC) methods. The UGKWP method requires only 60 GiB of memory to simulate a three-dimensional space vehicle with 560593 cells under different flow conditions, making it efficient and accurate for aerospace engineering applications.


title: ChiMera: Learning with noisy labels by contrasting mixed-up augmentations

abstract: Learning with noisy labels has been studied to address incorrect label annotations in real-world applications. In this paper, we present ChiMera, a two-stage learning-from-noisy-labels framework based on semi-supervised learning, developed based on a novel contrastive learning technique MixCLR. The key idea of MixCLR is to learn and refine the representations of mixed augmentations from two different images to better resist label noise. ChiMera jointly learns the representations of the original data distribution and mixed-up data distribution via MixCLR, introducing many additional augmented samples to fill in the gap between different classes. This results in a more smoothed representation space learned by contrastive learning with better alignment and a more robust decision boundary. By exploiting MixCLR, ChiMera also improves the label diffusion process in the semi-supervised noise recovery stage and further boosts its ability to diffuse correct label information. We evaluated ChiMera on seven real-world datasets and obtained state-of-the-art performance on both symmetric noise and asymmetric noise. Our method opens up new avenues for using contrastive learning on learning with noisy labels and we envision MixCLR to be broadly applicable to other applications.


title: AANet: Aggregation and Alignment Network with Semi-hard Positive Sample Mining for Hierarchical Place Recognition

abstract: Visual place recognition (VPR) is one of the research hotspots in robotics, which uses visual information to locate robots. Recently, the hierarchical two-stage VPR methods have become popular in this field due to the trade-off between accuracy and efficiency. These methods retrieve the top-k candidate images using the global features in the first stage, then re-rank the candidates by matching the local features in the second stage. However, they usually require additional algorithms (e.g. RANSAC) for geometric consistency verification in re-ranking, which is time-consuming. Here we propose a Dynamically Aligning Local Features (DALF) algorithm to align the local features under spatial constraints. It is significantly more efficient than the methods that need geometric consistency verification. We present a unified network capable of extracting global features for retrieving candidates via an aggregation module and aligning local features for re-ranking via the DALF alignment module. We call this network AANet. Meanwhile, many works use the simplest positive samples in triplet for weakly supervised training, which limits the ability of the network to recognize harder positive pairs. To address this issue, we propose a Semi-hard Positive Sample Mining (ShPSM) strategy to select appropriate hard positive images for training more robust VPR networks. Extensive experiments on four benchmark VPR datasets show that the proposed AANet can outperform several state-of-the-art methods with less time consumption. The code is released at https://github.com/Lu-Feng/AANet.


title: Text2NKG: Fine-Grained N-ary Relation Extraction for N-ary relational Knowledge Graph Construction

abstract: Beyond traditional binary relational facts, n-ary relational knowledge graphs (NKGs) are comprised of n-ary relational facts containing more than two entities, which are closer to real-world facts with broader applications. However, the construction of NKGs still significantly relies on manual labor, and n-ary relation extraction still remains at a course-grained level, which is always in a single schema and fixed arity of entities. To address these restrictions, we propose Text2NKG, a novel fine-grained n-ary relation extraction framework for n-ary relational knowledge graph construction. We introduce a span-tuple classification approach with hetero-ordered merging to accomplish fine-grained n-ary relation extraction in different arity. Furthermore, Text2NKG supports four typical NKG schemas: hyper-relational schema, event-based schema, role-based schema, and hypergraph-based schema, with high flexibility and practicality. Experimental results demonstrate that Text2NKG outperforms the previous state-of-the-art model by nearly 20\% points in the $F_1$ scores on the fine-grained n-ary relation extraction benchmark in the hyper-relational schema. Our code and datasets are publicly available.


title: Evolutionary Retrosynthetic Route Planning

abstract: Molecular retrosynthesis is a significant and complex problem in the field of chemistry, however, traditional manual synthesis methods not only need well-trained experts but also are time-consuming. With the development of big data and machine learning, artificial intelligence (AI) based retrosynthesis is attracting more attention and is becoming a valuable tool for molecular retrosynthesis. At present, Monte Carlo tree search is a mainstream search framework employed to address this problem. Nevertheless, its search efficiency is compromised by its large search space. Therefore, we propose a novel approach for retrosynthetic route planning based on evolutionary optimization, marking the first use of Evolutionary Algorithm (EA) in the field of multi-step retrosynthesis. The proposed method involves modeling the retrosynthetic problem into an optimization problem, defining the search space and operators. Additionally, to improve the search efficiency, a parallel strategy is implemented. The new approach is applied to four case products, and is compared with Monte Carlo tree search. The experimental results show that, in comparison to the Monte Carlo tree search algorithm, EA significantly reduces the number of calling single-step model by an average of 53.9%. The time required to search three solutions decreased by an average of 83.9%, and the number of feasible search routes increases by 5 times.


title: Lifelong Learning for Fog Load Balancing: A Transfer Learning Approach

abstract: Fog computing emerged as a promising paradigm to address the challenges of processing and managing data generated by the Internet of Things (IoT). Load balancing (LB) plays a crucial role in Fog computing environments to optimize the overall system performance. It requires efficient resource allocation to improve resource utilization, minimize latency, and enhance the quality of service for end-users. In this work, we improve the performance of privacy-aware Reinforcement Learning (RL) agents that optimize the execution delay of IoT applications by minimizing the waiting delay. To maintain privacy, these agents optimize the waiting delay by minimizing the change in the number of queued requests in the whole system, i.e., without explicitly observing the actual number of requests that are queued in each Fog node nor observing the compute resource capabilities of those nodes. Besides improving the performance of these agents, we propose in this paper a lifelong learning framework for these agents, where lightweight inference models are used during deployment to minimize action delay and only retrained in case of significant environmental changes. To improve the performance, minimize the training cost, and adapt the agents to those changes, we explore the application of Transfer Learning (TL). TL transfers the knowledge acquired from a source domain and applies it to a target domain, enabling the reuse of learned policies and experiences. TL can be also used to pre-train the agent in simulation before fine-tuning it in the real environment; this significantly reduces failure probability compared to learning from scratch in the real environment. To our knowledge, there are no existing efforts in the literature that use TL to address lifelong learning for RL-based Fog LB; this is one of the main obstacles in deploying RL LB solutions in Fog systems.


title: Gradient estimates and parabolic frequency under the Laplacian G_2 flow

abstract: In this paper, we consider the Laplacian G_2 flow on a closed seven-dimensional manifold M with a closed G_2-structure. We first obtain the gradient estimates of positive solutions of the heat equation under the Laplacian G_2 flow and then we get the Harnack inequality on spacetime. As an application, we prove the monotonicity for positive solutions of the heat equation with bounded Ricci curvature, and get the integral-type Harnack inequality. Besides, we prove the monotonicity of parabolic frequency for positive solutions of the linear heat equation with bounded Bakry-Emery Ricci curvature, and then obtain the backward uniqueness.


title: Factuality Challenges in the Era of Large Language Models

abstract: The emergence of tools based on Large Language Models (LLMs), such as OpenAI's ChatGPT, Microsoft's Bing Chat, and Google's Bard, has garnered immense public attention. These incredibly useful, natural-sounding tools mark significant advances in natural language generation, yet they exhibit a propensity to generate false, erroneous, or misleading content -- commonly referred to as "hallucinations." Moreover, LLMs can be exploited for malicious applications, such as generating false but credible-sounding content and profiles at scale. This poses a significant challenge to society in terms of the potential deception of users and the increasing dissemination of inaccurate information. In light of these risks, we explore the kinds of technological innovations, regulatory reforms, and AI literacy initiatives needed from fact-checkers, news organizations, and the broader research and policy communities. By identifying the risks, the imminent threats, and some viable solutions, we seek to shed light on navigating various aspects of veracity in the era of generative AI.


title: Scalar field perturbation around a rotating hairy black hole: quasinormal modes, quasibound states and superradiant instability

abstract: We consider the quasinormal modes, quasibound states and superradiant instability of a rotating hairy black hole, which possesses a Horndeski hair as deviation from Kerr black hole, under the perturbation of massive scalar field. With the use of the matrix method, we mainly calculate the eigenfrequencies related to those modes of the perturbation. Under the perturbation of the massless scalar field, the Horndeski hair and spin parameter have significant influences on the quasinormal frequency, but its imaginary part is always finite negative and no unstable mode is found. Under the perturbation of the massive scalar field, we focus on the eigenfrequencies of quasibound states and find the modes of which the imaginary part of eigenfrequencies is positive, indicating that the black hole undergoes superradiant instability. Then we scan the parameters and figure out a diagram in the space of Horndeski hair and spin parameters to distinguish the rotating hairy black hole with superradiant instability from the stable one.


title: FABRIC: Automated Scoring and Feedback Generation for Essays

abstract: Automated essay scoring (AES) provides a useful tool for students and instructors in writing classes by generating essay scores in real-time. However, previous AES models do not provide more specific rubric-based scores nor feedback on how to improve the essays, which can be even more important than the overall scores for learning. We present FABRIC, a pipeline to help students and instructors in English writing classes by automatically generating 1) the overall scores, 2) specific rubric-based scores, and 3) detailed feedback on how to improve the essays. Under the guidance of English education experts, we chose the rubrics for the specific scores as content, organization, and language. The first component of the FABRIC pipeline is DREsS, a real-world Dataset for Rubric-based Essay Scoring (DREsS). The second component is CASE, a Corruption-based Augmentation Strategy for Essays, with which we can improve the accuracy of the baseline model by 45.44%. The third component is EssayCoT, the Essay Chain-of-Thought prompting strategy which uses scores predicted from the AES model to generate better feedback. We evaluate the effectiveness of the new dataset DREsS and the augmentation strategy CASE quantitatively and show significant improvements over the models trained with existing datasets. We evaluate the feedback generated by EssayCoT with English education experts to show significant improvements in the helpfulness of the feedback across all rubrics. Lastly, we evaluate the FABRIC pipeline with students in a college English writing class who rated the generated scores and feedback with an average of 6 on the Likert scale from 1 to 7.


title: HOD: A Benchmark Dataset for Harmful Object Detection

abstract: Recent multi-media data such as images and videos have been rapidly spread out on various online services such as social network services (SNS). With the explosive growth of online media services, the number of image content that may harm users is also growing exponentially. Thus, most recent online platforms such as Facebook and Instagram have adopted content filtering systems to prevent the prevalence of harmful content and reduce the possible risk of adverse effects on users. Unfortunately, computer vision research on detecting harmful content has not yet attracted attention enough. Users of each platform still manually click the report button to recognize patterns of harmful content they dislike when exposed to harmful content. However, the problem with manual reporting is that users are already exposed to harmful content. To address these issues, our research goal in this work is to develop automatic harmful object detection systems for online services. We present a new benchmark dataset for harmful object detection. Unlike most related studies focusing on a small subset of object categories, our dataset addresses various categories. Specifically, our proposed dataset contains more than 10,000 images across 6 categories that might be harmful, consisting of not only normal cases but also hard cases that are difficult to detect. Moreover, we have conducted extensive experiments to evaluate the effectiveness of our proposed dataset. We have utilized the recently proposed state-of-the-art (SOTA) object detection architectures and demonstrated our proposed dataset can be greatly useful for the real-time harmful object detection task. The whole source codes and datasets are publicly accessible at https://github.com/poori-nuna/HOD-Benchmark-Dataset.


title: Improving Discriminative Multi-Modal Learning with Large-Scale Pre-Trained Models

abstract: This paper investigates how to better leverage large-scale pre-trained uni-modal models to further enhance discriminative multi-modal learning. Even when fine-tuned with only uni-modal data, these models can outperform previous multi-modal models in certain tasks. It's clear that their incorporation into multi-modal learning would significantly improve performance. However, multi-modal learning with these models still suffers from insufficient learning of uni-modal features, which weakens the resulting multi-modal model's generalization ability. While fine-tuning uni-modal models separately and then aggregating their predictions is straightforward, it doesn't allow for adequate adaptation between modalities, also leading to sub-optimal results. To this end, we introduce Multi-Modal Low-Rank Adaptation learning (MMLoRA). By freezing the weights of uni-modal fine-tuned models, adding extra trainable rank decomposition matrices to them, and subsequently performing multi-modal joint training, our method enhances adaptation between modalities and boosts overall performance. We demonstrate the effectiveness of MMLoRA on three dataset categories: audio-visual (e.g., AVE, Kinetics-Sound, CREMA-D), vision-language (e.g., MM-IMDB, UPMC Food101), and RGB-Optical Flow (UCF101).


title: Wave function of the sexaquark or compact H-dibaryon

abstract: We derive and explicitly display the internal wave function of a color-, flavor- and spin- singlet dibaryon composed of uuddss quarks in a spatially symmetric state, in the approximation of exact SU(3) flavor symmetry. This wavefunction shows that the often-used superposition of Lambda Lambda, N Xi and Sigma Sigma baryons, relevant for di-baryon molecules, accounts for only 1/5 of a spatially symmetric six-quark color-flavor-spin-singlet state, with the remaining 4/5 consisting of products of color-octet baryons. Using the correct wavefunction has important implications for calculations of the mass of the lowest-lying flavor-singlet dibaryon, as we illustrate using the Cornell potential. We also provide a compact representation of the state in terms of creation operators, and comment on the impact of not using the optimal operator in lattice studies of this system.


title: GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrieval

abstract: Given a text query, partially relevant video retrieval (PRVR) seeks to find untrimmed videos containing pertinent moments in a database. For PRVR, clip modeling is essential to capture the partial relationship between texts and videos. Current PRVR methods adopt scanning-based clip construction to achieve explicit clip modeling, which is information-redundant and requires a large storage overhead. To solve the efficiency problem of PRVR methods, this paper proposes GMMFormer, a Gaussian-Mixture-Model based Transformer which models clip representations implicitly. During frame interactions, we incorporate Gaussian-Mixture-Model constraints to focus each frame on its adjacent frames instead of the whole video. Then generated representations will contain multi-scale clip information, achieving implicit clip modeling. In addition, PRVR methods ignore semantic differences between text queries relevant to the same video, leading to a sparse embedding space. We propose a query diverse loss to distinguish these text queries, making the embedding space more intensive and contain more semantic information. Extensive experiments on three large-scale video datasets (i.e., TVR, ActivityNet Captions, and Charades-STA) demonstrate the superiority and efficiency of GMMFormer. Code is available at \url{https://github.com/huangmozhi9527/GMMFormer}.


title: On families of K3 surfaces with real multiplication

abstract: We exhibit large families of K3 surfaces with real multiplication, both abstractly using lattice theory, the Torelli theorem and the surjectivity of the period map, as well as explicitly using dihedral covers and isogenies.


title: Clustering in quasi-two-dimensional dispersions of Brownian particles with competitive interactions: Phase diagram and structural properties

abstract: Competing short-range attractive (SA) and long range repulsive (LR) interactions have been invoked to describe colloid or protein solutions, as well as membrane proteins interactions mediated by lipid molecules. Using Langevin dynamics simulations, we determine the generalized phase diagram, the cluster shapes and size distributions of a generic Q2D dispersion of spherical SALR particles confined to in-plane motion. SA and LR interactions are modelled by a generalized Lenard-Jones potential and a screened Coulomb potential, respectively. The microstructures of the various equilibrium and non-equilibrium phases turn out to be distinctly different from the ones observed in three-dimensional (3D) SALR systems. We discuss perturbation theory predictions for the metastable binodal line of a reference system of particles with SA interactions only, which in the Q2D-SALR phase diagram separates cluster from non-cluster phases. The transition from the high-temperature (low SA) dispersed fluid phase to the lower-temperature equilibrium cluster phase is characterised by a low-wavenumber peak of the static structure factor (corresponding to a thermal correlation length of about twice the particle diameter) featuring a distinctly smaller height ($\approx1.4$) than in 3D SALR systems. By further decreasing the temperature (increasing SA), the cluster morphology changes from disk-like shapes in the equilibrium cluster phase, to double-stranded anisotropic hexagonal cluster forms in the cluster-percolated gel phase. This transition is quantified by the hexagonal order parameter distribution function. The mean cluster size and coordination number of particles in the gel phase are insensitive to changes in the attraction strength.


title: Indoor Localization for an Autonomous Model Car: A Marker-Based Multi-Sensor Fusion Framework

abstract: Global navigation satellite systems readily provide accurate position information when localizing a robot outdoors. However, an analogous standard solution does not exist yet for mobile robots operating indoors. This paper presents an integrated framework for indoor localization and experimental validation of an autonomous driving system based on an advanced driver-assistance system (ADAS) model car. The global pose of the model car is obtained by fusing information from fiducial markers, inertial sensors and wheel odometry. In order to achieve robust localization, we investigate and compare two extensions to the Extended Kalman Filter; first with adaptive noise tuning and second with Chi-squared test for measurement outlier detection. An efficient and low-cost ground truth measurement method using a single LiDAR sensor is also proposed to validate the results. The performance of the localization algorithms is tested on a complete autonomous driving system with trajectory planning and model predictive control.


title: Loose lips sink ships: Mitigating Length Bias in Reinforcement Learning from Human Feedback

abstract: Reinforcement learning from human feedback serves as a crucial bridge, aligning large language models with human and societal values. This alignment requires a vast corpus of human feedback to learn a reward model, which is subsequently used to finetune language models. However, we have identified that the reward model often finds shortcuts to bypass its intended objectives, misleadingly assuming that humans prefer longer responses. The emergence of length bias often induces the model to favor longer outputs, yet it doesn't equate to an increase in helpful information within these outputs. In this paper, we propose an innovative solution, applying the Product-of-Experts (PoE) technique to separate reward modeling from the influence of sequence length. In our framework, the main expert concentrates on understanding human intents, while the biased expert targets the identification and capture of length bias. To further enhance the learning of bias, we introduce perturbations into the bias-focused expert, disrupting the flow of semantic information. Experimental results validate the effectiveness of our approach, indicating that language model performance is improved, irrespective of sequence length.


title: Boson stars in massless and massive scalar-tensor gravity

abstract: We study phenomenological features and stability of boson stars in massless and massive scalar-tensor theory of gravity with Damour-Esposito-Farese coupling. This coupling between the tensor and scalar sectors of the theory leads to a phenomenon called spontaneous scalarization, the onset of which we investigate by numerically computing families of boson-star models using shooting and relaxation algorithms. We systematically explore the effects of the theory's coupling, the mass of the gravitational scalar and the choice of the bosonic potential on the structure of weakly and strongly scalarized solutions. Scalarized boson-star models share many common features with neutron stars in the same scalar-tensor theory of gravity. In particular, scalarization can result in boson stars with significantly larger radii and masses, which tend to be energetically favored over their weakly or non-scalarized counterparts. Overall, we find that boson stars are not quite as susceptible to scalarization as neutron stars.


title: Photo-induced nonequilibrium states in Mott insulators

abstract: The study of nonequilibrium phenomena in interacting lattice systems can provide new perspectives on correlation effects, and information on metastable states of matter. Mott insulators are a promising class of systems for nonequilibrium studies, since they exhibit exotic phenomena and complex phase diagrams upon doping, and because a large Mott gap provides protection against fast thermalization and heating after photo-excitations. We can thus expect the emergence of interesting transient states and photo-induced phases in Mott systems. This review presents the current understanding of the mechanisms which control the time evolution of photo-doped charge carriers and the properties of photo-induced metastable states. We focus on recent theoretical progress, identify the relevant underlying concepts, and link them to experimental observations. The review starts with a general discussion of field-induced nonequilibrium setups and an overview of key experiments which revealed characteristic properties of photo-excited Mott states, proceeds with a compact overview of the theoretical tools which have been developed to investigate these strongly correlated nonequilibrium states, and then analyzes Mott insulators driven out of equilibrium by static electric fields, periodic fields, and short laser pulses. We also discuss the appearance of nonthermal electronic orders in photo-excited Mott systems, including nonthermal spin and orbital orders, $\eta$ pairing states, and novel types of excitonic orders.


title: Enhancing Cross-Dataset Performance of Distracted Driving Detection With Score-Softmax Classifier

abstract: Deep neural networks enable real-time monitoring of in-vehicle driver, facilitating the timely prediction of distractions, fatigue, and potential hazards. This technology is now integral to intelligent transportation systems. Recent research has exposed unreliable cross-dataset end-to-end driver behavior recognition due to overfitting, often referred to as ``shortcut learning", resulting from limited data samples. In this paper, we introduce the Score-Softmax classifier, which addresses this issue by enhancing inter-class independence and Intra-class uncertainty. Motivated by human rating patterns, we designed a two-dimensional supervisory matrix based on marginal Gaussian distributions to train the classifier. Gaussian distributions help amplify intra-class uncertainty while ensuring the Score-Softmax classifier learns accurate knowledge. Furthermore, leveraging the summation of independent Gaussian distributed random variables, we introduced a multi-channel information fusion method. This strategy effectively resolves the multi-information fusion challenge for the Score-Softmax classifier. Concurrently, we substantiate the necessity of transfer learning and multi-dataset combination. We conducted cross-dataset experiments using the SFD, AUCDD-V1, and 100-Driver datasets, demonstrating that Score-Softmax improves cross-dataset performance without modifying the model architecture. This provides a new approach for enhancing neural network generalization. Additionally, our information fusion approach outperforms traditional methods.


title: A Comparative Study of Voice Conversion Models with Large-Scale Speech and Singing Data: The T13 Systems for the Singing Voice Conversion Challenge 2023

abstract: This paper presents our systems (denoted as T13) for the singing voice conversion challenge (SVCC) 2023. For both in-domain and cross-domain English singing voice conversion (SVC) tasks (Task 1 and Task 2), we adopt a recognition-synthesis approach with self-supervised learning-based representation. To achieve data-efficient SVC with a limited amount of target singer/speaker's data (150 to 160 utterances for SVCC 2023), we first train a diffusion-based any-to-any voice conversion model using publicly available large-scale 750 hours of speech and singing data. Then, we finetune the model for each target singer/speaker of Task 1 and Task 2. Large-scale listening tests conducted by SVCC 2023 show that our T13 system achieves competitive naturalness and speaker similarity for the harder cross-domain SVC (Task 2), which implies the generalization ability of our proposed method. Our objective evaluation results show that using large datasets is particularly beneficial for cross-domain SVC.


title: Towards Optimizing with Large Language Models

abstract: In this work, we conduct an assessment of the optimization capabilities of LLMs across various tasks and data sizes. Each of these tasks corresponds to unique optimization domains, and LLMs are required to execute these tasks with interactive prompting. That is, in each optimization step, the LLM generates new solutions from the past generated solutions with their values, and then the new solutions are evaluated and considered in the next optimization step. Additionally, we introduce three distinct metrics for a comprehensive assessment of task performance from various perspectives. These metrics offer the advantage of being applicable for evaluating LLM performance across a broad spectrum of optimization tasks and are less sensitive to variations in test samples. By applying these metrics, we observe that LLMs exhibit strong optimization capabilities when dealing with small-sized samples. However, their performance is significantly influenced by factors like data size and values, underscoring the importance of further research in the domain of optimization tasks for LLMs.


title: GEAR: A GPU-Centric Experience Replay System for Large Reinforcement Learning Models

abstract: This paper introduces a distributed, GPU-centric experience replay system, GEAR, designed to perform scalable reinforcement learning (RL) with large sequence models (such as transformers). With such models, existing systems such as Reverb face considerable bottlenecks in memory, computation, and communication. GEAR, however, optimizes memory efficiency by enabling the memory resources on GPU servers (including host memory and device memory) to manage trajectory data. Furthermore, it facilitates decentralized GPU devices to expedite various trajectory selection strategies, circumventing computational bottlenecks. GEAR is equipped with GPU kernels capable of collecting trajectories using zero-copy access to host memory, along with remote-directed-memory access over InfiniBand, improving communication efficiency. Cluster experiments have shown that GEAR can achieve performance levels up to 6x greater than Reverb when training state-of-the-art large RL models. GEAR is open-sourced at https://github.com/bigrl-team/gear.


title: COALAS II. Extended molecular gas reservoirs are common in a distant, forming galaxy cluster

abstract: This paper presents the results of 475 hours of interferometric observations with the Australia Telescope Compact Array towards the Spiderweb protocluster at \(z=2.16\). We search for large, extended molecular gas reservoirs among 46 previously detected CO(1-0) emitters, employing a customised method we developed. Based on the CO emission images and position-velocity diagrams, as well as the ranking of sources using a binary weighting of six different criteria, we have identified 14 robust and 7 tentative candidates that exhibit large extended molecular gas reservoirs. These extended reservoirs are defined as having sizes greater than 40 kpc or super-galactic scale. This result suggests a high frequency of extended gas reservoirs, comprising at least \(30 \%\) of our CO-selected sample. An environmental study of the candidates is carried out based on N-th nearest neighbour and we find that the large molecular gas reservoirs tend to exist in denser regions. The spatial distribution of our candidates is mainly centred on the core region of the Spiderweb protocluster. The performance and adaptability of our method are discussed. We found 13 (potentially) extended gas reservoirs located in nine galaxy (proto)clusters from the literature. We noticed that large extended molecular gas reservoirs surrounding (normal) star-forming galaxies in protoclusters are rare. This may be attributable to the lack of observations low-J CO transitions and the lack of quantitative analyses of molecular gas morphologies. The large gas reservoirs in the Spiderweb protocluster are a potential source of the intracluster medium seen in low redshift Virgo- or Coma-like galaxy clusters.


title: Boosting Facial Action Unit Detection Through Jointly Learning Facial Landmark Detection and Domain Separation and Reconstruction

abstract: Recently how to introduce large amounts of unlabeled facial images in the wild into supervised Facial Action Unit (AU) detection frameworks has become a challenging problem. In this paper, we propose a new AU detection framework where multi-task learning is introduced to jointly learn AU domain separation and reconstruction and facial landmark detection by sharing the parameters of homostructural facial extraction modules. In addition, we propose a new feature alignment scheme based on contrastive learning by simple projectors and an improved contrastive loss, which adds four additional intermediate supervisors to promote the feature reconstruction process. Experimental results on two benchmarks demonstrate our superiority against the state-of-the-art methods for AU detection in the wild.