title: Accelerating Sparse Tensor Decomposition Using Adaptive Linearized Representation

abstract: High-dimensional sparse data emerge in many critical application domains such as cybersecurity, healthcare, anomaly detection, and trend analysis. To quickly extract meaningful insights from massive volumes of these multi-dimensional data, scientists employ unsupervised analysis tools based on tensor decomposition (TD) methods. However, real-world sparse tensors exhibit highly irregular shapes, data distributions, and sparsity, which pose significant challenges for making efficient use of modern parallel architectures. This study breaks the prevailing assumption that compressing sparse tensors into coarse-grained structures (i.e., tensor slices or blocks) or along a particular dimension/mode (i.e., mode-specific) is more efficient than keeping them in a fine-grained, mode-agnostic form. Our novel sparse tensor representation, Adaptive Linearized Tensor Order (ALTO), encodes tensors in a compact format that can be easily streamed from memory and is amenable to both caching and parallel execution. To demonstrate the efficacy of ALTO, we accelerate popular TD methods that compute the Canonical Polyadic Decomposition (CPD) model across a range of real-world sparse tensors. Additionally, we characterize the major execution bottlenecks of TD methods on multiple generations of the latest Intel Xeon Scalable processors, including Sapphire Rapids CPUs, and introduce dynamic adaptation heuristics to automatically select the best algorithm based on the sparse tensor characteristics. Across a diverse set of real-world data sets, ALTO outperforms the state-of-the-art approaches, achieving more than an order-of-magnitude speedup over the best mode-agnostic formats. Compared to the best mode-specific formats, which require multiple tensor copies, ALTO achieves more than 5.1x geometric mean speedup at a fraction (25%) of their storage.


title: MOAB: Multi-Modal Outer Arithmetic Block For Fusion Of Histopathological Images And Genetic Data For Brain Tumor Grading

abstract: Brain tumors are an abnormal growth of cells in the brain. They can be classified into distinct grades based on their growth. Often grading is performed based on a histological image and is one of the most significant predictors of a patients prognosis, the higher the grade, the more aggressive the tumor. Correct diagnosis of a tumor grade remains challenging. Though histopathological grading has been shown to be prognostic, results are subject to interobserver variability, even among experienced pathologists. Recently, the World Health Organization reported that advances in molecular genetics have led to improvements in tumor classification. This paper seeks to integrate histological images and genetic data for improved computer-aided diagnosis. We propose a novel Multi-modal Outer Arithmetic Block (MOAB) based on arithmetic operations to combine latent representations of the different modalities for predicting the tumor grade (Grade \rom{2}, \rom{3} and \rom{4}). Extensive experiments evaluate the effectiveness of our approach. By applying MOAB to The Cancer Genome Atlas (TCGA) glioma dataset, we show that it can improve separation between similar classes (Grade \rom{2} and \rom{3}) and outperform prior state-of-the-art grade classification techniques.


title: IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages

abstract: Despite the considerable advancements in English LLMs, the progress in building comparable models for other languages has been hindered due to the scarcity of tailored resources. Our work aims to bridge this divide by introducing an expansive suite of resources specifically designed for the development of Indic LLMs, covering 22 languages, containing a total of 251B tokens and 74.8M instruction-response pairs. Recognizing the importance of both data quality and quantity, our approach combines highly curated manually verified data, unverified yet valuable data, and synthetic data. We build a clean, open-source pipeline for curating pre-training data from diverse sources, including websites, PDFs, and videos, incorporating best practices for crawling, cleaning, flagging, and deduplication. For instruction-fine tuning, we amalgamate existing Indic datasets, translate/transliterate English datasets into Indian languages, and utilize LLaMa2 and Mixtral models to create conversations grounded in articles from Indian Wikipedia and Wikihow. Additionally, we address toxicity alignment by generating toxic prompts for multiple scenarios and then generate non-toxic responses by feeding these toxic prompts to an aligned LLaMa2 model. We hope that the datasets, tools, and resources released as a part of this work will not only propel the research and development of Indic LLMs but also establish an open-source blueprint for extending such efforts to other languages. The data and other artifacts created as part of this work are released with permissive licenses.


title: Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos

abstract: We investigate exocentric-to-egocentric cross-view translation, which aims to generate a first-person (egocentric) view of an actor based on a video recording that captures the actor from a third-person (exocentric) perspective. To this end, we propose a generative framework called Exo2Ego that decouples the translation process into two stages: high-level structure transformation, which explicitly encourages cross-view correspondence between exocentric and egocentric views, and a diffusion-based pixel-level hallucination, which incorporates a hand layout prior to enhance the fidelity of the generated egocentric view. To pave the way for future advancements in this field, we curate a comprehensive exo-to-ego cross-view translation benchmark. It consists of a diverse collection of synchronized ego-exo tabletop activity video pairs sourced from three public datasets: H2O, Aria Pilot, and Assembly101. The experimental results validate that Exo2Ego delivers photorealistic video results with clear hand manipulation details and outperforms several baselines in terms of both synthesis quality and generalization ability to new actions.


title: Exploring Hardware Friendly Bottleneck Architecture in CNN for Embedded Computing Systems

abstract: In this paper, we explore how to design lightweight CNN architecture for embedded computing systems. We propose L-Mobilenet model for ZYNQ based hardware platform. L-Mobilenet can adapt well to the hardware computing and accelerating, and its network structure is inspired by the state-of-the-art work of Inception-ResnetV1 and MobilenetV2, which can effectively reduce parameters and delay while maintaining the accuracy of inference. We deploy our L-Mobilenet model to ZYNQ embedded platform for fully evaluating the performance of our design. By measuring in cifar10 and cifar100 datasets, L-Mobilenet model is able to gain 3x speed up and 3.7x fewer parameters than MobileNetV2 while maintaining a similar accuracy. It also can obtain 2x speed up and 1.5x fewer parameters than ShufflenetV2 while maintaining the same accuracy. Experiments show that our network model can obtain better performance because of the special considerations for hardware accelerating and software-hardware co-design strategies in our L-Mobilenet bottleneck architecture.


title: A strong law of large numbers for real roots of random polynomials

abstract: We consider random polynomials $p_n(x)=\xi_0+\xi_1+\dots+\xi_n x^n$ whose coefficients are independent and identically distributed with zero mean, unit variance, and bounded $(2+\epsilon)^{th}$ moment (for some $\epsilon>0$), also known as the Kac polynomials. Let $N_n$ denote the number of real roots of $p_n$. In this paper, motivated by a question from Igor Pritsker, we prove that almost surely the following convergence holds: \begin{eqnarray*} \lim_{n\to\infty} \frac{N_n([-1,1])}{\log n} &=& \frac 1 \pi. \end{eqnarray*} This convergence could be viewed as a local strong law for the real roots. The main ingredient in the proof is a set of maximal inequalities that reduces the proof to proving convergence along lacunary subsequences, which in turn follows from a recent concentration estimate of Can--Nguyen.


title: Amharic LLaMA and LLaVA: Multimodal LLMs for Low Resource Languages

abstract: Large Language Models (LLMs) like GPT-4 and LLaMA have shown incredible proficiency at natural language processing tasks and have even begun to excel at tasks across other modalities such as vision and audio. Despite their success, LLMs often struggle to perform well on low-resource languages because there is so little training data available. This shortcoming is especially prevalent with open source models. In this work, we explore training LLaMA-2 to speak Amharic, a language which is spoken by over 50 million people world wide, but has orders of magnitude less data available than languages like English. We employ methods previously used for training LLMs on other languages with data scarcity, and use open source translation models to perform data augmentation and grow our dataset from millions of tokens to billions. We further enhance the capabilities of our model by connecting an image encoder and training on a translated visual instruction tuning dataset in the same manner as LLaVA, resulting in a multimodal Amharic LLM that can understand images along with text. We introduce an Amharic version of a popular benchmarking dataset to evaluate our work. Our models and dataset are open sourced and available on GitHub.


title: Multi-modal Semantic Understanding with Contrastive Cross-modal Feature Alignment

abstract: Multi-modal semantic understanding requires integrating information from different modalities to extract users' real intention behind words. Most previous work applies a dual-encoder structure to separately encode image and text, but fails to learn cross-modal feature alignment, making it hard to achieve cross-modal deep information interaction. This paper proposes a novel CLIP-guided contrastive-learning-based architecture to perform multi-modal feature alignment, which projects the features derived from different modalities into a unified deep space. On multi-modal sarcasm detection (MMSD) and multi-modal sentiment analysis (MMSA) tasks, the experimental results show that our proposed model significantly outperforms several baselines, and our feature alignment strategy brings obvious performance gain over models with different aggregating methods and models even enriched with knowledge. More importantly, our model is simple to implement without using task-specific external knowledge, and thus can easily migrate to other multi-modal tasks. Our source codes are available at https://github.com/ChangKe123/CLFA.


title: Video Generation with Consistency Tuning

abstract: Currently, various studies have been exploring generation of long videos. However, the generated frames in these videos often exhibit jitter and noise. Therefore, in order to generate the videos without these noise, we propose a novel framework composed of four modules: separate tuning module, average fusion module, combined tuning module, and inter-frame consistency module. By applying our newly proposed modules subsequently, the consistency of the background and foreground in each video frames is optimized. Besides, the experimental results demonstrate that videos generated by our method exhibit a high quality in comparison of the state-of-the-art methods.


title: Inference for Median and a Generalization of HulC

abstract: Constructing distribution-free confidence intervals for the median, a classic problem in statistics, has seen numerous solutions in the literature. While coverage validity has received ample attention, less has been explored about interval width. Our study breaks new ground by investigating the width of these intervals under non-standard assumptions. Surprisingly, we find that properly scaled, the interval width converges to a non-degenerate random variable, unlike traditional intervals. We also adapt our findings for constructing improved confidence intervals for general parameters, enhancing the existing HulC procedure. These advances provide practitioners with more robust tools for data analysis, reducing the need for strict distributional assumptions.


title: Compact Objects in close orbits as Gravitational Wave Sources: Formation Scenarios and Properties

abstract: Gravitational Waves (GWs) provide a unique way to explore our Universe. The ongoing ground-based detectors, e.g., LIGO, Virgo, and KAGRA, and the upcoming next-generation detectors, e.g., Cosmic Explorer and Einstein Telescope, as well as the future space-borne GW antennas, e.g., LISA, TianQin, and TaiJi, cover a wide range of GW frequencies {from $\sim 10^{-4}\;\rm Hz$ to $\sim 10^3\;\rm Hz$} and almost all types of compact objects in close orbits serve as the potential target sources for these GW detectors. The synergistic multi-band GW and EM observations would allow us to study fundamental physics from stars to cosmology. {The formation of stellar GW sources has been extensively explored in recent years, and progress on physical processes in binary interaction has been made as well. Furthermore, some studies have shown that the progress in binary evolution may significantly affect the properties of the stellar GW sources.}


title: Electrical Degradation in Dielectric and Piezoelectric Oxides: Review of Defect Chemistry and Associated Characterization Techniques

abstract: The properties of dielectric and piezoelectric oxides are determined by their processing history, crystal structure, chemical composition, microstructure, dopants (or defect) distribution, and defect kinetics. These materials are essential in a diverse range of applications including aerospace, medical, military, transportation, power engineering, and communication, where they are used as ceramic discs, thick and thin films, multilayer devices, etc. Significant advances in understanding the materials, processing, properties, and reliability of these materials have led to their widespread use in consumer electronics, military, and aerospace applications. This review delves into electrical degradation in dielectrics and piezoelectrics, focusing on defect chemistry and key characterization techniques. It also provides a detailed discussion of various spectroscopic, microscopic, and electronic characterization techniques essential for analyzing defects and degradation mechanisms.


title: Human and Automatic Interpretation of Romanian Noun Compounds

abstract: Determining the intended, context-dependent meanings of noun compounds like "shoe sale" and "fire sale" remains a challenge for NLP. Previous work has relied on inventories of semantic relations that capture the different meanings between compound members. Focusing on Romanian compounds, whose morphosyntax differs from that of their English counterparts, we propose a new set of relations and test it with human annotators and a neural net classifier. Results show an alignment of the network's predictions and human judgments, even where the human agreement rate is low. Agreement tracks with the frequency of the selected relations, regardless of structural differences. However, the most frequently selected relation was none of the sixteen labeled semantic relations, indicating the need for a better relation inventory.


title: See Through Their Minds: Learning Transferable Neural Representation from Cross-Subject fMRI

abstract: Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily employ subject-specific models, sensitive to training sample size. In this paper, we explore a straightforward but overlooked solution to address data scarcity. We propose shallow subject-specific adapters to map cross-subject fMRI data into unified representations. Subsequently, a shared deeper decoding model decodes cross-subject features into the target feature space. During training, we leverage both visual and textual supervision for multi-modal brain decoding. Our model integrates a high-level perception decoding pipeline and a pixel-wise reconstruction pipeline guided by high-level perceptions, simulating bottom-up and top-down processes in neuroscience. Empirical experiments demonstrate robust neural representation learning across subjects for both pipelines. Moreover, merging high-level and low-level information improves both low-level and high-level reconstruction metrics. Additionally, we successfully transfer learned general knowledge to new subjects by training new adapters with limited training data. Compared to previous state-of-the-art methods, notably pre-training-based methods (Mind-Vis and fMRI-PTE), our approach achieves comparable or superior results across diverse tasks, showing promise as an alternative method for cross-subject fMRI data pre-training. Our code and pre-trained weights will be publicly released at https://github.com/YulongBonjour/See_Through_Their_Minds.


title: An Alternative to Stride-Based RNG for Monte Carlo Transport

abstract: The techniques used to generate pseudo-random numbers for Monte Carlo (MC) applications bear many implications on the quality and speed of that programs work. As a random number generator (RNG) slows, the production of random numbers begins to dominate runtime. As RNG output grows in correlation, the final product becomes less reliable. These difficulties are further compounded by the need for reproducibility and parallelism. For reproducibility, the numbers generated to determine any outcome must be the same each time a simulation is run. However, the concurrency that comes with most parallelism introduces race conditions. To have both reproducibility and concurrency, separate RNG states must be tracked for each independently schedulable unit of simulation, forming independent random number streams. We propose an alternative to the stride-based parallel LCG seeding approach that scales more practically with increased concurrency and workload by generating seeds through hashing and allowing for repeated outputs. Data gathered from normality tests of tally results from simple MC transport benchmark calculations indicates that the proposed hash-based RNG does not significantly affect the tally result normality property as compared to the conventional stride-based RNG.


title: Say Anything with Any Style

abstract: Generating stylized talking head with diverse head motions is crucial for achieving natural-looking videos but still remains challenging. Previous works either adopt a regressive method to capture the speaking style, resulting in a coarse style that is averaged across all training data, or employ a universal network to synthesize videos with different styles which causes suboptimal performance. To address these, we propose a novel dynamic-weight method, namely Say Anything withAny Style (SAAS), which queries the discrete style representation via a generative model with a learned style codebook. Specifically, we develop a multi-task VQ-VAE that incorporates three closely related tasks to learn a style codebook as a prior for style extraction. This discrete prior, along with the generative model, enhances the precision and robustness when extracting the speaking styles of the given style clips. By utilizing the extracted style, a residual architecture comprising a canonical branch and style-specific branch is employed to predict the mouth shapes conditioned on any driving audio while transferring the speaking style from the source to any desired one. To adapt to different speaking styles, we steer clear of employing a universal network by exploring an elaborate HyperStyle to produce the style-specific weights offset for the style branch. Furthermore, we construct a pose generator and a pose codebook to store the quantized pose representation, allowing us to sample diverse head motions aligned with the audio and the extracted style. Experiments demonstrate that our approach surpasses state-of-theart methods in terms of both lip-synchronization and stylized expression. Besides, we extend our SAAS to video-driven style editing field and achieve satisfactory performance.


title: MP2-based composite extrapolation schemes can predict core-ionization energies for first-row elements with coupled-cluster level accuracy

abstract: X-ray photoelectron spectroscopy (XPS) measures core-electron binding energies (CEBEs) to reveal element-specific insights into chemical environment and bonding. Accurate theoretical CEBE prediction aids XPS interpretation but requires proper modeling of orbital relaxation and electron correlation upon core-ionization. This work systematically investigates basis set selection for extrapolation to the complete basis set (CBS) limit of CEBEs from $\Delta$MP2 and $\Delta$CC energies across 94 K-edges in diverse organic molecules. We demonstrate that an alternative composite scheme using $\Delta$MP2 in a large basis corrected by $\Delta$CC-$\Delta$MP2 difference in a small basis can quantitatively recover optimally extrapolated $\Delta$CC CEBEs within 0.02 eV. Unlike $\Delta$CC, MP2 calculations do not suffer from convergence issues and are computationally cheaper, and, thus, the composite $\Delta$MP2/$\Delta$CC scheme balances accuracy and cost, overcoming limitations of solely using either method. We conclude by providing a comprehensive analysis of the choice of small and large basis sets for the composite schemes and provide practical recommendations for highly accurate (within 0.10-0.15 eV MAE) ab initio prediction of XPS spectra.


title: Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style

abstract: Although automatically animating audio-driven talking heads has recently received growing interest, previous efforts have mainly concentrated on achieving lip synchronization with the audio, neglecting two crucial elements for generating expressive videos: emotion style and art style. In this paper, we present an innovative audio-driven talking face generation method called Style2Talker. It involves two stylized stages, namely Style-E and Style-A, which integrate text-controlled emotion style and picture-controlled art style into the final output. In order to prepare the scarce emotional text descriptions corresponding to the videos, we propose a labor-free paradigm that employs large-scale pretrained models to automatically annotate emotional text labels for existing audiovisual datasets. Incorporating the synthetic emotion texts, the Style-E stage utilizes a large-scale CLIP model to extract emotion representations, which are combined with the audio, serving as the condition for an efficient latent diffusion model designed to produce emotional motion coefficients of a 3DMM model. Moving on to the Style-A stage, we develop a coefficient-driven motion generator and an art-specific style path embedded in the well-known StyleGAN. This allows us to synthesize high-resolution artistically stylized talking head videos using the generated emotional motion coefficients and an art style source picture. Moreover, to better preserve image details and avoid artifacts, we provide StyleGAN with the multi-scale content features extracted from the identity image and refine its intermediate feature maps by the designed content encoder and refinement network, respectively. Extensive experimental results demonstrate our method outperforms existing state-of-the-art methods in terms of audio-lip synchronization and performance of both emotion style and art style.


title: Finite-Time Error Analysis of Soft Q-Learning: Switching System Approach

abstract: Soft Q-learning is a variation of Q-learning designed to solve entropy regularized Markov decision problems where an agent aims to maximize the entropy regularized value function. Despite its empirical success, there have been limited theoretical studies of soft Q-learning to date. This paper aims to offer a novel and unified finite-time, control-theoretic analysis of soft Q-learning algorithms. We focus on two types of soft Q-learning algorithms: one utilizing the log-sum-exp operator and the other employing the Boltzmann operator. By using dynamical switching system models, we derive novel finite-time error bounds for both soft Q-learning algorithms. We hope that our analysis will deepen the current understanding of soft Q-learning by establishing connections with switching system models and may even pave the way for new frameworks in the finite-time analysis of other reinforcement learning algorithms.


title: FeatAug: Automatic Feature Augmentation From One-to-Many Relationship Tables

abstract: Feature augmentation from one-to-many relationship tables is a critical but challenging problem in ML model development. To augment good features, data scientists need to come up with SQL queries manually, which is time-consuming. Featuretools [1] is a widely used tool by the data science community to automatically augment the training data by extracting new features from relevant tables. It represents each feature as a group-by aggregation SQL query on relevant tables and can automatically generate these SQL queries. However, it does not include predicates in these queries, which significantly limits its application in many real-world scenarios. To overcome this limitation, we propose FEATAUG, a new feature augmentation framework that automatically extracts predicate-aware SQL queries from one-to-many relationship tables. This extension is not trivial because considering predicates will exponentially increase the number of candidate queries. As a result, the original Featuretools framework, which materializes all candidate queries, will not work and needs to be redesigned. We formally define the problem and model it as a hyperparameter optimization problem. We discuss how the Bayesian Optimization can be applied here and propose a novel warm-up strategy to optimize it. To make our algorithm more practical, we also study how to identify promising attribute combinations for predicates. We show that how the beam search idea can partially solve the problem and propose several techniques to further optimize it. Our experiments on four real-world datasets demonstrate that FeatAug extracts more effective features compared to Featuretools and other baselines. The code is open-sourced at https://github.com/sfu-db/FeatAug


title: A New Testing Method for Justification Bias Using High-Frequency Data of Health and Employment

abstract: Justification bias, wherein retirees may report poorer health to rationalize their retirement, poses a major concern to the widely-used measure of self-assessed health in retirement studies. This paper introduces a novel method for testing the presence of this bias in the spirit of regression discontinuity. The underlying idea is that any sudden shift in self-assessed health immediately following retirement is more likely attributable to the bias. Our strategy is facilitated by a unique high-frequency data that offers monthly, in contrast to the typical biennial, information on employment, self-assessed health, and objective health conditions. Across a wider post-retirement time frame, we observe a decline in self-assessed health, potentially stemming from both justification bias and changes in actual health. However, this adverse effect diminishes with shorter intervals, indicating no evidence of such bias. Our method also validates a widely-used indirect testing approach.


title: Insights into Galaxy Morphology and Star Formation: Unveiling Filamentary Structures around an Extreme Overdensity at $z \sim 1.5$ Traced by [OII] Emitters

abstract: We explore the morphological features and star formation activities of [OII] emitters in the COSMOS UltraDeep field at $z \sim 1.5$ using JWST NIRCam data from the COSMOS-Web survey and Subaru Hyper Suprime-Cam. We also report the discovery of large filamentary structures traced by [OII] emitters, surrounding an extremely overdense core with a galaxy number density $\sim11\times$ higher than the field average. These structures span over 50 cMpc, underscoring their large scale in the cosmic web at this epoch. After matching the stellar mass distributions, the core galaxies show a higher frequency of disturbances (50$\%$ $ \pm$ 9$\%$) than those in outskirts (41$\%$ $ \pm$ 9$\%$) and the field (21$\%$ $ \pm$ 5$\%$), indicative of more frequent mergers and interactions in the innermost $\lesssim1.5 $ arcmin region. Additionally, we observe that specific star formation rates are elevated in denser environments. A Kolmogorov-Smirnov (KS) test comparing the distribution of specific star formation rates of core and field galaxies yields a $\textit{p}$-value of 0.02, suggesting an enhancement of star-formation activity driven by the dense environment. Our findings underscore the environmental impact on galaxy evolution during a pivotal cosmic epoch and set the stage for further investigation with the increasing larger data from upcoming surveys.


title: Tight bound for the Erd\H{o}s-P\'osa property of tree minors

abstract: Let $T$ be a tree on $t$ vertices. We prove that for every positive integer $k$ and every graph $G$, either $G$ contains $k$ pairwise vertex-disjoint subgraphs each having a $T$ minor, or there exists a set $X$ of at most $t(k-1)$ vertices of $G$ such that $G-X$ has no $T$ minor. The bound on the size of $X$ is best possible and improves on an earlier $f(t)k$ bound proved by Fiorini, Joret, and Wood (2013) with some very fast growing function $f(t)$. Moreover, our proof is very short and simple.


title: Ensemble Kalman filter in geoscience meets model predictive control

abstract: Although data assimilation originates from control theory, the relationship between modern data assimilation methods in geoscience and model predictive control has not been extensively explored. In the present paper, I discuss that the modern data assimilation methods in geoscience and model predictive control essentially minimize the similar quadratic cost functions. Inspired by this similarity, I propose a new ensemble Kalman filter (EnKF)-based method for controlling spatio-temporally chaotic systems, which can readily be applied to high-dimensional and nonlinear Earth systems. In this method, the reference vector, which serves as the control target, is assimilated into the state space as a pseudo-observation by ensemble Kalman smoother to obtain the appropriate perturbation to be added to a system. A proof-of-concept experiment using the Lorenz 63 model is presented. The system is constrained in one wing of the butterfly attractor without tipping to the other side by reasonably small control perturbations which are comparable with previous works.


title: Repeated Padding as Data Augmentation for Sequential Recommendation

abstract: Sequential recommendation aims to provide users with personalized suggestions based on their historical interactions. When training sequential models, padding is a widely adopted technique for two main reasons: 1) The vast majority of models can only handle fixed-length sequences; 2) Batching-based training needs to ensure that the sequences in each batch have the same length. The special value \emph{0} is usually used as the padding content, which does not contain the actual information and is ignored in the model calculations. This common-sense padding strategy leads us to a problem that has never been explored before: \emph{Can we fully utilize this idle input space by padding other content to further improve model performance and training efficiency?} In this paper, we propose a simple yet effective padding method called \textbf{Rep}eated \textbf{Pad}ding (\textbf{RepPad}). Specifically, we use the original interaction sequences as the padding content and fill it to the padding positions during model training. This operation can be performed a finite number of times or repeated until the input sequences' length reaches the maximum limit. Our RepPad can be viewed as a sequence-level data augmentation strategy. Unlike most existing works, our method contains no trainable parameters or hyperparameters and is a plug-and-play data augmentation operation. Extensive experiments on various categories of sequential models and five real-world datasets demonstrate the effectiveness and efficiency of our approach. The average recommendation performance improvement is up to 60.3\% on GRU4Rec and 24.3\% on SASRec. We also provide in-depth analysis and explanation of what makes RepPad effective from multiple perspectives. The source code will be released to ensure the reproducibility of our experiments.


title: Dynamic characteristics of terahertz hot-electron graphene FET bolometers: effect of electron cooling in channel and at side contacts

abstract: We analyze the operation of the hot-electron FET bolometers with the graphene channels (GCs) and the gate barrier layers (BLs). Such bolometers use the thermionic emission of the hot electrons heated by incident modulated THz radiation. The hot electron transfer from the GC into the metal gate. As the THz detectors, these bolometers can operate at room temperature. We show that the response and ultimate modulation frequency of the GC-FET bolometers are determined by the efficiency of the hot-electron energy transfer to the lattice and the GC side contacts due to the 2DEG lateral thermal conductance. The dependences of these mechanisms on the band structure and geometrical parameters open the way for the GC-FET bolometers optimization, in particular, for the enhancement of the maximum modulation frequency.


title: Intrinsic polarization conversion and avoided-mode crossing in X-cut lithium niobate microrings

abstract: Compared with well-developed free space polarization converters, polarization conversion between TE and TM modes in waveguide is generally considered to be caused by shape birefringence, like curvature, morphology of waveguide cross section and scattering. Here, we reveal a hidden polarization conversion mechanism in X-cut lithium niobate microrings, that is the conversion can be implemented by birefringence of waveguides, which will also introduce an unavoidable avoided-mode crossing. In the experiment, we find that this mode crossing results in severe suppression of one sideband in local nondegenerate four-wave mixing and disrupts the cascaded four-wave mixing on this side. Simultaneously, we proposed, for the first time to our best knowledge, one two-dimensional method to simulate the eigenmodes (TE and TM) in X-cut microrings, which avoids the obstacle from large computational effort in three-dimensional anisotropic microrings simulation, and the mode crossing point. This work will provide an entirely novel approach to the design of polarization converters and simulation for monolithic photonics integrated circuits, and may be helpful to the studies of missed temporal dissipative soliton formation in X-cut lithium niobate rings.


title: FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization

abstract: Generating emotional talking faces is a practical yet challenging endeavor. To create a lifelike avatar, we draw upon two critical insights from a human perspective: 1) The connection between audio and the non-deterministic facial dynamics, encompassing expressions, blinks, poses, should exhibit synchronous and one-to-many mapping. 2) Vibrant expressions are often accompanied by emotion-aware high-definition (HD) textures and finely detailed teeth. However, both aspects are frequently overlooked by existing methods. To this end, this paper proposes using normalizing Flow and Vector-Quantization modeling to produce emotional talking faces that satisfy both insights concurrently (FlowVQTalker). Specifically, we develop a flow-based coefficient generator that encodes the dynamics of facial emotion into a multi-emotion-class latent space represented as a mixture distribution. The generation process commences with random sampling from the modeled distribution, guided by the accompanying audio, enabling both lip-synchronization and the uncertain nonverbal facial cues generation. Furthermore, our designed vector-quantization image generator treats the creation of expressive facial images as a code query task, utilizing a learned codebook to provide rich, high-quality textures that enhance the emotional perception of the results. Extensive experiments are conducted to showcase the effectiveness of our approach.


title: The Geometry of Cyclical Social Trends

abstract: We investigate the emergence of periodic behavior in opinion dynamics and its underlying geometry. For this, we use a bounded-confidence model with contrarian agents in a convolution social network. This means that agents adapt their opinions by interacting with their neighbors in a time-varying social network. Being contrarian, the agents are kept from reaching consensus. This is the key feature that allows the emergence of cyclical trends. We show that the systems either converge to nonconsensual equilibrium or are attracted to periodic or quasi-periodic orbits. We bound the dimension of the attractors and the period of cyclical trends. We exhibit instances where each orbit is dense and uniformly distributed within its attractor. We also investigate the case of randomly changing social networks.


title: Adiabatic versus instantaneous transitions from a harmonic oscillator to an inverted oscillator

abstract: We have obtained explicit analytical formulas for the mean energy and its variance (characterizing the energy fluctuations) of a quantum harmonic oscillator with time-dependent frequency in the adiabatic regimes after the frequency passes through zero. The behavior of energy turns out to be quite different in two cases: when the frequency remains real and when it becomes imaginary. In the first case, the mean energy always increases when the frequency returns to its initial value, and the increment coefficient is determined by the exponent in the power law of the frequency crossing zero. On the other hand, if the frequency becomes imaginary, the absolute value of mean energy increases exponentially, even in the adiabatic regime, unless the Hamiltonian becomes time independent. Small corrections to the leading terms of simple adiabatic approximate formulas are crucial in this case, due to the unstable nature of the motion.


title: Eliminating Warping Shakes for Unsupervised Online Video Stitching

abstract: In this paper, we retarget video stitching to an emerging issue, named warping shake, when extending image stitching to video stitching. It unveils the temporal instability of warped content in non-overlapping regions, despite image stitching having endeavored to preserve the natural structures. Therefore, in most cases, even if the input videos to be stitched are stable, the stitched video will inevitably cause undesired warping shakes and affect the visual experience. To eliminate the shakes, we propose StabStitch to simultaneously realize video stitching and video stabilization in a unified unsupervised learning framework. Starting from the camera paths in video stabilization, we first derive the expression of stitching trajectories in video stitching by elaborately integrating spatial and temporal warps. Then a warp smoothing model is presented to optimize them with a comprehensive consideration regarding content alignment, trajectory smoothness, spatial consistency, and online collaboration. To establish an evaluation benchmark and train the learning framework, we build a video stitching dataset with a rich diversity in camera motions and scenes. Compared with existing stitching solutions, StabStitch exhibits significant superiority in scene robustness and inference speed in addition to stitching and stabilization performance, contributing to a robust and real-time online video stitching system. The code and dataset will be available at https://github.com/nie-lang/StabStitch.


title: First-principles Study of Carrier Mobility in MX (M=Sn, Pb; X=P, As) Monolayers

abstract: Compounds from groups IV and V have been the focus of recent research due to their impressive physical characteristics and structural stability. In this study, the MX monolayers (M=Sn, Pb; N=P, As) are investigated with first-principles calculations based on Boltzmann transport theory. The results show that SnP, SnAs, and PbAs all exhibit indirect band gaps, whereas PbP is the only semiconductor with a direct band gap. One important finding is that intravalley scattering has a significant impact on electron-phonon coupling. Interestingly, changes in carrier concentration do not affect the electron mobility within these MX monolayers, with SnP exhibiting the highest electron mobility among them. Subsequently, the SnP under a 6% biaxial strain is further explored and the results demonstrated a considerable increase in electron mobility to 2,511.9 cm^2/Vs, which is attributable to decreased scattering. This suggests that MX monolayers, especially SnP, are promising options for 2D semiconductor materials in the future.


title: First-principles study of two-dimensional transition metal carbide M n+1 C n O 2(M=Nb,Ta)

abstract: In the present work, the three stable MXenes M n+1 C n O 2 (M=Nb,Ta) are explored based onfirst-principles calculations. These materials are important derivatives of 2D materials and exhib-it distinctive properties, holding vast potential in nanodevices. All these M n+1 C n O 2 (M=Nb,Ta)materials exhibit outstanding superconducting performance, with corresponding superconductingtransition temperatures of 23.00K, 25.00K, and 29.00K. Analysis reveals that the high supercon-ducting transition temperatures of MXenes M n+1 C n O 2 (M=Nb,Ta) are closely associated with thehigh value of the logarithmic average of phonon frequencies, {\omega} log , and the strong electron-phononcoupling (EPC), attributed to the crucial contribution of low-frequency phonons. Additionally, weapplied strain treatments of 2% and 4% to M n+1 C n O 2 (M=Nb,Ta), resulting in varying changes insuperconducting transition temperatures under different strains.


title: Enhancing Semantic Fidelity in Text-to-Image Synthesis: Attention Regulation in Diffusion Models

abstract: Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended semantics of the associated text prompts. We examine cross-attention layers in diffusion models and observe a propensity for these layers to disproportionately focus on certain tokens during the generation process, thereby undermining semantic fidelity. To address the issue of dominant attention, we introduce attention regulation, a computation-efficient on-the-fly optimization approach at inference time to align attention maps with the input text prompt. Notably, our method requires no additional training or fine-tuning and serves as a plug-in module on a model. Hence, the generation capacity of the original model is fully preserved. We compare our approach with alternative approaches across various datasets, evaluation metrics, and diffusion models. Experiment results show that our method consistently outperforms other baselines, yielding images that more faithfully reflect the desired concepts with reduced computation overhead. Code is available at https://github.com/YaNgZhAnG-V5/attention_regulation.


title: Pre-Trained Model Recommendation for Downstream Fine-tuning

abstract: As a fundamental problem in transfer learning, model selection aims to rank off-the-shelf pre-trained models and select the most suitable one for the new target task. Existing model selection techniques are often constrained in their scope and tend to overlook the nuanced relationships between models and tasks. In this paper, we present a pragmatic framework \textbf{Fennec}, delving into a diverse, large-scale model repository while meticulously considering the intricate connections between tasks and models. The key insight is to map all models and historical tasks into a transfer-related subspace, where the distance between model vectors and task vectors represents the magnitude of transferability. A large vision model, as a proxy, infers a new task's representation in the transfer space, thereby circumventing the computational burden of extensive forward passes. We also investigate the impact of the inherent inductive bias of models on transfer results and propose a novel method called \textbf{archi2vec} to encode the intricate structures of models. The transfer score is computed through straightforward vector arithmetic with a time complexity of $\mathcal{O}(1)$. Finally, we make a substantial contribution to the field by releasing a comprehensive benchmark. We validate the effectiveness of our framework through rigorous testing on two benchmarks. The benchmark and the code will be publicly available in the near future.


title: The maximum spectral radius of planner graphs without the joint of K2 and a linear forest

abstract: Given a graph $F$, let $SPEX_P(n,F)$ be the set of graphs with the maximum spectral radius among all $F$-free $n$-vertex planner graph. In 2017, Tait and Tobin proved that for sufficiently $n$, $K_2+P_{n-2}$ is the unique graph with the maximum spectral radius over all $n$-vertex planner graphs. In this paper, focusing on $SPEX_P(n,K_2+H)$ in which $H$ is a linear forest, we prove that $SPEX_P(n,K_2+H)=\{2K_1+C_{n-2}\}$ when $H\in \{pK_2,P_3,I_q\}$ $(p\geq1, q\geq 3)$, where $K_n$, $P_n$, $I_n$ are complete graph, path and empty graph of order $n$, respectively. When $H$ contains a $P_4$, we prove that $2K_1+C_{n-2}\notin SPEX_P(n,K_2+H)$ and also provide a structural characterization of graphs in $SPEX_P(n,K_2+H)$.


title: Precision Spectroscopy and Nuclear Structure Parameters in 7Li+ ion

abstract: The optical Ramsey technique is used to obtain precise measurements of the hyperfine splittings in the $2\,^3\!S_1$ and $2\,^3\!P_J$ states of $^7$Li$^+$. Together with bound-state quantum electrodynamic theory, the Zemach radius and quadrupole moment of the $^7$Li nucleus are determined to be $3.35(1)$~fm and $-3.86(5)$~fm$^2$ respectively, with the quadrupole moment deviating from the recommended value of $-4.00(3)$~fm$^2$ by $1.75\sigma$. Furthermore, we determine the quadrupole moment ratio of $^6$Li to $^7$Li as $0.101(13)$, exhibiting a $6\sigma$ deviation from the previous measured value of $0.020161(13)$ by LiF molecular spectroscopy. The results taken together provide a sensitive test of nuclear structure models.


title: RA-ICM: A Novel Independent Cascade Model Incorporating User Relationships and Attitudes

abstract: The rapid development of social networks has a wide range of social effects, which facilitates the study of social issues. Accurately forecasting the information propagation process within social networks is crucial for promptly understanding the event direction and effectively addressing social problems in a scientific manner. The relationships between non-adjacent users and the attitudes of users significantly influence the information propagation process within social networks. However, existing research has ignored these two elements, which poses challenges for accurately predicting the information propagation process. This limitation significantly hinders the study of emotional contagion and influence maximization in social networks. To address these issues, by considering the relationships between non-adjacent users and the influence of user attitudes, we propose a new information propagation model based on the independent cascade model. Experimental results obtained from six real Weibo datasets validate the effectiveness of the proposed model, which is reflected in increased prediction accuracy and reduced time complexity. Furthermore, the information dissemination trend in social networks predicted by the proposed model closely resembles the actual information propagation process, which demonstrates the superiority of the proposed model.


title: Dyakonov-Shur instability of electronic fluid: Spectral effect of weak magnetic field

abstract: We study numerically and analytically how the Dyakonov-Shur instability for a two-dimensional (2D) inviscid electronic fluid in a long channel can be affected by an external, out-of-plane static magnetic field. By linear stability analysis for a model based on the shallow-water equations, we describe the discrete spectrum of frequencies in the complex plane. When the fluid system is near the subsonic-to-supersonic transition point, a magnetically controlled gap between the stability and instability spectra of the complex eigen-frequencies is evident by our computations. This suggests that the passage from stability to instability (and vice versa) is no longer continuous in the effective Mach parameter of the boundary conditions. We connect this complex-valued gap to a multivalued function characterizing the exact electronic steady state. In a regime of weak magnetic fields, we derive a scaling law for the eigen-frequencies by perturbation theory. We discuss implications of our results in efforts to generate terahertz electromagnetic radiation by 2D electronic transport.


title: Towards Decoupling Frontend Enhancement and Backend Recognition in Monaural Robust ASR

abstract: It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy conditions compared to an ASR model trained on noisy speech directly. The divide between SE and ASR impedes the progress of robust ASR systems, especially as SE has made major advances in recent years. This paper focuses on eliminating this divide with an ARN (attentive recurrent network) time-domain and a CrossNet time-frequency domain enhancement models. The proposed systems fully decouple frontend enhancement and backend ASR trained only on clean speech. Results on the WSJ, CHiME-2, LibriSpeech, and CHiME-4 corpora demonstrate that ARN and CrossNet enhanced speech both translate to improved ASR results in noisy and reverberant environments, and generalize well to real acoustic scenarios. The proposed system outperforms the baselines trained on corrupted speech directly. Furthermore, it cuts the previous best word error rate (WER) on CHiME-2 by $28.4\%$ relatively with a $5.57\%$ WER, and achieves $3.32/4.44\%$ WER on single-channel CHiME-4 simulated/real test data without training on CHiME-4.


title: A Zero Trust Framework for Realization and Defense Against Generative AI Attacks in Power Grid

abstract: Understanding the potential of generative AI (GenAI)-based attacks on the power grid is a fundamental challenge that must be addressed in order to protect the power grid by realizing and validating risk in new attack vectors. In this paper, a novel zero trust framework for a power grid supply chain (PGSC) is proposed. This framework facilitates early detection of potential GenAI-driven attack vectors (e.g., replay and protocol-type attacks), assessment of tail risk-based stability measures, and mitigation of such threats. First, a new zero trust system model of PGSC is designed and formulated as a zero-trust problem that seeks to guarantee for a stable PGSC by realizing and defending against GenAI-driven cyber attacks. Second, in which a domain-specific generative adversarial networks (GAN)-based attack generation mechanism is developed to create a new vulnerability cyberspace for further understanding that threat. Third, tail-based risk realization metrics are developed and implemented for quantifying the extreme risk of a potential attack while leveraging a trust measurement approach for continuous validation. Fourth, an ensemble learning-based bootstrap aggregation scheme is devised to detect the attacks that are generating synthetic identities with convincing user and distributed energy resources device profiles. Experimental results show the efficacy of the proposed zero trust framework that achieves an accuracy of 95.7% on attack vector generation, a risk measure of 9.61% for a 95% stable PGSC, and a 99% confidence in defense against GenAI-driven attack.


title: Suppression of flux jumps in high-$J_c$ Nb$_3$Sn conductors by ferromagnetic layer

abstract: Flux jumps observed in high-$J_c$ Nb$_3$Sn conductors are urgent problems to construct high field superconducting magnets. The low-field instabilities usually reduce the current-carrying capability and thus cause the premature quench of Nb$_3$Sn coils at low magnetic field. In this paper, we explore suppressing the flux jumps by ferromagnetic (FM) layer. Firstly, we experimentally and theoretically investigate the flux jumps of Nb$_3$Sn/FM hybrid wires exposed to a magnetic field loop with constant sweeping rate. Comparing with bare Nb$_3$Sn and Nb$_3$Sn/Cu wires, we reveal two underlying mechanisms that the suppression of flux jumps is mainly attributed to the thermal effect of FM layer for the case of lower sweeping rate, whereas both thermal and electromagnetic effects play a crucial role for the case of higher sweeping rate. Furthermore, we explore the flux jumps of Nb$_3$Sn/FM hybrid wires exposed to AC magnetic fields with amplitude $B_{a0}$ and frequency $\rm\omega$. We build up the phase diagrams of flux jumps in the plane $\rm\omega$-$B_{a0}$ for bare Nb$_{3}$Sn wire, Nb$_{3}$Sn/Cu wire and Nb$_{3}$Sn/FM wire, respectively. We stress that the region of flux jumps of Nb$_{3}$Sn/FM wire is much smaller than the other two wires, which indicates that the Nb$_{3}$Sn/FM wire has significant advantage over merely increasing the heat capacity. The findings shed light on suppression of the flux jumps by utilizing FM materials, which is useful for developing new type of high-$J_c$ Nb$_{3}$Sn conductors.


title: The Phenomenology of Sphaleron in Modified Mirror Model

abstract: We investigate sphaleron solutions of the field equations in the modified mirror model. This model is based on SU(3)$_1$ $\otimes$ SU(3)$_2$ $\otimes$ SU(2)$_L$ $\otimes$ SU(2)$_R$ $\otimes$ U(1)$_{Y}$ $\otimes$ U(1)$_{X}$ gauge group. Different from the usual Weinberg-Salam theory, we will have two types of fields, the ordinary (standard model) and its mirror partners. In this paper, we will focus only on the case when the doublet scalar of the mirror sector has a very large vacuum expectation value (VEV) compared to the VEV of the SM Higgs. We study two scenarios related to the sphaleron solutions in this model, depending on the value of the coupling $\alpha$. For the case of $\alpha=0$, each sector has its sphaleron and the sphaleron energy depends on the VEV of scalars for each sector. In the case $\alpha \neq 0$, we find that the sphaleron energy in the SM sector can be either increased or decreased depending on the relative sign of the coupling $\alpha$.


title: Towards verifications of Krylov complexity

abstract: Krylov complexity is considered to provide a measure of the growth of operators evolving under Hamiltonian dynamics. The main strategy is the analysis of the structure of Krylov subspace $\mathcal{K}_M(\mathcal{H},\eta)$ spanned by the multiple applications of the Liouville operator $\mathcal{L}$ defined by the commutator in terms of a Hamiltonian $\mathcal{H}$, $\mathcal{L}:=[\mathcal{H},\cdot]$ acting on an operator $\eta$, $\mathcal{K}_M(\mathcal{H},\eta)=\text{span}\{\eta,\mathcal{L}\eta,\ldots,\mathcal{L}^{M-1}\eta\}$. For a given inner product $(\cdot,\cdot)$ of the operators, the orthonormal basis $\{\mathcal{O}_n\}$ is constructed from $\mathcal{O}_0=\eta/\sqrt{(\eta,\eta)}$ by Lanczos algorithm. The moments $\mu_m=(\mathcal{O}_0,\mathcal{L}^m\mathcal{O}_0)$ are closely related to the important data $\{b_n\}$ called Lanczos coefficients. I present the exact and explicit expressions of the moments $\{\mu_m\}$ for 16 quantum mechanical systems which are {\em exactly solvable both in the Schr\"odinger and Heisenberg pictures}. The operator $\eta$ is the variable of the eigenpolynomials. Among them six systems show a clear sign of `non-complexity' as vanishing higher Lanczos coefficients $b_m=0$, $m\ge3$.


title: Towards Robust Out-of-Distribution Generalization Bounds via Sharpness

abstract: Generalizing to out-of-distribution (OOD) data or unseen domain, termed OOD generalization, still lacks appropriate theoretical guarantees. Canonical OOD bounds focus on different distance measurements between source and target domains but fail to consider the optimization property of the learned model. As empirically shown in recent work, the sharpness of learned minima influences OOD generalization. To bridge this gap between optimization and OOD generalization, we study the effect of sharpness on how a model tolerates data change in domain shift which is usually captured by "robustness" in generalization. In this paper, we give a rigorous connection between sharpness and robustness, which gives better OOD guarantees for robust algorithms. It also provides a theoretical backing for "flat minima leads to better OOD generalization". Overall, we propose a sharpness-based OOD generalization bound by taking robustness into consideration, resulting in a tighter bound than non-robust guarantees. Our findings are supported by the experiments on a ridge regression model, as well as the experiments on deep learning classification tasks.


title: A Functionally Connected Element Method for Solving Boundary Value Problems

abstract: We present the general forms of piece-wise functions on partitioned domains satisfying an intrinsic $C^0$ or $C^1$ continuity across the sub-domain boundaries. These general forms are constructed based on a strategy stemming from the theory of functional connections, and we refer to partitioned domains endowed with these general forms as functionally connected elements (FCE). We further present a method, incorporating functionally connected elements and a least squares collocation approach, for solving boundary and initial value problems. This method exhibits a spectral-like accuracy, with the free functions involved in the FCE form represented by polynomial bases or by non-polynomial bases of quasi-random sinusoidal functions. The FCE method offers a unique advantage over traditional element-based methods for boundary value problems involving relative boundary conditions. A number of linear and nonlinear numerical examples in one and two dimensions are presented to demonstrate the performance of the FCE method developed herein.


title: FSViewFusion: Few-Shots View Generation of Novel Objects

abstract: Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited remarkable performance on introducing generalization in view synthesis. Inspired by these advancements, we explore the capabilities of a pretrained stable diffusion model for view synthesis without explicit 3D priors. Specifically, we base our method on a personalized text to image model, Dreambooth, given its strong ability to adapt to specific novel objects with a few shots. Our research reveals two interesting findings. First, we observe that Dreambooth can learn the high level concept of a view, compared to arguably more complex strategies which involve finetuning diffusions on large amounts of multi-view data. Second, we establish that the concept of a view can be disentangled and transferred to a novel object irrespective of the original object's identify from which the views are learnt. Motivated by this, we introduce a learning strategy, FSViewFusion, which inherits a specific view through only one image sample of a single scene, and transfers the knowledge to a novel object, learnt from few shots, using low rank adapters. Through extensive experiments we demonstrate that our method, albeit simple, is efficient in generating reliable view samples for in the wild images. Code and models will be released.


title: A Linear Algebra approach to monomiality and operational methods

abstract: We use linear algebraic methods to obtain general results about linear operators on a space of polynomials that we apply to the operators associated with a polynomial sequence by the monomiality property. We show that all such operators are differential operators with polynomial coefficients of finite of infinite order. We consider the monomiality operators associated with several classes of polynomial sequences, such as Appell and Sheffer, and also orthogonal polynomial sequences that include the Meixner, Krawtchouk, Laguerre, Meixner-Pollaczek, and Hermite families.


title: A Segmentation Foundation Model for Diverse-type Tumors

abstract: Large pre-trained models with their numerous model parameters and extensive training datasets have shown excellent performance in various tasks. Many publicly available medical image datasets do not have a sufficient amount of data so there are few large-scale models in medical imaging. We propose a large-scale Tumor Segmentation Foundation Model (TSFM) with 1.6 billion parameters using Resblock-backbone and Transformer-bottleneck,which has good transfer ability for downstream tasks. To make TSFM exhibit good performance in tumor segmentation, we make full use of the strong spatial correlation between tumors and organs in the medical image, innovatively fuse 7 tumor datasets and 3 multi-organ datasets to build a 3D medical dataset pool, including 2779 cases with totally 300k medical images, whose size currently exceeds many other single publicly available datasets. TSFM is the pre-trained model for medical image segmentation, which also can be transferred to multiple downstream tasks for fine-tuning learning. The average performance of our pre-trained model is 2% higher than that of nnU-Net across various tumor types. In the transfer learning task, TSFM only needs 5% training epochs of nnU-Net to achieve similar performance and can surpass nnU-Net by 2% on average with 10% training epoch. Pre-trained TSFM and its code will be released soon.


title: DeepSafeMPC: Deep Learning-Based Model Predictive Control for Safe Multi-Agent Reinforcement Learning

abstract: Safe Multi-agent reinforcement learning (safe MARL) has increasingly gained attention in recent years, emphasizing the need for agents to not only optimize the global return but also adhere to safety requirements through behavioral constraints. Some recent work has integrated control theory with multi-agent reinforcement learning to address the challenge of ensuring safety. However, there have been only very limited applications of Model Predictive Control (MPC) methods in this domain, primarily due to the complex and implicit dynamics characteristic of multi-agent environments. To bridge this gap, we propose a novel method called Deep Learning-Based Model Predictive Control for Safe Multi-Agent Reinforcement Learning (DeepSafeMPC). The key insight of DeepSafeMPC is leveraging a entralized deep learning model to well predict environmental dynamics. Our method applies MARL principles to search for optimal solutions. Through the employment of MPC, the actions of agents can be restricted within safe states concurrently. We demonstrate the effectiveness of our approach using the Safe Multi-agent MuJoCo environment, showcasing significant advancements in addressing safety concerns in MARL.


title: On the Diminishing Returns of Width for Continual Learning

abstract: While deep neural networks have demonstrated groundbreaking performance in various settings, these models often suffer from \emph{catastrophic forgetting} when trained on new tasks in sequence. Several works have empirically demonstrated that increasing the width of a neural network leads to a decrease in catastrophic forgetting but have yet to characterize the exact relationship between width and continual learning. We design one of the first frameworks to analyze Continual Learning Theory and prove that width is directly related to forgetting in Feed-Forward Networks (FFN). Specifically, we demonstrate that increasing network widths to reduce forgetting yields diminishing returns. We empirically verify our claims at widths hitherto unexplored in prior studies where the diminishing returns are clearly observed as predicted by our theory.


title: GlossLM: Multilingual Pretraining for Low-Resource Interlinear Glossing

abstract: Language documentation projects often involve the creation of annotated text in a format such as interlinear glossed text (IGT), which captures fine-grained morphosyntactic analyses in a morpheme-by-morpheme format. However, there are few existing resources providing large amounts of standardized, easily accessible IGT data, limiting their applicability to linguistic research, and making it difficult to use such data in NLP modeling. We compile the largest existing corpus of IGT data from a variety of sources, covering over 450k examples across 1.8k languages, to enable research on crosslingual transfer and IGT generation. We normalize much of our data to follow a standard set of labels across languages. Furthermore, we explore the task of automatically generating IGT in order to aid documentation projects. As many languages lack sufficient monolingual data, we pretrain a large multilingual model on our corpus. We demonstrate the utility of this model by finetuning it on monolingual corpora, outperforming SOTA models by up to 6.6%. We will make our pretrained model and dataset available through Hugging Face, as well as provide access through a web interface for use in language documentation efforts.


title: DivCon: Divide and Conquer for Progressive Text-to-Image Generation

abstract: Diffusion-driven text-to-image (T2I) generation has achieved remarkable advancements. To further improve T2I models' capability in numerical and spatial reasoning, the layout is employed as an intermedium to bridge large language models and layout-based diffusion models. However, these methods still struggle with generating images from textural prompts with multiple objects and complicated spatial relationships. To tackle this challenge, we introduce a divide-and-conquer approach which decouples the T2I generation task into simple subtasks. Our approach divides the layout prediction stage into numerical \& spatial reasoning and bounding box prediction. Then, the layout-to-image generation stage is conducted in an iterative manner to reconstruct objects from easy ones to difficult ones. We conduct experiments on the HRS and NSR-1K benchmarks and our approach outperforms previous state-of-the-art models with notable margins. In addition, visual results demonstrate that our approach significantly improves the controllability and consistency in generating multiple objects from complex textural prompts.


title: Refining Segmentation On-the-Fly: An Interactive Framework for Point Cloud Semantic Segmentation

abstract: Existing interactive point cloud segmentation approaches primarily focus on the object segmentation, which aim to determine which points belong to the object of interest guided by user interactions. This paper concentrates on an unexplored yet meaningful task, i.e., interactive point cloud semantic segmentation, which assigns high-quality semantic labels to all points in a scene with user corrective clicks. Concretely, we presents the first interactive framework for point cloud semantic segmentation, named InterPCSeg, which seamlessly integrates with off-the-shelf semantic segmentation networks without offline re-training, enabling it to run in an on-the-fly manner. To achieve online refinement, we treat user interactions as sparse training examples during the test-time. To address the instability caused by the sparse supervision, we design a stabilization energy to regulate the test-time training process. For objective and reproducible evaluation, we develop an interaction simulation scheme tailored for the interactive point cloud semantic segmentation task. We evaluate our framework on the S3DIS and ScanNet datasets with off-the-shelf segmentation networks, incorporating interactions from both the proposed interaction simulator and real users. Quantitative and qualitative experimental results demonstrate the efficacy of our framework in refining the semantic segmentation results with user interactions. The source code will be publicly available.


title: 'One size doesn't fit all': Learning how many Examples to use for In-Context Learning for Improved Text Classification

abstract: Predictive models in natural language processing (NLP) have evolved from training models from scratch to fine-tuning pre-trained models with labelled data. An extreme form of this fine-tuning involves in-context learning (ICL), where the output of a pre-trained generative model (frozen decoder parameters) is controlled only with variations in the input strings (called instructions or prompts). An important component of ICL is the use of a small number of labelled data instances as examples in the prompt. While existing work uses a static number of examples during inference for each data instance, in this paper we propose a novel methodology of dynamically adapting the number of examples as per the data. This is analogous to the use of a variable-sized neighborhood in k-nearest neighbors (k-NN) classifier. In our proposed workflow of adaptive ICL (AICL), the number of demonstrations to employ during the inference on a particular data instance is predicted by the Softmax posteriors of a classifier. The parameters of this classifier are fitted on the optimal number of examples in ICL required to correctly infer the label of each instance in the training set with the hypothesis that a test instance that is similar to a training instance should use the same (or a closely matching) number of few-shot examples. Our experiments show that our AICL method results in improvement in text classification task on several standard datasets.


title: PointSeg: A Training-Free Paradigm for 3D Scene Segmentation via Foundation Models

abstract: Recent success of vision foundation models have shown promising performance for the 2D perception tasks. However, it is difficult to train a 3D foundation network directly due to the limited dataset and it remains under explored whether existing foundation models can be lifted to 3D space seamlessly. In this paper, we present PointSeg, a novel training-free paradigm that leverages off-the-shelf vision foundation models to address 3D scene perception tasks. PointSeg can segment anything in 3D scene by acquiring accurate 3D prompts to align their corresponding pixels across frames. Concretely, we design a two-branch prompts learning structure to construct the 3D point-box prompts pairs, combining with the bidirectional matching strategy for accurate point and proposal prompts generation. Then, we perform the iterative post-refinement adaptively when cooperated with different vision foundation models. Moreover, we design a affinity-aware merging algorithm to improve the final ensemble masks. PointSeg demonstrates impressive segmentation performance across various datasets, all without training. Specifically, our approach significantly surpasses the state-of-the-art specialist model by 13.4$\%$, 11.3$\%$, and 12$\%$ mAP on ScanNet, ScanNet++, and KITTI-360 datasets, respectively. On top of that, PointSeg can incorporate with various segmentation models and even surpasses the supervised methods.


title: Cosine Scoring with Uncertainty for Neural Speaker Embedding

abstract: Uncertainty modeling in speaker representation aims to learn the variability present in speech utterances. While the conventional cosine-scoring is computationally efficient and prevalent in speaker recognition, it lacks the capability to handle uncertainty. To address this challenge, this paper proposes an approach for estimating uncertainty at the speaker embedding front-end and propagating it to the cosine scoring back-end. Experiments conducted on the VoxCeleb and SITW datasets confirmed the efficacy of the proposed method in handling uncertainty arising from embedding estimation. It achieved improvement with 8.5% and 9.8% average reductions in EER and minDCF compared to the conventional cosine similarity. It is also computationally efficient in practice.


title: Chemical Potentials and the One-Electron Hamiltonian of the Second-Order Perturbation Theory from the Functional Derivative Approach

abstract: We develop a functional derivative approach to calculate the chemical potentials of the second-order perturbation theory (MP2). In the functional derivative approach, the correlation part of the MP2 chemical potential, which is the derivative of the MP2 correlation energy with respect to the occupation number of frontier orbitals, is obtained from the chain rule via the non-interacting Green's function. First, the MP2 correlation energy is expressed in terms of the non-interacting Green's function and its functional derivative to the non-interacting Green's function is the second-order self-energy. Then the derivative of the non-interacting Green's function to the occupation number is obtained by including the orbital relaxation effect. We show that the MP2 chemical potentials obtained from the functional derivative approach agrees with that obtained from the finite difference approach. The one-electron Hamiltonian, defined as the derivative of the MP2 energy with respect to the one particle density matrix, is also derived using the functional derivative approach, which can be used in the self-consistent calculations of MP2 and double-hybrid density functionals. The developed functional derivative approach is promising for calculating the chemical potentials and the one-electron Hamiltonian of approximate functionals and many-body perturbation approaches dependent explicitly on the non-interacting Green's function.


title: Comparison of No-Reference Image Quality Models via MAP Estimation in Diffusion Latents

abstract: Contemporary no-reference image quality assessment (NR-IQA) models can effectively quantify the perceived image quality, with high correlations between model predictions and human perceptual scores on fixed test sets. However, little progress has been made in comparing NR-IQA models from a perceptual optimization perspective. Here, for the first time, we demonstrate that NR-IQA models can be plugged into the maximum a posteriori (MAP) estimation framework for image enhancement. This is achieved by taking the gradients in differentiable and bijective diffusion latents rather than in the raw pixel domain. Different NR-IQA models are likely to induce different enhanced images, which are ultimately subject to psychophysical testing. This leads to a new computational method for comparing NR-IQA models within the analysis-by-synthesis framework. Compared to conventional correlation-based metrics, our method provides complementary insights into the relative strengths and weaknesses of the competing NR-IQA models in the context of perceptual optimization.


title: Can LLMs' Tuning Methods Work in Medical Multimodal Domain?

abstract: While large language models (LLMs) excel in world knowledge understanding, adapting them to specific subfields requires precise adjustments. Due to the model's vast scale, traditional global fine-tuning methods for large models can be computationally expensive and impact generalization. To address this challenge, a range of innovative Parameters-Efficient Fine-Tuning (PEFT) methods have emerged and achieved remarkable success in both LLMs and Large Vision-Language Models (LVLMs). In the medical domain, fine-tuning a medical Vision-Language Pretrained (VLP) model is essential for adapting it to specific tasks. Can the fine-tuning methods for large models be transferred to the medical field to enhance transfer learning efficiency? In this paper, we delve into the fine-tuning methods of LLMs and conduct extensive experiments to investigate the impact of fine-tuning methods for large models on existing multimodal models in the medical domain from the training data level and the model structure level. We show the different impacts of fine-tuning methods for large models on medical VLMs and develop the most efficient ways to fine-tune medical VLP models. We hope this research can guide medical domain researchers in optimizing VLMs' training costs, fostering the broader application of VLMs in healthcare fields. Code and dataset will be released upon acceptance.


title: What Makes Quantization for Large Language Models Hard? An Empirical Study from the Lens of Perturbation

abstract: Quantization has emerged as a promising technique for improving the memory and computational efficiency of large language models (LLMs). Though the trade-off between performance and efficiency is well-known, there is still much to be learned about the relationship between quantization and LLM performance. To shed light on this relationship, we propose a new perspective on quantization, viewing it as perturbations added to the weights and activations of LLMs. We call this approach "the lens of perturbation". Using this lens, we conduct experiments with various artificial perturbations to explore their impact on LLM performance. Our findings reveal several connections between the properties of perturbations and LLM performance, providing insights into the failure cases of uniform quantization and suggesting potential solutions to improve the robustness of LLM quantization. To demonstrate the significance of our findings, we implement a simple non-uniform quantization approach based on our insights. Our experiments show that this approach achieves minimal performance degradation on both 4-bit weight quantization and 8-bit quantization for weights and activations. These results validate the correctness of our approach and highlight its potential to improve the efficiency of LLMs without sacrificing performance.


title: Observational Properties of AGN Obscuration During the Peak of Accretion Growth

abstract: We investigated the gas obscuration and host galaxy properties of active galactic nuclei (AGN) during the peak of cosmic accretion growth of supermassive black holes (SMBHs) at redshift 0.8-1.8 using X-ray detected AGN with mid-infrared and far-infrared detection. The sample was classified as type-1 and type-2 AGN using optical spectral and morphological classification while the host galaxy properties were estimated with multiwavelength SED fitting. For type-1 AGN, the black hole mass was determined from MgII emission lines while the black hole mass of type-2 AGN was inferred from the host galaxy's stellar mass. Based on the derived parameters, the distribution of the sample in the absorption hydrogen column density ($N_{\rm H}$) vs. Eddington ratio diagram is examined. Among the type-2 AGN, $28\pm5$\% are in the forbidden zone, where the obscuration by dust torus cannot be maintained due to radiation pressure on dusty material. The fraction is higher than that observed in the local universe from the BAT AGN Spectroscopic Survey (BASS) data release 2 ($11\pm3$\%). The higher fraction implies that the obscuration of the majority of AGN is consistent with the radiation pressure regulated unified model but with an increased incidence of interstellar matter (ISM) obscured AGN. We discuss the possibility of dust-free absorption in type-1 AGN and heavy ISM absorption in type-2 AGN. We also find no statistical difference in the star-formation activity between type-1 and type-2 AGN which may suggest that obscuration triggered by a gas-rich merging is not common among X-ray detected AGN in this epoch.


title: A Logical Pattern Memory Pre-trained Model for Entailment Tree Generation

abstract: Generating coherent and credible explanations remains a significant challenge in the field of AI. In recent years, researchers have delved into the utilization of entailment trees to depict explanations, which exhibit a reasoning process of how a hypothesis is deduced from the supporting facts. However, existing models often overlook the importance of generating intermediate conclusions with logical consistency from the given facts, leading to inaccurate conclusions and undermining the overall credibility of entailment trees. To address this limitation, we propose the logical pattern memory pre-trained model (LMPM). LMPM incorporates an external memory structure to learn and store the latent representations of logical patterns, which aids in generating logically consistent conclusions. Furthermore, to mitigate the influence of logically irrelevant domain knowledge in the Wikipedia-based data, we introduce an entity abstraction approach to construct the dataset for pre-training LMPM. The experimental results highlight the effectiveness of our approach in improving the quality of entailment tree generation. By leveraging logical entailment patterns, our model produces more coherent and reasonable conclusions that closely align with the underlying premises. Code and Data are released at https://github.com/YuanLi95/T5-LMPM


title: Effect of non-equilibrium thermochemistry on Pitot pressure measurements in shock tunnels (or: Is 0.92 really the magic number?)

abstract: Pitot pressure is the most common measurement in high total enthalpy shock tunnels for test condition verification. Nozzle calculations using multi-temperature non-equilibrium thermochemistry are needed in conjunction with Pitot measurements to quantify freestream properties. Pitot pressure is typically matched by tuning the boundary layer transition location in these simulations. However, non-equilibrium thermochemistry effects on the Pitot probe are commonly ignored. A computational study was undertaken to estimate the effect of nonequilibrium thermochemistry on Pitot pressure and freestream conditions. The test flow was produced by a Mach 7 nozzle in a reflected shock tunnel for air at a relatively low total enthalpy of 2.67 MJ/kg. Three different thermochemical models (equilibrium, finite-rate chemistry and two-temperature thermochemistry) were employed to compute flow variables at the nozzle exit and Pitot probe. Pitot pressures from these simulations were compared against those obtained via experiments. The results show a departure from the commonly utilized C of 0.92 in the reduced Rayleigh-Pitot equation form for high Mach numbers. Additionally, calculations were done with a sweep of free-stream conditions and resulting in C approximately 0.94. These results show that the influence of finite-rate thermochemistry should be taken into account, even at relatively low flow enthalpies.


title: CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean

abstract: Despite the rapid development of large language models (LLMs) for the Korean language, there remains an obvious lack of benchmark datasets that test the requisite Korean cultural and linguistic knowledge. Because many existing Korean benchmark datasets are derived from the English counterparts through translation, they often overlook the different cultural contexts. For the few benchmark datasets that are sourced from Korean data capturing cultural knowledge, only narrow tasks such as bias and hate speech detection are offered. To address this gap, we introduce a benchmark of Cultural and Linguistic Intelligence in Korean (CLIcK), a dataset comprising 1,995 QA pairs. CLIcK sources its data from official Korean exams and textbooks, partitioning the questions into eleven categories under the two main categories of language and culture. For each instance in CLIcK, we provide fine-grained annotation of which cultural and linguistic knowledge is required to answer the question correctly. Using CLIcK, we test 13 language models to assess their performance. Our evaluation uncovers insights into their performances across the categories, as well as the diverse factors affecting their comprehension. CLIcK offers the first large-scale comprehensive Korean-centric analysis of LLMs' proficiency in Korean culture and language.


title: $L^p-L^q$ boundedness of Forelli-Rudin type operators on the unit ball of $\mathbb{C}^n$

abstract: We completely characterize $L^p-L^q$ boundedness of two classes of Forelli-Rudin type operators on the unit ball of $\mathbb{C}^n$ for all $(p, q)\in [1, \infty]\times [1, \infty]$. The results are not only a complement to some previous results on Forelli-Rudin type operators by Kures and Zhu in 2006 and the first author in 2015, but also a high dimension extension of some results by Cheng, Fang, Wang and Yu in 2017.


title: Evolving Knowledge Distillation with Large Language Models and Active Learning

abstract: Large language models (LLMs) have demonstrated remarkable capabilities across various NLP tasks. However, their computational costs are prohibitively high. To address this issue, previous research has attempted to distill the knowledge of LLMs into smaller models by generating annotated data. Nonetheless, these works have mainly focused on the direct use of LLMs for text generation and labeling, without fully exploring their potential to comprehend the target task and acquire valuable knowledge. In this paper, we propose EvoKD: Evolving Knowledge Distillation, which leverages the concept of active learning to interactively enhance the process of data generation using large language models, simultaneously improving the task capabilities of small domain model (student model). Different from previous work, we actively analyze the student model's weaknesses, and then synthesize labeled samples based on the analysis. In addition, we provide iterative feedback to the LLMs regarding the student model's performance to continuously construct diversified and challenging samples. Experiments and analysis on different NLP tasks, namely, text classification and named entity recognition show the effectiveness of EvoKD.


title: Elimination by Substitution

abstract: Let $K$ be a field and $P=K[x_1,\dots,x_n]$. The technique of elimination by substitution is based on discovering a coherently $Z=(z_1,\dots,z_s)$-separating tuple of polynomials $(f_1,\dots,f_s)$ in an ideal $I$, i.e., on finding polynomials such that $f_i = z_i - h_i$ with $h_i \in K[X \setminus Z]$. Here we elaborate on this technique in the case when $P$ is non-negatively graded. The existence of a coherently $Z$-separating tuple is reduced to solving several $P_0$-module membership problems. Best separable re-embeddings, i.e., isomorphisms $P/I \longrightarrow K[X \setminus Z] / (I \cap K[X \setminus Z])$ with maximal $\#Z$, are found degree-by-degree. They turn out to yield optimal re-embeddings in the positively graded case. Viewing $P_0 \longrightarrow P/I$ as a fibration over an affine space, we show that its fibers allow optimal $Z$-separating re-embeddings, and we provide a criterion for a fiber to be isomorphic to an affine space. In the last section we introduce a new technique based on the solution of a unimodular matrix problem which enables us to construct automorphisms of $P$ such that additional $Z$-separating re-embeddings are possible. One of the main outcomes is an algorithm which allows us to explicitly compute a homogeneous isomorphism between $P/I$ and a non-negatively graded polynomial ring if $P/I$ is regular.


title: Evidence of a Past Merger of the Galactic Center Black Hole

abstract: The origin of supermassive black holes (SMBHs) residing in the centers of most galaxies remains a mystery. Various growth models, such as accretion and hierarchical mergers, have been proposed to explain the existence and cosmological evolution of these SMBHs, but no direct observational evidence is available to test these models. The Event Horizon Telescope (EHT) offered direct imaging of nearby SMBHs, in particular, the one at the center of the Milky Way Galaxy named Sgr~A*. Measurements suggest that the Sgr~A* BH spins rapidly with significant spin axis misalignment relative to the angular momentum of the Galactic plane. Through investigating various SMBH growth models, here we show that the spin properties of Sgr~A* provides strong evidence of a past SMBH merger. Inspired by the merger between the Milky Way and Gaia-Enceladus, which has a 4:1 mass ratio as inferred from Gaia data, we have discovered that a 4:1 major merger of SMBH with a binary angular momentum inclination angle of 15-45 degrees with respect to the line of sight (LOS), can successfully replicate the measured spin properties of Sgr A*. This merger event in our galaxy provides observational support for the theory of hierarchical BH mergers in the formation and growth of SMBHs. The inferred merger rate, consistent with theoretical predictions, suggests a promising detection rate of SMBH mergers for space-borne gravitational wave detectors expected to operate in 2030s.


title: Enhanced Sparsification via Stimulative Training

abstract: Sparsification-based pruning has been an important category in model compression. Existing methods commonly set sparsity-inducing penalty terms to suppress the importance of dropped weights, which is regarded as the suppressed sparsification paradigm. However, this paradigm inactivates the dropped parts of networks causing capacity damage before pruning, thereby leading to performance degradation. To alleviate this issue, we first study and reveal the relative sparsity effect in emerging stimulative training and then propose a structured pruning framework, named STP, based on an enhanced sparsification paradigm which maintains the magnitude of dropped weights and enhances the expressivity of kept weights by self-distillation. Besides, to find an optimal architecture for the pruned network, we propose a multi-dimension architecture space and a knowledge distillation-guided exploration strategy. To reduce the huge capacity gap of distillation, we propose a subnet mutating expansion technique. Extensive experiments on various benchmarks indicate the effectiveness of STP. Specifically, without fine-tuning, our method consistently achieves superior performance at different budgets, especially under extremely aggressive pruning scenarios, e.g., remaining 95.11% Top-1 accuracy (72.43% in 76.15%) while reducing 85% FLOPs for ResNet-50 on ImageNet. Codes will be released soon.


title: Efficient Estimation of the Convective Cooling Rate of Photovoltaic Arrays with Various Geometric Configurations: a Physics-Informed Machine Learning Approach

abstract: Convective heat transfer is crucial for photovoltaic (PV) systems, as the power generation of PV is sensitive to temperature. The configuration of PV arrays have a significant impact on convective heat transfer by influencing turbulent characteristics. Conventional methods of quantifying the configuration effects are either through Computational Fluid Dynamics (CFD) simulations or empirical methods, which face the challenge of either high computational demand or low accuracy, especially when complex array configurations are considered. This work introduces a novel methodology to quantify the impact of geometric configurations of PV arrays on their convective heat transfer rate in wind field. The methodology combines Physics Informed Machine Learning (PIML) and Deep Convolution Neural Network (DCNN) to construct a robust PIML-DCNN model to predict convective heat transfer rates. In addition, an innovative loss function, termed Pocket Loss is proposed to enhance the interpretability of the PIML-DCNN model. The model exhibits promising performance, with a relative error of 1.9\% and overall $R^2$ of 0.99 over all CFD cases in estimating the coefficient of convective heat transfer, when compared with full CFD simulations. Therefore, the proposed model has the potential to efficiently guide the configuration design of PV arrays for power generation enhancement in real-world operations.


title: Causal Multi-Label Feature Selection in Federated Setting

abstract: Multi-label feature selection serves as an effective mean for dealing with high-dimensional multi-label data. To achieve satisfactory performance, existing methods for multi-label feature selection often require the centralization of substantial data from multiple sources. However, in Federated setting, centralizing data from all sources and merging them into a single dataset is not feasible. To tackle this issue, in this paper, we study a challenging problem of causal multi-label feature selection in federated setting and propose a Federated Causal Multi-label Feature Selection (FedCMFS) algorithm with three novel subroutines. Specifically, FedCMFS first uses the FedCFL subroutine that considers the correlations among label-label, label-feature, and feature-feature to learn the relevant features (candidate parents and children) of each class label while preserving data privacy without centralizing data. Second, FedCMFS employs the FedCFR subroutine to selectively recover the missed true relevant features. Finally, FedCMFS utilizes the FedCFC subroutine to remove false relevant features. The extensive experiments on 8 datasets have shown that FedCMFS is effect for causal multi-label feature selection in federated setting.


title: RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models

abstract: Reinforcement learning (RL) has demonstrated its capability in solving various tasks but is notorious for its low sample efficiency. In this paper, we propose RLingua, a framework that can leverage the internal knowledge of large language models (LLMs) to reduce the sample complexity of RL in robotic manipulations. To this end, we first present a method for extracting the prior knowledge of LLMs by prompt engineering so that a preliminary rule-based robot controller for a specific task can be generated in a user-friendly manner. Despite being imperfect, the LLM-generated robot controller is utilized to produce action samples during rollouts with a decaying probability, thereby improving RL's sample efficiency. We employ TD3, the widely-used RL baseline method, and modify the actor loss to regularize the policy learning towards the LLM-generated controller. RLingua also provides a novel method of improving the imperfect LLM-generated robot controllers by RL. We demonstrate that RLingua can significantly reduce the sample complexity of TD3 in four robot tasks of panda_gym and achieve high success rates in 12 sampled sparsely rewarded robot tasks in RLBench, where the standard TD3 fails. Additionally, We validated RLingua's effectiveness in real-world robot experiments through Sim2Real, demonstrating that the learned policies are effectively transferable to real robot tasks. Further details about our work are available at our project website https://rlingua.github.io.


title: A Comparative Study of Perceptual Quality Metrics for Audio-driven Talking Head Videos

abstract: The rapid advancement of Artificial Intelligence Generated Content (AIGC) technology has propelled audio-driven talking head generation, gaining considerable research attention for practical applications. However, performance evaluation research lags behind the development of talking head generation techniques. Existing literature relies on heuristic quantitative metrics without human validation, hindering accurate progress assessment. To address this gap, we collect talking head videos generated from four generative methods and conduct controlled psychophysical experiments on visual quality, lip-audio synchronization, and head movement naturalness. Our experiments validate consistency between model predictions and human annotations, identifying metrics that align better with human opinions than widely-used measures. We believe our work will facilitate performance evaluation and model development, providing insights into AIGC in a broader context. Code and data will be made available at https://github.com/zwx8981/ADTH-QA.


title: Bounding the Photon Mass with Ultrawide Bandwidth Pulsar Timing Data and Dedispersed Pulses of Fast Radio Bursts

abstract: Exploring the concept of a massive photon has been an important area in astronomy and physics. If photons have mass, their propagation in nonvacuum space would be affected by both the nonzero mass $m_{\gamma}$ and the presence of a plasma medium. This would lead to a delay time proportional to $m_{\gamma}^2\nu^{-4}$, which deviates from the classical dispersion relation (proportional to $\nu^{-2}$). For the first time, we have derived the dispersion relation of a photon with a nonzero mass propagating in plasma. To reduce the impact of variations in the dispersion measure (DM), we employed the high-precision timing data to constrain the upper bound of the photon mass. Specifically, the DM/time of arrival (TOA) uncertainties derived from ultrawide bandwidth (UWB) observations conducted by the Parkes Pulsar Timing Array (PPTA) are used. The dedispersed pulses from fast radio bursts (FRBs) with minimal scattering effects are also used to constrain the upper bound of photon mass. The stringent limit on the photon mass is determined by uncertainties of the TOA of pulsars, with an optimum value of $9.52\times 10^{-46} \, \rm kg \,\,(5.34 \times 10^{-10}\, \rm eV/c^2$). In the future, it is essential to investigate the photon mass, as pulsar timing data are collected by PTA and UWB receivers, or FRBs with wideband spectra are detected by UWB receivers.


title: LiDAR Point Cloud-based Multiple Vehicle Tracking with Probabilistic Measurement-Region Association

abstract: Multiple extended target tracking (ETT) has gained increasing attention due to the development of high-precision LiDAR and radar sensors in automotive applications. For LiDAR point cloud-based vehicle tracking, this paper presents a probabilistic measurement-region association (PMRA) ETT model, which can describe the complex measurement distribution by partitioning the target extent into different regions. The PMRA model overcomes the drawbacks of previous data-region association (DRA) models by eliminating the approximation error of constrained estimation and using continuous integrals to more reliably calculate the association probabilities. Furthermore, the PMRA model is integrated with the Poisson multi-Bernoulli mixture (PMBM) filter for tracking multiple vehicles. Simulation results illustrate the superior estimation accuracy of the proposed PMRA-PMBM filter in terms of both positions and extents of the vehicles comparing with PMBM filters using the gamma Gaussian inverse Wishart and DRA implementations.