title: Rethinking Classifier Re-Training in Long-Tailed Recognition: A Simple Logits Retargeting Approach

abstract: In the long-tailed recognition field, the Decoupled Training paradigm has demonstrated remarkable capabilities among various methods. This paradigm decouples the training process into separate representation learning and classifier re-training. Previous works have attempted to improve both stages simultaneously, making it difficult to isolate the effect of classifier re-training. Furthermore, recent empirical studies have demonstrated that simple regularization can yield strong feature representations, emphasizing the need to reassess existing classifier re-training methods. In this study, we revisit classifier re-training methods based on a unified feature representation and re-evaluate their performances. We propose a new metric called Logits Magnitude as a superior measure of model performance, replacing the commonly used Weight Norm. However, since it is hard to directly optimize the new metric during training, we introduce a suitable approximate invariant called Regularized Standard Deviation. Based on the two newly proposed metrics, we prove that reducing the absolute value of Logits Magnitude when it is nearly balanced can effectively decrease errors and disturbances during training, leading to better model performance. Motivated by these findings, we develop a simple logits retargeting approach (LORT) without the requirement of prior knowledge of the number of samples per class. LORT divides the original one-hot label into small true label probabilities and large negative label probabilities distributed across each class. Our method achieves state-of-the-art performance on various imbalanced datasets, including CIFAR100-LT, ImageNet-LT, and iNaturalist2018.


title: Are your comments outdated? Towards automatically detecting code-comment consistency

abstract: In software development and maintenance, code comments can help developers understand source code, and improve communication among developers. However, developers sometimes neglect to update the corresponding comment when changing the code, resulting in outdated comments (i.e., inconsistent codes and comments). Outdated comments are dangerous and harmful and may mislead subsequent developers. More seriously, the outdated comments may lead to a fatal flaw sometime in the future. To automatically identify the outdated comments in source code, we proposed a learning-based method, called CoCC, to detect the consistency between code and comment. To efficiently identify outdated comments, we extract multiple features from both codes and comments before and after they change. Besides, we also consider the relation between code and comment in our model. Experiment results show that CoCC can effectively detect outdated comments with precision over 90%. In addition, we have identified the 15 most important factors that cause outdated comments, and verified the applicability of CoCC in different programming languages. We also used CoCC to find outdated comments in the latest commits of open source projects, which further proves the effectiveness of the proposed method.


title: EUROPA: A Legal Multilingual Keyphrase Generation Dataset

abstract: Keyphrase generation has primarily been explored within the context of academic research articles, with a particular focus on scientific domains and the English language. In this work, we present EUROPA, a dataset for multilingual keyphrase generation in the legal domain. It is derived from legal judgments from the Court of Justice of the European Union (EU), and contains instances in all 24 EU official languages. We run multilingual models on our corpus and analyze the results, showing room for improvement on a domain-specific multilingual corpus such as the one we present.


title: Effects of $f(\mathcal{R},\mathcal{T},\mathcal{R}_{\gamma\upsilon}\mathcal{T}^{\gamma\upsilon})$ Gravity on Anisotropic Charged Compact Structures

abstract: This paper focuses on the analysis of static spherically symmetric anisotropic solutions in the presence of electromagnetic field through the gravitational decoupling approach in $f(\mathcal{R},\mathcal{T},\mathcal{R}_{\gamma\upsilon}\mathcal{T}^{\gamma\upsilon})$ gravity. We use geometric deformation only on radial metric function and obtain two sets of the field equations. The first set deals with isotropic fluid while the second set yields the influence of anisotropic source. We consider the modified Krori-Barua charged isotropic solution for spherical self-gravitating star to deal with the isotropic system. The second set of the field equations is solved by taking two different constraints. We then investigate physical acceptability of the obtained solutions through graphical analysis of the effective physical variables and energy conditions. We also analyze the effects of charge on different parameters, (i.e., mass, compactness and redshift) for the resulting solutions. It is found that our both solutions are viable as well as stable for specific values of the decoupling parameter $\varphi$ and charge. We conclude that a self-gravitating star shows more stable behavior in this gravity.


title: Cloud-based Federated Learning Framework for MRI Segmentation

abstract: In contemporary rural healthcare settings, the principal challenge in diagnosing brain images is the scarcity of available data, given that most of the existing deep learning models demand extensive training data to optimize their performance, necessitating centralized processing methods that potentially compromise data privacy. This paper proposes a novel framework tailored for brain tissue segmentation in rural healthcare facilities. The framework employs a deep reinforcement learning (DRL) environment in tandem with a refinement model (RM) deployed locally at rural healthcare sites. The proposed DRL model has a reduced parameter count and practicality for implementation across distributed rural sites. To uphold data privacy and enhance model generalization without transgressing privacy constraints, we employ federated learning (FL) for cooperative model training. We demonstrate the efficacy of our approach by training the network with a limited data set and observing a substantial performance enhancement, mitigating inaccuracies and irregularities in segmentation across diverse sites. Remarkably, the DRL model attains an accuracy of up to 80%, surpassing the capabilities of conventional convolutional neural networks when confronted with data insufficiency. Incorporating our RM results in an additional accuracy improvement of at least 10%, while FL contributes to a further accuracy enhancement of up to 5%. Collectively, the framework achieves an average 92% accuracy rate within rural healthcare settings characterized by data constraints.


title: Leveraging Team Correlation for Approximating Equilibrium in Two-Team Zero-Sum Games

abstract: Two-team zero-sum games are one of the most important paradigms in game theory. In this paper, we focus on finding an unexploitable equilibrium in large team games. An unexploitable equilibrium is a worst-case policy, where members in the opponent team cannot increase their team reward by taking any policy, e.g., cooperatively changing to other joint policies. As an optimal unexploitable equilibrium in two-team zero-sum games, correlated-team maxmin equilibrium remains unexploitable even in the worst case where players in the opponent team can achieve arbitrary cooperation through a joint team policy. However, finding such an equilibrium in large games is challenging due to the impracticality of evaluating the exponentially large number of joint policies. To solve this problem, we first introduce a general solution concept called restricted correlated-team maxmin equilibrium, which solves the problem of being impossible to evaluate all joint policy by a sample factor while avoiding an exploitation problem under the incomplete joint policy evaluation. We then develop an efficient sequential correlation mechanism, and based on which we propose an algorithm for approximating the unexploitable equilibrium in large games. We show that our approach achieves lower exploitability than the state-of-the-art baseline when encountering opponent teams with different exploitation ability in large team games including Google Research Football.


title: Critical scaling for dense granular flow between parallel plates near jamming

abstract: We numerically study the flow of dense granular materials between parallel plates driven by an external force. The granular materials form a jammed solid-like state when the external force is below a critical force, while they flow like fluids above the critical force. The transition is characterized by the mass flux. The critical force depends on the average packing fraction and the distance between the plates. The scaling laws for the critical force and the mass flux are predicted theoretically based on a continuum model. They are numerically verified.


title: Robust deep labeling of radiological emphysema subtypes using squeeze and excitation convolutional neural networks: The MESA Lung and SPIROMICS Studies

abstract: Pulmonary emphysema, the progressive, irreversible loss of lung tissue, is conventionally categorized into three subtypes identifiable on pathology and on lung computed tomography (CT) images. Recent work has led to the unsupervised learning of ten spatially-informed lung texture patterns (sLTPs) on lung CT, representing distinct patterns of emphysematous lung parenchyma based on both textural appearance and spatial location within the lung, and which aggregate into 6 robust and reproducible CT Emphysema Subtypes (CTES). Existing methods for sLTP segmentation, however, are slow and highly sensitive to changes in CT acquisition protocol. In this work, we present a robust 3-D squeeze-and-excitation CNN for supervised classification of sLTPs and CTES on lung CT. Our results demonstrate that this model achieves accurate and reproducible sLTP segmentation on lung CTscans, across two independent cohorts and independently of scanner manufacturer and model.


title: "Lossless" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach

abstract: Modern deep neural networks (DNNs) are extremely powerful; however, this comes at the price of increased depth and having more parameters per layer, making their training and inference more computationally challenging. In an attempt to address this key limitation, efforts have been devoted to the compression (e.g., sparsification and/or quantization) of these large-scale machine learning models, so that they can be deployed on low-power IoT devices. In this paper, building upon recent advances in neural tangent kernel (NTK) and random matrix theory (RMT), we provide a novel compression approach to wide and fully-connected \emph{deep} neural nets. Specifically, we demonstrate that in the high-dimensional regime where the number of data points $n$ and their dimension $p$ are both large, and under a Gaussian mixture model for the data, there exists \emph{asymptotic spectral equivalence} between the NTK matrices for a large family of DNN models. This theoretical result enables "lossless" compression of a given DNN to be performed, in the sense that the compressed network yields asymptotically the same NTK as the original (dense and unquantized) network, with its weights and activations taking values \emph{only} in $\{ 0, \pm 1 \}$ up to a scaling. Experiments on both synthetic and real-world data are conducted to support the advantages of the proposed compression scheme, with code available at \url{https://github.com/Model-Compression/Lossless_Compression}.


title: Deciphering diffuse scattering with machine learning and the equivariant foundation model: The case of molten FeO

abstract: Bridging the gap between diffuse x-ray or neutron scattering measurements and predicted structures derived from atom-atom pair potentials in disordered materials, has been a longstanding challenge in condensed matter physics. This perspective gives a brief overview of the traditional approaches employed over the past several decades. Namely, the use of approximate interatomic pair potentials that relate 3-dimensional structural models to the measured structure factor and its associated pair distribution function. The use of machine learned interatomic potentials has grown in the past few years, and has been particularly successful in the cases of ionic and oxide systems. Recent advances in large scale sampling, along with a direct integration of scattering measurements into the model development, has provided improved agreement between experiments and large-scale models calculated with quantum mechanical accuracy. However, details of local polyhedral bonding and connectivity in meta-stable disordered systems still require improvement. Here we leverage MACE-MP-0; a newly introduced equivariant foundation model and validate the results against high-quality experimental scattering data for the case of molten iron(II) oxide (FeO). These preliminary results suggest that the emerging foundation model has the potential to surpass the traditional limitations of classical interatomic potentials.


title: Extracting Polymer Nanocomposite Samples from Full-Length Documents

abstract: This paper investigates the use of large language models (LLMs) for extracting sample lists of polymer nanocomposites (PNCs) from full-length materials science research papers. The challenge lies in the complex nature of PNC samples, which have numerous attributes scattered throughout the text. The complexity of annotating detailed information on PNCs limits the availability of data, making conventional document-level relation extraction techniques impractical due to the challenge in creating comprehensive named entity span annotations. To address this, we introduce a new benchmark and an evaluation technique for this task and explore different prompting strategies in a zero-shot manner. We also incorporate self-consistency to improve the performance. Our findings show that even advanced LLMs struggle to extract all of the samples from an article. Finally, we analyze the errors encountered in this process, categorizing them into three main challenges, and discuss potential strategies for future research to overcome them.


title: Spatial Cascaded Clustering and Weighted Memory for Unsupervised Person Re-identification

abstract: Recent unsupervised person re-identification (re-ID) methods achieve high performance by leveraging fine-grained local context. These methods are referred to as part-based methods. However, most part-based methods obtain local contexts through horizontal division, which suffer from misalignment due to various human poses. Additionally, the misalignment of semantic information in part features restricts the use of metric learning, thus affecting the effectiveness of part-based methods. The two issues mentioned above result in the under-utilization of part features in part-based methods. We introduce the Spatial Cascaded Clustering and Weighted Memory (SCWM) method to address these challenges. SCWM aims to parse and align more accurate local contexts for different human body parts while allowing the memory module to balance hard example mining and noise suppression. Specifically, we first analyze the foreground omissions and spatial confusions issues in the previous method. Then, we propose foreground and space corrections to enhance the completeness and reasonableness of the human parsing results. Next, we introduce a weighted memory and utilize two weighting strategies. These strategies address hard sample mining for global features and enhance noise resistance for part features, which enables better utilization of both global and part features. Extensive experiments on Market-1501 and MSMT17 validate the proposed method's effectiveness over many state-of-the-art methods.


title: A New Class of Compact Formulations for Vehicle Routing Problems

abstract: This paper introduces a novel compact mixed integer linear programming (MILP) formulation and a discretization discovery-based solution approach for the Vehicle Routing Problem with Time Windows (VRPTW). We aim to solve the optimization problem efficiently by constraining the linear programming (LP) solutions to use only flows corresponding to time and capacity-feasible routes that are locally elementary (prohibiting cycles of customers localized in space). We employ a discretization discovery algorithm to refine the LP relaxation iteratively. This iterative process alternates between two steps: (1) increasing time/capacity/elementarity enforcement to increase the LP objective, albeit at the expense of increased complexity (more variables and constraints), and (2) decreasing enforcement without decreasing the LP objective to reduce complexity. This iterative approach ensures we produce an LP relaxation that closely approximates the optimal MILP objective with minimal complexity, facilitating an efficient solution via an off-the-shelf MILP solver. The effectiveness of our method is demonstrated through empirical evaluations on classical VRPTW instances. We showcase the efficiency of solving the final MILP and multiple iterations of LP relaxations, highlighting the decreased integrality gap of the final LP relaxation. We believe that our approach holds promise for addressing a wide range of routing problems within and beyond the VRPTW domain.


title: Data-driven transient lift attenuation for extreme vortex gust-airfoil interactions

abstract: We present a data-driven feedforward control to attenuate large transient lift experienced by an airfoil disturbed by an extreme level of discrete vortex gust. The current analysis uses a nonlinear machine-learning technique to compress the high-dimensional flow dynamics onto a low-dimensional manifold. While the interaction dynamics between the airfoil and extreme vortex gust are parameterized by its size, gust ratio, and position, the wake responses are well-captured on this simple manifold. The effect of extreme vortex disturbance about the undisturbed baseline flows can be extracted in a physically-interpretable manner. Furthermore, we call on phase-amplitude reduction to model and control the complex nonlinear extreme aerodynamic flows. The present phase-amplitude reduction model reveals the sensitivity of the dynamical system in terms of the phase shift and amplitude change induced by external forcing with respect to the baseline periodic orbit. By performing the phase-amplitude analysis for a latent dynamical model identified by sparse regression, the sensitivity functions of low-dimensionalized aerodynamic flows for both phase and amplitude are derived. With the phase and amplitude sensitivity functions, optimal forcing can be determined to quickly suppress the effect of extreme vortex gusts towards the undisturbed states in a low-order space. The present optimal flow modification built upon the machine-learned low-dimensional subspace quickly alleviates the impact of transient vortex gusts for a variety of extreme aerodynamic scenarios, providing a potential foundation for flight of small-scale air vehicles in adverse atmospheric conditions.


title: Generation and optimization of entanglement between giant atoms chirally coupled to spin cavities

abstract: We explore a scheme for entanglement generation and optimization in giant atoms by coupling them to finite one-dimensional arrays of spins that behave as cavities. We find that high values for the concurrence can be achieved in small-sized cavities, being the generation time very short. When exciting the system by external means, optimal concurrence is obtained for very weak drivings. We also analyze the effect of disorder in these systems, showing that although the average concurrence decreases with disorder, high concurrences can still be obtained even in scenarios presenting strong disorder. This result leads us to propose an optimization procedure in which by engineering the on-site energies or hoppings in the cavity, concurrences close to 1 can be reached within an extremely short period of time.


title: Designing for Harm Reduction: Communication Repair for Multicultural Users' Voice Interactions

abstract: Voice assistants' inability to serve people-of-color and non-native English speakers has largely been documented as a quality-of-service harm. However, little work has investigated what downstream harms propagate from this poor service. How does poor usability materially manifest and affect users' lives? And what interaction designs might help users recover from these effects? We identify 6 downstream harms that propagate from quality-of-service harms in voice assistants. Through interviews and design activities with 16 multicultural participants, we unveil these 6 harms, outline how multicultural users uniquely personify their voice assistant, and suggest how these harms and personifications may affect their interactions. Lastly, we employ techniques from psychology on communication repair to contribute suggestions for harm-reducing repair that may be implemented in voice technologies. Our communication repair strategies include: identity affirmations (intermittent frequency), cultural sensitivity, and blame redirection. This work shows potential for a harm-repair framework to positively influence voice interactions.


title: Algorithms for Efficient, Compact Online Data Stream Curation

abstract: Data stream algorithms tackle operations on high-volume sequences of read-once data items. Data stream scenarios include inherently real-time systems like sensor networks and financial markets. They also arise in purely-computational scenarios like ordered traversal of big data or long-running iterative simulations. In this work, we develop methods to maintain running archives of stream data that are temporally representative, a task we call "stream curation." Our approach contributes to rich existing literature on data stream binning, which we extend by providing stateless (i.e., non-iterative) curation schemes that enable key optimizations to trim archive storage overhead and streamline processing of incoming observations. We also broaden support to cover new trade-offs between curated archive size and temporal coverage. We present a suite of five stream curation algorithms that span $\mathcal{O}(n)$, $\mathcal{O}(\log n)$, and $\mathcal{O}(1)$ orders of growth for retained data items. Within each order of growth, algorithms are provided to maintain even coverage across history or bias coverage toward more recent time points. More broadly, memory-efficient stream curation can boost the data stream mining capabilities of low-grade hardware in roles such as sensor nodes and data logging devices.


title: Critical slowing of the spin and charge density wave order in thin film Cr following photoexcitation

abstract: We report on the evolution of the charge density wave (CDW) and spin density wave (SDW) order of a chromium film following photoexcitation with an ultrafast optical laser pulse. The CDW is measured by ultrafast time-resolved x-ray diffraction of the CDW satellite that tracks the suppression and recovery of the CDW following photoexcitation. We find that as the temperature of the film approaches a discontinuous phase transition in the CDW and SDW order, the time scales of recovery increase exponentially from the expected thermal time scales. We extend a Landau model for SDW systems to account for this critical slowing with the appropriate boundary conditions imposed by the geometry of the thin film system. This model allows us to assess the energy barrier between available CDW/SDW states with different spatial periodicities.


title: Improving Acne Image Grading with Label Distribution Smoothing

abstract: Acne, a prevalent skin condition, necessitates precise severity assessment for effective treatment. Acne severity grading typically involves lesion counting and global assessment. However, manual grading suffers from variability and inefficiency, highlighting the need for automated tools. Recently, label distribution learning (LDL) was proposed as an effective framework for acne image grading, but its effectiveness is hindered by severity scales that assign varying numbers of lesions to different severity grades. Addressing these limitations, we proposed to incorporate severity scale information into lesion counting by combining LDL with label smoothing, and to decouple if from global assessment. A novel weighting scheme in our approach adjusts the degree of label smoothing based on the severity grading scale. This method helped to effectively manage label uncertainty without compromising class distinctiveness. Applied to the benchmark ACNE04 dataset, our model demonstrated improved performance in automated acne grading, showcasing its potential in enhancing acne diagnostics. The source code is publicly available at http://github.com/openface-io/acne-lds.


title: Large Convolutional Model Tuning via Filter Subspace

abstract: Efficient fine-tuning methods are critical to address the high computational and parameter complexity while adapting large pre-trained models to downstream tasks. Our study is inspired by prior research that represents each convolution filter as a linear combination of a small set of filter subspace elements, referred to as filter atoms. In this paper, we propose to fine-tune pre-trained models by adjusting only filter atoms, which are responsible for spatial-only convolution, while preserving spatially-invariant channel combination knowledge in atom coefficients. In this way, we bring a new filter subspace view for model tuning. Furthermore, each filter atom can be recursively decomposed as a combination of another set of atoms, which naturally expands the number of tunable parameters in the filter subspace. By only adapting filter atoms constructed by a small number of parameters, while maintaining the rest of model parameters constant, the proposed approach is highly parameter-efficient. It effectively preserves the capabilities of pre-trained models and prevents overfitting to downstream tasks. Extensive experiments show that such a simple scheme surpasses previous tuning baselines for both discriminate and generative tasks.


title: Event-Driven Learning for Spiking Neural Networks

abstract: Brain-inspired spiking neural networks (SNNs) have gained prominence in the field of neuromorphic computing owing to their low energy consumption during feedforward inference on neuromorphic hardware. However, it remains an open challenge how to effectively benefit from the sparse event-driven property of SNNs to minimize backpropagation learning costs. In this paper, we conduct a comprehensive examination of the existing event-driven learning algorithms, reveal their limitations, and propose novel solutions to overcome them. Specifically, we introduce two novel event-driven learning methods: the spike-timing-dependent event-driven (STD-ED) and membrane-potential-dependent event-driven (MPD-ED) algorithms. These proposed algorithms leverage precise neuronal spike timing and membrane potential, respectively, for effective learning. The two methods are extensively evaluated on static and neuromorphic datasets to confirm their superior performance. They outperform existing event-driven counterparts by up to 2.51% for STD-ED and 6.79% for MPD-ED on the CIFAR-100 dataset. In addition, we theoretically and experimentally validate the energy efficiency of our methods on neuromorphic hardware. On-chip learning experiments achieved a remarkable 30-fold reduction in energy consumption over time-step-based surrogate gradient methods. The demonstrated efficiency and efficacy of the proposed event-driven learning methods emphasize their potential to significantly advance the fields of neuromorphic computing, offering promising avenues for energy-efficiency applications.


title: Assessing Bilateral Neurovascular Bundles Function with Pulsed Wave Doppler Ultrasound: Implications for Reducing Erectile Dysfunction Following Prostate Radiotherapy

abstract: This study aims to evaluate the functional status of bilateral neurovascular bundles (NVBs) using pulsed wave Doppler ultrasound in patients undergoing prostate radiotherapy (RT). Sixty-two patients (mean age: 66.1 +/- 7.2 years) underwent transrectal ultrasound scan using a conventional ultrasound scanner, a 7.5 MHz bi-plane probe and a mechanical stepper. The ultrasound protocol comprised 3 steps: 1) 3D B-mode scans of the entire prostate, 2) localization of NVBs using color flow Doppler imaging, and 3) measurement of NVB function using pulsed wave Doppler. Five pulsed Doppler waveform features were extracted: peak systolic velocity (PSV), end-diastolic velocity (EDV), mean velocity (Vm), resistive index (RI), and pulsatile index (PI). In summary, this study presents a Doppler evaluation of NVBs in patients undergoing prostate RT. It highlights substantial differences in Doppler ultrasound waveform features between bilateral NVBs. The proposed ultrasound method may prove valuable as clinicians strive to deliver NVB-sparing RT to preserve sexual function effectively and enhance patients' overall well-being.


title: Dual Pose-invariant Embeddings: Learning Category and Object-specific Discriminative Representations for Recognition and Retrieval

abstract: In the context of pose-invariant object recognition and retrieval, we demonstrate that it is possible to achieve significant improvements in performance if both the category-based and the object-identity-based embeddings are learned simultaneously during training. In hindsight, that sounds intuitive because learning about the categories is more fundamental than learning about the individual objects that correspond to those categories. However, to the best of what we know, no prior work in pose-invariant learning has demonstrated this effect. This paper presents an attention-based dual-encoder architecture with specially designed loss functions that optimize the inter- and intra-class distances simultaneously in two different embedding spaces, one for the category embeddings and the other for the object-level embeddings. The loss functions we have proposed are pose-invariant ranking losses that are designed to minimize the intra-class distances and maximize the inter-class distances in the dual representation spaces. We demonstrate the power of our approach with three challenging multi-view datasets, ModelNet-40, ObjectPI, and FG3D. With our dual approach, for single-view object recognition, we outperform the previous best by 20.0% on ModelNet40, 2.0% on ObjectPI, and 46.5% on FG3D. On the other hand, for single-view object retrieval, we outperform the previous best by 33.7% on ModelNet40, 18.8% on ObjectPI, and 56.9% on FG3D.


title: ARED: Argentina Real Estate Dataset

abstract: The Argentinian real estate market presents a unique case study characterized by its unstable and rapidly shifting macroeconomic circumstances over the past decades. Despite the existence of a few datasets for price prediction, there is a lack of mixed modality datasets specifically focused on Argentina. In this paper, the first edition of ARED is introduced. A comprehensive real estate price prediction dataset series, designed for the Argentinian market. This edition contains information solely for Jan-Feb 2024. It was found that despite the short time range captured by this zeroth edition (44 days), time dependent phenomena has been occurring mostly on a market level (market as a whole). Nevertheless future editions of this dataset, will most likely contain historical data. Each listing in ARED comprises descriptive features, and variable-length sets of images.


title: CustomListener: Text-guided Responsive Interaction for User-friendly Listening Head Generation

abstract: Listening head generation aims to synthesize a non-verbal responsive listener head by modeling the correlation between the speaker and the listener in dynamic conversion.The applications of listener agent generation in virtual interaction have promoted many works achieving the diverse and fine-grained motion generation. However, they can only manipulate motions through simple emotional labels, but cannot freely control the listener's motions. Since listener agents should have human-like attributes (e.g. identity, personality) which can be freely customized by users, this limits their realism. In this paper, we propose a user-friendly framework called CustomListener to realize the free-form text prior guided listener generation. To achieve speaker-listener coordination, we design a Static to Dynamic Portrait module (SDP), which interacts with speaker information to transform static text into dynamic portrait token with completion rhythm and amplitude information. To achieve coherence between segments, we design a Past Guided Generation Module (PGG) to maintain the consistency of customized listener attributes through the motion prior, and utilize a diffusion-based structure conditioned on the portrait token and the motion prior to realize the controllable generation. To train and evaluate our model, we have constructed two text-annotated listening head datasets based on ViCo and RealTalk, which provide text-video paired labels. Extensive experiments have verified the effectiveness of our model.


title: Crosstalk-Robust Quantum Control in Multimode Bosonic Systems

abstract: High-coherence superconducting cavities offer a hardware-efficient platform for quantum information processing. To achieve universal operations of these bosonic modes, the requisite nonlinearity is realized by coupling them to a transmon ancilla. However, this configuration is susceptible to crosstalk errors in the dispersive regime, where the ancilla frequency is Stark-shifted by the state of each coupled bosonic mode. This leads to a frequency mismatch of the ancilla drive, lowering the gate fidelities. To mitigate such coherent errors, we employ quantum optimal control to engineer ancilla pulses that are robust to the frequency shifts. These optimized pulses are subsequently integrated into a recently developed echoed conditional displacement (ECD) protocol for executing single- and two-mode operations. Through numerical simulations, we examine two representative scenarios: the preparation of single-mode Fock states in the presence of spectator modes and the generation of two-mode entangled Bell-cat states. Our approach markedly suppresses crosstalk errors, outperforming conventional ancilla control methods by orders of magnitude. These results provide guidance for experimentally achieving high-fidelity multimode operations and pave the way for developing high-performance bosonic quantum information processors.


title: Graph Construction with Flexible Nodes for Traffic Demand Prediction

abstract: Graph neural networks (GNNs) have been widely applied in traffic demand prediction, and transportation modes can be divided into station-based mode and free-floating traffic mode. Existing research in traffic graph construction primarily relies on map matching to construct graphs based on the road network. However, the complexity and inhomogeneity of data distribution in free-floating traffic demand forecasting make road network matching inflexible. To tackle these challenges, this paper introduces a novel graph construction method tailored to free-floating traffic mode. We propose a novel density-based clustering algorithm (HDPC-L) to determine the flexible positioning of nodes in the graph, overcoming the computational bottlenecks of traditional clustering algorithms and enabling effective handling of large-scale datasets. Furthermore, we extract valuable information from ridership data to initialize the edge weights of GNNs. Comprehensive experiments on two real-world datasets, the Shenzhen bike-sharing dataset and the Haikou ride-hailing dataset, show that the method significantly improves the performance of the model. On average, our models show an improvement in accuracy of around 25\% and 19.5\% on the two datasets. Additionally, it significantly enhances computational efficiency, reducing training time by approximately 12% and 32.5% on the two datasets. We make our code available at https://github.com/houjinyan/HDPC-L-ODInit.


title: Gender Bias in Large Language Models across Multiple Languages

abstract: With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing (NLP) has gained considerable focus, particularly in the context of English. Nonetheless, the investigation of gender bias in languages other than English is still relatively under-explored and insufficiently analyzed. In this work, We examine gender bias in LLMs-generated outputs for different languages. We use three measurements: 1) gender bias in selecting descriptive words given the gender-related context. 2) gender bias in selecting gender-related pronouns (she/he) given the descriptive words. 3) gender bias in the topics of LLM-generated dialogues. We investigate the outputs of the GPT series of LLMs in various languages using our three measurement methods. Our findings revealed significant gender biases across all the languages we examined.


title: Shifted Interpolation for Differential Privacy

abstract: Noisy gradient descent and its variants are the predominant algorithms for differentially private machine learning. It is a fundamental question to quantify their privacy leakage, yet tight characterizations remain open even in the foundational setting of convex losses. This paper improves over previous analyses by establishing (and refining) the "privacy amplification by iteration" phenomenon in the unifying framework of $f$-differential privacy--which tightly captures all aspects of the privacy loss and immediately implies tighter privacy accounting in other notions of differential privacy, e.g., $(\varepsilon,\delta)$-DP and R\'enyi DP. Our key technical insight is the construction of shifted interpolated processes that unravel the popular shifted-divergences argument, enabling generalizations beyond divergence-based relaxations of DP. Notably, this leads to the first exact privacy analysis in the foundational setting of strongly convex optimization. Our techniques extend to many settings: convex/strongly convex, constrained/unconstrained, full/cyclic/stochastic batches, and all combinations thereof. As an immediate corollary, we recover the $f$-DP characterization of the exponential mechanism for strongly convex optimization in Gopi et al. (2022), and moreover extend this result to more general settings.

categories: cs.LG cs.CR math.OC math.ST stat.ML stat.TH


title: The sharp estimate of nodal sets for Dirichlet Laplace eigenfunctions in polytopes

abstract: Let $P$ be a bounded $n$-dimensional Lipschitz polytope, and let $\varphi_{\lambda}$ be a Dirichlet Laplace eigenfunction in $P$ corresponding to the eigenvalue $\lambda$. We show that the $(n-1)$-dimensional Hausdorff measure of the nodal set of $\varphi_{\lambda}$ does not exceed $C(P)\sqrt{\lambda}$. Our result extends the previous ones in quaisconvex domains (including $C^1$ and convex domains) to general polytopes that are not necessarily quasiconvex.


title: SoK: Security of Programmable Logic Controllers

abstract: Billions of people rely on essential utility and manufacturing infrastructures such as water treatment plants, energy management, and food production. Our dependence on reliable infrastructures makes them valuable targets for cyberattacks. One of the prime targets for adversaries attacking physical infrastructures are Programmable Logic Controllers (PLCs) because they connect the cyber and physical worlds. In this study, we conduct the first comprehensive systematization of knowledge that explores the security of PLCs: We present an in-depth analysis of PLC attacks and defenses and discover trends in the security of PLCs from the last 17 years of research. We introduce a novel threat taxonomy for PLCs and Industrial Control Systems (ICS). Finally, we identify and point out research gaps that, if left ignored, could lead to new catastrophic attacks against critical infrastructures.


title: Wavelet Based Periodic Autoregressive Moving Average Models

abstract: This paper proposes a wavelet-based method for analysing periodic autoregressive moving average (PARMA) time series. Even though Fourier analysis provides an effective method for analysing periodic time series, it requires the estimation of a large number of Fourier parameters when the PARMA parameters do not vary smoothly. The wavelet-based analysis helps us to obtain a parsimonious model with a reduced number of parameters. We have illustrated this with simulated and actual data sets.


title: Conflict-Averse Gradient Aggregation for Constrained Multi-Objective Reinforcement Learning

abstract: In many real-world applications, a reinforcement learning (RL) agent should consider multiple objectives and adhere to safety guidelines. To address these considerations, we propose a constrained multi-objective RL algorithm named Constrained Multi-Objective Gradient Aggregator (CoMOGA). In the field of multi-objective optimization, managing conflicts between the gradients of the multiple objectives is crucial to prevent policies from converging to local optima. It is also essential to efficiently handle safety constraints for stable training and constraint satisfaction. We address these challenges straightforwardly by treating the maximization of multiple objectives as a constrained optimization problem (COP), where the constraints are defined to improve the original objectives. Existing safety constraints are then integrated into the COP, and the policy is updated using a linear approximation, which ensures the avoidance of gradient conflicts. Despite its simplicity, CoMOGA guarantees optimal convergence in tabular settings. Through various experiments, we have confirmed that preventing gradient conflicts is critical, and the proposed method achieves constraint satisfaction across all tasks.


title: Risk Twin: Real-time Risk Visualization and Control for Structural Systems

abstract: Digital twinning in structural engineering is a rapidly evolving technology that aims to eliminate the gap between physical systems and their digital models through real-time sensing, visualization, and control techniques. Although digital twins can offer dynamic insights into physical systems, their accuracy is inevitably compromised by uncertainties in sensing, modeling, simulation, and controlling. This paper proposes a specialized digital twin formulation, named Risk Twin, designed for real-time risk visualization and risk-informed control of structural systems. Integrating structural reliability and Bayesian inference methods with digital twining techniques, Risk Twin can analyze and visualize the reliability indices for structural components in real-time. To facilitate real-time inference and reliability updating, a "simulation-free" scheme is proposed, leveraging precomputed quantities prepared during an offline phase for rapid inference in the online phase. Proof-of-concept numerical and real-world Risk Twins are constructed to showcase the proposed concepts.


title: A Survey of Route Recommendations: Methods, Applications, and Opportunities

abstract: Nowadays, with advanced information technologies deployed citywide, large data volumes and powerful computational resources are intelligentizing modern city development. As an important part of intelligent transportation, route recommendation and its applications are widely used, directly influencing citizens` travel habits. Developing smart and efficient travel routes based on big data (possibly multi-modal) has become a central challenge in route recommendation research. Our survey offers a comprehensive review of route recommendation work based on urban computing. It is organized by the following three parts: 1) Methodology-wise. We categorize a large volume of traditional machine learning and modern deep learning methods. Also, we discuss their historical relations and reveal the edge-cutting progress. 2) Application\-wise. We present numerous novel applications related to route commendation within urban computing scenarios. 3) We discuss current problems and challenges and envision several promising research directions. We believe that this survey can help relevant researchers quickly familiarize themselves with the current state of route recommendation research and then direct them to future research trends.


title: Signal crosstalk in a flip-chip quantum processor

abstract: Quantum processors require a signal-delivery architecture with high addressability (low crosstalk) to ensure high performance already at the scale of dozens of qubits. Signal crosstalk causes inadvertent driving of quantum gates, which will adversely affect quantum-gate fidelities in scaled-up devices. Here, we demonstrate packaged flip-chip superconducting quantum processors with signal-crosstalk performance competitive with those reported in other platforms. For capacitively coupled qubit-drive lines, we find on-resonant crosstalk better than -27 dB (average -37 dB). For inductively coupled magnetic-flux-drive lines, we find less than 0.13 % direct-current flux crosstalk (average 0.05 %). These observed crosstalk levels are adequately small and indicate a decreasing trend with increasing distance, which is promising for further scaling up to larger numbers of qubits. We discuss the implication of our results for the design of a low-crosstalk, on-chip signal delivery architecture, including the influence of a shielding tunnel structure, potential sources of crosstalk, and estimation of crosstalk-induced qubit-gate error in scaled-up quantum processors.


title: Niobium coaxial cavities with internal quality factors exceeding 1.5 billion for circuit quantum electrodynamics

abstract: Group-V materials such as niobium and tantalum have become popular choices for extending the performance of circuit quantum electrodynamics (cQED) platforms allowing for quantum processors and memories with reduced error rates and more modes. The complex surface chemistry of niobium however makes identifying the main modes of decoherence difficult at millikelvin temperatures and single-photon powers. We use niobium coaxial quarter-wave cavities to study the impact of etch chemistry, prolonged atmospheric exposure, and the significance of cavity conditions prior to and during cooldown, in particular niobium hydride evolution, on single-photon coherence. We demonstrate cavities with quality factors of $Q_{\rm int}\gtrsim 1.4\times10^{9}$ in the single-photon regime, a $15$ fold improvement over aluminum cavities of the same geometry. We rigorously quantify the sensitivity of our fabrication process to various loss mechanisms and demonstrate a $2-4\times$ reduction in the two-level system (TLS) loss tangent and a $3-5\times$ improvement in the residual resistivity over traditional BCP etching techniques. Finally, we demonstrate transmon integration and coherent cavity control while maintaining a cavity coherence of \SI{11.3}{ms}. The accessibility of our method, which can easily be replicated in academic-lab settings, and the demonstration of its performance mark an advancement in 3D cQED.


title: Neural Simulation-Based Inference of the Neutron Star Equation of State directly from Telescope Spectra

abstract: Neutron stars provide a unique opportunity to study strongly interacting matter under extreme density conditions. The intricacies of matter inside neutron stars and their equation of state are not directly visible, but determine bulk properties, such as mass and radius, which affect the star's thermal X-ray emissions. However, the telescope spectra of these emissions are also affected by the stellar distance, hydrogen column, and effective surface temperature, which are not always well-constrained. Uncertainties on these nuisance parameters must be accounted for when making a robust estimation of the equation of state. In this study, we develop a novel methodology that, for the first time, can infer the full posterior distribution of both the equation of state and nuisance parameters directly from telescope observations. This method relies on the use of neural likelihood estimation, in which normalizing flows use samples of simulated telescope data to learn the likelihood of the neutron star spectra as a function of these parameters, coupled with Hamiltonian Monte Carlo methods to efficiently sample from the corresponding posterior distribution. Our approach surpasses the accuracy of previous methods, improves the interpretability of the results by providing access to the full posterior distribution, and naturally scales to a growing number of neutron star observations expected in the coming years.

categories: astro-ph.HE astro-ph.IM gr-qc hep-ph nucl-th


title: Stochastic linear quadratic optimal control problems with regime-switching jumps in infinite horizon

abstract: This paper investigates a stochastic linear-quadratic (SLQ, for short) control problem regulated by a time-invariant Markov chain in infinite horizon. Under the $L^2$-stability framework, we first study a class of linear backward stochastic differential equations (BSDE, for short) in infinite horizon. And then, we discuss the open-loop and closed-loop solvabilities of the SLQ problem. The open-loop solvability is characterized by the solvability of a system of coupled forward-backward stochastic differential equations (FBSDE, for short) in infinite horizon and the convexity of the cost functional, and the closed-loop solvability is shown that to be equivalent to the open-loop solvability, which in turn is equivalent to the existence of a static stabilizing solution to the associated constrained coupled algebra Riccati equations (CAREs, for short). Using the Hilbert space method, we provide a sufficient verifiable condition to ensure the SLQ problem is solvable. Finally, we also solve a class of discounted SLQ problems and give two concrete examples to illustrate the results developed in the earlier sections.


title: Optimization of array encoding for ultrasound imaging

abstract: Objective: The transmit encoding model for synthetic aperture imaging is a robust and flexible framework for understanding the effects of acoustic transmission on ultrasound image reconstruction. Our objective is to use machine learning (ML) to construct scanning sequences, parameterized by time delays and apodization weights, that produce high-quality B-mode images. Approach: We use a custom ML model in PyTorch with simulated RF data from Field II to probe the space of possible encoding sequences for those that minimize a loss function that describes image quality. This approach is made computationally feasible by a novel formulation of the derivative for delay-and-sum beamforming. Main Results: When trained for a specified experimental setting (imaging domain, hardware restrictions, etc.), our ML model produces optimized encoding sequences that, when deployed in the REFoCUS imaging framework, improve a number of standard quality metrics over conventional sequences including resolution, field of view, and contrast. We demonstrate these results experimentally on both wire targets and a tissue-mimicking phantom. Significance: This work demonstrates that the set of commonly used encoding schemes represent only a narrow subset of those available. Additionally, it demonstrates the value for ML tasks in synthetic transmit aperture imaging to consider the beamformer within the model, instead of purely as a post-processing step.


title: Semantic Text Transmission via Prediction with Small Language Models: Cost-Similarity Trade-off

abstract: We consider the communication of natural language text from a source to a destination over noiseless and character-erasure channels. We exploit language's inherent correlations and predictability to constrain transmission costs by allowing the destination to predict or complete words with potential dissimilarity with the source text. Concretely, our objective is to obtain achievable $(\bar{c}, \bar{s})$ pairs, where $\bar{c}$ is the average transmission cost at the source and $\bar{s}$ is the average semantic similarity measured via cosine similarity between vector embedding of words at the source and those predicted/completed at the destination. We obtain $(\bar{c}, \bar{s})$ pairs for neural language and first-order Markov chain-based small language models (SLM) for prediction, using both a threshold policy that transmits a word if its cosine similarity with that predicted/completed at the destination is below a threshold, and a periodic policy, which transmits words after a specific interval and predicts/completes the words in between, at the destination. We adopt an SLM for word completion. We demonstrate that, when communication occurs over a noiseless channel, the threshold policy achieves a higher $\bar{s}$ for a given $\bar{c}$ than the periodic policy and that the $\bar{s}$ achieved with the neural SLM is greater than or equal to that of the Markov chain-based algorithm for the same $\bar{c}$. The improved performance comes with a higher complexity in terms of time and computing requirements. However, when communication occurs over a character-erasure channel, all prediction algorithms and scheduling policies perform poorly. Furthermore, if character-level Huffman coding is used, the required $\bar{c}$ to achieve a given $\bar{s}$ is reduced, but the above observations still apply.


title: Hardware-Efficient Bosonic Quantum Computing with Photon-loss Detection Capability

abstract: Bosonic quantum systems offer the hardware-efficient construction of error detection/error correction codes by using the infinitely large Hilbert space. However, due to the encoding, arbitrary gate rotations usually require magic state teleportation or complicated optimized pulse sequences involving an ancilla qubit. Here, we propose a simple and hardware-efficient bosonic 02 error detection code that allows for the implementation of arbitrary X and Z rotations and a controlled phase gate by using a Kerr nonlinear resonator. Our code can detect a single photon loss, and we observe significant error suppression by simulating the frequently used hardware-efficient ansatz quantum circuit in near-term quantum computing.


title: DPP-Based Adversarial Prompt Searching for Lanugage Models

abstract: Language models risk generating mindless and offensive content, which hinders their safe deployment. Therefore, it is crucial to discover and modify potential toxic outputs of pre-trained language models before deployment. In this work, we elicit toxic content by automatically searching for a prompt that directs pre-trained language models towards the generation of a specific target output. The problem is challenging due to the discrete nature of textual data and the considerable computational resources required for a single forward pass of the language model. To combat these challenges, we introduce Auto-regressive Selective Replacement Ascent (ASRA), a discrete optimization algorithm that selects prompts based on both quality and similarity with determinantal point process (DPP). Experimental results on six different pre-trained language models demonstrate the efficacy of ASRA for eliciting toxic content. Furthermore, our analysis reveals a strong correlation between the success rate of ASRA attacks and the perplexity of target outputs, while indicating limited association with the quantity of model parameters.


title: Efficient Adapter Tuning of Pre-trained Speech Models for Automatic Speaker Verification

abstract: With excellent generalization ability, self-supervised speech models have shown impressive performance on various downstream speech tasks in the pre-training and fine-tuning paradigm. However, as the growing size of pre-trained models, fine-tuning becomes practically unfeasible due to heavy computation and storage overhead, as well as the risk of overfitting. Adapters are lightweight modules inserted into pre-trained models to facilitate parameter-efficient adaptation. In this paper, we propose an effective adapter framework designed for adapting self-supervised speech models to the speaker verification task. With a parallel adapter design, our proposed framework inserts two types of adapters into the pre-trained model, allowing the adaptation of latent features within intermediate Transformer layers and output embeddings from all Transformer layers. We conduct comprehensive experiments to validate the efficiency and effectiveness of the proposed framework. Experimental results on the VoxCeleb1 dataset demonstrate that the proposed adapters surpass fine-tuning and other parameter-efficient transfer learning methods, achieving superior performance while updating only 5% of the parameters.


title: A Gradually Reinforced Sample-Average-Approximation Differentiable Homotopy Method for a System of Stochastic Equations

abstract: This paper intends to apply the sample-average-approximation (SAA) scheme to solve a system of stochastic equations (SSE), which has many applications in a variety of fields. The SAA is an effective paradigm to address risks and uncertainty in stochastic models from the perspective of Monte Carlo principle. Nonetheless, a numerical conflict arises from the sample size of SAA when one has to make a tradeoff between the accuracy of solutions and the computational cost. To alleviate this issue, we incorporate a gradually reinforced SAA scheme into a differentiable homotopy method and develop a gradually reinforced sample-average-approximation (GRSAA) differentiable homotopy method in this paper. By introducing a series of continuously differentiable functions of the homotopy parameter $t$ ranging between zero and one, we establish a differentiable homotopy system, which is able to gradually increase the sample size of SAA as $t$ descends from one to zero. The set of solutions to the homotopy system contains an everywhere smooth path, which starts from an arbitrary point and ends at a solution to the SAA with any desired accuracy. The GRSAA differentiable homotopy method serves as a bridge to link the gradually reinforced SAA scheme and a differentiable homotopy method and retains the nice property of global convergence the homotopy method possesses while greatly reducing the computational cost for attaining a desired solution to the original SSE. Several numerical experiments further confirm the effectiveness and efficiency of the proposed method.


title: Magnetic flux in the Sun emerges unaffected by supergranular-scale surface flows

abstract: Magnetic flux emergence from the convection zone into the photosphere and beyond is a critical component of the behaviour of large-scale solar magnetism. Flux rarely emerges amid field-free areas at the surface, but when it does, the interaction between magnetism and plasma flows can be reliably explored. Prior ensemble studies identified weak flows forming near emergence locations, but the low signal-to-noise required averaging over the entire dataset, erasing information about variation across the sample. Here, we apply deep learning to achieve improved signal-to-noise, enabling a case-by-case study. We find that these associated flows are dissimilar across instances of emergence and also occur frequently in the quiet convective background. Our analysis suggests diminished influence of supergranular-scale convective flows and magnetic buoyancy on flux rise. Consistent with numerical evidence, we speculate that small-scale surface turbulence and / or deep-convective processes play an outsize role in driving flux emergence.


title: Complex scaling calculation of phase shifts for positron collisions with positive ions

abstract: We present phase-shift calculations for positron collisions with positive ions using a complex scaling method (CSM). Based on the findings of this study [R. Suzuki, T. Myo, and K. Kat\={o}, Prog. Theor. Phys. 113, 1273 (2005).], we propose a modification of the phase shift in the CSM calculation, in which phase shifts are derived only from the complex eigenenergies of the CSM Hamiltonian. This modification is based on the fact that the contributions of high-lying complex eigenenergies can be approximated as a constant value in the case of a small collision energy, where neither target excitation nor positronium formation occurs. The proposed modification limits the contribution of the complex eigenenergies to the vicinity of the collision energy, which is also intuitively acceptable. We present a geometrical formulation of the modification and demonstrative calculations of positron scattering off positive ions. Our results agree well with those reported in the literature for the targets Ne, Ar, Kr, Xe, H, He, He$^+$, and Li$^{2+}$. The phase shifts of positron scattering off a Li$^+$ ion have also been reported.


title: Lattice dynamics study of electron-correlation-induced charge density wave in antiferromagnetic kagome metal FeGe

abstract: Electron-correlation-driven phonon soft modes have been recently reported in the antiferromagnetic kagome FeGe compound and associated with the observed charge density wave (CDW). In this paper, we present a systematic investigation of the CDW origin in the context of the ab initio lattice dynamics study. Performing the group theory analysis of the mentioned soft mode, we found that the stable structure has the Immm symmetry and can be achieved by shifts of Ge atoms. Additionally, we show that the final structure realizes a distorted honeycomb Ge lattice as well as a non-flat kagome-like Fe net. For completeness, we present the electronic properties calculations. From the theoretical STM topography simulation, we indicate that the observed CDW occurs in the deformed honeycomb Ge sublattice.


title: Multiple Classical Noise Mitigation by Multiobjective Robust Quantum Optimal Control

abstract: High-quality control is a fundamental requirement for quantum computation, but practically it is often hampered by the presence of various types of noises, which can be static or time-dependent. In many realistic scenarios, multiple noise sources coexist, and their resulting noise effects need be corrected to a sufficient order, posing significant challenges for the design of effective robust control methods. Here, we explore the method of robust quantum optimal control to generally tackle the problem of resisting multiple noises from a complicated noise environment. Specifically, we confine our analysis to unitary noises that can be described by classical noise models. This method employs a gradient-based multiobjective optimization algorithm to maximize the control figure of merit, and meanwhile to minimize the perturbative effects of the noises that are allowed for. To verify its effectiveness, we apply this method to a number of examples, including roubust entangling gate in trapped ion system and robust controlled-Z gate in superconducting qubits, under commonly encountered static and time-dependent noises. Our simulation results reveal that robust optimal control can find smooth, robust pulses that can simultaneously resist several noises and thus achieve high-fidelity gates. Therefore, we expect that this method will find wide applications on current noisy quantum computing devices.


title: Universal Auto-encoder Framework for MIMO CSI Feedback

abstract: Existing auto-encoder (AE)-based channel state information (CSI) frameworks have focused on a specific configuration of user equipment (UE) and base station (BS), and thus the input and output sizes of the AE are fixed. However, in the real-world scenario, the input and output sizes may vary depending on the number of antennas of the BS and UE and the allocated resource block in the frequency dimension. A naive approach to support the different input and output sizes is to use multiple AE models, which is impractical for the UE due to the limited HW resources. In this paper, we propose a universal AE framework that can support different input sizes and multiple compression ratios. The proposed AE framework significantly reduces the HW complexity while providing comparable performance in terms of compression ratio-distortion trade-off compared to the naive and state-of-the-art approaches.


title: Hybrid Base Complex: Extract and Visualize Structure of Hex-dominant Meshes

abstract: Hex-dominant mesh generation has received significant attention in recent research due to its superior robustness compared to pure hex-mesh generation techniques. In this work, we introduce the first structure for analyzing hex-dominant meshes. This structure builds on the base complex of pure hex-meshes but incorporates the non-hex elements for a more comprehensive and complete representation. We provide its definition and describe its construction steps. Based on this structure, we present an extraction and categorization of sheets using advanced graph matching techniques to handle the non-hex elements. This enables us to develop an enhanced visual analysis of the structure for any hex-dominant meshes.We apply this structure-based visual analysis to compare hex-dominant meshes generated by different methods to study their advantages and disadvantages. This complements the standard quality metric based on the non-hex element percentage for hex-dominant meshes. Moreover, we propose a strategy to extract a cleaned (optimized) valence-based singularity graph wireframe to analyze the structure for both mesh and sheets. Our results demonstrate that the proposed hybrid base complex provides a coarse representation for mesh element, and the proposed valence singularity graph wireframe provides a better internal visualization of hex-dominant meshes.


title: Long-time fractalisation of liquid films undergoing thermocapillary instability

abstract: The study of viscous thin film flow has led to the development of highly nonlinear partial differential equations that model how the evolution of the film height is affected by different forces. We investigate a model of interaction between surface tension and the thermocapillary Marangoni effect, with a particular focus on the long-time limit. In this limit, the model predicts patterns that repeat on successively smaller spatial scales near points where the film thickness vanishes. By solving the governing equation in a space- and time-rescaled coordinate system, we observe the dynamics much further in time than has previously been achieved. Our numerical results suggest that patterns form on a close to, but not exactly, geometrically decreasing scale, potentially approaching a geometric scale very slowly as time tends to infinity.


title: Shock consolidation and the corresponding plasticity in nanopowdered Mg

abstract: Nanopowder consolidation under high strain rate shock compression is a potential method for synthesizing and processing bulk nanomaterials. A thorough investigation of the shock deformation of powder materials is of great engineering significance. Here we combine nonequilibrium molecular dynamics (NEMD) simulations and X-ray diffraction (XRD) simulation methods to investigate the deformation twinning and pore compaction in shock-compressed np-Mg. Significant anisotropy and strong dependence on crystallographic orientation are presented during shock-induced deformation twinning. During the shock stage, three typical types of twins were firstly induced, namely {11-21} twin (T1), {11-22} twin (T2) and {10-12} twin (T3). Most of them were generated in grains with a larger angle between the impact direction and the c-axis of the lattice. With the increase in strain rate, the types and quantities of twins continued to enrich, but they did not occur when the strain rate was too high. We also discussed the deformation mechanisms of the three types of twins and found that the coupling of slip and shuffle dominated twin deformation. In addition, void filling occurred due to the interaction of twinning and other plastic deformations, leading to the densification of np-Mg. During the release stage, an interesting reverse change was observed, where the twins produced by the impact receded, and twins were produced in grains that were previously difficult to produce.


title: ODM: A Text-Image Further Alignment Pre-training Approach for Scene Text Detection and Spotting

abstract: In recent years, text-image joint pre-training techniques have shown promising results in various tasks. However, in Optical Character Recognition (OCR) tasks, aligning text instances with their corresponding text regions in images poses a challenge, as it requires effective alignment between text and OCR-Text (referring to the text in images as OCR-Text to distinguish from the text in natural language) rather than a holistic understanding of the overall image content. In this paper, we propose a new pre-training method called OCR-Text Destylization Modeling (ODM) that transfers diverse styles of text found in images to a uniform style based on the text prompt. With ODM, we achieve better alignment between text and OCR-Text and enable pre-trained models to adapt to the complex and diverse styles of scene text detection and spotting tasks. Additionally, we have designed a new labeling generation method specifically for ODM and combined it with our proposed Text-Controller module to address the challenge of annotation costs in OCR tasks, allowing a larger amount of unlabeled data to participate in pre-training. Extensive experiments on multiple public datasets demonstrate that our method significantly improves performance and outperforms current pre-training methods in scene text detection and spotting tasks. Code is available at https://github.com/PriNing/ODM.


title: Coherent forecasting of NoGeAR(1) model

abstract: This article focuses on the coherent forecasting of the recently introduced novel geometric AR(1) (NoGeAR(1)) model - an INAR model based on inflated - parameter binomial thinning approach. Various techniques are available to achieve h - step ahead coherent forecasts of count time series, like median and mode forecasting. However, there needs to be more body of literature addressing coherent forecasting in the context of overdispersed count time series. Here, we study the forecasting distribution corresponding to NoGeAR(1) process using the Monte Carlo (MC) approximation method. Accordingly, several forecasting measures are employed in the simulation study to facilitate a thorough comparison of the forecasting capability of NoGeAR(1) with other models. The methodology is also demonstrated using real-life data, specifically the data on CW{\ss} TeXpert downloads and Barbados COVID-19 data.


title: Discovery of Asymmetric Spike-like Structures of the 10 au Disk around the Very Low-luminosity Protostar Embedded in the Taurus Dense Core MC 27/L1521F with ALMA

abstract: Recent Atacama Large Millimeter/submillimeter Array (ALMA) observations have revealed an increasing number of compact protostellar disks with radii of less than a few tens of astronomical units and that young Class 0/I objects have an intrinsic size diversity. To deepen our understanding of the origin of such tiny disks, we performed the highest-resolution configuration observations with ALMA at a beam size of $\sim$0$''$03 (4 au) on the very low-luminosity Class 0 protostar embedded in the Taurus dense core MC 27/L1521F. The 1.3 mm continuum measurement successfully resolved a tiny, faint ($\sim$1 mJy) disk with a major axis length of $\sim$10 au, one of the smallest examples in the ALMA protostellar studies. In addition, we detected spike-like components in the northeastern direction at the disk edge. Gravitational instability or other fragmentation mechanisms cannot explain the structures, given the central stellar mass of $\sim$0.2 $M_{\odot}$ and the disk mass of $\gtrsim$10$^{-4}$ $M_{\odot}$. Instead, we propose that these small spike structures were formed by a recent dynamic magnetic flux transport event due to interchange instability that would be favorable to occur if the parental core has a strong magnetic field. The presence of complex arc-like structures on a larger ($\sim$2000 au) scale in the same direction as the spike structures suggests that the event was not single. Such episodic, dynamical events may play an important role in maintaining the compact nature of the protostellar disk in the complex gas envelope during the main accretion phase.


title: qPMS Sigma -- An Efficient and Exact Parallel Algorithm for the Planted $(l, d)$ Motif Search Problem

abstract: Motif finding is an important step for the detection of rare events occurring in a set of DNA or protein sequences. Extraction of information about these rare events can lead to new biological discoveries. Motifs are some important patterns that have numerous applications including the identification of transcription factors and their binding sites, composite regulatory patterns, similarity between families of proteins, etc. Although several flavors of motif searching algorithms have been studied in the literature, we study the version known as $ (l, d) $-motif search or Planted Motif Search (PMS). In PMS, given two integers $ l $, $ d $ and $ n $ input sequences we try to find all the patterns of length $ l $ that appear in each of the $ n $ input sequences with at most $ d $ mismatches. We also discuss the quorum version of PMS in our work that finds motifs that are not planted in all the input sequences but at least in $ q $ of the sequences. Our algorithm is mainly based on the algorithms qPMSPrune, qPMS7, TraverStringRef and PMS8. We introduce some techniques to compress the input strings and make faster comparison between strings with bitwise operations. Our algorithm performs a little better than the existing exact algorithms to solve the qPMS problem in DNA sequence. We have also proposed an idea for parallel implementation of our algorithm.


title: Embedded Multi-label Feature Selection via Orthogonal Regression

abstract: In the last decade, embedded multi-label feature selection methods, incorporating the search for feature subsets into model optimization, have attracted considerable attention in accurately evaluating the importance of features in multi-label classification tasks. Nevertheless, the state-of-the-art embedded multi-label feature selection algorithms based on least square regression usually cannot preserve sufficient discriminative information in multi-label data. To tackle the aforementioned challenge, a novel embedded multi-label feature selection method, termed global redundancy and relevance optimization in orthogonal regression (GRROOR), is proposed to facilitate the multi-label feature selection. The method employs orthogonal regression with feature weighting to retain sufficient statistical and structural information related to local label correlations of the multi-label data in the feature learning process. Additionally, both global feature redundancy and global label relevancy information have been considered in the orthogonal regression model, which could contribute to the search for discriminative and non-redundant feature subsets in the multi-label data. The cost function of GRROOR is an unbalanced orthogonal Procrustes problem on the Stiefel manifold. A simple yet effective scheme is utilized to obtain an optimal solution. Extensive experimental results on ten multi-label data sets demonstrate the effectiveness of GRROOR.


title: Longitudinal beam dynamics design fpr Super Tau-Charm Facility

abstract: The project of Super Tau-Charm Facility (STCF) proposed in China, as a new-generation high-luminosity $e^+e^-$ collider in the low-energy region with the center-of-mass energy of 2-7 GeV, is well underway. The luminosity is targeted at $1.0\times10^{35} cm^{-2}s^{-1}$ at the optimized beam energy of 2 GeV. Longitudinal beam dynamics becomes of great importance for the STCF due to the constraints from the novel beam-beam effect called coherent X-Z instability and severe beam collective effects. In this paper, we will develop an iterative optimization model for the STCF longitudinal beam dynamics design, which takes into account the influence of transverse dynamics, coherent X-Z instability, and collective effects.


title: Global existence and uniqueness of strong solutions to the 2D nonhomogeneous primitive equations with density-dependent viscosity

abstract: This paper is concerned with an initial-boundary value problem of the two-dimensional inhomogeneous primitive equations with density-dependent viscosity. The global well-posedness of strong solutions is established, provided the initial horizontal velocity is suitably small, that is, $\|\nabla u_{0}\|_{L^{2}}\leq \eta_{0}$ for suitably small $\eta_{0}>0$. The initial data may contain vacuum. The proof is based on the local well-posedness and the blow-up criterion proved in \cite{0}, which states that if $T^{*}$ is the maximal existence time of the local strong solutions $(\rho,u,w,P)$ and $T^{*}<\infty$, then \begin{equation*} \sup_{0\leq t<T^{*}}(\left\|\nabla \rho(t)\right\|_{L^{\infty}}+\left\|\nabla^{2}\rho(t)\right\|_{L^{2}}+\left\|\nabla u(t)\right\|_{L^{2}})=\infty. \end{equation*} To complete the proof, it is required to make an estimate on a key term $\|\nabla u_{t}\|_{L_{t}^{1}L_{\Omega}^{2}}$. We prove that it is bounded and could be as small as desired under certain smallness conditions, by making use of the regularity result of hydrostatic Stokes equations and some careful time weighted estimates.


title: Wormholes in the f(R,L,T) theory of gravity

abstract: Morris and Thorne developed wormhole solutions in the late 1980s when they discovered a recipe that wormholes must follow for travelers to cross them safely. They describe exotic matter as satisfying $-p_{r} > \rho$, where $p_{r}$ is the radial pressure and $\rho$ is the energy density of the wormhole. This is a notable characteristic of the General Relativity Theory. The current article discusses traversable wormhole solutions in $f(R, L, T)=R+\alpha L+\beta T$, with $\alpha$ and $\beta$ are model parameters. The wormhole solutions presented here satisfy the metric constraints of traversability while remarkably avoiding the exotic matter condition, indicating that $f(R, L, T)$ gravity wormholes can be filled with ordinary matter. The derived solutions for the shape function of the wormhole meet the required metric conditions. They exhibit behavior that is comparable to that of wormholes reported in earlier references, which is also the case for our solutions for the energy density of such objects.


title: Enhancing social cohesion with cooperative bots in societies of greedy, mobile individuals

abstract: Addressing collective issues in social development requires a high level of social cohesion, characterized by cooperation and close social connections. However, social cohesion is challenged by selfish, greedy individuals. With the advancement of artificial intelligence (AI), the dynamics of human-machine hybrid interactions introduce new complexities in fostering social cohesion. This study explores the impact of simple bots on social cohesion from the perspective of human-machine hybrid populations within network. By investigating collective self-organizing movement during migration, results indicate that cooperative bots can promote cooperation, facilitate individual aggregation, and thereby enhance social cohesion. The random exploration movement of bots can break the frozen state of greedy population, help to separate defectors in cooperative clusters, and promote the establishment of cooperative clusters. However, the presence of defective bots can weaken social cohesion, underscoring the importance of carefully designing bot behavior. Our research reveals the potential of bots in guiding social self-organization and provides insights for enhancing social cohesion in the era of human-machine interaction within social networks.


title: Discrete Dynamics on Locally Conformal Framework

abstract: In this paper, we address the globalization problem of discrete Lagrangian and Hamiltonian dynamics in locally conformal framework.


title: A Phenomenological Study of WIMP Models

abstract: In this thesis, we investigate various possibilities of Weakly Interacting Massive Particle (WIMP) dark matter (DM) and their implications. These possibilities are important because they challenge the viability of WIMP DM in light of tight constraints from experiments such as direct detection. We begin by analyzing a fermion dark matter possibility with an axion-like particle (ALP) portal. We consider theoretical and experimental limits related to neutrino and ALP data within a certain mass range, and we find the allowed parameter space. This possibility resolves the problem of the lack of direct detection of WIMP DM through the ALP portal. Furthermore, we examine the limits on photon signals from HESS and Fermi-LAT data. Next, we look at a two-component scalar and fermion dark matter possibility, following a similar approach to our previous work. This simple possibility requires only a few additional fields and symmetries to explain neutrino mass and dark matter candidates. By finding parameter space that satisfies various bounds, such as relic density, direct detection, and invisible Higgs width, we show that both scalar and fermion particles can serve as DM. This possibility is consistent and offers a rich spectrum of phenomenology that can be tested through collider-based experiments. In our final work, we removie the extra Z2 symmetry and added a new pseudoscalar particle in our two compoent model. We test this pseudoscalar particle against multiple DM and non-DM related bounds, including DM lifetime bound, Planck bound, direct-detection limits from various target materials, and invisible Higgs width. The possibility exhibits a significant parameter space for our pseudoscalar DM while being in agreement with theoretical and experimental limits.


title: Lower-level Duality Based Reformulation and Majorization Minimization Algorithm for Hyperparameter Optimization

abstract: Hyperparameter tuning is an important task of machine learning, which can be formulated as a bilevel program (BLP). However, most existing algorithms are not applicable for BLP with non-smooth lower-level problems. To address this, we propose a single-level reformulation of the BLP based on lower-level duality without involving any implicit value function. To solve the reformulation, we propose a majorization minimization algorithm that marjorizes the constraint in each iteration. Furthermore, we show that the subproblems of the proposed algorithm for several widely used hyperparameter turning models can be reformulated into conic programs that can be efficiently solved by the off-the-shelf solvers. We theoretically prove the convergence of the proposed algorithm and demonstrate its superiority through numerical experiments.


title: Axe the X in XAI: A Plea for Understandable AI

abstract: In a recent paper, Erasmus et al. (2021) defend the idea that the ambiguity of the term "explanation" in explainable AI (XAI) can be solved by adopting any of four different extant accounts of explanation in the philosophy of science: the Deductive Nomological, Inductive Statistical, Causal Mechanical, and New Mechanist models. In this chapter, I show that the authors' claim that these accounts can be applied to deep neural networks as they would to any natural phenomenon is mistaken. I also provide a more general argument as to why the notion of explainability as it is currently used in the XAI literature bears little resemblance to the traditional concept of scientific explanation. It would be more fruitful to use the label "understandable AI" to avoid the confusion that surrounds the goal and purposes of XAI. In the second half of the chapter, I argue for a pragmatic conception of understanding that is better suited to play the central role attributed to explanation in XAI. Following Kuorikoski & Ylikoski (2015), the conditions of satisfaction for understanding an ML system are fleshed out in terms of an agent's success in using the system, in drawing correct inferences from it.


title: Surface Chern-Simons theory for third-order topological insulators and superconductors

abstract: Three-dimensional 3rd-order topological insulators (TOTIs) and superconductors (TOTSCs), as the highestorder topological phases hosting zero corner modes in physical dimension, has sparked extensive research interest. However, such topological states have not been discovered in reality due to the lack of experimental schemes of realization. Here, we propose a novel surface Chern-Simons (CS) theory for 3rd-order topological phases, and show that the theory enables a feasible and systematic design of TOTIs and TOTSCs. We show that the emergence of zero Dirac (Majorana) corner modes is entirely captured by an emergent $\mathbb{Z}_{2}$ CS term that can be further characterized by a novel two-particle Wess-Zumino (WZ) term uncovered here in the surfaces of three-dimensional topological materials. Importantly, our proposed CS term characterization and two-particle WZ term mechanism provide a unique perspective to design TOTIs (TOTSCs) in terms of minimal ingredients, feasibly guiding the search for underlying materials, with promising candidates being discussed. This work shall advance both the theoretical and experimental research for highest-order topological matters.


title: Deep Optical Emission-Line Images of Nine Known and Three New Galactic Supernova Remnants

abstract: Deep optical emission-line images are presented for nine known plus three new Galactic supernova remnants (SNRs), all but one having at least one angular dimension greater than one degree. Wide-field images taken in H$\alpha$ and [O III] $\lambda$5007 reveal many new and surprising remnant structures including large remnant shock extensions and `breakout' features not seen in published optical or radio data. These images represent over 12,000 individual images totaling more than 1000 hours of exposure time taken over the last two years mainly using small aperture telescopes which detected fainter nebular line emissions than published emission-line images. During the course of this imaging program, we discovered three new SNRs, namely G107.5-5.1 (the Nereides Nebula), G209.9-8.2, and G210.5+1.3, two of which have diameters >1.5 degrees. Besides offering greater structural detail on the nine already known SNRs, a key finding of this study is the importance of [O III] emission-line imaging for mapping the complete shock emissions of Galactic SNRs.


title: Deep Reinforcement Learning for Solving Management Problems: Towards A Large Management Mode

abstract: We introduce a deep reinforcement learning (DRL) approach for solving management problems including inventory management, dynamic pricing, and recommendation. This DRL approach has the potential to lead to a large management model based on certain transformer neural network structures, resulting in an artificial general intelligence paradigm for various management tasks. Traditional methods have limitations for solving complex real-world problems, and we demonstrate how DRL can surpass existing heuristic approaches for solving management tasks. We aim to solve the problems in a unified framework, considering the interconnections between different tasks. Central to our methodology is the development of a foundational decision model coordinating decisions across the different domains through generative decision-making. Our experimental results affirm the effectiveness of our DRL-based framework in complex and dynamic business environments. This work opens new pathways for the application of DRL in management problems, highlighting its potential to revolutionize traditional business management.


title: Creating area level indices of behaviours impacting cancer in Australia with a Bayesian generalised shared component model

abstract: This study develops a model-based index creation approach called the Generalized Shared Component Model (GSCM) by drawing on the large field of factor models. The proposed fully Bayesian approach accommodates heteroscedastic model error, multiple shared factors and flexible spatial priors. Moreover, our model, unlike previous index approaches, provides indices with uncertainty. Focusing on Australian risk factor data, the proposed GSCM is used to develop the Area Indices of Behaviors Impacting Cancer product - representing the first area level cancer risk factor index in Australia. This advancement aids in identifying communities with elevated cancer risk, facilitating targeted health interventions.


title: Diffusion limits in the quarter plane and non-semimartingale reflected Brownian motion

abstract: We consider a continuous-time random walk in the quarter plane for which the transition intensities are constant on each of the four faces $(0,\infty)^2$, $F_1=\{0\}\times(0,\infty)$, $F_2=(0,\infty)\times\{0\}$ and $\{(0,0)\}$. We show that when rescaled diffusively it converges in law to a Brownian motion with oblique reflection direction $d^{(i)}$ on face $F_i$, $i=1,2$, defined via the Varadhan-Williams submartingale problem. A parameter denoted by $\alpha$ was introduced in \cite{vw}, measuring the extent to which $d^{(i)}$ are inclined toward the origin. In the case of the quarter plane, $\alpha$ takes values in $(-2,2)$, and it is known that the reflected Brownian motion is a semimartingale if and only if $\alpha\in(-2,1)$. Convergence results via both the Skorohod map and the invariance principle for semimartingale reflected Brownian motion are known to hold in various settings in arbitrary dimension. In the case of the quarter plane, the invariance principle was proved for $\alpha \in (-2,1)$ whereas for tools based on the Skorohod map to be applicable it is necessary (but not sufficient) that $\alpha \in [-1,1)$. Another tool that has been used to prove convergence in general dimension is the extended Skorohod map, which in the case of the quarter plane provides convergence for $\alpha=1$. This paper focuses on the range $\alpha \in (1,2)$, where the Skorohod problem and the extended Skorohod problem do not possess a unique solution, the limit process is not a semimartingale, and convergence to reflected Brownian motion has not been shown before. The result has implications on the asymptotic analysis of two Markovian queueing models: The {\it generalized processor sharing model with parallelization slowdown}, and the {\it coupled processor model}.


title: DEEP-IoT: Downlink-Enhanced Efficient-Power Internet of Things

abstract: At the heart of the Internet of Things (IoT) -- a domain witnessing explosive growth -- the imperative for energy efficiency and the extension of device lifespans has never been more pressing. This paper presents DEEP-IoT, a revolutionary communication paradigm poised to redefine how IoT devices communicate. Through a pioneering "listen more, transmit less" strategy, DEEP-IoT challenges and transforms the traditional transmitter (IoT devices)-centric communication model to one where the receiver (the access point) play a pivotal role, thereby cutting down energy use and boosting device longevity. We not only conceptualize DEEP-IoT but also actualize it by integrating deep learning-enhanced feedback channel codes within a narrow-band system. Simulation results show a significant enhancement in the operational lifespan of IoT cells -- surpassing traditional systems using Turbo and Polar codes by up to 52.71%. This leap signifies a paradigm shift in IoT communications, setting the stage for a future where IoT devices boast unprecedented efficiency and durability.

categories: cs.IT cs.LG cs.SY eess.SP eess.SY math.IT


title: Model-Based Planning and Control for Terrestrial-Aerial Bimodal Vehicles with Passive Wheels

abstract: Terrestrial and aerial bimodal vehicles have gained widespread attention due to their cross-domain maneuverability. Nevertheless, their bimodal dynamics significantly increase the complexity of motion planning and control, thus hindering robust and efficient autonomous navigation in unknown environments. To resolve this issue, we develop a model-based planning and control framework for terrestrial aerial bi-modal vehicles. This work begins by deriving a unified dynamic model and the corresponding differential flatness. Leveraging differential flatness, an optimization-based trajectory planner is proposed, which takes into account both solution quality and computational efficiency. Moreover, we design a tracking controller using nonlinear model predictive control based on the proposed unified dynamic model to achieve accurate trajectory tracking and smooth mode transition. We validate our framework through extensive benchmark comparisons and experiments, demonstrating its effectiveness in terms of planning quality and control performance.


title: Softened Symbol Grounding for Neuro-symbolic Systems

abstract: Neuro-symbolic learning generally consists of two separated worlds, i.e., neural network training and symbolic constraint solving, whose success hinges on symbol grounding, a fundamental problem in AI. This paper presents a novel, softened symbol grounding process, bridging the gap between the two worlds, and resulting in an effective and efficient neuro-symbolic learning framework. Technically, the framework features (1) modeling of symbol solution states as a Boltzmann distribution, which avoids expensive state searching and facilitates mutually beneficial interactions between network training and symbolic reasoning;(2) a new MCMC technique leveraging projection and SMT solvers, which efficiently samples from disconnected symbol solution spaces; (3) an annealing mechanism that can escape from %being trapped into sub-optimal symbol groundings. Experiments with three representative neuro symbolic learning tasks demonstrate that, owining to its superior symbol grounding capability, our framework successfully solves problems well beyond the frontier of the existing proposals.


title: Local stability guarantees for data-driven quadratically nonlinear models

abstract: The Navier Stokes equations (NSEs) are partial differential equations (PDEs) to describe the nonlinear convective motion of fluids and they are computationally expensive to simulate because of their high nonlinearity and variables being fully coupled. Reduced-order models (ROMs) are simpler models for evolving the flows by capturing only the dominant behaviors of a system and can be used to design controllers for high-dimensional systems. However it is challenging to guarantee the stability of these models either globally or locally. Ensuring the stability of ROMs can improve the interpretability of the behavior of the dynamics and help develop effective system control strategies. For quadratically nonlinear systems that represent many fluid flows, the Schlegel and Noack trapping theorem (JFM, 2015) can be used to check if ROMs are globally stable (long-term bounded). This theorem was subsequently incorporated into system identification techniques that determine models directly from data. In this work, we relax the quadratically energy-preserving constraints in this theorem, and then promote local stability in data-driven models of quadratically nonlinear dynamics. First, we prove a theorem outlining sufficient conditions to ensure local stability in linear-quadratic systems and provide an estimate of the stability radius. Second, we incorporate this theorem into system identification methods and produce a-priori locally stable data-driven models. Several examples are presented to demonstrate the effectiveness and accuracy of the proposed algorithm.


title: Small, Versatile and Mighty: A Range-View Perception Framework

abstract: Despite its compactness and information integrity, the range view representation of LiDAR data rarely occurs as the first choice for 3D perception tasks. In this work, we further push the envelop of the range-view representation with a novel multi-task framework, achieving unprecedented 3D detection performances. Our proposed Small, Versatile, and Mighty (SVM) network utilizes a pure convolutional architecture to fully unleash the efficiency and multi-tasking potentials of the range view representation. To boost detection performances, we first propose a range-view specific Perspective Centric Label Assignment (PCLA) strategy, and a novel View Adaptive Regression (VAR) module to further refine hard-to-predict box properties. In addition, our framework seamlessly integrates semantic segmentation and panoptic segmentation tasks for the LiDAR point cloud, without extra modules. Among range-view-based methods, our model achieves new state-of-the-art detection performances on the Waymo Open Dataset. Especially, over 10 mAP improvement over convolutional counterparts can be obtained on the vehicle class. Our presented results for other tasks further reveal the multi-task capabilities of the proposed small but mighty framework.


title: DAMSDet: Dynamic Adaptive Multispectral Detection Transformer with Competitive Query Selection and Adaptive Feature Fusion

abstract: Infrared-visible object detection aims to achieve robust even full-day object detection by fusing the complementary information of infrared and visible images. However, highly dynamically variable complementary characteristics and commonly existing modality misalignment make the fusion of complementary information difficult. In this paper, we propose a Dynamic Adaptive Multispectral Detection Transformer (DAMSDet) to simultaneously address these two challenges. Specifically, we propose a Modality Competitive Query Selection strategy to provide useful prior information. This strategy can dynamically select basic salient modality feature representation for each object. To effectively mine the complementary information and adapt to misalignment situations, we propose a Multispectral Deformable Cross-attention module to adaptively sample and aggregate multi-semantic level features of infrared and visible images for each object. In addition, we further adopt the cascade structure of DETR to better mine complementary information. Experiments on four public datasets of different scenes demonstrate significant improvements compared to other state-of-the-art methods. The code will be released at https://github.com/gjj45/DAMSDet.