title: The Distributed Complexity of Locally Checkable Labeling Problems Beyond Paths and Trees

abstract: We consider locally checkable labeling LCL problems in the LOCAL model of distributed computing. Since 2016, there has been a substantial body of work examining the possible complexities of LCL problems. For example, it has been established that there are no LCL problems exhibiting deterministic complexities falling between $\omega(\log^* n)$ and $o(\log n)$. This line of inquiry has yielded a wealth of algorithmic techniques and insights that are useful for algorithm designers. While the complexity landscape of LCL problems on general graphs, trees, and paths is now well understood, graph classes beyond these three cases remain largely unexplored. Indeed, recent research trends have shifted towards a fine-grained study of special instances within the domains of paths and trees. In this paper, we generalize the line of research on characterizing the complexity landscape of LCL problems to a much broader range of graph classes. We propose a conjecture that characterizes the complexity landscape of LCL problems for an arbitrary class of graphs that is closed under minors, and we prove a part of the conjecture. Some highlights of our findings are as follows. 1. We establish a simple characterization of the minor-closed graph classes sharing the same deterministic complexity landscape as paths, where $O(1)$, $\Theta(\log^* n)$, and $\Theta(n)$ are the only possible complexity classes. 2. It is natural to conjecture that any minor-closed graph class shares the same complexity landscape as trees if and only if the graph class has bounded treewidth and unbounded pathwidth. We prove the "only if" part of the conjecture. 3. In addition to the well-known complexity landscapes for paths, trees, and general graphs, there are infinitely many different complexity landscapes among minor-closed graph classes.


title: On an Erd\H{o}s similarity problem in the large

abstract: In a recent paper, Kolountzakis and Papageorgiou ask if for every $\epsilon \in (0,1)$, there exists a set $S \subseteq \mathbb{R}$ such that $\vert S \cap I\vert \geq 1 - \epsilon$ for every interval $I \subset \mathbb{R}$ with unit length, but that does not contain any affine copy of a given increasing sequence of exponential growth or faster. This question is an analogue of the well-known Erd\H{o}s similarity problem. In this paper, we show that for each sequence of real numbers whose integer parts form a set of positive upper Banach density, one can explicitly construct such a set $S$ that contains no affine copy of that sequence. Since there exist sequences of arbitrarily rapid growth that satisfy this condition, our result answers Kolountzakis and Papageorgiou's question in the affirmative. A key ingredient of our proof is a generalization of results by Amice, Kahane, and Haight from metric number theory. In addition, we construct a set $S$ with the required property -- but with $\epsilon \in (1/2, 1)$ -- that contains no affine copy of $\{2^n\}$.


title: A Comprehensive Survey on Database Management System Fuzzing: Techniques, Taxonomy and Experimental Comparison

abstract: Database Management System (DBMS) fuzzing is an automated testing technique aimed at detecting errors and vulnerabilities in DBMSs by generating, mutating, and executing test cases. It not only reduces the time and cost of manual testing but also enhances detection coverage, providing valuable assistance in developing commercial DBMSs. Existing fuzzing surveys mainly focus on general-purpose software. However, DBMSs are different from them in terms of internal structure, input/output, and test objectives, requiring specialized fuzzing strategies. Therefore, this paper focuses on DBMS fuzzing and provides a comprehensive review and comparison of the methods in this field. We first introduce the fundamental concepts. Then, we systematically define a general fuzzing procedure and decompose and categorize existing methods. Furthermore, we classify existing methods from the testing objective perspective, covering various components in DBMSs. For representative works, more detailed descriptions are provided to analyze their strengths and limitations. To objectively evaluate the performance of each method, we present an open-source DBMS fuzzing toolkit, OpenDBFuzz. Based on this toolkit, we conduct a detailed experimental comparative analysis of existing methods and finally discuss future research directions.


title: Comprehending Lexical and Affective Ontologies in the Demographically Diverse Spatial Social Media Discourse

abstract: This study aims to comprehend linguistic and socio-demographic features, encompassing English language styles, conveyed sentiments, and lexical diversity within spatial online social media review data. To this end, we undertake a case study that scrutinizes reviews composed by two distinct and demographically diverse groups. Our analysis entails the extraction and examination of various statistical, grammatical, and sentimental features from these two groups. Subsequently, we leverage these features with machine learning (ML) classifiers to discern their potential in effectively differentiating between the groups. Our investigation unveils substantial disparities in certain linguistic attributes between the two groups. When integrated into ML classifiers, these attributes exhibit a marked efficacy in distinguishing the groups, yielding a macro F1 score of approximately 0.85. Furthermore, we conduct a comparative evaluation of these linguistic features with word n-gram-based lexical features in discerning demographically diverse review data. As expected, the n-gram lexical features, coupled with fine-tuned transformer-based models, show superior performance, attaining accuracies surpassing 95\% and macro F1 scores exceeding 0.96. Our meticulous analysis and comprehensive evaluations substantiate the efficacy of linguistic and sentimental features in effectively discerning demographically diverse review data. The findings of this study provide valuable guidelines for future research endeavors concerning the analysis of demographic patterns in textual content across various social media platforms.


title: Stability analysis for large-scale multi-agent molecular communication systems

abstract: Molecular communication (MC) is recently featured as a novel communication tool to connect individual biological nanorobots. It is expected that a large number of nanorobots can form large multi-agent MC systems through MC to accomplish complex and large-scale tasks that cannot be achieved by a single nanorobot. However, most previous models for MC systems assume a unidirectional diffusion communication channel and cannot capture the feedback between each nanorobot, which is important for multi-agent MC systems. In this paper, we introduce a system theoretic model for large-scale multi-agent MC systems using transfer functions, and then propose a method to analyze the stability for multi-agent MC systems. The proposed method decomposes the multi-agent MC system into multiple single-input and single-output (SISO) systems, which facilitates the application of simple analysis technique for SISO systems to the large-scale multi-agent MC system. Finally, we demonstrate the proposed method by analyzing the stability of a specific large-scale multi-agent MC system and clarify a parameter region to synchronize the states of nanorobots, which is important to make cooperative behaviors at a population level.


title: An advantage based policy transfer algorithm for reinforcement learning with metrics of transferability

abstract: Reinforcement learning (RL) can enable sequential decision-making in complex and high-dimensional environments if the acquisition of a new state-action pair is efficient, i.e., when interaction with the environment is inexpensive. However, there are a myriad of real-world applications in which a high number of interactions are infeasible. In these environments, transfer RL algorithms, which can be used for the transfer of knowledge from one or multiple source environments to a target environment, have been shown to increase learning speed and improve initial and asymptotic performance. However, most existing transfer RL algorithms are on-policy and sample inefficient, and often require heuristic choices in algorithm design. This paper proposes an off-policy Advantage-based Policy Transfer algorithm, APT-RL, for fixed domain environments. Its novelty is in using the popular notion of ``advantage'' as a regularizer, to weigh the knowledge that should be transferred from the source, relative to new knowledge learned in the target, removing the need for heuristic choices. Further, we propose a new transfer performance metric to evaluate the performance of our algorithm and unify existing transfer RL frameworks. Finally, we present a scalable, theoretically-backed task similarity measurement algorithm to illustrate the alignments between our proposed transferability metric and similarities between source and target environments. Numerical experiments on three continuous control benchmark tasks demonstrate that APT-RL outperforms existing transfer RL algorithms on most tasks, and is $10\%$ to $75\%$ more sample efficient than learning from scratch.


title: On explicit bounds of Fano threefolds

abstract: In this paper, we study the explicit geometry of threefolds, in particular, Fano varieties. We find an explicitly computable positive integer $N$, such that all but a bounded family of Fano threefolds have $N$-complements. This result has many applications on finding explicit bounds of algebraic invariants for threefolds. We provide explicit lower bounds for the first gap of the $\mathbb R$-complementary thresholds for threefolds, the first gap of the global lc thresholds, the smallest minimal log discrepancy of exceptional threefolds, and the volume of log threefolds with reduced boundary and ample log canonical divisor. We also provide an explicit upper bound of the anti-canonical volume of exceptional threefolds. While the bounds in this paper may not and are not expected to be optimal, they are the first explicit bounds of these invariants in dimension three.


title: Ground-state phase diagram of two-component interacting bosons on a two-leg ladder

abstract: Using the cluster Gutzwiller mean-field method, we numerically study the ground-state phase diagram of the non-hard-core two-component interacting bosons trapped in a two-leg ladder with and without an artificial magnetic field. There are three quantum phases namely Mott insulator (MI), supercounterfluid (SCF), and superfluid (SF) are found in the phase diagram. Interestingly, several loophole SCF phases are observed at a sufficiently small intra- to inter-leg hopping ratio when the magnetic flux is absent. While if the ratio is not so small, the loophole SCF phase would disappear, but it can still be induced by applying a sufficiently large magnetic flux. Additionally, we also find that the presence of the magnetic flux leads to an enlargement of the MI lobe and the conventional SCF lobe. Moreover, the SF-MI phase boundary is quantitatively consistent with the strong-couping expansion at a weak hopping amplitude.


title: Mechanical Metamaterials Fabricated from Self-assembly: A Perspective

abstract: Mechanical metamaterials, whose unique mechanical properties stem from their structural design rather than material constituents, are gaining popularity in engineering applications. In particular, recent advances in self-assembly techniques offer the potential to fabricate load-bearing mechanical metamaterials with unparalleled feature size control and scalability compared to those produced by additive manufacturing (AM). Yet, the field is still in its early stages. In this perspective, we first provide an overview of the state-of-the-art self-assembly techniques, with a focus on the copolymer and colloid crystal self-assembly processes. We then discuss current challenges and future opportunities in this research area, focusing on novel fabrication approaches, the need for high-throughput characterization methods, and the integration of Machine Learning (ML) and lab automation for inverse design. Given recent progress in all these areas, we foresee mechanical metamaterials fabricated from self-assembly techniques impacting a variety of applications relying on lightweight, strong, and tough materials.


title: DeepQC: A Deep Learning System for Automatic Quality Control of In-situ Soil Moisture Sensor Time Series Data

abstract: Amidst changing climate, real-time soil moisture monitoring is vital for the development of in-season decision support tools to help farmers manage weather related risks. Precision Sustainable Agriculture (PSA) recently established a real-time soil moisture monitoring network across the central, Midwest, and eastern U.S., but field-scale sensor observations often come with data gaps and anomalies. To maintain the data quality needed for development of decision tools, a quality control system is necessary. The International Soil Moisture Network (ISMN) introduced the Flagit module for anomaly detection in soil moisture observations. However, under certain conditions, Flagit's quality control approaches may underperform in identifying anomalies. Recently deep learning methods have been successfully applied to detect anomalies in time series data in various disciplines. However, their use in agriculture has not been yet investigated. This study focuses on developing a Bi-directional Long Short-Term Memory (LSTM) model, referred to as DeepQC, to identify anomalies in soil moisture data. Manual flagged PSA observations were used for training, validation, and testing the model, following an 80:10:10 split. The study then compared the DeepQC and Flagit based estimates to assess their relative performance. Flagit corrected flagged 95.5% of the corrected observations and 50.3% of the anomaly observations, indicating its limitations in identifying anomalies. On the other hand, the DeepQC correctly flagged 99.7% of the correct observations and 95.6% of the anomalies in significantly less time, demonstrating its superiority over Flagit approach. Importantly, DeepQC's performance remained consistent regardless of the number of anomalies. Given the promising results obtained with the DeepQC, future studies will focus on implementing this model on national and global soil moisture networks.


title: Are LLMs Rigorous Logical Reasoner? Empowering Natural Language Proof Generation with Contrastive Stepwise Decoding

abstract: Logical reasoning remains a pivotal component within the realm of artificial intelligence. The recent evolution of large language models (LLMs) has marked significant progress in this domain. The adoption of strategies like chain-of-thought (CoT) has enhanced the performance of LLMs across diverse reasoning tasks. Nonetheless, logical reasoning that involves proof planning, specifically those that necessitate the validation of explanation accuracy, continues to present stumbling blocks. In this study, we first evaluate the efficacy of LLMs with advanced CoT strategies concerning such tasks. Our analysis reveals that LLMs still struggle to navigate complex reasoning chains, which demand the meticulous linkage of premises to derive a cogent conclusion. To address this issue, we finetune a smaller-scale language model, equipping it to decompose proof objectives into more manageable subgoals. We also introduce contrastive decoding to stepwise proof generation, making use of negative reasoning paths to strengthen the model's capacity for logical deduction. Experiments on EntailmentBank underscore the success of our method in augmenting the proof planning abilities of language models.


title: Detecting and Correcting Hate Speech in Multimodal Memes with Large Visual Language Model

abstract: Recently, large language models (LLMs) have taken the spotlight in natural language processing. Further, integrating LLMs with vision enables the users to explore more emergent abilities in multimodality. Visual language models (VLMs), such as LLaVA, Flamingo, or GPT-4, have demonstrated impressive performance on various visio-linguistic tasks. Consequently, there are enormous applications of large models that could be potentially used on social media platforms. Despite that, there is a lack of related work on detecting or correcting hateful memes with VLMs. In this work, we study the ability of VLMs on hateful meme detection and hateful meme correction tasks with zero-shot prompting. From our empirical experiments, we show the effectiveness of the pretrained LLaVA model and discuss its strengths and weaknesses in these tasks.


title: A Robust Numerical Scheme for Solving Riesz-Tempered Fractional Reaction-Diffusion Equations

abstract: The Fractional Diffusion Equation (FDE) is a mathematical model that describes anomalous transport phenomena characterized by non-local and long-range dependencies which deviate from the traditional behavior of diffusion. Solving this equation numerically is challenging due to the need to discretize complicated integral operators which increase the computational costs. These complexities are exacerbated by nonlinear source terms, nonsmooth data and irregular domains. In this study, we propose a second order Exponential Time Differencing Finite Element Method (ETD-RDP-FEM) to efficiently solve nonlinear FDE, posed in irregular domains. This approach discretizes matrix exponentials using a rational function with real and distinct poles, resulting in an L-stable scheme that damps spurious oscillations caused by non-smooth initial data. The method is shown to outperform existing second-order methods for FDEs with a higher accuracy and faster computational time.


title: One Signal-Noise Separation based Wiener Filter for Magnetogastrogram

abstract: Magnetogastrogram (MGG) signal frequency is about 0.05 Hz, the low-frequency environmental noise interference is serious and can be several times stronger in magnitude than the signals of interest and may severely impede the extraction of relevant information. Wiener filter is one classic denoising solution for biomagnetic applications. Since the reference channels are usually placed not far enough from the biomagnetic sources under test, they will inevitably detect the signals and the Wiener filters may produce ill-conditioned solutions. Considering the solutions to improve the signal-to-noise ratio (SNR) of Wiener filter output, there are few methods to separate the signals from the noises of the reference signal at the filter input. In this paper, a new signal processing framework called signal-noise separation based Wiener filter (SNSWF) is proposed that it separates the main noise as the input signal of the filter to improve the output SNR of Wiener filter. The filter was successfully applied to the noise suppression for MGG signal detection. Using the SNSWF, the filter SNR is 16.7 dB better than the classic Wiener filter.


title: Aggregation and Closed-Form Results for Nonhomothetic CES Preferences

abstract: We provide four novel results for nonhomothetic Constant Elasticity of Substitution preferences (Hanoch, 1975). First, we derive a closed-form representation of the expenditure function of nonhomothetic CES under relatively flexible distributional assumptions of demand and price distribution parameters. Second, we characterize aggregate demand from heterogeneous households in closed-form, assuming that household total expenditures follow an empirically plausible distribution. Third, we leverage these results to study the Euler equation arising from standard intertemporal consumption-saving problems featuring within-period nonhomothetic CES preferences. Finally, we show that nonhomothetic CES expenditure shares arise as the solution of a discrete-choice logit problem.


title: Rethinking Thorne-\.Zytkow Object Formation: The Fate of X-ray Binary LMC X-4 and Implications for Ultra-long Gamma-ray Bursts

abstract: We present a start-to-end simulation aimed at studying the long-term fate of high mass X-ray binaries and whether a Thorne-\.Zytkow object (T\.ZO) might ultimately be produced. We analyze results from a 3D hydrodynamical simulation that models the eventual fate of LMC X-4, a compact high mass X-ray binary system, after the primary fills its Roche lobe and engulfs the neutron star companion. We discuss the outcome of this engulfment within the standard paradigm of T\.ZO formation. The post-merger angular momentum content of the stellar core is a key ingredient, as even a small amount of rotation can break spherical symmetry and produce a centrifugally supported accretion disk. Our findings suggest the inspiraling neutron star, upon merging with the core, can accrete efficiently via a disk at high rates ($\approx 10^{-2}M_\odot/{\rm s}$), subsequently collapsing into a black hole and triggering a bright transient with a luminosity and duration typical of an ultra-long gamma-ray burst. We propose that the canonical framework for T\.ZO formation via common envelope needs to be revised, as the significant post-merger accretion feedback will unavoidably unbind the vast majority of the surrounding envelope.


title: Meta-Reinforcement Learning for Timely and Energy-efficient Data Collection in Solar-powered UAV-assisted IoT Networks

abstract: Unmanned aerial vehicles (UAVs) have the potential to greatly aid Internet of Things (IoT) networks in mission-critical data collection, thanks to their flexibility and cost-effectiveness. However, challenges arise due to the UAV's limited onboard energy and the unpredictable status updates from sensor nodes (SNs), which impact the freshness of collected data. In this paper, we investigate the energy-efficient and timely data collection in IoT networks through the use of a solar-powered UAV. Each SN generates status updates at stochastic intervals, while the UAV collects and subsequently transmits these status updates to a central data center. Furthermore, the UAV harnesses solar energy from the environment to maintain its energy level above a predetermined threshold. To minimize both the average age of information (AoI) for SNs and the energy consumption of the UAV, we jointly optimize the UAV trajectory, SN scheduling, and offloading strategy. Then, we formulate this problem as a Markov decision process (MDP) and propose a meta-reinforcement learning algorithm to enhance the generalization capability. Specifically, the compound-action deep reinforcement learning (CADRL) algorithm is proposed to handle the discrete decisions related to SN scheduling and the UAV's offloading policy, as well as the continuous control of UAV flight. Moreover, we incorporate meta-learning into CADRL to improve the adaptability of the learned policy to new tasks. To validate the effectiveness of our proposed algorithms, we conduct extensive simulations and demonstrate their superiority over other baseline algorithms.


title: Progenitor constraint using line ratios of the CNO elements in supernova remnants

abstract: Unveiling the nature of progenitors is crucial for understanding the origin and the mechanism of core-collapse and thermonuclear supernovae (SNe). While several methods have been developed to derive stellar properties so far, many questions remain poorly understood. In this paper we demonstrate an observational approach to constrain progenitors of supernova remnants (SNRs) using abundances of carbon (C), nitrogen (N), and oxygen (O) in shock-heated circumstellar material (CSM). Our calculations with stellar evolution codes indicate that a total amount of these CNO elements will provide a more sensitive determination of the progenitor masses than the conventional method based on ejecta abundances. If the CNO lines (particularly those of C and N) are detected and measured their abundance ratios accurately, they can provide relatively robust constraint on the progenitor mass (and in some cases the rotation velocity) of SNRs. Since our method requires a better energy resolution and larger effective area in the soft X-ray band ($<1$~keV), XRISM launched on September 7, 2023 and next-generation microcalorimeter missions such as Athena, Lynx, LEM, and HUBS will bring a new insight into link between the progenitors and their remnants.


title: Cotton Gravity: the cosmological constant as spatial curvature

abstract: We derive Friedman-Lemaitre-Robertson-Walker (FLRW) models as non-trivial solutions of "Cotton Gravity" (CG), a recently proposed gravity theory alternative to General Relativity (GR) based on the Cotton tensor. Using an equivalent formulation, we show that CG leads to FLRW models with a modified expression for spatial curvature in terms of the Ricci scalar of hypersurfaces orthonormal to the 4-velocity. Considering models compatible with a well posed initial value formulation leads to operationally the same FLRW models in GR, but endowed with a precise covariant characterization of the positive/negative cosmological constant as the case with constant negative/positive spatial curvature. Under CG, the $\Lambda$CDM model becomes the unique FLRW dust model with constant negative spatial curvature.


title: Dynamic portfolio selection for nonlinear law-dependent preferences

abstract: This paper addresses the portfolio selection problem for nonlinear law-dependent preferences in continuous time, which inherently exhibit time inconsistency. Employing the method of stochastic maximum principle, we establish verification theorems for equilibrium strategies, accommodating both random market coefficients and incomplete markets. We derive the first-order condition (FOC) for the equilibrium strategies, using a notion of functional derivatives with respect to probability distributions. Then, with the help of the FOC we obtain the equilibrium strategies in closed form for two classes of implicitly defined preferences: CRRA and CARA betweenness preferences, with deterministic market coefficients. Finally, to show applications of our theoretical results to problems with random market coefficients, we examine the weighted utility. We reveal that the equilibrium strategy can be described by a coupled system of Quadratic Backward Stochastic Differential Equations (QBSDEs). The well-posedness of this system is generally open but is established under the special structures of our problem.


title: Two Stream Scene Understanding on Graph Embedding

abstract: The paper presents a novel two-stream network architecture for enhancing scene understanding in computer vision. This architecture utilizes a graph feature stream and an image feature stream, aiming to merge the strengths of both modalities for improved performance in image classification and scene graph generation tasks. The graph feature stream network comprises a segmentation structure, scene graph generation, and a graph representation module. The segmentation structure employs the UPSNet architecture with a backbone that can be a residual network, Vit, or Swin Transformer. The scene graph generation component focuses on extracting object labels and neighborhood relationships from the semantic map to create a scene graph. Graph Convolutional Networks (GCN), GraphSAGE, and Graph Attention Networks (GAT) are employed for graph representation, with an emphasis on capturing node features and their interconnections. The image feature stream network, on the other hand, focuses on image classification through the use of Vision Transformer and Swin Transformer models. The two streams are fused using various data fusion methods. This fusion is designed to leverage the complementary strengths of graph-based and image-based features.Experiments conducted on the ADE20K dataset demonstrate the effectiveness of the proposed two-stream network in improving image classification accuracy compared to conventional methods. This research provides a significant contribution to the field of computer vision, particularly in the areas of scene understanding and image classification, by effectively combining graph-based and image-based approaches.


title: Graph Signal Processing For Cancer Gene Co-Expression Network Analysis

abstract: Cancer heterogeneity arises from complex molecular interactions. Elucidating systems-level properties of gene interaction networks distinguishing cancer from normal cells is critical for understanding disease mechanisms and developing targeted therapies. Previous works focused only on identifying differences in network structures. In this study, we used graph frequency analysis of cancer genetic signals defined on a co-expression network to describe the spectral properties of underlying cancer systems. We demonstrated that cancer cells exhibit distinctive signatures in the graph frequency content of their gene expression signals. Applying graph frequency filtering, graph Fourier transforms, and its inverse to gene expression from different cancer stages resulted in significant improvements in average F-statistics of the genes compared to using their unfiltered expression levels. We propose graph spectral properties of cancer genetic signals defined on gene co-expression networks as cancer hallmarks with potential application for differential co-expression analysis.


title: How do Minimum-Norm Shallow Denoisers Look in Function Space?

abstract: Neural network (NN) denoisers are an essential building block in many common tasks, ranging from image reconstruction to image generation. However, the success of these models is not well understood from a theoretical perspective. In this paper, we aim to characterize the functions realized by shallow ReLU NN denoisers -- in the common theoretical setting of interpolation (i.e., zero training loss) with a minimal representation cost (i.e., minimal $\ell^2$ norm weights). First, for univariate data, we derive a closed form for the NN denoiser function, find it is contractive toward the clean data points, and prove it generalizes better than the empirical MMSE estimator at a low noise level. Next, for multivariate data, we find the NN denoiser functions in a closed form under various geometric assumptions on the training data: data contained in a low-dimensional subspace, data contained in a union of one-sided rays, or several types of simplexes. These functions decompose into a sum of simple rank-one piecewise linear interpolations aligned with edges and/or faces connecting training samples. We empirically verify this alignment phenomenon on synthetic data and real images.


title: Aggregate, Decompose, and Fine-Tune: A Simple Yet Effective Factor-Tuning Method for Vision Transformer

abstract: Recent advancements have illuminated the efficacy of some tensorization-decomposition Parameter-Efficient Fine-Tuning methods like LoRA and FacT in the context of Vision Transformers (ViT). However, these methods grapple with the challenges of inadequately addressing inner- and cross-layer redundancy. To tackle this issue, we introduce EFfective Factor-Tuning (EFFT), a simple yet effective fine-tuning method. Within the VTAB-1K dataset, our EFFT surpasses all baselines, attaining state-of-the-art performance with a categorical average of 75.9% in top-1 accuracy with only 0.28% of the parameters for full fine-tuning. Considering the simplicity and efficacy of EFFT, it holds the potential to serve as a foundational benchmark. The code and model are now available at https://github.com/Dongping-Chen/EFFT-EFfective-Factor-Tuning.


title: Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark

abstract: Federated learning has emerged as a promising paradigm for privacy-preserving collaboration among different parties. Recently, with the popularity of federated learning, an influx of approaches have delivered towards different realistic challenges. In this survey, we provide a systematic overview of the important and recent developments of research on federated learning. Firstly, we introduce the study history and terminology definition of this area. Then, we comprehensively review three basic lines of research: generalization, robustness, and fairness, by introducing their respective background concepts, task settings, and main challenges. We also offer a detailed overview of representative literature on both methods and datasets. We further benchmark the reviewed methods on several well-known datasets. Finally, we point out several open issues in this field and suggest opportunities for further research. We also provide a public website to continuously track developments in this fast advancing field: https://github.com/WenkeHuang/MarsFL.


title: Coupled dynamics of steady jet flow control for flexible membrane wings

abstract: We present a steady jet flow-based flow control of flexible membrane wings for an adaptive and efficient motion of bat-inspired drones in complex flight environments. A body-fitted variational computational aeroelastic framework is adopted for the modeling of fluid-structure interactions. High-momentum jet flows are injected from the leading edge and transported to the wake flows to alter the aerodynamic performance and the membrane vibration. The phase diagrams of the coupled fluid-membrane dynamics are constructed in the parameter space of the angle of attack and the jet momentum coefficient. The coupled dynamical effect of active jet flow control on the membrane performance is systematically explored. While the results indicate that the current active flow control strategy performs well at low angles of attack, the effectiveness degrades at high angles of attack with large flow separation. To understand the coupling mechanism, the variations of the vortex patterns at different jet momentum coefficients are examined by the proper orthogonal decomposition modes in the Eulerian view and the fluid transport process is studied by the coherent flow structures in the Lagrange description. Two scaling relations that quantitatively connect the membrane deformation with the aerodynamic loads presented in our previous work are verified even when active jet flow control is applied. A unifying feedback loop that reveals the fluid-membrane coupling mechanism is proposed. This feedback loop provides useful guidance for designing optimal active flow control strategies and enhancing flight capabilities. These findings can facilitate the development of next-generation bio-inspired drones that incorporate smart sensing and intelligent control.


title: BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesis

abstract: Recently, diffusion-based deep generative models (e.g., Stable Diffusion) have shown impressive results in text-to-image synthesis. However, current text-to-image models often require multiple passes of prompt engineering by humans in order to produce satisfactory results for real-world applications. We propose BeautifulPrompt, a deep generative model to produce high-quality prompts from very simple raw descriptions, which enables diffusion-based models to generate more beautiful images. In our work, we first fine-tuned the BeautifulPrompt model over low-quality and high-quality collecting prompt pairs. Then, to ensure that our generated prompts can generate more beautiful images, we further propose a Reinforcement Learning with Visual AI Feedback technique to fine-tune our model to maximize the reward values of the generated prompts, where the reward values are calculated based on the PickScore and the Aesthetic Scores. Our results demonstrate that learning from visual AI feedback promises the potential to improve the quality of generated prompts and images significantly. We further showcase the integration of BeautifulPrompt to a cloud-native AI platform to provide better text-to-image generation service in the cloud.


title: AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs

abstract: In this work, we extend the instruction-tuned Llama-2 model with end-to-end general-purpose speech processing and reasoning abilities while maintaining the wide range of original LLM capabilities, without using any carefully curated paired data. The resulting end-to-end model, named AudioChatLlama, can utilize audio prompts as a replacement for text and sustain a conversation. Such a model also has extended cross-modal capabilities such as being able to perform spoken question answering (QA), speech translation, and audio summarization amongst many other closed and open-domain tasks. This is unlike prior approaches in speech, in which LLMs are extended to handle audio for a limited number of pre-designated tasks. On both synthesized and recorded speech QA test sets, evaluations show that our end-to-end approach is on par with or outperforms cascaded systems (speech recognizer + LLM) in terms of modeling the response to a prompt. Furthermore, unlike cascades, our approach can interchange text and audio modalities and intrinsically utilize prior context in a conversation to provide better results.


title: From Complex to Simple: Unraveling the Cognitive Tree for Reasoning with Small Language Models

abstract: Reasoning is a distinctive human capacity, enabling us to address complex problems by breaking them down into a series of manageable cognitive steps. Yet, complex logical reasoning is still cumbersome for language models. Based on the dual process theory in cognitive science, we are the first to unravel the cognitive reasoning abilities of language models. Our framework employs an iterative methodology to construct a Cognitive Tree (CogTree). The root node of this tree represents the initial query, while the leaf nodes consist of straightforward questions that can be answered directly. This construction involves two main components: the implicit extraction module (referred to as the intuitive system) and the explicit reasoning module (referred to as the reflective system). The intuitive system rapidly generates multiple responses by utilizing in-context examples, while the reflective system scores these responses using comparative learning. The scores guide the intuitive system in its subsequent generation step. Our experimental results on two popular and challenging reasoning tasks indicate that it is possible to achieve a performance level comparable to that of GPT-3.5 (with 175B parameters), using a significantly smaller language model that contains fewer parameters (<=7B) than 5% of GPT-3.5.


title: The Point Process Framework for Integrated Modelling of Biodiversity Data

abstract: The quantity and types of biodiversity data being collected have increased in recent years. If we are to model and monitor biodiversity effectively, we need to respect how different data sets were collected, and effectively integrate these data types together. The framework that has emerged to do this is based on a point process formulation, with individuals as points and their distribution as a realisation of a random field. We describe this formulation and how the process model for the actual distribution is linked to the data that is collected through observation models. The observation models describe the data collection process and its uncertainties and biases. We provide an example of using these methods to model species of Norwegian freshwater fish, which shows how integrated models can be adapted to the data we can collect. We summarise the modelling issues that arise and the approaches that could be taken to solve them.


title: Personalized Federated Learning via ADMM with Moreau Envelope

abstract: Personalized federated learning (PFL) is an approach proposed to address the issue of poor convergence on heterogeneous data. However, most existing PFL frameworks require strong assumptions for convergence. In this paper, we propose an alternating direction method of multipliers (ADMM) for training PFL models with Moreau envelope (FLAME), which achieves a sublinear convergence rate, relying on the relatively weak assumption of gradient Lipschitz continuity. Moreover, due to the gradient-free nature of ADMM, FLAME alleviates the need for hyperparameter tuning, particularly in avoiding the adjustment of the learning rate when training the global model. In addition, we propose a biased client selection strategy to expedite the convergence of training of PFL models. Our theoretical analysis establishes the global convergence under both unbiased and biased client selection strategies. Our experiments validate that FLAME, when trained on heterogeneous data, outperforms state-of-the-art methods in terms of model performance. Regarding communication efficiency, it exhibits an average speedup of 3.75x compared to the baselines. Furthermore, experimental results validate that the biased client selection strategy speeds up the convergence of both personalized and global models.


title: Black Holes and Warp Drive

abstract: We study the generalizations of the original Alcubierre warp drive metric to the case of curved spacetime background. We find that the presence of a horizon is essential when one moves from spherical coordinates to Cartesian coordinates in order to avoid additional singularities. For the specific case of Schwarzschild black hole, the horizon would be effectively absent for the observers inside the warp bubble, implying that warp drives may provide a safe route to cross horizons. Moreover, we discover that the black hole's gravitational field can decrease the amount of negative energy required to sustain a warp drive, which may be instrumental for creating microscopic warp drives in lab experiments. A BEC model is also introduced to propose possible test in the Analogue Gravity framework.


title: Sharing, Teaching and Aligning: Knowledgeable Transfer Learning for Cross-Lingual Machine Reading Comprehension

abstract: In cross-lingual language understanding, machine translation is often utilized to enhance the transferability of models across languages, either by translating the training data from the source language to the target, or from the target to the source to aid inference. However, in cross-lingual machine reading comprehension (MRC), it is difficult to perform a deep level of assistance to enhance cross-lingual transfer because of the variation of answer span positions in different languages. In this paper, we propose X-STA, a new approach for cross-lingual MRC. Specifically, we leverage an attentive teacher to subtly transfer the answer spans of the source language to the answer output space of the target. A Gradient-Disentangled Knowledge Sharing technique is proposed as an improved cross-attention block. In addition, we force the model to learn semantic alignments from multiple granularities and calibrate the model outputs with teacher guidance to enhance cross-lingual transferability. Experiments on three multi-lingual MRC datasets show the effectiveness of our method, outperforming state-of-the-art approaches.


title: A Closer Look at Small-Scale Magnetic Flux Ropes in the Solar Wind at 1 AU: Results from Improved Automated Detection

abstract: Small-scale interplanetary magnetic flux ropes (SMFRs) are similar to ICMEs in magnetic structure, but are smaller and do not exhibit ICME plasma signatures. We present a computationally efficient and GPU-powered version of the single-spacecraft automated SMFR detection algorithm based on the Grad-Shafranov (GS) technique. Our algorithm is capable of processing higher resolution data, eliminates selection bias caused by a fixed $\avg{B}$ threshold, has improved detection criteria demonstrated to have better results on an MHD simulation, and recovers full 2.5D cross sections using GS reconstruction. We used it to detect 512,152 SMFRs from 27 years (1996 to 2022) of 3-second cadence \emph{Wind} measurements. Our novel findings are: (1) the radial density of SMFRs at 1 au (${\sim}1$ per $\si{10^6\kilo\meter}$) and filling factor (${\sim}$35\%) are independent of solar activity, distance to the heliospheric current sheet (HCS), and solar wind plasma type, although the minority of SMFRs with diameters greater than ${\sim}$0.01 au have a strong solar activity dependence; (2) SMFR diameters follow a log-normal distribution that peaks below the resolved range ($\gtrsim 10^4$ km), although the filling factor is dominated by SMFRs between $10^5$ to $10^6$ km; (3) most SMFRs at 1 au have strong field-aligned flows like those from PSP measurements; (4) in terms of diameter $d$, SMFR poloidal flux $\propto d^{1.2}$, axial flux $\propto d^{2.0}$, average twist number $\propto d^{-0.8}$, current density $\propto d^{-0.8}$, and helicity $\propto d^{3.2}$. Implications for the origin of SMFRs and switchbacks are briefly discussed. The new algorithm and SMFR dataset are made freely available.


title: GALA-n: Generic Architecture of Layout-Aware n-Bit Quantum Operators for Cost-Effective Realization on IBM Quantum Computers

abstract: A generic architecture of n-bit quantum operators is proposed for cost-effective transpilation, based on the layouts and the number of n neighbor physical qubits for IBM quantum computers, where n >= 3. This proposed architecture is termed "GALA-n quantum operator". The GALA-n quantum operator is designed using the visual approach of the Bloch sphere, from the visual representations of the rotational quantum operations for IBM native gates (square root of X, X, RZ, and CNOT). In this paper, we also proposed a new formula for the quantum cost, which calculates the total numbers of native gates, SWAP gates, and the depth of the final transpiled quantum circuits. This formula is termed the "transpilation quantum cost". After transpilation, our proposed GALA-n quantum operator always has a lower transpilation quantum cost than that of conventional n-bit quantum operators, which are mainly constructed from costly n-bit Toffoli gates.


title: Learning Knowledge-Enhanced Contextual Language Representations for Domain Natural Language Understanding

abstract: Knowledge-Enhanced Pre-trained Language Models (KEPLMs) improve the performance of various downstream NLP tasks by injecting knowledge facts from large-scale Knowledge Graphs (KGs). However, existing methods for pre-training KEPLMs with relational triples are difficult to be adapted to close domains due to the lack of sufficient domain graph semantics. In this paper, we propose a Knowledge-enhanced lANGuAge Representation learning framework for various clOsed dOmains (KANGAROO) via capturing the implicit graph structure among the entities. Specifically, since the entity coverage rates of closed-domain KGs can be relatively low and may exhibit the global sparsity phenomenon for knowledge injection, we consider not only the shallow relational representations of triples but also the hyperbolic embeddings of deep hierarchical entity-class structures for effective knowledge fusion.Moreover, as two closed-domain entities under the same entity-class often have locally dense neighbor subgraphs counted by max point biconnected component, we further propose a data augmentation strategy based on contrastive learning over subgraphs to construct hard negative samples of higher quality. It makes the underlying KELPMs better distinguish the semantics of these neighboring entities to further complement the global semantic sparsity. In the experiments, we evaluate KANGAROO over various knowledge-aware and general NLP tasks in both full and few-shot learning settings, outperforming various KEPLM training paradigms performance in closed-domains significantly.


title: An analytic framework for the multiplicative best-worst method

abstract: The Best-Worst Method (BWM) is a well-known Multi-Criteria Decision-Making (MCDM) method. This article deals with the multiplicative model of BWM. We first formulate an optimization model that is equivalent to the existing multiplicative model. This model provides a solid foundation for obtaining an analytic form of optimal interval-weights, Consistency Index (CI) and Consistency Ratio (CR). The proposed approach does not require any optimization software, which makes it easy to implement as well as time efficient. Also, the obtained analytical form of CR permits it to serve as an input-based consistency measure. After obtaining these analytic forms, a secondary objective function is introduced to select the best optimal weight set from the collection of all optimal weight sets. Finally, we discuss some numerical examples and a real-world application of the proposed approach in ranking the drivers of Sustainable Additive Manufacturing (SAM) to illustrate the proposed approach.


title: $L^p$-boundedness of wave operators for fourth order Schr\"odinger operators with zero resonances on $\mathbb{R}^3$

abstract: Let $H = \Delta^2 + V$ be the fourth-order Schr\"odinger operator on $\mathbb{R}^3$ with a real-valued fast-decaying potential $V$. If zero is neither a resonance nor an eigenvalue of $H$, it has recently been shown by Goldberg and Green \cite{GoGr21} that the wave operators $W_\pm(H, \Delta^2)$ are bounded on $L^p(\mathbb{R}^3)$ for $1 < p < \infty$. Additionally, it has been proved by the authors in \cite{MWY23} that these wave operators are unbounded at the endpoints, i.e., for $p=1$ and $p=\infty$. In this paper, our primary focus is to further establish the $L^p$-bounds of $W_\pm(H, \Delta^2)$ that exhibit all types of singularities at the zero energy threshold. We first prove that $W_\pm(H, \Delta^2)$ are bounded on $L^p(\mathbb{R}^3)$ for $1 < p < \infty$ in the first kind resonance case. We then proceed to establish for the second kind resonance case that they are bounded on $L^p(\mathbb{R}^3)$ for $1 < p < 3$, but not for $3 \le p < \infty$. In the third kind resonance case, we show that $W_\pm(H, \Delta^2)$ are bounded on $L^p(\mathbb{R}^3)$ for $1<p<3$. Remarkably, we can also prove that $W_\pm(H, \Delta^2)$ remain bounded on $L^p(\mathbb{R}^3)$ for $3\le p<\infty$ if in addition $H$ has a zero eigenvalue, but no $p$-wave zero resonance and all zero eigenfunctions are orthogonal to $x_ix_jx_kV$ in $L^2(\mathbb{R}^3)$ for all $i,j,k=1,2,3$ with $x=(x_1,x_2,x_3)$ and that, without such additional conditions, they are unbounded on $L^p(\mathbb{R}^3)$ for $3\le p<\infty$. These results precisely delineate all $L^p$-bounds of the wave operators $W_\pm(H, \Delta^2)$ in $\mathbb{R}^3$ with the exception of the endpoints $p=1$ and $p=\infty$. As a result, $L^p$-$L^q$ decay estimates are derived for solutions of fourth-order Schr\"odinger equations and beam equations with zero resonance singularities.


title: The $2 \times 2$ block matrices associated with an annulus

abstract: A bounded Hilbert space operator $T$ for which the closure of the annulus \[ \mathbb{A}_r=\{z \ : \ r<|z|<1\} \subseteq \mathbb{C}, \qquad (0<r<1) \] is a spectral set is called an $\mathbb A_r$-contraction. A celebrated theorem due to Douglas, Muhly and Pearcy gives a necessary and sufficient condition such that a $2 \times 2$ block matrix of operators $ \begin{bmatrix} T_1 & X 0 & T_2 \end{bmatrix} $ is a contraction. We seek an answer to the same question in the setting of annulus, i.e., under what conditions $\widetilde{T}_Y=\begin{bmatrix} T_1 & Y 0 & T_2 \end{bmatrix} $ becomes an $\mathbb A_r$-contraction. For a pair of $\mathbb A_r$-contractions $T_1,T_2$ and an operator $X$ that commutes with $T_1,T_2$, here we find a necessary and sufficient condition such that each of the block matrices \[ T_X= \begin{bmatrix} T & X 0 & T \end{bmatrix} \,, \quad \widehat{T}_X=\begin{bmatrix} T_1 & X(T_1-T_2) 0 & T_2 \end{bmatrix} \] becomes an $\mathbb A_r$-contraction. Thus, the general block matrix $\widetilde{T}_Y$ is an $\mathbb A_r$-contraction if $T_1-T_2$ (as in $\widehat{T}_X$) is invertible.


title: Exponential Stability of the Inhomogeneous Navier-Stokes-Vlasov System in Vacuum

abstract: In this paper, we study the asymptotic behaviors of solutions to the inhomogeneous Navier-Stokes-Vlasov system in $\mathbb{R}^{3}\times\mathbb{R}^{3}$, where the initial fluid density is allowed to vanish. We establish the uniform bound of the macroscopic density associated with the distribution function and prove the global existence and uniqueness of strong solutions to the Cauchy problem with vacuum for either small initial energy or large viscosity coefficient. The uniform boundedness and the presence of vacuum enable us to show that as the time evolves, the fluid velocity decays, while the distribution function concentrates towards a Dirac measure in velocity centred at $0$, with an exponential rate. In order to overcome the degeneracy in the momentum equations, we develop an energy argument based on higher order functional inequalities designed for fluid-particle coupled structures.


title: Enhancing Control Performance through ESN-Based Model Compensation in MPC for Dynamic Systems

abstract: Deriving precise system dynamic models through traditional numerical methods is often a challenging endeavor. The performance of Model Predictive Control is heavily contingent on the accuracy of the system dynamic model. Consequently, this study employs Echo State Networks to acquire knowledge of the unmodeled dynamic characteristics inherent in the system. This information is then integrated with the nominal model, functioning as a form of model compensation. The present paper introduces a control framework that combines ESN with MPC. By perpetually assimilating the disparities between the nominal and real models, control performance experiences augmentation. In a demonstrative example, a second order dynamic system is subjected to simulation. The outcomes conclusively evince that ESNbased MPC adeptly assimilates unmodeled dynamic attributes, thereby elevating the system control proficiency.


title: Effective Field Theory of Black Hole Perturbations in Vector-Tensor Gravity

abstract: We formulate the effective field theory (EFT) of vector-tensor gravity for perturbations around an arbitrary background with a ${\it timelike}$ vector profile, which can be applied to study black hole perturbations. The vector profile spontaneously breaks both the time diffeomorphism and the $U(1)$ symmetry, leaving their combination and the spatial diffeomorphism as the residual symmetries in the unitary gauge. We derive two sets of consistency relations which guarantee the residual symmetries of the EFT. Also, we provide the dictionary between our EFT coefficients and those of generalized Proca (GP) theories, which enables us to identify a simple subclass of the EFT that includes the GP theories as a special case. For this subclass, we consider the stealth Schwarzschild(-de Sitter) background solution with a constant temporal component of the vector field and study the decoupling limit of the longitudinal mode of the vector field, explicitly showing that the strong coupling problem arises due to vanishing sound speeds. This is in sharp contrast to the case of gauged ghost condensate, in which perturbations are weakly coupled thanks to certain higher-derivative terms, i.e., the scordatura terms. This implies that, in order to consistently describe this type of stealth solutions within the EFT, the scordatura terms must necessarily be taken into account in addition to those already included in the simple subclass.


title: Counterexamples and weak (1,1) estimates of wave operators for fourth-order Schr\"odinger operators in dimension three

abstract: This paper is dedicated to investigating the $L^p$-bounds of wave operators $W_\pm(H,\Delta^2)$ associated with fourth-order Schr\"odinger operators $H=\Delta^2+V$ on $\mathbb{R}^3$. We consider that real potentials satisfy $|V(x)|\lesssim \langle x\rangle^{-\mu}$ for some $\mu>0$. A recent work by Goldberg and Green \cite{GoGr21} has demonstrated that wave operators $W_\pm(H,\Delta^2)$ are bounded on $L^p(\mathbb{R}^3)$ for all $1<p<\infty$ under the condition that $\mu>9$, and zero is a regular point of $H$. In this paper, we aim to further establish endpoint estimates for $W_\pm(H,\Delta^2)$ in two significant ways. First, we provide counterexamples that illustrate the unboundedness of $W_\pm(H,\Delta^2)$ on the endpoint spaces $L^1(\mathbb{R}^3)$ and $L^\infty(\mathbb{R}^3)$, even for non-zero compactly supported potentials $V$. Second, we establish weak (1,1) estimates for the wave operators $W_\pm(H,\Delta^2)$ and their dual operators $W_\pm(H,\Delta^2)^*$ in the case where zero is a regular point and $\mu>11$. These estimates depend critically on the singular integral theory of Calder\'on-Zygmund on a homogeneous space $(X,d\omega)$ with a doubling measure $d\omega$.


title: Learning Predictive Safety Filter via Decomposition of Robust Invariant Set

abstract: Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex optimization problems online, which leads to high computational burden and poor scalability. Reinforcement learning (RL) works well with complex systems, but pays the price of losing rigorous safety guarantee. This paper presents a theoretical framework that bridges the advantages of both RMPC and RL to synthesize safety filters for nonlinear systems with state- and action-dependent uncertainty. We decompose the robust invariant set (RIS) into two parts: a target set that aligns with terminal region design of RMPC, and a reach-avoid set that accounts for the rest of RIS. We propose a policy iteration approach for robust reach-avoid problems and establish its monotone convergence. This method sets the stage for an adversarial actor-critic deep RL algorithm, which simultaneously synthesizes a reach-avoid policy network, a disturbance policy network, and a reach-avoid value network. The learned reach-avoid policy network is utilized to generate nominal trajectories for online verification, which filters potentially unsafe actions that may drive the system into unsafe regions when worst-case disturbances are applied. We formulate a second-order cone programming (SOCP) approach for online verification using system level synthesis, which optimizes for the worst-case reach-avoid value of any possible trajectories. The proposed safety filter requires much lower computational complexity than RMPC and still enjoys persistent robust safety guarantee. The effectiveness of our method is illustrated through a numerical example.


title: Compressive Sensing-Based Grant-Free Massive Access for 6G Massive Communication

abstract: The advent of the sixth-generation (6G) of wireless communications has given rise to the necessity to connect vast quantities of heterogeneous wireless devices, which requires advanced system capabilities far beyond existing network architectures. In particular, such massive communication has been recognized as a prime driver that can empower the 6G vision of future ubiquitous connectivity, supporting Internet of Human-Machine-Things for which massive access is critical. This paper surveys the most recent advances toward massive access in both academic and industry communities, focusing primarily on the promising compressive sensing-based grant-free massive access paradigm. We first specify the limitations of existing random access schemes and reveal that the practical implementation of massive communication relies on a dramatically different random access paradigm from the current ones mainly designed for human-centric communications. Then, a compressive sensing-based grant-free massive access roadmap is presented, where the evolutions from single-antenna to large-scale antenna array-based base stations, from single-station to cooperative massive multiple-input multiple-output systems, and from unsourced to sourced random access scenarios are detailed. Finally, we discuss the key challenges and open issues to shed light on the potential future research directions of grant-free massive access.


title: Learning Globally Optimized Language Structure via Adversarial Training

abstract: Recent work has explored integrating autoregressive language models with energy-based models (EBMs) to enhance text generation capabilities. However, learning effective EBMs for text is challenged by the discrete nature of language. This work proposes an adversarial training strategy to address limitations in prior efforts. Specifically, an iterative adversarial attack algorithm is presented to generate negative samples for training the EBM by perturbing text from the autoregressive model. This aims to enable the EBM to suppress spurious modes outside the support of the data distribution. Experiments on an arithmetic sequence generation task demonstrate that the proposed adversarial training approach can substantially enhance the quality of generated sequences compared to prior methods. The results highlight the promise of adversarial techniques to improve discrete EBM training. Key contributions include: (1) an adversarial attack strategy tailored to text to generate negative samples, circumventing MCMC limitations; (2) an adversarial training algorithm for EBMs leveraging these attacks; (3) empirical validation of performance improvements on a sequence generation task.


title: ChatAnything: Facetime Chat with LLM-Enhanced Personas

abstract: In this technical report, we target generating anthropomorphized personas for LLM-based characters in an online manner, including visual appearance, personality and tones, with only text descriptions. To achieve this, we first leverage the in-context learning capability of LLMs for personality generation by carefully designing a set of system prompts. We then propose two novel concepts: the mixture of voices (MoV) and the mixture of diffusers (MoD) for diverse voice and appearance generation. For MoV, we utilize the text-to-speech (TTS) algorithms with a variety of pre-defined tones and select the most matching one based on the user-provided text description automatically. For MoD, we combine the recent popular text-to-image generation techniques and talking head algorithms to streamline the process of generating talking objects. We termed the whole framework as ChatAnything. With it, users could be able to animate anything with any personas that are anthropomorphic using just a few text inputs. However, we have observed that the anthropomorphic objects produced by current generative models are often undetectable by pre-trained face landmark detectors, leading to failure of the face motion generation, even if these faces possess human-like appearances because those images are nearly seen during the training (e.g., OOD samples). To address this issue, we incorporate pixel-level guidance to infuse human face landmarks during the image generation phase. To benchmark these metrics, we have built an evaluation dataset. Based on it, we verify that the detection rate of the face landmark is significantly increased from 57.0% to 92.5% thus allowing automatic face animation based on generated speech content. The code and more results can be found at https://chatanything.github.io/.


title: Sublattice scars and beyond in two-dimensional $U(1)$ quantum link lattice gauge theories

abstract: In this article, we elucidate the structure and properties of a class of anomalous high-energy states of matter-free $U(1)$ quantum link gauge theory Hamiltonians using numerical and analytical methods. Such anomalous states, known as quantum many-body scars in the literature, have generated a lot of interest due to their athermal nature. Our starting Hamiltonian is $H = \mathcal{O}_{\mathrm{kin}} + \lambda \mathcal{O}_{\mathrm{pot}}$, where $\lambda$ is a real-valued coupling, and $\mathcal{O}_{\mathrm{kin}}$ ($\mathcal{O}_{\mathrm{pot}}$) are summed local diagonal (off-diagonal) operators in the electric flux basis acting on the elementary plaquette $\square$. The spectrum of the model in its spin-$\frac{1}{2}$ representation on $L_x \times L_y$ lattices reveal the existence of sublattice scars, $|\psi_s \rangle$, which satisfy $\mathcal{O}_{\mathrm{pot},\square} |\psi_s\rangle = |\psi_s\rangle$ for all elementary plaquettes on one sublattice and $ \mathcal{O}_{\mathrm{pot},\square} | \psi_s \rangle =0 $ on the other, while being simultaneous zero modes or nonzero integer-valued eigenstates of $\mathcal{O}_{\mathrm{kin}}$. We demonstrate a ``triangle relation'' connecting the sublattice scars with nonzero integer eigenvalues of $ \mathcal{O}_{\mathrm{kin}} $ to particular sublattice scars with $\mathcal{O}_{\mathrm{kin}} = 0$ eigenvalues. A fraction of the sublattice scars have a simple description in terms of emergent short singlets, on which we place analytic bounds. We further construct a long-ranged parent Hamiltonian for which all sublattice scars in the null space of $ \mathcal{O}_{\mathrm{kin}} $ become unique ground states and elucidate some of the properties of its spectrum. In particular, zero energy states of this parent Hamiltonian turn out to be exact scars of another $U(1)$ quantum link model with a staggered short-ranged diagonal term.


title: Challenges in Controllers on UAV Aircraft: Theory and Practice

abstract: This review explores the theoretical foundations and experimental dynamics of modern tiltrotor aircraft. Emphasizing feedback linearization, the study delves into the distinctive constraints and angular velocity ranges shaping tiltrotor behavior. Experimental findings highlight challenges in tracking circular trajectories, with color-coded representations illustrating the impact of angular velocity. Practical implications for applications like unmanned aerial vehicles are discussed, alongside identified challenges and avenues for future research. This work contributes to both theoretical understanding and practical considerations in the evolving field of tiltrotor control.


title: Emergent collective motion of self-propelled condensate droplets

abstract: Recently, there is much interest in droplet condensation on soft or liquid/liquid-like substrates. Droplets can deform soft and liquid interfaces resulting in a wealth of phenomena not observed on hard, solid surfaces (e.g., increased nucleation, inter-droplet attraction). Here, we describe a unique complex collective motion of condensate water droplets that emerges spontaneously when a solid substrate is covered with a thin oil film. Droplets move first in a serpentine, self-avoiding fashion before transitioning to circular motions. We show that this self-propulsion (with speeds in the 0.1-1 mm/s range) is fuelled by the interfacial energy release upon merging with newly condensed but much smaller droplets. The resultant collective motion spans multiple length scales from submillimetre to several centimetres, with potentially important heat-transfer and water-harvesting applications.


title: Galclaim: A tool to identify host galaxy of astrophysical transient sources

abstract: The Galclaim software is designed to identify association between astrophysical transient sources and host galaxy by computing the probability of chance alignment. It is distributed as an open source Python software. It is already used to identify, confirm or reject host galaxy candidates of GRBs and to validate or invalidate transient candidates in astrophysical observations. Such tools are also very useful to characterise archived transient candidates in large sky survey telescopes.


title: Alleviating Behavior Data Imbalance for Multi-Behavior Graph Collaborative Filtering

abstract: Graph collaborative filtering, which learns user and item representations through message propagation over the user-item interaction graph, has been shown to effectively enhance recommendation performance. However, most current graph collaborative filtering models mainly construct the interaction graph on a single behavior domain (e.g. click), even though users exhibit various types of behaviors on real-world platforms, including actions like click, cart, and purchase. Furthermore, due to variations in user engagement, there exists an imbalance in the scale of different types of behaviors. For instance, users may click and view multiple items but only make selective purchases from a small subset of them. How to alleviate the behavior imbalance problem and utilize information from the multiple behavior graphs concurrently to improve the target behavior conversion (e.g. purchase) remains underexplored. To this end, we propose IMGCF, a simple but effective model to alleviate behavior data imbalance for multi-behavior graph collaborative filtering. Specifically, IMGCF utilizes a multi-task learning framework for collaborative filtering on multi-behavior graphs. Then, to mitigate the data imbalance issue, IMGCF improves representation learning on the sparse behavior by leveraging representations learned from the behavior domain with abundant data volumes. Experiments on two widely-used multi-behavior datasets demonstrate the effectiveness of IMGCF.


title: Lectures on Finslerian Geometry

abstract: Lecture notes on Finsler Geometry


title: Non-existence of circle actions on oriented manifolds with three fixed points except in dimensions 4, 8 and 16

abstract: Let $M$ be a smooth $4k$-dimensional orientable closed manifold, and assume that $M$ has at most two non-zero Pontrjagin numbers which are associated to the top dimensional Pontrjagin class and the square of the middle dimensional Pontrjagin class. We prove that the signature of $M$ being equal to $1$ and the $\hat{A}$-genus of $M$ vanishing cannot hold at the same time except $\dim M=8, 16$. As an application, we claim that the dimensions of oriented $S^1$-manifolds with exactly three fixed points are only $4, 8$ and $16$, and the rational projective plane whose dimension is greater than $16$ has no smooth non-trivial $S^1$-action.


title: A Strategyproof Mechanism for Ownership Restructuring in Privately Owned Assets

abstract: It is unclear how to restructure ownership when an asset is privately held, and there is uncertainty about the owners' subjective valuations. When ownership is divided equally between two owners, a commonly used mechanism is called a BMBY mechanism. This mechanism works as follows: each owner can initiate a BMBY by naming her price. Once an owner declares a price, the other chooses to sell his holdings or buy the shares of the initiator at the given price. This mechanism is simple and tractable; however, it does not elicit actual owner valuations, does not guarantee an efficient allocation, and, most importantly, is limited to an equal partnership of two owners. In this paper, we extend this rationale to a multi-owner setting. Our proposed mechanism elicits owner valuations truthfully. Additionally, our proposed mechanism exhibits several desirable traits: it is easy to implement, budget balanced, robust to collusion (weakly group strategyproof), individually rational, and ex-post efficient.


title: Accretion-modified Stars in Accretion Disks of Active Galactic Nuclei: the Low-luminosity Cases and an Application to Sgr A$\!^{*}$

abstract: In this paper, we investigate the astrophysical processes of stellar-mass black holes (sMBHs) embedded in advection-dominated accretion flows (ADAFs) of supermassive black holes (SMBHs) in low-luminosity active galactic nuclei (AGNs). The sMBH is undergoing Bondi accretion at a rate lower than the SMBH. Outflows from the sMBH-ADAF dynamically interact with their surroundings and form a cavity inside the SMBH-ADAF, thereby quenching the accretion onto the SMBH. Rejuvenation of the Bondi accretion is rapidly done by turbulence. These processes give rise to quasi-periodic episodes of sMBH activities and create flickerings from relativistic jets developed by the Blandford-Znajek mechanism if the sMBH is maximally rotating. Accumulating successive sMBH-outflows trigger viscous instability of the SMBH-ADAF, leading to a flare following a series of flickerings. Recently, the similarity of near-infrared flare's orbits has been found by GRAVITY/VLTI astrometric observations of Sgr A$\!^{*}$: their loci during the last 4-years consist of a ring in agreement with the well-determined SMBH mass. We apply the present model to Sgr A$\!^{*}$, which shows quasi-periodic flickerings. A SMBHH of $\sim 40 M_{\odot}$ is preferred orbiting around the central SMBH of Sgr A$\!^{*}$ from fitting radio to X-ray continuum. Such an extreme mass ratio inspiraling (EMRI) provides an excellent laboratory for LISA, Taiji and Tianqin detection of mHz gravitational waves with strains of $\sim 10^{-17}$, as well as their polarization.


title: Star Formation in Self-gravitating Disks in Active Galactic Nuclei. III. Efficient Production of Iron and Infrared Spectral Energy Distributions

abstract: Strong iron lines are a common feature of the optical spectra of active galactic nuclei (AGNs) and quasars from $z\sim 6-7$ to the local Universe, and [Fe/Mg] ratios do not show cosmic evolution. During active episodes, accretion disks surrounding supermassive black holes (SMBHs) inevitably form stars in the self-gravitating part and these stars accrete with high accretion rates. In this paper, we investigate the population evolution of accretion-modified stars (AMSs) to produce irons and magnesium in AGNs. The AMSs as a new type of stars are allowed to have any metallicity but without significant loss from stellar winds since the winds are choked by the dense medium of the disks and return to the core stars. Mass functions of the AMS population show a pile-up or cutoff pile-up shape in top-heavy or top-dominant forms if the stellar winds are strong, consistent with the narrow range of supernovae (SN) explosions driven by the known pair-instability. This provides an efficient way to produce metals. Meanwhile, SN explosions support an inflated disk as a dusty torus. Furthermore, the evolving top-heavy initial mass functions (IMFs) lead to bright luminosity in infrared bands in dusty regions. This contributes a new component in infrared bands which is independent of the emissions from the central part of accretion disks, appearing as a long-term trending of the NIR continuum compared to optical variations. Moreover, the model can be further tested through reverberation mapping of emission lines, including LIGO/LISA detections of gravitational waves and signatures from spatially resolved observations of GRAVITY+/VLTI.


title: Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Models

abstract: Multi-modality foundation models, as represented by GPT-4V, have brought a new paradigm for low-level visual perception and understanding tasks, that can respond to a broad range of natural human instructions in a model. While existing foundation models have shown exciting potentials on low-level visual tasks, their related abilities are still preliminary and need to be improved. In order to enhance these models, we conduct a large-scale subjective experiment collecting a vast number of real human feedbacks on low-level vision. Each feedback follows a pathway that starts with a detailed description on the low-level visual appearance (*e.g. clarity, color, brightness* of an image, and ends with an overall conclusion, with an average length of 45 words. The constructed **Q-Pathway** dataset includes 58K detailed human feedbacks on 18,973 images with diverse low-level appearance. Moreover, to enable foundation models to robustly respond to diverse types of questions, we design a GPT-participated conversion to process these feedbacks into diverse-format 200K instruction-response pairs. Experimental results indicate that the **Q-Instruct** consistently elevates low-level perception and understanding abilities across several foundational models. We anticipate that our datasets can pave the way for a future that general intelligence can perceive, understand low-level visual appearance and evaluate visual quality like a human. Our dataset, model zoo, and demo is published at: https://q-future.github.io/Q-Instruct.


title: Geometric and Feedback Linearization on UAV: Review

abstract: The pervasive integration of Unmanned Aerial Vehicles (UAVs) across multifarious domains necessitates a nuanced understanding of control methodologies to ensure their optimal functionality. This exhaustive review meticulously examines two pivotal control paradigms in the UAV landscape, Geometric Control and Feedback Linearization. Delving into the intricate theoretical underpinnings, practical applications, strengths, and challenges of these methodologies, the paper endeavors to provide a comprehensive overview. Geometric Control, grounded in the principles of differential geometry, offers an elegant and intuitive approach to trajectory tracking and mission execution. In contrast, Feedback Linearization employs nonlinear control techniques to linearize UAV dynamics, paving the way for enhanced controllability. This review not only dissects the theoretical foundations but also scrutinizes real-world applications, integration challenges, and the ongoing research trajectory of Geometric Control and Feedback Linearization in the realm of UAVs.


title: Depth and Breadth of Research Area Coverage and Its Impact on Publication Citation: An Analysis of Bibliometric Papers

abstract: Many other factors affecting citation of publications, except for research area coverage, have been studied. This study aims to investigate impact of research area coverage. Bibliometric papers and their related papers (referred papers, citing papers and first author's papers) were screened and matched by Python program. Papers' research areas were classified according to Web of Science. Bibliometric parameters of the most cited 5% and the least cited 5% papers were compared. Firstly, coverage of related papers' research areas impacts the citation of their original papers. The impact of references and citing papers are positive and negative, separately, while the first author's papers have no influence. Secondly, high-influence papers tend to cite references from a wider area and are cited by followers from a wider area. Additionally, the pattern of knowledge flow differs significantly between high- and low-influence papers. Low-influence papers narrow knowledge flow, whereas high-influence papers broaden it. This study has shown that both depth and breadth of research area coverage can influence citations. It is recommended that authors should extensively cite high-influence publications, both within and beyond their own area.


title: Explainability of Vision Transformers: A Comprehensive Review and New Perspectives

abstract: Transformers have had a significant impact on natural language processing and have recently demonstrated their potential in computer vision. They have shown promising results over convolution neural networks in fundamental computer vision tasks. However, the scientific community has not fully grasped the inner workings of vision transformers, nor the basis for their decision-making, which underscores the importance of explainability methods. Understanding how these models arrive at their decisions not only improves their performance but also builds trust in AI systems. This study explores different explainability methods proposed for visual transformers and presents a taxonomy for organizing them according to their motivations, structures, and application scenarios. In addition, it provides a comprehensive review of evaluation criteria that can be used for comparing explanation results, as well as explainability tools and frameworks. Finally, the paper highlights essential but unexplored aspects that can enhance the explainability of visual transformers, and promising research directions are suggested for future investment.


title: Data-Driven Moving Horizon Estimation Using Bayesian Optimization

abstract: In this work, an innovative data-driven moving horizon state estimation is proposed for model dynamic-unknown systems based on Bayesian optimization. As long as the measurement data is received, a locally linear dynamics model can be obtained from one Bayesian optimization-based offline learning framework. Herein, the learned model is continuously updated iteratively based on the actual observed data to approximate the actual system dynamic with the intent of minimizing the cost function of the moving horizon estimator until the desired performance is achieved. Meanwhile, the characteristics of Bayesian optimization can guarantee the closest approximation of the learned model to the actual system dynamic. Thus, one effective data-driven moving horizon estimator can be designed further on the basis of this learned model. Finally, the efficiency of the proposed state estimation algorithm is demonstrated by several numerical simulations.


title: Real-Time Probabilistic Programming

abstract: Complex cyber-physical systems interact in real-time and must consider both timing and uncertainty. Developing software for such systems is both expensive and difficult, especially when modeling, inference, and real-time behavior need to be developed from scratch. Recently, a new kind of language has emerged -- called probabilistic programming languages (PPLs) -- that simplify modeling and inference by separating the concerns between probabilistic modeling and inference algorithm implementation. However, these languages have primarily been designed for offline problems, not online real-time systems. In this paper, we combine PPLs and real-time programming primitives by introducing the concept of real-time probabilistic programming languages (RTPPL). We develop an RTPPL called ProbTime and demonstrate its usability on an automotive testbed performing indoor positioning and braking. Moreover, we study fundamental properties and design alternatives for runtime behavior, including a new fairness-guided approach that automatically optimizes the accuracy of a ProbTime system under schedulability constraints.


title: Multiple SLEs and Dyson Brownian motion: transition density and Green's function

abstract: We consider multiple chordal SLEs. Under common time parameterization, we show that the transition density of the driving function of multiple chordal SLEs can be given by the transition density of Dyson Brownian motion and Green's function. As a consequence, we show that the driving function of multiple chordal SLEs, conditional on the rare event that it survives forever, becomes Dyson Brownian motion.


title: The QLBS Model within the presence of feedback loops through the impacts of a large trader

abstract: We extend the QLBS model by reformulating via considering a large trader whose transactions leave a permanent impact on the evolution of the exchange rate process and therefore affect the price of contingent claims on such processes. Through a hypothetical limit order book we quantify the exchange rate altered by such transactions. We therefore define the quoted exchange rate process, for which we assume the existence of a postulated hedging strategy. Given the quoted exchange rate and postulated hedging strategy, we find an optimal hedging strategy through batch-mode reinforcement learning given the trader alters the course of the exchange rate process. We assume that the trader has its own concept of fair price and we define our problem as finding the hedging strategy with much lower transaction costs yet delivering a price that well converges to the fair price of the trader. We show our contribution results in an optimal hedging strategy with much lower transaction costs and convergence to the fair price is obtained assuming sensible parameters.


title: InfMLLM: A Unified Framework for Visual-Language Tasks

abstract: Large language models (LLMs) have proven their remarkable versatility in handling a comprehensive range of language-centric applications. To expand LLMs' capabilities to a broader spectrum of modal inputs, multimodal large language models (MLLMs) have attracted growing interest. This work delves into enabling LLMs to tackle more vision-language-related tasks, particularly image captioning, visual question answering (VQA,) and visual grounding. To this end, we implemented a three-stage training scheme: starting with lightweight alignment pretraining, then moderate-weight multitask hybrid training, and finally, LLM fine-tuning to improve instruction following capability. Throughout the training process, the requirements on GPU memory gradually increase. To effectively manage the number of visual embeddings passed to the LLM while preserving their positional information, we introduce a straightforward visual adapter module dubbed pool-adapter. Our experiments demonstrate that preserving the positional information of visual embeddings through the pool-adapter is particularly beneficial for tasks like visual grounding. We name our proposed approach InfMLLM and have evaluated it extensively on various benchmark datasets. Our results demonstrate that InfMLLM achieves either state-of-the-art (SOTA) performance or performance comparable to recent MLLMs. The code and model will be made open-source at: \url{https://github.com/mightyzau/InfMLLM}.


title: IMPUS: Image Morphing with Perceptually-Uniform Sampling Using Diffusion Models

abstract: We present a diffusion-based image morphing approach with perceptually-uniform sampling (IMPUS) that produces smooth, direct and realistic interpolations given an image pair. The embeddings of two images may lie on distinct conditioned distributions of a latent diffusion model, especially when they have significant semantic difference. To bridge this gap, we interpolate in the locally linear and continuous text embedding space and Gaussian latent space. We first optimize the endpoint text embeddings and then map the images to the latent space using a probability flow ODE. Unlike existing work that takes an indirect morphing path, we show that the model adaptation yields a direct path and suppresses ghosting artifacts in the interpolated images. To achieve this, we propose a heuristic bottleneck constraint based on a novel relative perceptual path diversity score that automatically controls the bottleneck size and balances the diversity along the path with its directness. We also propose a perceptually-uniform sampling technique that enables visually smooth changes between the interpolated images. Extensive experiments validate that our IMPUS can achieve smooth, direct, and realistic image morphing and is adaptable to several other generative tasks.


title: Rationality of $\mbox{dlog}$ $\mathbb{A}^1$-zeta functions

abstract: For every smooth proper scheme over a finite field $\mathbb{F}_q$, Bilu, Ho, Srinivasan, Vogt, and Wickelgren introduced the dlog zeta function with coefficients in the Grothendieck-Witt ring $\mathrm{GW}(\mathbb{F}_q)$, enriching the dlog of the classical Weil zeta function with coefficients in $\mathbb{Z}$. They defined a notion of dlog rationality of such dlog zeta functions, which enriches the rationality of the Weil zeta function, and showed the dlog rationality for simple cellular schemes. In this paper, we show that for any smooth proper schemes over $\mathbb{F}_q$, the dlog zeta function is rational, but not necessarily dlog rational.


title: CL-Flow:Strengthening the Normalizing Flows by Contrastive Learning for Better Anomaly Detection

abstract: In the anomaly detection field, the scarcity of anomalous samples has directed the current research emphasis towards unsupervised anomaly detection. While these unsupervised anomaly detection methods offer convenience, they also overlook the crucial prior information embedded within anomalous samples. Moreover, among numerous deep learning methods, supervised methods generally exhibit superior performance compared to unsupervised methods. Considering the reasons mentioned above, we propose a self-supervised anomaly detection approach that combines contrastive learning with 2D-Flow to achieve more precise detection outcomes and expedited inference processes. On one hand, we introduce a novel approach to anomaly synthesis, yielding anomalous samples in accordance with authentic industrial scenarios, alongside their surrogate annotations. On the other hand, having obtained a substantial number of anomalous samples, we enhance the 2D-Flow framework by incorporating contrastive learning, leveraging diverse proxy tasks to fine-tune the network. Our approach enables the network to learn more precise mapping relationships from self-generated labels while retaining the lightweight characteristics of the 2D-Flow. Compared to mainstream unsupervised approaches, our self-supervised method demonstrates superior detection accuracy, fewer additional model parameters, and faster inference speed. Furthermore, the entire training and inference process is end-to-end. Our approach showcases new state-of-the-art results, achieving a performance of 99.6\% in image-level AUROC on the MVTecAD dataset and 96.8\% in image-level AUROC on the BTAD dataset.


title: Inspiration from machine learning on example of optimization of the Bose-Einstein condensate of thulium atoms in a 1064-nm trap

abstract: The number of atoms in Bose-Einstein condensate determines the scale of experiments that can be performed, making it crucial for quantum simulations. Optimization of the number of atoms in the condensate is a complex problem which could be efficiently solved using machine learning technique. Nevertheless, this approach usually does not give any insight in the underlying physics. Here we demonstrate possibility to learn physics from the machine learning on an example of condensation of thulium atoms at a 1064-nm dipole trap. Optimization of the number of condensed atoms revealed a saturation, which was explained as limitation imposed by a 3-body recombination process. This limitation was successfully overcome by leveraging Fano-Feshbach resonances.


title: Deep Perspective Transformation Based Vehicle Localization on Bird's Eye View

abstract: An accurate understanding of a self-driving vehicle's surrounding environment is crucial for its navigation system. To enhance the effectiveness of existing algorithms and facilitate further research, it is essential to provide comprehensive data to the routing system. Traditional approaches rely on installing multiple sensors to simulate the environment, leading to high costs and complexity. In this paper, we propose an alternative solution by generating a top-down representation of the scene, enabling the extraction of distances and directions of other cars relative to the ego vehicle. We introduce a new synthesized dataset that offers extensive information about the ego vehicle and its environment in each frame, providing valuable resources for similar downstream tasks. Additionally, we present an architecture that transforms perspective view RGB images into bird's-eye-view maps with segmented surrounding vehicles. This approach offers an efficient and cost-effective method for capturing crucial environmental information for self-driving cars. Code and dataset are available at https://github.com/IPM-HPC/Perspective-BEV-Transformer.


title: Dual-Branch Reconstruction Network for Industrial Anomaly Detection with RGB-D Data

abstract: Unsupervised anomaly detection methods are at the forefront of industrial anomaly detection efforts and have made notable progress. Previous work primarily used 2D information as input, but multi-modal industrial anomaly detection based on 3D point clouds and RGB images is just beginning to emerge. The regular approach involves utilizing large pre-trained models for feature representation and storing them in memory banks. However, the above methods require a longer inference time and higher memory usage, which cannot meet the real-time requirements of the industry. To overcome these issues, we propose a lightweight dual-branch reconstruction network(DBRN) based on RGB-D input, learning the decision boundary between normal and abnormal examples. The requirement for alignment between the two modalities is eliminated by using depth maps instead of point cloud input. Furthermore, we introduce an importance scoring module in the discriminative network to assist in fusing features from these two modalities, thereby obtaining a comprehensive discriminative result. DBRN achieves 92.8% AUROC with high inference efficiency on the MVTec 3D-AD dataset without large pre-trained models and memory banks.


title: MetaMix: Meta-state Precision Searcher for Mixed-precision Activation Quantization

abstract: Mixed-precision quantization of efficient networks often suffer from activation instability encountered in the exploration of bit selections. To address this problem, we propose a novel method called MetaMix which consists of bit selection and weight training phases. The bit selection phase iterates two steps, (1) the mixed-precision-aware weight update, and (2) the bit-search training with the fixed mixed-precision-aware weights, both of which combined reduce activation instability in mixed-precision quantization and contribute to fast and high-quality bit selection. The weight training phase exploits the weights and step sizes trained in the bit selection phase and fine-tunes them thereby offering fast training. Our experiments with efficient and hard-to-quantize networks, i.e., MobileNet v2 and v3, and ResNet-18 on ImageNet show that our proposed method pushes the boundary of mixed-precision quantization, in terms of accuracy vs. operations, by outperforming both mixed- and single-precision SOTA methods.


title: Correlated orientational disorder in entropic crystals

abstract: We report computational evidence for a new type of disordered phase in crystals resulting from entropy driven self-assembly of hard convex polyhedra. The disorder was reflected in the orientations of the anisotropic particles and not in the positions of the centers of geometry. Despite the lack of order, particle orientations were not random, and exhibited strong correlations. The orientational correlations possessed certain special properties that remained constant across the pressure range where this phase was observed. The rotational motions of all particles became discrete, characterized by a fixed number of absolute orientations. The particles were equally partitioned among them at all time, while maintaining specific values of pairwise orientational differences. The sense of ``order'' in the disorder was conserved irrespective of the extent of rotational mobility of the particles. This gave rise to a discretely mobile phase in the low density solid and a frozen disordered state at high pressure. The newly identified ``discrete plastic crystal'' phase transitioned into a freely rotating one, where rotational degrees of freedom were completely random. The resulting solid-solid transition was purely orientational in nature without the change in the face centered cubic crystalline arrangements of the centers of the anisotropic particles. This finding can be interpreted as the simplest example of correlated disorder in colloidal crystals.


title: Capturing the Edge of Chaos as a Spectral Submanifold in Pipe Flows

abstract: An extended turbulent state can coexist with the stable laminar state in pipe flows. We focus here on short pipes with additional discrete symmetries imposed. In this case, the boundary between the coexisting basins of attraction, often called the edge of chaos, is the stable manifold of an edge state, which is a lower-branch traveling wave solution. We show that a low-dimensional submanifold of the edge of chaos can be constructed from velocity data using the recently developed theory of spectral submanifolds (SSMs). These manifolds are the unique smoothest nonlinear continuations of nonresonant spectral subspaces of the linearized system at stationary states. Using very low dimensional SSM-based reduced-order models, we predict transitions to turbulence or laminarization for velocity fields near the edge of chaos.


title: A Comprehensive Survey On Client Selections in Federated Learning

abstract: Federated Learning (FL) is a rapidly growing field in machine learning that allows data to be trained across multiple decentralized devices. The selection of clients to participate in the training process is a critical factor for the performance of the overall system. In this survey, we provide a comprehensive overview of the state-of-the-art client selection techniques in FL, including their strengths and limitations, as well as the challenges and open issues that need to be addressed. We cover conventional selection techniques such as random selection where all or partial random of clients is used for the trained. We also cover performance-aware selections and as well as resource-aware selections for resource-constrained networks and heterogeneous networks. We also discuss the usage of client selection in model security enhancement. Lastly, we discuss open issues and challenges related to clients selection in dynamic constrained, and heterogeneous networks.


title: A hybrid discrete exterior calculus and finite difference method for anelastic convection in spherical shells

abstract: The present work develops, verifies, and benchmarks a hybrid discrete exterior calculus and finite difference (DEC-FD) method for density-stratified thermal convection in spherical shells. Discrete exterior calculus (DEC) is notable for its coordinate independence and structure preservation properties. The hybrid DEC-FD method for Boussinesq convection has been developed by Mantravadi et al. (Mantravadi, B., Jagad, P., & Samtaney, R. (2023). A hybrid discrete exterior calculus and finite difference method for Boussinesq convection in spherical shells. Journal of Computational Physics, 491, 112397). Motivated by astrophysics problems, we extend this method assuming anelastic convection, which retains density stratification; this has been widely used for decades to understand thermal convection in stars and giant planets. In the present work, the governing equations are splitted into surface and radial components and discrete anelastic equations are derived by replacing spherical surface operators with DEC and radial operators with FD operators. The novel feature of this work is the discretization of anelastic equations with the DEC-FD method and the assessment of a hybrid solver for density-stratified thermal convection in spherical shells. The discretized anelastic equations are verified using the method of manufactured solution (MMS). We performed a series of three-dimensional convection simulations in a spherical shell geometry and examined the effect of density ratio on convective flow structures and energy dynamics. The present observations are in agreement with the benchmark models.