title: Object-level Geometric Structure Preserving for Natural Image Stitching

abstract: The topic of stitching images with globally natural structures holds paramount significance. Current methodologies exhibit the ability to preserve local geometric structures, yet fall short in maintaining relationships between these geometric structures. In this paper, we endeavor to safeguard the overall, OBJect-level structures within images based on Global Similarity Prior, while concurrently mitigating distortion and ghosting artifacts with OBJ-GSP. Our approach leverages the Segment Anything Model to extract geometric structures with semantic information, enhancing the algorithm's ability to preserve objects in a manner that aligns more intuitively with human perception. We seek to identify spatial constraints that govern the relationships between various geometric boundaries. Recognizing that multiple geometric boundaries collectively define complete objects, we employ triangular meshes to safeguard not only individual geometric structures but also the overall shapes of objects within the images. Empirical evaluations across multiple image stitching datasets demonstrate that our method establishes a new state-of-the-art benchmark in image stitching. Our implementation and dataset is publicly available at https://github.com/RussRobin/OBJ-GSP .


title: Algebraic dynamics and recursive inequalities

abstract: We get three basic results in algebraic dynamics: (1). We give the first algorithm to compute the dynamical degrees to arbitrary precision. (2). We prove that for a family of dominant rational self-maps, the dynamical degrees are lower semi-continuous with respect to the Zariski topology. This implies a conjecture of Call and Silverman. (3). We prove that the set of periodic points of a cohomologically hyperbolic rational self-map is Zariski dense. Moreover, we show that, after a large iterate, every degree sequence grows almost at a uniform rate. This property is not satisfied for general submultiplicative sequences. Finally, we prove the Kawaguchi-Silverman conjecture for a class of self-maps of projective surfaces including all the birational ones. In fact, for every dominant rational self-map, we find a family of recursive inequalities of some dynamically meaningful cycles. Our proofs are based on these inequalities.


title: Min-Max Optimization for Robust Nonlinear Least Squares Problems

abstract: This paper considers min-max optimization for a class of robust nonlinear least squares problems. We show via an example that solving the first order optimality conditions defined by gradients of the objective function can lead to incorrect solutions of min-max problems. We give an explicit formula for the value function of the inner maximization problem. Using the formula, we show that finding a first order $\epsilon$-approximate necessary minimax point of the min-max problem needs at most $O(|\log\epsilon| +\epsilon^{-2}) $ evaluations of the function value and gradients of the objective function. Moreover, we establish error bounds from any solution of the nonlinear least squares problem to the solution set of the robust nonlinear least squares problem.


title: On reduced modeling of the modulational dynamics in magnetohydrodynamics

abstract: This paper explores structure formation in two-dimensional magnetohydrodynamic (MHD) turbulence as a modulational instability (MI) of turbulent fluctuations. We focus on the early stages of structure formation and consider simple backgrounds that allow for a tractable model of the MI while retaining the full chain of modulational harmonics. This approach allows us to systematically examine the validity of popular closures such as the quasilinear approximation and other low-order truncations. We find that, although such simple closures can provide quantitatively accurate approximations of the MI growth rates in some regimes, they can fail to capture the modulational dynamics in adjacent regimes even qualitatively, falsely predicting MI when the system is actually stable. We find that this discrepancy is due to the excitation of propagating spectral waves (PSWs) which can ballistically transport energy along the modulational spectrum, unimpeded until dissipative scales, thereby breaking the feedback loops that would otherwise sustain MIs. PSWs can be self-maintained as global modes with real frequencies and drain energy from the primary structure at a constant rate until the primary structure is depleted. To describe these waves within a reduced model, we propose an approximate spectral closure that captures them and MIs on the same footing. We also find that introducing corrections to ideal MHD, conservative or dissipative, can suppress PSWs and reinstate the accuracy of the quasilinear approximation. In this sense, ideal MHD is a `singular' system that is particularly sensitive to the accuracy of the closure within mean-field models.


title: Motion of Spinning Density Tensors in a Clifford Space

abstract: A Clifford Space is counted to be a tempting approach to unify both micro-physics and macro-physics simultaneously. Such a tendency may be found in the realm of replacing vectors with poly-vectors. Accordingly, the problem of motion becomes essential to express the motion of extended particles rather than test particles. These equations are performed by using an equivalent Bazanski Lagrangian in a Clifford space. From this perspective, a generalized type an equation for spinning density tensors and spinning density deviation tensors are obtained. Spinning deviation tensors in a Clifford space may give a better performance to examine the problem of stability for spinning density tensors as expressed in terms of vectors defined in such a class of Riemannian geometry.


title: Smart Mobility Digital Twin Based Automated Vehicle Navigation System: A Proof of Concept

abstract: Digital twins (DTs) have driven major advancements across various industrial domains over the past two decades. With the rapid advancements in autonomous driving and vehicle-to-everything (V2X) technologies, integrating DTs into vehicular platforms is anticipated to further revolutionize smart mobility systems. In this paper, a new smart mobility DT (SMDT) platform is proposed for the control of connected and automated vehicles (CAVs) over next-generation wireless networks. In particular, the proposed platform enables cloud services to leverage the abilities of DTs to promote the autonomous driving experience. To enhance traffic efficiency and road safety measures, a novel navigation system that exploits available DT information is designed. The SMDT platform and navigation system are implemented with state-of-the-art products, e.g., CAVs and roadside units (RSUs), and emerging technologies, e.g., cloud and cellular V2X (C-V2X). In addition, proof-of-concept (PoC) experiments are conducted to validate system performance. The performance of SMDT is evaluated from two standpoints: (i) the rewards of the proposed navigation system on traffic efficiency and safety and, (ii) the latency and reliability of the SMDT platform. Our experimental results using SUMO-based large-scale traffic simulations show that the proposed SMDT can reduce the average travel time and the blocking probability due to unexpected traffic incidents. Furthermore, the results record a peak overall latency for DT modeling and route planning services to be 155.15 ms and 810.59 ms, respectively, which validates that our proposed design aligns with the 3GPP requirements for emerging V2X use cases and fulfills the targets of the proposed design. Our demonstration video can be found at https://youtu.be/3waQwlaHQkk.


title: TorchCP: A Library for Conformal Prediction based on PyTorch

abstract: TorchCP is a Python toolbox for conformal prediction research on deep learning models. It contains various implementations for posthoc and training methods for classification and regression tasks (including multi-dimension output). TorchCP is built on PyTorch (Paszke et al., 2019) and leverages the advantages of matrix computation to provide concise and efficient inference implementations. The code is licensed under the LGPL license and is open-sourced at $\href{https://github.com/ml-stat-Sustech/TorchCP}{\text{this https URL}}$.


title: Interpolation by the Exact Inversion of the Gram Matrix

abstract: Using a lemma of Davis on Gram matrices applied to the classical Orthogonal Polynomials to generate reproducing kernel interpolation over the classical domains for polynomials. These kernels have terms which are exact over the rational ring. The Condition Numbers are readily shown to get very large with the size of the Gram matrices as expected. The calculation of the error variances for trigonometric functions and the exponential show a significant improvement over the equivalent Taylor expansion variances.


title: XRL-Bench: A Benchmark for Evaluating and Comparing Explainable Reinforcement Learning Techniques

abstract: Reinforcement Learning (RL) has demonstrated substantial potential across diverse fields, yet understanding its decision-making process, especially in real-world scenarios where rationality and safety are paramount, is an ongoing challenge. This paper delves in to Explainable RL (XRL), a subfield of Explainable AI (XAI) aimed at unravelling the complexities of RL models. Our focus rests on state-explaining techniques, a crucial subset within XRL methods, as they reveal the underlying factors influencing an agent's actions at any given time. Despite their significant role, the lack of a unified evaluation framework hinders assessment of their accuracy and effectiveness. To address this, we introduce XRL-Bench, a unified standardized benchmark tailored for the evaluation and comparison of XRL methods, encompassing three main modules: standard RL environments, explainers based on state importance, and standard evaluators. XRL-Bench supports both tabular and image data for state explanation. We also propose TabularSHAP, an innovative and competitive XRL method. We demonstrate the practical utility of TabularSHAP in real-world online gaming services and offer an open-source benchmark platform for the straightforward implementation and evaluation of XRL methods. Our contributions facilitate the continued progression of XRL technology.


title: Platform-Driven Collaboration Patterns: Structural Evolution Over Time and Scale

abstract: Within an increasingly digitalized organizational landscape, this research delves into the dynamics of decentralized collaboration, contrasting it with traditional collaboration models. An effective capturing of high-level collaborations (beyond direct massages) is introduced as the network construction methodology including both temporal and content dimensions of user collaborations - an Alternating Timed Interaction (ATI) metric as the first aspect, and a quantitative strategy of thematic similarity as the second aspect. This study validates three hypotheses that collectively underscore the complexities of digital team dynamics within sociotechnical systems: Firstly, it establishes the significant influence of problem context on team structures in work environments, emphasizing the need to consider the specific nature of tasks in analyzing collaborative dynamics. Secondly, the study reveals specific evolving patterns of team structures on digital platforms concerning team size and artifact maturity. Lastly, it identifies substantial differences in team structure patterns between digital platforms and traditional organizational settings, underscoring the unexplored nature of digital collaboration dynamics. The findings of this study are instrumental for organizations navigating the digital era, offering insights into effective knowledge sharing in the decentralized leadership of digital teams. By mapping out network structures and collaborative patterns, this study, with a focus on Wikipedia as a representative digital platform, paves the way for strategic interventions to optimize digital team dynamics and align them with broader organizational goals.


title: Learning on manifolds without manifold learning

abstract: Function approximation based on data drawn randomly from an unknown distribution is an important problem in machine learning. In contrast to the prevalent paradigm of solving this problem by minimizing a loss functional, we have given a direct one-shot construction together with optimal error bounds under the manifold assumption; i.e., one assumes that the data is sampled from an unknown sub-manifold of a high dimensional Euclidean space. A great deal of research deals with obtaining information about this manifold, such as the eigendecomposition of the Laplace-Beltrami operator or coordinate charts, and using this information for function approximation. This two step approach implies some extra errors in the approximation stemming from basic quantities of the data in addition to the errors inherent in function approximation. In Neural Networks, 132:253268, 2020, we have proposed a one-shot direct method to achieve function approximation without requiring the extraction of any information about the manifold other than its dimension. However, one cannot pin down the class of approximants used in that paper. In this paper, we view the unknown manifold as a sub-manifold of an ambient hypersphere and study the question of constructing a one-shot approximation using the spherical polynomials based on the hypersphere. Our approach does not require preprocessing of the data to obtain information about the manifold other than its dimension. We give optimal rates of approximation for relatively "rough" functions.


title: Robust-Wide: Robust Watermarking against Instruction-driven Image Editing

abstract: Instruction-driven image editing allows users to quickly edit an image according to text instructions in a forward pass. Nevertheless, malicious users can easily exploit this technique to create fake images, which could cause a crisis of trust and harm the rights of the original image owners. Watermarking is a common solution to trace such malicious behavior. Unfortunately, instruction-driven image editing can significantly change the watermarked image at the semantic level, making it less robust and effective. We propose Robust-Wide, the first robust watermarking methodology against instruction-driven image editing. Specifically, we adopt the widely-used encoder-decoder framework for watermark embedding and extraction. To achieve robustness against semantic distortions, we introduce a novel Partial Instruction-driven Denoising Sampling Guidance (PIDSG) module, which consists of a large variety of instruction injections and substantial modifications of images at different semantic levels. With PIDSG, the encoder tends to embed the watermark into more robust and semantic-aware areas, which remains in existence even after severe image editing. Experiments demonstrate that Robust-Wide can effectively extract the watermark from the edited image with a low bit error rate of nearly 2.6% for 64-bit watermark messages. Meanwhile, it only induces a neglectable influence on the visual quality and editability of the original images. Moreover, Robust-Wide holds general robustness against different sampling configurations and other image editing methods such as ControlNet-InstructPix2Pix, MagicBrush, Inpainting and DDIM Inversion.


title: Janus Bound States in the Continuum with Asymmetric Topological Charges and Intrinsic Chirality

abstract: We propose a novel topological defect called Janus bound states in the continuum (BICs), featuring asymmetric topological charges in upward and downward radiation channels. Our approach involves a photonic crystal slab (PCS) that initially exhibits both out-of-plane and in-plane mirror symmetry, and this PCS possesses one BIC at the $\Gamma$ point and two BICs off the $\Gamma$ point. By introducing perturbations that break the out-of-plane mirror symmetry, the two off-$\Gamma$ BICs decompose into four circularly polarized states (C points) with identical topological charges. Then, we selectively manipulate the four C points associated with downward radiation channel to converge at the at-$\Gamma$ BIC, forming a Janus BIC with Janus topological charges. By further introducing in-plane mirror symmetry perturbation, we can bring two of the C points with the same handedness and identical topological charges for upward radiation to merge into the Janus BIC. This process results in a Janus chiral BIC which exhibits large intrinsic chirality and an infinite Q factor. Janus BICs can induce distinct Pancharatnam-Berry phase singularities in momentum space for different incident channels, providing a new approach to control optical angular momentum. Janus chiral BICs hold promise in enhancing direction-dependent and spin-dependent asymmetric light-matter interaction, opening new pathways for improving chirality-dependent operation for on-chip devices.


title: Simpson's Paradox and the Accuracy-Fluency Tradeoff in Translation

abstract: A good translation should be faithful to the source and should respect the norms of the target language. We address a theoretical puzzle about the relationship between these objectives. On one hand, intuition and some prior work suggest that accuracy and fluency should trade off against each other, and that capturing every detail of the source can only be achieved at the cost of fluency. On the other hand, quality assessment researchers often suggest that accuracy and fluency are highly correlated and difficult for human raters to distinguish (Callison-Burch et al., 2007). We show that the tension between these views is an instance of Simpson's paradox, and that accuracy and fluency are positively correlated at the level of the corpus but trade off at the level of individual source segments. We further suggest that the relationship between accuracy and fluency is best evaluated at the segment (or sentence) level, and that the trade off between these dimensions has implications both for assessing translation quality and developing improved MT systems.


title: Tree-Planted Transformers: Unidirectional Transformer Language Models with Implicit Syntactic Supervision

abstract: Syntactic Language Models (SLMs) can be trained efficiently to reach relatively high performance; however, they have trouble with inference efficiency due to the explicit generation of syntactic structures. In this paper, we propose a new method dubbed tree-planting: instead of explicitly generating syntactic structures, we "plant" trees into attention weights of unidirectional Transformer LMs to implicitly reflect syntactic structures of natural language. Specifically, unidirectional Transformer LMs trained with tree-planting will be called Tree-Planted Transformers (TPT), which inherit the training efficiency from SLMs without changing the inference efficiency of their underlying Transformer LMs. Targeted syntactic evaluations on the SyntaxGym benchmark demonstrated that TPTs, despite the lack of explicit generation of syntactic structures, significantly outperformed not only vanilla Transformer LMs but also various SLMs that generate hundreds of syntactic structures in parallel. This result suggests that TPTs can learn human-like syntactic knowledge as data-efficiently as SLMs while maintaining the modeling space of Transformer LMs unchanged.


title: FormulaReasoning: A Dataset for Formula-Based Numerical Reasoning

abstract: The application of formulas is a fundamental ability of humans when addressing numerical reasoning problems. However, existing numerical reasoning datasets seldom explicitly indicate the formulas employed during the reasoning steps. To bridge this gap, we construct a dataset for formula-based numerical reasoning called FormulaReasoning, which consists of 5,420 reasoning-based questions. We employ it to conduct evaluations of LLMs with size ranging from 7B to over 100B parameters utilizing zero-shot and few-shot chain-of-thought methods, and we further explore using retrieval-augmented LLMs provided with an external formula database associated with our dataset. We also experiment with supervised methods where we divide the reasoning process into formula generation, parameter extraction, and numerical calculation, and perform data augmentation. Our empirical findings underscore the significant potential for improvement in existing models when applied to our complex, formula-driven FormulaReasoning.


title: Topological nano-switches in higher-order topological insulators

abstract: We consider multi-terminal transport through a flake of rectangular shape of a two-dimensional topological insulator in the presence of an in-plane magnetic field. This system has been shown to be a second-order topological insulator, thus exhibiting corner states at its boundaries. The position of the corner states and their decay length can be controlled by the direction of the magnetic field. In the leads we assume that the magnetic field is absent and therefore we have helical one-dimensional propagating states characteristic of the spin-Hall effect. Using a low-energy effective Hamiltonian we show analytically that, in a two-terminal setup, transport can be turned on and off by a rotation of the in-plane magnetic field. Similarly, in a three terminal configuration, the in-plane magnetic field can be used to turn on and off the transmission between neighbouring contacts, thus realising a directional switch. Analytical calculations are supplemented by a numerical finite-difference method. For small values of the Fermi energy and field strength, the analytical results agree exceptionally well with the numerics. The effect of disorder is also addressed in the numerical approach. We find that the switching functionality is remarkably robust to the presence of strong disorder stemming from the topological nature of the states contributing to the electron transport.


title: Revitalizing Multivariate Time Series Forecasting: Learnable Decomposition with Inter-Series Dependencies and Intra-Series Variations Modeling

abstract: Predicting multivariate time series is crucial, demanding precise modeling of intricate patterns, including inter-series dependencies and intra-series variations. Distinctive trend characteristics in each time series pose challenges, and existing methods, relying on basic moving average kernels, may struggle with the non-linear structure and complex trends in real-world data. Given that, we introduce a learnable decomposition strategy to capture dynamic trend information more reasonably. Additionally, we propose a dual attention module tailored to capture inter-series dependencies and intra-series variations simultaneously for better time series forecasting, which is implemented by channel-wise self-attention and autoregressive self-attention. To evaluate the effectiveness of our method, we conducted experiments across eight open-source datasets and compared it with the state-of-the-art methods. Through the comparison results, our Leddam (LEarnable Decomposition and Dual Attention Module) not only demonstrates significant advancements in predictive performance, but also the proposed decomposition strategy can be plugged into other methods with a large performance-boosting, from 11.87% to 48.56% MSE error degradation.


title: On the k-spanning cyclability of 4-valent Cayley graphs on Abelian groups

abstract: A graph $X$ is $k$-spanning cyclable if for any subset $S$ of $k$ distinct vertices there is a 2-factor of $X$ consisting of $k$ cycles such that each vertex in $S$ belongs to a distinct cycle. In this paper we examine the $k$-spanning cyclability of 4-valent Cayley graphs on Abelian groups.


title: A fully-integrated lattice Boltzmann method for fluid-structure interaction

abstract: We present a fully-integrated lattice Boltzmann (LB) method for fluid--structure interaction (FSI) simulations that efficiently models deformable solids in complex suspensions and active systems. Our Eulerian method (LBRMT) couples finite-strain solids to the LB fluid on the same fixed computational grid with the reference map technique (RMT). An integral part of the LBRMT is a new LB boundary condition for moving deformable interfaces across different densities. With this fully Eulerian solid--fluid coupling, the LBRMT is well-suited for parallelization and simulating multi-body contact without remeshing or extra meshes. We validate its accuracy via a benchmark of a deformable solid in a lid-driven cavity, then showcase its versatility through examples of soft solids rotating and settling. With simulations of complex suspensions mixing, we highlight potentials of the LBRMT for studying collective behavior in soft matter and biofluid dynamics.


title: Measurement of Nanoscale Interfacial Contact Area Using Vibrational Spectroscopy

abstract: Understanding the extent of contact between objects is crucial for surface-driven phenomena in the natural world. While interactions are known to occur at subnanometer-length scales, the techniques needed to measure such small-length scales are lacking. We combined two complementary techniques of attenuated total reflectance infrared (ATR-IR) spectroscopy coupled with an imaging detector and sum frequency generation (SFG) spectroscopy to characterize the real contact area between surfaces. Imaging ATR-IR provides the distribution of airgap separation between the surfaces at larger than molecular length scales as well as an estimation of the real contact area. Additionally, SFG directly probes the intermolecular interactions occurring at molecular scales. Through the combination of these techniques, we show how contact is achieved for both thin, rigid/glassy polymer films on top of soft elastomers and rigid/glassy samples. Interestingly, we also show that the orientation of the molecules in contact is a critically important factor that influences interfacial interactions rather than just the number of molecular sites in contact.


title: Dynamics of quantum coherence in many-body localized systems

abstract: We demonstrate that the dynamics of quantum coherence serves as an effective probe for identifying dephasing, which is a distinctive signature of many-body localization (MBL). Quantum coherence can be utilized to measure both the local coherence of specific subsystems and the total coherence of the whole system in a consistent manner. Our results reveal that the local coherence of small subsystems decays over time following a power law in the MBL phase, while it reaches a stable value within the same time window in the Anderson localized (AL) phase. In contrast, the total coherence of the whole system exhibits logarithmic growth during the MBL phase and reaches a stable value in the AL phase. Notably, this dynamic characteristic of quantum coherence remains robust even with weak interactions and displays unbounded behavior in infinite systems. Our results provide insights into understanding many-body dephasing phenomena in MBL systems and propose a novel feasible method for identifying and characterizing MBL phases in experiments.


title: Positive temperature-dependent thermal conductivity induced by wavelike phonons in complex Ag-based argyrodites

abstract: The phonon transport mechanisms and the anomalous temperature-dependent lattice thermal conductivities (kL) in Ag-based argyrodites have not been fully understood. Herein, we systematically study the phonon thermal transport of five Ag-based crystalline argyrodites Ag7PS6, Ag7AsS6, Ag8SnS6, Ag8GeS6 and Ag9GaS6 utilizing perturbation theory and the unified theory thermal transport model. Our results show that, as the complexity of the unit cell increases, the proportion of the population terms falls while the coherence contributions become more significant, leading to the relatively weak temperature-dependent kL of Ag7PS6 and Ag7AsS6, while the more complex crystalline argyrodites, Ag8SnS6, Ag8GeS6 and Ag9GaS6, exhibiting a glass-like behavior in their temperature dependence of kL. We attribute the positive temperature-dependent and ultralow kL of Ag8SnS6, Ag8GeS6 and Ag9GaS6 to the dominance of wavelike phonons and the strong phonon broadening. Furthermore, using laser flash measurements and the homogeneous non-equilibrium molecular dynamics simulations based on accurate machine learning neuroevolution potentials, we provide further evidence for the glass-like temperature-dependent kL of Ag8SnS6 and Ag8GeS6.


title: Chemical Rules for Stacked Kagome and Honeycomb Topological Semimetals

abstract: We study the chemical rules for predicting and understanding topological states in stacked kagome and honeycomb lattices in both analytical and numerical ways. Starting with a minimal five-band tight-binding model, we sort out all the topological states into five groups, which are determined by the interlayer and intralayer hopping parameters. Combined with the model, we design an algorithm to obtain a series of experimentally synthesized topological semimetals with kagome and honeycomb layers, i.e., IAMX family (IA = Alkali metal element, M = Rare earth metal element, X = Carbon group element), in the inorganic crystal structure database. A follow-up high-throughput calculation shows that IAMX family materials are all nodal-line semimetals and they will be Weyl semimetals after taking spin-orbit coupling into consideration. To have further insights into the topology of the IAMX family, a detailed chemical rule analysis is carried out on the high-throughput calculations, including the lattice constants of the structure, intralayer and interlayer couplings, bond strengths, electronegativity, and so on, which are consistent with our tight-binding model. Our study provides a way to discover and modulate topological properties in stacked kagome and honeycomb crystals and offers candidates for studying topology-related properties like topological superconductors and axion insulators.


title: wmh_seg: Transformer based U-Net for Robust and Automatic White Matter Hyperintensity Segmentation across 1.5T, 3T and 7T

abstract: White matter hyperintensity (WMH) remains the top imaging biomarker for neurodegenerative diseases. Robust and accurate segmentation of WMH holds paramount significance for neuroimaging studies. The growing shift from 3T to 7T MRI necessitates robust tools for harmonized segmentation across field strengths and artifacts. Recent deep learning models exhibit promise in WMH segmentation but still face challenges, including diverse training data representation and limited analysis of MRI artifacts' impact. To address these, we introduce wmh_seg, a novel deep learning model leveraging a transformer-based encoder from SegFormer. wmh_seg is trained on an unmatched dataset, including 1.5T, 3T, and 7T FLAIR images from various sources, alongside with artificially added MR artifacts. Our approach bridges gaps in training diversity and artifact analysis. Our model demonstrated stable performance across magnetic field strengths, scanner manufacturers, and common MR imaging artifacts. Despite the unique inhomogeneity artifacts on ultra-high field MR images, our model still offers robust and stable segmentation on 7T FLAIR images. Our model, to date, is the first that offers quality white matter lesion segmentation on 7T FLAIR images.


title: From Cloud to Edge: Rethinking Generative AI for Low-Resource Design Challenges

abstract: Generative Artificial Intelligence (AI) has shown tremendous prospects in all aspects of technology, including design. However, due to its heavy demand on resources, it is usually trained on large computing infrastructure and often made available as a cloud-based service. In this position paper, we consider the potential, challenges, and promising approaches for generative AI for design on the edge, i.e., in resource-constrained settings where memory, compute, energy (battery) and network connectivity may be limited. Adapting generative AI for such settings involves overcoming significant hurdles, primarily in how to streamline complex models to function efficiently in low-resource environments. This necessitates innovative approaches in model compression, efficient algorithmic design, and perhaps even leveraging edge computing. The objective is to harness the power of generative AI in creating bespoke solutions for design problems, such as medical interventions, farm equipment maintenance, and educational material design, tailored to the unique constraints and needs of remote areas. These efforts could democratize access to advanced technology and foster sustainable development, ensuring universal accessibility and environmental consideration of AI-driven design benefits.


title: Quantitative uniqueness estimates for stochastic parabolic equations on the whole Euclidean space

abstract: In this paper, a quantitative estimate of unique continuation for the stochastic heat equation with bounded potentials on the whole Euclidean space is established. This paper generalizes the earlier results in [29] and [17] from a bounded domain to an unbounded one. The proof is based on the locally parabolic-type frequency function method. An observability estimate from measurable sets in time for the same equation is also derived.


title: Quantum Embedding with Transformer for High-dimensional Data

abstract: Quantum embedding with transformers is a novel and promising architecture for quantum machine learning to deliver exceptional capability on near-term devices or simulators. The research incorporated a vision transformer (ViT) to advance quantum significantly embedding ability and results for a single qubit classifier with around 3 percent in the median F1 score on the BirdCLEF-2021, a challenging high-dimensional dataset. The study showcases and analyzes empirical evidence that our transformer-based architecture is a highly versatile and practical approach to modern quantum machine learning problems.


title: Distance Recoloring

abstract: Coloring a graph is a well known problem and used in many different contexts. Here we want to assign $k \geq 1$ colors to each vertex of a graph $G$ such that each edge has two different colors at each endpoint. Such a vertex-coloring, if exists, is called a feasible coloring of $G$. \textsc{Distance Coloring} is an extension to the standard \textsc{Coloring} problem. Here we want to enforce that every pair of distinct vertices of distance less than or equal to $d$ have different colors, for integers $d \geq 1$ and $k \geq d+1$. Reconfiguration problems ask if two given configurations can be transformed into each other with certain rules. For example, the well-known \textsc{Coloring Reconfiguration} asks if there is a way to change one vertex's color at a time, starting from a feasible given coloring $\alpha$ of a graph $G$ to reach another feasible given coloring $\beta$ of $G$, such that all intermediate colorings are also feasible. In this paper, we study the reconfiguration of distance colorings on certain graph classes. We show that even for planar, bipartite, and $2$-degenerate graphs, reconfiguring distance colorings is $\mathsf{PSPACE}$-complete for $d \geq 2$ and $k = \Omega(d^2)$ via a reduction from the well-known \textsc{Sliding Tokens} problem. Additionally, we show that the problem on split graphs remains $\mathsf{PSPACE}$-complete when $d = 2$ and large $k$ but can be solved in polynomial time when $d \geq 3$ and $k \geq d+1$, and design a quadratic-time algorithm to solve the problem on paths for any $d \geq 2$ and $k \geq d+1$.


title: Learning Causal Domain-Invariant Temporal Dynamics for Few-Shot Action Recognition

abstract: Few-shot action recognition aims at quickly adapting a pre-trained model to the novel data with a distribution shift using only a limited number of samples. Key challenges include how to identify and leverage the transferable knowledge learned by the pre-trained model. We therefore propose CDTD, or Causal Domain-Invariant Temporal Dynamics for knowledge transfer. To identify the temporally invariant and variant representations, we employ the causal representation learning methods for unsupervised pertaining, and then tune the classifier with supervisions in next stage. Specifically, we assume the domain information can be well estimated and the pre-trained image decoder and transition models can be well transferred. During adaptation, we fix the transferable temporal dynamics and update the image encoder and domain estimator. The efficacy of our approach is revealed by the superior accuracy of CDTD over leading alternatives across standard few-shot action recognition datasets.


title: Weight Structure of Low/High-Rate Polar Codes and Its Applications

abstract: The structure of a linear block code is pivotal in defining fundamental properties, particularly weight distribution, and code design. In this study, we characterize the Type II structure of polar codewords with weights less than twice the minimum weight $w_{min}$, utilizing the lower triangular affine (LTA) transform. We present a closed-form formula for their enumeration. Leveraging this structure and additionally characterizing the structure of weight $2w_{min}$, we ascertain the complete weight distribution of low-rate and, through the utilization of dual codes properties, high-rate polar codes, subcodes of Reed--Muller (RM) codes, and RMxPolar codes. Furthermore, we introduce a partial order based on the weight distribution and briefly explore its properties and applications in code construction and analysis.


title: Quantum computation of conical intersections on a programmable superconducting quantum processor

abstract: Conical intersections play a vital role in photochemical processes. The standard quantum chemistry approach to study conical intersections between ground and excited states are the state-average multi-configurational methods, which at least require solving an active space problem whose computational cost on classical computers scales exponentially in the worst case. Quantum computing offers an alternative tool to solve this problem, however, its applicability to study conical intersections, in particular, on real quantum hardware remains to be explored. In this work, we realize a hybrid quantum-classical state-average complete active space self-consistent field method based on the variational quantum eigensolver (VQE-SA-CASSCF) for the first time on a programmable superconducting quantum processor, and applied it to study conical intersections of two prototypical systems - ethylene (C2H4) and triatomic hydrogen (H3). We show that a combination of different strategies can lead to a qualitatively correct reproduction of conical intersections using VQE-SA-CASSCF, including improving the stability of quantum hardware, reducing the depth of variational circuits, grouping Pauli terms to minimize measurements, and applying appropriate error mitigation. These results allow us to identify the challenges to be overcome in the future and pave the way for using quantum computers to study conical intersections of more complex systems.


title: On quasiconformal non-equivalence of gasket Julia sets and limit sets

abstract: This paper studies quasiconformal non-equivalence of Julia sets and limit sets. We proved that any Julia set is quasiconformally different from the Apollonian gasket. We also proved that any Julia set of a quadratic rational map is quasiconformally different from the gasket limit set of a geometrically finite Kleinian group.


title: Integrating Active Learning in Causal Inference with Interference: A Novel Approach in Online Experiments

abstract: In the domain of causal inference research, the prevalent potential outcomes framework, notably the Rubin Causal Model (RCM), often overlooks individual interference and assumes independent treatment effects. This assumption, however, is frequently misaligned with the intricate realities of real-world scenarios, where interference is not merely a possibility but a common occurrence. Our research endeavors to address this discrepancy by focusing on the estimation of direct and spillover treatment effects under two assumptions: (1) network-based interference, where treatments on neighbors within connected networks affect one's outcomes, and (2) non-random treatment assignments influenced by confounders. To improve the efficiency of estimating potentially complex effects functions, we introduce an novel active learning approach: Active Learning in Causal Inference with Interference (ACI). This approach uses Gaussian process to flexibly model the direct and spillover treatment effects as a function of a continuous measure of neighbors' treatment assignment. The ACI framework sequentially identifies the experimental settings that demand further data. It further optimizes the treatment assignments under the network interference structure using genetic algorithms to achieve efficient learning outcome. By applying our method to simulation data and a Tencent game dataset, we demonstrate its feasibility in achieving accurate effects estimations with reduced data requirements. This ACI approach marks a significant advancement in the realm of data efficiency for causal inference, offering a robust and efficient alternative to traditional methodologies, particularly in scenarios characterized by complex interference patterns.


title: Achieving Near-Optimal Regret for Bandit Algorithms with Uniform Last-Iterate Guarantee

abstract: Existing performance measures for bandit algorithms such as regret, PAC bounds, or uniform-PAC (Dann et al., 2017), typically evaluate the cumulative performance, while allowing the play of an arbitrarily bad arm at any finite time t. Such a behavior can be highly detrimental in high-stakes applications. This paper introduces a stronger performance measure, the uniform last-iterate (ULI) guarantee, capturing both cumulative and instantaneous performance of bandit algorithms. Specifically, ULI characterizes the instantaneous performance since it ensures that the per-round regret of the played arm is bounded by a function, monotonically decreasing w.r.t. (large) round t, preventing revisits to bad arms when sufficient samples are available. We demonstrate that a near-optimal ULI guarantee directly implies near-optimal cumulative performance across aforementioned performance measures. To examine the achievability of ULI in the finite arm setting, we first provide two positive results that some elimination-based algorithms and high-probability adversarial algorithms with stronger analysis or additional designs, can attain near-optimal ULI guarantees. Then, we also provide a negative result, indicating that optimistic algorithms cannot achieve a near-optimal ULI guarantee. Finally, we propose an efficient algorithm for linear bandits with infinitely many arms, which achieves the ULI guarantee, given access to an optimization oracle.


title: MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstruction

abstract: This paper presents a neural architecture MVDiffusion++ for 3D object reconstruction that synthesizes dense and high-resolution views of an object given one or a few images without camera poses. MVDiffusion++ achieves superior flexibility and scalability with two surprisingly simple ideas: 1) A ``pose-free architecture'' where standard self-attention among 2D latent features learns 3D consistency across an arbitrary number of conditional and generation views without explicitly using camera pose information; and 2) A ``view dropout strategy'' that discards a substantial number of output views during training, which reduces the training-time memory footprint and enables dense and high-resolution view synthesis at test time. We use the Objaverse for training and the Google Scanned Objects for evaluation with standard novel view synthesis and 3D reconstruction metrics, where MVDiffusion++ significantly outperforms the current state of the arts. We also demonstrate a text-to-3D application example by combining MVDiffusion++ with a text-to-image generative model. The project page is at https://mvdiffusion-plusplus.github.io.


title: Are Large Language Models Rational Investors?

abstract: Large Language Models (LLMs) are progressively being adopted in financial analysis to harness their extensive knowledge base for interpreting complex market data and trends. However, their application in the financial domain is challenged by intrinsic biases (i.e., risk-preference bias) and a superficial grasp of market intricacies, underscoring the need for a thorough assessment of their financial insight. This study introduces a novel framework, Financial Bias Indicators (FBI), to critically evaluate the financial rationality of LLMs, focusing on their ability to discern and navigate the subtleties of financial information and to identify any irrational biases that might skew market analysis. Our research adopts an innovative methodology to measure financial rationality, integrating principles of behavioral finance to scrutinize the biases and decision-making patterns of LLMs. We conduct a comprehensive evaluation of 19 leading LLMs, considering factors such as model scale, training datasets, input strategies, etc. The findings reveal varying degrees of financial irrationality among the models, influenced by their design and training. Models trained specifically on financial datasets might exhibit greater irrationality, and it's possible that even larger financial language models (FinLLMs) could display more biases than smaller, more generalized models. This outcomes provide profound insights into how these elements affect the financial rationality of LLMs, indicating that targeted training and structured input methods could improve model performance. This work enriches our understanding of LLMs' strengths and weaknesses in financial applications, laying the groundwork for the development of more dependable and rational financial analysis tools.


title: Equivariant Pretrained Transformer for Unified Geometric Learning on Multi-Domain 3D Molecules

abstract: Pretraining on a large number of unlabeled 3D molecules has showcased superiority in various scientific applications. However, prior efforts typically focus on pretraining models on a specific domain, either proteins or small molecules, missing the opportunity to leverage the cross-domain knowledge. To mitigate this gap, we introduce Equivariant Pretrained Transformer (EPT), a novel pretraining framework designed to harmonize the geometric learning of small molecules and proteins. To be specific, EPT unifies the geometric modeling of multi-domain molecules via the block-enhanced representation that can attend a broader context of each atom. Upon transformer framework, EPT is further enhanced with E(3) equivariance to facilitate the accurate representation of 3D structures. Another key innovation of EPT is its block-level pretraining task, which allows for joint pretraining on datasets comprising both small molecules and proteins. Experimental evaluations on a diverse group of benchmarks, including ligand binding affinity prediction, molecular property prediction, and protein property prediction, show that EPT significantly outperforms previous SOTA methods for affinity prediction, and achieves the best or comparable performance with existing domain-specific pretraining models for other tasks.


title: Spurious Correlations in Machine Learning: A Survey

abstract: Machine learning systems are known to be sensitive to spurious correlations between non-essential features of the inputs (e.g., background, texture, and secondary objects) and the corresponding labels. These features and their correlations with the labels are known as "spurious" because they tend to change with shifts in real-world data distributions, which can negatively impact the model's generalization and robustness. In this paper, we provide a review of this issue, along with a taxonomy of current state-of-the-art methods for addressing spurious correlations in machine learning models. Additionally, we summarize existing datasets, benchmarks, and metrics to aid future research. The paper concludes with a discussion of the recent advancements and future challenges in this field, aiming to provide valuable insights for researchers in the related domains.


title: Off-Path TCP Hijacking in Wi-Fi Networks: A Packet-Size Side Channel Attack

abstract: In this paper, we unveil a fundamental side channel in Wi-Fi networks, specifically the observable frame size, which can be exploited by attackers to conduct TCP hijacking attacks. Despite the various security mechanisms (e.g., WEP and WPA2/WPA3) implemented to safeguard Wi-Fi networks, our study reveals that an off path attacker can still extract sufficient information from the frame size side channel to hijack the victim's TCP connection. Our side channel attack is based on two significant findings: (i) response packets (e.g., ACK and RST) generated by TCP receivers vary in size, and (ii) the encrypted frames containing these response packets have consistent and distinguishable sizes. By observing the size of the victim's encrypted frames, the attacker can detect and hijack the victim's TCP connections. We validate the effectiveness of this side channel attack through two case studies, i.e., SSH DoS and web traffic manipulation. Precisely, our attack can terminate the victim's SSH session in 19 seconds and inject malicious data into the victim's web traffic within 28 seconds. Furthermore, we conduct extensive measurements to evaluate the impact of our attack on real-world Wi-Fi networks. We test 30 popular wireless routers from 9 well-known vendors, and none of these routers can protect victims from our attack. Besides, we implement our attack in 80 real-world Wi-Fi networks and successfully hijack the victim's TCP connections in 75 (93.75%) evaluated Wi-Fi networks. We have responsibly disclosed the vulnerability to the Wi-Fi Alliance and proposed several mitigation strategies to address this issue.


title: Operahedron Lattices

abstract: Laplante-Anfossi associated to each rooted plane tree a polytope called an operahedron. He also defined a partial order on the vertex set of an operahedron and asked if the resulting poset is a lattice. We answer this question in the affirmative, motivating us to name Laplante-Anfossi's posets operahedron lattices. The operahedron lattice of a chain with $n+1$ vertices is isomorphic to the $n$-th Tamari lattice, while the operahedron lattice of a claw with $n+1$ vertices is isomorphic to $\mathrm{Weak}(\mathfrak S_n)$, the weak order on the symmetric group $\mathfrak S_n$. We characterize semidistributive operahedron lattices and trim operahedron lattices. Let $\Delta_{\mathrm{Weak}(\mathfrak S_n)}(w_\circ(k,n))$ be the principal order ideal of $\mathrm{Weak}(\mathfrak S_n)$ generated by the permutation ${w_\circ(k,n)=k(k-1)\cdots 1(k+1)(k+2)\cdots n}$. Our final result states that the operahedron lattice of a broom with $n+1$ vertices and $k$ leaves is isomorphic to the subposet of $\mathrm{Weak}(\mathfrak S_n)$ consisting of the preimages of $\Delta_{\mathrm{Weak}(\mathfrak S_n)}(w_\circ(k,n))$ under West's stack-sorting map; as a consequence, we deduce that this subposet is a semidistributive lattice.


title: Fostering Joint Innovation: A Global Online Platform for Ideas Sharing and Collaboration

abstract: In today's world, where moving forward hinges on innovation and working together, this article introduces a new global online platform that is all about sparking teamwork to come up with new ideas. This platform goes beyond borders and barriers between different fields, creating an exciting space where people from all over the world can swap ideas, get helpful feedback, and team up on exciting projects. What sets our platform apart is its ability to tap into the combined brainpower of a diverse bunch of users, giving people the power to come up with game-changing ideas that tackle big global problems. By making it easy for people to share ideas and promoting a culture of working together, our platform is like a buddy for innovation, boosting creativity and problem-solving on a global level. This article spills the details on what the platform aims to do, how it works, and what makes it special, emphasizing how it can kickstart creativity, ramp up problem-solving skills, and get different fields collaborating. It is not just a tool it is a whole new way of teaming up to make daily life better and build a global community of problem-solving pals.


title: Restricted maximum likelihood estimation in generalized linear mixed models

abstract: Restricted maximum likelihood (REML) estimation is a widely accepted and frequently used method for fitting linear mixed models, with its principal advantage being that it produces less biased estimates of the variance components. However, the concept of REML does not immediately generalize to the setting of non-normally distributed responses, and it is not always clear the extent to which, either asymptotically or in finite samples, such generalizations reduce the bias of variance component estimates compared to standard unrestricted maximum likelihood estimation. In this article, we review various attempts that have been made over the past four decades to extend REML estimation in generalized linear mixed models. We establish four major classes of approaches, namely approximate linearization, integrated likelihood, modified profile likelihoods, and direct bias correction of the score function, and show that while these four classes may have differing motivations and derivations, they often arrive at a similar if not the same REML estimate. We compare the finite sample performance of these four classes through a numerical study involving binary and count data, with results demonstrating that they perform similarly well in reducing the finite sample bias of variance components.


title: Revisiting the Information Capacity of Neural Network Watermarks: Upper Bound Estimation and Beyond

abstract: To trace the copyright of deep neural networks, an owner can embed its identity information into its model as a watermark. The capacity of the watermark quantify the maximal volume of information that can be verified from the watermarked model. Current studies on capacity focus on the ownership verification accuracy under ordinary removal attacks and fail to capture the relationship between robustness and fidelity. This paper studies the capacity of deep neural network watermarks from an information theoretical perspective. We propose a new definition of deep neural network watermark capacity analogous to channel capacity, analyze its properties, and design an algorithm that yields a tight estimation of its upper bound under adversarial overwriting. We also propose a universal non-invasive method to secure the transmission of the identity message beyond capacity by multiple rounds of ownership verification. Our observations provide evidence for neural network owners and defenders that are curious about the tradeoff between the integrity of their ownership and the performance degradation of their products.


title: PAC-FNO: Parallel-Structured All-Component Fourier Neural Operators for Recognizing Low-Quality Images

abstract: A standard practice in developing image recognition models is to train a model on a specific image resolution and then deploy it. However, in real-world inference, models often encounter images different from the training sets in resolution and/or subject to natural variations such as weather changes, noise types and compression artifacts. While traditional solutions involve training multiple models for different resolutions or input variations, these methods are computationally expensive and thus do not scale in practice. To this end, we propose a novel neural network model, parallel-structured and all-component Fourier neural operator (PAC-FNO), that addresses the problem. Unlike conventional feed-forward neural networks, PAC-FNO operates in the frequency domain, allowing it to handle images of varying resolutions within a single model. We also propose a two-stage algorithm for training PAC-FNO with a minimal modification to the original, downstream model. Moreover, the proposed PAC-FNO is ready to work with existing image recognition models. Extensively evaluating methods with seven image recognition benchmarks, we show that the proposed PAC-FNO improves the performance of existing baseline models on images with various resolutions by up to 77.1% and various types of natural variations in the images at inference.


title: Structural Knowledge Informed Continual Multivariate Time Series Forecasting

abstract: Recent studies in multivariate time series (MTS) forecasting reveal that explicitly modeling the hidden dependencies among different time series can yield promising forecasting performance and reliable explanations. However, modeling variable dependencies remains underexplored when MTS is continuously accumulated under different regimes (stages). Due to the potential distribution and dependency disparities, the underlying model may encounter the catastrophic forgetting problem, i.e., it is challenging to memorize and infer different types of variable dependencies across different regimes while maintaining forecasting performance. To address this issue, we propose a novel Structural Knowledge Informed Continual Learning (SKI-CL) framework to perform MTS forecasting within a continual learning paradigm, which leverages structural knowledge to steer the forecasting model toward identifying and adapting to different regimes, and selects representative MTS samples from each regime for memory replay. Specifically, we develop a forecasting model based on graph structure learning, where a consistency regularization scheme is imposed between the learned variable dependencies and the structural knowledge while optimizing the forecasting objective over the MTS data. As such, MTS representations learned in each regime are associated with distinct structural knowledge, which helps the model memorize a variety of conceivable scenarios and results in accurate forecasts in the continual learning context. Meanwhile, we develop a representation-matching memory replay scheme that maximizes the temporal coverage of MTS data to efficiently preserve the underlying temporal dynamics and dependency structures of each regime. Thorough empirical studies on synthetic and real-world benchmarks validate SKI-CL's efficacy and advantages over the state-of-the-art for continual MTS forecasting tasks.


title: Reduced-resolution beamforming: lowering the computational cost for pulsar and technosignature surveys

abstract: In radio astronomy, the science output of a telescope is often limited by computational resources. This is especially true for transient and technosignature surveys that need to search high-resolution data across a large parameter space. The tremendous data volumes produced by modern radio array telescopes exacerbate these processing challenges. Here, we introduce a 'reduced-resolution' beamforming approach to alleviate downstream processing requirements. Our approach, based on post-correlation beamforming, allows sensitivity to be traded against the number of beams needed to cover a given survey area. Using the MeerKAT and Murchison Widefield Array telescopes as examples, we show that survey speed can be vastly increased, and downstream signal processing requirements vastly decreased, if a moderate sacrifice to sensitivity is allowed. We show the reduced-resolution beamforming technique is intimately related to standard techniques used in synthesis imaging. We suggest that reduced-resolution beamforming should be considered to ease data processing challenges in current and planned searches; further, reduced-resolution beamforming may provide a path toward computationally-expensive search strategies previously considered infeasible.


title: Controlled Variable Selection from Summary Statistics Only? A Solution via GhostKnockoffs and Penalized Regression

abstract: Identifying which variables do influence a response while controlling false positives pervades statistics and data science. In this paper, we consider a scenario in which we only have access to summary statistics, such as the values of marginal empirical correlations between each dependent variable of potential interest and the response. This situation may arise due to privacy concerns, e.g., to avoid the release of sensitive genetic information. We extend GhostKnockoffs (He et al. [2022]) and introduce variable selection methods based on penalized regression achieving false discovery rate (FDR) control. We report empirical results in extensive simulation studies, demonstrating enhanced performance over previous work. We also apply our methods to genome-wide association studies of Alzheimer's disease, and evidence a significant improvement in power.


title: Radio Continuum Study of the Large Magellanic Cloud Supernova Remnant Honeycomb Nebula

abstract: We present the first and deepest Australia Telescope Compact Array radio continuum images of the Honeycomb Nebula at 2000 and 5500 MHz solely from archival data. The resolutions of these images are 3.6 x 2.8 arcsec2 and 1.3 x 1.2 arcsec2 at 2000 and 5500 MHz. We find an average radio spectral index for the remnant of -0.76 +- 0.07. Polarisation maps at 5500 MHz reveal an average fractional polarisation of 25 +- 5% with a maximum value of 95 x 16. We estimate the equipartition field for Honeycomb Nebula of 48 +- 5 {\mu}G, with an estimated minimum energy of Emin = 3 x 1049 erg. The estimated surface brightness, {\Sigma}1 GHz , is 30 x 10-20 W m-2 Hz-1 sr-1; applying the {\Sigma}-D relation suggests this supernova remnant is expanding into a low-density environment. Finally, using Hi data, we can support the idea that the Honeycomb Nebula exploded inside a low-density wind cavity. We suggest that this remnant is likely to be between late free expansion stage and early Sedov phase of evolution and expanding into a low-density medium.


title: Lowest-lying ${\frac{1}{2}}^-$ and ${\frac{3}{2}}^-$ $\Lambda_{Q}$ resonances: from the strange to the bottom sectors

abstract: We present a detailed study of the lowest-lying ${\frac{1}{2}}^-$ and ${\frac{3}{2}}^-$ $\Lambda_{Q}$ resonances both in the heavy quark (bottom and charm) and the strange sectors. We have paid special attention to the interplay between the constituent quark-model and chiral baryon-meson degrees of freedom, which are coupled using a unitarized scheme consistent with leading-order heavy quark symmetries. We show that the $\Lambda_b(5912)$ [$J^P=1/2^-$], $\Lambda_b(5920)$ [$J^P=3/2^-$] and the $\Lambda_c(2625)$ [$J^P=3/2^-$], and the $\Lambda(1520)$ [$J^P=3/2^-$] admitting larger breaking corrections, are heavy-quark spin-flavor siblings. They can be seen as dressed quark-model states with $\Sigma_{Q}^{(*)}\pi$ molecular components of the order of 30\%. The ${J^P=\frac{1}{2}}^-$ $\Lambda_c(2595)$ has, however, a higher molecular probability of at least $50$\%, and even values greater than 70\% can be easily accommodated. This is because it is located almost on top of the threshold of the $\Sigma_c\pi$ pair, which largely influences its properties. Although the light degrees of freedom in this resonance would be coupled to spin-parity $1^-$ as in the $\Lambda_b(5912)$, $\Lambda_b(5920)$ and $\Lambda_c(2625)$, the $\Lambda_c(2595)$ should not be considered as a heavy-quark spin-flavor partner of the former ones. We also show that the $\Lambda(1405)$ chiral two-pole pattern does not have analogs in the $\frac{1}{2}^-$ charmed and bottomed sectors, because the $ND^{(*)}$ and $N\overline{B}{}^{(*)} $ channels do not play for heavy quarks the decisive role that the $N \overline{K}$ does in the strange sector, and the notable influence of the bare quark-model states for the charm and bottom resonances. Finally, we predict the existence of two $\Lambda_b(6070)$ and two $\Lambda_c(2765)$ heavy-quark spin and flavor sibling odd parity states.


title: Diffusion Posterior Sampling is Computationally Intractable

abstract: Diffusion models are a remarkably effective way of learning and sampling from a distribution $p(x)$. In posterior sampling, one is also given a measurement model $p(y \mid x)$ and a measurement $y$, and would like to sample from $p(x \mid y)$. Posterior sampling is useful for tasks such as inpainting, super-resolution, and MRI reconstruction, so a number of recent works have given algorithms to heuristically approximate it; but none are known to converge to the correct distribution in polynomial time. In this paper we show that posterior sampling is \emph{computationally intractable}: under the most basic assumption in cryptography -- that one-way functions exist -- there are instances for which \emph{every} algorithm takes superpolynomial time, even though \emph{unconditional} sampling is provably fast. We also show that the exponential-time rejection sampling algorithm is essentially optimal under the stronger plausible assumption that there are one-way functions that take exponential time to invert.


title: Modality-Aware Integration with Large Language Models for Knowledge-based Visual Question Answering

abstract: Knowledge-based visual question answering (KVQA) has been extensively studied to answer visual questions with external knowledge, e.g., knowledge graphs (KGs). While several attempts have been proposed to leverage large language models (LLMs) as an implicit knowledge source, it remains challenging since LLMs may generate hallucinations. Moreover, multiple knowledge sources, e.g., images, KGs and LLMs, cannot be readily aligned for complex scenarios. To tackle these, we present a novel modality-aware integration with LLMs for KVQA (MAIL). It carefully leverages multimodal knowledge for both image understanding and knowledge reasoning. Specifically, (i) we propose a two-stage prompting strategy with LLMs to densely embody the image into a scene graph with detailed visual features; (ii) We construct a coupled concept graph by linking the mentioned entities with external facts. (iii) A tailored pseudo-siamese graph medium fusion is designed for sufficient multimodal fusion. We utilize the shared mentioned entities in two graphs as mediums to bridge a tight inter-modal exchange, while maximally preserving insightful intra-modal learning by constraining the fusion within mediums. Extensive experiments on two benchmark datasets show the superiority of MAIL with 24x less resources.


title: Scalable and reliable deep transfer learning for intelligent fault detection via multi-scale neural processes embedded with knowledge

abstract: Deep transfer learning (DTL) is a fundamental method in the field of Intelligent Fault Detection (IFD). It aims to mitigate the degradation of method performance that arises from the discrepancies in data distribution between training set (source domain) and testing set (target domain). Considering the fact that fault data collection is challenging and certain faults are scarce, DTL-based methods face the limitation of available observable data, which reduces the detection performance of the methods in the target domain. Furthermore, DTL-based methods lack comprehensive uncertainty analysis that is essential for building reliable IFD systems. To address the aforementioned problems, this paper proposes a novel DTL-based method known as Neural Processes-based deep transfer learning with graph convolution network (GTNP). Feature-based transfer strategy of GTNP bridges the data distribution discrepancies of source domain and target domain in high-dimensional space. Both the joint modeling based on global and local latent variables and sparse sampling strategy reduce the demand of observable data in the target domain. The multi-scale uncertainty analysis is obtained by using the distribution characteristics of global and local latent variables. Global analysis of uncertainty enables GTNP to provide quantitative values that reflect the complexity of methods and the difficulty of tasks. Local analysis of uncertainty allows GTNP to model uncertainty (confidence of the fault detection result) at each sample affected by noise and bias. The validation of the proposed method is conducted across 3 IFD tasks, consistently showing the superior detection performance of GTNP compared to the other DTL-based methods.


title: UMBCLU at SemEval-2024 Task 1A and 1C: Semantic Textual Relatedness with and without machine translation

abstract: The aim of SemEval-2024 Task 1, "Semantic Textual Relatedness for African and Asian Languages" is to develop models for identifying semantic textual relatedness (STR) between two sentences using multiple languages (14 African and Asian languages) and settings (supervised, unsupervised, and cross-lingual). Large language models (LLMs) have shown impressive performance on several natural language understanding tasks such as multilingual machine translation (MMT), semantic similarity (STS), and encoding sentence embeddings. Using a combination of LLMs that perform well on these tasks, we developed two STR models, $\textit{TranSem}$ and $\textit{FineSem}$, for the supervised and cross-lingual settings. We explore the effectiveness of several training methods and the usefulness of machine translation. We find that direct fine-tuning on the task is comparable to using sentence embeddings and translating to English leads to better performance for some languages. In the supervised setting, our model performance is better than the official baseline for 3 languages with the remaining 4 performing on par. In the cross-lingual setting, our model performance is better than the baseline for 3 languages (leading to $1^{st}$ place for Africaans and $2^{nd}$ place for Indonesian), is on par for 2 languages and performs poorly on the remaining 7 languages. Our code is publicly available at https://github.com/dipta007/SemEval24-Task8.


title: Black brookite rich in oxygen vacancies as an active photocatalyst for CO2 conversion: experiments and first-principles calculations

abstract: Photocatalytic CO2 conversion is a clean technology to deal with CO2 emissions, and titanium oxide (TiO2) polymorphs are the most investigated photocatalysts for such an application. In this study, black TiO2 brookite is produced by a high-pressure torsion (HPT) method and employed as an active photocatalyst for CO2 conversion. Black brookite with a large concentration of lattice defects (vacancies, dislocations and grain boundaries) showed enhanced light absorbance, narrowed optical bandgap and diminished recombination rate of electrons and holes. The photocatalytic activity of the black oxide for CO2 conversion was higher compared to commercial brookite and benchmark P25 catalyst powders. First-principles calculations suggested that the presence of oxygen vacancies in black brookite is effective not only for reducing optical bandgap but also for providing active sites for the adsorption of CO2 on the surface of TiO2.


title: Floquet Nonadiabatic Mixed Quantum-Classical Dynamics in Laser-Dressed Solid Systems

abstract: In this paper, we introduce the Floquet Ehrenfest and Floquet surface hopping approaches to study the nonadiabatic dynamics in the laser-dressed solid systems. We demonstrate that these two approaches can be formulated in both real and reciprocal spaces. Using these approaches, we are able to simulate the interaction between electronic carriers and phonons under periodic drivings, such as strong light-matter interactions. Employing the Holstein and Peierls models, we show that the strong light-matter interactions can effectively modulate the dynamics of electronic population and mobility. Notably, our study demonstrates the feasibility and effectiveness of modeling low-momentum carriers' interactions with phonons using a truncated reciprocal-space basis, an approach impractical in real-space frameworks. Moreover, we reveal that even with significant truncation, carrier populations derived from surface hopping maintain greater accuracy compared to those obtained via meanfield dynamics. These results underscore the potential of our proposed methods in advancing the understanding of carrier-phonon interactions in various laser-dressed materials.


title: BMLP: Behavior-aware MLP for Heterogeneous Sequential Recommendation

abstract: In real recommendation scenarios, users often have different types of behaviors, such as clicking and buying. Existing research methods show that it is possible to capture the heterogeneous interests of users through different types of behaviors. However, most multi-behavior approaches have limitations in learning the relationship between different behaviors. In this paper, we propose a novel multilayer perceptron (MLP)-based heterogeneous sequential recommendation method, namely behavior-aware multilayer perceptron (BMLP). Specifically, it has two main modules, including a heterogeneous interest perception (HIP) module, which models behaviors at multiple granularities through behavior types and transition relationships, and a purchase intent perception (PIP) module, which adaptively fuses subsequences of auxiliary behaviors to capture users' purchase intent. Compared with mainstream sequence models, MLP is competitive in terms of accuracy and has unique advantages in simplicity and efficiency. Extensive experiments show that BMLP achieves significant improvement over state-of-the-art algorithms on four public datasets. In addition, its pure MLP architecture leads to a linear time complexity.


title: A Lower Bound on the Competitive Ratio of the Permutation Algorithm for Online Facility Assignment on a Line

abstract: In the online facility assignment on a line (OFAL) with a set $S$ of $k$ servers and a capacity $c:S\to\mathbb{N}$, each server $s\in S$ with a capacity $c(s)$ is placed on a line and a request arrives on a line one-by-one. The task of an online algorithm is to irrevocably assign a current request to one of the servers with vacancies before the next request arrives. An algorithm can assign up to $c(s)$ requests to each server $s\in S$. In this paper, we show that the competitive ratio of the permutation algorithm is at least $k+1$ for OFAL where the servers are evenly placed on a line. This disproves the result that the permutation algorithm is $k$-competitive by Ahmed et al..


title: Denoising OCT Images Using Steered Mixture of Experts with Multi-Model Inference

abstract: In Optical Coherence Tomography (OCT), speckle noise significantly hampers image quality, affecting diagnostic accuracy. Current methods, including traditional filtering and deep learning techniques, have limitations in noise reduction and detail preservation. Addressing these challenges, this study introduces a novel denoising algorithm, Block-Matching Steered-Mixture of Experts with Multi-Model Inference and Autoencoder (BM-SMoE-AE). This method combines block-matched implementation of the SMoE algorithm with an enhanced autoencoder architecture, offering efficient speckle noise reduction while retaining critical image details. Our method stands out by providing improved edge definition and reduced processing time. Comparative analysis with existing denoising techniques demonstrates the superior performance of BM-SMoE-AE in maintaining image integrity and enhancing OCT image usability for medical diagnostics.


title: CST: Calibration Side-Tuning for Parameter and Memory Efficient Transfer Learning

abstract: Achieving a universally high accuracy in object detection is quite challenging, and the mainstream focus in the industry currently lies on detecting specific classes of objects. However, deploying one or multiple object detection networks requires a certain amount of GPU memory for training and storage capacity for inference. This presents challenges in terms of how to effectively coordinate multiple object detection tasks under resource-constrained conditions. This paper introduces a lightweight fine-tuning strategy called Calibration side tuning, which integrates aspects of adapter tuning and side tuning to adapt the successful techniques employed in transformers for use with ResNet. The Calibration side tuning architecture that incorporates maximal transition calibration, utilizing a small number of additional parameters to enhance network performance while maintaining a smooth training process. Furthermore, this paper has conducted an analysis on multiple fine-tuning strategies and have implemented their application within ResNet, thereby expanding the research on fine-tuning strategies for object detection networks. Besides, this paper carried out extensive experiments using five benchmark datasets. The experimental results demonstrated that this method outperforms other compared state-of-the-art techniques, and a better balance between the complexity and performance of the finetune schemes is achieved.


title: Guarantee Regions for Local Explanations

abstract: Interpretability methods that utilise local surrogate models (e.g. LIME) are very good at describing the behaviour of the predictive model at a point of interest, but they are not guaranteed to extrapolate to the local region surrounding the point. However, overfitting to the local curvature of the predictive model and malicious tampering can significantly limit extrapolation. We propose an anchor-based algorithm for identifying regions in which local explanations are guaranteed to be correct by explicitly describing those intervals along which the input features can be trusted. Our method produces an interpretable feature-aligned box where the prediction of the local surrogate model is guaranteed to match the predictive model. We demonstrate that our algorithm can be used to find explanations with larger guarantee regions that better cover the data manifold compared to existing baselines. We also show how our method can identify misleading local explanations with significantly poorer guarantee regions.


title: Can Large Language Models be Used to Provide Psychological Counselling? An Analysis of GPT-4-Generated Responses Using Role-play Dialogues

abstract: Mental health care poses an increasingly serious challenge to modern societies. In this context, there has been a surge in research that utilizes information technologies to address mental health problems, including those aiming to develop counseling dialogue systems. However, there is a need for more evaluations of the performance of counseling dialogue systems that use large language models. For this study, we collected counseling dialogue data via role-playing scenarios involving expert counselors, and the utterances were annotated with the intentions of the counselors. To determine the feasibility of a dialogue system in real-world counseling scenarios, third-party counselors evaluated the appropriateness of responses from human counselors and those generated by GPT-4 in identical contexts in role-play dialogue data. Analysis of the evaluation results showed that the responses generated by GPT-4 were competitive with those of human counselors.


title: Progress of photonuclear cross sections for medical radioisotope production at the SLEGS energy domain

abstract: Photonuclear reactions using a laser Compton scattering (LCS) gamma source provide a new method for producing radioisotopes for medical applications. Compared with the conventional method, this method has the advantages of a high specific activity and less heat. Initiated by the Shanghai Laser Electron Gamma Source (SLEGS), we conducted a survey of potential photonuclear reactions, $(\upgamma,n)$, $(\upgamma,p)$, and $(\upgamma,\upgamma')$ whose cross-sections can be measured at SLEGS by summarizing the experimental progress. In general, the data are rare and occasionally inconsistent. Therefore, theoretical calculations are often used to evaluate the production of medical radioisotopes. Subsequently, we verified the model uncertainties of the widely used reaction code TALYS-1.96, using the experimental data of the \ce{^100Mo}$(\upgamma,n)$\ce{^99Mo}, \ce{^65Cu}$(\upgamma,n)$\ce{^64Cu}, and \ce{^68Zn}$(\upgamma,p)$\ce{^67Cu} reactions.


title: Molten Salt Flux Liquid Transport Method for Ultra Clean Single Crystals UTe2

abstract: Various single crystal growth techniques are presented for the unconventional superconductor UTe2. The molten salt flux liquid transport (MSFLT) method is employed to grow high-quality and large single crystals, exhibiting a high residual resistivity ratio (RRR = 200-800). On the other hand, the Te self-flux and chemical vapor transport (CVT) method produces samples of lower quality. The MSFLT method is a hybrid approach that combines the molten salt flux (MSF) and CVT methods. One significant advantage is that the materials gradually crystallize at the relatively low temperature which is fixed during the main process. This might be crucial for preventing U deficiency and obtaining high-quality and large single crystals of UTe2. Many different single crystals obtained by different technique were characterized by resistivity, specific heat measurements. The superconducting transition temperature decreases with the residual resistivity, followed by the Abrikosov-Gor'kov pair breaking theory. The highest quality sample reaches Tc=2.1K. The residual gamma-value of specific heat for the highest quality sample is only 3 percents of the normal state gamma-value. The specific heat jump, Delta C/(gamma Tc) reaches about 2.7 for high quality samples, indicating a strong coupling superconductor. Furthermore, the magnetic susceptibility for the field along a-axis in a high quality single crystal does not show an up-turn behavior on cooling, which is consistent with the results of NMR Knight shift and muSR experiments.


title: MuLan: Multimodal-LLM Agent for Progressive and Interactive Multi-Object Diffusion

abstract: Existing text-to-image models still struggle to generate images of multiple objects, especially in handling their spatial positions, relative sizes, overlapping, and attribute bindings. To efficiently address these challenges, we develop a training-free Multimodal-LLM agent (MuLan), as a human painter, that can progressively generate multi-object with intricate planning and feedback control. MuLan harnesses a large language model (LLM) to decompose a prompt to a sequence of sub-tasks, each generating only one object by stable diffusion, conditioned on previously generated objects. Unlike existing LLM-grounded methods, MuLan only produces a high-level plan at the beginning while the exact size and location of each object are determined upon each sub-task by an LLM and attention guidance. Moreover, MuLan adopts a vision-language model (VLM) to provide feedback to the image generated in each sub-task and control the diffusion model to re-generate the image if it violates the original prompt. Hence, each model in every step of MuLan only needs to address an easy sub-task it is specialized for. The multi-step process also allows human users to monitor the generation process and make preferred changes at any intermediate step via text prompts, thereby improving the human-AI collaboration experience. We collect 200 prompts containing multi-objects with spatial relationships and attribute bindings from different benchmarks to evaluate MuLan. The results demonstrate the superiority of MuLan in generating multiple objects over baselines and its creativity when collaborating with human users. The code is available at https://github.com/measure-infinity/mulan-code.


title: DDC: A Vision for a Disaggregated Datacenter

abstract: Datacenters of today have maintained the same architecture for decades using the server as the primary building block. However, this traditional approach suffers from under-utilization of its resources, often caused by over-allocating these resources when deploying applications to accommodate worst-case scenarios. Specifically, servers can quickly drain their over-allocated memory resources while their CPUs are not fully utilized. This problem gives rise to a different school of thought, where resources are disaggregated instead of tightly bound to servers. This can address the utilization problem by allowing each type of resource to be allocated, utilized and freed separately as required. New high performance communication protocols, like CXL, could pave the way for practical implementations of resource disaggregation. In this article, we argue it is time to reconsider the datacenter architecture as a whole. We present our vision for a disaggregated datacenter aided by well-established computer architecture design methodologies.


title: APT-MMF: An advanced persistent threat actor attribution method based on multimodal and multilevel feature fusion

abstract: Threat actor attribution is a crucial defense strategy for combating advanced persistent threats (APTs). Cyber threat intelligence (CTI), which involves analyzing multisource heterogeneous data from APTs, plays an important role in APT actor attribution. The current attribution methods extract features from different CTI perspectives and employ machine learning models to classify CTI reports according to their threat actors. However, these methods usually extract only one kind of feature and ignore heterogeneous information, especially the attributes and relations of indicators of compromise (IOCs), which form the core of CTI. To address these problems, we propose an APT actor attribution method based on multimodal and multilevel feature fusion (APT-MMF). First, we leverage a heterogeneous attributed graph to characterize APT reports and their IOC information. Then, we extract and fuse multimodal features, including attribute type features, natural language text features and topological relationship features, to construct comprehensive node representations. Furthermore, we design multilevel heterogeneous graph attention networks to learn the deep hidden features of APT report nodes; these networks integrate IOC type-level, metapath-based neighbor node-level, and metapath semantic-level attention. Utilizing multisource threat intelligence, we construct a heterogeneous attributed graph dataset for verification purposes. The experimental results show that our method not only outperforms the existing methods but also demonstrates its good interpretability for attribution analysis tasks.


title: Surrogate models for vibrational entropy based on a spatial decomposition

abstract: The temperature-dependent behavior of defect densities within a crystalline structure is intricately linked to the phenomenon of vibrational entropy. Traditional methods for evaluating vibrational entropy are computationally intensive, limiting their practical utility. We show that total entropy can be decomposed into atomic site contributions and rigorously estimate the locality of site entropy. This analysis suggests that vibrational entropy can be effectively predicted using a surrogate model for site entropy. We employ machine learning to develop such a surrogate models employing the Atomic Cluster Expansion model. We supplement our rigorous analysis with an empirical convergence study. In addition we demonstrate the performance of our method for predicting vibrational formation entropy and attempt frequency of the transition rates, on point defects such as vacancies and interstitials.


title: Near-Optimal Quantum Algorithm for Minimizing the Maximal Loss

abstract: The problem of minimizing the maximum of $N$ convex, Lipschitz functions plays significant roles in optimization and machine learning. It has a series of results, with the most recent one requiring $O(N\epsilon^{-2/3} + \epsilon^{-8/3})$ queries to a first-order oracle to compute an $\epsilon$-suboptimal point. On the other hand, quantum algorithms for optimization are rapidly advancing with speedups shown on many important optimization problems. In this paper, we conduct a systematic study for quantum algorithms and lower bounds for minimizing the maximum of $N$ convex, Lipschitz functions. On one hand, we develop quantum algorithms with an improved complexity bound of $\tilde{O}(\sqrt{N}\epsilon^{-5/3} + \epsilon^{-8/3})$. On the other hand, we prove that quantum algorithms must take $\tilde{\Omega}(\sqrt{N}\epsilon^{-2/3})$ queries to a first order quantum oracle, showing that our dependence on $N$ is optimal up to poly-logarithmic factors.


title: Plugin Speech Enhancement: A Universal Speech Enhancement Framework Inspired by Dynamic Neural Network

abstract: The expectation to deploy a universal neural network for speech enhancement, with the aim of improving noise robustness across diverse speech processing tasks, faces challenges due to the existing lack of awareness within static speech enhancement frameworks regarding the expected speech in downstream modules. These limitations impede the effectiveness of static speech enhancement approaches in achieving optimal performance for a range of speech processing tasks, thereby challenging the notion of universal applicability. The fundamental issue in achieving universal speech enhancement lies in effectively informing the speech enhancement module about the features of downstream modules. In this study, we present a novel weighting prediction approach, which explicitly learns the task relationships from downstream training information to address the core challenge of universal speech enhancement. We found the role of deciding whether to employ data augmentation techniques as crucial downstream training information. This decision significantly impacts the expected speech and the performance of the speech enhancement module. Moreover, we introduce a novel speech enhancement network, the Plugin Speech Enhancement (Plugin-SE). The Plugin-SE is a dynamic neural network that includes the speech enhancement module, gate module, and weight prediction module. Experimental results demonstrate that the proposed Plugin-SE approach is competitive or superior to other joint training methods across various downstream tasks.


title: Enhanced Physical Layer Security for Full-duplex Symbiotic Radio with AN Generation and Forward Noise Suppression

abstract: Due to the constraints on power supply and limited encryption capability, data security based on physical layer security (PLS) techniques in backscatter communications has attracted a lot of attention. In this work, we propose to enhance PLS in a full-duplex symbiotic radio (FDSR) system with a proactive eavesdropper, which may overhear the information and interfere legitimate communications simultaneously by emitting attack signals. To deal with the eavesdroppers, we propose a security strategy based on pseudo-decoding and artificial noise (AN) injection to ensure the performance of legitimate communications through forward noise suppression. A novel AN signal generation scheme is proposed using a pseudo-decoding method, where AN signal is superimposed on data signal to safeguard the legitimate channel. The phase control in the forward noise suppression scheme and the power allocation between AN and data signals are optimized to maximize security throughput. The formulated problem can be solved via problem decomposition and alternate optimization algorithms. Simulation results demonstrate the superiority of the proposed scheme in terms of security throughput and attack mitigation performance.


title: Energy exchange between electrons and ions in ion temperature gradient turbulence

abstract: Microturbulence in magnetic confined plasmas contributes to energy exchange between particles of different species as well as the particle and heat fluxes. Although the effect of turbulent energy exchange has not been considered significant in previous studies, it is anticipated to have a greater impact than collisional energy exchange in low collisional plasmas such as those in future fusion reactors. In this study, gyrokinetic simulations are performed to evaluate the energy exchange in ion temperature gradient (ITG) turbulence. The energy exchange due to the ITG turbulence mainly consists of the cooling of ions in the $\nabla B$-curvature drift motion and the heating of electrons streaming along a field line. It is found that the ITG turbulence transfers energy from ions to electrons regardless of whether the ions or electrons are hotter, which is in marked contrast to the energy transfer by Coulomb collisions. This implies that the ITG turbulence should be suppressed from the viewpoint of sustaining the high ion temperature required for fusion reactions since it prevents energy transfer from alpha-heated electrons to ions as well as enhancing ion heat transport toward the outside of the reactor. Furthermore, linear and nonlinear simulation analyses confirm the feasibility of quasilinear modeling for predicting the turbulent energy exchange in addition to the particle and heat fluxes.


title: Me LLaMA: Foundation Large Language Models for Medical Applications

abstract: Recent advancements in large language models (LLMs) such as ChatGPT and LLaMA have hinted at their potential to revolutionize medical applications, yet their application in clinical settings often reveals limitations due to a lack of specialized training on medical-specific data. In response to this challenge, this study introduces Me-LLaMA, a novel medical LLM family that includes foundation models - Me-LLaMA 13/70B, along with their chat-enhanced versions - Me-LLaMA 13/70B-chat, developed through continual pre-training and instruction tuning of LLaMA2 using large medical datasets. Our methodology leverages a comprehensive domain-specific data suite, including a large-scale, continual pre-training dataset with 129B tokens, an instruction tuning dataset with 214k samples, and a new medical evaluation benchmark (MIBE) across six critical medical tasks with 12 datasets. Our extensive evaluation using the MIBE shows that Me-LLaMA models achieve overall better performance than existing open-source medical LLMs in zero-shot, few-shot and supervised learning abilities. With task-specific instruction tuning, Me-LLaMA models outperform ChatGPT on 7 out of 8 datasets and GPT-4 on 5 out of 8 datasets. In addition, we investigated the catastrophic forgetting problem, and our results show that Me-LLaMA models outperform other open-source medical LLMs in mitigating this issue. Me-LLaMA is one of the largest open-source medical foundation LLMs that use both biomedical and clinical data. It exhibits superior performance across both general and medical tasks compared to other open-source medical LLMs, rendering it an attractive choice for medical AI applications. We release our models, datasets, and evaluation scripts at: https://github.com/BIDS-Xu-Lab/Me-LLaMA.


title: Model Composition for Multimodal Large Language Models

abstract: Recent developments in Multimodal Large Language Models (MLLMs) have shown rapid progress, moving towards the goal of creating versatile MLLMs that understand inputs from various modalities. However, existing methods typically rely on joint training with paired multimodal instruction data, which is resource-intensive and challenging to extend to new modalities. In this paper, we propose a new paradigm through the model composition of existing MLLMs to create a new model that retains the modal understanding capabilities of each original model. Our basic implementation, NaiveMC, demonstrates the effectiveness of this paradigm by reusing modality encoders and merging LLM parameters. Furthermore, we introduce DAMC to address parameter interference and mismatch issues during the merging process, thereby enhancing the model performance. To facilitate research in this area, we propose MCUB, a benchmark for assessing ability of MLLMs to understand inputs from diverse modalities. Experiments on this benchmark and four other multimodal understanding tasks show significant improvements over baselines, proving that model composition can create a versatile model capable of processing inputs from multiple modalities.


title: On p-permutation equivalences between direct products of blocks

abstract: We extend the notion of a p-permutation equivalence to an equivalence between direct products of block algebras. We prove that a p-permutation equivalence between direct products of blocks gives a bijection between the factors and induces a p-permutation equivalence between corresponding blocks.


title: Critical Allard regularity: pointwise tilt-excess estimates

abstract: The main results of this paper provide VMO-type estimates for the quadratic tilt-excess on varifolds with critical generalized mean curvature. These estimates apply to varifolds with "almost-integral" density which are close to a multiplicity one $m$-disc in a ball in the usual senses. The class of almost-integral varifolds allows for varifolds with non-perpendicular mean curvature. Moreover, the estimates hold \emph{uniformly for every point} in a relatively open set in $\text{spt}||V||$ and naturally imply a Reifenberg-type parametrization. The proof relies upon generalizing the $Q$-valued Lipschitz approximation and Sobolev-Poincar\'e estimates of arXiv:0808.3660 to almost-integral rectifiable varifolds.


title: Giant enhancement of higher-order harmonics of an optical-tweezer phonon laser

abstract: Phonon lasers, as mechanical analogues of optical lasers, are unique tools for not only fundamental studies of phononics but also diverse applications such as acoustic imaging and force sensing. Very recently, by levitating a micro-size sphere in an optical tweezer, higher-order mechanical harmonics were observed in the phonon-lasing regime, as the first step towards nonlinear levitated optomechanics [Nat. Phys. 19, 414 (2023)]. However, both the lasing strengths and the quality factors of the observed harmonics are typically very low, thus severely hindering their applications. Here we show that, by applying a simple but powerful electronic control to such a levitated micro-sphere, three orders of magnitude enhancement are achievable in the brightness of the phonon lasers, including both the fundamental mode and all its higher-order harmonics. Also, giant improvements of their linewidth and frequency stability are realized in such an electro-optomechanical system, together with further improved higher-order phonon coherence. These results, as a significant step forward for enhancing and controlling micro-object phonon lasers, can be readily used for a wide range of applications involving nonlinear phonon lasers, such as acoustic frequency comb, ultra-sound sensing, atmospherical monitoring, and even bio-medical diagnosis of levitated micro-size objects.