title: Segment Anything Model-guided Collaborative Learning Network for Scribble-supervised Polyp Segmentation

abstract: Polyp segmentation plays a vital role in accurately locating polyps at an early stage, which holds significant clinical importance for the prevention of colorectal cancer. Various polyp segmentation methods have been developed using fully-supervised deep learning techniques. However, pixel-wise annotation for polyp images by physicians during the diagnosis is both time-consuming and expensive. Moreover, visual foundation models such as the Segment Anything Model (SAM) have shown remarkable performance. Nevertheless, directly applying SAM to medical segmentation may not produce satisfactory results due to the inherent absence of medical knowledge. In this paper, we propose a novel SAM-guided Collaborative Learning Network (SAM-CLNet) for scribble-supervised polyp segmentation, enabling a collaborative learning process between our segmentation network and SAM to boost the model performance. Specifically, we first propose a Cross-level Enhancement and Aggregation Network (CEA-Net) for weakly-supervised polyp segmentation. Within CEA-Net, we propose a Cross-level Enhancement Module (CEM) that integrates the adjacent features to enhance the representation capabilities of different resolution features. Additionally, a Feature Aggregation Module (FAM) is employed to capture richer features across multiple levels. Moreover, we present a box-augmentation strategy that combines the segmentation maps generated by CEA-Net with scribble annotations to create more precise prompts. These prompts are then fed into SAM, generating segmentation SAM-guided masks, which can provide additional supervision to train CEA-Net effectively. Furthermore, we present an Image-level Filtering Mechanism to filter out unreliable SAM-guided masks. Extensive experimental results show that our SAM-CLNet outperforms state-of-the-art weakly-supervised segmentation methods.


title: Improving Normalization with the James-Stein Estimator

abstract: Stein's paradox holds considerable sway in high-dimensional statistics, highlighting that the sample mean, traditionally considered the de facto estimator, might not be the most efficacious in higher dimensions. To address this, the James-Stein estimator proposes an enhancement by steering the sample means toward a more centralized mean vector. In this paper, first, we establish that normalization layers in deep learning use inadmissible estimators for mean and variance. Next, we introduce a novel method to employ the James-Stein estimator to improve the estimation of mean and variance within normalization layers. We evaluate our method on different computer vision tasks: image classification, semantic segmentation, and 3D object classification. Through these evaluations, it is evident that our improved normalization layers consistently yield superior accuracy across all tasks without extra computational burden. Moreover, recognizing that a plethora of shrinkage estimators surpass the traditional estimator in performance, we study two other prominent shrinkage estimators: Ridge and LASSO. Additionally, we provide visual representations to intuitively demonstrate the impact of shrinkage on the estimated layer statistics. Finally, we study the effect of regularization and batch size on our modified batch normalization. The studies show that our method is less sensitive to batch size and regularization, improving accuracy under various setups.


title: A bilevel optimal motion planning (BOMP) model with application to autonomous parking

abstract: In this paper, we present a bilevel optimal motion planning (BOMP) model for autonomous parking. The BOMP model treats motion planning as an optimal control problem, in which the upper level is designed for vehicle nonlinear dynamics, and the lower level is for geometry collision-free constraints. The significant feature of the BOMP model is that the lower level is a linear programming problem that serves as a constraint for the upper-level problem. That is, an optimal control problem contains an embedded optimization problem as constraints. Traditional optimal control methods cannot solve the BOMP problem directly. Therefore, the modified approximate Karush-Kuhn-Tucker theory is applied to generate a general nonlinear optimal control problem. Then the pseudospectral optimal control method solves the converted problem. Particularly, the lower level is the $J_2$-function that acts as a distance function between convex polyhedron objects. Polyhedrons can approximate vehicles in higher precision than spheres or ellipsoids. Besides, the modified $J_2$-function (MJ) and the active-points based modified $J_2$-function (APMJ) are proposed to reduce the variables number and time complexity. As a result, an iteirative two-stage BOMP algorithm for autonomous parking concerning dynamical feasibility and collision-free property is proposed. The MJ function is used in the initial stage to find an initial collision-free approximate optimal trajectory and the active points, then the APMJ function in the final stage finds out the optimal trajectory. Simulation results and experiment on Turtlebot3 validate the BOMP model, and demonstrate that the computation speed increases almost two orders of magnitude compared with the area criterion based collision avoidance method.


title: Multiple Control Functionals for Interconnected Time-Delay Systems

abstract: Safety is essential for autonomous systems, in particular for interconnected systems in which the interactions among subsystems are involved. Motivated by the recent interest in cyber-physical and interconnected autonomous systems, we address the safe stabilization problem of interconnected systems with time delays. We propose multiple control Lyapunov and barrier functionals for the stabilization and safety control problems, respectively. In order to investigate the safe stabilization control problem, the proposed multiple control functionals are combined together via two methods: the optimization-based method and the sliding mode based method. The resulting controllers can be of either explicit or implicit forms, both of which ensure the safe stabilization objective of the whole system. The derived results are illustrated via a reach-avoid problem of multi-robot systems.


title: Improving Efficiency of DNN-based Relocalization Module for Autonomous Driving with Server-side Computing

abstract: In this work, we present a novel framework for camera relocation in autonomous vehicles, leveraging deep neural networks (DNN). While existing literature offers various DNN-based camera relocation methods, their deployment is hindered by their high computational demands during inference. In contrast, our approach addresses this challenge through edge cloud collaboration. Specifically, we strategically offload certain modules of the neural network to the server and evaluate the inference time of data frames under different network segmentation schemes to guide our offloading decisions. Our findings highlight the vital role of server-side offloading in DNN-based camera relocation for autonomous vehicles, and we also discuss the results of data fusion. Finally, we validate the effectiveness of our proposed framework through experimental evaluation.


title: New formula for the prepotentials associated with Hurwitz-Frobenius manifolds and generalized WDVV equations

abstract: We consider the Hurwitz spaces of ramified coverings of $\mathbb{P}^1$ with prescribed ramification profile over the point at infinity. By means of a particular symmetric bidifferential on a compact Riemann surface, we introduce quasi-homogeneous differentials. By following Dubrovin, we construct on Hurwitz spaces a family of Frobenius manifold structures associated with the quasi-homogeneous differentials. We explicitly derive new generating formulas for the corresponding prepotentials. This produces quasi-homogeneous solutions to the following generalized WDVV associativity equations: $F_i\eta^{-1}F_j=F_j\eta^{-1}F_i$, where the invertible constant matrix $\eta$ is a linear combination of the matrices $F_j$. In particular, our approach provides another look at Dubrovin's construction of semi-simple Hurwitz-Frobenius manifolds and establishes an alternative practical method to calculate their primary free energy functions. As applications, we use our formalism to obtain various explicit quasi-homogeneous solutions to the WDVV equations in genus zero and one and give a new proof of Ramanujan's differential equations for Eisenstein series.


title: Deflection of charged signals in a dipole magnetic field in Kerr background

abstract: This paper investigates charged particle deflection in a Kerr spacetime background with a dipole magnetic field, focusing on the equatorial plane and employing the weak field approximation. We employ the Jacobi-Randers metric to unify the treatment of the gravitational and electromagnetic effects on charged particles. Furthermore, we utilize the Gauss-Bonnet theorem to calculate the deflection angle through curvature integrals. The difference between the prograde and retrograde deflection angles is linked to the non-reversibility of metrics and geodesics in Finsler geometry, revealing that this difference can be considered a Finslerian effect. We analyze the impact of both gravitomagnetic field and dipole magnetic field on particle motion and deflection using the Jacobi-Randers magnetic field. The model considered in this paper exhibits interesting features in the second-order approximation of ($M/b$). When $q\mu=2MaE$, the Jacobi-Randers metric possesses reversible geodesics, leading to equal prograde and retrograde deflection angles. In this case, the gravitomagnetic field and dipole magnetic field cancel each other out, distinguishing it from scenarios involving only the gravitomagnetic field or the dipole magnetic field. We also explore the magnetic field's impact on gravitational lensing of charged particles.


title: The Magnetic Field Calibration of the Full-Disk Magnetograph onboard the Advanced Space based Solar Observatory (ASO-S/FMG)

abstract: The Full-disk magnetograph is a main scientific payload onboard the Advanced Space based Solar Observatory (ASO-S/FMG) that through Stokes parameter observation to measures the vector magnetic field. The accuracy of magnetic-field values is an important aspect of checking the quality of the FMG magnetic-field measurement. According to the design of the FMG, the linear calibration method under the weak-field approximation is the preferred scheme for magnetic-field calibration. However, the spacecraft orbital velocity can affect the position of observed spectral lines, then result in a change of the polarization-signal strength. Thus, the magnetic field is modulated by the orbit velocity of the spacecraft. In this article, through cross calibration between FMG and HMI (Helioseismic and Magnetic Imager onboard the Solar Dynamic Observatory), the effects of spacecraft orbital velocity on the coefficient of magnetic-field calibration are investigated. By comparing the magnetic field of FMG and HMI with spacecraft orbital velocity as an auxiliary reference, the revised linear-calibration coefficients that depend on spacecraft orbital velocity are obtained. Magnetic field of FMG corrected by the revised calibration coefficients removing the effect of spacecraft orbital velocity will be more accurate and suitable for scientific research.


title: On Multi-step Fuzzy Inference in Goedel Logic

abstract: This paper addresses the logical and computational foundations of multi-step fuzzy inference using the Mamdani-Assilian type of fuzzy rules by implementing such inference in Goedel logic with truth constants. We apply the results achieved in the development of a hyperresolution calculus for this logic. We pose three fundamental problems: reachability, stability, the existence of a k-cycle in multi-step fuzzy inference and reduce them to certain deduction and unsatisfiability problems. The corresponding unsatisfiability problems may be solved using hyperresolution.


title: Nucleon-Pion Spectroscopy from Sparsened Correlators

abstract: Neutrino oscillation experiments require accurate reconstructions of neutrino energies, which depend in part on a theoretical understanding of the axial $N \rightarrow \Delta$ transition form factors. Lattice QCD studies of this transition require construction of all hadronic states with energies up to the mass of the $\Delta$ resonance, which includes $N\pi$ and $N\pi\pi$ for physical quark mass values. Building interpolating operators from sparse grids of source and sink points is a versatile method of approximating all-to-all quark propagators that has been successfully used in other multi-hadron calculations. This work will discuss applications of this method to $N\pi$ and $N\pi\pi$ systems and present preliminary results.


title: Simple homotopy types of even dimensional manifolds

abstract: We study the difference between simple homotopy equivalence and homotopy equivalence for closed manifolds of dimension $n \geq$ 4. Given a closed $n$-manifold, we characterise the set of simple homotopy types of $n$-manifolds within its homotopy type in terms of algebraic $K$-theory, the surgery obstruction map, and the homotopy automorphisms of the manifold. We use this to construct the first examples, for all $n \ge$ 4 even, of closed $n$-manifolds that are homotopy equivalent but not simple homotopy equivalent. In fact, we construct infinite families with pairwise the same properties, and our examples can be taken to be smooth for $n \geq$ 6. We also show that, for $n \ge 4$ even, orientable examples with fundamental group $C_\infty \times C_m$ exist if and only if $m$=4,8,9,12,15,16,18 or $\ge$ 20. The proof involves analysing the obstructions which arise using integral representation theory and class numbers of cyclotomic fields. More generally, we consider the classification of the fundamental groups $G$ for which such examples exist. For $n \ge$ 12 even, we show that examples exist for any finitely presented $G$ such that the involution on the Whitehead group $\text{Wh}(G)$ is nontrivial. The key ingredient of the proof is a formula for the Whitehead torsion of a homotopy equivalence between doubles of thickenings.


title: Liouville theory and the Weil-Petersson geometry of moduli space: bordered, conic, and higher genus surfaces

abstract: Two-dimensional conformal field theory is a powerful tool to understand the geometry of surfaces. Here, we study Liouville conformal field theory in the classical (large central charge) limit, where it encodes the geometry of the moduli space of Riemann surfaces. Generalizing previous work, we employ this to study moduli spaces of higher genus surfaces, surfaces with boundaries, and surfaces with cone points. In each case, the knowledge of classical conformal blocks provides an extremely efficient approximation to the Weil-Petersson metric on moduli space. We find detailed agreement with analytic results for volumes and geodesic lengths on moduli space.


title: Machine Learning for Actionable Warning Identification: A Comprehensive Survey

abstract: Actionable Warning Identification (AWI) plays a crucial role in improving the usability of static code analyzers. With recent advances in Machine Learning (ML), various approaches have been proposed to incorporate ML techniques into AWI. These ML-based AWI approaches, benefiting from ML's strong ability to learn subtle and previously unseen patterns from historical data, have demonstrated superior performance. However, a comprehensive overview of these approaches is missing, which could hinder researchers/practitioners from understanding the current process and discovering potential for future improvement in the ML-based AWI community. In this paper, we systematically review the state-of-the-art ML-based AWI approaches. First, we employ a meticulous survey methodology and gather 50 primary studies from 2000/01/01 to 2023/09/01. Then, we outline the typical ML-based AWI workflow, including warning dataset preparation, preprocessing, AWI model construction, and evaluation stages. In such a workflow, we categorize ML-based AWI approaches based on the warning output format. Besides, we analyze the techniques used in each stage, along with their strengths, weaknesses, and distribution. Finally, we provide practical research directions for future ML-based AWI approaches, focusing on aspects like data improvement (e.g., enhancing the warning labeling strategy) and model exploration (e.g., exploring large language models for AWI).


title: Universal Energy Functionals for Trapped Fermi Gases in Low Dimensions

abstract: We study the system of trapped two-component Fermi gases with zero-range interaction in two dimensions (2D) or one dimension (1D). We calculate the one-particle density matrices of these systems at small displacements, from which we show that the $N$-body energies are linear functionals of the occupation probabilities of single-particle energy eigenstates. A universal energy functional was first derived in 2011 for trapped zero-range interacting two-component Fermi gases in three dimensions (3D). We also calculate the asymptotic behaviors of the occupation probabilities of single-particle energy eigenstates at high energies.


title: Agent-OM: Leveraging LLM Agents for Ontology Matching

abstract: Ontology matching (OM) enables semantic interoperability between different ontologies and resolves their conceptual heterogeneity by aligning related entities. OM systems currently have two prevailing design paradigms: conventional knowledge-based expert systems and newer machine learning-based predictive systems. While large language models (LLMs) and LLM agents have revolutionised data engineering and have been applied creatively in many domains, their potential for OM remains underexplored. This study introduces a novel agent-powered LLM-based design paradigm for OM systems. With consideration of several specific challenges in leveraging LLM agents for OM, we propose a generic framework, namely Agent-OM, consisting of two Siamese agents for retrieval and matching, with a set of simple prompt-based OM tools. Our framework is implemented in a proof-of-concept system. Evaluations of three Ontology Alignment Evaluation Initiative (OAEI) tracks over state-of-the-art OM systems show that our system can achieve results very close to the long-standing best performance on simple OM tasks and can significantly improve the performance on complex and few-shot OM tasks.


title: A Framework for Solving Parabolic Partial Differential Equations on Discrete Domains

abstract: We introduce a framework for solving a class of parabolic partial differential equations on triangle mesh surfaces, including the Hamilton-Jacobi equation and the Fokker-Planck equation. PDE in this class often have nonlinear or stiff terms that cannot be resolved with standard methods on curved triangle meshes. To address this challenge, we leverage a splitting integrator combined with a convex optimization step to solve these PDE. Our machinery can be used to compute entropic approximation of optimal transport distances on geometric domains, overcoming the numerical limitations of the state-of-the-art method. In addition, we demonstrate the versatility of our method on a number of linear and nonlinear PDE that appear in diffusion and front propagation tasks in geometry processing.


title: On Novel Fixed-Point-Type Iterations with Structure-Preserving Doubling Algorithms for Stochastic Continuous-time Algebraic Riccati equations

abstract: In this paper we mainly propose efficient and reliable numerical algorithms for solving stochastic continuous-time algebraic Riccati equations (SCARE) typically arising from the differential statedependent Riccati equation technique from the 3D missile/target engagement, the F16 aircraft flight control and the quadrotor optimal control etc. To this end, we develop a fixed point (FP)-type iteration with solving a CARE by the structure-preserving doubling algorithm (SDA) at each iterative step, called FP-CARE SDA. We prove that either the FP-CARE SDA is monotonically nondecreasing or nonincreasing, and is R-linearly convergent, with the zero initial matrix or a special initial matrix satisfying some assumptions. The FP-CARE SDA (FPC) algorithm can be regarded as a robust initial step to produce a good initial matrix, and then the modified Newton (mNT) method can be used by solving the corresponding Lyapunov equation with SDA (FPC-mNT-Lyap SDA). Numerical experiments show that the FPC-mNT-Lyap SDA algorithm outperforms the other existing algorithms.


title: Neutron Star in Quantized-space-time

abstract: We construct and analyze a model of the neutron star in the k deformed space-time. This is done by first deriving the k deformed generalization of the Einstein tensor, starting from the non-commutative generalization of the metric tensor. By generalizing the energy momentum tensor to the non-commutative space-time and exploiting the k deformed dispersion relation, we then set up Einstein's field equations in the kdeformed space time. As we adopt a realization of the non commutative coordinates in terms of the commutative coordinates and their derivatives, our model is constructed in terms of commutative variables. Using this, we derive the kdeformed generalization of the Tolman Oppenheimer Volkoff equation. Now, by treating the interior of the star to be a perfect fluid as in the commutative space-time, we investigate the modification of the neutron star's mass due to non commutativity of the space time, valid up to first order in the deformation parameter. We show that the non-commutativity of the space time enhances the mass limit of the neutron star. We show that the radius and maximum mass of the neutron star depend on the deformation parameter. Further, our study shows that the mass increases as the radius increases for fixed values of the deformation parameter. We show that maximum mass and radius increase as the deformation parameter increases. We find that the mass varies from 0.26Ms to 3.68Ms as radius changes from 8.45km to 18.66km. Using the recent observational limits on the upper bound of the mass of a neutron star, we find the deformation parameter is approximately $10^{-44}m$. We also show that the compactness and surface redshift of the neutron star increase with its mass.


title: StyleCrafter: Enhancing Stylized Text-to-Video Generation with Style Adapter

abstract: Text-to-video (T2V) models have shown remarkable capabilities in generating diverse videos. However, they struggle to produce user-desired stylized videos due to (i) text's inherent clumsiness in expressing specific styles and (ii) the generally degraded style fidelity. To address these challenges, we introduce StyleCrafter, a generic method that enhances pre-trained T2V models with a style control adapter, enabling video generation in any style by providing a reference image. Considering the scarcity of stylized video datasets, we propose to first train a style control adapter using style-rich image datasets, then transfer the learned stylization ability to video generation through a tailor-made finetuning paradigm. To promote content-style disentanglement, we remove style descriptions from the text prompt and extract style information solely from the reference image using a decoupling learning strategy. Additionally, we design a scale-adaptive fusion module to balance the influences of text-based content features and image-based style features, which helps generalization across various text and style combinations. StyleCrafter efficiently generates high-quality stylized videos that align with the content of the texts and resemble the style of the reference images. Experiments demonstrate that our approach is more flexible and efficient than existing competitors.


title: Effects of domain walls and chiral supercurrent in quantum anomalous Hall Josephson junctions

abstract: The intriguing interplay between topology and superconductivity has attracted significant attention, given its potential for realizing topological superconductivity. In this study, we investigate the transport properties of the chiral Josephson effect in the quantum anomalous Hall insulators (QAHIs)-based junction. We reveal a systematic crossover from edge-state to bulk-state dominant supercurrents, with a notable $0-\pi$ transition observed under non-zero magnetic flux through chemical potential adjustments. This transition underscores the competition between bulk and chiral edge transport. Furthermore, we identify an evolution among three distinct quantum interference patterns: from a $2\Phi_0$-periodic oscillation pattern, to a $\Phi_0$-periodic oscillation pattern, and then to an asymmetric Fraunhofer pattern ($\Phi_0 = h/2e$ is the flux quantum, $h$ the Planck constant, and $e$ the electron charge). Subsequently, we examine the influence of domains on quantum interference patterns. Intriguingly, a distinctive Fraunhofer-like pattern emerges due to coexistence of chiral edge states and domain wall states, even when the chemical potential is within gap. These results not only advance the theoretical understanding but also pave the way for the experimental discovery of the chiral Josephson effect based on QAHI doped with magnetic impurities.


title: Matching Weak Informative Ontologies

abstract: Most existing ontology matching methods utilize the literal information to discover alignments. However, some literal information in ontologies may be opaque and some ontologies may not have sufficient literal information. In this paper, these ontologies are named as weak informative ontologies (WIOs) and it is challenging for existing methods to matching WIOs. On one hand, string-based and linguistic-based matching methods cannot work well for WIOs. On the other hand, some matching methods use external resources to improve their performance, but collecting and processing external resources is still time-consuming. To address this issue, this paper proposes a practical method for matching WIOs by employing the ontology structure information to discover alignments. First, the semantic subgraphs are extracted from the ontology graph to capture the precise meanings of ontology elements. Then, a new similarity propagation model is designed for matching WIOs. Meanwhile, in order to avoid meaningless propagation, the similarity propagation is constrained by semantic subgraphs and other conditions. Consequently, the similarity propagation model ensures a balance between efficiency and quality during matching. Finally, the similarity propagation model uses a few credible alignments as seeds to find more alignments, and some useful strategies are adopted to improve the performance. This matching method for WIOs has been implemented in the ontology matching system Lily. Experimental results on public OAEI benchmark datasets demonstrate that Lily significantly outperforms most of the state-of-the-art works in both WIO matching tasks and general ontology matching tasks. In particular, Lily increases the recall by a large margin, while it still obtains high precision of matching results.


title: Green Edge AI: A Contemporary Survey

abstract: Artificial intelligence (AI) technologies have emerged as pivotal enablers across a multitude of industries, including consumer electronics, healthcare, and manufacturing, largely due to their resurgence over the past decade. The transformative power of AI is primarily derived from the utilization of deep neural networks (DNNs), which require extensive data for training and substantial computational resources for processing. Consequently, DNN models are typically trained and deployed on resource-rich cloud servers. However, due to potential latency issues associated with cloud communications, deep learning (DL) workflows are increasingly being transitioned to wireless edge networks near end-user devices (EUDs). This shift is designed to support latency-sensitive applications and has given rise to a new paradigm of edge AI, which will play a critical role in upcoming 6G networks to support ubiquitous AI applications. Despite its potential, edge AI faces substantial challenges, mostly due to the dichotomy between the resource limitations of wireless edge networks and the resource-intensive nature of DL. Specifically, the acquisition of large-scale data, as well as the training and inference processes of DNNs, can rapidly deplete the battery energy of EUDs. This necessitates an energy-conscious approach to edge AI to ensure both optimal and sustainable performance. In this paper, we present a contemporary survey on green edge AI. We commence by analyzing the principal energy consumption components of edge AI systems to identify the fundamental design principles of green edge AI. Guided by these principles, we then explore energy-efficient design methodologies for the three critical tasks in edge AI systems, including training data acquisition, edge training, and edge inference. Finally, we underscore potential future research directions to further enhance the energy efficiency of edge AI.


title: UAV-Aided Lifelong Learning for AoI and Energy Optimization in Non-Stationary IoT Networks

abstract: In this paper, a novel joint energy and age of information (AoI) optimization framework for IoT devices in a non-stationary environment is presented. In particular, IoT devices that are distributed in the real-world are required to efficiently utilize their computing resources so as to balance the freshness of their data and their energy consumption. To optimize the performance of IoT devices in such a dynamic setting, a novel lifelong reinforcement learning (RL) solution that enables IoT devices to continuously adapt their policies to each newly encountered environment is proposed. Given that IoT devices have limited energy and computing resources, an unmanned aerial vehicle (UAV) is leveraged to visit the IoT devices and update the policy of each device sequentially. As such, the UAV is exploited as a mobile learning agent that can learn a shared knowledge base with a feature base in its training phase, and feature sets of a zero-shot learning method in its testing phase, to generalize between the environments. To optimize the trajectory and flying velocity of the UAV, an actor-critic network is leveraged so as to minimize the UAV energy consumption. Simulation results show that the proposed lifelong RL solution can outperform the state-of-art benchmarks by enhancing the balanced cost of IoT devices by $8.3\%$ when incorporating warm-start policies for unseen environments. In addition, our solution achieves up to $49.38\%$ reduction in terms of energy consumption by the UAV in comparison to the random flying strategy.


title: Learning Anatomically Consistent Embedding for Chest Radiography

abstract: Self-supervised learning (SSL) approaches have recently shown substantial success in learning visual representations from unannotated images. Compared with photographic images, medical images acquired with the same imaging protocol exhibit high consistency in anatomy. To exploit this anatomical consistency, this paper introduces a novel SSL approach, called PEAC (patch embedding of anatomical consistency), for medical image analysis. Specifically, in this paper, we propose to learn global and local consistencies via stable grid-based matching, transfer pre-trained PEAC models to diverse downstream tasks, and extensively demonstrate that (1) PEAC achieves significantly better performance than the existing state-of-the-art fully/self-supervised methods, and (2) PEAC captures the anatomical structure consistency across views of the same patient and across patients of different genders, weights, and healthy statuses, which enhances the interpretability of our method for medical image analysis.


title: Hypergraph Node Representation Learning with One-Stage Message Passing

abstract: Hypergraphs as an expressive and general structure have attracted considerable attention from various research domains. Most existing hypergraph node representation learning techniques are based on graph neural networks, and thus adopt the two-stage message passing paradigm (i.e. node -> hyperedge -> node). This paradigm only focuses on local information propagation and does not effectively take into account global information, resulting in less optimal representations. Our theoretical analysis of representative two-stage message passing methods shows that, mathematically, they model different ways of local message passing through hyperedges, and can be unified into one-stage message passing (i.e. node -> node). However, they still only model local information. Motivated by this theoretical analysis, we propose a novel one-stage message passing paradigm to model both global and local information propagation for hypergraphs. We integrate this paradigm into HGraphormer, a Transformer-based framework for hypergraph node representation learning. HGraphormer injects the hypergraph structure information (local information) into Transformers (global information) by combining the attention matrix and hypergraph Laplacian. Extensive experiments demonstrate that HGraphormer outperforms recent hypergraph learning methods on five representative benchmark datasets on the semi-supervised hypernode classification task, setting new state-of-the-art performance, with accuracy improvements between 2.52% and 6.70%. Our code and datasets are available.


title: Dynamic Matrix of Extremisms and Terrorism (DMET): A Continuum Approach Towards Identifying Different Degrees of Extremisms

abstract: We propose to extend the current binary understanding of terrorism (versus non-terrorism) with a Dynamic Matrix of Extremisms and Terrorism (DMET). DMET considers the whole ecosystem of content and actors that can contribute to a continuum of extremism (e.g., right-wing, left-wing, religious, separatist, single-issue). It organizes levels of extremisms by varying degrees of ideological engagement and the presence of violence identified (e.g., partisan, fringe, violent extremism, terrorism) based on cognitive and behavioral cues and group dynamics. DMET is globally applicable due to its comprehensive conceptualization of the levels of extremisms. It is also dynamic, enabling iterative mapping with the region- and time-specific classifications of extremist actors. Once global actors recognize DMET types and their distinct characteristics, they can comprehensively analyze the profiles of extremist actors (e.g., individuals, groups, movements), track these respective actors and their activities (e.g., social media content) over time, and launch targeted counter activities (e.g. de-platforming, content moderation, or redirects to targeted CVE narratives).


title: Merger rate of supermassive primordial black hole binaries

abstract: The probability that the primordial black hole (PBH) binaries formed in the early Universe can be affected by the Hubble expansion of background, which is non-negligible when the number density of PBHs is very low (it is actually this case for supermassive PBHs). In this paper, taking into account the effect of cosmic expansion on the comoving distance of PBH pairs, we worked out the merger rate of PBHs with any extended mass function. The torques by all PBHs and linear density perturbations are also considered. It is found that the merger rate of PBH, $M\gtrsim 10^6M_\odot$, binaries is significantly lower for $f_\text{pbh}\lesssim 0.01$ than expected.


title: Propagation of chaos in path spaces via information theory

abstract: We study the mean-field limit of the stochastic interacting particle systems via tools from information theory. The key in our method is that, after applying the data processing inequality, one only needs to handle independent copies of solutions to the mean-field McKean stochastic differential equations, which then allows one to apply the law of large numbers. Our result on the propagation of chaos in path space is valid for both first and second order interacting particle systems; in particular, for the latter one our convergence rate is independent of the particle mass and also only linear in time. Our framework is different from current approaches in literature and could provide new insight for the study of interacting particle systems.


title: Anisotropic magnetoresistance in single cubic crystals: A theory and its verification

abstract: A theory of anisotropic magnetoresistance (AMR) and planar Hall effect (PHE) in single cubic crystals and its experimental verifications are presented for the current in the (001) plane. In contrast to the general belief that AMR and PHE in single crystals are highly sensitive to many internal and external effects and have no universal features, the theory predicts universal angular dependencies of longitudinal and transverse resistivity and various characteristics when magnetization rotates in the (001) plane, the plane perpendicular to the current, and the plane containing the current and [001] direction. The universal angular dependencies are verified by the experiments on Fe30Co70 single cubic crystal film. The findings provide new avenues for fundamental research and applications of AMR and PHE, because single crystals offer advantages over polycrystalline materials for band structure and crystallographic orientation engineering.


title: Convolution algebras of double groupoids and strict 2-groups

abstract: Double groupoids are a type of higher groupoid structure that can arise when one has two distinct groupoid products on the same set of arrows. A particularly important example of such structures is the irrational torus and, more generally, strict 2-groups. Groupoid structures give rise to convolution operations on the space of arrows. Therefore, a double groupoid comes equipped with two product operations on the space of functions. In this article we investigate in what sense these two convolution operations are compatible. We use the representation theory of compact Lie groups to get insight into a certain class of 2-groups.


title: Efficient Off-Policy Safe Reinforcement Learning Using Trust Region Conditional Value at Risk

abstract: This paper aims to solve a safe reinforcement learning (RL) problem with risk measure-based constraints. As risk measures, such as conditional value at risk (CVaR), focus on the tail distribution of cost signals, constraining risk measures can effectively prevent a failure in the worst case. An on-policy safe RL method, called TRC, deals with a CVaR-constrained RL problem using a trust region method and can generate policies with almost zero constraint violations with high returns. However, to achieve outstanding performance in complex environments and satisfy safety constraints quickly, RL methods are required to be sample efficient. To this end, we propose an off-policy safe RL method with CVaR constraints, called off-policy TRC. If off-policy data from replay buffers is directly used to train TRC, the estimation error caused by the distributional shift results in performance degradation. To resolve this issue, we propose novel surrogate functions, in which the effect of the distributional shift can be reduced, and introduce an adaptive trust-region constraint to ensure a policy not to deviate far from replay buffers. The proposed method has been evaluated in simulation and real-world environments and satisfied safety constraints within a few steps while achieving high returns even in complex robotic tasks.


title: OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baseline

abstract: Stereo matching aims to estimate the disparity between matching pixels in a stereo image pair, which is important to robotics, autonomous driving, and other computer vision tasks. Despite the development of numerous impressive methods in recent years, determining the most suitable architecture for practical application remains challenging. Addressing this gap, our paper introduces a comprehensive benchmark focusing on practical applicability rather than solely on individual models for optimized performance. Specifically, we develop a flexible and efficient stereo matching codebase, called OpenStereo. OpenStereo includes training and inference codes of more than 10 network models, making it, to our knowledge, the most complete stereo matching toolbox available. Based on OpenStereo, we conducted experiments and have achieved or surpassed the performance metrics reported in the original paper. Additionally, we conduct an exhaustive analysis and deconstruction of recent developments in stereo matching through comprehensive ablative experiments. These investigations inspired the creation of StereoBase, a strong baseline model. Our StereoBase ranks 1st on SceneFlow, KITTI 2015, 2012 (Reflective) among published methods and achieves the best performance across all metrics. In addition, StereoBase has strong cross-dataset generalization. Code is available at \url{https://github.com/XiandaGuo/OpenStereo}.


title: TRC: Trust Region Conditional Value at Risk for Safe Reinforcement Learning

abstract: As safety is of paramount importance in robotics, reinforcement learning that reflects safety, called safe RL, has been studied extensively. In safe RL, we aim to find a policy which maximizes the desired return while satisfying the defined safety constraints. There are various types of constraints, among which constraints on conditional value at risk (CVaR) effectively lower the probability of failures caused by high costs since CVaR is a conditional expectation obtained above a certain percentile. In this paper, we propose a trust region-based safe RL method with CVaR constraints, called TRC. We first derive the upper bound on CVaR and then approximate the upper bound in a differentiable form in a trust region. Using this approximation, a subproblem to get policy gradients is formulated, and policies are trained by iteratively solving the subproblem. TRC is evaluated through safe navigation tasks in simulations with various robots and a sim-to-real environment with a Jackal robot from Clearpath. Compared to other safe RL methods, the performance is improved by 1.93 times while the constraints are satisfied in all experiments.


title: IEEE 802.11be Network Throughput Optimization with Multi-Link Operation and AP Coordination

abstract: IEEE 802.11be (Wi-Fi 7) introduces a new concept called multi-link operation (MLO), which allows multiple Wi-Fi interfaces in different bands (2.4, 5, and 6 GHz) to work together to increase network throughput, reduce latency, and improve spectrum reuse efficiency in dense overlapping networks. To make the most of MLO, this paper proposes a new data-driven resource allocation algorithm for the 11be network with the aid of an access point (AP) controller. To maximize network throughput, a network topology optimization problem is formulated for 11be network, which is solved by exploiting the totally unimodular property of the bipartite graph formed by the connection between AP and station (STA) in Wi-Fi networks. Subsequently, a proportional fairness algorithm is applied for radio link allocation, network throughput optimization considering the channel condition, and the fairness of the multi-link device (MLD) data rate. The performance of the proposed algorithm on two main MLO implementations - multi-link multi-radio (MLMR) with simultaneous transmission and reception (STR), and the interplay between multiple nodes employing them are evaluated through cross-layer (PHY-MAC) data rate simulation with PHY abstraction.


title: Supervised Factor Modeling for High-Dimensional Linear Time Series

abstract: Motivated by Tucker tensor decomposition, this paper imposes low-rank structures to the column and row spaces of coefficient matrices in a multivariate infinite-order vector autoregression (VAR), which leads to a supervised factor model with two factor modelings being conducted to responses and predictors simultaneously. Interestingly, the stationarity condition implies an intrinsic weak group sparsity mechanism of infinite-order VAR, and hence a rank-constrained group Lasso estimation is considered for high-dimensional linear time series. Its non-asymptotic properties are discussed thoughtfully by balancing the estimation, approximation and truncation errors. Moreover, an alternating gradient descent algorithm with thresholding is designed to search for high-dimensional estimates, and its theoretical justifications, including statistical and convergence analysis, are also provided. Theoretical and computational properties of the proposed methodology are verified by simulation experiments, and the advantages over existing methods are demonstrated by two real examples.


title: RTQ: Rethinking Video-language Understanding Based on Image-text Model

abstract: Recent advancements in video-language understanding have been established on the foundation of image-text models, resulting in promising outcomes due to the shared knowledge between images and videos. However, video-language understanding presents unique challenges due to the inclusion of highly complex semantic details, which result in information redundancy, temporal dependency, and scene complexity. Current techniques have only partially tackled these issues, and our quantitative analysis indicates that some of these methods are complementary. In light of this, we propose a novel framework called RTQ (Refine, Temporal model, and Query), which addresses these challenges simultaneously. The approach involves refining redundant information within frames, modeling temporal relations among frames, and querying task-specific information from the videos. Remarkably, our model demonstrates outstanding performance even in the absence of video-language pre-training, and the results are comparable with or superior to those achieved by state-of-the-art pre-training methods. Code is available at https://github.com/SCZwangxiao/RTQ-MM2023.


title: Student Activity Recognition in Classroom Environments using Transfer Learning

abstract: The recent advances in artificial intelligence and deep learning facilitate automation in various applications including home automation, smart surveillance systems, and healthcare among others. Human Activity Recognition is one of its emerging applications, which can be implemented in a classroom environment to enhance safety, efficiency, and overall educational quality. This paper proposes a system for detecting and recognizing the activities of students in a classroom environment. The dataset has been structured and recorded by the authors since a standard dataset for this task was not available at the time of this study. Transfer learning, a widely adopted method within the field of deep learning, has proven to be helpful in complex tasks like image and video processing. Pretrained models including VGG-16, ResNet-50, InceptionV3, and Xception are used for feature extraction and classification tasks. Xception achieved an accuracy of 93%, on the novel classroom dataset, outperforming the other three models in consideration. The system proposed in this study aims to introduce a safer and more productive learning environment for students and educators.


title: The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP

abstract: I propose a paradigm for scientific progress in NLP centered around developing scalable, data-driven theories of linguistic structure. The idea is to collect data in tightly scoped, carefully defined ways which allow for exhaustive annotation of behavioral phenomena of interest, and then use machine learning to construct explanatory theories of these phenomena which can form building blocks for intelligible AI systems. After laying some conceptual groundwork, I describe several investigations into data-driven theories of shallow semantic structure using Question-Answer driven Semantic Role Labeling (QA-SRL), a schema for annotating verbal predicate-argument relations using highly constrained question-answer pairs. While this only scratches the surface of the complex language behaviors of interest in AI, I outline principles for data collection and theoretical modeling which can inform future scientific progress. This note summarizes and draws heavily on my PhD thesis.


title: The colored Jones polynomial of the figure-eight knot and an $\operatorname{SL}(2;\mathbb{R})$-representation

abstract: We study the asymptotic behavior of the $N$-dimensional colored Jones polynomial of the figure-eight knot, evaluated at $\exp\bigl((u+2p\pi\sqrt{-1})/N\bigr)$ as $N$ tends to infinity, where $u>\operatorname{arccosh}(3/2)$ is a real number and $p\ge1$ is an integer. It turns out that it corresponds to an $\operatorname{SL}(2;\mathbb{R})$ representation of the fundamental group of the knot complement. Moreover, it defines the adjoint Reidemeister torsion and the Chern--Simons invariant associated with the representation.


title: Manipulating the Label Space for In-Context Classification

abstract: After pre-training by generating the next word conditional on previous words, the Language Model (LM) acquires the ability of In-Context Learning (ICL) that can learn a new task conditional on the context of the given in-context examples (ICEs). Similarly, visually-conditioned Language Modelling is also used to train Vision-Language Models (VLMs) with ICL ability. However, such VLMs typically exhibit weaker classification abilities compared to contrastive learning-based models like CLIP, since the Language Modelling objective does not directly contrast whether an object is paired with a text. To improve the ICL of classification, using more ICEs to provide more knowledge is a straightforward way. However, this may largely increase the selection time, and more importantly, the inclusion of additional in-context images tends to extend the length of the in-context sequence beyond the processing capacity of a VLM. To alleviate these limitations, we propose to manipulate the label space of each ICE to increase its knowledge density, allowing for fewer ICEs to convey as much information as a larger set would. Specifically, we propose two strategies which are Label Distribution Enhancement and Visual Descriptions Enhancement to improve In-context classification performance on diverse datasets, including the classic ImageNet and more fine-grained datasets like CUB-200. Specifically, using our approach on ImageNet, we increase accuracy from 74.70\% in a 4-shot setting to 76.21\% with just 2 shots. surpassing CLIP by 0.67\%. On CUB-200, our method raises 1-shot accuracy from 48.86\% to 69.05\%, 12.15\% higher than CLIP. The code is given in https://anonymous.4open.science/r/MLS_ICC.


title: Quantum Kernel t-Distributed Stochastic Neighbor Embedding

abstract: Data visualization is important in understanding the characteristics of data that are difficult to see directly. It is used to visualize loss landscapes and optimization trajectories to analyze optimization performance. Popular optimization analysis is performed by visualizing a loss landscape around the reached local or global minimum using principal component analysis. However, this visualization depends on the variational parameters of a quantum circuit rather than quantum states, which makes it difficult to understand the mechanism of optimization process through the property of quantum states. Here, we propose a quantum data visualization method using quantum kernels, which enables us to offer fast and highly accurate visualization of quantum states. In our numerical experiments, we visualize hand-written digits dataset and apply $k$-nearest neighbor algorithm to the low-dimensional data to quantitatively evaluate our proposed method compared with a classical kernel method. As a result, our proposed method achieves comparable accuracy to the state-of-the-art classical kernel method, meaning that the proposed visualization method based on quantum machine learning does not degrade the separability of the input higher dimensional data. Furthermore, we visualize the optimization trajectories of finding the ground states of transverse field Ising model and successfully find the trajectory characteristics. Since quantum states are higher dimensional objects that can only be seen via observables, our visualization method, which inherits the similarity of quantum data, would be useful in understanding the behavior of quantum circuits and algorithms.


title: On Exploring the Reasoning Capability of Large Language Models with Knowledge Graphs

abstract: This paper examines the capacity of LLMs to reason with knowledge graphs using their internal knowledge graph, i.e., the knowledge graph they learned during pre-training. Two research questions are formulated to investigate the accuracy of LLMs in recalling information from pre-training knowledge graphs and their ability to infer knowledge graph relations from context. To address these questions, we employ LLMs to perform four distinct knowledge graph reasoning tasks. Furthermore, we identify two types of hallucinations that may occur during knowledge reasoning with LLMs: content and ontology hallucination. Our experimental results demonstrate that LLMs can successfully tackle both simple and complex knowledge graph reasoning tasks from their own memory, as well as infer from input context.


title: Thermodynamic bounds on the asymmetry of cross-correlations with dynamical activity and entropy production

abstract: Entropy production and dynamical activity are two complementary aspects in nonequilibrium physics. The asymmetry of cross-correlation, serving as a distinctive feature of nonequilibrium, also finds widespread utility. In this Letter, we establish two thermodynamic bounds on the normalized asymmetry of cross-correlation in terms of dynamical activity and entropy production rate. These bounds demonstrate broad applicability, and offer experimental testability.


title: Growth Diagrams for Schubert RSK

abstract: Motivated by classical combinatorial Schubert calculus on the Grassmannian, Huang--Pylyavskyy introduced a generalized theory of Robinson-Schensted-Knuth (RSK) correspondence for studying Schubert calculus on the complete flag variety via insertion algorithms. The inputs of the correspondence are certain biwords, the insertion objects are bumpless pipe dreams, and the recording objects are certain chains in Bruhat order. In particular, they defined plactic biwords and showed that classical Knuth relations can be generalized to plactic biwords. In this paper, we give an analogue of Fomin's growth diagrams for this generalized RSK correspondence on plactic biwords. We show that this growth diagram recovers the bijection between pipe dreams and bumpless pipe dreams of Gao--Huang.


title: Transfer learning for predicting source terms of principal component transport in chemically reactive flow

abstract: The objective of this study is to evaluate whether the number of requisite training samples can be reduced with the use of various transfer learning models for predicting, for example, the chemical source terms of the data-driven reduced-order model that represents the homogeneous ignition process of a hydrogen/air mixture. Principal component analysis is applied to reduce the dimensionality of the hydrogen/air mixture in composition space. Artificial neural networks (ANNs) are used to tabulate the reaction rates of principal components, and subsequently, a system of ordinary differential equations is solved. As the number of training samples decreases at the target task (i.e.,for T0 > 1000 K and various phi), the reduced-order model fails to predict the ignition evolution of a hydrogen/air mixture. Three transfer learning strategies are then applied to the training of the ANN model with a sparse dataset. The performance of the reduced-order model with a sparse dataset is found to be remarkably enhanced if the training of the ANN model is restricted by a regularization term that controls the degree of knowledge transfer from source to target tasks. To this end, a novel transfer learning method is introduced, parameter control via partial initialization and regularization (PaPIR), whereby the amount of knowledge transferred is systemically adjusted for the initialization and regularization of the ANN model in the target task. It is found that an additional performance gain can be achieved by changing the initialization scheme of the ANN model in the target task when the task similarity between source and target tasks is relatively low.


title: A Generalizable Deep Learning System for Cardiac MRI

abstract: Cardiac MRI allows for a comprehensive assessment of myocardial structure, function, and tissue characteristics. Here we describe a foundational vision system for cardiac MRI, capable of representing the breadth of human cardiovascular disease and health. Our deep learning model is trained via self-supervised contrastive learning, by which visual concepts in cine-sequence cardiac MRI scans are learned from the raw text of the accompanying radiology reports. We train and evaluate our model on data from four large academic clinical institutions in the United States. We additionally showcase the performance of our models on the UK BioBank, and two additional publicly available external datasets. We explore emergent zero-shot capabilities of our system, and demonstrate remarkable performance across a range of tasks; including the problem of left ventricular ejection fraction regression, and the diagnosis of 35 different conditions such as cardiac amyloidosis and hypertrophic cardiomyopathy. We show that our deep learning system is capable of not only understanding the staggering complexity of human cardiovascular disease, but can be directed towards clinical problems of interest yielding impressive, clinical grade diagnostic accuracy with a fraction of the training data typically required for such tasks.


title: Impact of Data Augmentation on QCNNs

abstract: In recent years, Classical Convolutional Neural Networks (CNNs) have been applied for image recognition successfully. Quantum Convolutional Neural Networks (QCNNs) are proposed as a novel generalization to CNNs by using quantum mechanisms. The quantum mechanisms lead to an efficient training process in QCNNs by reducing the size of input from $N$ to $log_2N$. This paper implements and compares both CNNs and QCNNs by testing losses and prediction accuracy on three commonly used datasets. The datasets include the MNIST hand-written digits, Fashion MNIST and cat/dog face images. Additionally, data augmentation (DA), a technique commonly used in CNNs to improve the performance of classification by generating similar images based on original inputs, is also implemented in QCNNs. Surprisingly, the results showed that data augmentation didn't improve QCNNs performance. The reasons and logic behind this result are discussed, hoping to expand our understanding of Quantum machine learning theory.


title: Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training

abstract: Regularization in modern machine learning is crucial, and it can take various forms in algorithmic design: training set, model family, error function, regularization terms, and optimizations. In particular, the learning rate, which can be interpreted as a temperature-like parameter within the statistical mechanics of learning, plays a crucial role in neural network training. Indeed, many widely adopted training strategies basically just define the decay of the learning rate over time. This process can be interpreted as decreasing a temperature, using either a global learning rate (for the entire model) or a learning rate that varies for each parameter. This paper proposes TempBalance, a straightforward yet effective layer-wise learning rate method. TempBalance is based on Heavy-Tailed Self-Regularization (HT-SR) Theory, an approach which characterizes the implicit self-regularization of different layers in trained models. We demonstrate the efficacy of using HT-SR-motivated metrics to guide the scheduling and balancing of temperature across all network layers during model training, resulting in improved performance during testing. We implement TempBalance on CIFAR10, CIFAR100, SVHN, and TinyImageNet datasets using ResNets, VGGs, and WideResNets with various depths and widths. Our results show that TempBalance significantly outperforms ordinary SGD and carefully-tuned spectral norm regularization. We also show that TempBalance outperforms a number of state-of-the-art optimizers and learning rate schedulers.


title: Efficient Multimodal Semantic Segmentation via Dual-Prompt Learning

abstract: Multimodal (e.g., RGB-Depth/RGB-Thermal) fusion has shown great potential for improving semantic segmentation in complex scenes (e.g., indoor/low-light conditions). Existing approaches often fully fine-tune a dual-branch encoder-decoder framework with a complicated feature fusion strategy for achieving multimodal semantic segmentation, which is training-costly due to the massive parameter updates in feature extraction and fusion. To address this issue, we propose a surprisingly simple yet effective dual-prompt learning network (dubbed DPLNet) for training-efficient multimodal (e.g., RGB-D/T) semantic segmentation. The core of DPLNet is to directly adapt a frozen pre-trained RGB model to multimodal semantic segmentation, reducing parameter updates. For this purpose, we present two prompt learning modules, comprising multimodal prompt generator (MPG) and multimodal feature adapter (MFA). MPG works to fuse the features from different modalities in a compact manner and is inserted from shadow to deep stages to generate the multi-level multimodal prompts that are injected into the frozen backbone, while MPG adapts prompted multimodal features in the frozen backbone for better multimodal semantic segmentation. Since both the MPG and MFA are lightweight, only a few trainable parameters (3.88M, 4.4% of the pre-trained backbone parameters) are introduced for multimodal feature fusion and learning. Using a simple decoder (3.27M parameters), DPLNet achieves new state-of-the-art performance or is on a par with other complex approaches on four RGB-D/T semantic segmentation datasets while satisfying parameter efficiency. Moreover, we show that DPLNet is general and applicable to other multimodal tasks such as salient object detection and video semantic segmentation. Without special design, DPLNet outperforms many complicated models. Our code will be available at github.com/ShaohuaDong2021/DPLNet.


title: Matrix representations of linear transformations on bicomplex space

abstract: An algebraic investigation on bicomplex numbers is carried out here. Particularly matrices and linear maps defined on them are discussed. A new kind of cartesian product, referred to as an idempotent product, is introduced and studied. The elements of this space are linear maps of a special form. These linear maps are examined with respect to usual notions like kernel, range, and singularity. Their matrix representation is also discussed.


title: Dancing with Still Images: Video Distillation via Static-Dynamic Disentanglement

abstract: Recently, dataset distillation has paved the way towards efficient machine learning, especially for image datasets. However, the distillation for videos, characterized by an exclusive temporal dimension, remains an underexplored domain. In this work, we provide the first systematic study of video distillation and introduce a taxonomy to categorize temporal compression. Our investigation reveals that the temporal information is usually not well learned during distillation, and the temporal dimension of synthetic data contributes little. The observations motivate our unified framework of disentangling the dynamic and static information in the videos. It first distills the videos into still images as static memory and then compensates the dynamic and motion information with a learnable dynamic memory block. Our method achieves state-of-the-art on video datasets at different scales, with a notably smaller memory storage budget. Our code is available at https://github.com/yuz1wan/video_distillation.


title: Searching for discrete series representations at the late-time boundary of de Sitter

abstract: The group $SO(d+1,1)$ makes an appearance both as the conformal group of Euclidean space in $d$ dimensions and as the isometry group of de Sitter spacetime in $d+1$ dimensions. While this common feature can be taken as a hint towards holography on de Sitter space, understanding the representation theory has importance for cosmological applications where de Sitter spacetime is relevant. Among the categories of $SO(d+1,1)$ unitary irreducible representations, discrete series is important in physical applications because they are expected to capture gauge fields. However, they are also the most difficult ones to recognize in field theoretical examples compared to representations from the other categories. Here we point towards some examples where we are able to recognize discrete series representations from fields on de Sitter and highlight some of the properties of these representations.


title: Benchmarking Multi-Domain Active Learning on Image Classification

abstract: Active learning aims to enhance model performance by strategically labeling informative data points. While extensively studied, its effectiveness on large-scale, real-world datasets remains underexplored. Existing research primarily focuses on single-source data, ignoring the multi-domain nature of real-world data. We introduce a multi-domain active learning benchmark to bridge this gap. Our benchmark demonstrates that traditional single-domain active learning strategies are often less effective than random selection in multi-domain scenarios. We also introduce CLIP-GeoYFCC, a novel large-scale image dataset built around geographical domains, in contrast to existing genre-based domain datasets. Analysis on our benchmark shows that all multi-domain strategies exhibit significant tradeoffs, with no strategy outperforming across all datasets or all metrics, emphasizing the need for future research.


title: TMD gluon density in nuclei versus experimental data on heavy flavor production at LHC

abstract: Analytical expressions for the Transverse Momentum Dependent (TMD, or unintegrated) gluon and sea quark densities in nuclei are derived at leading order of QCD running coupling. The calculations are performed in the framework of the rescaling model and Kimber-Martin-Ryskin (KMR) prescription, where the Bessel-inspired behavior of parton densities at small Bjorken $x$ values, obtained in the case of flat initial conditions in the double scaling QCD approximation, is applied. The derived expressions are used to evaluate the inclusive heavy flavor production in proton-lead collisions at the LHC. We find a good agreement of our results with latest experimental data collected by the CMS and ALICE Collaborations at $\sqrt s = 5.02$ GeV.


title: Unbounded Donoho-Stark-Elad-Bruckstein-Ricaud-Torr\'esani Uncertainty Principles

abstract: Let $(\Omega, \mu)$, $(\Delta, \nu)$ be measure spaces and $p=1$ or $p=\infty$. Let $(\{f_\alpha\}_{\alpha\in \Omega}, \{\tau_\alpha\}_{\alpha\in \Omega})$ and $(\{g_\beta\}_{\beta\in \Delta}, \{\omega_\beta\}_{\beta\in \Delta})$ be unbounded continuous p-Schauder frames for a Banach space $\mathcal{X}$. Then for every $x \in ( \mathcal{D}(\theta_f) \cap\mathcal{D}(\theta_g))\setminus\{0\}$, we show that \begin{align}\label{UB} (1) \quad \quad \quad \quad \mu(\operatorname{supp}(\theta_f x))\nu(\operatorname{supp}(\theta_g x)) \geq \frac{1}{\left(\displaystyle\sup_{\alpha \in \Omega, \beta \in \Delta}|f_\alpha(\omega_\beta)|\right)\left(\displaystyle\sup_{\alpha \in \Omega , \beta \in \Delta}|g_\beta(\tau_\alpha)|\right)}, \end{align} where \begin{align*} &\theta_f:\mathcal{D}(\theta_f) \ni x \mapsto \theta_fx \in \mathcal{L}^p(\Omega, \mu); \quad \theta_fx: \Omega \ni \alpha \mapsto (\theta_fx) (\alpha):= f_\alpha (x) \in \mathbb{K},\\ &\theta_g: \mathcal{D}(\theta_g) \ni x \mapsto \theta_gx \in \mathcal{L}^p(\Delta, \nu); \quad \theta_gx: \Delta \ni \beta \mapsto (\theta_gx) (\beta):= g_\beta (x) \in \mathbb{K}. \end{align*} We call Inequality (1) as \textbf{Unbounded Donoho-Stark-Elad-Bruckstein-Ricaud-Torr\'{e}sani Uncertainty Principle}. Along with recent \textbf{Functional Continuous Uncertainty Principle} [arXiv:2308.00312], Inequality (1) also improves Ricaud-Torr\'{e}sani uncertainty principle [IEEE Trans. Inform. Theory, 2013]. In particular, it improves Elad-Bruckstein uncertainty principle [IEEE Trans. Inform. Theory, 2002] and Donoho-Stark uncertainty principle [SIAM J. Appl. Math., 1989].


title: Compensated Ferrimagnets with Colossal Spin Splitting in Organic Compounds

abstract: The study of the magnetic order has recently been invigorated by the discovery of exotic collinear antiferromagnets with time-reversal symmetry breaking. Examples include altermagnetism and compensated ferrimagnets, which show spin splittings of the electronic band structures even at zero net magnetization, leading to several unique transport phenomena, notably spin-current generation. Altermagnets demonstrate anisotropic spin splitting, such as $d$-wave, in momentum space, whereas compensated ferrimagnets exhibit isotropic spin splitting. However, methods to realize compensated ferrimagnets are limited. Here, we demonstrate a method to realize a fully compensated ferrimagnet with isotropic spin splitting utilizing the dimer structures inherent in organic compounds. Moreover, based on $ab$ $initio$ calculations, we find that this ferrimagnet can be realized in the recently discovered organic compound (EDO-TTF-I)$_2$ClO$_4$. Our findings provide an unprecedented strategy for using the dimer degrees of freedom in organic compounds to realize fully compensated ferrimagnets with colossal spin splitting.


title: The upper bound of the spectral radius for the hypergraphs without Berge-graphs

abstract: The spectral analogue of the Tur\'{a}n type problem for hypergraphs is to determine the maximum spectral radius for the hypergraphs of order $n$ that do not contain a given hypergraph. For the hypergraphs among the set of the connected linear $3$-uniform hypergraphs on $n$ vertices without the Berge-$C_l$, we present two upper bounds for their spectral radius and $\alpha$-spectral radius, which are related to $n$,$l$ and $\alpha$, where $C_l$ is a cycle of length $l$ with $l\geqslant 5$, $n\geqslant 3$ and $0 \leqslant \alpha<1$. Let $B_s$ be an $s$-book with $s\geqslant2$ and $K_{s,t}$ be a complete bipartite graph with two parts of size $s$ and $t$, respectively, where $s,t \geqslant 1$. For the hypergraphs among the set of the connected linear $k$-uniform hypergraphs on $n$ vertices without the Berge-$\{B_s, K_{2,t}\}$, we derive two upper bounds for their spectral radius and $\alpha$-spectral radius, which depend on $n$, $k$, $s$, and $\alpha$, where $n$,$k\geqslant 3$,$s\geqslant 2$,$1\leqslant t\leqslant \frac{1}{2}(6k^2-15k+10)(s-1)+1$, and $0\leqslant \alpha <1$.


title: A new approach for the implementation of contact line motion based on the phase-filed lattice Boltzmann method

abstract: This paper proposes a new strategy to implement the free-energy based wetting boundary condition within the phase-field lattice Boltzmann method. The greatest advantage of the proposed method is that the implementation of contact line motion can be significantly simplified while still maintaining good accuracy. For this purpose, the liquid-solid free energy is treated as a part of the chemical potential instead of the boundary condition, thus avoiding complicated interpolations with irregular geometries. Several numerical testing cases including the droplet spreading processes on the idea flat, inclined and curved boundaries are conducted, and the results demonstrate that the proposed method has good ability and satisfactory accuracy to simulate contact line motions.


title: Effect of interface quality on spin Hall magnetoresistance in Pt/MgFe$_{2}$O$_{4}$ bilayers

abstract: We report on spin Hall magnetoresistance (SMR) in bilayers composed of Pt and magnetic insulator MgFe$_{2}$O$_{4}$ (MFO) with spinel structure. The Pt thickness dependence of the SMR reveals that annealing of the MFO surface before depositing the Pt layer is crucial for a large SMR with better interface quality. We also found that oxygen pressure during the MFO growth hardly affects the SMR while it influences on magnetic property of the MFO film. Our findings provide important clues to further understanding the spin transport at interfaces containing magnetic insulators, facilitating development of low power consumption devices.


title: Hybrid Higher-Order Skin Topological Modes in the Two-Dimensional Su-Schrieffer-Heeger Model with Nonreciprocal Hoppings

abstract: The coexistence of edge states and skin effects provides the topologically protected localized states at the corners of two-dimensional systems. In this paper, we realize such corner states in the two-dimensional Su-Schrieffer-Heeger model with the nonreciprocal hoppings. For the characterization of the real line gap topology, we introduce the $\mathbb{Z}_4$ Berry phase protected by generalized four-fold rotational symmetry. From the physical picture of the adiabatic connection, we find that the value of the $\mathbb{Z}_4$ Berry phase predicts the position of edge states. Additionally, by using the winding number, we characterize the point gap topology of the edge spectra. From the results of these characterizations by the first-order topological invariants, we find that the pair of values of the $\mathbb{Z}_4$ Berry phase and the winding number yields the position of the topologically protected localized states.


title: Event-driven Real-time Retrieval in Web Search

abstract: Information retrieval in real-time search presents unique challenges distinct from those encountered in classical web search. These challenges are particularly pronounced due to the rapid change of user search intent, which is influenced by the occurrence and evolution of breaking news events, such as earthquakes, elections, and wars. Previous dense retrieval methods, which primarily focused on static semantic representation, lack the capacity to capture immediate search intent, leading to inferior performance in retrieving the most recent event-related documents in time-sensitive scenarios. To address this issue, this paper expands the query with event information that represents real-time search intent. The Event information is then integrated with the query through a cross-attention mechanism, resulting in a time-context query representation. We further enhance the model's capacity for event representation through multi-task training. Since publicly available datasets such as MS-MARCO do not contain any event information on the query side and have few time-sensitive queries, we design an automatic data collection and annotation pipeline to address this issue, which includes ModelZoo-based Coarse Annotation and LLM-driven Fine Annotation processes. In addition, we share the training tricks such as two-stage training and hard negative sampling. Finally, we conduct a set of offline experiments on a million-scale production dataset to evaluate our approach and deploy an A/B testing in a real online system to verify the performance. Extensive experimental results demonstrate that our proposed approach significantly outperforms existing state-of-the-art baseline methods.


title: Streaming Bayesian Modeling for predicting Fat-Tailed Customer Lifetime Value

abstract: We develop an online learning MCMC approach applicable for hierarchical bayesian models and GLMS. We also develop a fat-tailed LTV model that generalizes over several kinds of fat and thin tails. We demonstrate both developments on commercial LTV data from a large mobile app.


title: The Philosopher's Stone: Trojaning Plugins of Large Language Models

abstract: Open-source Large Language Models (LLMs) have recently gained popularity because of their comparable performance to proprietary LLMs. To efficiently fulfill domain-specialized tasks, open-source LLMs can be refined, without expensive accelerators, using low-rank adapters. However, it is still unknown whether low-rank adapters can be exploited to control LLMs. To address this gap, we demonstrate that an infected adapter can induce, on specific triggers, an LLM to output content defined by an adversary and to even maliciously use tools. To train a Trojan adapter, we propose two novel attacks, POLISHED and FUSION, that improve over prior approaches. POLISHED uses LLM-enhanced paraphrasing to polish benchmark poisoned datasets. In contrast, in the absence of a dataset, FUSION leverages an over-poisoning procedure to transform a benign adaptor. In our experiments, we first conduct two case studies to demonstrate that a compromised LLM agent can execute malware to control system (e.g., LLM-driven robot) or launch a spear-phishing attack. Then, in terms of targeted misinformation, we show that our attacks provide higher attack effectiveness than the baseline and, for the purpose of attracting downloads, preserve or improve the adapter's utility. Finally, we design and evaluate three potential defenses, yet none proved entirely effective in safeguarding against our attacks.


title: Text-Guided 3D Face Synthesis -- From Generation to Editing

abstract: Text-guided 3D face synthesis has achieved remarkable results by leveraging text-to-image (T2I) diffusion models. However, most existing works focus solely on the direct generation, ignoring the editing, restricting them from synthesizing customized 3D faces through iterative adjustments. In this paper, we propose a unified text-guided framework from face generation to editing. In the generation stage, we propose a geometry-texture decoupled generation to mitigate the loss of geometric details caused by coupling. Besides, decoupling enables us to utilize the generated geometry as a condition for texture generation, yielding highly geometry-texture aligned results. We further employ a fine-tuned texture diffusion model to enhance texture quality in both RGB and YUV space. In the editing stage, we first employ a pre-trained diffusion model to update facial geometry or texture based on the texts. To enable sequential editing, we introduce a UV domain consistency preservation regularization, preventing unintentional changes to irrelevant facial attributes. Besides, we propose a self-guided consistency weight strategy to improve editing efficacy while preserving consistency. Through comprehensive experiments, we showcase our method's superiority in face synthesis. Project page: https://faceg2e.github.io/.


title: Dynamics of a quantum system interacting with white non-Gaussian baths: Poisson noise master equation

abstract: Quantum systems are unavoidably open to their surrounding degrees of freedom. The theory of open quantum systems is thus crucial to understanding the fluctuations, dissipation, and decoherence of a quantum system of interest. Typically, the bath is modeled as an ensemble of harmonic oscillators, which yields Gaussian statistics of the bath influence on the quantum systems. However, there are also phenomena in which the bath consists of two-state systems, spins, or anharmonic oscillators; therefore, the non-Gaussian properties of the bath become important. Nevertheless, a theoretical framework to describe quantum systems under the influence of such non-Gaussian baths is not well established. Here, we develop a theory to describe quantum dissipative systems affected by Poisson noise properties of the bath, because the L\'evi-It\^o decomposition theorem asserts that Poisson noise is fundamental in describing arbitrary white noise beyond Gaussian properties. We introduce a quantum bath model that allows for the consistent description of dissipative quantum systems. The obtained master equation reveals non-Gaussian bath effects in the white noise regime, and provides an essential step toward describing open quantum dynamics under the influence of generic baths.


title: SynFundus-1M: A High-quality Million-scale Synthetic fundus images Dataset with Fifteen Types of Annotation

abstract: Large-scale public datasets with high-quality annotations are rarely available for intelligent medical imaging research, due to data privacy concerns and the cost of annotations. In this paper, we release SynFundus-1M, a high-quality synthetic dataset containing over one million fundus images in terms of \textbf{eleven disease types}. Furthermore, we deliberately assign four readability labels to the key regions of the fundus images. To the best of our knowledge, SynFundus-1M is currently the largest fundus dataset with the most sophisticated annotations. Leveraging over 1.3 million private authentic fundus images from various scenarios, we trained a powerful Denoising Diffusion Probabilistic Model, named SynFundus-Generator. The released SynFundus-1M are generated by SynFundus-Generator under predefined conditions. To demonstrate the value of SynFundus-1M, extensive experiments are designed in terms of the following aspect: 1) Authenticity of the images: we randomly blend the synthetic images with authentic fundus images, and find that experienced annotators can hardly distinguish the synthetic images from authentic ones. Moreover, we show that the disease-related vision features (e.g. lesions) are well simulated in the synthetic images. 2) Effectiveness for down-stream fine-tuning and pretraining: we demonstrate that retinal disease diagnosis models of either convolutional neural networks (CNN) or Vision Transformer (ViT) architectures can benefit from SynFundus-1M, and compared to the datasets commonly used for pretraining, models trained on SynFundus-1M not only achieve superior performance but also demonstrate faster convergence on various downstream tasks. SynFundus-1M is already public available for the open-source community.


title: Magneto-transport in the monolayer MoS2 material system for high-performance field-effect transistor applications

abstract: Electronic transport in monolayer MoS2 is significantly constrained by several extrinsic factors despite showing good prospects as a transistor channel material. Our paper aims to unveil the underlying mechanisms of the electrical and magneto-transport in monolayer MoS2. In order to quantitatively interpret the magneto-transport behavior of monolayer MoS2 on different substrate materials, identify the underlying bottlenecks, and provide guidelines for subsequent improvements, we present a deep analysis of the magneto-transport properties in the diffusive limit. Our calculations are performed on suspended monolayer MoS2 and MoS2 on different substrate materials taking into account remote impurity and the intrinsic and extrinsic phonon scattering mechanisms. We calculate the crucial transport parameters such as the Hall mobility, the conductivity tensor elements, the Hall factor, and the magnetoresistance over a wide range of temperatures, carrier concentrations, and magnetic fields. The Hall factor being a key quantity for calculating the carrier concentration and drift mobility, we show that for suspended monolayer MoS2 at room temperature, the Hall factor value is around 1.43 for magnetic fields ranging from 0.001 to 1 Tesla, which deviates significantly from the usual value of unity. In contrast, the Hall factor for various substrates approaches the ideal value of unity and remains stable in response to the magnetic field and temperature. We also show that the MoS2 over an Al2O3 substrate is a good choice for the Hall effect detector. Moreover, the magnetoresistance increases with an increase in magnetic field strength for smaller magnetic fields before reaching saturation at higher magnetic fields. The presented theoretical model quantitatively captures the scaling of mobility and various magnetoresistance coefficients with temperature, carrier densities and magnetic fields.


title: Optimal Sample Complexity of Contrastive Learning

abstract: Contrastive learning is a highly successful technique for learning representations of data from labeled tuples, specifying the distance relations within the tuple. We study the sample complexity of contrastive learning, i.e. the minimum number of labeled tuples sufficient for getting high generalization accuracy. We give tight bounds on the sample complexity in a variety of settings, focusing on arbitrary distance functions, both general $\ell_p$-distances, and tree metrics. Our main result is an (almost) optimal bound on the sample complexity of learning $\ell_p$-distances for integer $p$. For any $p \ge 1$ we show that $\tilde \Theta(\min(nd,n^2))$ labeled tuples are necessary and sufficient for learning $d$-dimensional representations of $n$-point datasets. Our results hold for an arbitrary distribution of the input samples and are based on giving the corresponding bounds on the Vapnik-Chervonenkis/Natarajan dimension of the associated problems. We further show that the theoretical bounds on sample complexity obtained via VC/Natarajan dimension can have strong predictive power for experimental results, in contrast with the folklore belief about a substantial gap between the statistical learning theory and the practice of deep learning.


title: Enhancing Explainability in Mobility Data Science through a combination of methods

abstract: In the domain of Mobility Data Science, the intricate task of interpreting models trained on trajectory data, and elucidating the spatio-temporal movement of entities, has persistently posed significant challenges. Conventional XAI techniques, although brimming with potential, frequently overlook the distinct structure and nuances inherent within trajectory data. Observing this deficiency, we introduced a comprehensive framework that harmonizes pivotal XAI techniques: LIME (Local Interpretable Model-agnostic Explanations), SHAP (SHapley Additive exPlanations), Saliency maps, attention mechanisms, direct trajectory visualization, and Permutation Feature Importance (PFI). Unlike conventional strategies that deploy these methods singularly, our unified approach capitalizes on the collective efficacy of these techniques, yielding deeper and more granular insights for models reliant on trajectory data. In crafting this synthesis, we effectively address the multifaceted essence of trajectories, achieving not only amplified interpretability but also a nuanced, contextually rich comprehension of model decisions. To validate and enhance our framework, we undertook a survey to gauge preferences and reception among various user demographics. Our findings underscored a dichotomy: professionals with academic orientations, particularly those in roles like Data Scientist, IT Expert, and ML Engineer, showcased a profound, technical understanding and often exhibited a predilection for amalgamated methods for interpretability. Conversely, end-users or individuals less acquainted with AI and Data Science showcased simpler inclinations, such as bar plots indicating timestep significance or visual depictions pinpointing pivotal segments of a vessel's trajectory.


title: Lung Imaging with UTE MRI

abstract: Cross-sectional imaging of the lungs, or pulmonary imaging, has proven to be an incredibly valuable tool in a wide range of pulmonary diseases. The vast majority of lung imaging is done with CT, as it is fast enough to freeze respiratory motion and provides high spatial resolution to visualize fine structure of the lungs. MRI of the lungs is inherently challenging due to the presence of large local magnetic field gradients, relatively low proton density, and motion. The benefits of performing MRI for lung imaging include no ionizing radiation, opportunities for multiple contrasts, and integration with other MRI also offers the opportunity to obtain multiple tissue contrasts. The most common lung MRI techniques are structural T1-weighted scans, but also emerging are functional contrasts such as ventilation and perfusion, as well as other MRI contrast mechanisms including T2-weighting and diffusion-weighting. Finally, lung MRI can be combined with other MRI scanning techniques, including cardiac MRI, abdominal MRI, whole-body MRI, and PET/MRI, for increasing examination efficiency by only requiring a single scan session and providing more comprehensive assessment that includes evaluation of the pulmonary system. This article covers pulse sequences, motion management methods, image reconstruction, and contrast mechanisms of UTE MRI (e.g. T1-weighting, ventilation mapping) for imaging of the lung.


title: The effective potential of composite operator in the first order region of QCD phase transition

abstract: We propose a method to determine the effective potential of QCD from the gap equation, by introducing the homotopy method between the solutions of the equation of motion. Via this method, the effective potential beyond the bare vertex approximation is obtained, which then generalizes the Cornwall, Jackiw and Tomboulis (CJT) effective potential for the bilocal composite operators. Moreover, the extended effective potential is set to be a function of self energy instead of the propagator, which is the key point for the potential to be bounded from below. We then investigate the extended effective potential in the cases of phase transition of the QCD vacuum with a small current quark mass, and the first-order phase transition of QCD at finite temperature and high baryon chemical potential. In the former case, the effective potential shows as an inflection point at the critical mass where the multiple solutions of the Dyson-Schwinger equation (DSE) vanishes, which is consistent with that obtained by solving the DSE directly. For the latter case, the in-medium properties, such as the latent heat and the difference of trace anomaly, of QCD is obtained.


title: On the automorphism group of a distance-regular graph

abstract: The motion of a graph is the minimal degree of its full automorphism group. Babai conjectured that the motion of a primitive distance-regular graph on $n$ vertices of diameter greater than two is at least $n/C$ for some universal constant $C > 0$, unless the graph is a Johnson or Hamming graph. We prove that the motion of a distance-regular graph of diameter $d \geq 3$ on $n$ vertices is at least $Cn/(\log n)^6$ for some universal constant $C > 0$, unless it is a Johnson, a Hamming or a crown graph. This follows using an improvement of an earlier result by Kivva who gave a lower bound on motion of the form $n/c_d$, where $c_d$ depends exponentially on $d$. As a corollary we derive a quasipolynomial upper bound for the automorphism group of a primitive distance-regular graph acting edge-transitively on the graph and on its distance-2 graph. The proofs use elementary combinatorial arguments and do not depend on the classification of finite simple groups.


title: T2 Relaxation during Radiofrequency (RF) pulses

abstract: Radiofrequency (RF) pulses are a critical part of every MRI pulse sequence, and must be specifically designed for ultrashort echo time (UTE) and zero echo time (ZTE) acquisitions. When considering the behavior of RF pulses, most often longitudinal T1 or transverse T2 relaxation is assumed to be negligible during the RF pulses themselves. This is usually valid with conventional sequences since most tissue T1s and T2s are much longer than typical RF pulse durations. However, when imaging tissues that have transverse relaxation times that are of the order of, or shorter than, the RF pulse duration, as is often the case with UTE and ZTE MRI, then relaxation during the pulse must be considered. This article covers the theory of T2/T2* relaxation during an RF pulse, and the implications and applications of this for imaging of ultrashort-T2* species.


title: Super Fermi polaron and Nagaoka ferromagnetism in a two-dimesnional square lattice

abstract: We consider the Fermi polaron problem of an impurity hopping around a two-dimensional square lattice and interacting with a sea of fermions at given filling factor. When the interaction is attractive, we find standard Fermi polaron quasiparticles, categorized as attractive polarons and repulsive polarons. When the interaction becomes repulsive, interestingly, we observe an unconventional highly-excited polaron quasiparticle, sharply peaked at the corner of the first Brillouin zone with momentum \mathbf{k}=(\pm\pi,\pm\pi). This super Fermi polaron branch arises from the dressing of the impurity's motion with holes, instead of particles of fermions. We show that super Fermi polarons become increasingly well-defined with increasing impurity-fermion repulsions and might be considered as a precursor of Nagaoka ferromagnetism, which would appear at sufficiently large repulsions and at large filling factors. We also investigate the temperature-dependence of super Fermi polarons and find that they are thermally robust against the significant increase in temperature.


title: Local monotone operator learning using non-monotone operators: MnM-MOL

abstract: The recovery of magnetic resonance (MR) images from undersampled measurements is a key problem that has seen extensive research in recent years. Unrolled approaches, which rely on end-to-end training of convolutional neural network (CNN) blocks within iterative reconstruction algorithms, offer state-of-the-art performance. These algorithms require a large amount of memory during training, making them difficult to employ in high-dimensional applications. Deep equilibrium (DEQ) models and the recent monotone operator learning (MOL) approach were introduced to eliminate the need for unrolling, thus reducing the memory demand during training. Both approaches require a Lipschitz constraint on the network to ensure that the forward and backpropagation iterations converge. Unfortunately, the constraint often results in reduced performance compared to unrolled methods. The main focus of this work is to relax the constraint on the CNN block in two different ways. Inspired by convex-non-convex regularization strategies, we now impose the monotone constraint on the sum of the gradient of the data term and the CNN block, rather than constrain the CNN itself to be a monotone operator. This approach enables the CNN to learn possibly non-monotone score functions, which can translate to improved performance. In addition, we only restrict the operator to be monotone in a local neighborhood around the image manifold. Our theoretical results show that the proposed algorithm is guaranteed to converge to the fixed point and that the solution is robust to input perturbations, provided that it is initialized close to the true solution. Our empirical results show that the relaxed constraints translate to improved performance and that the approach enjoys robustness to input perturbations similar to MOL.


title: Partition-based K-space Synthesis for Multi-contrast Parallel Imaging

abstract: Multi-contrast magnetic resonance imaging is a significant and essential medical imaging technique.However, multi-contrast imaging has longer acquisition time and is easy to cause motion artifacts. In particular, the acquisition time for a T2-weighted image is prolonged due to its longer repetition time (TR). On the contrary, T1-weighted image has a shorter TR. Therefore,utilizing complementary information across T1 and T2-weighted image is a way to decrease the overall imaging time. Previous T1-assisted T2 reconstruction methods have mostly focused on image domain using whole-based image fusion approaches. The image domain reconstruction method has the defects of high computational complexity and limited flexibility. To address this issue, we propose a novel multi-contrast imaging method called partition-based k-space synthesis (PKS) which can achieve super reconstruction quality of T2-weighted image by feature fusion. Concretely, we first decompose fully-sampled T1 k-space data and under-sampled T2 k-space data into two sub-data, separately. Then two new objects are constructed by combining the two sub-T1/T2 data. After that, the two new objects as the whole data to realize the reconstruction of T2-weighted image. Finally, the objective T2 is synthesized by extracting the sub-T2 data of each part. Experimental results showed that our combined technique can achieve comparable or better results than using traditional k-space parallel imaging(SAKE) that processes each contrast independently.


title: LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices

abstract: Deploying Large Language Models (LLMs) locally on mobile devices presents a significant challenge due to their extensive memory requirements. In this paper, we introduce LinguaLinked, a system for decentralized, distributed LLM inference on mobile devices. LinguaLinked enables collaborative execution of the inference task across multiple trusted devices. LinguaLinked ensures data privacy by processing information locally. LinguaLinked uses three key strategies. First, an optimized model assignment technique segments LLMs and uses linear optimization to align segments with each device's capabilities. Second, an optimized data transmission mechanism ensures efficient and structured data flow between model segments while also maintaining the integrity of the original model structure. Finally, LinguaLinked incorporates a runtime load balancer that actively monitors and redistributes tasks among mobile devices to prevent bottlenecks, enhancing the system's overall efficiency and responsiveness. We demonstrate that LinguaLinked facilitates efficient LLM inference while maintaining consistent throughput and minimal latency through extensive testing across various mobile devices, from high-end to low-end Android devices. In our evaluations, compared to the baseline, LinguaLinked achieves an inference performance acceleration of $1.11\times$ to $1.61\times$ in single-threaded settings, $1.73\times$ to $2.65\times$ with multi-threading. Additionally, runtime load balancing yields an overall inference acceleration of $1.29\times$ to $1.32\times$.


title: Sample path MDP for the current and the tagged particle in the SSEP

abstract: We prove sample path moderate deviation principles (MDP) for the current and the tagged particle in the symmetric simple exclusion process, which extends the results in \cite{xue2023moderate}, where the MDP was only proved at any fixed time.