title: Density Ratio Estimation via Sampling along Generalized Geodesics on Statistical Manifolds

abstract: The density ratio of two probability distributions is one of the fundamental tools in mathematical and computational statistics and machine learning, and it has a variety of known applications. Therefore, density ratio estimation from finite samples is a very important task, but it is known to be unstable when the distributions are distant from each other. One approach to address this problem is density ratio estimation using incremental mixtures of the two distributions. We geometrically reinterpret existing methods for density ratio estimation based on incremental mixtures. We show that these methods can be regarded as iterating on the Riemannian manifold along a particular curve between the two probability distributions. Making use of the geometry of the manifold, we propose to consider incremental density ratio estimation along generalized geodesics on this manifold. To achieve such a method requires Monte Carlo sampling along geodesics via transformations of the two distributions. We show how to implement an iterative algorithm to sample along these geodesics and show how changing the distances along the geodesic affect the variance and accuracy of the estimation of the density ratio. Our experiments demonstrate that the proposed approach outperforms the existing approaches using incremental mixtures that do not take the geometry of the


title: ML-Powered FPGA-based Real-Time Quantum State Discrimination Enabling Mid-circuit Measurements

abstract: Similar to reading the transistor state in classical computers, identifying the quantum bit (qubit) state is a fundamental operation to translate quantum information. However, identifying quantum state has been the slowest and most error-prone operation on superconducting quantum processors. Most existing state discrimination algorithms have only been implemented and optimized "after the fact" - using offline data transferred from control circuits to host computers. Real-time state discrimination is not possible because a superconducting quantum state only survives for a few hundred us, which is much shorter than the communication delay between the readout circuit and the host computer (i.e., tens of ms). Mid-circuit measurement (MCM), where measurements are conducted on qubits at intermediate stages within a quantum circuit rather than solely at the end, represents an advanced technique for qubit reuse. For MCM necessitating single-shot readout, it is imperative to employ an in-situ technique for state discrimination with low latency and high accuracy. This paper introduces QubiCML, a field-programmable gate array (FPGA) based system for real-time state discrimination enabling MCM - the ability to measure the state at the control circuit before/without transferring data to a host computer. A multi-layer neural network has been designed and deployed on an FPGA to ensure accurate in-situ state discrimination. For the first time, ML-powered quantum state discrimination has been implemented on a radio frequency system-on-chip FPGA platform. The deployed lightweight network on the FPGA only takes 54 ns to complete each inference. We evaluated QubiCML's performance on superconducting quantum processors and obtained an average accuracy of 98.5% with only 500 ns readout. QubiCML has the potential to be the standard real-time state discrimination method for the quantum community.


title: Binding in hippocampal-entorhinal circuits enables compositionality in cognitive maps

abstract: We propose a normative model for spatial representation in the hippocampal formation that combines optimality principles, such as maximizing coding range and spatial information per neuron, with an algebraic framework for computing in distributed representation. Spatial position is encoded in a residue number system, with individual residues represented by high-dimensional, complex-valued vectors. These are composed into a single vector representing position by a similarity-preserving, conjunctive vector-binding operation. Self-consistency between the representations of the overall position and of the individual residues is enforced by a modular attractor network whose modules correspond to the grid cell modules in entorhinal cortex. The vector binding operation can also associate different contexts to spatial representations, yielding a model for entorhinal cortex and hippocampus. We show that the model achieves normative desiderata including superlinear scaling of patterns with dimension, robust error correction, and hexagonal, carry-free encoding of spatial position. These properties in turn enable robust path integration and association with sensory inputs. More generally, the model formalizes how compositional computations could occur in the hippocampal formation and leads to testable experimental predictions.


title: Divide, Ensemble and Conquer: The Last Mile on Unsupervised Domain Adaptation for On-Board Semantic Segmentation

abstract: The last mile of unsupervised domain adaptation (UDA) for semantic segmentation is the challenge of solving the syn-to-real domain gap. Recent UDA methods have progressed significantly, yet they often rely on strategies customized for synthetic single-source datasets (e.g., GTA5), which limits their generalisation to multi-source datasets. Conversely, synthetic multi-source datasets hold promise for advancing the last mile of UDA but remain underutilized in current research. Thus, we propose DEC, a flexible UDA framework for multi-source datasets. Following a divide-and-conquer strategy, DEC simplifies the task by categorizing semantic classes, training models for each category, and fusing their outputs by an ensemble model trained exclusively on synthetic datasets to obtain the final segmentation mask. DEC can integrate with existing UDA methods, achieving state-of-the-art performance on Cityscapes, BDD100K, and Mapillary Vistas, significantly narrowing the syn-to-real domain gap.


title: Assisting Tibetan Students in Learning Quantum Mechanics via Mathematica

abstract: Undergraduate students of physics in Tibet have great difficulty learning quantum mechanics (QM). We attempt to use PER-based methods to help Tibetan students learn QM. In this preliminary study, we incorporate Mathematica in a QM course at Tibet University and record students' learning experiences. Tibetan students tend to have subjective feelings of learning Mathematica, whereas Han students (majority) are more focused on the operational techniques of Mathematica. The results also suggest that both Tibetan students and Han students show limited improvement in time-independent Schrodinger equations after learning QM with Mathematica. Further effort is needed to improve the academic literacy skills of physics students in Tibet.


title: 1/f noise of a tiny tunnel magnetoresistance sensor originated from a wide distribution of bath correlation time

abstract: Tunnel magnetoresistance (TMR) sensor is a highly sensitive magnetic field sensor and is expected to be applied in various fields, such as magnetic recording, industrial sensing, and bio-medical sensing. To improve the detection capability of TMR sensors in low frequency regime it is necessary to suppress the 1/f noise. We theoretically study 1/f noise of a tiny TMR sensor using the macrospin model. Starting from the generalized Langevin equation, 1/f noise power spectrum and the Hooge parameter are derived. The calculated Hooge parameter of a tiny TMR sensor is much smaller than that of a conventional TMR sensor with large junction area. The results provide a new perspective on magnetic 1/f noise and will be useful for improvement of TMR sensors.


title: A Survey on Privacy Attacks Against Digital Twin Systems in AI-Robotics

abstract: Industry 4.0 has witnessed the rise of complex robots fueled by the integration of Artificial Intelligence/Machine Learning (AI/ML) and Digital Twin (DT) technologies. While these technologies offer numerous benefits, they also introduce potential privacy and security risks. This paper surveys privacy attacks targeting robots enabled by AI and DT models. Exfiltration and data leakage of ML models are discussed in addition to the potential extraction of models derived from first-principles (e.g., physics-based). We also discuss design considerations with DT-integrated robotics touching on the impact of ML model training, responsible AI and DT safeguards, data governance and ethical considerations on the effectiveness of these attacks. We advocate for a trusted autonomy approach, emphasizing the need to combine robotics, AI, and DT technologies with robust ethical frameworks and trustworthiness principles for secure and reliable AI robotic systems.


title: Towards Secure Management of Edge-Cloud IoT Microservices using Policy as Code

abstract: IoT application providers increasingly use MicroService Architecture (MSA) to develop applications that convert IoT data into valuable information. The independently deployable and scalable nature of microservices enables dynamic utilization of edge and cloud resources provided by various service providers, thus improving performance. However, IoT data security should be ensured during multi-domain data processing and transmission among distributed and dynamically composed microservices. The ability to implement granular security controls at the microservices level has the potential to solve this. To this end, edge-cloud environments require intricate and scalable security frameworks that operate across multi-domain environments to enforce various security policies during the management of microservices (i.e., initial placement, scaling, migration, and dynamic composition), considering the sensitivity of the IoT data. To address the lack of such a framework, we propose an architectural framework that uses Policy-as-Code to ensure secure microservice management within multi-domain edge-cloud environments. The proposed framework contains a "control plane" to intelligently and dynamically utilise and configure cloud-native (i.e., container orchestrators and service mesh) technologies to enforce security policies. We implement a prototype of the proposed framework using open-source cloud-native technologies such as Docker, Kubernetes, Istio, and Open Policy Agent to validate the framework. Evaluations verify our proposed framework's ability to enforce security policies for distributed microservices management, thus harvesting the MSA characteristics to ensure IoT application security needs.


title: Length Optimization in Conformal Prediction

abstract: Conditional validity and length efficiency are two crucial aspects of conformal prediction (CP). Achieving conditional validity ensures accurate uncertainty quantification for data subpopulations, while proper length efficiency ensures that the prediction sets remain informative and non-trivial. Despite significant efforts to address each of these issues individually, a principled framework that reconciles these two objectives has been missing in the CP literature. In this paper, we develop Conformal Prediction with Length-Optimization (CPL) - a novel framework that constructs prediction sets with (near-) optimal length while ensuring conditional validity under various classes of covariate shifts, including the key cases of marginal and group-conditional coverage. In the infinite sample regime, we provide strong duality results which indicate that CPL achieves conditional validity and length optimality. In the finite sample regime, we show that CPL constructs conditionally valid prediction sets. Our extensive empirical evaluations demonstrate the superior prediction set size performance of CPL compared to state-of-the-art methods across diverse real-world and synthetic datasets in classification, regression, and text-related settings.


title: MissionGNN: Hierarchical Multimodal GNN-based Weakly Supervised Video Anomaly Recognition with Mission-Specific Knowledge Graph Generation

abstract: In the context of escalating safety concerns across various domains, the tasks of Video Anomaly Detection (VAD) and Video Anomaly Recognition (VAR) have emerged as critically important for applications in intelligent surveillance, evidence investigation, violence alerting, etc. These tasks, aimed at identifying and classifying deviations from normal behavior in video data, face significant challenges due to the rarity of anomalies which leads to extremely imbalanced data and the impracticality of extensive frame-level data annotation for supervised learning. This paper introduces a novel hierarchical graph neural network (GNN) based model MissionGNN that addresses these challenges by leveraging a state-of-the-art large language model and a comprehensive knowledge graph for efficient weakly supervised learning in VAR. Our approach circumvents the limitations of previous methods by avoiding heavy gradient computations on large multimodal models and enabling fully frame-level training without fixed video segmentation. Utilizing automated, mission-specific knowledge graph generation, our model provides a practical and efficient solution for real-time video analysis without the constraints of previous segmentation-based or multimodal approaches. Experimental validation on benchmark datasets demonstrates our model's performance in VAD and VAR, highlighting its potential to redefine the landscape of anomaly detection and recognition in video surveillance systems.


title: Angle-dependent planar thermal Hall effect by quasi-ballistic phonons in black phosphorus

abstract: The origin of the phonon thermal Hall effect in insulators is a matter of ongoing debate. The large amplitude of the signal in an elemental non-magnetic solid, such as black phosphorus (BP) calls for a minimal mechanism with no role for spin degree of freedom. Here, we show that a longitudinal heat flow generates a transverse temperature gradient in BP even when the magnetic field, the heat current and the thermal gradient lie in the same plane. The long phonon mean-free-path leaves little room for scattering by point-like symmetry breaking defects. we show that the signal peaks when the magnetic field is oriented along one of the two diagonal orientations of the puckered honeycomb plane and argue that this can be understood as the sum of two distinct contributions each parallel to a mirror plane. This angular dependence as well as the order of magnitude of the observed signal points to the torque exerted by magnetic field on electric dipoles traveling with heat-carrying phonons as the driver of the effect.


title: Correspondence-Free Non-Rigid Point Set Registration Using Unsupervised Clustering Analysis

abstract: This paper presents a novel non-rigid point set registration method that is inspired by unsupervised clustering analysis. Unlike previous approaches that treat the source and target point sets as separate entities, we develop a holistic framework where they are formulated as clustering centroids and clustering members, separately. We then adopt Tikhonov regularization with an $\ell_1$-induced Laplacian kernel instead of the commonly used Gaussian kernel to ensure smooth and more robust displacement fields. Our formulation delivers closed-form solutions, theoretical guarantees, independence from dimensions, and the ability to handle large deformations. Subsequently, we introduce a clustering-improved Nystr\"om method to effectively reduce the computational complexity and storage of the Gram matrix to linear, while providing a rigorous bound for the low-rank approximation. Our method achieves high accuracy results across various scenarios and surpasses competitors by a significant margin, particularly on shapes with substantial deformations. Additionally, we demonstrate the versatility of our method in challenging tasks such as shape transfer and medical registration.


title: Lattice Energy Reservoir in Metal Halide Perovskites

abstract: Metal halide perovskite-based technologies have been rapidly developed during the last decade. However, to date, the fundamental question, why are halide perovskites superior to conventional semiconductors? has remained elusive. Here, we propose a new theory of lattice energy reservoir (LER) in halide perovskites and elucidate that LER can comprehensively impact charge carrier dynamics and thus enhance device performance, from hot carrier cooling, carrier recombination, anomalous upconversion fluorescence, illumination induced fluorescence enhancement (photobrightening), to high efficiency solar cells and light-emitting diodes. An LER is a dynamic nanodomain in halide perovskites with suppressed thermal transport that can accumulate energy from phonon coupling and then feedback to subgap carriers and result in subgap carrier upconversion. The LER directly results in slowed cooling of hot carriers and significantly prolonged carrier recombination, anomalous upconversion fluorescence, as usually termed as defect tolerance, as well as the anomalous ultraslow phenomena including persistent polarization, memory effect, and photobrightening. The LER theory rationalizes the superior optoelectronic properties and device performance and provides a novel physical understanding for anomalous phenomena observed uniquely in halide perovskites.


title: MultiObjMatch: Matching with Optimal Tradeoffs between Multiple Objectives in R

abstract: In an observational study, matching aims to create many small sets of similar treated and control units from initial samples that may differ substantially in order to permit more credible causal inferences. The problem of constructing matched sets may be formulated as an optimization problem, but it can be challenging to specify a single objective function that adequately captures all the design considerations at work. One solution, proposed by \citet{pimentel2019optimal} is to explore a family of matched designs that are Pareto optimal for multiple objective functions. We present an R package, \href{https://github.com/ShichaoHan/MultiObjMatch}{\texttt{MultiObjMatch}}, that implements this multi-objective matching strategy using a network flow algorithm for several common design goals: marginal balance on important covariates, size of the matched sample, and average within-pair multivariate distances. We demonstrate the package's flexibility in exploring user-defined tradeoffs of interest via two case studies, a reanalysis of the canonical National Supported Work dataset and a novel analysis of a clinical dataset to estimate the impact of diabetic kidney disease on hospitalization costs.


title: Universal Checkpointing: Efficient and Flexible Checkpointing for Large Scale Distributed Training

abstract: Existing checkpointing approaches seem ill-suited for distributed training even though hardware limitations make model parallelism, i.e., sharding model state across multiple accelerators, a requirement for model scaling. Consolidating distributed model state into a single checkpoint unacceptably slows down training, and is impractical at extreme scales. Distributed checkpoints, in contrast, are tightly coupled to the model parallelism and hardware configurations of the training run, and thus unusable on different configurations. To address this problem, we propose Universal Checkpointing, a technique that enables efficient checkpoint creation while providing the flexibility of resuming on arbitrary parallelism strategy and hardware configurations. Universal Checkpointing unlocks unprecedented capabilities for large-scale training such as improved resilience to hardware failures through continued training on remaining healthy hardware, and reduced training time through opportunistic exploitation of elastic capacity. The key insight of Universal Checkpointing is the selection of the optimal representation in each phase of the checkpointing life cycle: distributed representation for saving, and consolidated representation for loading. This is achieved using two key mechanisms. First, the universal checkpoint format, which consists of a consolidated representation of each model parameter and metadata for mapping parameter fragments into training ranks of arbitrary model-parallelism configuration. Second, the universal checkpoint language, a simple but powerful specification language for converting distributed checkpoints into the universal checkpoint format. Our evaluation demonstrates the effectiveness and generality of Universal Checkpointing on state-of-the-art model architectures and a wide range of parallelism techniques.


title: ViPErLEED package I: Calculation of $I(V)$ curves and structural optimization

abstract: Low-energy electron diffraction (LEED) is a widely used technique in surface-science. Yet, it is rarely used to its full potential. The quantitative information about the surface structure, contained in the modulation of the intensities of the diffracted beams as a function of incident electron energy, LEED I(V), is underutilized. To acquire these data, minor adjustments would be required in most experimental setups, but existing analysis software is cumbersome to use. ViPErLEED (Vienna package for Erlangen LEED) lowers these barriers, introducing a combined solution for data acquisition, extraction, and computational analysis. These parts are discussed in three separate publications. Here, the focus is on the computational part of ViPErLEED, which performs automated LEED-I(V) calculations and structural optimization. Minimal user input is required, and the functionality is significantly enhanced compared to existing solutions. Computation is performed by embedding the Erlangen tensor-LEED package (TensErLEED). ViPErLEED manages parallelization, monitors convergence, and processes input and output. This makes LEED I(V) more accessible to new users while minimizing the potential for errors and the manual labor. Added functionality includes structure-dependent defaults, automatic detection of bulk and surface symmetries and their relationship, automated symmetry-preserving search procedures, adjustments to the TensErLEED code to handle larger systems, as well as parallelization and optimization. Modern file formats are used as input and output, and there is a direct interface to the Atomic Simulation Environment (ASE) package. The software is implemented primarily in Python (version >=3.7) and provided as an open-source package (GNU GPLv3 or later). A structure determination of the $\alpha$-Fe2O3(1-102)-(1x1) surface is presented as an example for the application of the software.


title: Insensitivity of the two-photon Jaynes-Cummings model to thermal noise

abstract: We study the thermal effects of the multi-photon Jaynes-Cummings model (JCM) with a method of thermo field dynamics (TFD). Letting the initial state of the whole system for the multi-photon JCM be a product of the ground state of an atom and a coherent state of a cavity field at finite temperature, we compute its time evolution. We evaluate a period of the collapse and revival of the Rabi oscillations and the relative entropy of coherence of the atom up to the second-order perturbation of the low-temperature expansion. We show that an intuitive estimation of the period matches with the result of the perturbation theory of TFD well. In particular, we witness that the period of the two-photon JCM hardly depends on the amplitude of the coherent state of the cavity field or the temperature. Numerical calculations suggest that the relative entropy of coherence of the two-photon JCM does not decay even for nonzero temperature cases as time proceeds. By contrast, the relative entropy of coherence for single-, three-, and four-photon JCMs decay as time proceeds for zero- and finite-temperature cases.


title: Emergence of metachronal waves in a chain of symmetrically beating filaments

abstract: Recent experiments have shown that metachronal waves (MCWs) can emerge from a chain of symmetrically beating nematodes aligned at the edge of sessile droplets. Our study, employing a coupled elastohydrodynamic model of active filaments, elucidates that a misalignment caused by a tilt against the bounding wall disrupts the synchronization and generates a constant time lag between adjacent filaments, leading to MCWs. The MCWs, enhancing the fluid circulation, achieve their maximum thermodynamic efficiency over the same range of tilt angles observed in the nematode experiments.


title: Topological winding guaranteed coherent orthogonal scattering

abstract: Coherent control has enabled various novel phenomena in wave scattering. We introduce an effect called coherent orthogonal scattering, where the output wave becomes orthogonal to the reference output state without scatterers. This effect leads to a unity extinction coefficient and complete mode conversion. We examine the conditions for this effect and reveal its topological nature by relating it to the indivisibility between the dimension and the winding number of scattering submatrices. These findings deepen our understanding of topological scattering phenomena.

categories: physics.optics cond-mat.mes-hall math-ph math.MP


title: ELCoRec: Enhance Language Understanding with Co-Propagation of Numerical and Categorical Features for Recommendation

abstract: Large language models have been flourishing in the natural language processing (NLP) domain, and their potential for recommendation has been paid much attention to. Despite the intelligence shown by the recommendation-oriented finetuned models, LLMs struggle to fully understand the user behavior patterns due to their innate weakness in interpreting numerical features and the overhead for long context, where the temporal relations among user behaviors, subtle quantitative signals among different ratings, and various side features of items are not well explored. Existing works only fine-tune a sole LLM on given text data without introducing that important information to it, leaving these problems unsolved. In this paper, we propose ELCoRec to Enhance Language understanding with CoPropagation of numerical and categorical features for Recommendation. Concretely, we propose to inject the preference understanding capability into LLM via a GAT expert model where the user preference is better encoded by parallelly propagating the temporal relations, and rating signals as well as various side information of historical items. The parallel propagation mechanism could stabilize heterogeneous features and offer an informative user preference encoding, which is then injected into the language models via soft prompting at the cost of a single token embedding. To further obtain the user's recent interests, we proposed a novel Recent interaction Augmented Prompt (RAP) template. Experiment results over three datasets against strong baselines validate the effectiveness of ELCoRec. The code is available at https://anonymous.4open.science/r/CIKM_Code_Repo-E6F5/README.md.


title: CFD analysis on the performance of a coaxial rotor with lift offset at high advance ratios

abstract: The aerodynamic performance of an isolated coaxial rotor in forward flight is analyzed by a high-fidelity computational fluid dynamics (CFD) approach. The analysis focuses on the high-speed forward flight with an advance ratio of 0.5 or higher. The effect of the degree of the rolling moment on the rotor thrust, called lift offset, is studied in detail. The coaxial rotor model is a pair of contrarotating rotors, each rotor consisting of two untwisted blades with a radius of 1.016 m. The pitch angle of the blades is controlled by both collective and cyclic as in a conventional single main-rotor helicopter. CFD analysis is performed using a flow solver based on the compressible Navier-Stokes equations with a Reynolds-averaged turbulence model. Laminar/turbulent transition in the boundary layer is taken into account in the calculation. The rotor trim for target forces and moments is achieved using a gradient-based delta-form blade pitch angle adjusting technique in conjunction with CFD analysis. The reliability of the calculations is confirmed by comparison with published wind tunnel experiments and two comprehensive analyses. Applying the lift offset improves the lift-to-effective drag ratio (lift-drag ratio) and reduces thrust fluctuations. However, in the case where the advance ratio exceeds 0.6, the lift-drag ratio drops significantly even if the lift offset is 0.3. The thrust fluctuation also increases with such a high advance ratio. Detailed analysis reveals that the degradation of aerodynamic performance and vibratory aerodynamic loads is closely related to the pitch angle control to compensate for the reduction in thrust on the retreating side due to the increased reverse flow region. It is effective to reduce the collective and longitudinal cyclic pitch angles for the improvement of the aerodynamic performance of coaxial rotors with an appropriate lift offset.


title: Evolution of Interfacial Hydration Structure Induced by Ion Condensation and Correlation Effects

abstract: Interfacial hydration structures are crucial in wide-ranging applications, including battery, colloid, lubrication etc. Multivalent ions like Mg2+ and La3+ show irreplaceable roles in these applications, which are hypothesized due to their unique interfacial hydration structures. However, this hypothesis lacks experimental supports. Here, using three-dimensional atomic force microscopy (3D-AFM), we provide the first observation for their interfacial hydration structures with molecular resolution. We observed the evolution of layered hydration structures at La(NO3)3 solution-mica interfaces with concentration. As concentration increases from 25 mM to 2 M, the layer number varies from 2 to 1 and back to 2, and the interlayer thickness rises from 0.25 to 0.34 nm, with hydration force increasing from 0.27+-0.07 to 1.04+-0.24 nN. Theory and molecular simulation reveal that multivalence induces concentration-dependent ion condensation and correlation effects, resulting in compositional and structural evolution within interfacial hydration structures. Additional experiments with MgCl2-mica, La(NO3)3-graphite and Al(NO3)3-mica interfaces together with literature comparison confirm the universality of this mechanism for both multivalent and monovalent ions. New factors affecting interfacial hydration structures are revealed, including concentration and solvent dielectric constant. This insight provides guidance for designing interfacial hydration structures to optimize solid-liquid-interphase for battery life extension, modulate colloid stability and develop efficient lubricants.


title: Insights into Gravitinos Abundance, Cosmic Strings and Stochastic Gravitational Wave Background

abstract: In this paper, we investigate D-term inflation within the framework of supergravity, employing the minimal Kahler potential. Our study reveals that this model can overcome the {\eta}-problem found in F-term models. Additionally, we explore reheating dynamics and gravitino production, emphasizing the interplay between reheating temperature, spectral index, and gravitino abundance. Our analysis indicates that gravitino production is sensitive to the equation of state during reheating, affecting the reheating temperature and subsequent dark matter relic density. Perturbation theory reveals that Primordial Gravitational Waves (PGWs) evolve according to second-order effects arising from first-order curvature perturbations. In fact, the spectral energy density of these waves is particularly relevant to Pulsar Timing Array (PTA) observations. Furthermore, we analyze gravitational waves generated by cosmic strings, providing critical constraints on early Universe dynamics and cosmic string properties. The dimensionless string tension significantly influences the stochastic gravitational wave background (SGWB) produced by cosmic strings post-inflation. Finally, the stochastic gravitational wave background (SGWB) produced by cosmic strings is influenced by the energy scales of inflation and string formation.


title: Full Information Linked ICA: addressing missing data problem in multimodal fusion

abstract: Recent advances in multimodal imaging acquisition techniques have allowed us to measure different aspects of brain structure and function. Multimodal fusion, such as linked independent component analysis (LICA), is popularly used to integrate complementary information. However, it has suffered from missing data, commonly occurring in neuroimaging data. Therefore, in this paper, we propose a Full Information LICA algorithm (FI-LICA) to handle the missing data problem during multimodal fusion under the LICA framework. Built upon complete cases, our method employs the principle of full information and utilizes all available information to recover the missing latent information. Our simulation experiments showed the ideal performance of FI-LICA compared to current practices. Further, we applied FI-LICA to multimodal data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) study, showcasing better performance in classifying current diagnosis and in predicting the AD transition of participants with mild cognitive impairment (MCI), thereby highlighting the practical utility of our proposed method.


title: Resonance and Damping in Drop-Cantilever Interactions

abstract: In this study, we investigated the dynamics of a droplet impacting and oscillating a polycarbonate cantilever beam of nine varying lengths. We analyzed the cantilever's damping and vibration frequency in relation to a resonance length, where the frequencies of the droplet and the cantilever are equal. In the pre-resonance length, the beam vibrates at a frequency higher than that of the droplet. Upon reaching resonance, the frequencies of both the droplet and the cantilever align, and the cantilever is out of phase with the oscillation of the droplet's apex. This leads to increased damping rates. At this resonance length, the droplet's force and the direction of the cantilever oppose each other. When the cantilever length exceeds the resonance length, it synchronize more with the droplet apex. This alignment allows the droplet force and the cantilever to work in phase. Our findings provide fundamental insights into the damping effect of droplet impacts on elastic surfaces around resonance.


title: Upshifted frequency of electromagnetic plasma waves due to reflecting gravitational waves acting as almost-luminal mirrors

abstract: We show that dispersive gravitational waves, as a background spacetime, can reflect electromagnetic waves in a plasma. This reflection upshifts the frequency of the reflected wave, being larger for low-frequency incident waves. This effect takes place when the gravitational wave background propagates almost at the speed of light, allowing it to behave similar to a luminal mirror to electromagnetic plasma waves.


title: OutlierTune: Efficient Channel-Wise Quantization for Large Language Models

abstract: Quantizing the activations of large language models (LLMs) has been a significant challenge due to the presence of structured outliers. Most existing methods focus on the per-token or per-tensor quantization of activations, making it difficult to achieve both accuracy and hardware efficiency. To address this problem, we propose OutlierTune, an efficient per-channel post-training quantization (PTQ) method for the activations of LLMs. OutlierTune consists of two components: pre-execution of dequantization and symmetrization. The pre-execution of dequantization updates the model weights by the activation scaling factors, avoiding the internal scaling and costly additional computational overheads brought by the per-channel activation quantization. The symmetrization further reduces the quantization differences arising from the weight updates by ensuring the balanced numerical ranges across different activation channels. OutlierTune is easy to implement and hardware-efficient, introducing almost no additional computational overheads during the inference. Extensive experiments show that the proposed framework outperforms existing methods across multiple different tasks. Demonstrating better generalization, this framework improves the Int6 quantization of the instruction-tuning LLMs, such as OPT-IML, to the same level as half-precision (FP16). Moreover, we have shown that the proposed framework is 1.48x faster than the FP16 implementation while reducing approximately 2x memory usage.


title: Quantum annealing-based structural optimization with a multiplicative design update

abstract: This paper presents a new structural design framework, developed based on iterative optimization via quantum annealing (QA). The novelty lies in its successful design update using an unknown design multiplier obtained by iteratively solving the optimization problems with QA. In addition, to align with density-based approaches in structural optimization, multipliers are multiplicative to represent design material and serve as design variables. In particular, structural analysis is performed on a classical computer using the finite element method, and QA is utilized for topology updating. The primary objective of the framework is to minimize compliance under an inequality volume constraint, while an encoding process for the design variable is adopted, enabling smooth iterative updates to the optimized design. The proposed framework incorporates both penalty methods and slack variables to transform the inequality constraint into an equality constraint and is implemented in a quadratic unconstrained binary optimization (QUBO) model through QA. To demonstrate its performance, design optimization is performed for both truss and continuum structures. Promising results from these applications indicate that the proposed framework is capable of creating an optimal shape and topology similar to those benchmarked by the optimality criteria (OC) method on a classical computer.


title: Eccentricity and Inclination of Massive Planets Inside Low-density Cavities: Results of 3D Simulations

abstract: We study the evolution of eccentricity and inclination of massive planets in low-density cavities of protoplanetary discs using three-dimensional (3D) simulations. When the planet's orbit is aligned with the equatorial plane of the disc, the eccentricity increases to high values of 0.7-0.9 due to the resonant interaction with the inner parts of the disc. For planets on inclined orbits, the eccentricity increases due to the Kozai-Lidov mechanism, where the disc acts as an external massive body that perturbs the planet's orbit. At small inclination angles, < 30 degrees, the resonant interaction with the inner disc strongly contributes to the eccentricity growth, while at larger angles, eccentricity growth is mainly due to the Kozai-Lidov mechanism. We conclude that planets inside low-density cavities tend to acquire high eccentricity if favorable conditions give sufficient time for growth. The final value of the planet's eccentricity, after the disc dispersal depends on the planet's mass and properties of the cavity and protoplanetary disc.


title: Approximate Minimum Sum Colorings and Maximum $k$-Colorable Subgraphs of Chordal Graphs

abstract: We give a $(1.796+\epsilon)$-approximation for the minimum sum coloring problem on chordal graphs, improving over the previous 3.591-approximation by Gandhi et al. [2005]. To do so, we also design the first polynomial-time approximation scheme for the maximum $k$-colorable subgraph problem in chordal graphs.


title: Zero-shot Composed Image Retrieval Considering Query-target Relationship Leveraging Masked Image-text Pairs

abstract: This paper proposes a novel zero-shot composed image retrieval (CIR) method considering the query-target relationship by masked image-text pairs. The objective of CIR is to retrieve the target image using a query image and a query text. Existing methods use a textual inversion network to convert the query image into a pseudo word to compose the image and text and use a pre-trained visual-language model to realize the retrieval. However, they do not consider the query-target relationship to train the textual inversion network to acquire information for retrieval. In this paper, we propose a novel zero-shot CIR method that is trained end-to-end using masked image-text pairs. By exploiting the abundant image-text pairs that are convenient to obtain with a masking strategy for learning the query-target relationship, it is expected that accurate zero-shot CIR using a retrieval-focused textual inversion network can be realized. Experimental results show the effectiveness of the proposed method.


title: Dense Monocular Motion Segmentation Using Optical Flow and Pseudo Depth Map: A Zero-Shot Approach

abstract: Motion segmentation from a single moving camera presents a significant challenge in the field of computer vision. This challenge is compounded by the unknown camera movements and the lack of depth information of the scene. While deep learning has shown impressive capabilities in addressing these issues, supervised models require extensive training on massive annotated datasets, and unsupervised models also require training on large volumes of unannotated data, presenting significant barriers for both. In contrast, traditional methods based on optical flow do not require training data, however, they often fail to capture object-level information, leading to over-segmentation or under-segmentation. In addition, they also struggle in complex scenes with substantial depth variations and non-rigid motion, due to the overreliance of optical flow. To overcome these challenges, we propose an innovative hybrid approach that leverages the advantages of both deep learning methods and traditional optical flow based methods to perform dense motion segmentation without requiring any training. Our method initiates by automatically generating object proposals for each frame using foundation models. These proposals are then clustered into distinct motion groups using both optical flow and relative depth maps as motion cues. The integration of depth maps derived from state-of-the-art monocular depth estimation models significantly enhances the motion cues provided by optical flow, particularly in handling motion parallax issues. Our method is evaluated on the DAVIS-Moving and YTVOS-Moving datasets, and the results demonstrate that our method outperforms the best unsupervised method and closely matches with the state-of-theart supervised methods.


title: Electric-field control of the perpendicular magnetization switching in ferroelectric/ferrimagnet heterostructures

abstract: Electric field control of the magnetic state in ferrimagnets holds great promise for developing spintronic devices due to low power consumption. Here, we demonstrate a non-volatile reversal of perpendicular net magnetization in a ferrimagnet by manipulating the electric-field driven polarization within the Pb (Zr0.2Ti0.8) O3 (PZT)/CoGd heterostructure. Electron energy loss spectra and X-ray absorption spectrum directly verify that the oxygen ion migration at the PZT/CoGd interface associated with reversing the polarization causes the enhanced/reduced oxidation in CoGd. Ab initio calculations further substantiate that the migrated oxygen ions can modulate the relative magnetization of Co/Gd sublattices, facilitating perpendicular net magnetization switching. Our findings offer an approach to effectively control ferrimagnetic net magnetization, holding significant implications for ferrimagnetic spintronic applications.


title: Disentangling Knowledge-based and Visual Reasoning by Question Decomposition in KB-VQA

abstract: We study the Knowledge-Based visual question-answering problem, for which given a question, the models need to ground it into the visual modality to find the answer. Although many recent works use question-dependent captioners to verbalize the given image and use Large Language Models to solve the VQA problem, the research results show they are not reasonably performing for multi-hop questions. Our study shows that replacing a complex question with several simpler questions helps to extract more relevant information from the image and provide a stronger comprehension of it. Moreover, we analyze the decomposed questions to find out the modality of the information that is required to answer them and use a captioner for the visual questions and LLMs as a general knowledge source for the non-visual KB-based questions. Our results demonstrate the positive impact of using simple questions before retrieving visual or non-visual information. We have provided results and analysis on three well-known VQA datasets including OKVQA, A-OKVQA, and KRVQA, and achieved up to 2% improvement in accuracy.


title: Shorter SPECT Scans Using Self-supervised Coordinate Learning to Synthesize Skipped Projection Views

abstract: Purpose: This study addresses the challenge of extended SPECT imaging duration under low-count conditions, as encountered in Lu-177 SPECT imaging, by developing a self-supervised learning approach to synthesize skipped SPECT projection views, thus shortening scan times in clinical settings. Methods: We employed a self-supervised coordinate-based learning technique, adapting the neural radiance field (NeRF) concept in computer vision to synthesize under-sampled SPECT projection views. For each single scan, we used self-supervised coordinate learning to estimate skipped SPECT projection views. The method was tested with various down-sampling factors (DFs=2, 4, 8) on both Lu-177 phantom SPECT/CT measurements and clinical SPECT/CT datasets, from 11 patients undergoing Lu-177 DOTATATE and 6 patients undergoing Lu-177 PSMA-617 radiopharmaceutical therapy. Results: For SPECT reconstructions, our method outperformed the use of linearly interpolated projections and partial projection views in relative contrast-to-noise-ratios (RCNR) averaged across different downsampling factors: 1) DOTATATE: 83% vs. 65% vs. 67% for lesions and 86% vs. 70% vs. 67% for kidney, 2) PSMA: 76% vs. 69% vs. 68% for lesions and 75% vs. 55% vs. 66% for organs, including kidneys, lacrimal glands, parotid glands, and submandibular glands. Conclusion: The proposed method enables reduction in acquisition time (by factors of 2, 4, or 8) while maintaining quantitative accuracy in clinical SPECT protocols by allowing for the collection of fewer projections. Importantly, the self-supervised nature of this NeRF-based approach eliminates the need for extensive training data, instead learning from each patient's projection data alone. The reduction in acquisition time is particularly relevant for imaging under low-count conditions and for protocols that require multiple-bed positions such as whole-body imaging.


title: Navigating LLM Ethics: Advancements, Challenges, and Future Directions

abstract: This study addresses ethical issues surrounding Large Language Models (LLMs) within the field of artificial intelligence. It explores the common ethical challenges posed by both LLMs and other AI systems, such as privacy and fairness, as well as ethical challenges uniquely arising from LLMs. It highlights challenges such as hallucination, verifiable accountability, and decoding censorship complexity, which are unique to LLMs and distinct from those encountered in traditional AI systems. The study underscores the need to tackle these complexities to ensure accountability, reduce biases, and enhance transparency in the influential role that LLMs play in shaping information dissemination. It proposes mitigation strategies and future directions for LLM ethics, advocating for interdisciplinary collaboration. It recommends ethical frameworks tailored to specific domains and dynamic auditing systems adapted to diverse contexts. This roadmap aims to guide responsible development and integration of LLMs, envisioning a future where ethical considerations govern AI advancements in society.


title: The global landscape of academic guidelines for generative AI and Large Language Models

abstract: The integration of Generative Artificial Intelligence (GAI) and Large Language Models (LLMs) in academia has spurred a global discourse on their potential pedagogical benefits and ethical considerations. Positive reactions highlight some potential, such as collaborative creativity, increased access to education, and empowerment of trainers and trainees. However, negative reactions raise concerns about ethical complexities, balancing innovation and academic integrity, unequal access, and misinformation risks. Through a systematic survey and text-mining-based analysis of global and national directives, insights from independent research, and eighty university-level guidelines, this study provides a nuanced understanding of the opportunities and challenges posed by GAI and LLMs in education. It emphasizes the importance of balanced approaches that harness the benefits of these technologies while addressing ethical considerations and ensuring equitable access and educational outcomes. The paper concludes with recommendations for fostering responsible innovation and ethical practices to guide the integration of GAI and LLMs in academia.


title: Yang-Baxter equations and relative Rota-Baxter operators for left-Alia algebras associated to invariant theory

abstract: Left-Alia algebras are a class of algebras with symmetric Jacobi identities. They contain several typical types of algebras as subclasses, and are closely related to the invariant theory. In this paper, we study the construction theory of left-Alia bialgebras. We introduce the notion of the left-Alia Yang-Baxter equation. We show that an antisymmetric solution of the left-Alia Yang-Baxter equation gives rise to a left-Alia bialgebra that we call triangular. The notions of relative Rota-Baxter operators of left-Alia algebras and pre-left-Alia algebras are introduced to provide antisymmetric solutions of the left-Alia Yang-Baxter equation.


title: Revisiting Backdoor Attacks against Large Vision-Language Models

abstract: Instruction tuning enhances large vision-language models (LVLMs) but raises security risks through potential backdoor attacks due to their openness. Previous backdoor studies focus on enclosed scenarios with consistent training and testing instructions, neglecting the practical domain gaps that could affect attack effectiveness. This paper empirically examines the generalizability of backdoor attacks during the instruction tuning of LVLMs for the first time, revealing certain limitations of most backdoor strategies in practical scenarios. We quantitatively evaluate the generalizability of six typical backdoor attacks on image caption benchmarks across multiple LVLMs, considering both visual and textual domain offsets. Our findings indicate that attack generalizability is positively correlated with the backdoor trigger's irrelevance to specific images/models and the preferential correlation of the trigger pattern. Additionally, we modify existing backdoor attacks based on the above key observations, demonstrating significant improvements in cross-domain scenario generalizability (+86% attack success rate). Notably, even without access to the instruction datasets, a multimodal instruction set can be successfully poisoned with a very low poisoning rate (0.2%), achieving an attack success rate of over 97%. This paper underscores that even simple traditional backdoor strategies pose a serious threat to LVLMs, necessitating more attention and in-depth research.


title: Retain, Blend, and Exchange: A Quality-aware Spatial-Stereo Fusion Approach for Event Stream Recognition

abstract: Existing event stream-based pattern recognition models usually represent the event stream as the point cloud, voxel, image, etc., and design various deep neural networks to learn their features. Although considerable results can be achieved in simple cases, however, the model performance may be limited by monotonous modality expressions, sub-optimal fusion, and readout mechanisms. In this paper, we propose a novel dual-stream framework for event stream-based pattern recognition via differentiated fusion, termed EFV++. It models two common event representations simultaneously, i.e., event images and event voxels. The spatial and three-dimensional stereo information can be learned separately by utilizing Transformer and Graph Neural Network (GNN). We believe the features of each representation still contain both efficient and redundant features and a sub-optimal solution may be obtained if we directly fuse them without differentiation. Thus, we divide each feature into three levels and retain high-quality features, blend medium-quality features, and exchange low-quality features. The enhanced dual features will be fed into the fusion Transformer together with bottleneck features. In addition, we introduce a novel hybrid interaction readout mechanism to enhance the diversity of features as final representations. Extensive experiments demonstrate that our proposed framework achieves state-of-the-art performance on multiple widely used event stream-based classification datasets. Specifically, we achieve new state-of-the-art performance on the Bullying10k dataset, i.e., $90.51\%$, which exceeds the second place by $+2.21\%$. The source code of this paper has been released on \url{https://github.com/Event-AHU/EFV_event_classification/tree/EFVpp}.


title: AFBench: A Large-scale Benchmark for Airfoil Design

abstract: Data-driven generative models have emerged as promising approaches towards achieving efficient mechanical inverse design. However, due to prohibitively high cost in time and money, there is still lack of open-source and large-scale benchmarks in this field. It is mainly the case for airfoil inverse design, which requires to generate and edit diverse geometric-qualified and aerodynamic-qualified airfoils following the multimodal instructions, \emph{i.e.,} dragging points and physical parameters. This paper presents the open-source endeavors in airfoil inverse design, \emph{AFBench}, including a large-scale dataset with 200 thousand airfoils and high-quality aerodynamic and geometric labels, two novel and practical airfoil inverse design tasks, \emph{i.e.,} conditional generation on multimodal physical parameters, controllable editing, and comprehensive metrics to evaluate various existing airfoil inverse design methods. Our aim is to establish \emph{AFBench} as an ecosystem for training and evaluating airfoil inverse design methods, with a specific focus on data-driven controllable inverse design models by multimodal instructions capable of bridging the gap between ideas and execution, the academic research and industrial applications. We have provided baseline models, comprehensive experimental observations, and analysis to accelerate future research. Our baseline model is trained on an RTX 3090 GPU within 16 hours. The codebase, datasets and benchmarks will be available at \url{https://hitcslj.github.io/afbench/}.


title: Learning Retrieval Augmentation for Personalized Dialogue Generation

abstract: Personalized dialogue generation, focusing on generating highly tailored responses by leveraging persona profiles and dialogue context, has gained significant attention in conversational AI applications. However, persona profiles, a prevalent setting in current personalized dialogue datasets, typically composed of merely four to five sentences, may not offer comprehensive descriptions of the persona about the agent, posing a challenge to generate truly personalized dialogues. To handle this problem, we propose $\textbf{L}$earning Retrieval $\textbf{A}$ugmentation for $\textbf{P}$ersonalized $\textbf{D}$ial$\textbf{O}$gue $\textbf{G}$eneration ($\textbf{LAPDOG}$), which studies the potential of leveraging external knowledge for persona dialogue generation. Specifically, the proposed LAPDOG model consists of a story retriever and a dialogue generator. The story retriever uses a given persona profile as queries to retrieve relevant information from the story document, which serves as a supplementary context to augment the persona profile. The dialogue generator utilizes both the dialogue history and the augmented persona profile to generate personalized responses. For optimization, we adopt a joint training framework that collaboratively learns the story retriever and dialogue generator, where the story retriever is optimized towards desired ultimate metrics (e.g., BLEU) to retrieve content for the dialogue generator to generate personalized responses. Experiments conducted on the CONVAI2 dataset with ROCStory as a supplementary data source show that the proposed LAPDOG method substantially outperforms the baselines, indicating the effectiveness of the proposed method. The LAPDOG model code is publicly available for further exploration. https://github.com/hqsiswiliam/LAPDOG


title: Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data Imputation

abstract: Wearable sensors enable health researchers to continuously collect data pertaining to the physiological state of individuals in real-world settings. However, such data can be subject to extensive missingness due to a complex combination of factors. In this work, we study the problem of imputation of missing step count data, one of the most ubiquitous forms of wearable sensor data. We construct a novel and large scale data set consisting of a training set with over 3 million hourly step count observations and a test set with over 2.5 million hourly step count observations. We propose a domain knowledge-informed sparse self-attention model for this task that captures the temporal multi-scale nature of step-count data. We assess the performance of the model relative to baselines and conduct ablation studies to verify our specific model designs.


title: Dysca: A Dynamic and Scalable Benchmark for Evaluating Perception Ability of LVLMs

abstract: Currently many benchmarks have been proposed to evaluate the perception ability of the Large Vision-Language Models (LVLMs). However, most benchmarks conduct questions by selecting images from existing datasets, resulting in the potential data leakage. Besides, these benchmarks merely focus on evaluating LVLMs on the realistic style images and clean scenarios, leaving the multi-stylized images and noisy scenarios unexplored. In response to these challenges, we propose a dynamic and scalable benchmark named Dysca for evaluating LVLMs by leveraging synthesis images. Specifically, we leverage Stable Diffusion and design a rule-based method to dynamically generate novel images, questions and the corresponding answers. We consider 51 kinds of image styles and evaluate the perception capability in 20 subtasks. Moreover, we conduct evaluations under 4 scenarios (i.e., Clean, Corruption, Print Attacking and Adversarial Attacking) and 3 question types (i.e., Multi-choices, True-or-false and Free-form). Thanks to the generative paradigm, Dysca serves as a scalable benchmark for easily adding new subtasks and scenarios. A total of 8 advanced open-source LVLMs with 10 checkpoints are evaluated on Dysca, revealing the drawbacks of current LVLMs. The benchmark is released in \url{https://github.com/Benchmark-Dysca/Dysca}.


title: RAVE: A Framework for Radar Ego-Velocity Estimation

abstract: State estimation is an essential component of autonomous systems, usually relying on sensor fusion that integrates data from cameras, LiDARs and IMUs. Recently, radars have shown the potential to improve the accuracy and robustness of state estimation and perception, especially in challenging environmental conditions such as adverse weather and low-light scenarios. In this paper, we present a framework for ego-velocity estimation, which we call RAVE, that relies on 3D automotive radar data and encompasses zero velocity detection, outlier rejection, and velocity estimation. In addition, we propose a simple filtering method to discard infeasible ego-velocity estimates. We also conduct a systematic analysis of how different existing outlier rejection techniques and optimization loss functions impact estimation accuracy. Our evaluation on three open-source datasets demonstrates the effectiveness of the proposed filter and a significant positive impact of RAVE on the odometry accuracy. Furthermore, we release an open-source implementation of the proposed framework for radar ego-velocity estimation accompanied with a ROS interface.


title: LICO: Large Language Models for In-Context Molecular Optimization

abstract: Optimizing black-box functions is a fundamental problem in science and engineering. To solve this problem, many approaches learn a surrogate function that estimates the underlying objective from limited historical evaluations. Large Language Models (LLMs), with their strong pattern-matching capabilities via pretraining on vast amounts of data, stand out as a potential candidate for surrogate modeling. However, directly prompting a pretrained language model to produce predictions is not feasible in many scientific domains due to the scarcity of domain-specific data in the pretraining corpora and the challenges of articulating complex problems in natural language. In this work, we introduce LICO, a general-purpose model that extends arbitrary base LLMs for black-box optimization, with a particular application to the molecular domain. To achieve this, we equip the language model with a separate embedding layer and prediction layer, and train the model to perform in-context predictions on a diverse set of functions defined over the domain. Once trained, LICO can generalize to unseen molecule properties simply via in-context prompting. LICO achieves state-of-the-art performance on PMO, a challenging molecular optimization benchmark comprising over 20 objective functions.

categories: cs.LG cs.AI physics.chem-ph q-bio.BM q-bio.QM


title: A Microscopic Estimation of the Splay Elastic Constant K11 for Nematic Liquid Crystals

abstract: A theory of the relationship between splay elastic constant K11 and permanent molecular moment of liquid crystals is developed. The theory gives a microscopic estimation of K11 with a correct order of magnitude by calculating the electrostatic energy density between the adjacent molecules.


title: Decoding-Time Language Model Alignment with Multiple Objectives

abstract: Aligning language models (LMs) to human preferences has emerged as a critical pursuit, enabling these models to better serve diverse user needs. Existing methods primarily focus on optimizing LMs for a single reward function, limiting their adaptability to varied objectives. Here, we propose $\textbf{multi-objective decoding (MOD)}$, a decoding-time algorithm that outputs the next token from a linear combination of predictions of all base models, for any given weightings over different objectives. We exploit a common form among a family of $f$-divergence regularized alignment approaches (such as PPO, DPO, and their variants) to identify a closed-form solution by Legendre transform, and derive an efficient decoding strategy. Theoretically, we show why existing approaches can be sub-optimal even in natural settings and obtain optimality guarantees for our method. Empirical results demonstrate the effectiveness of the algorithm. For example, compared to a parameter-merging baseline, MOD achieves 12.8% overall reward improvement when equally optimizing towards $3$ objectives. Moreover, we experiment with MOD on combining three fully-finetuned LLMs of different model sizes, each aimed at different objectives such as safety, coding, and general user preference. Unlike traditional methods that require careful curation of a mixture of datasets to achieve comprehensive improvement, we can quickly experiment with preference weightings using MOD to find the best combination of models. Our best combination reduces toxicity on Toxigen to nearly 0% and achieves 7.9--33.3% improvement across other three metrics ($\textit{i.e.}$, Codex@1, GSM-COT, BBH-COT).


title: What Is Missing In Homophily? Disentangling Graph Homophily For Graph Neural Networks

abstract: Graph homophily refers to the phenomenon that connected nodes tend to share similar characteristics. Understanding this concept and its related metrics is crucial for designing effective Graph Neural Networks (GNNs). The most widely used homophily metrics, such as edge or node homophily, quantify such "similarity" as label consistency across the graph topology. These metrics are believed to be able to reflect the performance of GNNs, especially on node-level tasks. However, many recent studies have empirically demonstrated that the performance of GNNs does not always align with homophily metrics, and how homophily influences GNNs still remains unclear and controversial. Then, a crucial question arises: What is missing in our current understanding of homophily? To figure out the missing part, in this paper, we disentangle the graph homophily into $3$ aspects: label, structural, and feature homophily, providing a more comprehensive understanding of GNN performance. To investigate their synergy, we propose a Contextual Stochastic Block Model with $3$ types of Homophily (CSBM-3H), where the topology and feature generation are controlled by the $3$ metrics. Based on the theoretical analysis of CSBM-3H, we derive a new composite metric, named Tri-Hom, that considers all $3$ aspects and overcomes the limitations of conventional homophily metrics. The theoretical conclusions and the effectiveness of Tri-Hom have been verified through synthetic experiments on CSBM-3H. In addition, we conduct experiments on $31$ real-world benchmark datasets and calculate the correlations between homophily metrics and model performance. Tri-Hom has significantly higher correlation values than $17$ existing metrics that only focus on a single homophily aspect, demonstrating its superiority and the importance of homophily synergy. Our code is available at \url{https://github.com/zylMozart/Disentangle_GraphHom}.


title: Limiting partition function for the Mallows model: a conjecture and partial evidence

abstract: Let $S_n$ denote the set of permutations of $n$ labels. We consider a class of Gibbs probability models on $S_n$ that is a subfamily of the so-called Mallows model of random permutations. The Gibbs energy is given by a class of right invariant divergences on $S_n$ that includes common choices such as the Spearman foot rule and the Spearman rank correlation. Mukherjee in 2016 computed the limit of the (scaled) log partition function (i.e. normalizing factor) of such models as $n\rightarrow \infty$. Our objective is to compute the exact limit, as $n\rightarrow \infty$, without the log. We conjecture that this limit is given by the Fredholm determinant of an integral operator related to the so-called Schr\"odinger bridge probability distributions from optimal transport theory. We provide partial evidence for this conjecture, although the argument lacks a final error bound that is needed for it to become a complete proof.


title: FFN: a Fine-grained Chinese-English Financial Domain Parallel Corpus

abstract: Large Language Models (LLMs) have stunningly advanced the field of machine translation, though their effectiveness within the financial domain remains largely underexplored. To probe this issue, we constructed a fine-grained Chinese-English parallel corpus of financial news called FFN. We acquired financial news articles spanning between January 1st, 2014, to December 31, 2023, from mainstream media websites such as CNN, FOX, and China Daily. The dataset consists of 1,013 main text and 809 titles, all of which have been manually corrected. We measured the translation quality of two LLMs -- ChatGPT and ERNIE-bot, utilizing BLEU, TER and chrF scores as the evaluation metrics. For comparison, we also trained an OpenNMT model based on our dataset. We detail problems of LLMs and provide in-depth analysis, intending to stimulate further research and solutions in this largely uncharted territory. Our research underlines the need to optimize LLMs within the specific field of financial translation to ensure accuracy and quality.


title: Radiative decay and axial-vector decay behaviors of octet pentaquark states

abstract: In this work, we systematically calculate transition magnetic moments, radiative decay widths, and axial-vector coupling constants of octet hidden-charm molecular pentaquark states with different flavor representations in constituent quark model. We discuss the relations between transition magnetic moments and decay widths for pentaquark states. For octet pentaquark states with the $8_{1f}$ and $8_{2f}$ flavor representations, decay widths of the processes $P_{\psi}|\frac{3}{2}^-\rangle_{(\frac{1}{2}^+\otimes1^-)}\to P_{\psi}|\frac{1}{2}^-\rangle_{(\frac{1}{2}^+\otimes0^-)}\gamma$ and $P_{\psi}|\frac{1}{2}^-\rangle_{(\frac{1}{2}^+\otimes1^-)}\to P_{\psi}|\frac{1}{2}^-\rangle_{(\frac{1}{2}^+\otimes0^-)}\gamma$ are quite close, decay widths of the $P_{\psi}|\frac{3}{2}^-\rangle_{(\frac{1}{2}^+\otimes1^-)}\to P_{\psi}|\frac{1}{2}^-\rangle_{(\frac{1}{2}^+\otimes1^-)}\gamma$ process are close to zero, and we notice that the axial-vector coupling constants of the pentaquark states are generally smaller than that of the nucleon.


title: On-off switchable nonreciprocal negative refraction in non-Hermitian photon-magnon hybrid systems

abstract: Photon-magnon coupling, where electromagnetic waves interact with spin waves, and negative refraction, which bends the direction of electromagnetic waves unnaturally, constitute critical foundations and advancements in the realms of optics, spintronics, and quantum information technology. Here, we explore a magnetic-field-controlled, on-off switchable, nonreciprocal negative refraction within a non-Hermitian photon-magnon hybrid system. By integrating an yttrium iron garnet film with an inverted split-ring resonator, we discover pronounced negative refraction driven by the system's non-Hermitian properties. This phenomenon exhibits unique nonreciprocal behavior dependent on the signal's propagation direction. Our analytical model sheds light on the crucial interplay between coherent and dissipative coupling, significantly altering permittivity and permeability's imaginary components, crucial for negative refraction's emergence. This work pioneers new avenues for employing negative refraction in photon-magnon hybrid systems, signaling substantial advancements in quantum hybrid systems.


title: Two-Pronged Human Evaluation of ChatGPT Self-Correction in Radiology Report Simplification

abstract: Radiology reports are highly technical documents aimed primarily at doctor-doctor communication. There has been an increasing interest in sharing those reports with patients, necessitating providing them patient-friendly simplifications of the original reports. This study explores the suitability of large language models in automatically generating those simplifications. We examine the usefulness of chain-of-thought and self-correction prompting mechanisms in this domain. We also propose a new evaluation protocol that employs radiologists and laypeople, where radiologists verify the factual correctness of simplifications, and laypeople assess simplicity and comprehension. Our experimental results demonstrate the effectiveness of self-correction prompting in producing high-quality simplifications. Our findings illuminate the preferences of radiologists and laypeople regarding text simplification, informing future research on this topic.


title: A Thermo-Electro-Mechanical Model for Long-Term Reliability of Aging Transmission Lines

abstract: Integrity and reliability of a national power grid system are essential to society's development and security. Among the power grid components, transmission lines are critical due to exposure and vulnerability to severe external conditions, including high winds, ice, and extreme temperatures. The combined effects of external agents with high electrical load and presence of damage precursors greatly affects the conducting material's properties due to a thermal runaway cycle that accelerates the aging process. In this paper, we develop a thermo-electro-mechanical model for long-term failure analysis of overhead transmission lines. A phase-field model of damage and fatigue, coupled with electrical and thermal modules, provides a detailed description of the conductor's temperature evolution. We define a limit state function based on maximum operating temperature to avoid excessive overheating and sagging. We study four representative scenarios deterministically, and propose the Probabilistic Collocation Method (PCM) as a tool to understand the stochastic behavior of the system. We use PCM in forward parametric uncertainty quantification, global sensitivity analysis, and computation of failure probability curves in a straightforward and computationally efficient fashion, and we quantify the most influential parameters that affect the failure predictability from a physics-based perspective.


title: Predicting the duration of traffic incidents for Sydney greater metropolitan area using machine learning methods

abstract: This research presents a comprehensive approach to predicting the duration of traffic incidents and classifying them as short-term or long-term across the Sydney Metropolitan Area. Leveraging a dataset that encompasses detailed records of traffic incidents, road network characteristics, and socio-economic indicators, we train and evaluate a variety of advanced machine learning models including Gradient Boosted Decision Trees (GBDT), Random Forest, LightGBM, and XGBoost. The models are assessed using Root Mean Square Error (RMSE) for regression tasks and F1 score for classification tasks. Our experimental results demonstrate that XGBoost and LightGBM outperform conventional models with XGBoost achieving the lowest RMSE of 33.7 for predicting incident duration and highest classification F1 score of 0.62 for a 30-minute duration threshold. For classification, the 30-minute threshold balances performance with 70.84\% short-term duration classification accuracy and 62.72\% long-term duration classification accuracy. Feature importance analysis, employing both tree split counts and SHAP values, identifies the number of affected lanes, traffic volume, and types of primary and secondary vehicles as the most influential features. The proposed methodology not only achieves high predictive accuracy but also provides stakeholders with vital insights into factors contributing to incident durations. These insights enable more informed decision-making for traffic management and response strategies. The code is available by the link: https://github.com/Future-Mobility-Lab/SydneyIncidents


title: Streaming Decoder-Only Automatic Speech Recognition with Discrete Speech Units: A Pilot Study

abstract: Unified speech-text models like SpeechGPT, VioLA, and AudioPaLM have shown impressive performance across various speech-related tasks, especially in Automatic Speech Recognition (ASR). These models typically adopt a unified method to model discrete speech and text tokens, followed by training a decoder-only transformer. However, they are all designed for non-streaming ASR tasks, where the entire speech utterance is needed during decoding. Hence, we introduce a decoder-only model exclusively designed for streaming recognition, incorporating a dedicated boundary token to facilitate streaming recognition and employing causal attention masking during the training phase. Furthermore, we introduce right-chunk attention and various data augmentation techniques to improve the model's contextual modeling abilities. While achieving streaming speech recognition, experiments on the AISHELL-1 and -2 datasets demonstrate the competitive performance of our streaming approach with non-streaming decoder-only counterparts.


title: The observable diameter of metric measure spaces and the existence of points of positive measures

abstract: A metric measure space is a metric space with a Borel measure. In Gromov's theory of metric measure spaces, there are important invariants called the partial diameter and the observable diameter. We obtain the result that the partial diameter or the observable diameter equals zero if and only if there exists a point that has positive measure.


title: Learning Modality Knowledge Alignment for Cross-Modality Transfer

abstract: Cross-modality transfer aims to leverage large pretrained models to complete tasks that may not belong to the modality of pretraining data. Existing works achieve certain success in extending classical finetuning to cross-modal scenarios, yet we still lack understanding about the influence of modality gap on the transfer. In this work, a series of experiments focusing on the source representation quality during transfer are conducted, revealing the connection between larger modality gap and lesser knowledge reuse which means ineffective transfer. We then formalize the gap as the knowledge misalignment between modalities using conditional distribution P(Y|X). Towards this problem, we present Modality kNowledge Alignment (MoNA), a meta-learning approach that learns target data transformation to reduce the modality knowledge discrepancy ahead of the transfer. Experiments show that out method enables better reuse of source modality knowledge in cross-modality transfer, which leads to improvements upon existing finetuning methods.


title: From Biased Selective Labels to Pseudo-Labels: An Expectation-Maximization Framework for Learning from Biased Decisions

abstract: Selective labels occur when label observations are subject to a decision-making process; e.g., diagnoses that depend on the administration of laboratory tests. We study a clinically-inspired selective label problem called disparate censorship, where labeling biases vary across subgroups and unlabeled individuals are imputed as "negative" (i.e., no diagnostic test = no illness). Machine learning models naively trained on such labels could amplify labeling bias. Inspired by causal models of selective labels, we propose Disparate Censorship Expectation-Maximization (DCEM), an algorithm for learning in the presence of disparate censorship. We theoretically analyze how DCEM mitigates the effects of disparate censorship on model performance. We validate DCEM on synthetic data, showing that it improves bias mitigation (area between ROC curves) without sacrificing discriminative performance (AUC) compared to baselines. We achieve similar results in a sepsis classification task using clinical data.


title: Tent Carleson measures and superposition operators on Hardy type tent spaces

abstract: In this paper, we completely characterize the positive Borel measures $\mu$ on the unit ball $\mathbb{B}_n$ of $\mathbb{C}^n$ such that the Carleson embedding from holomorphic Hardy type tent spaces $\mathcal{HT}^p_{q,\alpha}$ into the tent spaces $T^t_s(\mu)$ is bounded for all $0<p,q,s,t<\infty$ and $\alpha>-n-1$. As an application, we determine the indices $0<p,q,s,t<\infty$ and $\alpha,\beta>-n-1$ such that the inclusion $\mathcal{HT}^p_{q,\alpha}\subset\mathcal{HT}^t_{s,\beta}$ holds, which allows us to completely characterize the nonlinear superposition operators between Hardy type tent spaces.


title: Magneto-Rayleigh-Taylor instability and feedthrough in a resistive liquid-metal liner of a finite thickness

abstract: The effect of magnetic tension and diffusion on the perturbation growth of a liquid-metal liner subjected to the magneto-Rayleigh-Taylor (MRT) instability is investigated. An initially magnetic-field-free liquid-metal slab of finite thickness is surrounded by two lower-density regions. Within the lower region, a constant axial magnetic field of arbitrary magnitude is applied. The numerical examination of the MRT instability growth, initiated by a seeded perturbation parallel to the magnetic field at the liner's unstable interface, is performed for both perfectly conductive and resistive liners. To this end, a novel level set-based two-phase incompressible solver for ideal/resistive magnetohydrodynamic (MHD) flows within the finite-difference framework is introduced. Utilizing the implemented numerical toolkit, the impact of different Alfven numbers and magnetic Reynolds numbers on the MRT growth rate and feedthrough at the upper interface of the liner is studied. Accounting for the finite resistivity of the liner results in an increase in the MRT growth and feedthrough compared to the ideal MHD case. The results indicate that magnetic diffusion primarily affects the MRT growth rate for higher wavenumbers, while for smaller wavenumbers, the effect of finite resistivity is only observed over a longer duration of instability development. We further demonstrate that decreasing the Alfven number results in the faster emergence of the magnetic diffusion effect on the MRT growth rate. It is also observed that a greater electrical conductivity jump across the liner results in an increased perturbation growth. Lastly, the impact of surface tension on MRT instability growth for both ideal and resistive MHD cases is studied across different wavenumbers, specifically for Bond numbers related to fusion applications.


title: Advancing Cross-domain Discriminability in Continual Learning of Vison-Language Models

abstract: Continual learning (CL) with Vision-Language Models (VLMs) has overcome the constraints of traditional CL, which only focuses on previously encountered classes. During the CL of VLMs, we need not only to prevent the catastrophic forgetting on incrementally learned knowledge but also to preserve the zero-shot ability of VLMs. However, existing methods require additional reference datasets to maintain such zero-shot ability and rely on domain-identity hints to classify images across different domains. In this study, we propose Regression-based Analytic Incremental Learning (RAIL), which utilizes a recursive ridge regression-based adapter to learn from a sequence of domains in a non-forgetting manner and decouple the cross-domain correlations by projecting features to a higher-dimensional space. Cooperating with a training-free fusion module, RAIL absolutely preserves the VLM's zero-shot ability on unseen domains without any reference data. Additionally, we introduce Cross-domain Task-Agnostic Incremental Learning (X-TAIL) setting. In this setting, a CL learner is required to incrementally learn from multiple domains and classify test images from both seen and unseen domains without any domain-identity hint. We theoretically prove RAIL's absolute memorization on incrementally learned domains. Experiment results affirm RAIL's state-of-the-art performance in both X-TAIL and existing Multi-domain Task-Incremental Learning settings. The code will be released upon acceptance.


title: Chemical Continuous Time Random Walks under Anomalous Diffusion

abstract: Chemical master equation plays an important role to describe the time evolution of homogeneous chemical system. In addition to the reaction process, it is also accompanied by physical diffusion of the reactants in complex system that is generally not homogeneous, which will result in non-exponential waiting times for particle reactions and diffusion. In this paper we shall introduce a chemical continuous time random walk under anomalous diffusion model based on renewal process to describe the general reaction-diffusion process in the heterogeneous system, where the waiting times are arbitrary distributed. According to this model, we will develop the systematic stochastic theory including generalizing the chemical diffusion master equation, deriving the corresponding mass action law, and extending the Gillespie algorithm. As an example, we analyze the monomolecular $A\leftrightarrow B$ reaction-diffusion system for exponential and power-law waiting times respectively, and show the strong fractional memory effect of the concentration of the reactants on the history of the concentration in power-law case.


title: Exact results on traces of sets

abstract: For non-negative integers $n$, $m$, $a$ and $b$, we write $\left( n,m \right) \rightarrow \left( a,b \right)$ if for every family $\mathcal{F}\subseteq 2^{[n]}$ with $|\mathcal{F}|\geqslant m$ there is an $a$-element set $T\subseteq [n]$ such that $\left| \mathcal{F}_{\mid T} \right| \geqslant b$, where $\mathcal{F}_{\mid T}=\{ F \cap T : F \in \mathcal{F} \}$. A longstanding problem in extremal set theory asks to determine $m(s)=\lim_{n\rightarrow +\infty}\frac{m(n,s)}{n}$, where $m(n,s)$ denotes the maximum integer $m$ such that $\left( n,m \right) \rightarrow \left( n-1,m-s \right)$ holds for non-negatives $n$ and $s$. In this paper, we establish the exact value of $m(2^{d-1}-c)$ for all $1\leqslant c\leqslant d$ whenever $d\geqslant 50$, thereby solving an open problem posed by Piga and Sch\"{u}lke. To be precise, we show that $$m(n,2^{d-1}-c)=\frac{2^{d}-c}{d}n \mbox{ for } 1\leq c\leq d-1 \mbox{ and } d\mid n, \mbox{ and } m(n,2^{d-1}-d)=\frac{2^{d}-d-0.5}{d}n \mbox{ for } 2d\mid n $$ holds for $d\geq 50$. Furthermore, we provide a proof that confirms a conjecture of Frankl and Watanabe from 1994, demonstrating that $m(11)=5.3$.


title: DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment

abstract: Recent speech language models (SLMs) typically incorporate pre-trained speech models to extend the capabilities from large language models (LLMs). In this paper, we propose a Descriptive Speech-Text Alignment approach that leverages speech captioning to bridge the gap between speech and text modalities, enabling SLMs to interpret and generate comprehensive natural language descriptions, thereby facilitating the capability to understand both linguistic and non-linguistic features in speech. Enhanced with the proposed approach, our model demonstrates superior performance on the Dynamic-SUPERB benchmark, particularly in generalizing to unseen tasks. Moreover, we discover that the aligned model exhibits a zero-shot instruction-following capability without explicit speech instruction tuning. These findings highlight the potential to reshape instruction-following SLMs by incorporating rich, descriptive speech captions.


title: Efficacy of Language Model Self-Play in Non-Zero-Sum Games

abstract: Game-playing agents like AlphaGo have achieved superhuman performance through self-play, which is theoretically guaranteed to yield optimal policies in competitive games. However, most language tasks are partially or fully cooperative, so it is an open question whether techniques like self-play can effectively be used to improve language models. We empirically investigate this question in a negotiation game setting known as Deal or No Deal (DoND). Crucially, the objective in DoND can be modified to produce a fully cooperative game, a strictly competitive one, or anything in between. We finetune language models in self-play over multiple rounds of filtered behavior cloning in DoND for each of these objectives. Contrary to expectations, we find that language model self-play leads to significant performance gains in both cooperation and competition with humans, suggesting that self-play and related techniques have promise despite a lack of theoretical guarantees.


title: LayoutCopilot: An LLM-powered Multi-agent Collaborative Framework for Interactive Analog Layout Design

abstract: Analog layout design heavily involves interactive processes between humans and design tools. The tools are usually designed to use scripting commands or visualized buttons for manipulation, especially for those interactive automation functionalities, which have a steep learning curve and cumbersome user experience, making a notable barrier to their adoption by designers. Aiming to address such a usability issue, this paper introduces LayoutCopilot, a pioneering multi-agent collaborative framework powered by Large Language Models (LLMs) for interactive analog layout design. LayoutCopilot simplifies human-tool interaction by converting natural language instructions into executable script commands, and it interprets high-level design intents into actionable suggestions, significantly streamlining the design process. Experimental results demonstrate the flexibility, efficiency, and accessibility of LayoutCopilot in handling real-world analog designs.


title: Optimal version of the fundamental theorem of chronogeometry

abstract: We study lightlikeness preserving mappings from the $4$-dimensional Minkowski spacetime $\mathcal{M}_4$ to itself under no additional regularity assumptions like continuity, surjectivity, or injectivity. We prove that such a mapping $\phi$ satisfies one of the following three conditions. (1) The mapping $\phi$ can be written as a composition of a Lorentz transformation, a multiplication by a positive scalar, and a translation. (2) There is an event $r\in \mathcal{M}_4$ such that $\phi(\mathcal{M}_4\setminus\{r\})$ is contained in one light cone. (3) There is a lightlike line $\ell$ such that $\phi(\mathcal{M}_4\setminus \ell)$ is contained in another lightlike line. Here, a line that is contained in some light cone in $\mathcal{M}_4$ is called a lightlike line. We also give several similar results on mappings defined on a certain subset of $\mathcal{M}_4$ or the compactification of $\mathcal{M}_4$.


title: Design of ANF/MXene/SSG sandwich structure with electromagnetic shielding performance and impact resistance

abstract: Since entering the information era, electronic devices gradually play an important role in daily lives. However, the abuse of electronic devices leads to corresponding electromagnetic EM wave pollution. The complex external environment causes the potential for physical impact. In this work, an ANF MXene SSG flexible sandwich structure was fabricated according to methods of vacuum filtration, directional freeze-casting solidification, and polyurethane encapsulation. Apart from its excellent protection function, the sandwich structure also acts as a human body movement sensor.


title: Ordered bases, order-preserving automorphisms and bi-orderable link groups

abstract: We give a new criterion which guarantees that a free group admits a bi-ordering that is invariant under a given automorphism. As an application, we show that the fundamental group of the "magic manifold" is bi-orderable, answering a question of Kin and Rolfsen.


title: Anomalous Random Neural Networks: a Special Renewal Process

abstract: In this paper we propose an open anomalous semi-Markovian random neural networks model with negative and positive signals with arbitrary random waiting times. We investigate the signal flow process in the anomalous random neural networks based on renewal process, and obtain the corresponding master equation for time evolution of the probability of the potential of the neurons. As examples, we discuss the special cases of exponential waiting times and power law ones, and find the fractional memory effect of the probability of the system state on its history evolution. Besides, the closed random neural networks model is introduced and the corresponding rate equation is given.


title: Gluonic contributions to the pion parton distribution functions

abstract: We investigate the role of a dynamical gluon in the pion within the Basis Light-Front Quantization (BLFQ) framework and compare it with the solution of the Minkowski space Bethe-Salpeter equation, focusing on contributions beyond the valence state. Particularly in BLFQ, we identify the effect on the pion structure of the dynamical chiral symmetry breaking by the enhancement of the spin-flip matrix element, through the $|q\bar qg\rangle$ component of the light-front wave function and associated gluon parton distribution function (PDF). We explicitly show an enhancement of the low-$x$ contribution in the quark PDF associated with the large spin-flip matrix element, necessary to provide the $\pi-\rho$ mass splitting.


title: A New Diophantine Approximation Inequality on Surfaces and Its Applications

abstract: We prove a Diophantine approximation inequality for closed subschemes on surfaces which can be viewed as a joint generalization of recent inequalities of Ru-Vojta and Heier-Levin in this context. As applications, we study various Diophantine problems on affine surfaces given as the complement of three numerically parallel ample projective curves: inequalities involving greatest common divisors, degeneracy of integral points, and related Diophantine equations including families of S-unit equations. We state analogous results in the complex analytic setting, where our main result is an inequality of Second Main Theorem type for surfaces, with applications to the study and value distribution theory of holomorphic curves in surfaces.


title: SSP: Self-Supervised Prompting for Cross-Lingual Transfer to Low-Resource Languages using Large Language Models

abstract: Recently, very large language models (LLMs) have shown exceptional performance on several English NLP tasks with just in-context learning (ICL), but their utility in other languages is still underexplored. We investigate their effectiveness for NLP tasks in low-resource languages (LRLs), especially in the setting of zero-labelled cross-lingual transfer (0-CLT), where no labelled training data for the target language is available -- however training data from one or more related medium-resource languages (MRLs) is utilized, alongside the available unlabeled test data for a target language. We introduce Self-Supervised Prompting (SSP), a novel ICL approach tailored for the 0-CLT setting. SSP is based on the key observation that LLMs output more accurate labels if in-context exemplars are from the target language (even if their labels are slightly noisy). To operationalize this, since target language training data is not available in 0-CLT, SSP operates in two stages. In Stage I, using source MRL training data, target language's test data is noisily labeled. In Stage II, these noisy test data points are used as exemplars in ICL for further improved labelling. Additionally, our implementation of SSP uses a novel Integer Linear Programming (ILP)-based exemplar selection that balances similarity, prediction confidence (when available) and label coverage. Experiments on three tasks and eleven LRLs (from three regions) demonstrate that SSP strongly outperforms existing SOTA fine-tuned and prompting-based baselines in 0-CLT setup.


title: A Wireless, Multicolor Fluorescence Image Sensor Implant for Real-Time Monitoring in Cancer Therapy

abstract: Real-time monitoring of dynamic biological processes in the body is critical to understanding disease progression and treatment response. This data, for instance, can help address the lower than 50% response rates to cancer immunotherapy. However, current clinical imaging modalities lack the molecular contrast, resolution, and chronic usability for rapid and accurate response assessments. Here, we present a fully wireless image sensor featuring a 2.5$\times$5 mm$^2$ CMOS integrated circuit for multicolor fluorescence imaging deep in tissue. The sensor operates wirelessly via ultrasound (US) at 5 cm depth in oil, harvesting energy with 221 mW/cm$^{2}$ incident US power density (31% of FDA limits) and backscattering data at 13 kbps with a bit error rate <$10^{-6}$. In-situ fluorescence excitation is provided by micro-laser diodes controlled with a programmable on-chip driver. An optical frontend combining a multi-bandpass interference filter and a fiber optic plate provides >6 OD excitation blocking and enables three-color imaging for detecting multiple cell types. A 36$\times$40-pixel array captures images with <125 $\mu$m resolution. We demonstrate wireless, dual-color fluorescence imaging of both effector and suppressor immune cells in ex vivo mouse tumor samples with and without immunotherapy. These results show promise for providing rapid insight into therapeutic response and resistance, guiding personalized medicine.


title: Anomalous random networks

abstract: After the groundbreaking work of Erd$\ddot{o}$s-R$\acute{e}$nyi random graph, the random networks has made great progress in recent years. One of the eye-catching modeling is time-varying random network model capable of encoding the instantaneous time description of the network dynamics. To further describe the random duration time for the nodes to be inactive, we herein propose a dinner party anomalous random networks model, and derive the analytical solution of the probability density function for the node being active at a given time. Moreover, we investigate the gift delivery and viral transmission in dinner party random networks. This work provides new quantitative insights in describing random networks, and could help model other uncertainty phenomena in real networks.


title: Galaxies Ages with Redshift z=2 to 4: Stellar Population Synthesis for Candidates in FourStar Galaxy Evolution Survey

abstract: Observations of large amount of massive galaxies with relatively old populations found at high redshifts are challenging galaxy formation scenarios within standard cosmology. Precise determinations of the average age of these galaxies would be useful for the discussion of this problem. Here we carry out a better constraint of the age of 200 V-shaped SED non-AGN galaxies at redshifts $2<z<4$ of the catalog of FourStar Galaxy Evolution Survey, identified by V-shape in their spectral energy distribution (SED) with a Lyman and a Balmer break. SED fitting include a main stellar population in addition to a residual younger population and extinction. The galaxies are younger at higher redshift on average. However, for the galaxies with $z>2.5$, we do not see a significant evolution of their average age, with all average ages of galaxies mostly remaining between 1 and 2 Gyr. Our research find that most massive galaxies ($\sim 10^{10} M_\odot$ ) are older (typically $>\sim 1$ Gyr old) and formed earlier than less massive galaxies in our sample.