title: Quantification of cardiac capillarization in single-immunostained myocardial slices using weakly supervised instance segmentation

abstract: Decreased myocardial capillary density has been reported as an important histopathological feature associated with various heart disorders. Quantitative assessment of cardiac capillarization typically involves double immunostaining of cardiomyocytes (CMs) and capillaries in myocardial slices. In contrast, single immunostaining of basement membrane components is a straightforward approach to simultaneously label CMs and capillaries, presenting fewer challenges in background staining. However, subsequent image analysis always requires manual work in identifying and segmenting CMs and capillaries. Here, we developed an image analysis tool, AutoQC, to automatically identify and segment CMs and capillaries in immunofluorescence images of collagen type IV, a predominant basement membrane protein within the myocardium. In addition, commonly used capillarization-related measurements can be derived from segmentation masks. AutoQC features a weakly supervised instance segmentation algorithm by leveraging the power of a pre-trained segmentation model via prompt engineering. AutoQC outperformed YOLOv8-Seg, a state-of-the-art instance segmentation model, in both instance segmentation and capillarization assessment. Furthermore, the training of AutoQC required only a small dataset with bounding box annotations instead of pixel-wise annotations, leading to a reduced workload during network training. AutoQC provides an automated solution for quantifying cardiac capillarization in basement-membrane-immunostained myocardial slices, eliminating the need for manual image analysis once it is trained.


title: Packrat: Automatic Reconfiguration for Latency Minimization in CPU-based DNN Serving

abstract: In this paper, we investigate how to push the performance limits of serving Deep Neural Network (DNN) models on CPU-based servers. Specifically, we observe that while intra-operator parallelism across multiple threads is an effective way to reduce inference latency, it provides diminishing returns. Our primary insight is that instead of running a single instance of a model with all available threads on a server, running multiple instances each with smaller batch sizes and fewer threads for intra-op parallelism can provide lower inference latency. However, the right configuration is hard to determine manually since it is workload- (DNN model and batch size used by the serving system) and deployment-dependent (number of CPU cores on server). We present Packrat, a new serving system for online inference that given a model and batch size ($B$) algorithmically picks the optimal number of instances ($i$), the number of threads each should be allocated ($t$), and the batch sizes each should operate on ($b$) that minimizes latency. Packrat is built as an extension to TorchServe and supports online reconfigurations to avoid serving downtime. Averaged across a range of batch sizes, Packrat improves inference latency by 1.43$\times$ to 1.83$\times$ on a range of commonly used DNNs.


title: STL4IoT: A Statechart Template Library for IoT System Design

abstract: The engineering of IoT systems brings about various challenges due to the inherent complexities associated with such heterogeneous systems. In this paper, we propose a library of statechart templates, STL4IoT, for designing complex IoT systems. We have developed atomic statechart components modelling the heterogeneous aspects of IoT systems including sensors, actuators, physical entities, network, and controller. Base system units for smart systems have also been designed. A component for calculating power usage is available in the library. Additionally, a smart hub template that controls interactions among multiple IoT systems and manages power consumption has also been proposed. The templates aim to facilitate the modelling and simulation of IoT systems. Our work is demonstrated with a smart home system consisting of a smart hub of lights, a smart microwave, a smart TV, and a smart fire alarm system. We have created a multi statechart with itemis CREATE based on the proposed templates and components. A smart home simulator has been developed by generating controller code from the statechart and integrating it with a user interface.


title: An analysis of multivariate measures of skewness and kurtosis of skew-elliptical distributions

abstract: This paper examines eight measures of skewness and Mardia measure of kurtosis for skew-elliptical distributions. Multivariate measures of skewness considered include Mardia, Malkovich-Afifi, Isogai, Song, Balakrishnan-Brito-Quiroz, M$\acute{o}$ri, Rohatgi and Sz$\acute{e}$kely, Kollo and Srivastava measures. We first study the canonical form of skew-elliptical distributions, and then derive exact expressions of all measures of skewness and kurtosis for the family of skew-elliptical distributions, except for Song's measure. Specifically, the formulas of these measures for skew normal, skew $t$, skew logistic, skew Laplace, skew Pearson type II and skew Pearson type VII distributions are obtained. Next, as in Malkovich and Afifi (1973), test statistics based on a random sample are constructed for illustrating the usefulness of the established results. In a Monte Carlo simulation study, different measures of skewness and kurtosis for $2$-dimensional skewed distributions are calculated and compared. Finally, real data is analyzed to demonstrate all the results.


title: An Effective Universal Polynomial Basis for Spectral Graph Neural Networks

abstract: Spectral Graph Neural Networks (GNNs), also referred to as graph filters have gained increasing prevalence for heterophily graphs. Optimal graph filters rely on Laplacian eigendecomposition for Fourier transform. In an attempt to avert the prohibitive computations, numerous polynomial filters by leveraging distinct polynomials have been proposed to approximate the desired graph filters. However, polynomials in the majority of polynomial filters are predefined and remain fixed across all graphs, failing to accommodate the diverse heterophily degrees across different graphs. To tackle this issue, we first investigate the correlation between polynomial bases of desired graph filters and the degrees of graph heterophily via a thorough theoretical analysis. Afterward, we develop an adaptive heterophily basis by incorporating graph heterophily degrees. Subsequently, we integrate this heterophily basis with the homophily basis, creating a universal polynomial basis UniBasis. In consequence, we devise a general polynomial filter UniFilter. Comprehensive experiments on both real-world and synthetic datasets with varying heterophily degrees significantly support the superiority of UniFilter, demonstrating the effectiveness and generality of UniBasis, as well as its promising capability as a new method for graph analysis.


title: An extended Kolmogorov-Avrami-Ishibashi (EKAI) model to simulate dynamic characteristics of polycrystalline-ferroelectric-gate field-effect transistors

abstract: An extended Kolmogorov-Avrami-Ishibashi (EKAI) model is proposed, which represents dynamic characteristics in polycrystalline ferroelectric films consisting of grains under time-dependent electric fields. The original Kolmogorov-Avrami-Ishibashi (KAI) model described time-varying polarization reversal in a single-crystal film under a constant electric field. The field and the polarization were directed along the film normal. The polarization reversal dynamics were represented by a time-evolution function, c(t), regarding the volume fractions of the downward- and upward-polarization domains under a constant electric field. In the EKAI model, a grain in a polycrystalline ferroelectric film is indexed by l with an angle theta which is the angle between the spontaneous polarization Ps and the film normal. The EKAI model first assumes KAI-like polarization variations under a constant field inside the grain whose angle is tilted by theta. The second assumption is concerned with polarization variation under time-varying electric field. During a time period delta_t from t_now to t_next (=t_now+delta_t), the volume fractions of the downward- and upward-polarization domains changes according to the function c(t) under an electric field at t_now. By combining the derived polarization and an electrostatic potential equation across a gate stacked structure at t_next, an electric field at t_next is derived. Since the electric field and the volume fractions of the downward and upward domains are known at t_next, the calculation at the next delta_t step is possible. This procedure is repeated, and the EKAI model can simulate time-varying polarization reversal phenomena. Good agreement of the numerical results with the experimental indicates that the model is appropriate to simulate dynamic characteristics of FeFETs with polycrystalline ferroelectric films under swept and pulsed gate-voltages.


title: Experimental realization of universal high-dimensional quantum gates with ultra-high fidelity and efficiency

abstract: Qudit, a high-dimensional quantum system, provides a larger Hilbert space to process the quantum information and has shown remarkable advantages over the qubit counterparts. It is a great challenge to realize the high fidelity universal quantum gates with qudits. Here we theoretically propose and experimentally demonstrate a set of universal quantum gates for a single optical qudit with four dimensions (including the generalized Pauli $X_4$ gate, Pauli $Z_4$ gate, and all of their integer powers), which are encoded in the polarization-spatial degree of freedom without multiple unstable cascaded interferometers. Furthermore, we also realize the controlled-$X_4$ gate and all of its integer powers. We have achieved both the ultra-high average gate fidelity $99.73\%$ and efficiency $99.47\%$, which are above the the error threshold for fault-tolerant quantum computation. Our work paves a way for the large-scale high-dimensional fault-tolerant quantum computation with a polynomial resource cost.


title: Kinetic equations for real scalar fields coupled to a continuum of atoms

abstract: We consider a model of a scalar field, with dispersion relation {\omega}(k), coupled to a random medium of two level atoms. We investigate the dynamics of states with at most one quanta of excitation in the system. In a high frequency limit, the probability amplitudes are shown to satisfy kinetic equations. Under additional hypotheses on the dispersion relation, we obtain an analytically solvable expression in the diffusion limit.


title: Observing coherence in an incoherent paramagnetic nitrogen spin bath

abstract: The unpolarized spin environment surrounding a central spin qubit is typically considered as an incoherent source of dephasing, however, precise characterization and control of the spin bath can yield a resource for storing and sensing with quantum states. In this work, we use nitrogen-vacancy (NV) centers in diamond to measure the coherence of optically-dark paramagnetic nitrogen defects (P1 centers) and detect coherent interactions between the P1 centers and a local bath of $^{13}$C nuclear spins. The dipolar coupling between the P1 centers and $^{13}$C nuclear spins is identified by signature periodic collapses and revivals in the P1 spin coherence signal. We then demonstrate, using a range of dynamical decoupling protocols, that the probing NV centers and the P1 spins are coupled to independent ensembles of $^{13}$C nuclear spins. Our work illustrates how the optically-dark P1 spins, despite being unpolarized, can be used to extract information from their local environment and offers new insight into the interactions within a many-body system.


title: PEOPLEx: PEdestrian Opportunistic Positioning LEveraging IMU, UWB, BLE and WiFi

abstract: This paper advances the field of pedestrian localization by introducing a unifying framework for opportunistic positioning based on nonlinear factor graph optimization. While many existing approaches assume constant availability of one or multiple sensing signals, our methodology employs IMU-based pedestrian inertial navigation as the backbone for sensor fusion, opportunistically integrating Ultra-Wideband (UWB), Bluetooth Low Energy (BLE), and WiFi signals when they are available in the environment. The proposed PEOPLEx framework is designed to incorporate sensing data as it becomes available, operating without any prior knowledge about the environment (e.g. anchor locations, radio frequency maps, etc.). Our contributions are twofold: 1) we introduce an opportunistic multi-sensor and real-time pedestrian positioning framework fusing the available sensor measurements; 2) we develop novel factors for adaptive scaling and coarse loop closures, significantly improving the precision of indoor positioning. Experimental validation confirms that our approach achieves accurate localization estimates in real indoor scenarios using commercial smartphones.


title: Quantitative diffraction imaging using attosecond pulses

abstract: We have proposed and developed a method to utilize attosecond pulses in diffraction imaging techniques applied to complex samples. In this study, the effects of the broadband properties of the wavefield owing to attosecond pulses are considered in the reconstruction of images through the decomposition of the broad spectrum into multi-spectral components. This method successfully reconstructs the multi-spectral information of complex samples, probes, and spectral bandwidths using broadband diffraction intensities generated from computational scanning experiments. The results obtained in this research open the opportunities to perform quantitative ultrafast imaging using the attosecond pulses.


title: Sufficient conditions for rescaling expansivity

abstract: We demonstrate that any k*-expansive vector field on a closed manifold exhibits rescaling expansiveness. This enhances the principal outcome outlined in \cite{a}. The verification of this assertion hinges on the introduction and exploration of the novel concept termed as a "singular-expansive flow," which will be thoroughly examined.


title: Recent Developments of Small-$x$ Evolution for Quark and Gluon Helicity

abstract: Helicity of quarks and gluons inside the proton at small Bjorken $x$ is one of the missing pieces of the proton spin puzzle, with limited experimental results due to various challenges. To address the problem, we derive under the framework of color glass condensate (CGC) effective theory a renormalization group equation in rapidity for the parton helicity distributions, which resums double-logarithmic factor, $\alpha_s\ln^2(1/x)$, with $\alpha_s$ being the strong coupling constant. With running coupling, the equation produces results at Bjorken $x\leq 0.1$ that are consistent with the world polarized scattering data. There is an evidence for a significant parton helicity contribution from the small-$x$ region. However, the helicity estimate still contains a large uncertainty that will dramatically reduce with the upcoming measurements from the Electron-Ion Collider (EIC). Ongoing attempts to reduce the uncertainty of our helicity prediction in the medium term will also be discussed.


title: Material decomposition for dual-energy propagation-based phase-contrast CT

abstract: Material decomposition refers to using the energy dependence of material physical properties to differentiate materials in a sample, which is a very important application in computed tomography(CT). In propagation-based X-ray phase-contrast CT, the phase retrieval and Reconstruction are always independent. Moreover, like in conventional CT, the material decomposition methods in this technique can be classified into two types based on pre-reconstruction and post-reconstruction (two-step). The CT images often suffer from noise and artifacts in those methods because of no feedback and correction from the intensity data. This work investigates an iterative method to obtain material decomposition directly from the intensity data in different energies, which means that we perform phase retrieval, reconstruction and material decomposition in a one step. Fresnel diffraction is applied to forward propagation and CT images interact with this intensity data throughout the iterative process. Experiments results demonstrate that compared with two-step methods, the proposed method is superior in accurate material decomposition and noise reduction.


title: New Eruptive YSOs from SPICY and WISE

abstract: This work presents four high-amplitude variable YSOs ($\simeq$ 3 mag at near- or mid-IR wavelengths) arising from the SPICY catalog. Three outbursts show a duration that is longer than 1 year, and are still ongoing. And additional YSO brightened over the last two epochs of NEOWISE observations and the duration of the outburst is thus unclear. Analysis of the spectra of the four sources confirms them as new members of the eruptive variable class. We find two YSOs that can be firmly classified as bona fide FUors and one object that falls in the V1647 Ori-like class. Given the uncertainty in the duration of its outburst, an additional YSO can only be classified as a candidate FUor. Continued monitoring and follow-up of these particular sources is important to better understand the accretion process of YSOs.


title: Speech Understanding on Tiny Devices with A Learning Cache

abstract: This paper addresses spoken language understanding (SLU) on microcontroller-like embedded devices, integrating on-device execution with cloud offloading in a novel fashion. We leverage temporal locality in the speech inputs to a device and reuse recent SLU inferences accordingly. Our idea is simple: let the device match incoming inputs against cached results, and only offload inputs not matched to any cached ones to the cloud for full inference. Realization of this idea, however, is non-trivial: the device needs to compare acoustic features in a robust yet low-cost way. To this end, we present SpeechCache (or SC), a speech cache for tiny devices. It matches speech inputs at two levels of representations: first by sequences of clustered raw sound units, then as sequences of phonemes. Working in tandem, the two representations offer complementary tradeoffs between cost and efficiency. To boost accuracy even further, our cache learns to personalize: with the mismatched and then offloaded inputs, it continuously finetunes the device's feature extractors with the assistance of the cloud. We implement SC on an off-the-shelf STM32 microcontroller. The complete implementation has a small memory footprint of 2MB. Evaluated on challenging speech benchmarks, our system resolves 45%-90% of inputs on device, reducing the average latency by up to 80% compared to offloading to popular cloud speech recognition services. The benefit brought by our proposed SC is notable even in adversarial settings - noisy environments, cold cache, or one device shared by a number of users.


title: Event-based Visual Inertial Velometer

abstract: Neuromorphic event-based cameras are bio-inspired visual sensors with asynchronous pixels and extremely high temporal resolution. Such favorable properties make them an excellent choice for solving state estimation tasks under aggressive ego motion. However, failures of camera pose tracking are frequently witnessed in state-of-the-art event-based visual odometry systems when the local map cannot be updated in time. One of the biggest roadblocks for this specific field is the absence of efficient and robust methods for data association without imposing any assumption on the environment. This problem seems, however, unlikely to be addressed as in standard vision due to the motion-dependent observability of event data. Therefore, we propose a mapping-free design for event-based visual-inertial state estimation in this paper. Instead of estimating the position of the event camera, we find that recovering the instantaneous linear velocity is more consistent with the differential working principle of event cameras. The proposed event-based visual-inertial velometer leverages a continuous-time formulation that incrementally fuses the heterogeneous measurements from a stereo event camera and an inertial measurement unit. Experiments on the synthetic dataset demonstrate that the proposed method can recover instantaneous linear velocity in metric scale with low latency.


title: Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learning

abstract: Federated Learning (FL) is a novel privacy-protection distributed machine learning paradigm that guarantees user privacy and prevents the risk of data leakage due to the advantage of the client's local training. Researchers have struggled to design fair FL systems that ensure fairness of results. However, the interplay between fairness and privacy has been less studied. Increasing the fairness of FL systems can have an impact on user privacy, while an increase in user privacy can affect fairness. In this work, on the client side, we use fairness metrics, such as Demographic Parity (DemP), Equalized Odds (EOs), and Disparate Impact (DI), to construct the local fair model. To protect the privacy of the client model, we propose a privacy-protection fairness FL method. The results show that the accuracy of the fair model with privacy increases because privacy breaks the constraints of the fairness metrics. In our experiments, we conclude the relationship between privacy, fairness and utility, and there is a tradeoff between these.


title: Smyth complete real-enriched categories

abstract: This paper investigates Smyth completeness of categories enriched over a quantale obtained by equipping the unit interval of real numbers with a continuous t-norm. A real-enriched category is Smyth-complete if each of its forward Cauchy nets has a unique limit in the open ball topology of its symmetrization. It is demonstrated that Smyth completeness can be characterized as a categorical property and as a real-valued topological property. Explicitly, it is shown that a real-enriched category is Smyth complete if and only if it is separated and all of its ideals are representable, if and only if its Alexandroff real-valued topology is sober.


title: Powers of the Universe: Empowering primary school students with the powers of ten notation

abstract: Numbers, both very large and very small, are crucially important for understanding the modern world. This paper assesses trials of a mathematics and physics module called Powers of the Universe in which arithmetic with extreme numbers (large and small) is developed through early learning of the powers of ten notation. We trialled a 6-hour progression of lessons based on activities and group learning with students aged 7-13 years. We measured students' ability to estimate, compare, and calculate extreme numbers using pre and post-tests to evaluate the program. Results demonstrated students' strong enthusiasm and positive learning outcomes in areas normally assumed to be beyond the capability of students in this age group. We discuss the age dependence of some results and suggest an optimum strategy for enhancing primary school mathematics. The module has been delivered, as part of a broader five-module program called Maths for Einstein's Universe, that aims to reduce maths anxiety through programs with direct relevance to the modern world and reduced emphasis on exactness.


title: Persistent Test-time Adaptation in Episodic Testing Scenarios

abstract: Current test-time adaptation (TTA) approaches aim to adapt to environments that change continuously. Yet, when the environments not only change but also recur in a correlated manner over time, such as in the case of day-night surveillance cameras, it is unclear whether the adaptability of these methods is sustained after a long run. This study aims to examine the error accumulation of TTA models when they are repeatedly exposed to previous testing environments, proposing a novel testing setting called episodic TTA. To study this phenomenon, we design a simulation of TTA process on a simple yet representative $\epsilon$-perturbed Gaussian Mixture Model Classifier and derive the theoretical findings revealing the dataset- and algorithm-dependent factors that contribute to the gradual degeneration of TTA methods through time. Our investigation has led us to propose a method, named persistent TTA (PeTTA). PeTTA senses the model divergence towards a collapsing and adjusts the adaptation strategy of TTA, striking a balance between two primary objectives: adaptation and preventing model collapse. The stability of PeTTA in the face of episodic TTA scenarios has been demonstrated through a set of comprehensive experiments on various benchmarks.


title: Positional Information Matters for Invariant In-Context Learning: A Case Study of Simple Function Classes

abstract: In-context learning (ICL) refers to the ability of a model to condition on a few in-context demonstrations (input-output examples of the underlying task) to generate the answer for a new query input, without updating parameters. Despite the impressive ICL ability of LLMs, it has also been found that ICL in LLMs is sensitive to input demonstrations and limited to short context lengths. To understand the limitations and principles for successful ICL, we conduct an investigation with ICL linear regression of transformers. We characterize several Out-of-Distribution (OOD) cases for ICL inspired by realistic LLM ICL failures and compare transformers with DeepSet, a simple yet powerful architecture for ICL. Surprisingly, DeepSet outperforms transformers across a variety of distribution shifts, implying that preserving permutation invariance symmetry to input demonstrations is crucial for OOD ICL. The phenomenon specifies a fundamental requirement by ICL, which we termed as ICL invariance. Nevertheless, the positional encodings in LLMs will break ICL invariance. To this end, we further evaluate transformers with identical positional encodings and find preserving ICL invariance in transformers achieves state-of-the-art performance across various ICL distribution shifts


title: COVID-19 Vaccine Misinformation in Middle Income Countries

abstract: This paper introduces a multilingual dataset of COVID-19 vaccine misinformation, consisting of annotated tweets from three middle-income countries: Brazil, Indonesia, and Nigeria. The expertly curated dataset includes annotations for 5,952 tweets, assessing their relevance to COVID-19 vaccines, presence of misinformation, and the themes of the misinformation. To address challenges posed by domain specificity, the low-resource setting, and data imbalance, we adopt two approaches for developing COVID-19 vaccine misinformation detection models: domain-specific pre-training and text augmentation using a large language model. Our best misinformation detection models demonstrate improvements ranging from 2.7 to 15.9 percentage points in macro F1-score compared to the baseline models. Additionally, we apply our misinformation detection models in a large-scale study of 19 million unlabeled tweets from the three countries between 2020 and 2022, showcasing the practical application of our dataset and models for detecting and analyzing vaccine misinformation in multiple countries and languages. Our analysis indicates that percentage changes in the number of new COVID-19 cases are positively associated with COVID-19 vaccine misinformation rates in a staggered manner for Brazil and Indonesia, and there are significant positive associations between the misinformation rates across the three countries.


title: Formal lifting of dualizing complexes and consequences

abstract: We show that for a Noetherian ring $A$ that is $I$-adically complete for an ideal $I$, if $A/I$ admits a dualizing complex, so does $A$. We discuss several consequences of this result. We also consider a generalization of the notion of dualizing complexes to infinite-dimensional rings and prove the results in this generality. In addition, we give an alternative proof of the fact that every excellent Henselian local ring admits a dualizing complex, using ultrapower.


title: The $SO(3,1)$-orbits in the light cone of the 2-fold exterior power of the Minkowski 4-space

abstract: Two special neutral hypersurfaces $\mathcal{L}_{\pm}$ in the light cone $L(\bigwedge^2 E^4_1 )$ studied in [1], [3] are $SO(3,1)$-orbits. In this paper, we see that each $SO(3,1)$-orbit in $L(\bigwedge^2 E^4_1 )$ is either a neutral hypersurface homothetic to one of $\mathcal{L}_{\pm}$ in $L(\bigwedge^2 E^4_1 )$ or a hypersurface with a two-dimensional involutive distribution where the induced metric is degenerate. The difference between these hypersurfaces can be understood in terms of the stabilizer and the $r$-slice of $L(\bigwedge^2 E^4_1 )$ for $r>0$.


title: S-T CRF: Spatial-Temporal Conditional Random Field for Human Trajectory Prediction

abstract: Trajectory prediction is of significant importance in computer vision. Accurate pedestrian trajectory prediction benefits autonomous vehicles and robots in planning their motion. Pedestrians' trajectories are greatly influenced by their intentions. Prior studies having introduced various deep learning methods only pay attention to the spatial and temporal information of trajectory, overlooking the explicit intention information. In this study, we introduce a novel model, termed the \textbf{S-T CRF}: \textbf{S}patial-\textbf{T}emporal \textbf{C}onditional \textbf{R}andom \textbf{F}ield, which judiciously incorporates intention information besides spatial and temporal information of trajectory. This model uses a Conditional Random Field (CRF) to generate a representation of future intentions, greatly improving the prediction of subsequent trajectories when combined with spatial-temporal representation. Furthermore, the study innovatively devises a space CRF loss and a time CRF loss, meticulously designed to enhance interaction constraints and temporal dynamics, respectively. Extensive experimental evaluations on dataset ETH/UCY and SDD demonstrate that the proposed method surpasses existing baseline approaches.


title: Hy-Tracker: A Novel Framework for Enhancing Efficiency and Accuracy of Object Tracking in Hyperspectral Videos

abstract: Hyperspectral object tracking has recently emerged as a topic of great interest in the remote sensing community. The hyperspectral image, with its many bands, provides a rich source of material information of an object that can be effectively used for object tracking. While most hyperspectral trackers are based on detection-based techniques, no one has yet attempted to employ YOLO for detecting and tracking the object. This is due to the presence of multiple spectral bands, the scarcity of annotated hyperspectral videos, and YOLO's performance limitation in managing occlusions, and distinguishing object in cluttered backgrounds. Therefore, in this paper, we propose a novel framework called Hy-Tracker, which aims to bridge the gap between hyperspectral data and state-of-the-art object detection methods to leverage the strengths of YOLOv7 for object tracking in hyperspectral videos. Hy-Tracker not only introduces YOLOv7 but also innovatively incorporates a refined tracking module on top of YOLOv7. The tracker refines the initial detections produced by YOLOv7, leading to improved object-tracking performance. Furthermore, we incorporate Kalman-Filter into the tracker, which addresses the challenges posed by scale variation and occlusion. The experimental results on hyperspectral benchmark datasets demonstrate the effectiveness of Hy-Tracker in accurately tracking objects across frames.


title: INarIG: Iterative Non-autoregressive Instruct Generation Model For Word-Level Auto Completion

abstract: Computer-aided translation (CAT) aims to enhance human translation efficiency and is still important in scenarios where machine translation cannot meet quality requirements. One fundamental task within this field is Word-Level Auto Completion (WLAC). WLAC predicts a target word given a source sentence, translation context, and a human typed character sequence. Previous works either employ word classification models to exploit contextual information from both sides of the target word or directly disregarded the dependencies from the right-side context. Furthermore, the key information, i.e. human typed sequences, is only used as prefix constraints in the decoding module. In this paper, we propose the INarIG (Iterative Non-autoregressive Instruct Generation) model, which constructs the human typed sequence into Instruction Unit and employs iterative decoding with subwords to fully utilize input information given in the task. Our model is more competent in dealing with low-frequency words (core scenario of this task), and achieves state-of-the-art results on the WMT22 and benchmark datasets, with a maximum increase of over 10% prediction accuracy.


title: Extraordinary magnetic response of an anisotropic 2D antiferromagnet via site-dilution

abstract: A prominent character of two-dimensional magnetic systems is the enhanced spin fluctuations, which however reduce the ordering temperature. Here we report that a magnetic field of only one-thousandth of the Heisenberg superexchange interaction can induce a crossover, which for practical purposes is the effective ordering transition, at temperatures about 6 times of the Neel transition in a site-diluted two-dimensional anisotropic quantum antiferromagnet. Such a strong magnetic response is enabled because the system directly enters the antiferromagnetically ordered state from the isotropic disordered state skipping the intermediate anisotropic stage. The underlying mechanism is achieved on a pseudospin-half square lattice realized in the [(SrIrO3)1/(SrTiO3)2] superlattice thin film that is designed to linearly couple the staggered magnetization to external magnetic fields by virtue of the rotational symmetry-preserving Dzyaloshinskii Moriya interaction. Our model analysis shows that the skipping of the anisotropic regime despite the finite anisotropy is due to the enhanced isotropic fluctuations under moderate dilution.


title: Testing and Debugging Quantum Circuits

abstract: This paper introduces a process framework for debugging quantum circuits, focusing on three distinct types of circuit blocks: Amplitude Permutation, Phase Modulation, and Amplitude Redistribution circuit blocks. Our research addresses the critical need for specialized debugging approaches tailored to the unique properties of each circuit type. For Amplitude Permutation Circuits, we propose techniques to correct amplitude permutations mimicking classical operations. In phase modulation circuits, our proposed strategy targets the precise calibration of phase alterations essential for quantum computations. The most complex Amplitude Redistribution Circuits demand advanced methods to adjust probability amplitudes. This research bridges a vital gap in current methodologies and lays the groundwork for future advancements in quantum circuit debugging. Our contributions are twofold: We present a comprehensive unit testing tool (Cirquo) and debugging approaches tailored to the unique demands of quantum computing, and we provide empirical evidence of its effectiveness in optimizing quantum circuit performance. This work is a crucial step toward realizing robust quantum computing systems and their applications in various domains.


title: A Novel Interface Database of Graphene Nanoribbon from Density Functional Theory

abstract: Interfaces play a crucial role in determining the overall performance and functionality of electronic devices and systems. Driven by the data science, machine learning (ML) reveals excellent guidance for material selection and device design, in which an advanced database is crucial for training models with state-of-the-art (SOTA) precision. However, a systematic database of interfaces is still in its infancy due to the difficulties in collecting raw data in experiment and the expensive first-principles computational cost in density functional theory (DFT). In this paper, we construct ample interface structures of graphene nanoribbons (GNR), whose interfacial morphology can be precisely fabricated based on specific molecular precursors. The GNR interfaces serve as promising candidates since their bandgaps can be modulated. Their physical properties including energy bands and density of states (DOS) maps are obtained under reasonable calculation parameters. This database can provide theoretical guidance for the design of electronic devices and accelerate the ML study of various physical quantities.


title: Carrier Transport in 2D Hybrid Organic-Inorganic Perovskites: the role of spacer molecules

abstract: Two-dimensional organic-inorganic hybrid perovskites (2D HOIPs) have been widely used for various optoelectronics owing to the excellent photoelectric properties. Recently, a great deal of studies have focused on engineering the organic spacer cation in 2D HOIPs to enhance the carrier transport and improve the performance of devices. However, the selection of organic spacer cations is mostly qualitative without a quantitative guidance. Meanwhile, the fundamental mechanism of the carrier transport across the organic spacer layer is still unclear. Here, by using the first-principle non-adiabatic molecular dynamics (NAMD) method, we have studied the transport process of excited carriers between 2D HOIPs separated by the spacer cation layer. Various types of spacer cations of 2D HOIPs are investigated, where the carrier transport processes are simulated in real-time at atomic levels. We find that the excited electrons and holes can transfer from single-inorganic-layer 2D HOIP to bi-inorganic-layer 2D HOIP on a sub-picosecond scale, and different types of spacer cations can influence the carrier transfer rate significantly. Meanwhile, Dion-Jacobson (DJ) phase 2D HOIP leads to a more conductive carrier transport compared to the Ruddlesden-Popper (RP) phase, which is related to the different electron-phonon coupling strengths of these two phases. Moreover, we have developed a new method to capture the electron-hole interaction in the frame of NAMD. This work provides a promising direction to design new materials towards high performance optoelectronics.


title: Symmetry breaking and multiplicity for supercritical elliptic Hamiltonian systems in exterior domains

abstract: We consider positive solutions of the following elliptic Hamiltonian systems \begin{equation} \left\{ \begin{aligned} -\Delta u+u&=a(x)v^{p-1}~~~\text{in}~~A_R\\ -\Delta v+v&=b(x)u^{q-1}~~~\text{in}~~A_R~~~~~~~~~~~~~~~~~(0.1)\\ u, v&>0~~~~~~~~~~~~~~~\text{in}~~A_R\\ u=v&=0~~~~~~~~~~~~~~~\text{on}~~\partial A_R, \end{aligned} \right. \end{equation} where $A_R=\{x\in\mathbb{R}^{N}: |x|>R\}$, $R>0$, $N>3$, and $a(x)$ and $b(x)$ are positive continuous functions. Under certain symmetry and monotonicity properties on $a(x)$ and $b(x)$, we prove that (0.1) has a positive solution for $(p,q)$ above the standard critical hyperbola, that is, $\frac{1}{p}+\frac{1}{q}<1-\frac{2}{N}$, enjoying the same symmetry and monotonicity properties as the weights $a$ and $b$. In the case when $a(x)=b(x)=1$, our result ensures multiplicity as it provides $\Big\lfloor \frac{N}{2}\Big\rfloor-1$ (being $\lfloor \frac{N}{2}\rfloor$ the floor of $\frac{N}{2}$) non-radial positive solutions provided that \begin{equation} (p-1)(q-1)>\Big(1+\frac{2N}{\Lambda_H}\Big)^{2}\Big(\frac{q}{p}\Big), \end{equation} where $\Lambda_H$ is the optimal constant in Hardy inequality for the domain $A_R$.


title: SCOPE-RL: A Python Library for Offline Reinforcement Learning and Off-Policy Evaluation

abstract: This paper introduces SCOPE-RL, a comprehensive open-source Python software designed for offline reinforcement learning (offline RL), off-policy evaluation (OPE), and selection (OPS). Unlike most existing libraries that focus solely on either policy learning or evaluation, SCOPE-RL seamlessly integrates these two key aspects, facilitating flexible and complete implementations of both offline RL and OPE processes. SCOPE-RL put particular emphasis on its OPE modules, offering a range of OPE estimators and robust evaluation-of-OPE protocols. This approach enables more in-depth and reliable OPE compared to other packages. For instance, SCOPE-RL enhances OPE by estimating the entire reward distribution under a policy rather than its mere point-wise expected value. Additionally, SCOPE-RL provides a more thorough evaluation-of-OPE by presenting the risk-return tradeoff in OPE results, extending beyond mere accuracy evaluations in existing OPE literature. SCOPE-RL is designed with user accessibility in mind. Its user-friendly APIs, comprehensive documentation, and a variety of easy-to-follow examples assist researchers and practitioners in efficiently implementing and experimenting with various offline RL methods and OPE estimators, tailored to their specific problem contexts. The documentation of SCOPE-RL is available at https://scope-rl.readthedocs.io/en/latest/.


title: Towards Assessing and Benchmarking Risk-Return Tradeoff of Off-Policy Evaluation

abstract: Off-Policy Evaluation (OPE) aims to assess the effectiveness of counterfactual policies using only offline logged data and is often used to identify the top-k promising policies for deployment in online A/B tests. Existing evaluation metrics for OPE estimators primarily focus on the "accuracy" of OPE or that of downstream policy selection, neglecting risk-return tradeoff in the subsequent online policy deployment. To address this issue, we draw inspiration from portfolio evaluation in finance and develop a new metric, called SharpeRatio@k, which measures the risk-return tradeoff of policy portfolios formed by an OPE estimator under varying online evaluation budgets (k). We validate our metric in two example scenarios, demonstrating its ability to effectively distinguish between low-risk and high-risk estimators and to accurately identify the most efficient one. Efficiency of an estimator is characterized by its capability to form the most advantageous policy portfolios, maximizing returns while minimizing risks during online deployment, a nuance that existing metrics typically overlook. To facilitate a quick, accurate, and consistent evaluation of OPE via SharpeRatio@k, we have also integrated this metric into an open-source software, SCOPE-RL (https://github.com/hakuhodo-technologies/scope-rl). Employing SharpeRatio@k and SCOPE-RL, we conduct comprehensive benchmarking experiments on various estimators and RL tasks, focusing on their risk-return tradeoff. These experiments offer several interesting directions and suggestions for future OPE research.


title: SMaRt: Improving GANs with Score Matching Regularity

abstract: Generative adversarial networks (GANs) usually struggle in learning from highly diverse data, whose underlying manifold is complex. In this work, we revisit the mathematical foundations of GANs, and theoretically reveal that the native adversarial loss for GAN training is insufficient to fix the problem of subsets with positive Lebesgue measure of the generated data manifold lying out of the real data manifold. Instead, we find that score matching serves as a promising solution to this issue thanks to its capability of persistently pushing the generated data points towards the real data manifold. We thereby propose to improve the optimization of GANs with score matching regularity (SMaRt). Regarding the empirical evidences, we first design a toy example to show that training GANs by the aid of a ground-truth score function can help reproduce the real data distribution more accurately, and then confirm that our approach can consistently boost the synthesis performance of various state-of-the-art GANs on real-world datasets with pre-trained diffusion models acting as the approximate score function. For instance, when training Aurora on the ImageNet 64x64 dataset, we manage to improve FID from 8.87 to 7.11, on par with the performance of one-step consistency model. The source code will be made public.


title: Quantum Simulations for Strong-Field QED

abstract: Quantum field theory in the presence of strong background fields contains interesting problems where quantum computers may someday provide a valuable computational resource. In the NISQ era it is useful to consider simpler benchmark problems in order to develop feasible approaches, identify critical limitations of current hardware, and build new simulation tools. Here we perform quantum simulations of strong-field QED (SFQED) in $3+1$ dimensions, using real-time nonlinear Breit-Wheeler pair-production as a prototypical process. The strong-field QED Hamiltonian is derived and truncated in the Furry-Volkov mode expansion, and the interactions relevant for Breit-Wheeler are transformed into a quantum circuit. Quantum simulations of a "null double slit" experiment are found to agree well with classical simulations following the application of various error mitigation strategies, including an asymmetric depolarization algorithm which we develop and adapt to the case of Trotterization with a time-dependent Hamiltonian. We also discuss longer-term goals for the quantum simulation of SFQED.


title: Distributed Adaptive Greedy Quasi-Newton Methods with Explicit Non-asymptotic Convergence Bounds

abstract: Though quasi-Newton methods have been extensively studied in the literature, they either suffer from local convergence or use a series of line searches for global convergence which is not acceptable in the distributed setting. In this work, we first propose a line search free greedy quasi-Newton (GQN) method with adaptive steps and establish explicit non-asymptotic bounds for both the global convergence rate and local superlinear rate. Our novel idea lies in the design of multiple greedy quasi-Newton updates, which involves computing Hessian-vector products, to control the Hessian approximation error, and a simple mechanism to adjust stepsizes to ensure the objective function improvement per iterate. Then, we extend it to the master-worker framework and propose a distributed adaptive GQN method whose communication cost is comparable with that of first-order methods, yet it retains the superb convergence property of its centralized counterpart. Finally, we demonstrate the advantages of our methods via numerical experiments.


title: Analytic approach to astrometric perturbations of critical curves by substructures

abstract: Astrometric perturbations of critical curves in strong lens systems are thought to be one of the most promising probes of substructures down to small-mass scales. While a smooth mass distribution creates a symmetric geometry of critical curves with radii of curvature about the Einstein radius, substructures introduce small-scale distortions on critical curves, which can break the symmetry of gravitational lensing events near critical curves, such as highly magnified individual stars. We derive a general formula that connects the fluctuation of critical curves with the fluctuation of the surface density caused by substructures, which is useful when constraining models of substructures from observed astrometric perturbations of critical curves. We numerically check that the formula is valid and accurate as long as substructures are not dominated by a small number of massive structures. As a demonstration of the formula, we also explore the possibility that an anomalous position of an extremely magnified star, recently reported as ``Mothra,'' can be explained by fluctuations in the critical curve due to substructures. We find that cold dark matter subhalos with masses ranging from $5 \times 10^7 M_{\odot}/h$ to $10^9 M_{\odot}/h$ can well explain the anomalous position of Mothra, while in the fuzzy dark matter model, the very small mass of $\sim 10^{-24}~\mathrm{eV}$ is needed to explain it.


title: Whole-body Dynamic Collision Avoidance with Time-varying Control Barrier Functions

abstract: Recently, there has been increasing attention in robot research towards the whole-body collision avoidance. In this paper, we propose a safety-critical controller that utilizes time-varying control barrier functions (time varying CBFs) constructed by Robo-centric Euclidean Signed Distance Field (RC-ESDF) to achieve dynamic collision avoidance. The RC-ESDF is constructed in the robot body frame and solely relies on the robot's shape, eliminating the need for real-time updates to save computational resources. Additionally, we design two control Lyapunov functions (CLFs) to ensure that the robot can reach its destination. To enable real-time application, our safety-critical controller which incorporates CLFs and CBFs as constraints is formulated as a quadratic program (QP) optimization problem. We conducted numerical simulations on two different dynamics of an L-shaped robot to verify the effectiveness of our proposed approach.


title: Beyond Two-Tower Matching: Learning Sparse Retrievable Cross-Interactions for Recommendation

abstract: Two-tower models are a prevalent matching framework for recommendation, which have been widely deployed in industrial applications. The success of two-tower matching attributes to its efficiency in retrieval among a large number of items, since the item tower can be precomputed and used for fast Approximate Nearest Neighbor (ANN) search. However, it suffers two main challenges, including limited feature interaction capability and reduced accuracy in online serving. Existing approaches attempt to design novel late interactions instead of dot products, but they still fail to support complex feature interactions or lose retrieval efficiency. To address these challenges, we propose a new matching paradigm named SparCode, which supports not only sophisticated feature interactions but also efficient retrieval. Specifically, SparCode introduces an all-to-all interaction module to model fine-grained query-item interactions. Besides, we design a discrete code-based sparse inverted index jointly trained with the model to achieve effective and efficient model inference. Extensive experiments have been conducted on open benchmark datasets to demonstrate the superiority of our framework. The results show that SparCode significantly improves the accuracy of candidate item matching while retaining the same level of retrieval efficiency with two-tower models. Our source code will be available at MindSpore/models.


title: Perception of Misalignment States for Sky Survey Telescopes with the Digital Twin and the Deep Neural Networks

abstract: Sky survey telescopes play a critical role in modern astronomy, but misalignment of their optical elements can introduce significant variations in point spread functions, leading to reduced data quality. To address this, we need a method to obtain misalignment states, aiding in the reconstruction of accurate point spread functions for data processing methods or facilitating adjustments of optical components for improved image quality. Since sky survey telescopes consist of many optical elements, they result in a vast array of potential misalignment states, some of which are intricately coupled, posing detection challenges. However, by continuously adjusting the misalignment states of optical elements, we can disentangle coupled states. Based on this principle, we propose a deep neural network to extract misalignment states from continuously varying point spread functions in different field of views. To ensure sufficient and diverse training data, we recommend employing a digital twin to obtain data for neural network training. Additionally, we introduce the state graph to store misalignment data and explore complex relationships between misalignment states and corresponding point spread functions, guiding the generation of training data from experiments. Once trained, the neural network estimates misalignment states from observation data, regardless of the impacts caused by atmospheric turbulence, noise, and limited spatial sampling rates in the detector. The method proposed in this paper could be used to provide prior information for the active optics system and the optical system alignment.

categories: astro-ph.IM astro-ph.GA astro-ph.SR cs.CV physics.optics


title: Automatic Construction of a Korean Toxic Instruction Dataset for Ethical Tuning of Large Language Models

abstract: Caution: this paper may include material that could be offensive or distressing. The advent of Large Language Models (LLMs) necessitates the development of training approaches that mitigate the generation of unethical language and aptly manage toxic user queries. Given the challenges related to human labor and the scarcity of data, we present KoTox, comprising 39K unethical instruction-output pairs. This collection of automatically generated toxic instructions refines the training of LLMs and establishes a foundational framework for improving LLMs' ethical awareness and response to various toxic inputs, promoting more secure and responsible interactions in Natural Language Processing (NLP) applications.


title: FS-BAND: A Frequency-Sensitive Banding Detector

abstract: Banding artifact, as known as staircase-like contour, is a common quality annoyance that happens in compression, transmission, etc. scenarios, which largely affects the user's quality of experience (QoE). The banding distortion typically appears as relatively small pixel-wise variations in smooth backgrounds, which is difficult to analyze in the spatial domain but easily reflected in the frequency domain. In this paper, we thereby study the banding artifact from the frequency aspect and propose a no-reference banding detection model to capture and evaluate banding artifacts, called the Frequency-Sensitive BANding Detector (FS-BAND). The proposed detector is able to generate a pixel-wise banding map with a perception correlated quality score. Experimental results show that the proposed FS-BAND method outperforms state-of-the-art image quality assessment (IQA) approaches with higher accuracy in banding classification task.


title: Properties of Mars' Dayside Low-Altitude Induced Magnetic Field and Comparisons with Venus

abstract: Our research objective is to characterize Mars' low-altitude (250 km) induced magnetic fields using data from NASA's MAVEN (Mars Atmosphere and Volatile EvolutioN) Mission. We aim to assess how the induced magnetic fields behave under different solar zenith angles and solar wind conditions, and additionally, understand how planet-specific properties (such as Mars crustal magnetism) alter the formation and structure of the magnetic fields. We then use data from the Pioneer Venus Orbiter to compare induced magnetic fields at Venus with those at Mars. At Venus, the vertical structure of the magnetic field tends to exist in one of two states (magnetized or unmagnetized) but we find the induced fields at Mars are more complicated, and we are unable to use this simple classification scheme. We also find the low-altitude induced field strength in the ionospheres of both Venus and Mars vary with as cosine of the angle between solar wind velocity and the magnetic pileup boundary. The low-altitude field strength at Venus tends to be higher than Mars. However, Venus field strengths are lower than theoretical predictions assuming pressure balance and negligible thermal pressure. For Mars, low-altitude field strengths are higher than expected given these assumptions. Induced field strengths exhibit a trend with solar wind dynamic pressure that is consistent with pressure balance expectations at both planets, however there is significant uncertainty in the Venus fit due to lack of upstream solar wind data. Our results highlight major differences between the induced magnetic fields at Venus and Mars, suggesting planet-specific properties such as size and the presence of crustal magnetism affect the induced ionospheric magnetic fields at non magnetized planets.


title: Computing the Bounds of the Number of Reticulations in a Tree-Child Network That Displays a Set of Trees

abstract: Phylogenetic network is an evolutionary model that uses a rooted directed acyclic graph (instead of a tree) to model an evolutionary history of species in which reticulate events (e.g., hybrid speciation or horizontal gene transfer) occurred. Tree-child network is a kind of phylogenetic network with structural constraints. Existing approaches for tree-child network reconstruction can be slow for large data. In this paper, we present several computational approaches for bounding from below the number of reticulations in a tree-child network that displays a given set of rooted binary phylogenetic trees. In addition, we also present some theoretical results on bounding from above the number of reticulations. Through simulation, we demonstrate that the new lower bounds on the reticulation number for tree-child networks can practically be computed for large tree data. The bounds can provide estimates of reticulation for relatively large data.


title: FoldExplorer: Fast and Accurate Protein Structure Search with Sequence-Enhanced Graph Embedding

abstract: The advent of highly accurate protein structure prediction methods has fueled an exponential expansion of the protein structure database. Consequently, there is a rising demand for rapid and precise structural homolog search. Traditional alignment-based methods are dedicated to precise comparisons between pairs, exhibiting high accuracy. However, their sluggish processing speed is no longer adequate for managing the current massive volume of data. In response to this challenge, we propose a novel deep-learning approach FoldExplorer. It harnesses the powerful capabilities of graph attention neural networks and protein large language models for protein structures and sequences data processing to generate embeddings for protein structures. The structural embeddings can be used for fast and accurate protein search. The embeddings also provide insights into the protein space. FoldExplorer demonstrates a substantial performance improvement of 5% to 8% over the current state-of-the-art algorithm on the benchmark datasets. Meanwhile, FoldExplorer does not compromise on search speed and excels particularly in searching on a large-scale dataset.


title: Lifting query complexity to time-space complexity for two-way finite automata

abstract: Time-space tradeoff has been studied in a variety of models, such as Turing machines, branching programs, and finite automata, etc. While communication complexity as a technique has been applied to study finite automata, it seems it has not been used to study time-space tradeoffs of finite automata. We design a new technique showing that separations of query complexity can be lifted, via communication complexity, to separations of time-space complexity of two-way finite automata. As an application, one of our main results exhibits the first example of a language $L$ such that the time-space complexity of two-way probabilistic finite automata with a bounded error (2PFA) is $\widetilde{\Omega}(n^2)$, while of exact two-way quantum finite automata with classical states (2QCFA) is $\widetilde{O}(n^{5/3})$, that is, we demonstrate for the first time that exact quantum computing has an advantage in time-space complexity comparing to classical computing.


title: Determining the core-collapse supernova explosion mechanism with current and future gravitational-wave observatories

abstract: Gravitational waves are emitted from deep within a core-collapse supernova, which may enable us to determine the mechanism of the explosion from a gravitational-wave detection. Previous studies suggested that it is possible to determine if the explosion mechanism is neutrino-driven or magneto-rotationally powered from the gravitational-wave signal. However, long duration magneto-rotational waveforms, that cover the full explosion phase, were not available during the time of previous studies, and explosions were just assumed to be magneto-rotationally driven if the model was rapidly rotating. Therefore, we perform an updated study using new 3D long-duration magneto-rotational core-collapse supernova waveforms that cover the full explosion phase, injected into noise for the Advanced LIGO, Einstein Telescope and NEMO gravitational-wave detectors. We also include a category for failed explosions in our signal classification results. We then determine the explosion mechanism of the signals using three different methods: Bayesian model selection, dictionary learning, and convolutional neural networks. The three different methods are able to distinguish between neutrino-driven explosions and magneto-rotational explosions, even if the neutrino-driven explosion model is rapidly rotating. However they can only distinguish between the non-exploding and neutrino-driven explosions for signals with a high signal to noise ratio.


title: AI-predicted protein deformation encodes energy landscape perturbation

abstract: AI algorithms proved excellent predictors of protein structure, but whether their exceptional accuracy is merely due to megascale regression or these algorithms learn the underlying physics remains an open question. Here, we perform a stringent test for the existence of such learning in the Alphafold2 (AF) algorithm: We use AF to predict the subtle structural deformation induced by single mutations, quantified by strain, and compare with experimental datasets of corresponding perturbations in folding free energy $\Delta\Delta G$. Unexpectedly, we find that physical strain alone -- without any additional data or computation -- correlates almost as well with $\Delta \Delta G$ as state-of-the-art energy-based and machine-learning predictors.This indicates that the AF-predicted structures alone encode fine details about the energy landscape. In particular, the structures encode significant information on stability, enough to estimate (de-)stabilizing effects of mutations, thus paving the way for the development of novel, structure-based stability predictors for protein design and evolution.


title: Exact Degeneracy of Casimir Energy for $\mathcal{N}=4$ Supersymmetric Yang-Mills Theory on ADE Singularities and S-Duality

abstract: Classically, the ground states of $\mathcal{N}=4$ supersymmetric Yang-Mills theory on $\mathbb{R}\times S^3/\Gamma$ where $\Gamma$ is a discrete ADE subgroup of $SU(2)$ are represented by flat Wilson lines winding around the ADE singularity. By a duality relating such ground states to WZW conformal blocks, the ground state degeneracy cannot be lifted by quantum corrections. Using the superconformal index, we compute the supersymmetric Casimir energy of each flat Wilson line for $SU(2)$ SYM on different ADE singularities and find that the flat Wilson lines all have the same supersymmetric Casimir energy. We argue that this exact degeneracy is peculiar to $\mathcal{N}=4$ supersymmetry and show that the degeneracy is lifted when the number of supersymmetry is reduced. In particular, we uncover a surprising result for the ground state structure of the conformal $\mathcal{N}=2$ $SU(2)$ four-flavor theory on $S^3/\Gamma$. For $\mathcal{N}=4$ SYM, S-duality maps the ground state Wilson lines to ground state t' Hooft lines taking values in the Langlands dual group. We show that the supersymmetric Casimir energy of the t' Hooft line ground states is the same as the Wilson line ground states. This can be viewed as a ground state test of S-duality.


title: Reasoning with the Theory of Mind for Pragmatic Semantic Communication

abstract: In this paper, a pragmatic semantic communication framework that enables effective goal-oriented information sharing between two-intelligent agents is proposed. In particular, semantics is defined as the causal state that encapsulates the fundamental causal relationships and dependencies among different features extracted from data. The proposed framework leverages the emerging concept in machine learning (ML) called theory of mind (ToM). It employs a dynamic two-level (wireless and semantic) feedback mechanism to continuously fine-tune neural network components at the transmitter. Thanks to the ToM, the transmitter mimics the actual mental state of the receiver's reasoning neural network operating semantic interpretation. Then, the estimated mental state at the receiver is dynamically updated thanks to the proposed dynamic two-level feedback mechanism. At the lower level, conventional channel quality metrics are used to optimize the channel encoding process based on the wireless communication channel's quality, ensuring an efficient mapping of semantic representations to a finite constellation. Additionally, a semantic feedback level is introduced, providing information on the receiver's perceived semantic effectiveness with minimal overhead. Numerical evaluations demonstrate the framework's ability to achieve efficient communication with a reduced amount of bits while maintaining the same semantics, outperforming conventional systems that do not exploit the ToM-based reasoning.


title: Harnessing graph state resources for robust quantum magnetometry under noise

abstract: Precise measurement of magnetic fields is essential for various applications, such as fundamental physics, space exploration, and biophysics. Although recent progress in quantum engineering has assisted in creating advanced quantum magnetometers, there are still ongoing challenges in improving their efficiency and noise resistance. This study focuses on using symmetric graph state resources for quantum magnetometry to enhance measurement precision by analyzing the estimation theory under Markovian and non-Markovian noise models. The results show a significant improvement in estimating both single and multiple Larmor frequencies. In single Larmor frequency estimation, the quantum Fisher information spans a spectrum from the standard quantum limit to the Heisenberg limit within a periodic range of the Larmor frequency, and in the case of multiple Larmor frequencies, it can exceed the standard quantum limit for both Markovian and non-Markovian noise. This study highlights the potential of graph state-based methods for improving magnetic field measurements under noisy environments.


title: On the nonexistence of a genuinely optimal solution to the search problem

abstract: Given a target distribution, the uniformly optimal search plan provides the best way to search for a target. It has been widely and successfully applied in several high-profile civil and military search missions. Since the target distribution is subjective and chosen at the discretion of an analyst, eliciting the target distribution is also part of the solution to the search problem. Based on this observation, this article establishes that, under mild conditions, there is no genuinely optimal solution to the search problem even if the uniformly optimal search plan exists. One practical implication of this result is that one can improve an existing search plan in many cases even if such a plan is designed using the most advanced search software or system, such as the U.S. Coast Guard's Search and Rescue Optimal Planning System (SAROPS).


title: A positional statistic for 1324-avoiding permutations

abstract: We consider the class $S_n(1324)$ of permutations of size $n$ that avoid the pattern 1324 and examine the subset $S_n^{a\prec n}(1324)$ of elements for which $a\prec n\prec [a-1]$, $a\ge 1$. This notation means that, when written in one line notation, such a permutation must have $a$ to the left of $n$, and the elements of $\{1,\dots,a-1\}$ must all be to the right of $n$. For $n\ge 2$, we establish a connection between the subset of permutations in $S_n^{1\prec n}(1324)$ having the 1 adjacent to the $n$ (called primitives), and the set of 1324-avoiding dominoes with $n-2$ points. For $a\in\{1,2\}$, we introduce constructive algorithms and give formulas for the enumeration of $S_n^{a\prec n}(1324)$ by the position of $a$ relative to the position of $n$. For $a\ge 3$, we formulate some conjectures for the corresponding generating functions.


title: MBH binary intruders: triple systems from cosmological simulations

abstract: Massive black hole (MBH) binaries can form following a galaxy merger, but this may not always lead to a MBH binary merger within a Hubble time. The merger timescale depends on how efficiently the MBHs lose orbital energy to the gas and stellar background, and to gravitational waves (GWs). In systems where these mechanisms are inefficient, the binary inspiral time can be long enough for a subsequent galaxy merger to bring a third MBH into the system. In this work, we identify and characterize the population of triple MBH systems in the Illustris cosmological hydrodynamic simulation. We find a substantial occurrence rate of triple MBH systems: in our fiducial model, 22% of all binary systems form triples, and $>70$% of these involve binaries that would not otherwise merge by $z=0$. Furthermore, a significant subset of triples (6% of all binaries, or more than a quarter of all triples) form a triple system at parsec scales, where the three BHs are most likely to undergo a strong three-body interaction. Crucially, we find that the rate of triple occurrence has only a weak dependence on key parameters of the binary inspiral model (binary eccentricity and stellar loss-cone refilling rate). We also do not observe strong trends in the host galaxy properties for binary versus triple MBH populations. Our results demonstrate the potential for triple systems to increase MBH merger rates, thereby enhancing the low-frequency GW signals detectable with pulsar timing arrays and with LISA.


title: Direct Manipulation of quantum entanglement from the non-Hermitian nature of light-matter interaction

abstract: Biphoton process is an essential benchmark for quantum information science and technologies, while great efforts have been made to improve the coherence of the system for better quantum correlations. Nevertheless, we find that the non-Hermitian features induced by the atomic quantum interference could be well employed for the direct control of entanglement. We report the demonstration of exceptional point (EP) in biphotons by measuring the light-atom interaction as a natural non-Hermitian system, in which the electromagnetically induced transparency regime provides a powerful mechanism to precisely tune the non-Hermitian coupling strength. Such biphoton correlation is tuned within an unprecedented large range from Rabi oscillation to antibunching-exponential-decay, also indicating high-dimensional entanglement within the strong and weak light-matter coupling regimes. The EP at the transition point between the two regimes is clearly observed with the biphoton quantum correlation measurements, exhibiting a single exponential decay and manifesting the coalesced single eigenstate. Our results provide a unique method to realize the controllability of natural non-Hermitian processes without the assistance of artificial photonic structures, and paves the way for quantum control by manipulating the non-Hermitian features of the light-matter interaction.


title: Ultrafast Field-Resolved Nonlinear Optical Spectroscopy in the Molecular Frame

abstract: We resolve the real-time electric field of a femtosecond third-order nonlinear optical signal in the molecular frame. The electric field emitted by the induced third-order polarization from impulsively pre-aligned gas-phase molecules at room temperature, in a degenerate four-wave mixing (DFWM) scheme, is measured using a spectral interferometry technique. We show that by measuring both the amplitude and phase of the emitted femtosecond pulse, information related to electronic symmetries can be accessed. The nonlinear signal is measured around a rotational revival to extract its molecular-frame angle dependence from pump-probe time delay scans. By comparing these measurements for two linear molecules, carbon dioxide (CO2) and Nitrogen (N2), we show that the measured second-order phase parameter (temporal chirp) of the signal is sensitive to the valence electronic symmetry of the molecules, whereas the amplitude of the signal does not show such sensitivity. We compare these measurements to theoretical calculations of the chirp observable in the molecular frame. This work is an important step towards using field-resolved nonlinear optical measurements to study ultrafast dynamics in electronically excited molecules.


title: TCP:Textual-based Class-aware Prompt tuning for Visual-Language Model

abstract: Prompt tuning represents a valuable technique for adapting pre-trained visual-language models (VLM) to various downstream tasks. Recent advancements in CoOp-based methods propose a set of learnable domain-shared or image-conditional textual tokens to facilitate the generation of task-specific textual classifiers. However, those textual tokens have a limited generalization ability regarding unseen domains, as they cannot dynamically adjust to the distribution of testing classes. To tackle this issue, we present a novel Textual-based Class-aware Prompt tuning(TCP) that explicitly incorporates prior knowledge about classes to enhance their discriminability. The critical concept of TCP involves leveraging Textual Knowledge Embedding (TKE) to map the high generalizability of class-level textual knowledge into class-aware textual tokens. By seamlessly integrating these class-aware prompts into the Text Encoder, a dynamic class-aware classifier is generated to enhance discriminability for unseen domains. During inference, TKE dynamically generates class-aware prompts related to the unseen classes. Comprehensive evaluations demonstrate that TKE serves as a plug-and-play module effortlessly combinable with existing methods. Furthermore, TCP consistently achieves superior performance while demanding less training time. Code:https://github.com/htyao89/Textual-based_Class-aware_prompt_tuning/


title: LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language Models

abstract: Large language models (LLMs) provide excellent text-generation capabilities, but standard prompting and generation methods generally do not lead to intentional or goal-directed agents and might necessitate considerable prompt tuning. This becomes particularly apparent in multi-turn conversations: even the best current LLMs rarely ask clarifying questions, engage in explicit information gathering, or take actions now that lead to better decisions after multiple turns. Reinforcement learning has the potential to leverage the powerful modeling capabilities of LLMs, as well as their internal representation of textual interactions, to create capable goal-directed language agents. This can enable intentional and temporally extended interactions, such as with humans, through coordinated persuasion and carefully crafted questions, or in goal-directed play through text games to bring about desired final outcomes. However, enabling this requires the community to develop stable and reliable reinforcement learning algorithms that can effectively train LLMs. Developing such algorithms requires tasks that can gauge progress on algorithm design, provide accessible and reproducible evaluations for multi-turn interactions, and cover a range of task properties and challenges in improving reinforcement learning algorithms. Our paper introduces the LMRL-Gym benchmark for evaluating multi-turn RL for LLMs, together with an open-source research framework containing a basic toolkit for getting started on multi-turn RL with offline value-based and policy-based RL methods. Our benchmark consists of 8 different language tasks, which require multiple rounds of language interaction and cover a range of tasks in open-ended dialogue and text games.


title: Semantic Bound and Multi Types, Revisited

abstract: Intersection types are a standard tool in operational and semantical studies of the lambda calculus. De Carvalho showed how multi types, a quantitative variant of intersection types providing a handy presentation of the relational denotational model, allows one to extract precise bounds on the number of $\beta$-steps and the size of normal forms. In the last few years, de Carvalho's work has been extended and adapted to a number of lambda calculi, evaluation strategies, and abstract machines. These works, however, only adapt the first part of his work, that extracts bounds from multi type derivations, while never consider the second part, which deals with extracting bounds from the multi types themselves. The reason is that this second part is more technical, and requires to reason up to type substitutions. It is however also the most interesting, because it shows that the bounding power is inherent to the relational model (which is induced by the types, without the derivations), independently of its presentation as a type system. Here we dissect and clarify the second part of de Carvalho's work, establishing a link with principal multi types, and isolating a key property independent of type substitutions.


title: Hydrating and dehydrating dynamics process as an ion entering a carbon nanotube

abstract: Ion transport within confined environments, like nanopores and nanotubes, is pivotal for advancing a range of applications, including biosensors, seawater desalination, and energy storage devices. Existing research does not sufficiently delve into the alterations in ion hydration structure, a key element that significantly influences ion transport properties in such confined environments. Here, we report a theoretical model comprehensively considering the interplay between ions and nanotubes. By incorporating the effect of orientational competition, our model effectively predicts both the change in hydration structure and the free energy profile during an ion's transition from bulk water into a nanotube. These predictions match closely with the results from molecular dynamics simulations.


title: Einstein manifolds and curvature operator of the second kind

abstract: We prove that a compact Einstein manifold of dimension $n\geq 4$ with nonnegative curvature operator of the second kind is a constant curvature space by Bochner technique. Moreover, we obtain that compact Einstein manifolds of dimension $n\geq 11$ with $\left [ \frac{n+2}{4} \right ]$-nonnegative curvature operator of the second kind, $4\ (\mbox{resp.},8,9,10)$-dimensional compact Einstein manifolds with $2$-nonnegative curvature of the second kind and $5$-dimensional compact Einstein manifolds with $3$-nonnegative curvature of the second kind are constant curvature spaces. Combing with Li's result [10], we have that a compact Einstein manifold of dimension $n\geq 4$ with $\max\{4,\left [ \frac{n+2}{4} \right ]\}$-nonnegative curvature operator of the second kind is a constant curvature space.


title: Modelos de interacci\'{o}n no-conformal y termodin\'{a}mica de fluidos polares

abstract: In this thesis, we develop a simple model potential for polar molecules that effectively and accurately represents the thermodynamics of dilute gases. This potential models dipolar interactions, with a nonpolar spherical component, as seen in Stockmayer (SM) molecules or diatomic molecules such as dipolar Lennard-Jones molecules with two centers (2CLJ). Predictions based on this model for the second virial coefficient for SM and 2CLJ fluids closely match recent numerical results obtained by C. Vega et al. The model is employed to predict the critical temperature of an SM fluid with a variable dipole moment, as well as its equilibrium liquid-vapor properties. Finally, we apply this model to real polar molecules. A notable feature of this work is its connection between the shape of the potential profile and thermodynamic properties.


title: Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-specific Models

abstract: Vision Foundation Models (VFMs) pretrained on massive datasets exhibit impressive performance on various downstream tasks, especially with limited labeled target data. However, due to their high inference compute cost, these models cannot be deployed for many real-world applications. Motivated by this, we ask the following important question, "How can we leverage the knowledge from a large VFM to train a small task-specific model for a new target task with limited labeled training data?", and propose a simple task-oriented knowledge transfer approach as a highly effective solution to this problem. Our experimental results on five target tasks show that the proposed approach outperforms task-agnostic VFM distillation, web-scale CLIP pretraining, supervised ImageNet pretraining, and self-supervised DINO pretraining by up to 11.6%, 22.1%, 13.7%, and 29.8%, respectively. Furthermore, the proposed approach also demonstrates up to 9x, 4x and 15x reduction in pretraining compute cost when compared to task-agnostic VFM distillation, ImageNet pretraining and DINO pretraining, respectively, while outperforming them. We also show that the dataset used for transferring knowledge has a significant effect on the final target task performance, and introduce a retrieval-augmented knowledge transfer strategy that uses web-scale image retrieval to curate effective transfer sets.


title: The Einstein-Hilbert Action for Entropically Dominant Causal Sets

abstract: In the path integral formulation of causal set quantum gravity, the quantum partition function is a phase-weighted sum over locally finite partially ordered sets, which are viewed as discrete quantum spacetimes. It is known, however, that the number of ``layered'' sets -- a class of causal sets that look nothing like spacetime manifolds -- grows superexponentially with the cardinality $n$, giving an entropic contribution that can potentially dominate that of the action. We show here that in any dimension, the discrete Einstein-Hilbert action for a typical $K$-layered causal set reduces to the simple link action to leading order in $n$. Combined with earlier work, this completes the proof that the layered sets, although entropically dominant, are very strongly suppressed in the path sum of causal set quantum gravity whenever the discreteness scale is greater than or equal to a (mildly dimension-dependent) order one multiple of the Planck scale.


title: A unified continuous greedy algorithm for $k$-submodular maximization under a down-monotone constraint

abstract: A $k$-submodular function is a generalization of the submodular set function. Many practical applications can be modeled as maximizing a $k$-submodular function, such as multi-cooperative games, sensor placement with $k$ type sensors, influence maximization with $k$ topics, and feature selection with $k$ partitions. In this paper, we provide a unified continuous greedy algorithm for $k$-submodular maximization problem under a down-monotone constraint. Our technique involves relaxing the discrete variables in a continuous space by using the multilinear extension of $k$-submodular function to find a fractional solution, and then rounding it to obtain the feasible solution. Our proposed algorithm runs in polynomial time and can be applied to both the non-monotone and monotone cases. When the objective function is non-monotone, our algorithm achieves an approximation ratio of $(1/e-o(1))$; for a monotone $k$-submodular objective function, it achieves an approximation ratio of $(1-1/e-o(1))$.


title: Infinite dimensional analogues of Choi matrices

abstract: For a class of linear maps on a von Neumann factor, we associate two objects, bounded operators and trace class operators, both of which play the roles of Choi matrices. Each of them is positive if and only if the original map on the factor is completely positive. They are also useful to characterize positivity of maps as well as complete positivity. It turns out that such correspondences are possible for every normal completely bounded map if and only if the factor is of type I. As an application, we provide criteria for Schmidt numbers of normal positive functionals in terms of Choi matrices of $k$-positive maps, in infinite dimensional cases. We also define the notion of $k$-superpositive maps, which turns out to be equivalent to the property of $k$-partially entanglement breaking.


title: LLVMs4Protest: Harnessing the Power of Large Language and Vision Models for Deciphering Protests in the News

abstract: Large language and vision models have transformed how social movements scholars identify protest and extract key protest attributes from multi-modal data such as texts, images, and videos. This article documents how we fine-tuned two large pretrained transformer models, including longformer and swin-transformer v2, to infer potential protests in news articles using textual and imagery data. First, the longformer model was fine-tuned using the Dynamic of Collective Action (DoCA) Corpus. We matched the New York Times articles with the DoCA database to obtain a training dataset for downstream tasks. Second, the swin-transformer v2 models was trained on UCLA-protest imagery data. UCLA-protest project contains labeled imagery data with information such as protest, violence, and sign. Both fine-tuned models will be available via \url{https://github.com/Joshzyj/llvms4protest}. We release this short technical report for social movement scholars who are interested in using LLVMs to infer protests in textual and imagery data.


title: Localized and extended collective optical phonon modes in regular and random arrays of contacting nanoparticles: escape from phonon confinement

abstract: In the present paper, we utilize the coupled-oscillator model describing the hybridization of optical phonons in touching and/or overlapping particles in order to study the Raman spectra of nanoparticles organized into various types of regular and random arrays including nanosolids, porous media, and agglomerates with tightly bonded particles. For the nanocrystal solids, we demonstrate that the ratio of the size variance to the coupling strength allows us to judge the character (localized or propagating) of the optical phonon modes which left the particles of their origin and spread throughout an array. The relation between the shift and the broadening of the Raman peak and the coupling strength and the disorder is established for nanocrystal solids, agglomerates, and porous media providing us with information about the array structure, the structure of its constituents, and the properties of optical phonons.


title: DKiS: Decay weight invertible image steganography with private key

abstract: Image steganography, defined as the practice of concealing information within another image, traditionally encounters security challenges when its methods become publicly known or are under attack. To address this, a novel private key-based image steganography technique has been introduced. This approach ensures the security of the hidden information, as access requires a corresponding private key, regardless of the public knowledge of the steganography method. Experimental evidence has been presented, demonstrating the effectiveness of our method and showcasing its real-world applicability. Furthermore, a critical challenge in the invertible image steganography process has been identified by us: the transfer of non-essential, or `garbage', information from the secret to the host pipeline. To tackle this issue, the decay weight has been introduced to control the information transfer, effectively filtering out irrelevant data and enhancing the performance of image steganography. The code for this technique is publicly accessible at https://github.com/yanghangAI/DKiS, and a practical demonstration can be found at http://yanghang.site/hidekey.


title: Unveiling Vulnerabilities of Contrastive Recommender Systems to Poisoning Attacks

abstract: Contrastive learning (CL) has recently gained prominence in the domain of recommender systems due to its great ability to enhance recommendation accuracy and improve model robustness. Despite its advantages, this paper identifies a vulnerability of CL-based recommender systems that they are more susceptible to poisoning attacks aiming to promote individual items. Our analysis indicates that this vulnerability is attributed to the uniform spread of representations caused by the InfoNCE loss. Furthermore, theoretical and empirical evidence shows that optimizing this loss favors smooth spectral values of representations. This finding suggests that attackers could facilitate this optimization process of CL by encouraging a more uniform distribution of spectral values, thereby enhancing the degree of representation dispersion. With these insights, we attempt to reveal a potential poisoning attack against CL-based recommender systems, which encompasses a dual-objective framework: one that induces a smoother spectral value distribution to amplify the InfoNCE loss's inherent dispersion effect, named dispersion promotion; and the other that directly elevates the visibility of target items, named rank promotion. We validate the threats of our attack model through extensive experimentation on four datasets. By shedding light on these vulnerabilities, our goal is to advance the development of more robust CL-based recommender systems. The code is available at \url{https://github.com/CoderWZW/ARLib}.


title: Automatic Detection of Alzheimer's Disease with Multi-Modal Fusion of Clinical MRI Scans

abstract: The aging population of the U.S. drives the prevalence of Alzheimer's disease. Brookmeyer et al. forecasts approximately 15 million Americans will have either clinical AD or mild cognitive impairment by 2060. In response to this urgent call, methods for early detection of Alzheimer's disease have been developed for prevention and pre-treatment. Notably, literature on the application of deep learning in the automatic detection of the disease has been proliferating. This study builds upon previous literature and maintains a focus on leveraging multi-modal information to enhance automatic detection. We aim to predict the stage of the disease - Cognitively Normal (CN), Mildly Cognitive Impairment (MCI), and Alzheimer's Disease (AD), based on two different types of brain MRI scans. We design an AlexNet-based deep learning model that learns the synergy of complementary information from both T1 and FLAIR MRI scans.


title: Combined Scheduling, Memory Allocation and Tensor Replacement for Minimizing Off-Chip Data Accesses of DNN Accelerators

abstract: Specialized hardware accelerators have been extensively used for Deep Neural Networks (DNNs) to provide power/performance benefits. These accelerators contain specialized hardware that supports DNN operators, and scratchpad memory for storing the tensor operands. Often, the size of the scratchpad is insufficient to store all the tensors needed for the computation, and additional data accesses are needed to move tensors back and forth from host memory during the computation with significant power/performance overhead. The volume of these additional data accesses depends on the operator schedule, and memory allocation (specific locations selected for the tensors in the scratchpad). We propose an optimization framework, named COSMA, for mapping DNNs to an accelerator that finds the optimal operator schedule, memory allocation and tensor replacement that minimizes the additional data accesses. COSMA provides an Integer Linear Programming (ILP) formulation to generate the optimal solution for mapping a DNN to the accelerator for a given scratchpad size. We demonstrate that, using an off-the-shelf ILP solver, COSMA obtains the optimal solution in seconds for a wide-range of state-of-the-art DNNs for different applications. Further, it out-performs existing methods by reducing on average 84% of the non-compulsory data accesses. We further propose a divide-and-conquer heuristic to scale up to certain complex DNNs generated by Neural Architecture Search, and this heuristic solution reduces on average 85% data accesses compared with other works.


title: Induced electromagnetic radiation from a charged cloud in a plane gravitational wave

abstract: For the perturbative model of a plane gravitational wave on a flat background of Minkowski space-time, electromagnetic radiation from a charged cloud in the field of a gravitational wave, detected by a remote observer, was found. It is shown that the charge density in the cloud does not change, and the radiation is generated by currents induced by the gravitational wave. The angular distribution of the radiation is obtained. If the refractive index of the cloud medium is greater than unity, Cherenkov-type radiation is generated.


title: mPLUG-PaperOwl: Scientific Diagram Analysis with the Multimodal Large Language Model

abstract: Recently, the strong text creation ability of Large Language Models(LLMs) has given rise to many tools for assisting paper reading or even writing. However, the weak diagram analysis abilities of LLMs or Multimodal LLMs greatly limit their application scenarios, especially for scientific academic paper writing. In this work, towards a more versatile copilot for academic paper writing, we mainly focus on strengthening the multi-modal diagram analysis ability of Multimodal LLMs. By parsing Latex source files of high-quality papers, we carefully build a multi-modal diagram understanding dataset M-Paper. By aligning diagrams in the paper with related paragraphs, we construct professional diagram analysis samples for training and evaluation. M-Paper is the first dataset to support joint comprehension of multiple scientific diagrams, including figures and tables in the format of images or Latex codes. Besides, to better align the copilot with the user's intention, we introduce the `outline' as the control signal, which could be directly given by the user or revised based on auto-generated ones. Comprehensive experiments with a state-of-the-art Mumtimodal LLM demonstrate that training on our dataset shows stronger scientific diagram understanding performance, including diagram captioning, diagram analysis, and outline recommendation. The dataset, code, and model are available at https://github.com/X-PLUG/mPLUG-DocOwl/tree/main/PaperOwl.


title: Bulk-Edge Correspondence Recovered in Incompressible Geophysical Flows

abstract: Bulk-edge correspondence is a cornerstone in topological physics, establishing a connection between the number of unidirectional edge modes in physical space and a Chern number, an integer that counts phase singularities of the eigenmodes in parameter space. In continuous media, violation of this correspondence has been reported when some of the frequency wavebands are unbounded, resulting in weak topological protection of chiral edge states. Here, we propose a strategy to reestablish strong bulk-edge correspondence in incompressible rotating stratified flows, taking advantage of a natural cutoff frequency provided by density stratification. The key idea involves the introduction of an auxiliary field to handle the divergence-free constraint. This approach highlights the resilience of internal coastal Kelvin waves near vertical walls under varying boundary conditions.


title: Feasibility Analysis of In-Band Coexistence in Dense LEO Satellite Communication Systems

abstract: This work provides a rigorous methodology for assessing the feasibility of spectrum sharing between large low-earth orbit (LEO) satellite constellations. For concreteness, we focus on the existing Starlink system and the soon-to-be-launched Kuiper system, which is prohibited from inflicting excessive interference onto the incumbent Starlink ground users. We carefully model and study the potential downlink interference between the two systems and investigate how strategic satellite selection may be used by Kuiper to serve its ground users while also protecting Starlink ground users. We then extend this notion of satellite selection to the case where Kuiper has limited knowledge of Starlink's serving satellite. Our findings reveal that there is always the potential for very high and extremely low interference, depending on which Starlink and Kuiper satellites are being used to serve their users. Consequently, we show that Kuiper can protect Starlink ground users with high probability, by strategically selecting which of its satellites are used to serve its ground users. Simultaneously, Kuiper is capable of delivering near-maximal downlink SINR to its own ground users. This highlights a feasible route to the coexistence of two dense LEO satellite systems, even in scenarios where one system has limited knowledge of the other's serving satellites.


title: Can Large Language Models Be Good Companions? An LLM-Based Eyewear System with Conversational Common Ground

abstract: Developing chatbots as personal companions has long been a goal of artificial intelligence researchers. Recent advances in Large Language Models (LLMs) have delivered a practical solution for endowing chatbots with anthropomorphic language capabilities. However, it takes more than LLMs to enable chatbots that can act as companions. Humans use their understanding of individual personalities to drive conversations. Chatbots also require this capability to enable human-like companionship. They should act based on personalized, real-time, and time-evolving knowledge of their owner. We define such essential knowledge as the \textit{common ground} between chatbots and their owners, and we propose to build a common-ground-aware dialogue system from an LLM-based module, named \textit{OS-1}, to enable chatbot companionship. Hosted by eyewear, OS-1 can sense the visual and audio signals the user receives and extract real-time contextual semantics. Those semantics are categorized and recorded to formulate historical contexts from which the user's profile is distilled and evolves over time, i.e., OS-1 gradually learns about its user. OS-1 combines knowledge from real-time semantics, historical contexts, and user-specific profiles to produce a common-ground-aware prompt input into the LLM module. The LLM's output is converted to audio, spoken to the wearer when appropriate.We conduct laboratory and in-field studies to assess OS-1's ability to build common ground between the chatbot and its user. The technical feasibility and capabilities of the system are also evaluated. OS-1, with its common-ground awareness, can significantly improve user satisfaction and potentially lead to downstream tasks such as personal emotional support and assistance.