title: BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining

abstract: BERT (Bidirectional Encoder Representations from Transformers) has revolutionized the field of natural language processing through its exceptional performance on numerous tasks. Yet, the majority of researchers have mainly concentrated on enhancements related to the model structure, such as relative position embedding and more efficient attention mechanisms. Others have delved into pretraining tricks associated with Masked Language Modeling, including whole word masking. DeBERTa introduced an enhanced decoder adapted for BERT's encoder model for pretraining, proving to be highly effective. We argue that the design and research around enhanced masked language modeling decoders have been underappreciated. In this paper, we propose several designs of enhanced decoders and introduce BPDec (BERT Pretraining Decoder), a novel method for modeling training. Typically, a pretrained BERT model is fine-tuned for specific Natural Language Understanding (NLU) tasks. In our approach, we utilize the original BERT model as the encoder, making only changes to the decoder without altering the encoder. This approach does not necessitate extensive modifications to the encoder architecture and can be seamlessly integrated into existing fine-tuning pipelines and services, offering an efficient and effective enhancement strategy. Compared to other methods, while we also incur a moderate training cost for the decoder during the pretraining process, our approach does not introduce additional training costs during the fine-tuning phase. We test multiple enhanced decoder structures after pretraining and evaluate their performance on the GLUE tasks and SQuAD tasks. Our results demonstrate that BPDec, having only undergone subtle refinements to the model structure during pretraining, significantly enhances model performance without escalating the finetuning cost, inference time and serving budget.


title: PML-based boundary integral equation method for electromagnetic scattering problems in a layered-medium

abstract: This paper proposes a new boundary integral equation (BIE) methodology based on the perfectly matched layer (PML) truncation technique for solving the electromagnetic scattering problems in a multi-layered medium. Instead of using the original PML stretched fields, artificial fields which are also equivalent to the solutions in the physical region are introduced. This significantly simplifies the study of the proposed methodology to derive the PML problem. Then some PML transformed layer potentials and the associated boundary integral operators (BIOs) are defined and the corresponding jump relations are shown. Under the assumption that the fields vanish on the PML boundary, the solution representations, as well as the related BIEs and regularization of the hyper-singular operators, in terms of the current density functions on the truncated interface, are derived. Numerical experiments are presented to demonstrate the efficiency and accuracy of the method.


title: Importance-Aware Adaptive Dataset Distillation

abstract: Herein, we propose a novel dataset distillation method for constructing small informative datasets that preserve the information of the large original datasets. The development of deep learning models is enabled by the availability of large-scale datasets. Despite unprecedented success, large-scale datasets considerably increase the storage and transmission costs, resulting in a cumbersome model training process. Moreover, using raw data for training raises privacy and copyright concerns. To address these issues, a new task named dataset distillation has been introduced, aiming to synthesize a compact dataset that retains the essential information from the large original dataset. State-of-the-art (SOTA) dataset distillation methods have been proposed by matching gradients or network parameters obtained during training on real and synthetic datasets. The contribution of different network parameters to the distillation process varies, and uniformly treating them leads to degraded distillation performance. Based on this observation, we propose an importance-aware adaptive dataset distillation (IADD) method that can improve distillation performance by automatically assigning importance weights to different network parameters during distillation, thereby synthesizing more robust distilled datasets. IADD demonstrates superior performance over other SOTA dataset distillation methods based on parameter matching on multiple benchmark datasets and outperforms them in terms of cross-architecture generalization. In addition, the analysis of self-adaptive weights demonstrates the effectiveness of IADD. Furthermore, the effectiveness of IADD is validated in a real-world medical application such as COVID-19 detection.


title: Spatial Decomposition and Temporal Fusion based Inter Prediction for Learned Video Compression

abstract: Video compression performance is closely related to the accuracy of inter prediction. It tends to be difficult to obtain accurate inter prediction for the local video regions with inconsistent motion and occlusion. Traditional video coding standards propose various technologies to handle motion inconsistency and occlusion, such as recursive partitions, geometric partitions, and long-term references. However, existing learned video compression schemes focus on obtaining an overall minimized prediction error averaged over all regions while ignoring the motion inconsistency and occlusion in local regions. In this paper, we propose a spatial decomposition and temporal fusion based inter prediction for learned video compression. To handle motion inconsistency, we propose to decompose the video into structure and detail (SDD) components first. Then we perform SDD-based motion estimation and SDD-based temporal context mining for the structure and detail components to generate short-term temporal contexts. To handle occlusion, we propose to propagate long-term temporal contexts by recurrently accumulating the temporal information of each historical reference feature and fuse them with short-term temporal contexts. With the SDD-based motion model and long short-term temporal contexts fusion, our proposed learned video codec can obtain more accurate inter prediction. Comprehensive experimental results demonstrate that our codec outperforms the reference software of H.266/VVC on all common test datasets for both PSNR and MS-SSIM.


title: LiDAR-PTQ: Post-Training Quantization for Point Cloud 3D Object Detection

abstract: Due to highly constrained computing power and memory, deploying 3D lidar-based detectors on edge devices equipped in autonomous vehicles and robots poses a crucial challenge. Being a convenient and straightforward model compression approach, Post-Training Quantization (PTQ) has been widely adopted in 2D vision tasks. However, applying it directly to 3D lidar-based tasks inevitably leads to performance degradation. As a remedy, we propose an effective PTQ method called LiDAR-PTQ, which is particularly curated for 3D lidar detection (both SPConv-based and SPConv-free). Our LiDAR-PTQ features three main components, \textbf{(1)} a sparsity-based calibration method to determine the initialization of quantization parameters, \textbf{(2)} a Task-guided Global Positive Loss (TGPL) to reduce the disparity between the final predictions before and after quantization, \textbf{(3)} an adaptive rounding-to-nearest operation to minimize the layerwise reconstruction error. Extensive experiments demonstrate that our LiDAR-PTQ can achieve state-of-the-art quantization performance when applied to CenterPoint (both Pillar-based and Voxel-based). To our knowledge, for the very first time in lidar-based 3D detection tasks, the PTQ INT8 model's accuracy is almost the same as the FP32 model while enjoying $3\times$ inference speedup. Moreover, our LiDAR-PTQ is cost-effective being $30\times$ faster than the quantization-aware training method. Code will be released at \url{https://github.com/StiphyJay/LiDAR-PTQ}.


title: Stochastic Amortization: A Unified Approach to Accelerate Feature and Data Attribution

abstract: Many tasks in explainable machine learning, such as data valuation and feature attribution, perform expensive computation for each data point and can be intractable for large datasets. These methods require efficient approximations, and learning a network that directly predicts the desired output, which is commonly known as amortization, is a promising solution. However, training such models with exact labels is often intractable; we therefore explore training with noisy labels and find that this is inexpensive and surprisingly effective. Through theoretical analysis of the label noise and experiments with various models and datasets, we show that this approach significantly accelerates several feature attribution and data valuation methods, often yielding an order of magnitude speedup over existing approaches.


title: An Information Aggregation Operator

abstract: This study explores a new mathematical operator, symbolized as $\cupplus$, for information aggregation, aimed at enhancing traditional methods by directly amalgamating probability distributions. This operator facilitates the combination of probability densities, contributing a nuanced approach to probabilistic analysis. We apply this operator to a personalized incentive scenario, illustrating its potential in a practical context. The paper's primary contribution lies in introducing this operator and elucidating its elegant mathematical properties. This exploratory work marks a step forward in the field of information fusion and probabilistic reasoning.


title: Wormholes inside stars and black holes

abstract: We construct models of two exotic objects: (i) a wormhole whose throat is hidden by a stellar object like a neutron star; and (ii) a wormhole inside a black hole. We work within Einstein's gravity coupled to two scalar fields with a specific choice of the scalar field Lagrangian. In general, the model contains ghosts, but they are eliminated using the constraints given by the Lagrange multiplier fields. The constraints are a generalization of the mimetic constraint, where non-dynamical dark matter effectively appears. As a result, in our model, instead of the non-dynamical dark matter, non-dynamical exotic matter like a phantom effectively arises. For the mixed wormhole-plus-star system, we find the corresponding mass-radius relations and show that it is possible to get characteristics comparable to those of ordinary neutron stars. For the wormhole inside the black hole, we find an extremal limit where the radius of the throat coincides with the radius of the event horizon and demonstrate that the Hawking temperature vanishes in this limit.


title: Quantum Circuit Reconstruction from Power Side-Channel Attacks on Quantum Computer Controllers

abstract: The interest in quantum computing has grown rapidly in recent years, and with it grows the importance of securing quantum circuits. A novel type of threat to quantum circuits that dedicated attackers could launch are power trace attacks. To address this threat, this paper presents first formalization and demonstration of using power traces to unlock and steal quantum circuit secrets. With access to power traces, attackers can recover information about the control pulses sent to quantum computers. From the control pulses, the gate level description of the circuits, and eventually the secret algorithms can be reverse engineered. This work demonstrates how and what information could be recovered. This work uses algebraic reconstruction from power traces to realize two new types of single trace attacks: per-channel and total power attacks. The former attack relies on per-channel measurements to perform a brute-force attack to reconstruct the quantum circuits. The latter attack performs a single-trace attack using Mixed-Integer Linear Programming optimization. Through the use of algebraic reconstruction, this work demonstrates that quantum circuit secrets can be stolen with high accuracy. Evaluation on 32 real benchmark quantum circuits shows that our technique is highly effective at reconstructing quantum circuits. The findings not only show the veracity of the potential attacks, but also the need to develop new means to protect quantum circuits from power trace attacks. Throughout this work real control pulse information from real quantum computers is used to demonstrate potential attacks based on simulation of collection of power traces.


title: DF* PageRank: Improved Incrementally Expanding Approaches for Updating PageRank on Dynamic Graphs

abstract: PageRank is a widely used centrality measure that assesses the significance of vertices in a graph by considering their connections and the importance of those connections. Efficiently updating PageRank on dynamic graphs is essential for various applications due to the increasing scale of datasets. This technical report introduces our improved Dynamic Frontier (DF) and Dynamic Frontier with Pruning (DF-P) approaches. Given a batch update comprising edge insertions and deletions, these approaches iteratively identify vertices likely to change their ranks with minimal overhead. On a server featuring a 64-core AMD EPYC-7742 processor, our approaches outperform Static and Dynamic Traversal PageRank by 5.2x/15.2x and 1.3x/3.5x respectively - on real-world dynamic graphs, and by 7.2x/9.6x and 4.0x/5.6x on large static graphs with random batch updates. Furthermore, our approaches improve performance at a rate of 1.8x/1.7x for every doubling of threads.


title: Enhancing the expressivity of quantum neural networks with residual connections

abstract: In the recent noisy intermediate-scale quantum era, the research on the combination of artificial intelligence and quantum computing has been greatly developed. Inspired by neural networks, developing quantum neural networks with specific structures is one of the most promising directions for improving network performance. In this work, we propose a quantum circuit-based algorithm to implement quantum residual neural networks (QResNets), where the residual connection channels are constructed by introducing auxiliary qubits to the data-encoding and trainable blocks of the quantum neural networks. Importantly, we prove that when this particular network architecture is applied to a $l$-layer data-encoding, the number of frequency generation forms can be extended from one, namely the difference of the sum of generator eigenvalues, to $\mathcal{O}(l^2)$. And the flexibility in adjusting the corresponding Fourier coefficients can also be improved due to the diversity of spectrum construction methods and the additional optimization degrees of freedom in the generalized residual operators. These results indicate that the residual encoding scheme can achieve better spectral richness and enhance the expressivity of various parameterized quantum circuits. Extensive numerical demonstrations in regression tasks of fitting various functions and applications in image classification with MNIST datasets are offered to present the expressivity enhancement. Our work lays the foundation for a complete quantum implementation of the classical residual neural networks and explores a new strategy for quantum feature map in quantum machine learning.


title: A Deep Q-Network Based on Radial Basis Functions for Multi-Echelon Inventory Management

abstract: This paper addresses a multi-echelon inventory management problem with a complex network topology where deriving optimal ordering decisions is difficult. Deep reinforcement learning (DRL) has recently shown potential in solving such problems, while designing the neural networks in DRL remains a challenge. In order to address this, a DRL model is developed whose Q-network is based on radial basis functions. The approach can be more easily constructed compared to classic DRL models based on neural networks, thus alleviating the computational burden of hyperparameter tuning. Through a series of simulation experiments, the superior performance of this approach is demonstrated compared to the simple base-stock policy, producing a better policy in the multi-echelon system and competitive performance in the serial system where the base-stock policy is optimal. In addition, the approach outperforms current DRL approaches.


title: Finsler surfaces with vanishing $T$-tensor

abstract: In this paper, for Finsler surfaces, we prove that the T-condition and $\sigma T$-condition coincide. For higher dimensions $n\geq 3$, we illustrate by an example that the T-condition and $\sigma T$-condition are not equivalent. We show that the non-homothetic conformal change of a Berwald (resp. a Landsberg) surface is Berwaldian (resp. Landsbergian) if and only if the $\sigma T$-condition is satisfied. By solving the Landsberg's PDE, we classify all Finsler surfaces satisfying the T-condition, or equivalently the $\sigma T$-condition. Some examples are provided and studied.


title: Rethinking Personalized Federated Learning with Clustering-based Dynamic Graph Propagation

abstract: Most existing personalized federated learning approaches are based on intricate designs, which often require complex implementation and tuning. In order to address this limitation, we propose a simple yet effective personalized federated learning framework. Specifically, during each communication round, we group clients into multiple clusters based on their model training status and data distribution on the server side. We then consider each cluster center as a node equipped with model parameters and construct a graph that connects these nodes using weighted edges. Additionally, we update the model parameters at each node by propagating information across the entire graph. Subsequently, we design a precise personalized model distribution strategy to allow clients to obtain the most suitable model from the server side. We conduct experiments on three image benchmark datasets and create synthetic structured datasets with three types of typologies. Experimental results demonstrate the effectiveness of the proposed work.


title: Combining Satellite and Weather Data for Crop Type Mapping: An Inverse Modelling Approach

abstract: Accurate and timely crop mapping is essential for yield estimation, insurance claims, and conservation efforts. Over the years, many successful machine learning models for crop mapping have been developed that use just the multi-spectral imagery from satellites to predict crop type over the area of interest. However, these traditional methods do not account for the physical processes that govern crop growth. At a high level, crop growth can be envisioned as physical parameters, such as weather and soil type, acting upon the plant leading to crop growth which can be observed via satellites. In this paper, we propose Weather-based Spatio-Temporal segmentation network with ATTention (WSTATT), a deep learning model that leverages this understanding of crop growth by formulating it as an inverse model that combines weather (Daymet) and satellite imagery (Sentinel-2) to generate accurate crop maps. We show that our approach provides significant improvements over existing algorithms that solely rely on spectral imagery by comparing segmentation maps and F1 classification scores. Furthermore, effective use of attention in WSTATT architecture enables detection of crop types earlier in the season (up to 5 months in advance), which is very useful for improving food supply projections. We finally discuss the impact of weather by correlating our results with crop phenology to show that WSTATT is able to capture physical properties of crop growth.


title: CMA-ES with Learning Rate Adaptation

abstract: The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving continuous black-box optimization problems. A practically useful aspect of the CMA-ES is that it can be used without hyperparameter tuning. However, the hyperparameter settings still have a considerable impact on performance, especially for difficult tasks, such as solving multimodal or noisy problems. This study comprehensively explores the impact of learning rate on the CMA-ES performance and demonstrates the necessity of a small learning rate by considering ordinary differential equations. Thereafter, it discusses the setting of an ideal learning rate. Based on these discussions, we develop a novel learning rate adaptation mechanism for the CMA-ES that maintains a constant signal-to-noise ratio. Additionally, we investigate the behavior of the CMA-ES with the proposed learning rate adaptation mechanism through numerical experiments, and compare the results with those obtained for the CMA-ES with a fixed learning rate and with population size adaptation. The results show that the CMA-ES with the proposed learning rate adaptation works well for multimodal and/or noisy problems without extremely expensive learning rate tuning.


title: 3DPFIX: Improving Remote Novices' 3D Printing Troubleshooting through Human-AI Collaboration

abstract: The widespread consumer-grade 3D printers and learning resources online enable novices to self-train in remote settings. While troubleshooting plays an essential part of 3D printing, the process remains challenging for many remote novices even with the help of well-developed online sources, such as online troubleshooting archives and online community help. We conducted a formative study with 76 active 3D printing users to learn how remote novices leverage online resources in troubleshooting and their challenges. We found that remote novices cannot fully utilize online resources. For example, the online archives statically provide general information, making it hard to search and relate their unique cases with existing descriptions. Online communities can potentially ease their struggles by providing more targeted suggestions, but a helper who can provide custom help is rather scarce, making it hard to obtain timely assistance. We propose 3DPFIX, an interactive 3D troubleshooting system powered by the pipeline to facilitate Human-AI Collaboration, designed to improve novices' 3D printing experiences and thus help them easily accumulate their domain knowledge. We built 3DPFIX that supports automated diagnosis and solution-seeking. 3DPFIX was built upon shared dialogues about failure cases from Q&A discourses accumulated in online communities. We leverage social annotations (i.e., comments) to build an annotated failure image dataset for AI classifiers and extract a solution pool. Our summative study revealed that using 3DPFIX helped participants spend significantly less effort in diagnosing failures and finding a more accurate solution than relying on their common practice. We also found that 3DPFIX users learn about 3D printing domain-specific knowledge. We discuss the implications of leveraging community-driven data in developing future Human-AI Collaboration designs.


title: Decoding the MITRE Engenuity ATT&CK Enterprise Evaluation: An Analysis of EDR Performance in Real-World Environments

abstract: Endpoint detection and response (EDR) systems have emerged as a critical component of enterprise security solutions, effectively combating endpoint threats like APT attacks with extended lifecycles. In light of the growing significance of endpoint detection and response (EDR) systems, many cybersecurity providers have developed their own proprietary EDR solutions. It's crucial for users to assess the capabilities of these detection engines to make informed decisions about which products to choose. This is especially urgent given the market's size, which is expected to reach around 3.7 billion dollars by 2023 and is still expanding. MITRE is a leading organization in cyber threat analysis. In 2018, MITRE started to conduct annual APT emulations that cover major EDR vendors worldwide. Indicators include telemetry, detection and blocking capability, etc. Nevertheless, the evaluation results published by MITRE don't contain any further interpretations or suggestions. In this paper, we thoroughly analyzed MITRE evaluation results to gain further insights into real-world EDR systems under test. Specifically, we designed a whole-graph analysis method, which utilizes additional control flow and data flow information to measure the performance of EDR systems. Besides, we analyze MITRE evaluation's results over multiple years from various aspects, including detection coverage, detection confidence, detection modifier, data source, compatibility, etc. Through the above studies, we have compiled a thorough summary of our findings and gained valuable insights from the evaluation results. We believe these summaries and insights can assist researchers, practitioners, and vendors in better understanding the strengths and limitations of mainstream EDR products.


title: lil'HDoC: An Algorithm for Good Arm Identification under Small Threshold Gap

abstract: Good arm identification (GAI) is a pure-exploration bandit problem in which a single learner outputs an arm as soon as it is identified as a good arm. A good arm is defined as an arm with an expected reward greater than or equal to a given threshold. This paper focuses on the GAI problem under a small threshold gap, which refers to the distance between the expected rewards of arms and the given threshold. We propose a new algorithm called lil'HDoC to significantly improve the total sample complexity of the HDoC algorithm. We demonstrate that the sample complexity of the first $\lambda$ output arm in lil'HDoC is bounded by the original HDoC algorithm, except for one negligible term, when the distance between the expected reward and threshold is small. Extensive experiments confirm that our algorithm outperforms the state-of-the-art algorithms in both synthetic and real-world datasets.


title: Deciphering regulatory architectures from synthetic single-cell expression patterns

abstract: For the vast majority of genes in sequenced genomes, there is limited understanding of how they are regulated. Without such knowledge, it is not possible to perform a quantitative theory-experiment dialogue on how such genes give rise to physiological and evolutionary adaptation. One category of high-throughput experiments used to understand the sequence-phenotype relationship of the transcriptome is massively parallel reporter assays (MPRAs). However, to improve the versatility and scalability of MPRA pipelines, we need a "theory of the experiment" to help us better understand the impact of various biological and experimental parameters on the interpretation of experimental data. To that end, in this paper we create tens of thousands of synthetic single-cell gene expression outputs using both equilibrium and out-of-equilibrium models. These models make it possible to imitate the summary statistics (information footprints and expression shift matrices) used to characterize the output of MPRAs and from this summary statistic to infer the underlying regulatory architecture. Specifically, we use a more refined implementation of the so-called thermodynamic models in which the binding energies of each sequence variant are derived from energy matrices. Our simulations reveal important effects of the parameters on MPRA data and we demonstrate our ability to optimize MPRA experimental designs with the goal of generating thermodynamic models of the transcriptome with base-pair specificity. Further, this approach makes it possible to carefully examine the mapping between mutations in binding sites and their corresponding expression profiles, a tool useful not only for better designing MPRAs, but also for exploring regulatory evolution.


title: Signed $p$-adic $L$-functions of Bianchi modular forms

abstract: Let $p\geq 3$ be a prime number and $K$ be a quadratic imaginary field in which $p$ splits as $\mathfrak{p}\overline{\mathfrak{p}}$. Let $\mathcal{F}$ be a cuspidal Bianchi eigenform over $K$ of weight $(k,k)$, where $k\geq 2$ is an integer, level $\mathfrak{n}$ coprime to $(p)$, and non-ordinary at both of the primes above $p$. We assume $\mathcal{F}$ has trivial nebentypus. For $\mathfrak{q}\in\{\mathfrak{p}, \overline{\mathfrak{p}}\}$, let $a_{\mathfrak{q}}$ be the $T_{\mathfrak{q}}$ Hecke eigenvalue of $\mathcal{F}$ and let $\alpha_{\mathfrak{q}},\beta_{\mathfrak{q}}$ be the roots of polynomial $X^{2} -a_{\mathfrak{q}}X+ p^{k-1}$. Then we have four $p$-stabilizations of $\mathcal{F}$: $\mathcal{F}^{\alpha_{\mathfrak{p}},\alpha_{\overline{\mathfrak{p}}}}, \mathcal{F}^{\alpha_{\mathfrak{p}},\beta_{\overline{\mathfrak{p}}}}, \mathcal{F}^{\beta_{\mathfrak{p}},\alpha_{\overline{\mathfrak{p}}}},$ and $ \mathcal{F}^{\beta_{\mathfrak{p}},\beta_{\overline{\mathfrak{p}}}}$ which are Bianchi cusp forms of level $p\mathfrak{n}$. Due to Williams, to each $p$-stabilization $\mathcal{F}^{*,\dagger}$, we can attach a locally analytic distribution $L_{p}(\mathcal{F}^{*,\dagger})$ over the ray class group $\text{Cl}(K,p^{\infty})$. On viewing $L_{p}(\mathcal{F}^{*,\dagger})$ as a two-variable power series with coefficients in some $p$-adic field having unbounded denominators satisfying certain growth conditions, we decompose this power series into a linear combination of power series with bounded coefficients in the spirit of Pollack, Sprung, and Lei-Loeffler-Zerbes.


title: Space-division multiplexed phase compensation for quantum communication: concept and field demonstration

abstract: Phase-sensitive quantum communication has received considerable attention to overcome the distance limitation of quantum communication. A fundamental problem in phase-sensitive quantum communication is to compensate for phase drift in an optical fiber channel. A combination of time-, wavelength-, and space-division multiplexing can improve the phase stability of the optical fiber. However, the existing phase compensations have used only time- and wavelength-division multiplexing. Here, we demonstrate space-division multiplexed phase compensation in the Osaka metropolitan networks. Our compensation scheme uses two neighboring fibers, one for quantum communication and the other for sensing and compensating the phase drift. Our field investigations confirm the correlation of the phase drift patterns between the two neighboring fibers. Thanks to the correlation, our space-division multiplexed phase compensation significantly reduces the phase drift and improves the quantum bit error rate. Our phase compensation is scalable to a large number of fibers and can be implemented with simple instruments. Our study on space-multiplex phase compensation will support the field deployment of phase-sensitive quantum communication.


title: TransTroj: Transferable Backdoor Attacks to Pre-trained Models via Embedding Indistinguishability

abstract: Pre-trained models (PTMs) are extensively utilized in various downstream tasks. Adopting untrusted PTMs may suffer from backdoor attacks, where the adversary can compromise the downstream models by injecting backdoors into the PTM. However, existing backdoor attacks to PTMs can only achieve partially task-agnostic and the embedded backdoors are easily erased during the fine-tuning process. In this paper, we propose a novel transferable backdoor attack, TransTroj, to simultaneously meet functionality-preserving, durable, and task-agnostic. In particular, we first formalize transferable backdoor attacks as the indistinguishability problem between poisoned and clean samples in the embedding space. We decompose the embedding indistinguishability into pre- and post-indistinguishability, representing the similarity of the poisoned and reference embeddings before and after the attack. Then, we propose a two-stage optimization that separately optimizes triggers and victim PTMs to achieve embedding indistinguishability. We evaluate TransTroj on four PTMs and six downstream tasks. Experimental results show that TransTroj significantly outperforms SOTA task-agnostic backdoor attacks (18%$\sim$99%, 68% on average) and exhibits superior performance under various system settings. The code is available at https://github.com/haowang-cqu/TransTroj .


abstract: Large language models (LLMs) inevitably exhibit hallucinations since the accuracy of generated texts cannot be secured solely by the parametric knowledge they encapsulate. Although retrieval-augmented generation (RAG) is a practicable complement to LLMs, it relies heavily on the relevance of retrieved documents, raising concerns about how the model behaves if retrieval goes wrong. To this end, we propose the Corrective Retrieval Augmented Generation (CRAG) to improve the robustness of generation. Specifically, a lightweight retrieval evaluator is designed to assess the overall quality of retrieved documents for a query, returning a confidence degree based on which different knowledge retrieval actions can be triggered. Since retrieval from static and limited corpora can only return sub-optimal documents, large-scale web searches are utilized as an extension for augmenting the retrieval results. Besides, a decompose-then-recompose algorithm is designed for retrieved documents to selectively focus on key information and filter out irrelevant information in them. CRAG is plug-and-play and can be seamlessly coupled with various RAG-based approaches. Experiments on four datasets covering short- and long-form generation tasks show that CRAG can significantly improve the performance of RAG-based approaches.


title: Rectify the Regression Bias in Long-Tailed Object Detection

abstract: Long-tailed object detection faces great challenges because of its extremely imbalanced class distribution. Recent methods mainly focus on the classification bias and its loss function design, while ignoring the subtle influence of the regression branch. This paper shows that the regression bias exists and does adversely and seriously impact the detection accuracy. While existing methods fail to handle the regression bias, the class-specific regression head for rare classes is hypothesized to be the main cause of it in this paper. As a result, three kinds of viable solutions to cater for the rare categories are proposed, including adding a class-agnostic branch, clustering heads and merging heads. The proposed methods brings in consistent and significant improvements over existing long-tailed detection methods, especially in rare and common classes. The proposed method achieves state-of-the-art performance in the large vocabulary LVIS dataset with different backbones and architectures. It generalizes well to more difficult evaluation metrics, relatively balanced datasets, and the mask branch. This is the first attempt to reveal and explore rectifying of the regression bias in long-tailed object detection.


title: Grey Level Texture Features for Segmentation of Chromogenic Dye RNAscope From Breast Cancer Tissue

abstract: Chromogenic RNAscope dye and haematoxylin staining of cancer tissue facilitates diagnosis of the cancer type and subsequent treatment, and fits well into existing pathology workflows. However, manual quantification of the RNAscope transcripts (dots), which signify gene expression, is prohibitively time consuming. In addition, there is a lack of verified supporting methods for quantification and analysis. This paper investigates the usefulness of grey level texture features for automatically segmenting and classifying the positions of RNAscope transcripts from breast cancer tissue. Feature analysis showed that a small set of grey level features, including Grey Level Dependence Matrix and Neighbouring Grey Tone Difference Matrix features, were well suited for the task. The automated method performed similarly to expert annotators at identifying the positions of RNAscope transcripts, with an F1-score of 0.571 compared to the expert inter-rater F1-score of 0.596. These results demonstrate the potential of grey level texture features for automated quantification of RNAscope in the pathology workflow.


title: Rational reductions for holonomic sequences

abstract: Given a holonomic sequence $F(n)$, we characterize rational functions $r(n)$ so that $r(n)F(n)$ can be summable. We provide upper and lower bounds on the degree of the numerator of $r(k)$ and show the denominator of $r(n)$ can be read from annihilators of $F(k)$. This illustration provides the so-called rational reductions which can be used to generate new multi-sum equalities and congruences from known ones.


title: Topological magnon-polarons in honeycomb antiferromagnets with spin-flop transition

abstract: We theoretically investigate the thermal Hall transport of magnon-polarons in a two-dimensional honeycomb antiferromagnetic insulator under the influence of a perpendicular magnetic field, varying in strength. The application of a perpendicular magnetic field induces a magnetic phase transition from the collinear antiferromagnetic phase to the spin-flop phase, leading to a significant alteration in Hall transport across the transition point. In this paper, our focus is on the intrinsic contribution to thermal Hall transport arising from the magnetoelastic interaction. To facilitate experimental verification of our theoretical results, we present the dependence of thermal Hall conductivity on magnetic field strength and temperature.


title: Sliced Wasserstein with Random-Path Projecting Directions

abstract: Slicing distribution selection has been used as an effective technique to improve the performance of parameter estimators based on minimizing sliced Wasserstein distance in applications. Previous works either utilize expensive optimization to select the slicing distribution or use slicing distributions that require expensive sampling methods. In this work, we propose an optimization-free slicing distribution that provides a fast sampling for the Monte Carlo estimation of expectation. In particular, we introduce the random-path projecting direction (RPD) which is constructed by leveraging the normalized difference between two random vectors following the two input measures. From the RPD, we derive the random-path slicing distribution (RPSD) and two variants of sliced Wasserstein, i.e., the Random-Path Projection Sliced Wasserstein (RPSW) and the Importance Weighted Random-Path Projection Sliced Wasserstein (IWRPSW). We then discuss the topological, statistical, and computational properties of RPSW and IWRPSW. Finally, we showcase the favorable performance of RPSW and IWRPSW in gradient flow and the training of denoising diffusion generative models on images.


title: Probabilistic Guarantees of Stochastic Recursive Gradient in Non-Convex Finite Sum Problems

abstract: This paper develops a new dimension-free Azuma-Hoeffding type bound on summation norm of a martingale difference sequence with random individual bounds. With this novel result, we provide high-probability bounds for the gradient norm estimator in the proposed algorithm Prob-SARAH, which is a modified version of the StochAstic Recursive grAdient algoritHm (SARAH), a state-of-art variance reduced algorithm that achieves optimal computational complexity in expectation for the finite sum problem. The in-probability complexity by Prob-SARAH matches the best in-expectation result up to logarithmic factors. Empirical experiments demonstrate the superior probabilistic performance of Prob-SARAH on real datasets compared to other popular algorithms.


title: A field-level emulator for modeling baryonic effects across hydrodynamic simulations

abstract: We develop a new and simple method to model baryonic effects at the field level relevant for weak lensing analyses. We analyze thousands of state-of-the-art hydrodynamic simulations from the CAMELS project, each with different cosmology and strength of feedback, and we find that the cross-correlation coefficient between full hydrodynamic and N-body simulations is very close to 1 down to $k\sim10~h{\rm Mpc}^{-1}$. This suggests that modeling baryonic effects at the field level down to these scales only requires N-body simulations plus a correction to the mode's amplitude given by: $\sqrt{P_{\rm hydro}(k)/P_{\rm nbody}(k)}$. In this paper, we build an emulator for this quantity, using Gaussian processes, that is flexible enough to reproduce results from thousands of hydrodynamic simulations that have different cosmologies, astrophysics, subgrid physics, volumes, resolutions, and at different redshifts. Our emulator is accurate at the percent level and exhibits a range of validation superior to previous studies. This method and our emulator enable field-level simulation-based inference analyses and accounting for baryonic effects in weak lensing analyses.


title: On Chen--Xu's extensions of the Romanoff theorem

abstract: Let $\mathcal{P}$ be the set of primes and $\mathbb{N}$ the set of positive integers. Let also $r_1,...,r_t$ be positive real numbers and $R_2(r_1,...,r_t)$ the set of odd integers which can be represented as $$ p+2^{\lfloor k_1^{r_1}\rfloor}+\cdot\cdot\cdot+2^{\lfloor k_t^{r_t}\rfloor}, $$ where $p\in \mathcal{P}$ and $k_1,...,k_t\in\mathbb{N}$. Recently, Chen and Xu proved that the set $R_2(r_1,...,r_t)$ has positive lower asymptotic density, provided that $r_1^{-1}+\cdot\cdot\cdot+r_t^{-1}\ge 1$ and at least one of $r_1,...,r_t$ is an integer. Their result reduces to the famous theorem of Romanoff by taking $t=r_1=1.$ In this note, we remove the unnecessary condition that `{\it at least one of $r_1,...,r_t$ is an integer}'. The improvement benefits from a finite form of the uniform distribution type result as well as the van der Corput type bounds.


title: Arbitrary-Scale Downscaling of Tidal Current Data Using Implicit Continuous Representation

abstract: Numerical models have long been used to understand geoscientific phenomena, including tidal currents, crucial for renewable energy production and coastal engineering. However, their computational cost hinders generating data of varying resolutions. As an alternative, deep learning-based downscaling methods have gained traction due to their faster inference speeds. But most of them are limited to only inference fixed scale and overlook important characteristics of target geoscientific data. In this paper, we propose a novel downscaling framework for tidal current data, addressing its unique characteristics, which are dissimilar to images: heterogeneity and local dependency. Moreover, our framework can generate any arbitrary-scale output utilizing a continuous representation model. Our proposed framework demonstrates significantly improved flow velocity predictions by 93.21% (MSE) and 63.85% (MAE) compared to the Baseline model while achieving a remarkable 33.2% reduction in FLOPs.


title: A Gated MLP Architecture for Learning Topological Dependencies in Spatio-Temporal Graphs

abstract: Graph Neural Networks (GNNs) and Transformer have been increasingly adopted to learn the complex vector representations of spatio-temporal graphs, capturing intricate spatio-temporal dependencies crucial for applications such as traffic datasets. Although many existing methods utilize multi-head attention mechanisms and message-passing neural networks (MPNNs) to capture both spatial and temporal relations, these approaches encode temporal and spatial relations independently, and reflect the graph's topological characteristics in a limited manner. In this work, we introduce the Cycle to Mixer (Cy2Mixer), a novel spatio-temporal GNN based on topological non-trivial invariants of spatio-temporal graphs with gated multi-layer perceptrons (gMLP). The Cy2Mixer is composed of three blocks based on MLPs: A message-passing block for encapsulating spatial information, a cycle message-passing block for enriching topological information through cyclic subgraphs, and a temporal block for capturing temporal properties. We bolster the effectiveness of Cy2Mixer with mathematical evidence emphasizing that our cycle message-passing block is capable of offering differentiated information to the deep learning model compared to the message-passing block. Furthermore, empirical evaluations substantiate the efficacy of the Cy2Mixer, demonstrating state-of-the-art performances across various traffic benchmark datasets.


title: A Uniformly Selected Sample of Low-mass Black Holes in Seyfert 1 Galaxies. III. Radio sources from the SKA pathfinders and beyond

abstract: Occupying the intermediate-mass regime of the accretion--jet parameter space, radio continuum emission from active galactic nuclei with black hole mass M_BH <~ 10^6 Msun (low-mass AGNs) is a valuable probe to the physics of relativistic jets. Yet the number of low-mass AGNs with radio detection is rather limited so far (~ 40 in total). In this work we make two efforts to search for radio counterparts for the largest sample of optically selected low-mass AGNs. First, we collect counterparts from the recent data releases of SKA pathfinders such as LOFAR Two-metre Sky Survey (LoTSS). Additionally, we deeply mine in Faint Images of the Radio Sky at Twenty-Centimeters (FIRST), fitting the FIRST images of the optical AGNs with an elaborate procedure optimized to detect faint radio sources. We have obtained 151 radio sources (mainly from the SKA pathfinders), including 102 new reliable sources (S/N >= 5) and 23 new candidates (3.5 <= S/N < 5). The majority of these new sources (119 of 125) have flux densities lower than the threshold of the official FIRST catalog. The new sources have rest-frame 20 cm power (P_20cm) from 1.98 x 10^20 to 1.29 x 10^23 W/Hz. For low-z Seyfert galaxies P_20cm correlates with M_BH intrinsically and positively, yet only marginally with Eddington ratio L/L_EDD. In terms of the logN--logS relation for the expanding Universe, the limiting flux density for the completeness of our LoTSS sources turns out to be 0.45 mJy at 1.4 GHz; i.e., complete to such a flux-density level that is four times deeper than the official FIRST catalog.


title: M2-Encoder: Advancing Bilingual Image-Text Understanding by Large-scale Efficient Pretraining

abstract: Vision-language foundation models like CLIP have revolutionized the field of artificial intelligence. Nevertheless, VLM models supporting multi-language, e.g., in both Chinese and English, have lagged due to the relative scarcity of large-scale pretraining datasets. Toward this end, we introduce a comprehensive bilingual (Chinese-English) dataset BM-6B with over 6 billion image-text pairs, aimed at enhancing multimodal foundation models to well understand images in both languages. To handle such a scale of dataset, we propose a novel grouped aggregation approach for image-text contrastive loss computation, which reduces the communication overhead and GPU memory demands significantly, facilitating a 60% increase in training speed. We pretrain a series of bilingual image-text foundation models with an enhanced fine-grained understanding ability on BM-6B, the resulting models, dubbed as $M^2$-Encoders (pronounced "M-Square"), set new benchmarks in both languages for multimodal retrieval and classification tasks. Notably, Our largest $M^2$-Encoder-10B model has achieved top-1 accuracies of 88.5% on ImageNet and 80.7% on ImageNet-CN under a zero-shot classification setting, surpassing previously reported SoTA methods by 2.2% and 21.1%, respectively. The $M^2$-Encoder series represents one of the most comprehensive bilingual image-text foundation models to date, so we are making it available to the research community for further exploration and development.


title: Red-Teaming for Generative AI: Silver Bullet or Security Theater?

abstract: In response to rising concerns surrounding the safety, security, and trustworthiness of Generative AI (GenAI) models, practitioners and regulators alike have pointed to AI red-teaming as a key component of their strategies for identifying and mitigating these risks. However, despite AI red-teaming's central role in policy discussions and corporate messaging, significant questions remain about what precisely it means, what role it can play in regulation, and how it relates to conventional red-teaming practices as originally conceived in the field of cybersecurity. In this work, we identify recent cases of red-teaming activities in the AI industry and conduct an extensive survey of relevant research literature to characterize the scope, structure, and criteria for AI red-teaming practices. Our analysis reveals that prior methods and practices of AI red-teaming diverge along several axes, including the purpose of the activity (which is often vague), the artifact under evaluation, the setting in which the activity is conducted (e.g., actors, resources, and methods), and the resulting decisions it informs (e.g., reporting, disclosure, and mitigation). In light of our findings, we argue that while red-teaming may be a valuable big-tent idea for characterizing GenAI harm mitigations, and that industry may effectively apply red-teaming and other strategies behind closed doors to safeguard AI, gestures towards red-teaming (based on public definitions) as a panacea for every possible risk verge on security theater. To move toward a more robust toolbox of evaluations for generative AI, we synthesize our recommendations into a question bank meant to guide and scaffold future AI red-teaming practices.


title: Mitigation of Channel Tampering Attacks in Continuous-Variable Quantum Key Distribution

abstract: Despite significant advancements in continuous-variable quantum key distribution (CV-QKD), practical CV-QKD systems can be compromised by various attacks. Consequently, identifying new attack vectors and countermeasures for CV-QKD implementations is important for the continued robustness of CV-QKD. In particular, as CV-QKD relies on a public quantum channel, vulnerability to communication disruption persists from potential adversaries employing Denial-of-Service (DoS) attacks. Inspired by DoS attacks, this paper introduces a novel threat in CV-QKD called the Channel Amplification (CA) attack, wherein Eve manipulates the communication channel through amplification. We specifically model this attack in a CV-QKD optical fiber setup. To counter this threat, we propose a detection and mitigation strategy. Detection involves a machine learning (ML) model based on a decision tree classifier, classifying various channel tampering attacks, including CA and DoS attacks. For mitigation, Bob, post-selects quadrature data by classifying the attack type and frequency. Our ML model exhibits high accuracy in distinguishing and categorizing these attacks. The CA attack's impact on the secret key rate (SKR) is explored concerning Eve's location and the relative intensity noise of the local oscillator (LO). The proposed mitigation strategy improves the attacked SKR for CA attacks and, in some cases, for hybrid CA-DoS attacks. Our study marks a novel application of both ML classification and post-selection in this context. These findings are important for enhancing the robustness of CV-QKD systems against emerging threats on the channel.


title: Fast renormalizing the structures and dynamics of ultra-large systems via random renormalization group

abstract: Criticality and symmetry, studied by the renormalization groups, lie at the heart of modern physics theories of matters and complex systems. However, surveying these properties with massive experimental data is bottlenecked by the intolerable costs of computing renormalization groups on real systems. Here, we develop a time- and memory-efficient framework, termed as the random renormalization group, for renormalizing ultra-large systems (e.g., with millions of units) within minutes. This framework is based on random projections, hashing techniques, and kernel representations, which support the renormalization governed by linear and non-linear correlations. For system structures, it exploits the correlations among local topology in kernel spaces to unfold the connectivity of units, identify intrinsic system scales, and verify the existences of symmetries under scale transformation. For system dynamics, it renormalizes units into correlated clusters to analyze scaling behaviours, validate scaling relations, and investigate potential criticality. Benefiting from hashing-function-based designs, our framework significantly reduces computational complexity compared with classic renormalization groups, realizing a single-step acceleration of two orders of magnitude. Meanwhile, the efficient representation of different kinds of correlations in kernel spaces realized by random projections ensures the capacity of our framework to capture diverse unit relations. As shown by our experiments, the random renormalization group helps identify non-equilibrium phase transitions, criticality, and symmetry in diverse large-scale genetic, neural, material, social, and cosmological systems.


title: MV2MAE: Multi-View Video Masked Autoencoders

abstract: Videos captured from multiple viewpoints can help in perceiving the 3D structure of the world and benefit computer vision tasks such as action recognition, tracking, etc. In this paper, we present a method for self-supervised learning from synchronized multi-view videos. We use a cross-view reconstruction task to inject geometry information in the model. Our approach is based on the masked autoencoder (MAE) framework. In addition to the same-view decoder, we introduce a separate cross-view decoder which leverages cross-attention mechanism to reconstruct a target viewpoint video using a video from source viewpoint, to help representations robust to viewpoint changes. For videos, static regions can be reconstructed trivially which hinders learning meaningful representations. To tackle this, we introduce a motion-weighted reconstruction loss which improves temporal modeling. We report state-of-the-art results on the NTU-60, NTU-120 and ETRI datasets, as well as in the transfer learning setting on NUCLA, PKU-MMD-II and ROCOG-v2 datasets, demonstrating the robustness of our approach. Code will be made available.


title: Lagrangian cuts generated by batch to efficiently solve two-stage stochastic mixed-integer program

abstract: We propose to generate Lagrangian cut for two-stage stochastic integer program by batch, in contrast to the existing methods which solve each Lagrangian subproblem at every iteration. We establish two convergence properties of the proposed algorithm. Then we demonstrate that the improvement in the lower bound achieved by incorporating the Lagrangian cut adheres to the `triangle inequality', thereby showcasing the superiority of our proposed method over existing approaches. Moreover, we suggest acquiring Lagrangian cuts for unresolved scenarios by averaging the coefficients of the acquired Lagrangian cuts, ensuring the quality of this cut with a certain probability. Computational study demonstrates that our proposed algorithm can significantly improve the lower bound of the linear relaxation of the Bender master problem more quickly with much fewer Lagrangian cuts.


title: A Concise but High-performing Network for Image Guided Depth Completion in Autonomous Driving

abstract: Depth completion is a crucial task in autonomous driving, aiming to convert a sparse depth map into a dense depth prediction. Due to its potentially rich semantic information, RGB image is commonly fused to enhance the completion effect. Image-guided depth completion involves three key challenges: 1) how to effectively fuse the two modalities; 2) how to better recover depth information; and 3) how to achieve real-time prediction for practical autonomous driving. To solve the above problems, we propose a concise but effective network, named CENet, to achieve high-performance depth completion with a simple and elegant structure. Firstly, we use a fast guidance module to fuse the two sensor features, utilizing abundant auxiliary features extracted from the color space. Unlike other commonly used complicated guidance modules, our approach is intuitive and low-cost. In addition, we find and analyze the optimization inconsistency problem for observed and unobserved positions, and a decoupled depth prediction head is proposed to alleviate the issue. The proposed decoupled head can better output the depth of valid and invalid positions with very few extra inference time. Based on the simple structure of dual-encoder and single-decoder, our CENet can achieve superior balance between accuracy and efficiency. In the KITTI depth completion benchmark, our CENet attains competitive performance and inference speed compared with the state-of-the-art methods. To validate the generalization of our method, we also evaluate on indoor NYUv2 dataset, and our CENet still achieve impressive results. The code of this work will be available at https://github.com/lmomoy/CHNet.


title: Toward the Identifiability of Comparative Deep Generative Models

abstract: Deep Generative Models (DGMs) are versatile tools for learning data representations while adequately incorporating domain knowledge such as the specification of conditional probability distributions. Recently proposed DGMs tackle the important task of comparing data sets from different sources. One such example is the setting of contrastive analysis that focuses on describing patterns that are enriched in a target data set compared to a background data set. The practical deployment of those models often assumes that DGMs naturally infer interpretable and modular latent representations, which is known to be an issue in practice. Consequently, existing methods often rely on ad-hoc regularization schemes, although without any theoretical grounding. Here, we propose a theory of identifiability for comparative DGMs by extending recent advances in the field of non-linear independent component analysis. We show that, while these models lack identifiability across a general class of mixing functions, they surprisingly become identifiable when the mixing function is piece-wise affine (e.g., parameterized by a ReLU neural network). We also investigate the impact of model misspecification, and empirically show that previously proposed regularization techniques for fitting comparative DGMs help with identifiability when the number of latent variables is not known in advance. Finally, we introduce a novel methodology for fitting comparative DGMs that improves the treatment of multiple data sources via multi-objective optimization and that helps adjust the hyperparameter for the regularization in an interpretable manner, using constrained optimization. We empirically validate our theory and new methodology using simulated data as well as a recent data set of genetic perturbations in cells profiled via single-cell RNA sequencing.


title: Boundary touching probability and nested-path exponent for non-simple CLE

abstract: The conformal loop ensemble (CLE) has two phases: for $\kappa \in (8/3, 4]$, the loops are simple and do not touch each other or the boundary; for $\kappa \in (4,8)$, the loops are non-simple and may touch each other and the boundary. We derive the probability that the loop surrounding a given point touches the domain boundary. We also obtain the law of the conformal radius of this loop seen from the given point conditioned on the loop touching the boundary or not, refining a result of Schramm-Sheffield-Wilson (2009). As an application, we exactly evaluate the CLE counterpart of the nested-path exponent for the Fortuin-Kasteleyn (FK) random cluster model recently introduced by Song-Tan-Zhang-Jacobsen-Nienhuis-Deng (2022). This exponent describes the asymptotic behavior of the number of nested open paths in the open cluster containing the origin when the cluster is large. For Bernoulli percolation, which corresponds to $\kappa=6$, the exponent was derived recently in Song-Jacobsen-Nienhuis-Sportiello-Deng (2023) by a color switching argument. For $\kappa\neq 6$, and in particular for the FK-Ising case, our formula appears to be new. Our derivation begins with Sheffield's construction of CLE from which the quantities of interest can be expressed by radial SLE. We solve the radial SLE problem using the coupling between SLE and Liouville quantum gravity, along with the exact solvability of Liouville conformal field theory.


title: A Numerical Truncation Approximation with A Posteriori Error Bounds for the Solution of Poisson's Equation

abstract: The solution to Poisson's equation arise in many Markov chain and Markov jump process settings, including that of the central limit theorem, value functions for average reward Markov decision processes, and within the gradient formula for equilibrium Markovian rewards. In this paper, we consider the problem of numerically computing the solution to Poisson's equation when the state space is infinite or very large. In such settings, the state space must be truncated in order to make the problem computationally tractable. In this paper, we provide the first truncation approximation solution to Poisson's equation that comes with provable and computable a posteriori error bounds. Our theory applies to both discrete-time chains and continuous-time jump processes. Through numerical experiments, we show our method can provide highly accurate solutions and tight bounds.


title: Mean Estimation with User-Level Privacy for Spatio-Temporal IoT Datasets

abstract: This paper considers the problem of the private release of sample means of speed values from traffic datasets. Our key contribution is the development of user-level differentially private algorithms that incorporate carefully chosen parameter values to ensure low estimation errors on real-world datasets, while ensuring privacy. We test our algorithms on ITMS (Intelligent Traffic Management System) data from an Indian city, where the speeds of different buses are drawn in a potentially non-i.i.d. manner from an unknown distribution, and where the number of speed samples contributed by different buses is potentially different. We then apply our algorithms to large synthetic datasets, generated based on the ITMS data. Here, we provide theoretical justification for the observed performance trends, and also provide recommendations for the choices of algorithm subroutines that result in low estimation errors. Finally, we characterize the best performance of pseudo-user creation-based algorithms on worst-case datasets via a minimax approach; this then gives rise to a novel procedure for the creation of pseudo-users, which optimizes the worst-case total estimation error. The algorithms discussed in the paper are readily applicable to general spatio-temporal IoT datasets for releasing a differentially private mean of a desired value.


title: Magnetic, thermodynamic, and magnetotransport properties of CeGaGe and PrGaGe single crystals

abstract: We investigate the physical properties of high-quality single crystals CeGaGe and PrGaGe using magnetization, heat capacity, and magnetotransport measurements. Gallium-indium binary flux was used to grow these single crystals that crystallize in a body-centered tetragonal structure. Magnetic susceptibility data reveal a magnetic phase transition around 6.0 and 19.4 K in CeGaGe and PrGaGe, respectively, which is further confirmed by heat capacity and electrical resistivity data. A number of additional anomalies have been observed below the ordering temperature in the magnetic susceptibility data, indicating a complex magnetic structure. The magnetic measurements also reveal a strong magnetocrystalline anisotropy in both compounds. Our detailed analysis of the crystalline electric field (CEF) effect as observed in magnetic susceptibility and heat capacity data suggests that the $J$ = 5/2 multiplet of CeGaGe splits into three doublets, while the $J$ = 4 degenerate ground state of PrGaGe splits into five singlets and two doublets. The estimated energy levels from the CEF analysis are consistent with the magnetic entropy.


title: Energy Localization in Spherical Non-Hermitian Topolectrical Circuits

abstract: This work delves into the energy localization in non-Hermitian systems, particularly focusing on the effects of topological defects in spherical models. We analyze the mode distribution changes in non-Hermitian Su-Schrieffer-Heeger (SSH) chains impacted by defects, utilizing the Maximum Skin Corner Weight (MaxWSC). By introducing an innovative spherical model, conceptualized through bisecting spheres into one-dimensional chain structures, we investigate the non-Hermitian skin effect (NHSE) in a new dimensional context, venturing into the realm of non-Euclidean geometry. Our experimental validations on Printed Circuit Boards (PCBs) confirm the theoretical findings. Collectively, these results not only validate our theoretical framework but also demonstrate the potential of engineered circuit systems to emulate complex non-Hermitian phenomena, showcasing the applicability of non-Euclidean geometries in studying NHSE and topological phenomena in non-Hermitian systems.


title: Detection of diffusion anisotropy from an individual short particle trajectory

abstract: In parallel with advances in microscale imaging techniques, the fields of biology and materials science have focused on precisely extracting particle properties based on their diffusion behavior. Although the majority of real-world particles exhibit anisotropy, their behavior has been studied less than that of isotropic particles. In this study, we introduce a new method for estimating the diffusion coefficients of individual anisotropic particles using short-trajectory data on the basis of a maximum likelihood framework. Traditional estimation techniques often use mean-squared displacement (MSD) values or other statistical measures that inherently remove angular information. Instead, we treated the angle as a latent variable and used belief propagation to estimate it while maximizing the likelihood using the expectation-maximization algorithm. Compared to conventional methods, this approach facilitates better estimation of shorter trajectories and faster rotations, as confirmed by numerical simulations and experimental data involving bacteria and quantum rods. Additionally, we performed an analytical investigation of the limits of detectability of anisotropy and provided guidelines for the experimental design. In addition to serving as a powerful tool for analyzing complex systems, the proposed method will pave the way for applying maximum likelihood methods to more complex diffusion phenomena.


title: Correction to "Private Information Retrieval Over Gaussian MAC"

abstract: In the above article \cite{shmuel2021private}, the authors introduced a PIR scheme for the Additive White Gaussian Noise (AWGN) Multiple Access Channel (MAC), both with and without fading. The authors utilized the additive nature of the channel and leveraged the linear properties and structure of lattice codes to retrieve the desired message without the servers acquiring any knowledge on the retrieved message's index. Theorems 3 and 4 in \cite{shmuel2021private} contain an error arising from the incorrect usage of the modulo operator. Moreover, the proofs assume a one-to-one mapping function, $\phi(\cdot)$, between a message $W_j\in\mathbb{F}_p^L$ and the elements of $\mathcal{C}$, mistakenly suggesting that the user possesses all the required information in advance. However, this is not the case. Herein, we present the corrected versions of these theorems.


abstract: In the field of causal modeling, potential outcomes (PO) and structural causal models (SCMs) stand as the predominant frameworks. However, these frameworks face notable challenges in practically modeling counterfactuals, formalized as parameters of the joint distribution of potential outcomes. Counterfactual reasoning holds paramount importance in contemporary decision-making processes, especially in scenarios that demand personalized incentives based on the joint values of $(Y(0), Y(1))$. This paper begins with an investigation of the PO and SCM frameworks for modeling counterfactuals. Through the analysis, we identify an inherent model capacity limitation, termed as the ``degenerative counterfactual problem'', emerging from the consistency rule that is the cornerstone of both frameworks. To address this limitation, we introduce a novel \textit{distribution-consistency} assumption, and in alignment with it, we propose the Distribution-consistency Structural Causal Models (DiscoSCMs) offering enhanced capabilities to model counterfactuals. To concretely reveal the enhanced model capacity, we introduce a new identifiable causal parameter, \textit{the probability of consistency}, which holds practical significance within DiscoSCM alone, showcased with a personalized incentive example. Furthermore, we provide a comprehensive set of theoretical results about the ``Ladder of Causation'' within the DiscoSCM framework. We hope it opens new avenues for future research of counterfactual modeling, ultimately enhancing our understanding of causality and its real-world applications.


title: An Efficient, High-Rate Scheme for Private Information Retrieval over the Gaussian MAC

abstract: This paper revisited the problem of Private Information Retrieval (PIR), where there are $N$ replicated non-communicating databases containing the same $M$ messages and a user who wishes to retrieve one of the messages without revealing the wanted message's index to the databases. However, we assume a block-fading additive white Gaussian noise multiple access channel (AWGN MAC) linking the user and the databases. Previous work \cite{shmuel2021private} presented a joint channel-PIR scheme, utilizing the Compute and Forward protocol, showing the potential of a joint channel-PIR scheme over a separated one. This paper proposes an improved joint scheme tailored for the PIR problem with $N$ databases over a block-fading AWGN. Unlike the C\&F protocol, our scheme offers reduced computational complexity while improving the scaling laws governing the achievable rate. Specifically, the achievable rate scales with the number of databases $N$ and the power $P$ similarly to the channel capacity without the privacy constraint and outperforms the C\&F-based approach. Furthermore, the analysis demonstrates that the improved rate exhibits only a finite gap from the unconstrained channel capacity -- one bit per second per Hz as $N$ increases.


title: Vision-Informed Flow Image Super-Resolution with Quaternion Spatial Modeling and Dynamic Flow Convolution

abstract: Flow image super-resolution (FISR) aims at recovering high-resolution turbulent velocity fields from low-resolution flow images. Existing FISR methods mainly process the flow images in natural image patterns, while the critical and distinct flow visual properties are rarely considered. This negligence would cause the significant domain gap between flow and natural images to severely hamper the accurate perception of flow turbulence, thereby undermining super-resolution performance. To tackle this dilemma, we comprehensively consider the flow visual properties, including the unique flow imaging principle and morphological information, and propose the first flow visual property-informed FISR algorithm. Particularly, different from natural images that are constructed by independent RGB channels in the light field, flow images build on the orthogonal UVW velocities in the flow field. To empower the FISR network with an awareness of the flow imaging principle, we propose quaternion spatial modeling to model this orthogonal spatial relationship for improved FISR. Moreover, due to viscosity and surface tension characteristics, fluids often exhibit a droplet-like morphology in flow images. Inspired by this morphological property, we design the dynamic flow convolution to effectively mine the morphological information to enhance FISR. Extensive experiments on the newly acquired flow image datasets demonstrate the state-of-the-art performance of our method. Code and data will be made available.

categories: eess.IV cs.CV cs.LG physics.flu-dyn stat.AP


title: Overcoming the Pitfalls of Vision-Language Model Finetuning for OOD Generalization

abstract: Existing vision-language models exhibit strong generalization on a variety of visual domains and tasks. However, such models mainly perform zero-shot recognition in a closed-set manner, and thus struggle to handle open-domain visual concepts by design. There are recent finetuning methods, such as prompt learning, that not only study the discrimination between in-distribution (ID) and out-of-distribution (OOD) samples, but also show some improvements in both ID and OOD accuracies. In this paper, we first demonstrate that vision-language models, after long enough finetuning but without proper regularization, tend to overfit the known classes in the given dataset, with degraded performance on unknown classes. Then we propose a novel approach OGEN to address this pitfall, with the main focus on improving the OOD GENeralization of finetuned models. Specifically, a class-conditional feature generator is introduced to synthesize OOD features using just the class name of any unknown class. Such synthesized features will provide useful knowledge about unknowns and help regularize the decision boundary between ID and OOD data when optimized jointly. Equally important is our adaptive self-distillation mechanism to regularize our feature generation model during joint optimization, i.e., adaptively transferring knowledge between model states to further prevent overfitting. Experiments validate that our method yields convincing gains in OOD generalization performance in different settings. Code: https://github.com/apple/ml-ogen.


title: Unrestricted Error-Type Codebook Generation for Error Correction Code in DNA Storage Inspired by NLP

abstract: Recently, DNA storage has surfaced as a promising alternative for data storage, presenting notable benefits in terms of storage capacity, cost-effectiveness in maintenance, and the capability for parallel replication. Mathematically, the DNA storage process can be conceptualized as an insertion, deletion, and substitution (IDS) channel. Due to the mathematical complexity associated with the Levenshtein distance, creating a code that corrects for IDS remains a challenging task. In this paper, we propose a bottom-up generation approach to grow the required codebook based on the computation of Edit Computational Graph (ECG) which differs from the algebraic constructions by incorporating the Derivative-Free Optimization (DFO) method. Specifically, this approach is regardless of the type of errors. Compared the results with the work for 1-substitution-1-deletion and 2-deletion, the redundancy is reduced by about 30-bit and 60-bit, respectively. As far as we know, our method is the first IDS-correcting code designed using classical Natural Language Process (NLP) techniques, marking a turning point in the field of error correction code research. Based on the codebook generated by our method, there may be significant breakthroughs in the complexity of encoding and decoding algorithms.


title: New Skyrme parametrizations to describe finite nuclei and neutron star matter with realistic effective masses

abstract: The phenomenological Skyrme energy density functional theory is one of the most popular theories for dealing with finite nuclei and infinite nuclear matter, including neutron star matter. However, in a recent study we reported the problem that in many Skyrme functionals, the neutron Fermi velocity exceeds the speed of light at densities that exist in neutron-star cores. To solve this problem, we try to construct new Skyrme parametrizations by including constraints from microscopic calculations of the effective mass in addition to binding energies and charge radii of finite nuclei and different microscopic equations of state of pure neutron matter. We give the parameters of the new Skyrme forces and show that our new effective interactions can successfully describe properties of finite nuclei (including the weak radius and the neutron-skin thickness of $^{208}$Pb which were not fitted) and nuclear matter (including pure neutron matter, symmetric nuclear matter, and neutron star matter).


title: Blockchain-enabled Trustworthy Federated Unlearning

abstract: Federated unlearning is a promising paradigm for protecting the data ownership of distributed clients. It allows central servers to remove historical data effects within the machine learning model as well as address the "right to be forgotten" issue in federated learning. However, existing works require central servers to retain the historical model parameters from distributed clients, such that allows the central server to utilize these parameters for further training even, after the clients exit the training process. To address this issue, this paper proposes a new blockchain-enabled trustworthy federated unlearning framework. We first design a proof of federated unlearning protocol, which utilizes the Chameleon hash function to verify data removal and eliminate the data contributions stored in other clients' models. Then, an adaptive contribution-based retraining mechanism is developed to reduce the computational overhead and significantly improve the training efficiency. Extensive experiments demonstrate that the proposed framework can achieve a better data removal effect than the state-of-the-art frameworks, marking a significant stride towards trustworthy federated unlearning.


title: Tunable vortex bound states in multiband CsV3Sb5-derived kagome superconductors

abstract: Vortices and bound states offer an effective means of comprehending the electronic properties of superconductors. Recently, surface dependent vortex core states have been observed in the newly discovered kagome superconductors CsV3Sb5. Although the spatial distribution of the sharp zero energy conductance peak appears similar to Majorana bound states arising from the superconducting Dirac surface states, its origin remains elusive. In this study, we present observations of tunable vortex bound states (VBSs) in two chemically doped kagome superconductors Cs(V1-xTrx)3Sb5 (Tr=Ta or Ti), using low temperature scanning tunneling microscopy/spectroscopy. The CsV3Sb5-derived kagome superconductors exhibit full gap pairing superconductivity accompanied by the absence of long range charge orders, in contrast to pristine CsV3Sb5. Zero energy conductance maps demonstrate a field-driven continuous reorientation transition of the vortex lattice, suggesting multiband superconductivity. The Ta doped CsV3Sb5 displays the conventional cross shaped spatial evolution of Caroli de Gennes Matricon bound states, while the Ti doped CsV3Sb5 exhibits a sharp, non split zero bias conductance peak (ZBCP) that persists over a long distance across the vortex. The spatial evolution of the non split ZBCP is robust against surface effects and external magnetic field but is related to the doping concentrations. Our study reveals the tunable VBSs in multiband chemically doped CsV3Sb5 system and offers fresh insights into previously reported Y shaped ZBCP in a non quantum limit condition at the surface of kagome superconductor.


title: Integrated Imaging and Communication with Reconfigurable Intelligent Surfaces

abstract: Reconfigurable intelligent surfaces, with their large number of antennas, offer an interesting opportunity for high spatial-resolution imaging. In this paper, we propose a novel RIS-aided integrated imaging and communication system that can reduce the RIS beam training overhead for communication by leveraging the imaging of the surrounding environment. In particular, using the RIS as a wireless imaging device, our system constructs the scene depth map of the environment, including the mobile user. Then, we develop a user detection algorithm that subtracts the background and extracts the mobile user attributes from the depth map. These attributes are then utilized to design the RIS interaction vector and the beam selection strategy with low overhead. Simulation results show that the proposed approach can achieve comparable beamforming gain to the optimal/exhaustive beam selection solution while requiring 1000 times less beam training overhead.


title: Generalized Algorithm for Recognition of Complex Point Defects in Large-Scale \beta-$\rm {Ga_2O_3}$

abstract: The electrical and optical properties of semiconductor materials are profoundly influenced by the atomic configurations and concentrations of intrinsic defects. This influence is particularly significant in the case of $\beta$-$\rm {Ga_2O_3}$, a vital ultrawide bandgap semiconductor characterized by highly complex intrinsic defect configurations. Despite its importance, there is a notable absence of an accurate method to recognize these defects in large-scale atomistic computational modeling. In this work, we present an effective algorithm designed explicitly for identifying various intrinsic point defects in the $\beta$-$\rm {Ga_2O_3}$ lattice. By integrating particle swarm optimization and hierarchical clustering methods, our algorithm attains a recognition accuracy exceeding 95% for discrete point defect configurations. Furthermore, we have developed an efficient technique for randomly generating diverse intrinsic defects in large-scale $\beta$-$\rm {Ga_2O_3}$ systems. This approach facilitates the construction of an extensive atomic database, crucially instrumental in validating the recognition algorithm through a substantial number of statistical analyses. Finally, the recognition algorithm is applied to a molecular dynamics simulation, accurately describing the evolution of the point defects during high-temperature annealing. Our work provides a useful tool for investigating the complex dynamical evolution of intrinsic point defects in $\beta$-$\rm {Ga_2O_3}$, and moreover, holds promise for understanding similar material systems, such as $\rm {Al_2O_3}$, $\rm {In_2O_3}$, and $\rm {Sb_2O_3}$.


title: A New Framework to Predict and Visualize Technology Acceptance: A Case Study of Shared Autonomous Vehicles

abstract: The burgeoning field of Shared Autonomous Vehicles (SAVs) presents transformative potential for the transport sector, subject to public acceptance. Traditional acceptance models, primarily reliant on Structural Equation Modelling (SEM), often fall short of capturing the complex, non-linear dynamics underlying this acceptance. To address these limitations, this paper proposes a Machine Learning (ML) approach to predict public acceptance of SAVs and employs a chord diagram to visualize the influence of different predictors. This approach reveals nuanced, non-linear relationships between factors at both macro and micro levels, and identifies attitude as the primary predictor of SAV usage intention, followed by perceived risk, perceived usefulness, trust, and perceived ease of use. The framework also uncovers divergent perceptions of these factors among SAV adopters and non-adopters, providing granular insights for strategic initiatives to enhance SAV acceptance. Using SAV acceptance as a case study, our findings contribute a novel, machine learning-based perspective to the discourse on technology acceptance, underscoring the importance of nuanced, data-driven approaches in understanding and fostering public acceptance of emerging transport technologies.


title: Strongly ultrametric preserving functions

abstract: An ultrametric preserving function $f$ is said to be strongly ultrametric preserving if ultrametrics $d$ and $f \circ d$ define the same topology on $X$ for each ultrametric space $(X,d)$. The set of all strongly ultrametric preserving functions is characterized by several distinctive features. In particular, it is shown that an ultrametric preserving $f$ belongs to this set iff $f$ preserves the property to be compact.


title: Dieudonn\'{e} completeness of function spaces

abstract: A space is called Dieudonn\'{e} complete if it is complete relative to the maximal uniform structure compatible with its topology. In this paper, we investigated when the function space $C(X,Y)$ of all continuous functions from a topological space $X$ into a uniform space $Y$ with the topology of uniform convergence on a family of subsets of $X$ is Dieudonn\'{e} complete. Also we proved a generalization of the Eberlein-\v{S}mulian theorem to the class of Banach spaces.


title: Energy-Aware Service Offloading for Semantic Communications in Wireless Networks

abstract: Today, wireless networks are becoming responsible for serving intelligent applications, such as extended reality and metaverse, holographic telepresence, autonomous transportation, and collaborative robots. Although current fifth-generation (5G) networks can provide high data rates in terms of Gigabytes/second, they cannot cope with the high demands of the aforementioned applications, especially in terms of the size of the high-quality live videos and images that need to be communicated in real-time. Therefore, with the help of artificial intelligence (AI)-based future sixth-generation (6G) networks, the semantic communication concept can provide the services demanded by these applications. Unlike Shannon's classical information theory, semantic communication urges the use of the semantics (meaningful contents) of the data in designing more efficient data communication schemes. Hence, in this paper, we model semantic communication as an energy minimization framework in heterogeneous wireless networks with respect to delay and quality-of-service constraints. Then, we propose a sub-optimal solution to the NP-hard combinatorial mixed-integer nonlinear programming problem (MINLP) by utilizing efficient techniques such as discrete optimization variables' relaxation. In addition, AI-based autoencoder and classifier are trained and deployed to perform semantic extraction, reconstruction, and classification services. Finally, we compare our proposed sub-optimal solution with different state-of-the-art methods, and the obtained results demonstrate its superiority.


title: A Single-Mode Quasi Riemannian Gradient Descent Algorithm for Low-Rank Tensor Recovery

abstract: This paper focuses on recovering a low-rank tensor from its incomplete measurements. We propose a novel algorithm termed the Single Mode Quasi Riemannian Gradient Descent (SM-QRGD). By exploiting the benefits of both fixed-rank matrix tangent space projection in Riemannian gradient descent and sequentially truncated high-order singular value decomposition (ST-HOSVD), SM-QRGD achieves a much faster convergence speed than existing state-of-the-art algorithms. Theoretically, we establish the convergence of SM-QRGD through the Tensor Restricted Isometry Property (TRIP) and the geometry of the fixed-rank matrix manifold. Numerically, extensive experiments are conducted, affirming the accuracy and efficacy of the proposed algorithm.


title: Topological Diagrams and Hadronic Weak Decays of Charmed Baryons

abstract: Inspired by the recent BESIII measurement of the decay asymmetry and the phase shift between $S$- and $P$-wave amplitudes in the decay $\Lambda_c^+\to \Xi^0K^+$, we perform a global fit to the experimental data of charmed baryon decays based on the topological diagrammatic approach (TDA) which has the advantage that it is more intuitive and easier to implement model calculations. The measured branching fractions and decay asymmetries are well accommodated in TDA except for three modes, in particular, the predicted ${\cal B}(\Xi_c^0\to \Xi^-\pi^+)=(2.83\pm0.10)\%$ is larger than its current value. The predicted magnitudes of $S$- and $P$-wave amplitudes and their phase shifts are presented for measured and yet-measured modes which can be tested in forthcoming experiments.


title: E-EVAL: A Comprehensive Chinese K-12 Education Evaluation Benchmark for Large Language Models

abstract: With the accelerating development of Large Language Models (LLMs), many LLMs are beginning to be used in the Chinese K-12 education domain. The integration of LLMs and education is getting closer and closer, however, there is currently no benchmark for evaluating LLMs that focuses on the Chinese K-12 education domain. Therefore, there is an urgent need for a comprehensive natural language processing benchmark to accurately assess the capabilities of various LLMs in the Chinese K-12 education domain. To address this, we introduce the E-EVAL, the first comprehensive evaluation benchmark specifically designed for the Chinese K-12 education field. The E-EVAL consists of 4,351 multiple-choice questions at the primary, middle, and high school levels across a wide range of subjects, including Chinese, English, Politics, History, Ethics, Physics, Chemistry, Mathematics, and Geography. We conducted a comprehensive evaluation of E-EVAL on advanced LLMs, including both English-dominant and Chinese-dominant models. Findings show that Chinese-dominant models perform well compared to English-dominant models, with many scoring even above the GPT 4.0. However, almost all models perform poorly in complex subjects such as mathematics. We also found that most Chinese-dominant LLMs did not achieve higher scores at the primary school level compared to the middle school level. We observe that the mastery of higher-order knowledge by the model does not necessarily imply the mastery of lower-order knowledge as well. Additionally, the experimental results indicate that the Chain of Thought (CoT) technique is effective only for the challenging science subjects, while Few-shot prompting is more beneficial for liberal arts subjects. With E-EVAL, we aim to analyze the strengths and limitations of LLMs in educational applications, and to contribute to the progress and development of Chinese K-12 education and LLMs.


title: Trapped-atom Otto engine with light-induced dipole-dipole interactions

abstract: Finite-time quantum heat engines are of practical relevance as they can generate finite-power, distinguishing them from ideal quasistatic engines typically used for theoretical purposes. However, these engines encounter energy losses due to quantum friction, which is particularly pronounced in many-body systems with non-trivial coherences in their density operator. Strategies such as shortcuts to adiabaticity and fast routes to thermalization have been developed although the associated cost requirements remain uncertain. In this study, we theoretically investigate the finite-time operation of a trapped-atom Otto engine with light-induced dipole-dipole interactions and projection measurements in one of the isochoric processes. The investigation reveals that appropriate control of dipole-dipole interactions of the working medium prompts engine operation upon interacting with the hot reservoir, while projection measurements and adjustment of the unitary driving protocols effectively reduce quantum friction to enhance finite-time engine performance compared to non-interacting and quasi-static counterparts. This setup presents a compelling avenue for further investigation of finite-time many-body quantum heat engines and provides an opportunity to explore the full potential of photon-mediated dipole-dipole interactions in their operations.


title: Topology of a complex double plane branching along a real line arrangement

abstract: We investigate the topology of a double cover of a complex affine plane branching along a nodal real line arrangement. We define certain topological 2-cycles in the double plane using the real structure of the arrangement, and calculate their intersection numbers.


title: Zariski pairs on cubic surfaces

abstract: A line arrangement of a smooth cubic surface is a subset of the set of lines on the cubic surface. We define a notion of Zariski pairs of line arrangements on general cubic surfaces, and make the complete list of these Zariski pairs.


title: EmoDM: A Diffusion Model for Evolutionary Multi-objective Optimization

abstract: Evolutionary algorithms have been successful in solving multi-objective optimization problems (MOPs). However, as a class of population-based search methodology, evolutionary algorithms require a large number of evaluations of the objective functions, preventing them from being applied to a wide range of expensive MOPs. To tackle the above challenge, this work proposes for the first time a diffusion model that can learn to perform evolutionary multi-objective search, called EmoDM. This is achieved by treating the reversed convergence process of evolutionary search as the forward diffusion and learn the noise distributions from previously solved evolutionary optimization tasks. The pre-trained EmoDM can then generate a set of non-dominated solutions for a new MOP by means of its reverse diffusion without further evolutionary search, thereby significantly reducing the required function evaluations. To enhance the scalability of EmoDM, a mutual entropy-based attention mechanism is introduced to capture the decision variables that are most important for the objectives. Experimental results demonstrate the competitiveness of EmoDM in terms of both the search performance and computational efficiency compared with state-of-the-art evolutionary algorithms in solving MOPs having up to 5000 decision variables. The pre-trained EmoDM is shown to generalize well to unseen problems, revealing its strong potential as a general and efficient MOP solver.


title: Assessment of the area measurement on Cartosat-1 image

abstract: The goal of this study was the evaluation of agriculture parcel area measurement accuracy on Cartosat-1 imagery, and the determination of the technical tolerance appropriate for measurement using photointerpretation techniques. A further objective was to find out the influence of image type, land cover or parcel size on the area measurement variability. In our experiment, five independent operators measured 185 parcels, 3 times, on each image. Next, the buffer width, calculated as the difference between measured and reference parcel area, was derived and was the subject of statistical analysis. Prior to verifying the normality of the buffer widths, a detection of anomalous measurements is recommended. This detection of outliers within each group of observations (i.e. parcels) was made using the Jacknife distance test on each type of imagery (Cartosat Aft, Cartosat Fore). Then, the General Linear Model procedure to identify major significant effects and interactions was followed by analysis of variance to ease the interpretation of the variability observed of the area measurement. Finally, two different parameters, reproducibility limit and critical difference, were calculated to make comparison with other sensors like digital aerial orthophoto in this study possible. The repeatability limits gave the acceptability difference between two operators when measuring the same parcel. For orthophoto this value reached 2.86m, on Cartosat-1 5.17m and 8.76m for Aft and Fore image respectively.


title: Acyclic matchings on Bruhat intervals and applications to total positivity

abstract: The existence of acyclic complete matchings on the face poset of a regular CW complex implies that the underlying topological space of the CW complex is contractible by discrete Morse theory. In this paper, we construct explicitly acyclic complete matchings on any non-trivial Bruhat interval $[v,w]$ based on any reflection order on the Coxeter group $W$. We then apply this combinatorial result to regular CW complexes arising from the theory of total positivity. As an application, we show that the totally nonnegative Springer fibers are contractible. This verifies a conjecture of Lusztig. As another application, we show that the totally nonnegative fibers of the natural projection from full flag varieties to partial flag varieties are contractible. This leads to a much simplified proof of the regularity property on totally nonnegative partial flag varieties compared to the proofs by Galashin-Karp-Lam and in our earlier work.


title: HICH Image/Text (HICH-IT): Comprehensive Text and Image Datasets for Hypertensive Intracerebral Hemorrhage Research

abstract: In this paper, we introduce a new dataset in the medical field of hypertensive intracerebral hemorrhage (HICH), called HICH-IT, which includes both electronic medical records (EMRs) and head CT images. This dataset is designed to enhance the accuracy of artificial intelligence in the diagnosis and treatment of HICH. This dataset, built upon the foundation of standard text and image data, incorporates specific annotations within the EMRs, extracting key content from the text information, and categorizes the annotation content of imaging data into four types: brain midline, hematoma, left and right cerebral ventricle. HICH-IT aims to be a foundational dataset for feature learning in image segmentation tasks and named entity recognition. To further understand the dataset, we have trained deep learning algorithms to observe the performance. The pretrained models have been released at both www.daip.club and github.com/Deep-AI-Application-DAIP. The dataset has been uploaded to https://github.com/CYBUS123456/HICH-IT-Datasets. Index Terms-HICH, Deep learning, Intraparenchymal hemorrhage, named entity recognition, novel dataset


title: MLEM: Generative and Contrastive Learning as Distinct Modalities for Event Sequences

abstract: This study explores the application of self-supervised learning techniques for event sequences. It is a key modality in various applications such as banking, e-commerce, and healthcare. However, there is limited research on self-supervised learning for event sequences, and methods from other domains like images, texts, and speech may not easily transfer. To determine the most suitable approach, we conduct a detailed comparative analysis of previously identified best-performing methods. We find that neither the contrastive nor generative method is superior. Our assessment includes classifying event sequences, predicting the next event, and evaluating embedding quality. These results further highlight the potential benefits of combining both methods. Given the lack of research on hybrid models in this domain, we initially adapt the baseline model from another domain. However, upon observing its underperformance, we develop a novel method called the Multimodal-Learning Event Model (MLEM). MLEM treats contrastive learning and generative modeling as distinct yet complementary modalities, aligning their embeddings. The results of our study demonstrate that combining contrastive and generative approaches into one procedure with MLEM achieves superior performance across multiple metrics.