title: Strain Dependent Spin Hall Magnetoresistance in the Multiferroic Antiferromagnet BiFeO$_3$

abstract: The spin Hall magnetoresistance (SMR) of epitaxial BiFeO$_3$ thin films is investigated. SMR consistent with ferromagnetic interfacial states for BiFeO$_3$ films fabricated on (001) SrTiO$_3$ (R' BFO) and LaAlO$_3$ (T' BFO) substrates is found, albeit with different temperature dependencies. For T' BFO, the SMR is enhanced at room temperature, and decays with reduced temperatures. By contrast, R' BFO shows a monotonic decrease in SMR response with increasing temperature, mirroring the trend of a weak ferromagnet. Density functional theory shows that this difference originates from the coupling of the applied magnetic field to oxygen octahedral rotation (R') and spin (T') degrees of freedom.


title: DD-GCN: Directed Diffusion Graph Convolutional Network for Skeleton-based Human Action Recognition

abstract: Graph Convolutional Networks (GCNs) have been widely used in skeleton-based human action recognition. In GCN-based methods, the spatio-temporal graph is fundamental for capturing motion patterns. However, existing approaches ignore the physical dependency and synchronized spatio-temporal correlations between joints, which limits the representation capability of GCNs. To solve these problems, we construct the directed diffusion graph for action modeling and introduce the activity partition strategy to optimize the weight sharing mechanism of graph convolution kernels. In addition, we present the spatio-temporal synchronization encoder to embed synchronized spatio-temporal semantics. Finally, we propose Directed Diffusion Graph Convolutional Network (DD-GCN) for action recognition, and the experiments on three public datasets: NTU-RGB+D, NTU-RGB+D 120, and NW-UCLA, demonstrate the state-of-the-art performance of our method.


title: Incentivized Federated Learning and Unlearning

abstract: To protect users' right to be forgotten in federated learning, federated unlearning aims at eliminating the impact of leaving users' data on the global learned model. The current research in federated unlearning mainly concentrated on developing effective and efficient unlearning techniques. However, the issue of incentivizing valuable users to remain engaged and preventing their data from being unlearned is still under-explored, yet important to the unlearned model performance. This paper focuses on the incentive issue and develops an incentive mechanism for federated learning and unlearning. We first characterize the leaving users' impact on the global model accuracy and the required communication rounds for unlearning. Building on these results, we propose a four-stage game to capture the interaction and information updates during the learning and unlearning process. A key contribution is to summarize users' multi-dimensional private information into one-dimensional metrics to guide the incentive design. We further investigate whether allowing federated unlearning is beneficial to the server and users, compared to a scenario without unlearning. Interestingly, users usually have a larger total payoff in the scenario with higher costs, due to the server's excess incentives under information asymmetry. The numerical results demonstrate the necessity of unlearning incentives for retaining valuable leaving users, and also show that our proposed mechanisms decrease the server's cost by up to 53.91\% compared to state-of-the-art benchmarks.


title: CGMI: Configurable General Multi-Agent Interaction Framework

abstract: Benefiting from the powerful capabilities of large language models (LLMs), agents based on LLMs have shown the potential to address domain-specific tasks and emulate human behaviors. However, the content generated by these agents remains somewhat superficial, owing to their limited domain expertise and the absence of an effective cognitive architecture. To address this, we present the Configurable General Multi-Agent Interaction (CGMI) framework, designed to replicate human interactions in real-world scenarios. Specifically, we propose a tree-structured methodology for the assignment, detection, and maintenance of agent personality. Additionally, we designed a cognitive architecture equipped with a skill library based on the ACT* model, which contains memory, reflection, and planning modules. We have also integrated general agents to augment the virtual environment's realism. Using the CGMI framework, we simulated numerous classroom interactions between teacher and students. The experiments indicate that aspects such as the teaching methodology, curriculum, and student performance closely mirror real classroom settings. We will open source our work.


title: Long thin covers and nuclear dimension

abstract: We establish finite nuclear dimension for crossed product C*-algebras arising from various classes of possibly non-free topological actions, including arbitrary actions of finitely generated virtually nilpotent groups on finite dimensional spaces, certain amenable actions of hyperbolic groups, and certain allosteric actions of wreath products. We obtain these results by introducing a new notion of dimension for topological dynamical systems, called the long thin covering dimension, which involves a suitable version of Rokhlin-type towers with controlled overlaps for possibly non-free actions.


title: On the pre-Schwarzian norm of certain Logharmonic mappings

abstract: We connect the pre-Schwarzian norm of logharmonic mappings to the pre-Schwarzian norm of an analytic function and establish some necessary and sufficient conditions under which locally univalent logharmonic mappings have a finite pre-Schwarzian norm. We also obtain a necessary and sufficient condition for a logharmonic function to be Bloch. Furthermore, we obtain the pre-Schwarzian norm and growth theorem for logharmonic Bloch mappings and their analytic and co-analytic parts.


title: General Covariance-Based Conditions for Central Limit Theorems with Dependent Triangular Arrays

abstract: We present a general central limit theorem with simple, easy-to-check covariance-based sufficient conditions for triangular arrays of random vectors when all variables could be interdependent. The result is constructed from Stein's method, but the conditions are distinct from related work. We show that these covariance conditions nest standard assumptions studied in the literature such as $M$-dependence, mixing random fields, non-mixing autoregressive processes, and dependency graphs, which themselves need not imply each other. This permits researchers to work with high-level but intuitive conditions based on overall correlation instead of more complicated and restrictive conditions such as strong mixing in random fields that may not have any obvious micro-foundation. As examples of the implications, we show how the theorem implies asymptotic normality in estimating: treatment effects with spillovers in more settings than previously admitted, covariance matrices, processes with global dependencies such as epidemic spread and information diffusion, and spatial process with Mat\'{e}rn dependencies.


title: The chaotic four-body problem in Newtonian gravity -- II. An ansatz-based approach to analytic solutions

abstract: In this paper, we continue our analysis of the chaotic four-body problem by presenting a general ansatz-based analytic treatment using statistical mechanics, where each outcome of the four-body problem is regarded as some variation of the three-body problem (e.g., when two single stars are produced, called the 2+1+1 outcome, each ejection event is modeled as its own three-body interaction by assuming that the ejections are well separated in time). This is a generalization of the statistical mechanics treatment of the three-body problem based on the density-of-states formalism. In our case, we focus on the interaction of two binary systems, after which we divide our results into three possible outcome scenarios (2+2, 2+1+1, and 3+1). For each outcome, we apply an ansatz-based approach to deriving analytic distribution functions that describe the properties of the products of chaotic four-body interactions involving point particles. To test our theoretical distributions, we perform a set of scattering simulations in the equal-mass point particle limit using FEWBODY. We compare our final theoretical distributions to the simulations for each particular scenario, finding consistently good agreement between the two. The highlights of our results include that binary-binary scatterings act to systematically destroy binaries producing instead a single binary and two ejected stars or a stable triple, the 2+2 outcome produces the widest binaries and the 2+1+1 outcome produces the most compact binaries.


title: FFEINR: Flow Feature-Enhanced Implicit Neural Representation for Spatio-temporal Super-Resolution

abstract: Large-scale numerical simulations are capable of generating data up to terabytes or even petabytes. As a promising method of data reduction, super-resolution (SR) has been widely studied in the scientific visualization community. However, most of them are based on deep convolutional neural networks (CNNs) or generative adversarial networks (GANs) and the scale factor needs to be determined before constructing the network. As a result, a single training session only supports a fixed factor and has poor generalization ability. To address these problems, this paper proposes a Feature-Enhanced Implicit Neural Representation (FFEINR) for spatio-temporal super-resolution of flow field data. It can take full advantage of the implicit neural representation in terms of model structure and sampling resolution. The neural representation is based on a fully connected network with periodic activation functions, which enables us to obtain lightweight models. The learned continuous representation can decode the low-resolution flow field input data to arbitrary spatial and temporal resolutions, allowing for flexible upsampling. The training process of FFEINR is facilitated by introducing feature enhancements for the input layer, which complements the contextual information of the flow field. To demonstrate the effectiveness of the proposed method, a series of experiments are conducted on different datasets by setting different hyperparameters. The results show that FFEINR achieves significantly better results than the trilinear interpolation method.


title: Parameter-Efficient Transfer Learning for Remote Sensing Image-Text Retrieval

abstract: Vision-and-language pre-training (VLP) models have experienced a surge in popularity recently. By fine-tuning them on specific datasets, significant performance improvements have been observed in various tasks. However, full fine-tuning of VLP models not only consumes a significant amount of computational resources but also has a significant environmental impact. Moreover, as remote sensing (RS) data is constantly being updated, full fine-tuning may not be practical for real-world applications. To address this issue, in this work, we investigate the parameter-efficient transfer learning (PETL) method to effectively and efficiently transfer visual-language knowledge from the natural domain to the RS domain on the image-text retrieval task. To this end, we make the following contributions. 1) We construct a novel and sophisticated PETL framework for the RS image-text retrieval (RSITR) task, which includes the pretrained CLIP model, a multimodal remote sensing adapter, and a hybrid multi-modal contrastive (HMMC) learning objective; 2) To deal with the problem of high intra-modal similarity in RS data, we design a simple yet effective HMMC loss; 3) We provide comprehensive empirical studies for PETL-based RS image-text retrieval. Our results demonstrate that the proposed method is promising and of great potential for practical applications. 4) We benchmark extensive state-of-the-art PETL methods on the RSITR task. Our proposed model only contains 0.16M training parameters, which can achieve a parameter reduction of 98.9% compared to full fine-tuning, resulting in substantial savings in training costs. Our retrieval performance exceeds traditional methods by 7-13% and achieves comparable or better performance than full fine-tuning. This work can provide new ideas and useful insights for RS vision-language tasks.


title: Masked Autoencoders are Efficient Class Incremental Learners

abstract: Class Incremental Learning (CIL) aims to sequentially learn new classes while avoiding catastrophic forgetting of previous knowledge. We propose to use Masked Autoencoders (MAEs) as efficient learners for CIL. MAEs were originally designed to learn useful representations through reconstructive unsupervised learning, and they can be easily integrated with a supervised loss for classification. Moreover, MAEs can reliably reconstruct original input images from randomly selected patches, which we use to store exemplars from past tasks more efficiently for CIL. We also propose a bilateral MAE framework to learn from image-level and embedding-level fusion, which produces better-quality reconstructed images and more stable representations. Our experiments confirm that our approach performs better than the state-of-the-art on CIFAR-100, ImageNet-Subset, and ImageNet-Full. The code is available at https://github.com/scok30/MAE-CIL .


title: Global smooth solutions to 4D quasilinear wave equations with short pulse initial data

abstract: In this paper, we establish the global existence of smooth solutions to general 4D quasilinear wave equations satisfying the first null condition with the short pulse initial data. Although the global existence of small data solutions to 4D quasilinear wave equations holds true without any requirement of null conditions, yet for short pulse data, in general, it is sufficient and necessary to require the fulfillment of the first null condition to have global smooth solutions. It is noted that short pulse data are extensions of a class of spherically symmetric data, for which the smallness restrictions are imposed on angular directions and along the outgoing directional derivative $\partial_t+\partial_r$, but the largeness is kept for the incoming directional derivative $\partial_t-\partial_r$. We expect that here methods can be applied to study the global smooth solution or blowup problem with short pulse initial data for the general 2D and 3D quasilinear wave equations when the corresponding null conditions hold or not. On the other hand, as some direct applications of our main results, one can show that for the short pulse initial data, the smooth solutions to the 4D irrotational compressible Euler equations for Chaplygin gases, 4D nonlinear membrane equations and 4D relativistic membrane equations exist globally since their nonlinearities satisfy the first null condition; while the smooth solutions to the 4D irrotational compressible Euler equations for polytropic gases generally blow up in finite time since the corresponding first null condition does not hold.


title: I3DOD: Towards Incremental 3D Object Detection via Prompting

abstract: 3D object detection has achieved significant performance in many fields, e.g., robotics system, autonomous driving, and augmented reality. However, most existing methods could cause catastrophic forgetting of old classes when performing on the class-incremental scenarios. Meanwhile, the current class-incremental 3D object detection methods neglect the relationships between the object localization information and category semantic information and assume all the knowledge of old model is reliable. To address the above challenge, we present a novel Incremental 3D Object Detection framework with the guidance of prompting, i.e., I3DOD. Specifically, we propose a task-shared prompts mechanism to learn the matching relationships between the object localization information and category semantic information. After training on the current task, these prompts will be stored in our prompt pool, and perform the relationship of old classes in the next task. Moreover, we design a reliable distillation strategy to transfer knowledge from two aspects: a reliable dynamic distillation is developed to filter out the negative knowledge and transfer the reliable 3D knowledge to new detection model; the relation feature is proposed to capture the responses relation in feature space and protect plasticity of the model when learning novel 3D classes. To the end, we conduct comprehensive experiments on two benchmark datasets and our method outperforms the state-of-the-art object detection methods by 0.6% - 2.7% in terms of mAP@0.25.


title: Topological Anderson amorphous insulator

abstract: The topological phase in amorphous systems adds a new dimension to the topological states of matter. Here, we present an interesting phenomenon dubbed the topological Anderson amorphous insulator (TAAI). Anderson disorder can drive topologically trivial amorphous systems with structural disorders into noncrystalline topological insulators. The gap closing and reopening, spin Bott index, robust edge states, and quantized conductance characterize the Anderson disorder-induced nontrivial topology in amorphous systems. More importantly, phase diagrams are given for the topological phase transition (TPT). It is found that amorphous structural disorder and Anderson disorder are synergistic to drive the s-p band inversion of the system and hence the TPT, which is further confirmed by the effective medium theory. Our findings report a disorder-induced topological phenomenon in noncrystalline systems and shed light on the physical understanding of the interplay between the coexistence of two types of disorder effects and topology.


title: Privacy engineering through obfuscation

abstract: Obfuscation in privacy engineering denotes a diverse set of data operations aimed at reducing the privacy loss that users incur in by participating in digital systems. Obfuscation's domain of application is vast: privacy-preserving database analysis, location-based privacy, private web search or privacy-friendly recommender systems are but a few examples of the contexts in which privacy engineers have resorted to obfuscation. Yet an understanding of the role that obfuscation, in general, plays in the engineering of privacy has so far proved elusive. Similarly, we lack a cohesive view of the wide array of privacy measures that assist the evaluation of obfuscation technologies. This paper contributes to closing these research gaps. First, we provide a general analysis framework that brings together a multiplicity of obfuscation methods under the same analytical umbrella. Second, we distinguish between mechanism-centred and attack-centred evaluation, making explicit a hierarchy of assumptions behind privacy measures that assists and demystifies obfuscation tools' evaluation. Finally, we examine the role that obfuscation technology plays in privacy engineering by introducing the concepts of personal and public utility and distinguishing between utility-degrading and utility-preserving obfuscation. We observe that public utility requirements require us to resort to utility-degrading obfuscation to arbitrarily reduce privacy loss. Conversely, personal utility requirements do not, in theory, impose such a privacy-utility trade-off, and we illustrate how to perform utility-preserving obfuscation through chaff.


title: Expanding Targets in Virtual Reality Environments: A Fitts' Law Study

abstract: Target pointing selection is a fundamental task. According to Fitts' law, users need more time to select targets with smaller sizes. Expanding the target to a larger size is a practical approach that can facilitate pointing selection. It has been well-examined and -deployed in 2D user interfaces. However, limited research has investigated target expansion methods using an immersive virtual reality (VR) head-mounted display (HMD). In this work, we aimed to fill this gap by conducting a user study using ISO 9241-411 multi-directional pointing task to examine the effect of target expansion on target selection performance in VR HMD. Based on our results, we found that compared to not expanding the target, expanding the target width by 1.5 and 2.5 times during the movement can significantly reduce the selection time. We hope that the design and results derived from the study can help frame future work.


title: Controlled transport in chiral quantum walks on graphs

abstract: We investigate novel transport properties of chiral continuous-time quantum walks (CTQWs) on graphs. By employing a gauge transformation, we demonstrate that CTQWs on chiral chains are equivalent to those on non-chiral chains, but with additional momenta from initial wave packets. This explains the novel transport phenomenon numerically studied in [New J. Phys. 23, 083005(2021)]. Building on this, we delve deeper into the analysis of chiral CTQWs on the Y-junction graph, introducing phases to account for the chirality. The phase plays a key role in controlling both asymmetric transport and directed complete transport among the chains in the Y-junction graph. We systematically analyze these features through a comprehensive examination of the chiral continuous-time quantum walk (CTQW) on a Y-junction graph. Our analysis shows that the CTQW on Y-junction graph can be modeled as a combination of three wave functions, each of which evolves independently on three effective open chains. By constructing a lattice scattering theory, we calculate the phase shift of a wave packet after it interacts with the potential-shifted boundary. Our results demonstrate that the interplay of these phase shifts leads to the observed enhancement and suppression of quantum transport. The explicit condition for directed complete transport or 100% efficiency is analytically derived. Our theory has applications in building quantum versions of binary tree search algorithms.


title: Not Only Rewards But Also Constraints: Applications on Legged Robot Locomotion

abstract: Several earlier studies have shown impressive control performance in complex robotic systems by designing the controller using a neural network and training it with model-free reinforcement learning. However, these outstanding controllers with natural motion style and high task performance are developed through extensive reward engineering, which is a highly laborious and time-consuming process of designing numerous reward terms and determining suitable reward coefficients. In this work, we propose a novel reinforcement learning framework for training neural network controllers for complex robotic systems consisting of both rewards and constraints. To let the engineers appropriately reflect their intent to constraints and handle them with minimal computation overhead, two constraint types and an efficient policy optimization algorithm are suggested. The learning framework is applied to train locomotion controllers for several legged robots with different morphology and physical attributes to traverse challenging terrains. Extensive simulation and real-world experiments demonstrate that performant controllers can be trained with significantly less reward engineering, by tuning only a single reward coefficient. Furthermore, a more straightforward and intuitive engineering process can be utilized, thanks to the interpretability and generalizability of constraints. The summary video is available at https://youtu.be/KAlm3yskhvM.


title: Quasiclassical integrability condition in AKNS scheme

abstract: In this paper, we study the condition of quasiclassical integrability of soliton equations. This condition states that the Hamiltonian structure of equations, which govern propagation of high-frequency wave packets, is preserved by the dispersionless flow independently of initial conditions. If this condition is fulfilled, then the carrier wave number of any packet is a certain function of local values of the dispersionless variables pertained to the soliton equations under consideration. We show for several examples that this function together with the dispersion relation for linear harmonic waves determine the quasiclassical limit of the Lax pair functions in the scalar representation of the Ablowitz-Kaup-Newell-Segur scheme.


title: Rational Decision-Making Agent with Internalized Utility Judgment

abstract: Large language models (LLMs) have demonstrated remarkable advancements and have attracted significant efforts to develop LLMs into agents capable of executing intricate multi-step decision-making tasks beyond traditional NLP applications. Existing approaches to LLM-based decision-making predominantly build upon the manually-designed external performance metrics to guide the decision-making process. However, reliance on the external performance metrics as prior is problematic in real-world scenarios, where such prior may be unavailable, flawed, or even erroneous. For genuine autonomous decision making, it is imperative for the agent to develop its rationality from its posterior experiences to judge decisions independently. Central to the development of rationality is the construction of an internalized utility judgment, capable of assigning numerical utilities to each decision. This paper proposes RadAgent (Rational Decision-Making Agent), which fosters the development of its rationality through an iterative framework involving Experience Exploration and Utility Learning. Within this framework, Elo-based Utility Construction is devised to assign Elo scores to individual decision steps to judge their utilities via pairwise comparisons. Consequently, these Elo scores guide the decision-making process to derive optimal outcomes. Experimental results on the ToolBench dataset demonstrate RadAgent's superiority over baselines, achieving over 10% improvement in Pass Rate on diverse tasks. It offers higher-quality solutions and reduces costs (ChatGPT API calls), highlighting its effectiveness and efficiency.


title: A-PSRO: A Unified Strategy Learning Method with Advantage Function for Normal-form Games

abstract: Solving Nash equilibrium is the key challenge in normal-form games with large strategy spaces, where open-ended learning frameworks offer an efficient approach. In this work, we propose an innovative unified open-ended learning framework A-PSRO, i.e., Advantage Policy Space Response Oracle, as a comprehensive framework for both zero-sum and general-sum games. In particular, we introduce the advantage function as an enhanced evaluation metric for strategies, enabling a unified learning objective for agents engaged in normal-form games. We prove that the advantage function exhibits favorable properties and is connected with the Nash equilibrium, which can be used as an objective to guide agents to learn strategies efficiently. Our experiments reveal that A-PSRO achieves a considerable decrease in exploitability in zero-sum games and an escalation in rewards in general-sum games, significantly outperforming previous PSRO algorithms.


title: The generalized Bernoulli numbers and its relation with the Riemann zeta function at odd-integer arguments

abstract: By using the generalized Bernoulli numbers, we deduce new integral representations for the Riemann zeta function at positive odd-integer arguments. The explicit expressions enable us to obtain criteria for the dimension of the vector space spanned over the rational by the $\zeta(2n+1)/\pi^{2n}$, $n\geq1$.


title: Uniformly Distributed Category Prototype-Guided Vision-Language Framework for Long-Tail Recognition

abstract: Recently, large-scale pre-trained vision-language models have presented benefits for alleviating class imbalance in long-tailed recognition. However, the long-tailed data distribution can corrupt the representation space, where the distance between head and tail categories is much larger than the distance between two tail categories. This uneven feature space distribution causes the model to exhibit unclear and inseparable decision boundaries on the uniformly distributed test set, which lowers its performance. To address these challenges, we propose the uniformly category prototype-guided vision-language framework to effectively mitigate feature space bias caused by data imbalance. Especially, we generate a set of category prototypes uniformly distributed on a hypersphere. Category prototype-guided mechanism for image-text matching makes the features of different classes converge to these distinct and uniformly distributed category prototypes, which maintain a uniform distribution in the feature space, and improve class boundaries. Additionally, our proposed irrelevant text filtering and attribute enhancement module allows the model to ignore irrelevant noisy text and focus more on key attribute information, thereby enhancing the robustness of our framework. In the image recognition fine-tuning stage, to address the positive bias problem of the learnable classifier, we design the class feature prototype-guided classifier, which compensates for the performance of tail classes while maintaining the performance of head classes. Our method outperforms previous vision-language methods for long-tailed learning work by a large margin and achieves state-of-the-art performance.


title: Arithmetical independence of certain uniform sets of algebraic integers

abstract: We study four (families of) sets of algebraic integers of degree less than or equal to three. Apart from being simply defined, we show that they share two distinctive characteristics: almost uniformity and arithmetical independence. Here, ``almost uniformity'' means that the elements of a finite set are distributed almost equidistantly in the unit interval, while ``arithmetical independence'' means that the number fields generated by the elements of a set do not have a mutual inclusion relation each other. Furthermore, we reveal to what extent the algebraic number fields generated by the elements of the four sets can cover quadratic or cubic fields.


title: On The Study Of Partial Qubit Hamiltonian For Efficient Molecular Simulation Using Variational Quantum Eigensolvers

abstract: Quantum computing is being extensively used in quantum chemistry, especially in simulating simple molecules and evaluating properties like the ground state energy, dipole moment, etc. The transformation of a molecular Hamiltonian from the fermionic space to the qubit space provides us with a series of Pauli strings and the energy calculation involves the evaluation of the expectation values of all these individual strings. This introduces a major bottleneck for applications of VQEs in quantum chemistry. Unlike the fermionic Hamiltonian, the terms in a qubit Hamiltonian are additive and the present paper exploits this property to describe a new approach for extracting information from the partial qubit Hamiltonian of simple molecules to design more efficient variational quantum eigensolvers. In the partial (qubit) Hamiltonian approach (PHA), the qubit Hamiltonian is studied term-by-term to understand their relative contributions to the overall energy and a partial Hamiltonian is constructed with fewer Pauli strings that can resolve the entire Hamiltonian. With PHA, we can simulate molecules at a much lower computational cost with a truncated Hamiltonian. Additionally, the outcomes of the measurements with PHA quench the error due to noise introduced by the quantum circuits. We have also demonstrated the application of PHA as an initialization technique, where the simple partial Hamiltonian can be used to find a suitable initial state for a more complex system. The results of this study have the potential to demonstrate the potential advancement in the field of quantum computing and its implementation in quantum chemistry.


title: Experience with Distributed Memory Delaunay-based Image-to-Mesh Conversion Implementation

abstract: This paper presents some of our findings on the scalability of parallel 3D mesh generation on distributed memory machines. The primary objective of this study was to evaluate a distributed memory approach for implementing a 3D parallel Delaunay-based algorithm that converts images to meshes by leveraging an efficient shared memory implementation. The secondary objective was to evaluate the effectiveness of labor (i.e., reduce development time) while introducing minimal overheads to maintain the parallel efficiency of the end-product i.e., distributed implementation. The distributed algorithm utilizes two existing and independently developed parallel Delaunay-based methods: (1) a fine-grained method that employs multi-threading and speculative execution on shared memory nodes and (2) a loosely coupled Delaunay-refinement framework for multi-node platforms. The shared memory implementation uses a FIFO work-sharing scheme for thread scheduling, while the distributed memory implementation utilizes the MPI and the Master-Worker (MW) model. The findings from the specific MPI-MW implementation we tested suggest that the execution on (1) 40 cores not necessary in the same single node is 2.3 times faster than the execution on ten cores, (2) the best speedup is 5.4 with 180 cores again the comparison is with the best performance on ten cores. A closer look at the performance of distributed memory and shared memory implementation executing on a single node (40 cores) suggest that the overheads introduced in the MPI-MW implementation are high and render the MPI-MW implementation 4 times slower than the shared memory code using the same number of cores. These findings raise several questions on the potential scalability of a "black box" approach, i.e., re-using a code designed to execute efficiently on shared memory machines without considering its potential use in a distributed memory setting.


title: UNISOUND System for VoxCeleb Speaker Recognition Challenge 2023

abstract: This report describes the UNISOUND submission for Track1 and Track2 of VoxCeleb Speaker Recognition Challenge 2023 (VoxSRC 2023). We submit the same system on Track 1 and Track 2, which is trained with only VoxCeleb2-dev. Large-scale ResNet and RepVGG architectures are developed for the challenge. We propose a consistency-aware score calibration method, which leverages the stability of audio voiceprints in similarity score by a Consistency Measure Factor (CMF). CMF brings a huge performance boost in this challenge. Our final system is a fusion of six models and achieves the first place in Track 1 and second place in Track 2 of VoxSRC 2023. The minDCF of our submission is 0.0855 and the EER is 1.5880%.


title: Independence of Singularity Type for Numerically Effective K\"ahler-Ricci Flows

abstract: In this paper, we show that the singularity type of solutions to the K\"aher-Ricci flow on a numerically effective manifold does not depend on the initial metric. More precisely if there exists a type III solution to the K\"ahler-Ricci flow, then any other solution starting from a different initial metric will also be Type III. This generalises previous results by Y. Zhang for the semi-ample case.


title: Urns with Multiple Drawings and Graph-based Interaction

abstract: Consider a finite undirected graph and place an urn with balls of two colours at each vertex. At every discrete time-step, for each urn, a fixed number of balls are drawn from that same urn with probability $p$, and from a randomly chosen neighbour of that urn with probability $1-p$. Based on what is drawn, the urns then reinforce themselves or their neighbours. For every ball of a given colour in the sample, in case of P\'olya-type reinforcement, a constant multiple of balls of that colour is added while in case of Friedman-type reinforcement, balls of the other colour are reinforced. These different choices for reinforcement give rise to multiple models. In this paper, we study the convergence of the fraction of balls of either colour across urns for all of these models. We show that in most cases the urns synchronize, that is, the fraction of balls of either colour in each urn converges to the same limit almost surely. A different kind of asymptotic behaviour is observed on bipartite graphs. We also prove similar results for the case of finite directed graphs.


title: Privacy-Preserving Discretized Spiking Neural Networks

abstract: The rapid development of artificial intelligence has brought considerable convenience, yet also introduces significant security risks. One of the research hotspots is to balance data privacy and utility in the real world of artificial intelligence. The present second-generation artificial neural networks have made tremendous advances, but some big models could have really high computational costs. The third-generation neural network, SNN (Spiking Neural Network), mimics real neurons by using discrete spike signals, whose sequences exhibit strong sparsity, providing advantages such as low energy consumption and high efficiency. In this paper, we construct a framework to evaluate the homomorphic computation of SNN named FHE-DiSNN that enables SNN to achieve good prediction performance on encrypted data. First, benefitting from the discrete nature of spike signals, our proposed model avoids the errors introduced by discretizing activation functions. Second, by applying bootstrapping, we design new private preserving functions FHE-Fire and FHE-Reset, through which noise can be refreshed, allowing us to evaluate SNN for an arbitrary number of operations. Furthermore, We improve the computational efficiency of FHE-DiSNN while maintaining a high level of accuracy. Finally, we evaluate our model on the MNIST dataset. The experiments show that FHE-DiSNN with 30 neurons in the hidden layer achieves a minimum prediction accuracy of 94.4%. Under optimal parameters, it achieves a 95.1% accuracy, with only a 0.6% decrease compared to the original SNN (95.7%). These results demonstrate the superiority of SNN over second-generation neural networks for homomorphic evaluation.


title: SieveNet: Selecting Point-Based Features for Mesh Networks

abstract: Meshes are widely used in 3D computer vision and graphics, but their irregular topology poses challenges in applying them to existing neural network architectures. Recent advances in mesh neural networks turn to remeshing and push the boundary of pioneer methods that solely take the raw meshes as input. Although the remeshing offers a regular topology that significantly facilitates the design of mesh network architectures, features extracted from such remeshed proxies may struggle to retain the underlying geometry faithfully, limiting the subsequent neural network's capacity. To address this issue, we propose SieveNet, a novel paradigm that takes into account both the regular topology and the exact geometry. Specifically, this method utilizes structured mesh topology from remeshing and accurate geometric information from distortion-aware point sampling on the surface of the original mesh. Furthermore, our method eliminates the need for hand-crafted feature engineering and can leverage off-the-shelf network architectures such as the vision transformer. Comprehensive experimental results on classification and segmentation tasks well demonstrate the effectiveness and superiority of our method.


title: CARE: Co-Attention Network for Joint Entity and Relation Extraction

abstract: Joint entity and relation extraction is the fundamental task of information extraction, consisting of two subtasks: named entity recognition and relation extraction. However, most existing joint extraction methods suffer from issues of feature confusion or inadequate interaction between the two subtasks. Addressing these challenges, in this work, we propose a Co-Attention network for joint entity and Relation Extraction (CARE). Our approach includes adopting a parallel encoding strategy to learn separate representations for each subtask, aiming to avoid feature overlap or confusion. At the core of our approach is the co-attention module that captures two-way interaction between the two subtasks, allowing the model to leverage entity information for relation prediction and vice versa, thus promoting mutual enhancement. Through extensive experiments on three benchmark datasets for joint entity and relation extraction (NYT, WebNLG, and SciERC), we demonstrate that our proposed model outperforms existing baseline models. Our code will be available at https://github.com/kwj0x7f/CARE.


title: FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning

abstract: Federated Learning (FL) aggregates locally trained models from individual clients to construct a global model. While FL enables learning a model with data privacy, it often suffers from significant performance degradation when clients have heterogeneous data distributions. This data heterogeneity causes the model to forget the global knowledge acquired from previously sampled clients after being trained on local datasets. Although the introduction of proximal objectives in local updates helps to preserve global knowledge, it can also hinder local learning by interfering with local objectives. To address this problem, we propose a novel method, Federated Stabilized Orthogonal Learning (FedSOL), which adopts an orthogonal learning strategy to balance the two conflicting objectives. FedSOL is designed to identify gradients of local objectives that are inherently orthogonal to directions affecting the proximal objective. Specifically, FedSOL targets parameter regions where learning on the local objective is minimally influenced by proximal weight perturbations. Our experiments demonstrate that FedSOL consistently achieves state-of-the-art performance across various scenarios.


title: Pre-trained Model-based Automated Software Vulnerability Repair: How Far are We?

abstract: Various approaches are proposed to help under-resourced security researchers to detect and analyze software vulnerabilities. It is still incredibly time-consuming and labor-intensive for security researchers to fix vulnerabilities. The time lag between reporting and fixing a vulnerability causes software systems to suffer from significant exposure to possible attacks. Recently, some techniques have proposed applying pre-trained models to fix security vulnerabilities and have proved their success in improving repair accuracy. However, the effectiveness of existing pre-trained models has not been systematically analyzed, and little is known about their advantages and disadvantages. To bridge this gap, we perform the first extensive study on applying various pre-trained models to vulnerability repair. The results show that studied pre-trained models consistently outperform the state-of-the-art technique VRepair with a prediction accuracy of 32.94%~44.96%. We also investigate the impact of major phases in the vulnerability repair workflow. Surprisingly, a simplistic approach adopting transfer learning improves the prediction accuracy of pre-trained models by 9.40% on average. Besides, we provide additional discussion to illustrate the capacity and limitations of pre-trained models. Finally, we further pinpoint various practical guidelines for advancing pre-trained model-based vulnerability repair. Our study highlights the promising future of adopting pre-trained models to patch real-world vulnerabilities.


title: Channel and Spatial Relation-Propagation Network for RGB-Thermal Semantic Segmentation

abstract: RGB-Thermal (RGB-T) semantic segmentation has shown great potential in handling low-light conditions where RGB-based segmentation is hindered by poor RGB imaging quality. The key to RGB-T semantic segmentation is to effectively leverage the complementarity nature of RGB and thermal images. Most existing algorithms fuse RGB and thermal information in feature space via concatenation, element-wise summation, or attention operations in either unidirectional enhancement or bidirectional aggregation manners. However, they usually overlook the modality gap between RGB and thermal images during feature fusion, resulting in modality-specific information from one modality contaminating the other. In this paper, we propose a Channel and Spatial Relation-Propagation Network (CSRPNet) for RGB-T semantic segmentation, which propagates only modality-shared information across different modalities and alleviates the modality-specific information contamination issue. Our CSRPNet first performs relation-propagation in channel and spatial dimensions to capture the modality-shared features from the RGB and thermal features. CSRPNet then aggregates the modality-shared features captured from one modality with the input feature from the other modality to enhance the input feature without the contamination issue. While being fused together, the enhanced RGB and thermal features will be also fed into the subsequent RGB or thermal feature extraction layers for interactive feature fusion, respectively. We also introduce a dual-path cascaded feature refinement module that aggregates multi-layer features to produce two refined features for semantic and boundary prediction. Extensive experimental results demonstrate that CSRPNet performs favorably against state-of-the-art algorithms.


title: SCP: Spherical-Coordinate-based Learned Point Cloud Compression

abstract: In recent years, the task of learned point cloud compression has gained prominence. An important type of point cloud, the spinning LiDAR point cloud, is generated by spinning LiDAR on vehicles. This process results in numerous circular shapes and azimuthal angle invariance features within the point clouds. However, these two features have been largely overlooked by previous methodologies. In this paper, we introduce a model-agnostic method called Spherical-Coordinate-based learned Point cloud compression (SCP), designed to leverage the aforementioned features fully. Additionally, we propose a multi-level Octree for SCP to mitigate the reconstruction error for distant areas within the Spherical-coordinate-based Octree. SCP exhibits excellent universality, making it applicable to various learned point cloud compression techniques. Experimental results demonstrate that SCP surpasses previous state-of-the-art methods by up to 29.14% in point-to-point PSNR BD-Rate.


title: Advantage of gravitational cat states in preserving non-classical characteristics

abstract: We investigate how resourceful gravitational cat states are to preserve quantum correlations. In this regard, we explore the dynamics of gravitational cat states under different situations such as thermal, classical stochastic, general decaying, and power-law noisy fields. In particular, the one-way steerability, Bell non-locality, entanglement, and purity in two qubits are our main focus. We also address the weak measurement reversal protocol on the dynamics of quantum correlations and purity of the state. Our results show that the gravitational cat states have a reliable and better capacity to preserve quantum correlations and remain one of the good resources for the deployment of quantum information processing protocols.


title: HuBo-VLM: Unified Vision-Language Model designed for HUman roBOt interaction tasks

abstract: Human robot interaction is an exciting task, which aimed to guide robots following instructions from human. Since huge gap lies between human natural language and machine codes, end to end human robot interaction models is fair challenging. Further, visual information receiving from sensors of robot is also a hard language for robot to perceive. In this work, HuBo-VLM is proposed to tackle perception tasks associated with human robot interaction including object detection and visual grounding by a unified transformer based vision language model. Extensive experiments on the Talk2Car benchmark demonstrate the effectiveness of our approach. Code would be publicly available in https://github.com/dzcgaara/HuBo-VLM.


title: Mutual-Guided Dynamic Network for Image Fusion

abstract: Image fusion aims to generate a high-quality image from multiple images captured under varying conditions. The key problem of this task is to preserve complementary information while filtering out irrelevant information for the fused result. However, existing methods address this problem by leveraging static convolutional neural networks (CNNs), suffering two inherent limitations during feature extraction, i.e., being unable to handle spatial-variant contents and lacking guidance from multiple inputs. In this paper, we propose a novel mutual-guided dynamic network (MGDN) for image fusion, which allows for effective information utilization across different locations and inputs. Specifically, we design a mutual-guided dynamic filter (MGDF) for adaptive feature extraction, composed of a mutual-guided cross-attention (MGCA) module and a dynamic filter predictor, where the former incorporates additional guidance from different inputs and the latter generates spatial-variant kernels for different locations. In addition, we introduce a parallel feature fusion (PFF) module to effectively fuse local and global information of the extracted features. To further reduce the redundancy among the extracted features while simultaneously preserving their shared structural information, we devise a novel loss function that combines the minimization of normalized mutual information (NMI) with an estimated gradient mask. Experimental results on five benchmark datasets demonstrate that our proposed method outperforms existing methods on four image fusion tasks. The code and model are publicly available at: https://github.com/Guanys-dar/MGDN.


title: CALM : A Multi-task Benchmark for Comprehensive Assessment of Language Model Bias

abstract: As language models (LMs) become increasingly powerful and widely used, it is important to quantify them for sociodemographic bias with potential for harm. Prior measures of bias are sensitive to perturbations in the templates designed to compare performance across social groups, due to factors such as low diversity or limited number of templates. Also, most previous work considers only one NLP task. We introduce Comprehensive Assessment of Language Models (CALM) for robust measurement of two types of universally relevant sociodemographic bias, gender and race. CALM integrates sixteen datasets for question-answering, sentiment analysis and natural language inference. Examples from each dataset are filtered to produce 224 templates with high diversity (e.g., length, vocabulary). We assemble 50 highly frequent person names for each of seven distinct demographic groups to generate 78,400 prompts covering the three NLP tasks. Our empirical evaluation shows that CALM bias scores are more robust and far less sensitive than previous bias measurements to perturbations in the templates, such as synonym substitution, or to random subset selection of templates. We apply CALM to 20 large language models, and find that for 2 language model series, larger parameter models tend to be more biased than smaller ones. The T0 series is the least biased model families, of the 20 LLMs investigated here. The code is available at https://github.com/vipulgupta1011/CALM.


title: Wasserstein Regression with Empirical Measures and Density Estimation for Sparse Data

abstract: The problem of modeling the relationship between univariate distributions and one or more explanatory variables has found increasing interest. Traditional functional data methods cannot be applied directly to distributional data because of their inherent constraints. Modeling distributions as elements of the Wasserstein space, a geodesic metric space equipped with the Wasserstein metric that is related to optimal transport, is attractive for statistical applications. Existing approaches proceed by substituting proxy estimated distributions for the typically unknown response distributions. These estimates are obtained from available data but are problematic when for some of the distributions only few data are available. Such situations are common in practice and cannot be addressed with available approaches, especially when one aims at density estimates. We show how this and other problems associated with density estimation such as tuning parameter selection and bias issues can be side-stepped when covariates are available. We also introduce a novel version of distribution-response regression that is based on empirical measures. By avoiding the preprocessing step of recovering complete individual response distributions, the proposed approach is applicable when the sample size available for some of the distributions is small. In this case, one can still obtain consistent distribution estimates even for distributions with only few data by gaining strength across the entire sample of distributions, while traditional approaches where distributions or densities are estimated individually fail, since sparsely sampled densities cannot be consistently estimated. The proposed model is demonstrated to outperform existing approaches through simulations. Its efficacy is corroborated in two case studies on Environmental Influences on Child Health Outcomes (ECHO) data and eBay auction data.


title: Quillen's Plus Construction and the D(2) problem

abstract: Given a finite connected 3-complex with cohomological dimension 2, we show it may be constructed up to homotopy by applying the Quillen plus construction to the Cayley complex of a finite group presentation. This reduces the D(2) problem to a question about perfect normal subgroups.


title: Financial Inclusion and Monetary Policy: A Study on the Relationship between Financial Inclusion and Effectiveness of Monetary Policy in Developing Countries

abstract: The study analyzed the impact of financial inclusion on the effectiveness of monetary policy in developing countries. By using a panel data set of 10 developing countries during 2004-2020, the study revealed that the financial inclusion measured by the number of ATM per 100,000 adults had a significant negative effect on monetary policy, whereas the other measure of financial inclusion i.e. the number of bank accounts per 100,000 adults had a positive impact on monetary policy, which is not statistically significant. The study also revealed that foreign direct investment (FDI), lending rate and exchange rate had a positive impact on inflation, but only the effect of lending rate is statistically significant. Therefore, the governments of these countries should make necessary drives to increase the level of financial inclusion as it stabilizes the price level by reducing the inflation in the economy.


title: Study of four-body decays $B_{(s)} \to (\pi\pi)(\pi\pi)$ in the perturbative QCD approach

abstract: In this work, we make a systematical study on the four-body $B_{(s)} \to (\pi\pi)(\pi\pi)$ decays in the perturbative QCD approach, where the $\pi\pi$ invariant mass spectra are dominated by the vector resonance $\rho(770)$ and the scalar resonance $f_0(980)$. We improve the Gengenbauer moments for the longitudinal $P$-wave two-pion distribution amplitudes (DAs) by fitting the PQCD factorization formulas to measured branching ratios of three-body and four-body $B$ decays. With the fitted Gegenbauer moments, we make predictions for the branching ratios and direct $CP$ asymmetries of four-body $B_{(s)} \to (\pi\pi)(\pi\pi)$ decays. We extract the branching ratios of two-body $B_{(s)} \to \rho\rho$ from the corresponding four-body decay modes and calculate the relevant polarization fractions. We find that the ${\cal B}(B^0 \to \rho^+\rho^-)$ is consistent with the previous theoretical predictions and data. The leading-order PQCD calculations of the ${\cal B}(B^+\to \rho^+\rho^0)$, ${\cal B}(B^0\to \rho^0\rho^0)$ and the $f_0(B^0\to \rho^0\rho^0)$ are a bit lower than the experimental measurements, which should be further examined. In addition, the "true" and "fake" triple-product asymmetries (TPAs) in the $B_{(s)}\to (\pi\pi)(\pi\pi)$ decays are also analyzed. The sizable averaged TPA ${\cal A}_{\text{T-true}}^{1, \text{ave}}=25.26\%$ of the color-suppressed decay $B^0\to \rho^0\rho^0 \to (\pi^+\pi^-)(\pi^+\pi^-)$ is predicted for the first time, which deviates a lot from the so-called "true" TPA $\mathcal{A}_\text{T-true}^1=7.92\%$ due to the large direct $CP$ violation. A large "fake" TPA $\mathcal{A}_\text{T-fake}^1=24.96\%$ of the decay $B^0\to \rho^0\rho^0 \to (\pi^+\pi^-)(\pi^+\pi^-)$ is also found, which indicates the significance of the final-state interactions. The predictions in this work can be tested by LHCb and Belle-II experiments in the near future.


title: Analog Multi-Party Computing: Locally Differential Private Protocols for Collaborative Computations

abstract: We consider a fully-decentralized scenario in which no central trusted entity exists and all clients are honest-but-curious. The state-of-the-art approaches to this problem often rely on cryptographic protocols, such as multiparty computation (MPC), that require mapping real-valued data to a discrete alphabet, specifically a finite field. These approaches, however, can result in substantial accuracy losses due to computation overflows. To address this issue, we propose A-MPC, a private analog MPC protocol that performs all computations in the analog domain. We characterize the privacy of individual datasets in terms of $(\epsilon, \delta)$-local differential privacy, where the privacy of a single record in each client's dataset is guaranteed against other participants. In particular, we characterize the required noise variance in the Gaussian mechanism in terms of the required $(\epsilon,\delta)$-local differential privacy parameters by solving an optimization problem. Furthermore, compared with existing decentralized protocols, A-MPC keeps the privacy of individual datasets against the collusion of all other participants, thereby, in a notably significant improvement, increasing the maximum number of colluding clients tolerated in the protocol by a factor of three compared with the state-of-the-art collaborative learning protocols. Our experiments illustrate that the accuracy of the proposed $(\epsilon,\delta)$-locally differential private logistic regression and linear regression models trained in a fully-decentralized fashion using A-MPC closely follows that of a centralized one performed by a single trusted entity.


title: npm-follower: A Complete Dataset Tracking the NPM Ecosystem

abstract: Software developers typically rely upon a large network of dependencies to build their applications. For instance, the NPM package repository contains over 3 million packages and serves tens of billions of downloads weekly. Understanding the structure and nature of packages, dependencies, and published code requires datasets that provide researchers with easy access to metadata and code of packages. However, prior work on NPM dataset construction typically has two limitations: 1) only metadata is scraped, and 2) packages or versions that are deleted from NPM can not be scraped. Over 330,000 versions of packages were deleted from NPM between July 2022 and May 2023. This data is critical for researchers as it often pertains to important questions of security and malware. We present npm-follower, a dataset and crawling architecture which archives metadata and code of all packages and versions as they are published, and is thus able to retain data which is later deleted. The dataset currently includes over 35 million versions of packages, and grows at a rate of about 1 million versions per month. The dataset is designed to be easily used by researchers answering questions involving either metadata or program analysis. Both the code and dataset are available at https://dependencies.science.


title: On modular categories with Frobenius-Perron dimension congruent to 2 modulo 4

abstract: We contribute to the classification of modular categories $\mathcal{C}$ with $\operatorname{FPdim}(\mathcal{C})\equiv 2 \pmod 4$. We prove that such categories have group of invertibles of even order, and that they factorize as $\mathcal C\cong \widetilde{\mathcal C} \boxtimes \operatorname{sem}$, where $\widetilde{\mathcal C}$ is an odd-dimensional modular category and $\operatorname{sem}$ is the rank 2 pointed modular category. This reduces the classification of these categories to the classification of odd-dimensional modular categories. It follows that modular categories $\mathcal C$ with $\operatorname{FPdim}(\mathcal{C})\equiv 2 \pmod 4$ of rank up to 46 are pointed. More generally, we prove that if $\mathcal C$ is a weakly integral MTC and $p$ is an odd prime dividing the order of the group of invertibles that has multiplicity one in $\operatorname{FPdim}(\mathcal C)$, then we have a factorization $\mathcal C \cong \widetilde{\mathcal C} \boxtimes \operatorname{Vec}_{\mathbb Z_p}^{\chi},$ for $\widetilde{\mathcal C}$ an MTC with dimension not divisible by $p$.


title: Hybrid Models for Facial Emotion Recognition in Children

abstract: This paper focuses on the use of emotion recognition techniques to assist psychologists in performing children's therapy through remotely robot operated sessions. In the field of psychology, the use of agent-mediated therapy is growing increasingly given recent advances in robotics and computer science. Specifically, the use of Embodied Conversational Agents (ECA) as an intermediary tool can help professionals connect with children who face social challenges such as Attention Deficit Hyperactivity Disorder (ADHD), Autism Spectrum Disorder (ASD) or even who are physically unavailable due to being in regions of armed conflict, natural disasters, or other circumstances. In this context, emotion recognition represents an important feedback for the psychotherapist. In this article, we initially present the result of a bibliographical research associated with emotion recognition in children. This research revealed an initial overview on algorithms and datasets widely used by the community. Then, based on the analysis carried out on the results of the bibliographical research, we used the technique of dense optical flow features to improve the ability of identifying emotions in children in uncontrolled environments. From the output of a hybrid model of Convolutional Neural Network, two intermediary features are fused before being processed by a final classifier. The proposed architecture was called HybridCNNFusion. Finally, we present the initial results achieved in the recognition of children's emotions using a dataset of Brazilian children.


title: Relations Between Generalized JST Algorithm and Kalman Filtering Algorithm for Time Scale Generation

abstract: In this paper, we present a generalized Japan Standard Time algorithm (JST-algo) for higher-order atomic clock ensembles and mathematically clarify the relations of the (generalized) JST-algo and the conventional Kalman filtering algorithm (CKF-algo) in the averaged atomic time and the clock residuals for time scale generation. In particular, we reveal the fact that the averaged atomic time of the generalized JST-algo does not depend on the observation noise even though the measurement signal is not filtered in the algorithm. Furthermore, the prediction error of CKF- algo is rigorously shown by using the prediction error regarding an observable state space. It is mathematically shown that when the covariance matrices of system noises are identical for all atomic clocks, considering equal averaging weights for the clocks is a necessary and sufficient condition to ensure equivalence between the generalized JST-algo and CKF-algo in averaged atomic time. In such homogeneous systems, a necessary and sufficient condition for observation noises is presented to determine which algorithm can generate the clock residuals with smaller variances. A couple of numerical examples comparing the generalized JST-algo and CKF-algo are provided to illustrate the efficacy of the results.


title: Synchronize Feature Extracting and Matching: A Single Branch Framework for 3D Object Tracking

abstract: Siamese network has been a de facto benchmark framework for 3D LiDAR object tracking with a shared-parametric encoder extracting features from template and search region, respectively. This paradigm relies heavily on an additional matching network to model the cross-correlation/similarity of the template and search region. In this paper, we forsake the conventional Siamese paradigm and propose a novel single-branch framework, SyncTrack, synchronizing the feature extracting and matching to avoid forwarding encoder twice for template and search region as well as introducing extra parameters of matching network. The synchronization mechanism is based on the dynamic affinity of the Transformer, and an in-depth analysis of the relevance is provided theoretically. Moreover, based on the synchronization, we introduce a novel Attentive Points-Sampling strategy into the Transformer layers (APST), replacing the random/Farthest Points Sampling (FPS) method with sampling under the supervision of attentive relations between the template and search region. It implies connecting point-wise sampling with the feature learning, beneficial to aggregating more distinctive and geometric features for tracking with sparse points. Extensive experiments on two benchmark datasets (KITTI and NuScenes) show that SyncTrack achieves state-of-the-art performance in real-time tracking.


title: Optimal and Robust Fault Tolerant Control of Wind Turbines Working under Sensor, Actuator, and System Faults

abstract: Motivated by the increasing concerns over environmental challenges such as global warming and the exhaustion of fossil-fuel reserves, the renewable energy industry has become the most demanded electrical energy production source worldwide. In this context, wind energy conversion systems (WECSs) are the most dominant and fastest-growing alternative energy production technologies, playing an increasingly vital role in renewable power generation. To tackle the pitch control problem of WECSs, this thesis proposes an optimal fault-tolerant fractional-order pitch control strategy for pitch angle regulation of WT blades subjected to sensor, actuator, and system faults. To showcast the effects of faults, changes in the system parameters are considered as a result of sensor, actuator and system faults with various levels of severity.} Furthermore, taking advantage of the favourable merits of higher-order SMCs and fractional calculus, this thesis develops a fault-tolerant fractional-calculus-based higher-order sliding mode controller for optimum rotor speed tracking and power production maximization of WECSs. \textcolor{black}{The partial loss of the generator output torque is considered as an actuator failure, leading to loss of partial actuation power. Moreover, active fault-tolerant fractional-order higher-order SMC strategies are developed for rotor current regulation and speed trajectory tracking of doubly-fed induction generator (DFIG) -driven WECSs subjected to model uncertainties and rotor current sensor faults. The developed controllers are augmented with two state observers, an algebraic state estimator and a sliding mode observer, to estimate the rotor current dynamics during sensors' faults.


title: A Co-training Approach for Noisy Time Series Learning

abstract: In this work, we focus on robust time series representation learning. Our assumption is that real-world time series is noisy and complementary information from different views of the same time series plays an important role while analyzing noisy input. Based on this, we create two views for the input time series through two different encoders. We conduct co-training based contrastive learning iteratively to learn the encoders. Our experiments demonstrate that this co-training approach leads to a significant improvement in performance. Especially, by leveraging the complementary information from different views, our proposed TS-CoT method can mitigate the impact of data noise and corruption. Empirical evaluations on four time series benchmarks in unsupervised and semi-supervised settings reveal that TS-CoT outperforms existing methods. Furthermore, the representations learned by TS-CoT can transfer well to downstream tasks through fine-tuning.


title: Gaussian Process-based Bayesian Quantum Characterization

abstract: We present a Bayesian quantum characterization framework that takes into account uncertainties from both experimental data and the dynamical modeling of the experiment. We demonstrate that ignoring dynamical model uncertainty may lead to predictions that are inconsistent with the uncertainty present in quantum data. A Bayesian framework is proposed and applied to characterize a tantalum-based transmon device at Lawrence Livermore National Laboratory. We demonstrate how modeling uncertainty can be represented by a Gaussian process within the Bayesian framework, and how this approach improves the predictive capability of Lindblad's master equations applied to the Ramsey measurement protocol.


title: Don't blame Dataset Shift! Shortcut Learning due to Gradients and Cross Entropy

abstract: Common explanations for shortcut learning assume that the shortcut improves prediction under the training distribution but not in the test distribution. Thus, models trained via the typical gradient-based optimization of cross-entropy, which we call default-ERM, utilize the shortcut. However, even when the stable feature determines the label in the training distribution and the shortcut does not provide any additional information, like in perception tasks, default-ERM still exhibits shortcut learning. Why are such solutions preferred when the loss for default-ERM can be driven to zero using the stable feature alone? By studying a linear perception task, we show that default-ERM's preference for maximizing the margin leads to models that depend more on the shortcut than the stable feature, even without overparameterization. This insight suggests that default-ERM's implicit inductive bias towards max-margin is unsuitable for perception tasks. Instead, we develop an inductive bias toward uniform margins and show that this bias guarantees dependence only on the perfect stable feature in the linear perception task. We develop loss functions that encourage uniform-margin solutions, called margin control (MARG-CTRL). MARG-CTRL mitigates shortcut learning on a variety of vision and language tasks, showing that better inductive biases can remove the need for expensive two-stage shortcut-mitigating methods in perception tasks.


title: Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling

abstract: In order to coordinate energy interactions among various communities and energy conversions among multi-energy subsystems within the multi-community integrated energy system under uncertain conditions, and achieve overall optimization and scheduling of the comprehensive energy system, this paper proposes a comprehensive scheduling model that utilizes a multi-agent deep reinforcement learning algorithm to learn load characteristics of different communities and make decisions based on this knowledge. In this model, the scheduling problem of the integrated energy system is transformed into a Markov decision process and solved using a data-driven deep reinforcement learning algorithm, which avoids the need for modeling complex energy coupling relationships between multi-communities and multi-energy subsystems. The simulation results show that the proposed method effectively captures the load characteristics of different communities and utilizes their complementary features to coordinate reasonable energy interactions among them. This leads to a reduction in wind curtailment rate from 16.3% to 0% and lowers the overall operating cost by 5445.6 Yuan, demonstrating significant economic and environmental benefits.


title: On positive semi-definite holomorphic sectional curvature with many zeroes

abstract: We establish the existence of complete K\"ahler metrics of semi-positive holomorphic sectional curvature with many zeroes in an interesting and natural geometric setting. Specifically, we use Calabi's Ansatz in the form due to Koiso-Sakane to produce such metrics on the total space of powers of the tautological line bundles over the projective line. We formulate a general conjecture regarding the compact case and use a product approach to obtain an analogous result in the non-compact case.


title: Relic abundance of dark matter with coannihilation in non-standard cosmological scenarios

abstract: We investigate the relic abundance of dark matter from coannihilation in non-standard cosmological scenarios. We explore the effect of coannihilation on the relic density of dark matter and freeze out temperature in quintessence model with kination phase and brane world cosmological scenarios. Since the Hubble expansion rate is enhanced in quintessence and brane world cosmological models, it causes the larger relic density compared to that in the standard one. On the other hand, the relic density of dark matter is decreased due to the coannihilation in the standard cosmological scenario. After including coannihilation in quintessence or brane world cosmological scenarios, we find the decrease of the relic density of dark matter is slightly slower than that in the standard cosmological scenario.


title: Real Space Characterization of Nonlinear Hall Effect in Confined Directions

abstract: The nonlinear Hall effect (NLHE) is a phenomenon which could produce a transverse Hall voltage in a time-reversal-invariant material. Here, we report the real space characterization of NLHE evaluated through quantum transport in TaIrTe4 nanoribbon without the explicit Berry curvature dipole (BCD) information. We first characterize the NLHE in both transverse confined directions in global-level measurement. The impact of quantum confinement in NLHE is evaluated by adjusting the width of nanoribbons. Then, the probing area is trimmed to the atomic scale to evaluate the local texture, where we discover its unique patterns among the probed atomic groups for the first time. The analysis of charge distribution reveals the connections between NLHE's local patterns and its non-centrosymmetric nature, rendering nearly an order of Hall voltage enhancement through probe positioning. Our work paves the way to expand the range of NLHE study and unveil its physics in more versatile material systems.


title: Hyperbolic Audio-visual Zero-shot Learning

abstract: Audio-visual zero-shot learning aims to classify samples consisting of a pair of corresponding audio and video sequences from classes that are not present during training. An analysis of the audio-visual data reveals a large degree of hyperbolicity, indicating the potential benefit of using a hyperbolic transformation to achieve curvature-aware geometric learning, with the aim of exploring more complex hierarchical data structures for this task. The proposed approach employs a novel loss function that incorporates cross-modality alignment between video and audio features in the hyperbolic space. Additionally, we explore the use of multiple adaptive curvatures for hyperbolic projections. The experimental results on this very challenging task demonstrate that our proposed hyperbolic approach for zero-shot learning outperforms the SOTA method on three datasets: VGGSound-GZSL, UCF-GZSL, and ActivityNet-GZSL achieving a harmonic mean (HM) improvement of around 3.0%, 7.0%, and 5.3%, respectively.


title: Thermal-aware Workload Distribution for Data Centers with Demand Variations

abstract: Thermal-aware workload distribution is a common approach in the literature for power consumption optimization in data centers. However, data centers also have other operational costs such as the cost of equipment maintenance and replacement. It has been shown that server reliability depends on frequency of their temperature variations, arising from workload transitions due to dynamic demands. In this work, we formulate a nonlinear optimization problem that considers the cost of workload transitions in addition to IT and cooling power consumption. To approximate the solution, we first linearize the problem; the result is a mixed integer programming problem. A modified heuristic is then proposed to approximate the solution of the linear problem. Finally, a Model Predictive Control (MPC) approach is integrated with the proposed heuristics for automatic workload reconfiguration when future demand is not known exactly, but predictions are available. Numerical results show that the proposed schemes are attractive in different settings.


title: NOVA: NOvel View Augmentation for Neural Composition of Dynamic Objects

abstract: We propose a novel-view augmentation (NOVA) strategy to train NeRFs for photo-realistic 3D composition of dynamic objects in a static scene. Compared to prior work, our framework significantly reduces blending artifacts when inserting multiple dynamic objects into a 3D scene at novel views and times; achieves comparable PSNR without the need for additional ground truth modalities like optical flow; and overall provides ease, flexibility, and scalability in neural composition. Our codebase is on GitHub.


title: A theory of $\gamma$-factors for $G_2 \times GL_r$

abstract: We construct a theory of local gamma factors for $G_2 \times GL_r$ using a functorial lifting from $G_2$ to $GL_7$. This theory of gamma factors is uniquely characterized by a usual list of properties, showing that it is the only possible candidate. Moreover, this theory of gamma factors is compatible with the Galois theoretic one under the local Langlands correspondence for $G_2$.


title: Variational Information Pursuit with Large Language and Multimodal Models for Interpretable Predictions

abstract: Variational Information Pursuit (V-IP) is a framework for making interpretable predictions by design by sequentially selecting a short chain of task-relevant, user-defined and interpretable queries about the data that are most informative for the task. While this allows for built-in interpretability in predictive models, applying V-IP to any task requires data samples with dense concept-labeling by domain experts, limiting the application of V-IP to small-scale tasks where manual data annotation is feasible. In this work, we extend the V-IP framework with Foundational Models (FMs) to address this limitation. More specifically, we use a two-step process, by first leveraging Large Language Models (LLMs) to generate a sufficiently large candidate set of task-relevant interpretable concepts, then using Large Multimodal Models to annotate each data sample by semantic similarity with each concept in the generated concept set. While other interpretable-by-design frameworks such as Concept Bottleneck Models (CBMs) require an additional step of removing repetitive and non-discriminative concepts to have good interpretability and test performance, we mathematically and empirically justify that, with a sufficiently informative and task-relevant query (concept) set, the proposed FM+V-IP method does not require any type of concept filtering. In addition, we show that FM+V-IP with LLM generated concepts can achieve better test performance than V-IP with human annotated concepts, demonstrating the effectiveness of LLMs at generating efficient query sets. Finally, when compared to other interpretable-by-design frameworks such as CBMs, FM+V-IP can achieve competitive test performance using fewer number of concepts/queries in both cases with filtered or unfiltered concept sets.


title: Multivariate Time-Series Anomaly Detection with Contaminated Data

abstract: Mainstream unsupervised anomaly detection algorithms often excel in academic datasets, yet their real-world performance is restricted due to the controlled experimental conditions involving clean training data. Addressing the challenge of training with noise, a prevalent issue in practical anomaly detection, is frequently overlooked. In a pioneering endeavor, this study delves into the realm of label-level noise within sensory time-series anomaly detection (TSAD). This paper presents a novel and practical end-to-end unsupervised TSAD when the training data are contaminated with anomalies. The introduced approach, called TSAD-C, is devoid of access to abnormality labels during the training phase. TSAD-C encompasses three modules: a Decontaminator to rectify the abnormalities (aka noise) present in the training data, a Long-range Variable Dependency Modeling module to capture both long-term intra- and inter-variable dependencies within the decontaminated data that can be considered as a surrogate of the pure normal data, and an Anomaly Scoring module to detect anomalies from all types. Our extensive experiments conducted on three reliable datasets conclusively demonstrate that our approach surpasses existing methodologies, thus establishing a new state-of-the-art performance in the field.


title: Some New Results for Generalized Incomplete Exponential Matrix Functions

abstract: The primary goal of this paper is to introduce and investigate generalized incomplete exponential functions with matrix parameters. Integral representation, differential formula, addition formula, multiplication formula, and recurrence relation obtained here are believed to be new in the theory of special matrix functions. We also establish the connection between these matrix functions and other matrix functions, such as the incomplete gamma matrix function, the Bessel and modified Bessel matrix functions.


title: AMUSE-antlia I: Nuclear X-ray properties of early-type galaxies in a dynamically young galaxy cluster

abstract: To understand the formation and growth of supermassive black holes (SMBHs) and their co-evolution with host galaxies, it is essential to know the impact of environment on the activity of active galactic nuclei (AGN). We present new Chandra X-ray observations of nuclear emission from member galaxies in the Antlia cluster, the nearest non-cool core and the nearest merging galaxy cluster, residing at D = 35.2 Mpc. Its inner region, centered on two dominant galaxies NGC 3268 and NGC 3258, has been mapped with three deep Chandra ACIS-I pointings. Nuclear X-ray sources are detected in 7/84 (8.3%) early-type galaxies (ETG) and 2/8 (25%) late-type galaxies with a median detection limit of 8x10^38 erg/s. All nuclear X-ray sources but one have a corresponding radio continuum source detected by MeerKAT at the L-band. Nuclear X-ray sources detected in early-type galaxies are considered as the genuine X-ray counterpart of low-luminosity AGN. When restricted to a detection limit of logLx(erg/s) > 38.9 and a stellar mass of 10 < log Ms(Msun) <11.6, 6/11 (54.5%) ETG are found to contain an X-ray AGN in Antlia, exceeding the AGN occupation fraction of 7/39 (18.0%) and 2/12 (16.7%) in the more relaxed, cool core clusters, Virgo and Fornax, respectively, and rivaling that of the AMUSE-Field ETG of 27/49 (55.1%). Furthermore, more than half of the X-ray AGN in Antlia are hosted by its younger subcluster, centered on NGC 3258. We believe that this is because SMBH activity is enhanced in a dynamically young cluster compared to relatively relaxed clusters.


title: Hybrid noise shaping for audio coding using perfectly overlapped window

abstract: In recent years, audio coding technology has been standardized based on several frameworks that incorporate linear predictive coding (LPC). However, coding the transient signal using frequency-domain LP residual signals remains a challenge. To address this, temporal noise shaping (TNS) can be adapted, although it cannot be effectively operated since the estimated temporal envelope in the modified discrete cosine transform (MDCT) domain is accompanied by the time-domain aliasing (TDA) terms. In this study, we propose the modulated complex lapped transform-based coding framework integrated with transform coded excitation (TCX) and complex LPC-based TNS (CTNS). Our approach uses a 50\% overlap window and switching scheme for the CTNS to improve the coding efficiency. Additionally, an adaptive calculation of the target bits for the sub-bands using the frequency envelope information based on the quantized LPC coefficients is proposed. To minimize the quantization mismatch between both modes, an integrated quantization for real and complex values and a TDA augmentation method that compensates for the artificially generated TDA components during switching operations are proposed. The proposed coding framework shows a superior performance in both objective metrics and subjective listening tests, thereby demonstrating its low bit-rate audio coding.


title: Global existence of spherically symmetry solutions for isothermal Euler-Poisson system outside a ball

abstract: In this paper, we consider an isothermal Euler-Poisson system with self-gravitational force, modeling a compact star such as strange quark star. We prove that there exists a global entropy solution with spherically symmetry outside a ball, through the fractional Lax-Friedrichs scheme and the theory of compensated compactness.


title: A Small and Fast BERT for Chinese Medical Punctuation Restoration

abstract: In clinical dictation, utterances after automatic speech recognition (ASR) without explicit punctuation marks may lead to the misunderstanding of dictated reports. To give a precise and understandable clinical report with ASR, automatic punctuation restoration is required. Considering a practical scenario, we propose a fast and light pre-trained model for Chinese medical punctuation restoration based on 'pretraining and fine-tuning' paradigm. In this work, we distill pre-trained models by incorporating supervised contrastive learning and a novel auxiliary pre-training task (Punctuation Mark Prediction) to make it well-suited for punctuation restoration. Our experiments on various distilled models reveal that our model can achieve 95% performance while 10% model size relative to state-of-the-art Chinese RoBERTa.


title: Dynamics of quantum spin-nematics: Comparisons with canted antiferromagnets

abstract: The identification of spin-nematic states is challenging due to the absence of Bragg peaks. However, the study of dynamical physical quantities provides a promising avenue for characterizing these states. In this study, we investigate the dynamical properties of spin-nematic states in three-dimensional quantum spin systems in a magnetic field, using a two-component boson theory that incorporates magnons and bi-magnons. Our particular focus lies on the dynamical spin structure factor at zero temperature and the nuclear magnetic resonance (NMR) relaxation rate at finite temperatures. Our findings reveal that the dynamical structure factor does not exhibit any diverging singularity across momentum and frequency while providing valuable information about the form factor of bi-magnon states and the underlying structure of spin-nematic order. Furthermore, we find a temperature dependence in the NMR relaxation rate proportional to $T^3$ at low temperatures, similar to canted antiferromagnets. A clear distinction arises as there is no critical divergence of the NMR relaxation rate at the spin-nematic transition temperature. Our theoretical framework provides a comprehensive understanding of the excitation spectrum and the dynamical properties of spin-nematic states, covering arbitrary spin values $S$ and encompassing site and bond nematic orders. Additionally, we apply the same methodology to analyze these dynamical quantities in a canted antiferromagnetic state and compare the results with those in the spin-nematic states.


title: StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Construction

abstract: High-Definition (HD) maps are essential for the safety of autonomous driving systems. While existing techniques employ camera images and onboard sensors to generate vectorized high-precision maps, they are constrained by their reliance on single-frame input. This approach limits their stability and performance in complex scenarios such as occlusions, largely due to the absence of temporal information. Moreover, their performance diminishes when applied to broader perception ranges. In this paper, we present StreamMapNet, a novel online mapping pipeline adept at long-sequence temporal modeling of videos. StreamMapNet employs multi-point attention and temporal information which empowers the construction of large-range local HD maps with high stability and further addresses the limitations of existing methods. Furthermore, we critically examine widely used online HD Map construction benchmark and datasets, Argoverse2 and nuScenes, revealing significant bias in the existing evaluation protocols. We propose to resplit the benchmarks according to geographical spans, promoting fair and precise evaluations. Experimental results validate that StreamMapNet significantly outperforms existing methods across all settings while maintaining an online inference speed of $14.2$ FPS. Our code is available at https://github.com/yuantianyuan01/StreamMapNet.


title: Effective reaction temperatures of irreversible dust chemical reactions in a protoplanetary disk

abstract: Dust particles in protoplanetary disks experience various chemical reactions under different physicochemical conditions through their accretion and diffusion, which results in the radial chemical gradient of dust. We performed three-dimensional Monte Carlo simulations to evaluate the dust trajectories and the progress of fictitious irreversible reactions, of which kinetics is expressed by the Johnson-Mehl-Avrami equation. The distribution of the highest temperature that each particle experiences before the degree of reaction exceeds a certain level shows the log-normal distribution, and its mode temperature was used as the effective reaction temperature. Semi-analytical prediction formulas of the effective reaction temperature and its dispersion were derived by comparing a reaction timescale with a diffusive transport timescale of dust as a function of the reaction parameters and the disk parameters. The formulas reproduce the numerical results of the effective reaction temperatures and their dispersions within 5.5 and 24 %, respectively, in a wide temperature range (200-1400 K). We applied the formulas for the crystallization of amorphous silicate dust and its oxygen isotope exchange with the H2O vapor based on the experimentally determined kinetics. For sub-micron sized amorphous forsterite dust, the predicted effective reaction temperature for the oxygen isotope exchange was lower than that of crystallization without overlap even considering their dispersions. This suggests that the amorphous silicate dust in the protosolar disk could exchange their oxygen isotopes efficiently with the 16O-poor H2O vapor, resulting in the distinct oxygen isotope compositions from the Sun.


title: Light Propagation in the vicinity of the ModMax black hole

abstract: ModMax is a nonlinear electrodynamics theory with the same symmetries as Maxwell electrodynamics. Static spherically symmetric solutions have been derived by coupling ModMax electrodynamics with the Einstein equations, which can represent a black hole. In this paper, we analyze light propagation in the vicinity of the ModMax black hole. We determine birefringence, light trajectories, deflection, redshifts, as well as the shadow of the black hole using the effective or optical metric to determine the optical paths of light; comparison is done with the corresponding effects in the neighborhood of the Reissner-Nordstrom black hole, that is the solution to the Einstein-Maxwell equations.


title: Conditional Kernel Imitation Learning for Continuous State Environments

abstract: Imitation Learning (IL) is an important paradigm within the broader reinforcement learning (RL) methodology. Unlike most of RL, it does not assume availability of reward-feedback. Reward inference and shaping are known to be difficult and error-prone methods particularly when the demonstration data comes from human experts. Classical methods such as behavioral cloning and inverse reinforcement learning are highly sensitive to estimation errors, a problem that is particularly acute in continuous state space problems. Meanwhile, state-of-the-art IL algorithms convert behavioral policy learning problems into distribution-matching problems which often require additional online interaction data to be effective. In this paper, we consider the problem of imitation learning in continuous state space environments based solely on observed behavior, without access to transition dynamics information, reward structure, or, most importantly, any additional interactions with the environment. Our approach is based on the Markov balance equation and introduces a novel conditional kernel density estimation-based imitation learning framework. It involves estimating the environment's transition dynamics using conditional kernel density estimators and seeks to satisfy the probabilistic balance equations for the environment. We establish that our estimators satisfy basic asymptotic consistency requirements. Through a series of numerical experiments on continuous state benchmark environments, we show consistently superior empirical performance over many state-of-the-art IL algorithms.


title: Modeling Uncertainty and Using Post-fusion as Fallback Improves Retrieval Augmented Generation with LLMs

abstract: The integration of retrieved passages and large language models (LLMs), such as ChatGPTs, has significantly contributed to improving open-domain question answering. However, there is still a lack of exploration regarding the optimal approach for incorporating retrieved passages into the answer generation process. This paper aims to fill this gap by investigating different methods of combining retrieved passages with LLMs to enhance answer generation. We begin by examining the limitations of a commonly-used concatenation approach. Surprisingly, this approach often results in generating "unknown" outputs, even when the correct document is among the top-k retrieved passages. To address this issue, we explore four alternative strategies for integrating the retrieved passages with the LLMs. These strategies include two single-round methods that utilize chain-of-thought reasoning and two multi-round strategies that incorporate feedback loops. Through comprehensive analyses and experiments, we provide insightful observations on how to effectively leverage retrieved passages to enhance the answer generation capability of LLMs.


title: Hypergraph Convolutional Networks for Fine-grained ICU Patient Similarity Analysis and Risk Prediction

abstract: The Intensive Care Unit (ICU) is one of the most important parts of a hospital, which admits critically ill patients and provides continuous monitoring and treatment. Various patient outcome prediction methods have been attempted to assist healthcare professionals in clinical decision-making. Existing methods focus on measuring the similarity between patients using deep neural networks to capture the hidden feature structures. However, the higher-order relationships are ignored, such as patient characteristics (e.g., diagnosis codes) and their causal effects on downstream clinical predictions. In this paper, we propose a novel Hypergraph Convolutional Network that allows the representation of non-pairwise relationships among diagnosis codes in a hypergraph to capture the hidden feature structures so that fine-grained patient similarity can be calculated for personalized mortality risk prediction. Evaluation using a publicly available eICU Collaborative Research Database indicates that our method achieves superior performance over the state-of-the-art models on mortality risk prediction. Moreover, the results of several case studies demonstrated the effectiveness and robustness of the model decisions.


title: Quantum mechanics is compatible with counterfactual definiteness

abstract: Counterfactual definiteness (CFD) means that if some property is measured in some context, then the outcome of the measurement would have been the same had this property been measured in a different context. A context includes all other measurements made together with the one in question, and the spatiotemporal relations among them. The proviso for CFD is non-disturbance: any physical influence of the contexts on the property being measured is excluded by the laws of nature, so that no one measuring this property has a way of ascertaining its context. It is usually claimed that in quantum mechanics CFD does not hold, because if one assigns the same value to a property in all contexts it is measured in, one runs into a logical contradiction, or at least contravenes quantum theory and experimental evidence. We show that this claim is not substantiated if one takes into account that only one of the possible contexts can be a factual context, all other contexts being counterfactual. With this in mind, any system of random variables can be viewed as satisfying CFD. The concept of CFD is closely related to but distinct from that of noncontextuality, and it is the latter property that may or may not hold for a system, in particular being contravened by some quantum systems


title: REB: Reducing Biases in Representation for Industrial Anomaly Detection

abstract: Existing representation-based methods usually conduct industrial anomaly detection in two stages: obtain feature representations with a pre-trained model and perform distance measures for anomaly detection. Among them, K-nearest neighbor (KNN) retrieval-based anomaly detection methods show promising results. However, the features are not fully exploited as these methods ignore domain bias of pre-trained models and the difference of local density in feature space, which limits the detection performance. In this paper, we propose Reducing Biases (REB) in representation by considering the domain bias and building a self-supervised learning task for better domain adaption with a defect generation strategy (DefectMaker) that ensures a strong diversity in the synthetic defects. Additionally, we propose a local-density KNN (LDKNN) to reduce the local density bias in the feature space and obtain effective anomaly detection. The proposed REB method achieves a promising result of 99.5\% Im.AUROC on the widely used MVTec AD, with smaller backbone networks such as Vgg11 and Resnet18. The method also achieves an impressive 88.8\% Im.AUROC on the MVTec LOCO AD dataset and a remarkable 96.0\% on the BTAD dataset, outperforming other representation-based approaches. These results indicate the effectiveness and efficiency of REB for practical industrial applications. Code:https://github.com/ShuaiLYU/REB.