title: Private Learning with Public Features

abstract: We study a class of private learning problems in which the data is a join of private and public features. This is often the case in private personalization tasks such as recommendation or ad prediction, in which features related to individuals are sensitive, while features related to items (the movies or songs to be recommended, or the ads to be shown to users) are publicly available and do not require protection. A natural question is whether private algorithms can achieve higher utility in the presence of public features. We give a positive answer for multi-encoder models where one of the encoders operates on public features. We develop new algorithms that take advantage of this separation by only protecting certain sufficient statistics (instead of adding noise to the gradient). This method has a guaranteed utility improvement for linear regression, and importantly, achieves the state of the art on two standard private recommendation benchmarks, demonstrating the importance of methods that adapt to the private-public feature separation.


title: UI Layout Generation with LLMs Guided by UI Grammar

abstract: The recent advances in Large Language Models (LLMs) have stimulated interest among researchers and industry professionals, particularly in their application to tasks concerning mobile user interfaces (UIs). This position paper investigates the use of LLMs for UI layout generation. Central to our exploration is the introduction of UI grammar -- a novel approach we proposed to represent the hierarchical structure inherent in UI screens. The aim of this approach is to guide the generative capacities of LLMs more effectively and improve the explainability and controllability of the process. Initial experiments conducted with GPT-4 showed the promising capability of LLMs to produce high-quality user interfaces via in-context learning. Furthermore, our preliminary comparative study suggested the potential of the grammar-based approach in improving the quality of generative results in specific aspects.


title: Substantial Doubt Remains about the Efficacy of Anti-Amyloid Antibodies

abstract: Alzheimer's disease (AD) is a prevalent, progressive, and ultimately fatal neurodegenerative disorder that is defined pathologically by the accumulation of amyloid plaques and tau neurofibrillary tangles in the brain. There remains an unmet need for therapies that can halt or slow the course of AD. To address this need, the FDA has provided a mechanism, under its Accelerated Approval pathway, for potential therapeutics to be approved based in part on their ability to reduce brain amyloid. Through this pathway, two monoclonal anti-amyloid antibodies, aducanumab and lecanemab, have been approved for clinical use. More recently, another amyloid-lowering antibody, donanemab, generated a statistically significant outcome in a phase 3 clinical trial and will shortly come under FDA review. While these monoclonal antibodies are not yet routinely used in clinical practice, the series of recent positive clinical trials has fostered enthusiasm amongst some AD experts. Here, we discuss three key limitations regarding recent anti-amyloid clinical trials: (1) there is little to no evidence that amyloid reduction correlates with clinical outcome, (2) the reported efficacy of anti-amyloid therapies may be partly, or wholly, explained by functional unblinding, and (3) donanemab in its phase 3 trial had no effect on tau burden, the pathological hallmark more closely related to cognition. Taken together, these observations call into question the efficacy of anti-amyloid therapies.


title: An Unconditionally Stable Iterative Decoupled Algorithm for Multiple-Network Poroelasticity

abstract: In this work, we introduce an iterative decoupled algorithm designed for addressing the quasi-static multiple-network poroelasticity problem. This problem pertains to the simultaneous modeling of fluid flow and deformations within an elastic porous medium permeated by multiple fluid networks, each with distinct characteristics. Our approach focuses on the total-pressure-based formulation, which treats the solid displacement, total pressure, and network pressures as primary unknowns. This formulation transforms the original problem into a combination of the generalized Stokes problem and the parabolic problem, offering certain advantages such as mitigating elastic locking effects and streamlining the discretization process. Notably, the algorithm ensures unconditional convergence to the solution of the total-pressure-based coupled algorithm. To validate the accuracy and efficiency of our method, we present numerical experiments. The robustness of the algorithm with respect to the physical parameters and the discretization parameters is carefully investigated.


title: An O(N) distributed-memory parallel direct solver for planar integral equations

abstract: Boundary value problems involving elliptic PDEs such as the Laplace and the Helmholtz equations are ubiquitous in mathematical physics and engineering. Many such problems can be alternatively formulated as integral equations that are mathematically more tractable. However, an integral-equation formulation poses a significant computational challenge: solving large dense linear systems that arise upon discretization. In cases where iterative methods converge rapidly, existing methods that draw on fast summation schemes such as the Fast Multipole Method are highly efficient and well-established. More recently, linear complexity direct solvers that sidestep convergence issues by directly computing an invertible factorization have been developed. However, storage and computation costs are high, which limits their ability to solve large-scale problems in practice. In this work, we introduce a distributed-memory parallel algorithm based on an existing direct solver named ``strong recursive skeletonization factorization.'' Specifically, we apply low-rank compression to certain off-diagonal matrix blocks in a way that minimizes computation and data movement. Compared to iterative algorithms, our method is particularly suitable for problems involving ill-conditioned matrices or multiple right-hand sides. Large-scale numerical experiments are presented to show the performance of our Julia implementation.


title: Strategies to mitigate bias from time recording errors in pharmacokinetic studies

abstract: Opportunistic pharmacokinetic (PK) studies have sparse and imbalanced clinical measurement data, and the impact of sample time errors is an important concern when seeking accurate estimates of treatment response. We evaluated an approximate Bayesian model for individualized pharmacokinetics in the presence of time recording errors (TREs), considering both a short and long infusion dosing pattern. We found that the long infusion schedule generally had lower bias in estimates of the pharmacodynamic (PD) endpoint relative to the short infusion schedule. We investigated three different design strategies for their ability to mitigate the impact of TREs: (i) shifting blood draws taken during an active infusion to the post-infusion period, (ii) identifying the best next sample time by minimizing bias in the presence of TREs, and (iii) collecting additional information on a subset of patients based on estimate uncertainty or quadrature-estimated variance in the presence of TREs. Generally, the proposed strategies led to a decrease in bias of the PD estimate for the short infusion schedule, but had a negligible impact for the long infusion schedule. Dosing regimens with periods of high non-linearity may benefit from design modifications, while more stable concentration-time profiles are generally more robust to TREs with no design modifications.


title: HL-DPoS: An Enhanced Anti-Long-Range Attack DPoS Algorithm

abstract: The consensus algorithm is crucial in blockchain for ensuring the validity and security of transactions across the decentralized network. However, achieving consensus among nodes and packaging blocks in blockchain networks is a complex task that requires efficient and secure consensus algorithms. The DPoS consensus algorithm has emerged as a popular choice due to its fast transaction processing and high throughput. Despite these advantages, the algorithm still suffers from weaknesses such as centralization and vulnerability to long-range attacks, which can compromise the integrity of the blockchain network. To combat these problems, we developed an Enhanced Anti-Long-Range Attack DPoS algorithm (HL-DPoS). First, we split nodes into pieces to reduce centralization issues while giving witness nodes the power to report and benefit from malicious node's reports, maintaining high efficiency and high security. Second, we propose a validation method in HL-DPoS that compares consensuses transactions with the longest chain to detect long-range attacks. Algorithm analysis and simulation experiment results demonstrate that our HL-DPoS consensus algorithm improves security while achieving better consensus performance.


title: Facilitating Self-Guided Mental Health Interventions Through Human-Language Model Interaction: A Case Study of Cognitive Restructuring

abstract: Self-guided mental health interventions, such as "do-it-yourself" tools to learn and practice coping strategies, show great promise to improve access to mental health care. However, these interventions are often cognitively demanding and emotionally triggering, creating accessibility barriers that limit their wide-scale implementation and adoption. In this paper, we study how human-language model interaction can support self-guided mental health interventions. We take cognitive restructuring, an evidence-based therapeutic technique to overcome negative thinking, as a case study. In an IRB-approved randomized field study on a large mental health website with 15,531 participants, we design and evaluate a system that uses language models to support people through various steps of cognitive restructuring. Our findings reveal that our system positively impacts emotional intensity for 67% of participants and helps 65% overcome negative thoughts. Although adolescents report relatively worse outcomes, we find that tailored interventions that simplify language model generations improve overall effectiveness and equity.


title: Empirical limit theorems for Wiener chaos

abstract: We consider empirical measures in a triangular array setup with underlying distributions varying as sample size grows. We study asymptotic properties of multiple integrals with respect to normalized empirical measures. Limit theorems involving series of multiple Wiener-It\^o integrals are established.


title: Nested Control Co-design of a Spar Buoy Horizontal-axis Floating Offshore Wind Turbine

abstract: Floating offshore wind turbine (FOWT) systems involve several coupled physical analysis disciplines, including aeroelasticity, multi-body structural dynamics, hydrodynamics, and controls. Conventionally, physical structure (plant) and control design decisions are treated as two separate problems, and generally, control design is performed after the plant design is complete. However, this sequential design approach cannot fully capitalize upon the synergy between plant and control design decisions. These conventional design practices produce suboptimal designs, especially in cases with strong coupling between plant and control design decisions. Control co-design (CCD) is a holistic design approach that accounts fully for plant-control design coupling by optimizing these decisions simultaneously. CCD is especially advantageous for system design problems with complex interactions between physics disciplines, which is the case for FOWT systems. This paper presents and demonstrates a nested CCD approach using open-loop optimal control (OLOC) for a simplified reduced-order model that simulates FOWT dynamic behavior. This simplified model is helpful for optimization studies due to its computational efficiency, but is still sufficiently rich enough to capture important multidisciplinary physics couplings and plant-control design coupling associated with a horizontal-axis FOWT system with a spar buoy floating platform. The CCD result shows an improvement in the objective function, annual energy production (AEP), compared to the baseline design by more than eleven percent. Optimization studies at this fidelity level can provide system design engineers with insights into design directions that leverage design coupling to improve performance. These studies also provide a template for future more detailed turbine CCD optimization studies that utilize higher fidelity models and design representations.


title: Interpreting Answers to Yes-No Questions in User-Generated Content

abstract: Interpreting answers to yes-no questions in social media is difficult. Yes and no keywords are uncommon, and the few answers that include them are rarely to be interpreted what the keywords suggest. In this paper, we present a new corpus of 4,442 yes-no question-answer pairs from Twitter. We discuss linguistic characteristics of answers whose interpretation is yes or no, as well as answers whose interpretation is unknown. We show that large language models are far from solving this problem, even after fine-tuning and blending other corpora for the same problem but outside social media.


title: A universal meta-heuristic framework for influence maximization in hypergraphs

abstract: Influence maximization (IM) aims to select a small number of nodes that are able to maximize their influence in a network and covers a wide range of applications. Despite numerous attempts to provide effective solutions in ordinary networks, higher-order interactions between entities in various real-world systems are not usually taken into account. In this paper, we propose a versatile meta-heuristic approach, hyper genetic algorithm (HGA), to tackle the IM problem in hypergraphs, which is based on the concept of genetic evolution. Systematic validations in synthetic and empirical hypergraphs under both simple and complex contagion models indicate that HGA achieves universal and plausible performance compared to baseline methods. We explore the cause of the excellent performance of HGA through ablation studies and correlation analysis. The findings show that the solution of HGA is distinct from that of other prior methods. Moreover, a closer look at the local topological features of the seed nodes acquired by different algorithms reveals that the selection of seed nodes cannot be based on a single topological characteristic, but should involve a combination of multiple topological features to address the IM problem.


title: EKGNet: A 10.96{\mu}W Fully Analog Neural Network for Intra-Patient Arrhythmia Classification

abstract: We present an integrated approach by combining analog computing and deep learning for electrocardiogram (ECG) arrhythmia classification. We propose EKGNet, a hardware-efficient and fully analog arrhythmia classification architecture that archives high accuracy with low power consumption. The proposed architecture leverages the energy efficiency of transistors operating in the subthreshold region, eliminating the need for analog-to-digital converters (ADC) and static random access memory (SRAM). The system design includes a novel analog sequential Multiply-Accumulate (MAC) circuit that mitigates process, supply voltage, and temperature variations. Experimental evaluations on PhysioNet's MIT-BIH and PTB Diagnostics datasets demonstrate the effectiveness of the proposed method, achieving average balanced accuracy of 95% and 94.25% for intra-patient arrhythmia classification and myocardial infarction (MI) classification, respectively. This innovative approach presents a promising avenue for developing low-power arrhythmia classification systems with enhanced accuracy and transferability in biomedical applications.


title: Policy Optimization of Finite-Horizon Kalman Filter with Unknown Noise Covariance

abstract: This paper is on learning the Kalman gain by policy optimization method. Firstly, we reformulate the finite-horizon Kalman filter as a policy optimization problem of the dual system. Secondly, we obtain the global linear convergence of exact gradient descent method in the setting of known parameters. Thirdly, the gradient estimation and stochastic gradient descent method are proposed to solve the policy optimization problem, and further the global linear convergence and sample complexity of stochastic gradient descent are provided for the setting of unknown noise covariance matrices and known model parameters.


title: Empowering Distributed Solutions in Renewable Energy Systems and Grid Optimization

abstract: This study delves into the shift from centralized to decentralized approaches in the electricity industry, with a particular focus on how machine learning (ML) advancements play a crucial role in empowering renewable energy sources and improving grid management. ML models have become increasingly important in predicting renewable energy generation and consumption, utilizing various techniques like artificial neural networks, support vector machines, and decision trees. Furthermore, data preprocessing methods, such as data splitting, normalization, decomposition, and discretization, are employed to enhance prediction accuracy. The incorporation of big data and ML into smart grids offers several advantages, including heightened energy efficiency, more effective responses to demand, and better integration of renewable energy sources. Nevertheless, challenges like handling large data volumes, ensuring cybersecurity, and obtaining specialized expertise must be addressed. The research investigates various ML applications within the realms of solar energy, wind energy, and electric distribution and storage, illustrating their potential to optimize energy systems. To sum up, this research demonstrates the evolving landscape of the electricity sector as it shifts from centralized to decentralized solutions through the application of ML innovations and distributed decision-making, ultimately shaping a more efficient and sustainable energy future.


title: The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Risks

abstract: The rapid advancements of large language models (LLMs) have raised public concerns about the privacy leakage of personally identifiable information (PII) within their extensive training datasets. Recent studies have demonstrated that an adversary could extract highly sensitive privacy data from the training data of LLMs with carefully designed prompts. However, these attacks suffer from the model's tendency to hallucinate and catastrophic forgetting (CF) in the pre-training stage, rendering the veracity of divulged PIIs negligible. In our research, we propose a novel attack, Janus, which exploits the fine-tuning interface to recover forgotten PIIs from the pre-training data in LLMs. We formalize the privacy leakage problem in LLMs and explain why forgotten PIIs can be recovered through empirical analysis on open-source language models. Based upon these insights, we evaluate the performance of Janus on both open-source language models and two latest LLMs, i.e., GPT-3.5-Turbo and LLaMA-2-7b. Our experiment results show that Janus amplifies the privacy risks by over 10 times in comparison with the baseline and significantly outperforms the state-of-the-art privacy extraction attacks including prefix attacks and in-context learning (ICL). Furthermore, our analysis validates that existing fine-tuning APIs provided by OpenAI and Azure AI Studio are susceptible to our Janus attack, allowing an adversary to conduct such an attack at a low cost.


title: Continual Event Extraction with Semantic Confusion Rectification

abstract: We study continual event extraction, which aims to extract incessantly emerging event information while avoiding forgetting. We observe that the semantic confusion on event types stems from the annotations of the same text being updated over time. The imbalance between event types even aggravates this issue. This paper proposes a novel continual event extraction model with semantic confusion rectification. We mark pseudo labels for each sentence to alleviate semantic confusion. We transfer pivotal knowledge between current and previous models to enhance the understanding of event types. Moreover, we encourage the model to focus on the semantics of long-tailed event types by leveraging other associated types. Experimental results show that our model outperforms state-of-the-art baselines and is proficient in imbalanced datasets.


title: Multi-Path Bound for DAG Tasks

abstract: This paper studies the response time bound of a DAG (directed acyclic graph) task. Recently, the idea of using multiple paths to bound the response time of a DAG task, instead of using a single longest path in previous results, was proposed and leads to the so-called multi-path bound. Multi-path bounds can greatly reduce the response time bound and significantly improve the schedulability of DAG tasks. This paper derives a new multi-path bound and proposes an optimal algorithm to compute this bound. We further present a systematic analysis on the dominance and the sustainability of three existing multi-path bounds and the proposed multi-path bound. Our bound theoretically dominates and empirically outperforms all existing multi-path bounds. What's more, the proposed bound is the only multi-path bound that is proved to be self-sustainable.


title: Interpretable Survival Analysis for Heart Failure Risk Prediction

abstract: Survival analysis, or time-to-event analysis, is an important and widespread problem in healthcare research. Medical research has traditionally relied on Cox models for survival analysis, due to their simplicity and interpretability. Cox models assume a log-linear hazard function as well as proportional hazards over time, and can perform poorly when these assumptions fail. Newer survival models based on machine learning avoid these assumptions and offer improved accuracy, yet sometimes at the expense of model interpretability, which is vital for clinical use. We propose a novel survival analysis pipeline that is both interpretable and competitive with state-of-the-art survival models. Specifically, we use an improved version of survival stacking to transform a survival analysis problem to a classification problem, ControlBurn to perform feature selection, and Explainable Boosting Machines to generate interpretable predictions. To evaluate our pipeline, we predict risk of heart failure using a large-scale EHR database. Our pipeline achieves state-of-the-art performance and provides interesting and novel insights about risk factors for heart failure.


title: O(1) benchmarking of precise rotation in a spin-squeezed Bose-Einstein condensate

abstract: Benchmarking a high-precision quantum operation is a big challenge for many quantum systems in the presence of various noises as well as control errors. Here we propose an $O(1)$ benchmarking of a dynamically corrected rotation by taking the quantum advantage of a squeezed spin state in a spin-1 Bose-Einstein condensate. Our analytical and numerical results show that tiny rotation infidelity, defined by $1-F$ with $F$ the rotation fidelity, can be calibrated in the order of $1/N^2$ by only several measurements of the rotation error for $N$ atoms in an optimally squeezed spin state. Such an $O(1)$ benchmarking is possible not only in a spin-1 BEC but also in other many-spin or many-qubit systems if a squeezed or entangled state is available.


title: Coupled Cluster Degree of the Grassmannian

abstract: We determine the number of complex solutions to a nonlinear eigenvalue problem on the Grassmannian in its Pl\"ucker embedding. This is motivated by quantum chemistry, where it represents the truncation to single electrons in coupled cluster theory. We prove the formula for the Grassmannian of lines which was conjectured in earlier work with Fabian Faulstich. This rests on the geometry of the graph of a birational parametrization of the Grassmannian. We present a squarefree Gr\"obner basis for this graph, and we develop connections to toric degenerations from representation theory.


title: Vanishing of DHKK complexities for singularity categories and generation of syzygy modules

abstract: Let R be a commutative noetherian ring. In this paper, we study, for the singularity category of R, the vanishing of the complexity $\delta_t(X,Y)$ in the sense of Dimitrov, Haiden, Katzarkov and Kontsevich. We prove that the set of real numbers t such that $\delta_t(X,Y)$ does not vanish is bounded in various cases. We do it by building the high syzygy modules and maximal Cohen-Macaulay modules out of a single module only by taking direct summands and extensions.


title: Trade-off relations of geometric coherence

abstract: Quantum coherence is an important quantum resource and it is intimately related to various research fields. The geometric coherence is a coherence measure both operationally and geometrically. We study the trade-off relation of geometric coherence in qubit systems. We first derive an upper bound for the geometric coherence by the purity of quantum states. Based on this, a complementarity relation between the quantum coherence and the mixedness is established. We then derive the quantum uncertainty relations of the geometric coherence on two and three general measurement bases in terms of the incompatibility respectively, which turn out to be state-independent for pure states. These trade-off relations provide the limit to the amount of quantum coherence. As a byproduct,the complementarity relation between the minimum error probability for discriminating a pure-states ensemble and the mixedness of quantum states is established.


title: CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model

abstract: Instruction tuning has recently been recognized as an effective way of aligning Large Language Models (LLMs) to enhance their generalization ability across various tasks. However, when tuning publicly accessible, centralized LLMs with private instruction data, privacy concerns are inevitable. While direct transfer of parameterized modules between models is a plausible approach to address this, its implications and effectiveness need further exploration. This paper focuses on Offsite-Tuning (OFT), a representative technique that transfers transformer blocks between centralized LLMs and downstream emulators. Given the limited understanding of the underlying mechanism of OFT, we perform an empirical analysis on LLMs from the perspectives of representation and functional similarity. Interestingly, our findings reveal a unique modular structure within the layers of LLMs that appears to emerge as the model size expands. Simultaneously, we note subtle but potentially significant changes in representation and intermediate predictions across the layers. Inspired by these observations, we propose CRaSh, involving Clustering, Removing, and Sharing, a training-free strategy to derive improved emulators from LLMs. CRaSh significantly boosts performance of OFT with billions of parameters. Furthermore, we investigate the optimal solutions yielded by fine-tuning with and without full model through the lens of loss landscape. Our findings demonstrate a linear connectivity among these optima falling over the same basin, thereby highlighting the effectiveness of CRaSh and OFT. The source code is publicly available at https://github.com/TsinghuaC3I/CRaSh.


title: How to Train Your Neural Control Barrier Function: Learning Safety Filters for Complex Input-Constrained Systems

abstract: Control barrier functions (CBF) have become popular as a safety filter to guarantee the safety of nonlinear dynamical systems for arbitrary inputs. However, it is difficult to construct functions that satisfy the CBF constraints for high relative degree systems with input constraints. To address these challenges, recent work has explored learning CBFs using neural networks via neural CBF (NCBF). However, such methods face difficulties when scaling to higher dimensional systems under input constraints. In this work, we first identify challenges that NCBFs face during training. Next, to address these challenges, we propose policy neural CBF (PNCBF), a method of constructing CBFs by learning the value function of a nominal policy, and show that the value function of the maximum-over-time cost is a CBF. We demonstrate the effectiveness of our method in simulation on a variety of systems ranging from toy linear systems to an F-16 jet with a 16-dimensional state space. Finally, we validate our approach on a two-agent quadcopter system on hardware under tight input constraints.


title: AutoDiff: combining Auto-encoder and Diffusion model for tabular data synthesizing

abstract: Diffusion model has become a main paradigm for synthetic data generation in many subfields of modern machine learning, including computer vision, language model, or speech synthesis. In this paper, we leverage the power of diffusion model for generating synthetic tabular data. The heterogeneous features in tabular data have been main obstacles in tabular data synthesis, and we tackle this problem by employing the auto-encoder architecture. When compared with the state-of-the-art tabular synthesizers, the resulting synthetic tables from our model show nice statistical fidelities to the real data, and perform well in downstream tasks for machine learning utilities. We conducted the experiments over $15$ publicly available datasets. Notably, our model adeptly captures the correlations among features, which has been a long-standing challenge in tabular data synthesis. Our code is available at https://github.com/UCLA-Trustworthy-AI-Lab/AutoDiffusion.


title: R\'enyi entanglement asymmetry in 1+1-dimensional conformal field theories

abstract: In this paper, we consider the R\'enyi entanglement asymmetry of excited states in the 1+1 dimensional free compact boson conformal field theory (CFT) at equilibrium. We obtain a universal CFT expression written by correlation functions for the charged moments via the replica trick. We provide detailed analytic computations of the second R\'enyi entanglement asymmetry in the free compact boson CFT for excited states $\Psi=V_{\beta}+V_{-\beta}$ and $\Phi=V_{\beta}+J$ with $V_{\beta}$ and $J=i\partial\phi$ being the vertex operator and current operator respectively. We make numerical tests of the universal CFT computations using the XX spin chain model. Taking the non-Hermite fake RDMs into consideration, we propose an effective way to test them numerically, which can be applied to other excited states. The CFT predictions are in perfect agreement with the exact numerical calculations.


title: Detecting anomalous images in astronomical datasets

abstract: Environmental and instrumental conditions can cause anomalies in astronomical images, which can potentially bias all kinds of measurements if not excluded. Detection of the anomalous images is usually done by human eyes, which is slow and sometimes not accurate. This is an important issue in weak lensing studies, particularly in the era of large scale galaxy surveys, in which image qualities are crucial for the success of galaxy shape measurements. In this work we present two automatic methods for detecting anomalous images in astronomical datasets. The anomalous features can be divided into two types: one is associated with the source images, and the other appears on the background. Our first method, called the Entropy Method, utilizes the randomness of the orientation distribution of the source shapes and the background gradients to quantify the likelihood of an exposure being anomalous. Our second method involves training a neural network (autoencoder) to detect anomalies. We evaluate the effectiveness of the Entropy Method on the CFHTLenS and DECaLS DR3 data. In CFHTLenS, with 1171 exposures, the Entropy Method outperforms human inspection by detecting 12 of the 13 anomalous exposures found during human inspection and uncovering 10 new ones. In DECaLS DR3, with 17112 exposures, the Entropy method detects a significant number of anomalous exposures while keeping a low false positive rate. We find that although the neural network performs relatively well in detecting source anomalies, its current performance is not as good as the Entropy Method.


title: Salient Object Detection in RGB-D Videos

abstract: Given the widespread adoption of depth-sensing acquisition devices, RGB-D videos and related data/media have gained considerable traction in various aspects of daily life. Consequently, conducting salient object detection (SOD) in RGB-D videos presents a highly promising and evolving avenue. Despite the potential of this area, SOD in RGB-D videos remains somewhat under-explored, with RGB-D SOD and video SOD (VSOD) traditionally studied in isolation. To explore this emerging field, this paper makes two primary contributions: the dataset and the model. On one front, we construct the RDVS dataset, a new RGB-D VSOD dataset with realistic depth and characterized by its diversity of scenes and rigorous frame-by-frame annotations. We validate the dataset through comprehensive attribute and object-oriented analyses, and provide training and testing splits. Moreover, we introduce DCTNet+, a three-stream network tailored for RGB-D VSOD, with an emphasis on RGB modality and treats depth and optical flow as auxiliary modalities. In pursuit of effective feature enhancement, refinement, and fusion for precise final prediction, we propose two modules: the multi-modal attention module (MAM) and the refinement fusion module (RFM). To enhance interaction and fusion within RFM, we design a universal interaction module (UIM) and then integrate holistic multi-modal attentive paths (HMAPs) for refining multi-modal low-level features before reaching RFMs. Comprehensive experiments, conducted on pseudo RGB-D video datasets alongside our RDVS, highlight the superiority of DCTNet+ over 17 VSOD models and 14 RGB-D SOD models. Ablation experiments were performed on both pseudo and realistic RGB-D video datasets to demonstrate the advantages of individual modules as well as the necessity of introducing realistic depth. Our code together with RDVS dataset will be available at https://github.com/kerenfu/RDVS/.


title: LDPC Decoding with Degree-Specific Neural Message Weights and RCQ Decoding

abstract: Recently, neural networks have improved MinSum message-passing decoders for low-density parity-check (LDPC) codes by multiplying or adding weights to the messages, where the weights are determined by a neural network. The neural network complexity to determine distinct weights for each edge is high, often limiting the application to relatively short LDPC codes. Furthermore, storing separate weights for every edge and every iteration can be a burden for hardware implementations. To reduce neural network complexity and storage requirements, this paper proposes a family of weight-sharing schemes that use the same weight for edges that have the same check node degree and/or variable node degree. Our simulation results show that node-degree-based weight-sharing can deliver the same performance requiring distinct weights for each node. This paper also combines these degree-specific neural weights with a reconstruction-computation-quantization (RCQ) decoder to produce a weighted RCQ (W-RCQ) decoder. The W-RCQ decoder with node-degree-based weight sharing has a reduced hardware requirement compared with the original RCQ decoder. As an additional contribution, this paper identifies and resolves a gradient explosion issue that can arise when training neural LDPC decoders.


title: NuTrea: Neural Tree Search for Context-guided Multi-hop KGQA

abstract: Multi-hop Knowledge Graph Question Answering (KGQA) is a task that involves retrieving nodes from a knowledge graph (KG) to answer natural language questions. Recent GNN-based approaches formulate this task as a KG path searching problem, where messages are sequentially propagated from the seed node towards the answer nodes. However, these messages are past-oriented, and they do not consider the full KG context. To make matters worse, KG nodes often represent proper noun entities and are sometimes encrypted, being uninformative in selecting between paths. To address these problems, we propose Neural Tree Search (NuTrea), a tree search-based GNN model that incorporates the broader KG context. Our model adopts a message-passing scheme that probes the unreached subtree regions to boost the past-oriented embeddings. In addition, we introduce the Relation Frequency-Inverse Entity Frequency (RF-IEF) node embedding that considers the global KG context to better characterize ambiguous KG nodes. The general effectiveness of our approach is demonstrated through experiments on three major multi-hop KGQA benchmark datasets, and our extensive analyses further validate its expressiveness and robustness. Overall, NuTrea provides a powerful means to query the KG with complex natural language questions. Code is available at https://github.com/mlvlab/NuTrea.


title: A Berry-Essen Type Theorem for Finite Free Convolution

abstract: We prove that the rate of convergence for the central limit theorem in finite free convolution is of order $n^{1/2}$


title: RIS-based IMT-2030 Testbed for MmWave Multi-stream Ultra-massive MIMO Communications

abstract: As one enabling technique of the future sixth generation (6G) network, ultra-massive multiple-input-multiple-output (MIMO) can support high-speed data transmissions and cell coverage extension. However, it is hard to realize the ultra-massive MIMO via traditional phased arrays due to unacceptable power consumption. To address this issue, reconfigurable intelligent surface-based (RIS-based) antennas are an energy-efficient enabler of the ultra-massive MIMO, since they are free of energy-hungry phase shifters. In this article, we report the performances of the RIS-enabled ultra-massive MIMO via a project called Verification of MmWave Multi-stream Transmissions Enabled by RIS-based Ultra-massive MIMO for 6G (V4M), which was proposed to promote the evolution towards IMT-2030. In the V4M project, we manufacture RIS-based antennas with 1024 one-bit elements working at 26 GHz, based on which an mmWave dual-stream ultra-massive MIMO prototype is implemented for the first time. To approach practical settings, the Tx and Rx of the prototype are implemented by one commercial new radio base station and one off-the-shelf user equipment, respectively. The measured data rate of the dual-stream prototype approaches the theoretical peak rate. Our contributions to the V4M project are also discussed by presenting technological challenges and corresponding solutions.


title: Generalized Cardy conditions of topological defect lines

abstract: We propose a systematic procedure to work out systems of topological defect lines (TDLs) in minimal models. The only input of this method is the modular invariant partition function. For diagonal and permutation diagonal models, we prove there is a bijection between simple TDLs and primary fields preserving fusion rules. For block-diagonal models, we work out simple TDLs in the $3$-state Potts model as an example. The results agree with those in $3D$ topological field theory methods.


title: Reputation-based synergy and discounting mechanism promotes cooperation

abstract: A good group reputation often facilitates more efficient synergistic teamwork in production activities. Here we translate this simple motivation into a reputation-based synergy and discounting mechanism in the public goods game. Specifically, the reputation type of a group, either good or bad determined by a reputation threshold, modifies the nonlinear payoff structure described by a unified reputation impact factor. Results show that this reputation-based incentive mechanism could effectively promote cooperation compared with linear payoffs, despite the coexistence of synergy and discounting effects. Notably, the complicated interactions between reputation impact and reputation threshold result in a sharp phase transition from full cooperation to full defection. We also find that the presence of a few discounting groups could increase the average payoffs of cooperators, leading to an interesting phenomenon that when the reputation threshold is raised, the gap between the average payoffs of cooperations and defectors increases while the overall payoff decreases. Our work provides important insights into facilitating cooperation in social groups.


title: Small-scale cosmic ray anisotropy observed by the GRAPES-3 experiment at TeV energies

abstract: GRAPES-3 is a mid-altitude (2200 m) and near equatorial ($11.4^{\circ}$ North) air shower array, overlapping in its field of view for cosmic ray observations with experiments that are located in Northern and Southern hemispheres. We analyze a sample of $3.7\times10^9$ cosmic ray events collected by the GRAPES-3 experiment between 1 January 2013 and 31 December 2016 with a median energy of $\sim16$ TeV for study of small-scale ($<60^{\circ}$) angular scale anisotropies. We observed two structures labeled as A and B, deviate from the expected isotropic distribution of cosmic rays in a statistically significant manner. Structure `A' spans $50^{\circ}$ to $80^{\circ}$ in the right ascension and $-15^{\circ}$ to $30^{\circ}$ in the declination coordinate. The relative excess observed in the structure A is at the level of $(6.5\pm1.3)\times10^{-4}$ with a statistical significance of 6.8 standard deviations. Structure `B' is observed in the right ascension range of $110^{\circ}$ to $140^{\circ}$. The relative excess observed in this region is at the level of $(4.9\pm1.4)\times10^{-4}$ with a statistical significance of 4.7 standard deviations. These structures are consistent with those reported by Milagro, ARGO-YBJ, and HAWC. These observations could provide a better understanding of the cosmic ray sources, propagation and the magnetic structures in our Galaxy.


title: New Mass and Radius Constraints on the LHS 1140 Planets -- LHS 1140 b is Either a Temperate Mini-Neptune or a Water World

abstract: The two-planet transiting system LHS 1140 has been extensively observed since its discovery in 2017, notably with $Spitzer$, HST, TESS, and ESPRESSO, placing strong constraints on the parameters of the M4.5 host star and its small temperate exoplanets, LHS 1140 b and c. Here, we reanalyse the ESPRESSO observations of LHS 1140 with the novel line-by-line framework designed to fully exploit the radial velocity content of a stellar spectrum while being resilient to outlier measurements. The improved radial velocities, combined with updated stellar parameters, consolidate our knowledge on the mass of LHS 1140 b (5.60$\pm$0.19 M$_{\oplus}$) and LHS 1140 c (1.91$\pm$0.06 M$_{\oplus}$) with unprecedented precision of 3%. Transits from $Spitzer$, HST, and TESS are jointly analysed for the first time, allowing us to refine the planetary radii of b (1.730$\pm$0.025 R$_{\oplus}$) and c (1.272$\pm$0.026 R$_{\oplus}$). Stellar abundance measurements of refractory elements (Fe, Mg and Si) obtained with NIRPS are used to constrain the internal structure of LHS 1140 b. This planet is unlikely to be a rocky super-Earth as previously reported, but rather a mini-Neptune with a $\sim$0.1% H/He envelope by mass or a water world with a water-mass fraction between 9 and 19% depending on the atmospheric composition and relative abundance of Fe and Mg. While the mini-Neptune case would not be habitable, a water-abundant LHS 1140 b potentially has habitable surface conditions according to 3D global climate models, suggesting liquid water at the substellar point for atmospheres with relatively low CO$_2$ concentration, from Earth-like to a few bars.


title: Early Planet Formation in Embedded Disks (eDisk) X: Compact Disks, Extended Infall, and a Fossil Outburst in the Class I Oph IRS43 Binary

abstract: We present the first results from the Early Planet Formation in Embedded Disks (eDisk) ALMA Large Program toward Oph IRS43, a binary system of solar mass protostars. The 1.3 mm dust continuum observations resolve a compact disk, ~6au radius, around the northern component and show that the disk around the southern component is even smaller, <~3 au. CO, 13CO, and C18O maps reveal a large cavity in a low mass envelope that shows kinematic signatures of rotation and infall extending out to ~ 2000au. An expanding CO bubble centered on the extrapolated location of the source ~130 years ago suggests a recent outburst. Despite the small size of the disks, the overall picture is of a remarkably large and dynamically active region.


title: Robust Representation Learning for Unified Online Top-K Recommendation

abstract: In large-scale industrial e-commerce, the efficiency of an online recommendation system is crucial in delivering highly relevant item/content advertising that caters to diverse business scenarios. However, most existing studies focus solely on item advertising, neglecting the significance of content advertising. This oversight results in inconsistencies within the multi-entity structure and unfair retrieval. Furthermore, the challenge of retrieving top-k advertisements from multi-entity advertisements across different domains adds to the complexity. Recent research proves that user-entity behaviors within different domains exhibit characteristics of differentiation and homogeneity. Therefore, the multi-domain matching models typically rely on the hybrid-experts framework with domain-invariant and domain-specific representations. Unfortunately, most approaches primarily focus on optimizing the combination mode of different experts, failing to address the inherent difficulty in optimizing the expert modules themselves. The existence of redundant information across different domains introduces interference and competition among experts, while the distinct learning objectives of each domain lead to varying optimization challenges among experts. To tackle these issues, we propose robust representation learning for the unified online top-k recommendation. Our approach constructs unified modeling in entity space to ensure data fairness. The robust representation learning employs domain adversarial learning and multi-view wasserstein distribution learning to learn robust representations. Moreover, the proposed method balances conflicting objectives through the homoscedastic uncertainty weights and orthogonality constraints. Various experiments validate the effectiveness and rationality of our proposed method, which has been successfully deployed online to serve real business scenarios.


title: $P_c$ states in the mixture of molecular and pentaquark pictures

abstract: We systematically study hidden charm pentaquark states in the constituent quark model with a general Hamiltonian for multiquark systems, considering the coupling between the $\Sigma_c^{(*)}\bar{D}^{(*)}$ molecular states and the $q^3c\bar c$ compact pentaquark states by the one-gluon exchange hyperfine interaction. The ground state hidden-charm pentaquark mass spectra and the strong decay widths are calculated. This work suggests that $P_c(4312)$, $P_c(4457)$ and $P_c(4380)$ resonances might be mainly $\Sigma_c \bar D$, $\Sigma_c \bar D^*$ and $\Sigma_c^* \bar D$ hadronic molecules respectively, and $P_c(4440)$ might include sizable pentaquark components.


title: TRAMS: Training-free Memory Selection for Long-range Language Modeling

abstract: The Transformer architecture is crucial for numerous AI models, but it still faces challenges in long-range language modeling. Though several specific transformer architectures have been designed to tackle issues of long-range dependencies, existing methods like Transformer-XL are plagued by a high percentage of ineffective memories. In this study, we present a plug-and-play strategy, known as TRAining-free Memory Selection (TRAMS), that selects tokens participating in attention calculation based on one simple metric. This strategy allows us to keep tokens that are likely to have a high attention score with the current queries and ignore the other ones. We have tested our approach on the word-level benchmark (WikiText-103) and the character-level benchmark (enwik8), and the results indicate an improvement without having additional training or adding additional parameters.


title: AMG: Automated Efficient Approximate Multiplier Generator for FPGAs via Bayesian Optimization

abstract: Approximate computing is a promising approach to reduce the power, delay, and area in hardware design for many error-resilient applications such as machine learning (ML) and digital signal processing (DSP) systems, in which multipliers usually are key arithmetic units. Due to the underlying architectural differences between ASICs and FPGAs, existing ASIC-based approximate multipliers do not offer symmetrical gains when they are implemented by FPGA resources. In this paper, we propose AMG, an open-source automated approximate multiplier generator for FPGAs driven by Bayesian optimization (BO) with parallel evaluation. The proposed method simplifies the exact half adders (HAs) for the initial partial product (PP) compression in a multiplier while preserving coarse-grained additions for the following accumulation. The generated multipliers can be effectively mapped to lookup tables (LUTs) and carry chains provided by modern FPGAs, reducing hardware costs with acceptable errors. Compared with 1167 multipliers from previous works, our generated multipliers can form a Pareto front with 28.70%-38.47% improvements in terms of the product of hardware cost and error on average. All source codes, reproduced multipliers, and our generated multipliers are available at https://github.com/phyzhenli/AMG.


title: A family of Condorcet domains that are single-peaked on a circle

abstract: Fishburn's alternating scheme domains occupy a special place in the theory of Condorcet domains. Karpov (2023) generalised these domains and made an interesting observation proving that all of them are single-picked on a circle. However, an important point that all generalised Fishburn domains are maximal Condorcet domain remained unproved. We fill this gap and suggest a new combinatorial interpretation of generalised Fishburn's domains which provide a constructive proof of single-peakedness of these domains on a circle. We show that classical single-peaked domains and single-dipped domains as well as Fishburn's alternating scheme domains belong to this family of domains while single-crossing domains do not.


title: Generalized Box-Cox method to estimate sample mean and standard deviation for Meta-analysis

abstract: Meta-analysis is the aggregation of data from multiple studies to find patterns across a broad range relating to a particular subject. It is becoming increasingly useful to apply meta-analysis to summarize these studies being done across various fields. In meta-analysis, it is common to use the mean and standard deviation from each study to compare for analysis. While many studies reported mean and standard deviation for their summary statistics, some report other values including the minimum, maximum, median, and first and third quantiles. Often, the quantiles and median are reported when the data is skewed and does not follow a normal distribution. In order to correctly summarize the data and draw conclusions from multiple studies, it is necessary to estimate the mean and standard deviation from each study, considering variation and skewness within each study. In past literature, methods have been proposed to estimate the mean and standard deviation, but do not consider negative values. Data that include negative values are common and would increase the accuracy and impact of the me-ta-analysis. We propose a method that implements a generalized Box-Cox transformation to estimate the mean and standard deviation accounting for such negative values while maintaining similar accuracy.


title: Is hydrogen diffusion in amorphous metals non-Arrhenian?

abstract: Hydrogen diffusion is critical to the performance of metals for hydrogen storage as well as other important applications. As compared to its crystalline counterpart which follows the Arrhenius relation, hydrogen diffusion in amorphous metals sometimes are experimentally found to be non-Arrhenian. In this work we studied the diffusion of hydrogen in amorphous Pd-H and Zr-Cu-H alloys based on molecular dynamics simulations. Our simulations confirm Arrhenian diffusion behaviour for hydrogen in amorphous alloys, in contrast to previous theoretical studies which predict non-Arrhenian behaviour. We show that the simulated non-Arrhenian diffusion based on molecular dynamics could result from a systematic error related to too short simulation time. We also discussed the experimental non-Arrhenian behaviour of hydrogen diffusion within the framework of quantum tunneling and amorphous-amorphous phase transformations.


title: Nematic Phase of the n-Component Cubic-Spin Spin Glass in d=3: Liquid-Crystal Phase in a Dirty Magnet

abstract: A nematic phase, previously seen in the d=3 classical Heisenberg spin-glass system, occurs in the n-component cubic-spin spin-glass system, between the low-temperature spin-glass phase and the high temperature disordered phase, for number of components n >= 3, in spatial dimension d=3, thus constituting a liquid-crystal phase in a dirty (quenched-disordered) magnet. This result is obtained from renormalization-group calculations that are exact on the hierarchical lattice and, equivalently, approximate on the cubic spatial lattice. The nematic phase completely intervenes between the spin-glass phase and the disordered phase. The Lyapunov exponents of the spin-glass chaos are calculated from n=1 up to n=12 and show odd-even oscillations with respect to n.


title: Multi-split configuration design for fluid-based thermal management systems

abstract: High power density systems require efficient cooling to maintain their thermal performance. Despite this, as systems get larger and more complex, human practice and insight may not suffice to determine the desired thermal management system designs. To this end, a framework for automatic architecture exploration is presented in this article for a class of single-phase, multi-split cooling systems. For this class of systems, heat generation devices are clustered based on their spatial information, and flow-split are added only when required and at the location of heat devices. To generate different architectures, candidate architectures are represented as graphs. From these graphs, dynamic physics models are created automatically using a graph-based thermal modeling framework. Then, an optimal fluid flow distribution problem is solved by addressing temperature constraints in the presence of exogenous heat loads to achieve optimal performance. The focus in this work is on the design of general multi-split heat management systems. The architectures discussed here can be used for various applications in the domain of configuration design. The multi-split algorithm can produce configurations where splitting can occur at any of the vertices. The results presented include 3 categories of cases and are discussed in detail.


title: Evolution of MHD Torus and Mass Outflow Around Spinning AGN

abstract: We perform axisymmetric, two-dimensional magnetohydrodynamic (MHD) simulations to investigate accretion flows around spinning AGN. To mimic the space-time geometry of spinning black holes, we consider effective Kerr potential, and the mass of the black holes is $10^8 M_{\odot}$. We initialize the accretion disc with a magnetized torus by adopting the toroidal component of the magnetic vector potential. The initial magnetic field strength is set by using the plasma beta parameter ($\beta_0$). We observe self-consistent turbulence generated by magneto rotational instability (MRI) in the disc. The MRI turbulence transports angular momentum in the disc, resulting in an angular momentum distribution that approaches a Keplerian distribution. We investigate the effect of the magnetic field on the dynamics of the torus and associated mass outflow from the disc around a maximally spinning black hole $(a_k = 0.99)$. For the purpose of our analysis, we investigate the magnetic state of our simulation model. The model $\beta_0 = 10$ indicates the behaviour similar to the "magnetically arrested disk (MAD)'' state, and all the other low magnetic model remains in the SANE state. We observe that mass outflow rates are significantly enhanced with the increased magnetic field in the disc. We find a positive correlation between the magnetic field and mass outflow rates. We also investigate the effect of black hole spin on the magnetized torus evolution. However, we have not found any significant effect of black hole spin on mass outflows in our model. Finally, we discuss the possible astrophysical applications of our simulation results.


title: Algebraic combinatorial optimization on the degree of determinants of noncommutative symbolic matrices

abstract: We address the computation of the degrees of minors of a noncommutative symbolic matrix of form \[ A[c] := \sum_{k=1}^m A_k t^{c_k} x_k, \] where $A_k$ are matrices over a field $\mathbb{K}$, $x_i$ are noncommutative variables, $c_k$ are integer weights, and $t$ is a commuting variable specifying the degree. This problem extends noncommutative Edmonds' problem (Ivanyos et al. 2017), and can formulate various combinatorial optimization problems. Extending the study by Hirai 2018, and Hirai, Ikeda 2022, we provide novel duality theorems and polyhedral characterization for the maximum degrees of minors of $A[c]$ of all sizes, and develop a strongly polynomial-time algorithm for computing them. This algorithm is viewed as a unified algebraization of the classical Hungarian method for bipartite matching and the weight-splitting algorithm for linear matroid intersection. As applications, we provide polynomial-time algorithms for weighted fractional linear matroid matching and linear optimization over rank-2 Brascamp-Lieb polytopes.


title: Quantifying Photoproduction Corrections to J/\psi Measurements in Au+Au and Cu+Cu Collisions at $\sqrt{s_{NN}} = 200$ GeV

abstract: The contribution of J/\psi production from coherent and incoherent photon-induced production is calculated in Au+Au and Cu+Cu collisions at $\sqrt{s_{NN}} = 200$ GeV. The yield and nuclear modification factors ($R_{AA}$) contributed by photoproduction are presented as functions of transverse momentum ($p_T$) and centrality at both mid- and forward rapidity. The $R_{AA}$ of J/\psi from photoproduction is found to be as high as 0.6 in the lowest $p_{T}$ bin ($0 < p_{T} < 1$ GeV/$c$) at mid-rapidity in 60-92\% Au+Au collisions. The $R_{AA}$ measured in Au+Au and Cu+Cu collisions at $\sqrt{s_{NN}} = 200$ GeV are corrected by subtracting the calculated photoproduction contribution.


title: Cross-view Self-localization from Synthesized Scene-graphs

abstract: Cross-view self-localization is a challenging scenario of visual place recognition in which database images are provided from sparse viewpoints. Recently, an approach for synthesizing database images from unseen viewpoints using NeRF (Neural Radiance Fields) technology has emerged with impressive performance. However, synthesized images provided by these techniques are often of lower quality than the original images, and furthermore they significantly increase the storage cost of the database. In this study, we explore a new hybrid scene model that combines the advantages of view-invariant appearance features computed from raw images and view-dependent spatial-semantic features computed from synthesized images. These two types of features are then fused into scene graphs, and compressively learned and recognized by a graph neural network. The effectiveness of the proposed method was verified using a novel cross-view self-localization dataset with many unseen views generated using a photorealistic Habitat simulator.


title: The Quantum Tortoise and the Classical Hare: A simple framework for understanding which problems quantum computing will accelerate (and which it will not)

abstract: Quantum computing promises transformational gains for solving some problems, but little to none for others. For anyone hoping to use quantum computers now or in the future, it is important to know which problems will benefit. In this paper, we introduce a framework for answering this question both intuitively and quantitatively. The underlying structure of the framework is a race between quantum and classical computers, where their relative strengths determine when each wins. While classical computers operate faster, quantum computers can sometimes run more efficient algorithms. Whether the speed advantage or the algorithmic advantage dominates determines whether a problem will benefit from quantum computing or not. Our analysis reveals that many problems, particularly those of small to moderate size that can be important for typical businesses, will not benefit from quantum computing. Conversely, larger problems or those with particularly big algorithmic gains will benefit from near-term quantum computing. Since very large algorithmic gains are rare in practice and theorized to be rare even in principle, our analysis suggests that the benefits from quantum computing will flow either to users of these rare cases, or practitioners processing very large data.


title: Topology Optimization with Text-Guided Stylization

abstract: We propose an approach for the generation of topology-optimized structures with text-guided appearance stylization. This methodology aims to enrich the concurrent design of a structure's physical functionality and aesthetic appearance. Users can effortlessly input descriptive text to govern the style of the structure. Our system employs a hash-encoded neural network as the implicit structure representation backbone, which serves as the foundation for the co-optimization of structural mechanical performance, style, and connectivity, to ensure full-color, high-quality 3D-printable solutions. We substantiate the effectiveness of our system through extensive comparisons, demonstrations, and a 3D printing test.


title: Nonpropagating ghost in covariant $f(Q)$ gravity

abstract: $f(Q)$ gravity is an extension of the symmetric teleparallel equivalent to general relativity (STEGR). This work shows that based on the scalar-nonmetricity formulation, a scalar mode in $f(Q)$ gravity has a negative kinetic energy. This conclusion holds regardless of the coincident gauge frequently used in STEGR and $f(Q)$ gravity. To study the scalar mode, we further consider the covariant $f(Q)$ gravity as a special class in higher-order scalar tensor (HOST) theory and rewrite the four scalar fields, which play a role of the St\"{u}eckelberg fields associated with the diffeomorphism, by vector fields. Applying the standard Arnowitt-Deser-Misner (ADM) formulation to the new formulation of the $f(Q)$ gravity, we demonstrate that the ghost scalar mode can be eliminated by the second-class constraints, thus ensuring that $f(Q)$ gravity is a healthy theory.


title: Spacetime surgery for black hole fireworks

abstract: We construct an explicit model for the black hole to white hole transition (known as the black hole fireworks scenario) using the cut-and-paste technique. We model a black hole collapse using the evolution of a time-like shell in the background of the loop quantum gravity inspired metric. We then use the space-like shell analysis to construct the firework geometry. Our simple and well defined analysis removes some subtle issues that were present in the previous literature. In particular, we demonstrate that the null energy condition must be violated for the bounce. We also calculate the proper time scales required for the black to white hole transition, which in any valid scenario must be shorter than the evaporation time scale. In contrast, we show that the bouncing time for the distant observer can be chosen arbitrarily, since it is determined by how one cuts and pastes the spacetimes outside the event horizon, and thus does not have any obvious connection to quantum gravity effects.


title: Dual frequency master oscillator generation and distribution for ALS and ALS-U

abstract: The ongoing work to upgrade ALS to ALS-U demands strict RF requirements such as low jitter and low spurs frequency reference to meet its accelerator and science goals. A low phase noise dual frequency Master Oscillator (MO), where the two frequencies are related by a fractional ratio of 608/609 and flexible divide by four frequency outputs has been consolidated into a single chassis. Optical fiber clock distribution system has been selected over the old coax system used in ALS to distribute these signals to various clients across the facility, providing high electrical isolation between outputs and therefore lower phase errors. A Xilinx FPGA ties the MO chassis together by providing a RS-485 interface to monitor and control the system. The new system aims to deliver phase-continuous frequencies with a phase noise (integrated RMS jitter) from 1 Hz to 1 MHz of less than 200 femtosecond per output. This paper will discuss the design, implementation, performance and installation of the new MO generation and distribution system.


title: Natural liquid organic hydrogen carrier with low dehydrogenation energy: A first principles study

abstract: Liquid organic hydrogen carriers (LOHCs) represent a promising approach for hydrogen storage due to their favorable properties including stability and compatibility with the existing infrastructure. However, fossil-based LOHC molecules are not green or sustainable. Here we examined the possibility of using norbelladine and trisphaeridine, two typical structures of Amaryllidaceae alkaloids, as the LOHCs from the sustainable and renewable sources of natural products. Our first principles thermodynamics calculations reveal low reversibility for the reaction of norbelladine to/from perhydro-norbelladine because of the existence of stabler isomers of perhydro-norbelladine. On the other hand, trisphaeridine is found promising due to its high hydrogen storage capacity ($\sim$5.9 wt\%) and favorable energetics. Dehydrogenation of perhydro-trisphaeridine has an average standard enthalpy change of $\sim$54 KJ/mol-H$_2$, similar to that of perhydro-\textit{N}-ethylcarbazole, a typical LOHC known for its low dehydrogenation enthalpy. This work is a first exploration of Amaryllidaceae alkaloids for hydrogen storage and the results demonstrate, more generally, the potential of bio-based molecules as a new sustainable resource for future large-scale hydrogen storage.


title: KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval

abstract: We study the ability of state-of-the art models to answer constraint satisfaction queries for information retrieval (e.g., 'a list of ice cream shops in San Diego'). In the past, such queries were considered to be tasks that could only be solved via web-search or knowledge bases. More recently, large language models (LLMs) have demonstrated initial emergent abilities in this task. However, many current retrieval benchmarks are either saturated or do not measure constraint satisfaction. Motivated by rising concerns around factual incorrectness and hallucinations of LLMs, we present KITAB, a new dataset for measuring constraint satisfaction abilities of language models. KITAB consists of book-related data across more than 600 authors and 13,000 queries, and also offers an associated dynamic data collection and constraint verification approach for acquiring similar test data for other authors. Our extended experiments on GPT4 and GPT3.5 characterize and decouple common failure modes across dimensions such as information popularity, constraint types, and context availability. Results show that in the absence of context, models exhibit severe limitations as measured by irrelevant information, factual errors, and incompleteness, many of which exacerbate as information popularity decreases. While context availability mitigates irrelevant information, it is not helpful for satisfying constraints, identifying fundamental barriers to constraint satisfaction. We open source our contributions to foster further research on improving constraint satisfaction abilities of future models.


title: Inference for Rank-Rank Regressions

abstract: Slope coefficients in rank-rank regressions are popular measures of intergenerational mobility. In this paper, we first point out two important properties of the OLS estimator in such regressions: commonly used variance estimators do not consistently estimate the asymptotic variance of the OLS estimator and, when the underlying distribution is not continuous, the OLS estimator may be highly sensitive to the way in which ties are handled. Motivated by these findings we derive the asymptotic theory for the OLS estimator in a general rank-rank regression specification without making assumptions about the continuity of the underlying distribution. We then extend the asymptotic theory to other regressions involving ranks that have been used in empirical work. Finally, we apply our new inference methods to three empirical studies. We find that the confidence intervals based on estimators of the correct variance may sometimes be substantially shorter and sometimes substantially longer than those based on commonly used variance estimators. The differences in confidence intervals concern economically meaningful values of mobility and thus may lead to different conclusions when comparing mobility across different regions or countries.


title: A Joint Matrix Factorization Analysis of Multilingual Representations

abstract: We present an analysis tool based on joint matrix factorization for comparing latent representations of multilingual and monolingual models. An alternative to probing, this tool allows us to analyze multiple sets of representations in a joint manner. Using this tool, we study to what extent and how morphosyntactic features are reflected in the representations learned by multilingual pre-trained models. We conduct a large-scale empirical study of over 33 languages and 17 morphosyntactic categories. Our findings demonstrate variations in the encoding of morphosyntactic information across upper and lower layers, with category-specific differences influenced by language properties. Hierarchical clustering of the factorization outputs yields a tree structure that is related to phylogenetic trees manually crafted by linguists. Moreover, we find the factorization outputs exhibit strong associations with performance observed across different cross-lingual tasks. We release our code to facilitate future research.


title: Probing Luttinger Liquid Properties in Multichannel Two-Site Charge Kondo Simulator

abstract: We study the influence of many-body interactions on the transport properties in a two-site charge Kondo circuit recently implemented in a hybrid metal-semiconductor double-quantum dot device [W. Pouse {\it et al.}, Nat. Phys. {\bf 19}, 492 (2023)]. There emerge two principal types of interactions: (i) an intrinsic one, described by the Luttinger liquid model, and (ii) an induced one, which appears due to the coupling of the system to an Ohmic environment. Case (i) could be achieved if the charge Kondo circuit operates in the fractional quantum Hall regime, while case (ii) can be implemented via a finite number of open ballistic channels coupled to both the quantum dots. We demonstrate that the conductance scaling for the case of strong and weak interdot coupling is fully determined by the effective interaction parameter, which is the combination of the fractional filling factor $\nu=1/m$ and the number of transmitting channels. Furthermore, we predict that the fractional filling factor $\nu$ defines a universal Kondo scaling in the vicinity of a special triple quantum critical point featured by the emergence of a $\mathbb{Z}_3$ parafermion.


title: Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformation

abstract: Recent ubiquity and disruptive impacts of large language models (LLMs) have raised concerns about their potential to be misused (.i.e, generating large-scale harmful and misleading content). To combat this emerging risk of LLMs, we propose a novel "Fighting Fire with Fire" (F3) strategy that harnesses modern LLMs' generative and emergent reasoning capabilities to counter human-written and LLM-generated disinformation. First, we leverage GPT-3.5-turbo to synthesize authentic and deceptive LLM-generated content through paraphrase-based and perturbation-based prefix-style prompts, respectively. Second, we apply zero-shot in-context semantic reasoning techniques with cloze-style prompts to discern genuine from deceptive posts and news articles. In our extensive experiments, we observe GPT-3.5-turbo's zero-shot superiority for both in-distribution and out-of-distribution datasets, where GPT-3.5-turbo consistently achieved accuracy at 68-72%, unlike the decline observed in previous customized and fine-tuned disinformation detectors. Our codebase and dataset are available at https://github.com/mickeymst/F3.


title: Graph Attention-based Deep Reinforcement Learning for solving the Chinese Postman Problem with Load-dependent costs

abstract: Recently, Deep reinforcement learning (DRL) models have shown promising results in solving routing problems. However, most DRL solvers are commonly proposed to solve node routing problems, such as the Traveling Salesman Problem (TSP). Meanwhile, there has been limited research on applying neural methods to arc routing problems, such as the Chinese Postman Problem (CPP), since they often feature irregular and complex solution spaces compared to TSP. To fill these gaps, this paper proposes a novel DRL framework to address the CPP with load-dependent costs (CPP-LC) (Corberan et al., 2018), which is a complex arc routing problem with load constraints. The novelty of our method is two-fold. First, we formulate the CPP-LC as a Markov Decision Process (MDP) sequential model. Subsequently, we introduce an autoregressive model based on DRL, namely Arc-DRL, consisting of an encoder and decoder to address the CPP-LC challenge effectively. Such a framework allows the DRL model to work efficiently and scalably to arc routing problems. Furthermore, we propose a new bio-inspired meta-heuristic solution based on Evolutionary Algorithm (EA) for CPP-LC. Extensive experiments show that Arc-DRL outperforms existing meta-heuristic methods such as Iterative Local Search (ILS) and Variable Neighborhood Search (VNS) proposed by (Corberan et al., 2018) on large benchmark datasets for CPP-LC regarding both solution quality and running time; while the EA gives the best solution quality with much more running time. We release our C++ implementations for metaheuristics such as EA, ILS and VNS along with the code for data generation and our generated data at https://github.com/HySonLab/Chinese_Postman_Problem


title: MarkQA: A large scale KBQA dataset with numerical reasoning

abstract: While question answering over knowledge bases (KBQA) has shown progress in addressing factoid questions, KBQA with numerical reasoning remains relatively unexplored. In this paper, we focus on the complex numerical reasoning in KBQA and propose a new task, NR-KBQA, which necessitates the ability to perform both multi-hop reasoning and numerical reasoning. We design a logic form in Python format called PyQL to represent the reasoning process of numerical reasoning questions. To facilitate the development of NR-KBQA, we present a large dataset called MarkQA, which is automatically constructed from a small set of seeds. Each question in MarkQA is equipped with its corresponding SPARQL query, alongside the step-by-step reasoning process in the QDMR format and PyQL program. Experimental results of some state-of-the-art QA methods on the MarkQA show that complex numerical reasoning in KBQA faces great challenges.


title: Non-Fungible Token Security

abstract: Non-fungible tokens (NFTs) are unique digital assets stored on the blockchain and is used to certify ownership and authenticity of the digital asset. NFTs were first created in 2014 while their popularity peaked between 2021 and 2022. In this paper, the authors dive into the world of Non-Fungible Tokens (NFTs), their history, the Future of NFTs, as well as the security concerns.


title: Covert communication with Gaussian noise: from random access channel to point-to-point channel

abstract: We propose a covert communication protocol for the spread-spectrum multiple random access with additive white Gaussian noise (AWGN) channel. No existing paper has studied covert communication for the random access channel. Our protocol assumes binary discrete phase-shift keying (BPSK) modulation, and it works well under imperfect channel state information (I-CSI) for both the legitimate and adversary receivers, which is a realistic assumption in the low power regime. Also, our method assumes that the legitimate users share secret variables in a similar way as the preceding studies. Although several studies investigated the covert communication for the point-to-point communication, no existing paper considers the covert communication under the above uncertainty assumption even for point-to-point communication. Our protocol under the above uncertainty assumption allows O(n) legitimate senders and O(n/log n) active legitimate senders. Furthermore, our protocol can be converted to a protocol for point-to-point communication that works under the above uncertainty assumption.


title: Large-Time Behavior of the 2D Compressible Navier-Stokes System in Bounded Domains with Large Data and Vacuum

abstract: The large time behavior of the unique strong solution to the barotropic compressible Navier-Stokes system is studied with large external forces and initial data, where the shear viscosity is a positive constant and the bulk one is proportional to a power of the density. Some uniform estimates on the Lp-norm of the density are established, and then deduce that the density converges to its steady state in Lp-spaces, which transforms the large external force into a small one in some sense. Moreover, to deal with the obstacles brought by boundary, the conformal mapping and the pull back Green function are applied to give a point-wise representation of the effective viscous flux, and then make use of slip boundary conditions to cancel out the singularity.


title: Zr-Co-Al bulk metallic glass composites containing B2 ZrCo via rapid quenching and annealing

abstract: As a promising remedy for overcoming the limited ductility and work softening of bulk metallic glasses (BMGs), BMG composites incorporating a B2 crystalline phase have attracted considerable attention. Here, we explore the formation of Zr-Co-Al BMG composites by quenching alloys Zr$_{55}$Co$_{31}$Al$_{14}$, Zr$_{54.5}$Co$_{33.5}$Al$_{12}$, Zr$_{53.5}$Co$_{36.5}$Al$_{10}$, Zr$_{52.5}$Co$_{37.5}$Al$_{10}$, and Zr$_{43}$Co$_{43}$Al$_{14}$. We found the first alloy fully amorphous whereas the fifth was fully crystallized upon quenching. The other three were quenched to generate composite structures, with a higher fraction of B2 ZrCo phase with increasing Co/Zr ratio and decreasing Al content. For comparison, the formation of B2 ZrCo in annealed Zr$_{55}$Co$_{31}$Al$_{14}$ was also studied. For both approaches the influence of crystalline phases on hardness was examined.


title: Optimization of quantum noise in space gravitational-wave antenna DECIGO with optical-spring quantum locking considering mixture of vacuum fluctuations in homodyne detection

abstract: Quantum locking using optical spring and homodyne detection has been devised to reduce quantum noise that limits the sensitivity of DECIGO, a space-based gravitational wave antenna in the frequency band around 0.1 Hz for detection of primordial gravitational waves. The reduction in the upper limit of energy density ${\Omega}_{\mathrm{GW}}$ from $2{\times}10^{-15}$ to $1{\times}10^{-16}$, as inferred from recent observations, necessitates improved sensitivity in DECIGO to meet its primary science goals. To accurately evaluate the effectiveness of this method, this paper considers a detection mechanism that takes into account the influence of vacuum fluctuations on homodyne detection. In addition, an advanced signal processing method is devised to efficiently utilize signals from each photodetector, and design parameters for this configuration are optimized for the quantum noise. Our results show that this method is effective in reducing quantum noise, despite the detrimental impact of vacuum fluctuations on its sensitivity.


title: Generative and Contrastive Paradigms Are Complementary for Graph Self-Supervised Learning

abstract: For graph self-supervised learning (GSSL), masked autoencoder (MAE) follows the generative paradigm and learns to reconstruct masked graph edges or node features. Contrastive Learning (CL) maximizes the similarity between augmented views of the same graph and is widely used for GSSL. However, MAE and CL are considered separately in existing works for GSSL. We observe that the MAE and CL paradigms are complementary and propose the graph contrastive masked autoencoder (GCMAE) framework to unify them. Specifically, by focusing on local edges or node features, MAE cannot capture global information of the graph and is sensitive to particular edges and features. On the contrary, CL excels in extracting global information because it considers the relation between graphs. As such, we equip GCMAE with an MAE branch and a CL branch, and the two branches share a common encoder, which allows the MAE branch to exploit the global information extracted by the CL branch. To force GCMAE to capture global graph structures, we train it to reconstruct the entire adjacency matrix instead of only the masked edges as in existing works. Moreover, a discrimination loss is proposed for feature reconstruction, which improves the disparity between node embeddings rather than reducing the reconstruction error to tackle the feature smoothing problem of MAE. We evaluate GCMAE on four popular graph tasks (i.e., node classification, node clustering, link prediction, and graph classification) and compare with 14 state-of-the-art baselines. The results show that GCMAE consistently provides good accuracy across these tasks, and the maximum accuracy improvement is up to 3.2% compared with the best-performing baseline.


title: On the Inherent Privacy Properties of Discrete Denoising Diffusion Models

abstract: Privacy concerns have led to a surge in the creation of synthetic datasets, with diffusion models emerging as a promising avenue. Although prior studies have performed empirical evaluations on these models, there has been a gap in providing a mathematical characterization of their privacy-preserving capabilities. To address this, we present the pioneering theoretical exploration of the privacy preservation inherent in discrete diffusion models (DDMs) for discrete dataset generation. Focusing on per-instance differential privacy (pDP), our framework elucidates the potential privacy leakage for each data point in a given training dataset, offering insights into how the privacy loss of each point correlates with the dataset's distribution. Our bounds also show that training with $s$-sized data points leads to a surge in privacy leakage from $(\epsilon, O(\frac{1}{s^2\epsilon}))$-pDP to $(\epsilon, O(\frac{1}{s\epsilon}))$-pDP of the DDM during the transition from the pure noise to the synthetic clean data phase, and a faster decay in diffusion coefficients amplifies the privacy guarantee. Finally, we empirically verify our theoretical findings on both synthetic and real-world datasets.


title: Optimization of process parameters in additive manufacturing based on the finite element method

abstract: A design optimization framework for process parameters of additive manufacturing based on finite element simulation is proposed. The finite element method uses a coupled thermomechanical model developed for fused deposition modeling from the authors' previous work. Both gradient-based and gradient-free optimization methods are proposed. The gradient-based approach, which solves a PDE-constrained optimization problem, requires sensitivities computed from the fully discretized finite element model. We show the derivation of the sensitivities and apply them in a projected gradient descent algorithm. For the gradient-free approach, we propose two distinct algorithms: a local search algorithm called the method of local variations and a Bayesian optimization algorithm using Gaussian processes. To illustrate the effectiveness and differences of the methods, we provide two-dimensional design optimization examples using all three proposed algorithms.


title: Privacy Amplification for Matrix Mechanisms

abstract: Privacy amplification exploits randomness in data selection to provide tighter differential privacy (DP) guarantees. This analysis is key to DP-SGD's success in machine learning, but, is not readily applicable to the newer state-of-the-art algorithms. This is because these algorithms, known as DP-FTRL, use the matrix mechanism to add correlated noise instead of independent noise as in DP-SGD. In this paper, we propose "MMCC", the first algorithm to analyze privacy amplification via sampling for any generic matrix mechanism. MMCC is nearly tight in that it approaches a lower bound as $\epsilon\to0$. To analyze correlated outputs in MMCC, we prove that they can be analyzed as if they were independent, by conditioning them on prior outputs. Our "conditional composition theorem" has broad utility: we use it to show that the noise added to binary-tree-DP-FTRL can asymptotically match the noise added to DP-SGD with amplification. Our amplification algorithm also has practical empirical utility: we show it leads to significant improvement in the privacy-utility trade-offs for DP-FTRL algorithms on standard benchmarks.


title: Algebraic Sunflowers

abstract: We study sunflowers within the context of finitely generated substructures of ultrahomogeneous structures. In particular, we look at bounds on how large a set system is needed to guarantee the existence of sunflowers of a given size. We show that if we fix the size of the sunflower, the function which takes the size of the substructures in our set system and outputs the size of a set system needed to guarantee a sunflower of the desired size can grow arbitrarily slowly.


title: Spectral density in a Moszynski's class of Jacobi matrices. Spectral phase transition of 2nd type

abstract: In this paper it is considered a spectral density for a class of Jacobi matrices with absolutely continuous spectrum that was examined first by Moszynski. It is shown that the corresponding spectral density is equivalent to the positive continuous function everywhere except the point $x=0$. In the point $x=0$ the spectral density may be finite as well as essentially infinite depending on the parameter. So in this class we discover an example of 2nd type spectral phase transition.


title: Symmetric Strategies for Multi-Access IoT Network Optimization: A Common Information Approach

abstract: In the context of IoT deployments, a multitude of devices concurrently require network access to transmit data over a shared communication channel. Employing symmetric strategies can effectively facilitate the collaborative use of the communication medium among these devices. By adopting such strategies, devices collectively optimize their transmission parameters, resulting in minimized collisions and enhanced overall network throughput. Our primary focus centers on the formulation of symmetric (i.e., identical) strategies for the sensors, aiming to optimize a finite horizon team objective. The imposition of symmetric strategies introduces novel facets and complexities into the team problem. To address this, we embrace the common information approach and adapt it to accommodate the use of symmetric strategies. This adaptation yields a dynamic programming framework grounded in common information, wherein each step entails the minimization of a single function mapping from an agent's private information space to the space of probability distributions over possible actions. Our proposed policy/method incurs a reduced cumulative cost compared to other methods employing symmetric strategies, a point substantiated by our simulation results.


title: Constraining exotic dark matter models with the dark ages 21-cm signal

abstract: The dark ages 21-cm signal is a powerful tool for precision cosmology and probing new physics. We study two non-standard models: an excess radio background (ERB) model (possibly generated by dark matter decay) and the millicharged dark matter (mDM) model. These models were inspired by the possible EDGES detection of a strong global 21-cm absorption during cosmic dawn, but more generally they provide a way to anticipate the potential discovery space. During the dark ages the 21-cm global signal in the ERB model reaches a saturated form for an amplitude $A_{\rm r}=0.4$, where $A_{\rm r}$ is the radio background intensity at cosmic dawn relative to the cosmic microwave background. This amplitude is one-fifth of the minimum required to explain the EDGES signal, and corresponds to just 0.1% of the observed extragalactic background; it would give a signal that can be detected at 5.9$\sigma$ significance (compared to $4.1\,\sigma$ for the standard signal) and can be distinguished from the standard (no ERB) signal at $8.5\,\sigma$, all with a 1,000 hr global signal measurement. The 21-cm power spectrum has potentially more information, but far greater resources would be required for comparable constraints. For the mDM model, over a range of viable parameters, the global signal detection significance would be $4.7-7.2\,\sigma$, and it could be distinguished from the standard at $2.2-9.3\,\sigma$. With an array of global signal antennas achieving an effective 100,000 hr integration, the significance would be $10\,\times$ better. Our analysis helps motivate the development of lunar and space-based dark ages experiments.


title: Small Systle Sets and Coxeter Groups

abstract: The systoles of a hyperbolic surface {\Sigma} are the shortest closed geodesics. We say that the systoles fill the surface if the set Syst({\Sigma}) of all systoles cuts {\Sigma} into polygons. We refine an idea of Schmutz [15] to construct closed hyperbolic surfaces {\Sigma} of arbitrarily large genus with a small set Syst({\Sigma}) that fills. In fact, for the surfaces {\Sigma} considered, the cardinality of Syst({\Sigma}) is in o(g/ ln g), where g is the genus of {\Sigma}. The proof is based on the theory Coxeter groups, combined with some elementary number theory.


title: Role of sea quarks in the nucleon transverse spin

abstract: We present a phenomenological extraction of transversity distribution functions and Collins fragmentation functions by simultaneously fitting to semi-inclusive deep inelastic scattering and electron-positron annihilation data. The analysis is performed within the transverse momentum dependent factorization formalism, and sea quark transversity distributions are taken into account for the first time. We find the $\bar u$ quark favors a negative transversity distribution while that of the $\bar d$ quark is consistent with zero according to the current accuracy. In addition, based on a combined analysis of world data and simulated data, we quantitatively demonstrate the impact of the proposed Electron-ion Collider in China on precise determinations of the transversity distributions, especially for sea quarks, and the Collins fragmentation functions.


title: Learning with Noisy Labels Using Collaborative Sample Selection and Contrastive Semi-Supervised Learning

abstract: Learning with noisy labels (LNL) has been extensively studied, with existing approaches typically following a framework that alternates between clean sample selection and semi-supervised learning (SSL). However, this approach has a limitation: the clean set selected by the Deep Neural Network (DNN) classifier, trained through self-training, inevitably contains noisy samples. This mixture of clean and noisy samples leads to misguidance in DNN training during SSL, resulting in impaired generalization performance due to confirmation bias caused by error accumulation in sample selection. To address this issue, we propose a method called Collaborative Sample Selection (CSS), which leverages the large-scale pre-trained model CLIP. CSS aims to remove the mixed noisy samples from the identified clean set. We achieve this by training a 2-Dimensional Gaussian Mixture Model (2D-GMM) that combines the probabilities from CLIP with the predictions from the DNN classifier. To further enhance the adaptation of CLIP to LNL, we introduce a co-training mechanism with a contrastive loss in semi-supervised learning. This allows us to jointly train the prompt of CLIP and the DNN classifier, resulting in improved feature representation, boosted classification performance of DNNs, and reciprocal benefits to our Collaborative Sample Selection. By incorporating auxiliary information from CLIP and utilizing prompt fine-tuning, we effectively eliminate noisy samples from the clean set and mitigate confirmation bias during training. Experimental results on multiple benchmark datasets demonstrate the effectiveness of our proposed method in comparison with the state-of-the-art approaches.


title: On the Origin of the Variety of Velocity Dispersion Profiles of Galaxies

abstract: Observed and simulated galaxies exhibit a significant variation in their velocity dispersion profiles. We examine the inner and outer slopes of stellar velocity dispersion profiles using integral field spectroscopy data from two surveys, SAMI (for $z < 0.115$) and CALIFA (for $z < 0.03$), comparing them with results from two cosmological hydrodynamic simulations: Horizon-AGN (for $z = 0.017$) and NewHorizon (for $z\lesssim1$). The simulated galaxies closely reproduce the variety of velocity dispersion slopes and stellar mass dependence of both inner and outer radii ($0.5\,r_{50}$ and $3\,r_{50}$) as observed, where $r_{50}$ stands for half-light radius. The inner slopes are mainly influenced by the relative radial distribution of the young and old stars formed in-situ: a younger center shows a flatter inner profile. The presence of accreted (ex-situ) stars has two effects on the velocity dispersion profiles. First, because they are more dispersed in spatial and velocity distributions compared to in-situ formed stars, it increases the outer slope of the velocity dispersion profile. It also causes the velocity anisotropy to be more radial. More massive galaxies have a higher fraction of stars formed ex-situ and hence show a higher slope in outer velocity dispersion profile and a higher degree of radial anisotropy. The diversity in the outer velocity dispersion profiles reflects the diverse assembly histories among galaxies.


title: Integrable (3+1)-dimensional generalization for dispersionless Davey--Stewartson system

abstract: This paper introduces a (3+1)-dimensional dispersionless integrable system, utilizing a Lax pair involving contact vector fields, in alignment with methodologies presented by A. Sergyeyev in 2018. Significantly, it is shown that the proposed system serves as an integrable (3+1)-dimensional generalization of the well-studied (2+1)-dimensional dispersionless Davey-Stewartson system. This way, an interesting new example on integrability in higher dimensions is presented, with potential applications in modern mathematical physics. The work lays the foundation for future research into symmetries, conservation laws, and Hamiltonian structures, offering avenues for further exploration.


title: Non-smoothness of the fundamental solutions for Schr\"{o}dinger equations with super-quadratic and spherically symmetric potential

abstract: We study non-smoothness of the fundamental solution for the Schr\"{o}dinger equation with a spherically symmetric and super-quadratic potential in the sence that $V(x)\geq C|x|^{2+\varepsilon}$ at infinity with constants $C>0 $ and $\varepsilon>0$. More precisely, we show the fundamental solution $E(t,x,y)$ does not belong to $C^{1}$ as a function of $(t,x,y)$.


title: Kronecker coefficients for (dual) symmetric inverse semigroups

abstract: We study analogues of Kronecker coefficients for symmetric inverse semigroups, for dual symmetric inverse semigroups and for the inverse semigroups of bijections between subquotients of finite sets. In all cases we reduce the problem of determination of such coefficients to some group-theoretic and combinatorial problems. For symmetric inverse semigroups, we provide an explicit formula in terms of the classical Kronecker and Littlewood--Richardson coefficients for symmetric groups.


title: The three way Dirac operator and dynamical Turing and Dirac induced patterns on nodes and links

abstract: Topological signals are dynamical variables not only defined on nodes but also on links of a network that are gaining significant attention in non-linear dynamics and topology and have important applications in brain dynamics. Here we show that topological signals on nodes and links of a network can generate dynamical patterns when coupled together. In particular, dynamical patterns require at least three topological signals, here taken to be two node signals and one link signal. In order to couple these signals, we formulate the 3-way topological Dirac operator that generalizes previous definitions of the 2-way and 4-way topological Dirac operators. We characterize the spectral properties of the 3-way Dirac operator and we investigate the dynamical properties of the resulting Turing and Dirac induced patterns. Here we emphasize the distinct dynamical properties of the Dirac induced patterns which involve topological signals only coupled by the 3-way topological Dirac operator in absence of the Hodge-Laplacian coupling. While the observed Turing patterns generalize the Turing patterns typically investigated on networks, the Dirac induced patterns have no equivalence within the framework of node based Turing patterns. These results open new scenarios in the study of Turing patterns with possible application to neuroscience and more generally to the study of emergent patterns in complex systems.

categories: nlin.PS cond-mat.dis-nn cond-mat.stat-mech math-ph math.MP nlin.AO