title: Generative Lifting of Multiview to 3D from Unknown Pose: Wrapping NeRF inside Diffusion

abstract: We cast multiview reconstruction from unknown pose as a generative modeling problem. From a collection of unannotated 2D images of a scene, our approach simultaneously learns both a network to predict camera pose from 2D image input, as well as the parameters of a Neural Radiance Field (NeRF) for the 3D scene. To drive learning, we wrap both the pose prediction network and NeRF inside a Denoising Diffusion Probabilistic Model (DDPM) and train the system via the standard denoising objective. Our framework requires the system accomplish the task of denoising an input 2D image by predicting its pose and rendering the NeRF from that pose. Learning to denoise thus forces the system to concurrently learn the underlying 3D NeRF representation and a mapping from images to camera extrinsic parameters. To facilitate the latter, we design a custom network architecture to represent pose as a distribution, granting implicit capacity for discovering view correspondences when trained end-to-end for denoising alone. This technique allows our system to successfully build NeRFs, without pose knowledge, for challenging scenes where competing methods fail. At the conclusion of training, our learned NeRF can be extracted and used as a 3D scene model; our full system can be used to sample novel camera poses and generate novel-view images.


title: RWKV-CLIP: A Robust Vision-Language Representation Learner

abstract: Contrastive Language-Image Pre-training (CLIP) has significantly improved performance in various vision-language tasks by expanding the dataset with image-text pairs obtained from websites. This paper further explores CLIP from the perspectives of data and model architecture. To address the prevalence of noisy data and enhance the quality of large-scale image-text data crawled from the internet, we introduce a diverse description generation framework that can leverage Large Language Models (LLMs) to synthesize and refine content from web-based texts, synthetic captions, and detection tags. Furthermore, we propose RWKV-CLIP, the first RWKV-driven vision-language representation learning model that combines the effective parallel training of transformers with the efficient inference of RNNs. Comprehensive experiments across various model scales and pre-training datasets demonstrate that RWKV-CLIP is a robust and efficient vision-language representation learner, it achieves state-of-the-art performance in several downstream tasks, including linear probe, zero-shot classification, and zero-shot image-text retrieval. To facilitate future research, the code and pre-trained models are released at https://github.com/deepglint/RWKV-CLIP


title: Constructions, bounds, and algorithms for peaceable queens

abstract: The peaceable queens problem asks to determine the maximum number $a(n)$ such that there is a placement of $a(n)$ white queens and $a(n)$ black queens on an $n \times n$ chessboard so that no queen can capture any queen of the opposite color. In this paper, we consider the peaceable queens problem and its variant on the toroidal board. For the toroidal board, we provide new upper and lower bounds. Somewhat surprisingly, our bounds show that there is a sharp contrast in behaviour between the odd torus and the even torus. Our lower bounds are given by explicit constructions. For the upper bounds, we formulate the problem as a quadratic optimization problem with at most $70$ variables, regardless of the size of the board. We solve our quadratic program exactly using modern optimization software. Our method is quite robust. For example, with very minor changes, it also provides upper bounds for the regular board. In particular, we show that $a(n) \leq 0.1641n^2$, for all $n$. This improves on the bound $a(n) \leq 0.25n^2$ of van Bommel and MacEachern. We also provide a local search algorithm and a software implementation which converges very rapidly to solutions which appear optimal. Our algorithm is sufficiently robust that it works on both the classical and toroidal boards. For example, for the classical board, the algorithm quickly finds the so-called Ainley construction. Thus, our work provides some further evidence that the Ainley construction is indeed optimal.


title: TraceMesh: Scalable and Streaming Sampling for Distributed Traces

abstract: Distributed tracing serves as a fundamental element in the monitoring of cloud-based and datacenter systems. It provides visibility into the full lifecycle of a request or operation across multiple services, which is essential for understanding system dependencies and performance bottlenecks. To mitigate computational and storage overheads, most tracing frameworks adopt a uniform sampling strategy, which inevitably captures overlapping and redundant information. More advanced methods employ learning-based approaches to bias the sampling toward more informative traces. However, existing methods fall short of considering the high-dimensional and dynamic nature of trace data, which is essential for the production deployment of trace sampling. To address these practical challenges, in this paper we present TraceMesh, a scalable and streaming sampler for distributed traces. TraceMesh employs Locality-Sensitivity Hashing (LSH) to improve sampling efficiency by projecting traces into a low-dimensional space while preserving their similarity. In this process, TraceMesh accommodates previously unseen trace features in a unified and streamlined way. Subsequently, TraceMesh samples traces through evolving clustering, which dynamically adjusts the sampling decision to avoid over-sampling of recurring traces. The proposed method is evaluated with trace data collected from both open-source microservice benchmarks and production service systems. Experimental results demonstrate that TraceMesh outperforms state-of-the-art methods by a significant margin in both sampling accuracy and efficiency.


title: Discrete Dictionary-based Decomposition Layer for Structured Representation Learning

abstract: Neuro-symbolic neural networks have been extensively studied to integrate symbolic operations with neural networks, thereby improving systematic generalization. Specifically, Tensor Product Representation (TPR) framework enables neural networks to perform differentiable symbolic operations by encoding the symbolic structure of data within vector spaces. However, TPR-based neural networks often struggle to decompose unseen data into structured TPR representations, undermining their symbolic operations. To address this decomposition problem, we propose a Discrete Dictionary-based Decomposition (D3) layer designed to enhance the decomposition capabilities of TPR-based models. D3 employs discrete, learnable key-value dictionaries trained to capture symbolic features essential for decomposition operations. It leverages the prior knowledge acquired during training to generate structured TPR representations by mapping input data to pre-learned symbolic features within these dictionaries. D3 is a straightforward drop-in layer that can be seamlessly integrated into any TPR-based model without modifications. Our experimental results demonstrate that D3 significantly improves the systematic generalization of various TPR-based models while requiring fewer additional parameters. Notably, D3 outperforms baseline models on the synthetic task that demands the systematic decomposition of unseen combinatorial data.


title: Cross-domain-aware Worker Selection with Training for Crowdsourced Annotation

abstract: Annotation through crowdsourcing draws incremental attention, which relies on an effective selection scheme given a pool of workers. Existing methods propose to select workers based on their performance on tasks with ground truth, while two important points are missed. 1) The historical performances of workers in other tasks. In real-world scenarios, workers need to solve a new task whose correlation with previous tasks is not well-known before the training, which is called cross-domain. 2) The dynamic worker performance as workers will learn from the ground truth. In this paper, we consider both factors in designing an allocation scheme named cross-domain-aware worker selection with training approach. Our approach proposes two estimation modules to both statistically analyze the cross-domain correlation and simulate the learning gain of workers dynamically. A framework with a theoretical analysis of the worker elimination process is given. To validate the effectiveness of our methods, we collect two novel real-world datasets and generate synthetic datasets. The experiment results show that our method outperforms the baselines on both real-world and synthetic datasets.


title: Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillation

abstract: We propose Hydra-MDP, a novel paradigm employing multiple teachers in a teacher-student model. This approach uses knowledge distillation from both human and rule-based teachers to train the student model, which features a multi-head decoder to learn diverse trajectory candidates tailored to various evaluation metrics. With the knowledge of rule-based teachers, Hydra-MDP learns how the environment influences the planning in an end-to-end manner instead of resorting to non-differentiable post-processing. This method achieves the $1^{st}$ place in the Navsim challenge, demonstrating significant improvements in generalization across diverse driving environments and conditions. Code will be available at \url{https://github.com/NVlabs/Hydra-MDP}.


title: AudioMarkBench: Benchmarking Robustness of Audio Watermarking

abstract: The increasing realism of synthetic speech, driven by advancements in text-to-speech models, raises ethical concerns regarding impersonation and disinformation. Audio watermarking offers a promising solution via embedding human-imperceptible watermarks into AI-generated audios. However, the robustness of audio watermarking against common/adversarial perturbations remains understudied. We present AudioMarkBench, the first systematic benchmark for evaluating the robustness of audio watermarking against watermark removal and watermark forgery. AudioMarkBench includes a new dataset created from Common-Voice across languages, biological sexes, and ages, 3 state-of-the-art watermarking methods, and 15 types of perturbations. We benchmark the robustness of these methods against the perturbations in no-box, black-box, and white-box settings. Our findings highlight the vulnerabilities of current watermarking techniques and emphasize the need for more robust and fair audio watermarking solutions. Our dataset and code are publicly available at \url{https://github.com/moyangkuo/AudioMarkBench}.


title: Sensitivity Analysis for the Test-Negative Design

abstract: The test-negative design has become popular for evaluating the effectiveness of post-licensure vaccines using observational data. In addition to its logistical convenience on data collection, the design is also believed to control for the differential health-care-seeking behavior between vaccinated and unvaccinated individuals, which is an important while often unmeasured confounder between the vaccination and infection. Hence, the design has been employed routinely to monitor seasonal flu vaccines and more recently to measure the COVID-19 vaccine effectiveness. Despite its popularity, the design has been questioned, in particular about its ability to fully control for the unmeasured confounding. In this paper, we explore deviations from a perfect test-negative design, and propose various sensitivity analysis methods for estimating the effect of vaccination measured by the causal odds ratio on the subpopulation of individuals with good health-care-seeking behavior. We start with point identification of the causal odds ratio under a test-negative design, considering two forms of assumptions on the unmeasured confounder. These assumptions then lead to two approaches for conducting sensitivity analysis, addressing the influence of the unmeasured confounding in different ways. Specifically, one approach investigates partial control for unmeasured confounder in the test-negative design, while the other examines the impact of unmeasured confounder on both vaccination and infection. Furthermore, these approaches can be combined to provide narrower bounds on the true causal odds ratio, and can be further extended to sharpen the bounds by restricting the treatment effect heterogeneity. Finally, we apply the proposed methods to evaluate the effectiveness of COVID-19 vaccines using observational data from test-negative designs.


title: Half Heusler alloy CoVSn as self-supported electrocatalyst for hydrogen evolution reaction

abstract: Despite significant advancements in electrocatalysis for clean hydrogen fuel generation, the transition from concept to commercialization faces challenges due to the instability of electrocatalysts. This study delves into the exploration of a structurally and mechanically robust half-Heusler alloy, CoVSn, as an efficient electrocatalyst for hydrogen production. The synthesis of CoVSn was achieved using the arc-melting technique and optimized successfully into a cubic structure - a previously unattained and highly challenging feat. The resulting electrode, cut from the obtained CoVSn pellet, served as a self-supported electrocatalyst and initially generates a current density of 10 mA cm-2 at an overpotential of 244 mV. Remarkably, this overpotential decreased uniquely over time, reaches 202 mV after a durability testing of 12 hours, while maintaining its crystal structure integrity after the electrocatalysis process. This progressive enhancement in catalytic activity and structural stability underscores the significance of this research. The synergistic effect between Co and V atoms as pivotal active centers for hydrogen generation was evident, further enhanced by formation of high valance metal sites Co2O3 and V2O3 during the hydrogen evolution reaction. In essence, this study confirms the stability and promise of CoVSn in hydrogen generation, paving the way for exploring additional self-supported ternary intermetallics to enhance water-splitting efficiency.


title: Open Packing in Graphs: Bounds and Complexity

abstract: Given a graph $G(V,E)$, a vertex subset S of G is called an open packing in G if no pair of distinct vertices in S have a common neighbour in G. The size of a largest open packing in G is called the open packing number of G and is denoted by $\rho^o(G)$. It would be interesting to note that the open packing number is a lower bound for the total domination number in graphs with no isolated vertices [Henning and Slater, 1999]. Given a graph G and a positive integer k, the decision problem OPEN PACKING tests whether G has an open packing of size at least k. The optimization problem MAX-OPEN PACKING takes a graph G as input and finds the open packing number of G. It is known that OPEN PACKING is NP-complete on split graphs (i.e., the class of $\{2K_2,C_4,C_5\}$-free graphs) [Ramos et al., 2014]. In this work, we complete the study on the complexity (P vs NPC) of OPEN PACKING on H-free graphs for every graph H with at least three vertices by proving that OPEN PACKING is (i) NP-complete on $K_{1,3}$-free graphs and (ii) polynomial time solvable on $(P_4\cup rK_1)$-free graphs for every $r\geq 1$. In the course of proving (ii), we show that for every $t\in {2,3,4}$ and $r\geq 1$, if G is a $(P_t\cup rK_1)$-free graph, then $\rho^o(G)$ is bounded above by a linear function of r. Moreover, we show that OPEN PACKING parameterized by solution size is W[1]-complete on $K_{1,3}$-free graphs and MAX-OPEN PACKING is hard to approximate within a factor of $n^{(\frac{1}{2}-\delta)}$ for any $\delta>0$ on $K_{1,3}$-free graphs unless P=NP. Further, we prove that OPEN PACKING is (a) NP-complete on $K_{1,4}$-free split graphs and (b) polynomial time solvable on $K_{1,3}$-free split graphs. We prove a similar dichotomy result on split graphs with degree restrictions on the vertices in the independent set of the clique-independent set partition of the split graphs.


title: Secrecy Energy Efficiency Maximization in RIS-Aided Wireless Networks

abstract: This work proposes a provably convergent and low complexity optimization algorithm for the maximization of the secrecy energy efficiency in the uplink of a wireless network aided by a Reconfigurable Intelligent Surface (RIS), in the presence of an eavesdropper. The mobil users' transmit powers and the RIS reflection coefficients are optimized. Numerical results show the performance of the proposed methods and compare the use of active and nearly-passive RISs from an energy-efficient perspective.


title: On the H\"{o}lder Stability of Multiset and Graph Neural Networks

abstract: Famously, multiset neural networks based on sum-pooling can separate all distinct multisets, and as a result can be used by message passing neural networks (MPNNs) to separate all pairs of graphs that can be separated by the 1-WL graph isomorphism test. However, the quality of this separation may be very weak, to the extent that the embeddings of "separable" multisets and graphs might even be considered identical when using fixed finite precision. In this work, we propose to fully analyze the separation quality of multiset models and MPNNs via a novel adaptation of Lipschitz and H\"{o}lder continuity to parametric functions. We prove that common sum-based models are lower-H\"{o}lder continuous, with a H\"{o}lder exponent that decays rapidly with the network's depth. Our analysis leads to adversarial examples of graphs which can be separated by three 1-WL iterations, but cannot be separated in practice by standard maximally powerful MPNNs. To remedy this, we propose two novel MPNNs with improved separation quality, one of which is lower Lipschitz continuous. We show these MPNNs can easily classify our adversarial examples, and compare favorably with standard MPNNs on standard graph learning tasks.


title: pVACview: an interactive visualization tool for efficient neoantigen prioritization and selection

abstract: Neoantigen targeting therapies including personalized vaccines have shown promise in the treatment of cancers. Accurate identification/prioritization of neoantigens is highly relevant to designing clinical trials, predicting treatment response, and understanding mechanisms of resistance. With the advent of massively parallel sequencing technologies, it is now possible to predict neoantigens based on patient-specific variant information. However, numerous factors must be considered when prioritizing neoantigens for use in personalized therapies. Complexities such as alternative transcript annotations, various binding, presentation and immunogenicity prediction algorithms, and variable peptide lengths/registers all potentially impact the neoantigen selection process. While computational tools generate numerous algorithmic predictions for neoantigen characterization, results from these pipelines are difficult to navigate and require extensive knowledge of the underlying tools for accurate interpretation. Due to the intricate nature and number of salient neoantigen features, presenting all relevant information to facilitate candidate selection for downstream applications is a difficult challenge that current tools fail to address. We have created pVACview, the first interactive tool designed to aid in the prioritization and selection of neoantigen candidates for personalized neoantigen therapies. pVACview has a user-friendly and intuitive interface where users can upload, explore, select and export their neoantigen candidates. The tool allows users to visualize candidates using variant, transcript and peptide information. pVACview will allow researchers to analyze and prioritize neoantigen candidates with greater efficiency and accuracy in basic and translational settings. The application is available as part of the pVACtools pipeline at pvactools.org and as an online server at pvacview.org.


title: DNN Partitioning, Task Offloading, and Resource Allocation in Dynamic Vehicular Networks: A Lyapunov-Guided Diffusion-Based Reinforcement Learning Approach

abstract: The rapid advancement of Artificial Intelligence (AI) has introduced Deep Neural Network (DNN)-based tasks to the ecosystem of vehicular networks. These tasks are often computation-intensive, requiring substantial computation resources, which are beyond the capability of a single vehicle. To address this challenge, Vehicular Edge Computing (VEC) has emerged as a solution, offering computing services for DNN-based tasks through resource pooling via Vehicle-to-Vehicle/Infrastructure (V2V/V2I) communications. In this paper, we formulate the problem of joint DNN partitioning, task offloading, and resource allocation in VEC as a dynamic long-term optimization. Our objective is to minimize the DNN-based task completion time while guaranteeing the system stability over time. To this end, we first leverage a Lyapunov optimization technique to decouple the original long-term optimization with stability constraints into a per-slot deterministic problem. Afterwards, we propose a Multi-Agent Diffusion-based Deep Reinforcement Learning (MAD2RL) algorithm, incorporating the innovative use of diffusion models to determine the optimal DNN partitioning and task offloading decisions. Furthermore, we integrate convex optimization techniques into MAD2RL as a subroutine to allocate computation resources, enhancing the learning efficiency. Through simulations under real-world movement traces of vehicles, we demonstrate the superior performance of our proposed algorithm compared to existing benchmark solutions.


title: Position Paper: Technical Research and Talent is Needed for Effective AI Governance

abstract: In light of recent advancements in AI capabilities and the increasingly widespread integration of AI systems into society, governments worldwide are actively seeking to mitigate the potential harms and risks associated with these technologies through regulation and other governance tools. However, there exist significant gaps between governance aspirations and the current state of the technical tooling necessary for their realisation. In this position paper, we survey policy documents published by public-sector institutions in the EU, US, and China to highlight specific areas of disconnect between the technical requirements necessary for enacting proposed policy actions, and the current technical state of the art. Our analysis motivates a call for tighter integration of the AI/ML research community within AI governance in order to i) catalyse technical research aimed at bridging the gap between current and supposed technical underpinnings of regulatory action, as well as ii) increase the level of technical expertise within governing institutions so as to inform and guide effective governance of AI.


title: AC False Data Injection Attacks in Power Systems: Design and Optimization

abstract: False Data Injection (FDI) attacks are one of the challenges that the modern power system, as a cyber-physical system, is encountering. Designing AC FDI attacks that accurately address the physics of the power systems could jeopardize the security of power systems as they can easily bypass the traditional Bad Data Detection (BDD) algorithm. Knowing the essence of the AC FDI attack and how they can be designed gives insight about detecting the system again these attacks. Moreover, recognition of the nature of these attacks, especially when they are designed optimally, is essential for benchmarking various defensive approaches to increase the resilience of power systems. This paper presents a unified approach to demonstrate the process of designing optimal AC FDI attack. In this connection, we first define the process of designing an AC-based FDI attack that satisfies AC power flow equations. We then formulate an optimization problem to design an optimal AC FDI attack that both satisfies AC power flow equations and overloads a specific line in the system. The objective function is defined to optimize the magnitude of the attack vector in such a way that it can evade residue-based BDD approaches. The proposed approach for designing AC FDI attacks is applied to the IEEE 118-bus test case system. Various comparisons are conducted to elaborate on the impact of optimally designing AC FDI attacks on the residual for the AC state estimation algorithm. Comparing the results of optimal and non-optimal AC FDI attacks demonstrates the impact on the difficulty of detecting FDI attacks and the importance of optimally designing these attacks.


title: Regularized quantum motion in a bounded set: Hilbertian aspects

abstract: It is known that the momentum operator canonically conjugated to the position operator for a particle moving in some bounded interval of the line {(with Dirichlet boundary conditions) is not essentially self-adjoint}: it has a continuous set of self-adjoint extensions. We prove that essential self-adjointness can be recovered by symmetrically weighting the momentum operator with a positive bounded function approximating the indicator function of the considered interval. This weighted momentum operator is consistently obtained from a similarly weighted classical momentum through the so-called Weyl-Heisenberg covariant integral quantization of functions or distributions.


title: Privacy-Utility Tradeoff Based on $\alpha$-lift

abstract: Information density and its exponential form, known as lift, play a central role in information privacy leakage measures. $\alpha$-lift is the power-mean of lift, which is tunable between the worst-case measure max-lift ($\alpha=\infty$) and more relaxed versions ($\alpha<\infty$). This paper investigates the optimization problem of the privacy-utility tradeoff (PUT) where $\alpha$-lift and mutual information are privacy and utility measures, respectively. Due to the nonlinear nature of $\alpha$-lift for $\alpha<\infty$, finding the optimal solution is challenging. Therefore, we propose a heuristic algorithm to estimate the optimal utility for each value of $\alpha$, inspired by the optimal solution for $\alpha=\infty$ and the convexity of $\alpha$-lift with respect to the lift, which we prove. The numerical results show the efficacy of the algorithm and indicate the effective range of $\alpha$ and privacy budget $\varepsilon$ with good PUT performance.


title: Rational Delsarte designs and Galois fusions of association schemes

abstract: Delsarte theory, more specifically the study of codes and designs in association schemes, has proved invaluable in studying an increasing assortment of association schemes in recent years. Tools motivated by the study of error-correcting codes in the Hamming scheme and combinatorial $t$-designs in the Johnson scheme apply equally well in association schemes with irrational eigenvalues. We assume here that we have a commutative association scheme with irrational eigenvalues and wish to study its Delsarte $T$-designs. We explore when a $T$-design is also a $T'$-design where $T'\supseteq T$ is controlled by the orbits of a Galois group related to the splitting field of the association scheme. We then study Delsarte designs in the association schemes of finite groups, with a detailed exploration of the dicyclic groups.


title: Scaling up masked audio encoder learning for general audio classification

abstract: Despite progress in audio classification, a generalization gap remains between speech and other sound domains, such as environmental sounds and music. Models trained for speech tasks often fail to perform well on environmental or musical audio tasks, and vice versa. While self-supervised (SSL) audio representations offer an alternative, there has been limited exploration of scaling both model and dataset sizes for SSL-based general audio classification. We introduce Dasheng, a simple SSL audio encoder, based on the efficient masked autoencoder framework. Trained with 1.2 billion parameters on 272,356 hours of diverse audio, Dasheng obtains significant performance gains on the HEAR benchmark. It outperforms previous works on CREMA-D, LibriCount, Speech Commands, VoxLingua, and competes well in music and environment classification. Dasheng features inherently contain rich speech, music, and environmental information, as shown in nearest-neighbor classification experiments. Code is available https://github.com/richermans/dasheng/.


title: Spectrum of the molecular hexaquarks

abstract: We investigate the mass spectra of molecular-type hexaquark states in the dibaryon systems. These systems are composed of the charmed baryons $[\Sigma_c^{(\ast)}$, $\Xi_c^{(\prime,\ast)}]$, doubly charmed baryons $[\Xi_{cc}^{(\ast)}]$, and hyperons $[\Sigma^{(\ast)}$, $\Xi^{(\ast)}]$. We consider all possible combinations of particle-particle and particle-antiparticle pairs, including the S-wave spin multiplets in each combination. We establish the underlying connections among the molecular tetraquarks, pentaquarks, and hexaquarks with the effective quark-level interactions. We find that the existence of molecular states in $DD^\ast$, $D\bar{D}^\ast$, and $\Sigma_c\bar{D}^{(\ast)}$ systems leads to the emergence of a large number of deuteron-like hexaquarks in the heavy flavor sectors. Currently, there have been several experimental candidates for molecular tetraquarks and pentaquarks. The experimental search for near-threshold hexaquarks will further advance the establishment of the underlying dynamical picture of hadronic molecules and deepen our understanding of the role of spin-flavor symmetry in near-threshold residual strong interactions.


title: Strong Gr\"obner bases and linear algebra in multivariate polynomial rings over Euclidean domains

abstract: We provide a self-contained introduction to Gr\"obner bases of submodules of $R[x_1, \ldots, x_n]^k$, where $R$ is a Euclidean domain, and explain how to use these bases to solve linear systems over $R[x_1, \ldots, x_n]$.


title: HPC Alongside User-space Kubernetes

abstract: High performance computing (HPC) and cloud have traditionally been separate, and presented in an adversarial light. The conflict arises from disparate beginnings that led to two drastically different cultures, incentive structures, and communities that are now in direct competition with one another for resources, talent, and speed of innovation. With the emergence of converged computing, a new paradigm of computing has entered the space that advocates for bringing together the best of both worlds from a technological and cultural standpoint. This movement has emerged due to economic and practical needs. Emerging heterogeneous, complex scientific workloads that require an orchestration of services, simulation, and reaction to state can no longer be served by traditional HPC paradigms. However, while cloud offers automation, portability, and orchestration, as it stands now it cannot deliver the network performance, fine-grained resource mapping, or scalability that these same simulations require. These novel requirements call for change not just in workflow software or design, but also in the underlying infrastructure to support them. This is one of the goals of converged computing. While the future of traditional HPC and commercial cloud cannot be entirely known, a reasonable approach to take is one that focuses on new models of convergence, and a collaborative mindset. In this paper, we introduce a new paradigm for compute -- a traditional HPC workload manager, Flux Framework, running seamlessly with a user-space Kubernetes "Usernetes" to bring a service-oriented, modular, and portable architecture directly to on-premises HPC clusters. We present experiments that assess HPC application performance and networking between the environments, and provide a reproducible setup for the larger community to do exactly that.


title: Lorentz-violating extension of Wigner function formalism and chiral kinetic theory

abstract: The quantum kinetic equation for the gauge-invariant Wigner function, constructed from spinor fields that obey the Dirac equation modified by CPT and Lorentz symmetry-violating terms, is presented. The equations for the components of Wigner function in the Clifford algebra basis are accomplished. Focusing on the massless case, an extended semiclassical chiral kinetic theory in the presence of external electromagnetic fields is developed. We calculate the chiral currents and establish the anomalous magnetic and separation effects in a Lorentz-violating background. The chiral anomaly within the context of extended Quantum Electrodynamics is elucidated. Finally, we derive the semiclassical Lorentz-violating extended chiral transport equation.


title: On isometry groups of gradient Ricci solitons

abstract: We give a result estimating the dimension of the Lie algebra of Killing vector fields on an irreducible non-trivial gradient Ricci soliton. Then we study the structure of this manifold when the maximal dimension is attained. There are local and global implications.


title: Movable Antenna Enhanced NOMA Short-Packet Transmission

abstract: This letter investigates a short-packet downlink transmission system using non-orthogonal multiple access (NOMA) enhanced via movable antenna (MA). We focuses on maximizing the effective throughput for a core user while ensuring reliable communication for an edge user by optimizing the MAs' coordinates and the power and rate allocations from the access point (AP). The optimization challenge is approached by decomposing it into two subproblems, utilizing successive convex approximation (SCA) to handle the highly non-concave nature of channel gains. Numerical results confirm that the proposed solution offers substantial improvements in effective throughput compared to NOMA short-packet communication with fixed position antennas (FPAs).


title: Teaching with Uncertainty: Unleashing the Potential of Knowledge Distillation in Object Detection

abstract: Knowledge distillation (KD) is a widely adopted and effective method for compressing models in object detection tasks. Particularly, feature-based distillation methods have shown remarkable performance. Existing approaches often ignore the uncertainty in the teacher model's knowledge, which stems from data noise and imperfect training. This limits the student model's ability to learn latent knowledge, as it may overly rely on the teacher's imperfect guidance. In this paper, we propose a novel feature-based distillation paradigm with knowledge uncertainty for object detection, termed "Uncertainty Estimation-Discriminative Knowledge Extraction-Knowledge Transfer (UET)", which can seamlessly integrate with existing distillation methods. By leveraging the Monte Carlo dropout technique, we introduce knowledge uncertainty into the training process of the student model, facilitating deeper exploration of latent knowledge. Our method performs effectively during the KD process without requiring intricate structures or extensive computational resources. Extensive experiments validate the effectiveness of our proposed approach across various distillation strategies, detectors, and backbone architectures. Specifically, following our proposed paradigm, the existing FGD method achieves state-of-the-art (SoTA) performance, with ResNet50-based GFL achieving 44.1% mAP on the COCO dataset, surpassing the baselines by 3.9%.


title: Strong decays of the isovector-scalar $D^\ast\bar{D}^\ast$ hadronic molecule

abstract: We adopt the effective Lagrangian approach to study the strong decays of the $1^-(0^{++})$ $D^\ast\bar{D}^\ast$ molecular state [denoted as $T_{\psi0}^a(4010)$ according to the LHCb naming convention] through triangle diagrams. The decay channels include the open-charm $D\bar{D}$, and the hidden-charm $\eta_c\pi$, $J/\psi\rho$, and $\chi_{c1}\pi$. The coupling between the $T_{\psi0}^a(4010)$ and its constituents $D^\ast\bar{D}^\ast$ is obtained by solving for the residue of the scattering T-matrix at the pole. Our calculation yields a total width of $(12.0$$-$$35.4)$ MeV for the $T_{\psi0}^a(4010)$ state, with its main decay channels being $\eta_c\pi$ and $\chi_{c1}\pi$. The $X(4100)$ and $X(4050)$ have similar masses and widths, with both masses being close to the $D^\ast\bar{D}^\ast$ threshold. Additionally, their decay final states are consistent with those of the $T_{\psi0}^a(4010)$. Therefore, it is likely that they represent the same state and both potentially correspond to the $T_{\psi0}^a(4010)$. We suggest that future experiments focus on searching for the $T_{\psi0}^a(4010)$ signal in the final states $\eta_c\pi^-$, $\chi_{c1}\pi^-$ and $D^0D^-$ of the $B^0\to\eta_c\pi^-K^+$, $\chi_{c1}\pi^- K^+$ and $D^0D^-K^+$ processes, respectively, as well as further investigating its resonance parameters with Flatt\'e-like formula.


title: Mitigating Boundary Ambiguity and Inherent Bias for Text Classification in the Era of Large Language Models

abstract: Text classification is a crucial task encountered frequently in practical scenarios, yet it is still under-explored in the era of large language models (LLMs). This study shows that LLMs are vulnerable to changes in the number and arrangement of options in text classification. Our extensive empirical analyses reveal that the key bottleneck arises from ambiguous decision boundaries and inherent biases towards specific tokens and positions. To mitigate these issues, we make the first attempt and propose a novel two-stage classification framework for LLMs. Our approach is grounded in the empirical observation that pairwise comparisons can effectively alleviate boundary ambiguity and inherent bias. Specifically, we begin with a self-reduction technique to efficiently narrow down numerous options, which contributes to reduced decision space and a faster comparison process. Subsequently, pairwise contrastive comparisons are employed in a chain-of-thought manner to draw out nuances and distinguish confusable options, thus refining the ambiguous decision boundary. Extensive experiments on four datasets (Banking77, HWU64, LIU54, and Clinic150) verify the effectiveness of our framework. Furthermore, benefitting from our framework, various LLMs can achieve consistent improvements. Our code and data are available in \url{https://github.com/Chuge0335/PC-CoT}.


title: Atmospheric Centers of Action: current features and expected changes from simulations with CMIP5 and CMIP6 models

abstract: The results of an analysis of changes in the characteristics of atmospheric centers of action (ACAs) in the Northern (NH) and Southern (SH) hemispheres using results of simulations with the CMIP5 and CMIP6 ensembles of climate models are presented. The ability of models to simulate ACA features is estimated for the historical scenario in comparison with ERA5 reanalysis data. The projected changes are evaluated under RCP8.5 and SSP5-8.5 scenarios for CMIP5 and CMIP6 models, respectively. The ACA intensity is evaluated that defined as the difference in sea level pressure averaged over the ACA region and the entire hemisphere. In NH, reanalysis and models show greater intensity of subtropical oceanic anticyclonic ACAs in summer than in winter. The opposite is found for the intensity of NH subpolar oceanic cyclonic ACAs. The interannual variability of the ACA intensity in winter is generally greater than in summer. In SH, the season with greater intensity of oceanic anticyclonic and cyclonic ACAs and its interannual variability varies from ocean to ocean. CMIP5 and CMIP6 models show substantial changes of ACAs characteristics in the XXI century. More significant trends in the strengthening of ACAs in the 21st century appear in the SH, especially in the winter seasons. The most consistent weakening trends are found over continents for winter North American maximum and the summer Asian minimum. For the winter Siberian maximum, the weakening trend is found more pronounced in CMIP6 models than in CMIP5.


title: GraphCoder: Enhancing Repository-Level Code Completion via Code Context Graph-based Retrieval and Language Model

abstract: The performance of repository-level code completion depends upon the effective leverage of both general and repository-specific knowledge. Despite the impressive capability of code LLMs in general code completion tasks, they often exhibit less satisfactory performance on repository-level completion due to the lack of repository-specific knowledge in these LLMs. To address this problem, we propose GraphCoder, a retrieval-augmented code completion framework that leverages LLMs' general code knowledge and the repository-specific knowledge via a graph-based retrieval-generation process. In particular, GraphCoder captures the context of completion target more accurately through code context graph (CCG) that consists of control-flow, data- and control-dependence between code statements, a more structured way to capture the completion target context than the sequence-based context used in existing retrieval-augmented approaches; based on CCG, GraphCoder further employs a coarse-to-fine retrieval process to locate context-similar code snippets with the completion target from the current repository. Experimental results demonstrate both the effectiveness and efficiency of GraphCoder: Compared to baseline retrieval-augmented methods, GraphCoder achieves higher exact match (EM) on average, with increases of +6.06 in code match and +6.23 in identifier match, while using less time and space.


title: The asymptotic Plancherel formula and Lusztig's asymptotic algebra for $\tilde{\mathsf{A}}_n$

abstract: The aim of this paper is to give a new explicit construction of Lusztig's asymptotic algebra in affine type $\mathsf{A}$. To do so, we construct a balanced system of cell modules, prove an asymptotic version of the Plancherel Theorem and develop a relative version of the Satake Isomorphism for each two-sided Kazhdan-Lusztig cell.


title: DecoR: Deconfounding Time Series with Robust Regression

abstract: Causal inference on time series data is a challenging problem, especially in the presence of unobserved confounders. This work focuses on estimating the causal effect between two time series, which are confounded by a third, unobserved time series. Assuming spectral sparsity of the confounder, we show how in the frequency domain this problem can be framed as an adversarial outlier problem. We introduce Deconfounding by Robust regression (DecoR), a novel approach that estimates the causal effect using robust linear regression in the frequency domain. Considering two different robust regression techniques, we first improve existing bounds on the estimation error for such techniques. Crucially, our results do not require distributional assumptions on the covariates. We can therefore use them in time series settings. Applying these results to DecoR, we prove, under suitable assumptions, upper bounds for the estimation error of DecoR that imply consistency. We show DecoR's effectiveness through experiments on synthetic data. Our experiments furthermore suggest that our method is robust with respect to model misspecification.


title: MIPI 2024 Challenge on Few-shot RAW Image Denoising: Methods and Results

abstract: The increasing demand for computational photography and imaging on mobile platforms has led to the widespread development and integration of advanced image sensors with novel algorithms in camera systems. However, the scarcity of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). Building on the achievements of the previous MIPI Workshops held at ECCV 2022 and CVPR 2023, we introduce our third MIPI challenge including three tracks focusing on novel image sensors and imaging algorithms. In this paper, we summarize and review the Few-shot RAW Image Denoising track on MIPI 2024. In total, 165 participants were successfully registered, and 7 teams submitted results in the final testing phase. The developed solutions in this challenge achieved state-of-the-art erformance on Few-shot RAW Image Denoising. More details of this challenge and the link to the dataset can be found at https://mipichallenge.org/MIPI2024.


title: Crayon: Customized On-Device LLM via Instant Adapter Blending and Edge-Server Hybrid Inference

abstract: The customization of large language models (LLMs) for user-specified tasks gets important. However, maintaining all the customized LLMs on cloud servers incurs substantial memory and computational overheads, and uploading user data can also lead to privacy concerns. On-device LLMs can offer a promising solution by mitigating these issues. Yet, the performance of on-device LLMs is inherently constrained by the limitations of small-scaled models. To overcome these restrictions, we first propose Crayon, a novel approach for on-device LLM customization. Crayon begins by constructing a pool of diverse base adapters, and then we instantly blend them into a customized adapter without extra training. In addition, we develop a device-server hybrid inference strategy, which deftly allocates more demanding queries or non-customized tasks to a larger, more capable LLM on a server. This ensures optimal performance without sacrificing the benefits of on-device customization. We carefully craft a novel benchmark from multiple question-answer datasets, and show the efficacy of our method in the LLM customization.


title: Eye-for-an-eye: Appearance Transfer with Semantic Correspondence in Diffusion Models

abstract: As pretrained text-to-image diffusion models have become a useful tool for image synthesis, people want to specify the results in various ways. In this paper, we introduce a method to produce results with the same structure of a target image but painted with colors from a reference image, i.e., appearance transfer, especially following the semantic correspondence between the result and the reference. E.g., the result wing takes color from the reference wing, not the reference head. Existing methods rely on the query-key similarity within self-attention layer, usually producing defective results. To this end, we propose to find semantic correspondences and explicitly rearrange the features according to the semantic correspondences. Extensive experiments show the superiority of our method in various aspects: preserving the structure of the target and reflecting the color from the reference according to the semantic correspondences, even when the two images are not aligned.


title: Topological phase transition in fluctuating imaginary gauge fields

abstract: We investigate the exact solvability and point-gap topological phase transitions in non-Hermitian lattice models. These models incorporate site-dependent nonreciprocal hoppings $J e^{\pm g_n}$, facilitated by a spatially fluctuating imaginary gauge field $ig_n \hat~x$ that disrupts translational symmetry. By employing suitable imaginary gauge transformations, it is revealed that a lattice characterized by any given $g_n$ is spectrally equivalent to a lattice devoid of fields, under open boundary conditions. Furthermore, a system with closed boundaries can be simplified to a spectrally equivalent lattice featuring a uniform mean field $i\bar{g}\hat~x$. This framework offers a comprehensive method for analytically predicting spectral topological invariance and associated boundary localization phenomena for bond-disordered nonperiodic lattices. These predictions are made by analyzing gauge-transformed isospectral periodic lattices. Notably, for a lattice with quasiperiodic $g_n= \ln |\lambda \cos 2\pi \alpha n|$ and an irrational $\alpha$, a previously unknown topological phase transition is unveiled. It is observed that the topological spectral index $W$ assumes values of $-N$ or $+N$, leading to all $N$ open-boundary eigenstates localizing either at the right or left edge, solely dependent on the strength of the gauge field, where $\lambda<2$ or $\lambda>2$. A phase transition is identified at the critical point $\lambda\approx2$, at which all eigenstates undergo delocalization. The theory has been shown to be relevant for long-range hopping models and for higher dimensions.


title: Entropy and thermodynamical stability of white dwarfs

abstract: A structure of spherical white dwarfs is calculated for a non-zero temperature. It is shown that the thermodynamical stability of the white dwarf stars can be described naturally within the concept of the Helmholtz free energy of the Coulomb fully ionized electron-ion plasma.


title: Breaking Free: Efficient Multi-Party Private Set Union Without Non-Collusion Assumptions

abstract: Multi-party private set union (MPSU) protocol enables $m$ $(m > 2)$ parties, each holding a set, to collectively compute the union of their sets without revealing any additional information to other parties. There are two main categories of MPSU protocols: The first builds on public-key techniques. All existing works in this category involve a super-linear number of public-key operations, resulting in poor practical efficiency. The second builds on oblivious transfer and symmetric-key techniques. The only existing work in this category is proposed by Liu and Gao (ASIACRYPT 2023), which features the best concrete performance among all existing protocols, despite its super-linear computation and communication. Unfortunately, it does not achieve the standard semi-honest security, as it inherently relies on a non-collusion assumption, which is unlikely to hold in practice. Therefore, the problem of constructing a practical MPSU protocol based on oblivious transfer and symmetric-key techniques in standard semi-honest model remains open. Furthermore, there is no MPSU protocol achieving both linear computation and linear communication complexity, which leaves another unresolved problem. In this work, we resolve these two open problems. We propose the first MPSU protocol based on oblivious transfer and symmetric-key techniques in the standard semi-honest model. This protocol is $4.9-9.3 \times$ faster than Liu and Gao in the LAN setting. Concretely, our protocol requires only $3.6$ seconds in online phase for 3 parties with sets of $2^{20}$ items each. We propose the first MPSU protocol achieving both linear computation and linear communication complexity, based on public-key operations. This protocol has the lowest overall communication costs and shows a factor of $3.0-36.5\times$ improvement in terms of overall communication compared to Liu and Gao.


title: Bridging Language Gaps in Audio-Text Retrieval

abstract: Audio-text retrieval is a challenging task, requiring the search for an audio clip or a text caption within a database. The predominant focus of existing research on English descriptions poses a limitation on the applicability of such models, given the abundance of non-English content in real-world data. To address these linguistic disparities, we propose a language enhancement (LE), using a multilingual text encoder (SONAR) to encode the text data with language-specific information. Additionally, we optimize the audio encoder through the application of consistent ensemble distillation (CED), enhancing support for variable-length audio-text retrieval. Our methodology excels in English audio-text retrieval, demonstrating state-of-the-art (SOTA) performance on commonly used datasets such as AudioCaps and Clotho. Simultaneously, the approach exhibits proficiency in retrieving content in seven other languages with only 10% of additional language-enhanced training data, yielding promising results. The source code is publicly available https://github.com/zyyan4/ml-clap.


title: Thermodynamic Relations between Free Energy and Mobility

abstract: Stochastic and dynamical processes lie at the heart of all physical, chemical, and biological systems. However, kinetic and thermodynamic properties which characterize these processes have largely been treated separately as they can be obtained independently for many systems at thermodynamic equilibrium. In this work we demonstrate the existence of a class of relations between kinetic and thermodynamic factors which holds even in the hydrodynamic limit, and which must be satisfied for all systems that satisfy detailed balance and Boltzmann distribution at equilibrium. We achieve this by proving that for systems with inhomogeneous equilibrium states governed by dynamics such as the Cahn-Hilliard (CH) dynamics, the chemical potential and self-diffusivity must mutually constrain each other. We discuss common issues in the literature which result in inconsistent formulations, construct the consistency requirement mathematically, develop a class of self-diffusivities that guarantee consistency, and discuss how the requirement originates from detailed balance and Boltzmann distribution, and is therefore applicable to both conserved and non-conserved dynamics.


title: Riemann's Auxiliary Function. Right limit of zeros

abstract: Numerical data suggest that the zeros $\rho$ of the auxiliary Riemann function in the upper half-plane satisfy $\mathop{\mathrm{Re}}(\rho)<1$. We show that this is true for those zeros with $\mathop{\mathrm{Im}}(\rho)> 3.9211\dots10^{65}$. We conjecture that this is true for all of them.


title: On symmetric plane quartic curves

abstract: In the present paper we study the geometry of plane quartics with large automorphism groups. We show results devoted to smooth plane quartics that are invariant under the action of the elementary abelian group of type $[2,2,2]$, and we study geometric properties of the smooth plane quartic having automorphism group of order $48$.


title: Delving into ChatGPT usage in academic writing through excess vocabulary

abstract: Recent large language models (LLMs) can generate and revise text with human-level performance, and have been widely commercialized in systems like ChatGPT. These models come with clear limitations: they can produce inaccurate information, reinforce existing biases, and be easily misused. Yet, many scientists have been using them to assist their scholarly writing. How wide-spread is LLM usage in the academic literature currently? To answer this question, we use an unbiased, large-scale approach, free from any assumptions on academic LLM usage. We study vocabulary changes in 14 million PubMed abstracts from 2010-2024, and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. Our analysis based on excess words usage suggests that at least 10% of 2024 abstracts were processed with LLMs. This lower bound differed across disciplines, countries, and journals, and was as high as 30% for some PubMed sub-corpora. We show that the appearance of LLM-based writing assistants has had an unprecedented impact in the scientific literature, surpassing the effect of major world events such as the Covid pandemic.


title: MoreauPruner: Robust Pruning of Large Language Models against Weight Perturbations

abstract: Few-shot gradient methods have been extensively utilized in existing model pruning methods, where the model weights are regarded as static values and the effects of potential weight perturbations are not considered. However, the widely used large language models (LLMs) have several billion model parameters, which could increase the fragility of few-shot gradient pruning. In this work, we experimentally show that one-shot gradient pruning algorithms could lead to unstable results under perturbations to model weights. And the minor error of switching between data formats bfloat16 and float16 could result in drastically different outcomes. To address such instabilities, we leverage optimization analysis and propose an LLM structural pruning method, called MoreauPruner, with provable robustness against weight perturbations. In MoreauPruner, the model weight importance is estimated based on the neural network's Moreau envelope, which can be flexibly combined with $\ell_1$-norm regularization techniques to induce the sparsity required in the pruning task. We extensively evaluate the MoreauPruner algorithm on several well-known LLMs, including LLaMA-7B, LLaMA-13B, LLaMA3-8B, and Vicuna-7B. Our numerical results suggest the robustness of MoreauPruner against weight perturbations, and indicate the MoreauPruner's successful accuracy-based scores in comparison to several existing pruning methods. We have released the code in \url{https://github.com/ShiningSord/MoreauPruner}.


title: Study of $\pi$, K, and p production in high multiplicity pp collisions at $\sqrt{s}$ = 13 TeV with ALICE at the LHC

abstract: High multiplicity proton-proton and proton-lead collisions at LHC energies exhibit similar signatures to those observed in Pb-Pb collisions (i.e. the strangeness enhancement, the ridge behaviours etc.), that were commonly attributed to the formation of the Quark-Gluon Plasma. In this contribution, the measurements of $\pi$, K, and p transverse momentum spectra in the rapidity region |y| < 0.5 for various multiplicity classes in pp, p-Pb and A-A collisions with the ALICE detector at the LHC will be presented. Various results, including the integrated particle yields and particle ratios as a function of charged particle multiplicity for different systems and energies, will be discussed.


title: Edge Metric Dimension of Silicate Networks

abstract: Metric dimension is an essential parameter in graph theory that aids in addressing issues pertaining to information retrieval, localization, network design, and chemistry through the identification of the least possible number of elements necessary to identify the distances between vertices in a graph uniquely. A variant of metric dimension, called the edge metric dimension focuses on distinguishing the edges in a graph $G$, with a vertex subset. The minimum possible number of vertices in such a set is denoted as $\dim_E(G)$. This paper presents the precise edge metric dimension of silicate networks.


title: Learning Discrete Latent Variable Structures with Tensor Rank Conditions

abstract: Unobserved discrete data are ubiquitous in many scientific disciplines, and how to learn the causal structure of these latent variables is crucial for uncovering data patterns. Most studies focus on the linear latent variable model or impose strict constraints on latent structures, which fail to address cases in discrete data involving non-linear relationships or complex latent structures. To achieve this, we explore a tensor rank condition on contingency tables for an observed variable set $\mathbf{X}_p$, showing that the rank is determined by the minimum support of a specific conditional set (not necessary in $\mathbf{X}_p$) that d-separates all variables in $\mathbf{X}_p$. By this, one can locate the latent variable through probing the rank on different observed variables set, and further identify the latent causal structure under some structure assumptions. We present the corresponding identification algorithm and conduct simulated experiments to verify the effectiveness of our method. In general, our results elegantly extend the identification boundary for causal discovery with discrete latent variables and expand the application scope of causal discovery with latent variables.


title: A Tool for Test Case Scenarios Generation Using Large Language Models

abstract: Large Language Models (LLMs) are widely used in Software Engineering (SE) for various tasks, including generating code, designing and documenting software, adding code comments, reviewing code, and writing test scripts. However, creating test scripts or automating test cases demands test suite documentation that comprehensively covers functional requirements. Such documentation must enable thorough testing within a constrained scope and timeframe, particularly as requirements and user demands evolve. This article centers on generating user requirements as epics and high-level user stories and crafting test case scenarios based on these stories. It introduces a web-based software tool that employs an LLM-based agent and prompt engineering to automate the generation of test case scenarios against user requirements.


title: The Gaia-ESO Survey: No sign of multiple stellar populations in open clusters from their sodium and oxygen abundances

abstract: Context: The light element (anti-)correlations shown by globular clusters (GCs) are the main spectroscopic signature of multiple stellar populations. These internal abundance variations provide us with fundamental constraints on the formation mechanism of stellar clusters. Aims: Using Gaia-ESO, the largest and most homogeneous survey of open clusters (OCs), we intend to check whether these stellar aggregates display the same patterns. Based on previous studies of many GCs, several young and massive clusters in the Magellanic Clouds, as well as a few OCs, we do not expect to find any anti-correlation, given the low mass of Milky Way OCs. Methods: We used the results based on UVES spectra of stars in Gaia-ESO to derive the distribution of Na and O abundances and seevwhether they show an unexplained dispersion or whether they are anti-correlated. By selecting only high-probability members with high-precision stellar parameters, we ended up with more than 700 stars in 74 OCs. We examined the O-Na distribution in 28 OCsvwith at least 4 stars available as well as the Na distribution in 24 OCs, with at least 10 stars available. Results: We find that the distribution of Na abundances is compatible with a single-value population, within the errors. The fewvapparent exceptions can be explained by differences in the evolutionary phase (main sequence and giant post first dredge-up episode) or by difficulties in analysing low gravity giants. We did not find any indication of an Na-O anti-correlation in any of the clusters for which O has been derived. Conclusions: Based on the very small spread we find, OCs maintain the status of single stellar populations. However, a definitive answer requires studying more elements and larger samples covering different evolutionary phases. This will be possible with the next generation of large surveys


title: LiSD: An Efficient Multi-Task Learning Framework for LiDAR Segmentation and Detection

abstract: With the rapid proliferation of autonomous driving, there has been a heightened focus on the research of lidar-based 3D semantic segmentation and object detection methodologies, aiming to ensure the safety of traffic participants. In recent decades, learning-based approaches have emerged, demonstrating remarkable performance gains in comparison to conventional algorithms. However, the segmentation and detection tasks have traditionally been examined in isolation to achieve the best precision. To this end, we propose an efficient multi-task learning framework named LiSD which can address both segmentation and detection tasks, aiming to optimize the overall performance. Our proposed LiSD is a voxel-based encoder-decoder framework that contains a hierarchical feature collaboration module and a holistic information aggregation module. Different integration methods are adopted to keep sparsity in segmentation while densifying features for query initialization in detection. Besides, cross-task information is utilized in an instance-aware refinement module to obtain more accurate predictions. Experimental results on the nuScenes dataset and Waymo Open Dataset demonstrate the effectiveness of our proposed model. It is worth noting that LiSD achieves the state-of-the-art performance of 83.3% mIoU on the nuScenes segmentation benchmark for lidar-only methods.


title: Plant-and-Steal: Truthful Fair Allocations via Predictions

abstract: We study truthful mechanisms for approximating the Maximin-Share (MMS) allocation of agents with additive valuations for indivisible goods. Algorithmically, constant factor approximations exist for the problem for any number of agents. When adding incentives to the mix, a jarring result by Amanatidis, Birmpas, Christodoulou, and Markakis [EC 2017] shows that the best possible approximation for two agents and $m$ items is $\lfloor \frac{m}{2} \rfloor$. We adopt a learning-augmented framework to investigate what is possible when some prediction on the input is given. For two agents, we give a truthful mechanism that takes agents' ordering over items as prediction. When the prediction is accurate, we give a $2$-approximation to the MMS (consistency), and when the prediction is off, we still get an $\lceil \frac{m}{2} \rceil$-approximation to the MMS (robustness). We further show that the mechanism's performance degrades gracefully in the number of ``mistakes" in the prediction; i.e., we interpolate (up to constant factors) between the two extremes: when there are no mistakes, and when there is a maximum number of mistakes. We also show an impossibility result on the obtainable consistency for mechanisms with finite robustness. For the general case of $n\ge 2$ agents, we give a 2-approximation mechanism for accurate predictions, with relaxed fallback guarantees. Finally, we give experimental results which illustrate when different components of our framework, made to insure consistency and robustness, come into play.


title: Entropy-Reinforced Planning with Large Language Models for Drug Discovery

abstract: The objective of drug discovery is to identify chemical compounds that possess specific pharmaceutical properties toward a binding target. Existing large language models (LLMS) can achieve high token matching scores in terms of likelihood for molecule generation. However, relying solely on LLM decoding often results in the generation of molecules that are either invalid due to a single misused token, or suboptimal due to unbalanced exploration and exploitation as a consequence of the LLMs prior experience. Here we propose ERP, Entropy-Reinforced Planning for Transformer Decoding, which employs an entropy-reinforced planning algorithm to enhance the Transformer decoding process and strike a balance between exploitation and exploration. ERP aims to achieve improvements in multiple properties compared to direct sampling from the Transformer. We evaluated ERP on the SARS-CoV-2 virus (3CLPro) and human cancer cell target protein (RTCB) benchmarks and demonstrated that, in both benchmarks, ERP consistently outperforms the current state-of-the-art algorithm by 1-5 percent, and baselines by 5-10 percent, respectively. Moreover, such improvement is robust across Transformer models trained with different objectives. Finally, to further illustrate the capabilities of ERP, we tested our algorithm on three code generation benchmarks and outperformed the current state-of-the-art approach as well. Our code is publicly available at: https://github.com/xuefeng-cs/ERP.


title: Majority Dynamics and Internal Partitions of Random Regular Graphs: Experimental Results

abstract: This paper focuses on Majority Dynamics in sparse graphs, in particular, as a tool to study internal cuts. It is known that, in Majority Dynamics on a finite graph, each vertex eventually either comes to a fixed state, or oscillates with period two. The empirical evidence acquired by simulations suggests that for random odd-regular graphs, approximately half of the vertices end up oscillating with high probability. We notice a local symmetry between oscillating and non-oscillating vertices, that potentially can explain why the fraction of the oscillating vertices is concentrated around $\frac{1}{2}$. In our simulations, we observe that the parts of random odd-regular graph under Majority Dynamics with high probability do not contain $\lceil \frac{d}{2} \rceil$-cores at any timestep, and thus, one cannot use Majority Dynamics to prove that internal cuts exist in odd-regular graphs almost surely. However, we suggest a modification of Majority Dynamics, that yields parts with desired cores with high probability.


title: Inverse melting and re-entrant transformations of the vortex lattice in amorphous Re6Zr thin film

abstract: Melting of a solid is one of the most ubiquitous phenomena observed in nature. Most solids, when heated, melt from a crystalline state to an isotropic liquid at a characteristic temperature. There are however situations where increase in temperature can induce a transition to a more ordered state. Broadly termed as "inverse melting", experimental realisations of such situations are rare. Here, we report such a phenomenon in the 2-dimensional vortex liquid that forms in a moderately pinned amorphous Re6Zr (a-ReZr) thin film, from direct imaging of the vortex lattice using a scanning tunnelling microscope. At low temperature and magnetic fields, we find that the vortices form a "pinned liquid" , that is characterised by a low mobility of the vortices and vortex density that is spatially inhomogeneous. As the temperature or magnetic field is increased the vortices become more ordered, eventually forming a nearly perfectly ordered vortex lattice. Above this temperature/magnetic field, the ordered vortex lattice melts again into a vortex liquid. This re-entrant transformation from a liquid to solid-like state and then back to a liquid also leaves distinct signature in the magnetotransport properties of the superconductor.


title: Heterogeneous Learning Rate Scheduling for Neural Architecture Search on Long-Tailed Datasets

abstract: In this paper, we attempt to address the challenge of applying Neural Architecture Search (NAS) algorithms, specifically the Differentiable Architecture Search (DARTS), to long-tailed datasets where class distribution is highly imbalanced. We observe that traditional re-sampling and re-weighting techniques, which are effective in standard classification tasks, lead to performance degradation when combined with DARTS. To mitigate this, we propose a novel adaptive learning rate scheduling strategy tailored for the architecture parameters of DARTS when integrated with the Bilateral Branch Network (BBN) for handling imbalanced datasets. Our approach dynamically adjusts the learning rate of the architecture parameters based on the training epoch, preventing the disruption of well-trained representations in the later stages of training. Additionally, we explore the impact of branch mixing factors on the algorithm's performance. Through extensive experiments on the CIFAR-10 dataset with an artificially induced long-tailed distribution, we demonstrate that our method achieves comparable accuracy to using DARTS alone. And the experiment results suggest that re-sampling methods inherently harm the performance of the DARTS algorithm. Our findings highlight the importance of careful data augment when applying DNAS to imbalanced learning scenarios.


title: Fairness-Aware Meta-Learning via Nash Bargaining

abstract: To address issues of group-level fairness in machine learning, it is natural to adjust model parameters based on specific fairness objectives over a sensitive-attributed validation set. Such an adjustment procedure can be cast within a meta-learning framework. However, naive integration of fairness goals via meta-learning can cause hypergradient conflicts for subgroups, resulting in unstable convergence and compromising model performance and fairness. To navigate this issue, we frame the resolution of hypergradient conflicts as a multi-player cooperative bargaining game. We introduce a two-stage meta-learning framework in which the first stage involves the use of a Nash Bargaining Solution (NBS) to resolve hypergradient conflicts and steer the model toward the Pareto front, and the second stage optimizes with respect to specific fairness goals. Our method is supported by theoretical results, notably a proof of the NBS for gradient aggregation free from linear independence assumptions, a proof of Pareto improvement, and a proof of monotonic improvement in validation loss. We also show empirical effects across various fairness objectives in six key fairness datasets and two image classification tasks.


title: Exoplanets in reflected starlight with dual-field interferometry: A case for shorter wavelengths and a fifth Unit Telescope at VLTI/Paranal

abstract: The direct observation of cold and temperate planets within 1 to 10 AU would be extremely valuable for uncovering their atmospheric compositions but remains a formidable challenge with current astronomical methods. Ground-based optical interferometry, capable of high angular-resolution imaging, offers a promising avenue for studying these exoplanets, complementing space-based observations. Our objective is to explore the fundamental limits of dual-field interferometry and assess its potential for characterizing exoplanets in reflected light using the Very Large Telescope Interferometer (VLTI). We developed analytical expressions to describe the performance of dual-field interferometry and integrated these with simulations of atmospheric wavefronts corrected by extreme Adaptive Optics. An analytical solution for optimal phase apodization was formulated to enhance starlight rejection when injected into a single-mode fibre. This framework was applied to determine the detectability of known exoplanets in reflected light across various wavelength bands for both the current VLTI and a proposed extended version. Our results indicate that employing shorter wavelengths improves detectability, enabling at least seven Jupiter-mass exoplanets to be observed in the J band with current VLTI's baselines. Adding new baselines with lengths beyond 200 meters significantly enhances VLTI's capabilities, increasing the number of detectable exoplanets and revealing potential habitable zone candidates such as $\tau$ Ceti e and Proxima Centauri b. To substantially improve the VLTI's exoplanet characterization capabilities, we recommend developing instrumentation at wavelengths shorter than 1$\,\mu$m, as well as the addition of a fifth Unit Telescope (UT5).


title: Arbitrary-Order Distributed Finite-Time Differentiator for Multi-Agent Systems

abstract: This paper proposes arbitrary-order distributed finite-time differentiator (AODFD) for leader-follower multi-agent systems (MAS) under directed graph by only using relative or absolute output information. By using arbitrary-order distributed finite-time differentiator via relative output information (AODFD-R), each follower agent can obtain the relative output information between itself and leader and the relative output's arbitrary-order derivatives, where the information to be measured is only the local relative output information between each follower agent and its neighboring agents. As a simple extension of AODFD-R, the arbitrary-order distributed finite-time differentiator via absolute output information (AODFD-A) is also given. The finite-time stability of the closed-loop system under AODFD is proved by constructing a Lyapunov function skillfully. Finally, several simulation examples are given to verify the effectiveness of the AODFD.


title: RS-DFM: A Remote Sensing Distributed Foundation Model for Diverse Downstream Tasks

abstract: Remote sensing lightweight foundation models have achieved notable success in online perception within remote sensing. However, their capabilities are restricted to performing online inference solely based on their own observations and models, thus lacking a comprehensive understanding of large-scale remote sensing scenarios. To overcome this limitation, we propose a Remote Sensing Distributed Foundation Model (RS-DFM) based on generalized information mapping and interaction. This model can realize online collaborative perception across multiple platforms and various downstream tasks by mapping observations into a unified space and implementing a task-agnostic information interaction strategy. Specifically, we leverage the ground-based geometric prior of remote sensing oblique observations to transform the feature mapping from absolute depth estimation to relative depth estimation, thereby enhancing the model's ability to extract generalized features across diverse heights and perspectives. Additionally, we present a dual-branch information compression module to decouple high-frequency and low-frequency feature information, achieving feature-level compression while preserving essential task-agnostic details. In support of our research, we create a multi-task simulation dataset named AirCo-MultiTasks for multi-UAV collaborative observation. We also conduct extensive experiments, including 3D object detection, instance segmentation, and trajectory prediction. The numerous results demonstrate that our RS-DFM achieves state-of-the-art performance across various downstream tasks.


title: Solving the index problem for (curved) Bernstein-Gelfand-Gelfand sequences

abstract: We study the index theory of curved Bernstein-Gelfand-Gelfand (BGG) sequences in parabolic geometry and their role in $K$-homology and noncommutative geometry. The BGG-sequences fit into $K$-homology, and we solve their index problem. We provide a condition for when the BGG-complex on the flat parabolic geometry $G/P$ of a semisimple Lie group $G$ fits into $G$-equivariant $K$-homology by means of Heisenberg calculus. For higher rank Lie groups, we prove a no-go theorem showing that the approach fails.


title: Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning

abstract: Multi-hop logical reasoning on knowledge graphs is a pivotal task in natural language processing, with numerous approaches aiming to answer First-Order Logic (FOL) queries. Recent geometry (e.g., box, cone) and probability (e.g., beta distribution)-based methodologies have effectively addressed complex FOL queries. However, a common challenge across these methods lies in determining accurate geometric bounds or probability parameters for these queries. The challenge arises because existing methods rely on linear sequential operations within their computation graphs, overlooking the logical structure of the query and the relation-induced information that can be gleaned from the relations of the query, which we call the context of the query. To address the problem, we propose a model-agnostic methodology that enhances the effectiveness of existing multi-hop logical reasoning approaches by fully integrating the context of the FOL query graph. Our approach distinctively discerns (1) the structural context inherent to the query structure and (2) the relation-induced context unique to each node in the query graph as delineated in the corresponding knowledge graph. This dual-context paradigm helps nodes within a query graph attain refined internal representations throughout the multi-hop reasoning steps. Through experiments on two datasets, our method consistently enhances the three multi-hop reasoning foundation models, achieving performance improvements of up to 19.5%. Our code is available at https://github.com/kjh9503/caqr.


title: Random centers of localization for random operators

abstract: We propose a new random process to construct the eigenvectors of some random operators which make a short and clean connection with the resolvent. In this process the center of localization has to be chosen randomly.


title: Paying More Attention to Source Context: Mitigating Unfaithful Translations from Large Language Model

abstract: Large language models (LLMs) have showcased impressive multilingual machine translation ability. However, unlike encoder-decoder style models, decoder-only LLMs lack an explicit alignment between source and target contexts. Analyzing contribution scores during generation processes revealed that LLMs can be biased towards previously generated tokens over corresponding source tokens, leading to unfaithful translations. To address this issue, we propose to encourage LLMs to pay more attention to the source context from both source and target perspectives in zeroshot prompting: 1) adjust source context attention weights; 2) suppress irrelevant target prefix influence; Additionally, we propose 3) avoiding over-reliance on the target prefix in instruction tuning. Experimental results from both human-collected unfaithfulness test sets focusing on LLM-generated unfaithful translations and general test sets, verify our methods' effectiveness across multiple language pairs. Further human evaluation shows our method's efficacy in reducing hallucinatory translations and facilitating faithful translation generation.


title: PanoSSC: Exploring Monocular Panoptic 3D Scene Reconstruction for Autonomous Driving

abstract: Vision-centric occupancy networks, which represent the surrounding environment with uniform voxels with semantics, have become a new trend for safe driving of camera-only autonomous driving perception systems, as they are able to detect obstacles regardless of their shape and occlusion. Modern occupancy networks mainly focus on reconstructing visible voxels from object surfaces with voxel-wise semantic prediction. Usually, they suffer from inconsistent predictions of one object and mixed predictions for adjacent objects. These confusions may harm the safety of downstream planning modules. To this end, we investigate panoptic segmentation on 3D voxel scenarios and propose an instance-aware occupancy network, PanoSSC. We predict foreground objects and backgrounds separately and merge both in post-processing. For foreground instance grouping, we propose a novel 3D instance mask decoder that can efficiently extract individual objects. we unify geometric reconstruction, 3D semantic segmentation, and 3D instance segmentation into PanoSSC framework and propose new metrics for evaluating panoptic voxels. Extensive experiments show that our method achieves competitive results on SemanticKITTI semantic scene completion benchmark.


title: A Multi-Scale Boltzmann Equation for Complex Systems of Neutral Gases across All Flow Regimes

abstract: A Multi-scale Boltzmann Equation (MBE) is found from the gas-kinetic theory and the direct modeling philosophy as a master equation for complex physical systems of neutral gases across all flow regimes, which locates between the continuum limit and the free-molecular limit, covering a vast range of applications such as hypersonic flows over aerospace crafts and delicate flows around MEMS. The most explicit characteristic of MBE is evolving the variable observation time in the expression, which distinguishes the MBE from the single-scale master or governing equation where a fixed scale is implied in the assumptions. The fundamental properties of MBE, such as the asymptotic property, are proved theoretically, while a concise numerical scheme is developed for MBE to demonstrate its validity by benchmark multi-scale problems.


title: Pluriclosed manifolds with parallel Bismut torsion

abstract: We present a complete classification of simply-connected pluriclosed manifolds with parallel Bismut torsion, extending previously known results in the literature. Consequently, we also establish a splitting theorem for compact manifolds that are both pluriclosed with parallel Bismut torsion and Calabi-Yau with torsion.


title: Learning EFSM Models with Registers in Guards

abstract: This paper presents an active inference method for Extended Finite State Machines, where inputs and outputs are parametrized, and transitions can be conditioned by guards involving input parameters and internal variables called registers. The method applies to (software) systems that cannot be reset, so it learns an EFSM model of the system on a single trace.


title: Integrating Domain Knowledge for handling Limited Data in Offline RL

abstract: With the ability to learn from static datasets, Offline Reinforcement Learning (RL) emerges as a compelling avenue for real-world applications. However, state-of-the-art offline RL algorithms perform sub-optimally when confronted with limited data confined to specific regions within the state space. The performance degradation is attributed to the inability of offline RL algorithms to learn appropriate actions for rare or unseen observations. This paper proposes a novel domain knowledge-based regularization technique and adaptively refines the initial domain knowledge to considerably boost performance in limited data with partially omitted states. The key insight is that the regularization term mitigates erroneous actions for sparse samples and unobserved states covered by domain knowledge. Empirical evaluations on standard discrete environment datasets demonstrate a substantial average performance increase of at least 27% compared to existing offline RL algorithms operating on limited data.


title: EFFOcc: A Minimal Baseline for EFficient Fusion-based 3D Occupancy Network

abstract: 3D occupancy prediction (Occ) is a rapidly rising challenging perception task in the field of autonomous driving which represents the driving scene as uniformly partitioned 3D voxel grids with semantics. Compared to 3D object detection, grid perception has great advantage of better recognizing irregularly shaped, unknown category, or partially occluded general objects. However, existing 3D occupancy networks (occnets) are both computationally heavy and label-hungry. In terms of model complexity, occnets are commonly composed of heavy Conv3D modules or transformers on the voxel level. In terms of label annotations requirements, occnets are supervised with large-scale expensive dense voxel labels. Model and data inefficiency, caused by excessive network parameters and label annotations requirement, severely hinder the onboard deployment of occnets. This paper proposes an efficient 3d occupancy network (EFFOcc), that targets the minimal network complexity and label requirement while achieving state-of-the-art accuracy. EFFOcc only uses simple 2D operators, and improves Occ accuracy to the state-of-the-art on multiple large-scale benchmarks: Occ3D-nuScenes, Occ3D-Waymo, and OpenOccupancy-nuScenes. On Occ3D-nuScenes benchmark, EFFOcc has only 18.4M parameters, and achieves 50.46 in terms of mean IoU (mIoU), to our knowledge, it is the occnet with minimal parameters compared with related occnets. Moreover, we propose a two-stage active learning strategy to reduce the requirements of labelled data. Active EFFOcc trained with 6\% labelled voxels achieves 47.19 mIoU, which is 95.7% fully supervised performance. The proposed EFFOcc also supports improved vision-only occupancy prediction with the aid of region-decomposed distillation. Code and demo videos will be available at https://github.com/synsin0/EFFOcc.


title: 1st Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video Segmentation

abstract: Motion Expression guided Video Segmentation (MeViS), as an emerging task, poses many new challenges to the field of referring video object segmentation (RVOS). In this technical report, we investigated and validated the effectiveness of static-dominant data and frame sampling on this challenging setting. Our solution achieves a J&F score of 0.5447 in the competition phase and ranks 1st in the MeViS track of the PVUW Challenge. The code is available at: https://github.com/Tapall-AI/MeViS_Track_Solution_2024.


title: On inertial Levenberg-Marquardt type methods for solving nonlinear ill-posed operator equations

abstract: In these notes we propose and analyze an inertial type method for obtaining stable approximate solutions to nonlinear ill-posed operator equations. The method is based on the Levenberg-Marquardt (LM) iteration. The main obtained results are: monotonicity and convergence for exact data, stability and semi-convergence for noisy data. Regarding numerical experiments we consider: i) a parameter identification problem in elliptic PDEs, ii) a parameter identification problem in machine learning; the computational efficiency of the proposed method is compared with canonical implementations of the LM method.


title: Research on High-precision Detection Technology for Un-derground Space Information Data

abstract: The quality of underground space information data has become a major problem endangering the safety of underground space. After research and analysis, we found that the current high accuracy information data remote detection methods are limited to the detection of overground spaces objects, and are not applicable to the detection of various information data in underground space. In this paper, we analyze the spectral properties of the fractional-order differential (FDO) operator, and establish mathematical model of remote transmission and high-precision detection of information data, which realizes the functions of high-precision and remote detection of information data. By fusing the information data to detect the mathematical model in a long distance and with high accuracy, A mathematical model has been established to improve the quality of underground spatial information data. Through the application in engineering practice, the effectiveness of this method in underground space information data detection is verified.


title: A non-vanishing conjecture for cotangent bundles on elliptic surfaces

abstract: In this paper, we prove the non-vanishing conjecture for cotangent bundles on isotrivial elliptic surfaces. Combined with the result by H\"{o}ring and Peternell, it completely solves the question for surfaces with Kodaira dimension at most $1$.


title: Photo-induced dynamics with continuous and discrete quantum baths

abstract: The ultrafast quantum dynamics of photophysical processes in complex molecules is an extremely challenging computational problem with a wide variety of fascinating applications in quantum chemistry and biology. Inspired by recent developments in open quantum systems, we introduce a pure-state unraveled hybrid-bath method that describes a continuous environment via a set of discrete, effective bosonic degrees of freedom using a Markovian embedding. Our method is capable of describing both, a continuous spectral density and sharp peaks embedded into it. Thereby, we overcome the limitations of previous methods, which either capture long-time memory effects using the unitary dynamics of a set of discrete vibrational modes or use memoryless Markovian environments employing a Lindblad or Redfield master equation. We benchmark our method against two paradigmatic problems from quantum chemistry and biology. We demonstrate that compared to unitary descriptions, a significantly smaller number of bosonic modes suffices to describe the excitonic dynamics accurately, yielding a computational speed-up of nearly an order of magnitude. Furthermore, we take into account explicitly the effect of a $\delta$-peak in the spectral density of a light-harvesting complex, demonstrating the strong impact of the long-time memory of the environment on the dynamics.


title: GPU-Accelerated Optimization-Based Collision Avoidance

abstract: This paper proposes a GPU-accelerated optimization framework for collision avoidance problems where the controlled objects and the obstacles can be modeled as the finite union of convex polyhedra. A novel collision avoidance constraint is proposed based on scale-based collision detection and the strong duality of convex optimization. Under this constraint, the high-dimensional non-convex optimization problems of collision avoidance can be decomposed into several low-dimensional quadratic programmings (QPs) following the paradigm of alternating direction method of multipliers (ADMM). Furthermore, these low-dimensional QPs can be solved parallel with GPUs, significantly reducing computational time. High-fidelity simulations are conducted to validate the proposed method's effectiveness and practicality.


title: GridPE: Unifying Positional Encoding in Transformers with a Grid Cell-Inspired Framework

abstract: Understanding spatial location and relationships is a fundamental capability for modern artificial intelligence systems. Insights from human spatial cognition provide valuable guidance in this domain. Recent neuroscientific discoveries have highlighted the role of grid cells as a fundamental neural component for spatial representation, including distance computation, path integration, and scale discernment. In this paper, we introduce a novel positional encoding scheme inspired by Fourier analysis and the latest findings in computational neuroscience regarding grid cells. Assuming that grid cells encode spatial position through a summation of Fourier basis functions, we demonstrate the translational invariance of the grid representation during inner product calculations. Additionally, we derive an optimal grid scale ratio for multi-dimensional Euclidean spaces based on principles of biological efficiency. Utilizing these computational principles, we have developed a **Grid**-cell inspired **Positional Encoding** technique, termed **GridPE**, for encoding locations within high-dimensional spaces. We integrated GridPE into the Pyramid Vision Transformer architecture. Our theoretical analysis shows that GridPE provides a unifying framework for positional encoding in arbitrary high-dimensional spaces. Experimental results demonstrate that GridPE significantly enhances the performance of transformers, underscoring the importance of incorporating neuroscientific insights into the design of artificial intelligence systems.


title: DualMamba: A Lightweight Spectral-Spatial Mamba-Convolution Network for Hyperspectral Image Classification

abstract: The effectiveness and efficiency of modeling complex spectral-spatial relations are both crucial for Hyperspectral image (HSI) classification. Most existing methods based on CNNs and transformers still suffer from heavy computational burdens and have room for improvement in capturing the global-local spectral-spatial feature representation. To this end, we propose a novel lightweight parallel design called lightweight dual-stream Mamba-convolution network (DualMamba) for HSI classification. Specifically, a parallel lightweight Mamba and CNN block are first developed to extract global and local spectral-spatial features. First, the cross-attention spectral-spatial Mamba module is proposed to leverage the global modeling of Mamba at linear complexity. Within this module, dynamic positional embedding is designed to enhance the spatial location information of visual sequences. The lightweight spectral/spatial Mamba blocks comprise an efficient scanning strategy and a lightweight Mamba design to efficiently extract global spectral-spatial features. And the cross-attention spectral-spatial fusion is designed to learn cross-correlation and fuse spectral-spatial features. Second, the lightweight spectral-spatial residual convolution module is proposed with lightweight spectral and spatial branches to extract local spectral-spatial features through residual learning. Finally, the adaptive global-local fusion is proposed to dynamically combine global Mamba features and local convolution features for a global-local spectral-spatial representation. Compared with state-of-the-art HSI classification methods, experimental results demonstrate that DualMamba achieves significant classification accuracy on three public HSI datasets and a superior reduction in model parameters and floating point operations (FLOPs).


title: Bayesian inference of nuclear incompressibility from proton elliptic flow in central Au+Au collisions at 400 MeV/nucleon

abstract: The incompressibility $K$ of symmetric nuclear matter (SNM) is inferred in a Bayesian analysis of proton elliptic flow in mid-central Au + Au collisions at $E = 400$ MeV/nucleon using a Gaussian process (GP) emulator of the isospin-dependent quantum molecular dynamics (IQMD) model for heavy-ion collisions, with or without considering the momentum dependence of single-nucleon potentials. Consistent but with smaller quantified uncertainties than previous results from forward modeling of the collective flow in heavy-ion collisions using IQMD, considering the momentum dependence of nucleon potentials, $K=191.3^{+3.7}_{-6.3}$ MeV at 68\% confidence level, indicating a very soft SNM equation of state, is inferred from the combined data of the rapidity and transverse momentum dependence of the proton elliptic flow in the Au+Au collisions considered. Ignoring the momentum dependence of single-nucleon potentials, the extracted value for $K$ is $234.7^{+14.6}_{-11.4}$ MeV, in agreement with its fiducial value derived from giant resonance studies.


title: MPSDynamics.jl: Tensor network simulations for finite-temperature (non-Markovian) open quantum system dynamics

abstract: The MPSDynamics.jl package provides an easy to use interface for performing open quantum systems simulations at zero and finite temperatures. The package has been developed with the aim of studying non-Markovian open system dynamics using the state-of-the-art numerically exact Thermalized-Time Evolving Density operator with Orthonormal Polynomials Algorithm (T-TEDOPA) based on environment chain mapping. The simulations rely on a tensor network representation of the quantum states as matrix product states (MPS) and tree tensor network (TTN) states. Written in the Julia programming language, MPSDynamics.jl is a versatile open-source package providing a choice of several variants of the Time-Dependent Variational Principle (TDVP) method for time evolution (including novel bond-adaptive one-site algorithms). The package also provides strong support for the measurement of single and multi-site observables, as well as the storing and logging of data, which makes it a useful tool for the study of many-body physics. It currently handles long-range interactions, time-dependent Hamiltonians, multiple environments, bosonic and fermionic environments, and joint system-environment observables.

categories: quant-ph cond-mat.mes-hall physics.chem-ph physics.comp-ph


title: TelecomRAG: Taming Telecom Standards with Retrieval Augmented Generation and LLMs

abstract: Large Language Models (LLMs) have immense potential to transform the telecommunications industry. They could help professionals understand complex standards, generate code, and accelerate development. However, traditional LLMs struggle with the precision and source verification essential for telecom work. To address this, specialized LLM-based solutions tailored to telecommunication standards are needed. Retrieval-augmented generation (RAG) offers a way to create precise, fact-based answers. This paper proposes TelecomRAG, a framework for a Telecommunication Standards Assistant that provides accurate, detailed, and verifiable responses. Our implementation, using a knowledge base built from 3GPP Release 16 and Release 18 specification documents, demonstrates how this assistant surpasses generic LLMs, offering superior accuracy, technical depth, and verifiability, and thus significant value to the telecommunications field.