title: Meta-learning of semi-supervised learning from tasks with heterogeneous attribute spaces

abstract: We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space, which prevents us from learning with a wide variety of tasks. With the proposed method, the expected test performance on tasks with a small amount of labeled data is improved with unlabeled data as well as data in various tasks, where the attribute spaces are different among tasks. The proposed method embeds labeled and unlabeled data simultaneously in a task-specific space using a neural network, and the unlabeled data's labels are estimated by adapting classification or regression models in the embedding space. For the neural network, we develop variable-feature self-attention layers, which enable us to find embeddings of data with different attribute spaces with a single neural network by considering interactions among examples, attributes, and labels. Our experiments on classification and regression datasets with heterogeneous attribute spaces demonstrate that our proposed method outperforms the existing meta-learning and semi-supervised learning methods.


title: Legal-HNet: Mixing Legal Long-Context Tokens with Hartley Transform

abstract: Since its introduction, the transformers architecture has seen great adoption in NLP applications, but it also has limitations. Although the self-attention mechanism allows for generating very rich representations of the input text, its effectiveness may be limited in specialized domains such as legal, where, for example, language models often have to process very long texts. In this paper, we explore alternatives to replace the attention-based layers with simpler token-mixing mechanisms: Hartley and Fourier transforms. Using these non-parametric techniques, we train models with long input documents from scratch in the legal domain setting. We also introduce a new hybrid Seq2Seq architecture, a no-attention-based encoder connected with an attention-based decoder, which performs quite well on existing summarization tasks with much less compute and memory requirements. We believe that similar, if not better performance, as in the case of long correlations of abstractive text summarization tasks, can be achieved by adopting these simpler infrastructures. This not only makes training models from scratch accessible to more people, but also contributes to the reduction of the carbon footprint during training.


title: Deep Motion Masking for Secure, Usable, and Scalable Real-Time Anonymization of Virtual Reality Motion Data

abstract: Virtual reality (VR) and "metaverse" systems have recently seen a resurgence in interest and investment as major technology companies continue to enter the space. However, recent studies have demonstrated that the motion tracking "telemetry" data used by nearly all VR applications is as uniquely identifiable as a fingerprint scan, raising significant privacy concerns surrounding metaverse technologies. Although previous attempts have been made to anonymize VR motion data, we present in this paper a state-of-the-art VR identification model that can convincingly bypass known defensive countermeasures. We then propose a new "deep motion masking" approach that scalably facilitates the real-time anonymization of VR telemetry data. Through a large-scale user study (N=182), we demonstrate that our method is significantly more usable and private than existing VR anonymity systems.


title: A ternary phase-field model for two-phase flows in complex geometries

abstract: In this work, a ternary phase-field model for two-phase flows in complex geometries is proposed. In this model, one of the three components in the classical ternary Cahn-Hilliard model is considered as the solid phase, and only one Cahn-Hilliard equation with degenerate mobility needs to be solved due to the condition of volume conservation, which is consistent with the standard phase-field model with a single-scalar variable for two-phase flows. To depict different wetting properties at the complex fluid-solid boundaries, the spreading parameters in ternary phase-field model are determined based on the Young's law, in which the liquid-solid surface tension coefficient is assumed to be a linear function of gas-liquid surface tension coefficient and related to the contact angle and the minimum curvature of the solid surface. In addition, to achieve a high viscosity in the solid phase and preserve the velocity boundary conditions on the solid surface, the phase-field variable of the solid phase is also used to derive the modified Navier-Stokes equations. To test the present model, we further develop a consistent and conservative Hermite-moment based lattice Boltzmann method where an adjustable scale factor is introduced to improve the numerical stability, and conduct the numerical simulations of several benchmark problems. The results illustrate that present model has the good capability in the study of the two-phase flows in complex geometries.


title: GeoFormer: Predicting Human Mobility using Generative Pre-trained Transformer (GPT)

abstract: Predicting human mobility holds significant practical value, with applications ranging from enhancing disaster risk planning to simulating epidemic spread. In this paper, we present the GeoFormer, a decoder-only transformer model adapted from the GPT architecture to forecast human mobility. Our proposed model is rigorously tested in the context of the HuMob Challenge 2023 -- a competition designed to evaluate the performance of prediction models on standardized datasets to predict human mobility. The challenge leverages two datasets encompassing urban-scale data of 25,000 and 100,000 individuals over a longitudinal period of 75 days. GeoFormer stands out as a top performer in the competition, securing a place in the top-3 ranking. Its success is underscored by performing well on both performance metrics chosen for the competition -- the GEO-BLEU and the Dynamic Time Warping (DTW) measures. The performance of the GeoFormer on the HuMob Challenge 2023 underscores its potential to make substantial contributions to the field of human mobility prediction, with far-reaching implications for disaster preparedness, epidemic control, and beyond.


title: A million cycles in a day: enabling high-throughput computing of lithium-ion battery degradation with physics-based models

abstract: High-throughput computing (HTC) is a pivotal asset in many scientific fields, such as biology, material science and machine learning. Applying HTC to the complex physics-based degradation models of lithium-ion batteries enables efficient parameter identification and sensitivity analysis, which further leads to optimal battery design and operating conditions. However, running physics-based degradation models comes with pitfalls, as solvers can crash or get stuck in infinite loops due to numerical errors. Also, how to pipeline HTC for degradation models has seldom been discussed. To fill these gaps, we have created ParaSweeper, a Python script tailored for HTC, designed to streamline parameter sweeping by running as many ageing simulations as computational resources allow, each with different parameters. We have demonstrated the capability of ParaSweeper based on the open-source platform PyBaMM, and the approach can also apply to other numerical models which solve partial differential equations. ParaSweeper not only manages common solver errors, but also integrates various methods to accelerate the simulation. Using a high-performance computing platform, ParaSweeper can run millions of charge/discharge cycles within one day. ParaSweeper stands to benefit both academic researchers, through expedited model exploration, and industry professionals, by enabling rapid lifetime design, ultimately contributing to the prolonged lifetime of batteries.


title: Fast Combinatorial Algorithms for Efficient Sortation

abstract: Modern parcel logistic networks are designed to ship demand between given origin, destination pairs of nodes in an underlying directed network. Efficiency dictates that volume needs to be consolidated at intermediate nodes in typical hub-and-spoke fashion. In practice, such consolidation requires parcel sortation. In this work, we propose a mathematical model for the physical requirements, and limitations of parcel sortation. We then show that it is NP-hard to determine whether a feasible sortation plan exists. We discuss several settings, where (near-)feasibility of a given sortation instance can be determined efficiently. The algorithms we propose are fast and build on combinatorial witness set type lower bounds that are reminiscent and extend those used in earlier work on degree-bounded spanning trees and arborescences.


title: A Bessel Analog of the Riesz Composition Formula

abstract: We provide an elementary derivation of the Bessel analog of the celebrated Riesz composition formula and use the former to effortlessly derive the latter.


title: Universal wrinkling of freestanding atomically thin films

abstract: Atomically thin films, like transition metal dichalcogenides, can now be synthesized at wafer scale, achieving the same extreme aspect ratio (~10^8) that a sheet of paper would have if it covered an entire city. Yet, the intrinsic (i.e. unconfined) three-dimensional shape of these extreme membranes remains a mystery because of the very fundamentals of mechanical measurements: to measure such an ultra-thin film, one first needs to simultaneously free it and stabilize it without introducing confining boundaries. Here, we introduce a counter-intuitive solution to this problem: place atomically thin films on water. Using atomic force microscopy (AFM) and Raman spectroscopy adapted to water's surface, we reveal that large-scale freestanding membranes spontaneously self-wrinkle into a universal mechanical state with long emergent length scales that follow robust scaling trends. Our analytical and numerical models suggest that these universal trends are controlled by mesoscopic parameters of the polycrystalline domains instead of atomistic details. Moreover, we demonstrate experimentally that the wrinkles result in a large and tunable reduction of elastic stiffness by up to 2 orders of magnitude. The present work illuminates the physical properties of the world's thinnest materials at length scales never probed before and highlights their potential for tunable strain-controlled nanomechanical devices.


title: A thermodynamically consistent and conservative diffuse-interface model for gas-liquid-solid multiphase flows

abstract: In this work, a thermodynamically consistent and conservative diffuse-interface model for gas-liquid-solid multiphase flows is proposed. In this model, a novel free energy for the gas-liquid-solid multiphase flows is established according to a ternary phase-field model, and it not only contains the standard bulk and interface free energies for two-phase flows, but also includes some additional terms to reflect the penalty in the solid phase and the wettability on the solid surface. Furthermore, a smooth indicator function of the solid phase is also introduced in the consistent Navier-Stokes equations to achieve a high viscosity in the solid phase and preserve the velocity boundary conditions on the solid surface. Based on the proposed diffuse-interface model, the fluid interface dynamics, the fluid-structure interaction, and the wetting property of the solid surface can be described simply and efficiently. Additionally, the total energy is also proved to be dissipative for the two-phase flows in the stationary geometries. To test the present diffuse-interface model, we develop a consistent and conservative lattice Boltzmann method and conduct some simulations. The numerical results also confirm the energy dissipation and good capability of the proposed diffuse-interface model in the study of two-phase flows in complex geometries and gas-liquid-particle multiphase flows.


title: XQz5: A New Ultraluminous z$\sim$5 Quasar Legacy Sample

abstract: Bright quasar samples at high redshift are useful for investigating active galactic nuclei evolution. In this study, we describe XQz5, a sample of 83 ultraluminous quasars in the redshift range $4.5 < z < 5.3$ with optical and near-infrared spectroscopic observations, with unprecendented completeness at the bright end of the quasar luminosity function. The sample is observed with the Southern Astrophysical Research Telescope, the Very Large Telescope, and the ANU 2.3m Telescope, resulting in a high-quality, moderate-resolution spectral atlas of the brightest known quasars within the redshift range. We use established virial mass relations to derive the black hole masses by measuring the observed Mg\,\textsc{ii}$\lambda$2799\AA\ emission-line and we estimate the bolometric luminosity with bolometric corrections to the UV continuum. Comparisons to literature samples show that XQz5 bridges the redshift gap between other X-shooter quasar samples, XQ-100 and XQR-30, and is a brighter sample than both. Luminosity-matched lower-redshift samples host more massive black holes, which indicate that quasars at high redshift are more active than their counterparts at lower-redshift, in concordance with recent literature.


title: Time-Resolved Coulomb Explosion Imaging Unveils Ultrafast Ring Opening of Furan

abstract: Following the changes in molecular structure throughout the entirety of a chemical reaction with atomic resolution is a long-term goal in femtochemistry. Although the development of a plethora of ultrafast technique has enabled detailed investigations of the electronic and nuclear dynamics on femtosecond time scales, direct and unambiguous imaging of the nuclear motion during a reaction is still a major challenge. Here, we apply time-resolved Coulomb explosion imaging with femtosecond near-infrared pulses to visualize the ultraviolet-induced ultrafast molecular dynamics of gas-phase furan. Widely contradicting predictions and observations for this molecule have been reported in the literature. By combining the experimental Coulomb explosion imaging data with ab initio molecular dynamics and Coulomb explosion simulations, we reveal the presence of a strong ultrafast ring-opening pathway upon excitation at 198 nm that occurs within 100 fs.


title: Self-similarity Prior Distillation for Unsupervised Remote Physiological Measurement

abstract: Remote photoplethysmography (rPPG) is a noninvasive technique that aims to capture subtle variations in facial pixels caused by changes in blood volume resulting from cardiac activities. Most existing unsupervised methods for rPPG tasks focus on the contrastive learning between samples while neglecting the inherent self-similar prior in physiological signals. In this paper, we propose a Self-Similarity Prior Distillation (SSPD) framework for unsupervised rPPG estimation, which capitalizes on the intrinsic self-similarity of cardiac activities. Specifically, we first introduce a physical-prior embedded augmentation technique to mitigate the effect of various types of noise. Then, we tailor a self-similarity-aware network to extract more reliable self-similar physiological features. Finally, we develop a hierarchical self-distillation paradigm to assist the network in disentangling self-similar physiological patterns from facial videos. Comprehensive experiments demonstrate that the unsupervised SSPD framework achieves comparable or even superior performance compared to the state-of-the-art supervised methods. Meanwhile, SSPD maintains the lowest inference time and computation cost among end-to-end models. The source codes are available at https://github.com/LinXi1C/SSPD.


title: Integrated Sensing and Communication for Network-Assisted Full-Duplex Cell-Free Distributed Massive MIMO Systems

abstract: In this paper, we combine the network-assisted full-duplex (NAFD) technology and distributed radar sensing to implement integrated sensing and communication (ISAC). The ISAC system features both uplink and downlink remote radio units (RRUs) equipped with communication and sensing capabilities. We evaluate the communication and sensing performance of the system using the sum communication rates and the Cramer-Rao lower bound (CRLB), respectively. We compare the performance of the proposed scheme with other ISAC schemes, the result shows that the proposed scheme can provide more stable sensing and better communication performance. Furthermore, we propose two power allocation algorithms to optimize the communication and sensing performance jointly. One algorithm is based on the deep Q-network (DQN) and the other one is based on the non-dominated sorting genetic algorithm II (NSGA-II). The proposed algorithms provide more feasible solutions and achieve better system performance than the equal power allocation algorithm.


title: New constraints on primordial non-Gaussianity from missing two-loop contributions of scalar induced gravitational waves

abstract: We analyze the energy density spectrum of \acp{SIGW} using the NANOGrav 15-year data set, thereby constraining the primordial non-Gaussian parameter $f_{\mathrm{NL}}$. For the first time, we calculate the seventeen missing two-loop diagrams proportional to $f_{\mathrm{NL}}A_{\zeta}^3$ that correspond to the two-point correlation function $\langle h^{\lambda,(3)}_{\mathbf{k}} h^{\lambda',(2)}_{\mathbf{k}'} \rangle$ for local-type primordial non-Gaussianity. The total energy density spectrum of \acp{SIGW} can be significantly suppressed by these two-loop diagrams. If \acp{SIGW} dominate the \acp{SGWB} observed in \ac{PTA} experiments, the parameter interval $f_{\mathrm{NL}}\in [-5,-1]$ is notably excluded based on NANOGrav 15-year data set. After taking into account abundance of \acp{PBH} and the convergence of the cosmological perturbation expansion, we find that the only possible parameter range for $f_{\mathrm{NL}}$ might be $-1\le f_{\mathrm{NL}}< 0$.


title: PID-inspired Continuous-time Distributed Optimization

abstract: This paper proposes two novel distributed continuous-time algorithms inspired by PID control to solve distributed optimization problems. The algorithms are referred to as first-order and second-order, respectively, depend on the intrinsic dynamics of the agents in the network. Sufficient conditions are derived so that both algorithms converge exponentially over undirected connected graphs. Finally, numerical simulations illustrate the effectiveness and efficiency of the proposed algorithms.


title: Impact of thermal annealing on the interaction between monolayer MoS2 and Au

abstract: We have investigated the impact of thermal annealing on the interaction of single layer MoS2 and Au using Raman Spectroscopy. We found MoS2 has two main modes of interactions with the underlying Au being either weakly-coupled or strongly-coupled. The regions strongly-coupled to Au are hybridized to Au, minimally strained, and electron-doped. The weakly-coupled regions are found to be slightly hole-doped with tensile strain of 1.0 %. The observed nanoscale inhomogeneities in doping would result in Au contacts having a large variability in performance. The overall areal coverage of the strongly-coupled regions is not increased by thermal annealing, and the variability in the degree of hybridization increases at annealing temperatures above 100 {\deg}C. Our data also show that monolayer MoS2 starts to decouple from Au around 100 {\deg}C, becoming fully decoupled above 250 {\deg}C, suggesting that monolayer MoS2 produced by Au-assisted mechanical exfoliation may be more easily transferred off Au at elevated temperatures.


title: Atmospheric neutrino oscillation analysis with neutron tagging and an expanded fiducial volume in Super-Kamiokande I-V

abstract: We present a measurement of neutrino oscillation parameters with the Super-Kamiokande detector using atmospheric neutrinos from the complete pure-water SK I-V (April 1996-July 2020) data set, including events from an expanded fiducial volume. The data set corresponds to 6511.3 live days and an exposure of 484.2 kiloton-years. Measurements of the neutrino oscillation parameters $\Delta m^2_{32}$, $\sin^2\theta_{23}$, $\sin^2 \theta_{13}$, $\delta_{CP}$, and the preference for the neutrino mass ordering are presented with atmospheric neutrino data alone, and with constraints on $\sin^2 \theta_{13}$ from reactor neutrino experiments. Our analysis including constraints on $\sin^2 \theta_{13}$ favors the normal mass ordering at the 92.3% level.


title: A differentiable brain simulator bridging brain simulation and brain-inspired computing

abstract: Brain simulation builds dynamical models to mimic the structure and functions of the brain, while brain-inspired computing (BIC) develops intelligent systems by learning from the structure and functions of the brain. The two fields are intertwined and should share a common programming framework to facilitate each other's development. However, none of the existing software in the fields can achieve this goal, because traditional brain simulators lack differentiability for training, while existing deep learning (DL) frameworks fail to capture the biophysical realism and complexity of brain dynamics. In this paper, we introduce BrainPy, a differentiable brain simulator developed using JAX and XLA, with the aim of bridging the gap between brain simulation and BIC. BrainPy expands upon the functionalities of JAX, a powerful AI framework, by introducing complete capabilities for flexible, efficient, and scalable brain simulation. It offers a range of sparse and event-driven operators for efficient and scalable brain simulation, an abstraction for managing the intricacies of synaptic computations, a modular and flexible interface for constructing multi-scale brain models, and an object-oriented just-in-time compilation approach to handle the memory-intensive nature of brain dynamics. We showcase the efficiency and scalability of BrainPy on benchmark tasks, highlight its differentiable simulation for biologically plausible spiking models, and discuss its potential to support research at the intersection of brain simulation and BIC.


title: Impact of Exchange-Correlation Functionals on Phonon Hydrodynamics: A Study of Fluorides (NaF, LiF) and Alkali Hydrides (LiH, NaH) Under Guyer's Criteria

abstract: In this study, we examine the effect of various exchange-correlation (XC) functionals, including the Perdew-Burke-Ernzerhof generalized gradient approximation (PBE), the modified Perdew-Burke-Ernzerhof generalized gradient approximation (PBESOL), and the local density approximation (LDA), on the calculations of electrical, mechanical, and thermal properties of sodium fluoride (NaF), lithium fluoride (LiF), lithium hydride (LiH), and sodium hydride (NaH). The lattice thermal conductivity is computed based on an iterative solution of the Boltzmann transport equation (BTE). Guyer's criteria \cite{Guyer1966} is applied to predict the phonon hydrodynamics regime. Based on our calculations, second sound in NaF can be observed at a temperature of 15 K, in agreement with previous experimental observations from Jackson et al. \cite{Jackson1970}. The impact of isotopes on the calculated lattice thermal conductivity and phonon hydrodynamics windows is also reported. We find that the selection of a functional impacts the prediction of thermal conductivity and the window for observation of phonon hydrodynamics.


title: Personalized Online Federated Learning with Multiple Kernels

abstract: Multi-kernel learning (MKL) exhibits well-documented performance in online non-linear function approximation. Federated learning enables a group of learners (called clients) to train an MKL model on the data distributed among clients to perform online non-linear function approximation. There are some challenges in online federated MKL that need to be addressed: i) Communication efficiency especially when a large number of kernels are considered ii) Heterogeneous data distribution among clients. The present paper develops an algorithmic framework to enable clients to communicate with the server to send their updates with affordable communication cost while clients employ a large dictionary of kernels. Utilizing random feature (RF) approximation, the present paper proposes scalable online federated MKL algorithm. We prove that using the proposed online federated MKL algorithm, each client enjoys sub-linear regret with respect to the RF approximation of its best kernel in hindsight, which indicates that the proposed algorithm can effectively deal with heterogeneity of the data distributed among clients. Experimental results on real datasets showcase the advantages of the proposed algorithm compared with other online federated kernel learning ones.


title: Reducing the Side-Effects of Oscillations in Training of Quantized YOLO Networks

abstract: Quantized networks use less computational and memory resources and are suitable for deployment on edge devices. While quantization-aware training QAT is the well-studied approach to quantize the networks at low precision, most research focuses on over-parameterized networks for classification with limited studies on popular and edge device friendly single-shot object detection and semantic segmentation methods like YOLO. Moreover, majority of QAT methods rely on Straight-through Estimator (STE) approximation which suffers from an oscillation phenomenon resulting in sub-optimal network quantization. In this paper, we show that it is difficult to achieve extremely low precision (4-bit and lower) for efficient YOLO models even with SOTA QAT methods due to oscillation issue and existing methods to overcome this problem are not effective on these models. To mitigate the effect of oscillation, we first propose Exponentially Moving Average (EMA) based update to the QAT model. Further, we propose a simple QAT correction method, namely QC, that takes only a single epoch of training after standard QAT procedure to correct the error induced by oscillating weights and activations resulting in a more accurate quantized model. With extensive evaluation on COCO dataset using various YOLO5 and YOLO7 variants, we show that our correction method improves quantized YOLO networks consistently on both object detection and segmentation tasks at low-precision (4-bit and 3-bit).


title: Average value estimation in nonadiabatic holonomic quantum computation

abstract: Nonadiabatic holonomic quantum computation has been attracting continuous attention since it was proposed. Until now, various schemes of nonadiabatic holonomic quantum computation have been developed and many of them have been experimentally demonstrated. It is known that at the end of a computation, one usually needs to estimate the average value of an observable. However, computation errors severely disturb the final state of a computation, causing erroneous average value estimation. Thus for nonadiabatic holonomic quantum computation, an important topic is to investigate how to better give the average value of an observable under the condition of computation errors. While the above topic is important, the previous works in the field of nonadiabatic holonomic quantum computation pay woefully inadequate attention to it. In this paper, we show that rescaling the measurement results can better give the average value of an observable in nonadiabatic holonomic quantum computation when computation errors are considered. Particularly, we show that by rescaling the measurement results, $56.25\%$ of the computation errors can be reduced when using depolarizing noise model, a widely adopted noise model in quantum computation community, to analyse the benefit of our method.


title: Vector Approximate Survey Propagation for Model-Mismatched Estimation (Or: How to Achieve Kabashima's 1RSB Prediction)

abstract: For approximate inference in high-dimensional generalized linear models (GLMs), the performance of an estimator may significantly degrade when mismatch exists between the postulated model and the ground truth. In mismatched GLMs with rotation-invariant measurement matrices, Kabashima et al. proved vector approximate message passing (VAMP) computes exactly the optimal estimator if the replica symmetry (RS) ansatz is valid, but it becomes inappropriate if RS breaking (RSB) appears. Although the one-step RSB (1RSB) saddle point equations were given for the optimal estimator, the question remains: how to achieve the 1RSB prediction? This paper answers the question by proposing a new algorithm, vector approximate survey propagation (VASP). VASP derives from a reformulation of Kabashima's extremum conditions, which later links the theoretical equations to survey propagation in vector form and finally the algorithm. VASP has a complexity as low as VAMP, while embracing VAMP as a special case. The SE derived for VASP can capture precisely the per-iteration behavior of the simulated algorithm, and the SE's fixed point equations perfectly match Kabashima's 1RSB prediction, which indicates VASP can achieve the optimal performance even in a model-mismatched setting with 1RSB. Simulation results confirm VASP outperforms many state-of-the-art algorithms.


title: A Survey of Large Language Models in Medicine: Progress, Application, and Challenge

abstract: Large language models (LLMs), such as ChatGPT, have received substantial attention due to their capabilities for understanding and generating human language. While there has been a burgeoning trend in research focusing on the employment of LLMs in supporting different medical tasks (e.g., enhancing clinical diagnostics and providing medical education), a review of these efforts, particularly their development, practical applications, and outcomes in medicine, remains scarce. Therefore, this review aims to provide a detailed overview of the development and deployment of LLMs in medicine, including the challenges and opportunities they face. In terms of development, we provide a detailed introduction to the principles of existing medical LLMs, including their basic model structures, number of parameters, and sources and scales of data used for model development. It serves as a guide for practitioners in developing medical LLMs tailored to their specific needs. In terms of deployment, we offer a comparison of the performance of different LLMs across various medical tasks, and further compare them with state-of-the-art lightweight models, aiming to provide an understanding of the advantages and limitations of LLMs in medicine. Overall, in this review, we address the following questions: 1) What are the practices for developing medical LLMs 2) How to measure the medical task performance of LLMs in a medical setting? 3) How have medical LLMs been employed in real-world practice? 4) What challenges arise from the use of medical LLMs? and 5) How to more effectively develop and deploy medical LLMs? By answering these questions, this review aims to provide insights into the opportunities for LLMs in medicine and serve as a practical resource. We also maintain a regularly updated list of practical guides on medical LLMs at: https://github.com/AI-in-Health/MedLLMsPracticalGuide.


title: Conic10K: A Challenging Math Problem Understanding and Reasoning Dataset

abstract: Mathematical understanding and reasoning are crucial tasks for assessing the capabilities of artificial intelligence (AI). However, existing benchmarks either require just a few steps of reasoning, or only contain a small amount of data in one specific topic, making it hard to analyse AI's behaviour with reference to different problems within a specific topic in detail. In this work, we propose Conic10K, a challenging math problem dataset on conic sections in Chinese senior high school education. Our dataset contains various problems with different reasoning depths, while only the knowledge from conic sections is required. Since the dataset only involves a narrow range of knowledge, it is easy to separately analyse the knowledge a model possesses and the reasoning ability it has. For each problem, we provide a high-quality formal representation, the reasoning steps, and the final solution. Experiments show that existing large language models, including GPT-4, exhibit weak performance on complex reasoning. We hope that our findings could inspire more advanced techniques for precise natural language understanding and reasoning. Our dataset and codes are available at https://github.com/whyNLP/Conic10K.


title: Prompt Your Mind: Refine Personalized Text Prompts within Your Mind

abstract: Large language models (LLMs) have demonstrated remarkable potential in natural language understanding and generation, making them valuable tools for enhancing conversational interactions. However, LLMs encounter challenges such as lacking multi-step reasoning capabilities, and heavy reliance on prompts. In this regard, we introduce a prompt-refinement system named PromptMind, also known as "Prompt Your Mind", to provide an automated solution for generating contextually relevant prompts during conversations. PromptMind enhances the overall interaction between humans and chatbots through an automatic prompt suggestion and an automatic prompt refinement. To assess the effectiveness of PromptMind, we designed three interaction tasks to evaluate emotional support, advice acquisition, and task-oriented interactions during human-chatbot interactions. The results demonstrated that PromptMind reduced mental demands during interactions and fostered enhanced performance and social connections between users and chatbots. In summary, our findings indicate that PromptMind acts as a bridge, facilitating smoother information exchange and enhancing the usability of chatbot interactions.


title: A Survey on Convex Optimization for Guidance and Control of Vehicular Systems

abstract: Guidance and control (G&C) technologies play a central role in the development and operation of vehicular systems. The emergence of computational guidance and control (CG&C) and highly efficient numerical algorithms has opened up the great potential for solving complex constrained G&C problems onboard, enabling higher level of autonomous vehicle operations. In particular, convex-optimization-based G&C has matured significantly over the years and many advances continue to be made, allowing the generation of optimal G&C solutions in real-time for many vehicular systems in aerospace, automotive, and other domains. In this paper, we review recent major advances in convex optimization and convexification techniques for G&C of vehicular systems, focusing primarily on three important application fields: 1) Space vehicles for powered descent guidance, small body landing, rendezvous and proximity operations, orbital transfer, spacecraft reorientation, space robotics and manipulation, spacecraft formation flying, and station keeping; 2) Air vehicles including hypersonic/entry vehicles, missiles and projectiles, launch/ascent vehicles, and low-speed air vehicles; and 3) Motion control and powertrain control of ground vehicles. Throughout the paper, we draw figures that illustrate the basic mission concepts and scenarios and present tables that summarize similarities and distinctions among the key problems, ideas, and approaches. Where available, we provide comparative analyses and reveal correlations between different applications. Finally, we identify open challenges and issues, discuss potential opportunities, and make suggestions for future research directions.


title: Covering Number of Real Algebraic Varieties and Beyond: Improved Bounds and Applications

abstract: Covering numbers are a powerful tool used in the development of approximation algorithms, randomized dimension reduction methods, smoothed complexity analysis, and others. In this paper we prove upper bounds on the covering number of numerous sets in Euclidean space, namely real algebraic varieties, images of polynomial maps and semialgebraic sets in terms of the number of variables and degrees of the polynomials involved. The bounds remarkably improve the best known general bound by Yomdin-Comte, and our proof is much more straightforward. In particular, our result gives new bounds on the volume of the tubular neighborhood of the image of a polynomial map and a semialgebraic set, where results for varieties by Lotz and Basu-Lerario are not directly applicable. We illustrate the power of the result on three computational applications. Firstly, we derive a near-optimal bound on the covering number of low rank CP tensors, quantifying their approximation properties and filling in an important missing piece of theory for tensor dimension reduction and reconstruction. Secondly, we prove a bound on the required dimension for the randomized sketching of polynomial optimization problems, which controls how much computation can be saved through randomization without sacrificing solution quality. Finally, we deduce generalization error bounds for deep neural networks with rational or ReLU activation functions, improving or matching the best known results in the machine learning literature while helping to quantify the impact of architecture choice on generalization error.


title: Unsupervised Translation Quality Estimation Exploiting Synthetic Data and Pre-trained Multilingual Encoder

abstract: Translation quality estimation (TQE) is the task of predicting translation quality without reference translations. Due to the enormous cost of creating training data for TQE, only a few translation directions can benefit from supervised training. To address this issue, unsupervised TQE methods have been studied. In this paper, we extensively investigate the usefulness of synthetic TQE data and pre-trained multilingual encoders in unsupervised sentence-level TQE, both of which have been proven effective in the supervised training scenarios. Our experiment on WMT20 and WMT21 datasets revealed that this approach can outperform other unsupervised TQE methods on high- and low-resource translation directions in predicting post-editing effort and human evaluation score, and some zero-resource translation directions in predicting post-editing effort.


title: Higher incoherence of the automorphism groups of a free group

abstract: Let $F_n$ be the free group on $n \geq 2$ generators. We show that for all $1 \leq m \leq 2n-3$ (respectively for all $1 \leq m \leq 2n-4$) there exists a subgroup of $\operatorname{Aut}(F_n)$ (respectively $\operatorname{Out}(F_n)$) which has finiteness of type $F_{m}$ but not of type $FP_{m+1}(\mathbb{Q})$, hence it is not $m$-coherent. In both cases, the new result is the upper bound $m= 2n-3$ (respectively $m = 2n-4$), as it cannot be obtained by embedding direct products of free noncyclic groups, and certifies higher incoherence up to the virtual cohomological dimension and is therefore sharp. As a tool of the proof, we discuss the existence and nature of multiple inequivalent extensions of suitable finite-index subgroups of $\operatorname{Aut}(F_2)$.


title: High Performance Thin-film Lithium Niobate Modulator Applied ITO Composite Electrode with Modulation Efficiency of 1V*cm

abstract: Thin film lithium niobate (TFLN) based electro-optic modulator is widely applied in the field of broadband optical communications due to its advantages such as large bandwidth, high extinction ratio, and low optical loss, bringing new possibilities for the next generation of high-performance electro-optic modulators. However, the modulation efficiency of TFLN modulators is still relatively low when compared with Silicon and Indium-Phosphide (InP) based competitors. Due to the restriction of the trade-off between half-wave voltage and modulation length, it is difficult to simultaneously obtain low driving voltage and large modulating bandwidth. Here, we break this limitation by introducing Transparent Conductive Oxide (TCO) film, resulting in an ultra-high modulation efficiency of 1.02 V*cm in O-Band. The fabricated composite electrode not only achieves high modulation efficiency but also maintains a high electro-optic bandwidth, as demonstrated by the 3 dB roll-off at 108 GHz and the transmission of PAM-4 signals at 224 Gbit/s. Our device presents new solutions for the next generation of low-cost high-performance electro-optic modulators. Additionally, it paves the way for downsizing TFLN-based multi-channel optical transmitter chips.


title: Quranic Conversations: Developing a Semantic Search tool for the Quran using Arabic NLP Techniques

abstract: The Holy Book of Quran is believed to be the literal word of God (Allah) as revealed to the Prophet Muhammad (PBUH) over a period of approximately 23 years. It is the book where God provides guidance on how to live a righteous and just life, emphasizing principles like honesty, compassion, charity and justice, as well as providing rules for personal conduct, family matters, business ethics and much more. However, due to constraints related to the language and the Quran organization, it is challenging for Muslims to get all relevant ayahs (verses) pertaining to a matter or inquiry of interest. Hence, we developed a Quran semantic search tool which finds the verses pertaining to the user inquiry or prompt. To achieve this, we trained several models on a large dataset of over 30 tafsirs, where typically each tafsir corresponds to one verse in the Quran and, using cosine similarity, obtained the tafsir tensor which is most similar to the prompt tensor of interest, which was then used to index for the corresponding ayah in the Quran. Using the SNxLM model, we were able to achieve a cosine similarity score as high as 0.97 which corresponds to the abdu tafsir for a verse relating to financial matters.


title: Refined decay rates of $C_0$-semigroups on Banach spaces

abstract: We study rates of decay for $C_0$-semigroups on Banach spaces under the assumption that the norm of the resolvent of the semigroup generator grows with $\vert s\vert^{\beta}\log(\vert s\vert)^b$, $\beta, b \geq 0$, as $\vert s\vert\rightarrow\infty$, and with $\vert s\vert^{-\alpha}\log(1/\vert s\vert)^a$, $\alpha, a \geq 0$, as $\vert s\vert \rightarrow 0$. Our results do not suppose that the semigroup is bounded. In particular, for $a=b=0$, our results improve the rates involving Fourier types obtained by Rozendaal and Veraar (J. Funct. Anal. 275(10): 2845-2894, 2018).


title: ScribblePolyp: Scribble-Supervised Polyp Segmentation through Dual Consistency Alignment

abstract: Automatic polyp segmentation models play a pivotal role in the clinical diagnosis of gastrointestinal diseases. In previous studies, most methods relied on fully supervised approaches, necessitating pixel-level annotations for model training. However, the creation of pixel-level annotations is both expensive and time-consuming, impeding the development of model generalization. In response to this challenge, we introduce ScribblePolyp, a novel scribble-supervised polyp segmentation framework. Unlike fully-supervised models, ScribblePolyp only requires the annotation of two lines (scribble labels) for each image, significantly reducing the labeling cost. Despite the coarse nature of scribble labels, which leave a substantial portion of pixels unlabeled, we propose a two-branch consistency alignment approach to provide supervision for these unlabeled pixels. The first branch employs transformation consistency alignment to narrow the gap between predictions under different transformations of the same input image. The second branch leverages affinity propagation to refine predictions into a soft version, extending additional supervision to unlabeled pixels. In summary, ScribblePolyp is an efficient model that does not rely on teacher models or moving average pseudo labels during training. Extensive experiments on the SUN-SEG dataset underscore the effectiveness of ScribblePolyp, achieving a Dice score of 0.8155, with the potential for a 1.8% improvement in the Dice score through a straightforward self-training strategy.


title: On some manifolds with positive sigma invariants and their realizing conformal classes

abstract: We prove that the metric of the Riemannian product $(\mb{S}^k(r_1)\times \mb{S}^{n-k}(r_2), g^n_k)$, $r_1^2+r_2^2=1$, is a Yamabe metric in its conformal class if, and only if, either $g^n_k$ is Einstein, or the linear isometric embedding of this manifold into the standard $n+1$ dimensional sphere is minimal. We combine this result with Simons' gap theorem to show that, for $2\leq k\leq n-2$, the conformal class of the product metric with minimal embedding, which is at the upper end of Simons' gap theorem, realizes the sigma invariant of $\mb{S}^k\times \mb{S}^{n-k}$, and that this is the only class that achieves such a value. Similarly, we use coherent minimal isometric embeddings of suitably scaled standard Einstein metrics $g$ on $\mb{P}^n(\mb{R})$, $\mb{P}^n(\mb{C})$, and $\mb{P}^n(\mb{H})$ into unit spheres, and determine the sigma invariant of these projective spaces, prove that in each case the conformal class $[g]$ realizes it, and that this realizing class is unique.


title: High-mobility compensated semimetals, orbital magnetization, and umklapp scattering in bilayer graphene moire superlattices

abstract: Twist-controlled moire superlattices (MS) have emerged as a versatile platform in which to realize artificial systems with complex electronic spectra. Bernal-stacked bilayer graphene (BLG) and hexagonal boron nitride (hBN) form an interesting example of the MS that has recently featured a set of unexpected behaviors, such as unconventional ferroelectricity and electronic ratchet effect. Yet, the understanding of the BLG/hBN MS electronic properties has, at present, remained fairly limited. Here we develop a multi-messenger approach that combines standard magnetotransport techniques with low-energy sub-THz excitation to get insights into the properties of this MS. We show that BLG/hBN lattice alignment results in the emergence of compensated semimetals at some integer fillings of the moire bands separated by van Hove singularities where Lifshitz transition occurs. A particularly pronounced semimetal develops when 8 electrons reside in the moire unit cell, where coexisting high-mobility electron and hole systems feature a strong magnetoresistance reaching 2350 % already at B=0.25 T. Next, by measuring the THz-driven Nernst effect in remote bands, we observe valley splitting, pointing to an orbital magnetization characterized by a strongly enhanced effective g-factor of 340. Last, using THz photoresistance measurements, we show that the high-temperature conductivity of the BLG/hBN MS is limited by electron-electron umklapp processes. Our multi-facet analysis introduces THz-driven magnetotransport as a convenient tool to probe the band structure and interaction effects in vdW materials and provides a comprehension of the BLG/hBN MS.


title: Effects of Electroweak Symmetry Breaking on Axion Like Particles as Dark Matter

abstract: Axion like particles (ALPs), the pseudo Nambu-Goldstone bosons associated to the spontaneous breaking of global symmetry, have emerged as promising dark matter candidates. Conventionally, in the context of misalignment mechanism, the non-thermally produced ALPs happen to stay frozen due to Hubble friction initially and at a later stage, they begin to oscillate (before matter-radiation equality) at characteristic frequencies defined by their masses and behaving like cold dark matter. In this work, we study the influence of electroweak symmetry breaking (EWSB), through a higher order Higgs portal interaction, on the evolution of ALPs. Such an interaction is found to contribute partially to the ALP's mass during EWSB, thereby modifying oscillation frequencies during EWSB as well as impacting upon the existing correlation between the scale of symmetry breaking and their masses. The novelty of the work lies in broadening the relic satisfied parameter space so as to probe it in near future via a wide range of experiments.


title: Exploring and Analyzing the Effect of Avatar's Realism on Anxiety of English as Second Language (ESL) Speakers

abstract: The emergence of virtual avatars provides innovative opportunities for remote conferencing, education, and more. Our study investigates how the realism of avatars, used by native English speakers, impacts the anxiety levels of English as a Second Language (ESL) speakers during interactions. ESL participants engaged in conversations with native English speakers represented through cartoonish avatars, realistic-like avatars, or actual video streams. We measured both the ESL speakers' self-reported anxiety and their physiological indicators of anxiety. Our findings show that interactions with native speakers using cartoonish avatars or direct video lead to reduced anxiety levels among ESL participants. However, interactions with avatars that closely resemble humans heightened these anxieties. These insights are critically important for the design and application of virtual avatars, especially in addressing cross-cultural communication barriers and enhancing user experience.


title: On a radial projection conjecture in $\mathbb{F}_q^d$

abstract: A conjecture on radial projections in $\mathbb{F}_q^d$ states that if $E\subset \mathbb{F}_q^n$ with $q^{k-1}< |E|\leq q^{k}$ for some $k \in \{1,\dots, n-1\}$, then \[ \#\{y\in \mathbb{F}_q^n \mid |\pi^y(E)| < |E| \} \leq q^k. \] The case $k=n-1$ was recently proved by the second and third listed authors and Thu (2022). In this paper, we resolve this conjecture in all ranges of $k$.


title: Exploring and Analyzing Wildland Fire Data Via Machine Learning Techniques

abstract: This research project investigated the correlation between a 10 Hz time series of thermocouple temperatures and turbulent kinetic energy (TKE) computed from wind speeds collected from a small experimental prescribed burn at the Silas Little Experimental Forest in New Jersey, USA. The primary objective of this project was to explore the potential for using thermocouple temperatures as predictors for estimating the TKE produced by a wildland fire. Machine learning models, including Deep Neural Networks, Random Forest Regressor, Gradient Boosting, and Gaussian Process Regressor, are employed to assess the potential for thermocouple temperature perturbations to predict TKE values. Data visualization and correlation analyses reveal patterns and relationships between thermocouple temperatures and TKE, providing insight into the underlying dynamics. The project achieves high accuracy in predicting TKE by employing various machine learning models despite a weak correlation between the predictors and the target variable. The results demonstrate significant success, particularly from regression models, in accurately estimating the TKE. The research findings contribute to fire behavior and smoke modeling science, emphasizing the importance of incorporating machine learning approaches and identifying complex relationships between fine-scale fire behavior and turbulence. Accurate TKE estimation using thermocouple temperatures allows for the refinement of models that can inform decision-making in fire management strategies, facilitate effective risk mitigation, and optimize fire management efforts. This project highlights the valuable role of machine learning techniques in analyzing wildland fire data, showcasing their potential to advance fire research and management practices.


title: Staring at the Sun with the Keck Planet Finder: An Autonomous Solar Calibrator for High Signal-to-Noise Sun-as-a-Star Spectra

abstract: Extreme precision radial velocity (EPRV) measurements contend with internal noise (instrumental systematics) and external noise (intrinsic stellar variability) on the road to 10 cm/s "exo-Earth" sensitivity. Both of these noise sources are well-probed using "Sun-as-a-star" RVs and cross-instrument comparisons. We built the Solar Calibrator (SoCal), an autonomous system that feeds stable, disc-integrated sunlight to the recently commissioned Keck Planet Finder (KPF) at the W. M. Keck Observatory. With SoCal, KPF acquires signal-to-noise ~1200, R = ~98,000 optical (445--870 nm) spectra of the Sun in 5~sec exposures at unprecedented cadence for an EPRV facility using KPF's fast readout mode (<16 sec between exposures). Daily autonomous operation is achieved by defining an operations loop using state machine logic. Data affected by clouds are automatically flagged using a reliable quality control metric derived from simultaneous irradiance measurements. Comparing solar data across the growing global network of EPRV spectrographs with solar feeds will allow EPRV teams to disentangle internal and external noise sources and benchmark spectrograph performance. To facilitate this, all SoCal data products are immediately available to the public on the Keck Observatory Archive. We compared SoCal RVs to contemporaneous RVs from NEID, the only other immediately public EPRV solar dataset. We find agreement at the 30-40 cm/s level on timescales of several hours, which is comparable to the combined photon-limited precision. Data from SoCal were also used to assess a detector problem and wavelength calibration inaccuracies associated with KPF during early operations. Long-term SoCal operations will collect upwards of 1,000 solar spectra per six-hour day using KPF's fast readout mode, enabling stellar activity studies at high signal-to-noise on our nearest solar-type star.


title: 3 kV AlN Schottky Barrier Diodes on Bulk AlN Substrates by MOCVD

abstract: This letter reports the first demonstration of AlN Schottky diodes on bulk AlN substrates by metalorganic chemical vapor phase deposition (MOCVD) with breakdown voltages exceeding 3 kV. The devices exhibited good rectifying characteristics with ON/OFF ratios on the order of 10^6 to 10^8 and excellent thermal stability from 298 to 623 K. The device Schottky barrier height increased from 0.89 to 1.85 eV, and the ideality factor decreased from 4.29 to 1.95 with increasing temperatures, which was ascribed to the inhomogeneous metal/AlN interface. At reverse bias of -3 kV, the devices showed a low leakage current of 200 nA without the incorporation of any field plate structures or passivation techniques. This work demonstrates the potential of AlN as an ultra-wide bandgap semiconductor and represents a big step toward the development of multi-kV AlN high-voltage and high-power devices.


title: Stereotype Dualities in Geometry

abstract: This book contains the material of my research on stereotype duality theories in geometry. It was intended as a continuation of my recently published monograph in De Gruyter on stereotype spaces and algebras.


title: The non-perturbative stringy interaction between NS-brane \& Dp brane

abstract: To our best knowledge, the leading non-perturbative stringy interaction between an NS brane and a Dp brane remains unknown. We here present the non-perturbative stringy amplitudes for a system of an F-string and a Dp brane and a system of an NS 5 brane and a Dp brane for $0 \le p \le 6$. In either case, the F or NS5 and the Dp are placed parallel at a separation. We obtain the respective amplitudes, starting from the amplitude for a system of a D1 and a D3 for the former and that for a system of a D5 and a D3 system for the latter, based on the IIB S-duality and various T-dualities plus the consistency of both, along with the respective known long-range amplitudes. We would like to point out that the amplitude for the D1/D3 or D3/D5 computed from the usual D-brane technique does not take into consideration of the non-perturbative contribution due to the exchange of virtual closed D-string emitted by the D3. As such the resulting amplitudes obtained from this one via the S-duality and followed by various T-dualities are not consistent with the IIB S-duality. We resolve this issue and obtain the corresponding consistent amplitudes. The implications of so obtained amplitudes are also discussed.


title: Materials Properties Prediction (MAPP): Empowering the prediction of material properties solely based on chemical formulas

abstract: Predicting material properties has always been a challenging task in materials science. With the emergence of machine learning methodologies, new avenues have opened up. In this study, we build upon our recently developed Graph Neural Network (GNN) approach to construct models that predict four distinct material properties. Our graph model represents materials as element graphs, with chemical formula serving as the only input. This approach ensures permutation invariance, offering a robust solution to prior limitations. By employing bootstrap methods to train on this individual GNN, we further enhance the reliability and accuracy of our predictions. With multi-task learning, we harness the power of extensive datasets to boost the performance of smaller ones. We introduce the inaugural version of the Materials Properties Prediction (MAPP) framework, empowering the prediction of material properties solely based on chemical formulas.


title: Geometry and analytic properties of the sliced Wasserstein space

abstract: The sliced Wasserstein metric compares probability measures on $\mathbb{R}^d$ by taking averages of the Wasserstein distances between projections of the measures to lines. The distance has found a range of applications in statistics and machine learning, as it is easier to approximate and compute than the Wasserstein distance in high dimensions. While the geometry of the Wasserstein metric is quite well understood, and has led to important advances, very little is known about the geometry and metric properties of the sliced Wasserstein (SW) metric. Here we show that when the measures considered are ``nice'' (e.g. within a positive multiples of the Lebesgue measure) then the SW metric is comparable to the (homogeneous) negative Sobolev norm $\dot H^{-(d+1)/2}$. On the other hand when the measures considered are close in the infinity transportation metric to a discrete measure, then the SW metric between them is close to a multiple of the Wasserstein metric. We characterize the tangent space of the SW space, show that the speed of curves in the space can be described by a quadratic form, but that the SW space is not a length space. We establish a number of properties of the metric given by the minimal length of curves between measures -- the SW length. Finally we highlight the consequences of these properties to the gradient flows in SW metric.


title: Improving Computational Efficiency for Powered Descent Guidance via Transformer-based Tight Constraint Prediction

abstract: In this work, we present Transformer-based Powered Descent Guidance (T-PDG), a scalable algorithm for reducing the computational complexity of the direct optimization formulation of the spacecraft powered descent guidance problem. T-PDG uses data from prior runs of trajectory optimization algorithms to train a transformer neural network, which accurately predicts the relationship between problem parameters and the globally optimal solution for the powered descent guidance problem. The solution is encoded as the set of tight constraints corresponding to the constrained minimum-cost trajectory and the optimal final time of landing. By leveraging the attention mechanism of transformer neural networks, large sequences of time series data can be accurately predicted when given only the spacecraft state and landing site parameters. When applied to the real problem of Mars powered descent guidance, T-PDG reduces the time for computing the 3 degree of freedom fuel-optimal trajectory, when compared to lossless convexification, from an order of 1-8 seconds to less than 500 milliseconds. A safe and optimal solution is guaranteed by including a feasibility check in T-PDG before returning the final trajectory.


title: Explicit zero density estimate near unity

abstract: We will provide the first explicit zero-density estimate for $\zeta$ of the form $N(\sigma,T)\le \mathcal{C}T^{B(1-\sigma)^{3/2}}(\log T)^C$. In particular, we improve $C$ to $10393/900=11.547\dots.$


title: Differentiable Fluid Physics Parameter Identification Via Stirring

abstract: Fluid interactions permeate daily human activities, with properties like density and viscosity playing pivotal roles in household tasks. While density estimation is straightforward through Archimedes' principle, viscosity poses a more intricate challenge, especially given the varied behaviors of Newtonian and non-Newtonian fluids. These fluids, which differ in their stress-strain relationships, are delineated by specific constitutive models such as the Carreau, Cross, and Herschel-Bulkley models, each possessing unique viscosity parameters. This study introduces a novel differentiable fitting framework, DiffStir, tailored to identify key physics parameters via the common daily operation of stirring. By employing a robotic arm for stirring and harnessing a differentiable Material Point Method (diffMPM)-based simulator, the framework can determine fluid parameters by matching observations from both the simulator and the real world. Recognizing the distinct preferences of the aforementioned constitutive models for specific fluids, an online strategy was adopted to adaptively select the most fitting model based on real-world data. Additionally, we propose a refining neural network to bridge the sim-to-real gap and mitigate sensor noise-induced inaccuracies. Comprehensive experiments were conducted to validate the efficacy of DiffStir, showcasing its precision in parameter estimation when benchmarked against reported literature values. More experiments and videos can be found in the supplementary materials and on the website: https://sites.google.com/view/diffstir.


title: Unobscured central broad line regions in Type-1.9 AGN SDSS J1241+2602

abstract: In this manuscript, strong evidence is reported to support unobscured broad line regions (BLRs) in Type-1.9 AGN SDSS J1241+2602 with reliable broad H$\alpha$ but no broad H$\beta$. Commonly, disappearance of broad H$\beta$ can be explained by the AGN unified model expected heavily obscured BLRs in Type-1.9 AGN. Here, based on properties of two kinds of BH masses, the virial BH mass and the BH mass through the \msig relation, an independent method is proposed to test whether are there unobscured central BLRs in a Type-1.9 AGN. By the reliable measurement of stellar velocity dispersion about 110$\pm$12km/s through the host galaxy absorption features in \obj, the BH mass through the \msig relation is consistent with the virial BH mass $(3.43\pm1.25)\times10^7{\rm M_\odot}$ determined through properties of the observed broad H$\alpha$ without considering effects of obscurations in SDSS J1241+2602. Meanwhile, if considering heavily obscured BLRs in SDSS J1241+2602, the reddening corrected virial BH mass is tens of times larger than the \msig expected value, leading SDSS J1241+2602 to be an outlier in the \msig space with confidence level higher than $5\sigma$. Therefore, the unobscured BLRs are preferred in the Type-1.9 AGN SDSS J1241+2602. The results indicate that it is necessary to check whether unobscured central BLRs are common in Type-1.9 AGN, when to test the AGN unified model of AGN by properties of Type-1.9 AGN.


title: On neural and dimensional collapse in supervised and unsupervised contrastive learning with hard negative sampling

abstract: For a widely-studied data model and general loss and sample-hardening functions we prove that the Supervised Contrastive Learning (SCL), Hard-SCL (HSCL), and Unsupervised Contrastive Learning (UCL) risks are minimized by representations that exhibit Neural Collapse (NC), i.e., the class means form an Equianglular Tight Frame (ETF) and data from the same class are mapped to the same representation. We also prove that for any representation mapping, the HSCL and Hard-UCL (HUCL) risks are lower bounded by the corresponding SCL and UCL risks. Although the optimality of ETF is known for SCL, albeit only for InfoNCE loss, its optimality for HSCL and UCL under general loss and hardening functions is novel. Moreover, our proofs are much simpler, compact, and transparent. We empirically demonstrate, for the first time, that ADAM optimization of HSCL and HUCL risks with random initialization and suitable hardness levels can indeed converge to the NC geometry if we incorporate unit-ball or unit-sphere feature normalization. Without incorporating hard negatives or feature normalization, however, the representations learned via ADAM suffer from dimensional collapse (DC) and fail to attain the NC geometry.


title: Precompactness of domains with lower Ricci curvature bound under Gromov-Hausdorff topology

abstract: Based on a quantitative version of the classical Hopf-Rinow theorem in terms of the doubling property, we prove a new precompactness principle in the (pointed) Gromov-Hausdorff topology for domains in (maybe incomplete) Riemannian manifolds with a lower Ricci curvature bound, which are applicable to those with a Reifenberg-flat boundary, or the covering spaces of balls naturally appear in the study of local geometry and topology of manifolds with lower curvature bounds.


title: Differentiable Cloth Parameter Identification and State Estimation in Manipulation

abstract: In the realm of robotic cloth manipulation, accurately estimating the cloth state during or post-execution is imperative. However, the inherent complexities in a cloth's dynamic behavior and its near-infinite degrees of freedom (DoF) pose significant challenges. Traditional methods have been restricted to using keypoints or boundaries as cues for cloth state, which do not holistically capture the cloth's structure, especially during intricate tasks like folding. Additionally, the critical influence of cloth physics has often been overlooked in past research. Addressing these concerns, we introduce DiffCP, a novel differentiable pipeline that leverages the Anisotropic Elasto-Plastic (A-EP) constitutive model, tailored for differentiable computation and robotic tasks. DiffCP adopts a ``real-to-sim-to-real'' methodology. By observing real-world cloth states through an RGB-D camera and projecting this data into a differentiable simulator, the system identifies physics parameters by minimizing the geometric variance between observed and target states. Extensive experiments demonstrate DiffCP's ability and stability to determine physics parameters under varying manipulations, grasping points, and speeds. Additionally, its applications extend to cloth material identification, manipulation trajectory generation, and more notably, enhancing cloth pose estimation accuracy. More experiments and videos can be found in the supplementary materials and on the website: https://sites.google.com/view/diffcp.


title: Unusual quasiparticles and tunneling conductance in quantum point contacts in $\nu=2/3$ fractional quantum Hall systems

abstract: Understanding topological matter in the fractional quantum Hall (FQH) effect requires identifying the nature of edge state quasiparticles. FQH edge state at the filling factor $\nu=2/3$ in the spin-polarized and non-polarized phases is represented by the two modes of composite fermions (CF) with the parallel or opposite spins described by the chiral Luttinger liquids. Tunneling through a quantum point contact (QPC) in such systems between different or similar spin phases is solved exactly. With the increase of the applied voltage, the QPC conductance grows from zero and saturates at $e^2/2h$ while a weak electron tunneling between the edge modes with the same spin transforms into a backscattering carried by the charge $q=e/2$ quasiparticles. These unusual quasiparticles and conductance plateau emerge in the QPC with one or two CF modes scattering into a single mode, as occurs in these systems. We propose experiments on the applied voltage and temperature dependence of the QPC conductance and noise that can shed light on the nature of edge states and FQH transport.


title: SCAAT: Improving Neural Network Interpretability via Saliency Constrained Adaptive Adversarial Training

abstract: Deep Neural Networks (DNNs) are expected to provide explanation for users to understand their black-box predictions. Saliency map is a common form of explanation illustrating the heatmap of feature attributions, but it suffers from noise in distinguishing important features. In this paper, we propose a model-agnostic learning method called Saliency Constrained Adaptive Adversarial Training (SCAAT) to improve the quality of such DNN interpretability. By constructing adversarial samples under the guidance of saliency map, SCAAT effectively eliminates most noise and makes saliency maps sparser and more faithful without any modification to the model architecture. We apply SCAAT to multiple DNNs and evaluate the quality of the generated saliency maps on various natural and pathological image datasets. Evaluations on different domains and metrics show that SCAAT significantly improves the interpretability of DNNs by providing more faithful saliency maps without sacrificing their predictive power.


title: Counter-Empirical Attacking based on Adversarial Reinforcement Learning for Time-Relevant Scoring System

abstract: Scoring systems are commonly seen for platforms in the era of big data. From credit scoring systems in financial services to membership scores in E-commerce shopping platforms, platform managers use such systems to guide users towards the encouraged activity pattern, and manage resources more effectively and more efficiently thereby. To establish such scoring systems, several "empirical criteria" are firstly determined, followed by dedicated top-down design for each factor of the score, which usually requires enormous effort to adjust and tune the scoring function in the new application scenario. What's worse, many fresh projects usually have no ground-truth or any experience to evaluate a reasonable scoring system, making the designing even harder. To reduce the effort of manual adjustment of the scoring function in every new scoring system, we innovatively study the scoring system from the preset empirical criteria without any ground truth, and propose a novel framework to improve the system from scratch. In this paper, we propose a "counter-empirical attacking" mechanism that can generate "attacking" behavior traces and try to break the empirical rules of the scoring system. Then an adversarial "enhancer" is applied to evaluate the scoring system and find the improvement strategy. By training the adversarial learning problem, a proper scoring function can be learned to be robust to the attacking activity traces that are trying to violate the empirical criteria. Extensive experiments have been conducted on two scoring systems including a shared computing resource platform and a financial credit system. The experimental results have validated the effectiveness of our proposed framework.


title: Enhancing power grid resilience to cyber-physical attacks using distributed retail electricity markets

abstract: We propose using a hierarchical retail market structure to alert and dispatch resources to mitigate cyber-physical attacks on a distribution grid. We simulate attacks where a number of generation nodes in a distribution grid are attacked. We show that the market is able to successfully meet the shortfall between demand and supply by utilizing the flexibility of remaining resources while minimizing any extra power that needs to be imported from the main transmission grid. This includes utilizing upward flexibility or reserves of remaining online generators and some curtailment or shifting of flexible loads, which results in higher costs. Using price signals and market-based coordination, the grid operator can achieve its objectives without direct control over distributed energy resources and is able to accurately compensate prosumers for the grid support they provide.


title: OW-SLR: Overlapping Windows on Semi-Local Region for Image Super-Resolution

abstract: There has been considerable progress in implicit neural representation to upscale an image to any arbitrary resolution. However, existing methods are based on defining a function to predict the Red, Green and Blue (RGB) value from just four specific loci. Relying on just four loci is insufficient as it leads to losing fine details from the neighboring region(s). We show that by taking into account the semi-local region leads to an improvement in performance. In this paper, we propose applying a new technique called Overlapping Windows on Semi-Local Region (OW-SLR) to an image to obtain any arbitrary resolution by taking the coordinates of the semi-local region around a point in the latent space. This extracted detail is used to predict the RGB value of a point. We illustrate the technique by applying the algorithm to the Optical Coherence Tomography-Angiography (OCT-A) images and show that it can upscale them to random resolution. This technique outperforms the existing state-of-the-art methods when applied to the OCT500 dataset. OW-SLR provides better results for classifying healthy and diseased retinal images such as diabetic retinopathy and normals from the given set of OCT-A images. The project page is available at https://rishavbb.github.io/ow-slr/index.html


title: Dynamic Association Learning of Self-Attention and Convolution in Image Restoration

abstract: CNNs and Self attention have achieved great success in multimedia applications for dynamic association learning of self-attention and convolution in image restoration. However, CNNs have at least two shortcomings: 1) limited receptive field; 2) static weight of sliding window at inference, unable to cope with the content diversity.In view of the advantages and disadvantages of CNNs and Self attention, this paper proposes an association learning method to utilize the advantages and suppress their shortcomings, so as to achieve high-quality and efficient inpainting. We regard rain distribution reflects the degradation location and degree, in addition to the rain distribution prediction. Thus, we propose to refine background textures with the predicted degradation prior in an association learning manner. As a result, we accomplish image deraining by associating rain streak removal and background recovery, where an image deraining network and a background recovery network are designed for two subtasks. The key part of association learning is a novel multi-input attention module. It generates the degradation prior and produces the degradation mask according to the predicted rainy distribution. Benefited from the global correlation calculation of SA, MAM can extract the informative complementary components from the rainy input with the degradation mask, and then help accurate texture restoration. Meanwhile, SA tends to aggregate feature maps with self-attention importance, but convolution diversifies them to focus on the local textures. A hybrid fusion network involves one residual Transformer branch and one encoder-decoder branch. The former takes a few learnable tokens as input and stacks multi-head attention and feed-forward networks to encode global features of the image. The latter, conversely, leverages the multi-scale encoder-decoder to represent contexture knowledge.


title: Orthogonal projections in the plane over prime order fields

abstract: We give an upper bound on the number of exceptional orthogonal projections of a small set of points in a plane over a prime order field, which makes progress toward a conjecture of Chen (2018). This theorem relies on a new upper bound on the number of incidences between an arbitrary set of lines and a set of points contained in a reasonably small pencil of lines. We also prove a new upper bound on the number of incidences between points and lines when both are Cartesian products in an appropriate sense.


title: Lagrangian dynamics and regularity of the spin Euler equation

abstract: We derive the spin Euler equation for ideal flows by applying the spherical Clebsch mapping. This equation is based on the spin vector rather than the velocity. It enables a feasible Lagrangian study of fluid dynamics, as the isosurface of a spin-vector component is a vortex surface and material surface in ideal flows. The spin Euler equation is also equivalent to a special case of the Landau-Lifshitz equation with a specific effective magnetic field, revealing a possible connection between ideal flow and magnetic crystal. We conduct direct numerical simulations of three ideal flows of the vortex knot, vortex link and modified Taylor-Green flow by solving the spin Euler equation. The evolution of the Lagrangian vortex surface illustrates that the regions with large vorticity are rapidly stretched into spiral sheets. We establish a non-blowup criterion for the spin Euler equation, suggesting that the Laplacian of the spin vector must diverge if the solution forms a singularity at some finite time. The DNS result exhibits a pronounced double-exponential growth of the maximum norm of Laplacian of the spin vector, showing no evidence of the finite-time singularity formation if the double-exponential growth holds at later times. Moreover, the present criterion with Lagrangian nature appears to be more sensitive than the Beale-Kato-Majda criterion in detecting the flows that are incapable of producing finite-time singularities.


title: Fuel-Optimal Powered Descent Guidance for Hazardous Terrain

abstract: Future interplanetary missions will carry more and more sensitive equipment critical for setting up bases for crewed missions. The ability to manoeuvre around hazardous terrain thus becomes a critical mission aspect. However, large diverts and manoeuvres consume a significant amount of fuel, leading to less fuel remaining for emergencies or return missions. Thus, requiring more fuel to be carried onboard. This work presents fuel-optimal guidance to avoid hazardous terrain and safely land at the desired location. We approximate the hazardous terrain as step-shaped polygons and define barriers around the terrain. Using an augmented cost functional, fuel-optimal guidance command, which avoids the terrain, is derived. The results are validated using computer simulations and tested against many initial conditions to prove their effectiveness.


title: Extension and lifting of G-bundles on stacks

abstract: We study extension properties for morphisms of stacks of bundles for group algebraic spaces. Applications are a short proof of the classification of bundles on the projective line for smooth geometrically reductive groups and the existence of splittings of filtered fiber functors for gerbes bound by affine pro-smooth group schemes defined over rings.


title: Cross-modal Prompts: Adapting Large Pre-trained Models for Audio-Visual Downstream Tasks

abstract: In recent years, the deployment of large-scale pre-trained models in audio-visual downstream tasks has yielded remarkable outcomes. However, these models, primarily trained on single-modality unconstrained datasets, still encounter challenges in feature extraction for multi-modal tasks, leading to suboptimal performance. This limitation arises due to the introduction of irrelevant modality-specific information during encoding, which adversely affects the performance of downstream tasks. To address this challenge, this paper proposes a novel Dual-Guided Spatial-Channel-Temporal (DG-SCT) attention mechanism. This mechanism leverages audio and visual modalities as soft prompts to dynamically adjust the parameters of pre-trained models based on the current multi-modal input features. Specifically, the DG-SCT module incorporates trainable cross-modal interaction layers into pre-trained audio-visual encoders, allowing adaptive extraction of crucial information from the current modality across spatial, channel, and temporal dimensions, while preserving the frozen parameters of large-scale pre-trained models. Experimental evaluations demonstrate that our proposed model achieves state-of-the-art results across multiple downstream tasks, including AVE, AVVP, AVS, and AVQA. Furthermore, our model exhibits promising performance in challenging few-shot and zero-shot scenarios. The source code and pre-trained models are available at https://github.com/haoyi-duan/DG-SCT.


title: Scattering description of edge states in Aharonov-Bohm triangle chains

abstract: Scattering theory has been suggested as a convenient method to identify topological phases of matter, in particular of disordered systems for which the Bloch band-theory approach is inapplicable. Here we examine this idea, employing as a benchmark a one-dimensional triangle chain whose versatility yields a scattering matrix that ``flows" in parameter space among several members of the topology classification scheme. Our results show that the reflection amplitudes (from both ends of a sufficiently long chain) do indicate the appearance of edge states in {\it all} (topological and non-topological) cases. For the topological cases, the transmission has a peak at the topological phase transition, which happens at the Fermi energy. A peak still exists as one moves into the non-topological `trivial' regions, in which another transmission peak may occur at nonzero energy, at which a relevant edge state appears in the isolated chain. For finite chains, the peak in the transmission strongly depends on their coupling of the leads, and {\it not} on the phase transition of the isolated chain. In any case, {\it the appearance of a peak in the transmission is not sufficient to conclude that the system undergoes a topological phase transition.}


title: The High Energy X-ray Probe (HEX-P): The Future of Hard X-ray Dual AGN Science

abstract: A fundamental goal of modern-day astrophysics is to understand the connection between supermassive black hole (SMBH) growth and galaxy evolution. Merging galaxies offer one of the most dramatic channels for galaxy evolution known, capable of driving inflows of gas into galactic nuclei, potentially fueling both star formation and central SMBH activity. Dual active galactic nuclei (dual AGNs) in late-stage mergers with nuclear pair separations $<10$ kpc are thus ideal candidates to study SMBH growth along the merger sequence since they coincide with the most transformative period for galaxies. However, dual AGNs can be extremely difficult to confirm and study. Hard X-ray ($>10$ keV) studies offer a relatively contamination-free tool for probing the dense obscuring environments predicted to surround the majority of dual AGN in late-stage mergers. To date, only a handful of the brightest and closest systems have been studied at these energies due to the demanding instrumental requirements involved. We demonstrate the unique capabilities of HEX-P to spatially resolve the soft and - for the first time - hard X-ray counterparts of closely-separated ($\sim2''-5''$) dual AGNs in the local Universe. By incorporating state-of-the-art physical torus models, we reproduce realistic broadband X-ray spectra expected for deeply embedded accreting SMBHs. Hard X-ray spatially resolved observations of dual AGNs - accessible only to HEX-P - will hence transform our understanding of dual AGN in the nearby Universe.


title: Weakly-supervised Deep Cognate Detection Framework for Low-Resourced Languages Using Morphological Knowledge of Closely-Related Languages

abstract: Exploiting cognates for transfer learning in under-resourced languages is an exciting opportunity for language understanding tasks, including unsupervised machine translation, named entity recognition and information retrieval. Previous approaches mainly focused on supervised cognate detection tasks based on orthographic, phonetic or state-of-the-art contextual language models, which under-perform for most under-resourced languages. This paper proposes a novel language-agnostic weakly-supervised deep cognate detection framework for under-resourced languages using morphological knowledge from closely related languages. We train an encoder to gain morphological knowledge of a language and transfer the knowledge to perform unsupervised and weakly-supervised cognate detection tasks with and without the pivot language for the closely-related languages. While unsupervised, it overcomes the need for hand-crafted annotation of cognates. We performed experiments on different published cognate detection datasets across language families and observed not only significant improvement over the state-of-the-art but also our method outperformed the state-of-the-art supervised and unsupervised methods. Our model can be extended to a wide range of languages from any language family as it overcomes the requirement of the annotation of the cognate pairs for training. The code and dataset building scripts can be found at https://github.com/koustavagoswami/Weakly_supervised-Cognate_Detection


title: The Ground State Lattice Distortion of CsV$_{3}$Sb$_{5}$ Revealed by de Haas-van Alphen Oscillations

abstract: The recently discovered AV$_{3}$Sb$_{5}$ (A = K, Rb, Cs) compounds have garnered intense attention in the scientific community due to their unique characteristics as kagome superconductors coexisting with a charge density wave (CDW) order. To comprehend the electronic properties of this system, it is essential to understand the lattice distortions associated with the CDW order and the ground state electronic behavior. Here, we comprehensively examine the Fermi surface by a combination of angle-dependent torque magnetometry and density functional theory calculations. We observe magnetic breakdown in the de Haas-van Alphen oscillations under high magnetic fields. Additionally, by examining the angular and temperature variations in quantum oscillation frequencies, we gain insight into the evolution of the three-dimensional like Fermi surfaces and the cyclotron masses of the orbits, which are consistent with weak electron-phonon coupling. Notably, further comparisons indicate that the 2$\times$2$\times$2 Star-of-David (SoD) distortion is more compatible with both high frequency data above 1000\,T and low frequency data below 500\,T, while the 2$\times$2$\times$2 Tri-Hexagonal (TrH) distortion aligns well with experimental data at mid frequencies. This finding implies the inherent coexistence of both TrH and SoD 2$\times$2$\times$2 patterns within the CDW order. These observations provide key insights into the interplay among effective electronic dimensionality, CDW state, and superconductivity.


title: A DNN for CMS track classification and selection

abstract: The upgrade of the track classification and selection step of the CMS tracking to a Deep Neural Network is presented. The CMS tracking follows an iterative approach: tracks are reconstructed in multiple passes starting from the ones that are easiest to find and moving to the ones with more complex characteristics (lower transverse momentum, high displacement). The track classification comes into play at the end of each iteration. A classifier using a multivariate analysis is applied after each iteration and several selection criteria are defined. If a track meets the high purity requirement, its hits are removed from the hit collection, thus simplifying the later iterations, and making the track classification an integral part of the reconstruction process. Tracks passing loose selections are also saved for physics analysis usage. The CMS experiment improved the track classification starting from a parametric selection used in Run 1, moving to a Boosted Decision Tree in Run 2, and finally to a Deep Neural Network in Run 3. An overview of the Deep Neural Network training and current performance is shown.


title: Assessing nozzle flow dynamics in Fused Filament Fabrication through the parametric map $\alpha-\lambda$

abstract: Polymer rheology profoundly influences the intricate dynamics of material extrusion in Fused Filament Fabrication (FFF). This numerical study, which uses the Giesekus model fed with a full rheometric experimental data set, meticulously examines the molten flow patterns inside the printing nozzle during FFF. Our findings reveal new insights into the interplay between elastic stresses and complex flow patterns, highlighting their substantial role in forming upstream vortices. The parametric map $\alpha$-$\lambda$ from the Giesekus model allowed us to sort the materials and connect the polymer rheology with the FFF nozzle flow dynamics. The identification of elastic instabilities, the characterization of flow types, and the correlation between fluid rheology and pressure drop variations mark significant advancements in understanding FFF processes. These insights pave the way for tailored nozzle designs, promising enhanced efficiency and reliability in FFF-based additive manufacturing


title: Limited quantum advantage for stellar interferometry via continuous-variable teleportation

abstract: We consider stellar interferometry in the continuous-variable (CV) quantum information formalism and use the quantum Fisher information (QFI) to characterize the performance of three key strategies: direct interferometry (DI), local heterodyne measurement, and a CV teleportation-based strategy. In the lossless regime, we show that a squeezing parameter of $r\approx 2$ (18 dB) is required to reach $\approx$ 95\% of the QFI achievable with DI; such a squeezing level is beyond what has been achieved experimentally. In the low-loss regime, the CV teleportation strategy becomes inferior to DI, and the performance gap widens as loss increases. Curiously, in the high-loss regime, a small region of loss exists where the CV teleportation strategy slightly outperforms both DI and local heterodyne, representing a transition in the optimal strategy. We describe this advantage as limited because it occurs for a small region of loss, and the magnitude of the advantage is also small. We argue that practical difficulties further impede achieving any quantum advantage, limiting the merits of a CV teleportation-based strategy for stellar interferometry.


title: RAPID: Training-free Retrieval-based Log Anomaly Detection with PLM considering Token-level information

abstract: As the IT industry advances, system log data becomes increasingly crucial. Many computer systems rely on log texts for management due to restricted access to source code. The need for log anomaly detection is growing, especially in real-world applications, but identifying anomalies in rapidly accumulating logs remains a challenging task. Traditional deep learning-based anomaly detection models require dataset-specific training, leading to corresponding delays. Notably, most methods only focus on sequence-level log information, which makes the detection of subtle anomalies harder, and often involve inference processes that are difficult to utilize in real-time. We introduce RAPID, a model that capitalizes on the inherent features of log data to enable anomaly detection without training delays, ensuring real-time capability. RAPID treats logs as natural language, extracting representations using pre-trained language models. Given that logs can be categorized based on system context, we implement a retrieval-based technique to contrast test logs with the most similar normal logs. This strategy not only obviates the need for log-specific training but also adeptly incorporates token-level information, ensuring refined and robust detection, particularly for unseen logs. We also propose the core set technique, which can reduce the computational cost needed for comparison. Experimental results show that even without training on log data, RAPID demonstrates competitive performance compared to prior models and achieves the best performance on certain datasets. Through various research questions, we verified its capability for real-time detection without delay.


title: Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization

abstract: Large Language Models (LLMs) are proficient in natural language processing tasks, but their deployment is often restricted by extensive parameter sizes and computational demands. This paper focuses on post-training quantization (PTQ) in LLMs, specifically 4-bit weight and 8-bit activation (W4A8) quantization, to enhance computational efficiency -- a topic less explored compared to weight-only quantization. We present two innovative techniques: activation-quantization-aware scaling (AQAS) and sequence-length-aware calibration (SLAC) to enhance PTQ by considering the combined effects on weights and activations and aligning calibration sequence lengths to target tasks. Moreover, we introduce dINT, a hybrid data format combining integer and denormal representations, to address the underflow issue in W4A8 quantization, where small values are rounded to zero. Through rigorous evaluations of LLMs, including OPT and LLaMA, we demonstrate that our techniques significantly boost task accuracies to levels comparable with full-precision models. By developing arithmetic units compatible with dINT, we further confirm that our methods yield a 2$\times$ hardware efficiency improvement compared to 8-bit integer MAC unit.


title: Global error estimates of high-order fully decoupled schemes for the Cahn-Hilliard-Navier-Stokes model of Two-Phase Incompressible Flows

abstract: In this paper we construct new fully decoupled and high-order implicit-explicit (IMEX) schemes for the two-phase incompressible flows based on the new generalized scalar auxiliary variable approach with optimal energy approximation (EOP-GSAV) for Cahn-Hilliard equation and consistent splitting method for Navier-Stokes equation. These schemes are linear, fully decoupled, unconditionally energy stable, only require solving a sequence of elliptic equations with constant coefficients at each time step, and provide a new technique to preserve the consistency between original energy and modified energy. We derive that numerical solutions of these schemes are uniformly bounded without any restriction on time step size. Furthermore, we carry out a rigorous error analysis for the first-order scheme and establish optimal global error estimates for the phase function, velocity and pressure in two and three-dimensional cases. Numerical examples are presented to validate the proposed schemes.


title: Exotic spectroscopy in a diquark model with a little help from AdS/QCD

abstract: Masses of heavy mesons, tetraquarks and pentaquarks computed in a potential model are shown. Tetraquarks are studied as bound states of a diquark and an antidiquark. Pentaquarks are constructed from a series of two-body interactions between the four quarks and the antiquark. New results on $Qs\bar Q \bar q$ and $QQ\bar Q \bar Q$ tetraquarks are also obtained.


title: Signatures of gas flows-I: Connecting the kinematics of the HI circumgalactic medium to galaxy rotation

abstract: The CGM hosts many physical processes with different kinematic signatures that affect galaxy evolution. We address the CGM-galaxy kinematic connection by quantifying the fraction of HI that is aligned with galaxy rotation with the equivalent width co-rotation fraction, $f_{\rm EWcorot}$. Using 70 quasar sightlines having HST/COS HI absorption (${12<\log (N(HI)/{\rm cm}^{-2})<20}$) within $5R_{\rm vir}$ of $z<0.6$ galaxies we find that $f_{\rm EWcorot}$ increases with increasing HI column density. $f_{\rm EWcorot}$ is flat at $\sim0.6$ within $R_{\rm vir}$ and decreases beyond $R_{\rm vir}$ to $f_{\rm EWcorot}$$\sim0.35$. $f_{\rm EWcorot}$ also has a flat distribution with azimuthal and inclination angles within $R_{\rm vir}$, but decreases by a factor of two outside of $R_{\rm vir}$ for minor axis gas and by a factor of two for edge-on galaxies. Inside $R_{\rm vir}$, co-rotation dominated HI is located within $\sim 20$ deg of the major and minor axes. We surprisingly find equal amounts of HI absorption consistent with co-rotation along both major and minor axes within $R_{\rm vir}$. However, this co-rotation disappears along the minor axis beyond $R_{\rm vir}$, suggesting that if this gas is from outflows, then it is bound to galaxies. $f_{\rm EWcorot}$ is constant over two decades of halo mass, with no decrease for log(M$_{\rm h}/M_{\odot})>12$ as expected from simulations. Our results suggest that co-rotating gas flows are best found by searching for higher column density gas within $R_{\rm vir}$ and near the major and minor axes.


title: Signatures of gas flows-II: Connecting the kinematics of the multiphase circumgalactic medium to galaxy rotation

abstract: The multiphase CGM hosts critical processes that affect galaxy evolution such as accretion and outflows. We searched for evidence of these phenomena by using the EW co-rotation fraction ($f_{\rm EWcorot}$) to study the kinematic connection between the multiphase CGM and host galaxy rotation. We examined 27 systems with absorption lines from HST/COS (including, but not limited to, SiII, CII, SiIII, CIII, and OVI) within $21\leq D\leq~276$ kpc of galaxies. We find the median $f_{\rm EWcorot}$ for all ions is consistent within errors and the $f_{\rm EWcorot}$ increases with increasing N$(\rm HI)$. The $f_{\rm EWcorot}$ of lower ionization gas likely decreases with increasing $D/R_{\rm vir}$ while OVI and HI are more consistent with being flat. The $f_{\rm EWcorot}$ varies minimally as a function of azimuthal angle and is similar for all ions at a fixed azimuthal angle. The larger number of OVI detections enabled us to investigate where the majority of co-rotating gas is found. Highly co-rotating OVI primarily resides along the galaxies' major axis. Looking at the $f_{\rm EWcorot}$ as a function of ionization potential (${d{f_{\rm EWcorot}}}/{d{(eV)}}$), we find a stronger co-rotation signature for lower-ionization gas. There are suggestions of a connection between the CGM metallicity and major axis co-rotation where low-ionization gas with higher $f_{\rm EWcorot}$ exhibits lower metallicity and may trace large-scale filamentary inflows. Higher ionization gas with higher $f_{\rm EWcorot}$ exhibits higher metallicity and may instead trace co-planar recycled gas accretion. Our results stress the importance of comparing absorption originating from a range of ionization phases to differentiate between various gas flow scenarios.