title: Continuous Execution of High-Level Collaborative Tasks for Heterogeneous Robot Teams

abstract: We propose a control synthesis framework for a heterogeneous multi-robot system to satisfy collaborative tasks, where actions may take varying duration of time to complete. We encode tasks using the discrete logic LTL^\psi, which uses the concept of bindings to interleave robot actions and express information about relationship between specific task requirements and robot assignments. We present a synthesis approach to automatically generate a teaming assignment and corresponding discrete behavior that is correct-by-construction for continuous execution, while also implementing synchronization policies to ensure collaborative portions of the task are satisfied. We demonstrate our approach on a physical multi-robot system.


title: MolFusion: Multimodal Fusion Learning for Molecular Representations via Multi-granularity Views

abstract: Artificial Intelligence predicts drug properties by encoding drug molecules, aiding in the rapid screening of candidates. Different molecular representations, such as SMILES and molecule graphs, contain complementary information for molecular encoding. Thus exploiting complementary information from different molecular representations is one of the research priorities in molecular encoding. Most existing methods for combining molecular multi-modalities only use molecular-level information, making it hard to encode intra-molecular alignment information between different modalities. To address this issue, we propose a multi-granularity fusion method that is MolFusion. The proposed MolFusion consists of two key components: (1) MolSim, a molecular-level encoding component that achieves molecular-level alignment between different molecular representations. and (2) AtomAlign, an atomic-level encoding component that achieves atomic-level alignment between different molecular representations. Experimental results show that MolFusion effectively utilizes complementary multimodal information, leading to significant improvements in performance across various classification and regression tasks.


title: SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR

abstract: In this work, we propose a Switch-Conformer-based MoE system named SC-MoE for unified streaming and non-streaming code-switching (CS) automatic speech recognition (ASR), where we design a streaming MoE layer consisting of three language experts, which correspond to Mandarin, English, and blank, respectively, and equipped with a language identification (LID) network with a Connectionist Temporal Classification (CTC) loss as a router in the encoder of SC-MoE to achieve a real-time streaming CS ASR system. To further utilize the language information embedded in text, we also incorporate MoE layers into the decoder of SC-MoE. In addition, we introduce routers into every MoE layer of the encoder and the decoder and achieve better recognition performance. Experimental results show that the SC-MoE significantly improves CS ASR performances over baseline with comparable computational efficiency.


title: AutoOPE: Automated Off-Policy Estimator Selection

abstract: The Off-Policy Evaluation (OPE) problem consists of evaluating the performance of counterfactual policies with data collected by another one. This problem is of utmost importance for various application domains, e.g., recommendation systems, medical treatments, and many others. To solve the OPE problem, we resort to estimators, which aim to estimate in the most accurate way possible the performance that the counterfactual policies would have had if they were deployed in place of the logging policy. In the literature, several estimators have been developed, all with different characteristics and theoretical guarantees. Therefore, there is no dominant estimator, and each estimator may be the best one for different OPE problems, depending on the characteristics of the dataset at hand. While the selection of the estimator is a crucial choice for an accurate OPE, this problem has been widely overlooked in the literature. We propose an automated data-driven OPE estimator selection method based on machine learning. In particular, the core idea we propose in this paper is to create several synthetic OPE tasks and use a machine learning model trained to predict the best estimator for those synthetic tasks. We empirically show how our method is able to generalize to unseen tasks and make a better estimator selection compared to a baseline method on several real-world datasets, with a computational cost significantly lower than the one of the baseline.


title: Analytic torsion for irreducible holomorphic symplectic fourfolds with involution, I: Construction of an invariant

abstract: In this paper, we construct an invariant for irreducible holomorphic symplectic manifolds of $K3^{[2]}$-type with antisymplectic involution by using the equivariant analytic torsion. Moreover, we give a formula for the complex Hessian of the logarithm of the invariant.


title: Shifted moments of quadratic Dirichlet $L$-functions

abstract: We establish sharp upper bounds for shifted moments of quadratic Dirichlet $L$-function under the generalized Riemann hypothesis. Our result is then used to prove bounds for moments of quadratic Dirichlet character sums.


title: Precise determination of the bottom-quark on-shell mass using its four-loop relation to the $\overline{\rm MS}$-scheme running mass

abstract: In this paper, we explore the properties of the bottom-quark on-shell mass ($M_b$) by using its relation to the $\overline{\rm MS}$ mass (${\overline m}_b$). At present, this $\overline{\rm MS}$-on-shell relation has been known up to four-loop QCD corrections, which however still has a $\sim 2\%$ scale uncertainty by taking the renormalization scale as ${\overline m}_b({\overline m}_b)$ and varying it within the usual range of $[{\overline m}_b({\overline m}_b)/2, 2 {\overline m}_b({\overline m}_b)]$. The principle of maximum conformality (PMC) has been adopted to achieve a more precise $\overline{\rm MS}$-on-shell relation by eliminating such scale uncertainty. As a step forward, we also estimate the magnitude of the uncalculated higher-order terms by using the Pad\'{e} approximation approach. Numerically, by using the $\overline{\rm MS}$ mass ${\overline m}_b({\overline m}_b)=4.18^{+0.03}_{-0.02}$ GeV as an input, our predicted value for the bottom-quark on-shell mass becomes $M_b\simeq 5.36^{+0.10}_{-0.07}$ GeV, where the uncertainty is the squared average of the ones caused by $\Delta \alpha_s(M_Z)$, $\Delta {\overline m}_b({\overline m}_b)$, and the estimated magnitude of the higher-order terms.


title: USLC: Universal Self-Learning Control via Physical Performance Policy-Optimization Neural Network

abstract: This study addresses the challenge of achieving real-time Universal Self-Learning Control (USLC) in nonlinear dynamic systems with uncertain models. The proposed control method incorporates a Universal Self-Learning module, which introduces a model-free online executor-evaluator framework to enable controller adaptation in the presence of unknown disturbances. By leveraging a neural network model trained on historical system performance data, the controller can autonomously learn to approximate optimal performance during each learning cycle. Consequently, the controller's structural parameters are incrementally adjusted to achieve a performance threshold comparable to human-level performance. Utilizing nonlinear system stability theory, specifically in the context of three-dimensional manifold space, we demonstrate the stability of USLC in Lipschitz continuous systems. We illustrate the USLC framework numerically with two case studies: a low-order circuit system and a high-order morphing fixed-wing attitude control system. The simulation results verify the effectiveness and universality of the proposed method.


title: Automated Clinical Data Extraction with Knowledge Conditioned LLMs

abstract: The extraction of lung lesion information from clinical and medical imaging reports is crucial for research on and clinical care of lung-related diseases. Large language models (LLMs) can be effective at interpreting unstructured text in reports, but they often hallucinate due to a lack of domain-specific knowledge, leading to reduced accuracy and posing challenges for use in clinical settings. To address this, we propose a novel framework that aligns generated internal knowledge with external knowledge through in-context learning (ICL). Our framework employs a retriever to identify relevant units of internal or external knowledge and a grader to evaluate the truthfulness and helpfulness of the retrieved internal-knowledge rules, to align and update the knowledge bases. Our knowledge-conditioned approach also improves the accuracy and reliability of LLM outputs by addressing the extraction task in two stages: (i) lung lesion finding detection and primary structured field parsing, followed by (ii) further parsing of lesion description text into additional structured fields. Experiments with expert-curated test datasets demonstrate that this ICL approach can increase the F1 score for key fields (lesion size, margin and solidity) by an average of 12.9% over existing ICL methods.


title: Plasmonic polarization sensing of electrostatic superlattice potentials

abstract: Plasmon polaritons are formed by coupling light with delocalized electrons. The half-light and half-matter nature of plasmon polaritons endows them with unparalleled tunability via a range of parameters, such as dielectric environments and carrier density. Therefore, plasmon polaritons are expected to be tuned when in proximity to polar materials since the carrier density is tuned by an electrostatic potential; conversely, the plasmon polariton response might enable the sensing of polarization. Here, we use infrared nano-imaging and nano-photocurrent measurements to investigate heterostructures composed of graphene and twisted hexagonal boron nitride (t-BN), with alternating polarization in a triangular network of moir\'e stacking domains. We observe that the carrier density and the corresponding plasmonic response of graphene are modulated by polar domains in t-BN. In addition, we demonstrate that the nanometer-wide domain walls of graphene moir\'es superlattices, created by the polar domains of t-BN, provide momenta to assist the plasmonic excitations. Furthermore, our studies establish that the plasmon of graphene could function as a delicate sensor for polarization textures. The evolution of polarization textures in t-BN under uniform electric fields is tomographically examined via plasmonic imaging. Strikingly, no noticeable polarization switching is observed under applied electric fields up to 0.23 V/nm, at variance with transport reports. Our nano-images unambiguously reveal that t-BN with triangular domains acts like a ferrielectric, rather than ferroelectric claimed by many previous studies.


title: SideEye: A Side-Looking Catheter for Fenestrated Endovascular Aneurysm Repair Procedures

abstract: Fenestrated endovascular aneurysm repair remains a technically challenging procedure in the presence of complex anatomy, as it increases the difficulty of target vessel cannulation and prolongs procedure time and fluoroscopy radiation exposure. This paper aims to design, develop, and assess a novel steerable catheter, the SideEye, and compare its performance with conventional catheters in a thoracoabdominal aortic aneurysm phantom model. Users were asked to perform target vessel cannulation under fluoroscopic guidance using the SideEye and conventional non-steerable and steerable catheters. The experiment was divided into two cases based on the stent graft orientation (aligned and misaligned). Total procedure times, individual target vessel cannulation times, and exposure times were analyzed and compared in each case. In the misaligned case, the average cannulation times of all target vessels were $703 \pm 274$ s using the non-steerable catheter, $517 \pm 309$ s using the steerable catheter, and $199 \pm 91.0$ s using the SideEye. The average exposure times were $12 \pm 4.6$ min using the non-steerable catheter, $8.6 \pm 4.1$ min using the steerable catheter, and $3.0 \pm 1.1$ min using the SideEye. Target vessel cannulation using the SideEye significantly reduced procedure time and overall exposure time, compared to conventional devices.


title: Unified Architecture for a Quantum Lookup Table

abstract: Quantum access to arbitrary classical data encoded in unitary black-box oracles underlies interesting data-intensive quantum algorithms, such as machine learning or electronic structure simulation. The feasibility of these applications depends crucially on gate-efficient implementations of these oracles, which are commonly some reversible versions of the boolean circuit for a classical lookup table. We present a general parameterized architecture for quantum circuits implementing a lookup table that encompasses all prior work in realizing a continuum of optimal tradeoffs between qubits, non-Clifford gates, and error resilience, up to logarithmic factors. Our architecture assumes only local 2D connectivity, yet recovers results that previously required all-to-all connectivity, particularly, with the appropriate parameters, poly-logarithmic error scaling. We also identify novel regimes, such as simultaneous sublinear scaling in all parameters. These results enable tailoring implementations of the commonly used lookup table primitive to any given quantum device with constrained resources.


title: Real-time Structure Flow

abstract: This article introduces the structure flow field; a flow field that can provide high-speed robo-centric motion information for motion control of highly dynamic robotic devices and autonomous vehicles. Structure flow is the angular 3D velocity of the scene at a given pixel. We show that structure flow posses an elegant evolution model in the form of a Partial Differential Equation (PDE) that enables us to create dense flow predictions forward in time. We exploit this structure to design a predictor-update algorithm to compute structure flow in real time using image and depth measurements. The prediction stage takes the previous estimate of the structure flow and propagates it forward in time using a numerical implementation of the structure flow PDE. The predicted flow is then updated using new image and depth data. The algorithm runs up to 600 Hz on a Desktop GPU machine for 512x512 images with flow values up to 8 pixels. We provide ground truth validation on high-speed synthetic image sequences as well as results on real-life video on driving scenarios.


title: A Communication Satellite Servises Based Decentralized Network Protocol

abstract: In this paper, we present a decentralized network protocol, Space Network Protocol, based on Communication Satellite Services. The protocol outlines a method for distributing information about the status of satellite communication services across the entire blockchain network, facilitating fairness and transparency in all communication services. Our primary objective is to standardize the services delivered by all satellite networks under the communication satellite protocol. This standard remains intact regardless of potential unreliability associated with the satellites or the terminal hardware. We proposed PoD (Proof of Distribution) to verify if the communication satellites are online and PoF (Proof of Flow) to authenticate the actual data flow provided by the communication satellites. In addition, we also proposed PoM (Proof of Mesh) to verify if the communication satellites have successfully meshed together. Utilizing zero-knowledge proof and multi-party cryptographic computations, we can evaluate the service provisioning parameters of each satellite, even in the presence of potential terminal or network node fraud. This method offers technical support for the modeling of distributed network services.


title: Boosting Soft Q-Learning by Bounding

abstract: An agent's ability to leverage past experience is critical for efficiently solving new tasks. Prior work has focused on using value function estimates to obtain zero-shot approximations for solutions to a new task. In soft Q-learning, we show how any value function estimate can also be used to derive double-sided bounds on the optimal value function. The derived bounds lead to new approaches for boosting training performance which we validate experimentally. Notably, we find that the proposed framework suggests an alternative method for updating the Q-function, leading to boosted performance.


title: LLMs for Doctors: Leveraging Medical LLMs to Assist Doctors, Not Replace Them

abstract: The recent success of Large Language Models (LLMs) has had a significant impact on the healthcare field, providing patients with medical advice, diagnostic information, and more. However, due to a lack of professional medical knowledge, patients are easily misled by generated erroneous information from LLMs, which may result in serious medical problems. To address this issue, we focus on tuning the LLMs to be medical assistants who collaborate with more experienced doctors. We first conduct a two-stage survey by inspiration-feedback to gain a broad understanding of the real needs of doctors for medical assistants. Based on this, we construct a Chinese medical dataset called DoctorFLAN to support the entire workflow of doctors, which includes 92K Q\&A samples from 22 tasks and 27 specialists. Moreover, we evaluate LLMs in doctor-oriented scenarios by constructing the DoctorFLAN-\textit{test} containing 550 single-turn Q\&A and DotaBench containing 74 multi-turn conversations. The evaluation results indicate that being a medical assistant still poses challenges for existing open-source models, but DoctorFLAN can help them significantly. It demonstrates that the doctor-oriented dataset and benchmarks we construct can complement existing patient-oriented work and better promote medical LLMs research.


title: Local Linear Recovery Guarantee of Deep Neural Networks at Overparameterization

abstract: Determining whether deep neural network (DNN) models can reliably recover target functions at overparameterization is a critical yet complex issue in the theory of deep learning. To advance understanding in this area, we introduce a concept we term "local linear recovery" (LLR), a weaker form of target function recovery that renders the problem more amenable to theoretical analysis. In the sense of LLR, we prove that functions expressible by narrower DNNs are guaranteed to be recoverable from fewer samples than model parameters. Specifically, we establish upper limits on the optimistic sample sizes, defined as the smallest sample size necessary to guarantee LLR, for functions in the space of a given DNN. Furthermore, we prove that these upper bounds are achieved in the case of two-layer tanh neural networks. Our research lays a solid groundwork for future investigations into the recovery capabilities of DNNs in overparameterized scenarios.


title: Operating Single-Photon Circulator by Spinning Optical Resonators

abstract: A circulator is one of the crucial devices in quantum networks and simulations. We propose a four-port circulator that regulate the flow of single photons at muti-frequency points by studying the coherent transmission of a single photon in a coupled system of two resonators and two waveguides. When both resonators are static or rotate at the same angular velocity, single-photon transport demonstrates reciprocity; however, when the angular velocities differ, four distinct frequency points emerge where photon circulation can occur. In particular, when the angular velocities of the two resonators are equal and opposite, there are two different frequency points where photon circulation can be achieved, and there is a frequency point where a single photon input from any waveguide can be completely routed to the other waveguide. Interestingly, by rotating the two resonators, the single-photon circulation suppressed by the internal defect-induced backscattering can be restored.


title: Towards Synchronous Memorizability and Generalizability with Site-Modulated Diffusion Replay for Cross-Site Continual Segmentation

abstract: The ability to learn sequentially from different data sites is crucial for a deep network in solving practical medical image diagnosis problems due to privacy restrictions and storage limitations. However, adapting on incoming site leads to catastrophic forgetting on past sites and decreases generalizablity on unseen sites. Existing Continual Learning (CL) and Domain Generalization (DG) methods have been proposed to solve these two challenges respectively, but none of them can address both simultaneously. Recognizing this limitation, this paper proposes a novel training paradigm, learning towards Synchronous Memorizability and Generalizability (SMG-Learning). To achieve this, we create the orientational gradient alignment to ensure memorizability on previous sites, and arbitrary gradient alignment to enhance generalizability on unseen sites. This approach is named as Parallel Gradient Alignment (PGA). Furthermore, we approximate the PGA as dual meta-objectives using the first-order Taylor expansion to reduce computational cost of aligning gradients. Considering that performing gradient alignments, especially for previous sites, is not feasible due to the privacy constraints, we design a Site-Modulated Diffusion (SMD) model to generate images with site-specific learnable prompts, replaying images have similar data distributions as previous sites. We evaluate our method on two medical image segmentation tasks, where data from different sites arrive sequentially. Experimental results show that our method efficiently enhances both memorizability and generalizablity better than other state-of-the-art methods, delivering satisfactory performance across all sites. Our code will be available at: https://github.com/dyxu-cuhkcse/SMG-Learning.


title: MT2ST: Adaptive Multi-Task to Single-Task Learning

abstract: The conventional training approaches often face challenges in balancing the breadth of multi-task learning (MTL) with the depth of single-task learning (STL). To address this issue, we introduce the Multi-Task to Single-Task (MT2ST) framework, a groundbreaking approach that can combine the generalizability of MTL with the precision of STL. Our work include two strategies: 'Diminish' and 'Switch'. 'Diminish' Strategy will gradually reduce the influence of auxiliary tasks, while the 'Switch' strategy involves a shift from multi-tasking to single-tasking at a specific timepoint at the training process. In this paper, we propose the Multi-Task to Single-Task (MT2ST) framework, a novel approach that significantly enhances the efficiency and accuracy of word embedding training while concurrently addressing prevalent issues such as overfitting. Our empirical studies demonstrate that MT2ST can reduce training time by 67\% when contrasted with single-task learning approaches, and by 13\% compared to traditional multi-task learning methods. These findings underscore MT2ST's potential to be a powerful tools for word embedding training acceleration.


title: Diagnosis Assistant for Liver Cancer Utilizing a Large Language Model with Three Types of Knowledge

abstract: Liver cancer has a high incidence rate, but primary healthcare settings often lack experienced doctors. Advances in large models and AI technologies offer potential assistance. This work aims to address limitations in liver cancer diagnosis models, such as poor understanding of medical images, insufficient consideration of liver blood vessels, and ensuring accurate medical information. We propose a specialized diagnostic assistant to improve the diagnostic capabilities of less experienced doctors. Our framework combines large and small models, using optimized small models for precise patient image perception. Specifically, a segmentation network iteratively removes ambiguous pixels for liver tumor segmentation, and a multi-scale, multi-level differential network segments liver vessels. Features from these segmentations and medical records form a patient's personalized knowledge base. For diagnosis, Chain of Thought (COT) technology designs prompts mimicking experienced doctors' thought patterns, and Retrieval-Augmented Generation (RAG) technology provides answers based on reliable domain knowledge and trusted cases. Our small model methods improve liver tumor and vessel segmentation performance, resulting in more accurate information extraction. The large model component scores over 1 point higher on a 10-point scale in evaluations by doctors compared to control methods. Our method enhances semantic perception of medical images, improves classification of ambiguous pixels, and optimizes small object perception. It considers blood vessel positions for specific treatments and improves response credibility and interpretability by mimicking experienced doctors' thought processes using reliable resources. This approach has been recognized by doctors and benefits liver cancer auxiliary diagnosis.


title: Linear adiabatic analysis for general relativistic instability in primordial accreting supermassive stars

abstract: Accreting supermassive stars of $\gtrsim 10^{5}\,M_\odot$ will eventually collapse directly to a black hole via the general relativistic (GR) instability. Such direct collapses of supermassive stars are thought to be a possible formation channel for supermassive black holes at $z > 6$. In this work, we investigate the final mass of accreting Population III stars with constant accretion rates between $0.01$ and $1000\,M_\odot$yr$^{-1}$. We determine the final mass by solving the differential equation for the general relativistic linear adiabatic radial pulsations. We find that models with accretion rates $\gtrsim 0.05\,M_\odot$yr$^{-1}$ experience the GR instability at masses depending on the accretion rates. The critical masses are larger for higher accretion rates, ranging from $8\times10^{4}\,M_\odot$ for $0.05\,M_\odot$yr$^{-1}$ to $\sim10^6\,M_\odot$ for $1000\,M_\odot$yr$^{-1}$. The $0.05\,M_\odot$yr$^{-1}$ model reaches the GR instability at the end of the core hydrogen burning. The higher mass models with the higher accretion rates reach the GR instability during the hydrogen burning stage.


title: Emergence of Gibbs Ensemble as the Unique Steady State in Open Quantum Systems

abstract: We explicitly construct unique non-equilibrium steady state (NESS) of Lindblad master equation characterized by a Gibbs ensemble $\rho_{\text{NESS}} \propto e^{-\beta \tilde{H}}$, where the effective Hamiltonian $\tilde{H}$ consists only of $U(1)$ conserved charges of the original Hamiltonian. Specifically, when the original Hamiltonian has multiple charges, it is possible to couple them with bathes at different temperature respectively, but still leads to an equilibrium state. To access the Gibbs NESS, the jump operators need to be properly chosen to fulfill quantum detailed balance condition (qDBC). These jump operators are ladder operators for $\tilde{H}$ and jump process they generate form a vertex-weighted directed acyclic graph (wDAG). By studying the XX model and Fredkin model, we showcase how the Gibbs state emerges as the unique steady state.


title: Construction of almost K\"ahler solvmanifolds satisfying the hard-Lefschetz condition

abstract: A compact symplectic manifold $(M, \omega)$ is said to satisfy the hard-Lefschetz condition if it is possible to develop an analogue of Hodge theory for $(M, \omega)$. This loosely means that there is a notion of harmonicity of differential forms in $M$, depending on $\omega$ alone, such that every de Rham cohomology class in has a $\omega$-harmonic representative. In this article, we study two non-equivalent families of diagonal almost-abelian Lie algebras that admit a distinguished almost-K\"ahler structure and compute their cohomology explicitly. We show that they satisfy the hard-Lefschetz condition with respect to any left-invariant symplectic structure by exploiting an unforeseen connection with Kneser graphs. We also show that for some choice of parameters their associated simply connected, completely solvable Lie groups admit lattices, thereby constructing examples of almost-K\"ahler solvmanifolds satisfying the hard-Lefschetz condition, in such a way that their de Rham cohomology is fully known.


title: Multimodal foundation world models for generalist embodied agents

abstract: Learning generalist embodied agents, able to solve multitudes of tasks in different domains is a long-standing problem. Reinforcement learning (RL) is hard to scale up as it requires a complex reward design for each task. In contrast, language can specify tasks in a more natural way. Current foundation vision-language models (VLMs) generally require fine-tuning or other adaptations to be functional, due to the significant domain gap. However, the lack of multimodal data in such domains represents an obstacle toward developing foundation models for embodied applications. In this work, we overcome these problems by presenting multimodal foundation world models, able to connect and align the representation of foundation VLMs with the latent space of generative world models for RL, without any language annotations. The resulting agent learning framework, GenRL, allows one to specify tasks through vision and/or language prompts, ground them in the embodied domain's dynamics, and learns the corresponding behaviors in imagination. As assessed through large-scale multi-task benchmarking, GenRL exhibits strong multi-task generalization performance in several locomotion and manipulation domains. Furthermore, by introducing a data-free RL strategy, it lays the groundwork for foundation model-based RL for generalist embodied agents.


title: Torchtree: flexible phylogenetic model development and inference using PyTorch

abstract: Bayesian inference has predominantly relied on the Markov chain Monte Carlo (MCMC) algorithm for many years. However, MCMC is computationally laborious, especially for complex phylogenetic models of time trees. This bottleneck has led to the search for alternatives, such as variational Bayes, which can scale better to large datasets. In this paper, we introduce torchtree, a framework written in Python that allows developers to easily implement rich phylogenetic models and algorithms using a fixed tree topology. One can either use automatic differentiation, or leverage torchtree's plug-in system to compute gradients analytically for model components for which automatic differentiation is slow. We demonstrate that the torchtree variational inference framework performs similarly to BEAST in terms of speed and approximation accuracy. Furthermore, we explore the use of the forward KL divergence as an optimizing criterion for variational inference, which can handle discontinuous and non-differentiable models. Our experiments show that inference using the forward KL divergence tends to be faster per iteration compared to the evidence lower bound (ELBO) criterion, although the ELBO-based inference may converge faster in some cases. Overall, torchtree provides a flexible and efficient framework for phylogenetic model development and inference using PyTorch.


title: PharmGPT: Domain-Specific Large Language Models for Bio-Pharmaceutical and Chemistry

abstract: Large language models (LLMs) have revolutionized Natural Language Processing (NLP) by by minimizing the need for complex feature engineering. However, the application of LLMs in specialized domains like biopharmaceuticals and chemistry remains largely unexplored. These fields are characterized by intricate terminologies, specialized knowledge, and a high demand for precision areas where general purpose LLMs often fall short. In this study, we introduce PharmGPT, a suite of multilingual LLMs with 13 billion and 70 billion parameters, specifically trained on a comprehensive corpus of hundreds of billions of tokens tailored to the Bio-Pharmaceutical and Chemical sectors. Our evaluation shows that PharmGPT matches or surpasses existing general models on key benchmarks, such as NAPLEX, demonstrating its exceptional capability in domain-specific tasks. This advancement establishes a new benchmark for LLMs in the Bio-Pharmaceutical and Chemical fields, addressing the existing gap in specialized language modeling. Furthermore, this suggests a promising path for enhanced research and development in these specialized areas, paving the way for more precise and effective applications of NLP in specialized domains.


title: Revisiting the controversy over the time-dependent Aharonov-Bohm effect

abstract: The time-dependent Aharonov-Bohm (AB) effect considers the situation in which the magnetic flux inside the solenoid changes time-dependently. Different from the standard AB-effect, the problem is unexpectedly subtle and not easy to solve without any doubt, which is the reason why it is still in a state of unsettlement even theoretically. The difficulty originates from the fact that its theoretical analysis requires line-integral along a path in the 4-dimensional Minkowski space. The central controversy concerns the success or failure of the claim by Singleton and collaborators, which states that the time-dependent part of the AB-phase shift due to the magnetic vector potential is precisely cancelled by the effect of induced electric field generated by the time-variation of the magnetic flux. In this paper, we try to demonstrate that their cancellation argument would not be justified by going back to the basic quantum mechanical analysis of the charged particle motion under the presence of external electromagnetic potential. At the end, we conclude that the failure of the cancellation argument is due to unjustified application of the 4-dimensional Stokes theorem to the problem of time-dependent AB-effect.


title: Shrinkage Estimators for Beta Regression Models

abstract: The beta regression model is a useful framework to model response variables that are rates or proportions, that is to say, response variables which are continuous and restricted to the interval (0,1). As with any other regression model, parameter estimates may be affected by collinearity or even perfect collinearity among the explanatory variables. To handle these situations shrinkage estimators are proposed. In particular we develop ridge regression and LASSO estimators from a penalized likelihood perspective with a logit link function. The properties of the resulting estimators are evaluated through a simulation study and a real data application


title: ScanFormer: Referring Expression Comprehension by Iteratively Scanning

abstract: Referring Expression Comprehension (REC) aims to localize the target objects specified by free-form natural language descriptions in images. While state-of-the-art methods achieve impressive performance, they perform a dense perception of images, which incorporates redundant visual regions unrelated to linguistic queries, leading to additional computational overhead. This inspires us to explore a question: can we eliminate linguistic-irrelevant redundant visual regions to improve the efficiency of the model? Existing relevant methods primarily focus on fundamental visual tasks, with limited exploration in vision-language fields. To address this, we propose a coarse-to-fine iterative perception framework, called ScanFormer. It can iteratively exploit the image scale pyramid to extract linguistic-relevant visual patches from top to bottom. In each iteration, irrelevant patches are discarded by our designed informativeness prediction. Furthermore, we propose a patch selection strategy for discarded patches to accelerate inference. Experiments on widely used datasets, namely RefCOCO, RefCOCO+, RefCOCOg, and ReferItGame, verify the effectiveness of our method, which can strike a balance between accuracy and efficiency.


title: Improving Entity Recognition Using Ensembles of Deep Learning and Fine-tuned Large Language Models: A Case Study on Adverse Event Extraction from Multiple Sources

abstract: Adverse event (AE) extraction following COVID-19 vaccines from text data is crucial for monitoring and analyzing the safety profiles of immunizations. Traditional deep learning models are adept at learning intricate feature representations and dependencies in sequential data, but often require extensive labeled data. In contrast, large language models (LLMs) excel in understanding contextual information, but exhibit unstable performance on named entity recognition tasks, possibly due to their broad but unspecific training. This study aims to evaluate the effectiveness of LLMs and traditional deep learning models in AE extraction, and to assess the impact of ensembling these models on performance. In this study, we utilized reports and posts from the VAERS (n=621), Twitter (n=9,133), and Reddit (n=131) as our corpora. Our goal was to extract three types of entities: "vaccine", "shot", and "ae". We explored and fine-tuned (except GPT-4) multiple LLMs, including GPT-2, GPT-3.5, GPT-4, and Llama-2, as well as traditional deep learning models like RNN and BioBERT. To enhance performance, we created ensembles of the three models with the best performance. For evaluation, we used strict and relaxed F1 scores to evaluate the performance for each entity type, and micro-average F1 was used to assess the overall performance. The ensemble model achieved the highest performance in "vaccine", "shot", and "ae" with strict F1-scores of 0.878, 0.930, and 0.925, respectively, along with a micro-average score of 0.903. In conclusion, this study demonstrates the effectiveness and robustness of ensembling fine-tuned traditional deep learning models and LLMs, for extracting AE-related information. This study contributes to the advancement of biomedical natural language processing, providing valuable insights into improving AE extraction from text data for pharmacovigilance and public health surveillance.


title: A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Prediction

abstract: Pedestrian trajectory prediction plays a pivotal role in ensuring the safety and efficiency of various applications, including autonomous vehicles and traffic management systems. This paper proposes a novel method for pedestrian trajectory prediction, called multi-stage goal-driven network (MGNet). Diverging from prior approaches relying on stepwise recursive prediction and the singular forecasting of a long-term goal, MGNet directs trajectory generation by forecasting intermediate stage goals, thereby reducing prediction errors. The network comprises three main components: a conditional variational autoencoder (CVAE), an attention module, and a multi-stage goal evaluator. Trajectories are encoded using conditional variational autoencoders to acquire knowledge about the approximate distribution of pedestrians' future trajectories, and combined with an attention mechanism to capture the temporal dependency between trajectory sequences. The pivotal module is the multi-stage goal evaluator, which utilizes the encoded feature vectors to predict intermediate goals, effectively minimizing cumulative errors in the recursive inference process. The effectiveness of MGNet is demonstrated through comprehensive experiments on the JAAD and PIE datasets. Comparative evaluations against state-of-the-art algorithms reveal significant performance improvements achieved by our proposed method.


title: ViT-1.58b: Mobile Vision Transformers in the 1-bit Era

abstract: Vision Transformers (ViTs) have achieved remarkable performance in various image classification tasks by leveraging the attention mechanism to process image patches as tokens. However, the high computational and memory demands of ViTs pose significant challenges for deployment in resource-constrained environments. This paper introduces ViT-1.58b, a novel 1.58-bit quantized ViT model designed to drastically reduce memory and computational overhead while preserving competitive performance. ViT-1.58b employs ternary quantization, which refines the balance between efficiency and accuracy by constraining weights to {-1, 0, 1} and quantizing activations to 8-bit precision. Our approach ensures efficient scaling in terms of both memory and computation. Experiments on CIFAR-10 and ImageNet-1k demonstrate that ViT-1.58b maintains comparable accuracy to full-precision Vit, with significant reductions in memory usage and computational costs. This paper highlights the potential of extreme quantization techniques in developing sustainable AI solutions and contributes to the broader discourse on efficient model deployment in practical applications. Our code and weights are available at https://github.com/DLYuanGod/ViT-1.58b.


title: Flexible Conformal Highest Predictive Conditional Density Sets

abstract: We introduce our method, conformal highest conditional density sets (CHCDS), that forms conformal prediction sets using existing estimated conditional highest density predictive regions. We prove the validity of the method and that conformal adjustment is negligible under some regularity conditions. In particular, if we correctly specify the underlying conditional density estimator, the conformal adjustment will be negligible. When the underlying model is incorrect, the conformal adjustment provides guaranteed nominal unconditional coverage. We compare the proposed method via simulation and a real data analysis to other existing methods. Our numerical results show that the flexibility of being able to use any existing conditional density estimation method is a large advantage for CHCDS compared to existing methods.


title: Bidirectional-Reachable Hierarchical Reinforcement Learning with Mutually Responsive Policies

abstract: Hierarchical reinforcement learning (HRL) addresses complex long-horizon tasks by skillfully decomposing them into subgoals. Therefore, the effectiveness of HRL is greatly influenced by subgoal reachability. Typical HRL methods only consider subgoal reachability from the unilateral level, where a dominant level enforces compliance to the subordinate level. However, we observe that when the dominant level becomes trapped in local exploration or generates unattainable subgoals, the subordinate level is negatively affected and cannot follow the dominant level's actions. This can potentially make both levels stuck in local optima, ultimately hindering subsequent subgoal reachability. Allowing real-time bilateral information sharing and error correction would be a natural cure for this issue, which motivates us to propose a mutual response mechanism. Based on this, we propose the Bidirectional-reachable Hierarchical Policy Optimization (BrHPO)--a simple yet effective algorithm that also enjoys computation efficiency. Experiment results on a variety of long-horizon tasks showcase that BrHPO outperforms other state-of-the-art HRL baselines, coupled with a significantly higher exploration efficiency and robustness.


title: Leveraging Pre-trained Models for FF-to-FFPE Histopathological Image Translation

abstract: The two primary types of Hematoxylin and Eosin (H&E) slides in histopathology are Formalin-Fixed Paraffin-Embedded (FFPE) and Fresh Frozen (FF). FFPE slides offer high quality histopathological images but require a labor-intensive acquisition process. In contrast, FF slides can be prepared quickly, but the image quality is relatively poor. Our task is to translate FF images into FFPE style, thereby improving the image quality for diagnostic purposes. In this paper, we propose Diffusion-FFPE, a method for FF-to-FFPE histopathological image translation using a pre-trained diffusion model. Specifically, we employ a one-step diffusion model as the generator and fine-tune it with LoRA adapters using adversarial learning objectives. To ensure that the model effectively captures both global structural information and local details, we propose a multi-scale feature fusion (MFF) module. This module utilizes two VAE encoders to extract features of varying image sizes and performs feature fusion before feeding them into the UNet. Furthermore, we utilize a pre-trained vision-language model for histopathology as the backbone for the discriminator to further improve performance We conducted FF-to-FFPE translation experiments on the TCGA-NSCLC datasets, and our method achieved better performance compared to other methods. The code and models are released at https://github.com/QilaiZhang/Diffusion-FFPE.


title: Filtering Reconfigurable Intelligent Computational Surface for RF Spectrum Purification

abstract: The increasing demand for communication is degrading the electromagnetic (EM) transmission environment due to severe EM interference, significantly reducing the efficiency of the radio frequency (RF) spectrum. Metasurfaces, a promising technology for controlling desired EM waves, have recently received significant attention from both academia and industry. However, the potential impact of out-of-band signals has been largely overlooked, leading to RF spectrum pollution and degradation of wireless transmissions. To address this issue, we propose a novel surface structure called the Filtering Reconfigurable Intelligent Computational Surface (FRICS). We introduce two types of FRICS structures: one that dynamically reflects resonance band signals through a tunable spatial filter while absorbing out-of-band signals using metamaterials and the other one that dynamically amplifies in-band signals using computational metamaterials while reflecting out-of-band signals. To evaluate the performance of FRICS, we implement it in device-to-device (D2D) communication and vehicular-to-everything (V2X) scenarios. The experiments demonstrate the superiority of FRICS in signal-to-interference-noise ratio (SINR) and energy efficiency (EE). Finally, we discuss the critical challenges faced and promising techniques for implementing FRICS in future wireless systems.


title: The Smoluchowski-Kramers approximation for a system with arbitrary friction depending on both state and distribution

abstract: A system of stochastic differential equations describing diffusive phenomena, which has arbitrary friction depending on both state and distribution is investigated. The Smoluchowski-Kramers approximation is seen to describe dynamics in the small mass limit. We obtain the limiting equation and, in particular, the addition drift terms that appear in the limiting equation are expressed in terms of the solutions to the Lyapunov matrix equation and Sylvester matrix equation. Furthermore, we provide the rate of convergence and extend the system to encompass more general interactions and noise.


title: An Eulerian Meshless Method for Two-phase Flows with Embedded Geometries

abstract: We present a novel Eulerian meshless method for two-phase flows with arbitrary embedded geometries. The spatial derivatives are computed using the meshless generalized finite difference method (GFDM). The sharp phase interface is tracked using a volume fraction function. The volume fraction is advected using a method based on the minimisation of a directional flux-based error. For stability, the advection terms are discretised using upwinding schemes. In the vicinity of the embedded geometries, the signed distance function is used to populate the surface of the geometries to generate a body-conforming point cloud. Consequently, the points on the boundaries participate directly in the discretisation, unlike conventional immersed-boundary methods where they are either used to calculate momentum deficit (for example, continuous forcing) or conservation losses (for example, cut-cell methods). The boundary conditions are, therefore, directly imposed at these points on the embedded geometries, opening up the possibility for a discretisation that is body-conforming and spatially varying in resolution, while retaining the consistency of the scheme. We present benchmark test cases that validate the method for two-phase flows, flows with embedded boundaries and a combination of both.


title: Fuzzing at Scale: The Untold Story of the Scheduler

abstract: How to search for bugs in 1,000 programs using a pre-existing fuzzer and a standard PC? We consider this problem and show that a well-designed strategy that determines which programs to fuzz and for how long can greatly impact the number of bugs found across the programs. In fact, the impact of employing an effective strategy is comparable to that of utilizing a state-of-the-art fuzzer. The considered problem is referred to as fuzzing at scale, and the strategy as scheduler. We show that besides a naive scheduler, that allocates equal fuzz time to all programs, we can consider dynamic schedulers that adjust time allocation based on the ongoing fuzzing progress of individual programs. Such schedulers are superior because they lead both to higher number of total found bugs and to higher number of found bugs for most programs. The performance gap between naive and dynamic schedulers can be as wide (or even wider) as the gap between two fuzzers. Our findings thus suggest that the problem of advancing schedulers is fundamental for fuzzing at scale. We develop several schedulers and leverage the most sophisticated one to fuzz simultaneously our newly compiled benchmark of around 5,000 Ubuntu programs, and detect 4908 bugs.


title: On the binomial transforms of Ap\'ery-like sequences

abstract: In the proof of the irrationality of $\zeta(3)$ and $\zeta(2)$, Ap\'ery defined two integer sequences through $3$-term recurrences, which are known as the famous Ap\'ery numbers. Zagier, Almkvist--Zudilin and Cooper successively introduced the other $13$ sporadic sequences through variants of Ap\'ery's $3$-term recurrences. All of the $15$ sporadic sequences are called Ap\'ery-like sequences. Motivated by Gessel's congruences mod $24$ for the Ap\'ery numbers, we investigate the congruences in the form $u_n\equiv \alpha^n \pmod{N_{\alpha}}~(\alpha\in \mathbb{Z},N_{\alpha}\in \mathbb{N}^{+})$ for all of the $15$ Ap\'ery-like sequences $\{u_n\}_{n\ge 0}$. Let $N_{\alpha}$ be the largest positive integer such that $u_n\equiv \alpha^n \pmod{N_{\alpha}}$ for all non-negative integers $n$. We determine the values of $\max\{N_{\alpha}|\alpha \in \mathbb{Z}\}$ for all of the $15$ Ap\'ery-like sequences $\{u_n\}_{n\ge 0}$.The binomial transforms of Ap\'ery-like sequences provide us a unified approach to this type of congruences for Ap\'ery-like sequences.


title: AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning

abstract: Fine-tuning large language models (LLMs) has achieved remarkable performance across various natural language processing tasks, yet it demands more and more memory as model sizes keep growing. To address this issue, the recently proposed Memory-efficient Zeroth-order (MeZO) methods attempt to fine-tune LLMs using only forward passes, thereby avoiding the need for a backpropagation graph. However, significant performance drops and a high risk of divergence have limited their widespread adoption. In this paper, we propose the Adaptive Zeroth-order Tensor-Train Adaption (AdaZeta) framework, specifically designed to improve the performance and convergence of the ZO methods. To enhance dimension-dependent ZO estimation accuracy, we introduce a fast-forward, low-parameter tensorized adapter. To tackle the frequently observed divergence issue in large-scale ZO fine-tuning tasks, we propose an adaptive query number schedule that guarantees convergence. Detailed theoretical analysis and extensive experimental results on Roberta-Large and Llama-2-7B models substantiate the efficacy of our AdaZeta framework in terms of accuracy, memory efficiency, and convergence speed.


title: Emergence of a radio jet in the changing-look AGN 1ES 1927+654

abstract: We present multi-frequency (5-345 GHz) and multi-resolution radio observations of 1ES 1927+654, widely considered one of the most unusual and extreme changing-look active galactic nuclei (CL-AGN). The source was first designated a CL-AGN after an optical outburst in late 2017 and has since displayed considerable changes in X-ray emission, including the destruction and rebuilding of the X-ray corona in 2019-2020. Radio observations prior to 2023 show a faint and compact radio source not unusual for radio-quiet AGN. Starting in February 2023, 1ES 1927+654 began exhibiting a radio flare with a steep exponential rise, reaching a peak 60 times previous flux levels, and has maintained this higher level of radio emission for nearly a year. The 5-23 GHz spectrum is broadly similar to gigahertz-peaked radio sources, which are understood to be young radio jets less than ~1000 years old. Recent high-resolution VLBA observations at 23.5 GHz now show resolved extensions on either side of the core, with a separation of 0.14 pc, consistent with a new and mildly relativistic bipolar outflow. A steady increase in the soft X-ray band (0.3-2 keV) concurrent with the radio may be consistent with jet-driven shocked gas, though further observations are needed to test alternate scenarios. This source joins a growing number of CL-AGN and tidal disruption events which show late-time radio activity, years after the initial outburst.


title: Breaking the Barrier: Enhanced Utility and Robustness in Smoothed DRL Agents

abstract: Robustness remains a paramount concern in deep reinforcement learning (DRL), with randomized smoothing emerging as a key technique for enhancing this attribute. However, a notable gap exists in the performance of current smoothed DRL agents, often characterized by significantly low clean rewards and weak robustness. In response to this challenge, our study introduces innovative algorithms aimed at training effective smoothed robust DRL agents. We propose S-DQN and S-PPO, novel approaches that demonstrate remarkable improvements in clean rewards, empirical robustness, and robustness guarantee across standard RL benchmarks. Notably, our S-DQN and S-PPO agents not only significantly outperform existing smoothed agents by an average factor of $2.16\times$ under the strongest attack, but also surpass previous robustly-trained agents by an average factor of $2.13\times$. This represents a significant leap forward in the field. Furthermore, we introduce Smoothed Attack, which is $1.89\times$ more effective in decreasing the rewards of smoothed agents than existing adversarial attacks.


title: Data-driven imaging geometric recovery of ultrahigh resolution robotic micro-CT for in-vivo and other applications

abstract: We introduce an ultrahigh-resolution (50\mu m\) robotic micro-CT design for localized imaging of carotid plaques using robotic arms, cutting-edge detector, and machine learning technologies. To combat geometric error-induced artifacts in interior CT scans, we propose a data-driven geometry estimation method that maximizes the consistency between projection data and the reprojection counterparts of a reconstructed volume. Particularly, we use a normalized cross correlation metric to overcome the projection truncation effect. Our approach is validated on a robotic CT scan of a sacrificed mouse and a micro-CT phantom scan, both producing sharper images with finer details than that prior correction.


title: Evaluating Quality of Answers for Retrieval-Augmented Generation: A Strong LLM Is All You Need

abstract: We present a comprehensive evaluation of answer quality in Retrieval-Augmented Generation (RAG) applications using vRAG-Eval, a novel grading system that is designed to assess correctness, completeness, and honesty. We further map the grading of quality aspects aforementioned into a binary score, indicating an accept or reject decision, mirroring the intuitive "thumbs-up" or "thumbs-down" gesture commonly used in chat applications. This approach suits factual business settings where a clear decision opinion is essential. Our assessment applies vRAG-Eval to two Large Language Models (LLMs), evaluating the quality of answers generated by a vanilla RAG application. We compare these evaluations with human expert judgments and find a substantial alignment between GPT-4's assessments and those of human experts, reaching 83% agreement on accept or reject decisions. This study highlights the potential of LLMs as reliable evaluators in closed-domain, closed-ended settings, particularly when human evaluations require significant resources.


title: On Calibration of Speech Classification Models: Insights from Energy-Based Model Investigations

abstract: For speech classification tasks, deep learning models often achieve high accuracy but exhibit shortcomings in calibration, manifesting as classifiers exhibiting overconfidence. The significance of calibration lies in its critical role in guaranteeing the reliability of decision-making within deep learning systems. This study explores the effectiveness of Energy-Based Models in calibrating confidence for speech classification tasks by training a joint EBM integrating a discriminative and a generative model, thereby enhancing the classifiers calibration and mitigating overconfidence. Experimental evaluations conducted on three speech classification tasks specifically: age, emotion, and language recognition. Our findings highlight the competitive performance of EBMs in calibrating the speech classification models. This research emphasizes the potential of EBMs in speech classification tasks, demonstrating their ability to enhance calibration without sacrificing accuracy.


title: Learning Optimal Filters Using Variational Inference

abstract: Filtering-the task of estimating the conditional distribution of states of a dynamical system given partial, noisy, observations-is important in many areas of science and engineering, including weather and climate prediction. However, the filtering distribution is generally intractable to obtain for high-dimensional, nonlinear systems. Filters used in practice, such as the ensemble Kalman filter (EnKF), are biased for nonlinear systems and have numerous tuning parameters. Here, we present a framework for learning a parameterized analysis map-the map that takes a forecast distribution and observations to the filtering distribution-using variational inference. We show that this methodology can be used to learn gain matrices for filtering linear and nonlinear dynamical systems, as well as inflation and localization parameters for an EnKF. Future work will apply this framework to learn new filtering algorithms.


title: Exploring Energy-Based Models for Out-of-Distribution Detection in Dialect Identification

abstract: The diverse nature of dialects presents challenges for models trained on specific linguistic patterns, rendering them susceptible to errors when confronted with unseen or out-of-distribution (OOD) data. This study introduces a novel margin-enhanced joint energy model (MEJEM) tailored specifically for OOD detection in dialects. By integrating a generative model and the energy margin loss, our approach aims to enhance the robustness of dialect identification systems. Furthermore, we explore two OOD scores for OOD dialect detection, and our findings conclusively demonstrate that the energy score outperforms the softmax score. Leveraging Sharpness-Aware Minimization to optimize the training process of the joint model, we enhance model generalization by minimizing both loss and sharpness. Experiments conducted on dialect identification tasks validate the efficacy of Energy-Based Models and provide valuable insights into their performance.


title: Speech2UnifiedExpressions: Synchronous Synthesis of Co-Speech Affective Face and Body Expressions from Affordable Inputs

abstract: We present a multimodal learning-based method to simultaneously synthesize co-speech facial expressions and upper-body gestures for digital characters using RGB video data captured using commodity cameras. Our approach learns from sparse face landmarks and upper-body joints, estimated directly from video data, to generate plausible emotive character motions. Given a speech audio waveform and a token sequence of the speaker's face landmark motion and body-joint motion computed from a video, our method synthesizes the motion sequences for the speaker's face landmarks and body joints to match the content and the affect of the speech. We design a generator consisting of a set of encoders to transform all the inputs into a multimodal embedding space capturing their correlations, followed by a pair of decoders to synthesize the desired face and pose motions. To enhance the plausibility of synthesis, we use an adversarial discriminator that learns to differentiate between the face and pose motions computed from the original videos and our synthesized motions based on their affective expressions. To evaluate our approach, we extend the TED Gesture Dataset to include view-normalized, co-speech face landmarks in addition to body gestures. We demonstrate the performance of our method through thorough quantitative and qualitative experiments on multiple evaluation metrics and via a user study. We observe that our method results in low reconstruction error and produces synthesized samples with diverse facial expressions and body gestures for digital characters.


title: Large Language Models for Cuffless Blood Pressure Measurement From Wearable Biosignals

abstract: Large language models (LLMs) have captured significant interest from both academia and industry due to their impressive performance across various textual tasks. However, the potential of LLMs to analyze physiological time-series data remains an emerging research field. Particularly, there is a notable gap in the utilization of LLMs for analyzing wearable biosignals to achieve cuffless blood pressure (BP) measurement, which is critical for the management of cardiovascular diseases. This paper presents the first work to explore the capacity of LLMs to perform cuffless BP estimation based on wearable biosignals. We extracted physiological features from electrocardiogram (ECG) and photoplethysmogram (PPG) signals and designed context-enhanced prompts by combining these features with BP domain knowledge and user information. Subsequently, we adapted LLMs to BP estimation tasks through fine-tuning. To evaluate the proposed approach, we conducted assessments of ten advanced LLMs using a comprehensive public dataset of wearable biosignals from 1,272 participants. The experimental results demonstrate that the optimally fine-tuned LLM significantly surpasses conventional task-specific baselines, achieving an estimation error of 0.00 $\pm$ 9.25 mmHg for systolic BP and 1.29 $\pm$ 6.37 mmHg for diastolic BP. Notably, the ablation studies highlight the benefits of our context enhancement strategy, leading to an 8.9% reduction in mean absolute error for systolic BP estimation. This paper pioneers the exploration of LLMs for cuffless BP measurement, providing a potential solution to enhance the accuracy of cuffless BP measurement.


title: EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptation

abstract: In this report, we present our solutions to the EgoVis Challenges in CVPR 2024, including five tracks in the Ego4D challenge and three tracks in the EPIC-Kitchens challenge. Building upon the video-language two-tower model and leveraging our meticulously organized egocentric video data, we introduce a novel foundation model called EgoVideo. This model is specifically designed to cater to the unique characteristics of egocentric videos and provides strong support for our competition submissions. In the Ego4D challenges, we tackle various tasks including Natural Language Queries, Step Grounding, Moment Queries, Short-term Object Interaction Anticipation, and Long-term Action Anticipation. In addition, we also participate in the EPIC-Kitchens challenge, where we engage in the Action Recognition, Multiple Instance Retrieval, and Domain Adaptation for Action Recognition tracks. By adapting EgoVideo to these diverse tasks, we showcase its versatility and effectiveness in different egocentric video analysis scenarios, demonstrating the powerful representation ability of EgoVideo as an egocentric foundation model. Our codebase and pretrained models are publicly available at https://github.com/OpenGVLab/EgoVideo.


title: Documenting Ethical Considerations in Open Source AI Models

abstract: Background: The development of AI-enabled software heavily depends on AI model documentation, such as model cards, due to different domain expertise between software engineers and model developers. From an ethical standpoint, AI model documentation conveys critical information on ethical considerations along with mitigation strategies for downstream developers to ensure the delivery of ethically compliant software. However, knowledge on such documentation practice remains scarce. Aims: The objective of our study is to investigate how developers document ethical aspects of open source AI models in practice, aiming at providing recommendations for future documentation endeavours. Method: We selected three sources of documentation on GitHub and Hugging Face, and developed a keyword set to identify ethics-related documents systematically. After filtering an initial set of 2,347 documents, we identified 265 relevant ones and performed thematic analysis to derive the themes of ethical considerations. Results: Six themes emerge, with the three largest ones being model behavioural risks, model use cases, and model risk mitigation. Conclusions: Our findings reveal that open source AI model documentation focuses on articulating ethical problem statements and use case restrictions. We further provide suggestions to various stakeholders for improving documentation practice regarding ethical considerations.


title: Learning for Bandits under Action Erasures

abstract: We consider a novel multi-arm bandit (MAB) setup, where a learner needs to communicate the actions to distributed agents over erasure channels, while the rewards for the actions are directly available to the learner through external sensors. In our model, while the distributed agents know if an action is erased, the central learner does not (there is no feedback), and thus does not know whether the observed reward resulted from the desired action or not. We propose a scheme that can work on top of any (existing or future) MAB algorithm and make it robust to action erasures. Our scheme results in a worst-case regret over action-erasure channels that is at most a factor of $O(1/\sqrt{1-\epsilon})$ away from the no-erasure worst-case regret of the underlying MAB algorithm, where $\epsilon$ is the erasure probability. We also propose a modification of the successive arm elimination algorithm and prove that its worst-case regret is $\Tilde{O}(\sqrt{KT}+K/(1-\epsilon))$, which we prove is optimal by providing a matching lower bound.


title: Investigation into the origin of the soft excess in Ark 564 using principal component analysis

abstract: We combined a principal component analysis (PCA) and spectroscopy to investigate the origin of the soft excess in narrow-line Seyfert 1 galaxy Ark 564 with XMM-Newton observations over a period of ten years. We find that the principal components in different epochs are very similar, suggesting stable variability patterns in this source. More importantly, although its spectra could be equally well fitted by the two soft excess models, simulations show that the principal components from the relativistically smeared reflection model match the data well. At the same time, the principal components from the warm corona model show significant inconsistency. This finding indicates that the soft excess in Ark 564 originates from the relativistically smeared reflection, rather than the Comptonization in the warm corona, thereby favoring the reflection origin or the "hybrid" origin of the soft excess. Furthermore, the presence of the narrow absorption features in the spectra suggests that the soft excess is unlikely to originate from absorptions due to possible outflowing winds. Our results indicate that the PCA coupled with spectral analysis is a promising approach to exploring the origin of the soft excess in active galactic nuclei (AGNs).


title: Few-Shot Medical Image Segmentation with High-Fidelity Prototypes

abstract: Few-shot Semantic Segmentation (FSS) aims to adapt a pretrained model to new classes with as few as a single labelled training sample per class. Despite the prototype based approaches have achieved substantial success, existing models are limited to the imaging scenarios with considerably distinct objects and not highly complex background, e.g., natural images. This makes such models suboptimal for medical imaging with both conditions invalid. To address this problem, we propose a novel Detail Self-refined Prototype Network (DSPNet) to constructing high-fidelity prototypes representing the object foreground and the background more comprehensively. Specifically, to construct global semantics while maintaining the captured detail semantics, we learn the foreground prototypes by modelling the multi-modal structures with clustering and then fusing each in a channel-wise manner. Considering that the background often has no apparent semantic relation in the spatial dimensions, we integrate channel-specific structural information under sparse channel-aware regulation. Extensive experiments on three challenging medical image benchmarks show the superiority of DSPNet over previous state-of-the-art methods.


title: A Context-Driven Approach for Co-Auditing Smart Contracts with The Support of GPT-4 code interpreter

abstract: The surge in the adoption of smart contracts necessitates rigorous auditing to ensure their security and reliability. Manual auditing, although comprehensive, is time-consuming and heavily reliant on the auditor's expertise. With the rise of Large Language Models (LLMs), there is growing interest in leveraging them to assist auditors in the auditing process (co-auditing). However, the effectiveness of LLMs in smart contract co-auditing is contingent upon the design of the input prompts, especially in terms of context description and code length. This paper introduces a novel context-driven prompting technique for smart contract co-auditing. Our approach employs three techniques for context scoping and augmentation, encompassing code scoping to chunk long code into self-contained code segments based on code inter-dependencies, assessment scoping to enhance context description based on the target assessment goal, thereby limiting the search space, and reporting scoping to force a specific format for the generated response. Through empirical evaluations on publicly available vulnerable contracts, our method demonstrated a detection rate of 96\% for vulnerable functions, outperforming the native prompting approach, which detected only 53\%. To assess the reliability of our prompting approach, manual analysis of the results was conducted by expert auditors from our partner, Quantstamp, a world-leading smart contract auditing company. The experts' analysis indicates that, in unlabeled datasets, our proposed approach enhances the proficiency of the GPT-4 code interpreter in detecting vulnerabilities.


title: Continuum modeling for opinion formation on a network

abstract: We consider Abelson's model for opinion dynamics, where individuals interact if they are connected via a fixed network. Our aim is to develop a continuous description for these dynamics that captures well the global dynamics when the number of individuals grows to infinity. We aim at having a simple continuum description on which computations and comparison with the discrete dynamics are feasible. The difficulty lies in the network of connections being described through the labeling of the individuals: this makes the system not amenable to standard mean-field limits. We overcome this difficulty by introducing an evolving label-free network description. We compare the discrete model considered, and the continuum model proposed in the case of consensus dynamics, and carry out simulations for a system with three communities. Moreover, we propose extensions of the model to incorporate phenomena like creation and destruction of connections (dynamical networks), noise, and directional networks.


title: Quasiparticle and fully self-consistent GW methods: an unbiased analysis using Gaussian orbitals

abstract: We present a comparison of various approximations to self-consistency in the GW method, including the one-shot G0W0 method, different quasiparticle self-consistency schemes, and the fully self-consistent GW (scGW) approach. To ensure an unbiased and equitable comparison, we have implemented all the schemes with the same underlying Matsubara formalism, while employing Gaussian orbitals to describe the system. Aiming to assess and compare different GW schemes, we analyze band gaps in semiconductors and insulators, as well as ionization potentials in molecules. Our findings reveal that for solids, the different self-consistency schemes perform very similarly. However, for molecules, full self-consistency outperforms all other approximations, i.e., the one-shot and quasiparticle self-consistency GW schemes. Our work highlights the importance of implementation details when comparing different GW methods. By employing state-of-the-art fully self-consistent, finite temperature GW calculations, we have successfully addressed discrepancies in the existing literature regarding its performance. Our results also indicate that when stringent thresholds are imposed, the scGW method consistently yields accurate results.


title: Self-Training with Pseudo-Label Scorer for Aspect Sentiment Quad Prediction

abstract: Aspect Sentiment Quad Prediction (ASQP) aims to predict all quads (aspect term, aspect category, opinion term, sentiment polarity) for a given review, which is the most representative and challenging task in aspect-based sentiment analysis. A key challenge in the ASQP task is the scarcity of labeled data, which limits the performance of existing methods. To tackle this issue, we propose a self-training framework with a pseudo-label scorer, wherein a scorer assesses the match between reviews and their pseudo-labels, aiming to filter out mismatches and thereby enhance the effectiveness of self-training. We highlight two critical aspects to ensure the scorer's effectiveness and reliability: the quality of the training dataset and its model architecture. To this end, we create a human-annotated comparison dataset and train a generative model on it using ranking-based objectives. Extensive experiments on public ASQP datasets reveal that using our scorer can greatly and consistently improve the effectiveness of self-training. Moreover, we explore the possibility of replacing humans with large language models for comparison dataset annotation, and experiments demonstrate its feasibility. We release our code and data at https://github.com/HITSZ-HLT/ST-w-Scorer-ABSA .


title: MFDNet: Multi-Frequency Deflare Network for Efficient Nighttime Flare Removal

abstract: When light is scattered or reflected accidentally in the lens, flare artifacts may appear in the captured photos, affecting the photos' visual quality. The main challenge in flare removal is to eliminate various flare artifacts while preserving the original content of the image. To address this challenge, we propose a lightweight Multi-Frequency Deflare Network (MFDNet) based on the Laplacian Pyramid. Our network decomposes the flare-corrupted image into low and high-frequency bands, effectively separating the illumination and content information in the image. The low-frequency part typically contains illumination information, while the high-frequency part contains detailed content information. So our MFDNet consists of two main modules: the Low-Frequency Flare Perception Module (LFFPM) to remove flare in the low-frequency part and the Hierarchical Fusion Reconstruction Module (HFRM) to reconstruct the flare-free image. Specifically, to perceive flare from a global perspective while retaining detailed information for image restoration, LFFPM utilizes Transformer to extract global information while utilizing a convolutional neural network to capture detailed local features. Then HFRM gradually fuses the outputs of LFFPM with the high-frequency component of the image through feature aggregation. Moreover, our MFDNet can reduce the computational cost by processing in multiple frequency bands instead of directly removing the flare on the input image. Experimental results demonstrate that our approach outperforms state-of-the-art methods in removing nighttime flare on real-world and synthetic images from the Flare7K dataset. Furthermore, the computational complexity of our model is remarkably low.


title: Capacitance-based Fermion parity read-out and predicted Rabi oscillations in a Majorana nanowire

abstract: Recent experiments have measured flux dependent capacitance at radio frequencies leading to the potential for a fast parity read-out of a Majorana qubit. In this work we argue that the quantum dot used in the capacitance measurement can be reasonably approximated by a non-interacting weakly coupled orbital. We then predict the measured flux and parity dependent capacitance for several parameter regimes of the disordered Majorana nanowire model that are both topological and trivial. Following this we study how such a fast capacitance read-out can be used to characterize the quantum coherence of a Majorana nanowire-based qubit using Rabi oscillations. We additionally show that such measurements, if made possible by coherent inter-wire tunneling, would provide a valuable way of characterizing the low energy states in the frequency domain.


title: X-ray observations of black hole sources

abstract: X-ray astronomy is closely related to the study of black hole sources. The discovery that some unseen objects, more massive than any degenerate star, emit huge amounts of X-rays helped accept the concept that back holes are present in X-ray binaries. The detection of copious amounts of highly variable X-rays helped the emergence of the paradigm that all Active Galactic Nuclei harboured a supermassive black hole. Since the bulk of the emission in these sources are in X-rays and X-rays are thought to be originating from regions closest to the black holes, it was expected that X-ray observations would yield significant inputs for our understanding of the physical phenomena happening close to black holes like the disk-jet connection and help measure many important parameters like the mass and spin of the black holes. I will trace the developments in this area for the past several decades and, noting the relatively limited success, stress the need for more sensitive measurements. I will highlight the recent X-ray polarisation measurements of the Galactic black hole candidate source Cygnus X-1 using the CZT Imager instrument of AstroSat and sketch possible future developments.


title: Octo-planner: On-device Language Model for Planner-Action Agents

abstract: AI agents have become increasingly significant in various domains, enabling autonomous decision-making and problem-solving. To function effectively, these agents require a planning process that determines the best course of action and then executes the planned actions. In this paper, we present an efficient on-device Planner-Action framework that separates planning and action execution into two distinct components: a planner agent based on Phi-3 Mini, a 3.8 billion parameter LLM optimized for edge devices, and an action agent using the Octopus model for function execution. The planner agent first responds to user queries by decomposing tasks into a sequence of sub-steps, which are then executed by the action agent. To optimize performance on resource-constrained devices, we employ model fine-tuning instead of in-context learning, reducing computational costs and energy consumption while improving response times. Our approach involves using GPT-4 to generate diverse planning queries and responses based on available functions, with subsequent validations to ensure data quality. We fine-tune the Phi-3 Mini model on this curated dataset, achieving a 97\% success rate in our in-domain test environment. To address multi-domain planning challenges, we developed a multi-LoRA training method that merges weights from LoRAs trained on distinct function subsets. This approach enables flexible handling of complex, multi-domain queries while maintaining computational efficiency on resource-constrained devices. To support further research, we have open-sourced our model weights at \url{https://huggingface.co/NexaAIDev/octopus-planning}. For the demo, please refer to \url{https://www.nexa4ai.com/octo-planner}.


title: Measurements of $K_S^0$-$K_L^0$ asymmetries in the decays $\Lambda_c^+ \to pK_{L,S}^0$, $pK_{L,S}^0\pi^+\pi^-$ and $pK_{L,S}^0\pi^0$

abstract: Using $e^+e^-$ annihilation data sets corresponding to an integrated luminosity of 4.5 $\text{fb}^{-1}$, collected with the BESIII detector at center-of-mass energies between 4.600 and 4.699 GeV, we report the first measurements of the absolute branching fractions $\mathcal{B}(\Lambda_c^+\to pK_{L}^{0})=(1.67 \pm 0.06 \pm 0. 04)\%$, $\mathcal{B}(\Lambda_c^+\to pK_{L}^{0}\pi^+\pi^-)=(1.69 \pm 0.10 \pm 0.05)\%$, and $\mathcal{B}(\Lambda_c^+\to pK_{L}^{0}\pi^0)=(2.02 \pm 0.13 \pm 0.05)\%$, where the first uncertainties are statistical and the second systematic. Combining with the known branching fractions of $\Lambda_c^+ \to pK_{S}^{0}$, $\Lambda_c^+ \to pK_{S}^{0}\pi^+\pi^-$, and $\Lambda_c^+ \to pK_{S}^{0}\pi^0$, we present the first measurements of the $K_{S}^{0}$-$K_{L}^{0}$ asymmetries $R(\Lambda_c^+, K_{S,L}^0X) = \frac{\mathcal{B}(\Lambda_c^+ \to K_{S}^{0} X) - \mathcal{B}(\Lambda_c^+ \to K_{L}^{0} X)}{\mathcal{B}(\Lambda_c^+ \to K_{S}^{0} X) + \mathcal{B}(\Lambda_c^+ \to K_{L}^{0} X)}$ in charmed baryon decays: $R(\Lambda_c^+, pK_{S,L}^0) = -0.025 \pm 0.031$, $R(\Lambda_c^+, pK_{S,L}^0\pi^+\pi^-) = -0.027 \pm 0.048$, and $R(\Lambda_c^+, pK_{S,L}^0\pi^0) =-0.015 \pm 0.046$. No significant asymmetries within the uncertainties are observed.


title: Generation of spatiotemporal acoustic vortices with arbitrarily oriented orbital angular momentum

abstract: Despite extensive exploration of acoustic vortices carrying orbital angular momentum (OAM), the generation of acoustic vortices with OAM orientations beyond the conventional longitudinal direction remains largely unexplored. Spatiotemporal (ST) vortices, featuring spiral phase twisting in the ST domain and carrying transverse OAM, have recently attracted considerable interest in optics and acoustics. Here, we report the generation of three-dimensional (3D) ST acoustic vortices with arbitrarily oriented OAM, thereby opening up a new dimension in acoustic OAM control. By utilizing a two-dimensional (2D) acoustic phased array, we introduce two approaches to manipulate the orientation of OAM: through the direct rotation of vortices in 3D space and the intersection of vortices carrying distinct types of OAM. These methods enable unprecedented control over the orientation of acoustic OAM, providing a new degree of freedom in the manipulation of acoustic waves. The arbitrarily oriented OAM holds promise for enhancing acoustic communication by broadening capacity and enabling more complex particle manipulation techniques. Our work establishes a foundation for future explorations into the complex dynamics of novel structured acoustic fields in the ST domain.


title: Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints

abstract: Multilingual Knowledge Graph Completion (mKGC) aim at solving queries like (h, r, ?) in different languages by reasoning a tail entity t thus improving multilingual knowledge graphs. Previous studies leverage multilingual pretrained language models (PLMs) and the generative paradigm to achieve mKGC. Although multilingual pretrained language models contain extensive knowledge of different languages, its pretraining tasks cannot be directly aligned with the mKGC tasks. Moreover, the majority of KGs and PLMs currently available exhibit a pronounced English-centric bias. This makes it difficult for mKGC to achieve good results, particularly in the context of low-resource languages. To overcome previous problems, this paper introduces global and local knowledge constraints for mKGC. The former is used to constrain the reasoning of answer entities, while the latter is used to enhance the representation of query contexts. The proposed method makes the pretrained model better adapt to the mKGC task. Experimental results on public datasets demonstrate that our method outperforms the previous SOTA on Hits@1 and Hits@10 by an average of 12.32% and 16.03%, which indicates that our proposed method has significant enhancement on mKGC.


title: Quantum corrections to tunnelling amplitudes of neutral scalar fields

abstract: Though theoretical treatments of quantum tunnelling within single-particle quantum mechanics are well-established, at present, there is no quantum field-theoretic description (QFT) of tunnelling. Due to the single-particle nature of quantum mechanics, many-particle effects arising from quantum field theory are not accounted for. Such many-particle effects, including pair-production, have proved to be essential in resolving the Klein-paradox. This work seeks to determine how quantum corrections affect the tunnelling probability through an external field. We investigate a massive neutral scalar field, which interacts with an external field in accordance with relativistic quantum mechanics. To consider QFT corrections, we include another massive quantised neutral scalar field coupling to the original via a cubic interaction. This study formulates an all-order recursive expression for the loop-corrected scalar propagator, which contains only the class of vertex-corrected Feynman diagrams. This equation applies for general external potentials. Though there is no closed-form analytic solution, we also demonstrate how to approximate the QFT corrections if a perturbative coupling to the quantised field is assumed.


title: EHR-Based Mobile and Web Platform for Chronic Disease Risk Prediction Using Large Language Multimodal Models

abstract: Traditional diagnosis of chronic diseases involves in-person consultations with physicians to identify the disease. However, there is a lack of research focused on predicting and developing application systems using clinical notes and blood test values. We collected five years of Electronic Health Records (EHRs) from Taiwan's hospital database between 2017 and 2021 as an AI database. Furthermore, we developed an EHR-based chronic disease prediction platform utilizing Large Language Multimodal Models (LLMMs), successfully integrating with frontend web and mobile applications for prediction. This prediction platform can also connect to the hospital's backend database, providing physicians with real-time risk assessment diagnostics. The demonstration link can be found at https://www.youtube.com/watch?v=oqmL9DEDFgA.


title: LLM-Driven Multimodal Opinion Expression Identification

abstract: Opinion Expression Identification (OEI) is essential in NLP for applications ranging from voice assistants to depression diagnosis. This study extends OEI to encompass multimodal inputs, underlining the significance of auditory cues in delivering emotional subtleties beyond the capabilities of text. We introduce a novel multimodal OEI (MOEI) task, integrating text and speech to mirror real-world scenarios. Utilizing CMU MOSEI and IEMOCAP datasets, we construct the CI-MOEI dataset. Additionally, Text-to-Speech (TTS) technology is applied to the MPQA dataset to obtain the CIM-OEI dataset. We design a template for the OEI task to take full advantage of the generative power of large language models (LLMs). Advancing further, we propose an LLM-driven method STOEI, which combines speech and text modal to identify opinion expressions. Our experiments demonstrate that MOEI significantly improves the performance while our method outperforms existing methods by 9.20\% and obtains SOTA results.


title: A Study on Synthesizing Expressive Violin Performances: Approaches and Comparisons

abstract: Expressive music synthesis (EMS) for violin performance is a challenging task due to the disagreement among music performers in the interpretation of expressive musical terms (EMTs), scarcity of labeled recordings, and limited generalization ability of the synthesis model. These challenges create trade-offs between model effectiveness, diversity of generated results, and controllability of the synthesis system, making it essential to conduct a comparative study on EMS model design. This paper explores two violin EMS approaches. The end-to-end approach is a modification of a state-of-the-art text-to-speech generator. The parameter-controlled approach is based on a simple parameter sampling process that can render note lengths and other parameters compatible with MIDI-DDSP. We study these two approaches (in total, three model variants) through objective and subjective experiments and discuss several key issues of EMS based on the results.


title: Probing the superconducting gap structure of ScRuSi via $\mu$SR and first-principles calculations

abstract: In this study, we present a thorough investigation into the superconducting state of the ruthenium-based ternary equiatomic compound ScRuSi. Our analysis combines experimental techniques, including muon spin rotation/relaxation ($\mu$SR) and low-temperature resistivity measurements, with theoretical insights derived from first-principles calculations. The low-temperature resistivity measurements reveal a distinct superconducting phase transition in the orthorhombic structure of ScRuSi at a critical temperature ($T_\text{C}$) of $2.5$ K. Further, the TF-$\mu$SR analysis yields a gap-to-critical-temperature ratio of $2\Delta/k_\mathrm{B}T_\mathrm{C} = 2.71$, a value consistent with results obtained from previous heat capacity measurements. The temperature dependence of the superconducting normalized depolarization rate is fully described by the isotropic $s$-wave gap model. Additionally, zero-field $\mu$SR measurements indicate that the relaxation rate remains nearly identical below and above $T_\text{C}$. This observation strongly suggests the preservation of time-reversal symmetry within the superconducting state. By employing the McMillan-Allen-Dynes equation, we calculate a $T_\text{C}$ of $2.11$ K from first-principles calculations within the density functional theory framework. This calculated value aligns closely with the experimentally determined critical temperature. The coupling between the low-frequency phonon modes and the transition metal d-orbital states play an important role in governing the superconducting pairing in ScRuSi. The combination of experimental and theoretical approaches provides a comprehensive microscopic understanding of the superconducting nature of ScRuSi, offering insights into its critical temperature, pairing symmetry, and the underlying electron-phonon coupling mechanism.


title: Weak Waldhausen categories and a localization theorem

abstract: Waldhausen categories were introduced to extend algebraic $K$-theory beyond Quillen's exact categories. In this article, we modify Waldhausen's axioms so that it matches better with the theory of extriangulated categories, introducing a weak Waldhausen category and defining its Grothendieck group. Examples of weak Waldhausen categories include any extriangulated category, hence any exact or triangulated category, and any Waldhausen category. A key feature of this structure is that it allows for "one-sided" extriangulated localization theory, and thus enables us to extract right exact sequences of Grothendieck groups that we cannot obtain from the theory currently available. To demonstrate the utility of our Weak Waldhausen Localization Theorem, we give three applications. First, we give a new proof of the Extriangulated Localization Theorem proven by Enomoto--Saito, which is a generalization at the level of $K_0$ of Quillen's classical Localization Theorem for exact categories. Second, we give a new proof that the index with respect to an $n$-cluster tilting subcategory $\mathscr{X}$ of a triangulated category $\mathscr{C}$ induces an isomorphism between $K_0^{\mathsf{sp}}(\mathscr{X})$ and the Grothendieck group of an extriangulated substructure of $\mathscr{C}$. Last, we produce a weak Waldhausen $K_0$-generalization of a localization construction due to Sarazola that involves cotorsion pairs but allows for non-Serre localizations. We show that the right exact sequences of Grothendieck groups obtained from our Sarazola construction and the Extriangulated Localization Theorem agree under a common setup.


title: Polarized endomorphisms of log Calabi-Yau pairs

abstract: Let $(X,\Delta)$ be a dlt log Calabi-Yau pair admitting a polarized endomorphism. We show that $(X,\Delta)$ is a finite quotient of a toric log Calabi-Yau fibration over an abelian variety. We provide an example which shows that the previous statement does not hold if we drop the dlt condition of $(X,\Delta)$ even if $X$ is a smooth variety. Given a klt type variety $X$ and a log Calabi-Yau pair $(X,\Delta)$ admitting a polarized endomorphism, we show that a suitable birational modification of $(X,\Delta)$ is a finite quotient of a toric log Calabi-Yau fibration over an abelian variety.


title: Exploring Superconductivity in Ba$_{3}$Ir$_{4}$Ge$_{16}$: Experimental and Theoretical Insights

abstract: We explore both experimental and theoretical aspects of the superconducting properties in the distinctive layered caged compound, Ba$_{3}$Ir$_{4}$Ge$_{16}$. Our approach integrates muon spin rotation and relaxation ($\mu$SR) measurements with magnetization and heat capacity experiments, accompanied by first-principle calculations. The compound's bulk superconductivity is unequivocally established through DC magnetization measurements, revealing a critical temperature ($T_\mathrm{C}$) of 5.7 K. A noteworthy characteristic observed in the low-temperature superfluid density is its saturating behavior, aligning with the features typical of conventional Bardeen-Cooper-Schrieffer (BCS) superconductors. The assessment of moderate electron-phonon coupling superconductivity is conducted through transverse field $\mu$SR measurements, yielding a superconducting gap to $T_\mathrm{C}$ ratio ($2\Delta(0)/k_\mathrm{B}T_\mathrm{C}$) of 4.04, a value corroborated by heat capacity measurements. Crucially, zero field $\mu$SR measurements dismiss the possibility of any spontaneous magnetic field emergence below $T_\mathrm{C}$, highlighting the preservation of time-reversal symmetry. Our experimental results are reinforced by first-principles density functional calculations, underscoring the intricate interplay between crystal structure and superconducting order parameter symmetry in polyhedral caged compounds. This comprehensive investigation enhances our understanding of the nuanced relationship between crystal structure and superconductivity in such unique compounds.


title: Shimo Lab at "Discharge Me!": Discharge Summarization by Prompt-Driven Concatenation of Electronic Health Record Sections

abstract: In this paper, we present our approach to the shared task "Discharge Me!" at the BioNLP Workshop 2024. The primary goal of this task is to reduce the time and effort clinicians spend on writing detailed notes in the electronic health record (EHR). Participants develop a pipeline to generate the "Brief Hospital Course" and "Discharge Instructions" sections from the EHR. Our approach involves a first step of extracting the relevant sections from the EHR. We then add explanatory prompts to these sections and concatenate them with separate tokens to create the input text. To train a text generation model, we perform LoRA fine-tuning on the ClinicalT5-large model. On the final test data, our approach achieved a ROUGE-1 score of $0.394$, which is comparable to the top solutions.


title: Observational Evidence to Logistic Dark Energy Driving the Accelerating Universe

abstract: We present logistic dark energy model (LDEM), where the dark energy density follows a logistic function for the scale factor. The equation of state parameter of dark energy ($w_D$) transitioned from $-1$ in the distant past to its current value of $-0.76$, closely resembling the $\Lambda$CDM model in the early epoch and showing significant deviation in the late phase. The evolution of the deceleration parameter in the LDEM signifies its success in explaining the late-time cosmic acceleration. Model selection based on the Bayesian Information Criterion (BIC), incorporating observations from Type Ia Supernovae (SNe Ia), Observational Hubble data (OHD), and Baryon Acoustic Oscillation (BAO) strongly favors the LDEM over the conventional $\Lambda$CDM model, where BIC is estimated to be $\sim -20$. Incorporating the shift parameter derived from the Cosmic Microwave Background (CMB) data shows competing evidence of the LDEM over the standard $\Lambda$CDM. Remarkably, the Hubble constant ($H_0$) value computed using any of the datasets tends to align closely with the predictions from the Cosmic Microwave Background (CMB), suggesting a need to reconsider the local measurement.


title: Running of the Number of Degrees of Freedom in Quantum Conformal Gravity

abstract: We study how the number of degrees of freedom in Weyl conformal gravity runs with the energy scale from the UV fixed point. To this end we employ two approaches. First, we utilize the Fradkin--Tseytlin prescription for the number of degrees of freedom and demonstrate that the one-loop results are highly dependent on the selected background. We then employ the counting methodology based on the $a$- and $c$-functions, which are typically used to characterize the trace anomaly of conformal field theory in four dimensions. We compute these in the enhanced one-loop approximation and demonstrate that the degrees of freedom decrease monotonically from six degrees in the UV regime. This behavior is independent of the backgrounds considered. Finally, we show how to relate the Fradkin--Tseytlin prescription to counting based on the $a$- and $c$-functions.