title: Global Existence of Large Solutions for the 3D incompressible Navier--Stokes--Poisson--Nernst--Planck Equations

abstract: This work is concerned with the global existence of large solutions to the three-dimensional dissipative fluid-dynamical model, which is a strongly coupled nonlinear nonlocal system characterized by the incompressible Navier--Stokes--Poisson--Nernst--Planck equations. Making full use of the algebraic structure of the system, we obtain the global existence of solutions without smallness assumptions imposed on the third component of the initial velocity field and the summation of initial densities of charged species. More precisely, we prove that there exist two positive constants $c_{0}, C_{0}$ such that if the initial data satisfies \begin{align*} \big(\|u_{0}^{h}\|_{\dot{B}^{-1+\frac{3}{p}}_{p,1}}+\|N_{0}-P_{0}\|_{\dot{B}^{-2+\frac{3}{q}}_{q,1}} \big) \exp\Big\{C_{0}\big(\|u_{0}^{3}\|_{\dot{B}^{-1+\frac{3}{p}}_{p,1}}^{2}+(\|N_{0}+P_{0}\|_{\dot{B}^{-2+\frac{3}{r}}_{r,1}}+1)\exp\big\{C_{0}\|u_{0}^{3}\|_{\dot{B}^{-1+\frac{3}{p}}_{p,1}}\big\}+1\big)\Big\} \leq c_{0}, \end{align*} then the incompressible Navier--Stokes--Poisson--Nernst--Planck equations admits a unique global solution.


title: HoloFusion: Towards Photo-realistic 3D Generative Modeling

abstract: Diffusion-based image generators can now produce high-quality and diverse samples, but their success has yet to fully translate to 3D generation: existing diffusion methods can either generate low-resolution but 3D consistent outputs, or detailed 2D views of 3D objects but with potential structural defects and lacking view consistency or realism. We present HoloFusion, a method that combines the best of these approaches to produce high-fidelity, plausible, and diverse 3D samples while learning from a collection of multi-view 2D images only. The method first generates coarse 3D samples using a variant of the recently proposed HoloDiffusion generator. Then, it independently renders and upsamples a large number of views of the coarse 3D model, super-resolves them to add detail, and distills those into a single, high-fidelity implicit 3D representation, which also ensures view consistency of the final renders. The super-resolution network is trained as an integral part of HoloFusion, end-to-end, and the final distillation uses a new sampling scheme to capture the space of super-resolved signals. We compare our method against existing baselines, including DreamFusion, Get3D, EG3D, and HoloDiffusion, and achieve, to the best of our knowledge, the most realistic results on the challenging CO3Dv2 dataset.


title: A Comparison of Personalized and Generalized Approaches to Emotion Recognition Using Consumer Wearable Devices: Machine Learning Study

abstract: Background: Studies have shown the potential adverse health effects, ranging from headaches to cardiovascular disease, associated with long-term negative emotions and chronic stress. Since many indicators of stress are imperceptible to observers, the early detection and intervention of stress remains a pressing medical need. Physiological signals offer a non-invasive method of monitoring emotions and are easily collected by smartwatches. Existing research primarily focuses on developing generalized machine learning-based models for emotion classification. Objective: We aim to study the differences between personalized and generalized machine learning models for three-class emotion classification (neutral, stress, and amusement) using wearable biosignal data. Methods: We developed a convolutional encoder for the three-class emotion classification problem using data from WESAD, a multimodal dataset with physiological signals for 15 subjects. We compared the results between a subject-exclusive generalized, subject-inclusive generalized, and personalized model. Results: For the three-class classification problem, our personalized model achieved an average accuracy of 95.06% and F1-score of 91.71, our subject-inclusive generalized model achieved an average accuracy of 66.95% and F1-score of 42.50, and our subject-exclusive generalized model achieved an average accuracy of 67.65% and F1-score of 43.05. Conclusions: Our results emphasize the need for increased research in personalized emotion recognition models given that they outperform generalized models in certain contexts. We also demonstrate that personalized machine learning models for emotion classification are viable and can achieve high performance.


title: Using nanokelvin quantum thermometry to detect timelike Unruh effect in a Bose-Einstein condensate

abstract: It is found that the Unruh effect can not only arise out of the entanglement between two sets of modes spanning the left and right Rindler wedges, but also between modes spanning the future and past light cones. Furthermore, an inertial Unruh-DeWitt detector along a spacetime trajectory in one of these cones may exhibit the same thermal response to the vacuum as that of an accelerated detector confined in the Rindler wedge. This feature thus could be an alternative candidate to verify the ``Unruh effect", termed as the timelike Unruh effect correspondingly. In this paper we propose to detect the timelike Unruh effect by using an impurity immersed in a Bose-Einstein condensate (BEC). The impurity acts as the detector which interacts with the density fluctuations in the condensate, working as an effective quantum field. Following the paradigm of the emerging field of quantum thermometry, we combine quantum parameter estimation theory with the theory of open quantum systems to realize a nondemolition Unruh temperature measurement in the nanokelvin (nK) regime. Our results demonstrate that the timelike Unruh effect can be probed using a stationary two-level impurity with time-dependent energy gap immersed in a BEC within current technologies.


title: Draco 2: An Extensible Platform to Model Visualization Design

abstract: Draco introduced a constraint-based framework to model visualization design in an extensible and testable form. It provides a way to abstract design guidelines from theoretical and empirical studies and applies the knowledge in automated design tools. However, Draco is challenging to use because there is limited tooling and documentation. In response, we present Draco 2, the successor with (1) a more flexible visualization specification format, (2) a comprehensive test suite and documentation, and (3) flexible and convenient APIs. We designed Draco 2 to be more extensible and easier to integrate into visualization systems. We demonstrate these advantages and believe that they make Draco 2 a platform for future research.


title: Constraints on the $z\sim5$ Star-Forming Galaxy Luminosity Function From $\textit{Hubble Space Telescope}$ Imaging of an Unbiased and Complete Sample of Long Gamma-ray Burst Host Galaxies

abstract: We present rest-frame UV \textit{Hubble Space Telescope} imaging of the largest and most complete sample of 23 long duration gamma-ray burst (GRB) host galaxies between redshifts 4 and 6. Of these 23, we present new WFC3/F110W imaging for 19 of the hosts, which we combine with archival WFC3/F110W and WFC3/F140W imaging for the remaining four. We use the photometry of the host galaxies from this sample to characterize both the rest-frame UV luminosity function (LF) and the size-luminosity relation of the sample. We find that when assuming the standard Schechter-function parameterization for the UV LF, the GRB host sample is best fit with $\alpha = -1.30^{+0.30}_{-0.25}$ and $M_* = -20.33^{+0.44}_{-0.54}$ mag, which is consistent with results based on $z\sim5$ Lyman-break galaxies. We find that $\sim68\%$ of our size-luminosity measurements fall within or below the same relation for Lyman-break galaxies at $z\sim4$. This study observationally confirms expectations that at $z\sim5$ Lyman-break and GRB host galaxies should trace the same population and demonstrates the utility of GRBs as probes of hidden star-formation in the high-redshift universe. Under the assumption that GRBs unbiasedly trace star formation at this redshift, our non-detection fraction of 7/23 is consistent at the $95\%$-confidence level with $13 - 53\%$ of star formation at redshift $z\sim5$ occurring in galaxies fainter than our detection limit of $M_{1600 A} \sim -18.3$ mag.


title: Statistical Inference on Grayscale Images via the Euler-Radon Transform

abstract: Tools from topological data analysis have been widely used to represent binary images in many scientific applications. Methods that aim to represent grayscale images (i.e., where pixel intensities instead take on continuous values) have been relatively underdeveloped. In this paper, we introduce the Euler-Radon transform, which generalizes the Euler characteristic transform to grayscale images by using o-minimal structures and Euler integration over definable functions. Coupling the Karhunen-Loeve expansion with our proposed topological representation, we offer hypothesis-testing algorithms based on the chi-squared distribution for detecting significant differences between two groups of grayscale images. We illustrate our framework via extensive numerical experiments and simulations.


title: Rule-Based Error Detection and Correction to Operationalize Movement Trajectory Classification

abstract: Classification of movement trajectories has many applications in transportation. Supervised neural models represent the current state-of-the-art. Recent security applications require this task to be rapidly employed in environments that may differ from the data used to train such models for which there is little training data. We provide a neuro-symbolic rule-based framework to conduct error correction and detection of these models to support eventual deployment in security applications. We provide a suite of experiments on several recent and state-of-the-art models and show an accuracy improvement of 1.7% over the SOTA model in the case where all classes are present in training and when 40% of classes are omitted from training, we obtain a 5.2% improvement (zero-shot) and 23.9% (few-shot) improvement over the SOTA model without resorting to retraining of the base model.


title: Polarization engineering of entangled photons from a lithium niobate nonlinear metasurface

abstract: Complex polarization states of photon pairs are indispensable in various quantum technologies. Conventional methods for preparing desired two-photon polarization states are realized through bulky nonlinear crystals, which can restrict the versatility and tunability of the generated quantum states due to the fixed crystal nonlinear susceptibility. Here we present a solution using a nonlinear metasurface incorporating multiplexed silica metagratings on a lithium niobate film of 300 nanometer thickness. We fabricate two orthogonal metagratings on a single substrate with an identical resonant wavelength, thereby enabling the spectral indistinguishability of the emitted photons, and demonstrate in experiments that the two-photon polarization states can be shaped by the metagrating orientation. Leveraging this essential property, we formulate a theoretical approach for generating arbitrary polarization-entangled qutrit states by combining three metagratings on a single metasurface, allowing the encoding of desired quantum states or information. Our findings enable miniaturized optically controlled quantum devices using ultrathin metasurfaces as polarization-entangled photon sources.


title: Key technologies and application for radar and smart video fusion in perimeter intrusion alarm system

abstract: With the continuous development of modern science and technology, radar detection, video surveillance and perimeter alarm system are more and more widely used in the field of social security. This paper introduces video surveillance and perimeter alarm in detail, mathematical modeling and key technologies, analyzes their fusion and application status, and puts forward suggestions combined with the development trend of intelligent security system in the future.


title: The Promise and Peril of Artificial Intelligence -- Violet Teaming Offers a Balanced Path Forward

abstract: Artificial intelligence (AI) promises immense benefits across sectors, yet also poses risks from dual-use potentials, biases, and unintended behaviors. This paper reviews emerging issues with opaque and uncontrollable AI systems and proposes an integrative framework called violet teaming to develop reliable and responsible AI. Violet teaming combines adversarial vulnerability probing (red teaming) with solutions for safety and security (blue teaming) while prioritizing ethics and social benefit. It emerged from AI safety research to manage risks proactively by design. The paper traces the evolution of red, blue, and purple teaming toward violet teaming, and then discusses applying violet techniques to address biosecurity risks of AI in biotechnology. Additional sections review key perspectives across law, ethics, cybersecurity, macrostrategy, and industry best practices essential for operationalizing responsible AI through holistic technical and social considerations. Violet teaming provides both philosophy and method for steering AI trajectories toward societal good. With conscience and wisdom, the extraordinary capabilities of AI can enrich humanity. But without adequate precaution, the risks could prove catastrophic. Violet teaming aims to empower moral technology for the common welfare.


title: Posterior distributions of Gibbs-type priors

abstract: Gibbs type priors have been shown to be natural generalizations of Dirichlet process (DP) priors used for intricate applications of Bayesian nonparametric methods. This includes applications to mixture models and to species sampling models arising in populations genetics. Notably these latter applications, and also applications where power law behavior such as that arising in natural language models are exhibited, provide instances where the DP model is wholly inadequate. Gibbs type priors include the DP, the also popular Pitman-Yor process and closely related normalized generalized gamma process as special cases. However, there is in fact a richer infinite class of such priors, where, despite knowledge about the exchangeable marginal structures produced by sampling $n$ observations, descriptions of the corresponding posterior distribution, a crucial component in Bayesian analysis, remain unknown. This paper presents descriptions of the posterior distributions for the general class, utilizing a novel proof that leverages the exclusive Gibbs properties of these models. The results are applied to several specific cases for further illustration.


title: Global existence of large solutions for the parabolic-elliptic Keller-Segel system in Besov type spaces

abstract: In this paper, we investigate global existence of large solutions for the parabolic-elliptic Keller-Segel system in the homogeneous Besov type spaces. A class of initial data was presented, generating a global smooth solution although the $\dot{B}^{-2}_{\infty,\infty}$-norm of the initial data may be chosen arbitrarily large.


title: FaceChain: A Playground for Human-centric Artificial Intelligence Generated Content

abstract: Recent advancement in personalized image generation have unveiled the intriguing capability of pre-trained text-to-image models on learning identity information from a collection of portrait images. However, existing solutions are vulnerable in producing truthful details, and usually suffer from several defects such as (i) The generated face exhibit its own unique characteristics, \ie facial shape and facial feature positioning may not resemble key characteristics of the input, and (ii) The synthesized face may contain warped, blurred or corrupted regions. In this paper, we present FaceChain, a personalized portrait generation framework that combines a series of customized image-generation model and a rich set of face-related perceptual understanding models (\eg, face detection, deep face embedding extraction, and facial attribute recognition), to tackle aforementioned challenges and to generate truthful personalized portraits, with only a handful of portrait images as input. Concretely, we inject several SOTA face models into the generation procedure, achieving a more efficient label-tagging, data-processing, and model post-processing compared to previous solutions, such as DreamBooth ~\cite{ruiz2023dreambooth} , InstantBooth ~\cite{shi2023instantbooth} , or other LoRA-only approaches ~\cite{hu2021lora} . Besides, based on FaceChain, we further develop several applications to build a broader playground for better showing its value, including virtual try on and 2D talking head. We hope it can grow to serve the burgeoning needs from the communities. Note that this is an ongoing work that will be consistently refined and improved upon. FaceChain is open-sourced under Apache-2.0 license at \url{https://github.com/modelscope/facechain}.


title: Crystal-Chemical Origins of the Ultrahigh Conductivity of Metallic Delafossites

abstract: Despite their highly anisotropic complex-oxidic nature, certain delafossite compounds (e.g., PdCoO2, PtCoO2) are the most conductive oxides known, for reasons that remain poorly understood. Their room-temperature conductivity can exceed that of Au, while their low-temperature electronic mean-free-paths reach an astonishing 20 microns. It is widely accepted that these materials must be ultrapure to achieve this, although the methods for their growth (which produce only small crystals) are not typically capable of such. Here, we first report a new approach to PdCoO2 crystal growth, using chemical vapor transport methods to achieve order-of-magnitude gains in size, the highest structural qualities yet reported, and record residual resistivity ratios (>440). Nevertheless, the first detailed mass spectrometry measurements on these materials reveal that they are not ultrapure, typically harboring 100s-of-parts-per-million impurity levels. Through quantitative crystal-chemical analyses, we resolve this apparent dichotomy, showing that the vast majority of impurities are forced to reside in the Co-O octahedral layers, leaving the conductive Pd sheets highly pure (~1 ppm impurity concentrations). These purities are shown to be in quantitative agreement with measured residual resistivities. We thus conclude that a previously unconsidered "sublattice purification" mechanism is essential to the ultrahigh low-temperature conductivity and mean-free-path of metallic delafossites.


title: Breaking Boundaries: Distributed Domain Decomposition with Scalable Physics-Informed Neural PDE Solvers

abstract: Mosaic Flow is a novel domain decomposition method designed to scale physics-informed neural PDE solvers to large domains. Its unique approach leverages pre-trained networks on small domains to solve partial differential equations on large domains purely through inference, resulting in high reusability. This paper presents an end-to-end parallelization of Mosaic Flow, combining data parallel training and domain parallelism for inference on large-scale problems. By optimizing the network architecture and data parallel training, we significantly reduce the training time for learning the Laplacian operator to minutes on 32 GPUs. Moreover, our distributed domain decomposition algorithm enables scalable inferences for solving the Laplace equation on domains 4096 times larger than the training domain, demonstrating strong scaling while maintaining accuracy on 32 GPUs. The reusability of Mosaic Flow, combined with the improved performance achieved through the distributed-memory algorithms, makes it a promising tool for modeling complex physical phenomena and accelerating scientific discovery.


title: Partially Constrained GRAND of Linear Block Codes

abstract: This paper is concerned with a search-number-reduced guessing random additive noise decoding (GRAND) algorithm for linear block codes, called partially constrained GRAND (PC-GRAND). In contrast to the original GRAND, which guesses error patterns without constraints, the PC-GRAND guesses only those error patterns satisfying partial constraints of the codes. In particular, the PC-GRAND takes partial rows of the parity-check matrix as constraints for generating candidate error patterns and the remaining rows as checks for validating the candidates. The number of searches can be reduced when the serial list Viterbi algorithm (SLVA) is implemented for searching over a trellis specified by the partial parity-check matrix. This is confirmed by numerical results. Numerical simulations are also provided for comparison with other decoding algorithms.


title: Possible molecular states from interactions of charmed strange baryons

abstract: In this work, we perform an investigation of possible molecular states composed of two charmed strange baryons from the $\Xi_c^{(',*)}{\Xi}_c^{(',*)}$ interaction, and their hidden-charm hidden-strange partners from the $\Xi_c^{(',*)}\bar{\Xi}_c^{(',*)}$ interaction. With the help of the heavy quark chiral effective Lagrangians, the interactions of charmed strange baryons are described with light meson exchanges. The potential kernels are constructed, and inserted into the quasipotential Bethe-Salpeter equation. The bound states are produced from most interactions considered, which suggests that strong attractions exist widely between the charmed strange baryons. Experimental searching for such molecular states is suggested in future high-precision measurements.


title: Control of thermoacoustic instability through Lagrangian saddle point analysis

abstract: We propose a framework of Lagrangian Coherent Structures (LCS) to elucidate the shear layers and coherent structures to understand the mechanism of generation of tonal sound during thermoacoustic instability. Experiments were performed on a bluff-body stabilized turbulent combustor in the state of thermoacoustic instability. We use dynamic mode decomposition (DMD) on the flow-field to identify dynamical regions where the acoustic frequency is dominant. We find that the separating shear layer from the backward-facing step of the combustor envelops a cylindrical vortex in the outer recirculation zone (ORZ), eventually impinging on the top wall of the combustor during thermoacoustic instability. The production of tonal sound is due to the synchronous motion of this shear layer with the shear layer emerging from the leading edge of the bluff-body causing the fluid to squeeze and expand between them periodically. To de-synchronize the oscillations in an optimal manner, we track the Lagrangian saddle points in the shear layer emerging from the backward facing step over several acoustic cycles. A passive control strategy is then developed by injecting a steady stream of secondary air targeting the optimal locations thus identified. After implementing the control action, the flow-field is also analysed using LCS to understand the key differences in flow dynamics. We find that the shear layer emerging from the dump plane are deflected in a direction almost parallel to the axis of the combustor after the control action. This deflection in turn prevents the shear layer from enveloping the vortex and impinging on the combustor walls, resulting in a drastic reduction of the amplitude of the acoustic field.


title: Experimental simulation of quantum superchannels

abstract: Simulating quantum physical processes has been one of the major motivations for quantum information science. Quantum channels, which are completely positive and trace preserving processes, are the standard mathematical language to describe quantum evolution, while in recent years quantum superchannels have emerged as the substantial extension. Superchannels capture effects of quantum memory and non-Markovianality more precisely, and have found broad applications in universal models, algorithm, metrology, discrimination tasks, as examples. Here, we report an experimental simulation of qubit superchannels in a nuclear magnetic resonance (NMR) system with high accuracy, based on a recently developed quantum algorithm for superchannel simulation. Our algorithm applies to arbitrary target superchannels, and our experiment shows the high quality of NMR simulators for near-term usage. Our approach can also be adapted to other experimental systems and demonstrates prospects for more applications of superchannels.


title: Cross-Modal Retrieval: A Systematic Review of Methods and Future Directions

abstract: With the exponential surge in diverse multi-modal data, traditional uni-modal retrieval methods struggle to meet the needs of users demanding access to data from various modalities. To address this, cross-modal retrieval has emerged, enabling interaction across modalities, facilitating semantic matching, and leveraging complementarity and consistency between different modal data. Although prior literature undertook a review of the cross-modal retrieval field, it exhibits numerous deficiencies pertaining to timeliness, taxonomy, and comprehensiveness. This paper conducts a comprehensive review of cross-modal retrieval's evolution, spanning from shallow statistical analysis techniques to vision-language pre-training models. Commencing with a comprehensive taxonomy grounded in machine learning paradigms, mechanisms, and models, the paper then delves deeply into the principles and architectures underpinning existing cross-modal retrieval methods. Furthermore, it offers an overview of widely used benchmarks, metrics, and performances. Lastly, the paper probes the prospects and challenges that confront contemporary cross-modal retrieval, while engaging in a discourse on potential directions for further progress in the field. To facilitate the research on cross-modal retrieval, we develop an open-source code repository at https://github.com/BMC-SDNU/Cross-Modal-Retrieval.


title: Combined analysis on nature of $X(3960)$, $\chi_{c0}(3930)$, and $X_0(4140)$

abstract: In this work, a study of the $D_s\bar{D}_s$ interaction and its couplings to the channels $D\bar{D}$ and $J/\psi \phi$ is performed in a quasipotential Bethe-Salpeter equation approach. The $D_s^+{D}_s^-$ and $D^+{D}^-$ invariant mass spectra in three-body $B$ decays are investigated in order to understand the origin of $X(3960)$, $\chi_{c0}(3930)$, and $X_0(4140)$ structures reported at LHCb. With the help of effective Lagrangians, the potential kernel can be constructed with meson exchanges, from which the scattering amplitudes can be obtained. By inserting it into the three-body decay processes, the invariant mass spectra can be calculated with an additional Breit-Wigner resonance introduced. The $D_s^+{D}_s^-$ invariant mass spectrum in the decay process $B^+\to D^+_sD^-_sK^+$ is well reproduced, and the $X(3960)$ structure can be explained as a molecular state from the $D_s\bar{D}_s$ interaction. The state also exhibits as a peak in the $D^+{D}^-$ invariant mass spectrum in the decay $B^+\to D^+D^-K^+$, however, it is too narrow to reproduce the experimental structure around 3930~MeV. The dip around 4140~MeV in the $D_s^+{D}_s^-$ invariant mass spectrum can be reproduced by the additional resonance with interference effect. However, a small bump instead of a dip is produced from the $D_s\bar{D}_s-J/\psi \phi$ coupled-channel effect, which suggests that the $X_0(4140)$ cannot be interpreted as the $D_s\bar{D}_s-J/\psi \phi$ coupling in the current model.


title: A Risk-Aware Control: Integrating Worst-Case CVaR with Control Barrier Function

abstract: This paper proposes a risk-aware control approach to enforce safety for discrete-time nonlinear systems subject to stochastic uncertainties. We derive some useful results on the worst-case Conditional Value-at-Risk (CVaR) and define a discrete-time risk-aware control barrier function using the worst-case CVaR. On this basis, we present optimization-based control approaches that integrate the worst-case CVaR into the control barrier function, taking into account both safe set and tail risk considerations. In particular, three types of safe sets are discussed in detail: half-space, polytope, and ellipsoid. It is shown that control inputs for the half-space and polytopic safe sets can be obtained via quadratic programs, while control inputs for the ellipsoidal safe set can be computed via a semidefinite program. Through numerical examples of an inverted pendulum, we compare its performance with existing methods and demonstrate the effectiveness of our proposed controller.


title: SalesBot 2.0: A Human-Like Intent-Guided Chit-Chat Dataset

abstract: In recent research on dialogue systems and corpora, there has been a significant focus on two distinct categories: task-oriented (TOD) and open-domain (chit-chat) dialogues. TOD systems aim to satisfy specific user goals, such as finding a movie to watch, whereas open-domain systems primarily focus on generating engaging conversations. A recent study by Chiu et al. (2022) introduced SalesBot, which provides simulators and a dataset with one-turn transition from chit-chat to task-oriented dialogues. However, the previously generated data solely relied on BlenderBot, which raised concerns about its long-turn naturalness and consistency during a conversation. To address this issue, this paper aims to build SalesBot 2.0, a revised version of the published data, by leveraging the commonsense knowledge of large language models (LLMs) through proper prompting. The objective is to gradually bridge the gap between chit-chat and TOD towards better naturalness and consistency. The newly released large-scale dataset with detailed annotations exhibits smoother transitions between topics and is more human-like in terms of naturalness and consistency. It can serve as a valuable resource for both academic research and commercial applications. Furthermore, our proposed framework can be applied to generate numerous dialogues with various target intents.


title: Unleash Model Potential: Bootstrapped Meta Self-supervised Learning

abstract: The long-term goal of machine learning is to learn general visual representations from a small amount of data without supervision, mimicking three advantages of human cognition: i) no need for labels, ii) robustness to data scarcity, and iii) learning from experience. Self-supervised learning and meta-learning are two promising techniques to achieve this goal, but they both only partially capture the advantages and fail to address all the problems. Self-supervised learning struggles to overcome the drawbacks of data scarcity, while ignoring prior knowledge that can facilitate learning and generalization. Meta-learning relies on supervised information and suffers from a bottleneck of insufficient learning. To address these issues, we propose a novel Bootstrapped Meta Self-Supervised Learning (BMSSL) framework that aims to simulate the human learning process. We first analyze the close relationship between meta-learning and self-supervised learning. Based on this insight, we reconstruct tasks to leverage the strengths of both paradigms, achieving advantages i and ii. Moreover, we employ a bi-level optimization framework that alternates between solving specific tasks with a learned ability (first level) and improving this ability (second level), attaining advantage iii. To fully harness its power, we introduce a bootstrapped target based on meta-gradient to make the model its own teacher. We validate the effectiveness of our approach with comprehensive theoretical and empirical study.


title: The minimal volume of surfaces of log general type with non-empty non-klt locus

abstract: We show that the minimal volume of surfaces of log general type, with non-empty non-klt locus on the ample model, is $\frac{1}{825}$. Furthermore, the ample model $V$ achieving the minimal volume is determined uniquely up to isomorphism. The canonical embedding presents $V$ as a degree $86$ hypersurface of $\mathbb P(6,11,25,43)$. This motivates a one-parameter deformation of $V$ to klt stable surfaces within the weighted projective space. Consequently, we identify a $\textit{complete}$ rational curve in the corresponding moduli space $M_{\frac{1}{825}}$. As an important application, we deduce that the smallest accumulation point of the set of volumes for projective log canonical surfaces equals $\frac{1}{825}$.


title: Utilizing Mood-Inducing Background Music in Human-Robot Interaction

abstract: Past research has clearly established that music can affect mood and that mood affects emotional and cognitive processing, and thus decision-making. It follows that if a robot interacting with a person needs to predict the person's behavior, knowledge of the music the person is listening to when acting is a potentially relevant feature. To date, however, there has not been any concrete evidence that a robot can improve its human-interactive decision-making by taking into account what the person is listening to. This research fills this gap by reporting the results of an experiment in which human participants were required to complete a task in the presence of an autonomous agent while listening to background music. Specifically, the participants drove a simulated car through an intersection while listening to music. The intersection was not empty, as another simulated vehicle, controlled autonomously, was also crossing the intersection in a different direction. Our results clearly indicate that such background information can be effectively incorporated in an agent's world representation in order to better predict people's behavior. We subsequently analyze how knowledge of music impacted both participant behavior and the resulting learned policy.\setcounter{footnote}{2}\footnote{An earlier version of part of the material in this paper appeared originally in the first author's Ph.D. Dissertation~\cite{liebman2020sequential} but it has not appeared in any pear-reviewed conference or journal.}


title: Radiative leptonic decay of heavy quarkonia

abstract: This study examines the properties of heavy quarkonia $X$ by treating them as bound states of $Q$ and $\bar{Q}$, where $Q$ represents either a charm or a bottom quark. The branching ratios for the radiative leptonic decays $X\rightarrow \gamma l^{+} l^{-}$ are revisited and the angular and energy/momentum distributions of the final state particles are analyzed in the rest frame of $X$. Furthermore, we apply Lorentz transformations from the rest frame of $X$ to the center-of-mass frame of $l^+ l^-$ to establish the connection between the widths ${\Gamma_{X \rightarrow \gamma l^{+} l^{-}}}$ and ${\Gamma_{X \rightarrow l^{+} l^{-}}}$. The connection aligns well with those documented in the literature (divided by $2\pi$) for various $X$ states, such as $J/\Psi$, $\Psi(2S)$, $\Upsilon(1S)$, and $\Upsilon(2S)$, exhibiting good agreements within 10\%. However, we observe a significant disparity in the ratio between ${\Gamma_{\Psi(2S) \to \gamma \tau^+ \tau^-}}$ and ${\Gamma_{\Psi(2S) \to \tau^+ \tau^-}}$, with our prediction being four times larger than those in the literature. The outcomes derived from this study held practical implications in describing the QED radiative processes and contribute to the investigation of QCD processes associated with the decays of heavy quarkonia and the searches for new physics.


title: Metric tensor at second perturbation order for spherically symmetric space-times

abstract: It is shown in this article that if the Einstein Equivalence Principle is valid on a particular metric theory of gravitation in a spherically symmetric space-time, then the time metric component is not equal to the negative of the inverse radial one unless the underlying potential is inversely proportional to the radial coordinate. At the weak field limit of approximation, a general formula is calculated and applied to some useful cases.


title: Goodhart's Law Applies to NLP's Explanation Benchmarks

abstract: Despite the rising popularity of saliency-based explanations, the research community remains at an impasse, facing doubts concerning their purpose, efficacy, and tendency to contradict each other. Seeking to unite the community's efforts around common goals, several recent works have proposed evaluation metrics. In this paper, we critically examine two sets of metrics: the ERASER metrics (comprehensiveness and sufficiency) and the EVAL-X metrics, focusing our inquiry on natural language processing. First, we show that we can inflate a model's comprehensiveness and sufficiency scores dramatically without altering its predictions or explanations on in-distribution test inputs. Our strategy exploits the tendency for extracted explanations and their complements to be "out-of-support" relative to each other and in-distribution inputs. Next, we demonstrate that the EVAL-X metrics can be inflated arbitrarily by a simple method that encodes the label, even though EVAL-X is precisely motivated to address such exploits. Our results raise doubts about the ability of current metrics to guide explainability research, underscoring the need for a broader reassessment of what precisely these metrics are intended to capture.


title: RefSearch: A Search Engine for Refactoring

abstract: Developers often refactor source code to improve its quality during software development. A challenge in refactoring is to determine if it can be applied or not. To help with this decision-making process, we aim to search for past refactoring cases that are similar to the current refactoring scenario. We have designed and implemented a system called RefSearch that enables users to search for refactoring cases through a user-friendly query language. The system collects refactoring instances using two refactoring detectors and provides a web interface for querying and browsing the cases. We used four refactoring scenarios as test cases to evaluate the expressiveness of the query language and the search performance of the system. RefSearch is available at https://github.com/salab/refsearch.


title: Parameter-Efficient Transfer Learning for Audio-Visual-Language Tasks

abstract: The pretrain-then-finetune paradigm has been widely used in various unimodal and multimodal tasks. However, finetuning all the parameters of a pre-trained model becomes prohibitive as the model size grows exponentially. To address this issue, the adapter mechanism that freezes the pre-trained model and only finetunes a few extra parameters is introduced and delivers promising results. Most studies on adapter architectures are dedicated to unimodal or bimodal tasks, while the adapter architectures for trimodal tasks have not been investigated yet. This paper introduces a novel Long Short-Term Trimodal Adapter (LSTTA) approach for video understanding tasks involving audio, visual, and language modalities. Based on the pre-trained from the three modalities, the designed adapter module is inserted between the sequential blocks to model the dense interactions across the three modalities. Specifically, LSTTA consists of two types of complementary adapter modules, namely the long-term semantic filtering module and the short-term semantic interaction module. The long-term semantic filtering aims to characterize the temporal importance of the video frames and the short-term semantic interaction module models local interactions within short periods. Compared to previous state-of-the-art trimodal learning methods pre-trained on a large-scale trimodal corpus, LSTTA is more flexible and can inherit any powerful unimodal or bimodal models. Experimental results on four typical trimodal learning tasks show the effectiveness of LSTTA over existing state-of-the-art methods.


title: A search for a muon to electron conversion in COMET

abstract: The COMET experiment at J-PARC, Japan, aims to search for muon to electron conversion with aluminium nuclei, achieving a sensitivity four orders of magnitude higher than the current upper limit at a 90% confidence level. The proton beam line has recently been completed, and muons have been successfully transported through the curved solenoid in the Phase-alpha of the experiment. In this paper, we will present preliminary results from the Phase-alpha beam measurement, the status of the intermediate sensitivity experiment (COMET Phase-I), and the ultimate goal of COMET Phase-II.


title: Alleviating Video-Length Effect for Micro-video Recommendation

abstract: Micro-videos platforms such as TikTok are extremely popular nowadays. One important feature is that users no longer select interested videos from a set, instead they either watch the recommended video or skip to the next one. As a result, the time length of users' watching behavior becomes the most important signal for identifying preferences. However, our empirical data analysis has shown a video-length effect that long videos are easier to receive a higher value of average view time, thus adopting such view-time labels for measuring user preferences can easily induce a biased model that favors the longer videos. In this paper, we propose a Video Length Debiasing Recommendation (VLDRec) method to alleviate such an effect for micro-video recommendation. VLDRec designs the data labeling approach and the sample generation module that better capture user preferences in a view-time oriented manner. It further leverages the multi-task learning technique to jointly optimize the above samples with original biased ones. Extensive experiments show that VLDRec can improve the users' view time by 1.81% and 11.32% on two real-world datasets, given a recommendation list of a fixed overall video length, compared with the best baseline method. Moreover, VLDRec is also more effective in matching users' interests in terms of the video content.


title: 9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation

abstract: The advancements in vision-based tactile sensors have boosted the aptitude of robots to perform contact-rich manipulation, particularly when precise positioning and contact state of the manipulated objects are crucial for successful execution. In this work, we present 9DTact, a straightforward yet versatile tactile sensor that offers 3D shape reconstruction and 6D force estimation capabilities. Conceptually, 9DTact is designed to be highly compact, robust, and adaptable to various robotic platforms. Moreover, it is low-cost and easy-to-fabricate, requiring minimal assembly skills. Functionally, 9DTact builds upon the optical principles of DTact and is optimized to achieve 3D shape reconstruction with enhanced accuracy and efficiency. Remarkably, we leverage the optical and deformable properties of the translucent gel so that 9DTact can perform 6D force estimation without the participation of auxiliary markers or patterns on the gel surface. More specifically, we collect a dataset consisting of approximately 100,000 image-force pairs from 175 complex objects and train a neural network to regress the 6D force, which can generalize to unseen objects. To promote the development and applications of vision-based tactile sensors, we open-source both the hardware and software of 9DTact, along with a comprehensive video tutorial, all of which are available at https://linchangyi1.github.io/9DTact.


title: Simulation Of The Microlensing Effect Near The Critical Curve Of The Galaxy Cluster

abstract: In the smooth mass distribution model, the critical curve represents a line with magnification divergence on the image plane in a strong gravitational lensing system. Considering the microlensing effects caused by discrete masses, the magnification map in the source plane exhibits a complex structure, which offers a promising way for detecting dark matter. However, simulating microlensing near the critical curve poses challenges due to magnification divergence and the substantial computational demands involved. To achieve the required simulation accuracy, direct inverse ray-shooting would require significant computational resources. Therefore we applied a GPU-based code optimized with interpolation method to enable efficient computation on a large scale. Using the GPU of NVIDIA Tesla V100S PCIe 32GB, it takes approximately 7000 seconds to calculate the effects of around 13,000 microlenses for a simulation involving 1013 emitted rays. Then we generated 80 magnification maps, and select 800 light curves for a statistical analysis of microcaustic density and peak magnification.


title: Sampling unknown large networks restricted by low sampling rates

abstract: Graph sampling plays an important role in data mining for large networks. Specifically, larger networks often correspond to lower sampling rates. Under the situation, traditional traversal-based samplings for large networks usually have an excessive preference for densely-connected network core nodes. Aim at this issue, this paper proposes a sampling method for unknown networks at low sampling rates, called SLSR, which first adopts a random node sampling to evaluate a degree threshold, utilized to distinguish the core from periphery, and the average degree in unknown networks, and then runs a double-layer sampling strategy on the core and periphery. SLSR is simple that results in a high time efficiency, but experimental evaluation confirms that the proposed method can accurately preserve many critical structures of unknown large networks with low sampling rates and low variances.


title: FonMTL: Towards Multitask Learning for the Fon Language

abstract: The Fon language, spoken by an average 2 million of people, is a truly low-resourced African language, with a limited online presence, and existing datasets (just to name but a few). Multitask learning is a learning paradigm that aims to improve the generalization capacity of a model by sharing knowledge across different but related tasks: this could be prevalent in very data-scarce scenarios. In this paper, we present the first explorative approach to multitask learning, for model capabilities enhancement in Natural Language Processing for the Fon language. Specifically, we explore the tasks of Named Entity Recognition (NER) and Part of Speech Tagging (POS) for Fon. We leverage two language model heads as encoders to build shared representations for the inputs, and we use linear layers blocks for classification relative to each task. Our results on the NER and POS tasks for Fon, show competitive (or better) performances compared to several multilingual pretrained language models finetuned on single tasks. Additionally, we perform a few ablation studies to leverage the efficiency of two different loss combination strategies and find out that the equal loss weighting approach works best in our case. Our code is open-sourced at https://github.com/bonaventuredossou/multitask_fon.


title: Signatures of the Self-organized Criticality Phenomenon in Precursors of Gamma-ray bursts

abstract: Precursors provide important clues to the nature of gamma-ray burst (GRB) central engines and can be used to contain GRB physical processes. In this letter, we study the self-organized criticality in precursors of long GRBs in the third Swift/BAT Catalog. We investigate the differential and cumulative size distributions of 100 precursors, including peak flux, duration, rise time, decay time, and quiescent time with the Markov Chain Monte Carlo technique. It is found that all of the distributions can be well described by power-law models and understood within the physical framework of a self-organized criticality system. In addition, we inspect the cumulative distribution functions of the size differences with a q-Gaussian function. The scale-invariance structures of precursors further strengthen our findings. Particularly, similar analyses are made in 127 main bursts. The results show that both precursors and main bursts can be attributed to an self-organized criticality system with the spatial dimension S = 3 and driven by the similar magnetically dominated process.


title: Estimation problems for some perturbations of the independence copula

abstract: This work provides a study of parameter estimators based on functions of Markov chains generated by some perturbations of the independence copula. We provide asymptotic distributions of maximum likelihood estimators and confidence intervals for copula parameters of several families of copulas introduced in Longla (2023). Another set of moment-like estimators is proposed along with a multivariate central limit theorem, that provides their asymptotic distributions. We investigate the particular case of Markov chains generated by sine copulas, sine-cosine copulas and the extended Farlie-Gumbel-Morgenstern copula family. Some tests of independence are proposed. A simulation study is provided for the three copula families of interest. This simulation proposes a comparative study of the two introduced estimators and the robust estimator of Longla and Peligrad (2021), showing advantages of the proposed work.


title: Averaging Principle on Semi-axis for Semi-linear Differential Equations

abstract: We establish an averaging principle on the real semi-axis for semi-linear equation \begin{equation}\label{eqAb1} x'=\varepsilon (\mathcal A x+f(t)+F(t,x))\nonumber \end{equation} with unbounded closed linear operator $\mathcal A$ and asymptotically Poisson stable (in particular, asymptotically stationary, asymptotically periodic, asymptotically quasi-periodic, asymptotically almost periodic, asymptotically almost automorphic, asymptotically recurrent) coefficients. Under some conditions we prove that there exists at least one solution, which possesses the same asymptotically recurrence property as the coefficients, in a small neighborhood of the stationary solution to the averaged equation, and this solution converges to the stationary solution of averaged equation uniformly on the real semi-axis when the small parameter approaches to zero.


title: Prompt to Transfer: Sim-to-Real Transfer for Traffic Signal Control with Prompt Learning

abstract: Numerous solutions are proposed for the Traffic Signal Control (TSC) tasks aiming to provide efficient transportation and mitigate congestion waste. In recent, promising results have been attained by Reinforcement Learning (RL) methods through trial and error in simulators, bringing confidence in solving cities' congestion headaches. However, there still exist performance gaps when simulator-trained policies are deployed to the real world. This issue is mainly introduced by the system dynamic difference between the training simulator and the real-world environments. The Large Language Models (LLMs) are trained on mass knowledge and proved to be equipped with astonishing inference abilities. In this work, we leverage LLMs to understand and profile the system dynamics by a prompt-based grounded action transformation. Accepting the cloze prompt template, and then filling in the answer based on accessible context, the pre-trained LLM's inference ability is exploited and applied to understand how weather conditions, traffic states, and road types influence traffic dynamics, being aware of this, the policies' action is taken and grounded based on realistic dynamics, thus help the agent learn a more realistic policy. We conduct experiments using DQN to show the effectiveness of the proposed PromptGAT's ability in mitigating the performance gap from simulation to reality (sim-to-real).


title: Product of prime ideals as factorization of submodules

abstract: For a proper submodule $N$ of a finitely generated module $M$ over a Noetherian ring, the product of prime ideals which occur in a regular prime extension filtration of $M$ over $N$ is defined as its generalized prime ideal factorization in $M$. In this article, we find conditions for a product of prime ideals to be the generalized prime ideal factorization of a submodule of some module. We show that a power of a prime ideal occurs in a generalized prime ideal factorization only if it is not equal to its lesser powers. Also, we show that ${{\mathfrak{p}}_1}^{r_1} \cdots {{\mathfrak{p}}_{n}}^{r_{n}}$ is a generalized prime ideal factorization if and only if for each $1 \leq i \leq n$, ${{\mathfrak{p}}_i}^{r_i}$ is the generalized prime ideal factorization of some submodule of a module.


title: Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection

abstract: Knowledge distillation (KD) has shown potential for learning compact models in dense object detection. However, the commonly used softmax-based distillation ignores the absolute classification scores for individual categories. Thus, the optimum of the distillation loss does not necessarily lead to the optimal student classification scores for dense object detectors. This cross-task protocol inconsistency is critical, especially for dense object detectors, since the foreground categories are extremely imbalanced. To address the issue of protocol differences between distillation and classification, we propose a novel distillation method with cross-task consistent protocols, tailored for the dense object detection. For classification distillation, we address the cross-task protocol inconsistency problem by formulating the classification logit maps in both teacher and student models as multiple binary-classification maps and applying a binary-classification distillation loss to each map. For localization distillation, we design an IoU-based Localization Distillation Loss that is free from specific network structures and can be compared with existing localization distillation losses. Our proposed method is simple but effective, and experimental results demonstrate its superiority over existing methods. Code is available at https://github.com/TinyTigerPan/BCKD.


title: Halin's Infinite Ray Theorems: Complexity and Reverse Mathematics: Version E

abstract: Halin [1965] proved that if a graph has $n$ many pairwise disjoint rays for each $n$ then it has infinitely many pairwise disjoint rays. We analyze the complexity of this and other similar results in terms of computable and proof theoretic complexity. The statement of Halin's theorem and the construction proving it seem very much like standard versions of compactness arguments such as K\"{o}nig's Lemma. Those results, while not computable, are relatively simple. They only use arithmetic procedures or, equivalently, finitely many iterations of the Turing jump. We show that several Halin type theorems are much more complicated. They are among the theorems of hyperarithmetic analysis. Such theorems imply the ability to iterate the Turing jump along any computable well ordering. Several important logical principles in this class have been extensively studied beginning with work of Kreisel, H. Friedman, Steel and others in the 1960s and 1970s. Until now, only one purely mathematical example was known. Our work provides many more and so answers Question 30 of Montalb\'{a}n's Open Questions in Reverse Mathematics [2011]. Some of these theorems including ones in Halin [1965] are also shown to have unusual proof theoretic strength as well.


title: GRB Optical and X-ray Plateau Properties Classifier Using Unsupervised Machine Learning

abstract: The division of Gamma-ray bursts (GRBs) into different classes, other than the "short" and "long", has been an active field of research. We investigate whether GRBs can be classified based on a broader set of parameters, including prompt and plateau emission ones. Observational evidence suggests the existence of more GRB sub-classes, but results so far are either conflicting or not statistically significant. The novelty here is producing a machine-learning-based classification of GRBs using their observed X-rays and optical properties. We used two data samples: the first, composed of 203 GRBs, is from the Neil Gehrels Swift Observatory (Swift/XRT), and the latter, composed of 134 GRBs, is from the ground-based Telescopes and Swift/UVOT. Both samples possess the plateau emission (a flat part of the light curve happening after the prompt emission, the main GRB event). We have applied the Gaussian Mixture Model (GMM) to explore multiple parameter spaces and sub-class combinations to reveal if there is a match between the current observational sub-classes and the statistical classification. With these samples and the algorithm, we spot a few micro-trends in certain cases, but we cannot conclude that any clear trend exists in classifying GRBs. These microtrends could point towards a deeper understanding of the physical meaning of these classes (e.g., a different environment of the same progenitor or different progenitors). However, a larger sample and different algorithms could achieve such goals. Thus, this methodology can lead to deeper insights in the future.


title: Heterogeneous integration of spin-photon interfaces with a scalable CMOS platform

abstract: Color centers in diamonds have emerged as a leading solid-state platform for advancing quantum technologies, satisfying the DiVincenzo criteria and recently achieving a quantum advantage in secret key distribution. Recent theoretical works estimate that general-purpose quantum computing using local quantum communication networks will require millions of physical qubits to encode thousands of logical qubits, which presents a substantial challenge to the hardware architecture at this scale. To address the unanswered scaling problem, in this work, we first introduce a scalable hardware modular architecture "Quantum System-on-Chip" (QSoC) that features compact two-dimensional arrays "quantum microchiplets" (QMCs) containing tin-vacancy (SnV-) spin qubits integrated on a cryogenic application-specific integrated circuit (ASIC). We demonstrate crucial architectural subcomponents, including (1) QSoC fabrication via a lock-and-release method for large-scale heterogeneous integration; (2) a high-throughput calibration of the QSoC for spin qubit spectral inhomogenous registration; (3) spin qubit spectral tuning functionality for inhomogenous compensation; (4) efficient spin-state preparation and measurement for improved spin and optical properties. QSoC architecture supports full connectivity for quantum memory arrays in a set of different resonant frequencies and offers the possibility for further scaling the number of solid-state physical qubits via larger and denser QMC arrays and optical frequency multiplexing networking.


title: The spine of two-particle Fleming-Viot process in a bounded interval

abstract: We show that the spine of the Fleming-Viot process driven by Brownian motion and starting with two particles in a bounded interval has a different law from that of Brownian motion conditioned to stay in the interval forever. Furthermore, we estimate the ``extra drift.''


title: Comparison of gap-based and flow-based control strategies using a new controlled stochastic cellular automaton model for traffic flow

abstract: Autonomous vehicles are widely considered an imperative element of future transportation systems, and their adoption is expected to reduce traffic congestion. What is an effective vehicle control to reduce it? This study explores the impact of different vehicle control strategies on traffic flow through simulations. To achieve this, we introduce a novel stochastic traffic flow model called the controlled stochastic optimal velocity (CSOV) model, which incorporates vehicle control effects. Two distinct control strategies are applied within the CSOV model: gap-based control (GC) and flow-based control (FC). The GC strategy regulates the velocity to equalize the gap between the front and rear vehicles. Conversely, the FC strategy regulates the velocity to maintain a consistent front and rear flow rate. The results show that there were density regions where the GC strategy improved the flow rate. However, only the GC strategy with the weak control resulted in a lower flow rate compared to when there was no control. Conversely, the FC strategy consistently improved the flow rate regardless of control strength, yielding more robust results. Furthermore, when the two controls achieve similar flow rates, the FC strategy provided a more robust velocity distribution for density change than the GC strategy.


title: Photonic spectro-interferometry with SCExAO/FIRST at the Subaru Telescope: towards H-alpha imaging of protoplanets

abstract: FIRST is a post Extreme Adaptive-Optics (ExAO) spectro-interferometer operating in the Visible (600-800 nm, R~400). Its exquisite angular resolution (a sensitivity analysis of on-sky data shows that bright companions can be detected down to 0.25lambda/D) combined with its sensitivity to pupil phase discontinuities (from a few nm up to dozens of microns) makes FIRST an ideal self-calibrated solution for enabling exoplanet detection and characterization in the future. We present the latest on-sky results along with recent upgrades, including the integration and on-sky test of a new spectrograph (R~3,600) optimized for the detection of H-alpha emission from young exoplanets accreting matter.


title: Robust Dynamic Operating Envelopes via Superellipsoid-based Convex Optimisation in Unbalanced Distribution Networks

abstract: Dynamic operating envelopes (DOEs) have been introduced to integrate distributed energy resources (DER) in distribution networks via real-time management of network capacity limits. Recent research demonstrates that uncertainties in DOE calculations should be carefully considered to ensure network integrity while minimising curtailment of consumer DERs. This letter proposes a novel approach to calculating DOEs that is robust against uncertainties in the utilisation of allocated capacity limits and demonstrates that the reported solution can attain close to global optimality performance compared with existing approaches.


title: Implications of the electron-phonon coupling in CuPb$_9$(PO$_4$)$_6$O for superconductivity: an \textit{ab initio} study

abstract: We report $ab~initio$ calculations of the electronic and vibrational properties in CuPb$_9$(PO$_4$)$_6$O, including the electron-phonon coupling strength via strong-coupling Migdal-Eliashberg theory. We verify the presence of appealing flat electronic bands near the Fermi level, a strong hybridization between the Cu $3d$ and O $2p$ states, and soft low-energy phonons, which can suggest high-temperature superconducting behavior. However, the electron-phonon coupling strength appears insufficient to overcome the Coulomb repulsion between an electron pair and thus does does not support high-temperature superconductivity in CuPb$_9$(PO$_4$)$_6$O via the conventional electron-phonon Migdal-Eliashberg mechanism. Even neglecting Coulomb repulsion of the electron pair we find this electron-phonon coupling suggests a superconducting transition temperature less than 2~K.


title: Traffic Light Control with Reinforcement Learning

abstract: Traffic light control is important for reducing congestion in urban mobility systems. This paper proposes a real-time traffic light control method using deep Q learning. Our approach incorporates a reward function considering queue lengths, delays, travel time, and throughput. The model dynamically decides phase changes based on current traffic conditions. The training of the deep Q network involves an offline stage from pre-generated data with fixed schedules and an online stage using real-time traffic data. A deep Q network structure with a "phase gate" component is used to simplify the model's learning task under different phases. A "memory palace" mechanism is used to address sample imbalance during the training process. We validate our approach using both synthetic and real-world traffic flow data on a road intersecting in Hangzhou, China. Results demonstrate significant performance improvements of the proposed method in reducing vehicle waiting time (57.1% to 100%), queue lengths (40.9% to 100%), and total travel time (16.8% to 68.0%) compared to traditional fixed signal plans.


title: RecMind: Large Language Model Powered Agent For Recommendation

abstract: While the recommendation system (RS) has advanced significantly through deep learning, current RS approaches usually train and fine-tune models on task-specific datasets, limiting their generalizability to new recommendation tasks and their ability to leverage external knowledge due to model scale and data size constraints. Thus, we designed an LLM-powered autonomous recommender agent, RecMind, which is capable of leveraging external knowledge, utilizing tools with careful planning to provide zero-shot personalized recommendations. We propose a Self-Inspiring algorithm to improve the planning ability. At each intermediate step, the LLM self-inspires to consider all previously explored states to plan for the next step. This mechanism greatly improves the model's ability to comprehend and utilize historical information in planning for recommendation. We evaluate RecMind's performance in various recommendation scenarios. Our experiment shows that RecMind outperforms existing zero/few-shot LLM-based recommendation baseline methods in various tasks and achieves comparable performance to a fully trained recommendation model P5.


title: Cell response on laser-patterned Ti/Zr/Ti and Ti/Cu/Ti multi-layer systems

abstract: Arranged patterns obtained by ultrafast laser processing on the surface of Ti/Cu/Ti/Si and Ti/Zr/Ti/Si thin film systems are reported. Two differently designed multilayer thin films, Ti/Cu/Ti/Si and Ti/Zr/Ti/Si, were deposited on silicon by the ion sputtering method. The bioactive surfaces on these systems involve the formation of laser-induced periodic surface structures (LIPSS) in each of the laser-written lines of mesh patterns on 5x5 mm areas. The formation of nano- and micro-patterns with an ultra-thin oxide film on the surfaces was used to observe the effects of morphology and proliferation of the MRC-5 cell culture line. To determine whether Ti-based thin films have a toxic effect on living cells, an MTT assay was performed. The relative cytotoxic effect as a percentage of surviving cells showed that there was no difference in cell number between the Ti-based thin films and the control cells. There was also no difference in the viability of the MRC-5 cells, except for the Ti/Cu/Ti/Si system, where there was a slight 10% decrease in cell viability.


title: Direct initial orbit determination

abstract: Initial orbit determination (IOD) is an important early step in the processing chain that makes sense of and reconciles the multiple optical observations of a resident space object. IOD methods generally operate on line-of-sight (LOS) vectors extracted from images of the object, hence the LOS vectors can be seen as discrete point samples of the raw optical measurements. Typically, the number of LOS vectors used by an IOD method is much smaller than the available measurements (\ie, the set of pixel intensity values), hence current IOD methods arguably under-utilize the rich information present in the data. In this paper, we propose a \emph{direct} IOD method called D-IOD that fits the orbital parameters directly on the observed streak images, without requiring LOS extraction. Since it does not utilize LOS vectors, D-IOD avoids potential inaccuracies or errors due to an imperfect LOS extraction step. Two innovations underpin our novel orbit-fitting paradigm: first, we introduce a novel non-linear least-squares objective function that computes the loss between the candidate-orbit-generated streak images and the observed streak images. Second, the objective function is minimized with a gradient descent approach that is embedded in our proposed optimization strategies designed for streak images. We demonstrate the effectiveness of D-IOD on a variety of simulated scenarios and challenging real streak images.


title: Reinforcement Strategies in General Lotto Games

abstract: Strategic decisions are often made over multiple periods of time, wherein decisions made earlier impact a competitor's success in later stages. In this paper, we study these dynamics in General Lotto games, a class of models describing the competitive allocation of resources between two opposing players. We propose a two-stage formulation where one of the players has reserved resources that can be strategically pre-allocated across the battlefields in the first stage of the game as reinforcements. The players then simultaneously allocate their remaining real-time resources, which can be randomized, in a decisive final stage. Our main contributions provide complete characterizations of the optimal reinforcement strategies and resulting equilibrium payoffs in these multi-stage General Lotto games. Interestingly, we determine that real-time resources are at least twice as effective as reinforcement resources when considering equilibrium payoffs.


title: Improving antibody language models with native pairing

abstract: Current antibody language models are limited by their use of unpaired antibody sequence data and the biases in publicly available antibody sequence datasets, which are skewed toward antibodies against a relatively small number of pathogens. A recently published dataset (by Jaffe, et al) of approximately 1.6 x 10^6 natively paired human antibody sequences from healthy donors represents by far the largest dataset of its kind and offers a unique opportunity to evaluate how antibody language models can be improved by training with natively paired antibody sequence data. We trained two Baseline Antibody Language Models (BALM), using natively paired (BALM-paired) or unpaired (BALM-unpaired) sequences from the Jaffe dataset. We provide evidence that training with natively paired sequences substantially improves model performance and that this improvement results from the model learning immunologically relevant features that span the light and heavy chains. We also show that ESM-2, a state-of-the-art general protein language model, learns similar cross-chain features when fine-tuned with natively paired antibody sequence data.


title: Artificial Intelligence in Career Counseling: A Test Case with ResumAI

abstract: The rise of artificial intelligence (AI) has led to various means of integration of AI aimed to provide efficiency in tasks, one of which is career counseling. A key part of getting a job is having a solid resume that passes through the first round of programs and recruiters. It is difficult to find good resources or schedule an appointment with a career counselor to help with editing a resume for a specific role. With the rise of ChatGPT, Bard, and several other AI chat programs it is possible to provide specific, automated feedback on various concerns to suggest places for improvement within the context of career counseling. This paper begins with a quick literature review on the ethical considerations and limitations of AI in career counseling. The authors also have created their own website service, called ResumAI, to test and review the functionality of an AI career counselor. The findings of this study will contribute to the understanding of chat AI ResumAI reviewer programs and sites. The implications of the findings for the field of career counseling, AI development, and ethical practice will be discussed.


title: Finite simple characteristic quotients of the free group of rank 2

abstract: In this paper we describe how to explicitly construct infinitely many finite simple groups as characteristic quotients of the rank 2 free group $F_2$. This shows that a "baby" version of the Wiegold conjecture fails for $F_2$, and provides counterexamples to two conjectures in the theory of noncongruence subgroups of $\text{SL}_2(\mathbb{Z})$. Our main result explicitly produces, for every prime power $q\ge 7$, the groups $\text{SL}_3(\mathbb{F}_q)$ and $\text{SU}_3(\mathbb{F}_q)$ as characteristic quotients of $F_2$. Our strategy is to study specializations of the Burau representation for the braid group $B_4$, exploiting an exceptional relationship between $F_2$ and $B_4$ first observed by Dyer, Formanek, and Grossman. Weisfeiler's strong approximation theorem guarantees that our specializations are surjective for infinitely many primes, but it is not effective. To make our result effective, we give another proof of surjectivity via a careful analysis of the maximal subgroup structures of $\text{SL}_3(\mathbb{F}_q)$ and $\text{SU}_3(\mathbb{F}_q)$. We also show that our examples of $\text{PSL}_3(\mathbb{F}_q)$ and $\text{PSU}_3(\mathbb{F}_q)$ are minimal in the sense that no group of the form $\text{PSL}_2(\mathbb{F}_q)$ is a characteristic quotient of $F_2$.


title: A large sample of newly-identified carbon-deficient red giants from APOGEE

abstract: Based on the APOGEE survey we conducted a search for carbon-deficient red giants (CDGs). We found 103 new CDGs, increasing the number in the literature by more than a factor of 3. CDGs are very rare, representing $0.03$~per cent of giants. They appear as an extended tail off the normal carbon distribution. We show that they are found in all components of the Galaxy, contrary to previous findings. The location of CDGs in the Hertzsprung-Russell diagram (HRD) shows that they are primarily intermediate-mass stars ($2-4~\rm{M}_{\odot}$). Their extended distribution may indicate that CDGs can also sometimes have $M < 2.0~\rm{M}_{\odot}$. We attempted to identify the evolutionary phases of the CDGs using stellar model tracks. We found that the bulk of the CDGs are likely in the subgiant branch or red clump phase, whereas other CDGs may be in the red giant branch or early asymptotic giant branch phases. Degeneracy in the HRD makes exact identification difficult. We examined their C, N, and O compositions and confirmed previous studies showing that the envelope material has undergone extensive hydrogen burning through the CN(O) cycle. The new-CDGs have [C+N+O/Fe] that generally sum to zero, indicating that they started with scaled-solar composition. However, the previously known-CDGs generally have [C+N+O/Fe$] > 0.0$, indicating that some He-burning products were added to their envelopes. As to the site(s) in which this originally occurred, we do not find a convincing solution.


title: Solving Attention Kernel Regression Problem via Pre-conditioner

abstract: The attention mechanism is the key to large language models, and the attention matrix serves as an algorithmic and computational bottleneck for such a scheme. In this paper, we define two problems, motivated by designing fast algorithms for proxy of attention matrix and solving regressions against them. Given an input matrix $A\in \mathbb{R}^{n\times d}$ with $n\gg d$ and a response vector $b$, we first consider the matrix exponential of the matrix $A^\top A$ as a proxy, and we in turn design algorithms for two types of regression problems: $\min_{x\in \mathbb{R}^d}\|(A^\top A)^jx-b\|_2$ and $\min_{x\in \mathbb{R}^d}\|A(A^\top A)^jx-b\|_2$ for any positive integer $j$. Studying algorithms for these regressions is essential, as matrix exponential can be approximated term-by-term via these smaller problems. The second proxy is applying exponential entrywise to the Gram matrix, denoted by $\exp(AA^\top)$ and solving the regression $\min_{x\in \mathbb{R}^n}\|\exp(AA^\top)x-b \|_2$. We call this problem the attention kernel regression problem, as the matrix $\exp(AA^\top)$ could be viewed as a kernel function with respect to $A$. We design fast algorithms for these regression problems, based on sketching and preconditioning. We hope these efforts will provide an alternative perspective of studying efficient approximation of attention matrices.


title: 3D stellar motion in the axisymmetric Galactic potential and the e-z resonances

abstract: The full phase space information on the kinematics of a huge number of stars provided by the Gaia third Data Release raises the demand for a better understanding of the 3D stellar dynamics. In this paper, we investigate the possible regimes of motion of stars in the axisymmetric approximation of a Galactic potential model. The model consists of three components: the axisymmetric disk, the central spheroidal bulge and the spherical halo of dark matter. The axisymmetric disk is divided into stellar and gaseous disk subcomponents, each one modeled by three Miyamoto-Nagai profiles. The physical and structural parameters of the Galaxy components are adjusted by observational kinematic constraints. The phase space of the two-degrees-of-freedom model is studied by means of the Poincar\'e and dynamical mapping, the dynamical spectrum method and the direct numerical integrations of the Hamiltonian equations of motion. For the chosen physical parameters, the nearly-circular and low-altitude stellar behaviour is composed of two weakly coupled simple oscillations, radial and vertical motions. The amplitudes of the vertical oscillations of these orbits are gradually increasing with the growing Galactocentric distances, in concordance with the exponential mass decay assumed. However, for increasing planar eccentricities and the altitudes over the equatorial disk, new regimes of stellar motion emerge as a result of the beating between the radial and vertical oscillation frequencies, which we refer to as e-z resonances. The corresponding resonant motion produces characteristic sudden increase or decrease of the amplitude of the vertical oscillation, bifurcations in the dynamical spectra and the chains of islands of stable motion in the phase space. The results obtained can be useful in the understanding and interpretation of the features observed in the stellar 3D distribution around the Sun.


title: Evaluating the Robustness to Instructions of Large Language Models

abstract: Recently, Instruction fine-tuning has risen to prominence as a potential method for enhancing the zero-shot capabilities of Large Language Models (LLMs) on novel tasks. This technique has shown an exceptional ability to boost the performance of moderately sized LLMs, sometimes even reaching performance levels comparable to those of much larger model variants. The focus is on the robustness of instruction-tuned LLMs to seen and unseen tasks. We conducted an exploration of six models including Alpaca, Vicuna, WizardLM, and Traditional Task-oriented Models(Flan-T5-XL/XXL, T0++) using real-world relation extraction datasets as case studies. We carried out a comprehensive evaluation of these instruction-following LLMs which have been tuned based on open-domain instructions and task-oriented instructions. The main discussion is their performance and robustness towards instructions. We have observed that in most cases, the model's performance in dealing with unfamiliar instructions tends to worsen significantly, and the robustness of the model for RE instructions deteriorates compared to QA. Further, we discovered that up until a certain parameter size threshold (3B), the performance of the FLAN-T5 model improves as the parameter count increases. The robustness of different scales of FLAN-T5 models to RE instruction is worse than the robustness to QA instruction.


title: How much Training is Needed in Downlink Cell-Free mMIMO under LoS/NLoS channels?

abstract: The assumption that no LoS channels exist between wireless access points~(APs) and user equipments~(UEs) becomes questionable in the context of the recent developments in the direction of cell free massive multiple input multiple output MIMO~(CF-mMIMO) systems. In CF-mMIMO systems, the access point density is assumed to be comparable to, or much larger than the the user density, thereby leading to the possibility of existence of LoS links between the UEs and the APs, depending on the local propagation conditions. In this paper, we compare the rates achievable by CF-mMIMO systems under probabilistic LoS/ NLos channels, with and without acquiring the channel state information~(CSI) of the fast fading components. We show that, under sufficiently large AP densities, statistical beamforming that does not require the knowledge about the fast fading components of the channels, performs almost at par with full beamforming, utilizing the information about the fast fading channel coefficients, thus potentially avoiding the need for training during every frame. We validate our results via detailed Monte Carlo simulations, and also elaborate the conditions under which statistical beamforming can be successfully employed in massive MIMO systems with LoS/ NLoS channels.


title: Policy Diversity for Cooperative Agents

abstract: Standard cooperative multi-agent reinforcement learning (MARL) methods aim to find the optimal team cooperative policy to complete a task. However there may exist multiple different ways of cooperating, which usually are very needed by domain experts. Therefore, identifying a set of significantly different policies can alleviate the task complexity for them. Unfortunately, there is a general lack of effective policy diversity approaches specifically designed for the multi-agent domain. In this work, we propose a method called Moment-Matching Policy Diversity to alleviate this problem. This method can generate different team policies to varying degrees by formalizing the difference between team policies as the difference in actions of selected agents in different policies. Theoretically, we show that our method is a simple way to implement a constrained optimization problem that regularizes the difference between two trajectory distributions by using the maximum mean discrepancy. The effectiveness of our approach is demonstrated on a challenging team-based shooter.


title: The harmonic strength of shells of lattices and weighted theta series

abstract: This is the write-up of a talk given in RIMS conference ``Analytic and arithmetic aspects of automorphic representations", where I outlined two kinds of different results related to the D4 lattice, obtained in a joint work with Hirao and Nozaki. In general, from the design theoretical viewpoints, we are interested in determining the harmonic strength of finite subsets on the unit sphere. When considering the shells of a lattice, this problem shifts to the non-vanishing problem of the Fourier coefficients of elliptic cusp forms. Various instances, mostly from root lattices, are listed in this note.


title: Defects and Oxygen Impurities in Ferroelectric Wurtzite Al$_{1-x}$Sc$_x$N Alloys

abstract: III-nitrides and related alloys are widely used for optoelectronics and as acoustic resonators. Ferroelectric wurtzite nitrides are of particular interest because of their potential for direct integration with Si and wide bandgap semiconductors, and unique polarization switching characteristics; such interest has taken off since the first report of ferroelectric Al$_{1-x}$Sc$_x$N alloys. However, the coercive fields needed to switch polarization are on the order of MV/cm, which is 1-2 orders of magnitude larger than oxide perovskite ferroelectrics. Atomic-scale point defects are known to impact the dielectric properties, including breakdown fields and leakage currents, as well as ferroelectric switching. However, very little is known about the native defects and impurities in Al$_{1-x}$Sc$_x$N, and their effect on the dielectric properties. In this study, we use first-principles calculations to determine the formation energetics of native defects and unintentional oxygen incorporation in Al$_{1-x}$Sc$_x$N. We find that nitrogen vacancies are the dominant native defects, and that they introduce multiple mid-gap states that can lead to premature dielectric breakdown in ferroelectrics and carrier recombination in optoelectronics. Growth under N-rich conditions will reduce the concentration of these deep defects. We also investigate unintentional oxygen incorporation on the nitrogen site and find that the substitutional defect is present in high concentrations, which can contribute to increased temperature-activated leakage currents. Our findings provide fundamental understanding of the defect physics in Al$_{1-x}$Sc$_x$N alloys, which is critical for future deployment of ferroelectric devices.


title: Spread Control Method on Unknown Networks Based on Hierarchical Reinforcement Learning

abstract: Epidemics such as COVID-19 pose serious threats to public health and our society, and it is critical to investigate effective methods to control the spread of epidemics over networks. Prior works on epidemic control often assume complete knowledge of network structures, a presumption seldom valid in real-world situations. In this paper, we study epidemic control on networks with unknown structures, and propose a hierarchical reinforcement learning framework for joint network structure exploration and epidemic control. To reduce the action space and achieve computation tractability, our proposed framework contains three modules: the Policy Selection Module, which determines whether to explore the structure or remove nodes to control the epidemic; the Explore Module, responsible for selecting nodes to explore; and the Remove Module, which decides which nodes to remove to stop the epidemic spread. Simulation results show that our proposed method outperforms baseline methods.


title: Local-Global Pseudo-label Correction for Source-free Domain Adaptive Medical Image Segmentation

abstract: Domain shift is a commonly encountered issue in medical imaging solutions, primarily caused by variations in imaging devices and data sources. To mitigate this problem, unsupervised domain adaptation techniques have been employed. However, concerns regarding patient privacy and potential degradation of image quality have led to an increased focus on source-free domain adaptation. In this study, we address the issue of false labels in self-training based source-free domain adaptive medical image segmentation methods. To correct erroneous pseudo-labels, we propose a novel approach called the local-global pseudo-label correction (LGDA) method for source-free domain adaptive medical image segmentation. Our method consists of two components: An offline local context-based pseudo-label correction method that utilizes local context similarity in image space. And an online global pseudo-label correction method based on class prototypes, which corrects erroneously predicted pseudo-labels by considering the relative distance between pixel-wise feature vectors and prototype vectors. We evaluate the performance of our method on three benchmark fundus image datasets for optic disc and cup segmentation. Our method achieves superior performance compared to the state-of-the-art approaches, even without using of any source data.


title: Three-dimensional flat Landau levels in an inhomogeneous acoustic crystal

abstract: When electrons moving in two-dimensions (2D) are subjected to a strong uniform magnetic field, they form flat bands called Landau levels, which are the basis for the quantum Hall effect. Landau levels can also arise from pseudomagnetic fields (PMFs) induced by lattice distortions; for example, mechanically straining graphene causes its Dirac quasiparticles to form a characteristic set of unequally-spaced Landau levels, including a zeroth Landau level. In three-dimensional (3D) systems, there has thus far been no experimental demonstration of Landau levels or any other type of flat band. For instance, applying a uniform magnetic field to materials hosting Weyl quasiparticles, the 3D generalizations of Dirac quasiparticles, yields bands that are non-flat in the direction of the field. Here, we report on the experimental realization of a flat 3D Landau level in an acoustic crystal. Starting from a lattice whose bandstructure exhibits a nodal ring, we design an inhomogeneous distortion corresponding to a specific pseudomagnetic vector potential (PVP) that causes the nodal ring states to break up into Landau levels, with a zeroth Landau level that is flat along all three directions. These findings point to the possibility of using nodal ring materials to generate 3D flat bands, to access strong interactions and other interesting physical regimes in 3D.


title: The Nesterov-Spokoiny Acceleration Achieves Strict $o(1/k^2)$ Convergence

abstract: We study a variant of an accelerated gradient algorithm of Nesterov and Spokoiny. We call this algorithm the Nesterov--Spokoiny Acceleration (NSA). The NSA algorithm simultaneously satisfies the following property: For a smooth convex objective $f \in \mathscr{F}_{L}^{\infty,1} (\mathbb{R}^n) $, the sequence $\{ \mathbf{x}_k \}_{k \in \mathbb{N}}$ governed by NSA satisfies $ \limsup\limits_{k \to \infty } k^2 ( f (\mathbf{x}_k ) - f^* ) = 0 $, where $f^* > -\infty$ is the minimum of $f$.


title: General Discrete-Time Fokker-Planck Control by Power Moments

abstract: In this paper, we address the so-called general Fokker-Planck control problem for discrete-time first-order linear systems. Unlike conventional treatments, we don't assume the distributions of the system states to be Gaussian. Instead, we only assume the existence and finiteness of the first several order power moments of the distributions. It is proved in the literature that there doesn't exist a solution, which has a form of conventional feedback control, to this problem. We propose a moment representation of the system to turn the original problem into a finite-dimensional one. Then a novel feedback control term, which is a mixture of a feedback term and a Markovian transition kernel term is proposed to serve as the control input of the moment system. The states of the moment system are obtained by maximizing the smoothness of the state transition. The power moments of the transition kernels are obtained by a convex optimization problem, of which the solution is proved to exist and be unique. Then they are mapped back to the probability distributions. The control inputs to the original system are then obtained by sampling from the realized distributions. Simulation results are provided to validate our algorithm in treating the general discrete-time Fokker-Planck control problem.


title: UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory

abstract: Parameter-efficient transfer learning (PETL), i.e., fine-tuning a small portion of parameters, is an effective strategy for adapting pre-trained models to downstream domains. To further reduce the memory demand, recent PETL works focus on the more valuable memory-efficient characteristic. In this paper, we argue that the scalability, adaptability, and generalizability of state-of-the-art methods are hindered by structural dependency and pertinency on specific pre-trained backbones. To this end, we propose a new memory-efficient PETL strategy, Universal Parallel Tuning (UniPT), to mitigate these weaknesses. Specifically, we facilitate the transfer process via a lightweight and learnable parallel network, which consists of: 1) A parallel interaction module that decouples the sequential connections and processes the intermediate activations detachedly from the pre-trained network. 2) A confidence aggregation module that learns optimal strategies adaptively for integrating cross-layer features. We evaluate UniPT with different backbones (e.g., T5, VSE$\infty$, CLIP4Clip, Clip-ViL, and MDETR) on various vision-and-language and pure NLP tasks. Extensive ablations on 18 datasets have validated that UniPT can not only dramatically reduce memory consumption and outperform the best competitor, but also achieve competitive performance over other plain PETL methods with lower training memory overhead. Our code is publicly available at: https://github.com/Paranioar/UniPT.


title: Symbolic & Acoustic: Multi-domain Music Emotion Modeling for Instrumental Music

abstract: Music Emotion Recognition involves the automatic identification of emotional elements within music tracks, and it has garnered significant attention due to its broad applicability in the field of Music Information Retrieval. It can also be used as the upstream task of many other human-related tasks such as emotional music generation and music recommendation. Due to existing psychology research, music emotion is determined by multiple factors such as the Timbre, Velocity, and Structure of the music. Incorporating multiple factors in MER helps achieve more interpretable and finer-grained methods. However, most prior works were uni-domain and showed weak consistency between arousal modeling performance and valence modeling performance. Based on this background, we designed a multi-domain emotion modeling method for instrumental music that combines symbolic analysis and acoustic analysis. At the same time, because of the rarity of music data and the difficulty of labeling, our multi-domain approach can make full use of limited data. Our approach was implemented and assessed using the publicly available piano dataset EMOPIA, resulting in a notable improvement over our baseline model with a 2.4% increase in overall accuracy, establishing its state-of-the-art performance.


title: On torsion spaces

abstract: The purpose of this note is to construct examples of compact torsion objects of ${\cal SH}(F)$ of every $p$-level over an arbitrary field of characteristic different from $p$. We adapt the approach of Mitchell to the algebraic situation. We show that the respective level is determined by the action of the $v_m$-elements on the $MGL$-motive, and also prove the refinement which permits to distinguish isotropic Morava points of the Balmer spectrum of ${\cal SH}(F)$.


title: Voice Conversion with Denoising Diffusion Probabilistic GAN Models

abstract: Voice conversion is a method that allows for the transformation of speaking style while maintaining the integrity of linguistic information. There are many researchers using deep generative models for voice conversion tasks. Generative Adversarial Networks (GANs) can quickly generate high-quality samples, but the generated samples lack diversity. The samples generated by the Denoising Diffusion Probabilistic Models (DDPMs) are better than GANs in terms of mode coverage and sample diversity. But the DDPMs have high computational costs and the inference speed is slower than GANs. In order to make GANs and DDPMs more practical we proposes DiffGAN-VC, a variant of GANs and DDPMS, to achieve non-parallel many-to-many voice conversion (VC). We use large steps to achieve denoising, and also introduce a multimodal conditional GANs to model the denoising diffusion generative adversarial network. According to both objective and subjective evaluation experiments, DiffGAN-VC has been shown to achieve high voice quality on non-parallel data sets. Compared with the CycleGAN-VC method, DiffGAN-VC achieves speaker similarity, naturalness and higher sound quality.


title: Video Multimodal Emotion Recognition System for Real World Applications

abstract: This paper proposes a system capable of recognizing a speaker's utterance-level emotion through multimodal cues in a video. The system seamlessly integrates multiple AI models to first extract and pre-process multimodal information from the raw video input. Next, an end-to-end MER model sequentially predicts the speaker's emotions at the utterance level. Additionally, users can interactively demonstrate the system through the implemented interface.


title: Leveraging A Medical Knowledge Graph into Large Language Models for Diagnosis Prediction

abstract: Electronic Health Records (EHRs) and routine documentation practices play a vital role in patients' daily care, providing a holistic record of health, diagnoses, and treatment. However, complex and verbose EHR narratives overload healthcare providers, risking diagnostic inaccuracies. While Large Language Models (LLMs) have showcased their potential in diverse language tasks, their application in the healthcare arena needs to ensure the minimization of diagnostic errors and the prevention of patient harm. In this paper, we outline an innovative approach for augmenting the proficiency of LLMs in the realm of automated diagnosis generation, achieved through the incorporation of a medical knowledge graph (KG) and a novel graph model: Dr.Knows, inspired by the clinical diagnostic reasoning process. We derive the KG from the National Library of Medicine's Unified Medical Language System (UMLS), a robust repository of biomedical knowledge. Our method negates the need for pre-training and instead leverages the KG as an auxiliary instrument aiding in the interpretation and summarization of complex medical concepts. Using real-world hospital datasets, our experimental results demonstrate that the proposed approach of combining LLMs with KG has the potential to improve the accuracy of automated diagnosis generation. More importantly, our approach offers an explainable diagnostic pathway, edging us closer to the realization of AI-augmented diagnostic decision support systems.


title: Machine Unlearning Methodology base on Stochastic Teacher Network

abstract: The rise of the phenomenon of the "right to be forgotten" has prompted research on machine unlearning, which grants data owners the right to actively withdraw data that has been used for model training, and requires the elimination of the contribution of that data to the model. A simple method to achieve this is to use the remaining data to retrain the model, but this is not acceptable for other data owners who continue to participate in training. Existing machine unlearning methods have been found to be ineffective in quickly removing knowledge from deep learning models. This paper proposes using a stochastic network as a teacher to expedite the mitigation of the influence caused by forgotten data on the model. We performed experiments on three datasets, and the findings demonstrate that our approach can efficiently mitigate the influence of target data on the model within a single epoch. This allows for one-time erasure and reconstruction of the model, and the reconstruction model achieves the same performance as the retrained model.