title: Model Tuning or Prompt Tuning? A Study of Large Language Models for Clinical Concept and Relation Extraction

abstract: Objective To develop soft prompt-based learning algorithms for large language models (LLMs), examine the shape of prompts, prompt-tuning using frozen/unfrozen LLMs, transfer learning, and few-shot learning abilities. Methods We developed a soft prompt-based LLM model and compared 4 training strategies including (1) fine-tuning without prompts; (2) hard-prompt with unfrozen LLMs; (3) soft-prompt with unfrozen LLMs; and (4) soft-prompt with frozen LLMs. We evaluated 7 pretrained LLMs using the 4 training strategies for clinical concept and relation extraction on two benchmark datasets. We evaluated the transfer learning ability of the prompt-based learning algorithms in a cross-institution setting. We also assessed the few-shot learning ability. Results and Conclusion When LLMs are unfrozen, GatorTron-3.9B with soft prompting achieves the best strict F1-scores of 0.9118 and 0.8604 for concept extraction, outperforming the traditional fine-tuning and hard prompt-based models by 0.6~3.1% and 1.2~2.9%, respectively; GatorTron-345M with soft prompting achieves the best F1-scores of 0.8332 and 0.7488 for end-to-end relation extraction, outperforming the other two models by 0.2~2% and 0.6~11.7%, respectively. When LLMs are frozen, small (i.e., 345 million parameters) LLMs have a big gap to be competitive with unfrozen models; scaling LLMs up to billions of parameters makes frozen LLMs competitive with unfrozen LLMs. For cross-institute evaluation, soft prompting with a frozen GatorTron-8.9B model achieved the best performance. This study demonstrates that (1) machines can learn soft prompts better than humans, (2) frozen LLMs have better few-shot learning ability and transfer learning ability to facilitate muti-institution applications, and (3) frozen LLMs require large models.


title: Distributed Multi-Time Slot Power Balancing Control of Power Systems with Energy Storage Devices

abstract: This paper studies a crucial problem in power system balancing control, i.e., the multi-time slot economic dispatch (MTSED) problem, for power grids with substantial renewables, synchronous generators (SGs), and energy storage devices (ESDs). The target of MTSED is to optimally coordinate active/reactive power outputs of all controllable units to meet a forecast net demand profile over multiple time slots within a receding finite time horizon. Firstly, the MTSED is formulated as an optimization problem with operational constraints, including the limits on the output of each controllable unit, ramping rates of SGss, energy levels of ESDs, and bus voltages. Then, a novel projection-based algorithm is developed to solve the problem in a distributed way. In particular, the distributed algorithm is not limited to solving the MTSED problem but also applies to more general optimization problems with both generic convex objective functions and hard feasibility constraints. Finally, case studies verify the effectiveness of the proposed method.


title: A Bayesian framework for discovering interpretable Lagrangian of dynamical systems from data

abstract: Learning and predicting the dynamics of physical systems requires a profound understanding of the underlying physical laws. Recent works on learning physical laws involve generalizing the equation discovery frameworks to the discovery of Hamiltonian and Lagrangian of physical systems. While the existing methods parameterize the Lagrangian using neural networks, we propose an alternate framework for learning interpretable Lagrangian descriptions of physical systems from limited data using the sparse Bayesian approach. Unlike existing neural network-based approaches, the proposed approach (a) yields an interpretable description of Lagrangian, (b) exploits Bayesian learning to quantify the epistemic uncertainty due to limited data, (c) automates the distillation of Hamiltonian from the learned Lagrangian using Legendre transformation, and (d) provides ordinary (ODE) and partial differential equation (PDE) based descriptions of the observed systems. Six different examples involving both discrete and continuous system illustrates the efficacy of the proposed approach.


title: Treatment Choice, Mean Square Regret and Partial Identification

abstract: We consider a decision maker who faces a binary treatment choice when their welfare is only partially identified from data. We contribute to the literature by anchoring our finite-sample analysis on mean square regret, a decision criterion advocated by Kitagawa, Lee, and Qiu (2022). We find that optimal rules are always fractional, irrespective of the width of the identified set and precision of its estimate. The optimal treatment fraction is a simple logistic transformation of the commonly used t-statistic multiplied by a factor calculated by a simple constrained optimization. This treatment fraction gets closer to 0.5 as the width of the identified set becomes wider, implying the decision maker becomes more cautious against the adversarial Nature.


title: Sample-Efficient Multi-Agent RL: An Optimization Perspective

abstract: We study multi-agent reinforcement learning (MARL) for the general-sum Markov Games (MGs) under the general function approximation. In order to find the minimum assumption for sample-efficient learning, we introduce a novel complexity measure called the Multi-Agent Decoupling Coefficient (MADC) for general-sum MGs. Using this measure, we propose the first unified algorithmic framework that ensures sample efficiency in learning Nash Equilibrium, Coarse Correlated Equilibrium, and Correlated Equilibrium for both model-based and model-free MARL problems with low MADC. We also show that our algorithm provides comparable sublinear regret to the existing works. Moreover, our algorithm combines an equilibrium-solving oracle with a single objective optimization subprocedure that solves for the regularized payoff of each deterministic joint policy, which avoids solving constrained optimization problems within data-dependent constraints (Jin et al. 2020; Wang et al. 2023) or executing sampling procedures with complex multi-objective optimization problems (Foster et al. 2023), thus being more amenable to empirical implementation.


title: Emergent Classical Spin Liquid Phases in an Ising Lattice via Size Effects

abstract: We show that a classical spin liquid phase can emerge from an ordered magnetic state in the two-dimensional frustrated Shastry-Sutherland Ising lattice due to lateral confinement. Two distinct classical spin liquid states are stabilized (i) long-range spin-correlated dimers, and (ii) exponentially decaying spin-correlated disordered states, depending on widths of W=3n, 3n+1 or W=3n+2, n being a positive integer. Stabilization of spin liquids in a square-triangular lattice moves beyond the conventional geometric paradigm of kagome, triangular or tetrahedral arrangements of antiferromagnetic ions, where spin liquids have been discussed conventionally.


title: We are what we repeatedly do: Inducing and deploying habitual schemas in persona-based responses

abstract: Many practical applications of dialogue technology require the generation of responses according to a particular developer-specified persona. While a variety of personas can be elicited from recent large language models, the opaqueness and unpredictability of these models make it desirable to be able to specify personas in an explicit form. In previous work, personas have typically been represented as sets of one-off pieces of self-knowledge that are retrieved by the dialogue system for use in generation. However, in realistic human conversations, personas are often revealed through story-like narratives that involve rich habitual knowledge -- knowledge about kinds of events that an agent often participates in (e.g., work activities, hobbies, sporting activities, favorite entertainments, etc.), including typical goals, sub-events, preconditions, and postconditions of those events. We capture such habitual knowledge using an explicit schema representation, and propose an approach to dialogue generation that retrieves relevant schemas to condition a large language model to generate persona-based responses. Furthermore, we demonstrate a method for bootstrapping the creation of such schemas by first generating generic passages from a set of simple facts, and then inducing schemas from the generated passages.


title: Compression Ratio Learning and Semantic Communications for Video Imaging

abstract: Camera sensors have been widely used in intelligent robotic systems. Developing camera sensors with high sensing efficiency has always been important to reduce the power, memory, and other related resources. Inspired by recent success on programmable sensors and deep optic methods, we design a novel video compressed sensing system with spatially-variant compression ratios, which achieves higher imaging quality than the existing snapshot compressed imaging methods with the same sensing costs. In this article, we also investigate the data transmission methods for programmable sensors, where the performance of communication systems is evaluated by the reconstructed images or videos rather than the transmission of sensor data itself. Usually, different reconstruction algorithms are designed for applications in high dynamic range imaging, video compressive sensing, or motion debluring. This task-aware property inspires a semantic communication framework for programmable sensors. In this work, a policy-gradient based reinforcement learning method is introduced to achieve the explicit trade-off between the compression (or transmission) rate and the image distortion. Numerical results show the superiority of the proposed methods over existing baselines.


title: Measuring scattering distributions in scanning helium microscopy

abstract: A scanning helium microscope typically utilises a thermal energy helium atom beam, with an energy and wavelength (<100 meV, ~0.05 nm) particularly sensitive to surface structure. An angular detector stage for a scanning helium microscope is presented that facilitates the in-situ measurement of scattering distributions from a sample. We begin by demonstrating typical elastic and inelastic scattering from ordered surfaces. We then go on to show the role of topography in diffuse scattering from disordered surfaces, observing deviations from simple cosine scattering. In total, these studies demonstrate the wealth of information that is encoded into the scattering distributions obtained with the technique.


title: Discriminative Speech Recognition Rescoring with Pre-trained Language Models

abstract: Second pass rescoring is a critical component of competitive automatic speech recognition (ASR) systems. Large language models have demonstrated their ability in using pre-trained information for better rescoring of ASR hypothesis. Discriminative training, directly optimizing the minimum word-error-rate (MWER) criterion typically improves rescoring. In this study, we propose and explore several discriminative fine-tuning schemes for pre-trained LMs. We propose two architectures based on different pooling strategies of output embeddings and compare with probability based MWER. We conduct detailed comparisons between pre-trained causal and bidirectional LMs in discriminative settings. Experiments on LibriSpeech demonstrate that all MWER training schemes are beneficial, giving additional gains upto 8.5\% WER. Proposed pooling variants achieve lower latency while retaining most improvements. Finally, our study concludes that bidirectionality is better utilized with discriminative training.


title: l-dyno: framework to learn consistent visual features using robot's motion

abstract: Historically, feature-based approaches have been used extensively for camera-based robot perception tasks such as localization, mapping, tracking, and others. Several of these approaches also combine other sensors (inertial sensing, for example) to perform combined state estimation. Our work rethinks this approach; we present a representation learning mechanism that identifies visual features that best correspond to robot motion as estimated by an external signal. Specifically, we utilize the robot's transformations through an external signal (inertial sensing, for example) and give attention to image space that is most consistent with the external signal. We use a pairwise consistency metric as a representation to keep the visual features consistent through a sequence with the robot's relative pose transformations. This approach enables us to incorporate information from the robot's perspective instead of solely relying on the image attributes. We evaluate our approach on real-world datasets such as KITTI & EuRoC and compare the refined features with existing feature descriptors. We also evaluate our method using our real robot experiment. We notice an average of 49% reduction in the image search space without compromising the trajectory estimation accuracy. Our method reduces the execution time of visual odometry by 4.3% and also reduces reprojection errors. We demonstrate the need to select only the most important features and show the competitiveness using various feature detection baselines.


title: Traveling wave solutions and spreading speeds for a scalar age-structured equation with nonlocal diffusion

abstract: In this paper, we study the existence of traveling wave solutions and the spreading speed for the solutions of an age-structured epidemic model with nonlocal diffusion. Our proofs make use of the comparison principles both to construct suitable sub/super-solutions and to prove the regularity of traveling waves solutions.


title: Deep Learning: A Tutorial

abstract: Our goal is to provide a review of deep learning methods which provide insight into structured high-dimensional data. Rather than using shallow additive architectures common to most statistical models, deep learning uses layers of semi-affine input transformations to provide a predictive rule. Applying these layers of transformations leads to a set of attributes (or, features) to which probabilistic statistical methods can be applied. Thus, the best of both worlds can be achieved: scalable prediction rules fortified with uncertainty quantification, where sparse regularization finds the features.


title: Power and sample size calculation of two-sample projection-based testing for sparsely observed functional data

abstract: Projection-based testing for mean trajectory differences in two groups of irregularly and sparsely observed functional data has garnered significant attention in the literature because it accommodates a wide spectrum of group differences and (non-stationary) covariance structures. This article presents the derivation of the theoretical power function and the introduction of a comprehensive power and sample size (PASS) calculation toolkit tailored to the projection-based testing method developed by Wang (2021). Our approach accommodates a wide spectrum of group difference scenarios and a broad class of covariance structures governing the underlying processes. Through extensive numerical simulation, we demonstrate the robustness of this testing method by showcasing that its statistical power remains nearly unaffected even when a certain percentage of observations are missing, rendering it 'missing-immune'. Furthermore, we illustrate the practical utility of this test through analysis of two randomized controlled trials of Parkinson's disease. To facilitate implementation, we provide a user-friendly R package fPASS, complete with a detailed vignette to guide users through its practical application. We anticipate that this article will significantly enhance the usability of this potent statistical tool across a range of biostatistical applications, with a particular focus on its relevance in the design of clinical trials.


title: A Unified View on Solving Objective Mismatch in Model-Based Reinforcement Learning

abstract: Model-based Reinforcement Learning (MBRL) aims to make agents more sample-efficient, adaptive, and explainable by learning an explicit model of the environment. While the capabilities of MBRL agents have significantly improved in recent years, how to best learn the model is still an unresolved question. The majority of MBRL algorithms aim at training the model to make accurate predictions about the environment and subsequently using the model to determine the most rewarding actions. However, recent research has shown that model predictive accuracy is often not correlated with action quality, tracing the root cause to the objective mismatch between accurate dynamics model learning and policy optimization of rewards. A number of interrelated solution categories to the objective mismatch problem have emerged as MBRL continues to mature as a research area. In this work, we provide an in-depth survey of these solution categories and propose a taxonomy to foster future research.


title: Get the gist? Using large language models for few-shot decontextualization

abstract: In many NLP applications that involve interpreting sentences within a rich context -- for instance, information retrieval systems or dialogue systems -- it is desirable to be able to preserve the sentence in a form that can be readily understood without context, for later reuse -- a process known as ``decontextualization''. While previous work demonstrated that generative Seq2Seq models could effectively perform decontextualization after being fine-tuned on a specific dataset, this approach requires expensive human annotations and may not transfer to other domains. We propose a few-shot method of decontextualization using a large language model, and present preliminary results showing that this method achieves viable performance on multiple domains using only a small set of examples.


title: Effects of Metallicity on the Instability Mass Ratio of Low Mass Contact Binary Systems

abstract: The orbital stability of contact binary systems has been receiving considerable attention recently. Theoretical studies indicate that merger is likely to occur at very low mass ratios, but the actual mass ratio at which merger may take place is likely to be variable and dependent on the mass of the primary. We consider the effects of metal content on the orbital stability of contact binary systems by modelling the gyration radius of a rotating and tidally distorted primary component at various values of metallicity in the range -1.25 to +0.5. We determine the instability mass ratio range for contact binary systems with a low mass primary in the range 0.6M(sun) to 1.4M(sun) at various metallicity levels and show that systems with low metallicity have an instability mass ratio lower than those with higher metal content and therefore are likely to be more stable. We illustrate the effect through light curve analysis of two otherwise very similar contact binary systems, except for different metallicity. While both would be considered unstable if metallicity was not taken into consideration, only one remains in that category after appropriate adjustments based on metallicity have been made.


title: Rate Compatible LDPC Neural Decoding Network: A Multi-Task Learning Approach

abstract: Deep learning based decoding networks have shown significant improvement in decoding LDPC codes, but the neural decoders are limited by rate-matching operations such as puncturing or extending, thus needing to train multiple decoders with different code rates for a variety of channel conditions. In this correspondence, we propose a Multi-Task Learning based rate-compatible LDPC ecoding network, which utilizes the structure of raptor-like LDPC codes and can deal with multiple code rates. In the proposed network, different portions of parameters are activated to deal with distinct code rates, which leads to parameter sharing among tasks. Numerical experiments demonstrate the effectiveness of the proposed method. Training the specially designed network under multiple code rates makes the decoder compatible with multiple code rates without sacrificing frame error rate performance.


title: SCAR: Power Side-Channel Analysis at RTL-Level

abstract: Power side-channel attacks exploit the dynamic power consumption of cryptographic operations to leak sensitive information of encryption hardware. Therefore, it is necessary to conduct power side-channel analysis for assessing the susceptibility of cryptographic systems and mitigating potential risks. Existing power side-channel analysis primarily focuses on post-silicon implementations, which are inflexible in addressing design flaws, leading to costly and time-consuming post-fabrication design re-spins. Hence, pre-silicon power side-channel analysis is required for early detection of vulnerabilities to improve design robustness. In this paper, we introduce SCAR, a novel pre-silicon power side-channel analysis framework based on Graph Neural Networks (GNN). SCAR converts register-transfer level (RTL) designs of encryption hardware into control-data flow graphs and use that to detect the design modules susceptible to side-channel leakage. Furthermore, we incorporate a deep learning-based explainer in SCAR to generate quantifiable and human-accessible explanation of our detection and localization decisions. We have also developed a fortification component as a part of SCAR that uses large-language models (LLM) to automatically generate and insert additional design code at the localized zone to shore up the side-channel leakage. When evaluated on popular encryption algorithms like AES, RSA, and PRESENT, and postquantum cryptography algorithms like Saber and CRYSTALS-Kyber, SCAR, achieves up to 94.49% localization accuracy, 100% precision, and 90.48% recall. Additionally, through explainability analysis, SCAR reduces features for GNN model training by 57% while maintaining comparable accuracy. We believe that SCAR will transform the security-critical hardware design cycle, resulting in faster design closure at a reduced design cost.


title: Using Participants' Utility Functions to Compare Versions of Differential Privacy

abstract: We use decision theory to compare variants of differential privacy from the perspective of prospective study participants. We posit the existence of a preference ordering on the set of potential consequences that study participants can incur, which enables the analysis of individual utility functions. Drawing upon the theory of measurement, we argue that changes in expected utilities should be measured via the classic Euclidean metric. We then consider the question of which privacy guarantees would be more appealing for individuals under different decision settings. Through our analysis, we found that the nature of the potential participant's utility function, along with the specific values of $\epsilon$ and $\delta$, can greatly alter which privacy guarantees are preferable.


title: Cross-modal Cognitive Consensus guided Audio-Visual Segmentation

abstract: Audio-Visual Segmentation (AVS) aims to extract the sounding object from a video frame, which is represented by a pixel-wise segmentation mask for application scenarios such as multi-modal video editing, augmented reality, and intelligent robot systems. The pioneering work conducts this task through dense feature-level audio-visual interaction, which ignores the dimension gap between different modalities. More specifically, the audio clip could only provide a Global semantic label in each sequence, but the video frame covers multiple semantic objects across different Local regions, which leads to mislocalization of the representationally similar but semantically different object. In this paper, we propose a Cross-modal Cognitive Consensus guided Network (C3N) to align the audio-visual semantics from the global dimension and progressively inject them into the local regions via an attention mechanism. Firstly, a Cross-modal Cognitive Consensus Inference Module (C3IM) is developed to extract a unified-modal label by integrating audio/visual classification confidence and similarities of modality-agnostic label embeddings. Then, we feed the unified-modal label back to the visual backbone as the explicit semantic-level guidance via a Cognitive Consensus guided Attention Module (CCAM), which highlights the local features corresponding to the interested object. Extensive experiments on the Single Sound Source Segmentation (S4) setting and Multiple Sound Source Segmentation (MS3) setting of the AVSBench dataset demonstrate the effectiveness of the proposed method, which achieves state-of-the-art performance. Code will be available at https://github.com/ZhaofengSHI/AVS-C3N once accepted.


title: An experiment on an automated literature survey of data-driven speech enhancement methods

abstract: The increasing number of scientific publications in acoustics, in general, presents difficulties in conducting traditional literature surveys. This work explores the use of a generative pre-trained transformer (GPT) model to automate a literature survey of 116 articles on data-driven speech enhancement methods. The main objective is to evaluate the capabilities and limitations of the model in providing accurate responses to specific queries about the papers selected from a reference human-based survey. While we see great potential to automate literature surveys in acoustics, improvements are needed to address technical questions more clearly and accurately.


title: Self-Discriminative Modeling for Anomalous Graph Detection

abstract: This paper studies the problem of detecting anomalous graphs using a machine learning model trained on only normal graphs, which has many applications in molecule, biology, and social network data analysis. We present a self-discriminative modeling framework for anomalous graph detection. The key idea, mathematically and numerically illustrated, is to learn a discriminator (classifier) from the given normal graphs together with pseudo-anomalous graphs generated by a model jointly trained, where we never use any true anomalous graphs and we hope that the generated pseudo-anomalous graphs interpolate between normal ones and (real) anomalous ones. Under the framework, we provide three algorithms with different computational efficiencies and stabilities for anomalous graph detection. The three algorithms are compared with several state-of-the-art graph-level anomaly detection baselines on nine popular graph datasets (four with small size and five with moderate size) and show significant improvement in terms of AUC. The success of our algorithms stems from the integration of the discriminative classifier and the well-posed pseudo-anomalous graphs, which provide new insights for anomaly detection. Moreover, we investigate our algorithms for large-scale imbalanced graph datasets. Surprisingly, our algorithms, though fully unsupervised, are able to significantly outperform supervised learning algorithms of anomalous graph detection. The corresponding reason is also analyzed.


title: Flying doughnut terahertz pulses generated from semiconductor currents

abstract: The ability to manipulate the space-time structure of light waves diversifies light-matter interaction and light-driven applications. Conventionally, metasurfaces are employed to locally control the amplitude and phase of light fields by the material response and structure of small meta-atoms. However, the fixed spatial structures of metasurfaces offer limited opportunities. Here, using quantum control we introduce a new approach that enables the amplitude, sign, and even configuration of the generated light fields to be manipulated in an all-optical manner. Following this approach, we demonstrate the generation of flying doughnut terahertz (THz) pulses. We show that the single-cycle THz pulse radiated from the dynamic semiconductor ring current has an electric field structure that is azimuthally polarized and that the space- and time-resolved magnetic field has a strong, isolated longitudinal component. As a first application, we detect absorption features from ambient water vapor on the spatiotemporal structure of the measured electric fields and the calculated magnetic fields. Quantum control is a powerful and flexible route to generating any structured light pulse in the THz range, while pulse compression of cylindrical vector beams is available for very high-power magnetic-pulse generation from the mid-infrared to near UV spectral region. Pulses such as these will serve as unique probes for spectroscopy, imaging, telecommunications, and magnetic materials.


title: Persistent Sullivan Minimal Models of Metric Spaces

abstract: This is a note of the author's ongoing work on persistent Sullivan minimal models. Sullivan minimal models have been important tools in rational homotopy theory for representing topological spaces using simplified algebraic structures. In this note, we study persistent Sullivan minimal models for persistent spaces and establish their stability results. For the case of Vietoris-Rips filtrations arising from metric spaces, such stability results can provide a stronger lower bound estimate of the Gromov-Hausdorff distance between metric spaces than the standard persistent homology.


title: Astronomical Infrared Bands and Diffuse Interstellar Bands Both Reproduced by Hydrocarbon Pentagon-Hexagon Combined PAH Molecules

abstract: This study theoretically predicts the specific Polycyclic Aromatic Hydrocarbon (PAH) molecules to reproduce both astronomically observed Infrared Bands (IR) and Diffuse Interstellar Bands (DIB). In our recent paper, we could reproduce IR by the hydrocarbon pentagon-hexagon combined PAH molecules using Density Functional Theory (DFT). Found molecules were (C53H18), and (C23H12) with two carbon pentagons among hexagon networks. Origin of DIB may come from the molecular orbital excitation. We applied Time-Dependent DFT calculation. In case of (C53H18), by comparing calculation with observed DIB, we found 7 coincide bands among 42 calculated bands within observed band width. For example, neutral (C53H18) shows calculated 577.35nm band coincide well with observed DIB at 577.95nm within 1.55nm observed band width. Mono-cation shows calculated 627.87nm correspond to observed 627.83nm, also for di-cation calculated 635.89nm to observed 635.95nm. For smaller size molecule (C23H12), we found 5 coincide bands, of which mono-cation shows calculated 713.92nm coincide with observed 713.80nm, di-cation shows calculated 653.27nm correlate to observed 653.21nm. By such quantum-chemical survey, we could predict specific PAH molecules floating in interstellar space.


title: First direction sensitive search for dark matter with a nuclear emulsion detector at a surface site

abstract: Fine-grained nuclear emulsion films have been developed as a tracking detector with nanometric spatial resolution to be used in direction-sensitive dark matter searches, thanks to novel readout technologies capable of exploiting this unprecedented resolution. Emulsion detectors are time insensitive. Therefore, a directional dark matter search with such detector requires the use of an equatorial telescope to absorb the Earth rotation effect. We have conducted for the first time a directional dark matter search in an unshielded location, at the sea level, by keeping an emulsion detector exposed for 39 days on an equatorial telescope mount. The observed angular distribution of the data collected during an exposure equivalent to 0.59 g days agrees with the background model and an exclusion plot was then derived in the dark matter mass and cross-section plane: cross-sections higher than $1.3 \times 10^{-28}$ cm$^{2}$ and $1.7 \times 10^{-31}$ cm$^2$ were excluded for a dark matter mass of $10$ GeV$/c^2$ and $100$ GeV$/c^2$, respectively. This is the first direction sensitive search for dark matter with a solid-state, particle tracking detector.


title: CodeFuse-13B: A Pretrained Multi-lingual Code Large Language Model

abstract: Code Large Language Models (Code LLMs) have gained significant attention in the industry due to their wide applications in the full lifecycle of software engineering. However, the effectiveness of existing models in understanding non-English inputs for multi-lingual code-related tasks is still far from well studied. This paper introduces CodeFuse-13B, an open-sourced pre-trained code LLM. It is specifically designed for code-related tasks with both English and Chinese prompts and supports over 40 programming languages. CodeFuse achieves its effectiveness by utilizing a high quality pre-training dataset that is carefully filtered by program analyzers and optimized during the training process. Extensive experiments are conducted using real-world usage scenarios, the industry-standard benchmark HumanEval-x, and the specially designed CodeFuseEval for Chinese prompts. To assess the effectiveness of CodeFuse, we actively collected valuable human feedback from the AntGroup's software development process where CodeFuse has been successfully deployed. The results demonstrate that CodeFuse-13B achieves a HumanEval pass@1 score of 37.10%, positioning it as one of the top multi-lingual code LLMs with similar parameter sizes. In practical scenarios, such as code generation, code translation, code comments, and testcase generation, CodeFuse performs better than other models when confronted with Chinese prompts.


title: A Pair of Garside Shadows

abstract: We prove that the smallest elements of Shi parts and cone type parts exist and form Garside shadows. The latter resolves a conjecture of Parkinson and the second author as well as a conjecture of Hohlweg, Nadeau and Williams.


title: Bi-Level Offline Policy Optimization with Limited Exploration

abstract: We study offline reinforcement learning (RL) which seeks to learn a good policy based on a fixed, pre-collected dataset. A fundamental challenge behind this task is the distributional shift due to the dataset lacking sufficient exploration, especially under function approximation. To tackle this issue, we propose a bi-level structured policy optimization algorithm that models a hierarchical interaction between the policy (upper-level) and the value function (lower-level). The lower level focuses on constructing a confidence set of value estimates that maintain sufficiently small weighted average Bellman errors, while controlling uncertainty arising from distribution mismatch. Subsequently, at the upper level, the policy aims to maximize a conservative value estimate from the confidence set formed at the lower level. This novel formulation preserves the maximum flexibility of the implicitly induced exploratory data distribution, enabling the power of model extrapolation. In practice, it can be solved through a computationally efficient, penalized adversarial estimation procedure. Our theoretical regret guarantees do not rely on any data-coverage and completeness-type assumptions, only requiring realizability. These guarantees also demonstrate that the learned policy represents the "best effort" among all policies, as no other policies can outperform it. We evaluate our model using a blend of synthetic, benchmark, and real-world datasets for offline RL, showing that it performs competitively with state-of-the-art methods.


title: The AI Incident Database as an Educational Tool to Raise Awareness of AI Harms: A Classroom Exploration of Efficacy, Limitations, & Future Improvements

abstract: Prior work has established the importance of integrating AI ethics topics into computer and data sciences curricula. We provide evidence suggesting that one of the critical objectives of AI Ethics education must be to raise awareness of AI harms. While there are various sources to learn about such harms, The AI Incident Database (AIID) is one of the few attempts at offering a relatively comprehensive database indexing prior instances of harms or near harms stemming from the deployment of AI technologies in the real world. This study assesses the effectiveness of AIID as an educational tool to raise awareness regarding the prevalence and severity of AI harms in socially high-stakes domains. We present findings obtained through a classroom study conducted at an R1 institution as part of a course focused on the societal and ethical considerations around AI and ML. Our qualitative findings characterize students' initial perceptions of core topics in AI ethics and their desire to close the educational gap between their technical skills and their ability to think systematically about ethical and societal aspects of their work. We find that interacting with the database helps students better understand the magnitude and severity of AI harms and instills in them a sense of urgency around (a) designing functional and safe AI and (b) strengthening governance and accountability mechanisms. Finally, we compile students' feedback about the tool and our class activity into actionable recommendations for the database development team and the broader community to improve awareness of AI harms in AI ethics education.


title: Trainability Analysis of Quantum Optimization Algorithms from a Bayesian Lens

abstract: The Quantum Approximate Optimization Algorithm (QAOA) is an extensively studied variational quantum algorithm utilized for solving optimization problems on near-term quantum devices. A significant focus is placed on determining the effectiveness of training the $n$-qubit QAOA circuit, i.e., whether the optimization error can converge to a constant level as the number of optimization iterations scales polynomially with the number of qubits. In realistic scenarios, the landscape of the corresponding QAOA objective function is generally non-convex and contains numerous local optima. In this work, motivated by the favorable performance of Bayesian optimization in handling non-convex functions, we theoretically investigate the trainability of the QAOA circuit through the lens of the Bayesian approach. This lens considers the corresponding QAOA objective function as a sample drawn from a specific Gaussian process. Specifically, we focus on two scenarios: the noiseless QAOA circuit and the noisy QAOA circuit subjected to local Pauli channels. Our first result demonstrates that the noiseless QAOA circuit with a depth of $\tilde{\mathcal{O}}\left(\sqrt{\log n}\right)$ can be trained efficiently, based on the widely accepted assumption that either the left or right slice of each block in the circuit forms a local 1-design. Furthermore, we show that if each quantum gate is affected by a $q$-strength local Pauli channel with the noise strength range of $1/{\rm poly} (n)$ to 0.1, the noisy QAOA circuit with a depth of $\mathcal{O}\left(\log n/\log(1/q)\right)$ can also be trained efficiently. Our results offer valuable insights into the theoretical performance of quantum optimization algorithms in the noisy intermediate-scale quantum era.


title: Towards Mitigating Hallucination in Large Language Models via Self-Reflection

abstract: Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where models generate plausible-sounding but unfaithful or nonsensical information. This issue becomes particularly critical in the medical domain due to the uncommon professional concepts and potential social risks involved. This paper analyses the phenomenon of hallucination in medical generative QA systems using widely adopted LLMs and datasets. Our investigation centers on the identification and comprehension of common problematic answers, with a specific emphasis on hallucination. To tackle this challenge, we present an interactive self-reflection methodology that incorporates knowledge acquisition and answer generation. Through this feedback process, our approach steadily enhances the factuality, consistency, and entailment of the generated answers. Consequently, we harness the interactivity and multitasking ability of LLMs and produce progressively more precise and accurate answers. Experimental results on both automatic and human evaluation demonstrate the superiority of our approach in hallucination reduction compared to baselines.


title: Let Models Speak Ciphers: Multiagent Debate through Embeddings

abstract: Discussion and debate among Large Language Models (LLMs) have gained considerable attention due to their potential to enhance the reasoning ability of LLMs. Although natural language is an obvious choice for communication due to LLM's language understanding capability, the token sampling step needed when generating natural language poses a potential risk of information loss, as it uses only one token to represent the model's belief across the entire vocabulary. In this paper, we introduce a communication regime named CIPHER (Communicative Inter-Model Protocol Through Embedding Representation) to address this issue. Specifically, we remove the token sampling step from LLMs and let them communicate their beliefs across the vocabulary through the expectation of the raw transformer output embeddings. Remarkably, by deviating from natural language, CIPHER offers an advantage of encoding a broader spectrum of information without any modification to the model weights, outperforming the state-of-the-art LLM debate methods using natural language by 0.5-5.0% across five reasoning tasks and multiple open-source LLMs of varying sizes. This showcases the superiority and robustness of embeddings as an alternative "language" for communication among LLMs. We anticipate that CIPHER will inspire further exploration for the design of interactions within LLM agent systems, offering a new direction that could significantly influence future developments in the field.


title: Quantum state tomography with disentanglement algorithm

abstract: In this work, we report on a novel quantum state reconstruction process based on the disentanglement algorithm. Using variational quantum circuits, we disentangle the quantum state to a product of computational zero states. Inverse evolution of the zero states reconstructs the quantum state up to an overall phase. By sequentially disentangling the qubit one by one, we reduce the required measurements with only single qubit measurement. Demonstrations with our proposal for the reconstruction of the random states are presented where variational quantum circuit is optimized by disentangling process. To facilitate experimental implementation, we also employ reinforcement learning for quantum circuit design with limited discrete quantum gates. Our method is universal and imposes no specific ansatz or constrain on the quantum state.


title: Life cycle insurance, bequest motives and annuity loads

abstract: We investigate insurance purchases when bequest motives are age-varying and life insurance and life annuities both carry loads. The existing life cycle literature assumes bequests are normal goods without being either necessities or luxuries. Much of the literature also assumes implicitly that life annuity loads are negative. A key finding of the literature is that the demand for life insurance and the demand for life annuities are symmetrical. It is optimal to buy life-contingent insurance throughout life, even under loads. A life annuity phase backs directly onto a life insurance phase. We find that realistic examples with positive loads on both products reveal up to two distinct periods of non-participation, one in midlife and the other adjoining the maximum age. We highlight examples with necessity bequests during child-rearing years and luxury bequests thereafter. This set of assumptions explains why a substantial demand for life insurance during child-rearing years can co-exist with negligible demand for life annuities later on. A realistic 18% load on both products generates this outcome.


title: High-Fidelity 3D Head Avatars Reconstruction through Spatially-Varying Expression Conditioned Neural Radiance Field

abstract: One crucial aspect of 3D head avatar reconstruction lies in the details of facial expressions. Although recent NeRF-based photo-realistic 3D head avatar methods achieve high-quality avatar rendering, they still encounter challenges retaining intricate facial expression details because they overlook the potential of specific expression variations at different spatial positions when conditioning the radiance field. Motivated by this observation, we introduce a novel Spatially-Varying Expression (SVE) conditioning. The SVE can be obtained by a simple MLP-based generation network, encompassing both spatial positional features and global expression information. Benefiting from rich and diverse information of the SVE at different positions, the proposed SVE-conditioned neural radiance field can deal with intricate facial expressions and achieve realistic rendering and geometry details of high-fidelity 3D head avatars. Additionally, to further elevate the geometric and rendering quality, we introduce a new coarse-to-fine training strategy, including a geometry initialization strategy at the coarse stage and an adaptive importance sampling strategy at the fine stage. Extensive experiments indicate that our method outperforms other state-of-the-art (SOTA) methods in rendering and geometry quality on mobile phone-collected and public datasets.


title: GPI 2.0: Performance Evaluation of the Wavefront Sensor's EMCCD

abstract: The Gemini Planet Imager (GPI) is a high contrast imaging instrument that aims to detect and characterize extrasolar planets. GPI is being upgraded to GPI 2.0, with several subsystems receiving a re-design to improve the instrument's contrast. To enable observations on fainter targets and increase stability on brighter ones, one of the upgrades is to the adaptive optics system. The current Shack-Hartmann wavefront sensor (WFS) is being replaced by a pyramid WFS with an low-noise electron multiplying CCD (EMCCD). EMCCDs are detectors capable of counting single photon events at high speed and high sensitivity. In this work, we characterize the performance of the HN\"u 240 EMCCD from N\"uv\"u Cameras, which was custom-built for GPI 2.0. The HN\"u 240 EMCCD's characteristics make it well suited for extreme AO: it has low dark current ($<$ 0.01 e-/pix/fr), low readout noise (0.1 e-/pix/fr at a gain of 5000), high quantum efficiency ( 90% at wavelengths from 600-800 nm; 70% from 800-900 nm), and fast readout (up to 3000 fps full frame). Here we present test results on the EMCCD's noise contributors, such as the readout noise, pixel-to-pixel variability and CCD bias. We also tested the linearity and EM gain calibration of the detector. All camera tests were conducted before its integration into the GPI 2.0 PWFS system.


title: Streaming Probabilistic PCA for Missing Data with Heteroscedastic Noise

abstract: Streaming principal component analysis (PCA) is an integral tool in large-scale machine learning for rapidly estimating low-dimensional subspaces of very high dimensional and high arrival-rate data with missing entries and corrupting noise. However, modern trends increasingly combine data from a variety of sources, meaning they may exhibit heterogeneous quality across samples. Since standard streaming PCA algorithms do not account for non-uniform noise, their subspace estimates can quickly degrade. On the other hand, the recently proposed Heteroscedastic Probabilistic PCA Technique (HePPCAT) addresses this heterogeneity, but it was not designed to handle missing entries and streaming data, nor does it adapt to non-stationary behavior in time series data. This paper proposes the Streaming HeteroscedASTic Algorithm for PCA (SHASTA-PCA) to bridge this divide. SHASTA-PCA employs a stochastic alternating expectation maximization approach that jointly learns the low-rank latent factors and the unknown noise variances from streaming data that may have missing entries and heteroscedastic noise, all while maintaining a low memory and computational footprint. Numerical experiments validate the superior subspace estimation of our method compared to state-of-the-art streaming PCA algorithms in the heteroscedastic setting. Finally, we illustrate SHASTA-PCA applied to highly-heterogeneous real data from astronomy.


title: BC4LLM: Trusted Artificial Intelligence When Blockchain Meets Large Language Models

abstract: In recent years, artificial intelligence (AI) and machine learning (ML) are reshaping society's production methods and productivity, and also changing the paradigm of scientific research. Among them, the AI language model represented by ChatGPT has made great progress. Such large language models (LLMs) serve people in the form of AI-generated content (AIGC) and are widely used in consulting, healthcare, and education. However, it is difficult to guarantee the authenticity and reliability of AIGC learning data. In addition, there are also hidden dangers of privacy disclosure in distributed AI training. Moreover, the content generated by LLMs is difficult to identify and trace, and it is difficult to cross-platform mutual recognition. The above information security issues in the coming era of AI powered by LLMs will be infinitely amplified and affect everyone's life. Therefore, we consider empowering LLMs using blockchain technology with superior security features to propose a vision for trusted AI. This paper mainly introduces the motivation and technical route of blockchain for LLM (BC4LLM), including reliable learning corpus, secure training process, and identifiable generated content. Meanwhile, this paper also reviews the potential applications and future challenges, especially in the frontier communication networks field, including network resource allocation, dynamic spectrum sharing, and semantic communication. Based on the above work combined and the prospect of blockchain and LLMs, it is expected to help the early realization of trusted AI and provide guidance for the academic community.


title: MEC-Intelligent Agent Support for Low-Latency Data Plane in Private NextG Core

abstract: Private 5G networks will soon be ubiquitous across the future-generation smart wireless access infrastructures hosting a wide range of performance-critical applications. A high-performing User Plane Function (UPF) in the data plane is critical to achieving such stringent performance goals, as it governs fast packet processing and supports several key control-plane operations. Based on a private 5G prototype implementation and analysis, it is imperative to perform dynamic resource management and orchestration at the UPF. This paper leverages Mobile Edge Cloud-Intelligent Agent (MEC-IA), a logically centralized entity that proactively distributes resources at UPF for various service types, significantly reducing the tail latency experienced by the user requests while maximizing resource utilization. Extending the MEC-IA functionality to MEC layers further incurs data plane latency reduction. Based on our extensive simulations, under skewed uRLLC traffic arrival, the MEC-IA assisted bestfit UPF-MEC scheme reduces the worst-case latency of UE requests by up to 77.8% w.r.t. baseline. Additionally, the system can increase uRLLC connectivity gain by 2.40x while obtaining 40% CapEx savings.


title: Local star-forming galaxies build up central mass concentration most actively near $M_{*}=10^{10}M_{\odot}$

abstract: To understand in what mass regime star-forming galaxies (SFGs) build up central mass concentration most actively, we present a study on the luminosity-weighted stellar age radial gradient ($\nabla_{\rm age}$) distribution of $\sim3600$ low-redshift SFGs using the MaNGA Pipe3D data available in the SDSS DR17. The mean age gradient is negative, with $\nabla_{\rm age}=-0.14$log Gyr/$R_{\rm e}$, consistent with the inside-out disk formation scenario. Specifically, SFGs with positive $\nabla_{\rm age}$ consist of $\sim 28\%$ at log$(M_{*}/M_{\odot})<9.5$, while this fraction rises up to its peak ($\sim 40\%$) near log$(M_{*}/M_{\odot})=10$ and then decreases to $\sim 15\%$ at log$(M_{*}/M_{\odot})=11$. At fixed $M_{*}$, SFGs with positive $\nabla_{\rm age}$ typically have more compact sizes and more centrally concentrated star formation than their counterparts, indicative of recent central mass build-up events. These results suggest that the build-up of central stellar mass concentration in local SFGs is mostly active near $M_{*}=10^{10}M_{\odot}$. Our findings provide new insights on the origin of morphological differences between low-mass and high-mass SFGs.


title: First attempt of directionality reconstruction for atmospheric neutrinos in a large homogeneous liquid scintillator detector

abstract: The directionality information of incoming neutrinos is essential to atmospheric neutrino oscillation analysis since it is directly related to the oscillation baseline length. Large homogeneous liquid scintillator detectors, while offering excellent energy resolution, are traditionally very limited in their capabilities of measuring event directionality. In this paper, we present a novel directionality reconstruction method for atmospheric neutrino events in large homogeneous liquid scintillator detectors based on waveform analysis and machine learning techniques. We demonstrate for the first time that such detectors can achieve good direction resolution and potentially play an important role in future atmospheric neutrino oscillation measurements.


title: MuseChat: A Conversational Music Recommendation System for Videos

abstract: Music recommendation for videos attracts growing interest in multi-modal research. However, existing systems focus primarily on content compatibility, often ignoring the users' preferences. Their inability to interact with users for further refinements or to provide explanations leads to a less satisfying experience. We address these issues with MuseChat, a first-of-its-kind dialogue-based recommendation system that personalizes music suggestions for videos. Our system consists of two key functionalities with associated modules: recommendation and reasoning. The recommendation module takes a video along with optional information including previous suggested music and user's preference as inputs and retrieves an appropriate music matching the context. The reasoning module, equipped with the power of Large Language Model (Vicuna-7B) and extended to multi-modal inputs, is able to provide reasonable explanation for the recommended music. To evaluate the effectiveness of MuseChat, we build a large-scale dataset, conversational music recommendation for videos, that simulates a two-turn interaction between a user and a recommender based on accurate music track information. Experiment results show that MuseChat achieves significant improvements over existing video-based music retrieval methods as well as offers strong interpretability and interactability.


title: Towards More Efficient Depression Risk Recognition via Gait

abstract: Depression, a highly prevalent mental illness, affects over 280 million individuals worldwide. Early detection and timely intervention are crucial for promoting remission, preventing relapse, and alleviating the emotional and financial burdens associated with depression. However, patients with depression often go undiagnosed in the primary care setting. Unlike many physiological illnesses, depression lacks objective indicators for recognizing depression risk, and existing methods for depression risk recognition are time-consuming and often encounter a shortage of trained medical professionals. The correlation between gait and depression risk has been empirically established. Gait can serve as a promising objective biomarker, offering the advantage of efficient and convenient data collection. However, current methods for recognizing depression risk based on gait have only been validated on small, private datasets, lacking large-scale publicly available datasets for research purposes. Additionally, these methods are primarily limited to hand-crafted approaches. Gait is a complex form of motion, and hand-crafted gait features often only capture a fraction of the intricate associations between gait and depression risk. Therefore, this study first constructs a large-scale gait database, encompassing over 1,200 individuals, 40,000 gait sequences, and covering six perspectives and three types of attire. Two commonly used psychological scales are provided as depression risk annotations. Subsequently, a deep learning-based depression risk recognition model is proposed, overcoming the limitations of hand-crafted approaches. Through experiments conducted on the constructed large-scale database, the effectiveness of the proposed method is validated, and numerous instructive insights are presented in the paper, highlighting the significant potential of gait-based depression risk recognition.


title: The Functional Equations of Langlands Eisenstein Series for $SL(n,\mathbb Z)$

abstract: This paper presents a very simple explicit description of Langlands Eisenstein series for ${\rm SL}(n,\mathbb Z)$. The functional equations of these Eisenstein series are heuristically derived from the functional equations of certain divisor sums and certain Whittaker functions that appear in the Fourier coefficients of the Eisenstein series. We conjecture that the functional equations are unique up to a real affine transformation of the $s$ variables defining the Eisenstein series and prove the uniqueness conjecture in certain cases.


title: Fast Neighbor Discovery for Wireless Ad Hoc Network with Successive Interference Cancellation

abstract: Neighbor discovery (ND) is a key step in wireless ad hoc network, which directly affects the efficiency of wireless networking. Improving the speed of ND has always been the goal of ND algorithms. The classical ND algorithms lose packets due to the collision of multiple packets, which greatly affects the speed of the ND algorithms. Traditional methods detect packet collision and implement retransmission when encountering packet loss. However, they does not solve the packet collision problem and the performance improvement of ND algorithms is limited. In this paper, the successive interference cancellation (SIC) technology is introduced into the ND algorithms to unpack multiple collision packets by distinguishing multiple packets in the power domain. Besides, the multi-packet reception (MPR) is further applied to reduce the probability of packet collision by distinguishing multiple received packets, thus further improving the speed of ND algorithms. Six ND algorithms, namely completely random algorithm (CRA), CRA based on SIC (CRA-SIC), CRA based on SIC and MPR (CRA-SIC-MPR), scan-based algorithm (SBA), SBA based on SIC (SBA-SIC), and SBA based on SIC and MPR (SBA-SIC-MPR), are theoretically analyzed and verified by simulation. The simulation results show that SIC and MPR reduce the ND time of SBA by 69.02% and CRA by 66.03% averagely.


title: Suppressing Overestimation in Q-Learning through Adversarial Behaviors

abstract: The goal of this paper is to propose a new Q-learning algorithm with a dummy adversarial player, which is called dummy adversarial Q-learning (DAQ), that can effectively regulate the overestimation bias in standard Q-learning. With the dummy player, the learning can be formulated as a two-player zero-sum game. The proposed DAQ unifies several Q-learning variations to control overestimation biases, such as maxmin Q-learning and minmax Q-learning (proposed in this paper) in a single framework. The proposed DAQ is a simple but effective way to suppress the overestimation bias thourgh dummy adversarial behaviors and can be easily applied to off-the-shelf reinforcement learning algorithms to improve the performances. A finite-time convergence of DAQ is analyzed from an integrated perspective by adapting an adversarial Q-learning. The performance of the suggested DAQ is empirically demonstrated under various benchmark environments.


title: Stability of FFLS-based diffusion adaptive filter under a cooperative excitation condition

abstract: In this paper, we consider the distributed filtering problem over sensor networks such that all sensors cooperatively track unknown time-varying parameters by using local information. A distributed forgetting factor least squares (FFLS) algorithm is proposed by minimizing a local cost function formulated as a linear combination of accumulative estimation error. Stability analysis of the algorithm is provided under a cooperative excitation condition which contains spatial union information to reflect the cooperative effect of all sensors. Furthermore, we generalize theoretical results to the case of Markovian switching directed graphs. The main difficulties of theoretical analysis lie in how to analyze properties of the product of non-independent and non-stationary random matrices. Some techniques such as stability theory, algebraic graph theory and Markov chain theory are employed to deal with the above issue. Our theoretical results are obtained without relying on the independency or stationarity assumptions of regression vectors which are commonly used in existing literature.


title: Catalan-Spitzer permutations

abstract: We study two classes of permutations intimately related to the visual proof of Spitzer's lemma and Huq's generalization of the Chung-Feller theorem. Both classes of permutations are counted by the Fuss-Catalan numbers. The study of one class leads to a generalization of results of Flajolet from continued fractions to continuants. The study of the other class leads to the discovery of a restricted variant of the Foata--Strehl group action.


title: Better and Simpler Lower Bounds for Differentially Private Statistical Estimation

abstract: We provide optimal lower bounds for two well-known parameter estimation (also known as statistical estimation) tasks in high dimensions with approximate differential privacy. First, we prove that for any $\alpha \le O(1)$, estimating the covariance of a Gaussian up to spectral error $\alpha$ requires $\tilde{\Omega}\left(\frac{d^{3/2}}{\alpha \varepsilon} + \frac{d}{\alpha^2}\right)$ samples, which is tight up to logarithmic factors. This result improves over previous work which established this for $\alpha \le O\left(\frac{1}{\sqrt{d}}\right)$, and is also simpler than previous work. Next, we prove that estimating the mean of a heavy-tailed distribution with bounded $k$th moments requires $\tilde{\Omega}\left(\frac{d}{\alpha^{k/(k-1)} \varepsilon} + \frac{d}{\alpha^2}\right)$ samples. Previous work for this problem was only able to establish this lower bound against pure differential privacy, or in the special case of $k = 2$. Our techniques follow the method of fingerprinting and are generally quite simple. Our lower bound for heavy-tailed estimation is based on a black-box reduction from privately estimating identity-covariance Gaussians. Our lower bound for covariance estimation utilizes a Bayesian approach to show that, under an Inverse Wishart prior distribution for the covariance matrix, no private estimator can be accurate even in expectation, without sufficiently many samples.

categories: math.ST cs.CR cs.DS cs.IT cs.LG math.IT stat.TH


title: Gem5Pred: Predictive Approaches For Gem5 Simulation Time

abstract: Gem5, an open-source, flexible, and cost-effective simulator, is widely recognized and utilized in both academic and industry fields for hardware simulation. However, the typically time-consuming nature of simulating programs on Gem5 underscores the need for a predictive model that can estimate simulation time. As of now, no such dataset or model exists. In response to this gap, this paper makes a novel contribution by introducing a unique dataset specifically created for this purpose. We also conducted analysis of the effects of different instruction types on the simulation time in Gem5. After this, we employ three distinct models leveraging CodeBERT to execute the prediction task based on the developed dataset. Our superior regression model achieves a Mean Absolute Error (MAE) of 0.546, while our top-performing classification model records an Accuracy of 0.696. Our models establish a foundation for future investigations on this topic, serving as benchmarks against which subsequent models can be compared. We hope that our contribution can simulate further research in this field. The dataset we used is available at https://github.com/XueyangLiOSU/Gem5Pred.


title: Three-Dimensional Medical Image Fusion with Deformable Cross-Attention

abstract: Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before combining the features and reconstructing the fusion image. However, this approach often neglects the fundamental commonalities and disparities between multimodal information. Furthermore, the prevailing methodologies are largely confined to fusing two-dimensional (2D) medical image slices, leading to a lack of contextual supervision in the fusion images and subsequently, a decreased information yield for physicians relative to three-dimensional (3D) images. In this study, we introduce an innovative unsupervised feature mutual learning fusion network designed to rectify these limitations. Our approach incorporates a Deformable Cross Feature Blend (DCFB) module that facilitates the dual modalities in discerning their respective similarities and differences. We have applied our model to the fusion of 3D MRI and PET images obtained from 660 patients in the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Through the application of the DCFB module, our network generates high-quality MRI-PET fusion images. Experimental results demonstrate that our method surpasses traditional 2D image fusion methods in performance metrics such as Peak Signal to Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM). Importantly, the capacity of our method to fuse 3D images enhances the information available to physicians and researchers, thus marking a significant step forward in the field. The code will soon be available online.


title: Magnetic Effect on Potential Barrier for Nucleosynthesis II

abstract: We investigate the impact of magnetic fields on the potential barrier between two interacting nuclei. We addressed this by solving the Boltzmann equation and Maxwell's theory in the presence of a magnetic field, resulting in the determination of magnetized permittivity. Additionally, we derived the magnetized Debye potential, which combines the conventional Debye potential with an additional magnetic component. We then compared the Boltzmann approach with the Debye method. Both methods consistently demonstrate that magnetic fields increase permittivity. This enhanced permittivity leads to a reduction in the potential barrier, consequently increasing the reaction rate for nucleosynthesis. Furthermore, the dependence on temperature and electron density in each approach is consistent. Our findings suggest that magnetized plasmas, which have existed since the Big Bang, have played a crucial role in nucleosynthesis.

categories: astro-ph.CO astro-ph.SR nucl-th physics.app-ph physics.plasm-ph


title: NetShaper: A Differentially Private Network Side-Channel Mitigation System

abstract: The widespread adoption of encryption in network protocols has significantly improved the overall security of many Internet applications. However, these protocols cannot prevent network side-channel leaks -- leaks of sensitive information through the sizes and timing of network packets. We present NetShaper, a system that mitigates such leaks based on the principle of traffic shaping. NetShaper's traffic shaping provides differential privacy guarantees while adapting to the prevailing workload and congestion condition, and allows configuring a tradeoff between privacy guarantees, bandwidth and latency overheads. Furthermore, NetShaper provides a modular and portable tunnel endpoint design that can support diverse applications. We present a middlebox-based implementation of NetShaper and demonstrate its applicability in a video streaming and a web service application.


title: The Constraining Capability of BNS Dark Sirens Observed by the LIGO Gravitational Wave Detector on the Hubble Constant

abstract: The Hubble Constant observed at high redshift and low redshift are inconsistent, representing one of the urgent issues to be resolved in the field of cosmology. The discovery of gravitational waves opens a new window for addressing this problem. For instance, the GW170817 event, through the coordinated observation of electromagnetic and gravitational wave signals, allows for constraints to be imposed from a completely new perspective. However, the number of gravitational wave events where both electromagnetic and gravitational wave signals are observed simultaneously is too small, making it difficult to enhance the precision through statistical methods. In this paper, we use dark sirens as the subjects of study. Through the standard gravitational wave data simulation and the analysis process, we analyze the constraints a typical binary neutron star merger event can place on the Hubble Constant. We simulated a random event and found that it an provide an error of +0.04-0.05 for the Hubble Constant. By combining multiple events, this constraint can be improved.


title: Gaia Focused Product Release: A catalogue of sources around quasars to search for strongly lensed quasars

abstract: Context. Strongly lensed quasars are fundamental sources for cosmology. The Gaia space mission covers the entire sky with the unprecedented resolution of $0.18$" in the optical, making it an ideal instrument to search for gravitational lenses down to the limiting magnitude of 21. Nevertheless, the previous Gaia Data Releases are known to be incomplete for small angular separations such as those expected for most lenses. Aims. We present the Data Processing and Analysis Consortium GravLens pipeline, which was built to analyse all Gaia detections around quasars and to cluster them into sources, thus producing a catalogue of secondary sources around each quasar. We analysed the resulting catalogue to produce scores that indicate source configurations that are compatible with strongly lensed quasars. Methods. GravLens uses the DBSCAN unsupervised clustering algorithm to detect sources around quasars. The resulting catalogue of multiplets is then analysed with several methods to identify potential gravitational lenses. We developed and applied an outlier scoring method, a comparison between the average BP and RP spectra of the components, and we also used an extremely randomised tree algorithm. These methods produce scores to identify the most probable configurations and to establish a list of lens candidates. Results. We analysed the environment of 3 760 032 quasars. A total of 4 760 920 sources, including the quasars, were found within 6" of the quasar positions. This list is given in the Gaia archive. In 87\% of cases, the quasar remains a single source, and in 501 385 cases neighbouring sources were detected. We propose a list of 381 lensed candidates, of which we identified 49 as the most promising. Beyond these candidates, the associate tables in this Focused Product Release allow the entire community to explore the unique Gaia data for strong lensing studies further.


title: Exploring Users Pointing Performance on Large Displays with Different Curvatures in Virtual Reality

abstract: Large curved displays inside Virtual Reality environments are becoming popular for visualizing high-resolution content during analytical tasks, gaming or entertainment. Prior research showed that such displays provide a wide field of view and offer users a high level of immersion. However, little is known about users' performance (e.g., pointing speed and accuracy) on them. We explore users' pointing performance on large virtual curved displays. We investigate standard pointing factors (e.g., target width and amplitude) in combination with relevant curve-related factors, namely display curvature and both linear and angular measures. Our results show that the less curved the display, the higher the performance, i.e., faster movement time. This result holds for pointing tasks controlled via their visual properties (linear widths and amplitudes) or their motor properties (angular widths and amplitudes). Additionally, display curvatures significantly affect the error rate for both linear and angular conditions. Furthermore, we observe that curved displays perform better or similar to flat displays based on throughput analysis. Finally, we discuss our results and provide suggestions regarding pointing tasks on large curved displays in VR.


title: Reducing Detailed Vehicle Energy Dynamics to Physics-Like Models

abstract: The energy demand of vehicles, particularly in unsteady drive cycles, is affected by complex dynamics internal to the engine and other powertrain components. Yet, in many applications, particularly macroscopic traffic flow modeling and optimization, structurally simple approximations to the complex vehicle dynamics are needed that nevertheless reproduce the correct effective energy behavior. This work presents a systematic model reduction pipeline that starts from complex vehicle models based on the Autonomie software and derives a hierarchy of simplified models that are fast to evaluate, easy to disseminate in open-source frameworks, and compatible with optimization frameworks. The pipeline, based on a virtual chassis dynamometer and subsequent approximation strategies, is reproducible and is applied to six different vehicle classes to produce concrete explicit energy models that represent an average vehicle in each class and leverage the accuracy and validation work of the Autonomie software.


title: Just-in-Time Flaky Test Detection via Abstracted Failure Symptom Matching

abstract: We report our experience of using failure symptoms, such as error messages or stack traces, to identify flaky test failures in a Continuous Integration (CI) pipeline for a large industrial software system, SAP HANA. Although failure symptoms are commonly used to identify similar failures, they have not previously been employed to detect flaky test failures. Our hypothesis is that flaky failures will exhibit symptoms distinct from those of non-flaky failures. Consequently, we can identify recurring flaky failures, without rerunning the tests, by matching the failure symptoms to those of historical flaky runs. This can significantly reduce the need for test reruns, ultimately resulting in faster delivery of test results to developers. To facilitate the process of matching flaky failures across different execution instances, we abstract newer test failure symptoms before matching them to the known patterns of flaky failures, inspired by previous research in the fields of failure deduplication and log analysis. We evaluate our symptom-based flakiness detection method using actual failure symptoms gathered from CI data of SAP HANA during a six-month period. Our method shows the potential of using failure symptoms to identify recurring flaky failures, achieving a precision of at least 96%, while saving approximately 58% of the machine time compared to the traditional rerun strategy. Analysis of the false positives and the feedback from developers underscore the importance of having descriptive and informative failure symptoms for both the effective deployment of this symptom-based approach and the debugging of flaky tests.


title: Statistical Properties of X-Ray Bursts from SGR J1935+2154 Detected by Insight-HXMT

abstract: As one class of the most important objects in the universe, magnetars can produce a lot of different frequency bursts including X-ray bursts. In \cite{2022ApJS..260...24C}, 75 X-ray bursts produced by magnetar SGR J1935+2154 during an active period in 2020 are published, including the duration and net photon counts of each burst, and waiting time based on the trigger time difference. In this paper, we utilize the power-law model, $dN(x)/dx\propto (x+x_0)^{-\alpha_x}$, to fit the cumulative distributions of these parameters. It can be found that all the cumulative distributions can be well fitted, which can be interpreted by a self-organizing criticality theory. Furthermore, we check whether this phenomenon still exist in different energy bands and find that there is no obvious evolution. These findings further confirm that the X-ray bursts from magnetars are likely to be generated by some self-organizing critical process, which can be explained by a possible magnetic reconnection scenario in magnetars.


title: An Empirically Grounded Reference Architecture for Software Supply Chain Metadata Management

abstract: With the rapid rise in Software Supply Chain (SSC) attacks, organisations need thorough and trustworthy visibility over the entire SSC of their software inventory to detect risks early and identify compromised assets rapidly in the event of an SSC attack. One way to achieve such visibility is through SSC metadata, machine-readable and authenticated documents describing an artefact's lifecycle. Adopting SSC metadata requires organisations to procure or develop a Software Supply Chain Metadata Management system (SCM2), a suite of software tools for performing life cycle activities of SSC metadata documents such as creation, signing, distribution, and consumption. Selecting or developing an SCM2 is challenging due to the lack of a comprehensive domain model and architectural blueprint to aid practitioners in navigating the vast design space of SSC metadata terminologies, frameworks, and solutions. This paper addresses the above-mentioned challenge by presenting an empirically grounded Reference Architecture (RA) comprising of a domain model and an architectural blueprint for SCM2 systems. Our proposed RA is constructed systematically on an empirical foundation built with industry-driven and peer-reviewed SSC security frameworks. Our theoretical evaluation, which consists of an architectural mapping of five prominent SSC security tools on the RA, ensures its validity and applicability, thus affirming the proposed RA as an effective framework for analysing existing SCM2 solutions and guiding the engineering of new SCM2 systems.


title: Dynamical versus Bayesian Phase Transitions in a Toy Model of Superposition

abstract: We investigate phase transitions in a Toy Model of Superposition (TMS) using Singular Learning Theory (SLT). We derive a closed formula for the theoretical loss and, in the case of two hidden dimensions, discover that regular $k$-gons are critical points. We present supporting theory indicating that the local learning coefficient (a geometric invariant) of these $k$-gons determines phase transitions in the Bayesian posterior as a function of training sample size. We then show empirically that the same $k$-gon critical points also determine the behavior of SGD training. The picture that emerges adds evidence to the conjecture that the SGD learning trajectory is subject to a sequential learning mechanism. Specifically, we find that the learning process in TMS, be it through SGD or Bayesian learning, can be characterized by a journey through parameter space from regions of high loss and low complexity to regions of low loss and high complexity.


title: Selective Demonstrations for Cross-domain Text-to-SQL

abstract: Large language models (LLMs) with in-context learning have demonstrated impressive generalization capabilities in the cross-domain text-to-SQL task, without the use of in-domain annotations. However, incorporating in-domain demonstration examples has been found to greatly enhance LLMs' performance. In this paper, we delve into the key factors within in-domain examples that contribute to the improvement and explore whether we can harness these benefits without relying on in-domain annotations. Based on our findings, we propose a demonstration selection framework ODIS which utilizes both out-of-domain examples and synthetically generated in-domain examples to construct demonstrations. By retrieving demonstrations from hybrid sources, ODIS leverages the advantages of both, showcasing its effectiveness compared to baseline methods that rely on a single data source. Furthermore, ODIS outperforms state-of-the-art approaches on two cross-domain text-to-SQL datasets, with improvements of 1.1 and 11.8 points in execution accuracy, respectively.


title: Dobby: A Conversational Service Robot Driven by GPT-4

abstract: This work introduces a robotics platform which embeds a conversational AI agent in an embodied system for natural language understanding and intelligent decision-making for service tasks; integrating task planning and human-like conversation. The agent is derived from a large language model, which has learned from a vast corpus of general knowledge. In addition to generating dialogue, this agent can interface with the physical world by invoking commands on the robot; seamlessly merging communication and behavior. This system is demonstrated in a free-form tour-guide scenario, in an HRI study combining robots with and without conversational AI capabilities. Performance is measured along five dimensions: overall effectiveness, exploration abilities, scrutinization abilities, receptiveness to personification, and adaptability.


title: Yield Stress Fluids Solidifying in Capillary Imbibition

abstract: When subjected to an external stress that exceeds the yield stress ($\sigma_\mathrm{Y}$), yield stress fluids (YSFs) undergo a solid-to-liquid transition. Despite the extensive studies, there has been limited attention to the process of liquid-to-solid transition. This work examines the solidification of YSFs through capillary imbibition, easily observed in the processes of wetting, coating, spreading, and wicking. During gradual deceleration of the capillary rise, YSFs display an unexpected flowing behavior, even when subjected to stresses below the $\sigma_\mathrm{Y}$. We propose a model with numerical solutions based on rheological properties of YSFs and slip to capture this unusual, yet universal behavior.


title: On the mass transfer in the 3D Pitaevskii model

abstract: We examine a micro-scale model of superfluidity derived by Pitaevskii in 1959 which describes the interacting dynamics between superfluid He-4 and its normal fluid phase. This system consists of the nonlinear Schr\"odinger equation and the incompressible, inhomogeneous Navier-Stokes equations, coupled to each other via a bidirectional nonlinear relaxation mechanism. The coupling permits mass/momentum/energy transfer between the phases, and accounts for the conversion of superfluid into normal fluid. We prove the existence of weak solutions in $\mathbb{T}^3$ for a power-type nonlinearity, beginning from small initial data. The main challenge is to control the inter-phase mass transfer in order to ensure the strict positivity of the normal fluid density, while obtaining time-independent a priori estimates.


title: Ensemble Active Learning by Contextual Bandits for AI Incubation in Manufacturing

abstract: It is challenging but important to save annotation efforts in streaming data acquisition to maintain data quality for supervised learning base learners. We propose an ensemble active learning method to actively acquire samples for annotation by contextual bandits, which is will enforce the exploration-exploitation balance and leading to improved AI modeling performance.


title: Exploring Users' Pointing Performance on Virtual and Physical Large Curved Displays

abstract: Large curved displays have emerged as a powerful platform for collaboration, data visualization, and entertainment. These displays provide highly immersive experiences, a wider field of view, and higher satisfaction levels. Yet, large curved displays are not commonly available due to their high costs. With the recent advancement of Head Mounted Displays (HMDs), large curved displays can be simulated in Virtual Reality (VR) with minimal cost and space requirements. However, to consider the virtual display as an alternative to the physical display, it is necessary to uncover user performance differences (e.g., pointing speed and accuracy) between these two platforms. In this paper, we explored users' pointing performance on both physical and virtual large curved displays. Specifically, with two studies, we investigate users' performance between the two platforms for standard pointing factors such as target width, target amplitude as well as users' position relative to the screen. Results from user studies reveal no significant difference in pointing performance between the two platforms when users are located at the same position relative to the screen. In addition, we observe users' pointing performance improves when they are located at the center of a semi-circular display compared to off-centered positions. We conclude by outlining design implications for pointing on large curved virtual displays. These findings show that large curved virtual displays are a viable alternative to physical displays for pointing tasks.


title: Unit Testing Challenges with Automated Marking

abstract: Teaching software testing presents difficulties due to its abstract and conceptual nature. The lack of tangible outcomes and limited emphasis on hands-on experience further compound the challenge, often leading to difficulties in comprehension for students. This can result in waning engagement and diminishing motivation over time. In this paper, we introduce online unit testing challenges with automated marking as a learning tool via the EdStem platform to enhance students' software testing skills and understanding of software testing concepts. Then, we conducted a survey to investigate the impact of the unit testing challenges with automated marking on student learning. The results from 92 participants showed that our unit testing challenges have kept students more engaged and motivated, fostering deeper understanding and learning, while the automated marking mechanism enhanced students' learning progress, helping them to understand their mistakes and misconceptions quicker than traditional-style human-written manual feedback. Consequently, these results inform educators that the online unit testing challenges with automated marking improve overall student learning experience, and are an effective pedagogical practice in software testing.


title: Encoding and Decoding Narratives: Datafication and Alternative Access Models for Audiovisual Archives

abstract: Situated in the intersection of audiovisual archives, computational methods, and immersive interactions, this work probes the increasingly important accessibility issues from a two-fold approach. Firstly, the work proposes an ontological data model to handle complex descriptors (metadata, feature vectors, etc.) with regard to user interactions. Secondly, this work examines text-to-video retrieval from an implementation perspective by proposing a classifier-enhanced workflow to deal with complex and hybrid queries and a training data augmentation workflow to improve performance. This work serves as the foundation for experimenting with novel public-facing access models to large audiovisual archives


title: Can LLMs Demystify Bug Reports?

abstract: Bugs are notoriously challenging: they slow down software users and result in time-consuming investigations for developers. These challenges are exacerbated when bugs must be reported in natural language by users. Indeed, we lack reliable tools to automatically address reported bugs (i.e., enabling their analysis, reproduction, and bug fixing). With the recent promises created by LLMs such as ChatGPT for various tasks, including in software engineering, we ask ourselves: What if ChatGPT could understand bug reports and reproduce them? This question will be the main focus of this study. To evaluate whether ChatGPT is capable of catching the semantics of bug reports, we used the popular Defects4J benchmark with its bug reports. Our study has shown that ChatGPT was able to demystify and reproduce 50% of the reported bugs. ChatGPT being able to automatically address half of the reported bugs shows promising potential in the direction of applying machine learning to address bugs with only a human-in-the-loop to report the bug.


title: Improving Compositional Text-to-image Generation with Large Vision-Language Models

abstract: Recent advancements in text-to-image models, particularly diffusion models, have shown significant promise. However, compositional text-to-image models frequently encounter difficulties in generating high-quality images that accurately align with input texts describing multiple objects, variable attributes, and intricate spatial relationships. To address this limitation, we employ large vision-language models (LVLMs) for multi-dimensional assessment of the alignment between generated images and their corresponding input texts. Utilizing this assessment, we fine-tune the diffusion model to enhance its alignment capabilities. During the inference phase, an initial image is produced using the fine-tuned diffusion model. The LVLM is then employed to pinpoint areas of misalignment in the initial image, which are subsequently corrected using the image editing algorithm until no further misalignments are detected by the LVLM. The resultant image is consequently more closely aligned with the input text. Our experimental results validate that the proposed methodology significantly improves text-image alignment in compositional image generation, particularly with respect to object number, attribute binding, spatial relationships, and aesthetic quality.


title: Discovering Mixtures of Structural Causal Models from Time Series Data

abstract: Discovering causal relationships from time series data is significant in fields such as finance, climate science, and neuroscience. However, contemporary techniques rely on the simplifying assumption that data originates from the same causal model, while in practice, data is heterogeneous and can stem from different causal models. In this work, we relax this assumption and perform causal discovery from time series data originating from a mixture of causal models. We propose a general variational inference-based framework called MCD to infer the underlying causal models as well as the mixing probability of each sample. Our approach employs an end-to-end training process that maximizes an evidence-lower bound for the data likelihood. We present two variants: MCD-Linear for linear relationships and independent noise, and MCD-Nonlinear for nonlinear causal relationships and history-dependent noise. We demonstrate that our method surpasses state-of-the-art benchmarks in causal discovery tasks through extensive experimentation on synthetic and real-world datasets, particularly when the data emanates from diverse underlying causal graphs. Theoretically, we prove the identifiability of such a model under some mild assumptions.


title: Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Models

abstract: Recent work has showcased the significant potential of diffusion models in pose-guided person image synthesis. However, owing to the inconsistency in pose between the source and target images, synthesizing an image with a distinct pose, relying exclusively on the source image and target pose information, remains a formidable challenge. This paper presents Progressive Conditional Diffusion Models (PCDMs) that incrementally bridge the gap between person images under the target and source poses through three stages. Specifically, in the first stage, we design a simple prior conditional diffusion model that predicts the global features of the target image by mining the global alignment relationship between pose coordinates and image appearance. Then, the second stage establishes a dense correspondence between the source and target images using the global features from the previous stage, and an inpainting conditional diffusion model is proposed to further align and enhance the contextual features, generating a coarse-grained person image. In the third stage, we propose a refining conditional diffusion model to utilize the coarsely generated image from the previous stage as a condition, achieving texture restoration and enhancing fine-detail consistency. The three-stage PCDMs work progressively to generate the final high-quality and high-fidelity synthesized image. Both qualitative and quantitative results demonstrate the consistency and photorealism of our proposed PCDMs under challenging scenarios.The code and model will be available at https://github.com/tencent-ailab/PCDMs.


title: Power-partible Reduction and Congruences for Schr\"oder Polynomials

abstract: In this note, we apply the power-partible reduction to show the following arithmetic properties of large Schr\"oder polynomials $S_n(z)$ and little Schr\"oder polynomials $s_n(z)$: for any odd prime $p$, nonnegative integer $r\in\mathbb{N}$, $\varepsilon\in\{-1,1\}$ and $z\in\mathbb{Z}$ with $\gcd(p,z(z+1))=1$, we have \[ \sum_{k=0}^{p-1}(2k+1)^{2r+1}\varepsilon^k S_k(z)\equiv 1\pmod {p}\quad \text{and} \quad \sum_{k=0}^{p-1}(2k+1)^{2r+1}\varepsilon^k s_k(z)\equiv 0\pmod {p}. \]


title: Ultra-high dimensional confounder selection algorithms comparison with application to radiomics data

abstract: Radiomics is an emerging area of medical imaging data analysis particularly for cancer. It involves the conversion of digital medical images into mineable ultra-high dimensional data. Machine learning algorithms are widely used in radiomics data analysis to develop powerful decision support model to improve precision in diagnosis, assessment of prognosis and prediction of therapy response. However, machine learning algorithms for causal inference have not been previously employed in radiomics analysis. In this paper, we evaluate the value of machine learning algorithms for causal inference in radiomics. We select three recent competitive variable selection algorithms for causal inference: outcome-adaptive lasso (OAL), generalized outcome-adaptive lasso (GOAL) and causal ball screening (CBS). We used a sure independence screening procedure to propose an extension of GOAL and OAL for ultra-high dimensional data, SIS + GOAL and SIS + OAL. We compared SIS + GOAL, SIS + OAL and CBS using simulation study and two radiomics datasets in cancer, osteosarcoma and gliosarcoma. The two radiomics studies and the simulation study identified SIS + GOAL as the optimal variable selection algorithm.


title: UV Massive Resonance from IR Double Copy Consistency

abstract: From the perspective of effective field theory (EFT), Wilson coefficients of the low energy theory are determined by integrating out modes of the full ultraviolet (UV) theory. The spectrum can be in principle resummed if one has access to all available infrared (IR) coefficients at low energies. In this work we show that there exists a general class of consistent massive resonance double-copy (CMRDC) models where UV massive residues are reconstructed through double-copy consistency conditions between the IR Wilson coefficients of the full EFT expansion. Through a color-dual bootstrap, we find surprisingly that double-copy consistency alone introduces the kinematic factors of CMRDC models that soften high energy behavior by exponentiating color-dual contacts. This bootstrap suggests that our massive resonance paradigm is an inevitable consequence of the duality between color and kinematics, thereby providing a path towards emergent UV structure directly from the IR. We then demonstrate how CMRDC models can capture a spectrum of massive modes compatible with general multiplicity, and use Pad\'{e} extrapolation to solve the inverse problem of identifying massive UV resonance from a small number of IR Wilson coefficients.


title: The black hole to black hole phase transition probed by the D3-D7 model fermionic spectral functions

abstract: We consider the D3-D7 model and analyze the phase transition from the black-hole phase to another black-hole phase using the spectral function of a probe fermion on D7 in the presence of the finite density and temperature. From the fermionic spectral functions, we study the temperature dependence of the decay rate and we observe a jump in it at the critical temperature that corresponds to the first order phase transition. We found that if we assume that the Drude model works in this case so that the resistivity is proportional to the fermion decay rate, the jump matches the resistivity data in a heavy fermion material.


title: Adversarial Masked Image Inpainting for Robust Detection of Mpox and Non-Mpox

abstract: Due to the lack of efficient mpox diagnostic technology, mpox cases continue to increase. Recently, the great potential of deep learning models in detecting mpox and non-mpox has been proven. However, existing models learn image representations via image classification, which results in they may be easily susceptible to interference from real-world noise, require diverse non-mpox images, and fail to detect abnormal input. These drawbacks make classification models inapplicable in real-world settings. To address these challenges, we propose "Mask, Inpainting, and Measure" (MIM). In MIM's pipeline, a generative adversarial network only learns mpox image representations by inpainting the masked mpox images. Then, MIM determines whether the input belongs to mpox by measuring the similarity between the inpainted image and the original image. The underlying intuition is that since MIM solely models mpox images, it struggles to accurately inpaint non-mpox images in real-world settings. Without utilizing any non-mpox images, MIM cleverly detects mpox and non-mpox and can handle abnormal inputs. We used the recognized mpox dataset (MSLD) and images of eighteen non-mpox skin diseases to verify the effectiveness and robustness of MIM. Experimental results show that the average AUROC of MIM achieves 0.8237. In addition, we demonstrated the drawbacks of classification models and buttressed the potential of MIM through clinical validation. Finally, we developed an online smartphone app to provide free testing to the public in affected areas. This work first employs generative models to improve mpox detection and provides new insights into binary decision-making tasks in medical images.