title: Choose Your Diffusion: Efficient and flexible ways to accelerate the diffusion model in fast high energy physics simulation

abstract: The diffusion model has demonstrated promising results in image generation, recently becoming mainstream and representing a notable advancement for many generative modeling tasks. Prior applications of the diffusion model for both fast event and detector simulation in high energy physics have shown exceptional performance, providing a viable solution to generate sufficient statistics within a constrained computational budget in preparation for the High Luminosity LHC. However, many of these applications suffer from slow generation with large sampling steps and face challenges in finding the optimal balance between sample quality and speed. The study focuses on the latest benchmark developments in efficient ODE/SDE-based samplers, schedulers, and fast convergence training techniques. We test on the public CaloChallenge and JetNet datasets with the designs implemented on the existing architecture, the performance of the generated classes surpass previous models, achieving significant speedup via various evaluation metrics.


title: Boundary Technology Costs for Economic Viability of Long-Duration Energy Storage Systems

abstract: The urgent need for decarbonization in the energy sector has led to an increased emphasis on the integration of renewable energy sources, such as wind and solar, into power grids. While these resources offer significant environmental benefits, they also introduce challenges related to intermittency and variability. Long-duration energy storage (LDES) technologies have emerged as a very promising solution to address these challenges by storing excess energy during periods of high generation and delivering it when demand is high or renewable resources are scarce for a sustained amount of time. This paper introduces a novel methodology for estimating the boundary technology cost of LDES systems for economic viability in decarbonized energy systems. Our methodology is applied to estimate the boundary costs in 2050 for the state of California to achieve full retirement of gas power plants. California's ambitious decarbonization goals and transition to a renewable energy-based power system present an ideal context for examining the role of LDES. The results also offer insights into the needed capacity expansion planning and the operational contribution of LDES in the California's energy landscape, taking into account the unique energy demand profiles and renewable resource availability of the region. Our findings are intended to provide complementary information to guide decision-makers, energy planners, and any other stakeholders in making informed choices about LDES investment in the context of a decarbonized energy future.


title: A force field of Li$^+$ , Na$^+$ , K$^+$, Mg$^{2+}$, Ca$^{2+}$, Cl$^-$, and SO$_4^{2-}$ in aqueous solution based on the TIP4P/2005 water model and scaled charges for the ions

abstract: In this work, a force field for several ions in water is proposed. In particular, we consider the cations Li$^+$ , Na$^+$ , K$^+$, Mg$^{2+}$, Ca$^{2+}$ and the anions Cl$^-$, and SO$_4^{2-}$ . These ions were selected as they appear in the composition of seawater, and they are also found in biological systems. The force field proposed (denoted as Madrid-2019) is nonpolarizable, and both water molecules and sulfate anions are rigid. For water, we use the TIP4P/2005 model. The main idea behind this work is to further explore the possibility of using scaled charges for describing ionic solutions. Monovalent and divalent ions are modeled using charges of 0.85 and 1.7, respectively (in electron units). The model allows a very accurate description of the densities of the solutions up to high concentrations. It also gives good predictions of viscosities up to 3 m concentrations. Calculated structural properties are also in reasonable agreement with the experiment. We have checked that no crystallization occurred in the simulations at concentrations similar to the solubility limit. A test for ternary mixtures shows that the force field provides excellent performance at an affordable computer cost. In summary, the use of scaled charges, which could be regarded as an effective and simple way of accounting for polarization (at least to a certain extend), improves the overall description of ionic systems in water. However, for purely ionic systems, scaled charges will not adequately describe neither the solid nor the melt.


title: Misgendering and Assuming Gender in Machine Translation when Working with Low-Resource Languages

abstract: This chapter focuses on gender-related errors in machine translation (MT) in the context of low-resource languages. We begin by explaining what low-resource languages are, examining the inseparable social and computational factors that create such linguistic hierarchies. We demonstrate through a case study of our mother tongue Bengali, a global language spoken by almost 300 million people but still classified as low-resource, how gender is assumed and inferred in translations to and from the high(est)-resource English when no such information is provided in source texts. We discuss the postcolonial and societal impacts of such errors leading to linguistic erasure and representational harms, and conclude by discussing potential solutions towards uplifting languages by providing them more agency in MT conversations.


title: Cosmology before noon with multiple galaxy populations

abstract: Near-future facilities observing the high-redshift universe ($2<z<5$) will have an opportunity to take advantage of "multi-tracer" cosmology by observing multiple tracers of the matter density field: Lyman alpha emitters (LAE), Lyman break galaxies (LBG), and CMB lensing $\kappa$. In this work we use Fisher forecasts to investigate the effect of multi-tracers on next-generation facilities. In agreement with previous work, we show that multiple tracers improve constraints primarily from degeneracy breaking, instead of the traditional intuition of sample variance cancellation. Then, we forecast that for both BBN and CMB primary priors, the addition of lensing and LAEs onto a LBG-only sample will gain 25\% or more in many parameters, with the largest gains being factor of $\sim10$ improvement for $f_{\rm EDE}$. We include a preliminary approach towards modelling the impact of radiative transfer (RT) on forecasts involving LAEs by introducing a simplified model at linear theory level. Our results, albeit preliminary, show that the while RT influences LAE-only forecasts strongly, its effect on composite multi-tracer forecasts are limited.


title: A star-based method for precise flux calibration of the Chinese Space Station Telescope (CSST) slitless spectroscopic survey

abstract: The upcoming Chinese Space Station Telescope (CSST) slitless spectroscopic survey poses a challenge of flux calibration, which requires a large number of flux-standard stars. In this work, we design an uncertainty-aware residual attention network, the UaRA-net, to derive the CSST SEDs with a resolution of R = 200 over the wavelength range of 2500-10000 \AA using LAMOST normalized spectra with a resolution of R = 2000 over the wavelength range of 4000-7000 \AA. With the special structure and training strategy, the proposed model can not only provide accurate predictions of SEDs but also their corresponding errors. The precision of the predicted SEDs depends on effective temperature (Teff), wavelength, and the LAMOST spectral signal-to-noise ratios (SNRs), particularly in the GU band. For stars with Teff = 6000 K, the typical SED precisions in the GU band are 4.2%, 2.1%, and 1.5% at SNR values of 20, 40, and 80, respectively. As Teff increases to 8000 K, the precision increases to 1.2%, 0.6%, and 0.5%, respectively. The precision is higher at redder wavelengths. In the GI band, the typical SED precisions for stars with Teff = 6000 K increase to 0.3%, 0.1%, and 0.1% at SNR values of 20, 40, and 80, respectively. We further verify our model using the empirical spectra of the MILES and find good performance. The proposed method will open up new possibilities for optimal utilization of slitless spectra of the CSST and other surveys.


title: Reducing classical communication costs in multiplexed quantum repeaters using hardware-aware quasi-local policies

abstract: Future quantum networks will have nodes equipped with multiple quantum memories, allowing for multiplexing and entanglement distillation strategies in order to increase fidelities and reduce waiting times for end-to-end entanglement distribution. In this work, we introduce \textit{quasi-local} policies for multiplexed quantum repeater chains. In fully-local policies, nodes make decisions based only on knowledge of their own states. In our quasi-local policies, nodes have increased knowledge of the state of the repeater chain, but not necessarily full, global knowledge. Our policies exploit the observation that for most decisions the nodes have to make, they only need to have information about the connected region of the chain they belong to, and not the entire chain. In this way, we not only obtain improved performance over local policies, but we reduce the classical communication (CC) costs inherent to global-knowledge policies. Our policies also outperform the well-known and widely studied nested purification and doubling swapping policy in practically relevant parameter regimes. We also carefully examine the role of entanglement distillation. Via analytical and numerical results, we identify the parameter regimes in which distillation makes sense and is useful. In these regimes, we also address the question: "Should we distill before swapping, or vice versa?" Finally, to provide further practical guidance, we propose an experimental implementation of a multiplexing-based repeater chain, and experimentally demonstrate the key element, a high-dimensional biphoton frequency comb. We then evaluate the anticipated performance of our multiplexing-based policies in such a real-world network through simulation results for two concrete memory platforms, namely rare-earth ions and diamond vacancies.


title: ReposVul: A Repository-Level High-Quality Vulnerability Dataset

abstract: Open-Source Software (OSS) vulnerabilities bring great challenges to the software security and pose potential risks to our society. Enormous efforts have been devoted into automated vulnerability detection, among which deep learning (DL)-based approaches have proven to be the most effective. However, the current labeled data present the following limitations: (1) Tangled Patches: Developers may submit code changes unrelated to vulnerability fixes within patches, leading to tangled patches. (2) Lacking Inter-procedural Vulnerabilities: The existing vulnerability datasets typically contain function-level and file-level vulnerabilities, ignoring the relations between functions, thus rendering the approaches unable to detect the inter-procedural vulnerabilities. (3) Outdated Patches: The existing datasets usually contain outdated patches, which may bias the model during training. To address the above limitations, in this paper, we propose an automated data collection framework and construct the first repository-level high-quality vulnerability dataset named ReposVul. The proposed framework mainly contains three modules: (1) A vulnerability untangling module, aiming at distinguishing vulnerability-fixing related code changes from tangled patches, in which the Large Language Models (LLMs) and static analysis tools are jointly employed. (2) A multi-granularity dependency extraction module, aiming at capturing the inter-procedural call relationships of vulnerabilities, in which we construct multiple-granularity information for each vulnerability patch, including repository-level, file-level, function-level, and line-level. (3) A trace-based filtering module, aiming at filtering the outdated patches, which leverages the file path trace-based filter and commit time trace-based filter to construct an up-to-date dataset.


title: CFMatch: Aligning Automated Answer Equivalence Evaluation with Expert Judgments For Open-Domain Question Answering

abstract: Question answering (QA) can only make progress if we know if an answer is correct, but for many of the most challenging and interesting QA examples, current evaluation metrics to determine answer equivalence (AE) often do not align with human judgments, particularly more verbose, free-form answers from large language models (LLM). There are two challenges: a lack of data and that models are too big: LLM-based scorers can correlate better with human judges, but this task has only been tested on limited QA datasets, and even when available, update of the model is limited because LLMs are large and often expensive. We rectify both of these issues by providing clear and consistent guidelines for evaluating AE in machine QA adopted from professional human QA contests. We also introduce a combination of standard evaluation and a more efficient, robust, and lightweight discriminate AE classifier-based matching method (CFMatch, smaller than 1 MB), trained and validated to more accurately evaluate answer correctness in accordance with adopted expert AE rules that are more aligned with human judgments.


title: Compositional Generative Inverse Design

abstract: Inverse design, where we seek to design input variables in order to optimize an underlying objective function, is an important problem that arises across fields such as mechanical engineering to aerospace engineering. Inverse design is typically formulated as an optimization problem, with recent works leveraging optimization across learned dynamics models. However, as models are optimized they tend to fall into adversarial modes, preventing effective sampling. We illustrate that by instead optimizing over the learned energy function captured by the diffusion model, we can avoid such adversarial examples and significantly improve design performance. We further illustrate how such a design system is compositional, enabling us to combine multiple different diffusion models representing subcomponents of our desired system to design systems with every specified component. In an N-body interaction task and a challenging 2D multi-airfoil design task, we demonstrate that by composing the learned diffusion model at test time, our method allows us to design initial states and boundary shapes that are more complex than those in the training data. Our method generalizes to more objects for N-body dataset and discovers formation flying to minimize drag in the multi-airfoil design task. Project website and code can be found at https://github.com/AI4Science-WestlakeU/cindm.


title: ADMap: Anti-disturbance framework for reconstructing online vectorized HD map

abstract: In the field of autonomous driving, online high-definition (HD) map reconstruction is crucial for planning tasks. Recent research has developed several high-performance HD map reconstruction models to meet this necessity. However, the point sequences within the instance vectors may be jittery or jagged due to prediction bias, which can impact subsequent tasks. Therefore, this paper proposes the Anti-disturbance Map reconstruction framework (ADMap). To mitigate point-order jitter, the framework consists of three modules: Multi-Scale Perception Neck, Instance Interactive Attention (IIA), and Vector Direction Difference Loss (VDDL). By exploring the point-order relationships between and within instances in a cascading manner, the model can monitor the point-order prediction process more effectively. ADMap achieves state-of-the-art performance on the nuScenes and Argoverse2 datasets. Extensive results demonstrate its ability to produce stable and reliable map elements in complex and changing driving scenarios. Code and more demos are available at https://github.com/hht1996ok/ADMap.


title: Early release of the expanded atlas of the sky in continuous gravitational waves

abstract: We present the early release of the atlas of continuous gravitational waves covering frequencies from 20 Hz to 1500 Hz and spindowns from -5e-10 to 5e-10 Hz/s. Compared to the previous atlas release we have greatly expanded the parameter space, and we now also provide polarization-specific data - both for signal-to-noise ratios and for the upper limits. Continuous wave searches are computationally difficult and take a long time to complete. The atlas enables new searches to be performed using modest computing power. To allow new searches to start sooner, we are releasing this data early, before our followup stages have completed.

categories: gr-qc astro-ph.CO astro-ph.HE astro-ph.SR


title: Boundary and Relation Distillation for Semantic Segmentation

abstract: Recently, it has been revealed that small semantic segmentation (SS) models exhibit a tendency to make errors in maintaining boundary region completeness and preserving target region connectivity, despite their effective segmentation of the main object regions. To address these errors, we propose a targeted boundary and relation distillation (BRD) strategy using knowledge distillation from large teacher models to small student models. Specifically, the boundary distillation extracts explicit object boundaries from the hierarchical feature maps of the backbone network, subsequently enhancing the student model's mask quality in boundary regions. Concurrently, the relation distillation transfers implicit relations from the teacher model to the student model using pixel-level self-relation as a bridge, ensuring that the student's mask has strong target region connectivity. The proposed BRD is designed concretely for SS and is characterized by simplicity and efficiency. Through experimental evaluations on multiple SS datasets, including Pascal VOC 2012, Cityscapes, ADE20K, and COCO-Stuff 10K, we demonstrated that BRD significantly surpasses the current methods without increasing the inference costs, generating crisp region boundaries and smooth connecting regions that are challenging for small models.


title: Spin Seebeck Effect as a Probe for Majorana Fermions in Kitaev Spin Liquids

abstract: Quantum entanglement in strongly correlated electron systems often leads to exotic elementary excitations. Quantum spin liquids (QSLs) provide a paradigmatic example, where the elementary excitations are described by fractional quasiparticles such as spinons. However, such fractional quasiparticles behave differently from electrons, making their experimental identification challenging. Here, we theoretically investigate the spin Seebeck effect, which is a thermoelectric response via a spin current, as an efficient probe of the fractional quasiparticles in QSLs, focusing on the Kitaev honeycomb model. By comprehensive studies using the real-time dynamics, the perturbation theory, and the linear spin-wave theory based on the tunnel spin-current theory, we find that the spin current is induced by thermal gradient in the Kitaev spin liquid, via the low-energy fractional Majorana excitations. This underscores the ability of Majorana fermions to carry spin current, despite lacking spin angular momentum. Furthermore, we find that the induced spin current changes its sign depending on the sign of the Kitaev interaction, indicating that the Majorana fermions contribute to the spin current with (up-)down-spin like nature when the exchange coupling is (anti)ferromagnetic. Thus, in contrast to the negative spin current already found in a one-dimensional QSL, our finding reveals that the spin Seebeck effect can exhibit either positive or negative signals, contingent upon the nature of fractional excitations in the QSLs. We also clarify contrasting field-angle dependence between the Kitaev spin liquid in the low-field limit and the high-field ferromagnetic state, which is useful for the experimental identification. Our finding suggests that the spin Seebeck effect could be used not only to detect fractional quasiparticles emerging in QSLs but also to generate and control them.


title: Coherent Two-photon Backscattering and Induced Angular Quantum Correlations in Multiple-Scattered Two-Photon States of the Light

abstract: We present the emergence of coherent two-photon backscattering, a manifestation of weak localization, in multiple scattering of maximally entangled pure and fully mixed two-photon states and examine the effect of entanglement and classical correlations. Quantum correlations in backscattering are investigated for finite three-dimensional disordered structures in the weak localization regime as well as systems of a small number of scatterers with specified spatial arrangements. No assumptions are made on the statistical behavior of the scattering matrix elements. Furthermore, we study the interplay between quantum correlations induced by multiple scattering and the correlations that may be present in the illumination fields, and how they are manifested in the output modes. We study the effect of the dimensionality of the entanglement and the angular distribution of the jointly measurable photon pairs on the emergence of enhancement and angular quantum correlations and show how quantum correlations can be used as a probe of the entanglement dimensionality. We show that by increasing the disordered material density, the width of the coherent two-photon backscattering cones increases, in accordance with the reduction of the mean free path length within the structure.


title: Deep Learning Model Reuse in the HuggingFace Community: Challenges, Benefit and Trends

abstract: The ubiquity of large-scale Pre-Trained Models (PTMs) is on the rise, sparking interest in model hubs, and dedicated platforms for hosting PTMs. Despite this trend, a comprehensive exploration of the challenges that users encounter and how the community leverages PTMs remains lacking. To address this gap, we conducted an extensive mixed-methods empirical study by focusing on discussion forums and the model hub of HuggingFace, the largest public model hub. Based on our qualitative analysis, we present a taxonomy of the challenges and benefits associated with PTM reuse within this community. We then conduct a quantitative study to track model-type trends and model documentation evolution over time. Our findings highlight prevalent challenges such as limited guidance for beginner users, struggles with model output comprehensibility in training or inference, and a lack of model understanding. We also identified interesting trends among models where some models maintain high upload rates despite a decline in topics related to them. Additionally, we found that despite the introduction of model documentation tools, its quantity has not increased over time, leading to difficulties in model comprehension and selection among users. Our study sheds light on new challenges in reusing PTMs that were not reported before and we provide recommendations for various stakeholders involved in PTM reuse.


title: AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents

abstract: Evaluating large language models (LLMs) as general-purpose agents is essential for understanding their capabilities and facilitating their integration into practical applications. However, the evaluation process presents substantial challenges. A primary obstacle is the benchmarking of agent performance across diverse scenarios within a unified framework, especially in maintaining partially-observable environments and ensuring multi-round interactions. Moreover, current evaluation frameworks mostly focus on the final success rate, revealing few insights during the process and failing to provide a deep understanding of the model abilities. To address these challenges, we introduce AgentBoard, a pioneering comprehensive benchmark and accompanied open-source evaluation framework tailored to analytical evaluation of LLM agents. AgentBoard offers a fine-grained progress rate metric that captures incremental advancements as well as a comprehensive evaluation toolkit that features easy assessment of agents for multi-faceted analysis through interactive visualization. This not only sheds light on the capabilities and limitations of LLM agents but also propels the interpretability of their performance to the forefront. Ultimately, AgentBoard serves as a significant step towards demystifying agent behaviors and accelerating the development of stronger LLM agents.


title: Realized Stochastic Volatility Model with Skew-t Distributions for Improved Volatility and Quantile Forecasting

abstract: Forecasting volatility and quantiles of financial returns is essential for accurately measuring financial tail risks, such as value-at-risk and expected shortfall. The critical elements in these forecasts involve understanding the distribution of financial returns and accurately estimating volatility. This paper introduces an advancement to the traditional stochastic volatility model, termed the realized stochastic volatility model, which integrates realized volatility as a precise estimator of volatility. To capture the well-known characteristics of return distribution, namely skewness and heavy tails, we incorporate three types of skew-t distributions. Among these, two distributions include the skew-normal feature, offering enhanced flexibility in modeling the return distribution. We employ a Bayesian estimation approach using the Markov chain Monte Carlo method and apply it to major stock indices. Our empirical analysis, utilizing data from US and Japanese stock indices, indicates that the inclusion of both skewness and heavy tails in daily returns significantly improves the accuracy of volatility and quantile forecasts.


title: Single NV in nanodiamond for quantum sensing of protein dynamics in an ABEL trap

abstract: Enzymes are cellular protein machines using a variety of conformational changes to power fast biochemical catalysis. Our goal is to exploit the single-spin properties of the luminescent NV (nitrogen-vacancy) center in nanodiamonds to reveal the dynamics of an active enzyme complex at physiological conditions with the highest spatio-temporal resolution. Specifically attached to the membrane enzyme FoF1-ATP synthase, the NV sensor will report the adenosine triphosphate (ATP)-driven full rotation of Fo motor subunits in ten consecutive 36{\deg} steps. Conformational dynamics are monitored using either a double electron-electron resonance scheme or NV- magnetometry with optical readout or using NV- relaxometry with a superparamagnetic nanoparticle as the second marker attached to the same enzyme. First, we show how all photophysical parameters like individual size, charge, brightness, spectral range of fluorescence and fluorescence lifetime can be determined for the NV- center in a single nanodiamond held in aqueous solution by a confocal anti-Brownian electrokinetic trap (ABEL trap). Stable photon count rates of individual nanodiamonds and the absence of blinking allow for observation times of single nanodiamonds in solution exceeding hundreds of seconds. For the proposed quantum sensing of nanometer-sized distance changes within an active enzyme, we show that local magnetic field fluctuations can be detected all-optically by analyzing fluorescence lifetime changes of the NV- center in each nanodiamond in solution.


title: The EDGE-CALIFA Survey: An Extragalactic Database for Galaxy Evolution Studies

abstract: The EDGE-CALIFA survey provides spatially resolved optical integral field unit (IFU) and CO spectroscopy for 125 galaxies selected from the CALIFA Data Release 3 sample. The Extragalactic Database for Galaxy Evolution (EDGE) presents the spatially resolved products of the survey as pixel tables that reduce the oversampling in the original images and facilitate comparison of pixels from different images. By joining these pixel tables to lower dimensional tables that provide radial profiles, integrated spectra, or global properties, it is possible to investigate the dependence of local conditions on large-scale properties. The database is freely accessible and has been utilized in several publications. We illustrate the use of this database and highlight the effects of CO upper limits on the inferred slopes of the local scaling relations between stellar mass, star formation rate (SFR), and H$_2$ surface densities. We find that the correlation between H$_2$ and SFR surface density is the tightest among the three relations.


title: A Market-Clearing-based Sensitivity Model for Locational Marginal and Average Carbon Emission

abstract: This letter proposes a market-clearing-based locational marginal carbon emission (LMCE) metric to assess the marginal carbon emission effect of nodal load demand. Unlike the prevalent carbon emission flow (CEF) method that relies on a hypothetical power-flow tracking process, the proposed LMCE metric depends on a novel sensitivity analysis of market-clearing results, capable of revealing both energy-dependent and network-dependent impacts on emissions. Additionally, we introduce a locational average carbon emission (LACE) metric, derived from LMCE, to effectively measure the general emission effect. It offers insights into demand-side carbon emission effects, such as a negative LMCE and LACE indicating emission reduction even as load increases. It can also prevent excessive demand-side emission allocations. Overall, the proposed method provides a clear perspective for the ongoing decarbonization policies.


title: On Iterated Lorenz Curves

abstract: It is well-known that a Lorenz curve derived from the distribution function of a random variable can be viewed itself as a probability distribution function of a new random variable [3]. We prove the surprising result that a sequence of consecutive iterations of this map leads to a non-corner case convergence independent of the starting random variable. In the primal case, the limiting distribution has a power law with coefficient equal to the golden section. In the reflected case, the limiting distribution is classical Pareto with a conjugate coefficient. Possible directions for applications are discussed.


title: Extracting accurate light-matter couplings from disordered polaritons

abstract: The vacuum Rabi splitting (VRS) in molecular polaritons stands as a fundamental measure of collective light-matter coupling. Despite its significance, the impact of molecular disorder on VRS is not fully understood yet. This study delves into the complexities of VRS amidst various distributions and degrees of disorder. Our analysis provides precise analytical expressions for linear absorption, transmission, and reflection spectra, along with a "sum" rule, offering a straightforward protocol for extracting accurate collective light-matter coupling values from experimental data. Importantly, our study cautions against directly translating large VRS to the onset of ultrastrong coupling regime. Furthermore, for rectangular disorder, we witness the emergence of narrow side bands alongside a broad central peak, indicating an extended coherence lifetime even in the presence of substantial disorder. These findings not only enhance our understanding of VRS in disordered molecular systems but also open avenues for achieving prolonged coherence lifetimes between the cavity and molecules via the interplay of collective coupling and disorder.


title: Shortcutting Cross-Validation: Efficiently Deriving Column-Wise Centered and Scaled Training Set $\mathbf{X}^\mathbf{T}\mathbf{X}$ and $\mathbf{X}^\mathbf{T}\mathbf{Y}$ Without Full Recomputation of Matrix Products or Statistical Moments

abstract: Cross-validation is a widely used technique for assessing the performance of predictive models on unseen data. Many predictive models, such as Kernel-Based Partial Least-Squares (PLS) models, require the computation of $\mathbf{X}^{\mathbf{T}}\mathbf{X}$ and $\mathbf{X}^{\mathbf{T}}\mathbf{Y}$ using only training set samples from the input and output matrices, $\mathbf{X}$ and $\mathbf{Y}$, respectively. In this work, we present three algorithms that efficiently compute these matrices. The first one allows no column-wise preprocessing. The second one allows column-wise centering around the training set means. The third one allows column-wise centering and column-wise scaling around the training set means and standard deviations. Demonstrating correctness and superior computational complexity, they offer significant cross-validation speedup compared with straight-forward cross-validation and previous work on fast cross-validation - all without data leakage. Their suitability for parallelization is highlighted with an open-source Python implementation combining our algorithms with Improved Kernel PLS.


title: Campana conjecture for coverings of toric surfaces over function fields

abstract: We first proved Vojta's abc conjecture over function fields for Campana points on projective toric surfaces with high multiplicity along the boundary. As a consequence, we show a version of Campana's conjecture on finite covering of projective toric surfaces over function fields.


title: Effects of type Ia supernovae absolute magnitude priors on the Hubble constant value

abstract: We systematically explore the influence of the prior of the peak absolute magnitude ($M$) of type Ia supernovae (SNe Ia) on the measurement of the Hubble constant ($H_0$) from SNe Ia observations. We consider five different data-motivated $M$ priors, representing varying levels of dispersion, and assume the spatially-flat $\Lambda$CDM cosmological model. Different $M$ priors lead to relative changes in the mean values of $H_0$ from 2% to 7%. Loose priors on $M$ yield $H_0$ estimates consistent with both the Planck 2018 result and the SH0ES result at the 68% confidence level. We also examine the potential impact of peculiar velocity subtraction on the value of $H_0$, and show that it is insignificant for the SNe Ia observations with redshift $z > 0.01$ used in our analyses. We also repeat the analysis in the cosmography model and find very similar results. This suggests that our results are robust and model independent.


title: Joseph Wolstenholme and the Trigonometry of Tetrahedra

abstract: We describe the results in the trigonometry of tetrahedra obtained by Joseph Wolstenholme in the last few years of his life. 'The late Professor Wolstenholme, M.A., Sc.D., shortly before his death, handed to me a scrap of paper, on which he had hastily scratched the following equation in tetrahedra, saying he had proved it ...' (Richardson, 1897).


title: Open mappings of locally compact groups

abstract: The aim of this note is to insert in the literature some easy but apparently not widely known facts about morphisms of locally compact groups, all of which are concerned with the openness of the morphism.


title: A Comparison Between Lie Group- and Lie Algebra- Based Potential Functions for Geometric Impedance Control

abstract: In this paper, a comparison analysis between geometric impedance controls (GICs) derived from two different potential functions on SE(3) for robotic manipulators is presented. The first potential function is defined on the Lie group, utilizing the Frobenius norm of the configuration error matrix. The second potential function is defined utilizing the Lie algebra, i.e., log-map of the configuration error. Using a differential geometric approach, the detailed derivation of the distance metric and potential function on SE(3) is introduced. The GIC laws are respectively derived from the two potential functions, followed by extensive comparison analyses. In the qualitative analysis, the properties of the error function and control laws are analyzed, while the performances of the controllers are quantitatively compared using numerical simulation.


title: Towards Multi-domain Face Landmark Detection with Synthetic Data from Diffusion model

abstract: Recently, deep learning-based facial landmark detection for in-the-wild faces has achieved significant improvement. However, there are still challenges in face landmark detection in other domains (e.g. cartoon, caricature, etc). This is due to the scarcity of extensively annotated training data. To tackle this concern, we design a two-stage training approach that effectively leverages limited datasets and the pre-trained diffusion model to obtain aligned pairs of landmarks and face in multiple domains. In the first stage, we train a landmark-conditioned face generation model on a large dataset of real faces. In the second stage, we fine-tune the above model on a small dataset of image-landmark pairs with text prompts for controlling the domain. Our new designs enable our method to generate high-quality synthetic paired datasets from multiple domains while preserving the alignment between landmarks and facial features. Finally, we fine-tuned a pre-trained face landmark detection model on the synthetic dataset to achieve multi-domain face landmark detection. Our qualitative and quantitative results demonstrate that our method outperforms existing methods on multi-domain face landmark detection.


title: Generative Design of Crystal Structures by Point Cloud Representations and Diffusion Model

abstract: Efficiently generating energetically stable crystal structures has long been a challenge in material design, primarily due to the immense arrangement of atoms in a crystal lattice. To facilitate the discovery of stable material, we present a framework for the generation of synthesizable materials, leveraging a point cloud representation to encode intricate structural information. At the heart of this framework lies the introduction of a diffusion model as its foundational pillar. To gauge the efficacy of our approach, we employ it to reconstruct input structures from our training datasets, rigorously validating its high reconstruction performance. Furthermore, we demonstrate the profound potential of Point Cloud-Based Crystal Diffusion (PCCD) by generating entirely new materials, emphasizing their synthesizability. Our research stands as a noteworthy contribution to the advancement of materials design and synthesis through the cutting-edge avenue of generative design instead of the conventional substitution or experience-based discovery.

categories: cs.AI cond-mat.mtrl-sci cs.LG physics.comp-ph


title: Catch-Up Mix: Catch-Up Class for Struggling Filters in CNN

abstract: Deep learning has made significant advances in computer vision, particularly in image classification tasks. Despite their high accuracy on training data, deep learning models often face challenges related to complexity and overfitting. One notable concern is that the model often relies heavily on a limited subset of filters for making predictions. This dependency can result in compromised generalization and an increased vulnerability to minor variations. While regularization techniques like weight decay, dropout, and data augmentation are commonly used to address this issue, they may not directly tackle the reliance on specific filters. Our observations reveal that the heavy reliance problem gets severe when slow-learning filters are deprived of learning opportunities due to fast-learning filters. Drawing inspiration from image augmentation research that combats over-reliance on specific image regions by removing and replacing parts of images, our idea is to mitigate the problem of over-reliance on strong filters by substituting highly activated features. To this end, we present a novel method called Catch-up Mix, which provides learning opportunities to a wide range of filters during training, focusing on filters that may lag behind. By mixing activation maps with relatively lower norms, Catch-up Mix promotes the development of more diverse representations and reduces reliance on a small subset of filters. Experimental results demonstrate the superiority of our method in various vision classification datasets, providing enhanced robustness.


title: LightSleepNet: Design of a Personalized Portable Sleep Staging System Based on Single-Channel EEG

abstract: This paper proposed LightSleepNet - a light-weight, 1-d Convolutional Neural Network (CNN) based personalized architecture for real-time sleep staging, which can be implemented on various mobile platforms with limited hardware resources. The proposed architecture only requires an input of 30s single-channel EEG signal for the classification. Two residual blocks consisting of group 1-d convolution are used instead of the traditional convolution layers to remove the redundancy in the CNN. Channel shuffles are inserted into each convolution layer to improve the accuracy. In order to avoid over-fitting to the training set, a Global Average Pooling (GAP) layer is used to replace the fully connected layer, which further reduces the total number of the model parameters significantly. A personalized algorithm combining Adaptive Batch Normalization (AdaBN) and gradient re-weighting is proposed for unsupervised domain adaptation. A higher priority is given to examples that are easy to transfer to the new subject, and the algorithm could be personalized for new subjects without re-training. Experimental results show a state-of-the-art overall accuracy of 83.8% with only 45.76 Million Floating-point Operations per Second (MFLOPs) computation and 43.08 K parameters.


title: Virtualized Delta, sharp, and pass moves for oriented virtual knots and links

abstract: We study virtualized Delta, sharp, and pass moves for oriented virtual links, and give necessary and sufficient conditions for two oriented virtual links to be related by the local moves. In particular, they are unknotting operations for oriented virtual knots. We provide lower bounds for the unknotting numbers and prove that they are best possible.


title: Stable numerics for finite-strain elasticity

abstract: A backward stable numerical calculation of a function with condition number $\kappa$ will have a relative accuracy of $\kappa\epsilon_{\text{machine}}$. Standard formulations and software implementations of finite-strain elastic materials models make use of the deformation gradient $\boldsymbol F = I + \partial \boldsymbol u/\partial \boldsymbol X$ and Cauchy-Green tensors. These formulations are not numerically stable, leading to loss of several digits of accuracy when used in the small strain regime, and often precluding the use of single precision floating point arithmetic. We trace the source of this instability to specific points of numerical cancellation, interpretable as ill-conditioned steps. We show how to compute various strain measures in a stable way and how to transform common constitutive models to their stable representations, formulated in either initial or current configuration. The stable formulations all provide accuracy of order $\epsilon_{\text{machine}}$. In many cases, the stable formulations have elegant representations in terms of appropriate strain measures and offer geometric intuition that is lacking in their standard representation. We show that algorithmic differentiation can stably compute stresses so long as the strain energy is expressed stably, and give principles for stable computation that can be applied to inelastic materials.


title: Predicting Mitral Valve mTEER Surgery Outcomes Using Machine Learning and Deep Learning Techniques

abstract: Mitral Transcatheter Edge-to-Edge Repair (mTEER) is a medical procedure utilized for the treatment of mitral valve disorders. However, predicting the outcome of the procedure poses a significant challenge. This paper makes the first attempt to harness classical machine learning (ML) and deep learning (DL) techniques for predicting mitral valve mTEER surgery outcomes. To achieve this, we compiled a dataset from 467 patients, encompassing labeled echocardiogram videos and patient reports containing Transesophageal Echocardiography (TEE) measurements detailing Mitral Valve Repair (MVR) treatment outcomes. Leveraging this dataset, we conducted a benchmark evaluation of six ML algorithms and two DL models. The results underscore the potential of ML and DL in predicting mTEER surgery outcomes, providing insight for future investigation and advancements in this domain.


title: Study of solar brightness profiles in the 18-26 GHz frequency range with INAF radio telescopes I: solar radius

abstract: The Sun is an extraordinary workbench, from which several fundamental astronomical parameters can be measured with high precision. Among these parameters, the solar radius $R_{\odot}$ plays an important role in several aspects, such as in evolutionary models. Despite the efforts in obtaining accurate measurements of $R_{\odot}$, the subject is still debated and measurements are puzzling and/or lacking in many frequency ranges. We aimed to determine the mean, equatorial, and polar radii of the Sun ($R_c$, $R_{eq}$, and $R_{pol}$) in the frequency range 18.1 - 26.1 GHz. We employed single-dish observations from the newly-appointed Medicina "Gavril Grueff" Radio Telescope and the Sardinia Radio Telescope (SRT) throughout 5 years, from 2018 to mid-2023, in the framework of the SunDish project for solar monitoring. Two methods to calculate the radius at radio frequencies are considered and compared. To assess the quality of our radius determinations, we also analysed the possible degrading effects of the antenna beam pattern on our solar maps, using two 2D-models. We carried out a correlation analysis with the evolution of the solar cycle through the calculation of Pearson's correlation coefficient $\rho$. We obtained several values for the solar radius - ranging between 959 and 994 arcsec - and $\rho$, with typical errors of a few arcsec. Our $R_{\odot}$ measurements, consistent with values reported in literature, suggest a weak prolatness of the solar limb ($R_{eq}$ > $R_{pol}$), although $R_{eq}$ and $R_{pol}$ are statistically compatible within 3$\sigma$ errors. The correlation analysis using the solar images from Grueff shows (1) a positive correlation between the solar activity and the temporal variation of $R_c$ (and $R_{eq}$) at all observing frequencies, and (2) a weak anti-correlation between the temporal variation of $R_{pol}$ and the solar activity at 25.8 GHz.


title: Why People Still Fall for Phishing Emails: An Empirical Investigation into How Users Make Email Response Decisions

abstract: Despite technical and non-technical countermeasures, humans continue to be tricked by phishing emails. How users make email response decisions is a missing piece in the puzzle to identifying why people still fall for phishing emails. We conducted an empirical study using a think-aloud method to investigate how people make 'response decisions' while reading emails. The grounded theory analysis of the in-depth qualitative data has enabled us to identify different elements of email users' decision-making that influence their email response decisions. Furthermore, we developed a theoretical model that explains how people could be driven to respond to emails based on the identified elements of users' email decision-making processes and the relationships uncovered from the data. The findings provide deeper insights into phishing email susceptibility due to people's email response decision-making behavior. We also discuss the implications of our findings for designers and researchers working in anti-phishing training, education, and awareness interventions


title: Topology-aware Embedding Memory for Continual Learning on Expanding Networks

abstract: Memory replay based techniques have shown great success for continual learning with incrementally accumulated Euclidean data. Directly applying them to continually expanding networks, however, leads to the potential memory explosion problem due to the need to buffer representative nodes and their associated topological neighborhood structures. To this end, we systematically analyze the key challenges in the memory explosion problem, and present a general framework, i.e., Parameter Decoupled Graph Neural Networks (PDGNNs) with Topology-aware Embedding Memory (TEM), to tackle this issue. The proposed framework not only reduces the memory space complexity from $\mathcal{O}(nd^L)$ to $\mathcal{O}(n)$, but also fully utilizes the topological information for memory replay. Specifically, PDGNNs decouple trainable parameters from the computation ego-subnetwork via $\textit{Topology-aware Embeddings}$ (TEs), which compress ego-subnetworks into compact vectors (i.e., TEs) to reduce the memory consumption. Based on this framework, we discover a unique $\textit{pseudo-training effect}$ in continual learning on expanding networks and this effect motivates us to develop a novel $\textit{coverage maximization sampling}$ strategy that can enhance the performance with a tight memory budget. Thorough empirical studies demonstrate that, by tackling the memory explosion problem and incorporating topological information into memory replay, PDGNNs with TEM significantly outperform state-of-the-art techniques, especially in the challenging class-incremental setting.


title: MLLMReID: Multimodal Large Language Model-based Person Re-identification

abstract: Multimodal large language models (MLLM) have achieved satisfactory results in many tasks. However, their performance in the task of ReID (ReID) has not been explored to date. This paper will investigate how to adapt them for the task of ReID. An intuitive idea is to fine-tune MLLM with ReID image-text datasets, and then use their visual encoder as a backbone for ReID. However, there still exist two apparent issues: (1) Designing instructions for ReID, MLLMs may overfit specific instructions, and designing a variety of instructions will lead to higher costs. (2) When fine-tuning the visual encoder of a MLLM, it is not trained synchronously with the ReID task. As a result, the effectiveness of the visual encoder fine-tuning cannot be directly reflected in the performance of the ReID task. To address these problems, this paper proposes MLLMReID: Multimodal Large Language Model-based ReID. Firstly, we proposed Common Instruction, a simple approach that leverages the essence ability of LLMs to continue writing, avoiding complex and diverse instruction design. Secondly, we propose a multi-task learning-based synchronization module to ensure that the visual encoder of the MLLM is trained synchronously with the ReID task. The experimental results demonstrate the superiority of our method.


title: PAC Learnability for Reliable Communication over Discrete Memoryless Channels

abstract: In practical communication systems, knowledge of channel models is often absent, and consequently, transceivers need be designed based on empirical data. In this work, we study data-driven approaches to reliably choosing decoding metrics and code rates that facilitate reliable communication over unknown discrete memoryless channels (DMCs). Our analysis is inspired by the PAC (probably approximately correct) learning theory and does not rely on any assumptions on the statistical characteristics of DMCs. We show that a naive plug-in algorithm for choosing decoding metrics is likely to fail for finite training sets. We propose an alternative algorithm called the virtual sample algorithm and establish a non-asymptotic lower bound on its performance. The virtual sample algorithm is then used as a building block for constructing a learning algorithm that chooses a decoding metric and a code rate using which a transmitter and a receiver can reliably communicate at a rate arbitrarily close to the channel mutual information. Therefore, we conclude that DMCs are PAC learnable.


title: Style-Consistent 3D Indoor Scene Synthesis with Decoupled Objects

abstract: Controllable 3D indoor scene synthesis stands at the forefront of technological progress, offering various applications like gaming, film, and augmented/virtual reality. The capability to stylize and de-couple objects within these scenarios is a crucial factor, providing an advanced level of control throughout the editing process. This control extends not just to manipulating geometric attributes like translation and scaling but also includes managing appearances, such as stylization. Current methods for scene stylization are limited to applying styles to the entire scene, without the ability to separate and customize individual objects. Addressing the intricacies of this challenge, we introduce a unique pipeline designed for synthesis 3D indoor scenes. Our approach involves strategically placing objects within the scene, utilizing information from professionally designed bounding boxes. Significantly, our pipeline prioritizes maintaining style consistency across multiple objects within the scene, ensuring a cohesive and visually appealing result aligned with the desired aesthetic. The core strength of our pipeline lies in its ability to generate 3D scenes that are not only visually impressive but also exhibit features like photorealism, multi-view consistency, and diversity. These scenes are crafted in response to various natural language prompts, demonstrating the versatility and adaptability of our model.


title: An Extremely Young Protostellar Core, MMS 1/ OMC-3: Episodic Mass Ejection History Traced by the Micro SiO Jet

abstract: We present ${\sim}0.2$ arcsec ($\sim$80 au) resolution observations of the CO (2-1) and SiO (5-4) lines made with the Atacama large millimeter/submillimeter array toward an extremely young intermediate-mass protostellar source (t$_{\rm dyn}<$1000 years), MMS 1 located in the Orion Molecular Cloud-3 region. We have successfully imaged a very compact CO molecular outflow associated with MMS 1, having deprojected lobe sizes of $\sim$18000 au (red-shifted lobe) and $\sim$35000 au (blue-shifted lobe). We have also detected an extremely compact ($\lesssim$1000 au) and collimated SiO protostellar jet within the CO outflow. The maximum deprojected jet speed is measured to be as high as 93 km s$^{-1}$. The SiO jet wiggles and displays a chain of knots. Our detection of the molecular outflow and jet is the first direct evidence that MMS 1 already hosts a protostar. The position-velocity diagram obtained from the SiO emission shows two distinct structures: (i) bow-shocks associated with the tips of the outflow, and (ii) a collimated jet, showing the jet velocities linearly increasing with the distance from the driving source. Comparisons between the observations and numerical simulations quantitatively share similarities such as multiple-mass ejection events within the jet and Hubble-like flow associated with each mass ejection event. Finally, while there is a weak flux decline seen in the 850 $\mu$m light curve obtained with JCMT/SCUBA 2 toward MMS 1, no dramatic flux change events are detected. This suggests that there has not been a clear burst event within the last 8 years.


title: Boosting the Transferability of Adversarial Examples via Local Mixup and Adaptive Step Size

abstract: Adversarial examples are one critical security threat to various visual applications, where injected human-imperceptible perturbations can confuse the output.Generating transferable adversarial examples in the black-box setting is crucial but challenging in practice. Existing input-diversity-based methods adopt different image transformations, but may be inefficient due to insufficient input diversity and an identical perturbation step size. Motivated by the fact that different image regions have distinctive weights in classification, this paper proposes a black-box adversarial generative framework by jointly designing enhanced input diversity and adaptive step sizes. We design local mixup to randomly mix a group of transformed adversarial images, strengthening the input diversity. For precise adversarial generation, we project the perturbation into the $tanh$ space to relax the boundary constraint. Moreover, the step sizes of different regions can be dynamically adjusted by integrating a second-order momentum.Extensive experiments on ImageNet validate that our framework can achieve superior transferability compared to state-of-the-art baselines.


title: Self-Improving Interference Management Based on Deep Learning With Uncertainty Quantification

abstract: This paper presents a groundbreaking self-improving interference management framework tailored for wireless communications, integrating deep learning with uncertainty quantification to enhance overall system performance. Our approach addresses the computational challenges inherent in traditional optimization-based algorithms by harnessing deep learning models to predict optimal interference management solutions. A significant breakthrough of our framework is its acknowledgment of the limitations inherent in data-driven models, particularly in scenarios not adequately represented by the training dataset. To overcome these challenges, we propose a method for uncertainty quantification, accompanied by a qualifying criterion, to assess the trustworthiness of model predictions. This framework strategically alternates between model-generated solutions and traditional algorithms, guided by a criterion that assesses the prediction credibility based on quantified uncertainties. Experimental results validate the framework's efficacy, demonstrating its superiority over traditional deep learning models, notably in scenarios underrepresented in the training dataset. This work marks a pioneering endeavor in harnessing self-improving deep learning for interference management, through the lens of uncertainty quantification.


title: Extracting transition generalized parton distributions from hard exclusive pion-nucleon scattering

abstract: We study the extraction of transition generalized parton distributions (GPDs) from production of two back-to-back high transverse momentum photons ($\gamma\gamma$) and a massive pair of leptons ($\ell^+\ell^-$) in hard exclusive pion-nucleon scattering. We argue that the exclusive scattering amplitude of both processes could be factorized into nonperturbative pion distribution amplitude and nucleon transition GPDs that are convoluted with perturbatively calculable short-distance matching coefficients. We demonstrate that the exclusive diphoton production not only is complementary to the Drell-Yan-type dilepton production for extracting the GPDs, but also provides enhanced sensitivities for extracting the parton momentum fraction $x$ dependence of the GPDs. We show that both exclusive observables are physically measurable at the J-PARC and AMBER experiment energies. If the target nucleon can be polarized, corresponding spin asymmetries can offer additional sensitivities for extracting transition GPDs.


title: Assessing Influential Observations in Pain Prediction using fMRI Data

abstract: Influential diagnosis is an integral part of data analysis, of which most existing methodological frameworks presume a deterministic submodel and are designed for low-dimensional data (i.e., the number of predictors p smaller than the sample size n). However, the stochastic selection of a submodel from high-dimensional data where p exceeds n has become ubiquitous. Thus, methods for identifying observations that could exert undue influence on the choice of a submodel can play an important role in this setting. To date, discussion of this topic has been limited, falling short in two domains: (i) constrained ability to detect multiple influential points, and (ii) applicability only in restrictive settings. After describing the problem, we characterize and formalize the concept of influential observations on variable selection. Then, we propose a generalized diagnostic measure, extended from an available metric accommodating different model selectors and multiple influential observations, the asymptotic distribution of which is subsequently establish large p, thus providing guidelines to ascertain influential observations. A high-dimensional clustering procedure is further incorporated into our proposed scheme to detect multiple influential points. Simulation is conducted to assess the performances of various diagnostic approaches. The proposed procedure further demonstrates its value in improving predictive power when analyzing thermal-stimulated pain based on fMRI data.


title: Symmetric, Optimization-based, Cross-element Compatible Nodal Distributions for High-order Finite Elements

abstract: In high-order and high-dimensional finite elements, ill-conditioned nodal distributions are often computationally cost-prohibitive. As a result, uniform distributions quickly fall apart. For tensor-product like elements, Gauss-Legendre-Lobatto (GLL) nodal distributions are often used as a substitute. Besides these, other efficient nodal distributions are difficult to create due to a desired symmetry within elements and conformity with neighboring elements. In this paper, we provide a general framework to construct symmetric, well-conditioned, cross-element compatible nodal distributions which can be used for high-order and high-dimensional finite elements. Starting from the inherent symmetries in any potential element, the framework is used to build up nodal groups in a structured and efficient manner utilizing the natural coordinates of each element, while ensuring nodes stay within the elements. By constructing constrained symmetry groups, the vertices, edges, and faces, of all elements are required to conform to their respective lower-dimensional distributions. Optimizing over these groups yields the desired optimized nodal distributions. We demonstrate the strength of this framework by creating and comparing optimized nodal distributions with GLL distributions (in elements such as the line, quadrilateral, and hexahedron), and its robustness by generating optimized nodal distributions for otherwise difficult elements (such as the triangle, tetrahedron, and triangular prism).


title: Multitask Active Learning for Graph Anomaly Detection

abstract: In the web era, graph machine learning has been widely used on ubiquitous graph-structured data. As a pivotal component for bolstering web security and enhancing the robustness of graph-based applications, the significance of graph anomaly detection is continually increasing. While Graph Neural Networks (GNNs) have demonstrated efficacy in supervised and semi-supervised graph anomaly detection, their performance is contingent upon the availability of sufficient ground truth labels. The labor-intensive nature of identifying anomalies from complex graph structures poses a significant challenge in real-world applications. Despite that, the indirect supervision signals from other tasks (e.g., node classification) are relatively abundant. In this paper, we propose a novel MultItask acTIve Graph Anomaly deTEction framework, namely MITIGATE. Firstly, by coupling node classification tasks, MITIGATE obtains the capability to detect out-of-distribution nodes without known anomalies. Secondly, MITIGATE quantifies the informativeness of nodes by the confidence difference across tasks, allowing samples with conflicting predictions to provide informative yet not excessively challenging information for subsequent training. Finally, to enhance the likelihood of selecting representative nodes that are distant from known patterns, MITIGATE adopts a masked aggregation mechanism for distance measurement, considering both inherent features of nodes and current labeled status. Empirical studies on four datasets demonstrate that MITIGATE significantly outperforms the state-of-the-art methods for anomaly detection. Our code is publicly available at: https://github.com/AhaChang/MITIGATE.


title: High-throughput screening for boride superconductors

abstract: A high-throughput screening using density functional calculations is performed to search for stable boride superconductors from the existing materials database. The workflow employs the fast frozen phonon method as the descriptor to evaluate the superconducting properties quickly. 23 stable candidates are identified from the screening. For almost all found binary compounds, the superconductivity was obtained earlier experimentally or computationally. For ternary borides, previous studies are very limited. Our extensive search among ternary systems confirmed superconductivity in known systems and found several new compounds. Among these discovered superconducting ternary borides, Ta(MoB)$_2$ shows the highest superconducting temperature of ~12K. Most predicted compounds were synthesized previously; therefore, our predictions can be examined experimentally. Our work also demonstrates that the boride systems can have diverse structural motifs that lead to superconductivity.


title: AdCorDA: Classifier Refinement via Adversarial Correction and Domain Adaptation

abstract: This paper describes a simple yet effective technique for refining a pretrained classifier network. The proposed AdCorDA method is based on modification of the training set and making use of the duality between network weights and layer inputs. We call this input space training. The method consists of two stages - adversarial correction followed by domain adaptation. Adversarial correction uses adversarial attacks to correct incorrect training-set classifications. The incorrectly classified samples of the training set are removed and replaced with the adversarially corrected samples to form a new training set, and then, in the second stage, domain adaptation is performed back to the original training set. Extensive experimental validations show significant accuracy boosts of over 5% on the CIFAR-100 dataset. The technique can be straightforwardly applied to refinement of weight-quantized neural networks, where experiments show substantial enhancement in performance over the baseline. The adversarial correction technique also results in enhanced robustness to adversarial attacks.


title: Common-Sense Bias Discovery and Mitigation for Classification Tasks

abstract: Machine learning model bias can arise from dataset composition: sensitive features correlated to the learning target disturb the model decision rule and lead to performance differences along the features. Existing de-biasing work captures prominent and delicate image features which are traceable in model latent space, like colors of digits or background of animals. However, using the latent space is not sufficient to understand all dataset feature correlations. In this work, we propose a framework to extract feature clusters in a dataset based on image descriptions, allowing us to capture both subtle and coarse features of the images. The feature co-occurrence pattern is formulated and correlation is measured, utilizing a human-in-the-loop for examination. The analyzed features and correlations are human-interpretable, so we name the method Common-Sense Bias Discovery (CSBD). Having exposed sensitive correlations in a dataset, we demonstrate that downstream model bias can be mitigated by adjusting image sampling weights, without requiring a sensitive group label supervision. Experiments show that our method discovers novel biases on multiple classification tasks for two benchmark image datasets, and the intervention outperforms state-of-the-art unsupervised bias mitigation methods.


title: AMANet: Advancing SAR Ship Detection with Adaptive Multi-Hierarchical Attention Network

abstract: Recently, methods based on deep learning have been successfully applied to ship detection for synthetic aperture radar (SAR) images. Despite the development of numerous ship detection methodologies, detecting small and coastal ships remains a significant challenge due to the limited features and clutter in coastal environments. For that, a novel adaptive multi-hierarchical attention module (AMAM) is proposed to learn multi-scale features and adaptively aggregate salient features from various feature layers, even in complex environments. Specifically, we first fuse information from adjacent feature layers to enhance the detection of smaller targets, thereby achieving multi-scale feature enhancement. Then, to filter out the adverse effects of complex backgrounds, we dissect the previously fused multi-level features on the channel, individually excavate the salient regions, and adaptively amalgamate features originating from different channels. Thirdly, we present a novel adaptive multi-hierarchical attention network (AMANet) by embedding the AMAM between the backbone network and the feature pyramid network (FPN). Besides, the AMAM can be readily inserted between different frameworks to improve object detection. Lastly, extensive experiments on two large-scale SAR ship detection datasets demonstrate that our AMANet method is superior to state-of-the-art methods.


title: {\nu}Oscillation: a software package for computation and simulation of neutrino propagation and interaction

abstract: The behavior of neutrinos is the only phenomenon that cannot be explained by the standard model of particle physics. Because of these mysterious neutrino interactions observed in nature, at present, there is growing interest in this field and ongoing or planned neutrino experiments are seeking solutions to this mystery very actively. The design of neutrino experiments and the analysis of neutrino data rely on precise computations of neutrino oscillations and scattering processes in general. Motivated by this, we developed a software package that calculates neutrino production and oscillation in nuclear reactors, neutrino-electron scattering of solar neutrinos, and the oscillation of neutrinos from radioactive isotopes for the search of sterile neutrinos. This software package is validated by reproducing the result of calculations and observations in other publications. We also demonstrate the feasibility of this package by calculating the sensitivity of a liquid scintillator detector, currently in planning, to the sterile neutrinos. This work is expected to be used in designs of future neutrino experiments.


title: On Principled Local Optimization Methods for Federated Learning

abstract: Federated Learning (FL), a distributed learning paradigm that scales on-device learning collaboratively, has emerged as a promising approach for decentralized AI applications. Local optimization methods such as Federated Averaging (FedAvg) are the most prominent methods for FL applications. Despite their simplicity and popularity, the theoretical understanding of local optimization methods is far from clear. This dissertation aims to advance the theoretical foundation of local methods in the following three directions. First, we establish sharp bounds for FedAvg, the most popular algorithm in Federated Learning. We demonstrate how FedAvg may suffer from a notion we call iterate bias, and how an additional third-order smoothness assumption may mitigate this effect and lead to better convergence rates. We explain this phenomenon from a Stochastic Differential Equation (SDE) perspective. Second, we propose Federated Accelerated Stochastic Gradient Descent (FedAc), the first principled acceleration of FedAvg, which provably improves the convergence rate and communication efficiency. Our technique uses on a potential-based perturbed iterate analysis, a novel stability analysis of generalized accelerated SGD, and a strategic tradeoff between acceleration and stability. Third, we study the Federated Composite Optimization problem, which extends the classic smooth setting by incorporating a shared non-smooth regularizer. We show that direct extensions of FedAvg may suffer from the "curse of primal averaging," resulting in slow convergence. As a solution, we propose a new primal-dual algorithm, Federated Dual Averaging, which overcomes the curse of primal averaging by employing a novel inter-client dual averaging procedure.


title: Measurement of changes in muscle viscoelasticity during static stretching using stress-relaxation data

abstract: This study investigates how the viscoelasticity of the muscle changes during static stretching by measuring the state of the muscle during stretching using continuous time-series data. We used a device that applied a force to the muscle during stretching and measured the reaction force. The device was attached to the participants, and time-series data of the reaction force (stress-relaxation data) during stretching were obtained. A model using fractional calculus (spring-pot model) was selected as the viscoelastic model for the muscle, in which the data for stress relaxation were fitted on a straight line on a both logarithmic plot. The experimental stress-relaxation results showed that viscoelasticity tended to change abruptly at a particular time during static stretching because the stress-relaxation data were represented by a broken line comprising two segments on the both logarithmic plot. Considering two states of viscoelasticity, before and after the change, the stress-relaxation curve was fitted to the spring-pot model with high accuracy using segment regression (R2 = 0.99). We compared the parameters of the spring-pot model before and after the change in muscle viscoelasticity. By examining these continuous time-series data, we also investigated the time taken for the effects of stretching to become apparent. Furthermore, by measuring the changes in muscle viscoelasticity during static stretching before and after a short-term exercise load of running on a treadmill, we examined the effects of short-term exercise load on the changes in viscoelasticity during static stretching.


title: ULTRA: Unleash LLMs' Potential for Event Argument Extraction through Hierarchical Modeling and Pair-wise Refinement

abstract: Structural extraction of events within discourse is critical since it avails a deeper understanding of communication patterns and behavior trends. Event argument extraction (EAE), at the core of event-centric understanding, is the task of identifying role-specific text spans (i.e., arguments) for a given event. Document-level EAE (DocEAE) focuses on arguments that are scattered across an entire document. In this work, we explore the capabilities of open source Large Language Models (LLMs), i.e., Flan-UL2, for the DocEAE task. To this end, we propose ULTRA, a hierarchical framework that extracts event arguments more cost-effectively -- the method needs as few as 50 annotations and doesn't require hitting costly API endpoints. Further, it alleviates the positional bias issue intrinsic to LLMs. ULTRA first sequentially reads text chunks of a document to generate a candidate argument set, upon which ULTRA learns to drop non-pertinent candidates through self-refinement. We further introduce LEAFER to address the challenge LLMs face in locating the exact boundary of an argument span. ULTRA outperforms strong baselines, which include strong supervised models and ChatGPT, by 9.8% when evaluated by the exact match (EM) metric.


title: TEPI: Taxonomy-aware Embedding and Pseudo-Imaging for Scarcely-labeled Zero-shot Genome Classification

abstract: A species' genetic code or genome encodes valuable evolutionary, biological, and phylogenetic information that aids in species recognition, taxonomic classification, and understanding genetic predispositions like drug resistance and virulence. However, the vast number of potential species poses significant challenges in developing a general-purpose whole genome classification tool. Traditional bioinformatics tools have made notable progress but lack scalability and are computationally expensive. Machine learning-based frameworks show promise but must address the issue of large classification vocabularies with long-tail distributions. In this study, we propose addressing this problem through zero-shot learning using TEPI, Taxonomy-aware Embedding and Pseudo-Imaging. We represent each genome as pseudo-images and map them to a taxonomy-aware embedding space for reasoning and classification. This embedding space captures compositional and phylogenetic relationships of species, enabling predictions in extensive search spaces. We evaluate TEPI using two rigorous zero-shot settings and demonstrate its generalization capabilities qualitatively on curated, large-scale, publicly sourced data.


title: Segment Any Cell: A SAM-based Auto-prompting Fine-tuning Framework for Nuclei Segmentation

abstract: In the rapidly evolving field of AI research, foundational models like BERT and GPT have significantly advanced language and vision tasks. The advent of pretrain-prompting models such as ChatGPT and Segmentation Anything Model (SAM) has further revolutionized image segmentation. However, their applications in specialized areas, particularly in nuclei segmentation within medical imaging, reveal a key challenge: the generation of high-quality, informative prompts is as crucial as applying state-of-the-art (SOTA) fine-tuning techniques on foundation models. To address this, we introduce Segment Any Cell (SAC), an innovative framework that enhances SAM specifically for nuclei segmentation. SAC integrates a Low-Rank Adaptation (LoRA) within the attention layer of the Transformer to improve the fine-tuning process, outperforming existing SOTA methods. It also introduces an innovative auto-prompt generator that produces effective prompts to guide segmentation, a critical factor in handling the complexities of nuclei segmentation in biomedical imaging. Our extensive experiments demonstrate the superiority of SAC in nuclei segmentation tasks, proving its effectiveness as a tool for pathologists and researchers. Our contributions include a novel prompt generation strategy, automated adaptability for diverse segmentation tasks, the innovative application of Low-Rank Attention Adaptation in SAM, and a versatile framework for semantic segmentation challenges.


title: Unified-Width Adaptive Dynamic Network for All-In-One Image Restoration

abstract: In contrast to traditional image restoration methods, all-in-one image restoration techniques are gaining increased attention for their ability to restore images affected by diverse and unknown corruption types and levels. However, contemporary all-in-one image restoration methods omit task-wise difficulties and employ the same networks to reconstruct images afflicted by diverse degradations. This practice leads to an underestimation of the task correlations and suboptimal allocation of computational resources. To elucidate task-wise complexities, we introduce a novel concept positing that intricate image degradation can be represented in terms of elementary degradation. Building upon this foundation, we propose an innovative approach, termed the Unified-Width Adaptive Dynamic Network (U-WADN), consisting of two pivotal components: a Width Adaptive Backbone (WAB) and a Width Selector (WS). The WAB incorporates several nested sub-networks with varying widths, which facilitates the selection of the most apt computations tailored to each task, thereby striking a balance between accuracy and computational efficiency during runtime. For different inputs, the WS automatically selects the most appropriate sub-network width, taking into account both task-specific and sample-specific complexities. Extensive experiments across a variety of image restoration tasks demonstrate that the proposed U-WADN achieves better performance while simultaneously reducing up to 32.3\% of FLOPs and providing approximately 15.7\% real-time acceleration. The code has been made available at \url{https://github.com/xuyimin0926/U-WADN}.


title: It's About Time: Incorporating Temporality in Retrieval Augmented Language Models

abstract: The web serves as a global repository of knowledge, used by billions of people to search for information. Ensuring that users receive the most relevant and up-to-date information, especially in the presence of multiple versions of web content from different time points remains a critical challenge for information retrieval. This challenge has recently been compounded by the increased use of question answering tools trained on Wikipedia or web content and powered by large language models (LLMs) which have been found to make up information (or hallucinate), and in addition have been shown to struggle with the temporal dimensions of information. Even Retriever Augmented Language Models (RALMs) which incorporate a document database to reduce LLM hallucination are unable to handle temporal queries correctly. This leads to instances where RALMs respond to queries such as "Who won the Wimbledon Championship?", by retrieving document passages related to Wimbledon but without the ability to differentiate between them based on how recent they are. In this paper, we propose and evaluate, TempRALM, a temporally-aware Retriever Augmented Language Model (RALM) with few-shot learning extensions, which takes into account both semantically and temporally relevant documents relative to a given query, rather than relying on semantic similarity alone. We show that our approach results in up to 74% improvement in performance over the baseline RALM model, without requiring model pre-training, recalculating or replacing the RALM document index, or adding other computationally intensive elements.


title: TAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual Data

abstract: In this work, we address question answering (QA) over a hybrid of tabular and textual data that are very common content on the Web (e.g. SEC filings), where discrete reasoning capabilities are often required. Recently, large language models (LLMs) like GPT-4 have demonstrated strong multi-step reasoning capabilities. We then consider harnessing the amazing power of LLMs to solve our task. We abstract a Step-wise Pipeline for tabular and textual QA, which consists of three key steps, including Extractor, Reasoner and Executor, and initially design an instruction to instantiate the pipeline and validate that GPT-4 outperforms all existing methods. However, utilizing an online LLM like GPT-4 holds various challenges in terms of cost, latency, and data security risk, which motivates us to specialize smaller LLMs in this task. We develop a TAT-LLM language model by fine-tuning LLaMA 2 with the training data generated automatically from existing expert-annotated datasets following the Step-wise Pipeline. The experimental results have verified that our TAT-LLM model can outperform all baseline models, including the previous best fine-tuned models and very large-scale LLMs like GPT-4 on FinQA, TAT-QA and TAT-DQA benchmarks.


title: Magneto-chiral nonlinear optical effect with large anisotropic response in two-dimensional halide perovskite

abstract: The chiral organic-inorganic halide perovskites (OIHPs) are vital candidates for superior nonlinear optical (NLO) effects associated with circularly polarized (CP) light. NLO in chiral materials often couples with magnetic dipole (MD) transition, as well as the conventional electric dipole (ED) transition. However, the importance of MD in NLO process of chiral OIHPs has not yet been well recognized. Here, the analysis of second harmonic generation circular dichroism (SHG-CD) provides the direct evidence that the MD contribution leads to a large anisotropic response to CP lights in chiral OIHPs, (R-/S-MBACl)2PbI4. The thin films exhibit great sensitivity to CP lights over a wide wavelength range, and the g-value reaches up to 1.57 at the wavelength where the contribution of MD is maximized. Furthermore, it is also effective as CP light generator, outputting CP-SHG with maximum g-factor of 1.76 upon the stimulation of linearly polarized light. This study deepens the understanding of the magneto-optical NLO processes in chiral systems.


title: A New Look at the Scalar Meson $f_0(500)$ via $D^+\to \pi^+\pi^-\ell^+\nu_\ell$ Decays

abstract: Using $2.93~\mathrm{fb}^{-1}$ of $e^+e^-$ collision data collected with the BESIII detector at the center-of-mass energy of 3.773 GeV, we investigate the semileptonic decays $D^+\to \pi^+\pi^- \ell^+\nu_\ell$ ($\ell=e$ and $\mu$). The $D^+\to f_0(500)\mu^+\nu_\mu$ decay is observed for the first time. By analyzing simultaneously the differential decay rates of $D^+\to f_0(500) \mu^+\nu_\mu$ and $D^+\to f_0(500) e^+\nu_e$ in different $\ell^+\nu_\ell$ four-momentum transfer intervals, the product of the relevant hadronic form factor $f^{f_0}_{+}(0)$ and the magnitude of the $c\to d$ Cabibbo-Kobayashi-Maskawa matrix element $|V_{cd}|$ is determined to be $f_{+}^{f_0} (0)|V_{cd}|=0.0787\pm0.0060_{\rm stat}\pm0.0033_{\rm syst}$ for the first time. With the input of $|V_{cd}|$ from the global fit in the standard model, we determine $f_{+}^{f_0} (0)=0.350\pm0.027_{\rm stat}\pm0.015_{\rm syst}$. The absolute branching fractions of $D^+\to f_0(500)_{(\pi^+\pi^-)}\mu^+\nu_\mu$ and $D^+\to \rho^0_{(\pi^+\pi^-)} \mu^+\nu_\mu$ are determined as $(0.72\pm0.13_{\rm stat}\pm0.10_{\rm syst})\times10^{-3}$ and $(1.64\pm0.13_{\rm stat}\pm0.11_{\rm syst})\times 10^{-3}$. Combining these results with those of previous BESIII measurements on their semielectronic counterparts from the same data sample, we test lepton flavor universality by measuring the branching fraction ratios ${\mathcal B}_{D^+\to \rho^0 \mu^+\nu_\mu}/{\mathcal B}_{D^+\to \rho^0 e^+\nu_e}=0.88\pm0.10$ and ${\mathcal B}_{D^+\to f_0(500) \mu^+\nu_\mu}/{\mathcal B}_{D^+\to f_0(500) e^+\nu_e}=1.14\pm0.28$, which are compatible with the standard model expectation.


title: Riemannian Manifold HMC with fermions

abstract: We report on our study of the Riemannian Manifold HMC (RMHMC) algorithm with the mass term for the gauge momenta replaced by rational functions of the gauge covariant Laplace operator. A comparison of HMC and RMHMC on a 2+1+1 flavor dynamical ensemble with lattice spacing a ~0.05fm shows increased rate of change in long distance modes, identified by Wilson flowed energy, per fermion molecular dynamics step.


title: LPNL: Scalable Link Prediction with Large Language Models

abstract: Exploring the application of large language models (LLMs) to graph learning is a emerging endeavor. However, the vast amount of information inherent in large graphs poses significant challenges to this process. This work focuses on the link prediction task and introduces $\textbf{LPNL}$ (Link Prediction via Natural Language), a framework based on large language models designed for scalable link prediction on large-scale heterogeneous graphs. We design novel prompts for link prediction that articulate graph details in natural language. We propose a two-stage sampling pipeline to extract crucial information from the graphs, and a divide-and-conquer strategy to control the input tokens within predefined limits, addressing the challenge of overwhelming information. We fine-tune a T5 model based on our self-supervised learning designed for link prediction. Extensive experimental results demonstrate that LPNL outperforms multiple advanced baselines in link prediction tasks on large-scale graphs.


title: Multiple polaron quasiparticles with dipolar fermions in a bilayer geometry

abstract: We study the Fermi polaron problem with dipolar fermions in a bilayer geometry, where a single dipolar particle in one layer interacts with a Fermi sea of dipolar fermions in the other layer. By evaluating the polaron spectrum, we obtain the appearance of a series of attractive branches when the distance between the layers diminishes. We relate these to the appearance of a series of bound two-dipole states when the interlayer dipolar interaction strength increases. By inspecting the orbital angular momentum component of the polaron branches, we observe an interchange of orbital character when system parameters such as the gas density or the interlayer distance are varied. Further, we study the possibility that the lowest energy two-body bound state spontaneously acquires a finite center of mass momentum when the density of fermions exceeds a critical value, and we determine the dominating orbital angular momenta that characterize the pairing. Finally, we propose to use the tunneling rate from and into an auxiliary layer as an experimental probe of the impurity spectral function.


title: From Random to Informed Data Selection: A Diversity-Based Approach to Optimize Human Annotation and Few-Shot Learning

abstract: A major challenge in Natural Language Processing is obtaining annotated data for supervised learning. An option is the use of crowdsourcing platforms for data annotation. However, crowdsourcing introduces issues related to the annotator's experience, consistency, and biases. An alternative is to use zero-shot methods, which in turn have limitations compared to their few-shot or fully supervised counterparts. Recent advancements driven by large language models show potential, but struggle to adapt to specialized domains with severely limited data. The most common approaches therefore involve the human itself randomly annotating a set of datapoints to build initial datasets. But randomly sampling data to be annotated is often inefficient as it ignores the characteristics of the data and the specific needs of the model. The situation worsens when working with imbalanced datasets, as random sampling tends to heavily bias towards the majority classes, leading to excessive annotated data. To address these issues, this paper contributes an automatic and informed data selection architecture to build a small dataset for few-shot learning. Our proposal minimizes the quantity and maximizes diversity of data selected for human annotation, while improving model performance.


title: Twisted Triple Product $p$-adic $L$-function for Finite Slope Families of Hilbert Modular Forms

abstract: Let $L$ be a totally real field, and $p$ be a rational prime that is unramified in $L$. We construct overconvergent families of classes of relative de Rham cohomology of the universal abelian scheme over Hilbert modular varieties associated to $L$. We show that these classes come equipped with Gauss-Manin connection. We prove convergence for $p$-adic iteration of this connection, improving upon a technique due to Andreatta-Iovita. We use this to construct a $p$-adic twisted triple product $L$-function associated to finite slope families of Hilbert modular forms, extending work of Blanco-Chacon-Fornea for Hida families.


title: DittoGym: Learning to Control Soft Shape-Shifting Robots

abstract: Robot co-design, where the morphology of a robot is optimized jointly with a learned policy to solve a specific task, is an emerging area of research. It holds particular promise for soft robots, which are amenable to novel manufacturing techniques that can realize learned morphologies and actuators. Inspired by nature and recent novel robot designs, we propose to go a step further and explore the novel reconfigurable robots, defined as robots that can change their morphology within their lifetime. We formalize control of reconfigurable soft robots as a high-dimensional reinforcement learning (RL) problem. We unify morphology change, locomotion, and environment interaction in the same action space, and introduce an appropriate, coarse-to-fine curriculum that enables us to discover policies that accomplish fine-grained control of the resulting robots. We also introduce DittoGym, a comprehensive RL benchmark for reconfigurable soft robots that require fine-grained morphology changes to accomplish the tasks. Finally, we evaluate our proposed coarse-to-fine algorithm on DittoGym and demonstrate robots that learn to change their morphology several times within a sequence, uniquely enabled by our RL algorithm. More results are available at https://dittogym.github.io.


title: Distributed Source Coding Using Constrained-Random-Number Generators

abstract: This paper investigates the general distributed lossless/lossy source coding formulated by Jana and Blahut. Their multi-letter rate-distortion region, an alternative to the region derived by Yang and Qin, is characterized by entropy functions for arbitrary general correlated sources. Achievability is shown by constructing a code based on constrained-random number generators.


title: Generation of multi-component super integrable hierarchy associated with higher-dimensional Lie superalgebra spo(2N,2) and osp(2N,2)

abstract: A new type of high-dimensional Lie superalgebras is constructed, including Lie superalgebras spo(4,2) and osp(4,2). Based on it, two different coupled nonisospectral super AKNS hierarchies and their bi-Hamiltonian structures are obtained. Then, the Lie superalgebras spo(4,2) and osp(4,2) are expanded to infinite-dimensional Lie superalgebras spo(2N,2) and osp(2N,2). It follows that we present the generation of multi-component super integrable hierarchy, and deduce two different multi-component super integrable AKNS hierarchies and their Hamiltonian structures.


title: On the Statistical Mechanics of Mass Accommodation at Liquid-Vapor Interfaces

abstract: We propose a framework for describing the dynamics associated with the adsorption of small molecules to liquid-vapor interfaces, using an intermediate resolution between traditional continuum theories that are bereft of molecular detail and molecular dynamics simulations that are replete with them. In particular, we develop an effective single particle equation of motion capable of describing the physical processes that determine thermal and mass accommodation probabilities. The effective equation is parameterized with quantities that vary through space away from the liquid-vapor interface. Of particular importance in describing the early time dynamics is the spatially dependent friction, for which we propose a numerical scheme to evaluate from molecular simulation. Taken together with potentials of mean force computable with importance sampling methods, we illustrate how to compute the mass accommodation coefficient and residence time distribution. Throughout, we highlight the case of ozone adsorption in aqueous solutions and its dependence on electrolyte composition.


title: The role of carbon in red giant spectro-seismology

abstract: Although red clump stars function as reliable standard candles, their surface characteristics (i.e. $T_\text{eff}$, $\log g$, and [Fe/H]) overlap with those of red giant branch stars, which are not standard candles. Recent results have revealed that spectral features containing carbon (e.g. CN molecular bands) carry information correlating with the "gold-standard" asteroseismic classifiers that distinguish red clump from red giant branch stars. However, the underlying astrophysical processes driving the correlation between these spectroscopic and asteroseismic quantities in red giants remain inadequately explored. This study aims to enhance our understanding of this "spectro-seismic" effect, by refining the list of key spectral features predicting red giant evolutionary state. In addition, we conduct further investigation into those key spectral features to probe the astrophysical processes driving this connection. We employ the data-driven The Cannon algorithm to analyse high-resolution ($R\sim80,000$) Veloce Rosso spectra from the Anglo-Australian Telescope for 301 red giant stars (where asteroseismic classifications from the TESS mission are known for 123 of the stars). The results highlight molecular spectroscopic features, particularly those containing carbon (e.g. CN), as the primary indicators of the evolutionary states of red giant stars. Furthermore, by investigating CN isotopic pairs (that is, $^{12}$C$^{14}$N and $^{13}$C$^{14}$N) we find suggestions of statistically significant differences in the reduced equivalent widths of such lines, suggesting that physical processes that change the surface abundances and isotopic ratios in red giant stars, such as deep mixing, are the driving forces of the "spectro-seismic" connection of red giants.


title: How to Collaborate: Towards Maximizing the Generalization Performance in Cross-Silo Federated Learning

abstract: Federated learning (FL) has attracted vivid attention as a privacy-preserving distributed learning framework. In this work, we focus on cross-silo FL, where clients become the model owners after training and are only concerned about the model's generalization performance on their local data. Due to the data heterogeneity issue, asking all the clients to join a single FL training process may result in model performance degradation. To investigate the effectiveness of collaboration, we first derive a generalization bound for each client when collaborating with others or when training independently. We show that the generalization performance of a client can be improved only by collaborating with other clients that have more training data and similar data distribution. Our analysis allows us to formulate a client utility maximization problem by partitioning clients into multiple collaborating groups. A hierarchical clustering-based collaborative training (HCCT) scheme is then proposed, which does not need to fix in advance the number of groups. We further analyze the convergence of HCCT for general non-convex loss functions which unveils the effect of data similarity among clients. Extensive simulations show that HCCT achieves better generalization performance than baseline schemes, whereas it degenerates to independent training and conventional FL in specific scenarios.


title: Quantum natural gradient without monotonicity

abstract: Natural gradient (NG) is an information-geometric optimization method that plays a crucial role, especially in the estimation of parameters for machine learning models like neural networks. To apply NG to quantum systems, the quantum natural gradient (QNG) was introduced and utilized for noisy intermediate-scale devices. Additionally, a mathematically equivalent approach to QNG, known as the stochastic reconfiguration method, has been implemented to enhance the performance of quantum Monte Carlo methods. It is worth noting that these methods are based on the symmetric logarithmic derivative (SLD) metric, which is one of the monotone metrics. So far, monotonicity has been believed to be a guiding principle to construct a geometry in physics. In this paper, we propose generalized QNG by removing the condition of monotonicity. Initially, we demonstrate that monotonicity is a crucial condition for conventional QNG to be optimal. Subsequently, we provide analytical and numerical evidence showing that non-monotone QNG outperforms conventional QNG based on the SLD metric in terms of convergence speed.

categories: quant-ph cond-mat.stat-mech cs.IT math.IT physics.comp-ph stat.ML