title: Directional Differentiability of the Generalized Metric Projection in Hilbert spaces and Hilbertian Bochner spaces

abstract: Let $H$ be a real Hilbert space and $C$ a nonempty closed and convex subset of $H$. Let $P_C: H\rightarrow C$ denote the (standard) metric projection operator. In this paper, we study the G\^ateaux directional differentiability of $P_C$ and investigate some of its properties. The G\^ateaux directionally derivatives of $P_C$ are precisely given for the following cases of the considered subset $C$: 1. closed and convex subsets; 2. closed balls; 3. closed and convex cones (including proper closed subspaces). For special Hilbert spaces, we consider directional differentiability of $P_C$ for some Hilbert spaces with orthonormal bases and the real Hilbert space $L^2([-\pi,\pi])$ with the trigonometric orthonormal basis.


title: UAV-Sim: NeRF-based Synthetic Data Generation for UAV-based Perception

abstract: Tremendous variations coupled with large degrees of freedom in UAV-based imaging conditions lead to a significant lack of data in adequately learning UAV-based perception models. Using various synthetic renderers in conjunction with perception models is prevalent to create synthetic data to augment the learning in the ground-based imaging domain. However, severe challenges in the austere UAV-based domain require distinctive solutions to image synthesis for data augmentation. In this work, we leverage recent advancements in neural rendering to improve static and dynamic novelview UAV-based image synthesis, especially from high altitudes, capturing salient scene attributes. Finally, we demonstrate a considerable performance boost is achieved when a state-ofthe-art detection model is optimized primarily on hybrid sets of real and synthetic data instead of the real or synthetic data separately.


title: A Causal Disentangled Multi-Granularity Graph Classification Method

abstract: Graph data widely exists in real life, with large amounts of data and complex structures. It is necessary to map graph data to low-dimensional embedding. Graph classification, a critical graph task, mainly relies on identifying the important substructures within the graph. At present, some graph classification methods do not combine the multi-granularity characteristics of graph data. This lack of granularity distinction in modeling leads to a conflation of key information and false correlations within the model. So, achieving the desired goal of a credible and interpretable model becomes challenging. This paper proposes a causal disentangled multi-granularity graph representation learning method (CDM-GNN) to solve this challenge. The CDM-GNN model disentangles the important substructures and bias parts within the graph from a multi-granularity perspective. The disentanglement of the CDM-GNN model reveals important and bias parts, forming the foundation for its classification task, specifically, model interpretations. The CDM-GNN model exhibits strong classification performance and generates explanatory outcomes aligning with human cognitive patterns. In order to verify the effectiveness of the model, this paper compares the three real-world datasets MUTAG, PTC, and IMDM-M. Six state-of-the-art models, namely GCN, GAT, Top-k, ASAPool, SUGAR, and SAT are employed for comparison purposes. Additionally, a qualitative analysis of the interpretation results is conducted.


title: Variable stars in the field of the Galactic bulge globular cluster NGC 6522

abstract: We present a comprehensive analysis of the variable stars projected on the field of the Galactic bulge globular cluster NGC 6522, offering valuable insights into their characteristics. Using proper motions from Gaia DR3, we aim to distinguish between field stars and true cluster members. For an accurate color-magnitude diagram of the member stars, we produced a differential reddening map. We detect and discuss the peculiarities of variable stars of the types RR Lyrae, type II Cepheids, Long Period Variables (LPV) and eclipsing binaries, whose light curves are available through the OGLE III and IV databases. Notably, we explore the variable V24, which shows a prominent phase modulation resulting from period changes in a time scale of ~1100 days. The variable stars among the cluster members serve as indicators of the cluster metallicity and distance; these determinations are based on their light curves. With the Fourier light curve decomposition of three RRc stars, we have derived the following cluster parameters: the metallicity in the spectroscopic scale [Fe/H]$_{\rm UVES}$=--1.16 $\pm$0.09; and the mean distance $D=8.77 \pm 0.16$ kpc.


title: The effective QCD running coupling constant and a Dirac model for the charmonium spectrum

abstract: The QCD effective charge extracted from the experimental data is used to construct the vector interaction of a Dirac relativistic model for the charmonium spectrum. The process required to fit the spectrum is discussed and the relationship with a previous study of the vector interaction is analyzed.


title: Kerr-Nonlinearity Assisted Exceptional Point Degeneracy in a Detuned PT-Symmetric System

abstract: Systems operating at exceptional points (EPs) are highly responsive to small perturbations, making them suitable for sensing applications. Although this feature impedes the system working exactly at an EP due to imperfections arising during the fabrication process. We propose a fast self-tuning scheme based on Kerr nonlinearity in a coupled dielectric resonator excited through a waveguide placed in the near-field of the resonators. We show that in a coupled resonator with unequal Kerr-coefficients, initial distortion from EP regime can be completely compensated. It provides an opportunity to reach very close to the EP in a coupled resonator with detuned resonant frequencies via tuning the intensity of the incident wave. Using time-modulation of the incident wave in nonlinear systems to control both the gain or loss, and resonant frequencies can be a possible approach to fully control the parameters close to an EP.


title: Private Estimation and Inference in High-Dimensional Regression with FDR Control

abstract: This paper presents novel methodologies for conducting practical differentially private (DP) estimation and inference in high-dimensional linear regression. We start by proposing a differentially private Bayesian Information Criterion (BIC) for selecting the unknown sparsity parameter in DP-Lasso, eliminating the need for prior knowledge of model sparsity, a requisite in the existing literature. Then we propose a differentially private debiased LASSO algorithm that enables privacy-preserving inference on regression parameters. Our proposed method enables accurate and private inference on the regression parameters by leveraging the inherent sparsity of high-dimensional linear regression models. Additionally, we address the issue of multiple testing in high-dimensional linear regression by introducing a differentially private multiple testing procedure that controls the false discovery rate (FDR). This allows for accurate and privacy-preserving identification of significant predictors in the regression model. Through extensive simulations and real data analysis, we demonstrate the efficacy of our proposed methods in conducting inference for high-dimensional linear models while safeguarding privacy and controlling the FDR.


title: The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining

abstract: We analyze the masked language modeling pretraining objective function from the perspective of the distributional hypothesis. We investigate whether better sample efficiency and the better generalization capability of models pretrained with masked language modeling can be attributed to the semantic similarity encoded in the pretraining data's distributional property. Via a synthetic dataset, our analysis suggests that distributional property indeed leads to the better sample efficiency of pretrained masked language models, but does not fully explain the generalization capability. We also conduct analyses over two real-world datasets and demonstrate that the distributional property does not explain the generalization ability of pretrained natural language models either. Our results illustrate our limited understanding of model pretraining and provide future research directions.


title: rTisane: Externalizing conceptual models for data analysis increases engagement with domain knowledge and improves statistical model quality

abstract: Statistical models should accurately reflect analysts' domain knowledge about variables and their relationships. While recent tools let analysts express these assumptions and use them to produce a resulting statistical model, it remains unclear what analysts want to express and how externalization impacts statistical model quality. This paper addresses these gaps. We first conduct an exploratory study of analysts using a domain-specific language (DSL) to express conceptual models. We observe a preference for detailing how variables relate and a desire to allow, and then later resolve, ambiguity in their conceptual models. We leverage these findings to develop rTisane, a DSL for expressing conceptual models augmented with an interactive disambiguation process. In a controlled evaluation, we find that rTisane's DSL helps analysts engage more deeply with and accurately externalize their assumptions. rTisane also leads to statistical models that match analysts' assumptions, maintain analysis intent, and better fit the data.


title: Enhancing Large Language Models for Secure Code Generation: A Dataset-driven Study on Vulnerability Mitigation

abstract: Large language models (LLMs) have brought significant advancements to code generation, benefiting both novice and experienced developers. However, their training using unsanitized data from open-source repositories, like GitHub, introduces the risk of inadvertently propagating security vulnerabilities. To effectively mitigate this concern, this paper presents a comprehensive study focused on evaluating and enhancing code LLMs from a software security perspective. We introduce SecuCoGen\footnote{SecuCoGen has been uploaded as supplemental material and will be made publicly available after publication.}, a meticulously curated dataset targeting 21 critical vulnerability types. SecuCoGen comprises 180 samples and serves as the foundation for conducting experiments on three crucial code-related tasks: code generation, code repair and vulnerability classification, with a strong emphasis on security. Our experimental results reveal that existing models often overlook security concerns during code generation, leading to the generation of vulnerable code. To address this, we propose effective approaches to mitigate the security vulnerabilities and enhance the overall robustness of code generated by LLMs. Moreover, our study identifies weaknesses in existing models' ability to repair vulnerable code, even when provided with vulnerability information. Additionally, certain vulnerability types pose challenges for the models, hindering their performance in vulnerability classification. Based on these findings, we believe our study will have a positive impact on the software engineering community, inspiring the development of improved methods for training and utilizing LLMs, thereby leading to safer and more trustworthy model deployment.


title: Fully kinetic study of facility pressure effects on RF-source magnetic nozzles

abstract: A fully kinetic 2D axisymmetric Particle-in-Cell (PIC) model is used to examine the effects of background facility pressure on the plasma transport and propulsive efficiency of magnetic nozzles. Simulations are performed for a low-power (150 W class) cathode-less radio-frequency (RF) plasma thruster, operating with xenon, between background pressures up to 10$^{-2}$ Pa and average electron discharge temperatures of 4 - 16 eV. When the electron temperature within the near-plume region reaches 8 eV, a decisive reduction in performance occurs: at 10$^{-2}$ Pa, in-plume power losses surpass 25% of the discharge energy flux. Given that the ionization energy for Xe is 12 eV, the 8 eV threshold indicates that a consistent percentage of electrons has energy enough to trigger ionization. On the other hand, when the temperature is below such threshold, the primary collisions are charge-exchange and inelastic ion scattering, and the power loss remains less than 10%. It is established that losses in the considered HPT are significant if the facility pressure is greater than 10$^{-3}$ Pa, at absorbed powers larger than 130 W. At the nominal 150 W, this results in a 15% thrust reduction. When facility pressure is taken into consideration over ideal vacuum simulations, numerical error is reduced to <30% when compared to experimental thrust measurements at 10$^{-3}$ Pa.


title: Experimental test of the Jarzynski equality in a single spin-1 system using high-fidelity single-shot readouts

abstract: The Jarzynski equality (JE), which connects the equilibrium free energy with non-equilibrium work statistics, plays a crucial role in quantum thermodynamics. Although practical quantum systems are usually multi-level systems, most tests of the JE were executed in two-level systems. A rigorous test of the JE by directly measuring the work distribution of a physical process in a high-dimensional quantum system remains elusive. Here, we report an experimental test of the JE in a single spin-1 system. We realized nondemolition projective measurement of this three-level system via cascading high-fidelity single-shot readouts and directly measured the work distribution utilizing the two-point measurement protocol. The validity of the JE was verified from the non-adiabatic to adiabatic zone and under different effective temperatures. Our work puts the JE on a solid experimental foundation and makes the NV center system a mature toolbox to perform advanced experiments of stochastic quantum thermodynamics.


title: Super-resolution imaging reveals resistance to mass transfer in functionalized stationary phases

abstract: Chemical separations are costly in terms of energy, time, and money. Separation methods are optimized with inefficient trial-and-error approaches that lack insight into the molecular dynamics that lead to the success or failure of a separation and, hence, ways to improve the process. We perform super-resolution imaging of fluorescent analytes in four different commercial liquid chromatography materials. Surprisingly, we observe that chemical functionalization can block over fifty percent of the porous interior of the material, rendering it inaccessible to small molecule analytes. Only in situ imaging unveils the inaccessibility when compared to the industry-accepted ex situ characterization methods. Selectively removing some of the functionalization with solvent restores pore access without significantly altering the single-molecule kinetics that underlie the separation and agree with bulk chromatography measurements. Our molecular results determine that commercial stationary phases, marketed as fully porous, are over-functionalized and provide a new avenue to characterize and direct separation material design from the bottom-up.


title: Student Classroom Behavior Detection based on Spatio-Temporal Network and Multi-Model Fusion

abstract: Using deep learning methods to detect students' classroom behavior automatically is a promising approach for analyzing their class performance and improving teaching effectiveness. However, the lack of publicly available spatio-temporal datasets on student behavior, as well as the high cost of manually labeling such datasets, pose significant challenges for researchers in this field. To address this issue, we proposed a method for extending the spatio-temporal behavior dataset in Student Classroom Scenarios (SCB-ST-Dataset4) through image dataset. Our SCB-ST-Dataset4 comprises 757265 images with 25810 labels, focusing on 3 behaviors: hand-raising, reading, writing. Our proposed method can rapidly generate spatio-temporal behavior datasets without requiring extra manual labeling. Furthermore, we proposed a Behavior Similarity Index (BSI) to explore the similarity of behaviors. We evaluated the dataset using the YOLOv5, YOLOv7, YOLOv8, and SlowFast algorithms, achieving a mean average precision (map) of up to 82.3%. Last, we fused multiple models to generate student behavior-related data from various perspectives. The experiment further demonstrates the effectiveness of our method. And SCB-ST-Dataset4 provides a robust foundation for future research in student behavior detection, potentially contributing to advancements in this field. The SCB-ST-Dataset4 is available for download at: https://github.com/Whiffe/SCB-dataset.


title: Inelastic collisions facilitating runaway electron generation in weakly-ionized plasmas

abstract: Dreicer generation is one of the main mechanisms of runaway electrons generation, in particular during tokamak startup. In fully ionized plasma it is described as a diffusive flow from the Maxwellian core into high energies under the effect of the electric field. In this work we demonstrate a critical role of the non-differential nature of inelastic collisions in weakly ionized plasma during tokamak startup, where some electrons experience virtually no collisions during acceleration to the critical energy. We show that using the Fokker-Planck collisional operator can underestimate the Dreicer generation rate by several orders of magnitude.


title: Multilingual Coarse Political Stance Classification of Media. The Editorial Line of a ChatGPT and Bard Newspaper

abstract: Neutrality is difficult to achieve and, in politics, subjective. Traditional media typically adopt an editorial line that can be used by their potential readers as an indicator of the media bias. Several platforms currently rate news outlets according to their political bias. The editorial line and the ratings help readers in gathering a balanced view of news. But in the advent of instruction-following language models, tasks such as writing a newspaper article can be delegated to computers. Without imposing a biased persona, where would an AI-based news outlet lie within the bias ratings? In this work, we use the ratings of authentic news outlets to create a multilingual corpus of news with coarse stance annotations (Left and Right) along with automatically extracted topic annotations. We show that classifiers trained on this data are able to identify the editorial line of most unseen newspapers in English, German, Spanish and Catalan. We then apply the classifiers to 101 newspaper-like articles written by ChatGPT and Bard in the 4 languages at different time periods. We observe that, similarly to traditional newspapers, ChatGPT editorial line evolves with time and, being a data-driven system, the stance of the generated articles differs among languages.


title: Attention Lens: A Tool for Mechanistically Interpreting the Attention Head Information Retrieval Mechanism

abstract: Transformer-based Large Language Models (LLMs) are the state-of-the-art for natural language tasks. Recent work has attempted to decode, by reverse engineering the role of linear layers, the internal mechanisms by which LLMs arrive at their final predictions for text completion tasks. Yet little is known about the specific role of attention heads in producing the final token prediction. We propose Attention Lens, a tool that enables researchers to translate the outputs of attention heads into vocabulary tokens via learned attention-head-specific transformations called lenses. Preliminary findings from our trained lenses indicate that attention heads play highly specialized roles in language models. The code for Attention Lens is available at github.com/msakarvadia/AttentionLens.


title: CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment

abstract: Language models trained on large-scale corpus often generate content that is harmful, toxic, or contrary to human preferences, making their alignment with human values a critical concern. Reinforcement learning from human feedback (RLHF) with algorithms like PPO is a prevalent approach for alignment but is often complex, unstable, and resource-intensive. Recently, ranking-based alignment methods have emerged, offering stability and effectiveness by replacing the RL framework with supervised fine-tuning, but they are costly due to the need for annotated data. Considering that existing large language models (LLMs) like ChatGPT are already relatively well-aligned and cost-friendly, researchers have begun to align the language model with human preference from AI feedback. The common practices, which unidirectionally distill the instruction-following responses from LLMs, are constrained by their bottleneck. Thus we introduce CycleAlign to distill alignment capabilities from parameter-invisible LLMs (black-box) to a parameter-visible model (white-box) in an iterative manner. With in-context learning (ICL) as the core of the cycle, the black-box models are able to rank the model-generated responses guided by human-craft instruction and demonstrations about their preferences. During iterative interaction, the white-box models also have a judgment about responses generated by them. Consequently, the agreement ranking could be viewed as a pseudo label to dynamically update the in-context demonstrations and improve the preference ranking ability of black-box models. Through multiple interactions, the CycleAlign framework could align the white-box model with the black-box model effectively in a low-resource way. Empirical results illustrate that the model fine-tuned by CycleAlign remarkably exceeds existing methods, and achieves the state-of-the-art performance in alignment with human value.


title: Stripe order and diode effect in two-dimensional Rashba superconductors

abstract: In two-dimensional superconductors with a Rashba-type spin-orbit coupling, it is known that an in-plane magnetic field can induce a helical superconducting (SC) state with a phase modulation $e^{i {\bf q}\cdot {\bf r}}$. Here, we theoretically investigate the stability of a stripe order, a weight-biased superposition state composed of $+{\bf q}$ and $-{\bf q}$ modes taking the form of $\Delta_+ e^{i{\bf q}\cdot{\bf r}}+\Delta_- e^{-i{\bf q}\cdot{\bf r}}$ with $|\Delta_+|\neq|\Delta_-|\neq 0$, assuming that the spin-singlet pairing channel is dominant. Based on the Ginzburg-Landau theory, we show that for both s-wave and d-wave pairing symmetries, the stripe order can appear in the high-field and low-temperature region inside the helical phase and that the transition between the helical and stripe phases is of second order. It is noteworthy that for the d-wave pairing, the stability region of the stripe phase shrinks when the in-plane field is rotated from the nodal direction to the anti-nodal direction. It is also found that the nonreciprocity of the critical current, the so-called SC diode effect, emerges not only in the helical phase but also in the stripe phase, with no clear nonreciprocity anomaly at the helical-stripe transition due to its second-order nature.


title: Deep Learning for Plant Identification and Disease Classification from Leaf Images: Multi-prediction Approaches

abstract: Deep learning plays an important role in modern agriculture, especially in plant pathology using leaf images where convolutional neural networks (CNN) are attracting a lot of attention. While numerous reviews have explored the applications of deep learning within this research domain, there remains a notable absence of an empirical study to offer insightful comparisons due to the employment of varied datasets in the evaluation. Furthermore, a majority of these approaches tend to address the problem as a singular prediction task, overlooking the multifaceted nature of predicting various aspects of plant species and disease types. Lastly, there is an evident need for a more profound consideration of the semantic relationships that underlie plant species and disease types. In this paper, we start our study by surveying current deep learning approaches for plant identification and disease classification. We categorise the approaches into multi-model, multi-label, multi-output, and multi-task, in which different backbone CNNs can be employed. Furthermore, based on the survey of existing approaches in plant pathology and the study of available approaches in machine learning, we propose a new model named Generalised Stacking Multi-output CNN (GSMo-CNN). To investigate the effectiveness of different backbone CNNs and learning approaches, we conduct an intensive experiment on three benchmark datasets Plant Village, Plant Leaves, and PlantDoc. The experimental results demonstrate that InceptionV3 can be a good choice for a backbone CNN as its performance is better than AlexNet, VGG16, ResNet101, EfficientNet, MobileNet, and a custom CNN developed by us. Interestingly, empirical results support the hypothesis that using a single model can be comparable or better than using two models. Finally, we show that the proposed GSMo-CNN achieves state-of-the-art performance on three benchmark datasets.


title: A monotone $Q^1$ finite element method for anisotropic elliptic equations

abstract: We construct a monotone continuous $Q^1$ finite element method on the uniform mesh for the anisotropic diffusion problem with a diagonally dominant diffusion coefficient matrix. The monotonicity implies the discrete maximum principle. Convergence of the new scheme is rigorously proven. On quadrilateral meshes, the matrix coefficient conditions translate into specific a mesh constraint.


title: Non-Destructive Imaging of Breakdown Process in Ferroelectric Capacitors Using \textit{In-situ} Laser-Based Photoemission Electron Microscopy

abstract: HfO$_2$-based ferroelectrics are one of the most actively developed functional materials for memory devices. However, in HfO$_2$-based ferroelectric devices, dielectric breakdown is a main failure mechanism during repeated polarization switching. Elucidation of the breakdown process may broaden the scope of applications for the ferroelectric HfO$_2$. Here, we report direct observations of a breakdown process in HfO$_2$-based ferroelectric capacitors, by \textit{in-situ} laser-based photoemission electron microscopy (laser-PEEM). We have not only clearly visualized the hard dielectric breakdown (HDB) spot, but also observed the regions responsible for the soft dielectric breakdown (SDB) which is a precursor phenomenon to HDB. It was found that the low-resistance region formed after SDB is wider than the conduction path formed after HDB. Furthermore, our spectromicroscopic analysis revealed that the photoelectron spectrum after SDB shows an enhancement in intensity without spectral-shape modulation, interpreted that the initially existed defects are increased. In the HDB spot, however, an additional shoulder structure was observed. These results provide spectroscopic evidence that the electronic states responsible for the conduction path after SDB are different from those after HDB. Through this work, we propose this microscopic approach as a versatile tool for studying buried materials as they are, accelerating the development of material engineering for advanced electronic devices.


title: Complexity of Government response to Covid-19 pandemic: A perspective of coupled dynamics on information heterogeneity and epidemic outbreak

abstract: This study aims at modeling the universal failure in preventing the outbreak of COVID-19 via real-world data from the perspective of complexity and network science. Through formalizing information heterogeneity and government intervention in the coupled dynamics of epidemic and infodemic spreading; first, we find that information heterogeneity and its induced variation in human responses significantly increase the complexity of the government intervention decision. The complexity results in a dilemma between the socially optimal intervention that is risky for the government and the privately optimal intervention that is safer for the government but harmful to the social welfare. Second, via counterfactual analysis against the COVID-19 crisis in Wuhan, 2020, we find that the intervention dilemma becomes even worse if the initial decision time and the decision horizon vary. In the short horizon, both socially and privately optimal interventions agree with each other and require blocking the spread of all COVID-19-related information, leading to a negligible infection ratio 30 days after the initial reporting time. However, if the time horizon is prolonged to 180 days, only the privately optimal intervention requires information blocking, which would induce a catastrophically higher infection ratio than that in the counter-factual world where the socially optimal intervention encourages early-stage information spread. These findings contribute to the literature by revealing the complexity incurred by the coupled infodemic-epidemic dynamics and information heterogeneity to the governmental intervention decision, which also sheds insight into the design of an effective early warning system against the epidemic crisis in the future.


title: Bayesian Domain Invariant Learning via Posterior Generalization of Parameter Distributions

abstract: Domain invariant learning aims to learn models that extract invariant features over various training domains, resulting in better generalization to unseen target domains. Recently, Bayesian Neural Networks have achieved promising results in domain invariant learning, but most works concentrate on aligning features distributions rather than parameter distributions. Inspired by the principle of Bayesian Neural Network, we attempt to directly learn the domain invariant posterior distribution of network parameters. We first propose a theorem to show that the invariant posterior of parameters can be implicitly inferred by aggregating posteriors on different training domains. Our assumption is more relaxed and allows us to extract more domain invariant information. We also propose a simple yet effective method, named PosTerior Generalization (PTG), that can be used to estimate the invariant parameter distribution. PTG fully exploits variational inference to approximate parameter distributions, including the invariant posterior and the posteriors on training domains. Furthermore, we develop a lite version of PTG for widespread applications. PTG shows competitive performance on various domain generalization benchmarks on DomainBed. Additionally, PTG can use any existing domain generalization methods as its prior, and combined with previous state-of-the-art method the performance can be further improved. Code will be made public.


title: XFEVER: Exploring Fact Verification across Languages

abstract: This paper introduces the Cross-lingual Fact Extraction and VERification (XFEVER) dataset designed for benchmarking the fact verification models across different languages. We constructed it by translating the claim and evidence texts of the Fact Extraction and VERification (FEVER) dataset into six languages. The training and development sets were translated using machine translation, whereas the test set includes texts translated by professional translators and machine-translated texts. Using the XFEVER dataset, two cross-lingual fact verification scenarios, zero-shot learning and translate-train learning, are defined, and baseline models for each scenario are also proposed in this paper. Experimental results show that the multilingual language model can be used to build fact verification models in different languages efficiently. However, the performance varies by language and is somewhat inferior to the English case. We also found that we can effectively mitigate model miscalibration by considering the prediction similarity between the English and target languages. The XFEVER dataset, code, and model checkpoints are available at https://github.com/nii-yamagishilab/xfever.


title: TransPose: 6D Object Pose Estimation with Geometry-Aware Transformer

abstract: Estimating the 6D object pose is an essential task in many applications. Due to the lack of depth information, existing RGB-based methods are sensitive to occlusion and illumination changes. How to extract and utilize the geometry features in depth information is crucial to achieve accurate predictions. To this end, we propose TransPose, a novel 6D pose framework that exploits Transformer Encoder with geometry-aware module to develop better learning of point cloud feature representations. Specifically, we first uniformly sample point cloud and extract local geometry features with the designed local feature extractor base on graph convolution network. To improve robustness to occlusion, we adopt Transformer to perform the exchange of global information, making each local feature contains global information. Finally, we introduce geometry-aware module in Transformer Encoder, which to form an effective constrain for point cloud feature learning and makes the global information exchange more tightly coupled with point cloud tasks. Extensive experiments indicate the effectiveness of TransPose, our pose estimation pipeline achieves competitive results on three benchmark datasets.


title: Directly 3D Printed, Pneumatically Actuated Multi-Material Robotic Hand

abstract: Soft robotic manipulators with many degrees of freedom can carry out complex tasks safely around humans. However, manufacturing of soft robotic hands with several degrees of freedom requires a complex multi-step manual process, which significantly increases their cost. We present a design of a multi-material 15 DoF robotic hand with five fingers including an opposable thumb. Our design has 15 pneumatic actuators based on a series of hollow chambers that are driven by an external pressure system. The thumb utilizes rigid joints and the palm features internal rigid structure and soft skin. The design can be directly 3D printed using a multi-material additive manufacturing process without any assembly process and therefore our hand can be manufactured for less than 300 dollars. We test the hand in conjunction with a low-cost vision-based teleoperation system on different tasks.


title: Improving Robust Decisions with Data

abstract: A decision-maker faces uncertainty governed by a data-generating process (DGP), which is only known to belong to a set of sequences of independent but possibly non-identical distributions. A robust decision maximizes the expected payoff against the worst possible DGP in this set. This paper characterizes when and how such robust decisions can be improved with data, measured by the expected payoff under the true DGP, no matter which possible DGP is the truth. It further develops novel and simple inference methods to achieve it, as common methods (e.g., maximum likelihood or Bayesian) often fail to deliver such an improvement.


title: Phantom chain simulations for fracture of polymer networks created from star polymer mixtures of different functionalities

abstract: Fujiyabu et al. have experimentally reported that mixing of 3-arm star prepolymers into 4-arm analog improves the toughness of the resultant polymer networks compared to the base network composed of 4-arm star polymers only. For the mechanism of this phenomenon, this study conducted phantom chain simulations for polymer networks composed of mixtures of star branch prepolymers with equal arm length and different arm numbers, (f_1,f_2 )=(3,4), (3,6) and (3,8), for various f_1=3 prepolymer fractions {\phi}_3. The networks were created via end-linking reactions between prepolymers traced by a Brownian dynamics scheme, and the network structure was stored at different conversion ratios {\phi}_c, ranging from 0.6 and 0.9. The cycle rank of the gelated networks {\xi} is fully consistent with the mean field theory, demonstrating that the examined network structure is statistically fair. The networks were stretched with energy minimization until the break, and fracture characteristics including strain at break {\epsilon}_b, stress at break {\sigma}_b, work for fracture W_b, and the ratio of broken strands {\phi}_bb, were obtained. {\epsilon}_b, {\sigma}_b/{\phi}_bb, and W_b/{\phi}_bb data plotted against {\xi} roughly follow the master curves reported for the base networks without mixing, implying that the change of fracture properties by the mixing of f_1=3 mainly corresponds to a decrease of {\xi}. The mixing slightly suppresses {\sigma}_b/{\phi}_bb and W_b/{\phi}_bb for large f_2 cases compared to the base networks because of a biased breakage at the network strands without extenders, which are prepolymers with only two reacted arms. The analysis for broken strands exhibited a new master curve for the {\xi}-dependence of the molecular weight of broken strands.


title: Modeling and Analysis of the Lead-Lag Network of Economic Indicators

abstract: We propose a method of analyzing multivariate time series data that investigates lead-lag relationships among economic indicators during the COVID-19 era with a weighted directed network of lagged variables. The analysis includes a stock index, average unemployment, and several variables that are used to calculate inflation. Three complex networks are created, with these variables and several lags of each as the network nodes. Network edges are weighted based on three relationship metrics: correlation, mutual information, and transfer entropy. In each network, nodes are merged, and edges are aggregated to simplify the weighted directed graph. Pagerank is used to determine the most influential and the most influenced node over the time period. Results were reasonably robust within each network, but they were heavily dependent on the choice of metric.


title: Bayesian Image Mediation Analysis

abstract: Mediation analysis aims to separate the indirect effect through mediators from the direct effect of the exposure on the outcome. It is challenging to perform mediation analysis with neuroimaging data which involves high dimensionality, complex spatial correlations, sparse activation patterns and relatively low signal-to-noise ratio. To address these issues, we develop a new spatially varying coefficient structural equation model for Bayesian Image Mediation Analysis (BIMA). We define spatially varying mediation effects within the potential outcome framework, employing the soft-thresholded Gaussian process prior for functional parameters. We establish the posterior consistency for spatially varying mediation effects along with selection consistency on important regions that contribute to the mediation effects. We develop an efficient posterior computation algorithm scalable to analysis of large-scale imaging data. Through extensive simulations, we show that BIMA can improve the estimation accuracy and computational efficiency for high-dimensional mediation analysis over the existing methods. We apply BIMA to analyze the behavioral and fMRI data in the Adolescent Brain Cognitive Development (ABCD) study with a focus on inferring the mediation effects of the parental education level on the children's general cognitive ability that are mediated through the working memory brain activities.


title: Removing Dust from CMB Observations with Diffusion Models

abstract: In cosmology, the quest for primordial $B$-modes in cosmic microwave background (CMB) observations has highlighted the critical need for a refined model of the Galactic dust foreground. We investigate diffusion-based modeling of the dust foreground and its interest for component separation. Under the assumption of a Gaussian CMB with known cosmology (or covariance matrix), we show that diffusion models can be trained on examples of dust emission maps such that their sampling process directly coincides with posterior sampling in the context of component separation. We illustrate this on simulated mixtures of dust emission and CMB. We show that common summary statistics (power spectrum, Minkowski functionals) of the components are well recovered by this process. We also introduce a model conditioned by the CMB cosmology that outperforms models trained using a single cosmology on component separation. Such a model will be used in future work for diffusion-based cosmological inference.

categories: astro-ph.CO astro-ph.GA astro-ph.IM cs.LG


title: Homological stability for generalized Hurwitz spaces and Selmer groups in quadratic twist families over function fields

abstract: We prove a version of the Bhargava-Kane-Lenstra-Poonen-Rains heuristics for Selmer groups of quadratic twist families of abelian varieties over global function fields. As a consequence, we derive a result towards the "minimalist conjecture" on Selmer ranks of abelian varieties in such families. More precisely, we show that the probabilities predicted in these two conjectures are correct to within an error term in the size of the constant field, $q$, which goes to $0$ as $q$ grows. Two key inputs are a new homological stability theorem for a generalized version of Hurwitz spaces parameterizing covers of punctured Riemann surfaces of arbitrary genus, and an expression of average sizes of Selmer groups in terms of the number of rational points on these Hurwitz spaces over finite fields.


title: Towards Streaming Speech-to-Avatar Synthesis

abstract: Streaming speech-to-avatar synthesis creates real-time animations for a virtual character from audio data. Accurate avatar representations of speech are important for the visualization of sound in linguistics, phonetics, and phonology, visual feedback to assist second language acquisition, and virtual embodiment for paralyzed patients. Previous works have highlighted the capability of deep articulatory inversion to perform high-quality avatar animation using electromagnetic articulography (EMA) features. However, these models focus on offline avatar synthesis with recordings rather than real-time audio, which is necessary for live avatar visualization or embodiment. To address this issue, we propose a method using articulatory inversion for streaming high quality facial and inner-mouth avatar animation from real-time audio. Our approach achieves 130ms average streaming latency for every 0.1 seconds of audio with a 0.792 correlation with ground truth articulations. Finally, we show generated mouth and tongue animations to demonstrate the efficacy of our methodology.


title: MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Network

abstract: Recent transformer-based approaches have demonstrated excellent performance in 3D human pose estimation. However, they have a holistic view and by encoding global relationships between all the joints, they do not capture the local dependencies precisely. In this paper, we present a novel Attention-GCNFormer (AGFormer) block that divides the number of channels by using two parallel transformer and GCNFormer streams. Our proposed GCNFormer module exploits the local relationship between adjacent joints, outputting a new representation that is complementary to the transformer output. By fusing these two representation in an adaptive way, AGFormer exhibits the ability to better learn the underlying 3D structure. By stacking multiple AGFormer blocks, we propose MotionAGFormer in four different variants, which can be chosen based on the speed-accuracy trade-off. We evaluate our model on two popular benchmark datasets: Human3.6M and MPI-INF-3DHP. MotionAGFormer-B achieves state-of-the-art results, with P1 errors of 38.4mm and 16.2mm, respectively. Remarkably, it uses a quarter of the parameters and is three times more computationally efficient than the previous leading model on Human3.6M dataset. Code and models are available at https://github.com/TaatiTeam/MotionAGFormer.


title: Semiclassical gravity beyond coherent states

abstract: We show that it is possible to still use semiclassical gravity together with quantum field theory beyond the regimes where the field state is coherent. In particular, we identify families of cat states (superposition of almost-distinguishable coherent states that have very non-classical features) for which the gravitational backreaction can be modeled by semiclassical gravity.


title: Fair Adaptive Experiments

abstract: Randomized experiments have been the gold standard for assessing the effectiveness of a treatment or policy. The classical complete randomization approach assigns treatments based on a prespecified probability and may lead to inefficient use of data. Adaptive experiments improve upon complete randomization by sequentially learning and updating treatment assignment probabilities. However, their application can also raise fairness and equity concerns, as assignment probabilities may vary drastically across groups of participants. Furthermore, when treatment is expected to be extremely beneficial to certain groups of participants, it is more appropriate to expose many of these participants to favorable treatment. In response to these challenges, we propose a fair adaptive experiment strategy that simultaneously enhances data use efficiency, achieves an envy-free treatment assignment guarantee, and improves the overall welfare of participants. An important feature of our proposed strategy is that we do not impose parametric modeling assumptions on the outcome variables, making it more versatile and applicable to a wider array of applications. Through our theoretical investigation, we characterize the convergence rate of the estimated treatment effects and the associated standard deviations at the group level and further prove that our adaptive treatment assignment algorithm, despite not having a closed-form expression, approaches the optimal allocation rule asymptotically. Our proof strategy takes into account the fact that the allocation decisions in our design depend on sequentially accumulated data, which poses a significant challenge in characterizing the properties and conducting statistical inference of our method. We further provide simulation evidence to showcase the performance of our fair adaptive experiment strategy.


title: Sommets fortement critiques d'un tournoi ind\'ecomposable

abstract: Let $T=(V,A)$ be a tournament. For $X\subseteq V$, the subtournament of $T$ induced by $X$ is denoted by $T[X]$. A subset $I$ of $V$ is an interval of $T$ provided that for every $a,b\in I$ and $x\in V\setminus I$, $(a,x)\in A$ if and only if $(b,x)\in A$. For example, $\varnothing $, ${x}$ ($x \in V$) and $V$ are intervals of $T$, called trivial intervals. The tournament $T$ is indecomposable if all its intervals are trivial, otherwise, it is decomposable. A critical tournament is an indecomposable tournament $T$ of cardinality $\geqslant 5$ such that every vertex $x$ of $T$ is critical, i.e., the subtournament $T[V(T)\setminus\{x\}]$ is decomposable. Given an indecomposable tournament $T$, a vertex $x$ of $T$ is strongly critical, if for every $X\subseteq V(T)$ such that $x\in X$, $\vert X\vert \geqslant 5$ and $T[X]$ is indecomposable, $x$ is a critical vertex of $T[X]$. Let $T$ be an indecomposable tournament and let $\mathscr{C}(T)$ be the set of the strongly critical vertices of $T$. We prove that, if $T$ is non-critical, then $f(T):=\vert \mathscr{C}(T)\vert \leqslant 4$, and that the correspondence $f(T)$ is decreasing from the class of indecomposable and non-critical tournaments (defined by means of embedding) to $\{0,1,2,3,4\}$. By giving examples, we also verify that the bounds 0 and 4 are optimal. This article is an extract from my master's thesis \cite{mon mast\`ere}.


title: Dyson-Schwinger equations towards cold-dense QCD matter with improved truncations

abstract: We take the Dyson-Schwinger equation (DSE) approach of QCD to study the phase transition and the equation of state of cold dense matter. Besides the bare vertex and Gauss gluon model, we take into account an improved truncation scheme, the CLRQ vertex and infrared-constant gluon model. For the dynamical chiral symmetry breaking solution of the DSE, we require that the emergence of quark number density to be at the chemical potential for the nuclear liquid-gas phase transition to take place, by incorporating a chemical potential dependent modification factor to the gluon model. The result shows that our modified scheme can not only describe the phase transition of the cold dense matter well but also the deduced equation of state of the matter can describe the recent astronomical observations consistently.


title: Crowd-Certain: Label Aggregation in Crowdsourced and Ensemble Learning Classification

abstract: Crowdsourcing systems have been used to accumulate massive amounts of labeled data for applications such as computer vision and natural language processing. However, because crowdsourced labeling is inherently dynamic and uncertain, developing a technique that can work in most situations is extremely challenging. In this paper, we introduce Crowd-Certain, a novel approach for label aggregation in crowdsourced and ensemble learning classification tasks that offers improved performance and computational efficiency for different numbers of annotators and a variety of datasets. The proposed method uses the consistency of the annotators versus a trained classifier to determine a reliability score for each annotator. Furthermore, Crowd-Certain leverages predicted probabilities, enabling the reuse of trained classifiers on future sample data, thereby eliminating the need for recurrent simulation processes inherent in existing methods. We extensively evaluated our approach against ten existing techniques across ten different datasets, each labeled by varying numbers of annotators. The findings demonstrate that Crowd-Certain outperforms the existing methods (Tao, Sheng, KOS, MACE, MajorityVote, MMSR, Wawa, Zero-Based Skill, GLAD, and Dawid Skene), in nearly all scenarios, delivering higher average accuracy, F1 scores, and AUC rates. Additionally, we introduce a variation of two existing confidence score measurement techniques. Finally we evaluate these two confidence score techniques using two evaluation metrics: Expected Calibration Error (ECE) and Brier Score Loss. Our results show that Crowd-Certain achieves higher Brier Score, and lower ECE across the majority of the examined datasets, suggesting better calibrated results.


title: Producer-Side Experiments Based on Counterfactual Interleaving Designs for Online Recommender Systems

abstract: Recommender systems have become an integral part of online platforms, providing personalized recommendations for purchases, content consumption, and interpersonal connections. These systems consist of two sides: the producer side comprises product sellers, content creators, or service providers, etc., and the consumer side includes buyers, viewers, or customers, etc. To optimize online recommender systems, A/B tests serve as the golden standard for comparing different ranking models and evaluating their impact on both the consumers and producers. While consumer-side experiments is relatively straightforward to design and commonly employed to assess the impact of ranking changes on the behavior of consumers (buyers, viewers, etc.), designing producer-side experiments for an online recommender/ranking system is notably more intricate because producer items in the treatment and control groups need to be ranked by different models and then merged into a unified ranking to be presented to each consumer. Current design solutions in the literature are ad hoc and lacking rigorous guiding principles. In this paper, we examine limitations of these existing methods and propose the principle of consistency and principle of monotonicity for designing producer-side experiments of online recommender systems. Building upon these principles, we also present a systematic solution based on counterfactual interleaving designs to accurately measure the impacts of ranking changes on the producers (sellers, creators, etc.).


title: Instance-wise Linearization of Neural Network for Model Interpretation

abstract: Neural network have achieved remarkable successes in many scientific fields. However, the interpretability of the neural network model is still a major bottlenecks to deploy such technique into our daily life. The challenge can dive into the non-linear behavior of the neural network, which rises a critical question that how a model use input feature to make a decision. The classical approach to address this challenge is feature attribution, which assigns an important score to each input feature and reveal its importance of current prediction. However, current feature attribution approaches often indicate the importance of each input feature without detail of how they are actually processed by a model internally. These attribution approaches often raise a concern that whether they highlight correct features for a model prediction. For a neural network model, the non-linear behavior is often caused by non-linear activation units of a model. However, the computation behavior of a prediction from a neural network model is locally linear, because one prediction has only one activation pattern. Base on the observation, we propose an instance-wise linearization approach to reformulates the forward computation process of a neural network prediction. This approach reformulates different layers of convolution neural networks into linear matrix multiplication. Aggregating all layers' computation, a prediction complex convolution neural network operations can be described as a linear matrix multiplication $F(x) = W \cdot x + b$. This equation can not only provides a feature attribution map that highlights the important of the input features but also tells how each input feature contributes to a prediction exactly. Furthermore, we discuss the application of this technique in both supervise classification and unsupervised neural network learning parametric t-SNE dimension reduction.


title: A Near Magnetic-to-kinetic Energy Equipartition Flare from the Relativistic Jet in AO 0235+164 during 2013-2019

abstract: We present the multiwavelength flaring activity of the blazar AO 0235+164 during its recent active period from 2013 to 2019. From a discrete correlation function (DCF) analysis, we find a significant (>95%) correlation between radio and $\gamma$-ray light curves with flares at longer wavelengths following flares at shorter wavelengths. We identify a new jet component in 43 GHz VLBA data that was ejected from the radio core on MJD $57246^{+26}_{-30}$ (2015 August 12), during the peak of the 2015 radio flare. From the analysis of the jet component, we derived a Doppler factor of $\delta_{\rm var}=28.5\pm8.4$, a bulk Lorentz factor of $\Gamma=16.8^{+3.6}_{-3.1}$, and an intrinsic viewing angle of $\theta_{\rm v}=1.42^{+1.07}_{-0.52}\textrm{ degrees}$. Investigation of the quasi-simultaneous radio data revealed a partially absorbed spectrum with the turnover frequency varying in the range of $10-70$ GHz and the peak flux density varying in the range of $0.7-4$ Jy. We find the synchrotron self-absorption magnetic field strength to be $B_{\rm SSA}=15.3^{+12.6}_{-14.0}$ mG at the peak of the 2015 radio flare, which is comparable to the equipartition magnetic field strength of $B_{\rm EQ}=43.6^{+10.6}_{-10.4}$ mG calculated for the same epoch. Additional analysis of the radio emission region in the relativistic jet of AO 0235+164 suggests that it did not significantly deviate from equipartition during its recent flaring activity.


title: Ghost Problem, Spectrum Identities and Various Constraints on Brane-localized Gravity

abstract: This paper investigates the brane-localized interactions, including DGP gravity and higher derivative (HD) gravity localized on the brane. We derive the effective action on the brane, which suggests the brane-localized HD gravity suffers the ghost problem generally. Besides, we obtain novel algebraic identities of the mass spectrum, which reveal the global nature and can characterize the phase transformation of the mass spectrum. We get a powerful ghost-free condition from the spectrum identities, which rules out one type of brane-localized HD gravity. We further prove the mass spectrum is real and non-negative $m^2\ge 0$ under the ghost-free condition. Furthermore, we discuss various constraints on parameters of brane-localized gravity in AdS/BCFT and wedge holography, respectively. They include the ghost-free condition of Kaluza-Klein and brane-bending modes, the positive definiteness of boundary central charges, and entanglement entropy. The ghost-free condition imposes strict constraint, which requires non-negative couplings for pure DGP gravity and Gauss-Bonnet gravity on the brane. It also rules out one class of brane-localized HD gravity. Thus, such HD gravity should be understood as a low-energy effective theory on the brane under the ghost energy scale. Finally, we briefly discuss the applications of our results.


title: Stencil Matrixization

abstract: Current architectures are now equipped with matrix computation units designed to enhance AI and high-performance computing applications. Within these architectures, two fundamental instruction types are matrix multiplication and vector outer product, with the latter being lighter due to its vector inputs. This characteristic not only allows for the development of flexible algorithms beyond dense linear algebra computations but also offers greater potential for implementation optimization. Stencil computations, commonly found in scientific and engineering applications, involve nested loops. This paper introduces a novel stencil algorithm leveraging vector outer products. Unlike previous approaches, this algorithm emerges from the stencil definition in scatter mode and is initially formulated using vector outer product expressions. The implementation integrates a series of optimizations to enhance memory reference patterns, execution pipeline efficiency, and data reuse. These optimizations consider various algorithmic options and data sharing among input vectors. Evaluation conducted on a simulator demonstrates that our proposed design achieves significant speedup compared to vectorized stencil algorithms.


title: FoundLoc: Vision-based Onboard Aerial Localization in the Wild

abstract: Robust and accurate localization for Unmanned Aerial Vehicles (UAVs) is an essential capability to achieve autonomous, long-range flights. Current methods either rely heavily on GNSS, face limitations in visual-based localization due to appearance variances and stylistic dissimilarities between camera and reference imagery, or operate under the assumption of a known initial pose. In this paper, we developed a GNSS-denied localization approach for UAVs that harnesses both Visual-Inertial Odometry (VIO) and Visual Place Recognition (VPR) using a foundation model. This paper presents a novel vision-based pipeline that works exclusively with a nadir-facing camera, an Inertial Measurement Unit (IMU), and pre-existing satellite imagery for robust, accurate localization in varied environments and conditions. Our system demonstrated average localization accuracy within a $20$-meter range, with a minimum error below $1$ meter, under real-world conditions marked by drastic changes in environmental appearance and with no assumption of the vehicle's initial pose. The method is proven to be effective and robust, addressing the crucial need for reliable UAV localization in GNSS-denied environments, while also being computationally efficient enough to be deployed on resource-constrained platforms.


title: Snapshot: Fast, Userspace Crash Consistency for CXL and PM Using msync

abstract: Crash consistency using persistent memory programming libraries requires programmers to use complex transactions and manual annotations. In contrast, the failure-atomic msync() (FAMS) interface is much simpler as it transparently tracks updates and guarantees that modified data is atomically durable on a call to the failure-atomic variant of msync(). However, FAMS suffers from several drawbacks, like the overhead of msync() and the write amplification from page-level dirty data tracking. To address these drawbacks while preserving the advantages of FAMS, we propose Snapshot, an efficient userspace implementation of FAMS. Snapshot uses compiler-based annotation to transparently track updates in userspace and syncs them with the backing byte-addressable storage copy on a call to msync(). By keeping a copy of application data in DRAM, Snapshot improves access latency. Moreover, with automatic tracking and syncing changes only on a call to msync(), Snapshot provides crash-consistency guarantees, unlike the POSIX msync() system call. For a KV-Store backed by Intel Optane running the YCSB benchmark, Snapshot achieves at least 1.2$\times$ speedup over PMDK while significantly outperforming conventional (non-crash-consistent) msync(). On an emulated CXL memory semantic SSD, Snapshot outperforms PMDK by up to 10.9$\times$ on all but one YCSB workload, where PMDK is 1.2$\times$ faster than Snapshot. Further, Kyoto Cabinet commits perform up to 8.0$\times$ faster with Snapshot than its built-in, msync()-based crash-consistency mechanism.


title: Is ChatGPT a Good Multi-Party Conversation Solver?

abstract: Large Language Models (LLMs) have emerged as influential instruments within the realm of natural language processing; nevertheless, their capacity to handle multi-party conversations (MPCs) -- a scenario marked by the presence of multiple interlocutors involved in intricate information exchanges -- remains uncharted. In this paper, we delve into the potential of generative LLMs such as ChatGPT and GPT-4 within the context of MPCs. An empirical analysis is conducted to assess the zero-shot learning capabilities of ChatGPT and GPT-4 by subjecting them to evaluation across three MPC datasets that encompass five representative tasks. The findings reveal that ChatGPT's performance on a number of evaluated MPC tasks leaves much to be desired, whilst GPT-4's results portend a promising future. Additionally, we endeavor to bolster performance through the incorporation of MPC structures, encompassing both speaker and addressee architecture. This study provides an exhaustive evaluation and analysis of applying generative LLMs to MPCs, casting a light upon the conception and creation of increasingly effective and robust MPC agents. Concurrently, this work underscores the challenges implicit in the utilization of LLMs for MPCs, such as deciphering graphical information flows and generating stylistically consistent responses.


title: Imperfect Digital Twin Assisted Low Cost Reinforcement Training for Multi-UAV Networks

abstract: Deep Reinforcement Learning (DRL) is widely used to optimize the performance of multi-UAV networks. However, the training of DRL relies on the frequent interactions between the UAVs and the environment, which consumes lots of energy due to the flying and communication of UAVs in practical experiments. Inspired by the growing digital twin (DT) technology, which can simulate the performance of algorithms in the digital space constructed by coping features of the physical space, the DT is introduced to reduce the costs of practical training, e.g., energy and hardware purchases. Different from previous DT-assisted works with an assumption of perfect reflecting real physics by virtual digital, we consider an imperfect DT model with deviations for assisting the training of multi-UAV networks. Remarkably, to trade off the training cost, DT construction cost, and the impact of deviations of DT on training, the natural and virtually generated UAV mixing deployment method is proposed. Two cascade neural networks (NN) are used to optimize the joint number of virtually generated UAVs, the DT construction cost, and the performance of multi-UAV networks. These two NNs are trained by unsupervised and reinforcement learning, both low-cost label-free training methods. Simulation results show the training cost can significantly decrease while guaranteeing the training performance. This implies that an efficient decision can be made with imperfect DTs in multi-UAV networks.


title: URL-BERT: Training Webpage Representations via Social Media Engagements

abstract: Understanding and representing webpages is crucial to online social networks where users may share and engage with URLs. Common language model (LM) encoders such as BERT can be used to understand and represent the textual content of webpages. However, these representations may not model thematic information of web domains and URLs or accurately capture their appeal to social media users. In this work, we introduce a new pre-training objective that can be used to adapt LMs to understand URLs and webpages. Our proposed framework consists of two steps: (1) scalable graph embeddings to learn shallow representations of URLs based on user engagement on social media and (2) a contrastive objective that aligns LM representations with the aforementioned graph-based representation. We apply our framework to the multilingual version of BERT to obtain the model URL-BERT. We experimentally demonstrate that our continued pre-training approach improves webpage understanding on a variety of tasks and Twitter internal and external benchmarks.


title: Deep Learning Approach to Photometric Redshift Estimation

abstract: Photometric redshift estimation plays a pivotal role in modern astronomy, enabling the determination of celestial object distances by analyzing their magnitudes across various wavelength filters. This study leveraged a dataset of 50,000 objects sourced from the Sloan Digital Sky Survey (SDSS), encompassing magnitudes in five distinct bands alongside their corresponding redshift labels. Traditionally, redshift prediction relied on the use of spectral distribution templates (SED), which, while effective, pose challenges due to their cost and limited availability, particularly when dealing with extensive datasets. This paper explores innovative data-driven methodologies as an alternative to template-based predictions. By employing both a decision tree regression model and a Fully Connected Neural Network (FCN) for analysis, the study reveals a notable discrepancy in performance. The FCN outperforms the decision tree regressor significantly, demonstrating a notable improvement in root mean square error (RMSE) compared to the decision tree. This improvement highlights the FCN's ability to effectively capture complex relationships within space data. The potential of data-driven redshift estimation is underscored, positioning it as a valuable tool for advancing astronomical surveys and enhancing our comprehension of the universe. With the adaptability to either replace or complement template-based methods, FCNs are poised to reshape the field of photometric redshift estimation, opening up new possibilities for precision and discovery in astronomy.


title: Dolfin: Diffusion Layout Transformers without Autoencoder

abstract: In this paper, we introduce a novel generative model, Diffusion Layout Transformers without Autoencoder (Dolfin), which significantly improves the modeling capability with reduced complexity compared to existing methods. Dolfin employs a Transformer-based diffusion process to model layout generation. In addition to an efficient bi-directional (non-causal joint) sequence representation, we further propose an autoregressive diffusion model (Dolfin-AR) that is especially adept at capturing rich semantic correlations for the neighboring objects, such as alignment, size, and overlap. When evaluated against standard generative layout benchmarks, Dolfin notably improves performance across various metrics (fid, alignment, overlap, MaxIoU and DocSim scores), enhancing transparency and interoperability in the process. Moreover, Dolfin's applications extend beyond layout generation, making it suitable for modeling geometric structures, such as line segments. Our experiments present both qualitative and quantitative results to demonstrate the advantages of Dolfin.


title: Generation of $\gamma$ photons with extremely large orbital angular momenta

abstract: Vortex $\gamma$ photons, which carry large intrinsic orbital angular momenta (OAM), have significant applications in nuclear, atomic, hadron, particle and astro-physics, but their production remains unclear. In this work, we investigate the generation of such photons from nonlinear Compton scattering of circularly polarized monochromatic lasers on vortex electrons. We develop a quantum radiation theory for ultrarelativistic vortex electrons in lasers by using the harmonics expansion and spin eigenfunctions, which allows us to explore the kinematical characteristics, angular momentum transfer mechanisms, and formation conditions of vortex $\gamma$ photons. The multiphoton absorption of electrons enables the vortex $\gamma$ photons, with fixed polarizations and energies, to exist in mixed states comprised of multiple harmonics. Each harmonic represents a vortex eigenmode and has transverse momentum broadening due to transverse momenta of the vortex electrons. The large topological charges associated with vortex electrons offer the possibility for $\gamma$ photons to carry adjustable OAM quantum numbers from tens to thousands of units, even at moderate laser intensities. $\gamma$ photons with large OAM and transverse coherence length can assist in influencing quantum selection rules and extracting phase of the scattering amplitude in scattering processes.


title: The physical origin of the periodic activity for FRB 20180916B

abstract: Fast radio bursts (FRBs) are transient radio signals with millisecond-duration, large dispersion measure (DM) and extremely high brightness temperature. Among them, FRB 20180916B has been found to have a 16-day periodically modulated activity. However, the physical origin of the periodicity is still a mystery. Here, we utilize the comprehensive observational data to diagnose the periodic models. We find that the ultra-long rotation model is the most probable one for the periodic activity. However, this model cannot reproduce the observed rotation measure (RM) variations. We propose a self-consistent model, i.e., a massive star binary containing a slowly rotational neutron star and a massive star with large mass loss, which can naturally accommodate the wealth of observational features for FRB 20180916B. In this model, the RM variation is periodic, which can be tested by future observations.


title: Diffusion model approach to simulating electron-proton scattering events

abstract: Generative AI is a fast-growing area of research offering various avenues for exploration in high-energy nuclear physics. In this work, we explore the use of generative models for simulating electron-proton collisions relevant to experiments like CEBAF and the future Electron-Ion Collider (EIC). These experiments play a critical role in advancing our understanding of nucleons and nuclei in terms of quark and gluon degrees of freedom. The use of generative models for simulating collider events faces several challenges such as the sparsity of the data, the presence of global or event-wide constraints, and steeply falling particle distributions. In this work, we focus on the implementation of diffusion models for the simulation of electron-proton scattering events at EIC energies. Our results demonstrate that diffusion models can accurately reproduce relevant observables such as momentum distributions and correlations of particles, momentum sum rules, and the leading electron kinematics, all of which are of particular interest in electron-proton collisions. Although the sampling process is relatively slow compared to other machine learning architectures, we find diffusion models can generate high-quality samples. We foresee various applications of our work including inference for nuclear structure, interpretable generative machine learning, and searches of physics beyond the Standard Model.


title: Constant Curvature 3-branes in 5-D f(R) Bulk

abstract: Braneworld models remain the most promising candidates to address several important questions in low-energy particle phenomenology and cosmology. The role of the moduli field(s) and its stabilization is an integral part of this question. In this work, we show that a 5-dimensional warped braneworld model with higher curvature gravity in bulk admits de-Sitter and anti de-Sitter solutions on the branes. The remarkable feature of having a positive vacuum energy on the visible brane is the presence of a metastable minimum and a global minimum for the modulus potential. While the metastable minimum leads to a consistent cosmological model of a bouncing universe, the concomitant existence of the global minimum provides a vacuum for the modulus to roll down to stability. Further, this model is shown to be consistent with the swampland conjecture to qualify as a viable candidate in the low energy description of string landscape


title: Score Matching-based Pseudolikelihood Estimation of Neural Marked Spatio-Temporal Point Process with Uncertainty Quantification

abstract: Spatio-temporal point processes (STPPs) are potent mathematical tools for modeling and predicting events with both temporal and spatial features. Despite their versatility, most existing methods for learning STPPs either assume a restricted form of the spatio-temporal distribution, or suffer from inaccurate approximations of the intractable integral in the likelihood training objective. These issues typically arise from the normalization term of the probability density function. Moreover, current techniques fail to provide uncertainty quantification for model predictions, such as confidence intervals for the predicted event's arrival time and confidence regions for the event's location, which is crucial given the considerable randomness of the data. To tackle these challenges, we introduce SMASH: a Score MAtching-based pSeudolikeliHood estimator for learning marked STPPs with uncertainty quantification. Specifically, our framework adopts a normalization-free objective by estimating the pseudolikelihood of marked STPPs through score-matching and offers uncertainty quantification for the predicted event time, location and mark by computing confidence regions over the generated samples. The superior performance of our proposed framework is demonstrated through extensive experiments in both event prediction and uncertainty quantification.


title: Magnetic-field-induced electronic instability of Weyl-like fermions in compressed black phosphorus

abstract: Revealing the role of Coulomb interaction in topological semimetals with Dirac/Weyl-like band dispersion shapes a new frontier in condensed matter physics. Topological node-line semimetals (TNLSMs), anticipated as a fertile ground for exploring electronic correlation effects due to the anisotropy associated with their node-line structure, have recently attracted considerable attention. In this study, we report an experimental observation for correlation effects in TNLSMs realized by black phosphorus (BP) under hydrostatic pressure. By performing a combination of nuclear magnetic resonance measurements and band calculations on compressed BP, a magnetic-field-induced electronic instability of Weyl-like fermions is identified under an external magnetic field parallel to the so-called nodal ring in the reciprocal space. Anomalous spin fluctuations serving as the fingerprint of electronic instability are observed at low temperatures, and they are observed to maximize at approximately 1.0 GPa. This study presents compressed BP as a realistic material platform for exploring the rich physics in strongly coupled Weyl-like fermions.


title: Measurement of small photon numbers in circuit QED resonators

abstract: Off-resonant interaction of fluctuating photons in a resonator with a qubit increases the qubit dephasing rate. We use this effect to measure a small average number of intracavity photons that are coherently or thermally driven. For spectral resolution, we do this by subjecting the qubit to a Carr-Purcell-Meiboom-Gill (CPMG) sequence and record the qubit dephasing rate for various periods between qubit $\pi$-pulses. The recorded data is then analyzed with formulas for the photon-induced dephasing rate that we have derived for the non-Gaussian noise regime with an arbitrary ratio $2\chi/\kappa$, where $2\chi$ is the qubit frequency shift due to a single photon and $\kappa$ is the resonator decay rate. We show that the presented CPMG dephasing rate formulas agree well with experimental results and demonstrate measurement of thermal and coherent photon populations at the level of a few $10^{-4}$.


title: Discovery of a proto-white dwarf with a massive unseen companion

abstract: We report the discovery of SDSS~J022932.28+713002.7, a nascent extremely low-mass (ELM) white dwarf (WD) orbiting a massive ($> 1\,M_\odot$ at 2$\sigma$ confidence) companion with a period of 36 hours. We use a combination of spectroscopy, including data from the ongoing SDSS-V survey, and photometry to measure the stellar parameters for the primary pre-ELM white dwarf. The lightcurve of the primary WD exhibits ellipsoidal variation, which we combine with radial velocity data and $\tt{PHOEBE}$ binary simulations to estimate the mass of the invisible companion. We find that the primary WD has mass $M_1$ = $0.18^{+0.02}_{-0.02}$ M$_\odot$ and the unseen secondary has mass $M_2$ = $1.19^{+0.21}_{-0.14}$ M$_\odot$. The mass of the companion suggests that it is most likely a near-Chandrasekhar mass white dwarf or a neutron star. It is likely that the system recently went through a Roche lobe overflow from the visible primary onto the invisible secondary. The dynamical configuration of the binary is consistent with the theoretical evolutionary tracks for such objects, and the primary is currently in its contraction phase. The measured orbital period puts this system on a stable evolutionary path which, within a few Gyrs, will lead to a contracted ELM white dwarf orbiting a massive compact companion.


title: Understanding Code Semantics: An Evaluation of Transformer Models in Summarization

abstract: This paper delves into the intricacies of code summarization using advanced transformer-based language models. Through empirical studies, we evaluate the efficacy of code summarization by altering function and variable names to explore whether models truly understand code semantics or merely rely on textual cues. We have also introduced adversaries like dead code and commented code across three programming languages (Python, Javascript, and Java) to further scrutinize the model's understanding. Ultimately, our research aims to offer valuable insights into the inner workings of transformer-based LMs, enhancing their ability to understand code and contributing to more efficient software development practices and maintenance workflows.


title: Probing Silicon Carbide with Phase-Modulated Femtosecond Laser Pulses: Insights into Multiphoton Photocurrent

abstract: Wide bandgap semiconductors are widely used in photonic technologies due to their advantageous features, such as large optical bandgap, low losses, and fast operational speeds. Silicon carbide is a prototypical wide bandgap semiconductor with high optical nonlinearities, large electron transport, and a high breakdown threshold. Integration of silicon carbide in nonlinear photonics requires a systematic analysis of the multiphoton contribution to the device functionality. Here, multiphoton photocurrent in a silicon carbide photodetector is investigated using phase-modulated femtosecond pulses. Multiphoton absorption is quantified using a 1030 nm phase-modulated pulsed laser. Our measurements show that although the bandgap is less than the energy of three photons, only four-photon absorption has a significant contribution to the photocurrent. We interpret the four-photon absorption as a direct transition from the valance to the conduction band at the {\Gamma} point. More importantly, silicon carbide withstands higher excitation intensities compared to other wide bandgap semiconductors making it an ideal system for high-power nonlinear applications.


title: Sum-of-Parts Models: Faithful Attributions for Groups of Features

abstract: An explanation of a machine learning model is considered "faithful" if it accurately reflects the model's decision-making process. However, explanations such as feature attributions for deep learning are not guaranteed to be faithful, and can produce potentially misleading interpretations. In this work, we develop Sum-of-Parts (SOP), a class of models whose predictions come with grouped feature attributions that are faithful-by-construction. This model decomposes a prediction into an interpretable sum of scores, each of which is directly attributable to a sparse group of features. We evaluate SOP on benchmarks with standard interpretability metrics, and in a case study, we use the faithful explanations from SOP to help astrophysicists discover new knowledge about galaxy formation.


title: Rotatum of Light

abstract: Vortices are ubiquitous in nature and can be observed in fluids, condensed matter, and even in the formation of galaxies. Light, too, can evolve like a vortex. Optical vortices are exploited in light-matter interaction, free-space communications, and imaging. Here, we introduce optical rotatum; a new degree-of-freedom of light in which an optical vortex experiences a quadratic chirp in its orbital angular momentum along the optical path. We show that such an adiabatic deformation of topology is associated with the accumulation of a Berry phase factor which in turn perturbs the propagation constant (spatial frequency) of the beam. Remarkably, the spatial structure of optical rotatum follows a logarithmic spiral; a signature that is commonly seen in the pattern formation of seashells and galaxies. Our work expands previous literature on structured light, offers new modalities for light-matter interaction, communications, and sensing, and hints to analogous effects in condensed matter physics and Bose-Einstein condensates.


title: Modality-Agnostic Self-Supervised Learning with Meta-Learned Masked Auto-Encoder

abstract: Despite its practical importance across a wide range of modalities, recent advances in self-supervised learning (SSL) have been primarily focused on a few well-curated domains, e.g., vision and language, often relying on their domain-specific knowledge. For example, Masked Auto-Encoder (MAE) has become one of the popular architectures in these domains, but less has explored its potential in other modalities. In this paper, we develop MAE as a unified, modality-agnostic SSL framework. In turn, we argue meta-learning as a key to interpreting MAE as a modality-agnostic learner, and propose enhancements to MAE from the motivation to jointly improve its SSL across diverse modalities, coined MetaMAE as a result. Our key idea is to view the mask reconstruction of MAE as a meta-learning task: masked tokens are predicted by adapting the Transformer meta-learner through the amortization of unmasked tokens. Based on this novel interpretation, we propose to integrate two advanced meta-learning techniques. First, we adapt the amortized latent of the Transformer encoder using gradient-based meta-learning to enhance the reconstruction. Then, we maximize the alignment between amortized and adapted latents through task contrastive learning which guides the Transformer encoder to better encode the task-specific knowledge. Our experiment demonstrates the superiority of MetaMAE in the modality-agnostic SSL benchmark (called DABS), significantly outperforming prior baselines. Code is available at https://github.com/alinlab/MetaMAE.


title: DiQAD: A Benchmark Dataset for End-to-End Open-domain Dialogue Assessment

abstract: Dialogue assessment plays a critical role in the development of open-domain dialogue systems. Existing work are uncapable of providing an end-to-end and human-epistemic assessment dataset, while they only provide sub-metrics like coherence or the dialogues are conversed between annotators far from real user settings. In this paper, we release a large-scale dialogue quality assessment dataset (DiQAD), for automatically assessing open-domain dialogue quality. Specifically, we (1) establish the assessment criteria based on the dimensions conforming to human judgements on dialogue qualities, and (2) annotate large-scale dialogues that conversed between real users based on these annotation criteria, which contains around 100,000 dialogues. We conduct several experiments and report the performances of the baselines as the benchmark on DiQAD. The dataset is openly accessible at https://github.com/yukunZhao/Dataset_Dialogue_quality_evaluation.


title: Enhancing Low-Precision Sampling via Stochastic Gradient Hamiltonian Monte Carlo

abstract: Low-precision training has emerged as a promising low-cost technique to enhance the training efficiency of deep neural networks without sacrificing much accuracy. Its Bayesian counterpart can further provide uncertainty quantification and improved generalization accuracy. This paper investigates low-precision sampling via Stochastic Gradient Hamiltonian Monte Carlo (SGHMC) with low-precision and full-precision gradient accumulators for both strongly log-concave and non-log-concave distributions. Theoretically, our results show that, to achieve $\epsilon$-error in the 2-Wasserstein distance for non-log-concave distributions, low-precision SGHMC achieves quadratic improvement ($\widetilde{\mathbf{O}}\left({\epsilon^{-2}{\mu^*}^{-2}\log^2\left({\epsilon^{-1}}\right)}\right)$) compared to the state-of-the-art low-precision sampler, Stochastic Gradient Langevin Dynamics (SGLD) ($\widetilde{\mathbf{O}}\left({{\epsilon}^{-4}{\lambda^{*}}^{-1}\log^5\left({\epsilon^{-1}}\right)}\right)$). Moreover, we prove that low-precision SGHMC is more robust to the quantization error compared to low-precision SGLD due to the robustness of the momentum-based update w.r.t. gradient noise. Empirically, we conduct experiments on synthetic data, and {MNIST, CIFAR-10 \& CIFAR-100} datasets, which validate our theoretical findings. Our study highlights the potential of low-precision SGHMC as an efficient and accurate sampling method for large-scale and resource-limited machine learning.


title: Neuromorphic cameras for Atmospheric Cherenkov Telescopes and fast optical astronomy: new paradigm, challenges and opportunities

abstract: The astronomy community has witnessed an explosive growth in the use of deep-learning techniques based on neural networks since the mid-2010s. The widespread adoption of these nature-inspired technologies has helped astronomers tackle previously insurmountable problems and provided an unprecedented opportunity for new discoveries. However, one of the primary tools of today's optical astronomy is neither natural nor efficient: their photo-sensing devices. Specifically, the modern CCD camera - like that of the cutting-edge Rubin Observatory - requires an internal clock to regularly expose the sensor to light, consumes a large amount of energy and information bandwidth, and has a limited dynamic range. On the contrary, biological eyes lack an internal clock and a shutter, have much higher pixel density but consume significantly less energy and bandwidth, and can adapt to bright and low light conditions. Inspired by the nature of the eyes, M. Mahowald and C. Mead introduced the revolutionary concept of a silicon retina sensor in 1991. Also known as event-based cameras (EBCs), these types of devices operate in a vastly different way compared to conventional CCD-based imaging sensors. EBCs mimic the operating principles of optic nerves and continuously produce a stream of events, with each event generated only when a pixel detects a change in light intensity. EBCs do not have fixed exposure times, have high dynamic range, require low power for operation, and can capture high-speed phenomena. These properties are important requirements for Cherenkov telescopes as well as other high-speed optical astronomy. This work presents the opportunities and challenges of using EBCs in those cases, and proposes a low-cost approach to experimentally assess the feasibility of this innovative technique.


title: Samsung R&D Institute Philippines at WMT 2023

abstract: In this paper, we describe the constrained MT systems submitted by Samsung R&D Institute Philippines to the WMT 2023 General Translation Task for two directions: en$\rightarrow$he and he$\rightarrow$en. Our systems comprise of Transformer-based sequence-to-sequence models that are trained with a mix of best practices: comprehensive data preprocessing pipelines, synthetic backtranslated data, and the use of noisy channel reranking during online decoding. Our models perform comparably to, and sometimes outperform, strong baseline unconstrained systems such as mBART50 M2M and NLLB 200 MoE despite having significantly fewer parameters on two public benchmarks: FLORES-200 and NTREX-128.


title: Personalized Federated X -armed Bandit

abstract: In this work, we study the personalized federated $\mathcal{X}$-armed bandit problem, where the heterogeneous local objectives of the clients are optimized simultaneously in the federated learning paradigm. We propose the \texttt{PF-PNE} algorithm with a unique double elimination strategy, which safely eliminates the non-optimal regions while encouraging federated collaboration through biased but effective evaluations of the local objectives. The proposed \texttt{PF-PNE} algorithm is able to optimize local objectives with arbitrary levels of heterogeneity, and its limited communications protects the confidentiality of the client-wise reward data. Our theoretical analysis shows the benefit of the proposed algorithm over single-client algorithms. Experimentally, \texttt{PF-PNE} outperforms multiple baselines on both synthetic and real life datasets.


title: Extracting Design Knowledge from Optimization Data: Enhancing Engineering Design in Fluid Based Thermal Management Systems

abstract: As mechanical systems become more complex and technological advances accelerate, the traditional reliance on heritage designs for engineering endeavors is being diminished in its effectiveness. Considering the dynamic nature of the design industry where new challenges are continually emerging, alternative sources of knowledge need to be sought to guide future design efforts. One promising avenue lies in the analysis of design optimization data, which has the potential to offer valuable insights and overcome the limitations of heritage designs. This paper presents a step toward extracting knowledge from optimization data in multi-split fluid-based thermal management systems using different classification machine learning methods, so that designers can use it to guide decisions in future design efforts. This approach offers several advantages over traditional design heritage methods, including applicability in cases where there is no design heritage and the ability to derive optimal designs. We showcase our framework through four case studies with varying levels of complexity. These studies demonstrate its effectiveness in enhancing the design of complex thermal management systems. Our results show that the knowledge extracted from the configuration design optimization data provides a good basis for more general design of complex thermal management systems. It is shown that the objective value of the estimated optimal configuration closely approximates the true optimal configuration with less than 1 percent error, achieved using basic features based on the system heat loads without involving the corresponding optimal open loop control (OLOC) features. This eliminates the need to solve the OLOC problem, leading to reduced computation costs.


title: Electron EDM and LFV decays in the light of Muon $(g-2)_\mu$ with U(2) flavor symmetry

abstract: We study the interplay of New Physics (NP) among the lepton magnetic moment, the lepton flavor violation (LFV) and the electron electric dipole moment (EDM) in light of recent data of the muon $(g-2)_\mu$. The NP is discussed in the leptonic dipole operator with the $U(2)$ flavor symmetry of the charged leptons, where possible CP violating phases of the three family space are taken into account. It is remarked that the third-family contributes significantly to the LFV decay, $\mu \to e\gamma$, and the electron EDM. The experimental upper-bound on $\mu \to e\gamma$ decay gives a severe constraint on the parameters of the flavor model. The predicted electron EDM is rather large due to the CP violating phases in the three family space. In addition, we also study $(g-2)_{e,\tau}$ of the electron and tauon, and EDMs of the muon and tauon as well as the $\tau \to e \gamma$ and $\tau \to \mu \gamma$ decays. The $\tau_R \to \mu_L \gamma$ decay is predicted to be close to the experimental upper-bound.


title: Reinforcement Learning for SBM Graphon Games with Re-Sampling

abstract: The Mean-Field approximation is a tractable approach for studying large population dynamics. However, its assumption on homogeneity and universal connections among all agents limits its applicability in many real-world scenarios. Multi-Population Mean-Field Game (MP-MFG) models have been introduced in the literature to address these limitations. When the underlying Stochastic Block Model is known, we show that a Policy Mirror Ascent algorithm finds the MP-MFG Nash Equilibrium. In more realistic scenarios where the block model is unknown, we propose a re-sampling scheme from a graphon integrated with the finite N-player MP-MFG model. We develop a novel learning framework based on a Graphon Game with Re-Sampling (GGR-S) model, which captures the complex network structures of agents' connections. We analyze GGR-S dynamics and establish the convergence to dynamics of MP-MFG. Leveraging this result, we propose an efficient sample-based N-player Reinforcement Learning algorithm for GGR-S without population manipulation, and provide a rigorous convergence analysis with finite sample guarantee.


title: Covariance Blocking and Whitening Method for Successive Relative Transfer Function Vector Estimation in Multi-Speaker Scenarios

abstract: This paper addresses the challenge of estimating the relative transfer function (RTF) vectors of multiple speakers in a noisy and reverberant environment. More specifically, we consider a scenario where two speakers activate successively. In this scenario, the RTF vector of the first speaker can be estimated in a straightforward way and the main challenge lies in estimating the RTF vector of the second speaker during segments where both speakers are simultaneously active. To estimate the RTF vector of the second speaker the so-called blind oblique projection (BOP) method determines the oblique projection operator that optimally blocks the second speaker. Instead of blocking the second speaker, in this paper we propose a covariance blocking and whitening (CBW) method, which first blocks the first speaker and applies whitening using the estimated noise covariance matrix and then estimates the RTF vector of the second speaker based on a singular value decomposition. When using the estimated RTF vectors of both speakers in a linearly constrained minimum variance beamformer, simulation results using real-world recordings for multiple speaker positions demonstrate that the proposed CBW method outperforms the conventional BOP and covariance whitening methods in terms of signal-to-interferer-and-noise ratio improvement.


title: The effects of Thomson scattering and chemical mixing on early-time light curves of double peaked type IIb supernovae

abstract: Previous numerical simulations of double-peaked SNe IIb light curves have demonstrated that the radius and mass of the hydrogen-rich envelope of the progenitor star can significantly influence the brightness and timescale of the early-time light curve around the first peak. In this study, we investigate how Thomson scattering and chemical mixing in the SN ejecta affect the optical light curves during the early stages of the SNe IIb using radiation hydrodynamics simulations. By comparing the results from two different numerical codes (i.e., \stella{} and \snec{}), we find that the optical brightness of the first peak can be reduced by more than a factor of 3 due to the effect of Thomson scattering that causes the thermalization depth to be located below the Rosseland-mean photosphere, compared to the corresponding case where this effect is ignored. We also observe a short-lived plateau-like feature lasting for a few days in the early-time optical light curves of our models, in contrast to typical observed SNe IIb that show a quasi-linear decrease in optical magnitudes after the first peak. A significant degree of chemical mixing between the hydrogen-rich envelope and the helium core in SN ejecta is required to reconcile this discrepancy between the model prediction and observation. Meanwhile, to properly reproduce the first peak, a significant mixing of \nifs{} into the hydrogen-rich outermost layers should be restricted. Our findings indicate that inferring the SN IIb progenitor structure from a simplified approach that ignores these two factors may introduce substantial uncertainty.