title: CASSOCK: Viable Backdoor Attacks against DNN in The Wall of Source-Specific Backdoor Defences

abstract: As a critical threat to deep neural networks (DNNs), backdoor attacks can be categorized into two types, i.e., source-agnostic backdoor attacks (SABAs) and source-specific backdoor attacks (SSBAs). Compared to traditional SABAs, SSBAs are more advanced in that they have superior stealthier in bypassing mainstream countermeasures that are effective against SABAs. Nonetheless, existing SSBAs suffer from two major limitations. First, they can hardly achieve a good trade-off between ASR (attack success rate) and FPR (false positive rate). Besides, they can be effectively detected by the state-of-the-art (SOTA) countermeasures (e.g., SCAn). To address the limitations above, we propose a new class of viable source-specific backdoor attacks, coined as CASSOCK. Our key insight is that trigger designs when creating poisoned data and cover data in SSBAs play a crucial role in demonstrating a viable source-specific attack, which has not been considered by existing SSBAs. With this insight, we focus on trigger transparency and content when crafting triggers for poisoned dataset where a sample has an attacker-targeted label and cover dataset where a sample has a ground-truth label. Specifically, we implement $CASSOCK_{Trans}$ and $CASSOCK_{Cont}$. While both they are orthogonal, they are complementary to each other, generating a more powerful attack, called $CASSOCK_{Comp}$, with further improved attack performance and stealthiness. We perform a comprehensive evaluation of the three $CASSOCK$-based attacks on four popular datasets and three SOTA defenses. Compared with a representative SSBA as a baseline ($SSBA_{Base}$), $CASSOCK$-based attacks have significantly advanced the attack performance, i.e., higher ASR and lower FPR with comparable CDA (clean data accuracy). Besides, $CASSOCK$-based attacks have effectively bypassed the SOTA defenses, and $SSBA_{Base}$ cannot.


title: Structural Algebraic Quantum Field Theory

abstract: Conventional quantum field theory is a method for studying structureless elementary particles. Non-elementary particles, on the other hand, are those with internal structure or particles that are made up of elementary constituents like the hadrons, which contain quarks and gluons. We introduce a structure-inclusive algebraic formulation of quantum field theory that could handle such particles and in which orthogonal polynomials play a central role. For simplicity, we consider non-elementary scalar particles in 3+1 Minkowski space-time and, in three appendices, we treat spinors with structure, massless vector fields, and the massive vector bosons. We show how to do scattering calculation in a nonlinear scalar-spinor coupling model where we find that loop integrals in the Feynman diagrams are remarkably finite. The aim of this short expos\'e is to motivate further studies and research using this approach.


title: Unbiased Implicit Feedback via Bi-level Optimization

abstract: Implicit feedback is widely leveraged in recommender systems since it is easy to collect and provides weak supervision signals. Recent works reveal a huge gap between the implicit feedback and user-item relevance due to the fact that implicit feedback is also closely related to the item exposure. To bridge this gap, existing approaches explicitly model the exposure and propose unbiased estimators to improve the relevance. Unfortunately, these unbiased estimators suffer from the high gradient variance, especially for long-tail items, leading to inaccurate gradient updates and degraded model performance. To tackle this challenge, we propose a low-variance unbiased estimator from a probabilistic perspective, which effectively bounds the variance of the gradient. Unlike previous works which either estimate the exposure via heuristic-based strategies or use a large biased training set, we propose to estimate the exposure via an unbiased small-scale validation set. Specifically, we first parameterize the user-item exposure by incorporating both user and item information, and then construct an unbiased validation set from the biased training set. By leveraging the unbiased validation set, we adopt bi-level optimization to automatically update exposure-related parameters along with recommendation model parameters during the learning. Experiments on two real-world datasets and two semi-synthetic datasets verify the effectiveness of our method.


title: Hands-Up: Leveraging Synthetic Data for Hands-On-Wheel Detection

abstract: Over the past few years there has been major progress in the field of synthetic data generation using simulation based techniques. These methods use high-end graphics engines and physics-based ray-tracing rendering in order to represent the world in 3D and create highly realistic images. Datagen has specialized in the generation of high-quality 3D humans, realistic 3D environments and generation of realistic human motion. This technology has been developed into a data generation platform which we used for these experiments. This work demonstrates the use of synthetic photo-realistic in-cabin data to train a Driver Monitoring System that uses a lightweight neural network to detect whether the driver's hands are on the wheel. We demonstrate that when only a small amount of real data is available, synthetic data can be a simple way to boost performance. Moreover, we adopt the data-centric approach and show how performing error analysis and generating the missing edge-cases in our platform boosts performance. This showcases the ability of human-centric synthetic data to generalize well to the real world, and help train algorithms in computer vision settings where data from the target domain is scarce or hard to collect.


title: A Kernelised Stein Statistic for Assessing Implicit Generative Models

abstract: Synthetic data generation has become a key ingredient for training machine learning procedures, addressing tasks such as data augmentation, analysing privacy-sensitive data, or visualising representative samples. Assessing the quality of such synthetic data generators hence has to be addressed. As (deep) generative models for synthetic data often do not admit explicit probability distributions, classical statistical procedures for assessing model goodness-of-fit may not be applicable. In this paper, we propose a principled procedure to assess the quality of a synthetic data generator. The procedure is a kernelised Stein discrepancy (KSD)-type test which is based on a non-parametric Stein operator for the synthetic data generator of interest. This operator is estimated from samples which are obtained from the synthetic data generator and hence can be applied even when the model is only implicit. In contrast to classical testing, the sample size from the synthetic data generator can be as large as desired, while the size of the observed data, which the generator aims to emulate is fixed. Experimental results on synthetic distributions and trained generative models on synthetic and real datasets illustrate that the method shows improved power performance compared to existing approaches.


title: Material Effects on Electron Capture Decays in Cryogenic Sensors

abstract: Several current searches for physics beyond the standard model are based on measuring the electron capture (EC) decay of radionuclides implanted into cryogenic high-resolution sensors. The sensitivity of these experiments has already reached the level where systematic effects related to atomic-state energy changes from the host material are a limiting factor. One example is a neutrino mass study based on the nuclear EC decay of $^7$Be to $^7$Li inside cryogenic Ta-based sensors. To understand the material effects at the required level we have used density functional theory and modeled the electronic structure of lithium atoms in different atomic environments of the polycrystalline Ta absorber film. The calculations reveal that the Li 1s binding energies can vary by more than 2 eV due to insertion at different lattice sites, at grain boundaries, in disordered Ta, and in the vicinity of various impurities. However, the total range of Li 1s shifts does not exceed 4 eV, even for extreme amorphous disorder. Further, when investigating the effects on the Li 2s levels, we find broadening of more than 5 eV due to hybridization with the Ta band structure. Materials effects are shown to contribute significantly to peak broadening in Ta-based sensors that are used to search for physics beyond the standard model in the EC decay of $^7$Be, but they do not explain the full extent of observed broadening. Understanding these in-medium effects will be required for current- and future-generation experiments that observe low-energy radiation from the EC decay of implanted isotopes to evaluate potential limitations on the measurement sensitivity.


title: DotMat: Solving Cold-start Problem and Alleviating Sparsity Problem for Recommender Systems

abstract: Cold-start and sparsity problem are two key intrinsic problems to recommender systems. During the past two decades, researchers and industrial practitioners have spent considerable amount of efforts trying to solve the problems. However, for cold-start problem, most research relies on importing side information to transfer knowledge. A notable exception is ZeroMat, which uses no extra input data. Sparsity is a lesser noticed problem. In this paper, we propose a new algorithm named DotMat that relies on no extra input data, but is capable of solving cold-start and sparsity problems. In experiments, we prove that like ZeroMat, DotMat can achieve competitive results with recommender systems with full data, such as the classic matrix factorization algorithm.


title: Human-AI Shared Control via Policy Dissection

abstract: Human-AI shared control allows human to interact and collaborate with AI to accomplish control tasks in complex environments. Previous Reinforcement Learning (RL) methods attempt the goal-conditioned design to achieve human-controllable policies at the cost of redesigning the reward function and training paradigm. Inspired by the neuroscience approach to investigate the motor cortex in primates, we develop a simple yet effective frequency-based approach called \textit{Policy Dissection} to align the intermediate representation of the learned neural controller with the kinematic attributes of the agent behavior. Without modifying the neural controller or retraining the model, the proposed approach can convert a given RL-trained policy into a human-interactive policy. We evaluate the proposed approach on the RL tasks of autonomous driving and locomotion. The experiments show that human-AI shared control achieved by Policy Dissection in driving task can substantially improve the performance and safety in unseen traffic scenes. With human in the loop, the locomotion robots also exhibit versatile controllable motion skills even though they are only trained to move forward. Our results suggest the promising direction of implementing human-AI shared autonomy through interpreting the learned representation of the autonomous agents. Demo video and code will be made available at https://metadriverse.github.io/policydissect.


title: Modelling planar kirigami metamaterials as generalized elastic continua

abstract: Kirigami metamaterials dramatically change their shape through a coordinated motion of nearly rigid panels and flexible slits. Here, we study a model system for mechanism-based planar kirigami featuring periodic patterns of quadrilateral panels and rhombi slits, with the goal of predicting their engineering scale response to a broad range of loads. We develop a generalized continuum model based on the kirigami's effective (cell-averaged) nonlinear deformation, along with its slit actuation and gradients thereof. The model accounts for three sources of elasticity: a strong preference for the effective fields to match those of a local mechanism, inter-panel stresses arising from gradients in slit actuation, and distributed hinge bending. We provide a finite-element formulation of this model and implement it using the commercial software Abaqus. Simulations of the model agree quantitatively with experiments across designs and loading conditions.


title: Blended Survival Curves: A New Approach to Extrapolation for Time-to-Event Outcomes from Clinical Trial in Health Technology Assessment

abstract: Background Survival extrapolation is essential in the cost-effectiveness analysis to quantify the lifetime survival benefit associated with a new intervention, due to the restricted duration of randomized controlled trials (RCTs). Current approaches of extrapolation often assume that the treatment effect observed in the trial can continue indefinitely, which is unrealistic and may have a huge impact on decisions for resource allocation. Objective We introduce a novel methodology as a possible solution to alleviate the problem of performing survival extrapolation with heavily censored data from clinical trials. Method The main idea is to mix a flexible model (e.g., Cox semi-parametric) to fit as well as possible the observed data and a parametric model encoding assumptions on the expected behaviour of underlying long-term survival. The two are "blended" into a single survival curve that is identical with the Cox model over the range of observed times and gradually approaching the parametric model over the extrapolation period based on a weight function. The weight function regulates the way two survival curves are blended, determining how the internal and external sources contribute to the estimated survival over time. Results A 4-year follow-up RCT of rituximab in combination with fludarabine and cyclophosphamide v. fludarabine and cyclophosphamide alone for the first-line treatment of chronic lymphocytic leukemia is used to illustrate the method. Conclusion Long-term extrapolation from immature trial data may lead to significantly different estimates with various modelling assumptions. The blending approach provides sufficient flexibility, allowing a wide range of plausible scenarios to be considered as well as the inclusion of genuine external information, based e.g. on hard data or expert opinion. Both internal and external validity can be carefully examined.


title: Environmental effects in Herschel observations of the ionized carbon content of star forming dwarf galaxies in the Virgo cluster

abstract: We use archival Herschel data to examine the singly ionized carbon ([CII]) content of 14 star forming dwarf galaxies in the Virgo cluster. We use spectral energy distribution (SED) fits to far infrared, mid infrared, near infrared, optical and ultraviolet data to derive the total infrared continuum (TIR) for these galaxies. We compare the [CII]/TIR ratio for dwarf galaxies in the central part of Virgo to those in the southern part of the cluster and to galaxies with similar TIR luminosities and metallicities in the Herschel Dwarf Galaxy Survey (DGS) sample of field dwarf galaxies to look for signs of [CII] formation independent of star formation. Our analysis indicates that the sample of Virgo dwarfs in the central part of the cluster has significantly higher values of [CII]/TIR than the sample from the southern part of the cluster and the sample from the DGS, while the southern sample is consistent with the DGS. This [CII]/TIR excess implies that a significant fraction of the [CII] in the dwarf galaxies in the cluster center has an origin other than star formation and is likely to be due to environmental processes in the central part of the cluster. We also find a surprisingly strong correlation between [CII]/TIR and the local ram pressure felt by the dwarf galaxies in the cluster. In this respect, we claim that the excess [CII] we see in these galaxies is likely to be due to formation in ram pressure shocks.


title: Distributional Convergence of the Sliced Wasserstein Process

abstract: Motivated by the statistical and computational challenges of computing Wasserstein distances in high-dimensional contexts, machine learning researchers have defined modified Wasserstein distances based on computing distances between one-dimensional projections of the measures. Different choices of how to aggregate these projected distances (averaging, random sampling, maximizing) give rise to different distances, requiring different statistical analyses. We define the \emph{Sliced Wasserstein Process}, a stochastic process defined by the empirical Wasserstein distance between projections of empirical probability measures to all one-dimensional subspaces, and prove a uniform distributional limit theorem for this process. As a result, we obtain a unified framework in which to prove distributional limit results for all Wasserstein distances based on one-dimensional projections. We illustrate these results on a number of examples where no distributional limits were previously known.


title: Design and Simulation of an Autonomous Quantum Flying Robot Vehicle: An IBM Quantum Experience

abstract: The application of quantum computation and information in robotics has caught the attention of researchers off late. The field of robotics has always put its effort on the minimization of the space occupied by the robot, and on making the robot `smarter. `The smartness of a robot is its sensitivity to its surroundings and the user input and its ability to react upon them desirably. Quantum phenomena in robotics make sure that the robots occupy less space and the ability of quantum computation to process the huge amount of information effectively, consequently making the robot smarter. Braitenberg vehicle is a simple circuited robot that moves according to the input that its sensors receive. Building upon that, we propose a quantum robot vehicle that is `smart' enough to understand the complex situations more than that of a simple Braitenberg vehicle and navigate itself as per the obstacles present. It can detect an obstacle-free path and can navigate itself accordingly. It also takes input from the user when there is more than one free path available. When left with no option on the ground, it can airlift itself off the ground. As these vehicles sort of `react to the surrounding conditions, this idea can be used to build artificial life and genetic algorithms, space exploration and deep-earth exploration probes, and a handy tool in defense and intelligence services.


title: Uniqueness of Equilibria in Interactive Networks

abstract: This paper extends the unified network model, proposed by Acemoglu et al. (2016b), such that interaction functions can be heterogeneous, and the sensitivity matrix has less than or equal to one spectral radius. We show the existence and (almost surely) uniqueness of equilibrium under both eventually contracting and noncontracting assumptions. Applying the equilibrium in the study of systemic risk, we provide a measure to determine the key player who causes the most significant impact if removed from the network.


title: Provably Efficient Offline Multi-agent Reinforcement Learning via Strategy-wise Bonus

abstract: This paper considers offline multi-agent reinforcement learning. We propose the strategy-wise concentration principle which directly builds a confidence interval for the joint strategy, in contrast to the point-wise concentration principle that builds a confidence interval for each point in the joint action space. For two-player zero-sum Markov games, by exploiting the convexity of the strategy-wise bonus, we propose a computationally efficient algorithm whose sample complexity enjoys a better dependency on the number of actions than the prior methods based on the point-wise bonus. Furthermore, for offline multi-agent general-sum Markov games, based on the strategy-wise bonus and a novel surrogate function, we give the first algorithm whose sample complexity only scales $\sum_{i=1}^mA_i$ where $A_i$ is the action size of the $i$-th player and $m$ is the number of players. In sharp contrast, the sample complexity of methods based on the point-wise bonus would scale with the size of the joint action space $\Pi_{i=1}^m A_i$ due to the curse of multiagents. Lastly, all of our algorithms can naturally take a pre-specified strategy class $\Pi$ as input and output a strategy that is close to the best strategy in $\Pi$. In this setting, the sample complexity only scales with $\log |\Pi|$ instead of $\sum_{i=1}^mA_i$.


title: On an Information and Control Architecture for Future Electric Energy Systems

abstract: This paper presents considerations towards an information and control architecture for future electric energy systems driven by massive changes resulting from the societal goals of decarbonization and electrification. This paper describes the new requirements and challenges of an extended information and control architecture that need to be addressed for continued reliable delivery of electricity. It identifies several new actionable information and control loops, along with their spatial and temporal scales of operation, which can together meet the needs of future grids and enable deep decarbonization of the electricity sector. The present architecture of electric power grids designed in a different era is thereby extensible to allow the incorporation of increased renewables and other emerging electric loads.


title: On the asymptotic Plateau problem in hyperbolic space

abstract: In this paper, we solve the asymptotic Plateau problem in hyperbolic space for constant $\sigma_{n-1}$ curvature, i.e. the existence of a complete hypersurface in $\mathbb{H}^{n+1}$ satisfying $\sigma_{n-1}(\kappa)=\sigma\in (0,n)$ with a prescribed asymptotic boundary $\Gamma$. The key ingredient is the curvature estimates. Previously, this is only known for $\sigma_0<\sigma<n$, where $\sigma_0$ is a positive constant.


title: PAGER: Progressive Attribute-Guided Extendable Robust Image Generation

abstract: This work presents a generative modeling approach based on successive subspace learning (SSL). Unlike most generative models in the literature, our method does not utilize neural networks to analyze the underlying source distribution and synthesize images. The resulting method, called the progressive attribute-guided extendable robust image generative (PAGER) model, has advantages in mathematical transparency, progressive content generation, lower training time, robust performance with fewer training samples, and extendibility to conditional image generation. PAGER consists of three modules: core generator, resolution enhancer, and quality booster. The core generator learns the distribution of low-resolution images and performs unconditional image generation. The resolution enhancer increases image resolution via conditional generation. Finally, the quality booster adds finer details to generated images. Extensive experiments on MNIST, Fashion-MNIST, and CelebA datasets are conducted to demonstrate generative performance of PAGER.


title: Branching rule decomposition of the level-1 $E_8^{(1)}$-module with respect to the irregular subalgebra $F_4^{(1)} \oplus G_2^{(1)}$

abstract: Given a Lie algebra of type $E_8$, one can use Dynkin diagram automorphisms of the $E_6$ and $D_4$ Dynkin diagrams to locate a subalgebra of type $F_4\oplus G_2$. These automorphisms can be lifted to the affine Kac-Moody counterparts of these algebras and give a subalgebra of type $F_4^{(1)}\oplus G_2^{(1)}$ within a type $E_8^{(1)}$ Kac-Moody Lie algebra. We will consider the level-1 irreducible $E_8^{(1)}$-module $V^{\Lambda_0}$ and investigate its branching rule, that is how it decomposes as a direct sum of irreducible $F_4^{(1)}\oplus G_2^{(1)}$-modules. We calculate these branching rules using a character formula of Kac-Peterson which uses theta functions and the so-called "string functions." We will make use of Jacobi's, Ramanujan's and the Borweins' theta functions (and their respective properties and identities) in our calculation, including some identities involving the Rogers-Ramanujan series. Virasoro character theory is used to verify string functions stated by Kac and Peterson. We also investigate dissections of some interesting $\eta$-quotients.


title: A Theoretical Framework for Inference Learning

abstract: Backpropagation (BP) is the most successful and widely used algorithm in deep learning. However, the computations required by BP are challenging to reconcile with known neurobiology. This difficulty has stimulated interest in more biologically plausible alternatives to BP. One such algorithm is the inference learning algorithm (IL). IL has close connections to neurobiological models of cortical function and has achieved equal performance to BP on supervised learning and auto-associative tasks. In contrast to BP, however, the mathematical foundations of IL are not well-understood. Here, we develop a novel theoretical framework for IL. Our main result is that IL closely approximates an optimization method known as implicit stochastic gradient descent (implicit SGD), which is distinct from the explicit SGD implemented by BP. Our results further show how the standard implementation of IL can be altered to better approximate implicit SGD. Our novel implementation considerably improves the stability of IL across learning rates, which is consistent with our theory, as a key property of implicit SGD is its stability. We provide extensive simulation results that further support our theoretical interpretations and also demonstrate IL achieves quicker convergence when trained with small mini-batches while matching the performance of BP for large mini-batches.


title: Byzantine-Robust Online and Offline Distributed Reinforcement Learning

abstract: We consider a distributed reinforcement learning setting where multiple agents separately explore the environment and communicate their experiences through a central server. However, $\alpha$-fraction of agents are adversarial and can report arbitrary fake information. Critically, these adversarial agents can collude and their fake data can be of any sizes. We desire to robustly identify a near-optimal policy for the underlying Markov decision process in the presence of these adversarial agents. Our main technical contribution is Weighted-Clique, a novel algorithm for the robust mean estimation from batches problem, that can handle arbitrary batch sizes. Building upon this new estimator, in the offline setting, we design a Byzantine-robust distributed pessimistic value iteration algorithm; in the online setting, we design a Byzantine-robust distributed optimistic value iteration algorithm. Both algorithms obtain near-optimal sample complexities and achieve superior robustness guarantee than prior works.


title: Spectral Recognition of Magnetic Nanoparticles with Artificial Neural Networks

abstract: Ferromagnetic resonance (FMR) spectroscopy is a powerful method for quantifying internal magnetic anisotropy fields in nanoparticles, which is important in a wide range of biomedical and storage applications. The interpretation of FMR spectra, however, can only be achieved with the use of an appropriate model, and no inverse methods are available to extract internal fields from FMR spectra. Here, we present the use of artificial neural networks for spectral recognition, i.e., to identify the internal magnetic anisotropy field from the FMR spectrum. We trained two different types of networks, a convolutional neural network and a multi-layer perceptron, by feeding the networks pre-computed FMR spectra labeled with the corresponding anisotropy fields. Testing of the trained networks with unseen spectra showed that they successfully predict the correct anisotropy fields and, surprisingly, the networks performed well for data that was beyond their training range. These results show the promise of using artificial neural networks for accelerated high-throughput analysis of magnetic materials and nanostructures; for example they could serve in automatizing and optimizing exploration missions where nanomagnetic signals are often used as proxies.


title: Understanding How People Rate Their Conversations

abstract: User ratings play a significant role in spoken dialogue systems. Typically, such ratings tend to be averaged across all users and then utilized as feedback to improve the system or personalize its behavior. While this method can be useful to understand broad, general issues with the system and its behavior, it does not take into account differences between users that affect their ratings. In this work, we conduct a study to better understand how people rate their interactions with conversational agents. One macro-level characteristic that has been shown to correlate with how people perceive their inter-personal communication is personality. We specifically focus on agreeableness and extraversion as variables that may explain variation in ratings and therefore provide a more meaningful signal for training or personalization. In order to elicit those personality traits during an interaction with a conversational agent, we designed and validated a fictional story, grounded in prior work in psychology. We then implemented the story into an experimental conversational agent that allowed users to opt-in to hearing the story. Our results suggest that for human-conversational agent interactions, extraversion may play a role in user ratings, but more data is needed to determine if the relationship is significant. Agreeableness, on the other hand, plays a statistically significant role in conversation ratings: users who are more agreeable are more likely to provide a higher rating for their interaction. In addition, we found that users who opted to hear the story were, in general, more likely to rate their conversational experience higher than those who did not.


title: Analysis of $\sim10^6$ spiral galaxies from four telescopes shows large-scale patterns of asymmetry in galaxy spin directions

abstract: The ability to collect unprecedented amounts of astronomical data has enabled the studying scientific questions that were impractical to study in the pre-information era. This study uses large datasets collected by four different robotic telescopes to profile the large-scale distribution of the spin directions of spiral galaxies. These datasets cover the Northern and Southern hemispheres, in addition to data acquired from space by the Hubble Space Telescope. The data were annotated automatically by a fully symmetric algorithm, as well as manually through a long labor-intensive process, leading to a dataset of nearly $10^6$ galaxies. The data shows possible patterns of asymmetric distribution of the spin directions, and the patterns agree between the different telescopes. The profiles also agree when using automatic or manual annotation of the galaxies, showing very similar large-scale patterns. Combining all data from all telescopes allows the most comprehensive analysis of its kind to date in terms of both the number of galaxies and the footprint size. The results show a statistically significant profile that is consistent across all telescopes. The instruments used in this study are DECam, HST, SDSS, and Pan-STARRS. The paper also discusses possible sources of bias, and analyzes the design of previous work that showed different results. Further research will be required to understand and validate these preliminary observations.


title: Discovering the Hidden Vocabulary of DALLE-2

abstract: We discover that DALLE-2 seems to have a hidden vocabulary that can be used to generate images with absurd prompts. For example, it seems that \texttt{Apoploe vesrreaitais} means birds and \texttt{Contarra ccetnxniams luryca tanniounons} (sometimes) means bugs or pests. We find that these prompts are often consistent in isolation but also sometimes in combinations. We present our black-box method to discover words that seem random but have some correspondence to visual concepts. This creates important security and interpretability challenges.


title: Motion of charged particles in spacetimes with magnetic fields of spherical and hyperbolic symmetry

abstract: The motion of charged particles in spacetimes containing a submanifold of constant positive or negative curvature is considered, with the electromagnetic tensor proportional to the volume two-form form of the submanifold. In the positive curvature case, this describes spherically symmetric spacetimes with a magnetic monopole, while in the negative curvature case, it is a hyperbolic spacetime with magnetic field uniform along hyperbolic surfaces. Constants of motion are found by considering Poisson brackets defined on a phase space with gauge-covariant momenta. In the spherically-symmetric case, we find a correspondence between the trajectories on the Poincar\'{e} cone with equatorial geodesics in a conical defect spacetime. In the hyperbolic case, the analogue of the Poincar\'{e} cone is defined as a surface in an auxiliary Minkowski spacetime. Explicit examples are solved for the Minkowski, $\mathrm{AdS}_4\times S^2$, and the hyperbolic AdS-Reissner--Nordstr\"{o}m spacetimes.


title: Learning Sequential Contexts using Transformer for 3D Hand Pose Estimation

abstract: 3D hand pose estimation (HPE) is the process of locating the joints of the hand in 3D from any visual input. HPE has recently received an increased amount of attention due to its key role in a variety of human-computer interaction applications. Recent HPE methods have demonstrated the advantages of employing videos or multi-view images, allowing for more robust HPE systems. Accordingly, in this study, we propose a new method to perform Sequential learning with Transformer for Hand Pose (SeTHPose) estimation. Our SeTHPose pipeline begins by extracting visual embeddings from individual hand images. We then use a transformer encoder to learn the sequential context along time or viewing angles and generate accurate 2D hand joint locations. Then, a graph convolutional neural network with a U-Net configuration is used to convert the 2D hand joint locations to 3D poses. Our experiments show that SeTHPose performs well on both hand sequence varieties, temporal and angular. Also, SeTHPose outperforms other methods in the field to achieve new state-of-the-art results on two public available sequential datasets, STB and MuViHand.


title: Towards an AAK Theory Approach to Approximate Minimization in the Multi-Letter Case

abstract: We study the approximate minimization problem of weighted finite automata (WFAs): given a WFA, we want to compute its optimal approximation when restricted to a given size. We reformulate the problem as a rank-minimization task in the spectral norm, and propose a framework to apply Adamyan-Arov-Krein (AAK) theory to the approximation problem. This approach has already been successfully applied to the case of WFAs and language modelling black boxes over one-letter alphabets \citep{AAK-WFA,AAK-RNN}. Extending the result to multi-letter alphabets requires solving the following two steps. First, we need to reformulate the approximation problem in terms of noncommutative Hankel operators and noncommutative functions, in order to apply results from multivariable operator theory. Secondly, to obtain the optimal approximation we need a version of noncommutative AAK theory that is constructive. In this paper, we successfully tackle the first step, while the second challenge remains open.


title: Rational partition models under iterative proportional scaling

abstract: In this work we investigate partition models, the subset of log-linear models for which one can perform the iterative proportional scaling (IPS) algorithm to numerically compute the maximum likelihood estimate (MLE). Partition models include families of models such as hierarchical models and balanced, stratified staged trees. We define a sufficient condition, called the Generalized Running Intersection Property (GRIP), on the matrix representation of a partition model under which IPS algorithm produces the exact MLE in one cycle. Additionally we connect the GRIP to the toric fiber product and to previous results for hierarchical models and balanced, stratified staged trees. This leads to a characterization of balanced, stratified staged trees in terms of the GRIP.


title: Preliminary Results on the Employment Effect of Tourism. A meta-analysis

abstract: Unemployment is one of the most important issues in every country. Tourism industry is a dynamic sector which is labor augmented and can create jobs, increase consumption expenditures and offer employment opportunities. In the analysis of this work, the empirical literature on this issue is presented, which indicates that tourism can play a vital and beneficial role to increase employment. This paper uses meta-analysis techniques to investigate the effect of tourism on employment, and finds that the vast majority of the studies reveal a positive relationship. The mean effect of the 36 studies of the meta-sample, using Partial Correlations, is 0.129. This effect is similar to the regression results which is around 0.9, which is positive and statistically significant, clearly indicating that tourism is effective in the creation of jobs and offers employment opportunities. Moreover, evidence of selection bias in the literature in favor of studies which produce positive estimates is found, and once this bias is corrected the true effect is 0.85-0.97.


title: The coarse quotient for affine Weyl groups and pseudo-reflection groups

abstract: We study the coarse quotient $\mathfrak{t}^*//W^{\text{aff}}$ of the affine Weyl group $W^{\text{aff}}$ acting on a dual Cartan $\mathfrak{t}^*$ for some semisimple Lie algebra. Specifically, we classify sheaves on this space via a "pointwise" criterion for descent, which says that a $W^{\text{aff}}$-equivariant sheaf on $\mathfrak{t}^*$ descends to the coarse quotient if and only if the fiber at each field-valued point descends to the associated GIT quotient. We also prove the analogous pointwise criterion for descent for an arbitrary finite group acting on a vector space. Using this, we show that an equivariant sheaf for the action of a finite pseudo-reflection group descends to the GIT quotient if and only if it descends to the associated GIT quotient for every pseudo-reflection, generalizing a recent result of Lonergan.


title: Learning Sparse Nonlinear Dynamics via Mixed-Integer Optimization

abstract: Discovering governing equations of complex dynamical systems directly from data is a central problem in scientific machine learning. In recent years, the sparse identification of nonlinear dynamics (SINDy) framework, powered by heuristic sparse regression methods, has become a dominant tool for learning parsimonious models. We propose an exact formulation of the SINDy problem using mixed-integer optimization (MIO) to solve the sparsity constrained regression problem to provable optimality in seconds. On a large number of canonical ordinary and partial differential equations, we illustrate the dramatic improvement of our approach in accurate model discovery while being more sample efficient, robust to noise, and flexible in accommodating physical constraints.


title: On Gap-dependent Bounds for Offline Reinforcement Learning

abstract: This paper presents a systematic study on gap-dependent sample complexity in offline reinforcement learning. Prior work showed when the density ratio between an optimal policy and the behavior policy is upper bounded (the optimal policy coverage assumption), then the agent can achieve an $O\left(\frac{1}{\epsilon^2}\right)$ rate, which is also minimax optimal. We show under the optimal policy coverage assumption, the rate can be improved to $O\left(\frac{1}{\epsilon}\right)$ when there is a positive sub-optimality gap in the optimal $Q$-function. Furthermore, we show when the visitation probabilities of the behavior policy are uniformly lower bounded for states where an optimal policy's visitation probabilities are positive (the uniform optimal policy coverage assumption), the sample complexity of identifying an optimal policy is independent of $\frac{1}{\epsilon}$. Lastly, we present nearly-matching lower bounds to complement our gap-dependent upper bounds.


title: iPTF14hls in the circumstellar medium interaction model: A promising candidate for a pulsational pair-instability supernova

abstract: iPTF14hls is a luminous Type II supernova (SN) with a bumpy light curve that remains debated for its origin. It maintains roughly a constant effective temperature and luminosity since discovery for about 600 days, followed by a slow decay. On $\sim 1000$\ days post discovery the light curve transitions to a very steep decline. A spectrum taken during this steep decline phase shows clear signatures of shock interaction with dense circumstellar medium (CSM). Here we explore the possibility of iPTF14hls as an interaction-powered SN. The light curve of iPTF14hls can be fitted with wind-like CSMs. Analytic modeling indicates that iPTF14hls may have undertaken six episodes of mass loss during the last $\sim 200\mathrm{yr}$. Assuming that the 1954 eruption triggered the last mass-loss episode, the stellar-wind velocity is determined to be $40-70\mathrm{km}\mathrm{s}^{-1}$, depending on different models. Mass loss rates are in the range $% 0.4-3.3M_{\odot }\mathrm{yr}^{-1}$. The inferred total mass of ejecta and CSMs ($M_{\mathrm{ej}}+M_{\mathrm{CSMs}}\simeq 245M_{\odot }$) supports the idea that iPTF14hls may be a candidate for a (pulsational) pair-instability SN. Discovery and observations of more similar stellar explosions will help understand these peculiar SNe.


title: Variations of cyclotron resonant scattering features in Vela X-1 revealed with Insight-HXMT

abstract: We present a detailed study of the high mass X-ray binary Vela X-1, using observations performed by Insight-HXMT in 2019 and 2020, concentrating on timing analysis and spectral studies including pulse phase-resolved spectroscopy. The cyclotron line energy is found to be at ~21-27 keV and 43-50 keV for the fundamental and first harmonic, respectively. We present the evolution of spectral parameters and find that two line centroid energy ratio E2/E1 evolved from ~2 before MJD 58900 to ~1.7 after that. The harmonic cyclotron line energy has no relation to the luminosity but the fundamental line energy shows a positive correlation with X-ray luminosity, suggesting that Vela X-1 is located in the sub-critical accreting regime. In addition, the pulse phase-resolved spectroscopy in Vela X-1 is performed. Both the CRSF and continuum parameters show strong variability over the pulse phase with the ratio of two line energies about 2 near the peak phases, and down to ~1.6 around off-peak phases. Long-term significant variations of the absorption column density and its evolution over the pulse phase may imply the existence of the clumpy wind structure near the neutron star.


title: Self-similarity with universal property for soap film and bubble in roll-off stage

abstract: All children enjoy blowing soap bubbles that also show up in our bath and when we wash dishes. We analyze the thinning and breaking of soap bubble neck when it is stretched. To contrast with the more widely studied film whose boundaries are open, we concentrate on the bubble with a conserved air volume V. Like film (F), non-equilibrium state can be divided into four regimes for bubble (B): (1) roll-off, (2) cusp approach, (3) pinch-off and (4) breakup. We establish the existence of self-similarity in F-1, B-1 and B-3, and universal property in F-1 and B-1 for the profile of soap membrane. The former means that the profile at successive times can be mapped to a master curve after being rescaled by the countdown time \tau. Whiles, the latter further requires this master curve to be identical for different ring sizes R for film and different V and R for bubble while keeping V/R^3 fixed. The exhibition of universal property indicates that the process of memory erasing starts earlier than regime 3. We also found that the minimum radius scales as h_{min}~\tau ^{1/2}, independent of V and pulling speed. Note that the validity of our discussion is limited by the duration of roll-off regime from 10^{-2}~10^{-3} s.


title: Labeling Where Adapting Fails: Cross-Domain Semantic Segmentation with Point Supervision via Active Selection

abstract: Training models dedicated to semantic segmentation requires a large amount of pixel-wise annotated data. Due to their costly nature, these annotations might not be available for the task at hand. To alleviate this problem, unsupervised domain adaptation approaches aim at aligning the feature distributions between the labeled source and the unlabeled target data. While these strategies lead to noticeable improvements, their effectiveness remains limited. To guide the domain adaptation task more efficiently, previous works attempted to include human interactions in this process under the form of sparse single-pixel annotations in the target data. In this work, we propose a new domain adaptation framework for semantic segmentation with annotated points via active selection. First, we conduct an unsupervised domain adaptation of the model; from this adaptation, we use an entropy-based uncertainty measurement for target points selection. Finally, to minimize the domain gap, we propose a domain adaptation framework utilizing these target points annotated by human annotators. Experimental results on benchmark datasets show the effectiveness of our methods against existing unsupervised domain adaptation approaches. The propose pipeline is generic and can be included as an extra module to existing domain adaptation strategies.


title: Differentiable Soft-Masked Attention

abstract: Transformers have become prevalent in computer vision due to their performance and flexibility in modelling complex operations. Of particular significance is the 'cross-attention' operation, which allows a vector representation (e.g. of an object in an image) to be learned by attending to an arbitrarily sized set of input features. Recently, "Masked Attention" was proposed in which a given object representation only attends to those image pixel features for which the segmentation mask of that object is active. This specialization of attention proved beneficial for various image and video segmentation tasks. In this paper, we propose another specialization of attention which enables attending over `soft-masks' (those with continuous mask probabilities instead of binary values), and is also differentiable through these mask probabilities, thus allowing the mask used for attention to be learned within the network without requiring direct loss supervision. This can be useful for several applications. Specifically, we employ our "Differentiable Soft-Masked Attention" for the task of Weakly-Supervised Video Object Segmentation (VOS), where we develop a transformer-based network for VOS which only requires a single annotated image frame for training, but can also benefit from cycle consistency training on a video with just one annotated frame. Although there is no loss for masks in unlabeled frames, the network is still able to segment objects in those frames due to our novel attention formulation. Code: https://github.com/Ali2500/HODOR/blob/main/hodor/modelling/encoder/soft_masked_attention.py


title: Certain complex representations of $SL_2(\bar{\mathbb{F}}_q)$

abstract: We introduce the representation category $\mathscr{C}({\bf G})$ for a connected reductive algebraic group ${\bf G}$ which is defined over a finite field $\mathbb{F}_q$ of $q$ elements. We show that this category has many good properties for ${\bf G}=SL_2(\bar{\mathbb{F}}_q)$. In particular, it is an abelian category and a highest weight category. Moreover, we classify the simple objects in $\mathscr{C}({\bf G})$ for ${\bf G}=SL_2(\bar{\mathbb{F}}_q)$.


title: How Much Demand Flexibility Could Have Spared Texas from the 2021 Outage?

abstract: The February 2021 Texas winter power outage has led to hundreds of deaths and billions of dollars in economic losses, largely due to the generation failure and record-breaking electric demand. In this paper, we study the scaling-up of demand flexibility as a means to avoid load shedding during such an extreme weather event. The three mechanisms considered are interruptible load, residential load rationing, and incentive-based demand response. By simulating on a synthetic but realistic large-scale Texas grid model along with demand flexibility modeling and electricity outage data, we identify portfolios of mixing mechanisms that exactly avoid outages, which a single mechanism may fail due to decaying marginal effects. We also reveal a complementary relationship between interruptible load and residential load rationing and find nonlinear impacts of incentive-based demand response on the efficacy of other mechanisms.


title: On the sine polarity and the $L_p$-sine Blaschke-Santal\'{o} inequality

abstract: This paper is dedicated to study the sine version of polar bodies and establish the $L_p$-sine Blaschke-Santal\'{o} inequality for the $L_p$-sine centroid body. The $L_p$-sine centroid body $\Lambda_p K$ for a star body $K\subset\mathbb{R}^n$ is a convex body based on the $L_p$-sine transform, and its associated Blaschke-Santal\'{o} inequality provides an upper bound for the volume of $\Lambda_p^{\circ}K$, the polar body of $\Lambda_p K$, in terms of the volume of $K$. Thus, this inequality can be viewed as the "sine cousin" of the $L_p$ Blaschke-Santal\'{o} inequality established by Lutwak and Zhang. As $p\rightarrow \infty$, the limit of $\Lambda_p^{\circ} K$ becomes the sine polar body $K^{\diamond}$ and hence the $L_p$-sine Blaschke-Santal\'{o} inequality reduces to the sine Blaschke-Santal\'{o} inequality for the sine polar body. The sine polarity naturally leads to a new class of convex bodies $\mathcal{C}_{e}^n$, which consists of all origin-symmetric convex bodies generated by the intersection of origin-symmetric closed solid cylinders. Many notions in $\mathcal{C}_{e}^n$ are developed, including the cylindrical support function, the supporting cylinder, the cylindrical Gauss image, and the cylindrical hull. Based on these newly introduced notions, the equality conditions of the sine Blaschke-Santal\'{o} inequality are settled.


title: Dense minors of graphs with independence number two

abstract: Motivated by Hadwiger's conjecture, we prove that every $n$-vertex graph $G$ with no independent set of size three contains an $\lceil n/2\rceil$-vertex simple minor $H$ with $$0.98688 \cdot \binom{|V(H)|}{2} - o(n^2)$$ edges.


title: DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training

abstract: Personalized federated learning is proposed to handle the data heterogeneity problem amongst clients by learning dedicated tailored local models for each user. However, existing works are often built in a centralized way, leading to high communication pressure and high vulnerability when a failure or an attack on the central server occurs. In this work, we propose a novel personalized federated learning framework in a decentralized (peer-to-peer) communication protocol named Dis-PFL, which employs personalized sparse masks to customize sparse local models on the edge. To further save the communication and computation cost, we propose a decentralized sparse training technique, which means that each local model in Dis-PFL only maintains a fixed number of active parameters throughout the whole local training and peer-to-peer communication process. Comprehensive experiments demonstrate that Dis-PFL significantly saves the communication bottleneck for the busiest node among all clients and, at the same time, achieves higher model accuracy with less computation cost and communication rounds. Furthermore, we demonstrate that our method can easily adapt to heterogeneous local clients with varying computation complexities and achieves better personalized performances.


title: Benchmark of DNN Model Search at Deployment Time

abstract: Deep learning has become the most popular direction in machine learning and artificial intelligence. However, the preparation of training data, as well as model training, are often time-consuming and become the bottleneck of the end-to-end machine learning lifecycle. Reusing models for inferring a dataset can avoid the costs of retraining. However, when there are multiple candidate models, it is challenging to discover the right model for reuse. Although there exist a number of model sharing platforms such as ModelDB, TensorFlow Hub, PyTorch Hub, and DLHub, most of these systems require model uploaders to manually specify the details of each model and model downloaders to screen keyword search results for selecting a model. We are lacking a highly productive model search tool that selects models for deployment without the need for any manual inspection and/or labeled data from the target domain. This paper proposes multiple model search strategies including various similarity-based approaches and non-similarity-based approaches. We design, implement, and evaluate these approaches on multiple model inference scenarios, including activity recognition, image recognition, text classification, natural language processing, and entity matching. The experimental evaluation showed that our proposed asymmetric similarity-based measurement, adaptivity, outperformed symmetric similarity-based measurements and non-similarity-based measurements in most of the workloads.


title: Measurement of carbon finance level and exploration of its influencing factors

abstract: Faced with increasingly severe environmental problems, carbon trading markets and related financial activities aiming at limiting carbon dioxide emissions are booming. Considering the complexity and urgency of carbon market, it is necessary to construct an effective evaluation index system. This paper selected carbon finance index as a composite indicator. Taking Beijing, Shanghai, and Guangdong as examples, we adopted the classic method of multiple criteria decision analysis (MCDA) to analyze the composite indicator. Potential impact factors were screened extensively and calculated through normalization, weighting by coefficient of variation and different aggregation methods. Under the measurement of Shannon-Spearman Measure, the method with the least loss of information was used to obtain the carbon finance index (CFI) of the pilot areas. Through panel model analysis, we found that company size, the number of patents per 10,000 people and the proportion of new energy generation were the factors with significant influence. Based on the research, corresponding suggestions were put forward for different market entities. Hopefully, this research will contribute to the steady development of the national carbon market.


title: Predicted universality class of step bunching found on DC-heated Si(111) surfaces

abstract: Concerted experimental and numerical studies of step bunching on vicinal crystal surfaces resulting from step-down electromigration of partially charged adatoms, confirmed the theoretical prediction of scaling dependence of the minimal bunch distance $l_{\rm min}$ on the bunch size $N$: $l_{\rm min} \sim N^{-\gamma}$, with $\gamma = 2/3$. The value of the so called size-scaling exponent $\gamma$ was observed in experiments on vicinal surfaces of semiconducting, metallic, and dielectric materials. Careful theoretical investigations and numerical calculations predict a second value of $\gamma = 1/2$. However, this value is still not been reported from experiments. And we report here experimental observation of step bunching in the universality class relative to $\gamma = 1/2$. This is achieved by monitoring step flow during sublimation of Si(111)-vicinals heated by a direct step-down current at ~1200$^\circ$C. In the experiment we also measure other characteristic for the bunching quantities, such as the mean total number of steps in the bunch $N$ and the mean bunch width $W$. We then compare our findings with published experimental and numerical data to arrive at a theoretically consistent framework in terms of universality classes. The ultimate benefit of our study is not only to advance fundamental knowledge but also to provide further guidance for bottom-up synthesis of vicinal nanotemplates.


title: Biaxial strain engineering on the superconducting properties of MgB2 thin film

abstract: The effect of biaxial strain on the superconducting properties of MgB2 thin films was studied by first-principles calculations. The stability analyses by phonon dispersions show that biaxial strain as much as 7% can be applied onto MgB2 without inducing any imaginary frequency. The superconducting property calculations based on the frame of Migdal-Eliashberg theory successfully reproduce the two-gap superconductivity of MgB2. The results show that the tensile biaxial strain can increase the critical temperature of MgB2 while the compressive biaxial strain would decrease the critical temperature. The detailed microscopic mechanism of the biaxial strain effect on the superconducting properties was studied by calculations of electronic structures and phonon dispersions. The increased Tc is a combining result of the increased electron density at the Fermi level and the in-plane boron phonon softening. By means of high-throughput screening of proper substrates, it is found that most of the substrates would result in tensile strain in MgB2 film, which is in agreement with many experimental works. The results in this work provide detailed understanding of the biaxial strain engineering mechanism and demonstrate that biaxial strain engineering can be an effective way of tuning the superconducting properties of MgB2 and other similar materials.


title: Order-sensitive Shapley Values for Evaluating Conceptual Soundness of NLP Models

abstract: Previous works show that deep NLP models are not always conceptually sound: they do not always learn the correct linguistic concepts. Specifically, they can be insensitive to word order. In order to systematically evaluate models for their conceptual soundness with respect to word order, we introduce a new explanation method for sequential data: Order-sensitive Shapley Values (OSV). We conduct an extensive empirical evaluation to validate the method and surface how well various deep NLP models learn word order. Using synthetic data, we first show that OSV is more faithful in explaining model behavior than gradient-based methods. Second, applying to the HANS dataset, we discover that the BERT-based NLI model uses only the word occurrences without word orders. Although simple data augmentation improves accuracy on HANS, OSV shows that the augmented model does not fundamentally improve the model's learning of order. Third, we discover that not all sentiment analysis models learn negation properly: some fail to capture the correct syntax of the negation construct. Finally, we show that pretrained language models such as BERT may rely on the absolute positions of subject words to learn long-range Subject-Verb Agreement. With each NLP task, we also demonstrate how OSV can be leveraged to generate adversarial examples.


title: Do elderly want to work? Modeling elderly's decision to fight aging Thailand

abstract: Thailand has entered into an aging society since the year 2000. Using the 2017 Survey of the Older Persons in Thailand collected by Thailand National Statistical Office, this study uses cross tabulation, random forest with variable importance measure and lasso logistic regression to examine factors that have effects on the elderly's decision to remain in the labor market after retirement. This study reveals that these following variables: age, education level, healthcare eligibility, marital status, health condition, total assets, gender, residential type, percent of elderly in the household, and number of children have strong influences on an elderly's desire to continue work. By knowing which factors contribute to the elderly wish to continue work in the market, this research allows for future prediction of the labor market that can accommodate elderly in Thailand. Our final models of random forest and lasso logistic regression provide prediction accuracy of 68.19 and 69.58 percent on the elderly's desire to work, respectively. This study has a significant impact as policymakers can utilize our models in predicting elderly's desire to work after retirement age and design a labor market that can accommodate elderly in Thailand in the future.


title: Cosets from equivariant W-algebras

abstract: The equivariant $\mathcal{W}$-algebra of a simple Lie algebra $\mathfrak{g}$ is a BRST reduction of the algebra of chiral differential operators on the Lie group of $\mathfrak{g}$. We construct a family of vertex algebras $A[\mathfrak{g}, \kappa, n]$ as subalgebras of the equivariant $\mathcal{W}$-algebra of $\mathfrak{g}$ tensored with the integrable affine vertex algebra $L_n(\check{\mathfrak{g}})$ of the Langlands dual Lie algebra $\check{\mathfrak{g}}$ at level $n\in \mathbb{Z}_{>0}$. They are conformal extensions of the tensor product of an affine vertex algebra and the principal $\mathcal{W}$-algebra whose levels satisfy a specific relation.


title: Stellar representation of extremal Wigner-negative spin states

abstract: The Majorana stellar representation is used to characterize spin states that have a maximally negative Wigner quasiprobability distribution on a spherical phase space. These maximally Wigner-negative spin states generally exhibit a partial but not high degree of symmetry within their star configurations. In particular, for spin $j > 2$, maximal constellations do not correspond to a Platonic solid when available and do not follow an obvious geometric pattern as dimension increases. In addition, they are generally different from spin states that maximize other measures of nonclassicality such as anticoherence or geometric entanglement. Random states ($j \leq 6$) display on average a relatively high amount of negativity, but the extremal states and those with similar negativity are statistically rare in Hilbert space. We also prove that all spin coherent states of arbitrary dimension have non-zero Wigner negativity. This offers evidence that all pure spin states also have non-zero Wigner negativity. The results can be applied to qubit ensembles exhibiting permutation invariance.


title: Desingularization of 3D steady Euler equation with helical symmetry

abstract: In this paper, we study desingularization of steady solutions of 3D incompressible Euler equation with helical symmetry in a general helical domain. We construct a family of steady Euler flows with helical symmetry, such that the associated vorticities tend asymptotically to a helical vortex filament. The solutions are obtained by solving a semilinear elliptic problem in divergence form with a parameter. By using the stream-function method, we show the existence and asymptotic behavior of ground state solutions concentrating near a single point as the parameter $ \varepsilon\to 0 $. Qualitative properties of those solutions are also discussed.


title: Equilibria and energy minimizers for an interaction model on the hyperbolic space

abstract: We study an intrinsic model for collective behaviour on the hyperbolic space $\bbh^\dm$. We investigate the equilibria of the aggregation equation (or equivalently, the critical points of the associated interaction energy) for interaction potentials that include Newtonian repulsion. By using the method of moving planes, we establish the radial symmetry and the monotonicity of equilibria supported on geodesic balls of $\bbh^\dm$. We find several explicit forms of equilibria and show that one such equilibrium is a global energy minimizer. We also consider more general potentials and utilize a technique used for $\bbr^\dm$ to establish the existence of compactly supported global minimizers. Numerical simulations are presented, suggesting that some of the equilibria studied here are global attractors. The key tool in our investigations is a family of isometries of $\bbh^\dm$ that we have developed for this purpose.


title: The Special Role of Toroidal Black Holes in Holography

abstract: In the standard holographic ``dictionary'', the deep infrared of the strongly coupled boundary field theory is studied by examining the bulk region near to the event horizon of a simple AdS-Reissner-Nordstr\"{o}m black hole, near to extremality. Recently Horowitz et al. have argued that this is not correct, \emph{except} in the case of small toroidal black holes, which are therefore revealed to be particularly interesting and important. On the other hand, the Weak Gravity Conjecture postulates that black holes (including toroidal black holes) which are extremely near to extremality spontaneously emit black holes of the same kind. We show that, in the toroidal case, these ``emitted'' black holes are always small in the sense of Horowitz et al. As an application, we discuss the Grinberg-Maldacena analysis of the way one-point functions, evaluated outside an AdS-Reissner-Nordstr\"{o}m black hole, depend on the proper time of fall from the event horizon to the Cauchy horizon. We find that, for emitted toroidal black holes, this dependence effectively drops out.


title: Concentration inequalities using approximate zero bias couplings with applications to Hoeffding's statistic under the Ewens distribution

abstract: We prove concentration inequalities of the form $P(Y \ge t) \le \exp(-B(t))$ for a random variable $Y$ with mean zero and variance $\sigma^2$ using a coupling technique from Stein's method that is so-called approximate zero bias couplings. Applications to the Hoeffding's statistic where the random permutation has the Ewens distribution with parameter $\theta>0$ are also presented. A few simulation experiments are then provided to visualize the tail probability of the Hoeffding's statistic and our bounds. Based on the simulation results, our bounds work well especially when $\theta \le 1$.


title: Moment stability of stochastic processes with applications to control systems

abstract: We establish new conditions for obtaining uniform bounds on the moments of discrete-time stochastic processes. Our results require a weak negative drift criterion along with a state-dependent restriction on the sizes of the one-step jumps of the processes. The state-dependent feature of the results make them suitable for a large class of multiplicative-noise processes. Under the additional assumption of Markovian property, new result on ergodicity has also been proved. There are several applications to iterative systems, control systems, and other dynamical systems with state-dependent multiplicative noise, and we include illustrative examples to demonstrate applicability of our results.


title: Helical vortices with small cross-section for 3D incompressible Euler equation

abstract: In this article, we construct traveling-rotating helical vortices with small cross-section to the 3D incompressible Euler equations in an infinite pipe, which tend asymptotically to singular helical vortex filament evolved by the binormal curvature flow. The construction is based on studying a general semilinear elliptic problem in divergence form \begin{equation*} \begin{cases} -\varepsilon^2\text{div}(K(x)\nabla u)= (u-q|\ln\varepsilon|)^{p}_+,\ \ &x\in \Omega,\\ u=0,\ \ &x\in\partial \Omega, \end{cases} \end{equation*} for small values of $ \varepsilon. $ Helical vortex solutions concentrating near several helical filaments with polygonal symmetry are also constructed.


title: A massive Keplerian protostellar disk with flyby-induced spirals in the Central Molecular Zone

abstract: Accretion disks are an essential component in the paradigm of the formation of low-mass stars. Recent observations further identify disks surrounding low-mass pre-main-sequence stars perturbed by flybys. Whether disks around more massive stars evolve in a similar manner becomes an urgent question. We report the discovery of a Keplerian disk of a few solar masses surrounding a 32 solar-mass protostar in the Sagittarius C cloud around the Galactic Center. The disk is gravitationally stable with two embedded spirals. A combined analysis of analytical solutions and numerical simulations demonstrates that the most likely scenario to form the spirals is through external perturbations induced by a close flyby, and one such perturber with the expected parameters is identified. The massive, early O-type star embedded in this disk forms in a similar manner with respect to low-mass stars, in the sense of not only disk-mediated accretion, but also flyby-impacted disk evolution.


title: Normal approximation for fire incident simulation using permanental Cox processes

abstract: Estimating the number of natural disasters benefits the insurance industry in terms of risk management. However, the estimation process is complicated due to the fact that there are many factors affecting the number of such incidents. In this work, we propose a Normal approximation technique for associated point processes for estimating the number of natural disasters under the following two assumptions: 1) the incident counts in any two distinct areas are positively associated and 2) the association between these counts in two distinct areas decays exponentially with respect to distance outside some small local neighborhood. Under the stated assumptions, we extend previous results for the Normal approximation technique for associated point processes, i.e., the establishment of non-asymptotic $L^1$ bounds for the functionals of these processes [Wiroonsri (2019)]. Then we apply this new result to permanental Cox processes that are known to be positively associated. Finally, we apply our Normal approximation results for permanental Cox processes to Thailand's fire data from 2007 to 2020, which was collected by the Geo-Informatics and Space Technology Development Agency of Thailand.


title: Intelligent Omni-Surfaces: Reflection-Refraction Circuit Model, Full-Dimensional Beamforming, and System Implementation

abstract: The intelligent omni-surface (IOS) is a dynamic metasurface that has recently been proposed to achieve full-dimensional communications by realizing the dual function of anomalous reflection and anomalous refraction. Existing research works provide only simplified models for the reflection and refraction responses of the IOS, which do not explicitly depend on the physical structure of the IOS and the angle of incidence of the electromagnetic (EM) wave. Therefore, the available reflection-refraction models are insufficient to characterize the performance of full-dimensional communications. In this paper, we propose a complete and detailed circuit-based reflection-refraction model for the IOS, which is formulated in terms of the physical structure and equivalent circuits of the IOS elements, as well as we validate it against full-wave EM simulations. Based on the proposed circuit-based model for the IOS, we analyze the asymmetry between the reflection and transmission coefficients. Moreover, the proposed circuit-based model is utilized for optimizing the hybrid beamforming of IOS-assisted networks and hence improving the system performance. To verify the circuit-based model, the theoretical findings, and to evaluate the performance of full-dimensional beamforming, we implement a prototype of IOS and deploy an IOS-assisted wireless communication testbed to experimentally measure the beam patterns and to quantify the achievable rate. The obtained experimental results validate the theoretical findings and the accuracy of the proposed circuit-based reflection-refraction model for IOSs.


title: CAFA: Class-Aware Feature Alignment for Test-Time Adaptation

abstract: Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by adapting a model to unlabeled data at test time. TTA can be applied to pretrained networks without modifying their training procedures, enabling them to utilize a well-formed source distribution for adaptation. One possible approach is to align the representation space of test samples to the source distribution (\textit{i.e.,} feature alignment). However, performing feature alignment in TTA is especially challenging in that access to labeled source data is restricted during adaptation. That is, a model does not have a chance to learn test data in a class-discriminative manner, which was feasible in other adaptation tasks (\textit{e.g.,} unsupervised domain adaptation) via supervised losses on the source data. Based on this observation, we propose a simple yet effective feature alignment loss, termed as Class-Aware Feature Alignment (CAFA), which simultaneously 1) encourages a model to learn target representations in a class-discriminative manner and 2) effectively mitigates the distribution shifts at test time. Our method does not require any hyper-parameters or additional losses, which are required in previous approaches. We conduct extensive experiments on 6 different datasets and show our proposed method consistently outperforms existing baselines.


title: Transformer with Fourier Integral Attentions

abstract: Multi-head attention empowers the recent success of transformers, the state-of-the-art models that have achieved remarkable success in sequence modeling and beyond. These attention mechanisms compute the pairwise dot products between the queries and keys, which results from the use of unnormalized Gaussian kernels with the assumption that the queries follow a mixture of Gaussian distribution. There is no guarantee that this assumption is valid in practice. In response, we first interpret attention in transformers as a nonparametric kernel regression. We then propose the FourierFormer, a new class of transformers in which the dot-product kernels are replaced by the novel generalized Fourier integral kernels. Different from the dot-product kernels, where we need to choose a good covariance matrix to capture the dependency of the features of data, the generalized Fourier integral kernels can automatically capture such dependency and remove the need to tune the covariance matrix. We theoretically prove that our proposed Fourier integral kernels can efficiently approximate any key and query distributions. Compared to the conventional transformers with dot-product attention, FourierFormers attain better accuracy and reduce the redundancy between attention heads. We empirically corroborate the advantages of FourierFormers over the baseline transformers in a variety of practical applications including language modeling and image classification.


title: Statistical and Computational Complexities of BFGS Quasi-Newton Method for Generalized Linear Models

abstract: The gradient descent (GD) method has been used widely to solve parameter estimation in generalized linear models (GLMs), a generalization of linear models when the link function can be non-linear. In GLMs with a polynomial link function, it has been shown that in the high signal-to-noise ratio (SNR) regime, due to the problem's strong convexity and smoothness, GD converges linearly and reaches the final desired accuracy in a logarithmic number of iterations. In contrast, in the low SNR setting, where the problem becomes locally convex, GD converges at a slower rate and requires a polynomial number of iterations to reach the desired accuracy. Even though Newton's method can be used to resolve the flat curvature of the loss functions in the low SNR case, its computational cost is prohibitive in high-dimensional settings as it is $\mathcal{O}(d^3)$, where $d$ the is the problem dimension. To address the shortcomings of GD and Newton's method, we propose the use of the BFGS quasi-Newton method to solve parameter estimation of the GLMs, which has a per iteration cost of $\mathcal{O}(d^2)$. When the SNR is low, for GLMs with a polynomial link function of degree $p$, we demonstrate that the iterates of BFGS converge linearly to the optimal solution of the population least-square loss function, and the contraction coefficient of the BFGS algorithm is comparable to that of Newton's method. Moreover, the contraction factor of the linear rate is independent of problem parameters and only depends on the degree of the link function $p$. Also, for the empirical loss with $n$ samples, we prove that in the low SNR setting of GLMs with a polynomial link function of degree $p$, the iterates of BFGS reach a final statistical radius of $\mathcal{O}((d/n)^{\frac{1}{2p+2}})$ after at most $\log(n/d)$ iterations.


title: AdaVITS: Tiny VITS for Low Computing Resource Speaker Adaptation

abstract: Speaker adaptation in text-to-speech synthesis (TTS) is to finetune a pre-trained TTS model to adapt to new target speakers with limited data. While much effort has been conducted towards this task, seldom work has been performed for low computational resource scenarios due to the challenges raised by the requirement of the lightweight model and less computational complexity. In this paper, a tiny VITS-based TTS model, named AdaVITS, for low computing resource speaker adaptation is proposed. To effectively reduce parameters and computational complexity of VITS, an iSTFT-based wave construction decoder is proposed to replace the upsampling-based decoder which is resource-consuming in the original VITS. Besides, NanoFlow is introduced to share the density estimate across flow blocks to reduce the parameters of the prior encoder. Furthermore, to reduce the computational complexity of the textual encoder, scaled-dot attention is replaced with linear attention. To deal with the instability caused by the simplified model, instead of using the original text encoder, phonetic posteriorgram (PPG) is utilized as linguistic feature via a text-to-PPG module, which is then used as input for the encoder. Experiment shows that AdaVITS can generate stable and natural speech in speaker adaptation with 8.97M model parameters and 0.72GFlops computational complexity.


title: The Subtype-Free Average Causal Effect for Heterogeneous Disease Etiology

abstract: Studies have shown that the effect an exposure may have on a disease can vary for different subtypes of the same disease. However, existing approaches to estimate and compare these effects largely overlook causality. In this paper, we study the effect smoking may have on having colorectal cancer subtypes defined by a trait known as microsatellite instability (MSI). We use principal stratification to propose an alternative causal estimand, the Subtype-Free Average Causal Effect (SF-ACE). The SF-ACE is the causal effect of the exposure among those who would be free from other disease subtypes under any exposure level. We study non-parametric identification of the SF-ACE, and discuss different monotonicity assumptions, which are more nuanced than in the standard setting. As is often the case with principal stratum effects, the assumptions underlying the identification of the SF-ACE from the data are untestable and can be too strong. Therefore, we also develop sensitivity analysis methods that relax these assumptions. We present three different estimators, including a doubly-robust estimator, for the SF-ACE. We implement our methodology for data from two large cohorts to study the heterogeneity in the causal effect of smoking on colorectal cancer with respect to MSI subtypes.


title: Interplay between jamming and MIPS in persistent self-propelling particles

abstract: In living and engineered systems of active particles, self-propulsion induces an unjamming transition from a solid to a fluid phase and phase separation between a gas and a liquid-like phase. We demonstrate an interplay between these two nonequilibrium transitions in systems of persistent active particles. The coexistence and jamming lines in the activity-density plane meet at the jamming transition point in the limit of hard particles or zero activity. This interplay induces an anomalous dynamic in the liquid phase and hysteresis at the active jamming transition.


title: Molecular and Atomic Clouds Associated with the Gamma-Ray Supernova Remnant Puppis A

abstract: We have carried out a study of the interstellar medium (ISM) toward a shell-like supernova remnant SNR Puppis A by using the NANTEN CO and ATCA HI data. We synthesized a comprehensive picture of the SNR radiation by combining the ISM data with the gamma-ray and X-ray distributions. The ISM, both atomic and molecular gas, is dense and highly clumpy, and is distributed all around the SNR, but mainly in the north-east. The CO distribution revealed an enhanced line intensity ratio of CO($J$ = 2-1)/($J$ = 1-0) transitions as well as CO line broadening, which indicate shock heating/acceleration. The results support that Puppis A is located at 1.4 kpc, in the local arm. The ISM interacting with the SNR has a large mass of $\sim$10$^{4}$ $M_{\odot}$ which is dominated by HI, showing good spatial correspondence with the Fermi-LAT gamma-ray image. This favors the hadronic origin of the gamma-rays, while additional contribution of the leptonic component is not excluded. The distribution of the X-ray ionization timescales within the shell suggests that the shock front ionized various parts of the ISM at epochs ranging over a few to ten 1000 yr. We therefore suggest that the age of the SNR is around 10$^{4}$ yr as given by the largest ionization timescale. We estimate the total cosmic ray energy $W_{\rm p}$ to be 10$^{47}$ erg, which is well placed in the cosmic-ray escaping phase of an age-$W_{\rm p}$ plot including more than ten SNRs.


title: Negative Sampling for Contrastive Representation Learning: A Review

abstract: The learn-to-compare paradigm of contrastive representation learning (CRL), which compares positive samples with negative ones for representation learning, has achieved great success in a wide range of domains, including natural language processing, computer vision, information retrieval and graph learning. While many research works focus on data augmentations, nonlinear transformations or other certain parts of CRL, the importance of negative sample selection is usually overlooked in literature. In this paper, we provide a systematic review of negative sampling (NS) techniques and discuss how they contribute to the success of CRL. As the core part of this paper, we summarize the existing NS methods into four categories with pros and cons in each genre, and further conclude with several open research questions as future directions. By generalizing and aligning the fundamental NS ideas across multiple domains, we hope this survey can accelerate cross-domain knowledge sharing and motivate future researches for better CRL.


title: The Quantum and Classical Streaming Complexity of Quantum and Classical Max-Cut

abstract: We investigate the space complexity of two graph streaming problems: Max-Cut and its quantum analogue, Quantum Max-Cut. Previous work by Kapralov and Krachun [STOC `19] resolved the classical complexity of the \emph{classical} problem, showing that any $(2 - \varepsilon)$-approximation requires $\Omega(n)$ space (a $2$-approximation is trivial with $\textrm{O}(\log n)$ space). We generalize both of these qualifiers, demonstrating $\Omega(n)$ space lower bounds for $(2 - \varepsilon)$-approximating Max-Cut and Quantum Max-Cut, even if the algorithm is allowed to maintain a quantum state. As the trivial approximation algorithm for Quantum Max-Cut only gives a $4$-approximation, we show tightness with an algorithm that returns a $(2 + \varepsilon)$-approximation to the Quantum Max-Cut value of a graph in $\textrm{O}(\log n)$ space. Our work resolves the quantum and classical approximability of quantum and classical Max-Cut using $\textrm{o}(n)$ space. We prove our lower bounds through the techniques of Boolean Fourier analysis. We give the first application of these methods to sequential one-way quantum communication, in which each player receives a quantum message from the previous player, and can then perform arbitrary quantum operations on it before sending it to the next. To this end, we show how Fourier-analytic techniques may be used to understand the application of a quantum channel.


title: LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detection

abstract: The estimation of uncertainty in robotic vision, such as 3D object detection, is an essential component in developing safe autonomous systems aware of their own performance. However, the deployment of current uncertainty estimation methods in 3D object detection remains challenging due to timing and computational constraints. To tackle this issue, we propose LiDAR-MIMO, an adaptation of the multi-input multi-output (MIMO) uncertainty estimation method to the LiDAR-based 3D object detection task. Our method modifies the original MIMO by performing multi-input at the feature level to ensure the detection, uncertainty estimation, and runtime performance benefits are retained despite the limited capacity of the underlying detector and the large computational costs of point cloud processing. We compare LiDAR-MIMO with MC dropout and ensembles as baselines and show comparable uncertainty estimation results with only a small number of output heads. Further, LiDAR-MIMO can be configured to be twice as fast as MC dropout and ensembles, while achieving higher mAP than MC dropout and approaching that of ensembles.


title: Quantum Error Mitigation by Pauli Check Sandwiching

abstract: We describe and analyze an error mitigation technique that uses multiple pairs of parity checks to detect the presence of errors. Each pair of checks uses one ancilla qubit to detect a component of the error operator and represents one layer of the technique. We build on the results on extended flag gadgets and put it on a firm theoretical foundation. We prove that this technique can recover the noiseless state under the assumption of noise not affecting the checks. The method does not incur any encoding overhead and instead chooses the checks based on the input circuit. We provide an algorithm for obtaining such checks for an arbitrary target circuit. Since the method applies to any circuit and input state, it can be easily combined with other error mitigation techniques. We evaluate the performance of the proposed methods using extensive numerical simulations on 1,850 random input circuits composed of Clifford gates and non-Clifford single-qubit rotations, a class of circuits encompassing most commonly considered variational algorithm circuits. We observe average improvements in fidelity of 34 percentage points with six layers of checks.


title: THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption

abstract: As more and more pre-trained language models adopt on-cloud deployment, the privacy issues grow quickly, mainly for the exposure of plain-text user data (e.g., search history, medical record, bank account). Privacy-preserving inference of transformer models is on the demand of cloud service users. To protect privacy, it is an attractive choice to compute only with ciphertext in homomorphic encryption (HE). However, enabling pre-trained models inference on ciphertext data is difficult due to the complex computations in transformer blocks, which are not supported by current HE tools yet. In this work, we introduce $\textit{THE-X}$, an approximation approach for transformers, which enables privacy-preserving inference of pre-trained models developed by popular frameworks. $\textit{THE-X}$ proposes a workflow to deal with complex computation in transformer networks, including all the non-polynomial functions like GELU, softmax, and LayerNorm. Experiments reveal our proposed $\textit{THE-X}$ can enable transformer inference on encrypted data for different downstream tasks, all with negligible performance drop but enjoying the theory-guaranteed privacy-preserving advantage.


title: Resilience in Industrial Internet of Things Systems: A Communication Perspective

abstract: Industrial Internet of Things is an ultra-large-scale system that is much more sophisticated and fragile than conventional industrial platforms. The effective management of such a system relies heavily on the resilience of the network, especially the communication part. Imperative as resilient communication is, there is not enough attention from literature and a standardized framework is still missing. In awareness of these, this paper intends to provide a systematic overview of resilience in IIoT with a communication perspective, aiming to answer the questions of why we need it, what it is, how to enhance it, and where it can be applied. Specifically, we emphasize the urgency of resilience studies via examining existing literature and analyzing malfunction data from a real satellite communication system. Resilience-related concepts and metrics, together with standardization efforts are then summarized and discussed, presenting a basic framework for analyzing the resilience of the system before, during, and after disruptive events. On the basis of the framework, key resilience concerns associated with the design, deployment, and operation of IIoT are briefly described to shed light on the methods for resilience enhancement. Promising resilient applications in different IIoT sectors are also introduced to highlight the opportunities and challenges in practical implementations.


title: Spin symmetry energy and equation of state of spin-polarized neutron star matter

abstract: Equation of states (EOS) of the spin-polarized nuclear matter (NM) is studied within the Hartree-Fock (HF) formalism using the realistic density dependent nucleon-nucleon interaction. With a nonzero fraction $\Delta$ of spin-polarized baryons in NM, the spin- and spin-isospin dependent parts of the HF energy density give rise to the \emph{spin symmetry} energy that behaves in about the same manner as the \emph{isospin symmetry} energy, widely discussed in literature as the nuclear symmetry energy. The present HF study shows a strong correlation between the spin symmetry energy and nuclear symmetry energy over the whole range of baryon densities. The important contribution of the spin symmetry energy to the EOS of the spin-polarized NM is found to be comparable with that of the nuclear symmetry energy to the EOS of the isospin-polarized or asymmetric (neutron-rich) NM. Based on the HF energy density, the EOS of the spin-polarized ($\beta$-stable) np$e\mu$ matter is obtained for the determination of the macroscopic properties of neutron star (NS). A realistic density dependence of the spin-polarized fraction $\Delta$ have been suggested to explore the impact of the spin symmetry energy to the gravitational mass $M$ and radius $R$, as well as the tidal deformability of NS. Given the empirical constrains inferred from a coherent Bayesian analysis of gravitational wave signals of the NS merger GW170817 and the observed masses of the heaviest pulsars, the strong impacts of the spin symmetry energy $W$, nuclear symmetry energy $S$, and nuclear incompressibility $K$ to the EOS of nucleonic matter in magnetar were revealed.


title: Inter-BIN: Interaction-based Cross-architecture IoT Binary Similarity Comparison

abstract: The big wave of Internet of Things (IoT) malware reflects the fragility of the current IoT ecosystem. Research has found that IoT malware can spread quickly on devices of different processer architectures, which leads our attention to cross-architecture binary similarity comparison technology. The goal of binary similarity comparison is to determine whether the semantics of two binary snippets is similar. Existing learning-based approaches usually learn the representations of binary code snippets individually and perform similarity matching based on the distance metric, without considering inter-binary semantic interactions. Moreover, they often rely on the large-scale external code corpus for instruction embeddings pre-training, which is heavyweight and easy to suffer the out-of-vocabulary (OOV) problem. In this paper, we propose an interaction-based cross-architecture IoT binary similarity comparison system, Inter-BIN. Our key insight is to introduce interaction between instruction sequences by co-attention mechanism, which can flexibly perform soft alignment of semantically related instructions from different architectures. And we design a lightweight multi-feature fusion-based instruction embedding method, which can avoid the heavy workload and the OOV problem of previous approaches. Extensive experiments show that Inter-BIN can significantly outperform state-of-the-art approaches on cross-architecture binary similarity comparison tasks of different input granularities. Furthermore, we present an IoT malware function matching dataset from real network environments, CrossMal, containing 1,878,437 cross-architecture reuse function pairs. Experimental results on CrossMal prove that Inter-BIN is practical and scalable on real-world binary similarity comparison collections.


title: Adaptive Online Learning of Quantum States

abstract: In the fundamental problem of shadow tomography, the goal is to efficiently learn an unknown $d$-dimensional quantum state using projective measurements. However, it is rarely the case that the underlying state remains stationary: changes may occur due to measurements, environmental noise, or an underlying Hamiltonian state evolution. In this paper we adopt tools from adaptive online learning to learn a changing state, giving adaptive and dynamic regret bounds for online shadow tomography that are polynomial in the number of qubits and sublinear in the number of measurements. Our analysis utilizes tools from complex matrix analysis to cope with complex numbers, which may be of independent interest in online learning. In addition, we provide numerical experiments that corroborate our theoretical results.


title: Distributed Estimation for Interconnected Systems with Arbitrary Coupling Structures

abstract: This paper is concerned with the problem of distributed estimation for time-varying interconnected dynamic systems with arbitrary coupling structures. To guarantee the robustness of the designed estimators, novel distributed stability conditions are proposed with only local information and the information from neighbors. Then, simplified stability conditions which do not require timely exchange of neighbors' estimator gain information is further developed for systems with delayed communication. By merging these subsystem-level stability conditions and the optimization-based estimator gain design, the distributed, stable and optimal estimators are proposed. Quite notably, these optimization solutions can be easily obtained by standard software packages, and it is also shown that the designed estimators are scalable in the sense of adding or subtracting subsystems. Finally, an illustrative example is employed to show the effectiveness of the proposed methods.


title: Cross-domain Detection Transformer based on Spatial-aware and Semantic-aware Token Alignment

abstract: Detection transformers like DETR have recently shown promising performance on many object detection tasks, but the generalization ability of those methods is still quite challenging for cross-domain adaptation scenarios. To address the cross-domain issue, a straightforward way is to perform token alignment with adversarial training in transformers. However, its performance is often unsatisfactory as the tokens in detection transformers are quite diverse and represent different spatial and semantic information. In this paper, we propose a new method called Spatial-aware and Semantic-aware Token Alignment (SSTA) for cross-domain detection transformers. In particular, we take advantage of the characteristics of cross-attention as used in detection transformer and propose the spatial-aware token alignment (SpaTA) and the semantic-aware token alignment (SemTA) strategies to guide the token alignment across domains. For spatial-aware token alignment, we can extract the information from the cross-attention map (CAM) to align the distribution of tokens according to their attention to object queries. For semantic-aware token alignment, we inject the category information into the cross-attention map and construct domain embedding to guide the learning of a multi-class discriminator so as to model the category relationship and achieve category-level token alignment during the entire adaptation process. We conduct extensive experiments on several widely-used benchmarks, and the results clearly show the effectiveness of our proposed method over existing state-of-the-art baselines.


title: Public Release of A-SLOTH: Ancient Stars and Local Observables by Tracing Halos

abstract: The semi-analytical model A-SLOTH (Ancient Stars and Local Observables by Tracing Halos) is the first public code that connects the formation of the first stars and galaxies to observables. After several successful projects with this model, we publish the source code and describe the public version in this paper. The model is based on dark matter merger trees that can either be generated based on Extended Press-Schechter theory or that can be imported from dark matter simulations. On top of these merger trees, A-SLOTH applies analytical recipes for baryonic physics to model the formation of both metal-free and metal-poor stars and the transition between them with unprecedented precision and fidelity. A-SLOTH samples individual stars and includes radiative, chemical, and mechanical feedback. It is calibrated based on six observables, such as the optical depth to Thomson scattering, the stellar mass of the Milky Way and its satellite galaxies, the number of extremely-metal poor stars, and the cosmic star formation rate density at high redshift. A-SLOTH has versatile applications with moderate computational requirements. It can be used to constrain the properties of the first stars and high-z galaxies based on local observables, predicts properties of the oldest and most metal-poor stars in the Milky Way, can serve as a subgrid model for larger cosmological simulations, and predicts next-generation observables of the early Universe, such as supernova rates or gravitational wave events.