title: Robust Weight Perturbation for Adversarial Training

abstract: Overfitting widely exists in adversarial robust training of deep networks. An effective remedy is adversarial weight perturbation, which injects the worst-case weight perturbation during network training by maximizing the classification loss on adversarial examples. Adversarial weight perturbation helps reduce the robust generalization gap; however, it also undermines the robustness improvement. A criterion that regulates the weight perturbation is therefore crucial for adversarial training. In this paper, we propose such a criterion, namely Loss Stationary Condition (LSC) for constrained perturbation. With LSC, we find that it is essential to conduct weight perturbation on adversarial data with small classification loss to eliminate robust overfitting. Weight perturbation on adversarial data with large classification loss is not necessary and may even lead to poor robustness. Based on these observations, we propose a robust perturbation strategy to constrain the extent of weight perturbation. The perturbation strategy prevents deep networks from overfitting while avoiding the side effect of excessive weight perturbation, significantly improving the robustness of adversarial training. Extensive experiments demonstrate the superiority of the proposed method over the state-of-the-art adversarial training methods.


title: Gaeta resolutions and strange duality over rational surfaces

abstract: Over the projective plane and at most two-step blowups of Hirzebruch surfaces, where there are strong full exceptional sequences of line bundles, we obtain foundational results about Gaeta resolutions of coherent sheaves by these line bundles. Under appropriate conditions, we show the locus of semistable sheaves not admitting Gaeta resolutions has codimension at least 2. We then study Le Potier's strange duality conjecture. Over these surfaces, for two orthogonal numerical classes where one has rank one and the other has sufficiently positive first Chern class, we show that the strange morphism is injective. The main step in the proof is to use Gaeta resolutions to show that certain relevant Quot schemes are finite and reduced, allowing them to be enumerated using the authors' previous paper.


title: Lepton Flavour Violation Identification in Tau Decay ($\tau^{-} \rightarrow \mu^{-}\mu^{-}\mu^{+}$) Using Artificial Intelligence

abstract: The discovery of neutrino oscillation, proving that neutrinos do have masses, reveals the misfits of particles in the current Standard Model (SM) theory. In theory, neutrinos having masses could result in lepton flavour not being a symmetry called Lepton Flavour Violation (LFV). While SM theory extensions allowed LFV processes, their branching fractions are too small, making them unobservable even with the strongest equipment up-to-date. With that, scientists in recent years have generated LFV-like processes from the combined LHCb and Monte-Carlo-Simulated data in an attempt to identify LFV using Artificial Intelligence (AI), specifically Machine Learning (ML) and Deep Learning (DL). In this paper, the performance of several algorithms in AI has been presented, such as XGBoost, LightGBM, custom 1-D Dense Block Neural Networks (DBNNs), and custom 1-D Convolutional Neural Networks (CNNs) in identifying LFV signals, specifically $\tau^{-} \rightarrow \mu^{-}\mu^{-}\mu^{+}$ decay from the combined LHCb and Monte-Carlo-Simulated data that imitates the signatures of the said decay. Kolmogorov-Smirnov (KS) and Cramer-von Mises (CvM) tests were also conducted to verify the validity of predictions for each of the trained algorithms. The result shows decent performances among algorithms, except for the LightGBM, for failing the CvM test, and a 20-layered CNN for having recorded a considerably low AUC. Meanwhile, XGBoost and a 10-layered DBNN recorded the highest AUC of 0.88. The main contribution of this paper is the extensive experiment involving custom DBNN and CNN algorithms in different layers, all of which have been rarely used in the past years in identifying LFV-like signatures, unlike GBMs and tree-based algorithms, which have been more popular in the said task.


title: Adaptive Sampling for Discovery

abstract: In this paper, we study a sequential decision-making problem, called Adaptive Sampling for Discovery (ASD). Starting with a large unlabeled dataset, algorithms for ASD adaptively label the points with the goal to maximize the sum of responses. This problem has wide applications to real-world discovery problems, for example drug discovery with the help of machine learning models. ASD algorithms face the well-known exploration-exploitation dilemma. The algorithm needs to choose points that yield information to improve model estimates but it also needs to exploit the model. We rigorously formulate the problem and propose a general information-directed sampling (IDS) algorithm. We provide theoretical guarantees for the performance of IDS in linear, graph and low-rank models. The benefits of IDS are shown in both simulation experiments and real-data experiments for discovering chemical reaction conditions.


title: High Dielectric Sheet to reduce Electric Fields and Flatten Magnetic Fields in Self-decoupled Radiofrequency coils for MR Imaging

abstract: High impedance RF coils, such as self-decoupled coils, reduce the electromagnetic coupling between the coil elements and eliminates the use of complex decoupling technologies. Although the high impedance design promises excellent decoupling between the coil elements, it also results in high electric fields across the RF coil, leading to potential safety problems during imaging. It also causes B1 field asymmetry, ultimately leading to difficulties in imaging quantification. In this study, we propose and investigate using a high dielectric sheet to reduce the electric fields across the coil and achieve excellent electromagnetic decoupling among the coil elements, thereby ensuring safer MRI at ultra-high fields and maintaining high imaging performance.


title: Temporal Multiresolution Graph Neural Networks For Epidemic Prediction

abstract: In this paper, we introduce Temporal Multiresolution Graph Neural Networks (TMGNN), the first architecture that both learns to construct the multiscale and multiresolution graph structures and incorporates the time-series signals to capture the temporal changes of the dynamic graphs. We have applied our proposed model to the task of predicting future spreading of epidemic and pandemic based on the historical time-series data collected from the actual COVID-19 pandemic and chickenpox epidemic in several European countries, and have obtained competitive results in comparison to other previous state-of-the-art temporal architectures and graph learning algorithms. We have shown that capturing the multiscale and multiresolution structures of graphs is important to extract either local or global information that play a critical role in understanding the dynamic of a global pandemic such as COVID-19 which started from a local city and spread to the whole world. Our work brings a promising research direction in forecasting and mitigating future epidemics and pandemics.


title: LatticeOPT: A heuristic topology optimization framework for thin-walled, 2D extruded lattices

abstract: This paper introduces a heuristic topology optimization framework for thin-walled, 2D extruded lattice structures subject to complex high-speed loading. The proposed framework optimizes the wall thickness distribution in the lattice cross section through different thickness update schemes, inspired by the idea of equalization of absorbed energy density across all lattice walls. The proposed framework is ubiquitous and can be used in explicit dynamic simulations, which is the primary numerical method used in crashworthiness studies. No information on the material tangent stiffness matrix is required, and complex material behaviors and complex loading conditions can be handled. Three numerical examples are presented to demonstrate framework capabilities: (1) Optimization of a long, slender column under axial compression to maximize specific energy absorption, (2) Optimization of a lattice-filled sandwich panel under off-center blast loading to minimize material damage, (3) Generation of a periodic lattice core design under blast loading. The results show that the framework can effectively increase specific energy absorption or minimize material damage with as few as 25 finite element simulations and optimization iterations.


title: Walle: An End-to-End, General-Purpose, and Large-Scale Production System for Device-Cloud Collaborative Machine Learning

abstract: To break the bottlenecks of mainstream cloud-based machine learning (ML) paradigm, we adopt device-cloud collaborative ML and build the first end-to-end and general-purpose system, called Walle, as the foundation. Walle consists of a deployment platform, distributing ML tasks to billion-scale devices in time; a data pipeline, efficiently preparing task input; and a compute container, providing a cross-platform and high-performance execution environment, while facilitating daily task iteration. Specifically, the compute container is based on Mobile Neural Network (MNN), a tensor compute engine along with the data processing and model execution libraries, which are exposed through a refined Python thread-level virtual machine (VM) to support diverse ML tasks and concurrent task execution. The core of MNN is the novel mechanisms of operator decomposition and semi-auto search, sharply reducing the workload in manually optimizing hundreds of operators for tens of hardware backends and further quickly identifying the best backend with runtime optimization for a computation graph. The data pipeline introduces an on-device stream processing framework to enable processing user behavior data at source. The deployment platform releases ML tasks with an efficient push-then-pull method and supports multi-granularity deployment policies. We evaluate Walle in practical e-commerce application scenarios to demonstrate its effectiveness, efficiency, and scalability. Extensive micro-benchmarks also highlight the superior performance of MNN and the Python thread-level VM. Walle has been in large-scale production use in Alibaba, while MNN has been open source with a broad impact in the community.


title: GraMeR: Graph Meta Reinforcement Learning for Multi-Objective Influence Maximization

abstract: Influence maximization (IM) is a combinatorial problem of identifying a subset of nodes called the seed nodes in a network (graph), which when activated, provide a maximal spread of influence in the network for a given diffusion model and a budget for seed set size. IM has numerous applications such as viral marketing, epidemic control, sensor placement and other network-related tasks. However, the uses are limited due to the computational complexity of current algorithms. Recently, learning heuristics for IM have been explored to ease the computational burden. However, there are serious limitations in current approaches such as: (1) IM formulations only consider influence via spread and ignore self activation; (2) scalability to large graphs; (3) generalizability across graph families; (4) low computational efficiency with a large running time to identify seed sets for every test network. In this work, we address each of these limitations through a unique approach that involves (1) formulating a generic IM problem as a Markov decision process that handles both intrinsic and influence activations; (2) employing double Q learning to estimate seed nodes; (3) ensuring scalability via sub-graph based representations; and (4) incorporating generalizability via meta-learning across graph families. Extensive experiments are carried out in various standard networks to validate performance of the proposed Graph Meta Reinforcement learning (GraMeR) framework. The results indicate that GraMeR is multiple orders faster and generic than conventional approaches.


title: A geometric approach to characters of Hecke algebras

abstract: To any element of a connected, simply connected, semisimple complex algebraic group G and a choice of an element of the corresponding Weyl group there is an associated Lusztig variety. When the element of G is regular semisimple, the corresponding variety carries an action of the Weyl group on its (equivariant) intersection cohomology. From this action, we recover the induced characters of an element of the Kazhdan-Lusztig basis of the corresponding Hecke algebra. In type A, we prove a more precise statement: that the Frobenius character of this action is precisely the symmetric function given by the characters of a Kazhdan-Lusztig basis element. The main idea is to find celular decompositions of desingularizations of these varieties and apply the Brosnan-Chow palindromicity criterion for determining when the local invariant cycle map is an isomorphism. This recovers some results of Lusztig about character sheaves and gives a generalization of the Brosnan-Chow solution to the Sharesian-Wachs conjecture to non-codominant permutations, where singularities are involved. We also review the connections between Immanants, Hecke algebras, and Chromatic quasisymmetric functions of indifference graphs.


title: Chemical bonding in large systems using projected population analysis from real-space density functional theory calculations

abstract: We present an efficient and scalable computational approach for conducting projected population analysis from real-space finite-element (FE) based Kohn-Sham density functional theory calculations (DFT-FE). This work provides an important direction towards extracting chemical bonding information from large-scale DFT calculations on materials systems involving thousands of atoms while accommodating periodic, semi-periodic or fully non-periodic boundary conditions. Towards this, we derive the relevant mathematical expressions and develop efficient numerical implementation procedures that are scalable on multi-node CPU architectures to compute the projected overlap and Hamilton populations. The population analysis is accomplished by projecting either the self-consistently converged FE discretized Kohn-Sham orbitals, or the FE discretized Hamiltonian onto a subspace spanned by a localized atom-centred basis set. The proposed methods are implemented in a unified framework within DFT-FE code where the ground-state DFT calculations and the population analysis are performed on the same FE grid. We further benchmark the accuracy and performance of this approach on representative material systems involving periodic and non-periodic DFT calculations with LOBSTER, a widely used projected population analysis code. Finally, we discuss a case study demonstrating the advantages of our scalable approach to extract the quantitative chemical bonding information of hydrogen chemisorbed in large silicon nanoparticles alloyed with carbon, a candidate material for hydrogen storage.


title: Enhancing Sequential Recommendation with Graph Contrastive Learning

abstract: The sequential recommendation systems capture users' dynamic behavior patterns to predict their next interaction behaviors. Most existing sequential recommendation methods only exploit the local context information of an individual interaction sequence and learn model parameters solely based on the item prediction loss. Thus, they usually fail to learn appropriate sequence representations. This paper proposes a novel recommendation framework, namely Graph Contrastive Learning for Sequential Recommendation (GCL4SR). Specifically, GCL4SR employs a Weighted Item Transition Graph (WITG), built based on interaction sequences of all users, to provide global context information for each interaction and weaken the noise information in the sequence data. Moreover, GCL4SR uses subgraphs of WITG to augment the representation of each interaction sequence. Two auxiliary learning objectives have also been proposed to maximize the consistency between augmented representations induced by the same interaction sequence on WITG, and minimize the difference between the representations augmented by the global context on WITG and the local representation of the original sequence. Extensive experiments on real-world datasets demonstrate that GCL4SR consistently outperforms state-of-the-art sequential recommendation methods.


title: Most Equitable Voting Rules

abstract: In social choice theory, anonymity (all agents being treated equally) and neutrality (all alternatives being treated equally) are widely regarded as ``minimal demands'' and ``uncontroversial'' axioms of equity and fairness. However, the ANR impossibility -- there is no voting rule that satisfies anonymity, neutrality, and resolvability (always choosing one winner) -- holds even in the simple setting of two alternatives and two agents. How to design voting rules that optimally satisfy anonymity, neutrality, and resolvability remains an open question. We address the optimal design question for a wide range of preferences and decisions that include ranked lists and committees. Our conceptual contribution is a novel and strong notion of most equitable refinements that optimally preserves anonymity and neutrality for any irresolute rule that satisfies the two axioms. Our technical contributions are twofold. First, we characterize the conditions for the ANR impossibility to hold under general settings, especially when the number of agents is large. Second, we propose the most-favorable-permutation (MFP) tie-breaking to compute a most equitable refinement and design a polynomial-time algorithm to compute MFP when agents' preferences are full rankings.


title: Adversarial Bandits against Arbitrary Strategies

abstract: We study the adversarial bandit problem against arbitrary strategies, in which $S$ is the parameter for the hardness of the problem and this parameter is not given to the agent. To handle this problem, we adopt the master-base framework using the online mirror descent method (OMD). We first provide a master-base algorithm with simple OMD, achieving $\tilde{O}(S^{1/2}K^{1/3}T^{2/3})$, in which $T^{2/3}$ comes from the variance of loss estimators. To mitigate the impact of the variance, we propose using adaptive learning rates for OMD and achieve $\tilde{O}(\min\{\mathbb{E}[\sqrt{SKT\rho_T(h^\dagger)}],S\sqrt{KT}\})$, where $\rho_T(h^\dagger)$ is a variance term for loss estimators.


title: Maximizing Global Model Appeal in Federated Learning

abstract: Federated learning typically considers collaboratively training a global model using local data at edge clients. Clients may have their own individual requirements, such as having a minimal training loss threshold, which they expect to be met by the global model. However, due to client heterogeneity, the global model may not meet each client's requirements, and only a small subset may find the global model appealing. In this work, we explore the problem of the global model lacking appeal to the clients due to not being able to satisfy local requirements. We propose MaxFL, which aims to maximize the number of clients that find the global model appealing. We show that having a high global model appeal is important to maintain an adequate pool of clients for training, and can directly improve the test accuracy on both seen and unseen clients. We provide convergence guarantees for MaxFL and show that MaxFL achieves a $22$-$40\%$ and $18$-$50\%$ test accuracy improvement for the training clients and unseen clients respectively, compared to a wide range of FL modeling approaches, including those that tackle data heterogeneity, aim to incentivize clients, and learn personalized or fair models.


title: Coherently Coupled Mechanical Oscillators in the Quantum Regime

abstract: Coupled harmonic oscillators are ubiquitous in physics and play a prominent role in quantum science. They are a cornerstone of quantum mechanics and quantum field theory, where second quantization relies on harmonic oscillator operators to create and annihilate particles. Descriptions of quantum tunneling, beamsplitters, coupled potential wells, "hopping terms", decoherence and many other phenomena rely on coupled harmonic oscillators. Despite their prominence, only a few experimental systems have demonstrated direct coupling between separate harmonic oscillators; these demonstrations lacked the capability for high-fidelity quantum control. Here, we realize coherent exchange of single motional quanta between harmonic oscillators -- in this case, spectrally separated harmonic modes of motion of a trapped ion crystal where the timing, strength, and phase of the coupling are controlled through the application of an oscillating electric field with suitable spatial variation. We demonstrate high-fidelity quantum state transfer, entanglement of motional modes, and Hong-Ou-Mandel-type interference. We also project a harmonic oscillator into its ground state by measurement and preserve that state during repetitions of the projective measurement, an important prerequisite for non-destructive syndrome measurement in continuous-variable quantum error correction. Controllable coupling between harmonic oscillators has potential applications in quantum information processing with continuous variables, quantum simulation, and precision measurements. It can also enable cooling and quantum logic spectroscopy involving motional modes of trapped ions that are not directly accessible.


title: Efficient Reward Poisoning Attacks on Online Deep Reinforcement Learning

abstract: We study reward poisoning attacks on online deep reinforcement learning (DRL), where the attacker is oblivious to the learning algorithm used by the agent and the dynamics of the environment. We demonstrate the intrinsic vulnerability of state-of-the-art DRL algorithms by designing a general, black-box reward poisoning framework called adversarial MDP attacks. We instantiate our framework to construct two new attacks which only corrupt the rewards for a small fraction of the total training timesteps and make the agent learn a low-performing policy. We provide a theoretical analysis of the efficiency of our attack and perform an extensive empirical evaluation. Our results show that our attacks efficiently poison agents learning in several popular classical control and MuJoCo environments with a variety of state-of-the-art DRL algorithms, such as DQN, PPO, SAC, etc.


title: Controllability analysis of directed networks in finite states based on pruning motif isomorph

abstract: The current driver nodes search methods are difficult to cope with large networks, and the solution process does not consider the node cost. In order to solve the practical control problem of networks with different node costs in finite states, this paper proposes a pruning and motif isomorph search method for driver node set. Firstly, we prove the sufficient conditions for the network to be strictly controllable under partial nodes control, then we classify the nodes and prove the equivalence controllability of the pruning network, and then we establish three models of maximum augmenting path search, local pruning and motif matching to form a complete driver nodes set search algorithm. Finally, the algorithm is validated by real networks. The results show that our method not only guarantee the accuracy of search results, but also has the low time complexity, which can efficiently handle large networks, and no more than 16.84% of the maximum driver nodes can control the whole network.


title: Physics-informed discrete element modeling for the bandgap engineering of cylinder chains

abstract: We propose an efficient method to build a simple discrete element model (DEM) that accurately simulates the oscillation of a continuum beam. The DEM is based on the Timoshenko beam theory of slender cylindrical members and their corresponding wave dynamics in assembly. This physics-informed DEM accounts for multiple vibration modes of the constituting beam elements in wide frequency ranges. We construct various DEMs mimicking cylinder chains and compare their wave dynamics with those measured in experiments to validate the proposed method. Furthermore, we construct a graded woodpile chain of slender cylinders. We experimentally and numerically investigate the frequency bandgaps of the system and demonstrate the possibility of constructing a wide bandgap by consecutively superposing multiple stop bands generated from cylinders of various lengths. This system is highly efficient in blocking propagating waves by leveraging the vibration isolation effect stemming from the local resonance of the cylinders. The proposed DEM method can be useful for investigating and designing complex vibration systems in an efficient and accurate manner. Moreover, the design approach of manipulating the frequency bandgap can be exploited for developing vibration filters and impact mitigation devices.


title: QFaaS: A Serverless Function-as-a-Service Framework for Quantum Computing

abstract: Recent breakthroughs in quantum hardware are creating opportunities for its use in many applications. However, quantum software engineering is still in its infancy with many challenges, especially dealing with the diversity of quantum programming languages and hardware platforms. To alleviate these challenges, we propose QFaaS, a novel Quantum Function-as-a-Service framework, which leverages the advantages of the serverless model and the state-of-the-art software engineering approaches to advance practical quantum computing. Our framework provides essential components of a quantum serverless platform to simplify the software development and adapt to the quantum cloud computing paradigm, such as combining hybrid quantum-classical computation, containerizing functions, and integrating DevOps features. We design QFaaS as a unified quantum computing framework by supporting well-known quantum languages and software development kits (Qiskit, Q#, Cirq, and Braket), executing the quantum tasks on multiple simulators and quantum cloud providers (IBM Quantum and Amazon Braket). This paper proposes architectural design, principal components, the life cycle of hybrid quantum-classical function, operation workflow, and implementation of QFaaS. We present two practical use cases and perform the evaluations on quantum computers and simulators to demonstrate our framework's ability to ease the burden on traditional engineers to expedite the ongoing quantum software transition.


title: Precise Learning Curves and Higher-Order Scaling Limits for Dot Product Kernel Regression

abstract: As modern machine learning models continue to advance the computational frontier, it has become increasingly important to develop precise estimates for expected performance improvements under different model and data scaling regimes. Currently, theoretical understanding of the learning curves that characterize how the prediction error depends on the number of samples is restricted to either large-sample asymptotics ($m\to\infty$) or, for certain simple data distributions, to the high-dimensional asymptotics in which the number of samples scales linearly with the dimension ($m\propto d$). There is a wide gulf between these two regimes, including all higher-order scaling relations $m\propto d^r$, which are the subject of the present paper. We focus on the problem of kernel ridge regression for dot-product kernels and present precise formulas for the mean of the test error, bias, and variance, for data drawn uniformly from the sphere with isotropic random labels in the $r$th-order asymptotic scaling regime $m\to\infty$ with $m/d^r$ held constant. We observe a peak in the learning curve whenever $m \approx d^r/r!$ for any integer $r$, leading to multiple sample-wise descent and nontrivial behavior at multiple scales.


title: EA$^2$E: Improving Consistency with Event Awareness for Document-Level Argument Extraction

abstract: Events are inter-related in documents. Motivated by the one-sense-per-discourse theory, we hypothesize that a participant tends to play consistent roles across multiple events in the same document. However recent work on document-level event argument extraction models each individual event in isolation and therefore causes inconsistency among extracted arguments across events, which will further cause discrepancy for downstream applications such as event knowledge base population, question answering, and hypothesis generation. In this work, we formulate event argument consistency as the constraints from event-event relations under the document-level setting. To improve consistency we introduce the Event-Aware Argument Extraction (EA$^2$E) model with augmented context for training and inference. Experiment results on WIKIEVENTS and ACE2005 datasets demonstrate the effectiveness of EA$^2$E compared to baseline methods.


title: Homoclinics for geodesic flows of surfaces

abstract: We prove that the geodesic flow of a Kupka-Smale riemannian metric on a closed surface has homoclinic orbits for all of its hyperbolic closed geodesics.


title: Long-Range Charge Transport in Homogeneous and Alternating-Rigidity Chains

abstract: We study the interplay of intrinsic-electronic and environmental factors on long-range charge transport across molecular chains with up to $N\sim 80$ monomers. We describe the molecular electronic structure of the chain with a tight-binding Hamiltonian. Thermal effects in the form of electron decoherence and inelastic scatterings are incorporated with the Landauer-B\"uttiker probe method. In short chains of up to 10 units we observe the crossover between coherent (tunneling, ballistic) motion and thermally-assisted conduction, with thermal effects enhancing the current beyond the quantum coherent limit. We further show that unconventional (non monotonic with size) transport behavior emerges when monomer-to-monomer electronic coupling is made large. In long chains, we identify a different behavior, with thermal effects suppressing the conductance below the coherent-ballistic limit. With the goal to identify a minimal model for molecular chains displaying unconventional and effective long-range transport, we simulate a modular polymer with alternating regions of high and low rigidity. Simulations show that, surprisingly, while charge correlations are significantly affected by structuring environmental conditions, reflecting charge delocalization, the electrical resistance displays an averaging effect, and it is not sensitive to this patterning. We conclude by arguing that efficient long-range charge transport requires engineering both internal electronic parameters and environmental conditions.


title: Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learning

abstract: Humans are capable of completing a range of challenging manipulation tasks that require reasoning jointly over modalities such as vision, touch, and sound. Moreover, many such tasks are partially-observed; for example, taking a notebook out of a backpack will lead to visual occlusion and require reasoning over the history of audio or tactile information. While robust tactile sensing can be costly to capture on robots, microphones near or on a robot's gripper are a cheap and easy way to acquire audio feedback of contact events, which can be a surprisingly valuable data source for perception in the absence of vision. Motivated by the potential for sound to mitigate visual occlusion, we aim to learn a set of challenging partially-observed manipulation tasks from visual and audio inputs. Our proposed system learns these tasks by combining offline imitation learning from a modest number of tele-operated demonstrations and online finetuning using human provided interventions. In a set of simulated tasks, we find that our system benefits from using audio, and that by using online interventions we are able to improve the success rate of offline imitation learning by ~20%. Finally, we find that our system can complete a set of challenging, partially-observed tasks on a Franka Emika Panda robot, like extracting keys from a bag, with a 70% success rate, 50% higher than a policy that does not use audio.


title: Exposing Fine-Grained Adversarial Vulnerability of Face Anti-Spoofing Models

abstract: Face anti-spoofing aims to discriminate the spoofing face images (e.g., printed photos) from live ones. However, adversarial examples greatly challenge its credibility, where adding some perturbation noise can easily change the predictions. Previous works conducted adversarial attack methods to evaluate the face anti-spoofing performance without any fine-grained analysis that which model architecture or auxiliary feature is vulnerable to the adversary. To handle this problem, we propose a novel framework to expose the fine-grained adversarial vulnerability of the face anti-spoofing models, which consists of a multitask module and a semantic feature augmentation (SFA) module. The multitask module can obtain different semantic features for further evaluation, but only attacking these semantic features fails to reflect the discrimination-related vulnerability. We then design the SFA module to introduce the data distribution prior for more discrimination-related gradient directions for generating adversarial examples. Comprehensive experiments show that SFA module increases the attack success rate by nearly 40$\%$ on average. We conduct this fine-grained adversarial analysis on different annotations, geometric maps, and backbone networks (e.g., Resnet network). These fine-grained adversarial examples can be used for selecting robust backbone networks and auxiliary features. They also can be used for adversarial training, which makes it practical to further improve the accuracy and robustness of the face anti-spoofing models.


title: Benchmarking Unsupervised Anomaly Detection and Localization

abstract: Unsupervised anomaly detection and localization, as of one the most practical and challenging problems in computer vision, has received great attention in recent years. From the time the MVTec AD dataset was proposed to the present, new research methods that are constantly being proposed push its precision to saturation. It is the time to conduct a comprehensive comparison of existing methods to inspire further research. This paper extensively compares 13 papers in terms of the performance in unsupervised anomaly detection and localization tasks, and adds a comparison of inference efficiency previously ignored by the community. Meanwhile, analysis of the MVTec AD dataset are also given, especially the label ambiguity that affects the model fails to achieve full marks. Moreover, considering the proposal of the new MVTec 3D-AD dataset, this paper also conducts experiments using the existing state-of-the-art 2D methods on this new dataset, and reports the corresponding results with analysis.


title: Informable Multi-Objective and Multi-Directional RRT* System for Robot Path Planning

abstract: Multi-objective or multi-destination path planning is crucial for mobile robotics applications such as mobility as a service, robotics inspection, and electric vehicle charging for long trips. This work proposes an anytime iterative system to concurrently solve the multi-objective path planning problem and determine the visiting order of destinations. The system is comprised of an anytime informable multi-objective and multi-directional RRT* algorithm to form a simple connected graph, and a proposed solver that consists of an enhanced cheapest insertion algorithm and a genetic algorithm to solve the relaxed traveling salesman problem in polynomial time. Moreover, a list of waypoints is often provided for robotics inspection and vehicle routing so that the robot can preferentially visit certain equipment or areas of interest. We show that the proposed system can inherently incorporate such knowledge, and can navigate through challenging topology. The proposed anytime system is evaluated on large and complex graphs built for real-world driving applications. All implementations are coded in multi-threaded C++ and are available at: https://github.com/UMich-BipedLab/IMOMD-RRTStar.


title: Anti-virus Autobots: Predicting More Infectious Virus Variants for Pandemic Prevention through Deep Learning

abstract: More infectious virus variants can arise from rapid mutations in their proteins, creating new infection waves. These variants can evade one's immune system and infect vaccinated individuals, lowering vaccine efficacy. Hence, to improve vaccine design, this project proposes Optimus PPIme - a deep learning approach to predict future, more infectious variants from an existing virus (exemplified by SARS-CoV-2). The approach comprises an algorithm which acts as a "virus" attacking a host cell. To increase infectivity, the "virus" mutates to bind better to the host's receptor. 2 algorithms were attempted - greedy search and beam search. The strength of this variant-host binding was then assessed by a transformer network we developed, with a high accuracy of 90%. With both components, beam search eventually proposed more infectious variants. Therefore, this approach can potentially enable researchers to develop vaccines that provide protection against future infectious variants before they emerge, pre-empting outbreaks and saving lives.


title: Leave-one-out Singular Subspace Perturbation Analysis for Spectral Clustering

abstract: The singular subspaces perturbation theory is of fundamental importance in probability and statistics. It has various applications across different fields. We consider two arbitrary matrices where one is a leave-one-column-out submatrix of the other one and establish a novel perturbation upper bound for the distance between the two corresponding singular subspaces. It is well-suited for mixture models and results in a sharper and finer statistical analysis than classical perturbation bounds such as Wedin's Theorem. Empowered by this leave-one-out perturbation theory, we provide a deterministic entrywise analysis for the performance of spectral clustering under mixture models. Our analysis leads to an explicit exponential error rate for spectral clustering of sub-Gaussian mixture models. For the mixture of isotropic Gaussians, the rate is optimal under a weaker signal-to-noise condition than that of L{\"o}ffler et al. (2021).


title: Underwater Acoustic Communication Channel Modeling using Reservoir Computing

abstract: Underwater acoustic (UWA) communications have been widely used but greatly impaired due to the complicated nature of the underwater environment. In order to improve UWA communications, modeling and understanding the UWA channel is indispensable. However, there exist many challenges due to the high uncertainties of the underwater environment and the lack of real-world measurement data. In this work, the capability of reservoir computing and deep learning has been explored for modeling the UWA communication channel accurately using real underwater data collected from a water tank with disturbance and from Lake Tahoe. We leverage the capability of reservoir computing for modeling dynamical systems and provided a data-driven approach to modeling the UWA channel using Echo State Network (ESN). In addition, the potential application of transfer learning to reservoir computing has been examined. Experimental results show that ESN is able to model chaotic UWA channels with better performance compared to popular deep learning models in terms of mean absolute percentage error (MAPE), specifically, ESN has outperformed deep neural network by 2% and as much as 40% in benign and chaotic UWA respectively.


title: Demonstration of LogicLib: An Expressive Multi-Language Interface over Scalable Datalog System

abstract: With the ever-increasing volume of data, there is an urgent need to provide expressive and efficient tools to support Big Data analytics. The declarative logical language Datalog has proven very effective at expressing concisely graph, machine learning, and knowledge discovery applications via recursive queries. In this demonstration, we develop Logic Library (LLib), a library of recursive algorithms written in Datalog that can be executed in BigDatalog, a Datalog engine on top of Apache Spark developed by us. LLib encapsulates complex logic-based algorithms into high-level APIs, which simplify the development and provide a unified interface akin to the one of Spark MLlib. As LLib is fully compatible with DataFrame, it enables the integrated utilization of its built-in applications and new Datalog queries with existing Spark functions, such as those provided by MLlib and Spark SQL. With a variety of examples, we will (i) show how to write programs with LLib to express a variety of applications; (ii) illustrate its user experience in Apache Spark ecosystem; and (iii) present a user-friendly interface to interact with the LLib framework and monitor the query results.


title: Molecular Gas Structures traced by $^{13}$CO Emission in the 18,190 $^{12}$CO Molecular Clouds from the MWISP Survey

abstract: After the morphological classification of the 18,190 $^{12}$CO molecular clouds, we further investigate the properties of their internal molecular gas structures traced by the $^{13}$CO($J=$ 1$-$0) line emissions. Using three different methods to extract the $^{13}$CO gas structures within each $^{12}$CO cloud, we find that $\sim$ 15$\%$ of $^{12}$CO clouds (2851) have $^{13}$CO gas structures and these $^{12}$CO clouds contribute about 93$\%$ of the total integrated flux of $^{12}$CO emission. In each of 2851 $^{12}$CO clouds with $^{13}$CO gas structures, the $^{13}$CO emission area generally does not exceed 70$\%$ of the $^{12}$CO emission area, and the $^{13}$CO integrated flux does not exceed 20$\%$ of the $^{12}$CO integrated flux. We reveal a strong correlation between the velocity-integrated intensities of $^{12}$CO lines and those of $^{13}$CO lines in both $^{12}$CO and $^{13}$CO emission regions. This indicates the H$_{2}$ column densities of molecular clouds are crucial for the $^{13}$CO lines emission. After linking the $^{13}$CO structure detection rates of the 18,190 $^{12}$CO molecular clouds to their morphologies, i.e. nonfilaments and filaments, we find that the $^{13}$CO gas structures are primarily detected in the $^{12}$CO clouds with filamentary morphologies. Moreover, these filaments tend to harbor more than one $^{13}$CO structure. That demonstrates filaments not only have larger spatial scales, but also have more molecular gas structures traced by $^{13}$CO lines, i.e. the local gas density enhancements. Our results favor the turbulent compression scenario for filament formation, in which dynamical compression of turbulent flows induces the local density enhancements. The nonfilaments tend to be in the low-pressure and quiescent turbulent environments of the diffuse interstellar medium.


title: Cache-Augmented Inbatch Importance Resampling for Training Recommender Retriever

abstract: Recommender retrievers aim to rapidly retrieve a fraction of items from the entire item corpus when a user query requests, with the representative two-tower model trained with the log softmax loss. For efficiently training recommender retrievers on modern hardwares, inbatch sampling, where the items in the mini-batch are shared as negatives to estimate the softmax function, has attained growing interest. However, existing inbatch sampling based strategies just correct the sampling bias of inbatch items with item frequency, being unable to distinguish the user queries within the mini-batch and still incurring significant bias from the softmax. In this paper, we propose a Cache-Augmented Inbatch Importance Resampling (XIR) for training recommender retrievers, which not only offers different negatives to user queries with inbatch items, but also adaptively achieves a more accurate estimation of the softmax distribution. Specifically, XIR resamples items for the given mini-batch training pairs based on certain probabilities, where a cache with more frequently sampled items is adopted to augment the candidate item set, with the purpose of reusing the historical informative samples. XIR enables to sample query-dependent negatives based on inbatch items and to capture dynamic changes of model training, which leads to a better approximation of the softmax and further contributes to better convergence. Finally, we conduct experiments to validate the superior performance of the proposed XIR compared with competitive approaches.


title: Observation of Supersymmetry and its Spontaneous Breaking in a Trapped Ion Quantum Simulator

abstract: Supersymmetry (SUSY) helps solve the hierarchy problem in high-energy physics and provides a natural groundwork for unifying gravity with other fundamental interactions. While being one of the most promising frameworks for theories beyond the Standard Model, its direct experimental evidence in nature still remains to be discovered. Here we report experimental realization of a supersymmetric quantum mechanics (SUSY QM) model, a reduction of the SUSY quantum field theory for studying its fundamental properties, using a trapped ion quantum simulator. We demonstrate the energy degeneracy caused by SUSY in this model and the spontaneous SUSY breaking. By a partial quantum state tomography of the spin-phonon coupled system, we explicitly measure the supercharge of the degenerate ground states, which are superpositions of the bosonic and the fermionic states. Our work demonstrates the trapped-ion quantum simulator as an economic yet powerful platform to study versatile physics in a single well-controlled system.


title: Attosecond Entangled Photons from Two-Photon Decay of Metastable Atoms: A Source for Attosecond Experiments and Beyond

abstract: We propose the generation of attosecond entangled bi-photons in the extreme-ultraviolet regime by two-photon decay of a metastable atomic state as a source similar to spontaneous parametric down-conversion photons. The 1s2s $^1S_0$ metastable state in helium decays to the ground state by emission of two energy-time entangled photons with a photon bandwidth equal to the total energy spacing of 20.62 eV. This results in a pair correlation time in the attosecond regime making these entangled photons a highly suitable source for attosecond pump-probe experiments. The bi-photon generation rate from a direct four photon excitation of helium at 240 nm is calculated and used to assess some feasible schemes to generate these bi-photons. Possible applications of entangled bi-photons in attosecond time scale experiments, and a discussion of their potential to reach the zeptosecond regime are presented.


title: The vibrational modes of simplicial molecules

abstract: Consider a "simplicial molecule": $n$ equal point masses placed at the vertices of a regular $(n-1)$-simplex, connected by ${n \choose 2}$ identical springs. We apply the representation theory of the symmetric group $S_n$ to compute its vibrational modes.

categories: physics.class-ph math.CO math.HO math.RT


title: Sustaining Rabi oscillations by using a phase-tunable image drive

abstract: Recent electron spin resonance experiments on CaWO$_4$:Gd$^{3+}$ and on other magnetic impurities have demonstrated that sustained Rabi oscillations can be created by driving a magnetic moment with a microwave field frequency slightly larger than the Larmor frequency and tuned to the Floquet resonance together with another microwave field (image drive). These observations are confirmed by the new experimental results reported in this paper. We investigate several mechanisms of decoherence and dissipation by using a combination of numerical and analytical techniques. The first microscopic model describes a magnetic moment in external magnetic fields, interacting with a bath of two-level systems acting as a source of decoherence and dissipation. The second model describes a collection of the identical, interacting magnetics moments, all subject to the same magnetic fields. In this case, the many-body interactions causes a decay of the Rabi oscillations. In addition, we also study the effect of the inhomogeneity of the microwave radiation on the decay of the Rabi oscillations. Our simulation results show that the dynamics of a magnetic moment subject to the two microwave fields with different frequencies and in contact with an environment is highly nontrivial. We show that under appropriate conditions, and in particular at the Floquet resonance, the magnetization exhibits sustained Rabi oscillations, in some cases with additional beatings. Although these two microscopic models separately describe the experimental data well, a simulation study that simultaneously accounts for both types of interactions is currently prohibitively costly. To gain further insight into the microscopic dynamics of these two different models, we study the time dependence of the bath and system energy and of the correlations of the spins, data that is not readily accessible experimentally.


title: A search for photons with energies above $2{\times}10^{17}$ eV using hybrid data from the low-energy extensions of the Pierre Auger Observatory

abstract: Ultra-high-energy photons with energies exceeding $10^{17}$ eV offer a wealth of connections to different aspects of cosmic-ray astrophysics as well as to gamma-ray and neutrino astronomy. The recent observations of photons with energies in the $10^{15}$ eV range further motivate searches for even higher-energy photons. In this paper, we present a search for photons with energies exceeding $2{\times}10^{17}$ eV using about 5.5 years of hybrid data from the low-energy extensions of the Pierre Auger Observatory. The upper limits on the integral photon flux derived here are the most stringent ones to date in the energy region between $10^{17}$ and $10^{18}$ eV.


title: Prompt-aligned Gradient for Prompt Tuning

abstract: Thanks to the large pre-trained vision-language models (VLMs) like CLIP, we can craft a zero-shot classifier by "prompt", e.g., the confidence score of an image being "[CLASS]" can be obtained by using the VLM provided similarity measure between the image and the prompt sentence "a photo of a [CLASS]". Therefore, prompt shows a great potential for fast adaptation of VLMs to downstream tasks if we fine-tune the prompt-based similarity measure. However, we find a common failure that improper fine-tuning may not only undermine the prompt's inherent prediction for the task-related classes, but also for other classes in the VLM vocabulary. Existing methods still address this problem by using traditional anti-overfitting techniques such as early stopping and data augmentation, which lack a principled solution specific to prompt. We present Prompt-aligned Gradient, dubbed ProGrad, to prevent prompt tuning from forgetting the the general knowledge learned from VLMs. In particular, ProGrad only updates the prompt whose gradient is aligned (or non-conflicting) to the "general direction", which is represented as the gradient of the KL loss of the pre-defined prompt prediction. Extensive experiments demonstrate the stronger few-shot generalization ability of ProGrad over state-of-the-art prompt tuning methods. Codes are available at https://github.com/BeierZhu/Prompt-align.


title: Existence, uniqueness and stability of an inverse problem for two-dimensional convective Brinkman-Forchheimer equations with the integral overdetermination

abstract: In this article, we study an inverse problem for the following convective Brinkman-Forchheimer (CBF) equations: \begin{align*} \boldsymbol{u}_t-\mu \Delta\boldsymbol{u}+(\boldsymbol{u}\cdot\nabla)\boldsymbol{u}+\alpha\boldsymbol{u}+\beta|\boldsymbol{u}|^{r-1}\boldsymbol{u}+\nabla p=\boldsymbol{F}:=f \boldsymbol{g}, \ \ \ \nabla\cdot\boldsymbol{u}=0, \end{align*} in a bounded domain $\Omega\subset\mathbb{R}^2$ with smooth boundary $\partial\Omega$, where $\alpha,\beta,\mu>0$ and $r\in[1,3]$. The investigated inverse problem consists of reconstructing the vector-valued velocity function $\boldsymbol{u}$, the pressure field $p$ and the scalar function $f$. For the divergence free initial data $\boldsymbol{u}_0 \in \mathbb{L}^2(\Omega)$, we prove the existence of a solution to the inverse problem for two-dimensional CBF equations with the integral overdetermination condition, by showing the existence of a unique fixed point for an equivalent operator equation (using an extension of the contraction mapping theorem). Moreover, we establish the uniqueness and Lipschitz stability results of the solution to the inverse problem for 2D CBF equations with $r \in[1,3]$.


title: Measuring and mitigating voting access disparities: a study of race and polling locations in Florida and North Carolina

abstract: Voter suppression and associated racial disparities in access to voting are long-standing civil rights concerns in the United States. Barriers to voting have taken many forms over the decades. A history of violent explicit discouragement has shifted to more subtle access limitations that can include long lines and wait times, long travel times to reach a polling station, and other logistical barriers to voting. Our focus in this work is on quantifying disparities in voting access pertaining to the overall time-to-vote, and how they could be remedied via a better choice of polling location or provisioning more sites where voters can cast ballots. However, appropriately calibrating access disparities is difficult because of the need to account for factors such as population density and different community expectations for reasonable travel times. In this paper, we quantify access to polling locations, developing a methodology for the calibrated measurement of racial disparities in polling location "load" and distance to polling locations. We apply this methodology to a study of real-world data from Florida and North Carolina to identify disparities in voting access from the 2020 election. We also introduce algorithms, with modifications to handle scale, that can reduce these disparities by suggesting new polling locations from a given list of identified public locations (including schools and libraries). Applying these algorithms on the 2020 election location data also helps to expose and explore tradeoffs between the cost of allocating more polling locations and the potential impact on access disparities. The developed voting access measurement methodology and algorithmic remediation technique is a first step in better polling location assignment.


title: Emergence of cosmic space and its connection with thermodynamic principles

abstract: The recent research on the connection between gravity and thermodynamics suggests that gravity could be an emergent phenomenon. Following this, Padmanabhan proposed a novel idea that the expansion of the universe can be interpreted as equivalent to the emergence of space with the progress of cosmic time. In this approach, the expansion of the universe is described by what is known as the law of emergence, which states that the expansion of the universe is driven by the difference between the number of bulk and surface degrees of freedom in a region bounded by the Hubble radius. This principle correctly reproduces the standard evolution of a Friedmann universe. We establish the connection of the law of emergence, which is conceptually different from the conventional paradigm to describe cosmology, with other well-established results in thermodynamics. It has been shown that the law of emergence can be derived from the unified first law of thermodynamics, which can then be considered as the backbone of the law. However, the law of emergence is rich in structure than implied by the First law thermodynamics alone. It further explains the evolution of the universe towards a state of maximum horizon entropy. Following this, it can be considered that the first law of thermodynamics, along with the additional constraints imposed by the maximisation of the horizon entropy, can together lead to the law of emergence. In the present article, we first make a brief review of Padmanabhan's proposal and then studies its connection with the thermodynamics of the horizon in the context of Einstein's, Gauss-Bonnet, and more general Lovelock gravity theories.


title: Nonlinear stability of the two-jet Kolmogorov type flow on the unit sphere under a perturbation with nondissipative part

abstract: We consider the vorticity form of the Navier-Stokes equations on the two-dimensional unit sphere and study the nonlinear stability of the two-jet Kolmogorov type flow which is a stationary solution given by the zonal spherical harmonic function of degree two. In particular, we assume that a perturbation contains a nondissipative part given by a linear combination of the spherical harmonics of degree one and investigate the effect of the nondissipative part on the long-time behavior of the perturbation through the convection term. We show that the nondissipative part of a weak solution to the nonlinear stability problem is preserved in time for all initial data. Moreover, we prove that the dissipative part of the weak solution converges exponentially in time towards an equilibrium which is expressed explicitly in terms of the nondissipative part of the initial data and does not vanish in general. In particular, it turns out that the asymptotic behavior of the weak solution is finally determined by a system of linear ordinary differential equations. To prove these results, we make use of properties of Killing vector fields on a manifold. We also consider the case of a rotating sphere.


title: Compressible-composable NeRF via Rank-residual Decomposition

abstract: Neural Radiance Field (NeRF) has emerged as a compelling method to represent 3D objects and scenes for photo-realistic rendering. However, its implicit representation causes difficulty in manipulating the models like the explicit mesh representation. Several recent advances in NeRF manipulation are usually restricted by a shared renderer network, or suffer from large model size. To circumvent the hurdle, in this paper, we present an explicit neural field representation that enables efficient and convenient manipulation of models. To achieve this goal, we learn a hybrid tensor rank decomposition of the scene without neural networks. Motivated by the low-rank approximation property of the SVD algorithm, we propose a rank-residual learning strategy to encourage the preservation of primary information in lower ranks. The model size can then be dynamically adjusted by rank truncation to control the levels of detail, achieving near-optimal compression without extra optimization. Furthermore, different models can be arbitrarily transformed and composed into one scene by concatenating along the rank dimension. The growth of storage cost can also be mitigated by compressing the unimportant objects in the composed scene. We demonstrate that our method is able to achieve comparable rendering quality to state-of-the-art methods, while enabling extra capability of compression and composition. Code will be made available at https://github.com/ashawkey/CCNeRF.


title: You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction

abstract: Challenging illumination conditions (low-light, under-exposure and over-exposure) in the real world not only cast an unpleasant visual appearance but also taint the computer vision tasks. After camera captures the raw-RGB data, it renders standard sRGB images with image signal processor (ISP). By decomposing ISP pipeline into local and global image components, we propose a lightweight fast Illumination Adaptive Transformer (IAT) to restore the normal lit sRGB image from either low-light or under/over-exposure conditions. Specifically, IAT uses attention queries to represent and adjust the ISP-related parameters such as colour correction, gamma correction. With only ~90k parameters and ~0.004s processing speed, our IAT consistently achieves superior performance over SOTA on the current benchmark low-light enhancement and exposure correction datasets. Competitive experimental performance also demonstrates that our IAT significantly enhances object detection and semantic segmentation tasks under various light conditions. Training code and pretrained model is available at https://github.com/cuiziteng/Illumination-Adaptive-Transformer.


title: Effect of Prefix/Suffix Configurations on OTFS Systems with Rectangular Waveforms

abstract: Recently, orthogonal time-frequency-space (OTFS) modulation is used as a promising candidate waveform for high mobility communication scenarios. In practical transmission, OTFS with rectangular pulse shaping is implemented using different prefix/suffix configurations including reduced-cyclic prefix (RCP), full-CP (FCP), full-zero suffix (FZS), and reduced-zero padded (RZP). However, for each prefix/suffix type, different effective channel are seen at the receiver side resulting in dissimilar performance of the various OTFS configurations given a specific communication scenario. To fulfill this gap, in this paper, we study and model the effective channel in OTFS systems using various prefix/suffix configurations. Then, from the input-output relation analysis of the received signal, we show that the OTFS has a simple sparse structure for all prefix/suffix types, where the only difference is the phase term introduced when extending quasi-periodically in the delay-Doppler grid. We provide a comprehensive comparison between all OTFS types in terms of channel estimation/equalization complexity, symbol detection performance, power and spectral efficiencies, which helps in deciding the optimal prefix/suffix configuration for a specific scenario. Finally, we propose a novel OTFS structure namely reduced-FCP (RFCP) where the information of the CP block is decodable.


title: Lie symmetry classification and qualitative analysis for the fourth-order Schr\"{o}dinger equation

abstract: The Lie symmetry analysis for the study of a $1+n~$fourth-order Schr\"{o}dinger equation inspired by the modification of the deformation algebra in the presence of a minimum length is applied. Specifically, we perform a detailed classification for the scalar field potential function where non-trivial Lie symmetries exist and simplify the Schr\"{o}dinger equation. Then, a qualitative analysis allows for the reduced ordinary differential equation to be analyzed to understand the asymptotic dynamics.


title: Non-Hermitian topological mobility edges and transport in photonic quantum walks

abstract: In non-Hermitian quasicrystals, mobility edges (ME) separating localized and extended states in complex energy plane can arise as a result of non-Hermitian terms in the Hamiltonian. Such ME are of topological nature, i.e. the energies of localized and extended states exhibit distinct topological structures in the complex energy plane. However, depending on the origin of non-Hermiticity, i.e. asymmetry of hopping amplitudes or complexification of the incommensurate potential phase, different winding numbers are introduced, corresponding to different transport features in the bulk of the lattice: while ballistic transport is allowed in the former case, pseudo dynamical localization is observed in the latter case. The results are illustrated by considering non-Hermitian photonic quantum walks in synthetic mesh lattices.


title: A Testable Theory for The Emergence of the Classical World

abstract: The transition from the quantum to the classical world is not yet understood. Here we take a new approach. Central to this is the understanding that measurement and actualization cannot occur except in some specific basis. But we have no established theory for the emergence of a specific basis.


title: Freeze-in dark matter in EDGES 21-cm signal

abstract: The first measurement on temperature of hydrogen 21-cm signal reported by EDGES strongly favors Coulomb-like interaction between freeze-in dark matter and baryon fluid. We investigate such dark matter both in one- and two-component context, with the light force carrier(s) essential for the Coulomb-like interaction not being photon. Using a conversion of cross sections used by relevant experiments and Boltzmann equations to encode effects of the dark matter-baryon interaction, we show that both cases are robustly excluded by the stringent stellar cooling bounds in the sub-GeV dark matter mass range. The exclusion of one-component case applies to simplified freeze-in dark matter with the light force carrier as dark photon, gauged $B-L$, $L_{e}-L_{\mu}$,$L_{e}-L_{\tau}$ or axion-like particle, while the exclusion of two-component case applies to simplified freeze-in dark matter with the two light force carriers as two axion-like particles coupled to standard model quarks and leptons respectively.


title: The spectrum of simplicial volume with fixed fundamental group

abstract: We study the spectrum of simplicial volume for closed manifolds with fixed fundamental group and relate the gap problem to rationality questions in bounded (co)homology. In particular, we show that in many cases this spectrum has a gap at zero. For such groups, this leads to corresponding gap results for the minimal volume entropy semi-norm and for the minimal volume entropy in dimension 4.


title: Direct and reverse precession of a massive vortex in a binary Bose--Einstein condensate

abstract: The dynamics of a filled massive vortex is studied numerically and analytically using a two-dimensional model of a two-component Bose--Einstein condensate trapped in a harmonic trap. This condensate exhibits phase separation. In the framework of the coupled Gross--Pitaevskii equations, it is demonstrated that, in a certain range of parameters of the nonlinear interaction, the precession of a sufficiently massive vortex around the center is strongly slowed down and even reverses its direction with a further increase in the mass. An approximate ordinary differential equation is derived that makes it possible to explain this behavior of the system.


title: Easter2.0: Improving convolutional models for handwritten text recognition

abstract: Convolutional Neural Networks (CNN) have shown promising results for the task of Handwritten Text Recognition (HTR) but they still fall behind Recurrent Neural Networks (RNNs)/Transformer based models in terms of performance. In this paper, we propose a CNN based architecture that bridges this gap. Our work, Easter2.0, is composed of multiple layers of 1D Convolution, Batch Normalization, ReLU, Dropout, Dense Residual connection, Squeeze-and-Excitation module and make use of Connectionist Temporal Classification (CTC) loss. In addition to the Easter2.0 architecture, we propose a simple and effective data augmentation technique 'Tiling and Corruption (TACO)' relevant for the task of HTR/OCR. Our work achieves state-of-the-art results on IAM handwriting database when trained using only publicly available training data. In our experiments, we also present the impact of TACO augmentations and Squeeze-and-Excitation (SE) on text recognition accuracy. We further show that Easter2.0 is suitable for few-shot learning tasks and outperforms current best methods including Transformers when trained on limited amount of annotated data. Code and model is available at: https://github.com/kartikgill/Easter2


abstract: We present a detailed analysis of the Higgs boson decays $h\rightarrow Z \gamma$ and $h\rightarrow m_V Z$ in the $U(1)_X$SSM, with $m_V$ denoting the meson ($\omega,\rho,\phi,J/{\psi},\Upsilon$). Using the effective Lagrangian method, we calculate the effective constants $C_{\gamma Z}$ (CP-even) and $\tilde{C}_{\gamma Z}$ (CP-odd) for the vertex $h \gamma Z$, which are corrected by the new particle loop diagrams. Numerically, the ratio ${\Gamma}_{U(1)_X}(h\rightarrow Z \gamma )/{\Gamma}_{SM}(h\rightarrow Z \gamma)$ is between $1.02-1.35$. For the vector mesons $\omega,\rho,\phi$ and $J/{\psi}$, the ratios ${\Gamma}_{U(1)_X}(h\rightarrow m_V Z )/{\Gamma}_{SM}(h\rightarrow m_V Z)$ are mainly distributed in the range of ($1.01-1.45$). When $m_V$ represents $\Upsilon$, the larger value of the ratio ${\Gamma}_{U(1)_X}(h\rightarrow \Upsilon Z )/{\Gamma}_{SM}(h\rightarrow \Upsilon Z)$ is mostly located in the range of ($1.002-1.30$). This work can provide a reference for specific types of decay processes which can be searched in LHC.


title: Byzantine Fault-Tolerant Min-Max Optimization

abstract: In this paper, we consider a min-max optimization problem under adversarial manipulation, where there are $n$ cost functions, up to $f$ of which may be replaced by arbitrary faulty functions by an adversary. The goal is to minimize the maximum cost over $x$ among the $n$ functions despite the faulty functions. The problem formulation could naturally extend to Byzantine fault-tolerant distributed min-max optimization. We present a simple algorithm for Byzantine min-max optimization, and provide bounds on the output of the algorithm. We also present an approximate algorithm for this problem. We then extend the problem to a distributed setting and present a distributed algorithm. To the best of our knowledge, we are the first to consider this problem.


title: Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Driving

abstract: While separately leveraging monocular 3D object detection and 2D multi-object tracking can be straightforwardly applied to sequence images in a frame-by-frame fashion, stand-alone tracker cuts off the transmission of the uncertainty from the 3D detector to tracking while cannot pass tracking error differentials back to the 3D detector. In this work, we propose jointly training 3D detection and 3D tracking from only monocular videos in an end-to-end manner. The key component is a novel spatial-temporal information flow module that aggregates geometric and appearance features to predict robust similarity scores across all objects in current and past frames. Specifically, we leverage the attention mechanism of the transformer, in which self-attention aggregates the spatial information in a specific frame, and cross-attention exploits relation and affinities of all objects in the temporal domain of sequence frames. The affinities are then supervised to estimate the trajectory and guide the flow of information between corresponding 3D objects. In addition, we propose a temporal -consistency loss that explicitly involves 3D target motion modeling into the learning, making the 3D trajectory smooth in the world coordinate system. Time3D achieves 21.4\% AMOTA, 13.6\% AMOTP on the nuScenes 3D tracking benchmark, surpassing all published competitors, and running at 38 FPS, while Time3D achieves 31.2\% mAP, 39.4\% NDS on the nuScenes 3D detection benchmark.


title: Horizonless spacetimes as seen by present and next-generation Event Horizon Telescope arrays

abstract: We study the capabilities of present and future radio very-long-baseline-interferometry arrays to distinguish black holes from horizonless spacetimes. We consider an example of a horizonless spacetime, obtained by overspinning a regular black hole. Its image is distinct from the image of a Kerr spacetime due to a second set of photon rings interior to the shadow. These photon rings cannot be directly resolved by present and even next-generation Event Horizon telescope arrays, but instead imprint themselves in horizon-scale images as excess central brightness relative to that of a black hole. We demonstrate that future arrays can detect such indirect imprints.


title: Convergence Analysis of Consensus-ADMM for General QCQP

abstract: We analyze the convergence properties of the consensus-alternating direction method of multipliers (ADMM) for solving general quadratically constrained quadratic programs. We prove that the augmented Lagrangian function value is monotonically non-increasing as long as the augmented Lagrangian parameter is chosen to be sufficiently large. Simulation results show that the augmented Lagrangian function is bounded from below when the matrix in the quadratic term of the objective function is positive definite. In such a case, the consensus-ADMM is convergent.


title: A Connected Component Labeling Algorithm for Implicitly-Defined Domains

abstract: A connected component labeling algorithm is developed for implicitly-defined domains specified by multivariate polynomials. The algorithm operates by recursively subdividing the constraint domain into hyperrectangular subcells until the topology thereon is sufficiently simple; in particular, we devise a topology test using properties of Bernstein polynomials. In many cases the algorithm produces a certificate guaranteeing its correctness, i.e., two points yield the same label if and only if they are path-connected. To robustly handle various kinds of edge cases, the algorithm may assign identical labels to distinct components, but only when they are exactly or nearly touching, relative to a user-controlled length scale. A variety of numerical experiments assess the effectiveness of the overall approach, including statistical analyses on randomly generated multi-component geometry in 2D and 3D, as well as specific examples involving cusps, self-intersections, junctions, and other kinds of singularities.


title: Neural Shape Mating: Self-Supervised Object Assembly with Adversarial Shape Priors

abstract: Learning to autonomously assemble shapes is a crucial skill for many robotic applications. While the majority of existing part assembly methods focus on correctly posing semantic parts to recreate a whole object, we interpret assembly more literally: as mating geometric parts together to achieve a snug fit. By focusing on shape alignment rather than semantic cues, we can achieve across-category generalization. In this paper, we introduce a novel task, pairwise 3D geometric shape mating, and propose Neural Shape Mating (NSM) to tackle this problem. Given the point clouds of two object parts of an unknown category, NSM learns to reason about the fit of the two parts and predict a pair of 3D poses that tightly mate them together. We couple the training of NSM with an implicit shape reconstruction task to make NSM more robust to imperfect point cloud observations. To train NSM, we present a self-supervised data collection pipeline that generates pairwise shape mating data with ground truth by randomly cutting an object mesh into two parts, resulting in a dataset that consists of 200K shape mating pairs from numerous object meshes with diverse cut types. We train NSM on the collected dataset and compare it with several point cloud registration methods and one part assembly baseline. Extensive experimental results and ablation studies under various settings demonstrate the effectiveness of the proposed algorithm. Additional material is available at: https://neural-shape-mating.github.io/


title: Deep Posterior Distribution-based Embedding for Hyperspectral Image Super-resolution

abstract: In this paper, we investigate the problem of hyperspectral (HS) image spatial super-resolution via deep learning. Particularly, we focus on how to embed the high-dimensional spatial-spectral information of HS images efficiently and effectively. Specifically, in contrast to existing methods adopting empirically-designed network modules, we formulate HS embedding as an approximation of the posterior distribution of a set of carefully-defined HS embedding events, including layer-wise spatial-spectral feature extraction and network-level feature aggregation. Then, we incorporate the proposed feature embedding scheme into a source-consistent super-resolution framework that is physically-interpretable, producing lightweight PDE-Net, in which high-resolution (HR) HS images are iteratively refined from the residuals between input low-resolution (LR) HS images and pseudo-LR-HS images degenerated from reconstructed HR-HS images via probability-inspired HS embedding. Extensive experiments over three common benchmark datasets demonstrate that PDE-Net achieves superior performance over state-of-the-art methods. Besides, the probabilistic characteristic of this kind of networks can provide the epistemic uncertainty of the network outputs, which may bring additional benefits when used for other HS image-based applications. The code will be publicly available at https://github.com/jinnh/PDE-Net.


title: Giant Components in Random Temporal Graphs

abstract: A temporal graph is a graph whose edges appear only at certain points in time. Recently, the second and the last three authors proposed a natural temporal analog of the Erd\H{o}s-R\'enyi random graph model. The proposed model is obtained by randomly permuting the edges of an Erd\H{o}s-R\'enyi random graph and interpreting this permutation as an ordering of presence times. It was shown that the connectivity threshold in the Erd\H{o}s-R\'enyi model fans out into multiple phase transitions for several distinct notions of reachability in the temporal setting. In the present paper, we identify a sharp threshold for the emergence of a giant temporally connected component. We show that at $p = \log n/n$ the size of the largest temporally connected component increases from $o(n)$ to~$n-o(n)$. This threshold holds for both open and closed connected components, i.e. components that allow, respectively forbid, their connecting paths to use external nodes.


title: MUSSES2020J: The Earliest Discovery of a Fast Blue Ultraluminous Transient at Redshift 1.063

abstract: In this Letter, we report the discovery of an ultraluminous fast-evolving transient in rest-frame UV wavelengths, MUSSES2020J, soon after its occurrence by using the Hyper Suprime-Cam (HSC) mounted on the 8.2 m Subaru telescope. The rise time of about 5 days with an extremely high UV peak luminosity shares similarities to a handful of fast blue optical transients whose peak luminosities are comparable with the most luminous supernovae while their timescales are significantly shorter (hereafter "fast blue ultraluminous transient," FBUT). In addition, MUSSES2020J is located near the center of a normal low-mass galaxy at a redshift of 1.063, suggesting a possible connection between the energy source of MUSSES2020J and the central part of the host galaxy. Possible physical mechanisms powering this extreme transient such as a wind-driven tidal disruption event and an interaction between supernova and circumstellar material are qualitatively discussed based on the first multiband early-phase light curve of FBUTs, although whether the scenarios can quantitatively explain the early photometric behavior of MUSSES2020J requires systematical theoretical investigations. Thanks to the ultrahigh luminosity in UV and blue optical wavelengths of these extreme transients, a promising number of FBUTs from the local to the high-z universe can be discovered through deep wide-field optical surveys in the near future.


title: Comparative characterization study of LYSO:Ce crystals for timing applications

abstract: Cerium-doped Lutetium-Yttrium Oxyorthosilicate (LYSO:Ce)is one of the most widely used Cerium-doped Lutetium based scintillation crystals. Initially developed for medical detectors it rapidly became attractive for High Energy Particle Physics (HEP) applications, especially in the frame of high luminosity particle colliders. In this paper, a comprehensive and systematic study of LYSO:Ce ($[Lu_{(1-x)}Y_x]_2SiO_5$:$Ce$) crystals is presented. It involves for the first time a large number of crystal samples (180) of the same size from a dozen of producers.The study consists of a comparative characterization of LYSO:Ce crystal products available on the market by mechanical, optical and scintillation measurements and aims specifically, to investigate key parameters of timing applications for HEP.


title: Towards efficient structure prediction and pre-compensation in multi-photon lithography

abstract: Microscale 3D printing technologies have been of increasing interest in industry and research for several years. Unfortunately, the fabricated structures always deviate from the respective expectations, often caused by the physico-chemical properties during and after the printing process. Here, we show first steps towards a simple, fast and easy to implement algorithm to predict the final structure topography for multi-photon lithography - also known as Direct Laser Writing (DLW). The three main steps of DLW, (i) exposure of a photo resin, (ii) cross-linking of the resin, and (iii) subsequent shrinkage are approximated by mathematical operations, showing promising results in coincidence with experimental observations. E.g., the root-mean-square error (rmse) between the unmodified 3D print of a radial-symmetrically chirped topography and our predicted topography is only 0.46 $\mu$m, whereas the rmse between this 3D print and its target is 1.49 $\mu$m. Thus, our robust predictions can be used prior to the printing process to minimize undesired deviations between the target structure and the final 3D printed structure. Using a Downhill-Simplex algorithm for identifying the optimal prediction parameters, we were able to reduce the rmse from 4.04 $\mu$m to 0.33 $\mu$m by only two correction loops in our best-case scenario (rmse = 0.72 $\mu$m after one loop). Consequently, this approach can eliminate the need for many structural optimization loops to produce highly conformal and high quality micro structures in the future.


title: Exploring the Open World Using Incremental Extreme Value Machines

abstract: Dynamic environments require adaptive applications. One particular machine learning problem in dynamic environments is open world recognition. It characterizes a continuously changing domain where only some classes are seen in one batch of the training data and such batches can only be learned incrementally. Open world recognition is a demanding task that is, to the best of our knowledge, addressed by only a few methods. This work introduces a modification of the widely known Extreme Value Machine (EVM) to enable open world recognition. Our proposed method extends the EVM with a partial model fitting function by neglecting unaffected space during an update. This reduces the training time by a factor of 28. In addition, we provide a modified model reduction using weighted maximum K-set cover to strictly bound the model complexity and reduce the computational effort by a factor of 3.5 from 2.1 s to 0.6 s. In our experiments, we rigorously evaluate openness with two novel evaluation protocols. The proposed method achieves superior accuracy of about 12 % and computational efficiency in the tasks of image classification and face recognition.


title: Hybrid Numerical Modeling of Ballistic Clay under Low-Speed Impact using Artificial Neural Networks

abstract: Roma Plastilina No. 1 clay has been widely used as a conservative boundary condition in bulletproof vests, namely to play the role of a human body. Interestingly, the effect of this boundary condition on the ballistic performance of the vests is indiscernible. Moreover, back face deformation should be characterized by measuring the indentation in the deformed clay, which is important for determining the lethality of gunshots. Therefore, several studies have focused on modeling not only bulletproof vests but also the clay backing material. Despite various attempts to develop a suitable numerical model, determining the appropriate physical parameters that can capture the high-strain-rate behavior of clay is still challenging. In this study, we predicted indentation depth in clay using an artificial neural network (ANN) and determined the optimal material parameters required for a finite element method (FEM)-based model using an inverse tracking method. Our ANN-FEM hybrid model successfully optimized high-strain-rate material parameters without the need for any independent mechanical tests. The proposed novel model achieved a high prediction accuracy of over 98% referring impact cases.


title: Daisy Bloom Filters

abstract: A filter is a widely used data structure for storing an approximation of a given set $S$ of elements from some universe $U$ (a countable set).It represents a superset $S'\supseteq S$ that is ''close to $S$'' in the sense that for $x\not\in S$, the probability that $x\in S'$ is bounded by some $\varepsilon > 0$. The advantage of using a Bloom filter, when some false positives are acceptable, is that the space usage becomes smaller than what is required to store $S$ exactly. Though filters are well-understood from a worst-case perspective, it is clear that state-of-the-art constructions may not be close to optimal for particular distributions of data and queries. Suppose, for instance, that some elements are in $S$ with probability close to 1. Then it would make sense to always include them in $S'$, saving space by not having to represent these elements in the filter. Questions like this have been raised in the context of Weighted Bloom filters (Bruck, Gao and Jiang, ISIT 2006) and Bloom filter implementations that make use of access to learned components (Vaidya, Knorr, Mitzenmacher, and Krask, ICLR 2021). In this paper, we present a lower bound for the expected space that such a filter requires. We also show that the lower bound is asymptotically tight by exhibiting a filter construction that executes queries and insertions in worst-case constant time, and has a false positive rate at most $\varepsilon $ with high probability over input sets drawn from a product distribution. We also present a Bloom filter alternative, which we call the $\textit{Daisy Bloom filter}$, that executes operations faster and uses significantly less space than the standard Bloom filter.


title: From Representation to Reasoning: Towards both Evidence and Commonsense Reasoning for Video Question-Answering

abstract: Video understanding has achieved great success in representation learning, such as video caption, video object grounding, and video descriptive question-answer. However, current methods still struggle on video reasoning, including evidence reasoning and commonsense reasoning. To facilitate deeper video understanding towards video reasoning, we present the task of Causal-VidQA, which includes four types of questions ranging from scene description (description) to evidence reasoning (explanation) and commonsense reasoning (prediction and counterfactual). For commonsense reasoning, we set up a two-step solution by answering the question and providing a proper reason. Through extensive experiments on existing VideoQA methods, we find that the state-of-the-art methods are strong in descriptions but weak in reasoning. We hope that Causal-VidQA can guide the research of video understanding from representation learning to deeper reasoning. The dataset and related resources are available at \url{https://github.com/bcmi/Causal-VidQA.git}.


title: On resolvability of products

abstract: All spaces below are $T_0$ and crowded (i.e. have no isolated points). For $n \le \omega$ let $M(n)$ be the statement that there are $n$ measurable cardinals and $\Pi(n)$ ($\Pi^+(n)$) that there are $n+1$ (0-dimensional $T_2$) spaces whose product is irresolvable. We prove that $M(1),\,\Pi(1)$ and $\Pi^+(1)$ are equiconsistent. For $1 < n < \omega$ we show that $CON(M(n))$ implies $CON(\Pi^+(n))$. Finally, $CON(M(\omega))$ implies the consistency of having infinitely many crowded 0-dimensional $T_2$-spaces such that the product of any finitely many of them is irresolvable. These settle old problems of Malychin. Concerning an even older question of Ceder and Pearson, we show that the following are consistent modulo a measurable cardinal: (i) There is a 0-dimensional $T_2$ space $X$ with $\omega_2 \le \Delta(X) \le 2^{\omega_1}$ whose product with any countable space is not $\omega_2$-resolvable, hence not maximally resolvable. (ii) There is a monotonically normal space $X$ with $\Delta(X) = \aleph_\omega$ whose product with any countable space is not $\omega_1$-resolvable, hence not maximally resolvable. These significantly improve a result of Eckertson.


title: Fully Polynomial-Time Distributed Computation in Low-Treewidth Graphs

abstract: We consider global problems, i.e. problems that take at least diameter time, even when the bandwidth is not restricted. We show that all problems considered admit efficient solutions in low-treewidth graphs. By ``efficient'' we mean that the running time has polynomial dependence on the treewidth, a linear dependence on the diameter (which is unavoidable), and only a polylogarithmic dependence on $n$, the number of nodes in the graph. We present the algorithms solving the following problems in the CONGEST model which all attain $\tilde{O(\tau^{O(1)}D)}$-round complexity (where $\tau$ and $D$ denote the treewidth and diameter of the graph, respectively): (1) Exact single-source shortest paths (actually, the more general problem of computing a distance labeling scheme) for weighted and directed graphs, (2) exact bipartite unweighted maximum matching, and (3) the weighted girth for both directed and undirected graphs. We derive all of our results using a single unified framework, which consists of two novel technical ingredients, The first is a fully polynomial-time distributed tree decomposition algorithm, which outputs a decomposition of width $O(\tau^2\log n)$ in $\tilde{O}(\tau^{O(1)}D)$ rounds (where $n$ is the number of nodes in the graph). The second ingredient, and the technical highlight of this paper, is the novel concept of a \emph{stateful walk constraint}, which naturally defines a set of feasible walks in the input graph based on their local properties (e.g., augmenting paths). Given a stateful walk constraint, the constrained version of the shortest paths problem (or distance labeling) requires the algorithm to output the shortest \emph{constrained} walk (or its distance) for a given source and sink vertices. We show that this problem can be efficiently solved in the CONGEST model by reducing it to an \emph{unconstrained} version of the problem.


title: Friction-dependent rheology of dry granular systems

abstract: Understanding the rheology of granular assemblies is important for natural and engineering systems, but the relationship between inter-particle friction (or microscopic friction) and macroscopic friction is still not well understood. In this study, using the the discrete element method (DEM) with spherical particles and realistic contact laws, we investigate the mechanics of granular systems with a wide range of inter-particle frictional coefficients and aim to establish a friction-dependent rheology for dry granular flows. The corresponding results show that increasing inter-particle friction dramatically increases the effective frictional coefficient, $\mu_{\textrm{eff}}$, while decreasing the solid fraction of the system and increasing the transitional inertial number that marks the division of quasi-static regimes and intermediate flow regimes. We further propose a new dimensionless number, $\mathcal{M}$, as a ratio between the inertial effect and frictional effect, which is similar to the effective aspect ratio in granular column collapses, and unifies the influence of inter-particle friction with the inertial number. We then establish a relationship between $\mathcal{M}$ and the dimensionless granular temperature, $\Theta$, to further universalize the influence of inter-particle frictions. Such study can broaden the application of the $\mu(I)$ rheology in natural and engineering systems and help establish a more general constitutive model for complex granular systems.


title: Close Major Merger Pairs at $z=0$: Bulge-to-Total Ratio and Star Formation Enhancement

abstract: We present a study of the bulge-to-total ratio (B/T) of a Ks-band-selected sample of 88 close major-merger pairs of galaxies (H-KPAIR) based on 2-D decomposition of SDSS r-band images with \textsc{galfit}. We investigate the dependence of the interaction-induced specific star formation rate enhancement ($\rm sSFR_{enh}$) on the B/T ratio, and the effects of this dependence on the differences between star-forming galaxies (SFGs) in spiral+spiral (S+S) and spiral+elliptical (S+E) pairs. Of all 132 spiral galaxies in H-KPAIR, the 44 in S+E pairs show higher B/T than those in the 44 S+S pairs, with means of $\rm B/T = 0.35 \pm 0.05$ and $\rm B/T = 0.26 \pm 0.03$, respectively. There is a strong negative dependence of $\rm sSFR_{enh}$ on the B/T ratio and only paired SFGs with $\rm B/T<0.3$ show significant ($>5\sigma$) enhancement. Paired SFGs in S+S pairs show a similar trend, and many disky SFGs ($\rm B/T<0.1$) in S+S have strong sSFR enhancements ($\rm sSFR_{enh} > 0.7$~dex). For SFGs in S+E, the sSFR has no clear B/T dependence, nor any significant enhancement in any B/T bin. Disky SFGs in S+S show significant ($>4\sigma$) enhancement in the molecular gas content ($\rm M_{H_2}/M_{star}$), while SFGs in S+E have no such enhancement in any B/T bin. No significant enhancement on total gas content ($\rm M_{gas}/M_{star}$) is found in any B/T bin for paired galaxies. The star formation efficiency of either the total gas ($\rm SFE_{gas} = SFR/M_{gas}$) or the molecular gas ($\rm SFE_{H_2} = SFR/M_{H_2}$) does not depend on the B/T ratio. The only significant ($>4\sigma$) SFE enhancement found for paired SFGs is the $\rm SFE_{gas}$ for disky SFGs in S+S pairs.


title: FRAug: Tackling Federated Learning with Non-IID Features via Representation Augmentation

abstract: Federated Learning (FL) is a decentralized learning paradigm, in which multiple clients collaboratively train deep learning models without centralizing their local data, and hence preserve data privacy. Real-world applications usually involve a distribution shift across the datasets of the different clients, which hurts the generalization ability of the clients to unseen samples from their respective data distributions. In this work, we address the recently proposed feature shift problem where the clients have different feature distributions, while the label distribution is the same. We propose Federated Representation Augmentation (FRAug) to tackle this practical and challenging problem. Our approach generates synthetic client-specific samples in the embedding space to augment the usually small client datasets. For that, we train a shared generative model to fuse the clients knowledge learned from their different feature distributions. This generator synthesizes client-agnostic embeddings, which are then locally transformed into client-specific embeddings by Representation Transformation Networks (RTNets). By transferring knowledge across the clients, the generated embeddings act as a regularizer for the client models and reduce overfitting to the local original datasets, hence improving generalization. Our empirical evaluation on public benchmarks and a real-world medical dataset demonstrates the effectiveness of the proposed method, which substantially outperforms the current state-of-the-art FL methods for non-IID features, including PartialFed and FedBN.


title: Compactness of commutators in the Bloom setting: the off-diagonal case

abstract: In this paper, we establish a new characterization of weighted $\rm{VMO}$ spaces, which are essential different from the classical $\rm{VMO}$ spaces, via the compactness of sparse operators, commutators of Riesz potentials and fractional maximal operators. Some of our results are new even in unweighted setting.


title: Revisiting a disky origin for the faint branch of the Sagittarius stellar stream

abstract: We investigate ways to produce the bifurcation observed in the stellar stream of the Sagittarius dwarf galaxy (Sgr). Our method consists in running $N$-body simulations of Sgr falling into the Milky Way for the last 3~Gyr, with added test particles on disk orbits that span a wide range of initial positions, energies, and angular momenta. We find that particles that end up in the faint branch are predominantly high angular momentum particles that can all originate from a single plane within the progenitor, nearly perpendicular both to the orbital plane of the progenitor and to the Milky Way stellar disk. Their original configuration at the start of the simulation corresponds to spiral features already present 3~Gyr ago, which could be, e.g., the result of a disk-like component being tidally perturbed, or the tidal tails of a satellite being disrupted within Sgr. We then run a simulation including the self-gravity of this disky component. Despite the remaining ambiguity of its origin, this disk component of the Sgr dwarf with spiral over-densities provides a first step towards a working model to reproduce the observed faint branch of the bifurcated Sgr stream.


title: Quantum-assisted Monte Carlo algorithms for fermions

abstract: Quantum computing is a promising way to systematically solve the longstanding computational problem, the ground state of a many-body fermion system. Many efforts have been made to realise certain forms of quantum advantage in this problem, for instance, the development of variational quantum algorithms. A recent work by Huggins et al. reports a novel candidate, i.e. a quantum-classical hybrid Monte Carlo algorithm with a reduced bias in comparison to its fully-classical counterpart. In this paper, we propose a family of scalable quantum-assisted Monte Carlo algorithms where the quantum computer is used at its minimal cost and still can reduce the bias. By incorporating a Bayesian inference approach, we can achieve this quantum-facilitated bias reduction with a much smaller quantum-computing cost than taking empirical mean in amplitude estimation. Besides, we show that the hybrid Monte Carlo framework is a general way to suppress errors in the ground state obtained from classical algorithms. Our work provides a Monte Carlo toolkit for achieving quantum-enhanced calculation of fermion systems on near-term quantum devices.


title: Antifactors in bipartite multigraphs

abstract: Let $G$ be a $q$-regular bipartite graph with bipartition $(U,V)$. It was proved by Lu, Wang, and Yan in 2020 that $G$ has a spanning subgraph $H$ such that each vertex of $U$ has degree 1 in $H$, and each vertex of $V$ has degree distinct from 1 in $H$. We extend the result to multigraphs, under the condition that $q$ is a prime power and the number of perfect matchings of $G$ is not divisible by $q$. The condition on the number of perfect matchings is necessary for multigraphs. We conclude with a conjecture on the limiting distribution of the number of perfect matchings modulo $q$ in a random bipartite $q$-regular graph.