title: Rotating spiders and reflecting dogs: a class conditional approach to learning data augmentation distributions

abstract: Building invariance to non-meaningful transformations is essential to building efficient and generalizable machine learning models. In practice, the most common way to learn invariance is through data augmentation. There has been recent interest in the development of methods that learn distributions on augmentation transformations from the training data itself. While such approaches are beneficial since they are responsive to the data, they ignore the fact that in many situations the range of transformations to which a model needs to be invariant changes depending on the particular class input belongs to. For example, if a model needs to be able to predict whether an image contains a starfish or a dog, we may want to apply random rotations to starfish images during training (since these do not have a preferred orientation), but we would not want to do this to images of dogs. In this work we introduce a method by which we can learn class conditional distributions on augmentation transformations. We give a number of examples where our methods learn different non-meaningful transformations depending on class and further show how our method can be used as a tool to probe the symmetries intrinsic to a potentially complex dataset.


title: FEAR: A Simple Lightweight Method to Rank Architectures

abstract: The fundamental problem in Neural Architecture Search (NAS) is to efficiently find high-performing architectures from a given search space. We propose a simple but powerful method which we call FEAR, for ranking architectures in any search space. FEAR leverages the viewpoint that neural networks are powerful non-linear feature extractors. First, we train different architectures in the search space to the same training or validation error. Then, we compare the usefulness of the features extracted by each architecture. We do so with a quick training keeping most of the architecture frozen. This gives fast estimates of the relative performance. We validate FEAR on Natsbench topology search space on three different datasets against competing baselines and show strong ranking correlation especially compared to recently proposed zero-cost methods. FEAR particularly excels at ranking high-performance architectures in the search space. When used in the inner loop of discrete search algorithms like random search, FEAR can cut down the search time by approximately 2.4X without losing accuracy. We additionally empirically study very recently proposed zero-cost measures for ranking and find that they breakdown in ranking performance as training proceeds and also that data-agnostic ranking scores which ignore the dataset do not generalize across dissimilar datasets.


title: JANUS: Parallel Tempered Genetic Algorithm Guided by Deep Neural Networks for Inverse Molecular Design

abstract: Inverse molecular design, i.e., designing molecules with specific target properties, can be posed as an optimization problem. High-dimensional optimization tasks in the natural sciences are commonly tackled via population-based metaheuristic optimization algorithms such as evolutionary algorithms. However, expensive property evaluation, which is often required, can limit the widespread use of such approaches as the associated cost can become prohibitive. Herein, we present JANUS, a genetic algorithm that is inspired by parallel tempering. It propagates two populations, one for exploration and another for exploitation, improving optimization by reducing expensive property evaluations. Additionally, JANUS is augmented by a deep neural network that approximates molecular properties via active learning for enhanced sampling of the chemical space. Our method uses the SELFIES molecular representation and the STONED algorithm for the efficient generation of structures, and outperforms other generative models in common inverse molecular design tasks achieving state-of-the-art performance.


title: The ground state in a proximity to a possible Kitaev spin liquid: An undistorted honeycomb iridate NaxIrO3 (0.60 < x < 0.80)

abstract: We report results of our study of a newly synthesized honeycomb iridate NaxIrO3 (0.60 < x < 0.80). Single-crystal NaxIrO3 adopts a honeycomb lattice noticeably without distortions and stacking disorder inherently existent in its sister compound Na2IrO3. The oxidation state of the Ir ion is a mixed valence state resulting from a majority Ir5+(5d4) ion and a minority Ir6+(5d3) ion. NaxIrO3 is a Mott insulator likely with a predominant pseudospin = 1 state. It exhibits an effective moment of 1.1 Bohr Magneton/Ir and a Curie-Weiss temperature of -19 K but with no discernable long-range order above 1 K. The physical behavior below 1 K features two prominent anomalies at Th = 0.9 K and Tl = 0.12 K in both the heat capacity and AC magnetic susceptibility. Intermediate between Th and Tl lies a pronounced temperature linearity of the heat capacity with a large slope of 77 mJ/mole K2, a feature expected for highly correlated metals but not at all for insulators. These results along with comparison drawn with the honeycomb lattices Na2IrO3 and (Na0.2Li0.8)2IrO3 point to an exotic ground state in a proximity to a possible Kitaev spin liquid.


title: The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization

abstract: Theoretical results show that neural networks can be approximated by Gaussian processes in the infinite-width limit. However, for fully connected networks, it has been previously shown that for any fixed network width, $n$, the Gaussian approximation gets worse as the network depth, $d$, increases. Given that modern networks are deep, this raises the question of how well modern architectures, like ResNets, are captured by the infinite-width limit. To provide a better approximation, we study ReLU ResNets in the infinite-depth-and-width limit, where both depth and width tend to infinity as their ratio, $d/n$, remains constant. In contrast to the Gaussian infinite-width limit, we show theoretically that the network exhibits log-Gaussian behaviour at initialization in the infinite-depth-and-width limit, with parameters depending on the ratio $d/n$. Using Monte Carlo simulations, we demonstrate that even basic properties of standard ResNet architectures are poorly captured by the Gaussian limit, but remarkably well captured by our log-Gaussian limit. Moreover, our analysis reveals that ReLU ResNets at initialization are hypoactivated: fewer than half of the ReLUs are activated. Additionally, we calculate the interlayer correlations, which have the effect of exponentially increasing the variance of the network output. Based on our analysis, we introduce Balanced ResNets, a simple architecture modification, which eliminates hypoactivation and interlayer correlations and is more amenable to theoretical analysis.


title: Cosmic Voids in GAN-Generated Maps of Large-Scale Structure

abstract: A Generative Adversarial Network (GAN) was used to investigate the statistics and properties of voids in a $\Lambda$CDMuniverse. The total number of voids and the distribution of void sizes is similar in both sets of images and, within the formal error bars, the mean void properties are consistent with each other. However, the generated images yield somewhat fewer small voids than do the simulated images. In addition, the generated images yield far fewer voids with central density contrast $\sim$ $-$1. Because the generated images yield fewer of the emptiest voids, the distribution of the mean interior density contrast is systematically higher for the generated voids than it is for the simulated voids. The mean radial underdensity profiles of the largest voids are similar in both sets of images, but systematic differences are apparent. On small scales (r $< 0.5r_{v}$), the underdensity profiles of the voids in the generated images exceed those of the voids in the simulated images. On large scales (r $> 0.5r_{v}$), the underdensity profiles of the voids in the simulated images exceed those of the voids in the generated images. The discrepancies between the void properties in the two sets of images are attributable to the GAN struggling to capture absolute patterns in the data. In particular, the GAN produces too few pixels with density contrasts $\sim$ $-$1 and too many pixels with density contrasts in the range $\sim$ $-$0.88 to $\sim$ $-$0.63.


title: Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning

abstract: High-quality estimates of uncertainty and robustness are crucial for numerous real-world applications, especially for deep learning which underlies many deployed ML systems. The ability to compare techniques for improving these estimates is therefore very important for research and practice alike. Yet, competitive comparisons of methods are often lacking due to a range of reasons, including: compute availability for extensive tuning, incorporation of sufficiently many baselines, and concrete documentation for reproducibility. In this paper we introduce Uncertainty Baselines: high-quality implementations of standard and state-of-the-art deep learning methods on a variety of tasks. As of this writing, the collection spans 19 methods across 9 tasks, each with at least 5 metrics. Each baseline is a self-contained experiment pipeline with easily reusable and extendable components. Our goal is to provide immediate starting points for experimentation with new methods or applications. Additionally we provide model checkpoints, experiment outputs as Python notebooks, and leaderboards for comparing results. Code available at https://github.com/google/uncertainty-baselines.


title: Disfl-QA: A Benchmark Dataset for Understanding Disfluencies in Question Answering

abstract: Disfluencies is an under-studied topic in NLP, even though it is ubiquitous in human conversation. This is largely due to the lack of datasets containing disfluencies. In this paper, we present a new challenge question answering dataset, Disfl-QA, a derivative of SQuAD, where humans introduce contextual disfluencies in previously fluent questions. Disfl-QA contains a variety of challenging disfluencies that require a more comprehensive understanding of the text than what was necessary in prior datasets. Experiments show that the performance of existing state-of-the-art question answering models degrades significantly when tested on Disfl-QA in a zero-shot setting.We show data augmentation methods partially recover the loss in performance and also demonstrate the efficacy of using gold data for fine-tuning. We argue that we need large-scale disfluency datasets in order for NLP models to be robust to them. The dataset is publicly available at: https://github.com/google-research-datasets/disfl-qa.


title: Particle-hole asymmetry in the dynamical spin and charge structure factors of the corner-shared one-dimensional cuprates

abstract: The collective spin and charge excitations of doped cuprates and their relationship to superconductivity are not yet fully understood, particularly in the case of the charge excitations. Here, we study the doping-dependent dynamical spin and charge structure factors of single and multi-orbital models for the one-dimensional corner shared spin-chain cuprates using several numerically exact methods. We find that the singleband Hubbard model can describe the spin and charge excitations of the $pd$-model in the low-energy region, including the particle-hole asymmetry in the spin response. However, our results also reveal that the weight of the interorbital spin excitations between Cu and O orbitals is comparable to the weight of the spin excitations between two Cu orbitals. This finding elucidates the microscopic nature of the spin excitations in the 1D cuprates and sheds light on the spin properties of other oxides. Importantly, we find a particle-hole asymmetry in the orbital-resolved charge excitations, which cannot be described by the singleband Hubbard model and is relevant to resonant inelastic x-ray scattering experiments. Our results imply that the explicit inclusion of the oxygen degrees of freedom may be required to understand experimental observations.


title: Intrinsic Dimension Estimation Using Wasserstein Distances

abstract: It has long been thought that high-dimensional data encountered in many practical machine learning tasks have low-dimensional structure, i.e., the manifold hypothesis holds. A natural question, thus, is to estimate the intrinsic dimension of a given population distribution from a finite sample. We introduce a new estimator of the intrinsic dimension and provide finite sample, non-asymptotic guarantees. We then apply our techniques to get new sample complexity bounds for Generative Adversarial Networks (GANs) depending only on the intrinsic dimension of the data.


title: Random walks on SL_2(C): spectral gap and limit theorems

abstract: We obtain various new limit theorems for random walks on SL_2(C) under low moment conditions. For non-elementary measures with a finite second moment, we prove a Local Limit Theorem for the norm cocycle, yielding the optimal version of a theorem of E. Le Page. For measures with a finite third moment, we obtain the Local Limit Theorem for the matrix coefficients, improving a recent result of Grama-Quint-Xiao and the authors, and Berry-Esseen bounds with optimal rate $O(1 / \sqrt n)$ for the norm cocycle and the matrix coefficients. The main tool is a detailed study of the spectral properties of the Markov operator and its purely imaginary perturbations acting on different function spaces. We introduce, in particular, a new function space derived from the Sobolev space $W^{1,2}$ that provides uniform estimates.


title: A new construction for sublevel set persistence

abstract: We construct a filtered simplicial complex $(X_L,f_L)$ associated to a subset $X\subset \mathbb{R}^d$, a function $f:X\rightarrow \mathbb{R}$ with compactly supported sublevel sets, and a collection of landmark points $L\subset \mathbb{R}^d$. The persistence values $f_L(\Delta)$ are defined as the minimizing values of a family of constrained optimization problems, whose domains are certain higher order Voronoi cells associated to $L$. We prove that $H_k^{a,b}(X_L)\cong H^{a,b}_k(X)$ provided that $f$ is the restriction of a smooth function, the landmarks are sufficiently dense, and $a<b$ are generic, and we show that the construction produces desirable results in some examples.


title: Hybrid Method Based on NARX models and Machine Learning for Pattern Recognition

abstract: This work presents a novel technique that integrates the methodologies of machine learning and system identification to solve multiclass problems. Such an approach allows to extract and select sets of representative features with reduced dimensionality, as well as predicts categorical outputs. The efficiency of the method was tested by running case studies investigated in machine learning, obtaining better absolute results when compared with classical classification algorithms.


title: Electron beam shaping via laser heater temporal shaping

abstract: Active longitudinal beam optics can help FEL facilities achieve cutting edge performance by optimizing the beam to: produce multi-color pulses, suppress caustics, or support attosecond lasing. As the next generation of superconducting accelerators comes online, there is a need to find new elements which can both operate at high beam power and which offer multiplexing capabilities at Mhz repetition rate. Laser heater shaping promises to satisfy both criteria by imparting a programmable slice-energy spread on a shot-by-shot basis. We use a simple kinetic analysis to show how control of the slice energy spread translates into control of the bunch current profile, and then we present a collection of start-to-end simulations at LCLS-II in order to illustrate the technique.


title: On Generating Lagrangian Cuts for Two-Stage Stochastic Integer Programs

abstract: We investigate new methods for generating Lagrangian cuts to solve two-stage stochastic integer programs. Lagrangian cuts can be added to a Benders reformulation, and are derived from solving single scenario integer programming subproblems identical to those used in the nonanticipative Lagrangian dual of a stochastic integer program. While Lagrangian cuts have the potential to significantly strengthen the Benders relaxation, generating Lagrangian cuts can be computationally demanding. We investigate new techniques for generating Lagrangian cuts with the goal of obtaining methods that provide significant improvements to the Benders relaxation quickly. Computational results demonstrate that our proposed method improves the Benders relaxation significantly faster than previous methods for generating Lagrangian cuts and, when used within a branch-and-cut algorithm, significantly reduces the size of the search tree for three classes of test problems.


title: Manifold Topology Divergence: a Framework for Comparing Data Manifolds

abstract: We develop a framework for comparing data manifolds, aimed, in particular, towards the evaluation of deep generative models. We describe a novel tool, Cross-Barcode(P,Q), that, given a pair of distributions in a high-dimensional space, tracks multiscale topology spacial discrepancies between manifolds on which the distributions are concentrated. Based on the Cross-Barcode, we introduce the Manifold Topology Divergence score (MTop-Divergence) and apply it to assess the performance of deep generative models in various domains: images, 3D-shapes, time-series, and on different datasets: MNIST, Fashion MNIST, SVHN, CIFAR10, FFHQ, chest X-ray images, market stock data, ShapeNet. We demonstrate that the MTop-Divergence accurately detects various degrees of mode-dropping, intra-mode collapse, mode invention, and image disturbance. Our algorithm scales well (essentially linearly) with the increase of the dimension of the ambient high-dimensional space. It is one of the first TDA-based practical methodologies that can be applied universally to datasets of different sizes and dimensions, including the ones on which the most recent GANs in the visual domain are trained. The proposed method is domain agnostic and does not rely on pre-trained networks.


title: SpaceMeshLab: Spatial Context Memoization and Meshgrid Atrous Convolution Consensus for Semantic Segmentation

abstract: Semantic segmentation networks adopt transfer learning from image classification networks which occurs a shortage of spatial context information. For this reason, we propose Spatial Context Memoization (SpaM), a bypassing branch for spatial context by retaining the input dimension and constantly communicating its spatial context and rich semantic information mutually with the backbone network. Multi-scale context information for semantic segmentation is crucial for dealing with diverse sizes and shapes of target objects in the given scene. Conventional multi-scale context scheme adopts multiple effective receptive fields by multiple dilation rates or pooling operations, but often suffer from misalignment problem with respect to the target pixel. To this end, we propose Meshgrid Atrous Convolution Consensus (MetroCon^2) which brings multi-scale scheme into fine-grained multi-scale object context using convolutions with meshgrid-like scattered dilation rates. SpaceMeshLab (ResNet-101 + SpaM + MetroCon^2) achieves 82.0% mIoU in Cityscapes test and 53.5% mIoU on Pascal-Context validation set.


title: Subject-Independent Brain-Computer Interface for Decoding High-Level Visual Imagery Tasks

abstract: Brain-computer interface (BCI) is used for communication between humans and devices by recognizing status and intention of humans. Communication between humans and a drone using electroencephalogram (EEG) signals is one of the most challenging issues in the BCI domain. In particular, the control of drone swarms (the direction and formation) has more advantages compared to the control of a drone. The visual imagery (VI) paradigm is that subjects visually imagine specific objects or scenes. Reduction of the variability among EEG signals of subjects is essential for practical BCI-based systems. In this study, we proposed the subepoch-wise feature encoder (SEFE) to improve the performances in the subject-independent tasks by using the VI dataset. This study is the first attempt to demonstrate the possibility of generalization among subjects in the VI-based BCI. We used the leave-one-subject-out cross-validation for evaluating the performances. We obtained higher performances when including our proposed module than excluding our proposed module. The DeepConvNet with SEFE showed the highest performance of 0.72 among six different decoding models. Hence, we demonstrated the feasibility of decoding the VI dataset in the subject-independent task with robust performances by using our proposed module.


title: The Double-Bubble CME of the 2020 December 14 Total Solar Eclipse

abstract: Total solar eclipses (TSEs) continue to provide an invaluable platform for exploring the magnetic topology of the solar corona and for studying dynamic events such as Coronal Mass Ejections (CMEs) -- with a higher spatial resolution over a larger spatially continuous extent than is possible to achieve with any other method at present. In this Letter, we present observations of the full extent of a `double-bubble' CME structure from the solar surface out to over 5 solar radii, as captured during the 2020 December 14 TSE. Its evolution through the corona was recorded from two observing sites separated by 13 minutes in their times of totality. The eclipse observations are complemented by a plethora of space-based observations including: Extreme Ultraviolet observations of the solar disk and low corona from SDO/AIA and STEREO-A/EUVI, white-light coronagraph observations from SOHO/LASCO-C2, radio from STEREO-A/WAVES and WIND/WAVES, and X-ray from GOES-16. We also characterize the magnetic field with a potential field source surface model. This CME event itself is of particular interest, as it demonstrates interactions between a prominence channel and an active region that led to the double-bubble structure. Despite the plethora of space-based observations, only the eclipse data are able to provide the proper context to connect these observations and yield a detailed study of this unique CME.


title: Deep Learning Statistical Arbitrage

abstract: Statistical arbitrage exploits temporal price differences between similar assets. We develop a unifying conceptual framework for statistical arbitrage and a novel data driven solution. First, we construct arbitrage portfolios of similar assets as residual portfolios from conditional latent asset pricing factors. Second, we extract their time series signals with a powerful machine-learning time-series solution, a convolutional transformer. Lastly, we use these signals to form an optimal trading policy, that maximizes risk-adjusted returns under constraints. Our comprehensive empirical study on daily US equities shows a high compensation for arbitrageurs to enforce the law of one price. Our arbitrage strategies obtain consistently high out-of-sample mean returns and Sharpe ratios, and substantially outperform all benchmark approaches.


title: Mission Level Uncertainty in Multi-Agent Resource Allocation

abstract: In recent years, a significant research effort has been devoted to the design of distributed protocols for the control of multi-agent systems, as the scale and limited communication bandwidth characteristic of such systems render centralized control impossible. Given the strict operating conditions, it is unlikely that every agent in a multi-agent system will have local information that is consistent with the true system state. Yet, the majority of works in the literature assume that agents share perfect knowledge of their environment. This paper focuses on understanding the impact that inconsistencies in agents' local information can have on the performance of multi-agent systems. More specifically, we consider the design of multi-agent operations under a game theoretic lens where individual agents are assigned utilities that guide their local decision making. We provide a tractable procedure for designing utilities that optimize the efficiency of the resulting collective behavior (i.e., price of anarchy) for classes of set covering games where the extent of the information inconsistencies is known. In the setting where the extent of the informational inconsistencies is not known, we show -- perhaps surprisingly -- that underestimating the level of uncertainty leads to better price of anarchy than overestimating it.


title: Supporting Multiparty Signing over Named Data Networking

abstract: Modern digitally controlled systems require multiparty authentication and authorization to meet the desired security requirement. This paper describes the design and development of NDN-MPS, an automated solution to support multiparty signature signing and verification for NDN-enabled applications. NDN-MPS suggests several changes and extensions to the existing NDN security solutions. First, it introduces a new type of trust schema to support signing and verification for multiple signers under complex policies such as threshold schemes. Second, it extends the NDN signature format to accommodate multisignature schemes such as BLS signature. Third, it introduces a signature collection protocol to solicit signatures securely from multiple signers. We further evaluate NDN-MPS by assessing its security properties and measuring its performance.


title: Balancing Asymptotic and Transient Efficiency Guarantees in Set Covering Games

abstract: Game theoretic approaches have gained traction as robust methodologies for designing distributed local algorithms that induce a desired overall system configuration in multi-agent settings. However, much of the emphasis in these approaches is on providing asymptotic guarantees on the performance of a network of agents, and there is a gap in the study of efficiency guarantees along transients of these distributed algorithms. Therefore, in this paper, we study the transient efficiency guarantees of a natural game-theoretic algorithm in the class of set covering games, which have been used to model a variety of applications. Our main results characterize the optimal utility design that maximizes the guaranteed efficiency along the transient of the natural dynamics. Furthermore, we characterize the Pareto-optimal frontier with regards to guaranteed efficiency in the transient and the asymptote under a class of game-theoretic designs. Surprisingly, we show that there exists an extreme trade-off between the long-term and short-term guarantees in that an asymptotically optimal game-theoretic design can perform arbitrarily bad in the transient.


title: Effects of a non-causal electromagnetic response on the linear momentum transfer from a swift electron to a metallic nanoparticle

abstract: Electron beams in Scanning Transmission Electron Microscopes (STEMs) can be used as a tool to induce movement on nanoparticles. Employing a classical-electrodynamics approach, it has been reported that the linear momentum transfer from a STEM-beam electron to a metallic spherical nanoparticle can be either repulsive or attractive towards the swift electron trajectory. This is in qualitative agreement with experimental observations. The interaction time between a swift electron and a nanoparticle is typically on the order of attoseconds. Hence, the electromagnetic response of the nanoparticle at short times is of utmost importance. However, it has been reported that the dielectric function employed in previous studies presented a non-causal pre-echo at the attosecond timescale, which might have lead to incorrect unphysical results. Therefore, the validity of these linear momentum transfer results should be revisited. In this theoretical work, we study the non-causality effects on the linear momentum transferred from a swift electron to a metallic nanoparticle, made of either aluminum or gold. Using an efficient numerical methodology, we found that non-causality, as well as deficient numerical convergence, may lead to incorrect repulsive linear momentum transfer results. Contrary to what previous theoretical studies have reported, our results show that the linear momentum transfer from a swift electron to spherical aluminum and gold nanoparticles, with radius 1 nm, is always attractive.


title: Sample Complexity of Tree Search Configuration: Cutting Planes and Beyond

abstract: Cutting-plane methods have enabled remarkable successes in integer programming over the last few decades. State-of-the-art solvers integrate a myriad of cutting-plane techniques to speed up the underlying tree-search algorithm used to find optimal solutions. In this paper we prove the first guarantees for learning high-performing cut-selection policies tailored to the instance distribution at hand using samples. We first bound the sample complexity of learning cutting planes from the canonical family of Chv\'atal-Gomory cuts. Our bounds handle any number of waves of any number of cuts and are fine tuned to the magnitudes of the constraint coefficients. Next, we prove sample complexity bounds for more sophisticated cut selection policies that use a combination of scoring rules to choose from a family of cuts. Finally, beyond the realm of cutting planes for integer programming, we develop a general abstraction of tree search that captures key components such as node selection and variable selection. For this abstraction, we bound the sample complexity of learning a good policy for building the search tree.


title: GSGP-CUDA -- a CUDA framework for Geometric Semantic Genetic Programming

abstract: Geometric Semantic Genetic Programming (GSGP) is a state-of-the-art machine learning method based on evolutionary computation. GSGP performs search operations directly at the level of program semantics, which can be done more efficiently then operating at the syntax level like most GP systems. Efficient implementations of GSGP in C++ exploit this fact, but not to its full potential. This paper presents GSGP-CUDA, the first CUDA implementation of GSGP and the most efficient, which exploits the intrinsic parallelism of GSGP using GPUs. Results show speedups greater than 1,000X relative to the state-of-the-art sequential implementation.


title: Robust large-gap topological insulator phase in transition-metal chalcogenide ZrTe$_4$Se

abstract: Based on density functional theory (DFT), we investigate the electronic properties of bulk and single-layer ZrTe$_4$Se. The band structure of bulk ZrTe$_4$Se can produce a semimetal-to-topological insulator (TI) phase transition under uniaxial strain. The maximum global band gap is 0.189 eV at the 7\% tensile strain. Meanwhile, the Z$_2$ invariants (0; 110) demonstrate conclusively it is a weak topological insulator (WTI). The two Dirac cones for the (001) surface further confirm the nontrivial topological nature. The single-layer ZrTe$_4$Se is a quantum spin Hall (QSH) insulator with a band gap 86.4 meV and Z$_2$=1, the nontrivial metallic edge states further confirm the nontrivial topological nature. The maximum global band gap is 0.211 eV at the tensile strain 8\%. When the compressive strain is more than 1\%, the band structure of single-layer ZrTe$_4$Se produces a TI-to-semimetal transition. These theoretical analysis may provide a method for searching large band gap TIs and platform for topological nanoelectronic device applications.


title: Ratio sets of random sets

abstract: We study the typical behavior of the size of the ratio set $A/A$ for a random subset $A\subset \{1,\dots , n\}$. For example, we prove that $|A/A|\sim \frac{2\text{Li}_2(3/4)}{\pi^2}n^2 $ for almost all subsets $A \subset\{1,\dots ,n\}$. We also prove that the proportion of visible lattice points in the lattice $A_1\times\cdots \times A_d$, where $A_i$ is taken at random in $[1,n]$ with $\mathbb P(m\in A_i)=\alpha_i$ for any $m\in [1,n]$, is asymptotic to a constant $\mu(\alpha_1,\dots,\alpha_d)$ that involves the polylogarithm of order $d$.


title: Online Algorithms for Network Robustness under Connectivity Constraints

abstract: In this paper, we present algorithms for designing networks that are robust to node failures with minimal or limited number of links. We present algorithms for both the static network setting and the dynamic network setting; setting where new nodes can arrive in the future. For the static setting, we present algorithms for constructing the optimal network in terms of the number of links used for a given node size and the number of nodes that can fail. We then consider the dynamic setting where it is disruptive to remove any of the older links. For this setting, we present online algorithms for two cases: (i) when the number of nodes that can fail remains constant and (ii) when only the proportion of the nodes that can fail remains constant. We show that the proposed algorithm for the first case saves nearly $3/4$th of the total possible links at any point of time. We then present algorithms for various levels of the fraction of the nodes that can fail and characterize their link usage. We show that when $1/2$ the number of nodes can fail at any point of time, the proposed algorithm saves nearly $1/2$ of the total possible links at any point of time. We show that when the number of nodes that can fail is limited to the fraction $1/(2m)$ ($m \in \mathbb{N}$), the proposed algorithm saves nearly as much as $(1-1/2m)$ of the total possible links at any point of time. We also show that when the number of nodes that can fail at any point of time is $1/2$ of the number of nodes plus $n$, $n \in \mathbb{N}$, the number of links saved by the proposed algorithm reduces only linearly in $n$. We conjecture that the saving ratio achieved by the algorithms we present is optimal for the dynamic setting.


title: Three-dimensional Yang-Mills Chern-Simons theory from D3-brane background with D-instantons

abstract: By constructing the configuration of D3-branes with D(-1)-branes as D-instantons, we study the three-dimensional Yang-Mills Chern-Simons theory in holography. Due to the presence of the D-instantons, the D7-branes with discrepant embedding functions are able to be introduced in order to include the fundamental fermions (as flavors) and the Chern-Simons term (at very low energy) in the dual theory. The vacuum structure at zero temperature is studied in the soliton background and it illustrates the topological phase transition in the presence of instantons. Moreover, since the confinement/deconfinement phase transition could be holographically identified as the Hawking-Page transition in the bulk, we accordingly calculate the critical temperature of the deconfinement phase transition by collecting the bulk onshell action as the thermodynamical free energy. On the other hand, we evaluate the difference of the entanglement entropy in slab configuration by using the RT formula since the confinement may also be characterized by the entanglement entropy. Altogether we find the behavior of the critical temperature is in qualitative agreement with the behavior of the critical length determined by the entanglement entropy which implies the entanglement entropy could indeed be a character of the confinement in our setup and the D3-D(-1) system would be a remarkable approach to study the three-dimensional gauge theory.


title: Infinite-Dimensional Linear Algebra and Solvability of Partial Differential Equations

abstract: We discuss linear algebra of infinite-dimensional vector spaces in terms of algebraic (Hamel) bases. As an application we prove the surjectivity of a large class of linear partial differential operators with smooth ($\mathcal C^\infty$-coefficients) coefficients, called in the article \emph{regular}, acting on the algebraic dual $\mathcal D^*(\Omega)$ of the space of test-functions $\mathcal D(\Omega)$. The surjectivity of the partial differential operators guarantees solvability of the corresponding partial differential equations within $\mathcal D^*(\Omega)$. We discuss our result in contrast to and comparison with similar results about the restrictions of the regular operators on the space of Schwartz distribution $\mathcal D^\prime(\Omega)$, where these operators are often non-surjective.


title: Exploring Spin Symmetry-Breaking Effects for Static Field Ionization of Atoms: Is There an Analog to the Coulson-Fischer Point in Bond Dissociation?

abstract: L\"owdin's symmetry dilemma is an ubiquitous issue in approximate quantum chemistry. In the context of Hartree-Fock (HF) theory, the use of Slater determinants with some imposed constraints to preserve symmetries of the exact problem may lead to physically unreasonable potential energy surfaces. On the other hand, lifting these constraints leads to the so-called broken symmetry solutions that usually provide better energetics, at the cost of losing information about good quantum numbers that describe the state of the system. This behavior has been previously extensively studied in the context of bond dissociation. This paper studies the behavior of different classes of Hartree-Fock spin polarized solutions (restricted, unrestricted, generalized) in the context of ionization by strong static electric fields. We find that, for simple two-electron systems, UHF is able to provide a qualitatively good description of states involved during the ionization process (neutral, singly-ionized and doubly ionized states), whereas RHF fails to describe the singly ionized state. For more complex systems, even though UHF is able to capture some of the expected characteristics of the ionized states, it is constrained to a single $M_s$ (diabatic) manifold in the energy surface as a function of field intensity. In this case a better qualitative picture can be painted by GHF as it is able to explore different spin manifolds and follow the lowest solution due to lack of collinearity constraints on the spin quantization axis.


title: An Energetic Hot Wind from the Low-luminosity Active Galactic Nucleus M81*

abstract: For most of their lifetime, super-massive black holes (SMBHs) commonly found in galactic nuclei obtain mass from the ambient at a rate well below the Eddington limit, which is mediated by a radiatively inefficient, hot accretion flow. Both theory and numerical simulations predict that a strong wind must exist in such hot accretion flows. The wind is of special interest not only because it is an indispensable ingredient of accretion, but perhaps more importantly, it is believed to play a crucial role in the evolution of the host galaxy via the so-called kinetic mode AGN feedback. Observational evidence for this wind, however, remains scarce and indirect. Here we report the detection of a hot outflow from the low-luminosity active galactic nucleus in M81, based on {\it Chandra} high-resolution X-ray spectroscopy. The outflow is evidenced by a pair of Fe XXVI Ly$\alpha$ lines redshifted and blueshifted at a bulk line-of-sight velocity of $\pm2.8\times10^3 \rm~km~s^{-1}$ and a high Fe XXVI Ly$\alpha$-to-Fe XXV K$\alpha$ line ratio implying a plasma temperature of $1.3\times10^8$ Kelvin. This high-velocity, hot plasma cannot be produced by stellar activity or the accretion inflow onto the SMBH. Our magnetohydrodynamical simulations show, instead, it is naturally explained by a wind from the hot accretion flow, propagating out to $\gtrsim10^6$ times the gravitational radius of the SMBH. The kinetic energy and momentum of this wind can significantly affect the evolution of the circumnuclear environment and beyond.


title: The blowdown of ancient noncollapsed mean curvature flows

abstract: In this paper, we consider ancient noncollapsed mean curvature flows $M_t=\partial K_t\subset \mathbb{R}^{n+1}$ that do not split off a line. It follows from general theory that the blowdown of any time-slice, $\lim_{\lambda \to 0} \lambda K_{t_0}$, is at most $n-1$ dimensional. Here, we show that the blowdown is in fact at most $n-2$ dimensional. Our proof is based on fine cylindrical analysis, which generalizes the fine neck analysis that played a key role in many recent papers. Moreover, we show that in the uniformly $k$-convex case, the blowdown is at most $k-2$ dimensional. This generalizes recent results from Choi-Haslhofer-Hershkovits to higher dimensions, and also has some applications towards the classification problem for singularities in 3-convex mean curvature flow.


title: Dilated Convolution based CSI Feedback Compression for Massive MIMO Systems

abstract: Although the frequency-division duplex (FDD) massive multiple-input multiple-output (MIMO) system can offer high spectral and energy efficiency, it requires to feedback the downlink channel state information (CSI) from users to the base station (BS), in order to fulfill the precoding design at the BS. However, the large dimension of CSI matrices in the massive MIMO system makes the CSI feedback very challenging, and it is urgent to compress the feedback CSI. To this end, this paper proposes a novel dilated convolution based CSI feedback network, namely DCRNet. Specifically, the dilated convolutions are used to enhance the receptive field (RF) of the proposed DCRNet without increasing the convolution size. Moreover, advanced encoder and decoder blocks are designed to improve the reconstruction performance and reduce computational complexity as well. Numerical results are presented to show the superiority of the proposed DCRNet over the conventional networks. In particular, the proposed DCRNet can achieve almost the state-of-the-arts (SOTA) performance with much lower floating point operations (FLOPs). The open source code and checkpoint of this work are available at https://github.com/recusant7/DCRNet.


title: A new family of latitudinally corrugated two-spheres of revolution with simple cut locus

abstract: There are not so many kinds of surface of revolution whose cut locus structure have been determined, although the cut locus structures of very familiar surfaces of revolution (in Euclidean space) such as ellipsoids, 2-sheeted hyperboloids, paraboloids, and tori are now known. Except for tori, the known cut locus structures are very simple, i.e., a single point or an arc. In this article, a new family {M_n}_n of 2-spheres of revolution with simple cut locus structure is introduced. This family is also new in the sense that the number of points on each meridian which assume a local minimum or maximum of the Gaussian curvature function on the meridian goes to infinity as n goes to infinity.


title: Noise-Resilient Phase Transitions and Limit-Cycles in Coupled Kerr Oscillators

abstract: Driven-dissipative quantum many-body systems have been the subject of many studies in recent years. They possess unique, novel classes of dissipation-stabilized quantum many-body phases including the limit cycle. For a long time it has been speculated if such a behavior, a recurring phenomenon in non-linear classical and quantum many-body systems, can be classified as a time crystal. However, the robustness of these periodic dynamics, against quantum fluctuations is an open question. In this work we seek the answer to this question in a canonical yet important system, i.e., a multi-mode cavity with self and cross-Kerr non-linearity, including the fluctuation effects via higher order correlations. Employing the Keldysh path integral, we investigate the Green's function and correlation of the cavity modes in different regions. Furthermore, we extend our analysis beyond the mean-field by explicitly including the effect of two-body correlations via the 2nd-cumulant expansion. Our results shed light on the emergence of dissipative phase transitions in open quantum systems and clearly indicate the robustness of limit-cycle oscillations in the presence of the quantum fluctuations.


title: Dynamic Opening of a Gap in Dirac Surface States of the Thin-Film 3D Topological Insulator Bi2Se3 Driven by the Dynamic Rashba Effect

abstract: Optical control of Dirac surface states (SS) in topological insulators (TI) remains one of the most challenging problems governing their potential applications in novel electronic and spintronic devices. Here, using visible-range transient absorption spectroscopy exploiting ~340 nm (~3.65 eV) pumping, we provide evidence for dynamic opening of a gap in Dirac SS of the thin-film 3D TI Bi2Se3, which has been induced by the dynamic Rashba effect occurring in the film bulk with increasing optical pumping power (photoexcited carrier density). The observed effect appears through the transient absorption band associated with inverse-bremsstrahlung-type free carrier absorption in the gapped Dirac SS. We have also recognized experimental signatures of the existence of the higher energy Dirac SS in the 3D TI Bi2Se3 (in addition to those known as SS1 and SS2) with energies of ~2.7 and ~3.9 eV (SS3 and SS4). It is evidenced that the dynamic gap opening has the same effect on the Dirac SS occurring at any energy.


title: Joint Channel Estimation and Mixed-ADCs Allocation for Massive MIMO via Deep Learning

abstract: Millimeter wave (mmWave) multi-user massive multi-input multi-output (MIMO) is a promising technique for the next generation communication systems. However, the hardware cost and power consumption grow significantly as the number of radio frequency (RF) components increases, which hampers the deployment of practical massive MIMO systems. To address this issue and further facilitate the commercialization of massive MIMO, mixed analog-to-digital converters (ADCs) architecture has been considered, where parts of conventionally assumed full-resolution ADCs are replaced by one-bit ADCs. In this paper, we first propose a deep learning-based (DL) joint pilot design and channel estimation method for mixed-ADCs mmWave massive MIMO. Specifically, we devise a pilot design neural network whose weights directly represent the optimized pilots, and develop a Runge-Kutta model-driven densely connected network as the channel estimator. Instead of randomly assigning the mixed-ADCs, we then design a novel antenna selection network for mixed-ADCs allocation to further improve the channel estimation accuracy. Moreover, we adopt an autoencoder-inspired end-to-end architecture to jointly optimize the pilot design, channel estimation and mixed-ADCs allocation networks. Simulation results show that the proposed DL-based methods have advantages over the traditional channel estimators as well as the state-of-the-art networks.


title: H-ModQuad: Modular Multi-Rotors with 4, 5, and 6 Controllable DOF

abstract: Traditional aerial vehicles are usually custom-designed for specific tasks. Although they offer an efficient solution, they are not always able to adapt to changes in the task specification, e.g., increasing the payload. This applies to quadrotors, having a maximum payload and only four controllable degrees of freedom, limiting their adaptability to the task's variations. We propose a versatile modular robotic system that can increase its payload and degrees of freedom by assembling heterogeneous modules; we call it H-ModQuad. It consists of cuboid modules propelled by quadrotors with tilted propellers that can generate forces in different directions. By connecting different types of modules, an H-ModQuad can increase its controllable degrees of freedom from 4 to 5 and 6. We model the general structure and propose three controllers, one for each number of controllable degrees of freedom. We extend the concept of the actuation ellipsoid to find the best reference orientation that can maximize the performance of the structure. Our approach is validated with experiments using actual robots, showing the independence of the translation and orientation of a structure.


title: Random symmetric matrices: rank distribution and irreducibility of the characteristic polynomial

abstract: Conditional on the extended Riemann hypothesis, we show that with high probability, the characteristic polynomial of a random symmetric $\{\pm 1\}$-matrix is irreducible. This addresses a question raised by Eberhard in recent work. The main innovation in our work is establishing sharp estimates regarding the rank distribution of symmetric random $\{\pm 1\}$-matrices over $\mathbb{F}_p$ for primes $2 < p \leq \exp(O(n^{1/4}))$. Previously, such estimates were available only for $p = o(n^{1/8})$. At the heart of our proof is a way to combine multiple inverse Littlewood--Offord-type results to control the contribution to singularity-type events of vectors in $\mathbb{F}_p^{n}$ with anticoncentration at least $1/p + \Omega(1/p^2)$. Previously, inverse Littlewood--Offord-type results only allowed control over vectors with anticoncentration at least $C/p$ for some large constant $C > 1$.


title: Seebeck effect of Dirac electrons

abstract: We study the Seebeck effect in the three-dimensional Dirac electron system based on the linear response theory with Luttinger's gravitational potential. The Seebeck coefficient $S$ is defined by $S = L_{12} / L_{11} T$, where $T$ is the temperature, and $L_{11}$ and $L_{12}$ are the longitudinal response coefficients of the charge current to the electric field and to the temperature gradient, respectively; $L_{11}$ is the electric conductivity and $L_{12}$ is the thermo-electric conductivity. We consider randomly-distributed impurity potentials as the source of the momentum relaxation of electrons and microscopically calculate the relaxation rate and the vertex corrections of $L_{11}$ and $L_{12}$ due to the impurities. It is confirmed that $L_{11}$ and $L_{12}$ are related through Mott's formula in low temperatures when the chemical potential lies above the gap ($|\mu| > \Delta$), irrespective of the linear dispersion of the Dirac electrons and unconventional energy dependence of the lifetime of electrons. On the other hand, when the chemical potential lies in the band gap ($|\mu| < \Delta$), Seebeck coefficient behaves just as in conventional semiconductors: Its dependences on the chemical potential $\mu$ and the temperature $T$ are partially captured by $S \propto (\Delta - \mu) / \kB T$ for $\mu > 0$. The Seebeck coefficient takes the relatively large value $|S| \simeq 1.7 \,\mathrm{m V/K}$ at $T \simeq 8.7\,\mathrm{K}$ for $\Delta = 15 \,\mathrm{m eV}$ by assuming doped bismuth.


title: Graph-MLP: Node Classification without Message Passing in Graph

abstract: Graph Neural Network (GNN) has been demonstrated its effectiveness in dealing with non-Euclidean structural data. Both spatial-based and spectral-based GNNs are relying on adjacency matrix to guide message passing among neighbors during feature aggregation. Recent works have mainly focused on powerful message passing modules, however, in this paper, we show that none of the message passing modules is necessary. Instead, we propose a pure multilayer-perceptron-based framework, Graph-MLP with the supervision signal leveraging graph structure, which is sufficient for learning discriminative node representation. In model-level, Graph-MLP only includes multi-layer perceptrons, activation function, and layer normalization. In the loss level, we design a neighboring contrastive (NContrast) loss to bridge the gap between GNNs and MLPs by utilizing the adjacency information implicitly. This design allows our model to be lighter and more robust when facing large-scale graph data and corrupted adjacency information. Extensive experiments prove that even without adjacency information in testing phase, our framework can still reach comparable and even superior performance against the state-of-the-art models in the graph node classification task.


title: Molecular Cloud Cores with High Deuterium Fractions: Nobeyama Mapping Survey

abstract: We present the results of on-the-fly mapping observations of 44 fields containing 107 SCUBA-2 cores in the emission lines of molecules, N$_2$H$^+$, HC$_3$N, and CCS at 82$-$94 GHz using the Nobeyama 45-m telescope. This study aimed at investigating the physical properties of cores that show high deuterium fractions and might be close to the onset of star formation. We found that the distributions of the N$_2$H$^+$ and HC$_3$N line emissions are approximately similar to that of 850-$\mu$m dust continuum emission, whereas the CCS line emission is often undetected or is distributed in a clumpy structure surrounding the peak position of the 850-$\mu$m dust continuum emission. Occasionally (12%), we observe the CCS emission which is an early-type gas tracer toward the young stellar object, probably due to local high excitation. Evolution toward star formation does not immediately affect nonthermal velocity dispersion.


title: Discriminative Triad Matching and Reconstruction for Weakly Referring Expression Grounding

abstract: In this paper, we are tackling the weakly-supervised referring expression grounding task, for the localization of a referent object in an image according to a query sentence, where the mapping between image regions and queries are not available during the training stage. In traditional methods, an object region that best matches the referring expression is picked out, and then the query sentence is reconstructed from the selected region, where the reconstruction difference serves as the loss for back-propagation. The existing methods, however, conduct both the matching and the reconstruction approximately as they ignore the fact that the matching correctness is unknown. To overcome this limitation, a discriminative triad is designed here as the basis to the solution, through which a query can be converted into one or multiple discriminative triads in a very scalable way. Based on the discriminative triad, we further propose the triad-level matching and reconstruction modules which are lightweight yet effective for the weakly-supervised training, making it three times lighter and faster than the previous state-of-the-art methods. One important merit of our work is its superior performance despite the simple and neat design. Specifically, the proposed method achieves a new state-of-the-art accuracy when evaluated on RefCOCO (39.21%), RefCOCO+ (39.18%) and RefCOCOg (43.24%) datasets, that is 4.17%, 4.08% and 7.8% higher than the previous one, respectively.


title: Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentation

abstract: Weakly supervised semantic segmentation is receiving great attention due to its low human annotation cost. In this paper, we aim to tackle bounding box supervised semantic segmentation, i.e., training accurate semantic segmentation models using bounding box annotations as supervision. To this end, we propose Affinity Attention Graph Neural Network ($A^2$GNN). Following previous practices, we first generate pseudo semantic-aware seeds, which are then formed into semantic graphs based on our newly proposed affinity Convolutional Neural Network (CNN). Then the built graphs are input to our $A^2$GNN, in which an affinity attention layer is designed to acquire the short- and long- distance information from soft graph edges to accurately propagate semantic labels from the confident seeds to the unlabeled pixels. However, to guarantee the precision of the seeds, we only adopt a limited number of confident pixel seed labels for $A^2$GNN, which may lead to insufficient supervision for training. To alleviate this issue, we further introduce a new loss function and a consistency-checking mechanism to leverage the bounding box constraint, so that more reliable guidance can be included for the model optimization. Experiments show that our approach achieves new state-of-the-art performances on Pascal VOC 2012 datasets (val: 76.5\%, test: 75.2\%). More importantly, our approach can be readily applied to bounding box supervised instance segmentation task or other weakly supervised semantic segmentation tasks, with state-of-the-art or comparable performance among almot all weakly supervised tasks on PASCAL VOC or COCO dataset. Our source code will be available at https://github.com/zbf1991/A2GNN.


title: New Gelfond-Type Transcendental Numbers

abstract: It is well known that value at a non-zero algebraic number of each of the functions $e^{x}, \ln x, \sin x, \cos x, \tan x, \csc x, \sec x, \cot x, \sinh x,$ $ \cosh x,$ $ \tanh x,$ and $\coth x$ is transcendental number (see Theorem 9.11 of \cite{N}). In the work, we show that for any one of the above mentioned functions, $f(x)$, and for a polynomial $g(x)$ with rational coefficients the zero, if any, of the equation $f(x)=g(x)$ is a transcendental number. We also show that if $f(x)$ and $g(x)$ are polynomials with rational coefficients, then a zero of the equation $e^{f(x)}=g(x)$ is a transcendental number. Finally we show that the existence of an abelian group whose non-zero elements are transcendental numbers.


title: The use of hyaluronic acid in individuals with cleft lip and palate: Literature review

abstract: Since the Resolution 198/2019 of Brazilian Dental Council, which regulates orofacial harmonization as a dental specialty, and the advent of various uses of facial fillers, such as hyaluronic acid (HA), it is possible to perform both esthetic and functional corrections in individuals. Individuals with cleft lip and palate (CLP) present lip irregularities even after orofacial rehabilitation with an interdisciplinary team with several corrective surgeries, interfering with the esthetics, which can cause problems in self-esteem and social insertion. Thus, facial filling is an innovation that, together with dentistry, contributes to the individual's esthetics and well-being. Considering the patient safety and health, more research is progressively being conducted to make such procedures less invasive. This work conducted a literature review on the use of HA as a facial filler to correct lip scars in patients with CLP. By a literature and transverse search in Scientific Electronic Library Online and PubMed databases using specific descriptors, the studies that met the inclusion criteria were selected, from 1990 to 2020. It can be concluded that the use of HA as a facial filling material in the correction of lip scars from reparative surgeries related to CLP has been shown to be effective both for correction of facial asymmetry and to improve the quality of life of patients who used the procedure.


title: Cauchy and Goursat problems for the generalized spin zero rest-mass fields on Minkowski spacetime

abstract: In this paper, we study the Cauchy and Goursat problems of the spin-$n/2$ zero rest-mass equations on Minkowski spacetime by using the conformal geometric method. In our strategy, we prove the wellposedness of the Cauchy problem in Einstein's cylinder. Then we establish pointwise decays of the fields and prove the energy equalities of the conformal fields between the null conformal boundaries $\scri^\pm$ and the hypersurface $\Sigma_0=\left\{ t=0 \right\}$. Finally, we prove the wellposedness of the Goursat problem in the partial conformal compactification by using the energy equalities and the generalisation of H\"ormander's result.


title: Extract the Degradation Information in Squeezed States with Machine Learning

abstract: In order to leverage the full power of quantum noise squeezing with unavoidable decoherence, a complete understanding of the degradation in the purity of squeezed light is demanded. By implementing machine learning architecture with a convolutional neural network, we illustrate a fast, robust, and precise quantum state tomography for continuous variables, through the experimentally measured data generated from the balanced homodyne detectors. Compared with the maximum likelihood estimation method, which suffers from time-consuming and over-fitting problems, a well-trained machine fed with squeezed vacuum and squeezed thermal states can complete the task of reconstruction of the density matrix in less than one second. Moreover, the resulting fidelity remains as high as $0.99$ even when the anti-squeezing level is higher than $20$~dB. Compared with the phase noise and loss mechanisms coupled from the environment and surrounding vacuum, experimentally, the degradation information is unveiled with machine learning for low and high noisy scenarios, i.e., with the anti-squeezing levels at $12$~dB and $18$~dB, respectively. Our neural network enhanced quantum state tomography provides the metrics to give physical descriptions of every feature observed in the quantum state with a single-shot measurement and paves a way of exploring large-scale quantum systems in real-time.


title: Systematic experimental comparison of particle filtration efficiency test methods for commercial respirators and face masks

abstract: Respirators, medical masks, and barrier face coverings all filter airborne particles using similar physical principles. However, they are tested for certification using a variety of standardized test methods, creating challenges for the comparison of differently certified products. We have performed systematic experiments to quantify and understand the differences between standardized test methods for N95 respirators (NIOSH TEB-APR-STP-0059 under US 42 CFR 84), medical face masks (ASTM F2299/F2100), and COVID-19-related barrier face coverings (ASTM F3502-21). Our experiments demonstrate the role of face velocity, particle properties (mean size, size variability, electric charge, density, and shape), measurement techniques, and environmental preconditioning. The measured filtration efficiency was most sensitive to changes in face velocity and particle charge. Relative to the NIOSH method, users of the ASTM F2299/F2100 method have commonly used non-neutralized (highly charged) aerosols as well as smaller face velocities, each of which may result in approximately 10% higher measured filtration efficiencies. In the NIOSH method, environmental conditioning at elevated humidity increased filtration efficiency in some commercial samples while decreasing it in others, indicating that measurement should be performed both with and without conditioning. More generally, our results provide an experimental basis for the comparison of respirators certified under various international methods, including FFP2, KN95, P2, Korea 1st Class, and DS2.


title: Self-supervised and Supervised Joint Training for Resource-rich Machine Translation

abstract: Self-supervised pre-training of text representations has been successfully applied to low-resource Neural Machine Translation (NMT). However, it usually fails to achieve notable gains on resource-rich NMT. In this paper, we propose a joint training approach, $F_2$-XEnDec, to combine self-supervised and supervised learning to optimize NMT models. To exploit complementary self-supervised signals for supervised learning, NMT models are trained on examples that are interbred from monolingual and parallel sentences through a new process called crossover encoder-decoder. Experiments on two resource-rich translation benchmarks, WMT'14 English-German and WMT'14 English-French, demonstrate that our approach achieves substantial improvements over several strong baseline methods and obtains a new state of the art of 46.19 BLEU on English-French when incorporating back translation. Results also show that our approach is capable of improving model robustness to input perturbations such as code-switching noise which frequently appears on social media.


title: Interpretation of the Schur-Cohn test in terms of canonical systems

abstract: We solve direct and inverse problems for two-dimensional (quasi) canonical systems related to exponential polynomials of a specific but sufficiently general type. The approach to the inverse problem in this paper provides an interpretation of the matrices and their determinants in the classical Schur-Cohn test for polynomials in terms of Hamiltonians of canonical system.


title: A magnetic Weyl semimetallic phase in thin films of Eu$_2$Ir$_2$O$_7$

abstract: The interplay between electronic interactions and strong spin-orbit coupling is expected to create a plethora of fascinating correlated topological states of quantum matter. Of particular interest are magnetic Weyl semimetals originally proposed in the pyrochlore iridates, which are only expected to reveal their topological nature in thin film form. To date, however, direct experimental demonstrations of these exotic phases remain elusive, due to the lack of usable single crystals and the insufficient quality of available films. Here, we report on the discovery of the long-sought magnetic Weyl semi-metallic phase in (111)-oriented Eu$_2$Ir$_2$O$_7$ high-quality epitaxial thin films. The topological magnetic state shows an intrinsic anomalous Hall effect with colossal coercivity but vanishing net magnetization, which emerges below the onset of a peculiar magnetic phase with all-in-all-out antiferromagnetic ordering. The observed anomalous Hall conductivity arises from the non-zero Berry curvature emanated by Weyl node pairs near the Fermi level that act as sources and sinks of Berry flux, activated by broken cubic crystal symmetry at the top and bottom terminations of the thin film.


title: Elastic Wave Propagation and Bandgaps in Finitely Stretched Soft Lattice Material

abstract: In this study, the in-plane Bloch wave propagation and bandgaps in a finitely stretched square lattice were investigated numerically and theoretically. To be specific, the elastic band diagram was calculated for an infinite periodic structure with a cruciform hyperelastic unit cell under uniaxial or biaxial tension. In addition, an elastodynamic "tight binding" model was proposed to investigate the formation and evolution of the band structure. The elastic waves were found to propagate largely under "easy" modes in the pre-stretched soft lattice, and finite stretch tuned the symmetry of the band structure, but also "purify" the propagation modes. Moreover, the uniaxial stretch exhibits the opposite impacts on the two "easy" modes. The effect of the biaxial stretch was equated with the superposition of the uniaxial stretches in the tessellation directions. The mentioned effects on the band structure could be attributed to the competition between the effective shear moduli and lengths for different beam components. Next, the finite stretch could tune the directional bandgap of the soft lattice, and the broadest elastic wave bandgaps could be anticipated in an equi-biaxial stretch. In this study, an avenue was opened to design and implement elastic wave control devices with weight efficiency and tunability. Furthermore, the differences between the physical system and the corresponding simplified theoretical model (e.g., the theoretically predicted flat bands) did not exist in the numerical calculations.


title: Can we measure the collapse time of a post-merger remnant for a future GW170817-like event?

abstract: Measuring the collapse time of a binary neutron star merger remnant can inform the physics of extreme matter and improve modelling of short gamma-ray bursts and associated kilonova. The lifetime of the post-merger remnant directly impacts the mechanisms available for the jet launch of short gamma-ray bursts. We develop and test a method to measure the collapse time of post-merger remnants. We show that for a GW170817-like event at $\sim\!40\,$Mpc, a network of Einstein Telescope with Cosmic Explorer is required to detect collapse times of $\sim\!10\,$ms. For a two-detector network at A+ design sensitivity, post-merger remnants with collapse times of $\sim\!10\,\mathrm{ms}$ must be $\lesssim 10\,$Mpc to be measureable. This increases to $\sim\!18-26\,$Mpc if we include the proposed Neutron star Extreme Matter Observatory (NEMO), increasing the effective volume by a factor of $\sim\!30$.


title: Implications of Local Friendliness violation for quantum causality

abstract: We provide a new formulation of the Local Friendliness no-go theorem of Bong et al [Nat. Phys. 16, 1199 (2020)] from fundamental causal principles, providing another perspective on how it puts strictly stronger bounds on quantum reality than Bell's theorem. In particular, quantum causal models have been proposed as a way to maintain a peaceful coexistence between quantum mechanics and relativistic causality, while respecting Leibniz's methodological principle. This works for Bell's theorem but does not work for the Local Friendliness no-go theorem, which considers an extended Wigner's Friend scenario. More radical conceptual renewal is required; we suggest that cleaving to Leibniz's principle requires extending relativity to events themselves.


title: Semantically Adversarial Scenario Generation with Explicit Knowledge Guidance

abstract: Generating adversarial scenarios, which have the potential to fail autonomous driving systems, provides an effective way to improve robustness. Extending purely data-driven generative models, recent specialized models satisfy additional controllable requirements such as embedding a traffic sign in a driving scene by manipulating patterns implicitly in the neuron level. In this paper, we introduce a method to incorporate domain knowledge explicitly in the generation process to achieve the Semantically Adversarial Generation (SAG). To be consistent with the composition of driving scenes, we first categorize the knowledge into two types, the property of objects and the relationship among objects. We then propose a tree-structured variational auto-encoder (T-VAE) to learn hierarchical scene representation. By imposing semantic rules on the properties of nodes and edges in the tree structure, explicit knowledge integration enables controllable generation. We construct a synthetic example to illustrate the controllability and explainability of our method in a succinct setting. We further extend to realistic environments for autonomous vehicles: our method efficiently identifies adversarial driving scenes against different state-of-the-art 3D point cloud segmentation models and satisfies the traffic rules specified as the explicit knowledge.


title: LocalTrans: A Multiscale Local Transformer Network for Cross-Resolution Homography Estimation

abstract: Cross-resolution image alignment is a key problem in multiscale gigapixel photography, which requires to estimate homography matrix using images with large resolution gap. Existing deep homography methods concatenate the input images or features, neglecting the explicit formulation of correspondences between them, which leads to degraded accuracy in cross-resolution challenges. In this paper, we consider the cross-resolution homography estimation as a multimodal problem, and propose a local transformer network embedded within a multiscale structure to explicitly learn correspondences between the multimodal inputs, namely, input images with different resolutions. The proposed local transformer adopts a local attention map specifically for each position in the feature. By combining the local transformer with the multiscale structure, the network is able to capture long-short range correspondences efficiently and accurately. Experiments on both the MS-COCO dataset and the real-captured cross-resolution dataset show that the proposed network outperforms existing state-of-the-art feature-based and deep-learning-based homography estimation methods, and is able to accurately align images under $10\times$ resolution gap.


title: A fundamental derivation of two Boris solvers and the Ge-Marsden theorem

abstract: For a separable Hamiltonian, there are two fundamental, time-symmetric, second-order velocity-Verlet (VV) and position-Verlet (PV) symplectic integrators. Similarly, there are two VV and PV version of exact energy conserving algorithms for solving magnetic field trajectories. For a constant magnetic field, both algorithms can be further modified so that their trajectories are exactly on the gyro-circle. The magnetic PV integrator then becomes the well known Boris solver, while VV yields a second, previously unknown, Boris-type algorithm. Remarkably, the required on-orbit modification is a reparametrization of the time step, reminiscent of the Ge-Marsden theorem.


title: Chirped periodic and solitary waves in nonlinear negative index materials

abstract: Propagation of ultrashort pulses at least a few tens of optical cycles in duration through a negative index material is investigated theoretically based on the generalized nonlinear Schr\"{o}dinger equation with pseudo-quintic nonlinearity and self-steepening effect. Novel periodic waves of different forms are shown to exist in the system in the presence of higher-order effects. It is found that such periodic structures exhibit an interesting chirping property which depends on the light field intensity. The nonlinearity in pulse chirp is found to be caused by the presence of self-steepening effect in the negative index medium. The solutions also comprise dark, bright, and kink solitary waves. Stability of the solitary wave solutions are proved analytically using the theory of nonlinear dispersive waves. The stability of the solutions is numerically studied under finite initial perturbations.


title: Programmable Interactions and Emergent Geometry in an Atomic Array

abstract: Interactions govern the flow of information and the formation of correlations in quantum systems, dictating the phases of matter found in nature and the forms of entanglement generated in the laboratory. Typical interactions decay with distance and thus produce a network of connectivity governed by geometry, e.g., by the crystalline structure of a material or the trapping sites of atoms in a quantum simulator. However, many envisioned applications in quantum simulation and computation require richer coupling graphs including nonlocal interactions, which notably feature in mappings of hard optimization problems onto frustrated spin systems and in models of information scrambling in black holes. Here, we report on the realization of programmable nonlocal interactions in an array of atomic ensembles within an optical cavity, where photons carry information between distant atomic spins. By programming the distance-dependence of interactions, we access effective geometries where the dimensionality, topology, and metric are entirely distinct from the physical arrangement of atoms. As examples, we engineer an antiferromagnetic triangular ladder, a Moebius strip with sign-changing interactions, and a treelike geometry inspired by concepts of quantum gravity. The tree graph constitutes a toy model of holographic duality, where the quantum system may be viewed as lying on the boundary of a higher-dimensional geometry that emerges from measured spin correlations. Our work opens broader prospects for simulating frustrated magnets and topological phases, investigating quantum optimization algorithms, and engineering new entangled resource states for sensing and computation.


title: Robust orbital diamagnetism of correlated Dirac fermions in chiral Ising universality class

abstract: We study orbital diamagnetism at zero temperature in $(2+1)$-dimensional Dirac fermions with a short-range interaction which exhibits a quantum phase transition to a charge density wave (CDW) phase. We introduce orbital magnetic fields into spinless Dirac fermions on the $\pi$-flux square lattice, and analyze them by using infinite density matrix renormalization group. It is found that the diamagnetism remains intact in the Dirac semimetal regime as a result of a non-trivial competition between the enhanced Fermi velocity and magnetic-field-induced mass gap, while it is monotonically suppressed in the CDW regime. Around the quantum critical point (QCP) of the CDW phase transition, we find a scaling behavior of the diamagnetism characteristic of the chiral Ising universality class. This defines a universal behavior of orbital diamagnetism in correlated Dirac fermions around a QCP, and therefore the robust diamagnetism in the semimetal regime is a universal property of Dirac systems whose criticality belongs to the chiral Ising universality class. The scaling behavior may also be regarded as a quantum, magnetic analogue of the critical Casimir effect which has been widely studied for classical phase transitions.


title: Coarse-to-Fine Curriculum Learning

abstract: When faced with learning challenging new tasks, humans often follow sequences of steps that allow them to incrementally build up the necessary skills for performing these new tasks. However, in machine learning, models are most often trained to solve the target tasks directly.Inspired by human learning, we propose a novel curriculum learning approach which decomposes challenging tasks into sequences of easier intermediate goals that are used to pre-train a model before tackling the target task. We focus on classification tasks, and design the intermediate tasks using an automatically constructed label hierarchy. We train the model at each level of the hierarchy, from coarse labels to fine labels, transferring acquired knowledge across these levels. For instance, the model will first learn to distinguish animals from objects, and then use this acquired knowledge when learning to classify among more fine-grained classes such as cat, dog, car, and truck. Most existing curriculum learning algorithms for supervised learning consist of scheduling the order in which the training examples are presented to the model. In contrast, our approach focuses on the output space of the model. We evaluate our method on several established datasets and show significant performance gains especially on classification problems with many labels. We also evaluate on a new synthetic dataset which allows us to study multiple aspects of our method.


title: Salvage of Supervision in Weakly Supervised Object Detection

abstract: Weakly supervised object detection~(WSOD) has recently attracted much attention. However, the lack of bounding-box supervision makes its accuracy much lower than fully supervised object detection (FSOD), and currently modern FSOD techniques cannot be applied to WSOD. To bridge the performance and technical gaps between WSOD and FSOD, this paper proposes a new framework, Salvage of Supervision (SoS), with the key idea being to harness every potentially useful supervisory signal in WSOD: the weak image-level labels, the pseudo-labels, and the power of semi-supervised object detection. This paper proposes new approaches to utilize these weak and noisy signals effectively, and shows that each type of supervisory signal brings in notable improvements, outperforms existing WSOD methods (which mainly use only the weak labels) by large margins. The proposed SoS-WSOD method also has the ability to freely use modern FSOD techniques. SoS-WSOD achieves 64.4 $m\text{AP}_{50}$ on VOC2007, 61.9 $m\text{AP}_{50}$ on VOC2012 and 16.6 $m\text{AP}_{50:95}$ on MS-COCO, and also has fast inference speed. Ablations and visualization further verify the effectiveness of SoS.


title: Optimized Rate-Profiling for PAC Codes

abstract: The polarization-adjusted convolutional (PAC) codes concatenate the polar transform and the convolutional transform to improve the decoding performance of the finite-length polar codes, where the rate-profile is used to construct the PAC codes by setting the positions of frozen bits. However, the optimal rateprofile method of PAC codes is still unknown. In this paper, an optimized rate-profile algorithm of PAC codes is proposed. First, we propose the normalized compression factor (NCF) to quantify the transmission efficiency of useful information, showing that the distribution of useful information that needs to be transmitted after the convolutional transform should be adaptive to the capacity profile after finite-length polar transform. This phenomenon indicates that the PAC code improves the transmission efficiency of useful information, which leads to a better decoding performance than the polar codes with the same length. Then, we propose a novel rate-profile method of PAC codes, where a quadratic optimization model is established and the Euclidean norm of the NCF spectrum is adopted to construct the objective function. Finally, a heuristic bit-swapping strategy is designed to search for the frozen set with high objective function values, where the search space is limited by considering the only bits with medium Hamming weight of the row index. Simulation results show that the PAC codes with the proposed optimized rate-profile construction have better decoding performance than the PAC codes with the originally proposed Reed-Muller design construction.


title: Multi-Agent Cooperative Bidding Games for Multi-Objective Optimization in e-Commercial Sponsored Search

abstract: Bid optimization for online advertising from single advertiser's perspective has been thoroughly investigated in both academic research and industrial practice. However, existing work typically assume competitors do not change their bids, i.e., the wining price is fixed, leading to poor performance of the derived solution. Although a few studies use multi-agent reinforcement learning to set up a cooperative game, they still suffer the following drawbacks: (1) They fail to avoid collusion solutions where all the advertisers involved in an auction collude to bid an extremely low price on purpose. (2) Previous works cannot well handle the underlying complex bidding environment, leading to poor model convergence. This problem could be amplified when handling multiple objectives of advertisers which are practical demands but not considered by previous work. In this paper, we propose a novel multi-objective cooperative bid optimization formulation called Multi-Agent Cooperative bidding Games (MACG). MACG sets up a carefully designed multi-objective optimization framework where different objectives of advertisers are incorporated. A global objective to maximize the overall profit of all advertisements is added in order to encourage better cooperation and also to protect self-bidding advertisers. To avoid collusion, we also introduce an extra platform revenue constraint. We analyze the optimal functional form of the bidding formula theoretically and design a policy network accordingly to generate auction-level bids. Then we design an efficient multi-agent evolutionary strategy for model optimization. Offline experiments and online A/B tests conducted on the Taobao platform indicate both single advertiser's objective and global profit have been significantly improved compared to state-of-art methods.


title: Evolution of octupole deformation and collectivity in neutron-rich lanthanides

abstract: The onset of octupole deformation and its impact on related spectroscopic properties is studied in even-even neutron-rich lanthanide isotopes Xe, Ba, Ce, and Nd with neutron number $86\leqslant N\leqslant 94$. Microscopic input comes from the Hartree-Fock-Bogoliubov approximation with constrains on the axially symmetric quadrupole and octupole operators using the Gogny-D1M interaction. At the mean-field level, reflection asymmetric ground states are predicted for isotopes with neutron number around $N=88$. Spectroscopic properties are studied by diagonalizing the interacting boson model Hamiltonian, with the parameters obtained via the mapping of the mean-field potential energy surface onto the expectation value of the Hamiltonian in the $s$, $d$, and $f$ boson condensate state. The results obtained for low-energy positive- and negative-parity excitation spectra as well as the electric dipole, quadrupole, and octupole transition probabilities indicate the onset of pronounced octupolarity for $Z\approx 56$ and $N\approx 88$ nuclei.


title: Neutrino Mass Eigenvalues for Different Scheme within Four Flavor Neutrino framework

abstract: In this paper, we discuss neutrino mass eigenvalues for four flavor neutrino mixing. An extra mass states, in four flavor mixing and possible various combination of CP violating Majorana phases effects the neutrino mass eigenvalues. We have considered the effective Majorana mass m_{e}, related for \,\left(\beta\beta\right)_{0\nu\,} decay. In calculation, we consider two different neutrino mass orders, normal and inverted. We find the limits for neutrino mass eigenvalue m_{i} in the different neutrino mass spectrum and the sum of all four neutrino masses is \text{{\Sigma}}\text{\ensuremath{\equiv}}m_{1}+m_{2}+m_{3}+m_{4}>1.3\,eV\, which is relevant for cosmological observations and explain the different neutrino oscillations data.


title: End-to-End Speaker Diarization Conditioned on Speech Activity and Overlap Detection

abstract: In this paper, we present a conditional multitask learning method for end-to-end neural speaker diarization (EEND). The EEND system has shown promising performance compared with traditional clustering-based methods, especially in the case of overlapping speech. In this paper, to further improve the performance of the EEND system, we propose a novel multitask learning framework that solves speaker diarization and a desired subtask while explicitly considering the task dependency. We optimize speaker diarization conditioned on speech activity and overlap detection that are subtasks of speaker diarization, based on the probabilistic chain rule. Experimental results show that our proposed method can leverage a subtask to effectively model speaker diarization, and outperforms conventional EEND systems in terms of diarization error rate.


title: Estimating Reeb chords using microlocal sheaf theory

abstract: We show that for a closed Legendrian submanifold in a 1-jet bundle, if there is a sheaf with compact support, perfect stalk and singular support on that Legendrian, then (1) the number of Reeb chords has a lower bound by half of the sum of Betti numbers of the Legendrian; (2) the number of Reeb chords between the original Legendrian and its Hamiltonian pushoff has a lower bound in terms of Betti numbers when the oscillation norm of the Hamiltonian is small comparing with the length of Reeb chords. In the proof we develop a duality exact triangle and use the persistence structure (which comes from the action filtration) of microlocal sheaves.


title: RewardsOfSum: Exploring Reinforcement Learning Rewards for Summarisation

abstract: To date, most abstractive summarisation models have relied on variants of the negative log-likelihood (NLL) as their training objective. In some cases, reinforcement learning has been added to train the models with an objective that is closer to their evaluation measures (e.g. ROUGE). However, the reward function to be used within the reinforcement learning approach can play a key role for performance and is still partially unexplored. For this reason, in this paper, we propose two reward functions for the task of abstractive summarisation: the first function, referred to as RwB-Hinge, dynamically selects the samples for the gradient update. The second function, nicknamed RISK, leverages a small pool of strong candidates to inform the reward. In the experiments, we probe the proposed approach by fine-tuning an NLL pre trained model over nine summarisation datasets of diverse size and nature. The experimental results show a consistent improvement over the negative log-likelihood baselines.


title: Insight from NLP Analysis: COVID-19 Vaccines Sentiments on Social Media

abstract: Social media is an appropriate source for analyzing public attitudes towards the COVID-19 vaccine and various brands. Nevertheless, there are few relevant studies. In the research, we collected tweet posts by the UK and US residents from the Twitter API during the pandemic and designed experiments to answer three main questions concerning vaccination. To get the dominant sentiment of the civics, we performed sentiment analysis by VADER and proposed a new method that can count the individual's influence. This allows us to go a step further in sentiment analysis and explain some of the fluctuations in the data changing. The results indicated that celebrities could lead the opinion shift on social media in vaccination progress. Moreover, at the peak, nearly 40\% of the population in both countries have a negative attitude towards COVID-19 vaccines. Besides, we investigated how people's opinions toward different vaccine brands are. We found that the Pfizer vaccine enjoys the most popular among people. By applying the sentiment analysis tool, we discovered most people hold positive views toward the COVID-19 vaccine manufactured by most brands. In the end, we carried out topic modelling by using the LDA model. We found residents in the two countries are willing to share their views and feelings concerning the vaccine. Several death cases have occurred after vaccination. Due to these negative events, US residents are more worried about the side effects and safety of the vaccine.


title: Markov Chains Generated by Convolutions of Orthogonality Measures

abstract: About two dozens of exactly solvable Markov chains on one-dimensional finite and semi-infinite integer lattices are constructed in terms of convolutions of orthogonality measures of the Krawtchouk, Hahn, Meixner, Charlier, $q$-Hahn, $q$-Meixner and little $q$-Jacobi polynomials. By construction, the stationary probability distributions, the complete sets of eigenvalues and eigenvectors are provided by the polynomials and the orthogonality measures. An interesting property possessed by these stationary probability distributions, called `convolutional self-similarity,' is demonstrated.

categories: math.PR math-ph math.CA math.MP math.ST nlin.SI stat.TH


title: On the Average (Edge-)Connectivity of Minimally $k$-(Edge-)Connected Graphs

abstract: Let $G$ be a graph of order $n$ and let $u,v$ be vertices of $G$. Let $\kappa_G(u,v)$ denote the maximum number of internally disjoint $u$-$v$ paths in $G$. Then the average connectivity $\overline{\kappa}(G)$ of $G$, is defined as $ \overline{\kappa}(G)=\sum_{\{u,v\}\subseteq V(G)} \kappa_G(u,v)/\tbinom{n}{2}. $ If $k \ge 1$ is an integer, then $G$ is minimally $k$-connected if $\kappa(G)=k$ and $\kappa(G-e) < k$ for every edge $e$ of $G$. We say that $G$ is an optimal minimally $k$-connected graph if $G$ has maximum average connectivity among all minimally $k$-connected graphs of order $n$. Based on a recent structure result for minimally 2-connected graphs we conjecture that, for every integer $k \ge3$, if $G$ is an optimal minimally $k$-connected graph of order $n\geq 2k+1$, then $G$ is bipartite, with the set of vertices of degree $k$ and the set of vertices of degree exceeding $k$ as its partite sets. We show that if this conjecture is true, then $\overline{\kappa}(G)< 9k/8$ for every minimally $k$-connected graph $G$. For every $k \ge 3$, we describe an infinite family of minimally $k$-connected graphs whose average connectivity is asymptotically $9k/8$. Analogous results are established for the average edge-connectivity of minimally $k$-edge-connected graphs.


title: Testing General Relativity with black hole X-ray data: a progress report

abstract: Einstein's theory of General Relativity is one of the pillars of modern physics. For decades, the theory has been mainly tested in the weak field regime with experiments in the Solar System and observations of binary pulsars. Thanks to a new generation of observational facilities, the past 5 years have seen remarkable changes in this field and there are now numerous efforts for testing General Relativity in the strong field regime with black holes and neutron stars using different techniques. Here I will review the work of my group at Fudan University devoted to test General Relativity with black hole X-ray data.


title: Assessing the impact of social activity permissiveness on the COVID-19 infection curve of several countries

abstract: This document aims to estimate and describe the effects of the social distancing measures implemented in several countries with the expectancy of controlling the spread of COVID-19. The procedure relies on the classic Susceptible-Infected-Removed (SIR) model, which is modified to incorporate a permissiveness index, representing the isolation achieved by the social distancing and the future development of vaccination campaigns and allowing the math model to reproduce more than one infection wave. The adjusted SIR models are used to study the compromise between the economy's reactivation and the resulting infection spreading increase. The document presents a graphical-abacus that describes the convenience of progressively relax social distancing measures while a feasible vaccination campaign develops


title: Complexity classification of counting graph homomorphisms modulo a prime number

abstract: Counting graph homomorphisms and its generalizations such as the Counting Constraint Satisfaction Problem (CSP), its variations, and counting problems in general have been intensively studied since the pioneering work of Valiant. While the complexity of exact counting of graph homomorphisms (Dyer and Greenhill, 2000) and the counting CSP (Bulatov, 2013, and Dyer and Richerby, 2013) is well understood, counting modulo some natural number has attracted considerable interest as well. In their 2015 paper Faben and Jerrum suggested a conjecture stating that counting homomorphisms to a fixed graph H modulo a prime number is hard whenever it is hard to count exactly, unless H has automorphisms of certain kind. In this paper we confirm this conjecture. As a part of this investigation we develop techniques that widen the spectrum of reductions available for modular counting and apply to the general CSP rather than being limited to graph homomorphisms.


title: Criticality of Lower Dimensional AdS$_d$ Black Holes

abstract: In lower dimensions, charged AdS black holes in an extended phase space, where the cosmological constant is interpreted as the thermodynamic pressure, are typically absent of liquid/gas phase transitions. We investigate the criticality of lower dimensional charged, dilatonic, asymptotically AdS (CDAdS$_d$) black holes generated from consistent truncations of RNAdS$_{d+2}$ black objects. We demonstrate that CDAdS$_{d}$ black holes in $d<4$ can exhibit rich van der Waals behavior and confirm that the associated critical exponents match those expected from mean field theory.


title: A Lightweight and Gradient-Stable Neural Layer

abstract: To enhance resource efficiency and model deployability of neural networks, we propose a neural-layer architecture based on Householder weighting and absolute-value activating, called Householder-absolute neural layer or simply Han-layer. Compared to a fully connected layer with $d$-neurons and $d$ outputs, a Han-layer reduces the number of parameters and the corresponding computational complexity from $O(d^2)$ to $O(d)$. {The Han-layer structure guarantees that the Jacobian of the layer function is always orthogonal, thus ensuring gradient stability (i.e., free of gradient vanishing or exploding issues) for any Han-layer sub-networks.} Extensive numerical experiments show that one can strategically use Han-layers to replace fully connected (FC) layers, reducing the number of model parameters while maintaining or even improving the generalization performance. We will also showcase the capabilities of the Han-layer architecture on a few small stylized models, and discuss its current limitations.


title: Credit Assignment Through Broadcasting a Global Error Vector

abstract: Backpropagation (BP) uses detailed, unit-specific feedback to train deep neural networks (DNNs) with remarkable success. That biological neural circuits appear to perform credit assignment, but cannot implement BP, implies the existence of other powerful learning algorithms. Here, we explore the extent to which a globally broadcast learning signal, coupled with local weight updates, enables training of DNNs. We present both a learning rule, called global error-vector broadcasting (GEVB), and a class of DNNs, called vectorized nonnegative networks (VNNs), in which this learning rule operates. VNNs have vector-valued units and nonnegative weights past the first layer. The GEVB learning rule generalizes three-factor Hebbian learning, updating each weight by an amount proportional to the inner product of the presynaptic activation and a globally broadcast error vector when the postsynaptic unit is active. We prove that these weight updates are matched in sign to the gradient, enabling accurate credit assignment. Moreover, at initialization, these updates are exactly proportional to the gradient in the limit of infinite network width. GEVB matches the performance of BP in VNNs, and in some cases outperforms direct feedback alignment (DFA) applied in conventional networks. Unlike DFA, GEVB successfully trains convolutional layers. Altogether, our theoretical and empirical results point to a surprisingly powerful role for a global learning signal in training DNNs.


title: Variational AutoEncoder for Reference based Image Super-Resolution

abstract: In this paper, we propose a novel reference based image super-resolution approach via Variational AutoEncoder (RefVAE). Existing state-of-the-art methods mainly focus on single image super-resolution which cannot perform well on large upsampling factors, e.g., 8$\times$. We propose a reference based image super-resolution, for which any arbitrary image can act as a reference for super-resolution. Even using random map or low-resolution image itself, the proposed RefVAE can transfer the knowledge from the reference to the super-resolved images. Depending upon different references, the proposed method can generate different versions of super-resolved images from a hidden super-resolution space. Besides using different datasets for some standard evaluations with PSNR and SSIM, we also took part in the NTIRE2021 SR Space challenge and have provided results of the randomness evaluation of our approach. Compared to other state-of-the-art methods, our approach achieves higher diverse scores.


title: A Note on Sumsets and Restricted Sumsets

abstract: In this note we find the optimal lower bound for the size of the sumsets $HA$ and $H\,\hat{}A$ over finite sets $H, A$ of nonnegative integers, where $HA = \bigcup_{h\in H} hA$ and $H\,\hat{}A = \bigcup_{h\in H} h\,\hat{}A$. We also find the underlying algebraic structure of the sets $A$ and $H$ for which the size of the sumsets $HA$ and $H\,\hat{}A$ is minimum.