title: Operator valued positive definite kernels and differentiable universality

abstract: We present a characterization for a positive definite operator valued kernel to be universal or $C_{0}$-universal, and apply these characterizations to a family of operator valued kernels that are shown to be well behaved. Later, we obtain a characterization for an operator valued differentiable kernel to be $C^{q}$-universal and $C_{0}^{q}$-universal. In order to obtain such characterization and examples we generalize some well known results concerning the structure of differentiable kernels to the operator valued context. On the examples is given an emphasis on the radial kernels on Euclidean spaces.


title: Stochasticity in radiative polarization of ultrarelativistic electrons in an ultrastrong laser pulse

abstract: Stochasticity effects in the spin (de)polarization of an ultrarelativistic electron beam during photon emissions in a counterpropoagating ultrastrong focused laser pulse in the quantum radiation reaction regime are investigated. We employ a Monte Carlo method to describe the electron dynamics semiclassically, and photon emissions as well as the electron radiative polarization quantum mechanically. While in the latter the photon emission is inherently stochastic, we were able to identify its imprints in comparison with the new developed semiclassical stochasticity-free method of radiative polarization applicable in the quantum regime. With an initially spin-polarized electron beam, the stochastic spin effects are seen in the dependence of the depolarization degree on the electron scattering angle and the electron final energy (spin stochastic diffusion). With an initially unpolarized electron beam, the spin stochasticity is exhibited in enhancing the known effect of splitting of the electron beam along the propagation direction into two oppositely polarized parts by an elliptically polarized laser pulse. The considered stochasticity effects for the spin are observable with currently achievable laser and electron beam parameters.


title: Interface Studies of Molecular Beam Epitaxy (MBE) Grown ZnSe-GaAs Heterovalent Structures

abstract: Comprehensive investigations on ZnSe/GaAs and GaAs/ZnSe interfaces were carried out by photoluminescence (PL) and transmission electron microscopy (TEM), as a part of realizing high quality ZnSe-GaAs (100) hetero-valent structures (HS). The nature of ZnSe/GaAs interface under different surface terminations of GaAs was examined. The ZnSe/Ga-terminated GaAs was found to have a superior optical and microstructural quality, with a chemical interface consisting of a mixture of both the GaAs and ZnSe atomic constituents. For GaAs/ZnSe interface studies, a low-temperature migration enhanced epitaxy (LT-MEE) growth technique was used to grow GaAs layers under the conditions compatible to the growth of ZnSe. Both Ga and As-initialized LT-MEE GaAs/ZnSe interfaces were investigated. A defective transition layer was observed along the As-initialized GaAs/ZnSe interface, which may be attributed to the formation Zn$_3$As$_2$ compound. The correlation between the observed optical as well as structural properties of both the (GaAs/ZnSe and ZnSe/GaAs) interfaces and the growth conditions used in this study are discussed in detail. This study could provide a valuable insight on the interface nature of ZnSe-GaAs HS.


title: Set System Blowups

abstract: We prove that given a constant $k \ge 2$ and a large set system $\mathcal{F}$ of sets of size at most $w$, a typical $k$-tuple of sets $(S_1, \cdots, S_k)$ from $\mathcal{F}$ can be blown up in the following sense: for each $1 \le i \le k$, we can find a large subfamily $\mathcal{F}_i$ containing $S_i$ so that for $i \neq j$, if $T_i \in \mathcal{F}_i$ and $T_j \in \mathcal{F}_j$ , then $T_i \cap T_j=S_i \cap S_j$. This greatly improves the bounds in an old result of Furedi.


title: A Very Simple Estimate Of Rational Homological Dimension Of Moduli Spaces Of Riemann Surfaces With Boundary And Marked Points

abstract: The moduli spaces of compact and connected Riemann surfaces has been a central topic in modern mathematics in recent years. Thus their homological dimensions become important invariants. Motivated by the emergence mathematical counterparts of open-closed string theory, we give an estimate of rational homological dimension of Riemann suraces with possible boundary and marked points(can lie on both interior and boundary). We hope it will have applications in open-closed theory, for example, open-closed Gromov-Witten theory in the future.


title: Positive elliptic-elliptic rotopulsators on Clifford tori of nonconstant size project onto regular polygons

abstract: Let $q_{1}$,...,$q_{n}$ be the position vectors of the point masses of the curved $n$-body problem. Consider any positive elliptic-elliptic rotopulsator solution $q_{i}^{T}=(r\cos{(\theta+\alpha_{i})},r\sin{(\theta+\alpha_{i})},\rho\cos{(\phi+\beta_{i})},\rho\sin{(\phi+\beta_{i})})$, $i\in\{1,...,n\}$, where $\alpha_{1},...,\alpha_{n},\beta_{1},...,\beta_{n}\in [0,2\pi)$ are constants, $\phi$, $\theta$, $r$ and $\rho$ are twice-differentiable, continuous, nonconstant functions, $r^{2}+\rho^{2}=1$, $r\geq 0$ and $\rho\geq 0$. We prove that the if the configuration of the point masses is of nonconstant size, the configuration of the vectors $(r\cos{(\theta+\alpha_{i})},r\sin{(\theta+\alpha_{i})})^{T}$ is a regular polygon, as is the configuration of the vectors $(\rho\cos{(\phi+\beta_{i})},\rho\sin{(\phi+\beta_{i})})^{T}$, $i\in\{1,...,n\}$.


title: Generalized Canonical Correlation Analysis: A Subspace Intersection Approach

abstract: Generalized Canonical Correlation Analysis (GCCA) is an important tool that finds numerous applications in data mining, machine learning, and artificial intelligence. It aims at finding `common' random variables that are strongly correlated across multiple feature representations (views) of the same set of entities. CCA and to a lesser extent GCCA have been studied from the statistical and algorithmic points of view, but not as much from the standpoint of linear algebra. This paper offers a fresh algebraic perspective of GCCA based on a (bi-)linear generative model that naturally captures its essence. It is shown that from a linear algebra point of view, GCCA is tantamount to subspace intersection; and conditions under which the common subspace of the different views is identifiable are provided. A novel GCCA algorithm is proposed based on subspace intersection, which scales up to handle large GCCA tasks. Synthetic as well as real data experiments are provided to showcase the effectiveness of the proposed approach.


title: Weighted embeddings for function spaces associated with Hermite expansions

abstract: We study weighted Besov and Triebel--Lizorkin spaces associated with Hermite expansions and obtain (i) frame decompositions, and (ii) characterizations of continuous Sobolev-type embeddings. The weights we consider generalize the Muckhenhoupt weights.


title: Compact complex manifolds whose complement of an analytic subset is Kahler

abstract: In this paper, we consider a class of balanced manifolds and provide a proof of a problem proposed by Silva-that compact complex manifolds that are Kahler outside an analytic subset are balanced. Next, as a special case of this theorem, we prove that compact complex manifolds which are Kahler outside a Kahler submanifold are class C. Finally, we prove that a blow up along a submanifold of Hironaka's examples are Kahler, and we establish that Hironaka's examples are examples of this theorem.


title: Highly Scalable Bayesian Geostatistical Modeling via Meshed Gaussian Processes on Partitioned Domains

abstract: We introduce a class of scalable Bayesian hierarchical models for the analysis of massive geostatistical datasets. The underlying idea combines ideas on high-dimensional geostatistics by partitioning the spatial domain and modeling the regions in the partition using a sparsity-inducing directed acyclic graph (DAG). We extend the model over the DAG to a well-defined spatial process, which we call the Meshed Gaussian Process (MGP). A major contribution is the development of a MGPs on tessellated domains, accompanied by a Gibbs sampler for the efficient recovery of spatial random effects. In particular, the cubic MGP (Q-MGP) can harness high-performance computing resources by executing all large-scale operations in parallel within the Gibbs sampler, improving mixing and computing time compared to sequential updating schemes. Unlike some existing models for large spatial data, a Q-MGP facilitates massive caching of expensive matrix operations, making it particularly apt in dealing with spatiotemporal remote-sensing data. We compare Q-MGPs with large synthetic and real world data against state-of-the-art methods. We also illustrate using Normalized Difference Vegetation Index (NDVI) data from the Serengeti park region to recover latent multivariate spatiotemporal random effects at millions of locations. The source code is available at https://github.com/mkln/meshgp.


title: Prior-enlightened and Motion-robust Video Deblurring

abstract: Various blur distortions in video will cause negative impact on both human viewing and video-based applications, which makes motion-robust deblurring methods urgently needed. Most existing works have strong dataset dependency and limited generalization ability in handling challenging scenarios, like blur in low contrast or severe motion areas, and non-uniform blur. Therefore, we propose a PRiOr-enlightened and MOTION-robust video deblurring model (PROMOTION) suitable for challenging blurs. On the one hand, we use 3D group convolution to efficiently encode heterogeneous prior information, explicitly enhancing the scenes' perception while mitigating the output's artifacts. On the other hand, we design the priors representing blur distribution, to better handle non-uniform blur in spatio-temporal domain. Besides the classical camera shake caused global blurry, we also prove the generalization for the downstream task suffering from local blur. Extensive experiments demonstrate we can achieve the state-of-the-art performance on well-known REDS and GoPro datasets, and bring machine task gain.


title: Multi-Agent Deep Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks with Imperfect Channels

abstract: This paper investigates a futuristic spectrum sharing paradigm for heterogeneous wireless networks with imperfect channels. In the heterogeneous networks, multiple wireless networks adopt different medium access control (MAC) protocols to share a common wireless spectrum and each network is unaware of the MACs of others. This paper aims to design a distributed deep reinforcement learning (DRL) based MAC protocol for a particular network, and the objective of this network is to achieve a global $\alpha$-fairness objective. In the conventional DRL framework, feedback/reward given to the agent is always correctly received, so that the agent can optimize its strategy based on the received reward. In our wireless application where the channels are noisy, the feedback/reward (i.e., the ACK packet) may be lost due to channel noise and interference. Without correct feedback, the agent (i.e., the network user) may fail to find a good solution. Moreover, in the distributed protocol, each agent makes decisions on its own. It is a challenge to guarantee that the multiple agents will make coherent decisions and work together to achieve the same objective, particularly in the face of imperfect feedback channels. To tackle the challenge, we put forth (i) a feedback recovery mechanism to recover missing feedback information, and (ii) a two-stage action selection mechanism to aid coherent decision making to reduce transmission collisions among the agents. Extensive simulation results demonstrate the effectiveness of these two mechanisms. Last but not least, we believe that the feedback recovery mechanism and the two-stage action selection mechanism can also be used in general distributed multi-agent reinforcement learning problems in which feedback information on rewards can be corrupted.


title: Two-stage Discriminative Re-ranking for Large-scale Landmark Retrieval

abstract: We propose an efficient pipeline for large-scale landmark image retrieval that addresses the diversity of the dataset through two-stage discriminative re-ranking. Our approach is based on embedding the images in a feature-space using a convolutional neural network trained with a cosine softmax loss. Due to the variance of the images, which include extreme viewpoint changes such as having to retrieve images of the exterior of a landmark from images of the interior, this is very challenging for approaches based exclusively on visual similarity. Our proposed re-ranking approach improves the results in two steps: in the sort-step, $k$-nearest neighbor search with soft-voting to sort the retrieved results based on their label similarity to the query images, and in the insert-step, we add additional samples from the dataset that were not retrieved by image-similarity. This approach allows overcoming the low visual diversity in retrieved images. In-depth experimental results show that the proposed approach significantly outperforms existing approaches on the challenging Google Landmarks Datasets. Using our methods, we achieved 1st place in the Google Landmark Retrieval 2019 challenge and 3rd place in the Google Landmark Recognition 2019 challenge on Kaggle. Our code is publicly available here: \url{https://github.com/lyakaap/Landmark2019-1st-and-3rd-Place-Solution}


title: The twist-cofinite topology on the mapping class group of a surface

abstract: A topology is defined on the mapping class group of a compact connected orientable surface. It is shown that a notion of "genericity" on subsets of the mapping class group arises from this definition. Many plausible results follow from this notion easily; for example, the set of pseudo-Anosov maps is shown to be generic, and can be assumed to have arbitrary large stretch factor, generically. Let M be a 3-manifold obtained from a Heegaard splitting of fixed genus g and generic gluing map. It is shown that for such manifolds, generically M is hyperbolic, has first Betti number zero and Heegaard genus exactly equal to g.


title: A New Multiple Max-pooling Integration Module and Cross Multiscale Deconvolution Network Based on Image Semantic Segmentation

abstract: To better retain the deep features of an image and solve the sparsity problem of the end-to-end segmentation model, we propose a new deep convolutional network model for medical image pixel segmentation, called MC-Net. The core of this network model consists of four parts, namely, an encoder network, a multiple max-pooling integration module, a cross multiscale deconvolution decoder network and a pixel-level classification layer. In the network structure of the encoder, we use multiscale convolution instead of the traditional single-channel convolution. The multiple max-pooling integration module first integrates the output features of each submodule of the encoder network and reduces the number of parameters by convolution using a kernel size of 1. At the same time, each max-pooling layer (the pooling size of each layer is different) is spliced after each convolution to achieve the translation invariance of the feature maps of each submodule. We use the output feature maps from the multiple max-pooling integration module as the input of the decoder network; the multiscale convolution of each submodule in the decoder network is cross-fused with the feature maps generated by the corresponding multiscale convolution in the encoder network. Using the above feature map processing methods solves the sparsity problem after the max-pooling layer-generating matrix and enhances the robustness of the classification. We compare our proposed model with the well-known Fully Convolutional Networks for Semantic Segmentation (FCNs), DecovNet, PSPNet, U-net, SgeNet and other state-of-the-art segmentation networks such as HyperDenseNet, MS-Dual, Espnetv2, Denseaspp using one binary Kaggle 2018 data science bowl dataset and two multiclass dataset and obtain encouraging experimental results.


title: Comparison of edge turbulence characteristics between DIII-D and C-Mod simulations with XGC1

abstract: The physical processes taking place at the edge region are crucial for the operation of tokamaks as they govern the interaction of hot plasma with the vessel walls. Numerical modeling of the edge with state-of-the-art codes attempts to elucidate interactions between neoclassical drifts, turbulence, poloidal and parallel flows that control the physical set-up of the SOL region. Here, we present post-processing analysis of simulations from the gyrokinetic code XGC1, comparing edge turbulence characteristics from a simulation of DIII-D against one of C-Mod. We find that the equilibrium $E \times B$ flux across the separatrix has a similar poloidal pattern in both discharges which can be explained by magnetic drifts and trapped ion excursions. However, collisionality is noted to play a major role in that it prevents local charge accumulations from having global effects in C-Mod. In both cases, turbulent electron heat flux is higher than the ion one. This seems to be a universal characteristic of the tokamak edge. We identify turbulent frequencies and growth rates of the dominant mode in both simulations. In C-Mod, these numbers point to the presence of a drift wave. In DIII-D, linear simulations with Gene reveal a trapped electron mode. Furthermore, we present the amplitude and size distributions of the blobs from both simulations. Amplitude distributions are in qualitative agreement with experimental observations while size distributions are consistent with the fact that most blobs are not connecting to the divertor plates and suggest that they are generated by the shearing of the turbulent modes.


title: Some basic thoughts on the cofiality of Chang structures with an application to forcing

abstract: Consider $(\kappa^{+++},\kappa^{++}) \twoheadrightarrow (\kappa^+,\kappa)$ where $\kappa$ is an uncountable regular cardinal. By a result of Shelah's we have $\operatorname{cof}(X \cap \kappa^{++}) = \kappa$ for almost all $X \subset \kappa^{+++}$ witnessing this. Here we consider the question if there could be a similar result for $X \cap \kappa^+$. We use this discussion to give an interesting example of a pseudo Prikry forcing answering a question of Sinapova.


title: Event-Triggered Consensus of Homogeneous and Heterogeneous Multi-Agent Systems with Jointly Connected Switching Topologies

abstract: This paper investigates the distributed event-based consensus problem of switching networks satisfying the jointly connected condition. Both the state consensus of homogeneous linear networks and output consensus of heterogeneous networks are studied. Two kinds of event-based protocols based on local sampled information are designed, without the need to solve any matrix equation or inequality. Theoretical analysis indicates that the proposed event-based protocols guarantee the achievement of consensus and the exclusion of Zeno behaviors for jointly connected undirected switching graphs. These protocols, relying on no global knowledge of the network topology and independent of switching rules, can be devised and utilized in a completely distributed manner. They are able to avoid continuous information exchanges for either controllers' updating or triggering functions' monitoring, which ensures the feasibility of the presented protocols.


title: Stability, enhanced gauge symmetry and suppressed cosmological constant in 9D heterotic interpolating models

abstract: We investigate the structure of the moduli space of 9D heterotic interpolating models with a complete set of Wilson line backgrounds and a radius parameter by computing the one-loop partition functions and the cosmological constants and by deriving the massless spectra, paying attention to the region $a \approx 0$ where supersymmetry is asymptotically restoring. We find some special planes and points in the moduli space where the gauge symmetry is enhanced and/or massless fermions appear. The gauge symmetry is maximally enhanced at the minima of the one-loop effective potential where the cosmological constant is negative.


title: Sharp radial estimates in Besov spaces

abstract: We prove sharp radial estimates using Besov spaces. We also prove the propagation of singularities in Besov spaces.


title: The Construction of Dirac Operators on Orientifolds

abstract: Motivated by Wigner's theorem, a canonical construction is described that produces an Atiyah-Singer Dirac operator with both unitary and anti-unitary symmetries. This Dirac operator includes the Dirac operator for KR-theory as a special case, filling a long-standing gap in the literature. In order to make the construction, orientifold Spin-c-structures are defined and classified using semi-equivariant Dixmier-Douady theory, and analogues of several standard theorems on the existence of Spin-c-structures are proved.


title: Melonic dominance and the largest eigenvalue of a large random tensor

abstract: We consider a Gaussian rotationally invariant ensemble of random real totally symmetric tensors with independent normally distributed entries, and estimate the largest eigenvalue of a typical tensor in this ensemble by examining the rate of growth of a random initial vector under successive applications of a nonlinear map defined by the random tensor. In the limit of a large number of dimensions, we observe that a simple form of melonic dominance holds, and the quantity we study is effectively determined by a single Feynman diagram arising from the Gaussian average over the tensor components. This computation suggests that the largest tensor eigenvalue in our ensemble in the limit of a large number of dimensions is proportional to the square root of the number of dimensions, as it is for random real symmetric matrices.


title: Susceptible-Infected-Recovered (SIR) Dynamics of COVID-19 and Economic Impact

abstract: I estimate the Susceptible-Infected-Recovered (SIR) epidemic model for Coronavirus Disease 2019 (COVID-19). The transmission rate is heterogeneous across countries and far exceeds the recovery rate, which enables a fast spread. In the benchmark model, 28% of the population may be simultaneously infected at the peak, potentially overwhelming the healthcare system. The peak reduces to 6.2% under the optimal mitigation policy that controls the timing and intensity of social distancing. A stylized asset pricing model suggests that the stock price temporarily decreases by 50% in the benchmark case but shows a W-shaped, moderate but longer bear market under the optimal policy.


title: Establishing the carrier scattering phase diagram for ZrNiSn-based half-Heusler thermoelectric materials

abstract: Chemical doping is one of the most important strategies for tuning electrical properties of semiconductors, particularly thermoelectric materials. Generally, the main role of chemical doping lies in optimizing the carrier concentration, but there can potentially be other important effects. Here, we show that chemical doping plays multiple roles for both electron and phonon transport properties in half-Heusler thermoelectric materials. With ZrNiSn-based half-Heusler materials as an example, we use high-quality single and polycrystalline crystals, various probes, including electrical transport measurements, inelastic neutron scattering measurement, and first-principles calculations, to investigate the underlying electron-phonon interaction. We find that chemical doping brings strong screening effects to ionized impurities, grain boundary, and polar optical phonon scattering, but has negligible influence on lattice thermal conductivity. Furthermore, it is possible to establish a carrier scattering phase diagram, which can be used to select reasonable strategies for optimization of the thermoelectric performance.


title: Permanent charge effects on ionic flow: a numerical study of flux ratios and their bifurcation

abstract: Ionic flow carries electrical signals for cells to communicate with each other. The permanent charge of an ion channel is a crucial protein structure for flow properties while boundary conditions play a role of the driving force. Their effects on flow properties have been analyzed via a quasi-one-dimensional Poisson-Nernst-Planck model for small and relatively large permanent charges. The analytical studies have led to the introduction of flux ratios that reflect permanent charge effects and have a universal property. The studies also show that the flux ratios have different behaviors for small and large permanent charges. However, the existing analytical techniques can reveal neither behaviors of flux ratios nor transitions between small and large permanent charges. In this work we present a numerical investigation on flux ratios to bridge between small and large permanent charges. Numerical results verify the analytical predictions for the two extremal regions. More significantly, emergence of non-trivial behaviors is detected as the permanent charge varies from small to large. In particular, saddle-node bifurcations of flux ratios are revealed, showing rich phenomena of permanent charge effects by the power of combining analytical and numerical techniques. An adaptive moving mesh finite element method is used in the numerical studies.


title: Machine Learning meets Quantum Foundations: A Brief Survey

abstract: The goal of machine learning is to facilitate a computer to execute a specific task without explicit instruction by an external party. Quantum foundations seeks to explain the conceptual and mathematical edifice of quantum theory. Recently, ideas from machine learning have successfully been applied to different problems in quantum foundations. Here, we compile the representative works done so far at the interface of machine learning and quantum foundations. We conclude the survey with potential future directions.


title: Modules of the $0$-Hecke algebra arising from standard permuted composition tableaux

abstract: We study the $H_n(0)$-module $\mathbf{S}^\sigma_\alpha$ due to Tewari and van Willigenburg, which was constructed using new combinatorial objects called standard permuted composition tableaux and decomposed into cyclic submodules. First, we show that every direct summand appearing in their decomposition is indecomposable and characterize when $\mathbf{S}^\sigma_\alpha$ is indecomposable. Second, we find characteristic relations among $\mathbf{S}^\sigma_\alpha$'s and expand the image of $\mathbf{S}^\sigma_\alpha$ under the quasi characteristic in terms of quasisymmetric Schur functions. Finally, we show that the canonical submodule of $\mathbf{S}^\sigma_\alpha$ appears as a homomorphic image of a projective indecomposable module.


title: A differential operator representation of continuous homomorphisms between the spaces of entire functions of given proximate orders

abstract: In this paper, we consider the locally convex spaces of entire functions with growth given by proximate orders, and study the representation as a differential operator of a continuous homomorphism from such a space to another one. As a corollary, we give a characterization of continuous endomorphisms of such spaces.


title: Logarithmic Regret Bound in Partially Observable Linear Dynamical Systems

abstract: We study the problem of system identification and adaptive control in partially observable linear dynamical systems. Adaptive and closed-loop system identification is a challenging problem due to correlations introduced in data collection. In this paper, we present the first model estimation method with finite-time guarantees in both open and closed-loop system identification. Deploying this estimation method, we propose adaptive control online learning (AdaptOn), an efficient reinforcement learning algorithm that adaptively learns the system dynamics and continuously updates its controller through online learning steps. AdaptOn estimates the model dynamics by occasionally solving a linear regression problem through interactions with the environment. Using policy re-parameterization and the estimated model, AdaptOn constructs counterfactual loss functions to be used for updating the controller through online gradient descent. Over time, AdaptOn improves its model estimates and obtains more accurate gradient updates to improve the controller. We show that AdaptOn achieves a regret upper bound of $\text{polylog}\left(T\right)$, after $T$ time steps of agent-environment interaction. To the best of our knowledge, AdaptOn is the first algorithm that achieves $\text{polylog}\left(T\right)$ regret in adaptive control of unknown partially observable linear dynamical systems which includes linear quadratic Gaussian (LQG) control.


title: ASFD: Automatic and Scalable Face Detector

abstract: In this paper, we propose a novel Automatic and Scalable Face Detector (ASFD), which is based on a combination of neural architecture search techniques as well as a new loss design. First, we propose an automatic feature enhance module named Auto-FEM by improved differential architecture search, which allows efficient multi-scale feature fusion and context enhancement. Second, we use Distance-based Regression and Margin-based Classification (DRMC) multi-task loss to predict accurate bounding boxes and learn highly discriminative deep features. Third, we adopt compound scaling methods and uniformly scale the backbone, feature modules, and head networks to develop a family of ASFD, which are consistently more efficient than the state-of-the-art face detectors. Extensive experiments conducted on popular benchmarks, e.g. WIDER FACE and FDDB, demonstrate that our ASFD-D6 outperforms the prior strong competitors, and our lightweight ASFD-D0 runs at more than 120 FPS with Mobilenet for VGA-resolution images.


title: Time-dependent optimized coupled-cluster method for multielectron dynamics III: A second-order many-body perturbation approximation

abstract: We report successful implementation of the time-dependent second-order many-body perturbation theory using optimized orthonormal orbital functions called time-dependent optimized second-order many-body perturbation theory [TD-OMP2] to reach out to relatively larger chemical systems for the study of intense-laser-driven multielectron dynamics. We apply this method to strong-field ionization and high-order harmonic generation (HHG) of Ar. The calculation results are benchmarked against ab initio time-dependent complete-active-space self-consistent field (TD-CASSCF), time-dependent optimized coupled-cluster double (TD-OCCD), and time-dependent Hartree-Fock (TDHF) methods, as well as a single active electron (SAE) model to explore the role of electron correlation.


title: SIR Model for COVID-19 calibrated with existing data and projected for Colombia

abstract: In this paper we develop a SIR epidemiological model with parameters calculated according to existing data at the time of writing (24/03/2020); the data is from Italy, South Korea and Colombia, the model is then used to project the evolution of the COVID-19 epidemic in Colombia for different scenarios using the data of population for the country and known initial conditions at the start of the simulation.


title: Unsupervised Learning for security of Enterprise networks by micro-segmentation

abstract: Micro-segmentation is a network security technique that requires delivering services for each unique segment. To do so, the first stage is defining these unique segments (a.k.a security groups) and then initializing policy-driven security controls. In this paper, we propose an unsupervised learning technique that covers both the security grouping and policy creation. For the network asset grouping, we develop a distance-based machine learning algorithm using the dynamic behavior of the assets. That is, after observing the entire network logs, our unsupervised learning algorithm suggests partitioning network assets into the groups. A key point of this un-supervised technique is that the grouping is only generated during the training phase and remains valid during the testing phase. The outcome of the grouping stage is then fed into the rules (security policies) creation stage enabling to establish the security groups as the lowest granularity of firewall rules. We conducted both quantitative and qualitative experiments and demonstrate the good performance of our network micro-segmentation approach. We further developed a prototype to validate the run-time performance of our approach at scale in a real-world environment. The hyper-parameters of our approach provides users with a flexible model to be fine-tuned to adapt very easily with the enterprise's security governance.


title: QoS-Based Source and Relay Secure Optimization Design with Presence of Channel Uncertainty

abstract: In this letter, we study relay-aided networks with presence of single eavesdropper. We provide joint beamforming design of the source and relay that can minimize the overall power consumption while satisfying our predefined quality-of-service (QoS) requirements. Additionally, we investigate the case that the channel between relay and eavesdropper suffers from channel uncertainty. Finally, simulation results are provided to verify the effectiveness of our algorithm.


title: A CRC-aided Hybrid Decoding for Turbo Codes

abstract: Turbo codes and CRC codes are usually decoded separately according to the serially concatenated inner codes and outer codes respectively. In this letter, we propose a hybrid decoding algorithm of turbo-CRC codes, where the outer codes, CRC codes, are not used for error detection but as an assistance to improve the error correction performance. Two independent iterative decoding and reliability based decoding are carried out in a hybrid schedule, which can efficiently decode the two different codes as an entire codeword. By introducing an efficient error detecting method based on normalized Euclidean distance without CRC check, significant gain can be obtained by using the hybrid decoding method without loss of the error detection ability.


title: Joint Shortening and Puncturing Optimization for Structured LDPC Codes

abstract: The demand for flexible broadband wireless services makes the pruning technique, including both shortening and puncturing, an indispensable component of error correcting codes. The analysis of the pruning process for structured lowdensity parity-check (LDPC) codes can be considerably simplified with their equivalent representations through base-matrices or protographs. In this letter, we evaluate the thresholds of the pruned base-matrices by using protograph based on extrinsic information transfer (PEXIT). We also provide an efficient method to optimize the pruning patterns, which can significantly improve the thresholds of both the full-length patterns and the sub-patterns. Numerical results show that the structured LDPC codes pruned by the improved patterns outperform those with the existing patterns.


title: AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Prediction

abstract: Learning feature interactions is crucial for click-through rate (CTR) prediction in recommender systems. In most existing deep learning models, feature interactions are either manually designed or simply enumerated. However, enumerating all feature interactions brings large memory and computation cost. Even worse, useless interactions may introduce noise and complicate the training process. In this work, we propose a two-stage algorithm called Automatic Feature Interaction Selection (AutoFIS). AutoFIS can automatically identify important feature interactions for factorization models with computational cost just equivalent to training the target model to convergence. In the \emph{search stage}, instead of searching over a discrete set of candidate feature interactions, we relax the choices to be continuous by introducing the architecture parameters. By implementing a regularized optimizer over the architecture parameters, the model can automatically identify and remove the redundant feature interactions during the training process of the model. In the \emph{re-train stage}, we keep the architecture parameters serving as an attention unit to further boost the performance. Offline experiments on three large-scale datasets (two public benchmarks, one private) demonstrate that AutoFIS can significantly improve various FM based models. AutoFIS has been deployed onto the training platform of Huawei App Store recommendation service, where a 10-day online A/B test demonstrated that AutoFIS improved the DeepFM model by 20.3\% and 20.1\% in terms of CTR and CVR respectively.


title: GreedyNAS: Towards Fast One-Shot NAS with Greedy Supernet

abstract: Training a supernet matters for one-shot neural architecture search (NAS) methods since it serves as a basic performance estimator for different architectures (paths). Current methods mainly hold the assumption that a supernet should give a reasonable ranking over all paths. They thus treat all paths equally, and spare much effort to train paths. However, it is harsh for a single supernet to evaluate accurately on such a huge-scale search space (e.g., $7^{21}$). In this paper, instead of covering all paths, we ease the burden of supernet by encouraging it to focus more on evaluation of those potentially-good ones, which are identified using a surrogate portion of validation data. Concretely, during training, we propose a multi-path sampling strategy with rejection, and greedily filter the weak paths. The training efficiency is thus boosted since the training space has been greedily shrunk from all paths to those potentially-good ones. Moreover, we further adopt an exploration and exploitation policy by introducing an empirical candidate path pool. Our proposed method GreedyNAS is easy-to-follow, and experimental results on ImageNet dataset indicate that it can achieve better Top-1 accuracy under same search space and FLOPs or latency level, but with only $\sim$60\% of supernet training cost. By searching on a larger space, our GreedyNAS can also obtain new state-of-the-art architectures.


title: Global Lorentz gradient estimates for quasilinear equations with measure data for the strongly singular case: $1<p\leq \frac{3n-2}{2n-1}$

abstract: In this paper, we study the global regularity estimates in Lorentz spaces for gradients of solutions to quasilinear elliptic equations with measure data of the form \begin{eqnarray*} \left\{ \begin{array}{rcl} -{\rm div}(\mathcal{A}(x, \nabla u))&=& \mu \quad \text{in} ~\Omega, u&=&0 \quad \text{on}~ \partial \Omega, \end{array}\right. \end{eqnarray*} where $\mu$ is a finite signed Radon measure in $\Omega$, $\Omega \subset \mathbb{R}^n$ is a bounded domain such that its complement $\mathbb{R}^n\backslash\Omega$ is uniformly $p$-thick and $\mathcal{A}$ is a Carath\'eodory vector valued function satisfying growth and monotonicity conditions for the strongly singular case $1<p\leq \frac{3n-2}{2n-1}$. Our result extends the earlier results \cite{55Ph0,Tran19} to the strongly singular case $1<p\leq \frac{3n-2}{2n-1}$ and a recent result \cite{HP} by considering rough conditions on the domain $\Omega$ and the nonlinearity $\mathcal{A}$.


title: Stochastic Zeroth-order Riemannian Derivative Estimation and Optimization

abstract: We consider stochastic zeroth-order optimization over Riemannian submanifolds embedded in Euclidean space, where the task is to solve Riemannian optimization problem with only noisy objective function evaluations. Towards this, our main contribution is to propose estimators of the Riemannian gradient and Hessian from noisy objective function evaluations, based on a Riemannian version of the Gaussian smoothing technique. The proposed estimators overcome the difficulty of the non-linearity of the manifold constraint and the issues that arise in using Euclidean Gaussian smoothing techniques when the function is defined only over the manifold. We use the proposed estimators to solve Riemannian optimization problems in the following settings for the objective function: (i) stochastic and gradient-Lipschitz (in both nonconvex and geodesic convex settings), (ii) sum of gradient-Lipschitz and non-smooth functions, and (iii) Hessian-Lipschitz. For these settings, we analyze the oracle complexity of our algorithms to obtain appropriately defined notions of $\epsilon$-stationary point or $\epsilon$-approximate local minimizer. Notably, our complexities are independent of the dimension of the ambient Euclidean space and depend only on the intrinsic dimension of the manifold under consideration. We demonstrate the applicability of our algorithms by simulation results and real-world applications on black-box stiffness control for robotics and black-box attacks to neural networks.

categories: math.OC cs.DS cs.LG math.ST stat.ML stat.TH


title: Design of pseudo-mechanisms and multistable units for mechanical metamaterials

abstract: Mechanism - collections of rigid elements coupled by perfect hinges which exhibit a zero-energy motion -- motivate the design of a variety of mechanical metamaterials. We significantly enlarge this design space by considering pseudo-mechanisms, collections of elastically coupled elements that exhibit motions with very low energy costs. We show that their geometric design generally is distinct from those of true mechanisms, thus opening up a large and virtually unexplored design space. We further extend this space by designing building blocks with bistable and tristable energy landscapes, realize these by 3D printing, and show how these form unit cells for multistable metamaterials.


title: Two-photon driven magnon-pair resonance as a signature of spin-nematic order

abstract: We theoretically study the nonlinear magnetic resonance driven by intense laser or electromagnetic wave in a fully polarized frustrated magnet near a less-visible spin-nematic ordered phase. In general, both magnons and magnon pairs (two-magnon bound state) appear as the low-energy excitation in the saturated state of spin-nematic magnets. Their excitation energies are usually in terahertz (THz) or gigahertz range. Magnon pairs with angular momentum 2$\hbar$ can be excited by the simultaneous absorption of two photons, and such multi-photon processes occur if the applied THz laser is strong enough. We compute laser-driven magnetic dynamics of a frustrated four-spin system with both magnon ($\hbar$) and magnon-pair (2$\hbar$) like excitations which is analogous to a macroscopic frustrated magnet with a spin nematic phase. We estimate the required strength of magnetic field of laser for the realization of two photon absorption, taking into account dissipation effects with the Lindblad equation. We show that intense THz laser with ac magnetic field of 0.1-1.0 Tesla is enough to observe magnon-pair resonance.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.stat-mech quant-ph


title: What Deep CNNs Benefit from Global Covariance Pooling: An Optimization Perspective

abstract: Recent works have demonstrated that global covariance pooling (GCP) has the ability to improve performance of deep convolutional neural networks (CNNs) on visual classification task. Despite considerable advance, the reasons on effectiveness of GCP on deep CNNs have not been well studied. In this paper, we make an attempt to understand what deep CNNs benefit from GCP in a viewpoint of optimization. Specifically, we explore the effect of GCP on deep CNNs in terms of the Lipschitzness of optimization loss and the predictiveness of gradients, and show that GCP can make the optimization landscape more smooth and the gradients more predictive. Furthermore, we discuss the connection between GCP and second-order optimization for deep CNNs. More importantly, above findings can account for several merits of covariance pooling for training deep CNNs that have not been recognized previously or fully explored, including significant acceleration of network convergence (i.e., the networks trained with GCP can support rapid decay of learning rates, achieving favorable performance while significantly reducing number of training epochs), stronger robustness to distorted examples generated by image corruptions and perturbations, and good generalization ability to different vision tasks, e.g., object detection and instance segmentation. We conduct extensive experiments using various deep CNN models on diversified tasks, and the results provide strong support to our findings.


title: Safety-Aware Hardening of 3D Object Detection Neural Network Systems

abstract: We study how state-of-the-art neural networks for 3D object detection using a single-stage pipeline can be made safety aware. We start with the safety specification (reflecting the capability of other components) that partitions the 3D input space by criticality, where the critical area employs a separate criterion on robustness under perturbation, quality of bounding boxes, and the tolerance over false negatives demonstrated on the training set. In the architecture design, we consider symbolic error propagation to allow feature-level perturbation. Subsequently, we introduce a specialized loss function reflecting (1) the safety specification, (2) the use of single-stage detection architecture, and finally, (3) the characterization of robustness under perturbation. We also replace the commonly seen non-max-suppression post-processing algorithm by a safety-aware non-max-inclusion algorithm, in order to maintain the safety claim created by the neural network. The concept is detailed by extending the state-of-the-art PIXOR detector which creates object bounding boxes in bird's eye view with inputs from point clouds.


title: Volumization as a Natural Generalization of Weight Decay

abstract: We propose a novel regularization method, called \textit{volumization}, for neural networks. Inspired by physics, we define a physical volume for the weight parameters in neural networks, and we show that this method is an effective way of regularizing neural networks. Intuitively, this method interpolates between an $L_2$ and $L_\infty$ regularization. Therefore, weight decay and weight clipping become special cases of the proposed algorithm. We prove, on a toy example, that the essence of this method is a regularization technique to control bias-variance tradeoff. The method is shown to do well in the categories where the standard weight decay method is shown to work well, including improving the generalization of networks and preventing memorization. Moreover, we show that the volumization might lead to a simple method for training a neural network whose weight is binary or ternary.


title: Tensor Networks: Phase transition phenomena on hyperbolic and fractal geometries

abstract: One of the challenging problems in the condensed matter physics is to understand the quantum many-body systems, especially, their physical mechanisms behind. Since there are only a few complete analytical solutions of these systems, several numerical simulation methods have been proposed in recent years. Amongst all of them, the Tensor Network algorithms have become increasingly popular in recent years, especially for their adaptability to simulate strongly correlated systems. The current work focuses on the generalization of such Tensor-Network-based algorithms, which are sufficiently robust to describe critical phenomena and phase transitions of multistate spin Hamiltonians in the thermodynamic limit. We have chosen two algorithms: the Corner Transfer Matrix Renormalization Group and the Higher-Order Tensor Renormalization Group. This work, based on tensor-network analysis, opens doors for the understanding of phase transition and entanglement of the interacting systems on the non-Euclidean geometries. We focus on three main topics: A new thermodynamic model of social influence, free energy is analyzed to classify the phase transitions on an infinite set of the negatively curved geometries where a relation between the free energy and the Gaussian radius of the curvature is conjectured, a unique tensor-based algorithm is proposed to study the phase transition on fractal structures.


title: New Microscopic Magnetic Hamiltonian for Exotic Spin Textures in Metals

abstract: We derive a new microscopic spin Hamiltonian for Rashba-coupled double exchange metals. The Hamiltonian consists of anisotropic interactions of the Dzyaloshinskii-Moriya (DM) and Kitaev form, in addition to the standard isotropic term. We validate the spin Hamiltonian by comparing results with those on the exact spin-fermion model, and present its phase diagram using large scale Monte Carlo simulations. In addition to ferromagnetic, planar spiral and flux states, the model hosts skyrmion crystal and classical spin-liquid states characterized, respectively, by multiple peaks and a diffuse ring pattern in the spin structure factor. The filamentary domain wall structures in the spin-liquid state are in remarkable agreement with experimental data on thin films of MnSi-type B20 metals and transition metals and their alloys.


title: FastDTW is approximate and Generally Slower than the Algorithm it Approximates

abstract: Many time series data mining problems can be solved with repeated use of distance measure. Examples of such tasks include similarity search, clustering, classification, anomaly detection and segmentation. For over two decades it has been known that the Dynamic Time Warping (DTW) distance measure is the best measure to use for most tasks, in most domains. Because the classic DTW algorithm has quadratic time complexity, many ideas have been introduced to reduce its amortized time, or to quickly approximate it. One of the most cited approximate approaches is FastDTW. The FastDTW algorithm has well over a thousand citations and has been explicitly used in several hundred research efforts. In this work, we make a surprising claim. In any realistic data mining application, the approximate FastDTW is much slower than the exact DTW. This fact clearly has implications for the community that uses this algorithm: allowing it to address much larger datasets, get exact results, and do so in less time.


title: Second-order quark number susceptibility of deconfined QCD matter in the presence of a magnetic field

abstract: Considering the strong field approximation we compute the hard thermal loop pressure at finite temperature and chemical potential of hot and dense deconfined QCD matter in lowest Landau level in one-loop order. We consider the anisotropic pressure in the presence of the strong magnetic field i.e., longitudinal and transverse pressure along parallel and perpendicular to the magnetic field direction. As a first effort, we compute and discuss the anisotropic quark number susceptibility of deconfined QCD matter in lowest Landau level. The longitudinal quark number susceptibility is found to increase with the temperature whereas the transverse one decreases with the temperature. We also compute the quark number susceptibility in the weak field approximation. We find that the thermomagnetic correction to the quark number susceptibility is very marginal in the weak field approximation.


title: Continuous quantum error correction for evolution under time-dependent Hamiltonians

abstract: We develop a protocol for continuous operation of a quantum error correcting code for protection of coherent evolution due to an encoded Hamiltonian against environmental errors, using the three qubit bit flip code and bit flip errors as a canonical example. To detect errors in real time, we filter the output signals from continuous measurement of the error syndrome operators and use a double thresholding protocol for error diagnosis, while correction of errors is done as in the conventional operation. We optimize our continuous operation protocol for evolution under quantum memory and under quantum annealing, by maximizing the fidelity between the target and actual logical states at a specified final time. In the case of quantum memory we show that our continuous operation protocol yields a logical error rate that is slightly larger than the one obtained from using the optimal Wonham filter for error diagnosis. The advantage of our protocol is that it can be simpler to implement. For quantum annealing, we show that our continuous quantum error correction protocol can significantly reduce the final logical state infidelity when the continuous measurements are sufficiently strong relative to the strength of the time-dependent Hamiltonian, and that it can also significantly reduces the run time relative to that of a classical encoding. These results suggest that a continuous implementation is suitable for quantum error correction in the presence of encoded time-dependent Hamiltonians, opening the possibility of many applications in quantum simulation and quantum annealing.


title: VaB-AL: Incorporating Class Imbalance and Difficulty with Variational Bayes for Active Learning

abstract: Active Learning for discriminative models has largely been studied with the focus on individual samples, with less emphasis on how classes are distributed or which classes are hard to deal with. In this work, we show that this is harmful. We propose a method based on the Bayes' rule, that can naturally incorporate class imbalance into the Active Learning framework. We derive that three terms should be considered together when estimating the probability of a classifier making a mistake for a given sample; i) probability of mislabelling a class, ii) likelihood of the data given a predicted class, and iii) the prior probability on the abundance of a predicted class. Implementing these terms requires a generative model and an intractable likelihood estimation. Therefore, we train a Variational Auto Encoder (VAE) for this purpose. To further tie the VAE with the classifier and facilitate VAE training, we use the classifiers' deep feature representations as input to the VAE. By considering all three probabilities, among them especially the data imbalance, we can substantially improve the potential of existing methods under limited data budget. We show that our method can be applied to classification tasks on multiple different datasets -- including one that is a real-world dataset with heavy data imbalance -- significantly outperforming the state of the art.


title: Experimental demonstration of random walk by probability chaos using single photons

abstract: In our former work (Sci. Rep. 4: 6039, 2014), we theoretically and numerically demonstrated that chaotic oscillation can be induced in a nanoscale system consisting of quantum dots between which energy transfer occurs via optical near-field interactions. Furthermore, in addition to the nanoscale implementation of oscillators, it is intriguing that the chaotic behavior is associated with probability derived via a density matrix formalism. Indeed, in our previous work (Sci. Rep. 6: 38634, 2016) we examined such oscillating probabilities via diffusivity analysis by constructing random walkers driven by chaotically driven bias. In this study, we experimentally implemented the concept of probability chaos using a single-photon source that was chaotically modulated by an external electro-optical modulator that directly yielded random walkers via single-photon observations after a polarization beam splitter. An evident signature was observed in the resulting ensemble average of the time-averaged mean square displacement. Although the experiment involved a scaled-up, proof-of-concept model of a genuine nanoscale oscillator, the experimental observations clearly validate the concept of oscillating probability, paving the way toward future ideal nanoscale systems.


title: Efficient generation of extreme terahertz harmonics in 3D Dirac semimetals

abstract: Frequency multiplication of terahertz signals on a solid state platform is highly sought-after for the next generation of high-speed electronics and the creation of frequency combs. Solutions to efficiently generate extreme harmonics (up to the $31^{\rm{st}}$ harmonic and beyond) of a terahertz signal with modest input intensities, however, remain elusive. Using fully nonperturbative simulations and complementary analytical theory, we show that 3D Dirac semimetals (DSMs) have enormous potential as compact sources of extreme terahertz harmonics, achieving energy conversion efficiencies beyond $10^{-5}$ at the $31^{\rm{st}}$ harmonic with input intensities on the order of $10$ MW/cm$^2$, over $10^5$ times lower than in conventional THz high harmonic generation systems. Our theory also reveals a fundamental feature in the nonlinear optics of 3D DSMs: a distinctive regime where higher-order optical nonlinearity vanishes, arising as a direct result of the extra dimensionality in 3D DSMs compared to 2D DSMs. Our findings should pave the way to the development of efficient platforms for high-frequency terahertz light sources and optoelectronics based on 3D DSMs.


title: On the origin of the multi-GeV photons from the closest burst with intermediate luminosity: GRB 190829A

abstract: Very-high-energy (VHE) emission is usually interpreted in the synchrotron-self Compton (SSC) scenario, and expected from the low-redshift and high-luminosity gamma-ray bursts (GRBs), as GRB 180720B and GRB 190114C. Recently, VHE emission was detected by the H.E.S.S. telescopes from one of the closest burst GRB 190829A which was associated with the supernova (SN) 2019oyw. In this paper, we present a temporal and spectral analysis from optical bands to Fermi-LAT energy range over multiple observational periods beginning just after the BAT trigger time and extending for almost three months. We show that the X-ray and optical observations are consistent with synchrotron forward-shock emission evolving between the characteristic and cooling spectral breaks during the early and late afterglow in a uniform-density medium. Modeling the light curves together with its spectral energy distribution, it is shown that the outflow expands with an initial bulk Lorentz factor of $\Gamma\sim 30$, which is high for a low-luminosity GRBs and low for a high-luminosity GRBs. The values of the initial bulk Lorentz factor and the isotropic equivalent energy suggest that GRB 190829A is classified as an intermediate-luminosity burst and consequently, it becomes the first burst of this class in being detected in the VHE gamma-ray band by an imaging atmospheric Cherenkov telescope, and, in turn, the first event without being simultaneously observed by the Fermi-LAT instrument. Analyzing the intermediate-luminosity bursts with $z\lesssim 0.2$ such as GRB 130702A, we show that bursts with intermediate luminosity are potential candidates to be detected in very-high energies.


title: Data-consistent neural networks for solving nonlinear inverse problems

abstract: Data assisted reconstruction algorithms, incorporating trained neural networks, are a novel paradigm for solving inverse problems. One approach is to first apply a classical reconstruction method and then apply a neural network to improve its solution. Empirical evidence shows that such two-step methods provide high-quality reconstructions, but they lack a convergence analysis. In this paper we formalize the use of such two-step approaches with classical regularization theory. We propose data-consistent neural networks that we combine with classical regularization methods. This yields a data-driven regularization method for which we provide a full convergence analysis with respect to noise. Numerical simulations show that compared to standard two-step deep learning methods, our approach provides better stability with respect to structural changes in the test set, while performing similarly on test data similar to the training set. Our method provides a stable solution of inverse problems that exploits both the known nonlinear forward model as well as the desired solution manifold from data.


title: Separation of Convex Sets via Barrier Cones

abstract: A closed convex subset of a normed linear space is said to have the strong separation property if it can be strongly separated from every other disjoint closed and convex set by a closed hyperplane. In this paper we give some results on the separation of convex sets with noticing the role of barrier cones, develop some characterizations of subsets having the strong separation property, and apply them to consider a class of convex optimization problems.


title: Manifolds with many Rarita-Schwinger fields

abstract: The Rarita-Schwinger operator is the twisted Dirac operator restricted to 3/2-spinors. Rarita-Schwinger fields are solutions of this operator which are in addition divergence-free. This is an overdetermined problem and solutions are rare; it is even more unexpected for there to be large dimensional spaces of solutions. In this paper we prove the existence of a sequence of compact manifolds in any given dimension greater than or equal to 4 for which the dimension of the space of Rarita-Schwinger fields tends to infinity. These manifolds are either simply connected K\"ahler-Einstein spin with negative Einstein constant, or products of such spaces with flat tori. Moreover, we construct Calabi-Yau manifolds of even complex dimension with more linearly independent Rarita-Schwinger fields than flat tori of the same dimension.


title: ESSOP: Efficient and Scalable Stochastic Outer Product Architecture for Deep Learning

abstract: Deep neural networks (DNNs) have surpassed human-level accuracy in a variety of cognitive tasks but at the cost of significant memory/time requirements in DNN training. This limits their deployment in energy and memory limited applications that require real-time learning. Matrix-vector multiplications (MVM) and vector-vector outer product (VVOP) are the two most expensive operations associated with the training of DNNs. Strategies to improve the efficiency of MVM computation in hardware have been demonstrated with minimal impact on training accuracy. However, the VVOP computation remains a relatively less explored bottleneck even with the aforementioned strategies. Stochastic computing (SC) has been proposed to improve the efficiency of VVOP computation but on relatively shallow networks with bounded activation functions and floating-point (FP) scaling of activation gradients. In this paper, we propose ESSOP, an efficient and scalable stochastic outer product architecture based on the SC paradigm. We introduce efficient techniques to generalize SC for weight update computation in DNNs with the unbounded activation functions (e.g., ReLU), required by many state-of-the-art networks. Our architecture reduces the computational cost by re-using random numbers and replacing certain FP multiplication operations by bit shift scaling. We show that the ResNet-32 network with 33 convolution layers and a fully-connected layer can be trained with ESSOP on the CIFAR-10 dataset to achieve baseline comparable accuracy. Hardware design of ESSOP at 14nm technology node shows that, compared to a highly pipelined FP16 multiplier design, ESSOP is 82.2% and 93.7% better in energy and area efficiency respectively for outer product computation.


title: Convergence of Random Batch Method for interacting particles with disparate species and weights

abstract: We consider in this work the convergence of Random Batch Method proposed in our previous work [Jin et al., J. Comput. Phys., 400(1), 2020] for interacting particles to the case of disparate species and weights. We show that the strong error is of $O(\sqrt{\tau})$ while the weak error is of $O(\tau)$ where $\tau$ is the time step between two random divisions of batches. Both types of convergence are uniform in $N$, the number of particles. The proof of strong convergence follows closely the proof in [Jin et al., J. Comput. Phys., 400(1), 2020] for indistinguishable particles, but there are still some differences: since there is no exchangeability now, we have to use a certain weighted average of the errors; some refined auxiliary lemmas have to be proved compared with our previous work. To show that the weak convergence of empirical measure is uniform in $N$, certain sharp estimates for the derivatives of the backward equations have been used. The weak convergence analysis is also illustrating for the convergence of Random Batch Method for $N$-body Liouville equations.


title: From rest-frame luminosity functions to observer-frame colour distributions: tackling the next challenge in cosmological simulations

abstract: Galaxy spectral energy distributions (SEDs) remain among the most challenging yet informative quantities to reproduce in simulations due to the large and complex mixture of physical processes that shape the radiation output of a galaxy. With the increasing number of surveys utilising broadband colours as part of their target selection criteria, the production of realistic SEDs in simulations is necessary for assisting in survey design and interpretation of observations. The recent success in reproducing the observed luminosity functions (LF) from far-UV to far-IR, using the state-of-the-art semi-analytic model \shark\ and the SED generator \prospect, represents a critical step towards better galaxy colour predictions. We show that with \shark\ and \prospect\ we can closely reproduce the optical colour distributions observed in the panchromatic GAMA survey. The treatment of feedback, star formation, central-satellite interactions and radiation re-processing by dust are critical for this achievement. The first three processes create a bimodal distribution, while dust attenuation defines the location and shape of the blue and red populations. While a naive comparison between observation and simulations displays the known issue of over-quenching of satellite galaxies, the introduction of empirically-motivated observational errors and classification from the same group finder used in GAMA greatly reduces this tension. The introduction of random re-assignment of $\sim 15\%$ of centrals/satellites as satellites/centrals on the simulation classification closely resembles the outcome of the group finder, providing a computationally less intensive method to compare simulations with observations.


title: Genuine Dilatons in Gauge Theories

abstract: A genuine dilaton $\sigma$ allows scales to exist even in the limit of exact conformal invariance. In gauge theories, these may occur at an infrared fixed point (IRFP) $\alpha_{\text{IR}}$ through dimensional transmutation. These large scales at $\alpha_{\text{IR}}$ can be separated from small scales produced by $\theta^\mu_\mu$, the trace of the energy-momentum tensor. For quantum chromodynamics (QCD), the conformal limit can be combined with chiral $SU(3) \times SU(3)$ symmetry to produce chiral-scale perturbation theory $\chi$PT$_\sigma$, with $f_0(500)$ as the dilaton. The technicolor (TC) analogue of this is crawling TC: at low energies, the gauge coupling $\alpha$ goes directly to (but does not walk past) $\alpha_{\text{IR}}$, and the massless dilaton at $\alpha_{\text{IR}}$ corresponds to a light Higgs boson at $\alpha \lesssim \alpha_{\text{IR}}$. It is suggested that the $W^\pm$ and $Z^0$ bosons set the scale of the Higgs boson mass. Unlike crawling TC, in walking TC, $\theta^\mu_\mu$ produces $all$ scales, large and small, so it is hard to argue that its ``dilatonic'' candidate for the Higgs boson is not heavy.


title: Schr\"{o}dinger equations on elliptic curves: symmetries, solutions and eigenvalue problem

abstract: In this paper, we study Schr\"{o}dinger equations on elliptic curves called generalized Lam\'{e} equations. We suggest a method of finding integrable potentials for Schr\"{o}dinger type equations. We apply this method to the Lam\'{e} equations and provide a sequence of integrable potentials for which the eigenvalue problem is solved explicitly.


title: Unbounded derived categories of small and big modules: Is the natural functor fully faithful?

abstract: Consider the obvious functor from the unbounded derived category of all finitely generated modules over a left noetherian ring $R$ to the unbounded derived category of all modules. We answer the natural question whether this functor defines an equivalence onto the full subcategory of complexes with finitely generated cohomology modules in two special cases. If $R$ is a quasi-Frobenius ring of infinite global dimension, then this functor is not full. If $R$ has finite left global dimension, this functor is an equivalence. We also prove variants of the latter assertion for left coherent rings, for noetherian schemes and for locally noetherian Grothendieck categories.


title: Twin-field quantum digital signatures

abstract: Digital signature is a key technique in information security, especially for identity authentications. Compared with classical correspondence, quantum digital signatures (QDSs) provide a considerably higher level of security, i.e., information-theoretic security. At present, its performance is limited by key generation protocols (e.g., BB84 or measurement-device-independent protocols), which are fundamentally limited in terms of channel capacity. Fortunately, the recently proposed twin-field quantum key distribution can overcome this limit. This paper presents a twin-field QDS protocol and details a corresponding security analysis. In its distribution stage, a specific key generation protocol, the sending-or-not-sending twin-field protocol, has been adopted and full parameter optimization method has been implemented. Numerical simulation results show that the new protocol exhibits outstanding security and practicality compared with all other existing protocols. Therefore, the new protocol paves the way toward real-world applications of QDSs


title: Observable sets, potentials and Schr\"{o}dinger equations

abstract: We characterize observable sets for 1-dim Schr\"{o}dinger equations in $\mathbb{R}$: $i \partial_t u = (-\partial_x^2+x^{2m})u$ (with $m\in \mathbb{N}:=\{0,1,\dots\}$). More precisely, we obtain what follows: First, when $m=0$, $E\subset\mathbb{R}$ is an observable set at some time if and only if it is thick, namely, there is $\gamma>0$ and $L>0$ so that $$ \left|E \bigcap [x, x+ L]\right|\geq \gamma L\;\;\mbox{for each}\;\;x\in \mathbb{R}; $$ Second, when $m=1$ ($m\geq 2$ resp.), $E$ is an observable set at some time (at any time resp. ) if and only if it is weakly thick, namely $$ \varliminf_{x \rightarrow +\infty} \frac{|E\bigcap [-x, x]|}{x} >0. $$ From these, we see how potentials $x^{2m}$ affect the observability (including the geometric structures of observable sets and the minimal observable time). Besides, we obtain several supplemental theorems for the above results, in particular, we find that a half line is an observable set at time $T>0$ for the above equation with $m=1$ if and only if $T>\frac{\pi}{2}$.


title: Joint lattice QCD - dispersion theory analysis confirms the quark-mixing top-row unitarity deficit

abstract: Recently, the first ever lattice computation of the $\gamma W$-box radiative correction to the rate of the semileptonic pion decay allowed for a reduction of the theory uncertainty of that rate by a factor of $\sim3$. A recent dispersion evaluation of the $\gamma W$-box correction on the neutron also led to a significant reduction of the theory uncertainty, but shifted the value of $V_{ud}$ extracted from the neutron and superallowed nuclear $\beta$ decay, resulting in a deficit of the CKM unitarity in the top row. A direct lattice computation of the $\gamma W$-box correction for the neutron decay would provide an independent cross-check for this result but is very challenging. Before those challenges are overcome, we propose a hybrid analysis, converting the lattice calculation on the pion to that on the neutron by a combination of dispersion theory and phenomenological input. The new prediction for the universal radiative correction to free and bound neutron $\beta$-decay reads $\Delta_R^V=0.02477(24)$, in excellent agreement with the dispersion theory result $\Delta_R^V=0.02467(22)$. Combining with other relevant information, the top-row CKM unitarity deficit persists.


title: Multiscale Sparsifying Transform Learning for Image Denoising

abstract: The data-driven sparse methods such as synthesis dictionary learning (e.g., K-SVD) and sparsifying transform learning have been proven effective in image denoising. However, they are intrinsically single-scale which can lead to suboptimal results. We propose two methods developed based on wavelet subbands mixing to efficiently combine the merits of both single and multiscale methods. We show that an efficient multiscale method can be devised without the need for denoising detail subbands which substantially reduces the runtime. The proposed methods are initially derived within the framework of sparsifying transform learning denoising, and then, they are generalized to propose our multiscale extensions for the well-known K-SVD and SAIST image denoising methods. We analyze and assess the studied methods thoroughly and compare them with the well-known and state-of-the-art methods. The experiments show that our methods are able to offer good trade-offs between performance and complexity.


title: Auto-Ensemble: An Adaptive Learning Rate Scheduling based Deep Learning Model Ensembling

abstract: Ensembling deep learning models is a shortcut to promote its implementation in new scenarios, which can avoid tuning neural networks, losses and training algorithms from scratch. However, it is difficult to collect sufficient accurate and diverse models through once training. This paper proposes Auto-Ensemble (AE) to collect checkpoints of deep learning model and ensemble them automatically by adaptive learning rate scheduling algorithm. The advantage of this method is to make the model converge to various local optima by scheduling the learning rate in once training. When the number of lo-cal optimal solutions tends to be saturated, all the collected checkpoints are used for ensemble. Our method is universal, it can be applied to various scenarios. Experiment results on multiple datasets and neural networks demonstrate it is effective and competitive, especially on few-shot learning. Besides, we proposed a method to measure the distance among models. Then we can ensure the accuracy and diversity of collected models.


title: NVMe and PCIe SSD Monitoring in Hyperscale Data Centers

abstract: With low latency, high throughput and enterprise-grade reliability, SSDs have become the de-facto choice for storage in the data center. As a result, SSDs are used in all online data stores in LinkedIn. These apps persist and serve critical user data and have millisecond latencies. For the hosts serving these applications, SSD faults are the single largest cause of failure. Frequent SSD failures result in significant downtime for critical applications. They also generate a significant downstream RCA (Root Cause Analysis) load for systems operations teams. A lack of insight into the runtime characteristics of these drives results in limited ability to provide accurate RCAs for such issues and hinders the ability to provide credible, long term fixes to such issues. In this paper we describe the system developed at LinkedIn to facilitate the real-time monitoring of SSDs and the insights we gained into failure characteristics. We describe how we used that insight to perform predictive maintenance and present the resulting reduction of man-hours spent on maintenance.


title: Predictive Business Process Monitoring via Generative Adversarial Nets: The Case of Next Event Prediction

abstract: Predictive process monitoring aims to predict future characteristics of an ongoing process case, such as case outcome or remaining timestamp. Recently, several predictive process monitoring methods based on deep learning such as Long Short-Term Memory or Convolutional Neural Network have been proposed to address the problem of next event prediction. However, due to insufficient training data or sub-optimal network configuration and architecture, these approaches do not generalize well the problem at hand. This paper proposes a novel adversarial training framework to address this shortcoming, based on an adaptation of Generative Adversarial Networks (GANs) to the realm of sequential temporal data. The training works by putting one neural network against the other in a two-player game (hence the adversarial nature) which leads to predictions that are indistinguishable from the ground truth. We formally show that the worst-case accuracy of the proposed approach is at least equal to the accuracy achieved in non-adversarial settings. From the experimental evaluation it emerges that the approach systematically outperforms all baselines both in terms of accuracy and earliness of the prediction, despite using a simple network architecture and a naive feature encoding. Moreover, the approach is more robust, as its accuracy is not affected by fluctuations over the case length.


title: Simulating finite-time quantum isothermal processes with generic superconducting quantum circuit

abstract: The finite-time isothermal process is fundamental in quantum thermodynamics yet complicated with combination of changing control parameters and the interaction with the thermal bath. Such complexity prevents the direct application of the traditional thermodynamics measurement of the relevant quantities. In this paper, we provide a discrete-step method to separate the work done and the heat exchange in the isothermal process by decomposing the process into piecewise adiabatic and isochoric processes. The piecewise control scheme makes it possible to simulate the whole process on a generic quantum computer, which provides a new platform to experimentally study quantum thermodynamics. We implement the simulation on ibmqx2 to show the $\mathrm{\mathcal{C}/\tau}$ scaling of the extra work in the finite-time isothermal process.


title: Leray numbers of complexes of graphs with bounded matching number

abstract: Given a graph $G$ on the vertex set $V$, the non-matching complex of $G$, $\mathsf{NM}_k(G)$, is the family of subgraphs $G' \subset G$ whose matching number $\nu(G')$ is strictly less than $k$. As an attempt to generalize the result by Linusson, Shareshian and Welker on the homotopy types of $\mathsf{NM}_k(K_n)$ and $\mathsf{NM}_k(K_{r,s})$ to arbitrary graphs $G$, we show that (i) $\mathsf{NM}_k(G)$ is $(3k-3)$-Leray, and (ii) if $G$ is bipartite, then $\mathsf{NM}_k(G)$ is $(2k-2)$-Leray. This result is obtained by analyzing the homology of the links of non-empty faces of the complex $\mathsf{NM}_k(G)$, which vanishes in all dimensions $d\geq 3k-4$, and all dimensions $d \geq 2k-3$ when $G$ is bipartite. As a corollary, we have the following rainbow matching theorem which generalizes the result by Aharoni, Berger, Chudnovsky, Howard and Seymour: Let $E_1, \dots, E_{3k-2}$ be non-empty edge subsets of a graph and suppose that $\nu(E_i\cup E_j)\geq k$ for every $i\ne j$. Then $E=\bigcup E_i$ has a rainbow matching of size $k$. Furthermore, the number of edge sets $E_i$ can be reduced to $2k-1$ when $E$ is the edge set of a bipartite graph.


title: Multiple-gap response of type-I noncentrosymmetric BeAu superconductor

abstract: Precise measurements of the thermodynamic critical field ($B_{\rm c}$) in type-I noncentrosymmetric superconductor BeAu were performed by means of the muon-spin rotation/relaxation technique. The temperature evolution of $B_{\rm c}$ can not be described within the single gap scenario and it requires the presence of at least two different types of the superconducting order parameters. The self-consistent two-gap approach, adapted for analysis of $B_{\rm c}(T)$ behavior, suggests the presence of two superconducing energy gaps with the gap to $T_{\rm c}$ ratios $2\Delta/k_{\rm B}T_{\rm c}\simeq4.52$ and $\simeq2.37$ for the big and the small gap, respectively. This implies that the superconductivity in BeAu is unconventional and that the supercarrier pairing occurs at various energy bands.


title: On the determination of plane and axial symmetries in linear Elasticity and Piezo-electricity

abstract: We formulate necessary and sufficient conditions for a unit vector n to generate a plane or axial symmetry of a constitutive tensor. For the elasticity tensor, these conditions consist of two polynomial equations of degree lower than four in the components of n. Compared to Cowin-Mehrabadi conditions, this is an improvement, since these equations involve only the normal vector n to the plane symmetry (and no vector perpendicular to n). Similar reduced algebraic conditions are obtained for linear piezo-electricity and for totally symmetric tensors up to order 6.


title: Polynomial Kernels for Paw-free Edge Modification Problems

abstract: Let $H$ be a fixed graph. Given a graph $G$ and an integer $k$, the $H$-free edge modification problem asks whether it is possible to modify at most $k$ edges in $G$ to make it $H$-free. Sandeep and Sivadasan (IPEC 2015) asks whether the paw-free completion problem and the paw-free edge deletion problem admit polynomial kernels. We answer both questions affirmatively by presenting, respectively, $O(k)$-vertex and $O(k^4)$-vertex kernels for them. This is part of an ongoing program that aims at understanding compressibility of $H$-free edge modification problems.


title: Highly asymmetric optical properties of \b{eta}-Ga2O3 as probed by linear and nonlinear optical excitation spectroscopy

abstract: Highly asymmetric optical properties of b-Ga2O3 are investigated by polarization-dependent photoluminescence (PL) excitation spectroscopy for assessing its potential use for a novel ultraviolet emitter and nonlinear optical material. Based on power-dependent excitation and two-photon depth scan, it is demonstrated that the underlying mechanism for the PL occurring far below the bandgap is not caused by intrinsic polaron effects, but by excitonic recombination at extrinsic defect sites.


title: Optimization of multiplexed single-photon sources operated with photon-number-resolving detectors

abstract: Detectors inherently capable of resolving photon numbers have undergone a significant development recently, and this is expected to affect multiplexed periodic single-photon sources where such detectors can find their applications. We analyze various spatially and time-multiplexed periodic single-photon source arrangements with photon-number-resolving detectors, partly to identify the cases when they outperform those with threshold detectors. We develop a full statistical description of these arrangements in order to optimize such systems with respect to maximal single-photon probability, taking into account all relevant loss mechanisms. The model is suitable for the description of all spatial and time multiplexing schemes. Our detailed analysis of symmetric spatial multiplexing identifies a particular range of loss parameters in which the use of the new type of detectors leads to an improvement. Photon number resolution opens an additional possibility for optimizing the system in that the heralding strategy can be defined in terms of actual detected photon numbers. Our results show that this kind of optimization opens an additional parameter range of improved efficiency. Moreover, this higher efficiency can be achieved by using less multiplexed units, i.e., smaller system size as compared to threshold-detector schemes. We also extend our investigation to certain time-multiplexed schemes of actual experimental relevance. We find that the highest single-photon probability is 0.907 that can be achieved by binary bulk time multiplexers using photon-number-resolving detectors.


title: Geometric effect on near-field heat transfer analysis using efficient graphene and nanotube models

abstract: Following the recent research enthusiasm on the effect of geometry on near-field heat transfer (NFHT) enhancement, we present an analysis based on simplified yet highly efficient graphene and nanotube models. Two geometries are considered: that of two parallel infinite "graphene" surfaces and that of a one-dimensional infinite "nanotube" line in parallel with an infinite surface. Due to its symmetry, the former is in principal simpler to analyze and even so, earlier works suggested that the application of a full model in this problem still demands heavy computations. Among other findings, our simplified computation - having successfully replicated the results of relevant earlier works - suggests a sharper NFHT enhancement dependence on distance for the line-surface system, namely $J\sim d^{-5.1}$ as compared to $J\sim d^{-2.2}$ for the parallel surface. Such comparisons together with applications of our efficient approach would be the important first steps in the attempt to find a general rule describing geometric dependence of NFHT.


title: Statistical investigation of relationship between spread of coronavirus disease (COVID-19) and environmental factors based on study of four mostly affected places of China and five mostly affected places of Italy

abstract: COVID-19 is a new type of coronavirus disease which is caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). It originated in China in the month of December 2019 and quickly started to spread within the country. On 31st December 2019, it was first reported to country office of World Health Organization (WHO) in China. Since then, it has spread to most of the countries around the globe. However, there has been a recent rise in trend in believing that it would go away during summer days, which has not yet been properly investigated. In this paper, relationship of daily number of confirmed cases of COVID-19 with three environmental factors, viz. maximum relative humidity (RH_max), maximum temperature (T_max) and highest wind speed (WS_max), considering the incubation period, have been investigated statistically, for four of the most affected places of China, viz. Beijing, Chongqing, Shanghai, Wuhan and five of the most affected places of Italy, viz. Bergamo, Cremona, Lodi, Milano. It has been found that the relationship with maximum relative humidity and highest wind is mostly negligible, whereas relationship with maximum temperature is ranging between negligible to moderate.


title: Magnetar as Central Engine of Gamma-Ray Bursts: Quasi-Universal Jet, Event Rate and X-ray Luminosity Function of Dipole Radiations

abstract: Early shallow-decaying X-ray afterglows of gamma-ray bursts (GRBs) may be attributed to the dipole radiations of newly-born magnetars. Assuming that the GRB jets powered by magnetars are quasi-universal, we find that the jet structure can be parameterized as a uniform jet with a luminosity of $\log L_{\rm j}/{\rm erg\ s^{-1}}=52.68^{+0.76}_{-0.33}$ (1$\sigma$) and an opening angle $\theta_{\rm j}=2.10_{-1.28}^{+1.90}$ (50\% confidence level), surrounding by a power-law decay component with an index of ${-4.00^{+0.27}_{-0.37}}$ (1$\sigma$). The inferred local GRB rate is $\rho=9.6$ Gpc$^{-3}$ yr$^{-1}$ by including both the typical GRBs and LL-GRBs as the same population. The typical viewing angle is $3.3^{o}$, and may be $20^{o}\sim30^{o}$ for LL-GRBs. The X-ray luminosity function of the dipole radiation wind can be empirically described by a broken power-law function with indices $\beta_1=0.78^{+0.16}_{-0.15}$ and $\beta_2>1.6$ broken at $\log L_{b, w}/{\rm erg\ s^{-1}}=48.51^{+0.53}_{-0.65}$. In case of that the wind outflow is collimated and co-axial with the GRB jet, we find that the wind structure is similar to the GRB jet, i.e., $\log L_{\rm c, w}/{\rm erg\ s^{-1}}=48.38^{+0.30}_{-0.48}$, $\theta_{\rm c, w}={2.65^{o}}_{-1.19^{o}}^{+0.1.73^{o}}$, and $k_{\rm w}=4.57^{+1.21}_{-0.75}$. The observed correlation between the prompt gamma-ray luminosity and X-ray luminosity of the wind may be resulted from the viewing angle effect in such a jet-wind system. Discussion on survey with the X-ray instruments on board the {\em Einstein\ Probe} mission in the soft X-ray band for the jet and wind emission is also presented.


title: Symplectic Dirac operators for Lie algebras and graded Hecke algebras

abstract: We define a pair of symplectic Dirac operators $(D^+,D^-)$ in an algebraic setting motivated by the analogy with the algebraic orthogonal Dirac operators in representation theory. We work in the settings of $\mathbb Z/2$-graded quadratic Lie algebras $\mathfrak g=\mathfrak k+\mathfrak p$ and of graded affine Hecke algebras $\mathbb H$.


title: The gamma-ray and Optical Variability Analysis of the BL Lac Object 3FGL J0449.4-4350

abstract: We have assembled the historical light curves of the BL Lac Object 3FGL J0449.4-4350 at optical and gamma-ray bands, the time spanning about 10 years, analyzed the periodic variability of the light curves by using four different methods (Lomb-Scargle periodogram, REDFIT38, Jurkevich and DACF). We detected a marginally possible quasi-periodic oscillation (QPO) of ~450 days. Assuming it originates from the helical motion jet in a supermassive binary black hole (SMBBH) system undergoing major merger, we estimate the primary black hole mass M~7.7*10^{9} M_sun. To explore the origin of the gamma-ray, we investigated the optical-gamma-ray correlations using discrete correlation function (DCF) method, and found that the correlation between the two bands is very significant. This strong correlation tends to imply lepton self-synchro-Compton (LSSC) model to produce the gamma-ray.


title: Robust Stochastic Bayesian Games for Behavior Space Coverage

abstract: A key challenge in multi-agent systems is the design of intelligent agents solving real-world tasks in close interaction with other agents (e.g. humans), thereby being confronted with a variety of behavioral variations and limited knowledge about the true behaviors of observed agents. The practicability of existing works addressing this challenge is being limited due to using finite sets of hypothesis for behavior prediction, the lack of a hypothesis design process ensuring coverage over all behavioral variations and sample-inefficiency when modeling continuous behavioral variations. In this work, we present an approach to this challenge based on a new framework of Robust Stochastic Bayesian Games (RSBGs). An RSBG defines hypothesis sets by partitioning the physically feasible, continuous behavior space of the other agents. It combines the optimality criteria of the Robust Markov Decision Process (RMDP) and the Stochastic Bayesian Game (SBG) to exponentially reduce the sample complexity for planning with hypothesis sets defined over continuous behavior spaces. Our approach outperforms the baseline algorithms in two experiments modeling time-varying intents and large multidimensional behavior spaces, while achieving the same performance as a planner with knowledge of the true behaviors of other agents.


title: Content Adaptive and Error Propagation Aware Deep Video Compression

abstract: Recently, learning based video compression methods attract increasing attention. However, the previous works suffer from error propagation due to the accumulation of reconstructed error in inter predictive coding. Meanwhile, the previous learning based video codecs are also not adaptive to different video contents. To address these two problems, we propose a content adaptive and error propagation aware video compression system. Specifically, our method employs a joint training strategy by considering the compression performance of multiple consecutive frames instead of a single frame. Based on the learned long-term temporal information, our approach effectively alleviates error propagation in reconstructed frames. More importantly, instead of using the hand-crafted coding modes in the traditional compression systems, we design an online encoder updating scheme in our system. The proposed approach updates the parameters for encoder according to the rate-distortion criterion but keeps the decoder unchanged in the inference stage. Therefore, the encoder is adaptive to different video contents and achieves better compression performance by reducing the domain gap between the training and testing datasets. Our method is simple yet effective and outperforms the state-of-the-art learning based video codecs on benchmark datasets without increasing the model size or decreasing the decoding speed.


title: Boosting Ridge Regression for High Dimensional Data Classification

abstract: Ridge regression is a well established regression estimator which can conveniently be adapted for classification problems. One compelling reason is probably the fact that ridge regression emits a closed-form solution thereby facilitating the training phase. However in the case of high-dimensional problems, the closed-form solution which involves inverting the regularised covariance matrix is rather expensive to compute. The high computational demand of such operation also renders difficulty in constructing ensemble of ridge regressions. In this paper, we consider learning an ensemble of ridge regressors where each regressor is trained in its own randomly projected subspace. Subspace regressors are later combined via adaptive boosting methodology. Experiments based on five high-dimensional classification problems demonstrated the effectiveness of the proposed method in terms of learning time and in some cases improved predictive performance can be observed.


title: Evidence of time evolution in quantum gravity

abstract: We argue that the problem of time is not a crucial issue inherent in the quantum picture of the universe evolution. On the minisuperspace model example with the massless scalar field, we demonstrate four approaches to the description of quantum evolution, which give similar results explicitly. The relevance of these approaches to building a quantum theory of gravity is discussed.


title: MIM-Based GAN: Information Metric to Amplify Small Probability Events Importance in Generative Adversarial Networks

abstract: In terms of Generative Adversarial Networks (GANs), the information metric to discriminate the generative data from the real data, lies in the key point of generation efficiency, which plays an important role in GAN-based applications, especially in anomaly detection. As for the original GAN, there exist drawbacks for its hidden information measure based on KL divergence on rare events generation and training performance for adversarial networks. Therefore, it is significant to investigate the metrics used in GANs to improve the generation ability as well as bring gains in the training process. In this paper, we adopt the exponential form, referred from the information measure, i.e. MIM, to replace the logarithm form of the original GAN. This approach is called MIM-based GAN, has better performance on networks training and rare events generation. Specifically, we first discuss the characteristics of training process in this approach. Moreover, we also analyze its advantages on generating rare events in theory. In addition, we do simulations on the datasets of MNIST and ODDS to see that the MIM-based GAN achieves state-of-the-art performance on anomaly detection compared with some classical GANs.


title: Parallel Computation of Optimal Ate Cryptographic Pairings at the $128$, $192$ and $256$-bit security levels using elliptic net algorithm

abstract: Efficient computations of pairings with Miller Algorithm have recently received a great attention due to the many applications in cryptography. In this work, we give formulae for the optimal Ate pairing in terms of elliptic nets associated to twisted Barreto-Naehrig (BN) curve, Barreto-Lynn-Scott(BLS) curves and Kachisa-Schaefer-Scott(KSS) curves considered at the $128$, $192$ and $256$-bit security levels, and Scott-Guillevic curve with embedding degree $54$. We show how to parallelize the computation of these pairings when the elliptic net algorithm instead is used and we obtain except in the case of Kachisa-Schaefer-Scott(KSS) curves considered at the $256$-bit security level, more efficient theoretical results with $8$ processors compared to the case where the Miller algorithm is used. This work still confirms that $BLS48$ curves are the best for pairing-based cryptography at $256$-bit security level \cite{NARDIEFO19}.


title: On substitution automorphisms with pure singular spectrum

abstract: A sufficient condition for a substitution automorphism to have pure singular spectrum is given in terms of the top Lyapunov exponent of the associated spectral cocycle. As a corollary, singularity of the spectrum is established for an infinite family of self-similar interval exchange transformations.


title: SCATTER: Selective Context Attentional Scene Text Recognizer

abstract: Scene Text Recognition (STR), the task of recognizing text against complex image backgrounds, is an active area of research. Current state-of-the-art (SOTA) methods still struggle to recognize text written in arbitrary shapes. In this paper, we introduce a novel architecture for STR, named Selective Context ATtentional Text Recognizer (SCATTER). SCATTER utilizes a stacked block architecture with intermediate supervision during training, that paves the way to successfully train a deep BiLSTM encoder, thus improving the encoding of contextual dependencies. Decoding is done using a two-step 1D attention mechanism. The first attention step re-weights visual features from a CNN backbone together with contextual features computed by a BiLSTM layer. The second attention step, similar to previous papers, treats the features as a sequence and attends to the intra-sequence relationships. Experiments show that the proposed approach surpasses SOTA performance on irregular text recognition benchmarks by 3.7\% on average.


title: $S$-Unit Equations and the Asymptotic Fermat Conjecture over Number Fields

abstract: Recent attempts at studying the Fermat equation over number fields have uncovered an unexpected and powerful connection with $S$-unit equations. In this expository paper we explain this connection and its implications for the asymptotic Fermat conjecture.