title: Control and measurement of electric dipole moments in levitated optomechanics

abstract: Levitated optomechanical systems are rapidly becoming leading tools for precision sensing, enabling a high level of control over the sensor's center of mass motion, rotation and electric charge state. Higher-order multipole moments in the charge distribution, however, remain a major source of backgrounds. By applying controlled precessive torques to the dipole moment of a levitated microsphere in vacuum, we demonstrate cancellation of dipole-induced backgrounds by 2 orders of magnitude. We measure the dipole moments of ng-mass spheres and determine their scaling with sphere size, finding that the dominant torques arise from induced dipole moments related to dielectric-loss properties of the SiO$_2$ spheres. Control of multipole moments in the charge distribution of levitated sensors is a key requirement to sufficiently reduce background sources in future applications.


title: Reynolds $n$-Lie algebras and NS-$n$-Lie algebras

abstract: In this paper, first we introduce the notion of a Reynolds operator on an $n$-Lie algebra and illustrate the relationship between Reynolds operators and derivations on an $n$-Lie algebra. We give the cohomology theory of Reynolds operators on an $n$-Lie algebra and study infinitesimal deformations of Reynolds operators using the second cohomology group. Then we introduce the notion of NS-$n$-Lie algebras, which are generalizations of both $n$-Lie algebras and $n$-pre-Lie algebras. We show that an NS-$n$-Lie algebra gives rise to an $n$-Lie algebra together with a representation on itself. Reynolds operators and Nijenhuis operators on an $n$-Lie algebra naturally induce NS-$n$-Lie algebra structures. Finally, we construct Reynolds $(n+1)$-Lie algebras and Reynolds $3$-Lie algebras from Reynolds $n$-Lie algebras and Reynolds commutative associative algebras respectively.


title: Exploring the parameter space of modified supergravity for double inflation and primordial black hole formation

abstract: We study the parameter space of the effective (with two scalars) models of cosmological inflation and primordial black hole (PBH) formation in the modified $(R+R^2)$ supergravity. Our models describe double inflation, whose first stage is driven by Starobinsky's scalaron coming from the $R^2$ gravity, and whose second stage is driven by another scalar belonging to the supergravity multiplet. The ultra-slow-roll regime between the two stages leads a large peak (enhancement) in the power spectrum of scalar perturbations, which results in efficient PBH formation. Both inflation and PBH formation are generic in our models, while those PBH can account for a significant part or the whole of dark matter. Some of the earlier proposed models in the same class are in tension (over $3\sigma$) with the observed value of the scalar tilt $n_s$, so that we study more general models with more parameters, and investigate the dependence of the cosmological tilts $(n_s,r)$ and the scalar power spectrum enhancement upon the parameters. The PBH masses and their density fraction (as part of dark matter) are also calculated. A good agreement (between $2\sigma$ and $3\sigma$) with the observed value of $n_s$ requires fine tuning of the parameters, and it is only realized in the so-called $\delta$-models. Our models offer the (super)gravitational origin of inflation, PBH and dark matter together, and may be confirmed or falsified by future precision measurements of the cosmic microwave background radiation and PBH-induced gravitational waves.


title: On Procedural Adversarial Noise Attack And Defense

abstract: Deep Neural Networks (DNNs) are vulnerable to adversarial examples which would inveigle neural networks to make prediction errors with small perturbations on the input images. Researchers have been devoted to promoting the research on the universal adversarial perturbations (UAPs) which are gradient-free and have little prior knowledge on data distributions. Procedural adversarial noise attack is a data-free universal perturbation generation method. In this paper, we propose two universal adversarial perturbation (UAP) generation methods based on procedural noise functions: Simplex noise and Worley noise. In our framework, the shading which disturbs visual classification is generated with rendering technology. Without changing the semantic representations, the adversarial examples generated via our methods show superior performance on the attack.


title: WALLABY Pre-Pilot Survey: HI Content of the Eridanus Supergroup

abstract: We present observations of the Eridanus supergroup obtained with the Australian Square Kilometre Array Pathfinder (ASKAP) as part of the pre-pilot survey for the Widefield ASKAP L-band Legacy All-sky Blind Survey (WALLABY). The total number of detected HI sources is 55, of which 12 are background galaxies not associated with the Eridanus supergroup. Two massive HI clouds are identified and large HI debris fields are seen in the NGC 1359 interacting galaxy pair, and the face-on spiral galaxy NGC 1385. We describe the data products from the source finding algorithm and present the basic parameters. The presence of distorted HI morphology in all detected galaxies suggests ongoing tidal interactions within the subgroups. The Eridanus group has a large fraction of HI deficient galaxies as compared to previously studied galaxy groups. These HI deficient galaxies are not found at the centre of the group. We find that galaxies in the Eridanus supergroup do not follow the general trend of the atomic gas fraction versus stellar mass scaling relation, which indicates that the scaling relation changes with environmental density. In general, the majority of these galaxies are actively forming stars.


title: Heights and quantitative arithmetic on stacky curves

abstract: In this paper we investigate a family of algebraic stacks, the so-called stacky curves, in the context of the general theory of heights on algebraic stacks due to Ellenberg, Satriano, and Zureick-Brown. We first give an elementary construction of a height which is seen to be dual to theirs. Next we count rational points having bounded E-S-ZB height on a particular stacky curve, answering a question of Ellenberg, Satriano, and Zureick-Brown. We then show that when the Euler characteristic of stacky curves is non-positive, that the E-S-ZB height coming from the anti-canonical divisor class fails to have the Northcott property. Next we prove a generalized version of a conjecture of Vojta, applied to stacky curves with negative Euler characteristic and coarse space $\mathbb{P}^1$, is equivalent to the $abc$-conjecture. Finally, we prove that in the negative characteristic case the purely "stacky" part of the E-S-ZB height exhibits the Northcott property.


title: WALLABY pre-pilot survey: Two dark clouds in the vicinity of NGC 1395

abstract: We present the Australian Square Kilometre Array Pathfinder (ASKAP) WALLABY pre-pilot observations of two `dark' HI sources (with HI masses of a few times 10^8 Msol and no known stellar counterpart) that reside within 363 kpc of NGC 1395, the most massive early-type galaxy in the Eridanus group of galaxies. We investigate whether these `dark' HI sources have resulted from past tidal interactions or whether they are an extreme class of low surface brightness galaxies. Our results suggest that both scenarios are possible, and not mutually exclusive. The two `dark' HI sources are compact, reside in relative isolation and are more than 159 kpc away from their nearest HI-rich galaxy neighbour. Regardless of origin, the HI sizes and masses of both `dark' HI sources are consistent with the HI size-mass relationship that is found in nearby low-mass galaxies, supporting the possibility that these HI sources are an extreme class of low surface brightness galaxies. We identified three analogues of candidate primordial `dark' HI galaxies within the TNG100 cosmological, hydrodynamic simulation. All three model analogues are dark matter-dominated, have assembled most of their mass 12-13 Gyr ago, and have not experienced much evolution until cluster infall 1-2 Gyr ago. Our WALLABY pre-pilot science results suggest that the upcoming large area HI surveys will have a significant impact on our understanding of low surface brightness galaxies and the physical processes that shape them.


title: QForte: an efficient state simulator and quantum algorithms library for molecular electronic structure

abstract: We introduce a novel open-source software package QForte, a comprehensive development tool for new quantum simulation algorithms. QForte incorporates functionality for handling molecular Hamiltonians, fermionic encoding, ansatz construction, time evolution, and state-vector simulation, requiring only a classical electronic structure package as a dependency. QForte also contains black-box implementations of a wide variety of quantum algorithms including (but not limited to): variational and projective quantum eigensolvers, adaptive eigensolvers, quantum imaginary time evolution, quantum Krylov methods, and quantum phase estimation. We highlight two features of QForte: i) how the Python class structure of QForte enables the facile implementation of new algorithms, and ii) how existing algorithms can be executed in just a few lines of code.


title: WALLABY Pre-Pilot Survey: The effects of angular momentum and environment on the HI gas and star formation properties of galaxies in the Eridanus supergroup

abstract: We use high-resolution ASKAP observations of galaxies in the Eridanus supergroup to study their HI, angular momentum and star formation properties, as part of the WALLABY pre-pilot survey efforts. The Eridanus supergroup is composed of three sub-groups in the process of merging to form a cluster. The main focus of this study is the Eridanus (or NGC 1395) sub-group. The baryonic specific angular momentum - baryonic mass ($j_{\mathrm{b}} - M_{\mathrm{b}}$) relation for the Eridanus galaxies is observed to be an unbroken power law of the form $j_{\mathrm{b}} \propto M_{\mathrm{b}}^{0.57 \pm 0.05}$, with a scatter of $\sim 0.10 \pm 0.01$ dex, consistent with previous works. We examine the relation between the atomic gas fraction, $f_{\mathrm{atm}}$, and the integrated atomic disc stability parameter $q$ (the $f_{\mathrm{atm}} - q$ relation), and find that the Eridanus galaxies deviate significantly from the relation owing to environmental processes such as tidal interactions and ram-pressure affecting their HI gas. We find that a majority of the Eridanus galaxies are HI deficient compared to normal star-forming galaxies in the field. We also find that the star formation among the Eridanus galaxies may be suppressed owing to their environment, thus hinting at significant levels of pre-processing within the Eridanus sub-group, even before the galaxies have entered a cluster-like environment.


title: Issue Link Label Recovery and Prediction for Open Source Software

abstract: Modern open source software development heavily relies on the issue tracking systems to manage their feature requests, bug reports, tasks, and other similar artifacts. Together, those "issues" form a complex network with links to each other. The heterogeneous character of issues inherently results in varied link types and therefore poses a great challenge for users to create and maintain the label of the link manually. The goal of most existing automated issue link construction techniques ceases with only examining the existence of links between issues. In this work, we focus on the next important question of whether we can assess the type of issue link automatically through a data-driven method. We analyze the links between issues and their labels used the issue tracking system for 66 open source projects. Using three projects, we demonstrate promising results when using supervised machine learning classification for the task of link label recovery with careful model selection and tuning, achieving F1 scores of between 0.56-0.70 for the three studied projects. Further, the performance of our method for future link label prediction is convincing when there is sufficient historical data. Our work signifies the first step in systematically manage and maintain issue links faced in practice.


title: Improved Parallel Algorithm for Minimum Cost Submodular Cover Problem

abstract: In the minimum cost submodular cover problem (MinSMC), we are given a monotone nondecreasing submodular function $f\colon 2^V \rightarrow \mathbb{Z}^+$, a linear cost function $c: V\rightarrow \mathbb R^{+}$, and an integer $k\leq f(V)$, the goal is to find a subset $A\subseteq V$ with the minimum cost such that $f(A)\geq k$. The MinSMC can be found at the heart of many machine learning and data mining applications. In this paper, we design a parallel algorithm for the MinSMC that takes at most $O(\frac{\log km\log k(\log m+\log\log mk)}{\varepsilon^4})$ adaptive rounds, and it achieves an approximation ratio of $\frac{H(\min\{\Delta,k\})}{1-5\varepsilon}$ with probability at least $1-3\varepsilon$, where $\Delta=\max_{v\in V}f(v)$, $H(\cdot)$ is the Harmonic number, $m=|V|$, and $\varepsilon$ is a constant in $(0,\frac{1}{5})$.


title: Privacy-Preserving Machine Learning: Methods, Challenges and Directions

abstract: Machine learning (ML) is increasingly being adopted in a wide variety of application domains. Usually, a well-performing ML model relies on a large volume of training data and high-powered computational resources. Such a need for and the use of huge volumes of data raise serious privacy concerns because of the potential risks of leakage of highly privacy-sensitive information; further, the evolving regulatory environments that increasingly restrict access to and use of privacy-sensitive data add significant challenges to fully benefiting from the power of ML for data-driven applications. A trained ML model may also be vulnerable to adversarial attacks such as membership, attribute, or property inference attacks and model inversion attacks. Hence, well-designed privacy-preserving ML (PPML) solutions are critically needed for many emerging applications. Increasingly, significant research efforts from both academia and industry can be seen in PPML areas that aim toward integrating privacy-preserving techniques into ML pipeline or specific algorithms, or designing various PPML architectures. In particular, existing PPML research cross-cut ML, systems and applications design, as well as security and privacy areas; hence, there is a critical need to understand state-of-the-art research, related challenges and a research roadmap for future research in PPML area. In this paper, we systematically review and summarize existing privacy-preserving approaches and propose a Phase, Guarantee, and Utility (PGU) triad based model to understand and guide the evaluation of various PPML solutions by decomposing their privacy-preserving functionalities. We discuss the unique characteristics and challenges of PPML and outline possible research directions that leverage as well as benefit multiple research communities such as ML, distributed systems, security and privacy.


title: Knowledge Enhanced Multi-modal Fake News Detection

abstract: Recent years have witnessed the significant damage caused by various types of fake news. Although considerable effort has been applied to address this issue and much progress has been made on detecting fake news, most existing approaches mainly rely on the textual content and/or social context, while knowledge-level information---entities extracted from the news content and the relations between them---is much less explored. Within the limited work on knowledge-based fake news detection, an external knowledge graph is often required, which may introduce additional problems: it is quite common for entities and relations, especially with respect to new concepts, to be missing in existing knowledge graphs, and both entity prediction and link prediction are open research questions themselves. Therefore, in this work, we investigate \textbf{knowledge-based fake news detection that does not require any external knowledge graph.} Specifically, our contributions include: (1) transforming the problem of detecting fake news into a subgraph classification task---entities and relations are extracted from each news item to form a single knowledge graph, where a news item is represented by a subgraph. Then a graph neural network (GNN) model is trained to classify each subgraph/news item. (2) Further improving the performance of this model through a simple but effective multi-modal technique that combines extracted knowledge, textual content and social context. Experiments on multiple datasets with thousands of labelled news items demonstrate that our knowledge-based algorithm outperforms existing counterpart methods, and its performance can be further boosted by the multi-modal approach.


title: Photochemistry and Spectral Characterization of Temperate and Gas-Rich Exoplanets

abstract: Exoplanets that receive stellar irradiance of approximately Earth's or less have been discovered and many are suitable for spectral characterization. Here we focus on the temperate planets that have massive H2-dominated atmospheres, and trace the chemical reactions and transport following the photodissociation of H2O, CH4, NH3, and H2S, with K2-18 b, PH2 b, and Kepler-167 e representing temperate/cold planets around M and G/K stars. We find that NH3 is likely depleted by photodissociation to the cloud deck on planets around G/K stars but remains intact in the middle atmosphere of planets around M stars. A common phenomenon on temperate planets is that the photodissociation of NH3 in presence of CH4 results in HCN as the main photochemical product. The photodissociation of CH4 together with H2O leads to CO and CO2, and the synthesis of hydrocarbon is suppressed. Temperate planets with super-solar atmospheric metallicity and appreciable internal heat may have additional CO and CO2 from the interior and less NH3 and thus less HCN. Our models of K2-18 b can explain the transmission spectrum measured by Hubble, and indicate that future observations in 0.5-5.0 um would provide the sensitivity to detect the equilibrium gases CH4, H2O, and NH3, the photochemical gas HCN, as well as CO2 in some cases. Temperate and H2-rich exoplanets are thus laboratories of atmospheric chemistry that operate in regimes not found in the Solar System, and spectral characterization of these planets in transit or reflected starlight promises to greatly expand the types of molecules detected in exoplanet atmospheres.


title: Zero-field spin resonance in graphene with proximity-induced spin-orbit coupling

abstract: We investigate collective spin excitations in graphene with proximity-induced spin-orbit coupling (SOC) of the Rashba and valley-Zeeman types, as it is the case, e.g., for graphene on transition- metal-dichalcogenide substrates. It is shown that, even in the absence of an external magnetic field, such a system supports collective modes, which correspond to coupled oscillations of the uniform and valley-staggered magnetizations. These modes can be detected via both zero-field electron spin resonance (ESR) and zero-field electric-dipole spin resonance (EDSR), with EDSR response coming solely from Rashba SOC. We analyze the effect of electron-electron interaction within the Fermi- liquid kinetic equation and show that the interaction splits both the ESR and EDSR peaks into two. The magnitude of splitting and the relative weights of the resonances can be used to extract the spin-orbit coupling constants and many-body interaction parameters that may not be accessible by other methods.


title: Uniform Spanning Tree in Topological Polygons, Partition Functions for SLE(8), and Correlations in $c=-2$ Logarithmic CFT

abstract: We find explicit SLE(8) partition functions for the scaling limits of Peano curves in the uniform spanning tree (UST) in topological polygons with general boundary conditions. They are given in terms of Coulomb gas integral formulas, which can also be expressed in terms of determinants involving a-periods of a hyperelliptic Riemann surface. We also identify the crossing probabilities for the UST Peano curves as ratios of these partition functions. The partition functions are interpreted as correlation functions in a logarithmic conformal field theory (log-CFT) of central charge $c= -2$. Indeed, it is clear from our results that this theory is not a minimal model and exhibits logarithmic phenomena -- the limit functions have logarithmic asymptotic behavior, that we calculate explicitly. General fusion rules for them could also be inferred from the explicit formulas. The discovered algebraic structure matches the known Virasoro staggered module classification, so in this sense, we give a direct probabilistic construction for correlation functions in a log-CFT of central charge $-2$ describing the UST model.


title: A $D$-competitive algorithm for the Multilevel Aggregation Problem with Deadlines

abstract: In this paper, we consider the multi-level aggregation problem with deadlines (MLAPD) previously studied by Bienkowski et al. (2015), Buchbinder et al. (2017), and Azar and Touitou (2019). This is an online problem where the algorithm services requests arriving over time and can save costs by aggregating similar requests. Costs are structured in the form of a rooted tree. This problem has applications to many important areas such as multicasting, sensor networks, and supply-chain management. In particular, the TCP-acknowledgment problem, joint-replenishment problem, and assembly problem are all special cases of the delay version of the problem. We present a $D$-competitive algorithm for MLAPD. This beats the $6(D+1)$-competitive algorithm given in Buchbinder et al. (2017). Our approach illuminates key structural aspects of the problem and provides an algorithm that is simpler to implement than previous approaches. We also give improved competitive ratios for special cases of the problem.


title: Semi-supervised classification of radiology images with NoTeacher: A Teacher that is not Mean

abstract: Deep learning models achieve strong performance for radiology image classification, but their practical application is bottlenecked by the need for large labeled training datasets. Semi-supervised learning (SSL) approaches leverage small labeled datasets alongside larger unlabeled datasets and offer potential for reducing labeling cost. In this work, we introduce NoTeacher, a novel consistency-based SSL framework which incorporates probabilistic graphical models. Unlike Mean Teacher which maintains a teacher network updated via a temporal ensemble, NoTeacher employs two independent networks, thereby eliminating the need for a teacher network. We demonstrate how NoTeacher can be customized to handle a range of challenges in radiology image classification. Specifically, we describe adaptations for scenarios with 2D and 3D inputs, uni and multi-label classification, and class distribution mismatch between labeled and unlabeled portions of the training data. In realistic empirical evaluations on three public benchmark datasets spanning the workhorse modalities of radiology (X-Ray, CT, MRI), we show that NoTeacher achieves over 90-95% of the fully supervised AUROC with less than 5-15% labeling budget. Further, NoTeacher outperforms established SSL methods with minimal hyperparameter tuning, and has implications as a principled and practical option for semisupervised learning in radiology applications.


title: FT-TDR: Frequency-guided Transformer and Top-Down Refinement Network for Blind Face Inpainting

abstract: Blind face inpainting refers to the task of reconstructing visual contents without explicitly indicating the corrupted regions in a face image. Inherently, this task faces two challenges: (1) how to detect various mask patterns of different shapes and contents; (2) how to restore visually plausible and pleasing contents in the masked regions. In this paper, we propose a novel two-stage blind face inpainting method named Frequency-guided Transformer and Top-Down Refinement Network (FT-TDR) to tackle these challenges. Specifically, we first use a transformer-based network to detect the corrupted regions to be inpainted as masks by modeling the relation among different patches. We also exploit the frequency modality as complementary information for improved detection results and capture the local contextual incoherence to enhance boundary consistency. Then a top-down refinement network is proposed to hierarchically restore features at different levels and generate contents that are semantically consistent with the unmasked face regions. Extensive experiments demonstrate that our method outperforms current state-of-the-art blind and non-blind face inpainting methods qualitatively and quantitatively.


title: Asymmetric parametric generation of images with nonlinear dielectric metasurfaces

abstract: Subwavelength dielectric resonators assembled into metasurfaces have become a versatile tool for miniaturising optical components approaching the nanoscale. An important class of metasurface functionalities is associated with asymmetry in both generation and transmission of light with respect to reversals of the positions of emitters and receivers. Nonlinear light-matter interaction in metasurfaces offers a promising pathway towards miniaturisation of the asymmetric control of light. Here we demonstrate asymmetric parametric generation of light in nonlinear metasurfaces. We assemble dissimilar nonlinear dielectric resonators into translucent metasurfaces that produce images in the visible spectral range being illuminated by infrared radiation. By design, the metasurfaces produce different and completely independent images for the reversed direction of illumination, that is when the positions of the infrared emitter and the visible light receiver are exchanged. Nonlinearity-enabled asymmetric control of light by subwavelength resonators paves the way towards novel nanophotonic components via dense integration of large quantities of nonlinear resonators into compact metasurface designs.


title: Study of $e^+e^-\to \Upsilon(\rm1S,2S)\eta$ and $e^+e^-\to \Upsilon(\rm 1S)\eta^{\prime}$ at $\sqrt{s}=10.866$ GeV with the Belle detector

abstract: We report the first observation of the processes $e^+e^-\to\Upsilon(\rm 1S,2S)\eta$ at $\sqrt{s}=10.866$~GeV with a $10.2\sigma$ and $16.5\sigma$ significance respectively. The measured Born cross sections are $\sigma(e^+e^- \to \Upsilon(2S)\eta)=2.07 \pm 0.21 \pm 0.19$~pb, and $\sigma(e^+e^- \to \Upsilon(\rm 1S)\eta)=0.42 \pm 0.08 \pm 0.04$~pb. We also set the upper limit on the cross section of the process $e^+e^- \to \Upsilon(\rm 1S)\eta^{\prime}$ to be $\sigma(e^+e^- \to \Upsilon(\rm 1S)\eta^{\prime})<0.035$~pb at $90\%$ CL. The results are obtained with the data sample collected with the Belle detector at the KEKB asymmetric-energy $e^+e^-$ collider in the energy range from $10.63$~GeV to $11.02$~GeV.


title: Synthetic Correlated Diffusion Imaging Hyperintensity Delineates Clinically Significant Prostate Cancer

abstract: Prostate cancer (PCa) is the second most common cancer in men worldwide and the most frequently diagnosed cancer among men in more developed countries. The prognosis of PCa is excellent if detected at an early stage, making early screening crucial for detection and treatment. In recent years, a new form of diffusion magnetic resonance imaging called correlated diffusion imaging (CDI) was introduced, and preliminary results show promise as a screening tool for PCa. In the largest study of its kind, we investigate the relationship between PCa presence and a new variant of CDI we term synthetic correlated diffusion imaging (CDI$^s$), as well as its performance for PCa delineation compared to current standard MRI techniques (T2-weighted (T2w) imaging, diffusion-weighted imaging (DWI), and dynamic contrast-enhanced (DCE) imaging) across a cohort of 200 patient cases. Statistical analyses reveal that hyperintensity in CDI$^s$ is a strong indicator of PCa presence and achieves strong delineation of clinically significant cancerous tissue compared to T2w, DWI, and DCE. These results suggest that CDI$^s$ hyperintensity may be a powerful biomarker for the presence of PCa, and may have a clinical impact as a diagnostic aid for improving PCa screening.


title: Tensor Principal Component Analysis in High Dimensional CP Models

abstract: The CP decomposition for high dimensional non-orthogonal spiked tensors is an important problem with broad applications across many disciplines. However, previous works with theoretical guarantee typically assume restrictive incoherence conditions on the basis vectors for the CP components. In this paper, we propose new computationally efficient composite PCA and concurrent orthogonalization algorithms for tensor CP decomposition with theoretical guarantees under mild incoherence conditions. The composite PCA applies the principal component or singular value decompositions twice, first to a matrix unfolding of the tensor data to obtain singular vectors and then to the matrix folding of the singular vectors obtained in the first step. It can be used as an initialization for any iterative optimization schemes for the tensor CP decomposition. The concurrent orthogonalization algorithm iteratively estimates the basis vector in each mode of the tensor by simultaneously applying projections to the orthogonal complements of the spaces generated by other CP components in other modes. It is designed to improve the alternating least squares estimator and other forms of the high order orthogonal iteration for tensors with low or moderately high CP ranks, and it is guaranteed to converge rapidly when the error of any given initial estimator is bounded by a small constant. Our theoretical investigation provides estimation accuracy and convergence rates for the two proposed algorithms. Both proposed algorithms are applicable to deterministic tensor, its noisy version, and the order-$2K$ covariance tensor of order-$K$ tensor data in a factor model with uncorrelated factors. Our implementations on synthetic data demonstrate significant practical superiority of our approach over existing methods.


title: An Analysis of Stochastic Variance Reduced Gradient for Linear Inverse Problems

abstract: Stochastic variance reduced gradient (SVRG) is a popular variance reduction technique for accelerating stochastic gradient descent (SGD). We provide a first analysis of the method for solving a class of linear inverse problems in the lens of the classical regularization theory. We prove that for a suitable constant step size schedule, the method can achieve an optimal convergence rate in terms of the noise level (under suitable regularity condition) and the variance of the SVRG iterate error is smaller than that by SGD. These theoretical findings are corroborated by a set of numerical experiments.


title: Enhancing Knowledge Tracing via Adversarial Training

abstract: We study the problem of knowledge tracing (KT) where the goal is to trace the students' knowledge mastery over time so as to make predictions on their future performance. Owing to the good representation capacity of deep neural networks (DNNs), recent advances on KT have increasingly concentrated on exploring DNNs to improve the performance of KT. However, we empirically reveal that the DNNs based KT models may run the risk of overfitting, especially on small datasets, leading to limited generalization. In this paper, by leveraging the current advances in adversarial training (AT), we propose an efficient AT based KT method (ATKT) to enhance KT model's generalization and thus push the limit of KT. Specifically, we first construct adversarial perturbations and add them on the original interaction embeddings as adversarial examples. The original and adversarial examples are further used to jointly train the KT model, forcing it is not only to be robust to the adversarial examples, but also to enhance the generalization over the original ones. To better implement AT, we then present an efficient attentive-LSTM model as KT backbone, where the key is a proposed knowledge hidden state attention module that adaptively aggregates information from previous knowledge hidden states while simultaneously highlighting the importance of current knowledge hidden state to make a more accurate prediction. Extensive experiments on four public benchmark datasets demonstrate that our ATKT achieves new state-of-the-art performance. Code is available at: \color{blue} {\url{https://github.com/xiaopengguo/ATKT}}.


title: A panoramic view of the Local Group dwarf galaxy NGC 6822

abstract: We present a panoramic survey of the isolated Local Group dwarf irregular galaxy NGC 6822. Our photometry reaches $\sim2-3$ magnitudes deeper than most previous studies and spans the widest area around the dwarf compared to any prior work. We observe no stellar over-densities in the outskirts of NGC 6822 to $V\sim 30$ mag$\,$arcsec$^{-2}$ and a projected radius of $16.5$ kpc. This indicates that NGC 6822 has not experienced any recent interaction with a companion galaxy, despite previous suggestions to the contrary. Similarly, we find no evidence for any dwarf satellites of NGC 6822 to a limiting luminosity $M_V\approx -5$. NGC 6822 contains a disk of HI gas and young stars, oriented at $\sim 60$ degrees to an extended spheroid composed of old stellar populations. We observe no correlation between the distribution of young stars and spheroid members. Our imaging allows us to trace the spheroid to nearly $11$ kpc along its major axis, commensurate with the extent of the NGC 6822 globular cluster system. We find that the spheroid becomes increasingly flattened at larger radii, and its position angle twists by up to $40$ degrees. We use Gaia EDR3 astrometry to measure a proper motion for NGC 6822, and then sample its orbital parameter space. While this galaxy has spent the majority of its life in isolation, we find that it likely passed within the virial radius of the Milky Way $\sim3-4$ Gyr ago. This may explain the apparent flattening and twisting observed in the outskirts of its spheroid.


title: Revisit the Fundamental Theorem of Linear Algebra

abstract: This survey is meant to provide an introduction to the fundamental theorem of linear algebra and the theories behind them. Our goal is to give a rigorous introduction to the readers with prior exposure to linear algebra. Specifically, we provide some details and proofs of some results from (Strang, 1993). We then describe the fundamental theorem of linear algebra from different views and find the properties and relationships behind the views. The fundamental theorem of linear algebra is essential in many fields, such as electrical engineering, computer science, machine learning, and deep learning. This survey is primarily a summary of purpose, significance of important theories behind it. The sole aim of this survey is to give a self-contained introduction to concepts and mathematical tools in theory behind the fundamental theorem of linear algebra and rigorous analysis in order to seamlessly introduce its properties in four subspaces in subsequent sections. However, we clearly realize our inability to cover all the useful and interesting results and given the paucity of scope to present this discussion, e.g., the separated analysis of the (orthogonal) projection matrices. We refer the reader to literature in the field of linear algebra for a more detailed introduction to the related fields. Some excellent examples include (Rose, 1982; Strang, 2009; Trefethen and Bau III, 1997; Strang, 2019, 2021).


title: Deep Learning Enhanced Dynamic Mode Decomposition

abstract: Koopman operator theory shows how nonlinear dynamical systems can be represented as an infinite-dimensional, linear operator acting on a Hilbert space of observables of the system. However, determining the relevant modes and eigenvalues of this infinite-dimensional operator can be difficult. The extended dynamic mode decomposition (EDMD) is one such method for generating approximations to Koopman spectra and modes, but the EDMD method faces its own set of challenges due to the need of user defined observables. To address this issue, we explore the use of autoencoder networks to simultaneously find optimal families of observables which also generate both accurate embeddings of the flow into a space of observables and submersions of the observables back into flow coordinates. This network results in a global transformation of the flow and affords future state prediction via the EDMD and the decoder network. We call this method the deep learning dynamic mode decomposition (DLDMD). The method is tested on canonical nonlinear data sets and is shown to produce results that outperform a standard DMD approach and enable data-driven prediction where the standard DMD fails.


title: Linear programming bounds for quantum channels acting on quantum error-correcting codes

abstract: While quantum weight enumerators establish some of the best upper bounds on the minimum distance of quantum error-correcting codes, these bounds are not optimized to quantify the performance of quantum codes under the effect of arbitrary quantum channels that describe bespoke noise models. Herein, for any Kraus decomposition of any given quantum channel, we introduce corresponding quantum weight enumerators that naturally generalize the Shor-Laflamme quantum weight enumerators. We establish an indirect linear relationship between these generalized quantum weight enumerators by introducing an auxiliary exact weight enumerator that completely quantifies the quantum code's projector, and is independent of the underlying noise process. By additionally working within the framework of approximate quantum error correction, we establish a general framework for constructing a linear program that is infeasible whenever approximate quantum error correcting codes with corresponding parameters do not exist. Our linear programming framework allows us to establish the non-existence of certain quantum codes that approximately correct amplitude damping errors, and obtain non-trivial upper bounds on the maximum dimension of a broad family of permutation-invariant quantum codes.


title: Coupled dynamics of quantized vortices and normal fluid in superfluid $^4$He based on lattice Boltzmann method

abstract: We investigate the coupled dynamics of quantized vortices and normal fluid in superfluid $^4$He at finite temperatures using a numerical approach based on the vortex filament model (VFM) and lattice Boltzmann method (LBM). The LBM allows us to simulate a fluid flow with only local operations, i .e., rather than solving the Navier--Stokes (NS) equations directly; a fluid flow is considered a convection of mesoscopic particles between sites on a lattice grid. Although the two-fluid nature of He II makes its flow complex, the particle-like treatment of the normal fluid in the LBM significantly reduces the complexity. We confirm, by comparing to results obtained with direct NS simulations, that the proposed numerical approach reproduces characteristic flow structures. We also demonstrate that the proposed computational approach is suitable for a thermal counterflow simulation with a solid boundary to elucidate a thermal boundary layer near a heater in a closed channel.


title: A Generalizable Model-and-Data Driven Approach for Open-Set RFF Authentication

abstract: Radio-frequency fingerprints~(RFFs) are promising solutions for realizing low-cost physical layer authentication. Machine learning-based methods have been proposed for RFF extraction and discrimination. However, most existing methods are designed for the closed-set scenario where the set of devices is remains unchanged. These methods can not be generalized to the RFF discrimination of unknown devices. To enable the discrimination of RFF from both known and unknown devices, we propose a new end-to-end deep learning framework for extracting RFFs from raw received signals. The proposed framework comprises a novel preprocessing module, called neural synchronization~(NS), which incorporates the data-driven learning with signal processing priors as an inductive bias from communication-model based processing. Compared to traditional carrier synchronization techniques, which are static, this module estimates offsets by two learnable deep neural networks jointly trained by the RFF extractor. Additionally, a hypersphere representation is proposed to further improve the discrimination of RFF. Theoretical analysis shows that such a data-and-model framework can better optimize the mutual information between device identity and the RFF, which naturally leads to better performance. Experimental results verify that the proposed RFF significantly outperforms purely data-driven DNN-design and existing handcrafted RFF methods in terms of both discrimination and network generalizability.


title: Statistical Inference in High-dimensional Generalized Linear Models with Streaming Data

abstract: In this paper we develop an online statistical inference approach for high-dimensional generalized linear models with streaming data for real-time estimation and inference. We propose an online debiased lasso (ODL) method to accommodate the special structure of streaming data. ODL differs from offline debiased lasso in two important aspects. First, in computing the estimate at the current stage, it only uses summary statistics of the historical data. Second, in addition to debiasing an online lasso estimator, ODL corrects an approximation error term arising from nonlinear online updating with streaming data. We show that the proposed online debiased estimators for the GLMs are consistent and asymptotically normal. This result provides a theoretical basis for carrying out real-time interim statistical inference with streaming data. Extensive numerical experiments are conducted to evaluate the performance of the proposed ODL method. These experiments demonstrate the effectiveness of our algorithm and support the theoretical results. A streaming dataset from the National Automotive Sampling System-Crashworthiness Data System is analyzed to illustrate the application of the proposed method.


title: On Random Quantum Random Walks

abstract: Quantum random walks, - coined, lattice ones, - exhibit ballistic behavior with fascinating asymptotic patterns of the amplitudes. We show that averaging over the coins (using the Haar measure), these patterns blend into a spline. Also, we discuss the localizations of such quantum random walks, and establish some strong constraints on the achievable speeds.


title: Giant Piezospintronic Effect in a Noncollinear Antiferromagnetic Metal

abstract: One of the main bottleneck issues for room-temperature antiferromagnetic spintronic devices is the small signal read-out owing to the limited anisotropic magnetoresistance in antiferromagnets. However, this could be overcome by either utilizing the Berry-curvature-induced anomalous Hall resistance in noncollinear antiferromagnets or establishing tunnel junction devices based on effective manipulation of antiferromagnetic spins. In this work, we demonstrate the giant piezoelectric strain control of the spin structure and the anomalous Hall resistance in a noncollinear antiferromagnetic metal - D019 hexagonal Mn3Ga. Furthermore, we built tunnel junction devices with a diameter of 200 nm to amplify the maximum tunneling resistance ratio to more than 10% at room-temperature, which thus implies significant potential of noncollinear antiferromagnets for large signal-output and high-density antiferromagnetic spintronic device applications.

categories: cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el physics.app-ph


title: Full Realization Scheme of the Tensor Product Space of N Distinguishable Photons in Two States

abstract: The ability to control and hence to realize a given number of photons is of major interest from a fundamental point of view, e.g. Bell inequalities, photons bunching. In recent years this interest has grown by the so-called the "Second Quantum Revolution" where such an ability is needed for quantum computers, etc. In this paper, we show that such a realization can not be done by a unitary process. Therefore, a non-unitary interferometer is given to build a full realization of the tensor product space for two photons at two states. Finally, by modifying the previous interferometer, the full tonsorial product space of N photons in two states is shown.


title: Domain-Aware Universal Style Transfer

abstract: Style transfer aims to reproduce content images with the styles from reference images. Existing universal style transfer methods successfully deliver arbitrary styles to original images either in an artistic or a photo-realistic way. However, the range of 'arbitrary style' defined by existing works is bounded in the particular domain due to their structural limitation. Specifically, the degrees of content preservation and stylization are established according to a predefined target domain. As a result, both photo-realistic and artistic models have difficulty in performing the desired style transfer for the other domain. To overcome this limitation, we propose a unified architecture, Domain-aware Style Transfer Networks (DSTN) that transfer not only the style but also the property of domain (i.e., domainness) from a given reference image. To this end, we design a novel domainness indicator that captures the domainness value from the texture and structural features of reference images. Moreover, we introduce a unified framework with domain-aware skip connection to adaptively transfer the stroke and palette to the input contents guided by the domainness indicator. Our extensive experiments validate that our model produces better qualitative results and outperforms previous methods in terms of proxy metrics on both artistic and photo-realistic stylizations.


title: Resonant Ultrasound Spectroscopy: Sensitivity Analysis for Anisotropic Materials with Hexagonal Symmetry

abstract: Resonance ultrasound spectroscopy (RUS) is a non-destructive technique for evaluating elastic and an-elastic material properties. The frequencies of free vibrations for a carefully crafted sample are measured, and material properties can be extracted from this. In one popular application, the determination of monocrystal elasticity, the results are not always reliable. In some cases, the resonant frequencies are insensitive to changes in certain elastic constants or their linear combinations. Previous work has been done to characterize these sensitivity issues in materials with isotropic and cubic symmetry. This work examines the sensitivity of elastic constant measurements by the RUS method for materials with hexagonal symmetry, such as titanium-diboride. We investigate the reliability of RUS data and explore supplemental measurements to obtain an accurate and complete set of elastic constants.


title: AdaRNN: Adaptive Learning and Forecasting of Time Series

abstract: Time series has wide applications in the real world and is known to be difficult to forecast. Since its statistical properties change over time, its distribution also changes temporally, which will cause severe distribution shift problem to existing methods. However, it remains unexplored to model the time series in the distribution perspective. In this paper, we term this as Temporal Covariate Shift (TCS). This paper proposes Adaptive RNNs (AdaRNN) to tackle the TCS problem by building an adaptive model that generalizes well on the unseen test data. AdaRNN is sequentially composed of two novel algorithms. First, we propose Temporal Distribution Characterization to better characterize the distribution information in the TS. Second, we propose Temporal Distribution Matching to reduce the distribution mismatch in TS to learn the adaptive TS model. AdaRNN is a general framework with flexible distribution distances integrated. Experiments on human activity recognition, air quality prediction, and financial analysis show that AdaRNN outperforms the latest methods by a classification accuracy of 2.6% and significantly reduces the RMSE by 9.0%. We also show that the temporal distribution matching algorithm can be extended in Transformer structure to boost its performance.


title: SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer

abstract: Point cloud completion aims to predict a complete shape in high accuracy from its partial observation. However, previous methods usually suffered from discrete nature of point cloud and unstructured prediction of points in local regions, which makes it hard to reveal fine local geometric details on the complete shape. To resolve this issue, we propose SnowflakeNet with Snowflake Point Deconvolution (SPD) to generate the complete point clouds. The SnowflakeNet models the generation of complete point clouds as the snowflake-like growth of points in 3D space, where the child points are progressively generated by splitting their parent points after each SPD. Our insight of revealing detailed geometry is to introduce skip-transformer in SPD to learn point splitting patterns which can fit local regions the best. Skip-transformer leverages attention mechanism to summarize the splitting patterns used in the previous SPD layer to produce the splitting in the current SPD layer. The locally compact and structured point cloud generated by SPD is able to precisely capture the structure characteristic of 3D shape in local patches, which enables the network to predict highly detailed geometries, such as smooth regions, sharp edges and corners. Our experimental results outperform the state-of-the-art point cloud completion methods under widely used benchmarks. Code will be available at https://github.com/AllenXiangX/SnowflakeNet.


title: Lifelong Intent Detection via Multi-Strategy Rebalancing

abstract: Conventional Intent Detection (ID) models are usually trained offline, which relies on a fixed dataset and a predefined set of intent classes. However, in real-world applications, online systems usually involve continually emerging new user intents, which pose a great challenge to the offline training paradigm. Recently, lifelong learning has received increasing attention and is considered to be the most promising solution to this challenge. In this paper, we propose Lifelong Intent Detection (LID), which continually trains an ID model on new data to learn newly emerging intents while avoiding catastrophically forgetting old data. Nevertheless, we find that existing lifelong learning methods usually suffer from a serious imbalance between old and new data in the LID task. Therefore, we propose a novel lifelong learning method, Multi-Strategy Rebalancing (MSR), which consists of cosine normalization, hierarchical knowledge distillation, and inter-class margin loss to alleviate the multiple negative effects of the imbalance problem. Experimental results demonstrate the effectiveness of our method, which significantly outperforms previous state-of-the-art lifelong learning methods on the ATIS, SNIPS, HWU64, and CLINC150 benchmarks.


title: Electric-Field-Controlled Antiferromagnetic Spintronic Devices

abstract: In recent years, the field of antiferromagnetic spintronics has been substantially advanced. Electric-field control is a promising approach to achieving ultra-low power spintronic devices via suppressing Joule heating. In this article, cutting-edge research, including electric-field modulation of antiferromagnetic spintronic devices using strain, ionic liquids, dielectric materials, and electrochemical ionic migration, are comprehensively reviewed. Various emergent topics such as the Neel spin-orbit torque, chiral spintronics, topological antiferromagnetic spintronics, anisotropic magnetoresistance, memory devices, two-dimensional magnetism, and magneto-ionic modulation with respect to antiferromagnets are examined. In conclusion, we envision the possibility of realizing high-quality room-temperature antiferromagnetic tunnel junctions, antiferromagnetic spin logic devices, and artificial antiferromagnetic neurons. It is expected that this work provides an appropriate and forward-looking perspective that will promote the rapid development of this field.


title: The Sakaguchi-Kuramoto model in presence of asymmetric interactions that break phase-shift symmetry

abstract: The celebrated Kuramoto model provides an analytically tractable framework to study spontaneous collective synchronization and comprises globally coupled limit-cycle oscillators interacting symmetrically with one another. The Sakaguchi-Kuramoto model is a generalization of the basic model that considers the presence of a phase-lag parameter in the interaction, thereby making it asymmetric between oscillator pairs. Here, we consider a further generalization, by adding an interaction that breaks the phase-shift symmetry of the model. The highlight of our study is the unveiling of a very rich bifurcation diagram comprising of both oscillatory and non-oscillatory synchronized states as well as an incoherent state: There are regions of two-state as well as an interesting and hitherto unexplored three-state coexistence arising from asymmetric interactions in our model.


title: Decentralized Composite Optimization with Compression

abstract: Decentralized optimization and communication compression have exhibited their great potential in accelerating distributed machine learning by mitigating the communication bottleneck in practice. While existing decentralized algorithms with communication compression mostly focus on the problems with only smooth components, we study the decentralized stochastic composite optimization problem with a potentially non-smooth component. A \underline{Prox}imal gradient \underline{L}in\underline{EA}r convergent \underline{D}ecentralized algorithm with compression, Prox-LEAD, is proposed with rigorous theoretical analyses in the general stochastic setting and the finite-sum setting. Our theorems indicate that Prox-LEAD works with arbitrary compression precision, and it tremendously reduces the communication cost almost for free. The superiorities of the proposed algorithms are demonstrated through the comparison with state-of-the-art algorithms in terms of convergence complexities and numerical experiments. Our algorithmic framework also generally enlightens the compressed communication on other primal-dual algorithms by reducing the impact of inexact iterations, which might be of independent interest.


title: An empirical investigation into audio pipeline approaches for classifying bird species

abstract: This paper is an investigation into aspects of an audio classification pipeline that will be appropriate for the monitoring of bird species on edges devices. These aspects include transfer learning, data augmentation and model optimization. The hope is that the resulting models will be good candidates to deploy on edge devices to monitor bird populations. Two classification approaches will be taken into consideration, one which explores the effectiveness of a traditional Deep Neural Network(DNN) and another that makes use of Convolutional layers.This study aims to contribute empirical evidence of the merits and demerits of each approach.


title: Unidirectional output from a quantum-dot single-photon source hybrid integrated on silicon

abstract: We report a quantum-dot single-photon source (QD SPS) hybrid integrated on a silicon waveguide embedding a photonic crystal mirror, which reflects photons and enables efficient unidirectional output from the waveguide. The silicon waveguide is constituted of a subwavelength grating so as to maintain the high efficiency even under the presence of stacking misalignment accompanied by hybrid integration processes. Experimentally, we assembled the hybrid photonic structure by transfer printing, and demonstrated single-photon generation from a QD and its unidirectional output from the waveguide. These results point out a promising approach toward scalable integration of SPSs on silicon quantum photonics platforms.


title: Downlink Performance Enhancement of High Velocity Users in 5G Networks by Configuring Antenna System

abstract: A limitation of bandwidth in the wireless network and the exponential rise in the high data rate requirement prompted the development of Massive Multiple-Input-Multiple-Output (MIMO) technique in 5G. Using this method the ever rising data rate can be met with the increment of the number of antennas. This comes at the price of energy consumption of higher amount, complex network setups and maintenance. Moreover a high-velocity user experiences unpredictable fluctuations in the channel condition that deteriorates the downlink performance. Therefore a proper number of antenna selection is of paramount importance. This issue has been addressed using different categories of algorithms but only for static users. In this study we proffer to implement antenna diversity in closed loop spatial multiplexing MIMO transmission scheme by operating more number of reception antennas than the number of transmission antennas for ameliorating the downlink performance of high-velocity users in case of single user MIMO technology. In general our results can be interpreted for large scale antenna systems like Massive MIMO even though a 4x4 MIMO system has been executed to carry out this study here. Additionally it shows great prospects for solving practical life problems like low data rate and call drops during handover to be experienced by cellular users traveling by high-speed transportation systems like Dhaka Metro Rail. The cell edge users are anticipated to get benefits from this method in case of SU-MIMO technology. The proposed method is expected to be easily implemented in the existing network structures with nominal difficulties.


title: High Quality Related Search Query Suggestions using Deep Reinforcement Learning

abstract: "High Quality Related Search Query Suggestions" task aims at recommending search queries which are real, accurate, diverse, relevant and engaging. Obtaining large amounts of query-quality human annotations is expensive. Prior work on supervised query suggestion models suffered from selection and exposure bias, and relied on sparse and noisy immediate user-feedback (e.g., clicks), leading to low quality suggestions. Reinforcement Learning techniques employed to reformulate a query using terms from search results, have limited scalability to large-scale industry applications. To recommend high quality related search queries, we train a Deep Reinforcement Learning model to predict the query a user would enter next. The reward signal is composed of long-term session-based user feedback, syntactic relatedness and estimated naturalness of generated query. Over the baseline supervised model, our proposed approach achieves a significant relative improvement in terms of recommendation diversity (3%), down-stream user-engagement (4.2%) and per-sentence word repetitions (82%).


title: Method Towards CVPR 2021 Image Matching Challenge

abstract: This report describes Megvii-3D team's approach towards CVPR 2021 Image Matching Workshop.


title: CPNet: Cross-Parallel Network for Efficient Anomaly Detection

abstract: Anomaly detection in video streams is a challenging problem because of the scarcity of abnormal events and the difficulty of accurately annotating them. To alleviate these issues, unsupervised learning-based prediction methods have been previously applied. These approaches train the model with only normal events and predict a future frame from a sequence of preceding frames by use of encoder-decoder architectures so that they result in small prediction errors on normal events but large errors on abnormal events. The architecture, however, comes with the computational burden as some anomaly detection tasks require low computational cost without sacrificing performance. In this paper, Cross-Parallel Network (CPNet) for efficient anomaly detection is proposed here to minimize computations without performance drops. It consists of N smaller parallel U-Net, each of which is designed to handle a single input frame, to make the calculations significantly more efficient. Additionally, an inter-network shift module is incorporated to capture temporal relationships among sequential frames to enable more accurate future predictions.The quantitative results show that our model requires less computational cost than the baseline U-Net while delivering equivalent performance in anomaly detection.


title: Searching for Multi-Fault Programs in Defects4J

abstract: Defects4J has enabled numerous software testing and debugging research work since its introduction. A large part of its contribution, and the resulting popularity, lies in the clear separation and distillation of the root cause of each individual test failure based on careful manual analysis, which in turn allowed researchers to easily study individual faults in isolation. However, in a realistic debugging scenario, multiple faults can coexist and affect test results collectively. Study of automated debugging techniques for these situations, such as failure clustering or fault localisation for multiple faults, would significantly benefit from a reliable benchmark of multiple, coexisting faults. We search for versions of Defects4J subjects that contain multiple faults, by iteratively transplanting fault-revealing test cases across Defects4J versions. Out of 326 studied versions of Defects4J subjects, we report that over 95% (311 versions) actually contain from two to 24 faults. We hope that the extended, multi-fault Defects4J can provide a platform for future research of testing and debugging techniques for multi-fault programs.


abstract: The defect detection task can be regarded as a realistic scenario of object detection in the computer vision field and it is widely used in the industrial field. Directly applying vanilla object detector to defect detection task can achieve promising results, while there still exists challenging issues that have not been solved. The first issue is the texture shift which means a trained defect detector model will be easily affected by unseen texture, and the second issue is partial visual confusion which indicates that a partial defect box is visually similar with a complete box. To tackle these two problems, we propose a Reference-based Defect Detection Network (RDDN). Specifically, we introduce template reference and context reference to against those two problems, respectively. Template reference can reduce the texture shift from image, feature or region levels, and encourage the detectors to focus more on the defective area as a result. We can use either well-aligned template images or the outputs of a pseudo template generator as template references in this work, and they are jointly trained with detectors by the supervision of normal samples. To solve the partial visual confusion issue, we propose to leverage the carried context information of context reference, which is the concentric bigger box of each region proposal, to perform more accurate region classification and regression. Experiments on two defect detection datasets demonstrate the effectiveness of our proposed approach.


title: Tropical precipitation clusters as islands on a rough water-vapor topography

abstract: Tropical precipitation clusters exhibit power-law frequency distributions in area and volume (integrated precipitation), implying a lack of characteristic scale in tropical convective organization. However, it remains unknown what gives rise to the power laws and how the power-law exponents for area and volume are related to one another. Here, we explore the perspective that precipitation clusters are islands above a convective threshold on a rough column-water-vapor (CWV) topography. This perspective is supported by the agreement between the precipitation clusters and CWV islands in their frequency distributions as well as fractal dimensions. Power laws exist for CWV islands at different thresholds through the CWV topography, suggesting that the existence of power-laws is not specifically related to local precipitation dynamics, but is rather a general feature of CWV islands. Furthermore, the frequency distributions and fractal dimensions of the clusters can be reproduced when the CWV field is modeled to be self-affine with a roughness exponent of 0.3. Self-affine scaling theory relates the statistics of precipitation clusters to the roughness exponent; it also relates the power-law slopes for area and volume without involving the roughness exponent. Thus, the perspective of precipitation clusters as CWV islands provides a useful framework to consider many statistical properties of the precipitation clusters, particularly given that CWV is well-observed over a wide range of length scales in the tropics. However, the statistics of CWV islands at the convective threshold imply a smaller roughness than is inferred from the power spectrum of the bulk CWV field, and further work is needed to understand the scaling of the CWV field.


title: A Tight Analysis of Slim Heaps and Smooth Heaps

abstract: The smooth heap and the closely related slim heap are recently invented self-adjusting implementations of the heap (priority queue) data structure. We analyze the efficiency of these data structures. We obtain the following amortized bounds on the time per operation: $O(1)$ for make-heap, insert, find-min, and meld; $O(\log\log n)$ for decrease-key; and $O(\log n)$ for delete-min and delete, where $n$ is the current number of items in the heap. These bounds are tight not only for smooth and slim heaps but for any heap implementation in Iacono and \"{O}zkan's pure heap model, intended to capture all possible "self-adjusting" heap implementations. Slim and smooth heaps are the first known data structures to match Iacono and \"{O}zkan's lower bounds and to satisfy the constraints of their model. Our analysis builds on Pettie's insights into the efficiency of pairing heaps, a classical self-adjusting heap implementation.


title: On the circular numerical range of 5-by-5 partial isometries

abstract: We prove, in some cases in term of kippenhahn curve, that if 5-by-5 partial isometry whose numerical range is a circular disc then its center is must be the origin. This gives a partial affirmative answer of the Conjecture 5.1. of [H. l. Gau et al., Linear and Multilinear Algebra, 64 (1) 2016, 14--35.], for the five dimensional case.


title: Contiguous Hetero-structures & Co-existing Morphological Derivatives of Preferentially Grown Carbo-nitrides in Long Term Aged SS 316LN with Varying Nitrogen Concentration

abstract: To assess long-term structural integrity under operational conditions in nuclear reactors, SS 316LN with varying nitrogen content is subjected to thermal aging for 20000 hours at 650{\deg}C. While the annealing twins and heterogeneous grain evolution by bimodal division are independent of chemical composition, the type, size and morphology of evolving secondary phases are characteristic for nitrogen concentration. Colour contrast in bright field optical microscopy combined with transmission electron microscopy reveals the presence of three major precipitate phases; M23(C, N)6, Fe2Mo intermetallics and Cr2N. Contiguously formed hetero-structures of Fe2Mo and Cr2N are quantified and extensive formation has been observed in steels with high nitrogen content (0.14 wt. % and 0.22 wt. %). A unique occurrence of morphological derivatives of intra-granular M23(C, N)6 precipitates with cube-on-cube orientation relationship such as (1) isolated cubes, (2) primary stringers/strings of cubes, (3) secondary stringers/clusters of branched primary strings, and (4) clusters of laths are identified. The stringers and laths are preferentially grown in{111}/<110>{\gamma} and have crystallographic variants. The conclusions are drawn from bright field colour contrast optical micrographs in the present study demonstrate the potential of light optical microscopy to be used as a significant tool to efficiently and accurately process huge amount of data including the preferential growth planes/directions ({111}/<110>) of morphological derivatives of M23(C, N)6 precipitates, by analyzing the symmetry and dense planes/directions of secondary phases. Overall mechanical properties have been reformed by the precipitation strengthening effect arising from the excess nitrogen content.


title: 2D Surface Brightness Modelling of Large 2MASS Galaxies I: Photometry and Structural Parameters

abstract: We have studied a sample of 101 bright 2MASS galaxies from the Large Galaxy Atlas (LGA), whose morphologies span from early to late-types. We have generated estimates for structural parameters through a two-dimensional (2D) surface brightness photometric decomposition in the three 2MASS bands (J, H, Ks). This work represents a detailed multi-component photometric study of nearby galaxies. We report total magnitudes, effective radii, concentration indices, among other parameters, in the three 2MASS bands. We found that the integrated total magnitudes of early-type galaxies (ETGs) measured on 2MASS LGA mosaics are ~0.35 mag dimmer, when compared with images generated from IRSA image tiles service; nevertheless, when comparing late-type galaxies (LTGs) we did not find any difference. Therefore, for ETGs we present the results derived on IRSA image tiles, while for LTGs we used data from the LGA mosaics. Additionally, by combining these structural parameters with scaling relations and kinematic data, we separated classical bulges from pseudobulges. We found that ~40 % of the objects in our sample are classified as pseudobulges, which are found preferentially in LTGs. Also, our findings confirm trends reported earlier in the distributions for some physical parameters, such as S\'ersic index, B/T and q ratios. In general, our results are in agreement with previous one-dimensional studies. In a companion paper, we revise some of the scaling relations among global galaxy properties, as well as their interrelation with Supermassive Black Holes.


title: Deep Reinforcement Learning for Demand Driven Services in Logistics and Transportation Systems: A Survey

abstract: Recent technology development brings the booming of numerous new Demand-Driven Services (DDS) into urban lives, including ridesharing, on-demand delivery, express systems and warehousing. In DDS, a service loop is an elemental structure, including its service worker, the service providers and corresponding service targets. The service workers should transport either humans or parcels from the providers to the target locations. Various planning tasks within DDS can thus be classified into two individual stages: 1) Dispatching, which is to form service loops from demand/supply distributions, and 2)Routing, which is to decide specific serving orders within the constructed loops. Generating high-quality strategies in both stages is important to develop DDS but faces several challenging. Meanwhile, deep reinforcement learning (DRL) has been developed rapidly in recent years. It is a powerful tool to solve these problems since DRL can learn a parametric model without relying on too many problem-based assumptions and optimize long-term effect by learning sequential decisions. In this survey, we first define DDS, then highlight common applications and important decision/control problems within. For each problem, we comprehensively introduce the existing DRL solutions. We also introduce open simulation environments for development and evaluation of DDS applications. Finally, we analyze remaining challenges and discuss further research opportunities in DRL solutions for DDS.


title: High order well-balanced asymptotic preserving finite difference WENO schemes for the shallow water equations in all Froude numbers

abstract: In this paper, high order semi-implicit well-balanced and asymptotic preserving finite difference WENO schemes are proposed for the shallow water equations with a non-flat bottom topography. We consider the Froude number ranging from O(1) to 0, which in the zero Froude limit becomes the "lake equations" for balanced flow without gravity waves. We apply a well-balanced finite difference WENO reconstruction, coupled with a stiffly accurate implicit-explicit (IMEX) Runge-Kutta time discretization. The resulting semi-implicit scheme can be shown to be well-balanced, asymptotic preserving (AP) and asymptotically accurate (AA) at the same time. Both one- and two-dimensional numerical results are provided to demonstrate the high order accuracy, AP property and good performance of the proposed methods in capturing small perturbations of steady state solutions.


title: Distributionally robust goal-reaching optimization in the presence of background risk

abstract: In this paper, we examine the effect of background risk on portfolio selection and optimal reinsurance design under the criterion of maximizing the probability of reaching a goal. Following the literature, we adopt dependence uncertainty to model the dependence ambiguity between financial risk (or insurable risk) and background risk. Because the goal-reaching objective function is non-concave, these two problems bring highly unconventional and challenging issues for which classical optimization techniques often fail. Using quantile formulation method, we derive the optimal solutions explicitly. The results show that the presence of background risk does not alter the shape of the solution but instead changes the parameter value of the solution. Finally, numerical examples are given to illustrate the results and verify the robustness of our solutions.


title: Industrial Digital Twins at the Nexus of NextG Wireless Networks and Computational Intelligence: A Survey

abstract: By amalgamating recent communication and control technologies, computing and data analytics techniques, and modular manufacturing, Industry~4.0 promotes integrating cyber-physical worlds through cyber-physical systems (CPS) and digital twin (DT) for monitoring, optimization, and prognostics of industrial processes. A DT is an emerging but conceptually different construct than CPS. Like CPS, DT relies on communication to create a highly-consistent, synchronized digital mirror image of the objects or physical processes. DT, in addition, uses built-in models on this precise image to simulate, analyze, predict, and optimize their real-time operation using feedback. DT is rapidly diffusing in the industries with recent advances in the industrial Internet of things (IIoT), edge and cloud computing, machine learning, artificial intelligence, and advanced data analytics. However, the existing literature lacks in identifying and discussing the role and requirements of these technologies in DT-enabled industries from the communication and computing perspective. In this article, we first present the functional aspects, appeal, and innovative use of DT in smart industries. Then, we elaborate on this perspective by systematically reviewing and reflecting on recent research in next-generation (NextG) wireless technologies (e.g., 5G and beyond networks), various tools (e.g., age of information, federated learning, data analytics), and other promising trends in networked computing (e.g., edge and cloud computing). Moreover, we discuss the DT deployment strategies at different industrial communication layers to meet the monitoring and control requirements of industrial applications. We also outline several key reflections and future research challenges and directions to facilitate industrial DT's adoption.


title: Method Towards CVPR 2021 SimLocMatch Challenge

abstract: This report describes Megvii-3D team's approach towards SimLocMatch Challenge @ CVPR 2021 Image Matching Workshop.


title: Collimation and finite-size effects in suspended resonant guided-mode gratings

abstract: The optical transmission of resonant guided-mode gratings patterned on suspended silicon nitride thin films and illuminated at normal incidence with a Gaussian beam are investigated both experimentally and theoretically. Effects due to the beam focusing and its finite size are accounted for by a phenomenological coupled mode model whose predictions are found to be in very good agreement with the experimentally measured spectra for various grating structures and beam sizes, and which allow for a detailed analysis of the respective magnitude of these effects. These results are highly relevant for the design and optimization of such suspended structured films which are widely used for photonics, sensing and optomechanics applications.


title: End-to-End User Behavior Retrieval in Click-Through RatePrediction Model

abstract: Click-Through Rate (CTR) prediction is one of the core tasks in recommender systems (RS). It predicts a personalized click probability for each user-item pair. Recently, researchers have found that the performance of CTR model can be improved greatly by taking user behavior sequence into consideration, especially long-term user behavior sequence. The report on an e-commerce website shows that 23\% of users have more than 1000 clicks during the past 5 months. Though there are numerous works focus on modeling sequential user behaviors, few works can handle long-term user behavior sequence due to the strict inference time constraint in real world system. Two-stage methods are proposed to push the limit for better performance. At the first stage, an auxiliary task is designed to retrieve the top-$k$ similar items from long-term user behavior sequence. At the second stage, the classical attention mechanism is conducted between the candidate item and $k$ items selected in the first stage. However, information gap happens between retrieval stage and the main CTR task. This goal divergence can greatly diminishing the performance gain of long-term user sequence. In this paper, inspired by Reformer, we propose a locality-sensitive hashing (LSH) method called ETA (End-to-end Target Attention) which can greatly reduce the training and inference cost and make the end-to-end training with long-term user behavior sequence possible. Both offline and online experiments confirm the effectiveness of our model. We deploy ETA into a large-scale real world E-commerce system and achieve extra 3.1\% improvements on GMV (Gross Merchandise Value) compared to a two-stage long user sequence CTR model.


title: Component Actions of Liberated $\mathcal{N} = 1$ Supergravity and New Fayet-Iliopoulos Terms in Superconformal Tensor Calculus

abstract: We explicitly compute the component action of certain recently discovered new $\mathcal{N} = 1$ supergravity actions which enlarge the space of scalar potentials allowed by supersymmetry and also contain fermionic interaction terms that become singular when supersymmetry is unbroken. They are the "Liberated Supergravity" introduced by Farakos, Kehagias and Riotto, and supergravities with a new Kahler-invariant Fayet-Iliopoulos term proposed by Antoniadis, Chatrabhuti, Isono, and Knoops. This paper is complementary to our previous papers [Phys. Rev. D 103 (2021), 025008 and 105006], in which new constraints on the coupling constants of those new theories were found. In this paper we spell out many details that were left out of our previous papers.


title: The Science Alert Generation system of the Cherenkov Telescope Array Observatory

abstract: The Cherenkov Telescope Array (CTA) Observatory, with dozens of telescopes located in both the Northern and Southern Hemispheres, will be the largest ground-based gamma-ray observatory and will provide broad energy coverage from 20 GeV to 300 TeV. The large effective area and field-of-view, coupled with the fast slewing capability and unprecedented sensitivity, make CTA a crucial instrument for the future of ground-based gamma-ray astronomy. To maximise the scientific return, the array will send alerts on transients and variable phenomena (e.g. gamma-ray burst, active galactic nuclei, gamma-ray binaries, serendipitous sources). Rapid and effective communication to the community requires a reliable and automated system to detect and issue candidate science alerts. This automation will be accomplished by the Science Alert Generation (SAG) pipeline, a key system of the CTA Observatory. SAG is part of the Array Control and Data Acquisition (ACADA) working group. The SAG working group develops the pipelines to perform data reconstruction, data quality monitoring, science monitoring and real-time alert issuing during observations to the Transients Handler functionality of ACADA. SAG is the system that performs the first real-time scientific analysis after the data acquisition. The system performs analysis on multiple time scales (from seconds to hours). \abrb{SAG must issue candidate science alerts within} 20 seconds from the data taking and with sensitivity at least half of the CTA nominal sensitivity. These challenging requirements must be fulfilled by managing trigger rates of tens of kHz from the arrays. Dedicated and highly optimised software and hardware architecture must thus be designed and tested. In this work, we present the general architecture of the ACADA-SAG system.


title: Gas and dust from extremely metal-poor AGB stars

abstract: We study the evolution of extremely metal-poor AGB stars, with metallicities down to [Fe/H]=-5, to understand the main evolutionary properties, the efficiency of the processes able to alter their surface chemical composition and to determine the gas and dust yields. We calculate two sets of evolutionary sequences of stars in the 1-7.5Msun mass range, evolved from the pre-main sequence to the end of the AGB phase. To explore the extremely metal-poor chemistries we adopted the metallicities Z=3x10^{-5} and Z=3x10^{-7} which correspond, respectively to [Fe/H]=-3 and [Fe/H]=-5. The results from stellar evolution modelling are used to calculate the yields of the individual chemical species. We also modelled dust formation in the wind, to determine the dust produced by these objects. The evolution of AGB stars in the extremely metal-poor domain explored here proves tremendously sensitive to the initial mass of the star. M<2Msun stars experience several third dredge-up events, which favour the gradual surface enrichment of C12 and the formation of significant quantities of carbonaceous dust, of the order of 0.01Msun. The C13 and nitrogen yiel are found to be significantly smaller than in previous explorations of low-mass, metal-poor AGB stars, owing to the weaker proton ingestion episodes experienced during the initial AGB phases. M>5Msun stars experience hot bottom burning and their surface chemistry reflects the equilibria of a very advanced proton-capture nucleosynthesis; little dust production takes place in their wind. Intermediate mass stars experience both third dredge-up and hot bottom burning: they prove efficient producers of nitrogen, which is formed by proton captures on C12 nuclei of primary origin dredged-up from the internal regions.


title: Non-Boussinesq convection at low Prandtl numbers relevant to the Sun

abstract: Convection in the Sun occurs at Rayleigh numbers, $Ra$, as high as $10^{22}$, molecular Prandtl numbers, $Pr$, as low as $10^{-6}$, under conditions that are far from satisfying the Oberbeck-Boussinesq (OB) idealization. The effects of these extreme circumstances on turbulent heat transport are unknown, and no comparable conditions exist on Earth. Our goal is to understand how these effects scale (since we cannot yet replicate the Sun's conditions faithfully). We study thermal convection by using direct numerical simulations, and determine the variation with respect to $Pr$, to values as low as $10^{-4}$, of the turbulent Prandtl number, $Pr_t$, which is the ratio of turbulent viscosity to thermal diffusivity. The simulations are primarily two-dimensional but we draw upon some three-dimensional results as well. We focus on non-Oberbeck-Boussinesq (NOB) conditions of a certain type, but also study OB convection for comparison. The OB simulations are performed in a rectangular box of aspect ratio 2 by varying $Pr$ from $O(10)$ to $10^{-4}$ at fixed Grashof number $Gr \equiv Ra/Pr = 10^9$. The NOB simulations are done in the same box by letting only the thermal diffusivity depend on the temperature. Here, the Rayleigh number is fixed at the top boundary while the mean $Pr$ varies in the bulk from 0.07 to $5 \times 10^{-4}$. The three-dimensional simulations are performed in a box of aspect ratio 25 at a fixed Rayleigh number of $10^5$, and $0.005 \leq Pr \leq 7$. The principal finding is that $Pr_t$ increases with decreasing $Pr$ in both OB and NOB convection: $Pr_t \sim Pr^{-0.3}$ for OB convection and $Pr_t \sim Pr^{-1}$ for the NOB case. The $Pr_t$-dependence for the NOB case especially suggests that convective flows in the astrophysical settings behave effectively as in high-Prandtl-number turbulence.


title: Site-selective magnetic moment collapse in compressed Fe5O6

abstract: Iron oxide is one of the most important components in Earth's mantle. Recent discovery of the stable presence of Fe5O6 at Earth's mantle environment stimulates significant interests in the understanding of this new category of iron oxides. In this paper, we report the electronic structure and magnetic properties of Fe5O6 calculated by the density functional theory plus dynamic mean field theory (DFT+DMFT) approach. Our calculations indicate that Fe5O6 is a conductor at the ambient pressure with dominant Fe-3d density of states at the Fermi level. The magnetic moments of iron atoms at three non-equivalent crystallographic sites in Fe5O6 collapse at significantly different rate under pressure. Such site-selective collapse of magnetic moments originates from the shifting of energy levels and the consequent charge transfer among the Fe-3d orbits when Fe5O6 is being compressed. Our simulations suggest that there could be high conductivity and volume contraction in Fe5O6 at high pressure, which may induce anomalous features in seismic velocity, energy exchange, and mass distribution at the deep interior of Earth.


title: Observational effects of banded repeating FRBs

abstract: Recent observations have shown that repeating Fast Radio Bursts (FRBs) exhibit band-limited emission, whose frequency-dependent amplitude can be modeled using a Gaussian function. In this analysis, we show that banded emission of FRBs can lead to incompleteness across the observing band. This biases the detected sample of bursts and can explain the various shapes of cumulative energy distributions seen for repeating FRBs. We assume a Gaussian shape of the burst spectra and used simulations to demonstrate the above bias using an FRB 121102-like example. We recovered energy distributions that showed a break in power-law and flattening of power-law at low energies, based on the fluence threshold of the observations. We provide recommendations for single-pulse searches and analysis of repeating FRBs to account for this incompleteness. Primarily, we recommend that burst spectra should be modeled to estimate the intrinsic fluence and bandwidth of the burst robustly. Also, bursts that lie mainly within the observing band should be used for analyses of energy distributions. We show that the bimodality reported in the distribution of energies of FRB 121102 by Li et al. (2021) disappears when burst bandwidth, instead of the center frequency of the observation, is used to estimate energy. Sub-banded searches will also aid in detecting band-limited bursts. All the analysis scripts used in this work are available in a Github repository.


title: Localized Graph Collaborative Filtering

abstract: User-item interactions in recommendations can be naturally de-noted as a user-item bipartite graph. Given the success of graph neural networks (GNNs) in graph representation learning, GNN-based C methods have been proposed to advance recommender systems. These methods often make recommendations based on the learned user and item embeddings. However, we found that they do not perform well wit sparse user-item graphs which are quite common in real-world recommendations. Therefore, in this work, we introduce a novel perspective to build GNN-based CF methods for recommendations which leads to the proposed framework Localized Graph Collaborative Filtering (LGCF). One key advantage of LGCF is that it does not need to learn embeddings for each user and item, which is challenging in sparse scenarios. Alternatively, LGCF aims at encoding useful CF information into a localized graph and making recommendations based on such graph. Extensive experiments on various datasets validate the effectiveness of LGCF especially in sparse scenarios. Furthermore, empirical results demonstrate that LGCF provides complementary information to the embedding-based CF model which can be utilized to boost recommendation performance.


title: SP-GAN: Sphere-Guided 3D Shape Generation and Manipulation

abstract: We present SP-GAN, a new unsupervised sphere-guided generative model for direct synthesis of 3D shapes in the form of point clouds. Compared with existing models, SP-GAN is able to synthesize diverse and high-quality shapes with fine details and promote controllability for part-aware shape generation and manipulation, yet trainable without any parts annotations. In SP-GAN, we incorporate a global prior (uniform points on a sphere) to spatially guide the generative process and attach a local prior (a random latent code) to each sphere point to provide local details. The key insight in our design is to disentangle the complex 3D shape generation task into a global shape modeling and a local structure adjustment, to ease the learning process and enhance the shape generation quality. Also, our model forms an implicit dense correspondence between the sphere points and points in every generated shape, enabling various forms of structure-aware shape manipulations such as part editing, part-wise shape interpolation, and multi-shape part composition, etc., beyond the existing generative models. Experimental results, which include both visual and quantitative evaluations, demonstrate that our model is able to synthesize diverse point clouds with fine details and less noise, as compared with the state-of-the-art models.


title: Metallic nature and site-selective magnetic collapse in iron oxide Fe4O5 at the extreme conditions of Earth's deep interior

abstract: Properties of iron oxides at the extreme conditions are of essential importance in condensed matter physics and Geophysics. The recent discovery of a new type of iron oxide, Fe4O5, at high pressure and high temperature of Earth's deep interior attracts great interests. In this paper, we report the electronic structure and the magnetic properties of Fe4O5 predicted by the density functional theory plus dynamic mean field theory (DFT+DMFT) approach. We find that Fe4O5 stays metallic from ambient pressure to high pressure. The magnetic moments of iron atoms at the three different crystallographic positions of Fe4O5 undergo position-dependent collapse as being compressed. Such site-selective magnetic moment collapse originates from the shift of energy levels and the consequent charge transfer among the Fe-3d orbits under compression.


title: Probing anomalous $\gamma\gamma\gamma Z$ couplings through $\gamma Z$ production in $\gamma\gamma$ collisions at the CLIC

abstract: We have estimated the sensitivity to the anomalous couplings of the $\gamma\gamma\gamma Z$ vertex in the $\gamma\gamma\rightarrow\gamma Z$ scattering of the Compton backscattered photons at the CLIC. Both polarized and unpolarized collisions at the $e^+e^-$ energies 1500 GeV and 3000 GeV are addressed, and anomalous contributions to helicity amplitudes are derived. The differential and total cross sections are calculated. We have obtained 95\% C.L. exclusion limits on the anomalous quartic gauge couplings (QGCs). They are compared with corresponding bounds derived for the $\gamma\gamma\gamma Z$ couplings via $\gamma Z$ production at the LHC. The constraints on the anomalous QGCs are one to two orders of magnitude more stringent that at the HL-LHC. The partial-wave unitarity constraints on the anomalous couplings are examined. It is shown that the unitarity is not violated in the region of the anomalous QGCs studied in the paper.


title: Scalable Reverse Image Search Engine for NASAWorldview

abstract: Researchers often spend weeks sifting through decades of unlabeled satellite imagery(on NASA Worldview) in order to develop datasets on which they can start conducting research. We developed an interactive, scalable and fast image similarity search engine (which can take one or more images as the query image) that automatically sifts through the unlabeled dataset reducing dataset generation time from weeks to minutes. In this work, we describe key components of the end to end pipeline. Our similarity search system was created to be able to identify similar images from a potentially petabyte scale database that are similar to an input image, and for this we had to break down each query image into its features, which were generated by a classification layer stripped CNN trained in a supervised manner. To store and search these features efficiently, we had to make several scalability improvements. To improve the speed, reduce the storage, and shrink memory requirements for embedding search, we add a fully connected layer to our CNN make all images into a 128 length vector before entering the classification layers. This helped us compress the size of our image features from 2048 (for ResNet, which was initially tried as our featurizer) to 128 for our new custom model. Additionally, we utilize existing approximate nearest neighbor search libraries to significantly speed up embedding search. Our system currently searches over our entire database of images at 5 seconds per query on a single virtual machine in the cloud. In the future, we would like to incorporate a SimCLR based featurizing model which could be trained without any labelling by a human (since the classification aspect of the model is irrelevant to this use case).


title: Predicting the Last Zero before an exponential time of a Spectrally Negative L\'evy Process

abstract: Given a spectrally negative L\'evy process, we predict, in a $L_1$ sense, the last passage time of the process below zero before an independent exponential time. This optimal prediction problem generalises Baurdoux and Pedraza (2020) where the infinite horizon problem is solved. Using a similar argument as that in Urusov (2005), we show that this optimal prediction problem is equivalent to solving an optimal prediction problem in a finite horizon setting. Surprisingly (unlike the infinite horizon problem) an optimal stopping time is based on a curve that is killed at the moment the mean of the exponential time is reached. That is, an optimal stopping time is the first time the process crosses above a non-negative, continuous and non-increasing curve depending on time. This curve and the value function are characterised as a solution of a system of non-linear integral equations which can be understood as a generalisation of the free boundary equations (see e.g. Peskir and Shiryaev (2006) Chapter IV.14.1) in the presence of jumps. As an example, we calculate numerically such curve in the Brownian motion case and a compound Poisson process with exponential sized jumps perturbed by a Brownian motion.


title: One-Loop Correction to The Casimir Energy in Lifshitz-Like Theory

abstract: In the present article, Radiative Correction (RC) to the Casimir energy was computed for the self-interacting massive/massless Lifshitz-like scalar field, confined between a pair of plates with Dirichlet and Mixed boundary conditions in $3+1$ dimensions. Moreover, using the results obtained for the Dirichlet Casimir energy, the RC to the Casimir energy for Periodic and Neumann boundary conditions were also draw outed. To renormalize the bare parameters of the Lagrangian, a systematic perturbation expansion was used in which the counterterms were automatically obtained in a position-dependent manner. In our view, the position dependency of the counterterm was allowed, since it reflected the effects of the boundary condition imposed or the background space in the problem. All the answers obtained for the Casimir energy were consistent with well-known physical expects. In the language of graphs, the Casimir energy for the massive Lifshitz-like scalar field confined with four boundary conditions (Dirichlet, Neumann, Mixed, and Periodic) was also compared to each other, and as a concluding remark, the sign and magnitude of their values were discussed.


title: Complexity of Inexact Proximal Point Algorithm for minimizing convex functions with Holderian Growth

abstract: Several decades ago the Proximal Point Algorithm (PPA) started to gain a long-lasting attraction for both abstract operator theory and numerical optimization communities. Even in modern applications, researchers still use proximal minimization theory to design scalable algorithms that overcome nonsmoothness. Remarkable works as \cite{Fer:91,Ber:82constrained,Ber:89parallel,Tom:11} established tight relations between the convergence behaviour of PPA and the regularity of the objective function. In this manuscript we derive nonasymptotic iteration complexity of exact and inexact PPA to minimize convex functions under $\gamma-$Holderian growth: $\BigO{\log(1/\epsilon)}$ (for $\gamma \in [1,2]$) and $\BigO{1/\epsilon^{\gamma - 2}}$ (for $\gamma > 2$). In particular, we recover well-known results on PPA: finite convergence for sharp minima and linear convergence for quadratic growth, even under presence of deterministic noise. Moreover, when a simple Proximal Subgradient Method is recurrently called as an inner routine for computing each IPPA iterate, novel computational complexity bounds are obtained for Restarting Inexact PPA. Our numerical tests show improvements over existing restarting versions of the Subgradient Method.