title: Visual Navigation in Real-World Indoor Environments Using End-to-End Deep Reinforcement Learning

abstract: Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing, localization, and planning in one module, which can be trained and therefore optimized for a given environment. However, to date, DRL-based visual navigation was validated exclusively in simulation, where the simulator provides information that is not available in the real world, e.g., the robot's position or image segmentation masks. This precludes the use of the learned policy on a real robot. Therefore, we propose a novel approach that enables a direct deployment of the trained policy on real robots. We have designed visual auxiliary tasks, a tailored reward scheme, and a new powerful simulator to facilitate domain randomization. The policy is fine-tuned on images collected from real-world environments. We have evaluated the method on a mobile robot in a real office environment. The training took ~30 hours on a single GPU. In 30 navigation experiments, the robot reached a 0.3-meter neighborhood of the goal in more than 86.7% of cases. This result makes the proposed method directly applicable to tasks like mobile manipulation.


title: High-Dimensional Bayesian Optimization via Nested Riemannian Manifolds

abstract: Despite the recent success of Bayesian optimization (BO) in a variety of applications where sample efficiency is imperative, its performance may be seriously compromised in settings characterized by high-dimensional parameter spaces. A solution to preserve the sample efficiency of BO in such problems is to introduce domain knowledge into its formulation. In this paper, we propose to exploit the geometry of non-Euclidean search spaces, which often arise in a variety of domains, to learn structure-preserving mappings and optimize the acquisition function of BO in low-dimensional latent spaces. Our approach, built on Riemannian manifolds theory, features geometry-aware Gaussian processes that jointly learn a nested-manifold embedding and a representation of the objective function in the latent space. We test our approach in several benchmark artificial landscapes and report that it not only outperforms other high-dimensional BO approaches in several settings, but consistently optimizes the objective functions, as opposed to geometry-unaware BO methods.


title: Did life originate from low-temperature areas of the Universe?

abstract: The biological molecules delivered to Earth on the board of meteorites and comets were called one of the possible causes of the origin of life. Therefore, our understanding of the routes of formation of biomolecules in space should shed the light on the possibility of the existence of habitable extrasolar planets. The large abundance of organic molecules is found in the space regions with the lowest temperature. Different routes of the organics formation in these areas were suggested. In this article, we demonstrate that complex organic molecules same as important biological molecules can be formed due to the reaction of C atoms with the mantels of molecular ices covering refractory dust grains present in the interstellar medium (ISM). Having four valence electrons, C atoms act as glue joining simple non-organic molecules and converting them into organic matter. The formation of many molecules is barrierless and thus can happen at low temperature. The barrierless reaction C + NH3 + CO -> NH2CHCO attracts particular interest. The product of this reaction is an isomer of the central residue of a peptide chain and expected to be efficiently formed in the translucent molecular clouds. The polymerization of these molecules leads to the formation of proteins that according to some theories are life's first molecules. Considering a high abundance of atomic carbon in the ISM, we expect a high efficiency of the formation of a large variety of different organic molecules, and show why the amount of organic material formed by condensation of atomic carbon may be underestimated.


title: German's Next Language Model

abstract: In this work we present the experiments which lead to the creation of our BERT and ELECTRA based German language models, GBERT and GELECTRA. By varying the input training data, model size, and the presence of Whole Word Masking (WWM) we were able to attain SoTA performance across a set of document classification and named entity recognition (NER) tasks for both models of base and large size. We adopt an evaluation driven approach in training these models and our results indicate that both adding more data and utilizing WWM improve model performance. By benchmarking against existing German models, we show that these models are the best German models to date. Our trained models will be made publicly available to the research community.


title: Analyzing the Source and Target Contributions to Predictions in Neural Machine Translation

abstract: In Neural Machine Translation (and, more generally, conditional language modeling), the generation of a target token is influenced by two types of context: the source and the prefix of the target sequence. While many attempts to understand the internal workings of NMT models have been made, none of them explicitly evaluates relative source and target contributions to a generation decision. We argue that this relative contribution can be evaluated by adopting a variant of Layerwise Relevance Propagation (LRP). Its underlying 'conservation principle' makes relevance propagation unique: differently from other methods, it evaluates not an abstract quantity reflecting token importance, but the proportion of each token's influence. We extend LRP to the Transformer and conduct an analysis of NMT models which explicitly evaluates the source and target relative contributions to the generation process. We analyze changes in these contributions when conditioning on different types of prefixes, when varying the training objective or the amount of training data, and during the training process. We find that models trained with more data tend to rely on source information more and to have more sharp token contributions; the training process is non-monotonic with several stages of different nature.


title: Substitutional VSn nanodispersed in MoS$_2$ film for Pt-scalable catalyst

abstract: Among transition metal dichalcogenides (TMdCs) as alternatives for Pt-based catalysts, metallic-TMdCs catalysts have highly reactive basal-plane but are unstable. Meanwhile, chemically stable semiconducting-TMdCs show limiting catalytic activity due to their inactive basal-plane. Here, we propose metallic vanadium sulfide (VSn) nanodispersed in a semiconducting MoS2 film (V-MoS2) as an efficient catalyst. During synthesis, vanadium atoms are substituted into hexagonal monolayer MoS2 to form randomly distributed VSn units. The V-MoS2 film on a Cu electrode exhibits Pt-scalable catalytic performance; current density of 1000 mA cm-2 at 0.6 V, overpotential of -0.06 V at a current density of 10 mA cm-2 and exchange current density of 0.65 mA cm-2 at 0 V with excellent cycle stability for hydrogen-evolution-reaction (HER). The high intrinsic HER performance of V-MoS2 is explained by the efficient electron transfer from the Cu electrode to chalcogen vacancies near vanadium sites with optimal Gibbs free energy (-0.02 eV). This study adds insight into ways to engineer TMdCs at the atomic-level to boost intrinsic catalytic activity for hydrogen evolution.


title: Do symmetries "explain" conservation laws? The modern converse Noether theorem vs pragmatism

abstract: Noether's first theorem does not establish a one-way explanatory arrow from symmetries to conservation laws, but such an arrow is widely assumed in discussions of the theorem in the physics and philosophy literature. It is argued here that there are pragmatic reasons for privileging symmetries, even if they do not strictly justify explanatory priority. To this end, some practical factors are adduced as to why Noether's direct theorem seems to be more well-known and exploited than its converse, with special attention being given to the sometimes overlooked nature of Noether's converse result and to its strengthened version due to Luis Mart\'inez Alonso in 1979 and Peter Olver in 1986.


title: Complaint Identification in Social Media with Transformer Networks

abstract: Complaining is a speech act extensively used by humans to communicate a negative inconsistency between reality and expectations. Previous work on automatically identifying complaints in social media has focused on using feature-based and task-specific neural network models. Adapting state-of-the-art pre-trained neural language models and their combinations with other linguistic information from topics or sentiment for complaint prediction has yet to be explored. In this paper, we evaluate a battery of neural models underpinned by transformer networks which we subsequently combine with linguistic information. Experiments on a publicly available data set of complaints demonstrate that our models outperform previous state-of-the-art methods by a large margin achieving a macro F1 up to 87.


title: Evidence for bosonic mode coupling in electron dynamics of LiFeAs superconductor

abstract: Super-high resolution laser-based angle-resolved photoemission measurements are carried out on LiFeAs superconductor to investigate its electron dynamics. Three energy scales at $\sim$20 meV, $\sim$34 meV and $\sim$55 meV are revealed for the first time in the electron self-energy both in the superconducting state and normal state. The $\sim$20 meV and $\sim$34 meV scales can be attributed to the coupling of electrons with sharp bosonic modes which are most likely phonons. These observations provide definitive evidence on the existence of mode coupling in iron-based superconductors.


title: A Linear-Time Nominal $\mu$-Calculus with Name Allocation

abstract: Logics and automata models for languages over infinite alphabets, such as Freeze LTL and register automata, serve the verification of processes or documents with data. They relate tightly to formalisms over nominal sets, such as nondetermininistic orbit-finite automata (NOFAs), where names play the role of data. Reasoning problems in such formalisms tend to be computationally hard. Name-binding nominal automata models such as regular nondeterministic nominal automata (RNNAs) have been shown to be computationally more tractable. In the present paper, we introduce a linear-time fixpoint logic Bar-muTL for finite words over an infinite alphabet, which features full negation and freeze quantification via name binding. We show by a nontrivial reduction to extended regular nondeterministic nominal automata that even though Bar-muTL allows unrestricted nondeterminism and unboundedly many registers, model checking Bar-muTL over RNNAs and satisfiability checking both have elementary complexity. For example, model checking is in 2ExpSpace, more precisely in parametrized ExpSpace, effectively with the number of registers as the parameter.


title: Evolutionary Diversity Optimization and the Minimum Spanning Tree Problem

abstract: In the area of evolutionary computation the calculation of diverse sets of high-quality solutions to a given optimization problem has gained momentum in recent years under the term evolutionary diversity optimization. Theoretical insights into the working principles of baseline evolutionary algorithms for diversity optimization are still rare. In this paper we study the well-known Minimum Spanning Tree problem (MST) in the context of diversity optimization where population diversity is measured by the sum of pairwise edge overlaps. Theoretical results provide insights into the fitness landscape of the MST diversity optimization problem pointing out that even for a population of $\mu=2$ fitness plateaus (of constant length) can be reached, but nevertheless diverse sets can be calculated in polynomial time. We supplement our theoretical results with a series of experiments for the unconstrained and constraint case where all solutions need to fulfill a minimal quality threshold. Our results show that a simple $(\mu+1)$-EA can effectively compute a diversified population of spanning trees of high quality.


title: Convergence and supercloseness in a balanced norm of finite element methods on Bakhvalov-type meshes for reaction-diffusion problems

abstract: In convergence analysis of finite element methods for singularly perturbed reaction--diffusion problems, balanced norms have been successfully introduced to replace standard energy norms so that layers can be captured. In this article, we focus on the convergence analysis in a balanced norm on Bakhvalov-type rectangular meshes. In order to achieve our goal, a novel interpolation operator, which consists of a local weighted $L^2$ projection operator and the Lagrange interpolation operator, is introduced for a convergence analysis of optimal order in the balanced norm. The analysis also depends on the stabilities of the $L^2$ projection and the characteristics of Bakhvalov-type meshes. Furthermore, we obtain a supercloseness result in the balanced norm, which appears in the literature for the first time. This result depends on another novel interpolant, which consists of the local weighted $L^2$ projection operator, a vertices-edges-element operator and some corrections on the boundary.


title: Contrastive Learning of General-Purpose Audio Representations

abstract: We introduce COLA, a self-supervised pre-training approach for learning a general-purpose representation of audio. Our approach is based on contrastive learning: it learns a representation which assigns high similarity to audio segments extracted from the same recording while assigning lower similarity to segments from different recordings. We build on top of recent advances in contrastive learning for computer vision and reinforcement learning to design a lightweight, easy-to-implement self-supervised model of audio. We pre-train embeddings on the large-scale Audioset database and transfer these representations to 9 diverse classification tasks, including speech, music, animal sounds, and acoustic scenes. We show that despite its simplicity, our method significantly outperforms previous self-supervised systems. We furthermore conduct ablation studies to identify key design choices and release a library to pre-train and fine-tune COLA models.


title: On the Saturation Phenomenon of Stochastic Gradient Descent for Linear Inverse Problems

abstract: Stochastic gradient descent (SGD) is a promising method for solving large-scale inverse problems, due to its excellent scalability with respect to data size. The current mathematical theory in the lens of regularization theory predicts that SGD with a polynomially decaying stepsize schedule may suffer from an undesirable saturation phenomenon, i.e., the convergence rate does not further improve with the solution regularity index when it is beyond a certain range. In this work, we present a refined convergence rate analysis of SGD, and prove that saturation actually does not occur if the initial stepsize of the schedule is sufficiently small. Several numerical experiments are provided to complement the analysis.


title: Finite volume corrections to forward Compton scattering off the nucleon

abstract: We calculate the spin-averaged amplitude for doubly virtual forward Compton scattering off nucleons in the framework of manifestly Lorentz invariant baryon chiral perturbation theory at complete one-loop order $O(p^4)$. The calculations are carried out both in the infinite and in a finite volume. The obtained results allow for a detailed estimation the finite-volume corrections to the amplitude which can be extracted on the lattice using the background field technique.


title: The entropy based goodness of fit tests for generalized von Mises-Fisher distributions and beyond

abstract: We introduce some new classes of unimodal rotational invariant directional distributions, which generalize von Mises-Fisher distribution. We propose three types of distributions, one of which represents axial data. For each new type we provide formulae and short computational study of parameter estimators by the method of moments and the method of maximum likelihood. The main goal of the paper is to develop the goodness of fit test to detect that sample entries follow one of the introduced generalized von Mises--Fisher distribution based on the maximum entropy principle. We use $k$th nearest neighbour distances estimator of Shannon entropy and prove its $L^2$-consistency. We examine the behaviour of the test statistics, find critical values and compute power of the test on simulated samples. We apply the goodness of fit test to local fiber directions in a glass fibre reinforced composite material and detect the samples which follow axial generalized von Mises--Fisher distribution.


title: Multi-task Metric Learning for Text-independent Speaker Verification

abstract: In this work, we introduce metric learning (ML) to enhance the deep embedding learning for text-independent speaker verification (SV). Specifically, the deep speaker embedding network is trained with conventional cross entropy loss and auxiliary pair-based ML loss function. For the auxiliary ML task, training samples of a mini-batch are first arranged into pairs, then positive and negative pairs are selected and weighted through their own and relative similarities, and finally the auxiliary ML loss is calculated by the similarity of the selected pairs. To evaluate the proposed method, we conduct experiments on the Speaker in the Wild (SITW) dataset. The results demonstrate the effectiveness of the proposed method.


title: Surface critical behaviors of coupled Haldane chains

abstract: The special surface transition at (2+1)-dimensional quantum critical point is precluded in corresponding classical critical point. The mechanism of such behavior which is only found in dimerized Heisenberg models so far is still under debate. To illuminate the role of symmetry protected topological (SPT) phase in inducing such nonordinary behaviors, we study a system on a two-dimensional square lattice consisted by interacting spin-1 Haldane chains, which has a genuine SPT phase--the Haldane phase--at weak interchain interactions and a quantum critical point belonging to the classical 3D O(3) universality class to the N\'eel phase. Different from models studied previously, there is no dimerization in the current model. Cutting the system along the chain direction or perpendicular to the chain direction exposes two different surfaces. Using unbiased quantum Monte Carlo simulations, we find that the two different types of surface show completely different surface critical behaviors at the bulk critical point, resulted from different surface states in the SPT phase. For the system with surfaces along the chain direction, the surface critical behavior is of ordinary type of the bulk 3D O(3) critical point, while for the surfaces perpendicular to the chain direction, the surface critical behavior is nonordinary, consistent with special transitions found in dimerized Heisenberg models. Our numerical results demonstrate that the gapless surface state in the gapped SPT phase together with the gapless mode of critical point is a pure quantum scenario that leads to the nonordinary transition.


title: LemMED: Fast and Effective Neural Morphological Analysis with Short Context Windows

abstract: We present LemMED, a character-level encoder-decoder for contextual morphological analysis (combined lemmatization and tagging). LemMED extends and is named after two other attention-based models, namely Lematus, a contextual lemmatizer, and MED, a morphological (re)inflection model. Our approach does not require training separate lemmatization and tagging models, nor does it need additional resources and tools, such as morphological dictionaries or transducers. Moreover, LemMED relies solely on character-level representations and on local context. Although the model can, in principle, account for global context on sentence level, our experiments show that using just a single word of context around each target word is not only more computationally feasible, but yields better results as well. We evaluate LemMED in the framework of the SIMGMORPHON-2019 shared task on combined lemmatization and tagging. In terms of average performance LemMED ranks 5th among 13 systems and is bested only by the submissions that use contextualized embeddings.


title: Reliability of meta-analysis of an association between ambient air quality and development of asthma later in life

abstract: Claims from observational studies often fail to replicate. A study was undertaken to assess the reliability of cohort studies used in a highly cited meta-analysis of the association between ambient nitrogen dioxide, NO2, and fine particulate matter, PM2.5, concentrations early in life and development of asthma later in life. The numbers of statistical tests possible were estimated for 19 base papers considered for the meta-analysis. A p-value plot for NO2 and PM2.5 was constructed to evaluate effect heterogeneity of p-values used from the base papers. The numbers of statistical tests possible in the base papers were large - median 13,824, interquartile range 1,536-221,184; range 96-42M, in comparison to statistical test results presented. Statistical test results drawn from the base papers are unlikely to provide unbiased measures for meta-analysis. The p-value plot indicated that heterogeneity of the NO2 results across the base papers is consistent with a two-component mixture. First, it makes no sense to average across a mixture in meta-analysis. Second, the shape of the p-value plot for NO2 appears consistent with the possibility of analysis manipulation to obtain small p-values in several of the cohort studies. As for PM2.5, all corresponding p-values fall on a 45-degree line indicating complete randomness rather than a true association. Our interpretation of the meta-analysis is that the random p-values indicating no cause-effect associations are more plausible and that their meta-analysis will not likely replicate in the absence of bias. We conclude that claims made in the base papers used for meta-analysis are unreliable due to bias induced by multiple testing and multiple modelling, MTMM. We also show there is evidence that the heterogeneity across the base papers used for meta-analysis is more complex than simple sampling from a normal process.


title: Attention-based scaling adaptation for target speech extraction

abstract: The target speech extraction has attracted widespread attention in recent years. In this work, we focus on investigating the dynamic interaction between different mixtures and the target speaker to exploit the discriminative target speaker clues. We propose a special attention mechanism without introducing any additional parameters in a scaling adaptation layer to better adapt the network towards extracting the target speech. Furthermore, by introducing a mixture embedding matrix pooling method, our proposed attention-based scaling adaptation (ASA) can exploit the target speaker clues in a more efficient way. Experimental results on the spatialized reverberant WSJ0 2-mix dataset demonstrate that the proposed method can improve the performance of the target speech extraction effectively. Furthermore, we find that under the same network configurations, the ASA in a single-channel condition can achieve competitive performance gains as that achieved from two-channel mixtures with inter-microphone phase difference (IPD) features.


title: Internal Photo Effect from a Single Quantum Emitter

abstract: We demonstrate by time-resolved resonance fluorescence measurements on a single self-assembled quantum dot an internal photo-effect that emits electrons from the dot by an intra-band excitation. We find a linear dependence of the optically generated emission rate on the excitation intensity and use a rate equation model to deduce the involved rates. The emission rate is tunable over several orders of magnitude by adjusting the excitation intensity. Our findings show that a process that is well known in single atom spectroscopy (i.e. photo ionization) can also be observed in the solid state. The results also quantify an important, but mostly neglected, mechanism that may fundamentally limit the coherence times in solid-state quantum optical devices.


title: Metric rigidity of Kahler manifolds with lower Ricci bounds and almost maximal volume

abstract: In this short note we prove that a Kahler manifold with lower Ricci curvature bound and almost maximal volume is Gromov-Hausdorff close to the projective space with the Fubini-Study metric. This is done by combining the recent results of Kewei Zhang and Yuchen Liu on holomorphic rigidity of such Kahler manifolds with the structure theorem of Tian-Wang for almost Einstein manifolds. This can be regarded as the complex analog of the result on Colding on the shape of Riemannian manifolds with almost maximal volume


title: Efficient Similarity-Preserving Unsupervised Learning using Modular Sparse Distributed Codes and Novelty-Contingent Noise

abstract: There is increasing realization in neuroscience that information is represented in the brain, e.g., neocortex, hippocampus, in the form sparse distributed codes (SDCs), a kind of cell assembly. Two essential questions are: a) how are such codes formed on the basis of single trials, and how is similarity preserved during learning, i.e., how do more similar inputs get mapped to more similar SDCs. I describe a novel Modular Sparse Distributed Code (MSDC) that provides simple, neurally plausible answers to both questions. An MSDC coding field (CF) consists of Q WTA competitive modules (CMs), each comprised of K binary units (analogs of principal cells). The modular nature of the CF makes possible a single-trial, unsupervised learning algorithm that approximately preserves similarity and crucially, runs in fixed time, i.e., the number of steps needed to store an item remains constant as the number of stored items grows. Further, once items are stored as MSDCs in superposition and such that their intersection structure reflects input similarity, both fixed time best-match retrieval and fixed time belief update (updating the probabilities of all stored items) also become possible. The algorithm's core principle is simply to add noise into the process of choosing a code, i.e., choosing a winner in each CM, which is proportional to the novelty of the input. This causes the expected intersection of the code for an input, X, with the code of each previously stored input, Y, to be proportional to the similarity of X and Y. Results demonstrating these capabilities for spatial patterns are given in the appendix.


title: An operational characterization of infinite-dimensional quantum resources

abstract: Recently, various non-classical properties of quantum states and channels have been characterized through an advantage they provide in specific quantum information tasks over their classical counterparts. Such advantage can be typically proven to be quantitative, in that larger amounts of quantum resources lead to better performance in the corresponding tasks. So far, these characterizations have been established only in the finite-dimensional setting. In this manuscript, we present a technique for extending the known results to the infinite-dimensional regime. The technique relies on approximating infinite-dimensional resource measures by their finite-dimensional counterparts. We give a sufficient condition for the approximation procedure to be tight, i.e. to match with established infinite-dimensional resource quantifiers, and another sufficient condition for the procedure to match with relevant extensions of these quantifiers. We show that various continuous variable quantum resources fall under these conditions, hence, giving them an operational interpretation through the advantage they can provide in so-called quantum games. Finally, we extend the interpretation to the max relative entropy in the infinite-dimensional setting.


title: Role of ALD Al2O3 surface passivation on the performance of p-type Cu2O thin film transistors

abstract: High-performance p-type oxide thin film transistors (TFTs) have great potential for many semiconductor applications. However, these devices typically suffer from low hole mobility and high off-state currents. We fabricated p-type TFTs with a phase-pure polycrystalline Cu2O semiconductor channel grown by atomic layer deposition (ALD). The TFT switching characteristics were improved by applying a thin ALD Al2O3 passivation layer on the Cu2O channel, followed by vacuum annealing at 300 C. Detailed characterisation by TEM-EDX and XPS shows that the surface of Cu2O is reduced following Al2O3 deposition and indicates the formation of 1-2 nm thick CuAlO2 interfacial layer. This, together with field-effect passivation caused by the high negative fixed charge of the ALD Al2O3, leads to an improvement in the TFT performance by reducing the density of deep trap states as well as by reducing the accumulation of electrons in the semiconducting layer in the device off-state.


title: Temporal Properties of Precursors, Main peaks and Extended Emissions of Short GRBs in the Third Swift/BAT GRB Catalog

abstract: A comprehensive study is given to short gamma-ray bursts (sGRBs) in the third Swift/BAT GRB Catalog from December 2004 to July 2019. We examine in details the temporal properties of the three components in the prompt gamma-ray emission phase, including precursors, main peaks and extended emissions (EE). We investigate the similarity of the main peaks between one-component and two-component sGRBs. It is found that there is no substantial difference among their main peaks. Importantly, comparisons are made between in the single-peaked sGRBs and the double-peaked sGRBs. It is found that our results of main peaks in Swift/BAT sGRBs are essentially consistent with those in CGRO/BATSE ones recently found in our paper I. Interestingly, we suspect, besides the newly-found MODE I/II evolution forms of pulses in BATSE sGRBs in paper I, that there would have more evolution modes of pulses across differently adjacent energy channels in view of the Swift/BAT observations. We further inspect the correlation of the main peaks with either the precursors or the EEs. We find that the main peaks tend to last longer than the precursors but shorter than the EEs. In particular, we verify the power-law correlations related with peak fluxes of the three components, strongly suggesting that they are produced from the similar central engine activities. Especially, we compare the temporal properties of GRB 170817A with other sGRBs with EE and find no obvious differences between them.


title: Towards Distributed Software Resilience in Asynchronous Many-Task Programming Models

abstract: Exceptions and errors occurring within mission critical applications due to hardware failures have a high cost. With the emerging Next Generation Platforms (NGPs), the rate of hardware failures will likely increase. Therefore, designing our applications to be resilient is a critical concern in order to retain the reliability of results while meeting the constraints on power budgets. In this paper, we discuss software resilience in AMTs at both local and distributed scale. We choose HPX to prototype our resiliency designs. We implement two resiliency APIs that we expose to the application developers, namely task replication and task replay. Task replication repeats a task n-times and executes them asynchronously. Task replay reschedules a task up to n-times until a valid output is returned. Furthermore, we expose algorithm based fault tolerance (ABFT) using user provided predicates (e.g., checksums) to validate the returned results. We benchmark the resiliency scheme for both synthetic and real world applications at local and distributed scale and show that most of the added execution time arises from the replay, replication or data movement of the tasks and not the boilerplate code added to achieve resilience.


title: Fingerprinting the fractional order phase transitions in AdS black holes

abstract: In this paper, we have extended and deepened the study on fractional order phase transition (FPT) of a charged AdS black hole performed in [1]. We have carried out a detailed analysis of FPT for several AdS black hole prototypes: black hole surrounded by quintessence background, 5D Gauss-Bonnet, D dimensional RN-AdS BH, and lastly Kerr black holes. We have shown that the 4/3 order FPT at critical points obtained in [1] still holds for the first three black holes systems, while for Kerr black holes, the fractional order is rather 1/3. These results suggest two remarkable features: Firstly 4/3 order phase transition can be assumed for asymptotically AdS black holes spherical solutions, secondly the fractional order is not universal and can be affected by the geometric symmetry.


title: Deep learning-based citation recommendation system for patents

abstract: In this study, we address the challenges in developing a deep learning-based automatic patent citation recommendation system. Although deep learning-based recommendation systems have exhibited outstanding performance in various domains (such as movies, products, and paper citations), their validity in patent citations has not been investigated, owing to the lack of a freely available high-quality dataset and relevant benchmark model. To solve these problems, we present a novel dataset called PatentNet that includes textual information and metadata for approximately 110,000 patents from the Google Big Query service. Further, we propose strong benchmark models considering the similarity of textual information and metadata (such as cooperative patent classification code). Compared with existing recommendation methods, the proposed benchmark method achieved a mean reciprocal rank of 0.2377 on the test set, whereas the existing state-of-the-art recommendation method achieved 0.2073.


title: Complemented subspaces of polynomial ideals

abstract: Given the polynomial ideal $\mathcal{J}\circ\mathcal{P} (^{n}E; F)$, we prove that if $\mathcal{J}\circ\mathcal{P} (^{n}E; F)$ contains an isomorphic copy of $c_{0}$, then $\mathcal{J}\circ\mathcal{P} (^{n}E; F)$ is not complemented in $\mathcal{P} (^{n}E; F)$ for every closed operator ideal $\mathcal{J}\subset \mathcal{L}_{K}$ and every $n\in\mathbb{N}$. Likewise we show that if $\widehat{(\mathcal{J}\circ\mathcal{L})^{fac}}(^{n}E;F)$ contains an isomorphic copy of $c_{0}$, then $\widehat{(\mathcal{J}\circ\mathcal{L})^{fac}}(^{n}E;F)$ is not complemented in $\mathcal{P}(^{n}E; F)$ for every closed operator ideal $\mathcal{J}\subset \mathcal{L}_{K}$ and every $n>1$. When $\mathcal{J}=\mathcal{L}_{K}$, these results generalizes results of several authors \cite{LEW},\cite{EM},\cite{KALTON},\cite{IOANA},\cite{SERGIO}, among others.


title: Optimizing Planning Service Territories by Dividing Into Compact Several Sub-areas Using Binary K-means Clustering According Vehicle Constraints

abstract: VRP (Vehicle Routing Problem) is an NP hard problem, and it has attracted a lot of research interest. In contexts where vehicles have limited carrying capacity, such as volume and weight but needed to deliver items at various locations. Initially before creating a route, each vehicle needs a group of delivery points that are not exceeding their maximum capacity. Drivers tend to deliver only to certain areas. Cluster-based is one of the approaches to give a basis for generating tighter routes. In this paper we propose new algorithms for producing such clusters/groups that do not exceed vehicles maximum capacity. Our basic assumptions are each vehicle originates from a depot, delivers the items to the customers and returns to the depot, also the vehicles are homogeneous. This methods are able to compact sub-areas in each cluster. Computational results demonstrate the effectiveness of our new procedures, which are able to assist users to plan service territories and vehicle routes more efficiently.


title: An Eager Splitting Strategy for Online Decision Trees

abstract: Decision tree ensembles are widely used in practice. In this work, we study in ensemble settings the effectiveness of replacing the split strategy for the state-of-the-art online tree learner, Hoeffding Tree, with a rigorous but more eager splitting strategy that we had previously published as Hoeffding AnyTime Tree. Hoeffding AnyTime Tree (HATT), uses the Hoeffding Test to determine whether the current best candidate split is superior to the current split, with the possibility of revision, while Hoeffding Tree aims to determine whether the top candidate is better than the second best and if a test is selected, fixes it for all posterity. HATT converges to the ideal batch tree while Hoeffding Tree does not. We find that HATT is an efficacious base learner for online bagging and online boosting ensembles. On UCI and synthetic streams, HATT as a base learner outperforms HT within a 0.05 significance level for the majority of tested ensembles on what we believe is the largest and most comprehensive set of testbenches in the online learning literature. Our results indicate that HATT is a superior alternative to Hoeffding Tree in a large number of ensemble settings.


title: Transition to the ultimate regime in a radiatively driven convection experiment

abstract: We report on the transition between two regimes of heat transport in a radiatively driven convection experiment, where a fluid gets heated up within a tunable heating length $\ell$ in the vicinity of the bottom of the tank. The first regime is similar to the one observed in standard Rayleigh-B\'enard experiments, the Nusselt number $Nu$ being related to the Rayleigh number $Ra$ through the power-law $Nu \sim Ra^{1/3}$. The second regime corresponds to the "ultimate" or mixing-length scaling regime of thermal convection, where $Nu$ varies as the square-root of $Ra$. Evidence for these two scaling regimes have been reported in Lepot et al. (Proc. Nat. Acad. Sci. U S A, {\bf 115}, 36, 2018), and we now study in detail how the system transitions from one to the other. We propose a simple model describing radiatively driven convection in the mixing-length regime. \corr{It leads to the scaling relation $Nu \sim \frac{\ell}{H} Pr^{1/2} Ra^{1/2}$,} where $H$ is the height of the cell, thereby allowing us to deduce the values of $Ra$ and $Nu$ at which the system transitions from one regime to the other. These predictions are confirmed by the experimental data gathered at various $Ra$ and $\ell$. \corr{We conclude by showing that boundary layer corrections can persistently modify the Prandtl number dependence of $Nu$ at large $Ra$, for $Pr \gtrsim 1$.


title: The UPC Speaker Verification System Submitted to VoxCeleb Speaker Recognition Challenge 2020 (VoxSRC-20)

abstract: This report describes the submission from Technical University of Catalonia (UPC) to the VoxCeleb Speaker Recognition Challenge (VoxSRC-20) at Interspeech 2020. The final submission is a combination of three systems. System-1 is an autoencoder based approach which tries to reconstruct similar i-vectors, whereas System-2 and -3 are Convolutional Neural Network (CNN) based siamese architectures. The siamese networks have two and three branches, respectively, where each branch is a CNN encoder. The double-branch siamese performs binary classification using cross entropy loss during training. Whereas, our triple-branch siamese is trained to learn speaker embeddings using triplet loss. We provide results of our systems on VoxCeleb-1 test, VoxSRC-20 validation and test sets.


title: What makes multilingual BERT multilingual?

abstract: Recently, multilingual BERT works remarkably well on cross-lingual transfer tasks, superior to static non-contextualized word embeddings. In this work, we provide an in-depth experimental study to supplement the existing literature of cross-lingual ability. We compare the cross-lingual ability of non-contextualized and contextualized representation model with the same data. We found that datasize and context window size are crucial factors to the transferability.


title: Scheduling of Emergency Tasks for Multiservice UAVs in Post-Disaster Scenarios

abstract: Single-task UAVs are increasingly being employed to carry out surveillance, parcel delivery, communication support, and other specific tasks. When the geographical area of operation of single-task missions is common, e.g., in post-disaster recovery scenarios, it is more efficient to have multiple tasks carried out as part of a single UAV mission. In these scenarios, the UAVs' equipment and mission plan must be carefully selected to minimize the carried load and overall resource consumption. In this paper, we investigate the joint planning of multitask missions leveraging a fleet of UAVs equipped with a standard set of accessories enabling heterogeneous tasks. To this end, an optimization problem is formulated yielding the optimal joint planning and deriving the resulting quality of the delivered tasks. In addition, two heuristic solutions are developed for large-scale environments to cope with the increased complexity of the optimization framework. The joint planning is applied to a specific scenario of a flood in the San Francisco area. Results show the effectiveness of the proposed heuristic solutions, which provide good performance and allow for drastic savings in the computational time required to plan the UAVs' trajectories with respect to the optimal approach, thus enabling prompt reaction to the emergency events.


title: Possibilities to generation of optical non-diffracting beams by holographic metasurfaces using surface impedance

abstract: In this work, we present the computational simulations of holographic metasurfaces to generation of the optical non-diffracting beams. The metasurfaces are designed by the holographic technique and the computer-generated holograms (CGHs) of optical non-diffracting beams are generated computationally. These holographic metasurfaces (HMS) are obtained by modeling a periodic lattice of metallic patches on dielectric substrates with sub-wavelength dimensions, where each one of those unit cells change the phase of the incoming wave. We use the surface impedance (Z) to control the phase of the electromagnetic wave through the metasurface in each unit cell. The sub-wavelength dimensions guarantees that the effective medium theory is fulfilled. The results is according to the predicted by non-diffracting beams theory. These results are important given the possibilities of applications in optical tweezers, optics communications, optical metrology, 3D imaging, and others in optics and photonics


title: A Large Massive Quiescent Galaxy Sample at z~1.2

abstract: In this paper we present a simple color-magnitude selection and obtain a large sample of 33,893 massive quiescent galaxies at intermediate redshifts (1<z<1.5). We choose the longest wavelength available in the Hyper-Supreme-Cam (HSC) deep survey, the Y band and i-Y color, to select the 4000A Balmer jump in passive galaxies to the highest redshift possible within the survey. With the rich multi-wavelength data in the HSC deep fields, we then confirm that the selected galaxies are in the targeted redshift range of 1<z<1.5, lie in the passive region of the UVJ diagram, and have high stellar masses at log(M*/M_sun)>10.5, with a median of log(M*/M_sun)=11.0. A small fraction of our galaxies is also covered by the HST CANDELS. Morphological analysis in the observed H band shows that the majority of this subsample are early-type galaxies. As massive early-type galaxies trace the high density regions in the large scale structure in the universe, our study provides a quick and simple way to obtain a statistical significant sample of massive galaxies in a relative narrow redshift range. Our sample is 7-20 times larger at the massive end (log(M*/M_sun)>10.5) than any existing samples obtained in previous surveys. This is a pioneer study, and the technique introduced here can be applied to future wide-field survey to study large scale structure, and to identify high density region and clusters.


title: Complexity of four-dimensional hairy Anti-de-Sitter black holes with a rotating string and shear viscosity in generalized scalar-tensor theories

abstract: In four dimensions, we consider a generalized scalar-tensor theory where the coupling functions only depend on the kinetic term of the scalar field. For this model, we obtain a set of hairy Anti-de-Sitter black hole solutions, allowing us to calculate the computational complexity, according to the Complexity equals Action conjecture. To perform this, the system contains a particle moving on the boundary, corresponding to the insertion of a fundamental string in the bulk. The effect string is given by the Nambu-Goto term, analyzing the time development of this system. Together with the above, we calculate the shear viscosity, where the viscosity/entropy density ratio can violate the Kovtun-Son-Starinets bound for a suitable choice of coupling functions.


title: Polymer electrolytes in strong external electric fields: Modification of structure and dynamics

abstract: We present the results from an extensive atomistic molecular dynamics simulation study of poly(ethylene oxide) (PEO) doped with various amounts of lithium-bis(trifluoromethane)sulfonimide (LiTFSI) salt under the influence of external electric field strengths up to $1\,$V/nm. The motivation stems from recent experimental reports on the nonlinear response of mobilities to the application of an electric field in such electrolyte systems and arising speculations on field-induced alignment of the polymer chains, creating channel-like structures that facilitate ion passage. Hence, we systematically examine the electric field impact on the lithium coordination environment, polymer structure as well as ionic transport properties and further present a procedure to quantify the susceptibility of both structural and dynamical observables to the external field. Our investigation reveals indeed a coiled-to-stretched transformation of the PEO strands along with a concurrent nonlinear behavior of the dynamic properties. However, from studying the temporal response of the unperturbed electrolyte system to field application we are able to exclude a structurally conditioned enhancement of ion transport and surprisingly observe a slowing down. A microscopic understanding is supplied.


title: Euclidean formulation of relativistic quantum mechanics of N particles

abstract: A Euclidean formulation of relativistic quantum mechanics for systems of a finite number of degrees of freedom is discussed. Relativistic treatments of quantum theory are needed to study hadronic systems at sub-hadronic distance scales. While direct interaction approaches to relativistic quantum mechanics have proved to be useful, they have two disadvantages. One is that cluster properties are difficult to realize for systems of more than two particles. The second is that the relation to quantum field theories is indirect. Euclidean formulations of relativistic quantum mechanics provide an alternative representation that does not have these difficulties. More surprising, the theory can be formulated entirely in the Euclidean representation without the need for analytic continuation. In this work a Euclidean representation of a relativistic $N$-particle system is discussed. Kernels for systems of N free particles of any spin are given and shown to be reflection positive. Explicit formulas for generators of the Poincar\'e group for any spin are constructed and shown to be self-adjoint on the Euclidean representation of the Hilbert space. The structure of correlations that preserve both the Euclidean covariance and reflection positivity is discussed.


title: A Direct Sampling Method for the Inversion of the Radon Transform

abstract: We propose a novel direct sampling method (DSM) for the effective and stable inversion of the Radon transform. The DSM is based on a generalization of the important almost orthogonality property in classical DSMs to fractional order Sobolev duality products and to a new family of probing functions. The fractional order duality product proves to be able to greatly enhance the robustness of the reconstructions in some practically important but severely ill-posed inverse problems associated with the Radon transform. We present a detailed analysis to better understand the performance of the new probing and index functions, which are crucial to stable and effective numerical reconstructions. The DSM can be computed in a very fast and highly parallel manner. Numerical experiments are carried out to compare the DSM with a popular existing method, and to illustrate the efficiency, stability, and accuracy of the DSM.


title: An Euler system for GU(2, 1)

abstract: We construct an Euler system associated to regular algebraic, essentially conjugate self-dual cuspidal automorphic representations of GL(3) over imaginary quadratic fields, using the cohomology of Shimura varieties for GU(2, 1).


title: Composition and origin of L5 Trojan asteroids of Mars: Insights from spectroscopy

abstract: We investigate the mineralogy of L5 Martian Trojan asteroids via reflectance spectroscopy, in particular (101429) 1998 $\mbox{VF}_{31}$, the only L5 Trojan that does not belong to the Eureka family (Christou, 2013). We find that this asteroid most likely belongs to the Bus-Demeo S-complex, in agreement with Rivkin et al. (2007) and obtain good spectral matches with Sq- or S-type asteroids, the lunar surface and of Martian and lunar meteorites. Mixture fitting to spectral endmembers suggests a surface abundance of Mg-rich orthopyroxene and iron metal or, alternatively, a mixture of plagioclase and metal with a small amount of Mg-poor orthopyroxene. The metallic component may be part of the intrinsic mineral makeup of the asteroid or an indication of extreme space weathering. We discuss several origin scenarios for (101429). The asteroid could be related to iron-rich primitive achondrites (Rivkin et al.), may have originated as impact ejecta from Mars - as proposed recently for the Eureka family asteroids (Polishook et al., 2017) - or could be a relic fragment of the Moon's original solid crust. If, on the other hand, (101429) is a relatively recent addition to the Martian Trojan clouds (Christou et al., 2020), its origin is probably traced to high-inclination asteroid families in the Inner Main Belt. For the olivine-dominated Eureka family, we find that the two smaller asteroids are more spectrally similar to one another than to (5261) Eureka. Spectral profiles of all three asteroids are closely similar shortward of $\sim$0.7$\mu$m but diverge at longer wavelengths. For the two smaller asteroids in particular, we find the spectra are virtually identical up to $0.8$$\mu$m. We attribute spectral differences in the near-IR region to differences in either: degree of space weathering, olivine chemical composition and/or regolith grain size.


title: On $\lambda$-fold relative Heffter arrays and biembedding multigraphs on surfaces

abstract: In this paper we define a new class of partially filled arrays, called $\lambda$-fold relative Heffter arrays, that are a generalisation of the Heffter arrays introduced by Archdeacon in 2015. After showing the connection of this new concept with several other ones, such as signed magic arrays, graph decompositions and relative difference families, we determine some necessary conditions and we present existence results for infinite classes of these arrays. In the last part of the paper we also show that these arrays give rise to biembeddings of multigraphs into orientable surfaces and we provide infinite families of such biembeddings. To conclude, we present a result concerning pairs of $\lambda$-fold relative Heffter arrays and covering surfaces.


title: DiSCO: Differentiable Scan Context with Orientation

abstract: Global localization is essential for robot navigation, of which the first step is to retrieve a query from the map database. This problem is called place recognition. In recent years, LiDAR scan based place recognition has drawn attention as it is robust against the appearance change. In this paper, we propose a LiDAR-based place recognition method, named Differentiable Scan Context with Orientation (DiSCO), which simultaneously finds the scan at a similar place and estimates their relative orientation. The orientation can further be used as the initial value for the down-stream local optimal metric pose estimation, improving the pose estimation especially when a large orientation between the current scan and retrieved scan exists. Our key idea is to transform the feature into the frequency domain. We utilize the magnitude of the spectrum as the place signature, which is theoretically rotation-invariant. In addition, based on the differentiable phase correlation, we can efficiently estimate the global optimal relative orientation using the spectrum. With such structural constraints, the network can be learned in an end-to-end manner, and the backbone is fully shared by the two tasks, achieving interpretability and light weight. Finally, DiSCO is validated on three datasets with long-term outdoor conditions, showing better performance than the compared methods.


title: Influence Maximization on Dynamic Social Networks with Conjugate Learning Automata

abstract: Selecting the optimal subset from all vertices as seeds to maximize the influence in a social network has been a task of interest. Various methods have been proposed to select the optimal vertices in a static network, however, they are challenged by the dynamics, i.e. the time-dependent variation of the social network structure. Such dynamics hinder the paradigm for static networks and leaves a seemingly unbridgeable gap between algorithms of influence maximization on static networks and those on dynamic ones. In this paper, we extend our previous work and demonstrate that conjugate learning automata (an elementary variant of reinforcement learning) that have been successfully applied to maximize influence on static networks can be applied to dynamic networks as well. The network dynamics is measured by the variation of the influence range and absorbed into the learning procedure. Our proposal delicately formulates the effect of network dynamics: the more the influence range varies, the more likely the seeds are to be learned from scratch. Under this assumption, the continuity of the network variation is fully taken advantage of. Experimental results on both synthetic and real-world networks verify the privileges of our proposal against alternative methods.


title: SU(3) partial dynamical symmetry and nuclear shapes

abstract: We consider several variants of SU(3) partial dynamical symmetry in relation to quadrupole shapes in nuclei. Explicit construction of Hamiltonians with such property is presented in the framework of the interacting boson model (IBM), including higher order terms, and in its proton-neutron extension (IBM-2). The cases considered include a single prolate-deformed shape with solvable ground and $\gamma$ or $\beta$ bands, coexisting prolate-oblate shapes with solvable ground bands, and aligned axially-deformed proton-neutron shapes with solvable symmetric ground and $\gamma$ bands and mixed-symmetry scissors and $\gamma$ bands.


title: A Wigner-Eckart Theorem for Group Equivariant Convolution Kernels

abstract: Group equivariant convolutional networks (GCNNs) endow classical convolutional networks with additional symmetry priors, which can lead to a considerably improved performance. Recent advances in the theoretical description of GCNNs revealed that such models can generally be understood as performing convolutions with G-steerable kernels, that is, kernels that satisfy an equivariance constraint themselves. While the G-steerability constraint has been derived, it has to date only been solved for specific use cases - a general characterization of G-steerable kernel spaces is still missing. This work provides such a characterization for the practically relevant case of G being any compact group. Our investigation is motivated by a striking analogy between the constraints underlying steerable kernels on the one hand and spherical tensor operators from quantum mechanics on the other hand. By generalizing the famous Wigner-Eckart theorem for spherical tensor operators, we prove that steerable kernel spaces are fully understood and parameterized in terms of 1) generalized reduced matrix elements, 2) Clebsch-Gordan coefficients, and 3) harmonic basis functions on homogeneous spaces.


title: A search for ultra high energy neutrinos from TXS 0506+056 using the Pierre Auger Observatory

abstract: Results of a search for ultra-high-energy neutrinos with the Pierre Auger Observatory from the direction of the blazar TXS 0506+056 are presented. They were obtained as part of the follow-up that stemmed from the detection of high-energy neutrinos and gamma rays with IceCube, \textit{Fermi}-LAT, MAGIC, and other detectors of electromagnetic radiation in several bands. The Pierre Auger Observatory is sensitive to neutrinos in the energy range from 100 PeV to 100 EeV and in the zenith angle range from $\theta=60^\circ$ to $\theta=95^\circ$, where the zenith angle is measured from the vertical direction. No neutrinos from the direction of TXS 0506+056 have been found. The results were analyzed in three periods: One of 6 months around the detection of IceCube-170922A, coinciding with a flare period of TXS 0506+056, a second one of 110 days during which the IceCube collaboration found an excess of 13 neutrinos from a direction compatible with TXS 0506+056, and a third one from 2004 January 1 up to 2018 August 31, over which the Pierre Auger Observatory has been taking data. The sensitivity of the Observatory is addressed for different spectral indices by considering the fluxes that would induce a single expected event during the observation period. For indices compatible with those measured by the IceCube collaboration the expected number of neutrinos at the Observatory is well-below one. Spectral indices as hard as 1.5 would have to apply in this energy range to expect a single event to have been detected.


title: Numerical Simulation of Critical Quantum Dynamics without Finite Size Effects

abstract: Classical $(1+1)D$ cellular automata, as for instance Domany-Kinzel cellular automata, are paradigmatic systems for the study of non-equilibrium phenomena. Such systems evolve in discrete time-steps, and are thus free of time-discretisation errors. Moreover, information about critical phenomena can be obtained by simulating the evolution of an initial seed that, at any finite time, has support only on a finite light-cone. This allows for essentially numerically exact simulations, free of finite-size errors or boundary effects. Here, we show how similar advantages can be gained in the quantum regime: The many-body critical dynamics occurring in $(1+1)D$ quantum cellular automata with an absorbing state can be studied directly on an infinite lattice when starting from seed initial conditions. This can be achieved efficiently by simulating the dynamics of an associated one-dimensional, non-unitary quantum cellular automaton using tensor networks. We apply our method to a model introduced recently and find accurate values for universal exponents, suggesting that this approach can be a powerful tool for precisely classifying non-equilibrium universal physics in quantum systems.


title: Efficient and flexible methods for time since infection models

abstract: Epidemic models are useful tools in the fight against infectious diseases, as they allow policy makers to test and compare various strategies to limit disease transmission while mitigating collateral damage on the economy. Epidemic models that are more faithful to the microscopic details of disease transmission can offer more reliable projections, which in turn can lead to more reliable control strategies. For example, many epidemic models describe disease progression via a series of artificial 'stages' or 'compartments' (e.g. exposed, activated, infectious, etc.) but an epidemic model that explicitly tracks time since infection (TSI) can provide a more precise description. At present, epidemic models with 'compartments' are more common than TSI models , largely due to higher computational cost and complexity typically associated with TSI models. Here, however, we show that with the right discretization scheme a TSI model is not much more difficult to solve than a comparment model with three or four 'stages' for the infected class. We also provide a new perspective for adding 'stages' to a TSI model in a way that decouples the disease transmission dynamics from the residence time distributions at each stage. These results are also generalized for age-structured TSI models in an appendix. Finally, as proof-of-principle for the efficiency of the proposed numerical methods, we provide calculations for optimal epidemic control by non-pharmaceutical intervention. Many of the tools described in this report are available through the software package 'pyross'


title: Subword complexity of the Fibonacci-Thue-Morse sequence: the proof of Dekking's conjecture

abstract: Recently Dekking conjectured the form of the subword complexity function for the Fibonacci-Thue-Morse sequence. In this note we prove his conjecture by purely computational means, using the free software Walnut.


title: 2nd Place Solution to Instance Segmentation of IJCAI 3D AI Challenge 2020

abstract: Compared with MS-COCO, the dataset for the competition has a larger proportion of large objects which area is greater than 96x96 pixels. As getting fine boundaries is vitally important for large object segmentation, Mask R-CNN with PointRend is selected as the base segmentation framework to output high-quality object boundaries. Besides, a better engine that integrates ResNeSt, FPN and DCNv2, and a range of effective tricks that including multi-scale training and test time augmentation are applied to improve segmentation performance. Our best performance is an ensemble of four models (three PointRend-based models and SOLOv2), which won the 2nd place in IJCAI-PRICAI 3D AI Challenge 2020: Instance Segmentation.


title: An application of a quantum wave impedance method to finite periodic structures

abstract: The relations between a quantum wave impedance function and elements of transfer and scattering matrixes for quantum mechanical systems with arbitrary localized form of potential were established. Obtained results allows using the advantages of both methods, namely a transfer matrix technique and a quantum wave impedance approach, for an investigating of nanosystems with a complicated geometry of a potential. A finit Dirac comb was solved and expressions for Tamm's levels in this system were derived within both approaches.


title: Learning to Guide Local Feature Matches

abstract: We tackle the problem of finding accurate and robust keypoint correspondences between images. We propose a learning-based approach to guide local feature matches via a learned approximate image matching. Our approach can boost the results of SIFT to a level similar to state-of-the-art deep descriptors, such as Superpoint, ContextDesc, or D2-Net and can improve performance for these descriptors. We introduce and study different levels of supervision to learn coarse correspondences. In particular, we show that weak supervision from epipolar geometry leads to performances higher than the stronger but more biased point level supervision and is a clear improvement over weak image level supervision. We demonstrate the benefits of our approach in a variety of conditions by evaluating our guided keypoint correspondences for localization of internet images on the YFCC100M dataset and indoor images on theSUN3D dataset, for robust localization on the Aachen day-night benchmark and for 3D reconstruction in challenging conditions using the LTLL historical image data.


title: Gene-gene interaction analysis incorporating network information via a structured Bayesian approach

abstract: Increasing evidence has shown that gene-gene interactions have important effects on biological processes of human diseases. Due to the high dimensionality of genetic measurements, existing interaction analysis methods usually suffer from a lack of sufficient information and are still unsatisfactory. Biological networks have been massively accumulated, allowing researchers to identify biomarkers from a system perspective by utilizing network selection (consisting of functionally related biomarkers) as well as network structures. In the main-effect analysis, network information has been widely incorporated, leading to biologically more meaningful and more accurate estimates. However, there is still a big gap in the context of interaction analysis. In this study, we develop a novel structured Bayesian interaction analysis approach, effectively incorporating the network information. This study is among the first to identify gene-gene interactions with the assistance of network selection for phenotype prediction, while simultaneously accommodating the underlying network structures. It innovatively respects the multiple hierarchies among main effects, interactions, and networks. Bayesian method is adopted, which has been shown to have multiple advantages over some other techniques. An efficient variational inference algorithm is developed to explore the posterior distribution. Extensive simulation studies demonstrate the practical superiority of the proposed approach. The analysis of TCGA data on melanoma and lung cancer leads to biologically sensible findings with satisfactory prediction accuracy and selection stability.


title: A Test for Kronecker Product Structure Covariance Matrix

abstract: We propose a test for a covariance matrix to have Kronecker Product Structure (KPS). KPS implies a reduced rank restriction on a certain transformation of the covariance matrix and the new procedure is an adaptation of the Kleibergen and Paap (2006) reduced rank test. To derive the limiting distribution of the Wald type test statistic proves challenging partly because of the singularity of the covariance matrix estimator that appears in the weighting matrix. We show that the test statistic has a chi square limiting null distribution with degrees of freedom equal to the number of restrictions tested. Local asymptotic power results are derived. Monte Carlo simulations reveal good size and power properties of the test. Re-examining fifteen highly cited papers conducting instrumental variable regressions, we find that KPS is not rejected in 56 out of 118 specifications at the 5% nominal size.


title: World impact of kernel European Union 9 countries from Google matrix analysis of the world trade network

abstract: We use the United Nations COMTRADE database for analysis of the multiproduct world trade network. With this data, considered for years 2012-2018, we determined the world trade impact of the Kernel of EU 9 countries (KEU9), being Austria, Belgium, France, Germany, Italy, Luxembourg, Netherlands, Portugal, Spain, considered as one united country. We apply the advanced Google matrix analysis for investigation of the influence of KEU9 and show that KEU9 takes the top trade network rank positions thus becoming the main player of the world trade being ahead of USA and China. Our network analysis provides additional mathematical grounds in favor of the recent proposal of KEU9 super-union which is based only on historical, political and economy basis.


title: Fermion-fermion interaction driven instability and criticality of quadratic band crossing systems with the breaking of time-reversal symmetry

abstract: We carefully study how the fermion-fermion interactions affect the low-energy states of a two-dimensional spin-$1/2$ fermionic system on the kagom\'{e} lattice with a quadratic band crossing point. With the help of the renormalization group approach, we can treat all kinds of fermionic interactions on the the same footing and then establish the coupled energy-dependent flows of fermionic interaction parameters via collecting one-loop corrections, from which a number of interesting results are extracted in the low-energy regime. At first, various sorts of fermion-fermion interactions furiously compete with each other and are inevitably attracted by certain fixed point in the parameter space, which clusters into three qualitatively distinct regions relying heavily upon the structure parameters of materials. In addition, we notice that an instability accompanied by some symmetry breaking is triggered around different sorts of fixed points. Computing and comparing susceptibilities of twelve potential candidates indicates that charge density wave always dominates over all other instabilities. Incidently, there exist several subleading ones including the $x$-current, bond density, and chiral plus s-wave superconductors. Finally, we realize that strong fluctuations nearby the leading instability prefer to suppress density of states and specific heat as well compressibility of quasiparticles in the lowest-energy limit.


title: 2D kinematics of massive stars near the Galactic Center

abstract: The presence of massive stars (MSs) in the region close to the Galactic Center (GC) poses several questions about their origin. The harsh environment of the GC favors specific formation scenarios, each of which should imprint characteristic kinematic features on the MSs. We present a 2D kinematic analysis of MSs in a GC region surrounding Sgr A* based on high-precision proper motions obtained with the Hubble Space Telescope. Thanks to a careful data reduction, well-measured bright stars in our proper-motion catalogs have errors better than 0.5 mas yr$^{-1}$. We discuss the absolute motion of the MSs in the field and their motion relative to Sgr A*, the Arches and the Quintuplet. For the majority of the MSs, we rule out any distance further than 3-4 kpc from Sgr A* using only kinematic arguments. If their membership to the GC is confirmed, most of the isolated MSs are likely not associated with either the Arches or Quintuplet clusters or Sgr A*. Only a few MSs have proper motions suggesting they are likely members of the Arches cluster, in agreement with previous spectroscopic results. Line-of-sight radial velocities and distances are required to shed further light on the origin of most of these massive objects. We also present an analysis of other fast-moving objects in the GC region, finding no clear excess of high-velocity escaping stars. We make our astro-photometric catalogs publicly available.


title: Symmetry breaking and phase transitions in Bose-Einstein condensates with spin-orbital-angular-momentum coupling

abstract: Theoretical study is presented for a spinor Bose-Einstein condensate, whose two components are coupled by copropagating Raman beams with different orbital angular momenta. The investigation is focused on the behavior of the ground state of this condensate, depending on the atom-light coupling strength. By analyzing the ground state, we have identified a number of quantum phases, which reflect the symmetries of the effective Hamiltonian and are characterized by the specific structure of the wave function. In addition to the well-known stripe, polarized and zero-momentum phases, our results show that the system can support phases, whose wave function contains a complex vortex molecule. Such molecule plays an important role in the continuous phase transitions of the system. The predicted behavior of vortex-molecule phases can be examined in cold-atom experiments using currently existing techniques.


title: Anomaly Detection in a Large-scale Cloud Platform

abstract: Cloud computing is ubiquitous: more and more companies are moving the workloads into the Cloud. However, this rise in popularity challenges Cloud service providers, as they need to monitor the quality of their ever-growing offerings effectively. To address the challenge, we designed and implemented an automated monitoring system for the IBM Cloud Platform. This monitoring system utilizes deep learning neural networks to detect anomalies in near-real-time in multiple Platform components simultaneously. After running the system for a year, we observed that the proposed solution frees the DevOps team's time and human resources from manually monitoring thousands of Cloud components. Moreover, it increases customer satisfaction by reducing the risk of Cloud outages. In this paper, we share our solutions' architecture, implementation notes, and best practices that emerged while evolving the monitoring system. They can be leveraged by other researchers and practitioners to build anomaly detectors for complex systems.


title: Safe Handover in Mixed-Initiative Control for Cyber-Physical Systems

abstract: For mixed-initiative control between cyber-physical systems (CPS) and its users, it is still an open question how machines can safely hand over control to humans. In this work, we propose a concept to provide technological support that uses formal methods from AI -- description logic (DL) and automated planning -- to predict more reliably when a hand-over is necessary, and to increase the advance notice for handovers by planning ahead of runtime. We combine this with methods from human-computer interaction (HCI) and natural language generation (NLG) to develop solutions for safe and smooth handovers and provide an example autonomous driving scenario. A study design is proposed with the assessment of qualitative feedback, cognitive load and trust in automation.


title: Progressive Batching for Efficient Non-linear Least Squares

abstract: Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying problem structure for computational speedup. With the success of deep learning methods leveraging large datasets, stochastic optimization methods received recently a lot of attention. Our work borrows ideas from both stochastic machine learning and statistics, and we present an approach for non-linear least-squares that guarantees convergence while at the same time significantly reduces the required amount of computation. Empirical results show that our proposed method achieves competitive convergence rates compared to traditional second-order approaches on common computer vision problems, such as image alignment and essential matrix estimation, with very large numbers of residuals.


title: Incorporating Interpretable Output Constraints in Bayesian Neural Networks

abstract: Domains where supervised models are deployed often come with task-specific constraints, such as prior expert knowledge on the ground-truth function, or desiderata like safety and fairness. We introduce a novel probabilistic framework for reasoning with such constraints and formulate a prior that enables us to effectively incorporate them into Bayesian neural networks (BNNs), including a variant that can be amortized over tasks. The resulting Output-Constrained BNN (OC-BNN) is fully consistent with the Bayesian framework for uncertainty quantification and is amenable to black-box inference. Unlike typical BNN inference in uninterpretable parameter space, OC-BNNs widen the range of functional knowledge that can be incorporated, especially for model users without expertise in machine learning. We demonstrate the efficacy of OC-BNNs on real-world datasets, spanning multiple domains such as healthcare, criminal justice, and credit scoring.


title: Deconstructing higher order clockwork gravity

abstract: We consider the higher order clockwork theory of gravitational interactions, whereby a number of gravitons are coupled together with TeV strength, but nevertheless generate a Planck scale coupling to matter without the need for a dilaton. It is shown that the framework naturally lends itself to a five-dimensional geometry, and we find the 5D continuum version of such deconstructed 4D gravitational clockwork models. Moreover, the clockwork picture has matter coupled to particular gravitons, which in the 5D framework looks like a braneworld model, with the Randall-Sundrum model being a special case. More generally, the gravitational clockwork leads to a family of scalar-tensor braneworld models, where the scalar is not a dilaton.


title: Second-order asymptotic expansion and thermodynamic interpretation of a fast-slow Hamiltonian system

abstract: This article includes a short survey of selected averaging and dimension reduction techniques for deterministic fast-slow systems. This survey includes, among others, classical techniques, such as the WKB approximation or the averaging method, as well as modern techniques, such as the GENERIC formalism. The main part of this article combines ideas of some of these techniques and addresses the problem of deriving a reduced system for the slow degrees of freedom (DOF) of a fast-slow Hamiltonian system. In the first part, we derive an asymptotic expansion of the averaged evolution of the fast-slow system up to second-order, using weak convergence techniques and two-scale convergence. In the second part, we determine quantities which can be interpreted as temperature and entropy of the system and expand these quantities up to second-order, using results from the first part. The results give new insights into the thermodynamic interpretation of the fast-slow system at different scales.


title: On accompanying measures and asymptotic expansions in limit theorems for maximum of random variables

abstract: A sequence of accompanying laws is suggested in the limit theorem of B. V. Gnedenko for maximums of independent random variables belonging to maximum domain of attraction of the Gumbel distribution. It is shown that this sequence gives an exponential power rate of convergence whereas the Gumbel distribution gives only a logarithmic rate. As examples, classes of Weibull and log-Weibull type distributions are considered in details. A scale for the Gumbel maximum domain of attraction is suggested as a continuation of the considered two classes.


title: Regularised Least-Squares Regression with Infinite-Dimensional Output Space

abstract: This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibly infinite-dimensional) Hilbert space. Our approach is based on the integral operator technique using spectral theory for non-compact operators. We place a particular emphasis on obtaining results with as few assumptions as possible; as such we only use Chebyshev's inequality, and no effort is made to obtain the best rates or constants.


title: Eisenstein series of even weight $k \geq 2$ and integral binary quadratic forms

abstract: We prove a conjecture of Matsusaka on the analytic continuationof hyperbolic Eisenstein series in weight $2$ on the full modular group $\mathrm{SL}_2(\mathbb{Z})$.


title: Correlative chemical and structural nanocharacterization of a pseudo-binary 0.75Bi(Fe0.97Ti0.03)O3-0.25BaTiO3 ceramic

abstract: Fast-cooling after sintering or annealing of BiFeO3-BaTiO3 mixed oxide ceramics yields core-shell structures that give excellent functional properties, but their precise phase assemblage and nanostructure remains an open question. By comparing conventional electron energy loss spectroscopy (EELS) with scanning precession electron diffraction (SPED) mapping using a direct electron detector, we correlate chemical composition with the presence or absence of octahedral tilting and with changes in lattice parameters. This reveals that some grains have a 3-phase assemblage of a BaTiO3-rich pseudocubic shell; a BiFeO3-rich outer core with octahedral tilting consistent with an R3c structure; and an inner core richer in Ba and even poorer in Ti, which seems to show a pseudocubic structure of slightly smaller lattice parameter than the shell region. This last structure has not been previously identified in these materials, but the composition and structure fit with previous studies. These inner cores are likely to be non-polar and play no part in the ferroelectric properties. Nevertheless, the combination of EELS and SPED clearly provides a novel way to examine heterogeneous microstructures with high spatial resolution, thus revealing the presence of phases that may be too subtle to detect with more conventional techniques.


title: Geometry of surfaces in $\mathbb R^5$ through projections and normal sections

abstract: We study the geometry of surfaces in $\mathbb R^5$ by relating it to the geometry of regular and singular surfaces in $\mathbb R^4$ obtained by orthogonal projections. In particular, we obtain relations between asymptotic directions, which are not second order geometry for surfaces in $\mathbb R^5$ but are in $\mathbb R^4$. We also relate the umbilic curvatures of each type of surface and their contact with spheres. We then consider the surfaces as normal sections of 3-manifolds in $\mathbb R^6$ and again relate asymptotic directions and contact with spheres by defining an appropriate umbilic curvature for 3-manifolds.


title: New approximate-analytical solutions for the nonlinear fractional Schr\"{o}dinger equation with second-order spatio-temporal dispersion via double Laplace transform method

abstract: In this paper, a modified nonlinear Schr\"{o}dinger equation with spatio-temporal dispersion is formulated in the senses of Caputo fractional derivative and conformable derivative. A new generalized double Laplace transform coupled with Adomian decomposition method has been defined and applied to solve the newly formulated nonlinear Schr\"{o}dinger equation with spatio-temporal dispersion. The approximate analytical solutions using the proposed generalized method in the sense of Caputo fractional derivative and conformable derivatives are obtained and compared with each other graphically.


title: The role of charge recombination to spin-triplet excitons in non-fullerene acceptor organic solar cells

abstract: The power conversion efficiencies (PCEs) of organic solar cells (OSCs) using non-fullerene acceptors (NFAs) have now reached 18%. However, this is still lower than inorganic solar cells, for which PCEs >20% are commonplace. A key reason is that OSCs still show low open-circuit voltages (Voc) relative to their optical band gaps, attributed to non-radiative recombination. For OSCs to compete with inorganics in efficiency, all non-radiative loss pathways must be identified and where possible, removed. Here, we show that in most NFA OSCs, the majority of charge recombination at open-circuit proceeds via formation of non-emissive NFA triplet excitons (T1); in the benchmark PM6:Y6 blend, this fraction reaches 90%, contributing 60 mV to the reduction of Voc. We develop a new design to prevent recombination via this non-radiative channel through the engineering of significant hybridisation between the NFA T1 and the spin-triplet charge transfer exciton (3CTE). We model that the rate of the back charge transfer from 3CTE to T1 can be reduced by an order of magnitude, allowing re-dissociation of the 3CTE. We then demonstrate NFA systems where T1 formation is suppressed. This work therefore provides a clear design pathway for improved OSC performance to 20% PCE and beyond.


title: Synthetic Expressions are Better Than Real for Learning to Detect Facial Actions

abstract: Critical obstacles in training classifiers to detect facial actions are the limited sizes of annotated video databases and the relatively low frequencies of occurrence of many actions. To address these problems, we propose an approach that makes use of facial expression generation. Our approach reconstructs the 3D shape of the face from each video frame, aligns the 3D mesh to a canonical view, and then trains a GAN-based network to synthesize novel images with facial action units of interest. To evaluate this approach, a deep neural network was trained on two separate datasets: One network was trained on video of synthesized facial expressions generated from FERA17; the other network was trained on unaltered video from the same database. Both networks used the same train and validation partitions and were tested on the test partition of actual video from FERA17. The network trained on synthesized facial expressions outperformed the one trained on actual facial expressions and surpassed current state-of-the-art approaches.


title: Enhanced User Grouping and Power Allocation for Hybrid mmWave MIMO-NOMA systems

abstract: Non-orthogonal multiple access (NOMA) and millimeter wave (mmWave) are two key enabling technologies for the fifth-generation (5G) mobile networks and beyond. In this paper, we consider uplink communications with a hybrid beamforming structure and focus on improving the spectral efficiency (SE) and energy efficiency (EE) of mmWave multiple-input multiple-output (MIMO)-NOMA systems with enhanced user grouping and power allocation. Exploiting the directionality feature of mmWave channels, we first propose a novel initial agglomerative nesting (AGNES) based user grouping algorithm by taking advantage of the channel correlations. It is noted that the optimization of the SE/EE is a challenging task due to the non-linear programming nature of the corresponding problem involving user grouping, beam selection, and power allocation. Our idea is to decompose the overall optimization problem into a mixed integer problem comprising of user grouping and beam selection only, followed by a continuous problem involving power allocation and digital beamforming design. To avoid the prohibitively high complexity of the brute-force search approach, we propose two suboptimal low-complexity user grouping and beam selection schemes, the direct AGNES (DIR-AGNES) scheme and the successive AGNES (SUC-AGNES) scheme. We also introduce the quadratic transform (QT) to recast the non-convex power allocation optimization problem into a convex one subject to a minimum required data rate of each user. The continuous problem is solved by iteratively optimizing the power and the digital beamforming. Extensive simulation results have shown that our proposed mmWave-NOMA design outperforms the conventional orthogonal multiple access (OMA) scenario and the state-of-art NOMA schemes.


title: Amnesiac Machine Learning

abstract: The Right to be Forgotten is part of the recently enacted General Data Protection Regulation (GDPR) law that affects any data holder that has data on European Union residents. It gives EU residents the ability to request deletion of their personal data, including training records used to train machine learning models. Unfortunately, Deep Neural Network models are vulnerable to information leaking attacks such as model inversion attacks which extract class information from a trained model and membership inference attacks which determine the presence of an example in a model's training data. If a malicious party can mount an attack and learn private information that was meant to be removed, then it implies that the model owner has not properly protected their user's rights and their models may not be compliant with the GDPR law. In this paper, we present two efficient methods that address this question of how a model owner or data holder may delete personal data from models in such a way that they may not be vulnerable to model inversion and membership inference attacks while maintaining model efficacy. We start by presenting a real-world threat model that shows that simply removing training data is insufficient to protect users. We follow that up with two data removal methods, namely Unlearning and Amnesiac Unlearning, that enable model owners to protect themselves against such attacks while being compliant with regulations. We provide extensive empirical analysis that show that these methods are indeed efficient, safe to apply, effectively remove learned information about sensitive data from trained models while maintaining model efficacy.


title: Anisotropic Second Harmonic Generation From Monocrystalline Gold Flakes

abstract: Noble metals with well-defined crystallographic orientation constitute an appealing class of materials for controlling light-matter interactions on the nanoscale. Nonlinear optical processes, being particularly sensitive to anisotropy, are a natural and versatile probe of crystallinity in nano-optical devices. Here we study the nonlinear optical response of monocrystalline gold flakes, revealing a polarization dependence in second-harmonic generation from the {111} surface that is markedly absent in polycrystalline films. Apart from suggesting an approach for directional enhancement of nonlinear response in plasmonic systems, we anticipate that our findings can be used as a rapid and non-destructive method for characterization of crystal quality and orientation that may be of significant importance in future applications.


title: The vortex gas scaling regime of baroclinic turbulence

abstract: The mean state of the atmosphere and ocean is set through a balance between external forcing (winds, radiation, heat and freshwater fluxes) and the emergent turbulence, which transfers energy to dissipative structures. The forcing gives rise to jets in the atmosphere and currents in the ocean, which spontaneously develop turbulent eddies through the baroclinic instability. A critical step in the development of a theory of climate is to properly include the resulting eddy-induced turbulent transport of properties like heat, moisture, and carbon. The baroclinic instability generates flow structures at the Rossby deformation radius, a length scale of order 1000 km in the atmosphere and 100 km in the ocean, smaller than the planetary scale and the typical extent of ocean basins respectively. There is therefore a separation of scales between the large-scale temperature gradient and the smaller eddies that advect it randomly, inducing effective diffusion. Numerical solutions of the two-layer quasi-geostrophic model, the standard model for studies of eddy motions in the atmosphere and ocean, show that such scale separation remains in the strongly nonlinear turbulent regime, provided there is sufficient bottom drag. We compute the scaling-laws governing the eddy-driven transport associated with baroclinic turbulence. First, we provide a theoretical underpinning for empirical scaling-laws reported in previous studies, for different formulations of the bottom drag law. Second, these scaling-laws are shown to provide an important first step toward an accurate local closure to predict the impact of baroclinic turbulence in setting the large-scale temperature profiles in the atmosphere and ocean.


title: Ultrafast optical circuit switching for data centers using integrated soliton microcombs

abstract: Networks inside current data centers comprise a hierarchy of power-hungry electronic packet switches interconnected via optical fibers and transceivers. As the scaling of such electrically-switched networks approaches a plateau, a power-efficient solution is to implement a flat network with optical circuit switching (OCS), without electronic switches and a reduced number of transceivers due to direct links among servers. One of the promising ways of implementing OCS is by using tunable lasers and arrayed waveguide grating routers. Such an OCS-network can offer high bandwidth and low network latency, and the possibility of photonic integration results in an energy-efficient, compact, and scalable photonic data center network. To support dynamic data center workloads efficiently, it is critical to switch between wavelengths in sub nanoseconds (ns). Here we demonstrate ultrafast photonic circuit switching based on a microcomb. Using a photonic integrated Si3N4 microcomb in conjunction with semiconductor optical amplifiers (SOAs), sub ns (< 500 ps) switching of more than 20 carriers is achieved. Moreover, the 25-Gbps non-return to zero (NRZ) and 50-Gbps four-level pulse amplitude modulation (PAM-4) burst mode transmission systems are shown. Further, on-chip Indium phosphide (InP) based SOAs and arrayed waveguide grating (AWG) are used to show sub-ns switching along with 25-Gbps NRZ burst mode transmission providing a path toward a more scalable and energy-efficient wavelength-switched network for future data centers.


title: Abstract crystals for quantum Borcherds-Bozec algebras

abstract: In this paper, we develop the theory of abstract crystals for quantum Borcherds-Bozec algebras. Our construction is different from the one given by Bozec. We further prove the crystal embedding theorem and provide a characterization of ${B}(\infty)$ and ${B}(\lambda)$ as its application, where ${B}(\infty)$ and ${B}(\lambda)$ are the crystals of the negative half part of the quantum Borcherds-Bozec algebra $U_q(\mathfrak g)$ and its irreducible highest weight module $V(\lambda)$, respectively.


title: Highly-scalable stochastic neuron based on Ovonic Threshold Switch (OTS) and its applications in Restricted Boltzmann Machine (RBM)

abstract: Interest in Restricted Boltzmann Machine (RBM) is growing as a generative stochastic artificial neural network to implement a novel energy-efficient machine-learning (ML) technique. For a hardware implementation of the RBM, an essential building block is a reliable stochastic binary neuron device that generates random spikes following the Boltzmann distribution. Here, we propose a highly-scalable stochastic neuron device based on Ovonic Threshold Switch (OTS) which utilizes the random emission and capture process of traps as the source of stochasticity. The switching probability is well described by the Boltzmann distribution, which can be controlled by operating parameters. As a candidate for a true random number generator (TRNG), it passes 15 among the 16 tests of the National Institute of Standards and Technology (NIST) Statistical Test Suite (Special Publication 800-22). In addition, the recognition task of handwritten digits (MNIST) is demonstrated using a simulated RBM network consisting of the proposed device with a maximum recognition accuracy of 86.07 %. Furthermore, reconstruction of images is successfully demonstrated using images contaminated with noises, resulting in images with the noise removed. These results show the promising properties of OTS-based stochastic neuron devices for applications in RBM systems.


title: Certified Distributional Robustness on Smoothed Classifiers

abstract: The robustness of deep neural networks (DNNs) against adversarial example attacks has raised wide attention. For smoothed classifiers, we propose the worst-case adversarial loss over input distributions as a robustness certificate. Compared with previous certificates, our certificate better describes the empirical performance of the smoothed classifiers. By exploiting duality and the smoothness property, we provide an easy-to-compute upper bound as a surrogate for the certificate. We adopt a noisy adversarial learning procedure to minimize the surrogate loss to improve model robustness. We show that our training method provides a theoretically tighter bound over the distributional robust base classifiers. Experiments on a variety of datasets further demonstrate superior robustness performance of our method over the state-of-the-art certified or heuristic methods.


title: Adhesion mechanism of temperature effects on Sn coating on the carbon fiber reinforced polymer substrate by cold spray

abstract: Metalization of carbon fiber reinforced polymers (CFRPs) composites by the surface modification method to enhance their electrical conductivity, thermal conductivity, electromagnetic shielding, erosion, and radiation protection, has a significant meaning in the aerospace field. In this study, Sn coating was successfully fabricated on the CFRP composite substrate via low-pressure cold spray under four gas temperatures (473K, 523K, 573K, and 623K). Their bonding mechanism was explored via the surface observation after peel-off adhesion strength, accompanying with surface temperature distribution investigation. The results indicates that we cannot obtain coating at 623 K, the epoxy matrix of the CFRP substrate was gradually eroded during deposition over 523 K. Meanwhile, Sn particles melt under 623 K condition. Three kinds of interfaces: Sn/epoxy, Sn/CF, and Sn/CF/epoxy are revealed as characteristics with respect to different gas temperatures to explore the bonding mechanisms.


title: Real roots near the unit circle of random polynomials

abstract: Let $f_n(z) = \sum_{k = 0}^n \varepsilon_k z^k$ be a random polynomial where $\varepsilon_0,\ldots,\varepsilon_n$ are i.i.d. random variables with $\mathbb{E} \varepsilon_1 = 0$ and $\mathbb{E} \varepsilon_1^2 = 1$. Letting $r_1, r_2,\ldots, r_k$ denote the real roots of $f_n$, we show that the point process defined by $\{|r_1| - 1,\ldots, |r_k| - 1 \}$ converges to a non-Poissonian limit on the scale of $n^{-1}$ as $n \to \infty$. Further, we show that for each $\delta > 0$, $f_n$ has a real root within $\Theta_{\delta}(1/n)$ of the unit circle with probability at least $1 - \delta$. This resolves a conjecture of Shepp and Vanderbei from 1995 by confirming its weakest form and refuting its strongest form.


title: Nano-Hz gravitational wave signature from axion dark matter

abstract: We calculate the accurate spectrum of the stochastic gravitational wave background from U(1) gauge fields produced by axion dark matter. The explosive production of gauge fields soon invalidates the applicability of the linear analysis and one needs nonlinear schemes. We make use of numerical lattice simulations to properly follow the nonlinear dynamics such as backreaction and rescattering which gives important contributions to the emission of gravitational waves. It turns out that the axion with the decay constant $f \sim 10^{16}$ GeV which gives the correct dark matter abundance predicts the circularly polarized gravitational wave signature detectable by SKA. We also show that the resulting gravitational wave spectrum has a potential to explain NANOGrav 12.5 year data.