title: Transferability of Natural Language Inference to Biomedical Question Answering

abstract: Biomedical question answering (QA) is a challenging task due to the scarcity of data and the requirement of domain expertise. Pre-trained language models have been used to address these issues. Recently, learning relationships between sentence pairs has been proved to improve performance in general QA. In this paper, we focus on applying BioBERT to transfer the knowledge of natural language inference (NLI) to biomedical QA. We observe that BioBERT trained on the NLI dataset obtains better performance on Yes/No (+5.59%), Factoid (+0.53%), List type (+13.58%) questions compared to performance obtained in a previous challenge (BioASQ 7B Phase B). We present a sequential transfer learning method that significantly performed well in the 8th BioASQ Challenge (Phase B). In sequential transfer learning, the order in which tasks are fine-tuned is important. We measure an unanswerable rate of the extractive QA setting when the formats of factoid and list type questions are converted to the format of the Stanford Question Answering Dataset (SQuAD).


title: Fairness constraints can help exact inference in structured prediction

abstract: Many inference problems in structured prediction can be modeled as maximizing a score function on a space of labels, where graphs are a natural representation to decompose the total score into a sum of unary (nodes) and pairwise (edges) scores. Given a generative model with an undirected connected graph $G$ and true vector of binary labels, it has been previously shown that when $G$ has good expansion properties, such as complete graphs or $d$-regular expanders, one can exactly recover the true labels (with high probability and in polynomial time) from a single noisy observation of each edge and node. We analyze the previously studied generative model by Globerson et al. (2015) under a notion of statistical parity. That is, given a fair binary node labeling, we ask the question whether it is possible to recover the fair assignment, with high probability and in polynomial time, from single edge and node observations. We find that, in contrast to the known trade-offs between fairness and model performance, the addition of the fairness constraint improves the probability of exact recovery. We effectively explain this phenomenon and empirically show how graphs with poor expansion properties, such as grids, are now capable to achieve exact recovery with high probability. Finally, as a byproduct of our analysis, we provide a tighter minimum-eigenvalue bound than that of Weyl's inequality.


title: Comparison theorems on weighted Finsler manifolds and spacetimes with $\epsilon$-range

abstract: We establish the Bonnet-Myers theorem, Laplacian comparison theorem, and Bishop-Gromov volume comparison theorem for weighted Finsler manifolds as well as weighted Finsler spacetimes, of weighted Ricci curvature bounded below by using the weight function. These comparison theorems are formulated with $\epsilon$-range introduced in our previous paper, that provides a natural viewpoint of interpolating weighted Ricci curvature conditions of different effective dimensions. Some of our results are new even for weighted Riemannian manifolds and generalize comparison theorems of Wylie-Yeroshkin and Kuwae-Li.


title: Discrete heat kernel, UV modified Green's function, and higher derivative theories

abstract: We perform the UV deformation of the Green's function in free scalar field theory using a discrete heat kernel method. It is found that the simplest UV deformation based on the discretized diffusion equation leads to the well-known Pauli-Villars effective Lagrangian. Furthermore, by extending assumptions on the discretized equation, we find that the general higher derivative theory is derived from the present UV deformation. In some specific cases, we also calculate the vacuum expectation values of the scalar field squared in nontrivial background spaces and examine their dependence on the UV cutoff constant.


title: Massive MIMO As an Extreme Learning Machine

abstract: This work shows that a massive multiple-input multiple-output (MIMO) system with low-resolution analog-to-digital converters (ADCs) forms a natural extreme learning machine (ELM). The receive antennas at the base station serve as the hidden nodes of the ELM, and the low-resolution ADCs act as the ELM activation function. By adding random biases to the received signals and optimizing the ELM output weights, the system can effectively tackle hardware impairments, such as the nonlinearity of power amplifiers and the low-resolution ADCs. Moreover, the fast adaptive capability of ELM allows the design of an adaptive receiver to address time-varying effects of MIMO channels. Simulations demonstrate the promising performance of the ELM-based receiver compared to conventional receivers in dealing with hardware impairments.


title: A Transformer-based Audio Captioning Model with Keyword Estimation

abstract: One of the problems with automated audio captioning (AAC) is the indeterminacy in word selection corresponding to the audio event/scene. Since one acoustic event/scene can be described with several words, it results in a combinatorial explosion of possible captions and difficulty in training. To solve this problem, we propose a Transformer-based audio-captioning model with keyword estimation called TRACKE. It simultaneously solves the word-selection indeterminacy problem with the main task of AAC while executing the sub-task of acoustic event detection/acoustic scene classification (i.e., keyword estimation). TRACKE estimates keywords, which comprise a word set corresponding to audio events/scenes in the input audio, and generates the caption while referring to the estimated keywords to reduce word-selection indeterminacy. Experimental results on a public AAC dataset indicate that TRACKE achieved state-of-the-art performance and successfully estimated both the caption and its keywords.


title: Observation of the Topologically Originated Edge States in large-gap Quasi-One-Dimensional a-Bi$_4$Br$_4$

abstract: Two-dimensional topological insulator features time-reversal-invariant spin-momentum-locked one-dimensional (1D) edge states with a linear energy dispersion. However, experimental access to 1D edge states is still of great challenge and only limited to few techniques to date. Here, by using infrared absorption spectroscopy, we observed robust topologically originated edge states in a-Bi4Br4 belts with definitive signature of strong infrared absorption at belt sides and distinct anisotropy with respect to light polarizations, which is further supported by first-principles calculations. Our work demonstrates for the first time that the infrared spectroscopy can offer a power-efficient approach in experimentally probing 1D edge states of topological materials.


title: Debiased Contrastive Learning

abstract: A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled datapoints, implicitly accepting that these points may, in reality, actually have the same label. Perhaps unsurprisingly, we observe that sampling negative examples from truly different labels improves performance, in a synthetic setting where labels are available. Motivated by this observation, we develop a debiased contrastive objective that corrects for the sampling of same-label datapoints, even without knowledge of the true labels. Empirically, the proposed objective consistently outperforms the state-of-the-art for representation learning in vision, language, and reinforcement learning benchmarks. Theoretically, we establish generalization bounds for the downstream classification task.


title: The NTT DCASE2020 Challenge Task 6 system: Automated Audio Captioning with Keywords and Sentence Length Estimation

abstract: This technical report describes the system participating to the Detection and Classification of Acoustic Scenes and Events (DCASE) 2020 Challenge, Task 6: automated audio captioning. Our submission focuses on solving two indeterminacy problems in automated audio captioning: word selection indeterminacy and sentence length indeterminacy. We simultaneously solve the main caption generation and sub indeterminacy problems by estimating keywords and sentence length through multi-task learning. We tested a simplified model of our submission using the development-testing dataset. Our model achieved 20.7 SPIDEr score where that of the baseline system was 5.4.


title: New Probes of Large Scale Structure

abstract: This is the second paper in a series where we propose a method of indirectly measuring large scale structure using information from small scale perturbations. The idea is to build a quadratic estimator from small scale modes that provides a map of structure on large scales. We demonstrated in the first paper that the quadratic estimator works well on a dark-matter-only N-body simulation at a snapshot of $z=0$. Here we generalize the theory to the case of a light cone halo catalog with a non-cubic region taken into consideration. We successfully apply the generalized version of the quadratic estimator to the light cone halo catalog based on an N-body simulation of volume $\sim15.03\,(h^{-1}\,\rm Gpc)^3$. The most distant point in the light cone is at a redshift of $1.42$, indicating the applicability of our method to next generation of galaxy surveys.


title: Casimir Effect in a Schwarzschild-Like Wormhole Spacetime

abstract: In this paper, we investigate the role of gravito-inertial effects on the Casimir energy of a massless scalar field confined between two parallel plates orbiting a static and zero tidal Schwarzschild-like wormhole, at zero temperature. Firstly, we obtain the metric in isotropic coordinates, finding the allowed angular velocities and the circular orbit radii for a material particle as well as for the photon. Following, we compute the changes induced by both gravity and rotation of the plates in the energy density of the quantum vacuum fluctuations associated to the scalar field, in the zero tidal approximation inside the cavity. Finally, the Casimir energy obtained for some these wormholes are graphically compared between themselves and also with those ones related to an Ellis wormhole as well as to a Schwarzschild black hole. With this, the gravito-inertial effects on the quantum vacuum fluctuations analyzed in this work allow to recognize and identify both the geometry and topology of the spacetime associated to each one of these objects.


title: Monitoring Depression Trend on Twitter during the COVID-19 Pandemic

abstract: The COVID-19 pandemic has severely affected people's daily lives and caused tremendous economic loss worldwide. However, its influence on people's mental health conditions has not received as much attention. To study this subject, we choose social media as our main data resource and create by far the largest English Twitter depression dataset containing 2,575 distinct identified depression users with their past tweets. To examine the effect of depression on people's Twitter language, we train three transformer-based depression classification models on the dataset, evaluate their performance with progressively increased training sizes, and compare the model's "tweet chunk"-level and user-level performances. Furthermore, inspired by psychological studies, we create a fusion classifier that combines deep learning model scores with psychological text features and users' demographic information and investigate these features' relations to depression signals. Finally, we demonstrate our model's capability of monitoring both group-level and population-level depression trends by presenting two of its applications during the COVID-19 pandemic. We hope this study can raise awareness among researchers and the general public of COVID-19's impact on people's mental health.


title: Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation

abstract: One of the most challenging topics in Natural Language Processing (NLP) is visually-grounded language understanding and reasoning. Outdoor vision-and-language navigation (VLN) is such a task where an agent follows natural language instructions and navigates a real-life urban environment. Due to the lack of human-annotated instructions that illustrate intricate urban scenes, outdoor VLN remains a challenging task to solve. This paper introduces a Multimodal Text Style Transfer (MTST) learning approach and leverages external multimodal resources to mitigate data scarcity in outdoor navigation tasks. We first enrich the navigation data by transferring the style of the instructions generated by Google Maps API, then pre-train the navigator with the augmented external outdoor navigation dataset. Experimental results show that our MTST learning approach is model-agnostic, and our MTST approach significantly outperforms the baseline models on the outdoor VLN task, improving task completion rate by 8.7% relatively on the test set.


title: Gravity Dual of Connes Cocycle Flow

abstract: We define the "kink transform" as a one-sided boost of bulk initial data about the Ryu-Takayanagi surface of a boundary cut. For a flat cut, we conjecture that the resulting Wheeler-DeWitt patch is the bulk dual to the boundary state obtained by Connes cocycle (CC) flow across the cut. The bulk patch is glued to a precursor slice related to the original boundary slice by a one-sided boost. This evades ultraviolet divergences and distinguishes our construction from one-sided modular flow. We verify that the kink transform is consistent with known properties of operator expectation values and subregion entropies under CC flow. CC flow generates a stress tensor shock at the cut, controlled by a shape derivative of the entropy; the kink transform reproduces this shock holographically by creating a bulk Weyl tensor shock. We also go beyond known properties of CC flow by deriving novel shock components from the kink transform.


title: Wrinkles, folds and ripplocations: unusual deformation structures of confined elastic sheets at non-zero temperatures

abstract: We study the deformation of a fluctuating crystalline sheet confined between two flat rigid walls as a simple model for layered solids where bonds among atoms {\it within} the same layer are much stronger than those {\it between} layers. When subjected to sufficiently high loads in an appropriate geometry, these solids deform and fail in unconventional ways. Recent experiments suggest that configurations named {\it ripplocations}, where a layer folds backwards over itself, are involved. These structures are distinct and separated by large free energy barriers from smooth {\it ripples} of the atomic layers that are always present at any non-zero temperature. We use Monte Carlo simulation in combination with an umbrella sampling technique to obtain conditions under which such structures form and study their specific experimental signatures.


title: Linear Convergent Decentralized Optimization with Compression

abstract: Communication compression has become a key strategy to speed up distributed optimization. However, existing decentralized algorithms with compression mainly focus on compressing DGD-type algorithms. They are unsatisfactory in terms of convergence rate, stability, and the capability to handle heterogeneous data. Motivated by primal-dual algorithms, this paper proposes the first \underline{L}in\underline{EA}r convergent \underline{D}ecentralized algorithm with compression, LEAD. Our theory describes the coupled dynamics of the inexact primal and dual update as well as compression error, and we provide the first consensus error bound in such settings without assuming bounded gradients. Experiments on convex problems validate our theoretical analysis, and empirical study on deep neural nets shows that LEAD is applicable to non-convex problems.


title: Optimal reinsurance and dividends with transaction costs and taxes under thinning structure

abstract: In this paper, we investigate the problem of optimal strategies of dividend and reinsurance under the Cram\'{e}r-Lundberg risk model embedded with the thinning-dependence structure which was firstly introduced by Wang and Yuen (2005), subject to the optimality criteria of maximizing the expected accumulated discounted dividends paid until ruin. To enhance the practical relevance of the optimal dividend and reinsurance problem, non-cheap reinsurance is considered and transaction costs and taxes are imposed on dividends, which converts our optimization problem into a mixed classical-impulse control problem. For the purpose of better mathematical tractability and neat, explicit solutions of our control problem, instead of the Cram\'er-Lundberg framework we study its approximated diffusion model with two thinly dependent classes of insurance businesses. Using a method of quasi-variational inequalities, we show that the optimal reinsurance follows a two-dimensional excess-of-loss reinsurance strategy, and, the optimal dividend strategy turns out to be an impulse dividend strategy with an upper and a lower barrier, i.e., every thing above the lower barrier is paid as dividends each time the surplus is above the upper barrier, otherwise no dividends are paid. Closed-form expression for the value function associated with the optimal dividend and reinsurance strategy is also given. In addition, some numerical examples are presented to illustrate the optimality results.


title: Algebraicity of the Bergman Kernel

abstract: Our main result introduces a new way to characterize two-dimensional finite ball quotients by algebraicity of their Bergman kernels. This characterization is particular to dimension two and fails in higher dimensions, as is illustrated by a counterexample in dimension three constructed in this paper. As a corollary of our main theorem, we prove, e.g., that a smoothly bounded strictly pseudoconvex domain G in $\mathbb{C}^2$ has rational Bergman kernel if and only if there is a rational biholomorphism from G to the 2-dimensional unit ball.


title: Thermodynamics of DNA-RNA renaturation

abstract: We consider a new model which consists of a DNA together with a RNA. Here we assume that DNA is from a mammal or bird but RNA comes from a virus. To study thermodynamic properties of this model we use methods of statistical mechanics, namely, the theory of Gibbs measures. We use these measures to describe phases (states) of the DNA-RNA system. Using a Markov chain (corresponding to Gibbs measure) we give conditions (on temperature) of DNA-RNA renaturation.


title: SemEval-2020 Task 4: Commonsense Validation and Explanation

abstract: In this paper, we present SemEval-2020 Task 4, Commonsense Validation and Explanation (ComVE), which includes three subtasks, aiming to evaluate whether a system can distinguish a natural language statement that makes sense to humans from one that does not, and provide the reasons. Specifically, in our first subtask, the participating systems are required to choose from two natural language statements of similar wording the one that makes sense and the one does not. The second subtask additionally asks a system to select the key reason from three options why a given statement does not make sense. In the third subtask, a participating system needs to generate the reason. We finally attracted 39 teams participating at least one of the three subtasks. For Subtask A and Subtask B, the performances of top-ranked systems are close to that of humans. However, for Subtask C, there is still a relatively large gap between systems and human performance. The dataset used in our task can be found at https://github.com/wangcunxiang/SemEval2020- Task4-Commonsense-Validation-and-Explanation; The leaderboard can be found at https://competitions.codalab.org/competitions/21080#results.


title: Unbiased Loss Functions for Extreme Classification With Missing Labels

abstract: The goal in extreme multi-label classification (XMC) is to tag an instance with a small subset of relevant labels from an extremely large set of possible labels. In addition to the computational burden arising from large number of training instances, features and labels, problems in XMC are faced with two statistical challenges, (i) large number of 'tail-labels' -- those which occur very infrequently, and (ii) missing labels as it is virtually impossible to manually assign every relevant label to an instance. In this work, we derive an unbiased estimator for general formulation of loss functions which decompose over labels, and then infer the forms for commonly used loss functions such as hinge- and squared-hinge-loss and binary cross-entropy loss. We show that the derived unbiased estimators, in the form of appropriate weighting factors, can be easily incorporated in state-of-the-art algorithms for extreme classification, thereby scaling to datasets with hundreds of thousand labels. However, empirically, we find a slightly altered version that gives more relative weight to tail labels to perform even better. We suspect is due to the label imbalance in the dataset, which is not explicitly addressed by our theoretically derived estimator. Minimizing the proposed loss functions leads to significant improvement over existing methods (up to 20% in some cases) on benchmark datasets in XMC.


title: Popper's falsification and corroboration from the statistical perspectives

abstract: The role of probability appears unchallenged as the key measure of uncertainty, used among other things for practical induction in the empirical sciences. Yet, Popper was emphatic in his rejection of inductive probability and of the logical probability of hypotheses; furthermore, for him, the degree of corroboration cannot be a probability. Instead he proposed a deductive method of testing. In many ways this dialectic tension has many parallels in statistics, with the Bayesians on logico-inductive side vs the non-Bayesians or the frequentists on the other side. Simplistically Popper seems to be on the frequentist side, but recent synthesis on the non-Bayesian side might direct the Popperian views to a more nuanced destination. Logical probability seems perfectly suited to measure partial evidence or support, so what can we use if we are to reject it? For the past 100 years, statisticians have also developed a related concept called likelihood, which has played a central role in statistical modelling and inference. Remarkably, this Fisherian concept of uncertainty is largely unknown or at least severely under-appreciated in non-statistical literature. As a measure of corroboration, the likelihood satisfies the Popperian requirement that it is not a probability. Our aim is to introduce the likelihood and its recent extension via a discussion of two well-known logical fallacies in order to highlight that its lack of recognition may have led to unnecessary confusion in our discourse about falsification and corroboration of hypotheses. We highlight the 100 years of development of likelihood concepts. The year 2021 will mark the 100-year anniversary of the likelihood, so with this paper we wish it a long life and increased appreciation in non-statistical literature.


title: Zonally opposing shifts of the intertropical convergence zone in response to climate change

abstract: Future changes in the location of the intertropical convergence zone (ITCZ) due to climate change are of high interest since they could substantially alter precipitation patterns in the tropics and subtropics. Although models predict a future narrowing of the ITCZ during the 21st century in response to climate warming, uncertainties remain large regarding its future position, with most past work focusing on the zonal-mean ITCZ shifts. Here we use projections from 27 state-of-the-art climate models (CMIP6) to investigate future changes in ITCZ location as a function of longitude and season, in response to climate warming. We document a robust zonally opposing response of the ITCZ, with a northward shift over eastern Africa and the Indian Ocean, and a southward shift in the eastern Pacific and Atlantic Ocean by 2100, for the SSP3-7.0 scenario. Using a two-dimensional energetics framework, we find that the revealed ITCZ response is consistent with future changes in the divergent atmospheric energy transport over the tropics, and sector-mean shifts of the energy flux equator (EFE). The changes in the EFE appear to be the result of zonally opposing imbalances in the hemispheric atmospheric heating over the two sectors, consisting of increases in atmospheric heating over Eurasia and cooling over the Southern Ocean, which contrast with atmospheric cooling over the North Atlantic Ocean due to a model-projected weakening of the Atlantic meridional overturning circulation.


title: Temporal Calibrated Regularization for Robust Noisy Label Learning

abstract: Deep neural networks (DNNs) exhibit great success on many tasks with the help of large-scale well annotated datasets. However, labeling large-scale data can be very costly and error-prone so that it is difficult to guarantee the annotation quality (i.e., having noisy labels). Training on these noisy labeled datasets may adversely deteriorate their generalization performance. Existing methods either rely on complex training stage division or bring too much computation for marginal performance improvement. In this paper, we propose a Temporal Calibrated Regularization (TCR), in which we utilize the original labels and the predictions in the previous epoch together to make DNN inherit the simple pattern it has learned with little overhead. We conduct extensive experiments on various neural network architectures and datasets, and find that it consistently enhances the robustness of DNNs to label noise.


title: Towards Direct Numerical Simulation of a 5x5 Rod Bundle

abstract: Rod bundle flows are prevalent in nuclear engineering for both light water reactors (LWR) and advanced reactor concepts. Unlike canonical channel flow, the flow in rod bundles presents some unique characteristics, notably due to the inhomogeneous cross section which can present different local conditions of turbulence as well as localized effects characteristic of external flows. Despite the ubiquity of rod bundle flows and the decades of experimental and numerical knowledge acquired in this field, there are no publicly available direct numerical simulations (DNS) of the flow in multiple pin rod bundles with heat transfer. A multiple pin DNS study is of great value as it would allow for assessment of the reliability of various turbulence models in the presence of heat transfer, as well as allow for a deeper understanding of the flow physics. We present work towards DNS of the flow in a square 5x5 rod bundle representative of LWR fuel. We consider standard configurations as well as configurations where the central pin is replaced with a guide thimble. We perform simulations in STAR-CCM+ to design the numerical DNS, which is to be conducted using the open source spectral element code Nek5000. Large Eddy Simulations are also performed in Nek5000 to confirm that the resolution requirements are adequate. We compare results from STAR-CCM+ and Nek5000, which show very good agreement in the wide gaps with larger discrepancies in the narrow gaps. In particular, evidence of a gap vortex street is seen in the edge subchannels in LES but is not predicted by STAR-CCM+.


title: Random projection of Linear and Semidefinite problem with linear inequalities

abstract: The Johnson-Lindenstrauss Lemma states that there exist linear maps that project a set of points of a vector space into a space of much lower dimension such that the Euclidean distance between these points is approximately preserved. This lemma has been previously used to prove that we can randomly aggregate, using a random matrix whose entries are drawn from a zero-mean sub-Gaussian distribution, the equality constraints of an Linear Program (LP) while preserving approximately the value of the problem. In this paper we extend these results to the inequality case by introducing a random matrix with non-negative entries that allows to randomly aggregate inequality constraints of an LP while preserving approximately the value of the problem. By duality, the approach we propose allows to reduce both the number of constraints and the dimension of the problem while obtaining some theoretical guarantees on the optimal value. We will also show an extension of our results to certain semidefinite programming instances.


title: BiO-Net: Learning Recurrent Bi-directional Connections for Encoder-Decoder Architecture

abstract: U-Net has become one of the state-of-the-art deep learning-based approaches for modern computer vision tasks such as semantic segmentation, super resolution, image denoising, and inpainting. Previous extensions of U-Net have focused mainly on the modification of its existing building blocks or the development of new functional modules for performance gains. As a result, these variants usually lead to an unneglectable increase in model complexity. To tackle this issue in such U-Net variants, in this paper, we present a novel Bi-directional O-shape network (BiO-Net) that reuses the building blocks in a recurrent manner without introducing any extra parameters. Our proposed bi-directional skip connections can be directly adopted into any encoder-decoder architecture to further enhance its capabilities in various task domains. We evaluated our method on various medical image analysis tasks and the results show that our BiO-Net significantly outperforms the vanilla U-Net as well as other state-of-the-art methods. Our code is available at https://github.com/tiangexiang/BiO-Net.


title: UAV-Assisted Attack Prevention, Detection, and Recovery of 5G Networks

abstract: Unmanned aerial vehicles (UAVs) are emerging as enablers for supporting many applications and services, such as precision agriculture, search and rescue, temporary network deployment or coverage extension, and security. UAVs are being considered for integration into emerging 5G networks as aerial users or network support nodes. We propose to leverage UAVs in 5G to assist in the prevention, detection, and recovery of attacks on 5G networks. Specifically, we consider jamming, spoofing, eavesdropping and the corresponding mitigation mechanisms that are enabled by the versatility of UAVs. We introduce the hot zone, safe zone and UAV-based secondary authorization entity, among others, to increase the resilience and confidentiality of 5G radio access networks and services. We present simulation results and discuss open issues and research directions, including the need for experimental evaluation and a research platform for prototyping and testing the proposed technologies.


title: Fighting Failures with FIRE: Failure Identification to Reduce Expert Burden in Intervention-Based Learning

abstract: Supervised imitation learning, also known as behavioral cloning, suffers from distribution drift leading to failures during policy execution. One approach to mitigate this issue is to allow an expert to correct the agent's actions during task execution, based on the expert's determination that the agent has reached a `point of no return.' The agent's policy is then retrained using this new corrective data. This approach alone can enable high-performance agents to be learned, but at a substantial cost: the expert must vigilantly observe execution until the policy reaches a specified level of success, and even at that point, there is no guarantee that the policy will always succeed. To address these limitations, we present FIRE (Failure Identification to Reduce Expert Burden in intervention-based learning), a system that can predict when a running policy will fail, halt its execution, and request a correction from the expert. Unlike existing approaches that learn only from expert data, our approach learns from both expert and non-expert data, akin to adversarial learning. We demonstrate experimentally for a series of challenging manipulation tasks that our method is able to recognize state-action pairs that lead to failures. This permits seamless integration into an intervention-based learning system, where we show an order-of-magnitude gain in sample efficiency compared with a state-of-the-art inverse reinforcement learning method and dramatically improved performance over an equivalent amount of data learned with behavioral cloning.


title: Optimizing Quantum Teleportation and Dense Coding via Mixed Noise Under Non-Markovian Approximation

abstract: Physicists are attracted to open-system dynamics, how quantum systems evolve, and how they can protected from unnecessary environmental noise, especially environmental memory effects are not negligible, as with non-Markovian approximations. There are several methods to solve master equation of non-Markovian cases, we obtain the solutions of quantum-state-diffusion equation for a two qubit system using perturbation method, which under influence of various types of environmental noises, i.e., relaxation, dephasing and mix of them. We found that mixing these two types of noises benefit the quantum teleportation and quantum super-dense coding, that by introducing strong magnetic field on the relaxation processes will enhance quantum correlation in some time-scale.


title: A Unified Framework for Adjustable Robust Optimization with Endogenous Uncertainty

abstract: This work proposes a framework for multistage adjustable robust optimization that unifies the treatment of three different types of endogenous uncertainty, where decisions, respectively, (i) alter the uncertainty set, (ii) affect the materialization of uncertain parameters, and (iii) determine the time when the true values of uncertain parameters are observed. We provide a systematic analysis of the different types of endogenous uncertainty and highlight the connection between optimization under endogenous uncertainty and active learning. We consider decision-dependent polyhedral uncertainty sets and propose a decision rule approach that incorporates both continuous and binary recourse, including recourse decisions that affect the uncertainty set. The proposed method enables the modeling of decision-dependent nonanticipativity and results in a tractable reformulation of the problem. We demonstrate the effectiveness of the approach in computational experiments that cover a range of applications, including plant redesign, maintenance planning with inspections, optimizing revision points in capacity planning, and production scheduling with active parameter estimation. The results show significant benefits from the proper modeling of endogenous uncertainty and active learning.


title: Non-Homogeneous Poisson Process Intensity Modeling and Estimation using Measure Transport

abstract: Non-homogeneous Poisson processes are used in a wide range of scientific disciplines, ranging from the environmental sciences to the health sciences. Often, the central object of interest in a point process is the underlying intensity function. Here, we present a general model for the intensity function of a non-homogeneous Poisson process using measure transport. The model is built from a flexible bijective mapping that maps from the underlying intensity function of interest to a simpler reference intensity function. We enforce bijectivity by modeling the map as a composition of multiple simple bijective maps, and show that the model exhibits an important approximation property. Estimation of the flexible mapping is accomplished within an optimization framework, wherein computations are efficiently done using recent technological advances in deep learning and a graphics processing unit. Although we find that intensity function estimates obtained with our method are not necessarily superior to those obtained using conventional methods, the modeling representation brings with it other advantages such as facilitated point process simulation and uncertainty quantification. Modeling point processes in higher dimensions is also facilitated using our approach. We illustrate the use of our model on both simulated data, and a real data set containing the locations of seismic events near Fiji since 1964.


title: A theoretical framework for Koopman analyses of fluid flows, part 1: local Koopman spectrum and properties

abstract: Local Koopman spectral problem is studied to resolve all dynamics for a nonlinear system. The proposed spectral problem is compatible with the linear spectral theory for various linear systems, and several properties of local Koopman spectrums are discovered. Firstly, proliferation rule is discovered for nonlinear observables and it applies to nonlinear systems recursively. Secondly, the hierarchy structure of Koopman eigenspace of nonlinear dynamics is revealed since dynamics can be decomposed into the base and perturbation parts, where the former can be analyzed analytically or numerically and the latter is further divided into linear and nonlinear parts. The linear part can be analyzed by the linear spectrums theory. They are then recursively proliferated to infinite numbers for the nonlinear part. Thirdly, local Koopman spectrums and eigenfunctions change continuously and analytically in the whole manifold under suitable conditions, derived from operator perturbation theory. Two cases of fluid dynamics are numerically studied. One is the two-dimensional flow past cylinder at the Hopf-bifurcation near the critical Reynolds number. Two asymptotic stages, flow systems around an unstable fixed point and a stable limit cycle were studied separately by the DMD algorithm. The triad-chain and the lattice distribution of Koopman spectrums confirmed the proliferation rule and hierarchy structure of Koopman eigenspace. Another example is the three-dimensional secondary instability of flow past a fixed cylinder, where the Fourier modes, Floquet modes, and high-order Koopman modes characterizing the main structure of the flow are discovered.


title: The theoretical study on intermittency and propagation of geodesic acoustic mode in L- mode discharge near tokamak edge

abstract: Through a systematically developed theory, we demonstrate that the motion of instanton identified in [Y. Z. Zhang, Z. Y. Liu, T. Xie, S. M. Mahajan, and J. Liu, Physics of Plasmas 24, 122304 (2017)] is highly correlated to the intermittent excitation and propagation of geodesic acoustic mode (GAM) that are observed in tokamaks. While many numerical simulations have observed the phenomena, it is the first theory that reveals the physical mechanism behind GAM intermittent excitation and propagation. The preceding work is based on the micro-turbulence associated with toroidal ion temperature gradient (ITG) mode, and slab-based phenomenological model of zonal flow. When full toroidal effect are introduced into the system, two branches of zonal flow emerge: the torus-modified low frequency zonal flow (TLFZF), and GAM, necessitating a unified exploration of GAM and TLFZF. Indeed, we observe that the transition (decay) from the caviton to instanton is triggered by a rapid zero-crossing of radial group velocity of drift wave and is found to be strongly correlated with the GAM onset. Many features peculiar to intermittent GAMs, observed in real machines, are thus identified in the numerical experiment. The results will be displayed in figures and in a movie; first for single central rational surface, and then with coupled multiple central rational surfaces. The periodic bursting first shown disappears as being replaced by irregular one, more similar to the intermittent characteristics observed in GAM experiments.


title: Unifying Model Explainability and Robustness via Machine-Checkable Concepts

abstract: As deep neural networks (DNNs) get adopted in an ever-increasing number of applications, explainability has emerged as a crucial desideratum for these models. In many real-world tasks, one of the principal reasons for requiring explainability is to in turn assess prediction robustness, where predictions (i.e., class labels) that do not conform to their respective explanations (e.g., presence or absence of a concept in the input) are deemed to be unreliable. However, most, if not all, prior methods for checking explanation-conformity (e.g., LIME, TCAV, saliency maps) require significant manual intervention, which hinders their large-scale deployability. In this paper, we propose a robustness-assessment framework, at the core of which is the idea of using machine-checkable concepts. Our framework defines a large number of concepts that the DNN explanations could be based on and performs the explanation-conformity check at test time to assess prediction robustness. Both steps are executed in an automated manner without requiring any human intervention and are easily scaled to datasets with a very large number of classes. Experiments on real-world datasets and human surveys show that our framework is able to enhance prediction robustness significantly: the predictions marked to be robust by our framework have significantly higher accuracy and are more robust to adversarial perturbations.


title: The intermittent excitation of geodesic acoustic mode by nonlinear Instanton of electron drift wave envelope in L-mode discharge near tokamak edge

abstract: There are two distinct phases in the evolution of drift wave envelope in the presence of zonal flow. A long-lived standing wave phase, which we call the Caviton, and a short-lived traveling wave phase (in radial direction) we call the Instanton. For drift wave turbulence driven by ion temperature gradient mode (ITG), these two stages of dynamics were displayed in [Zhang Y Z, Liu Z Y, Xie T, Mahajan S M and Liu J 2017 Physics of Plasmas 24 122304]. In this paper we show that the dynamical attributes of ITG turbulence are readily replicated when the turbulence rotates in the electron direction; our model calculation deals specifically with the toroidal electron drift waves (EDW) in the well-known \delta_e model. While the basic calculations are presented in parallel to the ITG counterpart, more emphasis is laid here on the motion of Instanton; several abrupt phenomena observed in tokamaks, such as intermittent excitation of geodesic acoustic mode (GAM) shown in this paper, could be attributed to the sudden and fast radial motion of Instanton. The calculation brings out the defining characteristics of the Instanton: it begins as a linear traveling wave right after the transition. Then, it evolves to a nonlinear stage with increasing frequency all the way to 20 kHz. The modulation to Reynolds stress in zonal flow equation will cause resonant excitation to GAM. The intermittency is shown due to the random phase mixing between multiple central rational surfaces in the reaction region.


title: Private Speech Classification with Secure Multiparty Computation

abstract: Deep learning in audio signal processing, such as human voice audio signal classification, is a rich application area of machine learning. Legitimate use cases include voice authentication, gunfire detection, and emotion recognition. While there are clear advantages to automated human speech classification, application developers can gain knowledge beyond the professed scope from unprotected audio signal processing. In this paper we propose the first privacy-preserving solution for deep learning-based audio classification that is provably secure. Our approach, which is based on Secure Multiparty Computation, allows to classify a speech signal of one party (Alice) with a deep neural network of another party (Bob) without Bob ever seeing Alice's speech signal in an unencrypted manner. As threat models, we consider both passive security, i.e. with semi-honest parties who follow the instructions of the cryptographic protocols, as well as active security, i.e. with malicious parties who deviate from the protocols. We evaluate the efficiency-security-accuracy trade-off of the proposed solution in a use case for privacy-preserving emotion detection from speech with a convolutional neural network. In the semi-honest case we can classify a speech signal in under 0.3 sec; in the malicious case it takes $\sim$1.6 sec. In both cases there is no leakage of information, and we achieve classification accuracies that are the same as when computations are done on unencrypted data.


title: Construction of confidence interval for a univariate stock price signal predicted through Long Short Term Memory Network

abstract: In this paper, we show an innovative way to construct bootstrap confidence interval of a signal estimated based on a univariate LSTM model. We take three different types of bootstrap methods for dependent set up. We prescribe some useful suggestions to select the optimal block length while performing the bootstrapping of the sample. We also propose a benchmark to compare the confidence interval measured through different bootstrap strategies. We illustrate the experimental results through some stock price data set.


title: Photon-Dressed Bloch-Siegert Shift in an Ultrastrongly Coupled Circuit Quantum Electrodynamical System

abstract: A cavity quantum electrodynamical (QED) system beyond the strong-coupling regime is expected to exhibit intriguing quantum phenomena. Here we report a direct measurement of the photon-dressed qubit transition frequencies up to four photons by harnessing the same type of state transitions in an ultrastrongly coupled circuit-QED system realized by inductively coupling a superconducting flux qubit to a coplanar-waveguide resonator. This demonstrates a convincing observation of the photon-dressed Bloch-Siegert shift in the ultrastrongly coupled quantum system. Moreover, our results show that the photon-dressed Bloch-Siegert shift becomes more pronounced as the photon number increases, which is a characteristic of the quantum Rabi model.


title: On the Latency, Rate and Reliability Tradeoff in Wireless Networked Control Systems for IIoT

abstract: Wireless networked control systems (WNCSs) provide a key enabling technique for Industry Internet of Things (IIoT). However, in the literature of WNCSs, most of the research focuses on the control perspective, and has considered oversimplified models of wireless communications which do not capture the key parameters of a practical wireless communication system, such as latency, data rate and reliability. In this paper, we focus on a WNCS, where a controller transmits quantized and encoded control codewords to a remote actuator through a wireless channel, and adopt a detailed model of the wireless communication system, which jointly considers the inter-related communication parameters. We derive the stability region of the WNCS. If and only if the tuple of the communication parameters lies in the region, the average cost function, i.e., a performance metric of the WNCS, is bounded. We further obtain a necessary and sufficient condition under which the stability region is $n$-bounded, where $n$ is the control codeword blocklength. We also analyze the average cost function of the WNCS. Such analysis is non-trivial because the finite-bit control-signal quantizer introduces a non-linear and discontinuous quantization function which makes the performance analysis very difficult. We derive tight upper and lower bounds on the average cost function in terms of latency, data rate and reliability. Our analytical results provide important insights into the design of the optimal parameters to minimize the average cost within the stability region.


title: So What's the Plan? Mining Strategic Planning Documents

abstract: In this paper we present a corpus of Russian strategic planning documents, RuREBus. This project is grounded both from language technology and e-government perspectives. Not only new language sources and tools are being developed, but also their applications to e-goverment research. We demonstrate the pipeline for creating a text corpus from scratch. First, the annotation schema is designed. Next texts are marked up using human-in-the-loop strategy, so that preliminary annotations are derived from a machine learning model and are manually corrected. The amount of annotated texts is large enough to showcase what insights can be gained from RuREBus.


title: LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping

abstract: We propose a framework for tightly-coupled lidar inertial odometry via smoothing and mapping, LIO-SAM, that achieves highly accurate, real-time mobile robot trajectory estimation and map-building. LIO-SAM formulates lidar-inertial odometry atop a factor graph, allowing a multitude of relative and absolute measurements, including loop closures, to be incorporated from different sources as factors into the system. The estimated motion from inertial measurement unit (IMU) pre-integration de-skews point clouds and produces an initial guess for lidar odometry optimization. The obtained lidar odometry solution is used to estimate the bias of the IMU. To ensure high performance in real-time, we marginalize old lidar scans for pose optimization, rather than matching lidar scans to a global map. Scan-matching at a local scale instead of a global scale significantly improves the real-time performance of the system, as does the selective introduction of keyframes, and an efficient sliding window approach that registers a new keyframe to a fixed-size set of prior ``sub-keyframes.'' The proposed method is extensively evaluated on datasets gathered from three platforms over various scales and environments.


title: Immersion and clustered coloring

abstract: Hadwiger and Haj\'{o}s conjectured that for every positive integer $t$, $K_{t+1}$-minor free graphs and $K_{t+1}$-topological minor free graphs are properly $t$-colorable, respectively. Clustered coloring version of these two conjectures which only require monochromatic components to have bounded size has been extensively studied. In this paper we consider the clustered coloring version of the immersion-variant of Hadwiger's and Haj\'{o}s' conjecture proposed by Lescure and Meyniel and independently by Abu-Khzam and Langston. We determine the minimum number of required colors for $H$-immersion free graphs, for any fixed graph $H$, up to a small additive absolute constant. Our result is tight for infinitely many graphs $H$. A key machinery developed in this paper is a lemma that reduces a clustering coloring problem on graphs to the one on the torsos of their tree-cut decomposition or tree-decomposition. A byproduct of this machinery is a unified proof of a result of Alon, Ding, Oporowski and Vertigan and a result of the author and Oum about clustered coloring graphs of bounded maximum degree in minor-closed families.


title: Precision Timing of PSR J0437-4715 with the IAR Observatory and Implications for Low-Frequency Gravitational Wave Source Sensitivity

abstract: While observations of many high-precision radio pulsars of order $\lesssim1~\mu$s across the sky are needed for the detection and characterization of a stochastic background of low-frequency gravitational waves (GWs), sensitivity to single sources of GWs requires even higher timing precision. The Argentine Institute of Radio Astronomy (IAR; Instituto Argentino de Radioastronom\'ia) has begun observations of the brightest-known millisecond pulsar, J0437$-$4715. Even though the two antennas are smaller than other single-dish telescopes previously used for pulsar timing array (PTA) science, the IAR's capability to monitor this pulsar daily coupled with the pulsar's brightness allows for high-precision pulse arrival-time measurements. While upgrades of the facility are currently underway, we show that modest improvements beyond current plans will provide IAR with unparalleled sensitivity to this pulsar. The most stringent upper limits on single GW sources come from the North American Nanohertz Observatory for Gravitational Waves (NANOGrav). Observations of PSR J0437$-$4715 will provide a significant sensitivity increase in NANOGrav's "blind spot" in the sky where fewer pulsars are currently being observed. With state-of-the-art instrumentation installed, we estimate the array's sensitivity will improve by a factor of $\approx$2-4 over 10 years for 20% of the sky with the inclusion of this pulsar as compared to a static version of the PTA used in NANOGrav's most recent limits. More modest instrumentation result in factors of $\approx$1.4-3. We identify four other candidate pulsars as suitable for inclusion in PTA efforts. International PTA efforts will also benefit from inclusion of these data given the potential achievable sensitivity.


title: Photoassociation of ultracold long-range polyatomic molecules

abstract: We explore the feasibility of optically forming long-range tetratomic and larger polyatomic molecules in their ground electronic state from ultracold pairs of polar molecules aligned by external fields. Depending on the relative orientation of the interacting diatomic molecules, we find that a tetratomic can be formed either as a weakly bound complex in a very extended halo state or as a pure long-range molecule composed of collinear or nearly-collinear diatomic molecules. The latter is a novel type of tetratomic molecule comprised of two diatomic molecules bound at long intermolecular range and predicted to be stable in cold and ultracold regimes. Our numerical studies were conducted for ultracold KRb and RbCs, resulting in production of (KRb)$_2$ and (RbCs)$_2$ complexes, respectively. Based on universal properties of long-range interactions between polar molecules, we identify triatomic and tetratomic linear polar molecules with favorable ratio of dipole and quadrupole moments for which the apporach could be generalized to form polyatomic molecules.


title: Magnetic asymmetry induced anomalous spin-orbit torque in IrMn

abstract: We demonstrate an anomalous spin-orbit torque induced by the broken magnetic symmetry in the antiferromagnet IrMn. We study the magnetic structure of three phases of IrMn thin films using neutron diffraction technique. The magnetic mirror symmetry M' is broken laterally in both L10-IrMn and L12-IrMn3 but not {\gamma}-IrMn3. We observe an out-of-plane damping-like spin-orbit torque in both L10-IrMn/permalloy and L12-IrMn3/permalloy bilayers but not in {\gamma}-IrMn3/permalloy. This is consistent with both the symmetry analysis on the effects of a broken M' on spin-orbit torque and the theoretical predictions of the spin Hall effect and the Rashba-Edelstein effect. In addition, the measured spin-orbit torque efficiencies are 0.61+-0.01, 1.01+-0.03 and 0.80+-0.01 for the L10, L12 and {\gamma} phases, respectively. Our work highlights the critical roles of the magnetic asymmetry in spin-orbit torque generation.


title: Mobile Botnet Detection: A Deep Learning Approach Using Convolutional Neural Networks

abstract: Android, being the most widespread mobile operating systems is increasingly becoming a target for malware. Malicious apps designed to turn mobile devices into bots that may form part of a larger botnet have become quite common, thus posing a serious threat. This calls for more effective methods to detect botnets on the Android platform. Hence, in this paper, we present a deep learning approach for Android botnet detection based on Convolutional Neural Networks (CNN). Our proposed botnet detection system is implemented as a CNN-based model that is trained on 342 static app features to distinguish between botnet apps and normal apps. The trained botnet detection model was evaluated on a set of 6,802 real applications containing 1,929 botnets from the publicly available ISCX botnet dataset. The results show that our CNN-based approach had the highest overall prediction accuracy compared to other popular machine learning classifiers. Furthermore, the performance results observed from our model were better than those reported in previous studies on machine learning based Android botnet detection.


title: Ultralong carrier lifetime of topological edge states in a-Bi4Br4

abstract: The rising of quantum spin Hall insulators (QSHI) in two-dimensional (2D) systems has been attracting significant interest in current research, for which the 1D helical edge states, a hallmark of QSHI, are widely expected to be a promising platform for next-generation optoelectronics. However, the dynamics of the 1D edge states has not yet been experimentally addressed. Here, we report the observation of optical response of the topological helical edge states in a-Bi4Br4, using the infrared-pump infrared-probe microscopic spectroscopy. Remarkably, we observe that the carrier lifetime of the helical edge states reaches nanosecond-scale at room temperature, which is about 2 - 3 orders longer than that of most 2D topological surface states and is even comparable with that of the well developed optoelectronics semiconductors used in modern industry. The ultralong carrier lifetime of the topological edge states may be attributed to their helical and 1D nature. Our findings not only provide an ideal material for further investigations of the carrier dynamics of 1D helical edge states but also pave the way for its application in optoelectronics.


title: Enhancing the Association in Multi-Object Tracking via Neighbor Graph

abstract: Most modern multi-object tracking (MOT) systems follow the tracking-by-detection paradigm. It first localizes the objects of interest, then extracting their individual appearance features to make data association. The individual features, however, are susceptible to the negative effects as occlusions, illumination variations and inaccurate detections, thus resulting in the mismatch in the association inference. In this work, we propose to handle this problem via making full use of the neighboring information. Our motivations derive from the observations that people tend to move in a group. As such, when an individual target's appearance is seriously changed, we can still identify it with the help of its neighbors. To this end, we first utilize the spatio-temporal relations produced by the tracking self to efficiently select suitable neighbors for the targets. Subsequently, we construct neighbor graph of the target and neighbors then employ the graph convolution networks (GCN) to learn the graph features. To the best of our knowledge, it is the first time to exploit neighbor cues via GCN in MOT. Finally, we test our approach on the MOT benchmarks and achieve state-of-the-art performance in online tracking.


title: Latent Compositional Representations Improve Systematic Generalization in Grounded Question Answering

abstract: Answering questions that involve multi-step reasoning requires decomposing them and using the answers of intermediate steps to reach the final answer. However, state-of-the-art models in grounded question answering often do not explicitly perform decomposition, leading to difficulties in generalization to out-of-distribution examples. In this work, we propose a model that computes a representation and denotation for all question spans in a bottom-up, compositional manner using a CKY-style parser. Our model induces latent trees, driven by end-to-end (the answer) supervision only. We show that this inductive bias towards tree structures dramatically improves systematic generalization to out-of-distribution examples, compared to strong baselines on an arithmetic expressions benchmark as well as on CLOSURE, a dataset that focuses on systematic generalization for grounded question answering. On this challenging dataset, our model reaches an accuracy of 96.1%, significantly higher than prior models that almost perfectly solve the task on a random, in-distribution split.


title: Reconstructing regime-dependent causal relationships from observational time series

abstract: Inferring causal relations from observational time series data is a key problem across science and engineering whenever experimental interventions are infeasible or unethical. Increasing data availability over the past decades has spurred the development of a plethora of causal discovery methods, each addressing particular challenges of this difficult task. In this paper we focus on an important challenge that is at the core of time series causal discovery: regime-dependent causal relations. Often dynamical systems feature transitions depending on some, often persistent, unobserved background regime, and different regimes may exhibit different causal relations. Here, we assume a persistent and discrete regime variable leading to a finite number of regimes within which we may assume stationary causal relations. To detect regime-dependent causal relations, we combine the conditional independence-based PCMCI method with a regime learning optimisation approach. PCMCI allows for linear and nonlinear, high-dimensional time series causal discovery. Our method, Regime-PCMCI, is evaluated on a number of numerical experiments demonstrating that it can distinguish regimes with different causal directions, time lags, effects and sign of causal links, as well as changes in the variables' autocorrelation. Further, Regime-PCMCI is employed to observations of El Ni\~no Southern Oscillation and Indian rainfall, demonstrating skill also in real-world datasets.


title: Reply to Zhang et al.: Linear regression does not encapsulate the effect of non-pharmaceutical interventions on the number of COVID-19 cases

abstract: Zhang et al. (2020) used linear regression to quantify the effect of lockdowns on the number of cases of COVID-19. We show using differential equations from the susceptible-exposed-infected-recovered (SEIR) model and with an example from another location not previously considered that the Zhang et al. analysis should not be considered sound evidence that mask mandates are sufficient to control or the primary factor controlling the spread of COVID-19.


title: Density of diagonalizable matrices in sets of structured matrices defined from indefinite scalar products

abstract: For an (indefinite) scalar product $[x,y]_B = x^HBy$ for $B= \pm B^H \in Gl_n(\mathbb{C})$ on $\mathbb{C}^n \times \mathbb{C}^n$ we show that the set of diagonalizable matrices is dense in the set of all $B$-selfadjoint, $B$-skewadjoint, $B$-unitary and $B$-normal matrices.


title: The Cassels heights of cyclotomic integers

abstract: We study the set $\mathscr C$ of mean square values of the moduli of the conjugates of cyclotomic integers $\beta$. For its $k$th derived set $\mathscr C^{(k)}$, we show that $\mathscr C^{(k)}=(k+1)\mathscr C\,\, (k\ge 0)$, so that also ${\mathscr C}^{(k)}+{\mathscr C}^{(\ell)}={\mathscr C}^{(k+\ell+1)}\,\,(k,\ell\ge 0)$. We also calculate the order type of $\mathscr C$, and show that it is the same as that of the set of PV numbers. Furthermore, we describe precisely the restricted set $\mathscr C_p$ where the $\beta$ are confined to the ring $\mathbb Z[\omega_p]$, where $p$ is an odd prime and $\omega_p$ is a primitive $p$th root of unity. In order to do this, we prove that both of the quadratic polynomials $a^2+ab+b^2+c^2+a+b+c$ and $a^2+b^2+c^2+ab+bc+ca+a+b+c$ are universal.


title: TransINT: Embedding Implication Rules in Knowledge Graphs with Isomorphic Intersections of Linear Subspaces

abstract: Knowledge Graphs (KG), composed of entities and relations, provide a structured representation of knowledge. For easy access to statistical approaches on relational data, multiple methods to embed a KG into f(KG) $\in$ R^d have been introduced. We propose TransINT, a novel and interpretable KG embedding method that isomorphically preserves the implication ordering among relations in the embedding space. Given implication rules, TransINT maps set of entities (tied by a relation) to continuous sets of vectors that are inclusion-ordered isomorphically to relation implications. With a novel parameter sharing scheme, TransINT enables automatic training on missing but implied facts without rule grounding. On a benchmark dataset, we outperform the best existing state-of-the-art rule integration embedding methods with significant margins in link Prediction and triple Classification. The angles between the continuous sets embedded by TransINT provide an interpretable way to mine semantic relatedness and implication rules among relations.


title: Exploring the time-domain deep attractor network with two-stream architectures in a reverberant environment

abstract: Deep attractor networks (DANs) perform speech separation with discriminative embeddings and speaker attractors. Compared with methods based on the permutation invariant training (PIT), DANs define a deep embedding space and deliver a more elaborate representation on each time-frequency (T-F) bin. However, it has been observed that the DANs achieve limited improvement on the signal quality if directly deployed in a reverberant environment. Following the success of time-domain separation networks on the clean mixture speech, we propose a time-domain DAN (TD-DAN) with two-streams of convolutional networks, which efficiently perform both dereverberation and separation tasks under the condition of a variable number of speakers. The speaker encoding stream (SES) of the TD-DAN is trained to model the speaker information in the embedding space. The speech decoding stream (SDS) accepts speaker attractors from the SES and learns to estimate early reflections from the spectro-temporal representations. Meanwhile, additional clustering losses are used to bridge the gap between the oracle and the estimated attractors. Experiments were conducted on the Spatialized Multi-Speaker Wall Street Journal (SMS-WSJ) dataset. The early reflection was compared with the anechoic and reverberant signals and then was chosen as the learning targets. The experimental results demonstrated that the TD-DAN achieved scale-invariant source-to-distortion ratio (SI-SDR) gains of 9.79/7.47 dB on the reverberant 2/3-speaker evaluation set, exceeding the baseline DAN and convolutional time-domain audio separation network (Conv-TasNet) by 1.92/0.68 dB and 0.91/0.47 dB, respectively.


title: When are Google data useful to nowcast GDP? An approach via pre-selection and shrinkage

abstract: Alternative data sets are widely used for macroeconomic nowcasting together with machine learning--based tools. The latter are often applied without a complete picture of their theoretical nowcasting properties. Against this background, this paper proposes a theoretically grounded nowcasting methodology that allows researchers to incorporate alternative Google Search Data (GSD) among the predictors and that combines targeted preselection, Ridge regularization, and Generalized Cross Validation. Breaking with most existing literature, which focuses on asymptotic in-sample theoretical properties, we establish the theoretical out-of-sample properties of our methodology and support them by Monte-Carlo simulations. We apply our methodology to GSD to nowcast GDP growth rate of several countries during various economic periods. Our empirical findings support the idea that GSD tend to increase nowcasting accuracy, even after controlling for official variables, but that the gain differs between periods of recessions and of macroeconomic stability.


title: Consistent Independent Low-Rank Matrix Analysis for Determined Blind Source Separation

abstract: Independent low-rank matrix analysis (ILRMA) is the state-of-the-art algorithm for blind source separation (BSS) in the determined situation (the number of microphones is greater than or equal to that of source signals). ILRMA achieves a great separation performance by modeling the power spectrograms of the source signals via the nonnegative matrix factorization (NMF). Such a highly developed source model can solve the permutation problem of the frequency-domain BSS to a large extent, which is the reason for the excellence of ILRMA. In this paper, we further improve the separation performance of ILRMA by additionally considering the general structure of spectrograms, which is called consistency, and hence we call the proposed method Consistent ILRMA. Since a spectrogram is calculated by an overlapping window (and a window function induces spectral smearing called main- and side-lobes), the time-frequency bins depend on each other. In other words, the time-frequency components are related to each other via the uncertainty principle. Such co-occurrence among the spectral components can function as an assistant for solving the permutation problem, which has been demonstrated by a recent study. On the basis of these facts, we propose an algorithm for realizing Consistent ILRMA by slightly modifying the original algorithm. Its performance was extensively evaluated through experiments performed with various window lengths and shift lengths. The results indicated several tendencies of the original and proposed ILRMA that include some topics not fully discussed in the literature. For example, the proposed Consistent ILRMA tends to outperform the original ILRMA when the window length is sufficiently long compared to the reverberation time of the mixing system.


title: Rigidity of wonderful group compactifications under Fano deformations

abstract: For a complex connected semisimple linear algebraic group $G$ of adjoint type and of rank $n$, De Concini and Procesi constructed its wonderful compactification $\bar{G}$, which is a smooth Fano $G \times G$-variety of Picard number $n$ enjoying many interesting properties. In this paper, it is shown that the wonderful compactification $\bar{G}$ is rigid under Fano deformation. Namely, for any regular family of Fano manifolds over a connected base, if one fiber is isomorphic to $\bar{G}$, then so are all other fibers. This answers a question raised by Bien and Brion in their work on the local rigidity of wonderful varieties.


title: Birch's law at elevated temperatures

abstract: Birch's law in high pressure physics postulates a linear relationship between elastic wave speed and density and one of its most well known applications is in investigations into the composition of the inner core of the Earth using the Preliminary Reference Earth Model as the primary source of constraints. However, it has never been subjected to high precision tests even at moderately elevated temperatures. Here we carry out such a test by making use of the Density Functional Theory of electronic structure calculation and the Density Functional Perturbation Theory of calculating the phonon dispersion relation. We show that a recently proposed modification to the Birch's law is consistently satisfied more accurately than its original version. This modified version states that it is the product of elastic wave speed and one-third power of density that should be a linear function of density. We have studied the cases of platinum, palladium, molybdenum and rhodium with cubic unit cell and iron with hexagonal-close-packed unit cell with temperatures up to 1500K and pressures up to about 360 GPa. We also examine the genericity of the validity of a recently proposed extension of the Birch's law according to which elastic wave speed is a linear function of temperature at a given density. Within the error bars of our calculation, we find that this is consistent with our data for the four cubic materials at temperatures up to 3300 K.


title: Static spherically symmetric black hole's solution in Einstein-Maxwell-Yang-Mills-dilaton theory

abstract: In this work a static spherically symmetric black hole's solution within the Einstein-Maxwell-Yang-Mills-dilaton theory is derived. The obtained solution is examined, in particular, we have calculated the Kretschmann scalar which allowed us to characterize singularity points. Using the obtained black hole's solution we have studied its thermodynamics. Namely, the temperature was calculated, the first law was written, and the heat capacity was studied. The extended thermodynamics approach is utilized to obtain the equation of state. Within the extended thermodynamics the Gibbs free energy is derived and investigated. The analysis of the Gibbs free energy shows that below the critical temperature besides the first order phase transition in addition the zeroth order phase transition occurs, what is typical for other types of black holes with dilaton fields. Finally, we have shown that the critical exponents take the same values as for other types of the dilaton black holes.


title: A finite element model updating method based on global optimization

abstract: Finite element model updating of a structure made of linear elastic materials is based on the solution of a minimization problem. The goal is to find some unknown parameters of the finite element model (elastic moduli, mass densities, constraints and boundary conditions) that minimize an objective function which evaluates the discrepancy between experimental and numerical dynamic properties. The objective function depends nonlinearly on the parameters and may have multiple local minimum points. This paper presents a numerical method able to find a global minimum point and assess its reliability. The numerical method has been tested on two simulated examples - a masonry tower and a domed temple - and validated via a generic genetic algorithm and a global sensitivity analysis tool. A real case study monitored under operational conditions has also been addressed, and the structure's experimental modal properties have been used in the model updating procedure to estimate the mechanical properties of its constituent materials.


title: HPC AI500: The Methodology, Tools, Roofline Performance Models, and Metrics for Benchmarking HPC AI Systems

abstract: The recent years witness a trend of applying large-scale distributed deep learning in both business and scientific computing areas, whose goal is to speed up the training time to achieve a state-of-the-art quality. The HPC community feels a great interest in building the HPC AI systems that are dedicated to running those workloads. The HPC AI benchmarks accelerate the process. Unfortunately, benchmarking HPC AI systems at scale raises serious challenges. None of previous HPC AI benchmarks achieve the goal of being equivalent, relevant, representative, affordable, and repeatable. This paper presents a comprehensive methodology, tools, Roofline performance models, and innovative metrics for benchmarking, optimizing, and ranking HPC AI systems, which we call HPC AI500 V2.0. We abstract the HPC AI system into nine independent layers, and present explicit benchmarking rules and procedures to assure equivalence of each layer, repeatability, and replicability. On the basis of AIBench -- by far the most comprehensive AI benchmarks suite, we present and build two HPC AI benchmarks from both business and scientific computing: Image Classification, and Extreme Weather Analytics, achieving both representativeness and affordability. To rank the performance and energy-efficiency of HPC AI systems, we propose Valid FLOPS, and Valid FLOPS per watt, which impose a penalty on failing to achieve the target quality. We propose using convolution and GEMM -- the two most intensively-used kernel functions to measure the upper bound performance of the HPC AI systems, and present HPC AI roofline models for guiding performance optimizations. The evaluations show our methodology, benchmarks, performance models, and metrics can measure, optimize, and rank the HPC AI systems in a scalable, simple, and affordable way. HPC AI500 V2.0 are publicly available from http://www.benchcouncil.org/benchhub/hpc-ai500-benchmark.


title: Quantum Spectral Clustering

abstract: Spectral clustering is a powerful unsupervised machine learning algorithm for clustering data with non convex or nested structures. With roots in graph theory, it uses the spectral properties of the Laplacian matrix to project the data in a low-dimensional space where clustering is more efficient. Despite its success in clustering tasks, spectral clustering suffers in practice from a fast-growing running time of $O(n^3)$, where $n$ is the number of points in the dataset. In this work we propose an end-to-end quantum algorithm performing spectral clustering, extending a number of works in quantum machine learning. The quantum algorithm is composed of two parts: the first is the efficient creation of the quantum state corresponding to the projected Laplacian matrix, and the second consists of applying the existing quantum analogue of the $k$-means algorithm. Both steps depend polynomially on the number of clusters, as well as precision and data parameters arising from quantum procedures, and polylogarithmically on the dimension of the input vectors. Our numerical simulations show an asymptotic linear growth with $n$ when all terms are taken into account, significantly better than the classical cubic growth. This work opens the path to other graph-based quantum machine learning algorithms, as it provides routines for efficient computation and quantum access to the Incidence, Adjacency, and projected Laplacian matrices of a graph.


title: Invariant measures on products and on the space of linear orders

abstract: Let $M$ be an $\aleph_0$-categorical structure and assume that $M$ has no algebraicity and has weak elimination of imaginaries. Generalizing classical theorems of de Finetti and Ryll-Nardzewski, we show that any ergodic, $\operatorname{Aut}(M)$-invariant measure on $[0, 1]^M$ is a product measure. We also investigate the action of $\operatorname{Aut}(M)$ on the compact space $\mathrm{LO}(M)$ of linear orders on $M$. If we assume moreover that the action $\operatorname{Aut}(M) \curvearrowright M$ is transitive, we prove that the action $\operatorname{Aut}(M) \curvearrowright \mathrm{LO}(M)$ either has a fixed point or is uniquely ergodic.


title: Are Pulsar Giant Pulses Induced by Re-emission of Cyclotron Resonance Absorption?

abstract: It is conjectured that coherent re-emission of cyclotron resonance absorption could result in pulsar giant pulses. This conjecture seems reasonable as it can naturally explain the distribution of pulsars with giant pulses on the $P$-$\dot{P}$ diagram.


title: Coarse-grained entropy production with multiple reservoirs: unraveling the role of time-scales and detailed balance in biology-inspired systems

abstract: A general framework to describe a vast majority of biology-inspired systems is to model them as stochastic processes in which multiple couplings are in play at the same time. Molecular motors, chemical reaction networks, catalytic enzymes, and particles exchanging heat with different baths, constitute some interesting examples of such a modelization. Moreover, they usually operate out of equilibrium, being characterized by a net production of entropy, which entails a constrained efficiency. Hitherto, in order to investigate multiple processes simultaneously driving a system, all theoretical approaches deal with them independently, at a coarse-grained level, or employing a separation of time-scales. Here, we explicitly take in consideration the interplay among time-scales of different processes, and whether or not their own evolution eventually relaxes toward an equilibrium state in a given sub-space. We propose a general framework for multiple coupling, from which the well-known formulas for the entropy production can be derived, depending on the available information about each single process. Furthermore, when one of the processes does not equilibrate in its sub-space, even if much faster than all the others, it introduces a finite correction to the entropy production. We employ our framework in various simple and pedagogical examples, for which such a corrective term can be related to a typical scaling of physical quantities in play.


title: Littlewood-Paley-Stein functionals: an R-boundedness approach

abstract: Let $L = \Delta + V$ be a Schr\"odinger operator with a non-negative potential $V$ on a complete Riemannian manifold $M$. We prove that the vertical Littlewood-Paley-Stein functional associated with $L$ is bounded on $L^p(M)$ {\it if and only if} the set $\{\sqrt{t}\, \nabla e^{-tL}, \, t > 0\}$ is ${\mathcal R}$-bounded on $L^p(M)$. We also introduce and study more general functionals. For a sequence of functions $m_k : [0, \infty) \to \mathbb{C}$, we define $$H((f_k)) := \Big( \sum_k \int_0^\infty | \nabla m_k(tL) f_k |^2 dt \Big)^{1/2} + \Big( \sum_k \int_0^\infty | \sqrt{V} m_k(tL) f_k |^2 dt \Big)^{1/2}.$$ Under fairly reasonable assumptions on $M$ we prove boundedness of $H$ on $L^p(M)$ in the sense $$\| H((f_k)) \|_p \le C\, \Big\| \Big( \sum_k |f_k|^2 \Big)^{1/2} \Big\|_p$$ for some constant $C$ independent of $(f_k)_k$. A lower estimate is also proved on the dual space $L^{p'}$. We introduce and study boundedness of other Littlewood-Paley-Stein type functionals and discuss their relationships to the Riesz transform. Several examples are given in the paper.


title: The positive mass theorem in Kaluza-Klein picture

abstract: We reconsider Schoen and Yau's proof of the positive mass theorem from the extra dimensional point of view, and we introduce a modified argument to prove the theorem in the Kaluza-Klein picture. We consider in this study an alternative condition to Jang's equation, which makes the argument more physically intuitive.


title: Maintaining Smart Contracts on Ethereum: Issues, Techniques, and Future Challenges

abstract: Software development is a very broad activity that captures the entire life cycle of a software, which includes designing, programming, maintenance and so on. In this study, we focus on the maintenance-related concerns of the post-deployment of smart contracts. Smart contracts are self-executed programs that run on a blockchain. They cannot be modified once deployed and hence they bring unique maintenance challenges compared to conventional software. According to the definition of ISO/IEC 14764, there are four kinds of software maintenance, i.e., corrective, adaptive, perfective, and preventive maintenance. This study aims to answer (i) What kinds of issues will smart contract developers encounter for corrective, adaptive, perfective, and preventive maintenance after they are deployed to the Ethereum? (ii) What are the current maintenance-related methods used for smart contracts? To obtain the answers to these research questions, we first conducted a systematic literature review to analyze 131 smart contract related research papers published from 2014 to 2020. Since the Ethereum ecosystem is fast-growing, some results from previous publications might be out-of-date and there may be a gap between academia and industry. To address this, we performed an online survey of smart contract developers on Github to validate our findings and received 165 useful responses. Based on the survey feedback and literature review, we present the first empirical study on smart contract maintenance-related concerns. Our study can help smart contract developers better maintain their smart contract-based projects, and we highlight some key future research directions to improve the Ethereum ecosystem.


title: On Exact Distribution of Poisson-Voronoi Area in $K$-tier HetNets with Generalized Association Rule

abstract: This letter characterizes the exact distribution function of a typical Voronoi area in a $K$-tier Poisson network. The users obey a generalized association (GA) rule, which is a superset of nearest base station association and maximum received power based association (with arbitrary fading) rules that are commonly adopted in the literature. Combining the Robbins' theorem and the probability generating functional of a Poisson point process, we obtain the exact moments of a typical $k$-th tier Voronoi area, $k \in \{1,...,K\}$ under the GA rule. We apply this result in several special cases. For example, we prove that in multi-tier networks with the GA rule, the mean of $k$-th tier Voronoi area can exactly be expressed in a closed-form. We also obtain simplified expressions of its higher-order moments for both average and instantaneous received power based user association. In single-tier networks with exponential fading, the later association rule provides closed-form expression of the second-order moment of a typical Voronoi area. We numerically evaluate this exact expression and compare it with an approximated result.


title: Entanglement of quantum oscillators coupled to different heat baths

abstract: We study the non-equilibrium dynamics of two coupled oscillators interacting with their own heat baths of quantum scalar fields at different temperature $T_1$ and $T_2$ with bilinear couplings between them. We particularly focus on the entanglement or inseparability property of their quantum states. The critical temperatures of two respective oscillators, $T_{1c}$ and $T_{2c}$, higher than which the entanglement disappears, can be determined. It is found that when two damping parameters are largely different, say $\gamma_1 \ll \gamma_2$, the critical temperature $T_{1c}$ with respect to the frequency $\Omega_+$, the higher frequency among two normal modes frequencies, can be very large, $T_{1c} \gg \Omega_+$, while $T_{2c} \propto \Omega_+$ with the possibility of hot entanglement. The entanglement of two oscillators with the temperature-dependent damping parameters $\gamma_{1;2,T}$ from heat baths is also discussed.


title: A Le Cam Type Bound for Adversarial Learning and Applications

abstract: Robustness of machine learning methods is essential for modern practical applications. Given the arms race between attack and defense methods, one may be curious regarding the fundamental limits of any defense mechanism. In this work, we focus on the problem of learning from noise-injected data, where the existing literature falls short by either assuming a specific attack method or by over-specifying the learning problem. We shed light on the information-theoretic limits of adversarial learning without assuming a particular learning process or attacker. Finally, we apply our general bounds to a canonical set of non-trivial learning problems and provide examples of common types of attacks.


title: Robust Semantic Segmentation in Adverse Weather Conditions by means of Fast Video-Sequence Segmentation

abstract: Computer vision tasks such as semantic segmentation perform very well in good weather conditions, but if the weather turns bad, they have problems to achieve this performance in these conditions. One possibility to obtain more robust and reliable results in adverse weather conditions is to use video-segmentation approaches instead of commonly used single-image segmentation methods. Video-segmentation approaches capture temporal information of the previous video-frames in addition to current image information, and hence, they are more robust against disturbances, especially if they occur in only a few frames of the video-sequence. However, video-segmentation approaches, which are often based on recurrent neural networks, cannot be applied in real-time applications anymore, since their recurrent structures in the network are computational expensive. For instance, the inference time of the LSTM-ICNet, in which recurrent units are placed at proper positions in the single-segmentation approach ICNet, increases up to 61 percent compared to the basic ICNet. Hence, in this work, the LSTM-ICNet is sped up by modifying the recurrent units of the network so that it becomes real-time capable again. Experiments on different datasets and various weather conditions show that the inference time can be decreased by about 23 percent by these modifications, while they achieve similar performance than the LSTM-ICNet and outperform the single-segmentation approach enormously in adverse weather conditions.


title: FlowControl: Optical Flow Based Visual Servoing

abstract: One-shot imitation is the vision of robot programming from a single demonstration, rather than by tedious construction of computer code. We present a practical method for realizing one-shot imitation for manipulation tasks, exploiting modern learning-based optical flow to perform real-time visual servoing. Our approach, which we call FlowControl, continuously tracks a demonstration video, using a specified foreground mask to attend to an object of interest. Using RGB-D observations, FlowControl requires no 3D object models, and is easy to set up. FlowControl inherits great robustness to visual appearance from decades of work in optical flow. We exhibit FlowControl on a range of problems, including ones requiring very precise motions, and ones requiring the ability to generalize.


title: Fr\'echet Sufficient Dimension Reduction for Random Objects

abstract: We in this paper consider Fr\'echet sufficient dimension reduction with responses being complex random objects in a metric space and high dimension Euclidean predictors. We propose a novel approach called weighted inverse regression ensemble method for linear Fr\'echet sufficient dimension reduction. The method is further generalized as a new operator defined on reproducing kernel Hilbert spaces for nonlinear Fr\'echet sufficient dimension reduction. We provide theoretical guarantees for the new method via asymptotic analysis. Intensive simulation studies verify the performance of our proposals. And we apply our methods to analyze the handwritten digits data to demonstrate its use in real applications.


title: Motivations, Benefits, and Issues for Adopting Micro-Frontends: A Multivocal Literature Review

abstract: [Context] Micro-Frontends are increasing in popularity, being adopted by several large companies, such as DAZN, Ikea, Starbucks and may others. Micro-Frontends enable splitting of monolithic frontends into independent and smaller micro applications. However, many companies are still hesitant to adopt Micro-Frontends, due to the lack of knowledge concerning their benefits. Additionally, provided online documentation is often times perplexed and contradictory. [Objective] The goal of this work is to map the existing knowledge on Micro-Frontends, by understanding the motivations of companies when adopting such applications as well as possible benefits and issues. [Method] We conducted a Multivocal Literature Review, analyzing 43 sources , and classifying motivations, benefits and issues. [Results] The results show that existing architectural options to build web applications are cumbersome if the application and development team grows, and if multiple teams need to develop the same frontend application. The application of the Micro-Frontend, confirmed the expected benefits, and Micro-Frontends resulted to provide the same benefits as microservices on the back end side, combining the development team into a fully cross-functional development team that can scale processes when needed. However, Micro-Frontends also showed some issues, such as the increased payload size of the application, increased code duplication and coupling between teams, and monitoring complexity. [Conclusions] Micro-Frontends allow companies to scale development according to business needs in the same way microservices do with the back end side. In addition, ...


title: Non-Hermitian Anderson Transport

abstract: Andersons groundbreaking discovery that the presence of stochastic imperfections in a crystal may result in a sudden breakdown of conductivity revolutionized our understanding of disordered media. After stimulating decades of lively studies, Anderson localization has found intriguing applications in various areas of physics, such mesoscopic physics, strongly-correlated systems, light localization, cavity quantum electrodynamics, random lasers, and topological phases of matter. However, a fundamental assumption in Andersons treatment is that no energy is exchanged with the environment, in contrast to the common knowledge that every real system is subject to dissipation. Recently, a growing number of theoretical studies has addressed disordered media with dissipation. In particular it has been predicted that in such systems all eigenstates exponentially localize, similar to the original case without dissipation that Anderson considered. However, in dissipative systems an eigenstate analysis is insufficient for characterizing the transport dynamics of wave, in stark contrast to Hermitian systems, where the localization of all eigenstates necessarily suppresses transport. In our work, we show in theory and experiment that systems with dissipative disorder allow for a new type of spatial transport, despite the fact that all eigenstates are exponentially localized. This Anderson transport is characterized by super-diffusive spreading and ultra-far spatial jumps between localized states. We anticipate our findings to mark the starting point towards novel phenomena in dissipative media, which are subject to general non-Hermitian disorder.


title: Belief Propagation Neural Networks

abstract: Learned neural solvers have successfully been used to solve combinatorial optimization and decision problems. More general counting variants of these problems, however, are still largely solved with hand-crafted solvers. To bridge this gap, we introduce belief propagation neural networks (BPNNs), a class of parameterized operators that operate on factor graphs and generalize Belief Propagation (BP). In its strictest form, a BPNN layer (BPNN-D) is a learned iterative operator that provably maintains many of the desirable properties of BP for any choice of the parameters. Empirically, we show that by training BPNN-D learns to perform the task better than the original BP: it converges 1.7x faster on Ising models while providing tighter bounds. On challenging model counting problems, BPNNs compute estimates 100's of times faster than state-of-the-art handcrafted methods, while returning an estimate of comparable quality.


title: A Kernel-based Consensual Aggregation for Regression

abstract: In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators $r_1, r_2, \ldots, r_M$ using a weighted average where the weights are defined based on some kernel function to build a target prediction. This work extends the context of Biau et al. (2016) to a more general kernel-based framework. We show that this more general configuration also inherits the consistency of the basic consistent estimators. Moreover, an optimization method based on gradient descent algorithm is proposed to efficiently and rapidly estimate the key parameter of the strategy. The numerical experiments carried out on several simulated and real datasets are also provided to illustrate the speed-up of gradient descent algorithm in estimating the key parameter and the improvement of overall performance of the method with the introduction of smoother kernel functions.


title: Two step melting of the Weeks-Chandler-Anderson system in two dimensions

abstract: We present a detailed numerical simulation study of a two dimensional system of particles interacting via the Weeks-Chandler-Anderson potential, the repulsive part of the Lennard-Jones potential. With reduction of density, the system shows a two-step melting: a continuous melting from solid to hexatic phase, followed by a a first order melting of hexatic to liquid. The solid-hexatic melting is consistent with the Kosterlitz-Thouless-Halperin-Nelson-Young (KTHNY) scenario and shows dislocation unbinding. The first order melting of hexatic to fluid phase, on the other hand, is dominated by formation of string of defects at the hexatic-fluid interfaces.


title: A pressure robust staggered discontinuous Galerkin method for the Stokes equations

abstract: In this paper we propose a pressure robust staggered discontinuous Galerkin method for the Stokes equations on general polygonal meshes by using piecewise constant approximations. We modify the right hand side of the body force in the discrete formulation by exploiting divergence preserving velocity reconstruction operator, which is the crux for pressure independent velocity error estimates. The optimal convergence for velocity gradient, velocity and pressure are proved. In addition, we are able to prove the superconvergence of velocity approximation by the incorporation of divergence preserving velocity reconstruction operator in the dual problem, which is also an important contribution of this paper. Finally, several numerical experiments are carried out to confirm the theoretical findings.


title: Ultra-fast quantum-well infared photodetectors operating at 10{\mu}m with flat response up to 70GHz at room temperature

abstract: III-V semiconductor mid-infrared photodetectors based on intersubband transitions hold a great potential for ultra-high-speed operation up to several hundreds of GHz. In this work we exploit a ~350nm-thick GaAs/Al0.2Ga0.8As multi-quantum-well heterostructure to demonstrate heterodyne detection at 10um wavelength with a nearly flat frequency response up to 70GHz at room temperature, solely limited by the measurement system bandwidth. This is the broadest RF-bandwidth reported to date for a quantum-well mid-infrared photodetector. Responsivities of 0.15A/W and 1.5A/W are obtained at 300K and 77K respectively. To allow ultrafast operation and illumination at normal incidence, the detector consists of a 50Ohm coplanar waveguide, monolithically integrated with a 2D-array of sub-wavelength antennas, electrically interconnected by suspended wires. With this device architecture we obtain a parasitic capacitance of ~30fF, corresponding to the static capacitance of the antennas, yielding a RC-limited 3dB cutoff frequency >150GHz at 300K, extracted with a small-signal equivalent circuit model. Using this model, we quantitively reproduce the detector frequency response and find intrinsic roll-off time constants as low as 1ps at room temperature.


title: Making Use of NXt to Nothing: The Effect of Class Imbalances on DGA Detection Classifiers

abstract: Numerous machine learning classifiers have been proposed for binary classification of domain names as either benign or malicious, and even for multiclass classification to identify the domain generation algorithm (DGA) that generated a specific domain name. Both classification tasks have to deal with the class imbalance problem of strongly varying amounts of training samples per DGA. Currently, it is unclear whether the inclusion of DGAs for which only a few samples are known to the training sets is beneficial or harmful to the overall performance of the classifiers. In this paper, we perform a comprehensive analysis of various contextless DGA classifiers, which reveals the high value of a few training samples per class for both classification tasks. We demonstrate that the classifiers are able to detect various DGAs with high probability by including the underrepresented classes which were previously hardly recognizable. Simultaneously, we show that the classifiers' detection capabilities of well represented classes do not decrease.