title: Detection of 3D Bounding Boxes of Vehicles Using Perspective Transformation for Accurate Speed Measurement

abstract: Detection and tracking of vehicles captured by traffic surveillance cameras is a key component of intelligent transportation systems. We present an improved version of our algorithm for detection of 3D bounding boxes of vehicles, their tracking and subsequent speed estimation. Our algorithm utilizes the known geometry of vanishing points in the surveilled scene to construct a perspective transformation. The transformation enables an intuitive simplification of the problem of detecting 3D bounding boxes to detection of 2D bounding boxes with one additional parameter using a standard 2D object detector. Main contribution of this paper is an improved construction of the perspective transformation which is more robust and fully automatic and an extended experimental evaluation of speed estimation. We test our algorithm on the speed estimation task of the BrnoCompSpeed dataset. We evaluate our approach with different configurations to gauge the relationship between accuracy and computational costs and benefits of 3D bounding box detection over 2D detection. All of the tested configurations run in real-time and are fully automatic. Compared to other published state-of-the-art fully automatic results our algorithm reduces the mean absolute speed measurement error by 32% (1.10 km/h to 0.75 km/h) and the absolute median error by 40% (0.97 km/h to 0.58 km/h).


title: Topological Data Analysis in Text Classification: Extracting Features with Additive Information

abstract: While the strength of Topological Data Analysis has been explored in many studies on high dimensional numeric data, it is still a challenging task to apply it to text. As the primary goal in topological data analysis is to define and quantify the shapes in numeric data, defining shapes in the text is much more challenging, even though the geometries of vector spaces and conceptual spaces are clearly relevant for information retrieval and semantics. In this paper, we examine two different methods of extraction of topological features from text, using as the underlying representations of words the two most popular methods, namely word embeddings and TF-IDF vectors. To extract topological features from the word embedding space, we interpret the embedding of a text document as high dimensional time series, and we analyze the topology of the underlying graph where the vertices correspond to different embedding dimensions. For topological data analysis with the TF-IDF representations, we analyze the topology of the graph whose vertices come from the TF-IDF vectors of different blocks in the textual document. In both cases, we apply homological persistence to reveal the geometric structures under different distance resolutions. Our results show that these topological features carry some exclusive information that is not captured by conventional text mining methods. In our experiments we observe adding topological features to the conventional features in ensemble models improves the classification results (up to 5\%). On the other hand, as expected, topological features by themselves may be not sufficient for effective classification. It is an open problem to see whether TDA features from word embeddings might be sufficient, as they seem to perform within a range of few points from top results obtained with a linear support vector classifier.


title: The 1-2-3 Conjecture holds for graphs with large enough minimum degree

abstract: A simple graph more often than not contains adjacent vertices with equal degrees. This in particular holds for all pairs of neighbours in regular graphs, while a lot such pairs can be expected e.g. in many random models. Is there a universal constant $K$, say $K=3$, such that one may always dispose of such pairs from any given connected graph with at least three vertices by blowing its selected edges into at most $K$ parallel edges? This question was first posed in 2004 by Karo\'nski, {\L}uczak and Thomason, who equivalently asked if one may assign weights $1,2,3$ to the edges of every such graph so that adjacent vertices receive distinct weighted degrees - the sums of their incident weights. This basic problem is commonly referred to as the 1-2-3 Conjecture nowadays, and has been addressed in multiple papers. Thus far it is known that weights $1,2,3,4,5$ are sufficient [J. Combin. Theory Ser. B 100 (2010) 347-349]. We show that this conjecture holds if only the minimum degree $\delta$ of a graph is large enough, i.e. when $\delta = \Omega(\log\Delta)$, where $\Delta$ denotes the maximum degree of the graph. The principle idea behind our probabilistic proof relies on associating random variables with a special and carefully designed distribution to most of the vertices of a given graph, and then choosing weights for major part of the edges depending on the values of these variables in a deterministic or random manner.


title: Congruences for certain lacunary sums of products of binomial coefficients

abstract: It is shown that for any prime $p$ and any natural numbers $\ell, m,$ and $s$ such that $0<s<p$, the three following congruences \begin{align*}\sum_{i\ge \ell+1}(-1)^{m-i} {m \choose i}{m+s-1+i(p-1) \choose m+s-1+\ell(p-1)} &\equiv 0 \bmod p\\ \sum_{i\ge 0}(-1)^{m-i} {m \choose i}{\ell+ip \choose m+s-1}&\equiv 0 \bmod p^m\\ \sum_{j,i\ge \ell}(-1)^{j-i}{m \choose j} {j \choose i}{j+s-1+i(p-1) \choose j+s-1+\ell(p-1)}&\equiv 0 \bmod p^{m-\ell} \end{align*} hold true. The corresponding quotients involve Adelberg polynomials which can be computed explicitly, providing closed-form expressions for these sums, valid even if $p$ is not prime, when the congruences do not necessarily hold.


title: Learning a Weakly-Supervised Video Actor-Action Segmentation Model with a Wise Selection

abstract: We address weakly-supervised video actor-action segmentation (VAAS), which extends general video object segmentation (VOS) to additionally consider action labels of the actors. The most successful methods on VOS synthesize a pool of pseudo-annotations (PAs) and then refine them iteratively. However, they face challenges as to how to select from a massive amount of PAs high-quality ones, how to set an appropriate stop condition for weakly-supervised training, and how to initialize PAs pertaining to VAAS. To overcome these challenges, we propose a general Weakly-Supervised framework with a Wise Selection of training samples and model evaluation criterion (WS^2). Instead of blindly trusting quality-inconsistent PAs, WS^2 employs a learning-based selection to select effective PAs and a novel region integrity criterion as a stopping condition for weakly-supervised training. In addition, a 3D-Conv GCAM is devised to adapt to the VAAS task. Extensive experiments show that WS^2 achieves state-of-the-art performance on both weakly-supervised VOS and VAAS tasks and is on par with the best fully-supervised method on VAAS.


title: An analysis of carrier dynamics in methylammonium lead triiodide perovskite solar cells using cross-correlation noise spectroscopy

abstract: Using cross-correlation current noise spectroscopy, we have investigated carrier dynamics in methylammonium lead triiodide solar cells. This method provides a space selectivity for devices with planar multi-layered structure, effectively amplifying current noise contributions coming from the most resistive element of the stack. In the studied solar cells, we observe near full-scale shot noise, indicating the dominance of noise generation by a single source, likely the interface between the perovskite and the spiro-OMeTAD hole-transport layer. We argue that the strong 1/f noise term has contributions both from the perovskite layer and interfaces. It displays non-ideal dependence on photocurrent, $S \propto I^{1.4}$ (instead of usual $S \propto I^2$ ), which is likely due to current-induced halide migration. Finally, we observe generation-recombination noise. The relaxation time of this process grows linearly with photocurrent, which allows to attribute this contribution to bimolecular recombination in the perovskite bulk absorption layer. Extrapolating our results, we estimate that at the standard 1 sun illumination the electron-hole recombination time is 5 microseconds.


title: Asymptotic behavior of critical dissipative quasi-geostrophic equation in Fourier space

abstract: In this paper we show the global existence for critical dissipative quasi-geostrophic equations if $\|\widehat{\theta^0}\|_{L^1}$ is small enough; among others we prove the analyticity of such a solution. If in addition the initial condition verifies $|D|^{-\delta}\theta^0\in L^1(\mathbb R^2)$ with $0<\delta<1$, then the solution remains regular and $\lim_{t\rightarrow\infty}t^\delta\|\widehat{\theta}(t)\|_{L^1}=0$. Fourier analysis and standard techniques are used.


title: Limits from the Funk Experiment on the Mixing Strength of Hidden-Photon Dark Matter in the Visible and Near-Ultraviolet Wavelength Range

abstract: We present results from the FUNK experiment in the search for hidden-photon dark matter. Near the surface of a mirror, hidden photons may be converted into ordinary photons. These photons are emitted perpendicular to the surface and have an energy equal to the mass of the dark matter hidden photon. Our experimental setup consists of a large, spherical mirror with an area of more than 14 m$^2$, which concentrates the emitted photons into its central point. Using a detector sensitive to visible and near-UV photons, we can exclude a kinetic-mixing coupling of stronger than $\chi \approx 10^{-12}$ in the mass range of 2.5 to 7 eV, assuming hidden photons comprise all of the dark matter. The experimental setup and analysis used to obtain this limit are discussed in detail.

categories: astro-ph.CO astro-ph.IM hep-ex hep-ph physics.ins-det


title: Can AI help in screening Viral and COVID-19 pneumonia?

abstract: Coronavirus disease (COVID-19) is a pandemic disease, which has already caused thousands of causalities and infected several millions of people worldwide. Any technological tool enabling rapid screening of the COVID-19 infection with high accuracy can be crucially helpful to healthcare professionals. The main clinical tool currently in use for the diagnosis of COVID-19 is the Reverse transcription polymerase chain reaction (RT-PCR), which is expensive, less-sensitive and requires specialized medical personnel. X-ray imaging is an easily accessible tool that can be an excellent alternative in the COVID-19 diagnosis. This research was taken to investigate the utility of artificial intelligence (AI) in the rapid and accurate detection of COVID-19 from chest X-ray images. The aim of this paper is to propose a robust technique for automatic detection of COVID-19 pneumonia from digital chest X-ray images applying pre-trained deep-learning algorithms while maximizing the detection accuracy. A public database was created by the authors combining several public databases and also by collecting images from recently published articles. The database contains a mixture of 423 COVID-19, 1485 viral pneumonia, and 1579 normal chest X-ray images. Transfer learning technique was used with the help of image augmentation to train and validate several pre-trained deep Convolutional Neural Networks (CNNs). The networks were trained to classify two different schemes: i) normal and COVID-19 pneumonia; ii) normal, viral and COVID-19 pneumonia with and without image augmentation. The classification accuracy, precision, sensitivity, and specificity for both the schemes were 99.7%, 99.7%, 99.7% and 99.55% and 97.9%, 97.95%, 97.9%, and 98.8%, respectively.


title: $\Lambda$CDM as a Noether Symmetry in Cosmology

abstract: The standard $\Lambda$CDM model of cosmology is formulated as a simple modified gravity coupled to a single scalar field ("darkon") possessing a non-trivial hidden nonlinear Noether symmetry. The main ingredient in the construction is the use of the formalism of non-Riemannian spacetime volume-elements. The associated Noether conserved current produces stress-energy tensor consisting of two additive parts -- dynamically generated dark energy and dark matter components non-interacting among themselves. Noether symmetry breaking via an additional scalar "darkon" potential introduces naturally an interaction between dark energy and dark matter. The correspondence between the $\Lambda$CDM model and the present "darkon" Noether symmetry is exhibited up to linear order w.r.t. gravity-matter perturbations.


title: Replica wormhole and information retrieval in the SYK model coupled to Majorana chains

abstract: Motivated by recent studies of the information paradox in (1+1)-D anti-de Sitter spacetime with a bath described by a (1+1)-D conformal field theory, we study the dynamics of second R\'{e}nyi entropy of the Sachdev-Ye-Kitaev (SYK) model ($\chi$) coupled to a Majorana chain bath ($\psi$). The system is prepared in the thermofield double (TFD) state and then evolved by $H_L+H_R$. For small system-bath coupling, we find that the second R\'{e}nyi entropy $S^{(2)}_{\chi_L, \chi_R}$ of the SYK model undergoes a first order transition during the evolution. In the sense of holographic duality, the long-time solution corresponds to a "replica wormhole". The transition time corresponds to the Page time of a black hole coupled to a thermal bath. We further study the information scrambling and retrieval by introducing a classical control bit, which controls whether or not we add a perturbation in the SYK system. The mutual information between the bath and the control bit shows a positive jump at the Page time, indicating that the entanglement wedge of the bath includes an island in the holographic bulk.


title: Long-term spin state storage using ancilla charge memories

abstract: We articulate confocal microscopy and electron spin resonance to implement spin-to-charge conversion in a small ensemble of nitrogen-vacancy (NV) centers in bulk diamond, and demonstrate charge conversion of neighboring defects conditional on the NV spin state. We build on this observation to show time-resolved NV spin manipulation and ancilla-charge-aided NV spin state detection via integrated measurements. Our results hint at intriguing opportunities in the search for enhanced forms of color-center-based metrology and information processing down to the limit of individual point defects.


title: SOS: Online probability estimation and generation of T and B cell receptors

abstract: Recent advances in modelling VDJ recombination and subsequent selection of T and B cell receptors provide useful tools to analyze and compare immune repertoires across time, individuals, and tissues. A suite of tools--IGoR [1], OLGA [2] and SONIA [3]--have been publicly released to the community that allow for the inference of generative and selection models from high-throughput sequencing data. However using these tools requires some scripting or command-line skills and familiarity with complex datasets. As a result the application of the above models has not been available to a broad audience. In this application note we fill this gap by presenting Simple OLGA & SONIA (SOS), a web-based interface where users with no coding skills can compute the generation and post-selection probabilities of their sequences, as well as generate batches of synthetic sequences. The application also functions on mobile phones.


title: Experience Selection Using Dynamics Similarity for Efficient Multi-Source Transfer Learning Between Robots

abstract: In the robotics literature, different knowledge transfer approaches have been proposed to leverage the experience from a source task or robot -- real or virtual -- to accelerate the learning process on a new task or robot. A commonly made but infrequently examined assumption is that incorporating experience from a source task or robot will be beneficial. In practice, inappropriate knowledge transfer can result in negative transfer or unsafe behaviour. In this work, inspired by a system gap metric from robust control theory, the $\nu$-gap, we present a data-efficient algorithm for estimating the similarity between pairs of robot systems. In a multi-source inter-robot transfer learning setup, we show that this similarity metric allows us to predict relative transfer performance and thus informatively select experiences from a source robot before knowledge transfer. We demonstrate our approach with quadrotor experiments, where we transfer an inverse dynamics model from a real or virtual source quadrotor to enhance the tracking performance of a target quadrotor on arbitrary hand-drawn trajectories. We show that selecting experiences based on the proposed similarity metric effectively facilitates the learning of the target quadrotor, improving performance by 62% compared to a poorly selected experience.


title: How the Degeneracy Helps for Triangle Counting in Graph Streams

abstract: We revisit the well-studied problem of triangle count estimation in graph streams. Given a graph represented as a stream of $m$ edges, our aim is to compute a $(1\pm\varepsilon)$-approximation to the triangle count $T$, using a small space algorithm. For arbitrary order and a constant number of passes, the space complexity is known to be essentially $\Theta(\min(m^{3/2}/T, m/\sqrt{T}))$ (McGregor et al., PODS 2016, Bera et al., STACS 2017). We give a (constant pass, arbitrary order) streaming algorithm that can circumvent this lower bound for \emph{low degeneracy graphs}. The degeneracy, $\kappa$, is a nuanced measure of density, and the class of constant degeneracy graphs is immensely rich (containing planar graphs, minor-closed families, and preferential attachment graphs). We design a streaming algorithm with space complexity $\widetilde{O}(m\kappa/T)$. For constant degeneracy graphs, this bound is $\widetilde{O}(m/T)$, which is significantly smaller than both $m^{3/2}/T$ and $m/\sqrt{T}$. We complement our algorithmic result with a nearly matching lower bound of $\Omega(m\kappa/T)$.


title: Dynamics of plane partitions: Proof of the Cameron-Fon-Der-Flaass conjecture

abstract: One of the oldest outstanding problems in dynamical algebraic combinatorics is the following conjecture of P. Cameron and D. Fon-Der-Flaass (1995). Consider a plane partition $P$ in an $a \times b \times c$ box ${\sf B}$. Let $\Psi(P)$ denote the smallest plane partition containing the minimal elements of ${\sf B} - P$. Then if $p= a+b+c-1$ is prime, Cameron and Fon-Der-Flaass conjectured that the cardinality of the $\Psi$-orbit of $P$ is always a multiple of $p$. This conjecture was established for $p \gg 0$ by Cameron and Fon-Der-Flaass (1995) and for slightly smaller values of $p$ in work of K. Dilks, J. Striker, and the second author (2017). Our main theorem specializes to prove this conjecture in full generality.


title: Nonconvex Matrix Completion with Linearly Parameterized Factors

abstract: Techniques of matrix completion aim to impute a large portion of missing entries in a data matrix through a small portion of observed ones. In practice including collaborative filtering, prior information and special structures are usually employed in order to improve the accuracy of matrix completion. In this paper, we propose a unified nonconvex optimization framework for matrix completion with linearly parameterized factors. In particular, by introducing a condition referred to as Correlated Parametric Factorization, we can conduct a unified geometric analysis for the nonconvex objective by establishing uniform upper bounds for low-rank estimation resulting from any local minimum. Perhaps surprisingly, the condition of Correlated Parametric Factorization holds for important examples including subspace-constrained matrix completion and skew-symmetric matrix completion. The effectiveness of our unified nonconvex optimization method is also empirically illustrated by extensive numerical simulations.


title: Universal non-adiabatic control of small-gap superconducting qubits

abstract: Resonant transverse driving of a two-level system as viewed in the rotating frame couples two degenerate states at the Rabi frequency, an amazing equivalence that emerges in quantum mechanics. While spectacularly successful at controlling natural and artificial quantum systems, certain limitations may arise (e.g., the achievable gate speed) due to non-idealities like the counter-rotating term. Here, we explore a complementary approach to quantum control based on non-resonant, non-adiabatic driving of a longitudinal parameter in the presence of a fixed transverse coupling. We introduce a superconducting composite qubit (CQB), formed from two capacitively coupled transmon qubits, which features a small avoided crossing -- smaller than the environmental temperature -- between two energy levels. We control this low-frequency CQB using solely baseband pulses, non-adiabatic transitions, and coherent Landau-Zener interference to achieve fast, high-fidelity, single-qubit operations with Clifford fidelities exceeding $99.7\%$. We also perform coupled qubit operations between two low-frequency CQBs. This work demonstrates that universal non-adiabatic control of low-frequency qubits is feasible using solely baseband pulses.


title: Byzantine Agreement, Broadcast and State Machine Replication with Near-optimal Good-case Latency

abstract: This paper investigates the problem \textit{good-case latency} of Byzantine agreement, broadcast and state machine replication in the synchronous authenticated setting. The good-case latency measure captures the time it takes to reach agreement when all non-faulty parties have the same input (or in BB/SMR when the sender/leader is non-faulty). Previous result implies a lower bound showing that any Byzantine agreement or broadcast protocol tolerating more than $n/3$ faults must have a good-case latency of at least $\Delta$, where $\Delta$ is the assumed maximum message delay bound. Our first result is a family of protocols we call $1\Delta$ that have near-optimal good-case latency. We propose a protocol $1\Delta$-BA that solves Byzantine agreement in the synchronous and authenticated setting with near-optimal good-case latency of $\Delta+2\delta$ and optimal resilience $f<n/2$, where $\delta$ is the actual (unknown) delay bound. We then extend our protocol and present $1\Delta$-BB and $1\Delta$-SMR for Byzantine fault tolerant broadcast and state machine replication, respectively, in the same setting and with the same good-case latency of $\Delta+2\delta$ and $f<n/2$ fault tolerance. Our $1\Delta$-SMR upper bound improves the gap between the best current solution, Sync HotStuff, which obtains a good-case latency of $2\Delta$ per command and the lower bound of $\Delta$ on good-case latency. Finally, we investigate weaker notions of the synchronous setting and show how to adopt the $1\Delta$ approach to these models.


title: Controlling T$_c$ through band structure and correlation engineering in collapsed and uncollapsed phases of iron arsenides

abstract: Recent observations of selective emergence (suppression) of superconductivity in the uncollapsed (collapsed) tetragonal phase of LaFe$_2$As$_2$ has rekindled interest in understanding what features of the band structure control the superconducting T$_c$. We show that the proximity of the narrow Fe-d$_{xy}$ state to the Fermi energy emerges as the primary factor. In the uncollapsed phase this state is at the Fermi energy, and is most strongly correlated and source of enhanced scattering in both single and two particle channels. The resulting intense and broad low energy spin fluctuations suppress magnetic ordering and simultaneously provide glue for Cooper pair formation. In the collapsed tetragonal phase, the d$_{xy}$ state is driven far below the Fermi energy, which suppresses the low-energy scattering and blocks superconductivity. A similar source of broad spin excitation appears in uncollapsed and collapsed phases of CaFe$_{2}$As$_{2}$. This suggests controlling coherence provides a way to engineer T$_c$ in unconventional superconductors primarily mediated through spin fluctuations.


title: Deficiency of the scaling collapse as an indicator of a superconductor-insulator quantum phase transition

abstract: Finite-size scaling analysis is a well-accepted method for identification and characterization of quantum phase transitions (QPTs) in superconducting, magnetic and insulating systems. We formally apply this analysis in the form suitable for QPTs in 2-dimensional superconducting films to magnetic-field driven superconductor-metal transition in 1-dimensional MoGe nanowires. Despite being obviously inapplicable to nanowires, the 2d scaling equation leads to a high-quality scaling collapse of the nanowire resistance in the temperature and resistance ranges comparable or better to what is accepted in the analysis of the films. Our results suggest that the appearance and the quality of the scaling collapse by itself is not a reliable indicator of a QPT. We have also observed a sign-change of the zero-bias anomaly (ZBA) in the non-linear resistance, occurring exactly at the critical field of the accidental QPT. This behavior is often taken as an additional confirmation of the transition. We argue that in nanowires, the non-linearity is caused by electron heating and has no relation to the critical fluctuations. Our observation suggests that similar to the scaling collapse, the sign-change of ZBA can be a misleading indicator of QPT.


title: Learning Interactions and Relationships between Movie Characters

abstract: Interactions between people are often governed by their relationships. On the flip side, social relationships are built upon several interactions. Two strangers are more likely to greet and introduce themselves while becoming friends over time. We are fascinated by this interplay between interactions and relationships, and believe that it is an important aspect of understanding social situations. In this work, we propose neural models to learn and jointly predict interactions, relationships, and the pair of characters that are involved. We note that interactions are informed by a mixture of visual and dialog cues, and present a multimodal architecture to extract meaningful information from them. Localizing the pair of interacting characters in video is a time-consuming process, instead, we train our model to learn from clip-level weak labels. We evaluate our models on the MovieGraphs dataset and show the impact of modalities, use of longer temporal context for predicting relationships, and achieve encouraging performance using weak labels as compared with ground-truth labels. Code is online.


title: Extending Automated Deduction for Commonsense Reasoning

abstract: Commonsense reasoning has long been considered as one of the holy grails of artificial intelligence. Most of the recent progress in the field has been achieved by novel machine learning algorithms for natural language processing. However, without incorporating logical reasoning, these algorithms remain arguably shallow. With some notable exceptions, developers of practical automated logic-based reasoners have mostly avoided focusing on the problem. The paper argues that the methods and algorithms used by existing automated reasoners for classical first-order logic can be extended towards commonsense reasoning. Instead of devising new specialized logics we propose a framework of extensions to the mainstream resolution-based search methods to make these capable of performing search tasks for practical commonsense reasoning with reasonable efficiency. The proposed extensions mostly rely on operating on ordinary proof trees and are devised to handle commonsense knowledge bases containing inconsistencies, default rules, taxonomies, topics, relevance, confidence and similarity measures. We claim that machine learning is best suited for the construction of commonsense knowledge bases while the extended logic-based methods would be well-suited for actually answering queries from these knowledge bases.


title: Contact network models matching the dynamics of the COVID-19 spreading

abstract: We study the epidemic spreading on spatial networks where the probability that two nodes are connected decays with their distance as a power law. As the exponent of the distance dependence grows, model networks smoothly transition from the random network limit to the regular lattice limit. We show that despite keeping the average number of contacts constant, the increasing exponent hampers the epidemic spreading by making long-distance connections less frequent. The spreading dynamics is influenced by the distance-dependence exponent as well and changes from exponential growth to power-law growth. The observed power-law growth is compatible with recent analyses of empirical data on the spreading of COVID-19 in numerous countries.


title: DCMD: Distance-based Classification Using Mixture Distributions on Microbiome Data

abstract: Current advances in next generation sequencing techniques have allowed researchers to conduct comprehensive research on microbiome and human diseases, with recent studies identifying associations between human microbiome and health outcomes for a number of chronic conditions. However, microbiome data structure, characterized by sparsity and skewness, presents challenges to building effective classifiers. To address this, we present an innovative approach for distance-based classification using mixture distributions (DCMD). The method aims to improve classification performance when using microbiome community data, where the predictors are composed of sparse and heterogeneous count data. This approach models the inherent uncertainty in sparse counts by estimating a mixture distribution for the sample data, and representing each observation as a distribution, conditional on observed counts and the estimated mixture, which are then used as inputs for distance-based classification. The method is implemented into a k-means and k-nearest neighbours framework and we identify two distance metrics that produce optimal results. The performance of the model is assessed using simulations and applied to a human microbiome study, with results compared against a number of existing machine learning and distance-based approaches. The proposed method is competitive when compared to the machine learning approaches and showed a clear improvement over commonly used distance-based classifiers. The range of applicability and robustness make the proposed method a viable alternative for classification using sparse microbiome count data.


title: An Explicit Probabilistic Derivation of Inflation in a Scalar Ensemble Kalman Filter for Finite Step, Finite Ensemble Convergence

abstract: This paper uses a probabilistic approach to analyze the converge of an ensemble Kalman filter solution to an exact Kalman filter solution in the simplest possible setting, the scalar case, as it allows us to build upon a rich literature of scalar probability distributions and non-elementary functions. To this end we introduce the bare-bones Scalar Pedagogical Ensemble Kalman Filter (SPEnKF). We show that in the asymptotic case of ensemble size, the expected value of both the analysis mean and variance estimate of the SPEnKF converges to that of the true Kalman filter, and that the variances of both tend towards zero, at each time moment. We also show that the ensemble converges in probability in the complementary case, when the ensemble is finite, and time is taken to infinity. Moreover, we show that in the finite-ensemble, finite-time case, variance inflation and mean correction can be leveraged to coerce the SPEnKF converge to its scalar Kalman filter counterpart. We then apply this framework to analyze perturbed observations and explain why perturbed observations ensemble Kalman filters underperform their deterministic counterparts.


title: Efficient classical simulation of noisy random quantum circuits in one dimension

abstract: Understanding the computational power of noisy intermediate-scale quantum (NISQ) devices is of both fundamental and practical importance to quantum information science. Here, we address the question of whether error-uncorrected noisy quantum computers can provide computational advantage over classical computers. Specifically, we study noisy random circuit sampling in one dimension (or 1D noisy RCS) as a simple model for exploring the effects of noise on the computational power of a noisy quantum device. In particular, we simulate the real-time dynamics of 1D noisy random quantum circuits via matrix product operators (MPOs) and characterize the computational power of the 1D noisy quantum system by using a metric we call MPO entanglement entropy. The latter metric is chosen because it determines the cost of classical MPO simulation. We numerically demonstrate that for the two-qubit gate error rates we considered, there exists a characteristic system size above which adding more qubits does not bring about an exponential growth of the cost of classical MPO simulation of 1D noisy systems. Specifically, we show that above the characteristic system size, there is an optimal circuit depth, independent of the system size, where the MPO entanglement entropy is maximized. Most importantly, the maximum achievable MPO entanglement entropy is bounded by a constant that depends only on the gate error rate, not on the system size. We also provide a heuristic analysis to get the scaling of the maximum achievable MPO entanglement entropy as a function of the gate error rate. The obtained scaling suggests that although the cost of MPO simulation does not increase exponentially in the system size above a certain characteristic system size, it does increase exponentially as the gate error rate decreases, possibly making classical simulation practically not feasible even with state-of-the-art supercomputers.


title: Analytical Estimation and Localization of Hardware Trojan Vulnerability in RTL Designs

abstract: Offshoring the proprietary Intellectual property (IP) has recently increased the threat of malicious logic insertion in the form of Hardware Trojan (HT). A potential and stealthy HT is triggered with nets that switch rarely during regular circuit operation. Detection of HT in the host design requires exhaustive simulation to activate the HT during pre- and postsilicon. Although the nets with variable switching probability less than a threshold are primarily chosen as a good candidate for Trojan triggering, there is no systematic fine-grained approach for earlier detection of rare nets from word-level measures of input signals. In this paper, we propose a high-level technique to estimate the nets with the rare activity of arithmetic modules from word-level information. Specifically, for a given module, we use the knowledge of internal construction of the architecture to detect "low activity" and "local regions" without resorting to expensive RTL and other low-level simulations. The presented heuristic method abstracts away from the low-level details of design and describes the rare activity of bits (modules) in a word (architecture) as a function of signal statistics. The resulting quick estimates of nets in rare regions allows a designer to develop a compact test generation algorithm without the knowledge of the bit-level activity. We determine the effect of different positions of the breakpoint in the input signal to calculate the accuracy of the approach. We conduct a set of experiments on six adder architectures and four multiplier architectures. The average error to calculate the rare nets between RTL simulation and estimated values are below 2% in all architectures.


title: In-Hand Object-Dynamics Inference using Tactile Fingertips

abstract: Having the ability to estimate an object's properties through interaction will enable robots to manipulate novel objects. Object's dynamics, specifically the friction and inertial parameters have only been estimated in a lab environment with precise and often external sensing. Could we infer an object's dynamics in the wild with only the robot's sensors? In this paper, we explore the estimation of dynamics of a grasped object in motion, with tactile force sensing at multiple fingertips. Our estimation approach does not rely on torque sensing to estimate the dynamics. To estimate friction, we develop a control scheme to actively interact with the object until slip is detected. To robustly perform the inertial estimation, we setup a factor graph that fuses all our sensor measurements on physically consistent manifolds and perform inference. We show that tactile fingertips enable in-hand dynamics estimation of low mass objects.


title: A Conjecture on Induced Subgraphs of Cayley Graphs

abstract: In this paper, we propose the following conjecture which generalizes a theorem proved by Huang [Hua19] in his recent breakthrough proof of the sensitivity conjecture. We conjecture that for any Cayley graph $X = \Gamma(G,S)$ on a group $G$ and any generating set $S$, if $U \subseteq G$ has size $|U| > |G|/2$, then the induced subgraph of $X$ on $U$ has maximum degree at least $\sqrt{|S|/2}$. Using a recent idea of Alon and Zheng [AZ20], who proved this conjecture for the special case when $G = Z_2^n$, we prove that this conjecture is true whenever $G$ is abelian. We also observe that for this conjecture to hold for a graph $X$, some symmetry is required: it is insufficient for $X$ to just be regular and bipartite.


title: Formation mechanism of helical Q structure in Gd-based skyrmion materials

abstract: Using the ab initio local force method, we investigate the formation mechanism of the helical spin structure in GdRu$_2$Si$_2$ and Gd$_2$PdSi$_3$. We calculate the paramagnetic spin susceptibility and find that the Fermi surface nesting is not the origin of the incommensurate modulation, in contrast to the naive scenario based on the Ruderman-Kittel-Kasuya-Yosida mechanism. We then decompose the exchange interactions between the Gd spins into each orbital component, and show that spin-density-wave type interaction between the Gd-5$d$ orbitals is ferromagnetic, but the interaction between the Gd-4$f$ orbitals is antiferromagnetic. We conclude that the competition of these two interactions, namely, the inter-orbital frustration, stabilizes the finite-Q structure.


title: A note of the first law of thermodynamics by gravitational decoupling

abstract: We provide a way of decoupling the first law of thermodynamics in two sectors : the standard first law of thermodynamics and the quasi first law of thermodynamics. It is showed that both sectors share the same thermodynamics volume and the same entropy. However, the total thermodynamics pressure, the total temperature and the total local energy correspond to a simple sum of the thermodynamics contributions of each sector. Furthermore, it is showed a simple example, where there is a phase transition due to the behavior of the temperature at the quasi sector.


title: Associative Submanifolds of the Berger Space

abstract: We study associative submanifolds of the Berger space SO(5)/SO(3) endowed with its homogeneous nearly-parallel G2-structure. We focus on two geometrically interesting classes: the ruled associatives, and the associatives with special Gauss map. We show that the associative submanifolds ruled by a certain special type of geodesic are in correspondence with pseudo-holomorphic curves in $Gr_2^+(TS^4).$ Using this correspondence, together with a theorem of Bryant on superminimal surfaces in $S^4,$ we prove the existence of infinitely many topological types of compact immersed associative 3-folds in SO(5)/SO(3). An associative submanifold of the Berger space is said to have special Gauss map if its tangent spaces have non-trivial SO(3)-stabiliser. We classify the associative submanifolds with special Gauss map in the cases where the stabiliser contains an element of order greater than 2. In particular, we find several homogeneous examples of this type.


title: Space-Time-Aware Multi-Resolution Video Enhancement

abstract: We consider the problem of space-time super-resolution (ST-SR): increasing spatial resolution of video frames and simultaneously interpolating frames to increase the frame rate. Modern approaches handle these axes one at a time. In contrast, our proposed model called STARnet super-resolves jointly in space and time. This allows us to leverage mutually informative relationships between time and space: higher resolution can provide more detailed information about motion, and higher frame-rate can provide better pixel alignment. The components of our model that generate latent low- and high-resolution representations during ST-SR can be used to finetune a specialized mechanism for just spatial or just temporal super-resolution. Experimental results demonstrate that STARnet improves the performances of space-time, spatial, and temporal video super-resolution by substantial margins on publicly available datasets.


title: Quantum Transport in Air-stable Na3Bi Thin Films

abstract: Na3Bi has attracted significant interest in both bulk form as a three-dimensional topological Dirac semimetal and in ultra-thin form as a wide-bandgap two-dimensional topological insulator. Its extreme air sensitivity has limited experimental efforts on thin- and ultra-thin films grown via molecular beam epitaxy to ultra-high vacuum environments. Here we demonstrate air-stable Na3Bi thin films passivated with magnesium difluoride (MgF2) or silicon (Si) capping layers. Electrical measurements show that deposition of MgF2 or Si has minimal impact on the transport properties of Na3Bi whilst in ultra-high vacuum. Importantly, the MgF2-passivated Na3Bi films are air-stable and remain metallic for over 100 hours after exposure to air, as compared to near instantaneous degradation when they are unpassivated. Air stability enables transfer of films to a conventional high-magnetic field cryostat, enabling quantum transport measurements which verify that the Dirac semimetal character of Na3Bi films is retained after air exposure.


title: Miniaturized optical frequency standard for next-generation portable optical clocks

abstract: Optical frequency standards, lasers stabilized to atomic or molecular transitions, are widely used in length metrology and laser ranging, provide a backbone for optical communications and lie at the heart of next-generation optical atomic clocks. Here we demonstrate a compact, low-power optical frequency standard based on the Doppler-free, two-photon transition in rubidium-87 at 778 nm implemented on a micro-optics breadboard. The optical standard achieves a fractional frequency stability of 2.9x10$^{-12}$/$\sqrt{\tau}$ for averaging times $\tau$ less than 10$^{3}$ s, has a volume of $\approx$35 cm$^3$ and operates on $\approx$450 mW of electrical power. These results demonstrate a key step towards the development of compact optical clocks and the broad dissemination of SI-traceable wavelength references.


title: Hadronic High-energy Emission from Magnetically Arrested Disks in Radio Galaxies

abstract: We propose a novel interpretation that gamma-rays from nearby radio galaxies are hadronic emission from magnetically arrested disks (MADs) around central black holes (BHs). The magnetic energy in MADs is higher than the thermal energy of the accreting plasma, where the magnetic reconnection or turbulence may efficiently accelerate non-thermal protons. They emit gamma-rays via hadronic processes, which can account for the observed gamma-rays for M87 and NGC 315. Non-thermal electrons are also accelerated with protons and produce MeV gamma-rays, which is useful to test our model by proposed MeV satellites. The hadronic emission from the MADs may significantly contribute to the GeV gamma-ray background and produce the multi-PeV neutrino background detectable by IceCube-Gen2. In addition, gamma-rays from MADs provide electron-positron pairs through two-photon pair production at the BH magnetosphere. These pairs can screen the vacuum gap, which affects high-energy emission and jet-launching mechanisms in radio galaxies.


title: MIP An AI Distributed Architectural Model to Introduce Cognitive computing capabilities in Cyber Physical Systems (CPS)

abstract: This paper introduces the MIP Platform architecture model, a novel AI-based cognitive computing platform architecture. The goal of the proposed application of MIP is to reduce the implementation burden for the usage of AI algorithms applied to cognitive computing and fluent HMI interactions within the manufacturing process in a cyber-physical production system. The cognitive inferencing engine of MIP is a deterministic cognitive module that processes declarative goals, identifies Intents and Entities, selects suitable actions and associated algorithms, and invokes for the execution a processing logic (Function) configured in the internal Function-as-aService or Connectivity Engine. Constant observation and evaluation against performance criteria assess the performance of Lambda(s) for many and varying scenarios. The modular design with well-defined interfaces enables the reusability and extensibility of FaaS components. An integrated BigData platform implements this modular design supported by technologies such as Docker, Kubernetes for virtualization and orchestration of the individual components and their communication. The implementation of the architecture is evaluated using a real-world use case later discussed in this paper.


title: An electron linac with high beam intensity over 1-Ampere for disposal of radioactive waste

abstract: In order to dissipate long-lived radioactive waste, not only high ux proton accelerator but also electron linac have been proposed. A proton accelerator directly induces nuclear fission and mutation. On the other hand, electron beam has two processes: production of gamma rays through bremsstrahlung and produced gamma rays are available for the (gamma ; n) reaction. Protons dissipate nuclei and simultaneously newly produce radioisotopes of by-products. Since an electron linac produces less radioactive wastes, we focus only an electron linac with high beam intensity more than 1-Ampere. To reduce the yield of by-products for radioisotopes as less as possible, we accelerate electron beam with the energy less than 30 MeV. The accelerated beam intensity is designed to be more than 1-Ampere. To realize an electron linac with high intensity, the operation for the linac is not pulsed one, but continuous wave. To accelerate electron beam, we install higher-order-modes (HOMs) free normal conducting cavities to suppress beam instabilities.


title: Non-reciprocal phase transitions

abstract: Out of equilibrium, the lack of reciprocity is the rule rather than the exception. Non-reciprocal interactions occur, for instance, in networks of neurons, directional growth of interfaces, and synthetic active materials. While wave propagation in non-reciprocal media has recently been under intense study, less is known about the consequences of non-reciprocity on the collective behavior of many-body systems. Here, we show that non-reciprocity leads to time-dependent phases where spontaneously broken symmetries are dynamically restored. The resulting phase transitions are controlled by spectral singularities called exceptional points. We describe the emergence of these phases using insights from bifurcation theory and non-Hermitian quantum mechanics. Our approach captures non-reciprocal generalizations of three archetypal classes of self-organization out of equilibrium: synchronization, flocking and pattern formation. Collective phenomena in these non-reciprocal systems range from active time-(quasi)crystals to exceptional-point enforced pattern-formation and hysteresis. Our work paves the way towards a general theory of critical phenomena in non-reciprocal matter.


title: Flux-induced topological superconductivity in full-shell nanowires

abstract: We present a novel route to realizing topological superconductivity using magnetic flux applied to a full superconducting shell surrounding a semiconducting nanowire core. In the destructive Little-Parks regime, reentrant regions of superconductivity are associated with integer number of phase windings in the shell. Tunneling into the core reveals a hard induced gap near zero applied flux, corresponding to zero phase winding, and a gapped region with a discrete zero-energy state around one applied flux quantum, {\Phi}_0 = h/2e, corresponding to 2{\pi} phase winding. Theoretical analysis indicates that in the presence of radial spin-orbit coupling in the semiconductor, the winding of the superconducting phase can induce a transition to a topological phase supporting Majorana zero modes. Realistic modeling shows a topological phase persisting over a wide range of parameters, and reproduces experimental tunneling conductance data. Further measurements of Coulomb blockade peak spacing around one flux quantum in full-shell nanowire islands shows exponentially decreasing deviation from 1e periodicity with device length, consistent with Majorana modes at the ends of the nanowire.


title: An under-approximation for the robust uncertain two-level cooperative set covering problem

abstract: This paper investigates the robust uncertain two-level cooperative set covering problem (RUTLCSCP). Given two types of facilities, which are called y-facility and z-facility. The problem is to decide which facilities of both types to be selected, in order to cover the demand nodes cooperatively with minimal cost. It combines the concepts of robust, probabilistic, and cooperative covering by introducting "$\Gamma$-robust two-level-cooperative $\alpha$-cover" constraints. Additionally, the constraint relaxed verison of the RUTLCSCP, which is also a linear approximation robust counterpart version of RUTLCSCP (RUTLCSCP-LA-RC), is developed by linear approximation of the constraints, and can be stated as a compact mixed-integer linear programming problem. We show that the solution for RUTLCSCP-LA-RC, $\varepsilon$-under-approximate solution, can also be the solution for RUTLCSCP on some conditions. Computational experiments show that the solutions in 333 instances (10125 instances in total) with 12 types which tinily violate the constraints of RUTLCSCP, can be an efficient under-approximate solutions, while the feasible solutions in other instances are proven to be optimal.


title: Self-similar orbit-averaged Fokker-Planck equation for isotropic spherical dense clusters (ii) physical properties and negative heat capacity of pre-collapse core

abstract: This is the second paper of a series of our works on the self-similar orbit-averaged Fokker-Planck (OAFP) equation and details physical properties of isotropic pre-collapse solution. The fundamental core collapse process at the late stage of relaxation evolution of spherical star clusters can be described by the self-similar OAFP equation. The accurate spectral solution was found recently in the first paper. The present work details the thermodynamic aspects of the model based on the stellar DF obtained from the solution. Our calculation shows the following local properties (i) Equation of state is $p=1.0\rho/\chi_\text{esc}$ in the core where $p$ is the pressure, $\rho$ the density and $\chi_\text{esc}$ the scaled escape energy, while it is $p=0.5\rho^{1.1}/\chi_\text{esc}$ at large radii. (ii) If we consider the center of the core is polytropic, the polytropic index is 177. Also, as a global property we construct caloric curves of the model to discuss the heat capacity together with Virial. Special focus is the cause of negative heat capacity of the core; the well-relaxed core can be directly compared to the isothermal sphere with positive heat capacity. Comparing our results to the previous works, we conclude, in the self-similar evolution, the negative heat capacity in the core holds due to collisionless and high-temperature stars that experience a rapid change in mean field potential through stellar- and heat- flows, rather than due to the (quasi-)isolation of the core from surroundings.


title: Graphon mean field systems

abstract: We consider heterogeneously interacting diffusive particle systems and their large population limit. The interaction is of mean field type with weights characterized by an underlying graphon. A law of large numbers result is established as the system size increases and the underlying graphons converge. The limit is given by a graphon mean field system consisting of independent but heterogeneous nonlinear diffusions whose probability distributions are fully coupled. Well-posedness, continuity and stability of such systems are provided. We also consider a not-so-dense analogue of the finite particle system, obtained by percolation with vanishing rates and suitable scaling of interactions. A law of large numbers result is proved for the convergence of such systems to the corresponding graphon mean field system.


title: Intrinsic orbital moment and prediction of a large orbital Hall effect in the 2D transition metal dichalcogenides

abstract: Carrying information using generation and detection of the orbital current, instead of the spin current, is an emerging field of research, where the orbital Hall effect (OHE) is an important ingredient. Here, we propose a new mechanism of the OHE that occurs in {\it non-}centrosymmetric materials. We show that the broken inversion symmetry in the 2D transition metal dichalcogenides (TMDCs) causes a robust orbital moment, which flow in different directions due to the opposite Berry curvatures under an applied electric field, leading to a large OHE. This is in complete contrast to the inversion-symmetric systems, where the orbital moment is induced only by the external electric field. We show that the valley-orbital locking as well as the OHE both appear even in the absence of the spin-orbit coupling. The non-zero spin-orbit coupling leads to the well-known valley-spin locking and the spin Hall effect, which we find to be weak, making the TMDCs particularly suitable for direct observation of the OHE, with potential application in {\it orbitronics}.


title: Tests of Dark MACHOs: Lensing, Accretion, and Glow

abstract: Dark matter could take the form of dark massive compact halo objects (dMACHOs); i.e., composite objects that are made up of dark-sector elementary particles, that could have a macroscopic mass from the Planck scale to above the solar mass scale, and that also admit a wide range of energy densities and sizes. Concentrating on the gravitational interaction of dMACHOs with visible matter, we map out the mass-radius parameter space that is consistent with gravitational lensing experiments, as well as anisotropies of the cosmic microwave background (CMB) based on the spherical accretion of matter onto a dMACHO in the hydrostatic approximation. For dMACHOs with a uniform-density mass profile and total mass in the range of $\sim 10^{-12} - 10\,M_\odot$, we find that a dMACHO could explain 100% of the dark matter if its radius is above $\approx 3$ times the Einstein radius of the lensing system. For a larger mass above $10\,M_\odot$, a dMACHO with radius above $\sim 1 \times 10^8 \mbox{cm} \times(M/100\,M_\odot)^{9/2}$ is consistent with CMB observables. For a lighter dMACHO with mass below $\sim 10^{-12}\,M_\odot$, there still is not a good experimental probe. Finally, we point out that heavier dMACHOs with masses $\sim 0.1\,M_\odot$ may be observed by X-ray and optical telescopes if they reside at rest in a large molecular cloud, nearby to our solar system, and accrete ordinary matter to emit photons.


title: Gradually Vanishing Bridge for Adversarial Domain Adaptation

abstract: In unsupervised domain adaptation, rich domain-specific characteristics bring great challenge to learn domain-invariant representations. However, domain discrepancy is considered to be directly minimized in existing solutions, which is difficult to achieve in practice. Some methods alleviate the difficulty by explicitly modeling domain-invariant and domain-specific parts in the representations, but the adverse influence of the explicit construction lies in the residual domain-specific characteristics in the constructed domain-invariant representations. In this paper, we equip adversarial domain adaptation with Gradually Vanishing Bridge (GVB) mechanism on both generator and discriminator. On the generator, GVB could not only reduce the overall transfer difficulty, but also reduce the influence of the residual domain-specific characteristics in domain-invariant representations. On the discriminator, GVB contributes to enhance the discriminating ability, and balance the adversarial training process. Experiments on three challenging datasets show that our GVB methods outperform strong competitors, and cooperate well with other adversarial methods. The code is available at https://github.com/cuishuhao/GVB.


title: Wannier-type photonic higher-order topological corner states induced solely by gain and loss

abstract: Photonic crystals have provided a controllable platform to examine excitingly new topological states in open systems. In this work, we reveal photonic topological corner states in a photonic graphene with mirror-symmetrically patterned gain and loss. Such a nontrivial Wannier-type higher-order topological phase is achieved through solely tuning on-site gain/loss strengths, which leads to annihilation of the two valley Dirac cones at a time-reversal-symmetric point, as the gain and loss change the effective tunneling between adjacent sites. We find that the symmetry-protected photonic corner modes exhibit purely imaginary energies and the role of the Wannier center as the topological invariant is illustrated. For experimental considerations, we also examine the topological interface states near a domain wall. Our work introduces an interesting platform for non-Hermiticity-induced photonic higher-order topological insulators, which, with current experimental technologies, can be readily accessed.


title: Bi2Te3/Si thermophotovoltaic cells converting low temperature radiation into electricity

abstract: The thermophotovoltaic cells which convert the low temperature radiation into electricity are of significance due to their potential applications in many fields. In this work, Bi2Te3/Si thermophotovoltaic cells which work under the radiation from the blackbody with the temperature of 300 K-480 K are presented. The experimental results show that the cells can output electricity even under the radiation temperature of 300 K. The band structure of Bi2Te3/Si heterojunctions and the defects in Bi2Te3 thin films lower the conversion efficiency of the cells. It is also demonstrated that the resistivity of Si and the thickness of Bi2Te3 thin films have important effects on Bi2Te3/Si thermophotovoltaic cells. Although the cells' output power is small, this work provides a possible way to utilize the low temperature radiation.


title: Learning reaction coordinates via cross-entropy minimization: Application to alanine dipeptide

abstract: We propose a cross-entropy minimization method for finding the reaction coordinate from a large number of collective variables in complex molecular systems. This method is an extension of the likelihood maximization approach describing the committor function with a sigmoid. By design, the reaction coordinate as a function of various collective variables is optimized such that the distribution of the committor $p_\mathrm{B}^*$ values generated from molecular dynamics simulations can be described in a sigmoidal manner. We also introduce the $L_2$-norm regularization used in the machine learning field to prevent overfitting when the number of considered collective variables is large. The current method is applied to study the isomerization of alanine dipeptide in vacuum, where 45 dihedral angles are used as candidate variables. The regularization parameter is determined by cross-validation using training and test datasets. It is demonstrated that the optimal reaction coordinate involves important dihedral angles, which are consistent with the previously reported results. Furthermore, the points with $p_\mathrm{B}^*\sim 0.5$ clearly indicate a separatrix distinguishing reactant and product states on the potential of mean force using the extracted dihedral angles.


title: Bounding Privacy Leakage in Smart Buildings

abstract: Smart building management systems rely on sensors to optimize the operation of buildings. If an unauthorized user gains access to these sensors, a privacy leak may occur. This paper considers such a potential leak of privacy in a smart residential building, and how it may be mitigated through corrupting the measurements with additive Gaussian noise. This corruption is done in order to hide the occupancy change in an apartment. A lower bound on the variance of any estimator that estimates the change time is derived. The bound is then used to analyze how different model parameters affect the variance. It is shown that the signal to noise ratio and the system dynamics are the main factors that affect the bound. These results are then verified on a simulator of the KTH Live-In Lab Testbed, showing good correspondence with theoretical results.


title: Lagrange spectrum of a circle over the Eisensteinian field

abstract: We study an intrinsic Lagrange spectrum of the unit circle $|z|=1$ in the complex plane with respect to the Eisensteinian field $\mathbb{Q}(\sqrt{-3})$. We prove that the minimum of the Lagrange spectrum is $2$ and that its smallest accumulation point is $4/\sqrt{3}$. In addition, we characterize the set of all values in the spectrum between $2$ and $4/\sqrt3$.


title: Brownian heat engine with active reservoirs

abstract: Microorganisms such as bacteria are active matters which consume chemical energy and generate their unique run-and-tumble motion. A swarm of such microorganisms provide a nonequilibrium active environment whose noise characteristics are different from those of thermal equilibrium reservoirs. One important difference is a finite persistence time, which is considerably large compared to that of the equilibrium noise, that is, the active noise is colored. Here, we study a mesoscopic energy-harvesting device (engine) with active reservoirs harnessing this noise nature. For a simple linear model, we analytically show that the engine efficiency can surpass the conventional Carnot bound, thus the power-efficiency tradeoff constraint is released, and the efficiency at the maximum power can overcome the Curzon-Ahlborn efficiency. We find that the supremacy of the active engine critically depends on the time-scale symmetry of two active reservoirs.


title: Partial Traces and the Geometry of Entanglement; Sufficient Conditions for the Separability of Gaussian States

abstract: The notion of partial trace of a density operator is essential for the understanding of the entanglement and separability properties of quantum states. In this paper we investigate these notions putting an emphasis on the geometrical properties of the covariance ellipsoids of the reduced states. We thereafter focus on Gaussian states and we give new and easily numerically implementable sufficient conditions for the separability of all Gaussian states. Unlike the positive partial transposition criterion, none of these conditions is however necessary.


title: Incremental Learning In Online Scenario

abstract: Modern deep learning approaches have achieved great success in many vision applications by training a model using all available task-specific data. However, there are two major obstacles making it challenging to implement for real life applications: (1) Learning new classes makes the trained model quickly forget old classes knowledge, which is referred to as catastrophic forgetting. (2) As new observations of old classes come sequentially over time, the distribution may change in unforeseen way, making the performance degrade dramatically on future data, which is referred to as concept drift. Current state-of-the-art incremental learning methods require a long time to train the model whenever new classes are added and none of them takes into consideration the new observations of old classes. In this paper, we propose an incremental learning framework that can work in the challenging online learning scenario and handle both new classes data and new observations of old classes. We address problem (1) in online mode by introducing a modified cross-distillation loss together with a two-step learning technique. Our method outperforms the results obtained from current state-of-the-art offline incremental learning methods on the CIFAR-100 and ImageNet-1000 (ILSVRC 2012) datasets under the same experiment protocol but in online scenario. We also provide a simple yet effective method to mitigate problem (2) by updating exemplar set using the feature of each new observation of old classes and demonstrate a real life application of online food image classification based on our complete framework using the Food-101 dataset.


title: How to Find a Point in the Convex Hull Privately

abstract: We study the question of how to compute a point in the convex hull of an input set $S$ of $n$ points in ${\mathbb R}^d$ in a differentially private manner. This question, which is trivial non-privately, turns out to be quite deep when imposing differential privacy. In particular, it is known that the input points must reside on a fixed finite subset $G\subseteq{\mathbb R}^d$, and furthermore, the size of $S$ must grow with the size of $G$. Previous works focused on understanding how $n$ needs to grow with $|G|$, and showed that $n=O\left(d^{2.5}\cdot8^{\log^*|G|}\right)$ suffices (so $n$ does not have to grow significantly with $|G|$). However, the available constructions exhibit running time at least $|G|^{d^2}$, where typically $|G|=X^d$ for some (large) discretization parameter $X$, so the running time is in fact $\Omega(X^{d^3})$. In this paper we give a differentially private algorithm that runs in $O(n^d)$ time, assuming that $n=\Omega(d^4\log X)$. To get this result we study and exploit some structural properties of the Tukey levels (the regions $D_{\ge k}$ consisting of points whose Tukey depth is at least $k$, for $k=0,1,...$). In particular, we derive lower bounds on their volumes for point sets $S$ in general position, and develop a rather subtle mechanism for handling point sets $S$ in degenerate position (where the deep Tukey regions have zero volume). A naive approach to the construction of the Tukey regions requires $n^{O(d^2)}$ time. To reduce the cost to $O(n^d)$, we use an approximation scheme for estimating the volumes of the Tukey regions (within their affine spans in case of degeneracy), and for sampling a point from such a region, a scheme that is based on the volume estimation framework of Lov\'asz and Vempala (FOCS 2003) and of Cousins and Vempala (STOC 2015). Making this framework differentially private raises a set of technical challenges that we address.


title: Adversarial Feature Hallucination Networks for Few-Shot Learning

abstract: The recent flourish of deep learning in various tasks is largely accredited to the rich and accessible labeled data. Nonetheless, massive supervision remains a luxury for many real applications, boosting great interest in label-scarce techniques such as few-shot learning (FSL), which aims to learn concept of new classes with a few labeled samples. A natural approach to FSL is data augmentation and many recent works have proved the feasibility by proposing various data synthesis models. However, these models fail to well secure the discriminability and diversity of the synthesized data and thus often produce undesirable results. In this paper, we propose Adversarial Feature Hallucination Networks (AFHN) which is based on conditional Wasserstein Generative Adversarial networks (cWGAN) and hallucinates diverse and discriminative features conditioned on the few labeled samples. Two novel regularizers, i.e., the classification regularizer and the anti-collapse regularizer, are incorporated into AFHN to encourage discriminability and diversity of the synthesized features, respectively. Ablation study verifies the effectiveness of the proposed cWGAN based feature hallucination framework and the proposed regularizers. Comparative results on three common benchmark datasets substantiate the superiority of AFHN to existing data augmentation based FSL approaches and other state-of-the-art ones.


title: Density-Aware Graph for Deep Semi-Supervised Visual Recognition

abstract: Semi-supervised learning (SSL) has been extensively studied to improve the generalization ability of deep neural networks for visual recognition. To involve the unlabelled data, most existing SSL methods are based on common density-based cluster assumption: samples lying in the same high-density region are likely to belong to the same class, including the methods performing consistency regularization or generating pseudo-labels for the unlabelled images. Despite their impressive performance, we argue three limitations exist: 1) Though the density information is demonstrated to be an important clue, they all use it in an implicit way and have not exploited it in depth. 2) For feature learning, they often learn the feature embedding based on the single data sample and ignore the neighborhood information. 3) For label-propagation based pseudo-label generation, it is often done offline and difficult to be end-to-end trained with feature learning. Motivated by these limitations, this paper proposes to solve the SSL problem by building a novel density-aware graph, based on which the neighborhood information can be easily leveraged and the feature learning and label propagation can also be trained in an end-to-end way. Specifically, we first propose a new Density-aware Neighborhood Aggregation(DNA) module to learn more discriminative features by incorporating the neighborhood information in a density-aware manner. Then a novel Density-ascending Path based Label Propagation(DPLP) module is proposed to generate the pseudo-labels for unlabeled samples more efficiently according to the feature distribution characterized by density. Finally, the DNA module and DPLP module evolve and improve each other end-to-end.


title: Approximate Equilibrium Computation for Discrete-Time Linear-Quadratic Mean-Field Games

abstract: While the topic of mean-field games (MFGs) has a relatively long history, heretofore there has been limited work concerning algorithms for the computation of equilibrium control policies. In this paper, we develop a computable policy iteration algorithm for approximating the mean-field equilibrium in linear-quadratic MFGs with discounted cost. Given the mean-field, each agent faces a linear-quadratic tracking problem, the solution of which involves a dynamical system evolving in retrograde time. This makes the development of forward-in-time algorithm updates challenging. By identifying a structural property of the mean-field update operator, namely that it preserves sequences of a particular form, we develop a forward-in-time equilibrium computation algorithm. Bounds that quantify the accuracy of the computed mean-field equilibrium as a function of the algorithm's stopping condition are provided. The optimality of the computed equilibrium is validated numerically. In contrast to the most recent/concurrent results, our algorithm appears to be the first to study infinite-horizon MFGs with non-stationary mean-field equilibria, though with focus on the linear quadratic setting.


title: Investigating how students collaborate to generate physics problems through structured tasks

abstract: Traditionally, scholars in physics education research pay attention to students solving well-structured learning activities, which provide restricted room for collaboration and idea-generation due to their close-ended nature. In order to encourage the socialization of information among group members, we utilized a real-world problem where students were asked to generate a well-structured physics task, and investigated how student groups collaborated to create physics problems for younger students at an introductory physics course at a university in northern Chile. Data collection consists of audio recording the group discussions while they were collaborating to develop their physics problems as well as the solutions they created to their problems. Through interviews, we accessed students' perceptions on the task and its challenges. Results suggest that generating problems is an opportunity for students to propose ideas and make decisions regarding the goals of the problem, concepts and procedures, contextual details and magnitudes and units to introduce in their generated problems. In addition, we found evidence that groups tested the validity of their creations by engaging in strategies often observed with algebra-based physics problems, such as mathematical procedures and qualitative descriptions of the physics embedded in the problem, yet groups invested more time with algebra-based strategies compared to more qualitative descriptions. Students valued the open-ended nature of the task and recognized its benefits in utilizing physics ideas into context, which in turn enabled collaboration in a way not experienced with traditional algebra-based problems. These findings support the use of generative activities as a pathway for students to engage in real-world physics problems that allow for a range and variety of collective processes and ideas.


title: Cross-Domain Document Object Detection: Benchmark Suite and Method

abstract: Decomposing images of document pages into high-level semantic regions (e.g., figures, tables, paragraphs), document object detection (DOD) is fundamental for downstream tasks like intelligent document editing and understanding. DOD remains a challenging problem as document objects vary significantly in layout, size, aspect ratio, texture, etc. An additional challenge arises in practice because large labeled training datasets are only available for domains that differ from the target domain. We investigate cross-domain DOD, where the goal is to learn a detector for the target domain using labeled data from the source domain and only unlabeled data from the target domain. Documents from the two domains may vary significantly in layout, language, and genre. We establish a benchmark suite consisting of different types of PDF document datasets that can be utilized for cross-domain DOD model training and evaluation. For each dataset, we provide the page images, bounding box annotations, PDF files, and the rendering layers extracted from the PDF files. Moreover, we propose a novel cross-domain DOD model which builds upon the standard detection model and addresses domain shifts by incorporating three novel alignment modules: Feature Pyramid Alignment (FPA) module, Region Alignment (RA) module and Rendering Layer alignment (RLA) module. Extensive experiments on the benchmark suite substantiate the efficacy of the three proposed modules and the proposed method significantly outperforms the baseline methods. The project page is at \url{https://github.com/kailigo/cddod}.


title: InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining

abstract: Multi-modal pretraining for learning high-level multi-modal representation is a further step towards deep learning and artificial intelligence. In this work, we propose a novel model, namely InterBERT (BERT for Interaction), which is the first model of our series of multimodal pretraining methods M6 (MultiModality-to-MultiModality Multitask Mega-transformer). The model owns strong capability of modeling interaction between the information flows of different modalities. The single-stream interaction module is capable of effectively processing information of multiple modalilties, and the two-stream module on top preserves the independence of each modality to avoid performance downgrade in single-modal tasks. We pretrain the model with three pretraining tasks, including masked segment modeling (MSM), masked region modeling (MRM) and image-text matching (ITM); and finetune the model on a series of vision-and-language downstream tasks. Experimental results demonstrate that InterBERT outperforms a series of strong baselines, including the most recent multi-modal pretraining methods, and the analysis shows that MSM and MRM are effective for pretraining and our method can achieve performances comparable to BERT in single-modal tasks. Besides, we propose a large-scale dataset for multi-modal pretraining in Chinese, and we develop the Chinese InterBERT which is the first Chinese multi-modal pretrained model. We pretrain the Chinese InterBERT on our proposed dataset of 3.1M image-text pairs from the mobile Taobao, the largest Chinese e-commerce platform. We finetune the model for text-based image retrieval, and recently we deployed the model online for topic-based recommendation.


title: A note on Onicescu's informational energy and correlation coefficient in exponential families

abstract: The informational energy of Onicescu is a positive quantity that measures the amount of uncertainty of a random variable. But contrary to Shannon's entropy, the informational energy increases when randomness decreases. We report closed-form formula for Onicescu's informational energy and its associated correlation coefficient when the probability distributions belong to an exponential family. We show how to instantiate the generic formula for several common exponential families.


title: Rainbow Saturation

abstract: We introduce a notion of rainbow saturation and the corresponding rainbow saturation number. This is the saturation version of the rainbow Tur\'an numbers whose systematic study was initiated by Keevash, Mubayi, Sudakov, and Verstra\"ete. We give examples of graphs for which the rainbow saturation number is bounded away from the ordinary saturation number. This includes all complete graphs $K_n$ for $n\geq 4$, and several bipartite graphs. It is notable that there are non-bipartite graphs for which this is the case, as this does not happen when it comes to the rainbow extremal number versus the traditional extremal number. We also show that saturation numbers are linear for a large class of graphs, providing a partial rainbow analogue of a well known theorem of K\'asonyi and Tuza. We conclude this paper with related open questions and conjectures.


title: Probabilistic Caching for Small-Cell Networks with Terrestrial and Aerial Users

abstract: The support for aerial users has become the focus of recent 3GPP standardizations of 5G, due to their high maneuverability and flexibility for on-demand deployment. In this paper, probabilistic caching is studied for ultra-dense small-cell networks with terrestrial and aerial users, where a dynamic on-off architecture is adopted under a sophisticated path loss model incorporating both line-of-sight and non-line-of-sight transmissions. Generally, this paper focuses on the successful download probability (SDP) of user equipments (UEs) from small-cell base stations (SBSs) that cache the requested files under various caching strategies. To be more specific, the SDP is first analyzed using stochastic geometry theory, by considering the distribution of such two-tier UEs and SBSs as Homogeneous Poisson Point Processes. Second, an optimized caching strategy (OCS) is proposed to maximize the average SDP. Third, the performance limits of the average SDP are developed for the popular caching strategy (PCS) and the uniform caching strategy (UCS). Finally, the impacts of the key parameters, such as the SBS density, the cache size, the exponent of Zipf distribution and the height of aerial user, are investigated on the average SDP. The analytical results indicate that the UCS outperforms the PCS if the SBSs are sufficiently dense, while the PCS is better than the UCS if the exponent of Zipf distribution is large enough. Furthermore, the proposed OCS is superior to both the UCS and PCS.


title: Optimization of quantum noise by completing the square of multiple interferometer outputs in quantum locking for gravitational wave detectors

abstract: The quantum locking technique, which uses additional short low-loss sub-cavities, is effective in reducing quantum noise in space gravitational wave antenna DECIGO. However, the quantum noise of the main interferometer depends on the control systems in the sub-cavities. Here we demonstrate a new method to optimize the quantum noise independently of the feedback gain by completing the square in the quantum locking system. We successfully demonstrate in simulations that this method is effective in optimizing the homodyne angle to the best quantum-noise-limited sensitivity.


title: Linear Precoding for Fading Cognitive Multiple Access Wiretap Channel with Finite-Alphabet Inputs

abstract: We investigate the fading cognitive multiple access wiretap channel (CMAC-WT), in which two secondary-user transmitters (STs) send secure messages to a secondary-user receiver (SR) in the presence of an eavesdropper (ED) and subject to interference threshold constraints at multiple primary-user receivers (PRs). We design linear precoders to maximize the average secrecy sum rate for multiple-input multiple-output (MIMO) fading CMAC-WT under finite-alphabet inputs and statistical channel state information (CSI) at STs. For this non-deterministic polynomial time (NP)-hard problem, we utilize an accurate approximation of the average secrecy sum rate to reduce the computational complexity, and then present a two-layer algorithm by embedding the convex-concave procedure into an outer approximation framework. The idea behind this algorithm is to reformulate the approximated average secrecy sum rate as a difference of convex functions, and then generate a sequence of simpler relaxed sets to approach the non-convex feasible set. Subsequently, we maximize the approximated average secrecy sum rate over the sequence of relaxed sets by using the convex-concave procedure. Numerical results indicate that our proposed precoding algorithm is superior to the conventional Gaussian precoding method in the medium and high signal-to-noise ratio (SNR) regimes.


title: Design of Compact Huygens' Metasurface Pairs with Multiple Reflections for Arbitrary Wave Transformations

abstract: Huygens' metasurfaces have demonstrated a remarkable potential to perform wave transformations within a subwavelength region. In particular, omega-bianisotropic Huygens' metasurfaces have allowed for the passive implementation of any wave transformation that conserves real power locally. Previous reports have also shown that Huygens' metasurface pairs are capable of realizing transformations that break the local power conservation requirement by redistributing the total power, while the wave propagates between the two metasurfaces. However, the required separation distance overshadows the low-profile characteristics of the individual metasurfaces and leads to bulky designs, especially for lower frequencies. In this work, we develop a method of designing omega-bianisotropic Huygens' metasurface pairs, relying on a point-matching process of the real power at the two metasurfaces. We highlight the versatility of our method by presenting two variations of the configuration, depending on whether the electromagnetic source is located within or outside the metasurface pair. Based on the examples of a cylindrical-wave to plane-wave transformation and a beam expander, we examine the impact of multiple reflections, as a way to overcome the size limitations and design compact structures. Moreover, we explore possible beamforming applications through an example of a Taylor-pattern antenna with a single feed-point between the two metasurfaces.


title: Learning Contextualized Sentence Representations for Document-Level Neural Machine Translation

abstract: Document-level machine translation incorporates inter-sentential dependencies into the translation of a source sentence. In this paper, we propose a new framework to model cross-sentence dependencies by training neural machine translation (NMT) to predict both the target translation and surrounding sentences of a source sentence. By enforcing the NMT model to predict source context, we want the model to learn "contextualized" source sentence representations that capture document-level dependencies on the source side. We further propose two different methods to learn and integrate such contextualized sentence embeddings into NMT: a joint training method that jointly trains an NMT model with the source context prediction model and a pre-training & fine-tuning method that pretrains the source context prediction model on a large-scale monolingual document corpus and then fine-tunes it with the NMT model. Experiments on Chinese-English and English-German translation show that both methods can substantially improve the translation quality over a strong document-level Transformer baseline.


title: Subadditivity of Kodaira dimension does not hold in positive characteristic

abstract: Over any algebraically closed field of positive characteristic, we construct examples of fibrations violating subadditivity of Kodaira dimension.


title: Two remarks on proof theory of first-order arithmetic

abstract: In this note let us give two remarks on proof-theory of PA. First a derivability relation is introduced to bound witnesses for provable $\Sigma_{1}$-formulas in PA. Second Paris-Harrington's proof for their independence result is reformulated to show a `consistency' proof of PA based on a combinatorial principle.


title: Minimax optimality of permutation tests

abstract: Permutation tests are widely used in statistics, providing a finite-sample guarantee on the type I error rate whenever the distribution of the samples under the null hypothesis is invariant to some rearrangement. Despite its increasing popularity and empirical success, theoretical properties of the permutation test, especially its power, have not been fully explored beyond simple cases. In this paper, we attempt to partly fill this gap by presenting a general non-asymptotic framework for analyzing the minimax power of the permutation test. The utility of our proposed framework is illustrated in the context of two-sample and independence testing under both discrete and continuous settings. In each setting, we introduce permutation tests based on U-statistics and study their minimax performance. We also develop exponential concentration bounds for permuted U-statistics based on a novel coupling idea, which may be of independent interest. Building on these exponential bounds, we introduce permutation tests which are adaptive to unknown smoothness parameters without losing much power. The proposed framework is further illustrated using more sophisticated test statistics including weighted U-statistics for multinomial testing and Gaussian kernel-based statistics for density testing. Finally, we provide some simulation results that further justify the permutation approach.


title: Flag manifolds over semifields

abstract: In this paper, we develop the theory of flag manifold over a semifield for any Kac-Moody root datum. We show that the flag manifold over a semifield admits a natural action of the monoid over that semifield associated with the Kac-Moody datum and admits a cellular decomposition. This extends the previous work of Lusztig, Postnikov, Rietsch and others on the totally nonnegative flag manifolds (of finite type) and the work of Lusztig, Speyer, Williams on the tropical flag manifolds (of finite type). As a by-product, we prove a conjecture of Lusztig on the duality of totally nonnegative flag manifold of finite type.


title: Poisson structure on character varieties

abstract: We show that the character variety for a $n$-punctured oriented surface has a natural Poisson structure.


title: Rational curves on a smooth Hermitian surface II

abstract: In characteristic $p>0$ and for $q$ a power of $p$, we compute the number of nonplanar rational curves of arbitrary degrees on a smooth Hermitian surface of degree $q+1$ under the assumption that the curves have a parametrization given by polynomials with at most $4$ terms. It is shown that a smooth Hermitian cubic surface contains infinitely many rational curves of degree $3$ and $6$. On the other hand, for all other cases the numbers of curves are finite and they are exactly determined. Further such rational curves are given explicitly up to projective isomorphism and their smoothness are checked.


title: Temporal Network Representation Learning via Historical Neighborhoods Aggregation

abstract: Network embedding is an effective method to learn low-dimensional representations of nodes, which can be applied to various real-life applications such as visualization, node classification, and link prediction. Although significant progress has been made on this problem in recent years, several important challenges remain, such as how to properly capture temporal information in evolving networks. In practice, most networks are continually evolving. Some networks only add new edges or nodes such as authorship networks, while others support removal of nodes or edges such as internet data routing. If patterns exist in the changes of the network structure, we can better understand the relationships between nodes and the evolution of the network, which can be further leveraged to learn node representations with more meaningful information. In this paper, we propose the Embedding via Historical Neighborhoods Aggregation (EHNA) algorithm. More specifically, we first propose a temporal random walk that can identify relevant nodes in historical neighborhoods which have impact on edge formations. Then we apply a deep learning model which uses a custom attention mechanism to induce node embeddings that directly capture temporal information in the underlying feature representation. We perform extensive experiments on a range of real-world datasets, and the results demonstrate the effectiveness of our new approach in the network reconstruction task and the link prediction task.


title: Deep Learning-Based Anomaly Detection in Cyber-Physical Systems: Progress and Opportunities

abstract: Anomaly detection is crucial to ensure the security of cyber-physical systems (CPS). However, due to the increasing complexity of CPSs and more sophisticated attacks, conventional anomaly detection methods, which face the growing volume of data and need domain-specific knowledge, cannot be directly applied to address these challenges. To this end, deep learning-based anomaly detection (DLAD) methods have been proposed. In this paper, we review state-of-the-art DLAD methods in CPSs. We propose a taxonomy in terms of the type of anomalies, strategies, implementation, and evaluation metrics to understand the essential properties of current methods. Further, we utilize this taxonomy to identify and highlight new characteristics and designs in each CPS domain. Also, we discuss the limitations and open problems of these methods. Moreover, to give users insights into choosing proper DLAD methods in practice, we experimentally explore the characteristics of typical neural models, the workflow of DLAD methods, and the running performance of DL models. Finally, we discuss the deficiencies of DL approaches, our findings, and possible directions to improve DLAD methods and motivate future research.


title: Temporal and Spatial Scales in Coronal Rain Revealed by UV Imaging and Spectroscopic Observations

abstract: Coronal rain corresponds to cool and dense clumps in the corona accreting towards the solar surface, and is often observed above solar active regions. They are generally thought to be produced by thermal instability in the corona and their lifetime is limited by the time they take to reach the chromosphere. Although the rain usually fragments into smaller clumps while falling down, their specific spatial and temporal scales remain unclear. In addition, the observational signatures of the impact of the rain with the chromosphere have not been clarified yet. In this study, we investigate the time evolution of velocity and intensity of coronal rain above a sunspot by analyzing coronal images obtained by the AIA onboard the SDO satellite as well as the Slit-Jaw Images (SJIs) and spectral data taken by the IRIS satellite. We identify dark and bright threads moving towards the umbra in AIA images and in SJIs, respectively, and co-spatial chromospheric intensity enhancements and redshifts in three IRIS spectra, Mg II k 2796 Angstrom, Si IV 1394 Angstrom, and C II 1336 Angstrom. The intensity enhancements and coronal rain redshifts occur almost concurrently in all the three lines, which clearly demonstrates the causal relationship with coronal rain. Furthermore, we detect bursty intensity variation with a timescale shorter than 1 minute in Mg II k, Si IV and C II spectra, indicating that a length scale of rain clumps is about 2.7 Mm if we multiply the typical time scale of the busty intensity variation at 30 sec by the rain velocity at 90 $\mathrm{km\ s}^{-1}$. Such rapid enhancements in the IRIS lines are excited within a time lag of 5.6 sec limited by the temporal resolution. These temporal and spatial scales may reflect the physical processes responsible for the rain morphology, and are suggestive of instabilities such as Kelvin-Helmholtz.


title: Some Conclusions on Markov Matrices and Transformations

abstract: Markov matrices have an important role in the filed of stochastic processes. In this paper, we will show and prove a series of conclusions on Markov matrices and transformations rather than pay attention to stochastic processes although these conclusions are useful for studying stochastic processes. These conclusions we come to, which will make us have a deeper understanding of Markov matrices and transformations, refer to eigenvalues, eigenvectors and the structure of invariant subspaces. At the same time, we account for the corresponding significances of the conclusions. For any Markov matrix and the corresponding transformation, we decompose the space as a direct sum of an eigenvector and an invariant subspace. Enlightened by this, we achieve two theorems about Markov matrices and transformations inspired by which we conclude that Markov transformations may be a defective matrix--in other words, may be a nondiagonalizable one. Specifically, we construct a nondiagonalizable Markov matrix to exhibit our train of thought.


title: Learning to Learn Single Domain Generalization

abstract: We are concerned with a worst-case scenario in model generalization, in the sense that a model aims to perform well on many unseen domains while there is only one single domain available for training. We propose a new method named adversarial domain augmentation to solve this Out-of-Distribution (OOD) generalization problem. The key idea is to leverage adversarial training to create "fictitious" yet "challenging" populations, from which a model can learn to generalize with theoretical guarantees. To facilitate fast and desirable domain augmentation, we cast the model training in a meta-learning scheme and use a Wasserstein Auto-Encoder (WAE) to relax the widely used worst-case constraint. Detailed theoretical analysis is provided to testify our formulation, while extensive experiments on multiple benchmark datasets indicate its superior performance in tackling single domain generalization.


title: Deep Residual Neural Networks for Image in Speech Steganography

abstract: Steganography is the art of hiding a secret message inside a publicly visible carrier message. Ideally, it is done without modifying the carrier, and with minimal loss of information in the secret message. Recently, various deep learning based approaches to steganography have been applied to different message types. We propose a deep learning based technique to hide a source RGB image message inside finite length speech segments without perceptual loss. To achieve this, we train three neural networks; an encoding network to hide the message in the carrier, a decoding network to reconstruct the message from the carrier and an additional image enhancer network to further improve the reconstructed message. We also discuss future improvements to the algorithm proposed.


title: Exact electrostatic energy calculation for charged systems neutralized by uniformly distributed background charge using fast multipole method and its application to efficient free energy calculation

abstract: In the molecular dynamics calculations for the free energy of ions and ionic molecules, we often encounter wet charged molecular systems where electrical neutrality condition is broken. This causes a problem in the evaluation of electrostatic interaction under periodic boundary condition. A standard remedy for the problem is to consider a hypothetical homogeneous background charge density to neutralize the total system. Here, we present a new expression for the evaluation of electrostatic interactions for the system including the background charge by fast multipole method (FMM). Further, an efficient scheme to evaluate solute-solvent interaction energy by FMM has been developed to reduce the computation of far-field part. We have calculated hydration free energy of ions, Mg$^{2+}$, Na$^{+}$, and Cl$^{-}$ dissolved in neutral solvent using the new expression. The calculated free energy showed a good agreement with the result using well-established particle mesh Ewald method, demonstrating the validity of the present expression in the framework of FMM. An advantage of the present scheme is in an efficient free energy calculation of a large-scale charged systems (particularly over million particles) based on highly parallel computations.


title: A radiative seesaw model with three Higgs doublets in modular $A_4$ symmetry

abstract: We propose a radiative seesaw model based on a modular $A_4$ symmetry, which has good predictability in the lepton sector. We execute a numerical analysis to search for parameters that satisfy the experimental constraints such as those from neutrino oscillation data and lepton flavor violations. Then, we present several predictions in our model that originate from the modular symmetry at a fixed point as well as fundamental region of $\tau$.