title: Mapping nanoscale dynamic properties of suspended and supported multi-layer graphene membranes via contact resonance and ultrasonic scanning probe microscopies

abstract: Graphene (GR) remarkable mechanical and electrical properties - such as its Young's modulus, low mass per unit area, natural atomic flatness and electrical conductance - would make it an ideal material for micro and nanoelectromechanical systems (MEMS and NEMS). However, the difficulty of attaching GR to supports coupled with naturally occurring internal defects in a few-layer GR can significantly adversely affect the performance of such devices. Here, we have used a combined contact resonance atomic force microscopy (CR-AFM) and ultrasonic force microscopy (UFM) approach to characterise and map with nanoscale spatial resolution GR membrane properties inaccessible to most conventional scanning probe characterisation techniques. Using a multi-layer GR plate (membrane) suspended over a round hole we show that this combined approach allows access to the mechanical properties, internal structure and attachment geometry of the membrane providing information about both the supported and suspended regions of the system. We show that UFM allows the precise geometrical position of the supported membrane-substrate contact to be located and provides indication of the local variation of its quality in the contact areas. At the same time, we show that by mapping the position sensitive frequency and phase response of CR-AFM response, one can reliably quantify the membrane stiffness, and image the defects in the suspended area of the membrane. The phase and amplitude of experimental CR-AFM measurements show excellent agreement with an analytical model accounting for the resonance of the combined CR-AFM probe-membrane system. The combination of UFM and CR-AFM provide a beneficial combination for investigation of few-layer NEMS systems based on two dimensional materials.


title: Consequences of Neutrinoless Double Decays Dominated by Short Range Interactions

abstract: We investigate some consequences if neutrinoless double beta decays of nuclei are dominated by short range interactions. To illustrate our results, we assume that such decays proceed mainly through short range interactions involving two-W-bosons exchanges and confine ourselves to only include new scalars without new gauge interactions for SM fermions. For the neutrino mass problem we propose to solve it by adopting that the active light neutrinos have predominantly Dirac masses and the small Majorana masses induced by the new scalars render them pseudo(quasi)-Dirac particles. This particular aspect of neutrinos may be detectable in the next generation of neutrino oscillation experiments and/or neutrino telescopes. If so this opens a new connection between neutrinoless double beta decays and neutrino physics. We also noted the new physics signals such as high charged scalar states that can be explored in hadron colliders. In particular, we find that a high energy e^- e^- collider will be very useful in testing the origin of lepton number violation which complements neutrinoless double decays studies.


title: RC Circuits based Distributed Conditional Gradient Method

abstract: We consider distributed optimization on undirected connected graphs. We propose a novel distributed conditional gradient method with (O(1/\sqrt{k})) convergence. Compared with existing methods, each iteration of our method uses both communication and linear minimization step only once rather than multiple times. We further extend our results to cases with composite local constraints. We demonstrate our results via examples on distributed matrix completion problem.


title: An introduction to the trapping experienced by biased random walk on the trace of biased random walk

abstract: We introduce and summarise results from the recent paper 'Biased random walk on the trace of biased random walk on the trace of ...', which was written jointly with M. P. Holmes (University of Melbourne). We also present additional discussion on some of the conjectures made in that work. The content of this article is loosely based on the presentation given by the author at the Probability Symposium held at the Research Institute for Mathematical Sciences, Kyoto University in December 2018


title: Camera Trace Erasing

abstract: Camera trace is a unique noise produced in digital imaging process. Most existing forensic methods analyze camera trace to identify image origins. In this paper, we address a new low-level vision problem, camera trace erasing, to reveal the weakness of trace-based forensic methods. A comprehensive investigation on existing anti-forensic methods reveals that it is non-trivial to effectively erase camera trace while avoiding the destruction of content signal. To reconcile these two demands, we propose Siamese Trace Erasing (SiamTE), in which a novel hybrid loss is designed on the basis of Siamese architecture for network training. Specifically, we propose embedded similarity, truncated fidelity, and cross identity to form the hybrid loss. Compared with existing anti-forensic methods, SiamTE has a clear advantage for camera trace erasing, which is demonstrated in three representative tasks. Code and dataset are available at https://github.com/ngchc/CameraTE.


title: Clustering-Based Model Order Reduction for Nonlinear Network Systems

abstract: Clustering by projection has been proposed as a way to preserve network structure in linear multi-agent systems. Here, we extend this approach to a class of nonlinear network systems. Additionally, we generalize our clustering method which restores the network structure in an arbitrary reduced-order model obtained by projection. We demonstrate this method on a number of examples.


title: Large deviations for backward stochastic differential equations driven by $G$-Brownian motion

abstract: In this paper, we consider forward-backward stochastic differential equation driven by $G$-Brownian motion ($G$-FBSDEs in short) with small parameter $\varepsilon > 0$. We study the asymptotic behavior of the solution of the backward equation and establish a large deviation principle for the corresponding process.


title: Bounded-Rational Pursuit-Evasion Games

abstract: We present a framework that incorporates the idea of bounded rationality into dynamic stochastic pursuit-evasion games. The solution of a stochastic game is characterized, in general, by its (Nash) equilibria in feedback form. However, computing these Nash equilibrium strategies may require extensive computational resources. In this paper, the agents are modeled as bounded rational entities having limited computational resources. We illustrate the framework by applying it to a pursuit-evasion game between two vehicles in a stochastic wind field, where both the pursuer and the evader are bounded rational. We show how such a game may be analyzed by properly casting it as an iterative sequence of finite-state Markov Decision Processes (MDPs). Leveraging tools and algorithms from cognitive hierarchy theory ("level-$k$ thinking") we compute the solution of the ensuing discrete game, while taking into consideration the rationality level of each agent. We also present an online algorithm for each agent to infer its opponent rationality level.


title: Model-based Inference for Rare and Clustered Populations from Adaptive Cluster Sampling using Auxiliary Variables

abstract: Rare populations, such as endangered animals and plants, drug users and individuals with rare diseases, tend to cluster in regions. Adaptive cluster sampling is generally applied to obtain information from clustered and sparse populations since it increases survey effort in areas where the individuals of interest are observed. This work aims to propose a unit-level model which assumes that counts are related to auxiliary variables, improving the sampling process, assigning different weights to the cells, besides referring them spatially. The proposed model fits rare and grouped populations, disposed over a regular grid, in a Bayesian framework. The approach is compared to alternative methods using simulated data and a real experiment in which adaptive samples were drawn from an African Buffaloes population in a 24,108 square kilometers area of East Africa. Simulation studies show that the model is efficient under several settings, validating the methodology proposed in this paper for practical situations.


title: A roadmap to hadronic supercriticalities: a comprehensive study of the parameter space for high-energy astrophysical sources

abstract: Hadronic supercriticalities are radiative instabilities that appear when large amounts of energy are stored in relativistic protons. When the proton energy density exceeds some critical value, a runaway process is initiated resulting in the explosive transfer of the proton energy into electron-positron pairs and radiation. The runaway also leads to an increase of the radiative efficiency, namely the ratio of the photon luminosity to the injected proton luminosity. We perform a comprehensive study of the parameter space by investigating the onset of hadronic supercriticalities for a wide range of source parameters (i.e., magnetic field strengths of 1 G$- 100$ kG and radii of $10^{11}$ cm$-10^{16}$ cm) and maximum proton Lorentz factors ($10^3-10^9$). We show that supercriticalities are possible for the whole range of source parameters related to compact astrophysical sources, like gamma-rays bursts, cores and jets of active galactic nuclei. We also provide an in-depth look at the physical mechanisms of hadronic supercriticalities and show that magnetized relativistic plasmas are excellent examples of non-linear dynamical systems in high-energy astrophysics.


title: Frustratingly Simple Few-Shot Object Detection

abstract: Detecting rare objects from a few examples is an emerging problem. Prior works show meta-learning is a promising approach. But, fine-tuning techniques have drawn scant attention. We find that fine-tuning only the last layer of existing detectors on rare classes is crucial to the few-shot object detection task. Such a simple approach outperforms the meta-learning methods by roughly 2~20 points on current benchmarks and sometimes even doubles the accuracy of the prior methods. However, the high variance in the few samples often leads to the unreliability of existing benchmarks. We revise the evaluation protocols by sampling multiple groups of training examples to obtain stable comparisons and build new benchmarks based on three datasets: PASCAL VOC, COCO and LVIS. Again, our fine-tuning approach establishes a new state of the art on the revised benchmarks. The code as well as the pretrained models are available at https://github.com/ucbdrive/few-shot-object-detection.


title: Vec2Face: Unveil Human Faces from their Blackbox Features in Face Recognition

abstract: Unveiling face images of a subject given his/her high-level representations extracted from a blackbox Face Recognition engine is extremely challenging. It is because the limitations of accessible information from that engine including its structure and uninterpretable extracted features. This paper presents a novel generative structure with Bijective Metric Learning, namely Bijective Generative Adversarial Networks in a Distillation framework (DiBiGAN), for synthesizing faces of an identity given that person's features. In order to effectively address this problem, this work firstly introduces a bijective metric so that the distance measurement and metric learning process can be directly adopted in image domain for an image reconstruction task. Secondly, a distillation process is introduced to maximize the information exploited from the blackbox face recognition engine. Then a Feature-Conditional Generator Structure with Exponential Weighting Strategy is presented for a more robust generator that can synthesize realistic faces with ID preservation. Results on several benchmarking datasets including CelebA, LFW, AgeDB, CFP-FP against matching engines have demonstrated the effectiveness of DiBiGAN on both image realism and ID preservation properties.


title: PFPN: Continuous Control of Physically Simulated Characters using Particle Filtering Policy Network

abstract: Data-driven methods for physics-based character control using reinforcement learning have been successfully applied to generate high-quality motions. However, existing approaches typically rely on Gaussian distributions to represent the action policy, which can prematurely commit to suboptimal actions when solving high-dimensional continuous control problems for highly-articulated characters. In this paper, to improve the learning performance of physics-based character controllers, we propose a framework that considers a particle-based action policy as a substitute for Gaussian policies. We exploit particle filtering to dynamically explore and discretize the action space, and track the posterior policy represented as a mixture distribution. The resulting policy can replace the unimodal Gaussian policy which has been the staple for character control problems, without changing the underlying model architecture of the reinforcement learning algorithm used to perform policy optimization. We demonstrate the applicability of our approach on various motion capture imitation tasks. Baselines using our particle-based policies achieve better imitation performance and speed of convergence as compared to corresponding implementations using Gaussians, and are more robust to external perturbations during character control. Related code is available at: https://motion-lab.github.io/PFPN.


title: Studying the doublet bands at the borders of the $A \approx 130$ island of chiral candidates: the $^{120}$I case

abstract: Based on the reported positive-parity doublet bands in $^{120}$I, the corresponding experimental characteristics including rotational alignment have been discussed and corresponding configuration assignment is reexamined. The self-consistent tilted axis cranking relativistic mean-field calculations indicates that this doublet bands is built on configuration $\pi h_{11/2}\otimes \nu h ^{-1}_{11/2}$. In addition, adopting the two quasiparticles coupled with a triaxial rotor model, the excitation energies, energy staggering parameter $S(I)$, $B(M1)/B(E2)$, effective angles, and $K$ $plots$ have been discussed and also compared with the available data. All of these results support the interpretation of chiral doublet bands for the positive-parity doublet bands in $^{120}$I, and hence identify this nucleus as the border of the $A \approx 130$ island of chiral candidates.


title: Online detection of local abrupt changes in high-dimensional Gaussian graphical models

abstract: The problem of identifying change points in high-dimensional Gaussian graphical models (GGMs) in an online fashion is of interest, due to new applications in biology, economics and social sciences. The offline version of the problem, where all the data are a priori available, has led to a number of methods and associated algorithms involving regularized loss functions. However, for the online version, there is currently only a single work in the literature that develops a sequential testing procedure and also studies its asymptotic false alarm probability and power. The latter test is best suited for the detection of change points driven by global changes in the structure of the precision matrix of the GGM, in the sense that many edges are involved. Nevertheless, in many practical settings the change point is driven by local changes, in the sense that only a small number of edges exhibit changes. To that end, we develop a novel test to address this problem that is based on the $\ell_\infty$ norm of the normalized covariance matrix of an appropriately selected portion of incoming data. The study of the asymptotic distribution of the proposed test statistic under the null (no presence of a change point) and the alternative (presence of a change point) hypotheses requires new technical tools that examine maxima of graph-dependent Gaussian random variables, and that of independent interest. It is further shown that these tools lead to the imposition of mild regularity conditions for key model parameters, instead of more stringent ones required by leveraging previously used tools in related problems in the literature. Numerical work on synthetic data illustrates the good performance of the proposed detection procedure both in terms of computational and statistical efficiency across numerous experimental settings.


title: On optimal autocorrelation inequalities on the real line

abstract: We study autocorrelation inequalities, in the spirit of Barnard and Steinerberger's work. In particular, we obtain improvements on the sharp constants in some of the inequalities previously considered by these authors, and also prove existence of extremizers to these inequalities in certain specific settings. Our methods consist of relating the inequalities in question to other classical sharp inequalities in Fourier analysis, such as the sharp Hausdorff--Young inequality, and employing functional analysis as well as measure theory tools in connection to a suitable dual version of the problem to identify and impose conditions on extremizers.


title: Safety-Critical Event Triggered Control via Input-to-State Safe Barrier Functions

abstract: The efficient utilization of available resources while simultaneously achieving control objectives is a primary motivation in the event-triggered control paradigm. In many modern control applications, one such objective is enforcing the safety of a system. The goal of this paper is to carry out this vision by combining event-triggered and safety-critical control design. We discuss how a direct transcription, in the context of safety, of event-triggered methods for stabilization may result in designs that are not implementable on real hardware due to the lack of a minimum interevent time. We provide a counterexample showing this phenomena and, building on the insight gained, propose an event-triggered control approach via Input to State Safe Barrier Functions that achieves safety while ensuring that interevent times are uniformly lower bounded. We illustrate our results in simulation.


title: A Generalized Uncertainty Principle from a Mediating Field

abstract: A generalized uncertainty principle is obtained from a conformally transformed action containing a scalar field and a unique constraint. The constraint's Lagrange multiplier is found to obey a relativistic diffusion equation transforming the internal coordinates of the scalar field, via the shift theorem. For an approximately conserved Noether current, the coupled wave- and diffusion-like equations are merged into an infinite-order partial differential equation (PDE). It is conjectured that infrared and ultraviolet divergences are naturally removed in studying the infinite-order PDE's corresponding propagator. It is further suggested that higher-order contributions of the associated commutation relations are reminiscent of a self-interaction not present in the current quantum theory.


title: OmniTact: A Multi-Directional High Resolution Touch Sensor

abstract: Incorporating touch as a sensing modality for robots can enable finer and more robust manipulation skills. Existing tactile sensors are either flat, have small sensitive fields or only provide low-resolution signals. In this paper, we introduce OmniTact, a multi-directional high-resolution tactile sensor. OmniTact is designed to be used as a fingertip for robotic manipulation with robotic hands, and uses multiple micro-cameras to detect multi-directional deformations of a gel-based skin. This provides a rich signal from which a variety of different contact state variables can be inferred using modern image processing and computer vision methods. We evaluate the capabilities of OmniTact on a challenging robotic control task that requires inserting an electrical connector into an outlet, as well as a state estimation problem that is representative of those typically encountered in dexterous robotic manipulation, where the goal is to infer the angle of contact of a curved finger pressing against an object. Both tasks are performed using only touch sensing and deep convolutional neural networks to process images from the sensor's cameras. We compare with a state-of-the-art tactile sensor that is only sensitive on one side, as well as a state-of-the-art multi-directional tactile sensor, and find that OmniTact's combination of high-resolution and multi-directional sensing is crucial for reliably inserting the electrical connector and allows for higher accuracy in the state estimation task. Videos and supplementary material can be found at https://sites.google.com/berkeley.edu/omnitact


title: Bayesian item response models for citizen science ecological data

abstract: So-called 'citizen science' data elicited from crowds has become increasingly popular in many fields including ecology. However, the quality of this information is being frequently debated by many within the scientific community. Therefore, modern citizen science implementations require measures of the users' proficiency that account for the difficulty of the tasks. We introduce a new methodological framework of item response and linear logistic test models with application to citizen science data used in ecology research. This approach accommodates spatial autocorrelation within the item difficulties and produces relevant ecological measures of species and site-related difficulties, discriminatory power and guessing behavior. These, along with estimates of the subject abilities allow better management of these programs and provide deeper insights. This paper also highlights the fit of item response models to big data via divide-and-conquer. We found that the suggested methods outperform the traditional item response models in terms of RMSE, accuracy, and WAIC based on leave-one-out cross-validation on simulated and empirical data. We present a comprehensive implementation using a case study of species identification in the Serengeti, Tanzania. The R and Stan codes are provided for full reproducibility. Multiple statistical illustrations and visualizations are given which allow practitioners the extrapolation to a wide range of citizen science ecological problems.


title: Can the COVID-19 epidemic be controlled on the basis of daily test reports?

abstract: This paper studies if and to which extent COVID-19 epidemics can be controlled by authorities taking decisions on public health measures on the basis of daily reports of swab test results, active cases and total cases. A suitably simplified process model is derived to support the controllability analysis, highlighting the presence of very significant time delay; the model is validated with data from several outbreaks. The analysis shows that suppression strategies can be effective if strong enough and enacted early on. It also shows how mitigation strategies can fail because of the combination of delay, unstable dynamics, and uncertainty in the feedback loop; approximate conditions based on the theory of limitation of linear control are given for feedback control to be feasible.


title: Scaling laws for partially developed turbulence

abstract: We formulate multifractal models for velocity differences and gradients which describe the full range of length scales in turbulent flow, namely: laminar, dissipation, inertial, and stirring ranges. The models subsume existing models of inertial range turbulence. In the localized ranges of length scales in which the turbulence is only partially developed, we propose multifractal scaling laws with scaling exponents modified from their inertial range values. In local regions, even within a fully developed turbulent flow, the turbulence is not isotropic nor scale invariant due to the influence of larger turbulent structures (or their absence). For this reason, turbulence that is not fully developed is an important issue which inertial range study can not address. In the ranges of partially developed turbulence, the flow can be far from universal, so that standard inertial range turbulence scaling models become inapplicable. The model proposed here serves as a replacement.Details of the fitting of the parameters for the $\tau_p$ and $\zeta_p$ models in the dissipation range are discussed. Some of the behavior of $\zeta_p$ for larger $p$ is unexplained. The theories are verified by comparing to high resolution simulation data.


title: Excited states of odd-mass nuclei with different deformation-dependent mass coefficients

abstract: Experimental data indicate that the mass tensor of collective Bohr Hamiltonian cannot be considered as a constant but should be considered as a function of the collective coordinates. In this work our purpose is to investigate the properties of low-lying collective states of the odd nuclei $^{173}$Yb and $^{163}$Dy by using a new generalized version of the collective quadrupole Bohr Hamiltonian with deformation-dependent mass coefficients. The proposed new version of the Bohr Hamiltonian is solved for Davidson potential in $\beta$ shape variable, while the $\gamma$ potential is taken to be equal to the harmonic oscillator. The obtained results of the excitation energies and B(E2) reduced transition probabilities show an overall agreement with the experimental data. Moreover, we investigate the effect of the deformation dependent mass parameter on energy spectra and transition rates in both cases, namely: when the mass coefficients are different and when they are equal. Besides, we will show the positive effect of the present formalism on the moment of inertia.


title: Quantum Sensing by Using STIRAP with Dressed States Driving

abstract: Exploring quantum technology to precisely measure physical quantities is a meaningful task for practical scientific researches. Here, we propose a novel quantum sensing model based on dressed states driving (DSD) in stimulated Raman adiabatic passage. The model is universal for sensing different physical quantities, such as magnetic field, mass, rotation and etc. For different sensors, the used systems can range from macroscopic scale, e.g. optomechanical systems, to microscopic nanoscale, e.g. nitrogen-vacancy color centres in diamond. By investigating the dynamics of color detuning of DSD passage, the results show the sensitivity of sensors can be enhanced by tuning system with more adiabatic and accelerated processes in non-degenerate and degenerate color detuning regime, respectively. To show application examples, we apply our approach to build optomechanical mass sensor and solid spin magnetometer with practical parameters.


title: Online Algorithms for Dynamic Matching Markets in Power Distribution Systems

abstract: This paper proposes online algorithms for dynamic matching markets in power distribution systems, which at any real-time operation instance decides about matching -- or delaying the supply of -- flexible loads with available renewable generation with the objective of maximizing the social welfare of the exchange in the system. More specifically, two online matching algorithms are proposed for the following generation-load scenarios: (i) when the mean of renewable generation is greater than the mean of the flexible load, and (ii) when the condition (i) is reversed. With the intuition that the performance of such algorithms degrades with increasing randomness of the supply and demand, two properties are proposed for assessing the performance of the algorithms. First property is convergence to optimality (CO) as the underlying randomness of renewable generation and customer loads goes to zero. The second property is deviation from optimality, is measured as a function of the standard deviation of the underlying randomness of renewable generation and customer loads. The algorithm proposed for the first scenario is shown to satisfy CO and a deviation from optimal that varies linearly with the variation in the standard deviation. But the same algorithm is shown to not satisfy CO for the second scenario. We then show that the algorithm proposed for the second scenario satisfies CO and a deviation from optimal that varies linearly with the variation in standard deviation plus an offset.


title: Error analysis of higher order trace finite element methods for the surface Stokes equations

abstract: The paper studies a higher order unfitted finite element method for the Stokes system posed on a surface in three-dimensional space. The method employs generalized Taylor-Hood finite element pairs on tetrahedral bulk mesh to discretize the Stokes system on embedded surface. Stability and optimal order convergence results are proved. The proofs include a complete quantification of geometric errors stemming from approximate parametric representation of the surface. Numerical experiments include formal convergence studies and an example of the Kelvin-Helmholtz instability problem on the unit sphere.


title: A semi-supervised sparse K-Means algorithm

abstract: We consider the problem of data clustering with unidentified feature quality and when a small amount of labelled data is provided. An unsupervised sparse clustering method can be employed in order to detect the subgroup of features necessary for clustering and a semi-supervised method can use the labelled data to create constraints and enhance the clustering solution. In this paper we propose a K-Means variant that employs these techniques. We show that the algorithm maintains the high performance of other semi-supervised algorithms and in addition preserves the ability to identify informative from uninformative features. We examine the performance of the algorithm on synthetic and real world data sets. We use scenarios of different number and types of constraints as well as different clustering initialisation methods.


title: Toward Adversarial Robustness via Semi-supervised Robust Training

abstract: Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which encourages both the benign example $x$ and its adversarially perturbed neighborhoods within the $\ell_{p}$-ball to be predicted as the ground-truth label. In this work, we propose a novel defense method, the robust training (RT), by jointly minimizing two separated risks ($R_{stand}$ and $R_{rob}$), which is with respect to the benign example and its neighborhoods respectively. The motivation is to explicitly and jointly enhance the accuracy and the adversarial robustness. We prove that $R_{adv}$ is upper-bounded by $R_{stand} + R_{rob}$, which implies that RT has similar effect as AT. Intuitively, minimizing the standard risk enforces the benign example to be correctly predicted, and the robust risk minimization encourages the predictions of the neighbor examples to be consistent with the prediction of the benign example. Besides, since $R_{rob}$ is independent of the ground-truth label, RT is naturally extended to the semi-supervised mode ($i.e.$, SRT), to further enhance the adversarial robustness. Moreover, we extend the $\ell_{p}$-bounded neighborhood to a general case, which covers different types of perturbations, such as the pixel-wise ($i.e.$, $x + \delta$) or the spatial perturbation ($i.e.$, $ AX + b$). Extensive experiments on benchmark datasets not only verify the superiority of the proposed SRT method to state-of-the-art methods for defensing pixel-wise or spatial perturbations separately, but also demonstrate its robustness to both perturbations simultaneously. The code for reproducing main results is available at \url{https://github.com/THUYimingLi/Semi-supervised_Robust_Training}.


title: TACO: Trash Annotations in Context for Litter Detection

abstract: TACO is an open image dataset for litter detection and segmentation, which is growing through crowdsourcing. Firstly, this paper describes this dataset and the tools developed to support it. Secondly, we report instance segmentation performance using Mask R-CNN on the current version of TACO. Despite its small size (1500 images and 4784 annotations), our results are promising on this challenging problem. However, to achieve satisfactory trash detection in the wild for deployment, TACO still needs much more manual annotations. These can be contributed using: http://tacodataset.org/


title: Ricci-flat metrics and dynamics on K3 surfaces

abstract: We give an overview of some recent interactions between the geometry of K3 surfaces and their Ricci-flat Kahler metrics and the dynamical study of K3 automorphisms with positive entropy.


title: Visual Task Progress Estimation with Appearance Invariant Embeddings for Robot Control and Planning

abstract: One of the challenges of full autonomy is to have a robot capable of manipulating its current environment to achieve another environment configuration. This paper is a step towards this challenge, focusing on the visual understanding of the task. Our approach trains a deep neural network to represent images as measurable features that are useful to estimate the progress (or phase) of a task. The training uses numerous variations of images of identical tasks when taken under the same phase index. The goal is to make the network sensitive to differences in task progress but insensitive to the appearance of the images. To this end, our method builds upon Time-Contrastive Networks (TCNs) to train a network using only discrete snapshots taken at different stages of a task. A robot can then solve long-horizon tasks by using the trained network to identify the progress of the current task and by iteratively calling a motion planner until the task is solved. We quantify the granularity achieved by the network in two simulated environments. In the first, to detect the number of objects in a scene and in the second to measure the volume of particles in a cup. Our experiments leverage this granularity to make a mobile robot move a desired number of objects into a storage area and to control the amount of pouring in a cup.


title: Perturbation theory and uniform ergodicity for discrete-time Markov chains

abstract: We study perturbation theory and uniform ergodicity for discrete-time Markov chains on general state spaces in terms of the uniform moments of the first hitting times on some set. The methods we adopt are different from previous ones. For reversible and non-negative definite Markov chains, we first investigate the geometrically ergodic convergence rates. Based on the estimates, together with a first passage formula, we then get the convergence rates in uniform ergodicity. If the transition kernel $P$ is only reversible, we transfer to study the two-skeleton chain with the transition kernel $P^2$. At a technical level, the crucial point is to connect the geometric moments of the first return times between $P$ and $P^2$.


title: Anomalous Example Detection in Deep Learning: A Survey

abstract: Deep Learning (DL) is vulnerable to out-of-distribution and adversarial examples resulting in incorrect outputs. To make DL more robust, several posthoc (or runtime) anomaly detection techniques to detect (and discard) these anomalous samples have been proposed in the recent past. This survey tries to provide a structured and comprehensive overview of the research on anomaly detection for DL based applications. We provide a taxonomy for existing techniques based on their underlying assumptions and adopted approaches. We discuss various techniques in each of the categories and provide the relative strengths and weaknesses of the approaches. Our goal in this survey is to provide an easier yet better understanding of the techniques belonging to different categories in which research has been done on this topic. Finally, we highlight the unsolved research challenges while applying anomaly detection techniques in DL systems and present some high-impact future research directions.


title: On resurgence via asymptotic resurgence

abstract: The resurgence and asymptotic resurgence of an ideal in a polynomial ring are two statistics which measure the relationship between its regular and symbolic powers. We address two aspects of resurgence which can be studied via asymptotic resurgence. First, we show that if an ideal has Noetherian symbolic Rees algebra then its resurgence is rational. Second, we derive two bounds on asymptotic resurgence given a single known containment between a symbolic and regular power. From these bounds we recover and extend criteria for the resurgence of an ideal to be strictly less than its big height recently derived by Grifo, Huneke, and Mukundan. We achieve the reduction to asymptotic resurgence by showing that if the asymptotic resurgence and resurgence are different, then resurgence is a maximum instead of a supremum.


title: Solving non-Markovian Stochastic Control Problems driven by Wiener Functionals

abstract: In this article, we present a general methodology for stochastic control problems driven by the Brownian motion filtration including non-Markovian and non-semimartingale state processes controlled by mutually singular measures. The main result of this paper is the development of a numerical scheme for computing near-optimal controls associated with controlled Wiener functionals via a finite-dimensional approximation procedure. The approach does not require functional differentiability assumptions on the value process and ellipticity conditions on the diffusion components. The general convergence of the method is established under rather weak conditions for distinct types of non-Markovian and non-semimartingale states. Explicit rates of convergence are provided in case the control acts only on the drift component of the controlled system. Near-closed/open-loop optimal controls are fully characterized by a dynamic programming algorithm and they are classified according to the strength of the possibly underlying non-Markovian memory. The theory is applied to stochastic control problems based on path-dependent SDEs and rough stochastic volatility models, where both drift and possibly degenerated diffusion components are controlled. Optimal control of drifts for nonlinear path-dependent SDEs driven by fractional Brownian motion with exponent $H\in (0,\frac{1}{2})$ is also discussed. Finally, we present a simple numerical example to illustrate the method.


title: Relativity and Diversity of Strong Coupling to Measured Subsystems

abstract: The strong coupling between two subsystems consisting of quantum emitters and photonic modes, at which the level splitting of mixed quantum states occurs, has been a central subject of quantum physics and nanophotonics due to various important applications. The spectral Rabi-splitting of photon emission or absorption has been adopted to experimentally characterize the strong coupling under the equality assumption that it is identical to the level splitting. Here, we for the first time reveal that the equality assumption is not valid. It is the invalidity that results in the relativity and diversity of the strong coupling characterized by the spectral Rabi-splitting to the measured subsystems, highly correlated with their dissipative decays. The strong coupling is easier to be observed from the subsystem with larger decay, and can be classified into pseudo-, dark-, middle-, and super-strong interaction regimes. We also suggest a prototype of coupled plasmon-exciton system for possibly future experiment observations on these novel predictions. Our work brings new fundamental insight to the light-matter interaction in nanostructures, which will stimulate further researches in this field.


title: Memristive Learning Cellular Automata: Theory and Applications

abstract: Memristors are novel non volatile devices that manage to combine storing and processing capabilities in the same physical place.Their nanoscale dimensions and low power consumption enable the further design of various nanoelectronic processing circuits and corresponding computing architectures, like neuromorhpic, in memory, unconventional, etc.One of the possible ways to exploit the memristor's advantages is by combining them with Cellular Automata (CA).CA constitute a well known non von Neumann computing architecture that is based on the local interconnection of simple identical cells forming N-dimensional grids.These local interconnections allow the emergence of global and complex phenomena.In this paper, we propose a hybridization of the CA original definition coupled with memristor based implementation, and, more specifically, we focus on Memristive Learning Cellular Automata (MLCA), which have the ability of learning using also simple identical interconnected cells and taking advantage of the memristor devices inherent variability.The proposed MLCA circuit level implementation is applied on optimal detection of edges in image processing through a series of SPICE simulations, proving its robustness and efficacy.


title: Supporting Hard Queries over Probabilistic Preferences

abstract: Preference analysis is widely applied in various domains such as social choice and e-commerce. A recently proposed framework augments the relational database with a preference relation that represents uncertain preferences in the form of statistical ranking models, and provides methods to evaluate Conjunctive Queries (CQs) that express preferences among item attributes. In this paper, we explore the evaluation of queries that are more general and harder to compute. The main focus of this paper is on a class of CQs that cannot be evaluated by previous work. These queries are provably hard since relate variables that represent items being compared. To overcome this hardness, we instantiate these variables with their domain values, rewrite hard CQs as unions of such instantiated queries, and develop several exact and approximate solvers to evaluate these unions of queries. We demonstrate that exact solvers that target specific common kinds of queries are far more efficient than general solvers. Further, we demonstrate that sophisticated approximate solvers making use of importance sampling can be orders of magnitude more efficient than exact solvers, while showing good accuracy. In addition to supporting provably hard CQs, we also present methods to evaluate an important family of count queries, and of top-k queries.


title: Wigner-Smith Time Delay Matrix for Electromagnetics: Theory and Phenomenology

abstract: Wigner-Smith (WS) time delay concepts have been used extensively in quantum mechanics to characterize delays experienced by particles interacting with a potential well. This paper formally extends WS time delay theory to Maxwell's equations and explores its potential applications in electromagnetics. The WS time delay matrix relates a lossless and reciprocal system's scattering matrix to its frequency derivative and allows for the construction of modes that experience well-defined group delays when interacting with the system. The matrix' entries for guiding, scattering, and radiating systems are energy-like overlap integrals of the electric and/or magnetic fields that arise upon excitation of the system via its ports. The WS time delay matrix has numerous applications in electromagnetics, including the characterization of group delays in multiport systems, the description of electromagnetic fields in terms of elementary scattering processes, and the characterization of frequency sensitivities of fields and multiport antenna impedance matrices.


title: A CNN-Based Blind Denoising Method for Endoscopic Images

abstract: The quality of images captured by wireless capsule endoscopy (WCE) is key for doctors to diagnose diseases of gastrointestinal (GI) tract. However, there exist many low-quality endoscopic images due to the limited illumination and complex environment in GI tract. After an enhancement process, the severe noise become an unacceptable problem. The noise varies with different cameras, GI tract environments and image enhancement. And the noise model is hard to be obtained. This paper proposes a convolutional blind denoising network for endoscopic images. We apply Deep Image Prior (DIP) method to reconstruct a clean image iteratively using a noisy image without a specific noise model and ground truth. Then we design a blind image quality assessment network based on MobileNet to estimate the quality of the reconstructed images. The estimated quality is used to stop the iterative operation in DIP method. The number of iterations is reduced about 36% by using transfer learning in our DIP process. Experimental results on endoscopic images and real-world noisy images demonstrate the superiority of our proposed method over the state-of-the-art methods in terms of visual quality and quantitative metrics.


title: Degrees of displacement: The impact of household PV battery prosumage on utility generation and storage

abstract: Reductions in the cost of PV and batteries encourage households to invest in PV battery prosumage. We explore the implications for the rest of the power sector by applying two open-source techno-economic models to scenarios in Western Australia for the year 2030. Household PV capacity generally substitutes utility PV, but slightly less so as additional household batteries are installed. Wind power is less affected, especially in scenarios with higher shares of renewables. With household batteries operating to maximise self-consumption, utility battery capacities are hardly substituted. Wholesale prices to supply households, including those not engaging in prosumage, slightly decrease, while prices for other consumers slightly increase. We conclude that the growth of prosumage has implications on the various elements of the power sector and should be more thoroughly considered by investors, regulators, and power sector planners.

categories: econ.GN cs.SY eess.SY physics.soc-ph q-fin.EC


title: House-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generation

abstract: This paper proposes a novel graph-constrained generative adversarial network, whose generator and discriminator are built upon relational architecture. The main idea is to encode the constraint into the graph structure of its relational networks. We have demonstrated the proposed architecture for a new house layout generation problem, whose task is to take an architectural constraint as a graph (i.e., the number and types of rooms with their spatial adjacency) and produce a set of axis-aligned bounding boxes of rooms. We measure the quality of generated house layouts with the three metrics: the realism, the diversity, and the compatibility with the input graph constraint. Our qualitative and quantitative evaluations over 117,000 real floorplan images demonstrate that the proposed approach outperforms existing methods and baselines. We will publicly share all our code and data.


title: On the finite $(Q-1)$-Hausdorff measure of the free boundary in the subelliptic obstacle problem

abstract: In this note, we prove the finite ${(Q-1)}$-Hausdorff measure of the free boundary in the obstacle problem in a Carnot group $\mathbb{G}$. Here, $Q$ represents the homogeneous dimension of $\mathbb{G}$. Our main result, Theorem 1.1, constitutes the subelliptic counterpart of the Euclidean result due to Caffarelli, but the analysis is complicated by the lack of commutation of the left-invariant vector fields. This obstruction is compensated by the use of right-invariant derivatives, and by a delicate compactness argument inspired to Caffarelli's fundamental works.


title: A Flexible n/2 Adversary Node Resistant and Halting Recoverable Blockchain Sharding Protocol

abstract: Blockchain sharding is a promising approach to solving the dilemma between decentralisation and high performance (transaction throughput) for blockchain. The main challenge of Blockchain sharding systems is how to reach a decision on a statement among a sub-group (shard) of people while ensuring the whole population recognises this statement. Namely, the challenge is to prevent an adversary who does not have the majority of nodes globally but have the majority of nodes inside a shard. Most Blockchain sharding approaches can only reach a correct consensus inside a shard with at most $n/3$ evil nodes in a $n$ node system. There is a blockchain sharding approach which can prevent an incorrect decision to be reached when the adversary does not have $n/2$ nodes globally. However, the system can be stopped from reaching consensus (become deadlocked) if the adversary controls a smaller number of nodes. In this paper, we present an improved Blockchain sharding approach that can withstand $n/2$ adversarial nodes and recover from deadlocks. The recovery is made by dynamically adjusting the number of shards and the shard size. A performance analysis suggests our approach has a high performance (transaction throughput) while requiring little bandwidth for synchronisation.


title: How to Construct Mutually Orthogonal Complementary Sets with Non-Power-of-Two Lengths?

abstract: Mutually orthogonal complementary sets (MOCSs) have received significant research attention in recent years due to their wide applications in communications and radar. Existing MOCSs which are constructed based on generalized Boolean functions (GBFs) mostly have lengths of power-of-two. How to construct MOCSs with non-power-of-two lengths whilst having large set sizes is a largely open problem. With the aid of GBFs, in this paper, we present new constructions of such MOCSs and show that the maximal achievable set size is $1/2$ of the flock size of an MOCS.


title: Weak value picture on quantum observables: gauge-invariant vector potentials

abstract: The conservation of physical quantities under coordinate transformations, known as gauge invariance, has been the foundation of theoretical frameworks in both quantum and classical theory. The finding of gauge-invariant quantities has enabled the geometric and topological interpretations of quantum phenomena with the Berry phase, or the separation of quark and gluon contributions in quantum chromodynamics. Here, with an example of quantum geometric quantities-Berry connection, phase, and curvature-we extract a new gauge-invariant quantity by applying a "weak value picture". By employing different pre- and post-selections in the derivation of the Berry phase in the context of weak values, we derive the gauge-invariant vector potential from the Berry connection that is originally gauge-dependent, and show that the obtained vector potential corresponds to the weak value of the projected momentum operator. The local nature of this quantity is demonstrated with an example of the Aharonov-Bohm effect, proving that this gauge-invariant vector potential can be interpreted as the only source of the Berry curvature in the magnetic field. This weak value decomposition approach will lead to the extraction of new measurable quantities from traditionally unobservable quantities.


title: Space Hardness of Solving Structured Linear Systems

abstract: We show that if the probabilistic logarithmic-space solver or the deterministic nearly logarithmic-space solver for undirected Laplacian matrices can be extended to solve slightly larger subclasses of linear systems, then they can be use to solve all linear systems with similar space complexity. Previously Kyng and Zhang proved similar results in the time complexity setting using reductions between approximate solvers. We prove that their reductions can be implemented using constant-depth, polynomial-size threshold circuits.


title: Multi-Drone based Single Object Tracking with Agent Sharing Network

abstract: Drone equipped with cameras can dynamically track the target in the air from a broader view compared with static cameras or moving sensors over the ground. However, it is still challenging to accurately track the target using a single drone due to several factors such as appearance variations and severe occlusions. In this paper, we collect a new Multi-Drone single Object Tracking (MDOT) dataset that consists of 92 groups of video clips with 113,918 high resolution frames taken by two drones and 63 groups of video clips with 145,875 high resolution frames taken by three drones. Besides, two evaluation metrics are specially designed for multi-drone single object tracking, i.e. automatic fusion score (AFS) and ideal fusion score (IFS). Moreover, an agent sharing network (ASNet) is proposed by self-supervised template sharing and view-aware fusion of the target from multiple drones, which can improve the tracking accuracy significantly compared with single drone tracking. Extensive experiments on MDOT show that our ASNet significantly outperforms recent state-of-the-art trackers.


title: Motivic classes of classifying stacks of finite groups and unramified cohomology

abstract: Combining work of Peyre, Colliot-Th\'el\`ene and Voisin, we give the first example of a finite group $G$ such that the motivic class of its classifying stack $BG$ in Ekedahl's Grothendieck ring of stacks over $\mathbb{C}$ is non-trivial and $BG$ has trivial unramified Brauer group.


title: Non-zero tensor condensates in cold quark matter within the three-flavor Nambu-Jona-Lasinio model with the Kobayashi-Maskawa-'t Hooft interaction

abstract: The possible formation of tensor condensates originated from a tensor-type interaction between quarks is investigated in the three-flavor Nambu-Jona-Lasinio model including the Kobayashi-Maskawa-'t Hooft interaction, which leads to flavor mixing. It is shown that independent two tensor condensates appear and a tensor condensate related to the strange quark easily occurs by the effect of the flavor mixing compared with one related to light quarks. Also, it is shown that the tensor condensate related to the strange quark appears at a slightly smaller chemical potential if the Kobayashi-Maskawa-'t Hooft interaction is included, due to the flavor mixing effect. It is also shown that the two kinds of tensor condensates may coexist in a certain quark chemical potential due to the flavor mixing.


title: Irreducible flat SL(2,R)-connections on the trivial holomorphic bundle

abstract: We construct an irreducible holomorphic connection with SL(2,R)-monodromy on the trivial holomorphic vector bundle of rank two over a compact Riemann surface. This answers a question of Calsamiglia, Deroin, Heu and Loray in \cite{CDHL}.


title: In-flight calibration of the Insight-Hard X-ray Modulation Telescope

abstract: We present the calibration of the Insight-Hard X-ray Modulation Telescope (Insight-HXMT) X-ray satellite, which can be used to perform timing and spectral studies of bright X-ray sources. Insight-HXMT carries three main payloads onboard: the High Energy X-ray telescope (HE), the Medium Energy X-ray telescope (ME) and the Low Energy X-ray telescope (LE). In orbit, the radioactive sources, activated lines, the fluorescence lines and celestial sources are used to calibrate the energy scale and energy resolution of the payloads. The Crab nebular is adopted as the primary effective area calibrator and empirical functions are constructed to modify the simulated effective areas of the three payloads respectively. The systematic errors of HE, compared to the model of the Crab nebular, are less than 2% in 28--120 keV and 2%--10% above 120 keV. The systematic errors of ME are less than 1.5% in 10--35 keV. The systematic errors of LE are less than 1% in 1--7 keV except the Si K--edge (1.839 keV, up to 1.5%) and less than 2% in 7--10 keV.


title: ReLaText: Exploiting Visual Relationships for Arbitrary-Shaped Scene Text Detection with Graph Convolutional Networks

abstract: We introduce a new arbitrary-shaped text detection approach named ReLaText by formulating text detection as a visual relationship detection problem. To demonstrate the effectiveness of this new formulation, we start from using a "link" relationship to address the challenging text-line grouping problem firstly. The key idea is to decompose text detection into two subproblems, namely detection of text primitives and prediction of link relationships between nearby text primitive pairs. Specifically, an anchor-free region proposal network based text detector is first used to detect text primitives of different scales from different feature maps of a feature pyramid network, from which a text primitive graph is constructed by linking each pair of nearby text primitives detected from a same feature map with an edge. Then, a Graph Convolutional Network (GCN) based link relationship prediction module is used to prune wrongly-linked edges in the text primitive graph to generate a number of disjoint subgraphs, each representing a detected text instance. As GCN can effectively leverage context information to improve link prediction accuracy, our GCN based text-line grouping approach can achieve better text detection accuracy than previous text-line grouping methods, especially when dealing with text instances with large inter-character or very small inter-line spacings. Consequently, the proposed ReLaText achieves state-of-the-art performance on five public text detection benchmarks, namely RCTW-17, MSRA-TD500, Total-Text, CTW1500 and DAST1500.


title: TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding

abstract: Bidirectional Encoder Representations from Transformers (BERT) has recently achieved state-of-the-art performance on a broad range of NLP tasks including sentence classification, machine translation, and question answering. The BERT model architecture is derived primarily from the transformer. Prior to the transformer era, bidirectional Long Short-Term Memory (BLSTM) has been the dominant modeling architecture for neural machine translation and question answering. In this paper, we investigate how these two modeling techniques can be combined to create a more powerful model architecture. We propose a new architecture denoted as Transformer with BLSTM (TRANS-BLSTM) which has a BLSTM layer integrated to each transformer block, leading to a joint modeling framework for transformer and BLSTM. We show that TRANS-BLSTM models consistently lead to improvements in accuracy compared to BERT baselines in GLUE and SQuAD 1.1 experiments. Our TRANS-BLSTM model obtains an F1 score of 94.01% on the SQuAD 1.1 development dataset, which is comparable to the state-of-the-art result.


title: Resonances and viscosity limit for the Wigner-von Neumann type Hamiltonian

abstract: The resonances for the Wigner-von Neumann type Hamiltonian are defined by the periodic complex distortion in the Fourier space. Also, following Zworski, we characterize resonances as the limit points of discrete eigenvalues of the Hamiltonian with a quadratic complex absorbing potential in the viscosity type limit.


title: Topological hyperbolic lattices

abstract: Non-Euclidean geometry, discovered by negating Euclid's parallel postulate, has been of considerable interest in mathematics and related fields for the description of geographical coordinates, Internet infrastructures, and the general theory of relativity. Notably, an infinite number of regular tessellations in hyperbolic geometry-hyperbolic lattices-can extend Euclidean Bravais lattices and the consequent band theory to non-Euclidean geometry. Here we demonstrate topological phenomena in hyperbolic geometry, exploring how the quantized curvature and edge dominance of the geometry affect topological phases. We report a recipe for the construction of a Euclidean photonic platform that inherits the topological band properties of a hyperbolic lattice under a uniform, pseudospin-dependent magnetic field, realizing a non-Euclidean analogue of the quantum spin Hall effect. For hyperbolic lattices with different quantized curvatures, we examine the topological protection of helical edge states and generalize Hofstadter's butterfly, showing the unique spectral sensitivity of topological immunity in highly curved hyperbolic planes. Our approach is applicable to general non-Euclidean geometry and enables the exploitation of infinite lattice degrees of freedom for band theory.


title: Any-Shot Object Detection

abstract: Previous work on novel object detection considers zero or few-shot settings where none or few examples of each category are available for training. In real world scenarios, it is less practical to expect that 'all' the novel classes are either unseen or {have} few-examples. Here, we propose a more realistic setting termed 'Any-shot detection', where totally unseen and few-shot categories can simultaneously co-occur during inference. Any-shot detection offers unique challenges compared to conventional novel object detection such as, a high imbalance between unseen, few-shot and seen object classes, susceptibility to forget base-training while learning novel classes and distinguishing novel classes from the background. To address these challenges, we propose a unified any-shot detection model, that can concurrently learn to detect both zero-shot and few-shot object classes. Our core idea is to use class semantics as prototypes for object detection, a formulation that naturally minimizes knowledge forgetting and mitigates the class-imbalance in the label space. Besides, we propose a rebalanced loss function that emphasizes difficult few-shot cases but avoids overfitting on the novel classes to allow detection of totally unseen classes. Without bells and whistles, our framework can also be used solely for Zero-shot detection and Few-shot detection tasks. We report extensive experiments on Pascal VOC and MS-COCO datasets where our approach is shown to provide significant improvements.


title: A Generative Learning Approach for Spatio-temporal Modeling in Connected Vehicular Network

abstract: Spatio-temporal modeling of wireless access latency is of great importance for connected-vehicular systems. The quality of the molded results rely heavily on the number and quality of samples which can vary significantly due to the sensor deployment density as well as traffic volume and density. This paper proposes LaMI (Latency Model Inpainting), a novel framework to generate a comprehensive spatio-temporal of wireless access latency of a connected vehicles across a wide geographical area. LaMI adopts the idea from image inpainting and synthesizing and can reconstruct the missing latency samples by a two-step procedure. In particular, it first discovers the spatial correlation between samples collected in various regions using a patching-based approach and then feeds the original and highly correlated samples into a Variational Autoencoder (VAE), a deep generative model, to create latency samples with similar probability distribution with the original samples. Finally, LaMI establishes the empirical PDF of latency performance and maps the PDFs into the confidence levels of different vehicular service requirements. Extensive performance evaluation has been conducted using the real traces collected in a commercial LTE network in a university campus. Simulation results show that our proposed model can significantly improve the accuracy of latency modeling especially compared to existing popular solutions such as interpolation and nearest neighbor-based methods.


title: Topological protection in nonlinear optical dynamics with parity-time symmetry

abstract: Topological phases exhibit properties that are conserved for continuous deformations, as demonstrated in topological protections in condensed-matter physics and electromagnetic waves. Despite its ubiquitous nature and recent extensions to synthetic dimensions, non-Hermitian Hamiltonians, and nonlinear dynamics, topological protection has generally been described in spatial lattices with the Chern number in the Brillouin zone, focusing on the realization of backscattering-free wave transport. Here, we investigate a different class of topological protection in parity-time-symmetric nonlinear optical dynamics, exploiting the topological invariance of optical state trajectories. For coupled nonlinear photonic systems composed of gain and loss atoms, we classify the topology of equilibria separately for unbroken and broken parity-time symmetry. Utilizing the immunity of topological phases against temporal perturbations, we develop noise-immune laser modulation and rectification with a parasitic nonlinear resonator based on oscillation quenching mechanisms that are protected by parity-time symmetry. The connection between topological photonics and parity-time symmetry through nonlinear dynamics provides a powerful platform for noise-immune signal processing.


title: Long-term orbital evolution of Galactic satellites and the effects on their star formation histories

abstract: We investigate the orbital motions of dwarf spheroidal galaxies (dSphs) in the halo of the Milky Way (MW) to understand their possible effects on the diversity of the star formation histories seen in these MW satellites. In this work, we explicitly consider a time-varying gravitational potential due to the growth of the MW's dark halo mass to calculate the long-term orbital evolutions of the dSphs, guided with {\it Gaia} DR2 proper motions, over the past 13.5 billion years. We find that the infall time of a satellite, defined at which the galaxy first crosses within the growing virial radius of the MW's halo, coincides well with the time when the star formation rate (SFR) is peaked for the sample of classical dSphs. On the other hand, ultra-faint dSphs already finished their SF activity prior to their infall times as already suggested in previous works, but there is a signature that their earlier SF histories are affected by interaction with the growing MW's halo to some extent. We also find, for classical dSphs, that the relative fraction of stars formed after the peak of the SFR to the current stellar mass is smaller for the smaller pericentric radius of the galaxy at its first infall. These results suggest that the infalling properties of the dSphs into the MW and the resultant environmental effects such as ram-pressure stripping and/or tidal disturbance in the MW's dark halo containing hot gas play important roles in their star formation histories.


title: Modeling and Experimental Validation of a Fractal Tetrahedron UAS Assembly

abstract: This paper presents the foundation of a modular robotic system comprised of several novel modules in the shape of a tetrahedron. Four single-propeller submodules are assembled to create the Tetracopter, a tetrahedron-shaped quad-rotorcraft used as the elementary module of a modular flying system. This modular flying system is built by assembling the different elementary modules in a fractal shape. The fractal tetrahedron structure of the modular flying assembly grants the vehicle more rigidity than a conventional two-dimensional modular robotic flight system while maintaining the relative efficiency of a two-dimensional modular robotic flight system. A prototype of the Tetracopter has been modeled, fabricated, and successfully flight-tested by the Decision and Control Laboratory at the Georgia Institute of Technology. The results of this research set the foundation for the development of Tetrahedron rotorcraft that can maintain controllable flight and assemble in flight to create a Fractal Tetrahedron Assembly.


title: CompLex: A New Corpus for Lexical Complexity Prediction from Likert Scale Data

abstract: Predicting which words are considered hard to understand for a given target population is a vital step in many NLP applications such as text simplification. This task is commonly referred to as Complex Word Identification (CWI). With a few exceptions, previous studies have approached the task as a binary classification task in which systems predict a complexity value (complex vs. non-complex) for a set of target words in a text. This choice is motivated by the fact that all CWI datasets compiled so far have been annotated using a binary annotation scheme. Our paper addresses this limitation by presenting the first English dataset for continuous lexical complexity prediction. We use a 5-point Likert scale scheme to annotate complex words in texts from three sources/domains: the Bible, Europarl, and biomedical texts. This resulted in a corpus of 9,476 sentences each annotated by around 7 annotators.


title: Stability and Learning in Strategic Queuing Systems

abstract: Bounding the price of anarchy, which quantifies the damage to social welfare due to selfish behavior of the participants, has been an important area of research. In this paper, we study this phenomenon in the context of a game modeling queuing systems: routers compete for servers, where packets that do not get service will be resent at future rounds, resulting in a system where the number of packets at each round depends on the success of the routers in the previous rounds. We model this as an (infinitely) repeated game, where the system holds a state (number of packets held by each queue) that arises from the results of the previous round. We assume that routers satisfy the no-regret condition, e.g. they use learning strategies to identify the server where their packets get the best service. Classical work on repeated games makes the strong assumption that the subsequent rounds of the repeated games are independent (beyond the influence on learning from past history). The carryover effect caused by packets remaining in this system makes learning in our context result in a highly dependent random process. We analyze this random process and find that if the capacity of the servers is high enough to allow a centralized and knowledgeable scheduler to get all packets served even with double the packet arrival rate, and queues use no-regret learning algorithms, then the expected number of packets in the queues will remain bounded throughout time, assuming older packets have priority. This paper is the first to study the effect of selfish learning in a queuing system, where the learners compete for resources, but rounds are not all independent: the number of packets to be routed at each round depends on the success of the routers in the previous rounds.


title: Adversarial Perturbations of Opinion Dynamics in Networks

abstract: We study the connections between network structure, opinion dynamics, and an adversary's power to artificially induce disagreements. We approach these questions by extending models of opinion formation in the social sciences to represent scenarios, familiar from recent events, in which external actors seek to destabilize communities through sophisticated information warfare tactics via fake news and bots. In many instances, the intrinsic goals of these efforts are not necessarily to shift the overall sentiment of the network, but rather to induce discord. These perturbations diffuse via opinion dynamics on the underlying network, through mechanisms that have been analyzed and abstracted through work in computer science and the social sciences. We investigate the properties of such attacks, considering optimal strategies both for the adversary seeking to create disagreement and for the entities tasked with defending the network from attack. We show that for different formulations of these types of objectives, different regimes of the spectral structure of the network will limit the adversary's capacity to sow discord; this enables us to qualitatively describe which networks are most vulnerable against these perturbations. We then consider the algorithmic task of a network defender to mitigate these sorts of adversarial attacks by insulating nodes heterogeneously; we show that, by considering the geometry of this problem, this optimization task can be efficiently solved via convex programming. Finally, we generalize these results to allow for two network structures, where the opinion dynamics process and the measurement of disagreement become uncoupled, and determine how the adversary's power changes; for instance, this may arise when opinion dynamics are controlled an online community via social media, while disagreement is measured along "real-world" connections.


title: Machine learning identifies scale-free properties in disordered materials

abstract: The vast amount of design freedom in disordered systems expands the parameter space for signal processing, allowing for unique signal flows that are distinguished from those in regular systems. However, this large degree of freedom has hindered the deterministic design of disordered systems for target functionalities. Here, we employ a machine learning (ML) approach for predicting and designing wave-matter interactions in disordered structures, thereby identifying scale-free properties for waves. To abstract and map the features of wave behaviours and disordered structures, we develop disorder-to-localization and localization-to-disorder convolutional neural networks (CNNs). Each CNN enables the instantaneous prediction of wave localization in disordered structures and the instantaneous generation of disordered structures from given localizations. We demonstrate that CNN-generated disordered structures have scale-free properties with heavy tails and hub atoms, which exhibit an increase of multiple orders of magnitude in robustness to accidental defects, such as material or structural imperfection. Our results verify the critical role of ML network structures in determining ML-generated real-space structures, which can be used in the design of defect-immune and efficiently tunable devices.

categories: physics.optics cond-mat.dis-nn physics.comp-ph physics.data-an


title: AVR: Attention based Salient Visual Relationship Detection

abstract: Visual relationship detection aims to locate objects in images and recognize the relationships between objects. Traditional methods treat all observed relationships in an image equally, which causes a relatively poor performance in the detection tasks on complex images with abundant visual objects and various relationships. To address this problem, we propose an attention based model, namely AVR, to achieve salient visual relationships based on both local and global context of the relationships. Specifically, AVR recognizes relationships and measures the attention on the relationships in the local context of an input image by fusing the visual features, semantic and spatial information of the relationships. AVR then applies the attention to assign important relationships with larger salient weights for effective information filtering. Furthermore, AVR is integrated with the priori knowledge in the global context of image datasets to improve the precision of relationship prediction, where the context is modeled as a heterogeneous graph to measure the priori probability of relationships based on the random walk algorithm. Comprehensive experiments are conducted to demonstrate the effectiveness of AVR in several real-world image datasets, and the results show that AVR outperforms state-of-the-art visual relationship detection methods significantly by up to $87.5\%$ in terms of recall.


title: Large Scale Many-Objective Optimization Driven by Distributional Adversarial Networks

abstract: Estimation of distribution algorithms (EDA) as one of the EAs is a stochastic optimization problem which establishes a probability model to describe the distribution of solutions and randomly samples the probability model to create offspring and optimize model and population. Reference Vector Guided Evolutionary (RVEA) based on the EDA framework, having a better performance to solve MaOPs. Besides, using the generative adversarial networks to generate offspring solutions is also a state-of-art thought in EAs instead of crossover and mutation. In this paper, we will propose a novel algorithm based on RVEA[1] framework and using Distributional Adversarial Networks (DAN) [2]to generate new offspring. DAN uses a new distributional framework for adversarial training of neural networks and operates on genuine samples rather than a single point because the framework also leads to more stable training and extraordinarily better mode coverage compared to single-point-sample methods. Thereby, DAN can quickly generate offspring with high convergence regarding the same distribution of data. In addition, we also use Large-Scale Multi-Objective Optimization Based on A Competitive Swarm Optimizer (LMOCSO)[3] to adopts a new two-stage strategy to update the position in order to significantly increase the search efficiency to find optimal solutions in huge decision space. The propose new algorithm will be tested on 9 benchmark problems in Large scale multi-objective problems (LSMOP). To measure the performance, we will compare our proposal algorithm with some state-of-art EAs e.g., RM-MEDA[4], MO-CMA[10] and NSGA-II.


title: Resource Allocation for Secure Multi-UAV Communication Systems with Multi-Eavesdropper

abstract: In this paper, we study the resource allocation and trajectory design for secure unmanned aerial vehicle (UAV)-enabled communication systems, where multiple multi-purpose UAV base stations are dispatched to provide secure communications to multiple legitimate ground users (GUs) in the existence of multiple eavesdroppers (Eves). Specifically, by leveraging orthogonal frequency division multiple access (OFDMA), active UAV base stations can communicate to their desired ground users via the assigned subcarriers while idle UAV base stations can serve as jammer simultaneously for communication security provisioning. To achieve fairness in secure communication, we maximize the average minimum secrecy rate per user by jointly optimizing the communication/jamming subcarrier allocation policy and the trajectory of UAVs, while taking into account the constraints on the minimum safety distance among multiple UAVs, the maximum cruising speed, the initial/final locations, and the existence of cylindrical no-fly zones (NFZs). The design is formulated as a mixed integer non-convex optimization problem which is generally intractable. Subsequently, a computationally-efficient iterative algorithm is proposed to obtain a suboptimal solution. Simulation results illustrate that the performance of the proposed iterative algorithm can significantly improve the average minimum secrecy rate compared to various baseline schemes.


title: SHINE (Strategies for High-frequency INdoor Environments) with Efficient THz-AP Placement

abstract: The increasing demand for ultra-high throughput in ultra-dense networks might take a toll on 5G capacity. Moreover, with Internet-of-Things (IoT) and the growing use-cases for indoor killer-applications, it will be necessary to look beyond 5G technologies. One such promising technology is to move higher in the frequencies, such as the THz ($300$ $GHz$-$10$ $THz$) spectrum. THz has a massive number of greenfield-contiguous channels ranging from $10$ $GHz$ to $200$ $GHz$ (best case), which was not available in the traditional radio frequency (RF) or millimeter wave (mmWave) bands. Although THz has immense potential to cater to such demands, it comes with numerous challenges revolving around hardware, link budget, mobility, blockages, scheduling, and deployment. Terahertz access points (THz-APs) are sensitive to deployment and can critically impact a system\textquotesingle s dynamics (i.e., coverage, throughput, and efficiency). In this paper, we present Strategies for High-frequency INdoor Environments or SHINE, which focuses on efficient AP deployment in the THz spectrum and draws motivation from approaches used indoor to improve lighting conditions. Due to THz\textquotesingle s limited coverage area of a few meters, the number of THz-APs required to satisfy a densely populated room will be higher compared to today's single router/box/AP model. This increased number of THz-APs will not only increase the operational costs, but also (in some cases) can make the system inefficient. Through SHINE, we explore the deployment-related challenges and propose strategies to mitigate the same.


title: Extreme Hawking Radiation

abstract: Modeling the collapse of an extreme Reissner-Nordstr\"om (ERN) black hole by solving the corresponding moving mirror model for the trajectory that asymptotically approaches uniform acceleration, we obtain the non-zero beta coefficients for all times. Finite energy is emitted, the radiation spectra is non-thermal (non-steady / not Planck), soft particles characterize the evaporation, and particle production at ultra-late times is damped. Entanglement entropy diverges with no Page curve turn-over, demonstrating non-thermal information loss. The radiation obeys time-reversal symmetry.


title: Uncertainty Quantification for Demand Prediction in Contextual Dynamic Pricing

abstract: Data-driven sequential decision has found a wide range of applications in modern operations management, such as dynamic pricing, inventory control, and assortment optimization. Most existing research on data-driven sequential decision focuses on designing an online policy to maximize the revenue. However, the research on uncertainty quantification on the underlying true model function (e.g., demand function), a critical problem for practitioners, has not been well explored. In this paper, using the problem of demand function prediction in dynamic pricing as the motivating example, we study the problem of constructing accurate confidence intervals for the demand function. The main challenge is that sequentially collected data leads to significant distributional bias in the maximum likelihood estimator or the empirical risk minimization estimate, making classical statistics approaches such as the Wald's test no longer valid. We address this challenge by developing a debiased approach and provide the asymptotic normality guarantee of the debiased estimator. Based this the debiased estimator, we provide both point-wise and uniform confidence intervals of the demand function.


title: Closed-loop Matters: Dual Regression Networks for Single Image Super-Resolution

abstract: Deep neural networks have exhibited promising performance in image super-resolution (SR) by learning a nonlinear mapping function from low-resolution (LR) images to high-resolution (HR) images. However, there are two underlying limitations to existing SR methods. First, learning the mapping function from LR to HR images is typically an ill-posed problem, because there exist infinite HR images that can be downsampled to the same LR image. As a result, the space of the possible functions can be extremely large, which makes it hard to find a good solution. Second, the paired LR-HR data may be unavailable in real-world applications and the underlying degradation method is often unknown. For such a more general case, existing SR models often incur the adaptation problem and yield poor performance. To address the above issues, we propose a dual regression scheme by introducing an additional constraint on LR data to reduce the space of the possible functions. Specifically, besides the mapping from LR to HR images, we learn an additional dual regression mapping estimates the down-sampling kernel and reconstruct LR images, which forms a closed-loop to provide additional supervision. More critically, since the dual regression process does not depend on HR images, we can directly learn from LR images. In this sense, we can easily adapt SR models to real-world data, e.g., raw video frames from YouTube. Extensive experiments with paired training data and unpaired real-world data demonstrate our superiority over existing methods.


title: Key Phrase Classification in Complex Assignments

abstract: Complex assignments typically consist of open-ended questions with large and diverse content in the context of both classroom and online graduate programs. With the sheer scale of these programs comes a variety of problems in peer and expert feedback, including rogue reviews. As such with the hope of identifying important contents needed for the review, in this work we present a very first work on key phrase classification with a detailed empirical study on traditional and most recent language modeling approaches. From this study, we find that the task of classification of key phrases is ambiguous at a human level producing Cohen's kappa of 0.77 on a new data set. Both pretrained language models and simple TFIDF SVM classifiers produce similar results with a former producing average of 0.6 F1 higher than the latter. We finally derive practical advice from our extensive empirical and model interpretability results for those interested in key phrase classification from educational reports in the future.


title: A note on parallel preconditioning for the all-at-once solution of Riesz fractional diffusion equations

abstract: The $p$-step backwards difference formula (BDF) for solving the system of ODEs can result in a kind of all-at-once linear systems, which are solved via the parallel-in-time preconditioned Krylov subspace solvers (see McDonald, Pestana, and Wathen [SIAM J. Sci. Comput., 40(2) (2018): A1012-A1033] and Lin and Ng [arXiv:2002.01108, 17 pages]. However, these studies ignored that the $p$-step BDF ($p\geq 2$) is not selfstarting, when they are exploited to solve time-dependent PDEs. In this note, we focus on the 2-step BDF which is often superior to the trapezoidal rule for solving the Riesz fractional diffusion equations, but its resultant all-at-once discretized system is a block triangular Toeplitz system with a low-rank perturbation. Meanwhile, we first give an estimation of the condition number of the all-at-once systems and then adapt the previous work to construct two block circulant (BC) preconditioners. Both the invertibility of these two BC preconditioners and the eigenvalue distributions of preconditioned matrices are discussed in details. The efficient implementation of these BC preconditioners is also presented especially for handling the computation of dense structured Jacobi matrices. Finally, numerical experiments involving both the one- and two-dimensional Riesz fractional diffusion equations are reported to support our theoretical findings.


title: Extended Feature Pyramid Network for Small Object Detection

abstract: Small object detection remains an unsolved challenge because it is hard to extract information of small objects with only a few pixels. While scale-level corresponding detection in feature pyramid network alleviates this problem, we find feature coupling of various scales still impairs the performance of small objects. In this paper, we propose extended feature pyramid network (EFPN) with an extra high-resolution pyramid level specialized for small object detection. Specifically, we design a novel module, named feature texture transfer (FTT), which is used to super-resolve features and extract credible regional details simultaneously. Moreover, we design a foreground-background-balanced loss function to alleviate area imbalance of foreground and background. In our experiments, the proposed EFPN is efficient on both computation and memory, and yields state-of-the-art results on small traffic-sign dataset Tsinghua-Tencent 100K and small category of general object detection dataset MS COCO.


title: Creation of nanometric magnetic skyrmions by global application of circularly polarized microwave magnetic field

abstract: From a theoretical perspective, we demonstrate that nanometric magnetic skyrmions are created by application of a circularly polarized microwave magnetic field to a thin-plate Dzyaloshinskii-Moriya ferromagnet with fabricated rectangular holes. This phenomenon is caused by an effective steady magnetic field perpendicular to the microwave-polarization plane induced by the rotating magnetic field and the intense interference of spin waves excited by this magnetic field due to the hole structure, which causes reversals of local magnetizations and results in the formation of skyrmions. Our proposal provides a new option to write or create magnetic textures the sizes of which are much smaller than the spot size of the external stimulus such as magnetic field, light, and microwave.


title: Simplicial and Conical Decomposition of Positively Spanning Sets

abstract: We investigate the decomposition of a set $X$, which positively spans the Euclidean space $\mathbb{R}^{d}$ into a set of minimal positive bases, we call simplices, and into maximal sets positively spanning pointed cones, i.e. cones with exactly one apex. For any set $X$, let $\mathcal{S}(X)$ denote the set of simplex subsets of $X$, and let $\ell(X)$ denote the linear hull of $X$. The set $X$ is said to fulfill the factorisation condition if and only if for each subset $Y\subset X$ and each simplex $S\in\mathcal{S}(X)$, $\ell(Y)\cap\ell(S) = \ell(Y\cap S)$. We demonstrate that $X$ is a positive basis if and only if it is the union of most d simplices, and $X$ satisfies the factorization condition. In this case, $X$ contains a linear basis $B$ such that each simplex in $\mathcal{S}(X)$ has with $B$, all but one exactly one element in common. We show that for sets positively spanning $\mathbb{R}^{d}$, the set of subbases of $X$ forms a boolean lattice, which can be embedded into the set $2^{\mathcal{S}(X)}$, with isomorphy for positive bases. Our second main result depending on the former is as follows. A finite set $X\subset\mathbb{R}^{d}\setminus\{0\}$ can be written as the union of at most $2^{d}$ maximal sets spanning pointed cones, which, if $X$ is a positive basis, are tantamount to frames of the cones. The inequality holds sharply if and only if $X$ is a cross, that is, a union of 1-simplices derived from a linear basis of $\mathbb{R}^{d}$. We also show that there can be at the most $2^{d}$ maximal subsets of $X$ spanning pointed cones, when intersections of two of them do not span a set of full dimension.


title: Infinitesimal bending of knots and energy change

abstract: We discuss infinitesimal bending of curves and knots in R^{3}. A brief overview of the results on the infinitesimal bending of curves is outlined. Change of the Willmore energy, as well as of the Mobius energy under infinitesimal bending of knots is considered. Our visualization tool devoted to visual representation of infinitesimal bending of knots is presented.


title: Accessibility of derived-from-Anosov systems

abstract: This paper shows any non-Anosov partially hyperbolic diffeomorphism on the 3-torus which is homotopic to Anosov must be accessible.


title: On the $C_0$ semigroup generated by the Oseen operator around a steady flow exterior to a rotating obstacle

abstract: We consider the motion of an incompressible viscous fluid filling the whole space exterior to a moving with rotation and translation obstacle. We show that the Stokes operator around the steady flow in the exterior of this obstacle generates a $C_0$-semigroup in $L^p$ space and then develop a series of $L^p$-$L^q$ estimates of such semigroup. As an application, we give out the stability of such steady flow when the initial disturbance in $L^3$ and the steady flow are sufficiently small.


title: Eating Healthier: Exploring Nutrition Information for Healthier Recipe Recommendation

abstract: With the booming of personalized recipe sharing networks (e.g., Yummly), a deluge of recipes from different cuisines could be obtained easily. In this paper, we aim to solve a problem which many home-cooks encounter when searching for recipes online. Namely, finding recipes which best fit a handy set of ingredients while at the same time follow healthy eating guidelines. This task is especially difficult since the lions share of online recipes have been shown to be unhealthy. In this paper we propose a novel framework named NutRec, which models the interactions between ingredients and their proportions within recipes for the purpose of offering healthy recommendation. Specifically, NutRec consists of three main components: 1) using an embedding-based ingredient predictor to predict the relevant ingredients with user-defined initial ingredients, 2) predicting the amounts of the relevant ingredients with a multi-layer perceptron-based network, 3) creating a healthy pseudo-recipe with a list of ingredients and their amounts according to the nutritional information and recommending the top similar recipes with the pseudo-recipe. We conduct the experiments on two recipe datasets, including Allrecipes with 36,429 recipes and Yummly with 89,413 recipes, respectively. The empirical results support the framework's intuition and showcase its ability to retrieve healthier recipes.


title: Joint Trajectory and Resource Allocation Design for Energy-Efficient Secure UAV Communication Systems

abstract: In this paper, we study the trajectory and resource allocation design for downlink energy-efficient secure unmanned aerial vehicle (UAV) communication systems, where an information UAV assisted by a multi-antenna jammer UAV serves multiple ground users in the existence of multiple ground eavesdroppers. The resource allocation strategy and the trajectory of the information UAV, and the jamming policy of the jammer UAV are jointly optimized for maximizing the system energy efficiency. The joint design is formulated as a non-convex optimization problem taking into account the quality of service (QoS) requirement, the security constraint, and the imperfect channel state information (CSI) of the eavesdroppers. The formulated problem is generally intractable. As a compromise approach, the problem is divided into two subproblems which facilitates the design of a low-complexity suboptimal algorithm based on alternating optimization approach. Simulation results illustrate that the proposed algorithm converges within a small number of iterations and demonstrate some interesting insights: (1) the introduction of a jammer UAV facilitates a highly flexible trajectory design of the information UAV which is critical to improving the system energy efficiency; (2) by exploiting the spatial degrees of freedom brought by the multi-antenna jammer UAV, our proposed design can focus the artificial noise on eavesdroppers offering a strong security mean to the system.


title: Joint Power Allocation and Precoding for Network Coding based Cooperative Multicast Systems

abstract: In this letter, we propose two power allocation schemes based on the statistical channel state information (CSI) and instantaneous s->r CSI at transmitters respectively for a 2-N-2 cooperative multicast system with non-regenerative network coding.Then the isolated precoder and the distributed precoder are respectively applied to the schemes to further improve the system performance by achieving the full diversity gain. Finally, we demonstrate that joint instantaneous s->r CSI based power allocation and distributed precoder design achieve the best performance.


title: Power Allocation in the High SNR Regime for A Multicast Cell with Regenerative Network Coding

abstract: This letter focuses on power allocation schemes for a basic multicast cell with wireless regenerative network coding (RNC). In RNC, mixed signals received from the two sources are jointly decoded by the relay where decoded symbols are superposed in either the complex field (RCNC) or Galois field (RGNC) before being retransmitted. We deduce the optimal statistical channels state information (CSI) based power allocation and give a comparison between the two RNCs. When instantaneous CSI is available at each transmitter, we propose a suboptimal power allocation for RCNC, which achieves better performance.


title: Finding semi-optimal measurements for entanglement detection using Autoencoder Neural Networks

abstract: Entanglement is one of the key resources of quantum information science which makes identification of entangled states essential to a wide range of quantum technologies and phenomena. This problem is however both computationally and experimentally challenging. Here we use autoencoder neural networks to find semi-optimal set of incomplete measurements that are most informative for the detection of entangled states. We show that it is possible to find high-performance entanglement detectors with as few as three measurements. Also, with the complete information of the state, we develop a neural network that can identify all two-qubits entangled states almost perfectly. This result paves the way for automatic development of efficient entanglement witnesses and entanglement detection using machine learning techniques.


title: Multi-modal Multi-channel Target Speech Separation

abstract: Target speech separation refers to extracting a target speaker's voice from an overlapped audio of simultaneous talkers. Previously the use of visual modality for target speech separation has demonstrated great potentials. This work proposes a general multi-modal framework for target speech separation by utilizing all the available information of the target speaker, including his/her spatial location, voice characteristics and lip movements. Also, under this framework, we investigate on the fusion methods for multi-modal joint modeling. A factorized attention-based fusion method is proposed to aggregate the high-level semantic information of multi-modalities at embedding level. This method firstly factorizes the mixture audio into a set of acoustic subspaces, then leverages the target's information from other modalities to enhance these subspace acoustic embeddings with a learnable attention scheme. To validate the robustness of proposed multi-modal separation model in practical scenarios, the system was evaluated under the condition that one of the modalities is temporarily missing, invalid or corrupted. Experiments are conducted on a large-scale audio-visual dataset collected from YouTube (to be released) that spatialized by simulated room impulse responses (RIRs). Experiment results illustrate that our proposed multi-modal framework significantly outperforms single-modal and bi-modal speech separation approaches, while can still support real-time processing.