title: Body Shape Privacy in Images: Understanding Privacy and Preventing Automatic Shape Extraction

abstract: Modern approaches to pose and body shape estimation have recently achieved strong performance even under challenging real-world conditions. Even from a single image of a clothed person, a realistic looking body shape can be inferred that captures a users' weight group and body shape type well. This opens up a whole spectrum of applications -- in particular in fashion -- where virtual try-on and recommendation systems can make use of these new and automatized cues. However, a realistic depiction of the undressed body is regarded highly private and therefore might not be consented by most people. Hence, we ask if the automatic extraction of such information can be effectively evaded. While adversarial perturbations have been shown to be effective for manipulating the output of machine learning models -- in particular, end-to-end deep learning approaches -- state of the art shape estimation methods are composed of multiple stages. We perform the first investigation of different strategies that can be used to effectively manipulate the automatic shape estimation while preserving the overall appearance of the original image.


title: Gelfand-type problem for turbulent jets

abstract: We consider the model of auto-ignition (thermal explosion) of a free round reactive turbulent jet. This model falls into the general class of Gelfand-type problems and constitutes a boundary value problem for a certain semi-linear elliptic equation that depends on two parameters: $\alpha$ characterizing the flow rate and $\lambda$ (Frank-Kamentskii parameter) characterizing the strength of the reaction. Similarly to the classical Gelfand problem, this equation admits a solution when the Frank-Kametskii parameter $\lambda$ does not exceed some critical value $\lambda^*(\alpha)$ and admits no solutions for larger values of $\lambda$. We obtain the sharp asymptotic behavior of the critical Frank-Kamenetskii parameter in the strong flow limit ($\alpha\gg1$). We also provide a detailed description of the extremal solution (i.e., the solution corresponding to $\lambda^*$) in this regime.


title: Validation of Approximate Likelihood and Emulator Models for Computationally Intensive Simulations

abstract: Complex phenomena in engineering and the sciences are often modeled with computationally intensive feed-forward simulations for which a tractable analytic likelihood does not exist. In these cases, it is sometimes necessary to estimate an approximate likelihood or fit a fast emulator model for efficient statistical inference; such surrogate models include Gaussian synthetic likelihoods and more recently neural density estimators such as autoregressive models and normalizing flows. To date, however, there is no consistent way of quantifying the quality of such a fit. Here we propose a statistical framework that can distinguish any arbitrary misspecified model from the target likelihood, and that in addition can identify with statistical confidence the regions of parameter as well as feature space where the fit is inadequate. Our validation method applies to settings where simulations are extremely costly and generated in batches or "ensembles" at fixed locations in parameter space. At the heart of our approach is a two-sample test that quantifies the quality of the fit at fixed parameter values, and a global test that assesses goodness-of-fit across simulation parameters. While our general framework can incorporate any test statistic or distance metric, we specifically argue for a new two-sample test that can leverage any regression method to attain high power and provide diagnostics in complex data settings.


title: Ancestral causal learning in high dimensions with a human genome-wide application

abstract: We consider learning ancestral causal relationships in high dimensions. Our approach is driven by a supervised learning perspective, with discrete indicators of causal relationships treated as labels to be learned from available data. We focus on the setting in which some causal (ancestral) relationships are known (via background knowledge or experimental data) and put forward a general approach that scales to large problems. This is motivated by problems in human biology which are characterized by high dimensionality and potentially many latent variables. We present a case study involving interventional data from human cells with total dimension $p \! \sim \! 19{,}000$. Performance is assessed empirically by testing model output against previously unseen interventional data. The proposed approach is highly effective and demonstrably scalable to the human genome-wide setting. We consider sensitivity to background knowledge and find that results are robust to nontrivial perturbations of the input information. We consider also the case, relevant to some applications, where the only prior information available concerns a small number of known ancestral relationships.


title: Superheavy nuclei in microscopic collective Hamiltonian approach: the impact of beyond mean field correlations on the ground state and fission properties

abstract: The impact of beyond mean field effects on the ground state and fission properties of superheavy nuclei has been investigated in a five-dimensional collective Hamiltonian based on covariant density functional theory. The inclusion of dynamical correlations reduces the impact of the $Z=120$ shell closure and induces substantial collectivity for the majority of the $Z=120$ nuclei which otherwise are spherical at the mean field level (as seen in the calculations with the PC-PK1 functional). Thus, they lead to a substantial convergence of the predictions of the functionals DD-PC1 and PC-PK1 which are different at the mean field level. On the contrary, the predictions of these two functionals remain distinctly different for the $N=184$ nuclei even when dynamical correlations are included. These nuclei are mostly spherical (oblate) in the calculations with PC-PK1 (DD-PC1). Our calculations for the first time reveal significant impact of dynamical correlations on the heights of inner fission barriers of superheavy nuclei with soft potential energy surfaces, the minimum of which at the mean field level is located at spherical shape. These correlations affect the fission barriers of the nuclei, which are deformed in the ground state at the mean field level, to a lesser degree.


title: Twisted cyclic quiver varieties on curves

abstract: We study the algebraic geometry of twisted Higgs bundles of cyclic type along complex curves. These objects, which generalize ordinary cyclic Higgs bundles, can be identified with representations of a cyclic quiver in a twisted category of coherent sheaves. Referring to the Hitchin fibration, we produce a fibre-wise geometric description of the locus of such representations within the ambient twisted Higgs moduli space. When the genus is 0, we produce a concrete geometric identification of the moduli space as a vector bundle over an associated (twisted) A-type quiver variety; we count the number of points at which the cyclic moduli space intersects a Hitchin fibre; and we describe explicitly certain $\mathbb{C}^\times$-flows into the nilpotent cone. We also extend this description to moduli of certain twisted cyclic quivers whose rank vector has components larger than 1. We show that, for certain choices of underlying bundle, such moduli spaces decompose as a product of cyclic quiver varieties in which each node is a line bundle.


title: Spin-Cooling of the Motion of a Trapped Diamond

abstract: Observing and controlling macroscopic quantum systems has long been a driving force in research on quantum physics. In this endeavor, strong coupling between individual quantum systems and mechanical oscillators is being actively pursued. While both read-out of mechanical motion using coherent control of spin systems and single spin read-out using pristine oscillators have been demonstrated, temperature control of the motion of a macroscopic object using long-lived electronic spins has not been reported. Here, we observe both a spin-dependent torque and spin-cooling of the motion of a trapped microdiamond. Using a combination of microwave and laser excitation enables the spin of nitrogen-vacancy centers to act on the diamond orientation and to cool the diamond libration via a dynamical back-action. Further, driving the system in the non-linear regime, we demonstrate bistability and self-sustained coherent oscillations stimulated by the spin-mechanical coupling, which offers prospects for spin-driven generation of non-classical states of motion. Such a levitating diamond operated as a compass with controlled dissipation has implications in high-precision torque sensing, emulation of the spin-boson problem and probing of quantum phase transitions. In the single spin limit and employing ultra-pure nano-diamonds, it will allow quantum non-demolition read-out of the spin of nitrogen-vacancy centers under ambient conditions, deterministic entanglement between distant individual spins and matter-wave interferometry.


title: Transition rates for $3s3p^2\;^4P - 3s3p4s\;^4P^o$ transitions in Al I

abstract: Fully relativistic calculations have been performed for two multiplets, $3s3p^2\;^4P$ and $3s3p4s\;^4P^o$, in Al I. Wave functions were obtained for all levels of these multiplets using the GRASP programs. Reported are the E1 transitions rates for all transitions between levels of these multiplets. Transition energies and transition rates are compared with observed values and other theory. Our calculated transition rates are smaller by about 10% than observed rates, reducing a large discrepancy between earlier calculations and experiment.


title: Optimization-based control design techniques and tools

abstract: Structured output feedback controller synthesis is an exciting recent concept in modern control design, which bridges between theory and practice in so far as it allows for the first time to apply sophisticated mathematical design paradigms like $H_\infty$- or $H_2$-control within control architectures preferred by practitioners. The new approach to structured $H_\infty$-control, developed by the authors during the past decade, is rooted in a change of paradigm in the synthesis algorithms. Structured design is no longer be based on solving algebraic Riccati equations or matrix inequalities. Instead, optimization-based design techniques are required. In this essay we indicate why structured controller synthesis is central in modern control engineering. We explain why non-smooth optimization techniques are needed to compute structured control laws, and we point to software tools which enable practitioners to use these new tools in high technology applications.


title: A New Algorithm for Decremental Single-Source Shortest Paths with Applications to Vertex-Capacitated Flow and Cut Problems

abstract: We study the vertex-decremental Single-Source Shortest Paths (SSSP) problem: given an undirected graph $G=(V,E)$ with lengths $\ell(e)\geq 1$ on its edges and a source vertex $s$, we need to support (approximate) shortest-path queries in $G$, as $G$ undergoes vertex deletions. In a shortest-path query, given a vertex $v$, we need to return a path connecting $s$ to $v$, whose length is at most $(1+\epsilon)$ times the length of the shortest such path, where $\epsilon$ is a given accuracy parameter. The problem has many applications, for example to flow and cut problems in vertex-capacitated graphs. Our main result is a randomized algorithm for vertex-decremental SSSP with total expected update time $O(n^{2+o(1)}\log L)$, that responds to each shortest-path query in $O(n\log L)$ time in expectation, returning a $(1+\epsilon)$-approximate shortest path. The algorithm works against an adaptive adversary. The main technical ingredient of our algorithm is an $\tilde O(|E(G)|+ n^{1+o(1)})$-time algorithm to compute a \emph{core decomposition} of a given dense graph $G$, which allows us to compute short paths between pairs of query vertices in $G$ efficiently. We believe that this core decomposition algorithm may be of independent interest. We use our result for vertex-decremental SSSP to obtain $(1+\epsilon)$-approximation algorithms for maximum $s$-$t$ flow and minimum $s$-$t$ cut in vertex-capacitated graphs, in expected time $n^{2+o(1)}$, and an $O(\log^4n)$-approximation algorithm for the vertex version of the sparsest cut problem with expected running time $n^{2+o(1)}$. These results improve upon the previous best known results for these problems in the regime where $m= \omega(n^{1.5 + o(1)})$.


title: A Knowledge Graph-based Approach for Exploring the U.S. Opioid Epidemic

abstract: The United States is in the midst of an opioid epidemic with recent estimates indicating that more than 130 people die every day due to drug overdose. The over-prescription and addiction to opioid painkillers, heroin, and synthetic opioids, has led to a public health crisis and created a huge social and economic burden. Statistical learning methods that use data from multiple clinical centers across the US to detect opioid over-prescribing trends and predict possible opioid misuse are required. However, the semantic heterogeneity in the representation of clinical data across different centers makes the development and evaluation of such methods difficult and non-trivial. We create the Opioid Drug Knowledge Graph (ODKG) -- a network of opioid-related drugs, active ingredients, formulations, combinations, and brand names. We use the ODKG to normalize drug strings in a clinical data warehouse consisting of patient data from over 400 healthcare facilities in 42 different states. We showcase the use of ODKG to generate summary statistics of opioid prescription trends across US regions. These methods and resources can aid the development of advanced and scalable models to monitor the opioid epidemic and to detect illicit opioid misuse behavior. Our work is relevant to policymakers and pain researchers who wish to systematically assess factors that contribute to opioid over-prescribing and iatrogenic opioid addiction in the US.


title: Solid-like mean-square displacement in glass-forming liquids

abstract: It was recently shown that the real part of the frequency-dependent fluidity for several glass-forming liquids of different chemistry conforms to the prediction of the random barrier model (RBM) devised for ac electrical conduction in disordered solids [S. P. Bierwirth \textit{et al.}, Phys. Rev. Lett. {\bf 119}, 248001 (2017)]. Inspired by these results we introduce a crystallization-resistant modification of the Kob-Andersen binary Lennard-Jones mixture for which the results of extensive graphics-processing unit (GPU)-based molecular-dynamics simulations are presented. We find that the low-temperature mean-square displacement is fitted well by the RBM prediction, which involves no shape parameters. This finding highlights the challenge of explaining why a simple model based on hopping of non-interacting particles in a fixed random energy landscape can reproduce the complex and highly cooperative dynamics of glass-forming liquids.


title: Abstraction Mechanisms Predict Generalization in Deep Neural Networks

abstract: A longstanding problem for Deep Neural Networks (DNNs) is understanding their puzzling ability to generalize well. We approach this problem through the unconventional angle of \textit{cognitive abstraction mechanisms}, drawing inspiration from recent neuroscience work, allowing us to define the Cognitive Neural Activation metric (CNA) for DNNs, which is the correlation between information complexity (entropy) of given input and the concentration of higher activation values in deeper layers of the network. The CNA is highly predictive of generalization ability, outperforming norm-and-margin-based generalization metrics on an extensive evaluation of over 100 dataset-and-network-architecture combinations, especially in cases where additive noise is present and/or training labels are corrupted. These strong empirical results show the usefulness of CNA as a generalization metric, and encourage further research on the connection between information complexity and representations in the deeper layers of networks in order to better understand the generalization capabilities of DNNs.


title: Anomaly Detection in the Open Supernova Catalog

abstract: In the upcoming decade large astronomical surveys will discover millions of transients raising unprecedented data challenges in the process. Only the use of the machine learning algorithms can process such large data volumes. Most of the discovered transients will belong to the known classes of astronomical objects. However, it is expected that some transients will be rare or completely new events of unknown physical nature. The task of finding them can be framed as an anomaly detection problem. In this work, we perform for the first time an automated anomaly detection analysis in the photometric data of the Open Supernova Catalog (OSC), which serves as a proof of concept for the applicability of these methods to future large scale surveys. The analysis consists of the following steps: 1) data selection from the OSC and approximation of the pre-processed data with Gaussian processes, 2) dimensionality reduction, 3) searching for outliers with the use of the isolation forest algorithm, 4) expert analysis of the identified outliers. The pipeline returned 81 candidate anomalies, 27 (33%) of which were confirmed to be from astrophysically peculiar objects. Found anomalies correspond to a selected sample of 1.4% of the initial automatically identified data sample of ~2000 objects. Among the identified outliers we recognised superluminous supernovae, non-classical Type Ia supernovae, unusual Type II supernovae, one active galactic nucleus and one binary microlensing event. We also found that 16 anomalies classified as supernovae in the literature are likely to be quasars or stars. Our proposed pipeline represents an effective strategy to guarantee we shall not overlook exciting new science hidden in the data we fought so hard to acquire. All code and products of this investigation are made publicly available.


title: Novel Flavon Stabilization with Trimaximal Neutrino Mixing

abstract: We construct a supersymmetric $S_4$ flavor symmetry model with one of the trimaximal neutrino mixing patterns, the so-called TM$_1$, by using the novel way to stabilize flavons, which we proposed recently. The flavons are assumed to have tachyonic supersymmetry breaking mass terms and stabilized by higher-dimensional terms in the potential. We can obtain the desired alignment structure of the flavon vacuum expectation values to realize neutrino masses and mixings consistent with the current observations. This mechanism naturally avoids the appearance of dangerous cosmological domain walls.


title: On a scalable problem transformation method for multi-label learning

abstract: Binary relevance is a simple approach to solve multi-label learning problems where an independent binary classifier is built per each label. A common challenge with this in real-world applications is that the label space can be very large, making it difficult to use binary relevance to larger scale problems. In this paper, we propose a scalable alternative to this, via transforming the multi-label problem into a single binary classification. We experiment with a few variations of our method and show that our method achieves higher precision than binary relevance and faster execution times on a top-K recommender system task.


title: Open Platforms for Artificial Intelligence for Social Good: Common Patterns as a Pathway to True Impact

abstract: The AI for social good movement has now reached a state in which a large number of one-off demonstrations have illustrated that partnerships of AI practitioners and social change organizations are possible and can address problems faced in sustainable development. In this paper, we discuss how moving from demonstrations to true impact on humanity will require a different course of action, namely open platforms containing foundational AI capabilities to support common needs of multiple organizations working in similar topical areas. We lend credence to this proposal by describing three example patterns of social good problems and their AI-based solutions: natural language processing for making sense of international development reports, causal inference for providing guidance to vulnerable individuals, and discrimination-aware classification for supporting unbiased allocation decisions. We argue that the development of such platforms will be possible through convenings of social change organizations, AI companies, and grantmaking foundations.


title: Universality Theorems for Generative Models

abstract: Despite the fact that generative models are extremely successful in practice, the theory underlying this phenomenon is only starting to catch up with practice. In this work we address the question of the universality of generative models: is it true that neural networks can approximate any data manifold arbitrarily well? We provide a positive answer to this question and show that under mild assumptions on the activation function one can always find a feedforward neural network that maps the latent space onto a set located within the specified Hausdorff distance from the desired data manifold. We also prove similar theorems for the case of multiclass generative models and cycle generative models, trained to map samples from one manifold to another and vice versa.


title: Quantization of graphene plasmons

abstract: In this article we perform the quantization of graphene plasmons using both a macroscopic approach based on the classical average electromagnetic energy and a quantum hydrodynamic model, in which graphene charge carriers are modeled as a charged fluid. Both models allow to take into account the dispersion of graphenes optical response, with the hydrodynamic model also allowing for the inclusion of non-local effects. Using both methods, the electromagnetic field mode-functions, and the respective frequencies, are determined for two different graphene structures. we show how to quantize graphene plasmons, considering that graphene is a dispersive medium, and taking into account both local and nonlocal descriptions. It is found that the dispersion of graphene's optical response leads to a non-trivial normalization condition for the mode-functions. The obtained mode-functions are then used to calculate the decay of an emitter, represented by a dipole, via the excitation of graphene surface plasmon-polaritons. The obtained results are compared with the total spontaneous decay rate of the emitter and a near perfect match is found in the relevant spectral range. It is found that non-local effects in graphene's conductivity, become relevant for the emission rate for small Fermi energies and small distances between the dipole and the graphene sheet.


title: Enhancing Salient Object Segmentation Through Attention

abstract: Segmenting salient objects in an image is an important vision task with ubiquitous applications. The problem becomes more challenging in the presence of a cluttered and textured background, low resolution and/or low contrast images. Even though existing algorithms perform well in segmenting most of the object(s) of interest, they often end up segmenting false positives due to resembling salient objects in the background. In this work, we tackle this problem by iteratively attending to image patches in a recurrent fashion and subsequently enhancing the predicted segmentation mask. Saliency features are estimated independently for every image patch, which are further combined using an aggregation strategy based on a Convolutional Gated Recurrent Unit (ConvGRU) network. The proposed approach works in an end-to-end manner, removing background noise and false positives incrementally. Through extensive evaluation on various benchmark datasets, we show superior performance to the existing approaches without any post-processing.


title: A Geometric Characterization of Rational Groups

abstract: We give a geometric characterization of finite rational groups. In particular, we prove that a finite group is rational if and only if there exists a finite geometry $\Gamma$ of type $I$ and action of $G$ on $\Gamma$ as a group of automorphisms such that if $g$ and $h$ are elements of $G$ fixing the same number of flags of type $J$ for all subsets $J$ of $I$, then $g$ and $h$ are conjugate in $G$.


title: Shared Linear Quadratic Regulation Control: A Reinforcement Learning Approach

abstract: We propose controller synthesis for state regulation problems in which a human operator shares control with an autonomy system, running in parallel. The autonomy system continuously improves over human action, with minimal intervention, and can take over full-control. It additively combines user input with an adaptive optimal corrective signal. It is adaptive in that it neither estimates nor requires a model of the human's action policy, or the internal dynamics of the plant, and can adjust to changes in both. Our contribution is twofold; first, a new synthesis for shared control which we formulate as an adaptive optimal control problem for continuous-time linear systems and solve it online as a human-in-the-loop reinforcement learning. The result is an architecture that we call shared linear quadratic regulator (sLQR). Second, we provide new analysis of reinforcement learning for continuous-time linear systems in two parts. In the first analysis part, we avoid learning along a single state-space trajectory which we show leads to data collinearity under certain conditions. We make a clear separation between exploitation of learned policies and exploration of the state-space, and propose an exploration scheme that requires switching to new state-space trajectories rather than injecting noise continuously while learning. This avoidance of continuous noise injection minimizes interference with human action, and avoids bias in the convergence to the stabilizing solution of the underlying algebraic Riccati equation. We show that exploring a minimum number of pairwise distinct state-space trajectories is necessary to avoid collinearity in the learning data. In the second analysis part, we show conditions under which existence and uniqueness of solutions can be established for off-policy reinforcement learning in continuous-time linear systems; namely, prior knowledge of the input matrix.


title: A Closed Universe with Maximum Life-Time

abstract: A closed universe with maximum life-time is constructed using optimal control. Einstein's field equations are used with varying cosmological "constant". The second time derivative of the Hubble parameter acts as the control function in the optimal control model.


title: Skew key polynomials and a generalized Littlewood-Richardson rule

abstract: Young's lattice is a partial order on integer partitions whose saturated chains correspond to standard Young tableaux, one type of combinatorial object that generates the Schur basis for symmetric functions. Generalizing Young's lattice, we introduce a new partial order on weak compositions that we call the key poset. Saturated chains in this poset correspond to standard key tableaux, the combinatorial objects that generate the key polynomials, a nonsymmetric polynomial generalization of the Schur basis. Generalizing skew Schur functions, we define skew key polynomials in terms of this new poset. Using weak dual equivalence, we give a nonnegative weak composition Littlewood-Richardson rule for the key expansion of skew key polynomials, generalizing the flagged Littlewood-Richardson rule of Reiner and Shimozono.


title: Tight Regret Bounds for Model-Based Reinforcement Learning with Greedy Policies

abstract: State-of-the-art efficient model-based Reinforcement Learning (RL) algorithms typically act by iteratively solving empirical models, i.e., by performing \emph{full-planning} on Markov Decision Processes (MDPs) built by the gathered experience. In this paper, we focus on model-based RL in the finite-state finite-horizon MDP setting and establish that exploring with \emph{greedy policies} -- act by \emph{1-step planning} -- can achieve tight minimax performance in terms of regret, $\tilde{\mathcal{O}}(\sqrt{HSAT})$. Thus, full-planning in model-based RL can be avoided altogether without any performance degradation, and, by doing so, the computational complexity decreases by a factor of $S$. The results are based on a novel analysis of real-time dynamic programming, then extended to model-based RL. Specifically, we generalize existing algorithms that perform full-planning to such that act by 1-step planning. For these generalizations, we prove regret bounds with the same rate as their full-planning counterparts.


title: Improved Training Speed, Accuracy, and Data Utilization Through Loss Function Optimization

abstract: As the complexity of neural network models has grown, it has become increasingly important to optimize their design automatically through metalearning. Methods for discovering hyperparameters, topologies, and learning rate schedules have lead to significant increases in performance. This paper shows that loss functions can be optimized with metalearning as well, and result in similar improvements. The method, Genetic Loss-function Optimization (GLO), discovers loss functions de novo, and optimizes them for a target task. Leveraging techniques from genetic programming, GLO builds loss functions hierarchically from a set of operators and leaf nodes. These functions are repeatedly recombined and mutated to find an optimal structure, and then a covariance-matrix adaptation evolutionary strategy (CMA-ES) is used to find optimal coefficients. Networks trained with GLO loss functions are found to outperform the standard cross-entropy loss on standard image classification tasks. Training with these new loss functions requires fewer steps, results in lower test error, and allows for smaller datasets to be used. Loss-function optimization thus provides a new dimension of metalearning, and constitutes an important step towards AutoML.


title: Grid Optimal Integration of Power Ships

abstract: Power-generating ships or Power Ships (PSs) are considered one of the largest mobile energy resources. In this paper, a model is proposed to evaluate the integration of PSs into power grid operations. The model optimally coordinates the ships to enhance the grid objective; its solution provides optimal generation resource scheduling, as well as optimal scheduling and routing of the ships. IEEE 6-bus and IEEE 118-bus case studies were considered to model the system and to validate the effectiveness of the proposed model.


title: Efficient Network Construction through Structural Plasticity

abstract: Deep Neural Networks (DNNs) on hardware is facing excessive computation cost due to the massive number of parameters. A typical training pipeline to mitigate over-parameterization is to pre-define a DNN structure first with redundant learning units (filters and neurons) under the goal of high accuracy, then to prune redundant learning units after training with the purpose of efficient inference. We argue that it is sub-optimal to introduce redundancy into training for the purpose of reducing redundancy later in inference. Moreover, the fixed network structure further results in poor adaption to dynamic tasks, such as lifelong learning. In contrast, structural plasticity plays an indispensable role in mammalian brains to achieve compact and accurate learning. Throughout the lifetime, active connections are continuously created while those no longer important are degenerated. Inspired by such observation, we propose a training scheme, namely Continuous Growth and Pruning (CGaP), where we start the training from a small network seed, then literally execute continuous growth by adding important learning units and finally prune secondary ones for efficient inference. The inference model generated from CGaP is sparse in the structure, largely decreasing the inference power and latency when deployed on hardware platforms. With popular DNN structures on representative datasets, the efficacy of CGaP is benchmarked by both algorithm simulation and architectural modeling on Field-programmable Gate Arrays (FPGA). For example, CGaP decreases the FLOPs, model size, DRAM access energy and inference latency by 63.3%, 64.0%, 11.8% and 40.2%, respectively, for ResNet-110 on CIFAR-10.


title: Compositional pre-training for neural semantic parsing

abstract: Semantic parsing is the process of translating natural language utterances into logical forms, which has many important applications such as question answering and instruction following. Sequence-to-sequence models have been very successful across many NLP tasks. However, a lack of task-specific prior knowledge can be detrimental to the performance of these models. Prior work has used frameworks for inducing grammars over the training examples, which capture conditional independence properties that the model can leverage. Inspired by the recent success stories such as BERT we set out to extend this augmentation framework into two stages. The first stage is to pre-train using a corpus of augmented examples in an unsupervised manner. The second stage is to fine-tune to a domain-specific task. In addition, since the pre-training stage is separate from the training on the main task we also expand the universe of possible augmentations without causing catastrophic inference. We also propose a novel data augmentation strategy that interchanges tokens that co-occur in similar contexts to produce new training pairs. We demonstrate that the proposed two-stage framework is beneficial for improving the parsing accuracy in a standard dataset called GeoQuery for the task of generating logical forms from a set of questions about the US geography.


title: Structure Learning for Neural Module Networks

abstract: Neural Module Networks, originally proposed for the task of visual question answering, are a class of neural network architectures that involve human-specified neural modules, each designed for a specific form of reasoning. In current formulations of such networks only the parameters of the neural modules and/or the order of their execution is learned. In this work, we further expand this approach and also learn the underlying internal structure of modules in terms of the ordering and combination of simple and elementary arithmetic operators. Our results show that one is indeed able to simultaneously learn both internal module structure and module sequencing without extra supervisory signals for module execution sequencing. With this approach, we report performance comparable to models using hand-designed modules.


title: CGaP: Continuous Growth and Pruning for Efficient Deep Learning

abstract: Today a canonical approach to reduce the computation cost of Deep Neural Networks (DNNs) is to pre-define an over-parameterized model before training to guarantee the learning capacity, and then prune unimportant learning units (filters and neurons) during training to improve model compactness. We argue it is unnecessary to introduce redundancy at the beginning of the training but then reduce redundancy for the ultimate inference model. In this paper, we propose a Continuous Growth and Pruning (CGaP) scheme to minimize the redundancy from the beginning. CGaP starts the training from a small network seed, then expands the model continuously by reinforcing important learning units, and finally prunes the network to obtain a compact and accurate model. As the growth phase favors important learning units, CGaP provides a clear learning purpose to the pruning phase. Experimental results on representative datasets and DNN architectures demonstrate that CGaP outperforms previous pruning-only approaches that deal with pre-defined structures. For VGG-19 on CIFAR-100 and SVHN datasets, CGaP reduces the number of parameters by 78.9% and 85.8%, FLOPs by 53.2% and 74.2%, respectively; For ResNet-110 On CIFAR-10, CGaP reduces 64.0% number of parameters and 63.3% FLOPs.


title: Fluctuation-Induced Interactions and the Spin Glass Transition in $Fe_2TiO_5$

abstract: We investigate the spin-glass transition in the strongly frustrated well-known compound $Fe_2TiO_5$. A remarkable feature of this transition, widely discussed in the literature, is its anisotropic properties: the transition manifests itself in the magnetic susceptibly only along one axis, despite $Fe^{3+}$ $d^5$ spins having no orbital component. We demonstrate, using neutron scattering, that below the transition temperature $T_g = 55 K$, $Fe_2TiO_5$ develops nanoscale surfboard shaped antiferromagnetic regions in which the $Fe^{3+}$ spins are aligned perpendicular to the axis which exhibits freezing. We show that the glass transition may result from the freezing of transverse fluctuations of the magnetization of these regions and we develop a mean-field replica theory of such a transition, revealing a type of magnetic van der Waals effect.


title: A Stochastic Decoupling Method for Minimizing the Sum of Smooth and Non-Smooth Functions

abstract: We consider the problem of minimizing the sum of three convex functions: i) a smooth function $f$ in the form of an expectation or a finite average, ii) a non-smooth function $g$ in the form of a finite average of proximable functions $g_j$, and iii) a proximable regularizer $R$. We design a variance-reduced method which is able to progressively learn the proximal operator of $g$ via the computation of the proximal operator of a single randomly selected function $g_j$ in each iteration only. Our method can provably and efficiently accommodate many strategies for the estimation of the gradient of $f$, including via standard and variance-reduced stochastic estimation, effectively decoupling the smooth part of the problem from the non-smooth part. We prove a number of iteration complexity results, including a general ${\cal O}(1/t)$ rate, ${\cal O}(1/t^2)$ rate in the case of strongly convex smooth $f$, and several linear rates in special cases, including accelerated linear rate. For example, our method achieves a linear rate for the problem of minimizing a strongly convex function $f$ subject to linear constraints under no assumption on the constraints beyond consistency. When combined with SGD or SAGA estimators for the gradient of $f$, this leads to a very efficient method for empirical risk minimization. Our method generalizes several existing algorithms, including forward-backward splitting, Douglas-Rachford splitting, proximal SGD, proximal SAGA, SDCA, randomized Kaczmarz and Point-SAGA. However, our method leads to many new specific methods in special cases; for instance, we obtain the first randomized variant of the Dykstra's method for projection onto the intersection of closed convex sets.


title: OrderNet: Ordering by Example

abstract: In this paper we introduce a new neural architecture for sorting unordered sequences where the correct sequence order is not easily defined but must rather be inferred from training data. We refer to this architecture as OrderNet and describe how it was constructed to be naturally permutation equivariant while still allowing for rich interactions of elements of the input set. We evaluate the capabilities of our architecture by training it to approximate solutions for the Traveling Salesman Problem and find that it outperforms previously studied supervised techniques in its ability to generalize to longer sequences than it was trained with. We further demonstrate the capability by reconstructing the order of sentences with scrambled word order.


title: Reasoning about Quality and Fuzziness of Strategic Behaviours

abstract: Temporal logics are extensively used for the specification of on-going behaviours of reactive systems. Two significant developments in this area are the extension of traditional temporal logics with modalities that enable the specification of on-going strategic behaviours in multi-agent systems, and the transition of temporal logics to a quantitative setting, where different satisfaction values enable the specifier to formalise concepts such as certainty or quality. We introduce and study FSL---a quantitative extension of SL (Strategy Logic), one of the most natural and expressive logics describing strategic behaviours. The satisfaction value of an FSL formula is a real value in [0,1], reflecting `how much' or `how well' the strategic on-going objectives of the underlying agents are satisfied. We demonstrate the applications of FSL in quantitative reasoning about multi-agent systems, by showing how it can express concepts of stability in multi-agent systems, and how it generalises some fuzzy temporal logics. We also provide a model-checking algorithm for our logic, based on a quantitative extension of Quantified CTL*.


title: Phonons in Twisted Transition Metal Dichalcogenide Bilayers ("Twistnonics"): Ultra-soft Phasons, and a transition from Superlubric to Pinned Phase

abstract: The tunability of the interlayer coupling by twisting one layer with respect to another layer of two-dimensional materials provides a unique way to manipulate the phonons and related properties. We refer to this engineering of phononic properties as "Twistnonics". We study the effects of twisting on low-frequency shear (SM) and layer breathing (LBM) modes in transition metal dichalcogenide (TMD) bilayer using atomistic classical simulations. We show that these low-frequency modes are extremely sensitive to twist and can be used to infer the twist angle. We find unique "ultra-soft" phason modes (frequency $\lesssim 1\ \mathrm{cm^{-1}}$, comparable to acoustic modes) for any non-zero twist, corresponding to an \textit{effective} translation of the moir{\'e} lattice by relative displacement of the constituent layers in a non-trivial way. Unlike the acoustic modes, the velocity of the phason modes is quite sensitive to twist angle. As twist angle decreases, ($\theta \lesssim 3^{\circ},\ \gtrsim 57^{\circ}$) the ultra-soft modes represent the acoustic modes of the "emergent" soft moir{\'e} scale lattice. Also, new high-frequency SMs appear, identical to those in stable bilayer TMD ($\theta = 0\degree/60\degree$), due to the overwhelming growth of stable stacking regions in relaxed twisted structures. Furthermore, we find remarkably different structural relaxation as $\theta \to 0^{\circ}$, $\to 60^{\circ}$ due to sub-lattice symmetry breaking. Our study reveals the possibility of an intriguing $\theta$ dependent superlubric to pinning behavior and of the existence of ultra-soft modes in \textit{all} two-dimensional (2D) materials.


title: Semantic Fisher Scores for Task Transfer: Using Objects to Classify Scenes

abstract: The transfer of a neural network (CNN) trained to recognize objects to the task of scene classification is considered. A Bag-of-Semantics (BoS) representation is first induced, by feeding scene image patches to the object CNN, and representing the scene image by the ensuing bag of posterior class probability vectors (semantic posteriors). The encoding of the BoS with a Fisher vector(FV) is then studied. A link is established between the FV of any probabilistic model and the Q-function of the expectation-maximization(EM) algorithm used to estimate its parameters by maximum likelihood. A network implementation of the MFA Fisher Score (MFA-FS), denoted as the MFAFSNet, is finally proposed to enable end-to-end training. Experiments with various object CNNs and datasets show that the approach has state-of-the-art transfer performance. Somewhat surprisingly, the scene classification results are superior to those of a CNN explicitly trained for scene classification, using a large scene dataset (Places). This suggests that holistic analysis is insufficient for scene classification. The modeling of local object semantics appears to be at least equally important. The two approaches are also shown to be strongly complementary, leading to very large scene classification gains when combined, and outperforming all previous scene classification approaches by a sizeable margin


title: Multiline Orthogonal Scanning Temporal Focusing (mosTF) Microscopy for Scattering Reduction in High-speed in vivo Brain Imaging

abstract: Temporal focusing two-photon microscopy enables high resolution imaging of fine structures in vivo over a large volume. A limitation of temporal focusing is that signal-to-background ratio and resolution degrade rapidly with increasing imaging depth. This degradation originates from the scattered emission photons are widely distributed resulting in a strong background. We have developed Multiline Orthogonal Scanning Temporal Focusing (mosTF) microscopy that overcomes this problem. mosTF captures a sequence of images at each scan location of the excitation line, followed by a reconstruction algorithm reassigns scattered photons back to the correct scan position. We demonstrate mosTF by acquiring mice neuronal images in vivo. Our results show remarkably improvements with mosTF for in vivo brain imaging while maintaining its speed advantage.


title: Two-dimensional rogue waves on zero background of the Davey-Stewartson II equation

abstract: A prototypical example of a rogue wave structure in a two-dimensional model is presented in the context of the Davey-Stewartson~II (DS~II) equation arising in water waves. The analytical methodology involves a Taylor expansion of an eigenfunctionof the model's Lax pair which is used to form a hierarchy of infinitely many new eigenfunctions. These are used for the construction of two-dimensional (2D) rogue waves (RWs) of the DS~II equation by the even-fold Darboux transformation (DT). The obtained 2D RWs, which are localized in both space and time, can be viewed as a 2D analogue of the Peregrine soliton and are thus natural candidates to describe oceanic RW phenomena,as well as ones in 2D fluid systems and water tanks.


title: Counterpropagating continuous variable entangled states in lossy coupled-cavity optical waveguides

abstract: We present an integrated source of counterpropagating entangled states based on a coupled resonator optical waveguide that is pumped by a classical pulsed source incident from above the waveguide. We investigate theoretically the generation and propagation of continuous variable entangled states in this coupled-cavity system in the presence of intrinsic loss. Using a tight-binding approximation, we derive analytic time-dependent expressions for the number of photons in each cavity, as well as for the correlation variance between the photons in different pairs of cavities, to evaluate the degree of quantum entanglement. We also derive simple approximate expressions for these quantities that can be used to guide the design of such systems, and discuss how pumping configurations and physical properties of the system affect the photon statistics and the degree of quantum correlation.


title: Jointly Learning Structured Analysis Discriminative Dictionary and Analysis Multiclass Classifier

abstract: In this paper, we propose an analysis mechanism based structured Analysis Discriminative Dictionary Learning (ADDL) framework. ADDL seamlessly integrates the analysis discriminative dictionary learning, analysis representation and analysis classifier training into a unified model. The applied analysis mechanism can make sure that the learnt dictionaries, representations and linear classifiers over different classes are independent and discriminating as much as possible. The dictionary is obtained by minimizing a reconstruction error and an analytical incoherence promoting term that encourages the sub-dictionaries associated with different classes to be independent. To obtain the representation coefficients, ADDL imposes a sparse l2,1-norm constraint on the coding coefficients instead of using l0 or l1-norm, since the l0 or l1-norm constraint applied in most existing DL criteria makes the training phase time consuming. The codes-extraction projection that bridges data with the sparse codes by extracting special features from the given samples is calculated via minimizing a sparse codes approximation term. Then we compute a linear classifier based on the approximated sparse codes by an analysis mechanism to simultaneously consider the classification and representation powers. Thus, the classification approach of our model is very efficient, because it can avoid the extra time-consuming sparse reconstruction process with trained dictionary for each new test data as most existing DL algorithms. Simulations on real image databases demonstrate that our ADDL model can obtain superior performance over other state-of-the-arts.


title: Label Universal Targeted Attack

abstract: We introduce Label Universal Targeted Attack (LUTA) that makes a deep model predict a label of attacker's choice for `any' sample of a given source class with high probability. Our attack stochastically maximizes the log-probability of the target label for the source class with first order gradient optimization, while accounting for the gradient moments. It also suppresses the leakage of attack information to the non-source classes for avoiding the attack suspicions. The perturbations resulting from our attack achieve high fooling ratios on the large-scale ImageNet and VGGFace models, and transfer well to the Physical World. Given full control over the perturbation scope in LUTA, we also demonstrate it as a tool for deep model autopsy. The proposed attack reveals interesting perturbation patterns and observations regarding the deep models.


title: Learning to Approximate a Bregman Divergence

abstract: Bregman divergences generalize measures such as the squared Euclidean distance and the KL divergence, and arise throughout many areas of machine learning. In this paper, we focus on the problem of approximating an arbitrary Bregman divergence from supervision, and we provide a well-principled approach to analyzing such approximations. We develop a formulation and algorithm for learning arbitrary Bregman divergences based on approximating their underlying convex generating function via a piecewise linear function. We provide theoretical approximation bounds using our parameterization and show that the generalization error $O_p(m^{-1/2})$ for metric learning using our framework matches the known generalization error in the strictly less general Mahalanobis metric learning setting. We further demonstrate empirically that our method performs well in comparison to existing metric learning methods, particularly for clustering and ranking problems.


title: Distributed estimation of the inverse Hessian by determinantal averaging

abstract: In distributed optimization and distributed numerical linear algebra, we often encounter an inversion bias: if we want to compute a quantity that depends on the inverse of a sum of distributed matrices, then the sum of the inverses does not equal the inverse of the sum. An example of this occurs in distributed Newton's method, where we wish to compute (or implicitly work with) the inverse Hessian multiplied by the gradient. In this case, locally computed estimates are biased, and so taking a uniform average will not recover the correct solution. To address this, we propose determinantal averaging, a new approach for correcting the inversion bias. This approach involves reweighting the local estimates of the Newton's step proportionally to the determinant of the local Hessian estimate, and then averaging them together to obtain an improved global estimate. This method provides the first known distributed Newton step that is asymptotically consistent, i.e., it recovers the exact step in the limit as the number of distributed partitions grows to infinity. To show this, we develop new expectation identities and moment bounds for the determinant and adjugate of a random matrix. Determinantal averaging can be applied not only to Newton's method, but to computing any quantity that is a linear tranformation of a matrix inverse, e.g., taking a trace of the inverse covariance matrix, which is used in data uncertainty quantification.


title: Automorphisms and Periods of Cubic Fourfolds

abstract: We classify the symplectic automorphism groups for cubic fourfolds. The main inputs are the global Torelli theorem for cubic fourfolds and the classification of the fixed-point sublattices of the Leech lattice. Among the highlights of our results, we note that there are 34 possible groups of symplectic automorphisms, with 6 maximal cases. The six maximal cases correspond to 8 non-isomorphic, and isolated in moduli, cubic fourfolds; six of them previously identified by other authors. Finally, the Fermat cubic fourfold has the largest possible order (174,960) for the automorphism group (non-necessarily symplectic) among all smooth cubic fourfolds.


title: Large-scale photonic Ising machine by spatial light modulation

abstract: Quantum and classical physics can be used for mathematical computations that are hard to tackle by conventional electronics. Very recently, optical Ising machines have been demonstrated for computing the minima of spin Hamiltonians, paving the way to new ultra-fast hardware for machine learning. However, the proposed systems are either tricky to scale or involve a limited number of spins. We design and experimentally demonstrate a large-scale optical Ising machine based on a simple setup with a spatial light modulator. By encoding the spin variables in a binary phase modulation of the field, we show that light propagation can be tailored to minimize an Ising Hamiltonian with spin couplings set by input amplitude modulation and a feedback scheme. We realize configurations with thousands of spins that settle in the ground state in a low-temperature ferromagnetic-like phase with all-to-all and tunable pairwise interactions. Our results open the route to classical and quantum photonic Ising machines that exploit light spatial degrees of freedom for parallel processing of a vast number of spins with programmable couplings.


title: Distributed Linear Model Clustering over Networks: A Tree-Based Fused-Lasso ADMM Approach

abstract: In this work, we consider to improve the model estimation efficiency by aggregating the neighbors' information as well as identify the subgroup membership for each node in the network. A tree-based $l_1$ penalty is proposed to save the computation and communication cost. We design a decentralized generalized alternating direction method of multiplier algorithm for solving the objective function in parallel. The theoretical properties are derived to guarantee both the model consistency and the algorithm convergence. Thorough numerical experiments are also conducted to back up our theory, which also show that our approach outperforms in the aspects of the estimation accuracy, computation speed and communication cost.

categories: stat.ML cs.DC cs.LG cs.NI math.ST stat.TH


title: Single-Net Continual Learning with Progressive Segmented Training (PST)

abstract: There is an increasing need of continual learning in dynamic systems, such as the self-driving vehicle, the surveillance drone, and the robotic system. Such a system requires learning from the data stream, training the model to preserve previous information and adapt to a new task, and generating a single-headed vector for future inference. Different from previous approaches with dynamic structures, this work focuses on a single network and model segmentation to prevent catastrophic forgetting. Leveraging the redundant capacity of a single network, model parameters for each task are separated into two groups: one important group which is frozen to preserve current knowledge, and secondary group to be saved (not pruned) for a future learning. A fixed-size memory containing a small amount of previously seen data is further adopted to assist the training. Without additional regularization, the simple yet effective approach of PST successfully incorporates multiple tasks and achieves the state-of-the-art accuracy in the single-head evaluation on CIFAR-10 and CIFAR-100 datasets. Moreover, the segmented training significantly improves computation efficiency in continual learning.


title: Room-temperature stability of excitons and transverse-electric polarized deep-ultraviolet luminescence in atomically thin GaN quantum wells

abstract: Quantum confinement profoundly affects the properties and interactions of electrons, holes, and excitons in nanomaterials. We apply first-principles calculations to study the effects of extreme quantum confinement on the electronic, excitonic, and radiative properties of atomically thin GaN quantum wells with a thickness of 1 to 4 atomic monolayers embedded in AlN. We determine the quasiparticle band gaps, exciton energies and wave functions, radiative lifetimes, and Mott critical densities as a function of well and barrier thickness. Our results show that quantum confinement in GaN monolayers increases the band gap up to 5.44 eV and the exciton binding energy up 215 meV, indicating the thermal stability of excitons at room temperature. Exciton radiative lifetimes range from 1 to 3 nanoseconds at room temperature, while the Mott critical density for exciton dissociation is approximately 10$^{13}$ cm$^{-2}$. The luminescence is transverse-electric polarized, which facilitates light extraction from c-plane heterostructures. We also introduce a simple approximate model for calculating the exciton radiative lifetime based on the free-carrier bimolecular radiative recombination coefficient and the exciton radius, which agrees well with our results obtained with the Bethe-Salpeter equation predictions. Our results demonstrate that atomically thin GaN quantum wells exhibit stable excitons at room temperature for potential applications in efficient light emitters in the deep ultraviolet, as well as room-temperature excitonic devices.


title: Visualizations of electric and magnetic interactions in ECD and ROA

abstract: The chiral source and its mechanism in the molecular system are of great significance in many fields. In this work, we proposed visualized methods to investigate physical mechanism of chiral molecule, where the electric and magnetic interactions are visualized with the transitional electric dipole moment, the transitional magnetic dipole moment and the transitional electric quadrupole moment, and their tensor product. The relationship between molecular ROA response and molecular structure was analyzed in an intuitive way. The relationship between chromophore chirality and molecular vibration mode are revealed via interaction between the transition electric dipole moment and the transition magnetic dipole moment. The molecular chirality is derived from the anisotropy of the molecular transition electric dipole moment and the transition magnetic dipole moment. The anisotropic dipole moment localized molecular chromophore is the source of the vibration mode in which the ROA responds to the reverse.


title: Target-Guided Open-Domain Conversation

abstract: Many real-world open-domain conversation applications have specific goals to achieve during open-ended chats, such as recommendation, psychotherapy, education, etc. We study the problem of imposing conversational goals on open-domain chat agents. In particular, we want a conversational system to chat naturally with human and proactively guide the conversation to a designated target subject. The problem is challenging as no public data is available for learning such a target-guided strategy. We propose a structured approach that introduces coarse-grained keywords to control the intended content of system responses. We then attain smooth conversation transition through turn-level supervised learning, and drive the conversation towards the target with discourse-level constraints. We further derive a keyword-augmented conversation dataset for the study. Quantitative and human evaluations show our system can produce meaningful and effective conversations, significantly improving over other approaches.


title: Electronic structure and $H$-$T$ phase diagram of Eu(Fe$_{1-x}$Rh$_x$)$_2$As$_2$

abstract: The iron-based superconductors represent a promising platform for high-temperature superconductivity, but the interactions underpinning their pairing present a puzzle. The EuFe$_2$As$_2$ family is unique among these materials for having magnetic order which onsets within the superconducting state, just below the superconducting transition. Superconductivity and magnetic order are normally antagonistic and often vie for the same unpaired electrons, but in this family the magnetism arises from largely localized Eu moments and they coexist, with the competition between these evenly-matched opponents leading to reentrant superconducting behavior. To help elucidate the physics in this family and the interactions between the magnetic order and superconductivity, we investigate the $H$--$T$ phase diagram near optimal Rh doping through specific heat, resistivity, and magnetization measurements, and study the electronic structure by angular-resolved photoemission spectroscopy. The competition between the Eu and FeAs layers may offer a route to directly accessing the electronic structure under effective magnetic fields via ARPES, which is ordinarily a strictly zero-field technique.


title: Robust Commitments and Partial Reputation

abstract: Agents rarely act in isolation -- their behavioral history, in particular, is public to others. We seek a non-asymptotic understanding of how a leader agent should shape this history to its maximal advantage, knowing that follower agent(s) will be learning and responding to it. We study Stackelberg leader-follower games with finite observations of the leader commitment, which commonly models security games and network routing in engineering, and persuasion mechanisms in economics. First, we formally show that when the game is not zero-sum and the vanilla Stackelberg commitment is mixed, it is not robust to observational uncertainty. We propose observation-robust, polynomial-time-computable commitment constructions for leader strategies that approximate the Stackelberg payoff, and also show that these commitment rules approximate the maximum obtainable payoff (which could in general be greater than the Stackelberg payoff).


title: On $\mathbb{Z}_2$-indices for ground states of fermionic chains

abstract: For parity-conserving fermionic chains, we review how to associate $\mathbb{Z}_2$-indices to ground states in finite systems with quadratic and higher-order interactions as well as to quasifree ground states on the infinite CAR algebra. It is shown that the $\mathbb{Z}_2$-valued spectral flow provides a topological obstruction for two systems to have the same $\mathbb{Z}_2$-index. A rudimentary definition of a $\mathbb{Z}_2$-phase label for a class of parity-invariant and pure ground states of the one-dimensional infinite CAR algebra is also provided. Ground states with differing phase labels cannot be connected without a closing of the spectral gap of the infinite GNS Hamiltonian.


title: Dynamics of transcendental H\'enon maps-II

abstract: Transcendental H\'enon maps are the natural extensions of the well investigated complex polynomial H\'enon maps to the much larger class of holomorphic automorphisms. We prove here that transcendental H\'enon maps always have non-trivial dynamical behavior, namely that they always admit both periodic and escaping orbits, and that their Julia sets are non-empty and perfect.


title: Leap-LSTM: Enhancing Long Short-Term Memory for Text Categorization

abstract: Recurrent Neural Networks (RNNs) are widely used in the field of natural language processing (NLP), ranging from text categorization to question answering and machine translation. However, RNNs generally read the whole text from beginning to end or vice versa sometimes, which makes it inefficient to process long texts. When reading a long document for a categorization task, such as topic categorization, large quantities of words are irrelevant and can be skipped. To this end, we propose Leap-LSTM, an LSTM-enhanced model which dynamically leaps between words while reading texts. At each step, we utilize several feature encoders to extract messages from preceding texts, following texts and the current word, and then determine whether to skip the current word. We evaluate Leap-LSTM on several text categorization tasks: sentiment analysis, news categorization, ontology classification and topic classification, with five benchmark data sets. The experimental results show that our model reads faster and predicts better than standard LSTM. Compared to previous models which can also skip words, our model achieves better trade-offs between performance and efficiency.


title: Road Segmentation with Image-LiDAR Data Fusion

abstract: Robust road segmentation is a key challenge in self-driving research. Though many image-based methods have been studied and high performances in dataset evaluations have been reported, developing robust and reliable road segmentation is still a major challenge. Data fusion across different sensors to improve the performance of road segmentation is widely considered an important and irreplaceable solution. In this paper, we propose a novel structure to fuse image and LiDAR point cloud in an end-to-end semantic segmentation network, in which the fusion is performed at decoder stage instead of at, more commonly, encoder stage. During fusion, we improve the multi-scale LiDAR map generation to increase the precision of the multi-scale LiDAR map by introducing pyramid projection method. Additionally, we adapted the multi-path refinement network with our fusion strategy and improve the road prediction compared with transpose convolution with skip layers. Our approach has been tested on KITTI ROAD dataset and has competitive performance.


title: Chiral spin liquid with spinon Fermi surfaces in spin-$1/2$ triangular Heisenberg model

abstract: We study the interplay of competing interactions in spin-$1/2$ triangular Heisenberg model through tuning the first- ($J_1$), second- ($J_2$), and third-neighbor ($J_3$) couplings. Based on large-scale density matrix renormalization group calculation, we identify a quantum phase diagram of the system and discover a new {\it gapless} chiral spin liquid (CSL) phase in the intermediate $J_2$ and $J_3$ regime. This CSL state spontaneously breaks time-reversal symmetry with finite scalar chiral order, and it has gapless excitations implied by a vanishing spin triplet gap and a finite central charge on the cylinder. Moreover, the central charge grows rapidly with the cylinder circumference, indicating emergent spinon Fermi surfaces. To understand the numerical results we propose a parton mean-field spin liquid state, the $U(1)$ staggered flux state, which breaks time-reversal symmetry with chiral edge modes by adding a Chern insulator mass to Dirac spinons in the $U(1)$ Dirac spin liquid. This state also breaks lattice rotational symmetries and possesses two spinon Fermi surfaces driven by nonzero $J_2$ and $J_3$, which naturally explains the numerical results. To our knowledge, this is the first example of a gapless CSL state with coexisting spinon Fermi surfaces and chiral edge states, demonstrating the rich family of novel phases emergent from competing interactions in triangular-lattice magnets.


title: XMM-Newton Spectrum of the magnetar CXOU J171405.7-381031

abstract: We observe the magnetar CXOU J171405.7-381031 with XMM-Newton and obtain the most reliable X-ray spectral parameters for this magnetar. After removing the flux from the surrounding supernova remnant CTB~37B, the radiation of CXOU J171405.7-381031 is best described by a two-component model, consisting of a blackbody and power law. We obtain a blackbody temperature of 0.58^{+0.03}_{-0.03} keV, photon index of 2.15^{+0.62}_{-0.68}, and unabsorbed 2-10 keV flux of 2.33^{+0.02}_{-0.02} x 10^{-12} erg cm^{-2} s^{-1}. These new parameters enable us to compare CXOU 171405.7-381031 with other magnetars, and it is found that the luminosity, temperature and the photon index of CXOU J171405.7-381031 are aligned with the known trend among the magnetar population with a slightly higher temperature, which could be caused by its young age. All the magnetars with a spin-down age of less than 1~kyr show time variation or bursts except for CXOU J171405.7-381031. We explore the time variability for ten observations in between 2006 and 2015, but there is no variation larger than \sim 10%.


title: Lorentz Violation and Riemann-Finsler Geometry

abstract: The general charge-conserving effective scalar field theory incorporating violations of Lorentz symmetry is presented. The dispersion relation is used to infer the effects of spin-independent Lorentz violation on point-particle motion. A large class of associated Finsler spaces is derived, and the properties of these spaces is explored.


title: Unsupervised End-to-End Learning of Discrete Linguistic Units for Voice Conversion

abstract: We present an unsupervised end-to-end training scheme where we discover discrete subword units from speech without using any labels. The discrete subword units are learned under an ASR-TTS autoencoder reconstruction setting, where an ASR-Encoder is trained to discover a set of common linguistic units given a variety of speakers, and a TTS-Decoder trained to project the discovered units back to the designated speech. We propose a discrete encoding method, Multilabel-Binary Vectors (MBV), to make the ASR-TTS autoencoder differentiable. We found that the proposed encoding method offers automatic extraction of speech content from speaker style, and is sufficient to cover full linguistic content in a given language. Therefore, the TTS-Decoder can synthesize speech with the same content as the input of ASR-Encoder but with different speaker characteristics, which achieves voice conversion (VC). We further improve the quality of VC using adversarial training, where we train a TTS-Patcher that augments the output of TTS-Decoder. Objective and subjective evaluations show that the proposed approach offers strong VC results as it eliminates speaker identity while preserving content within speech. In the ZeroSpeech 2019 Challenge, we achieved outstanding performance in terms of low bitrate.


title: Adversarially Robust Learning Could Leverage Computational Hardness

abstract: Over recent years, devising classification algorithms that are robust to adversarial perturbations has emerged as a challenging problem. In particular, deep neural nets (DNNs) seem to be susceptible to small imperceptible changes over test instances. However, the line of work in provable robustness, so far, has been focused on information-theoretic robustness, ruling out even the existence of any adversarial examples. In this work, we study whether there is a hope to benefit from algorithmic nature of an attacker that searches for adversarial examples, and ask whether there is any learning task for which it is possible to design classifiers that are only robust against polynomial-time adversaries. Indeed, numerous cryptographic tasks can only be secure against computationally bounded adversaries, and are indeed impossible for computationally unbounded attackers. Thus, it is natural to ask if the same strategy could help robust learning. We show that computational limitation of attackers can indeed be useful in robust learning by demonstrating the possibility of a classifier for some learning task for which computational and information theoretic adversaries of bounded perturbations have very different power. Namely, while computationally unbounded adversaries can attack successfully and find adversarial examples with small perturbation, polynomial time adversaries are unable to do so unless they can break standard cryptographic hardness assumptions. Our results, therefore, indicate that perhaps a similar approach to cryptography (relying on computational hardness) holds promise for achieving computationally robust machine learning. On the reverse directions, we also show that the existence of such learning task in which computational robustness beats information theoretic robustness requires computational hardness by implying (average-case) hardness of NP.


title: Spin-Orbit Torque in a Single Ferromagnetic Layer with Large Spin-Orbit Coupling

abstract: Spin-orbit torque in heavy metal/ferromagnet heterostructures with broken spatial inversion symmetry provides an efficient mechanism for manipulating magnetization using a charge current. Here, we report the presence of a spin torque in a single ferromagnetic layer in both asymmetric MgO/Fe0.8Mn0.2 and symmetric MgO/Fe0.8Mn0.2/MgO structures, which manifests itself in the form of an effective field transverse to the charge current. The current to effective field conversion efficiency, which is characterized using both the nonlinear magnetoresistance and second-order planar Hall effect methods, is comparable to the efficiency in typical heavy metal/ferromagnet bilayers. We argue that the torque is caused by spin rotation in the vicinity of the surface via impurity scattering in the presence of a strong spin-orbit coupling. Instead of cancelling off with each other, the torques from the top and bottom surfaces simply add up, leading to a fairly large net torque, which is readily observed experimentally.


title: Adaptive Reduced Rank Regression

abstract: We study the low rank regression problem $\my = M\mx + \epsilon$, where $\mx$ and $\my$ are $d_1$ and $d_2$ dimensional vectors respectively. We consider the extreme high-dimensional setting where the number of observations $n$ is less than $d_1 + d_2$. Existing algorithms are designed for settings where $n$ is typically as large as $\Rank(M)(d_1+d_2)$. This work provides an efficient algorithm which only involves two SVD, and establishes statistical guarantees on its performance. The algorithm decouples the problem by first estimating the precision matrix of the features, and then solving the matrix denoising problem. To complement the upper bound, we introduce new techniques for establishing lower bounds on the performance of any algorithm for this problem. Our preliminary experiments confirm that our algorithm often out-performs existing baselines, and is always at least competitive.


title: Case-Based Histopathological Malignancy Diagnosis using Convolutional Neural Networks

abstract: In practice, histopathological diagnosis of tumor malignancy often requires a human expert to scan through histopathological images at multiple magnification levels, after which a final diagnosis can be accurately determined. However, previous research on such classification tasks using convolutional neural networks primarily determine a diagnosis for a single magnification level. In this paper, we propose a case-based approach using deep residual neural networks for histopathological malignancy diagnosis, where a case is defined as a sequence of images from the patient at all available levels of magnification. Effectively, through mimicking what a human expert would actually do, our approach makes a diagnosis decision based on features learned in combination at multiple magnification levels. Our results show that the case-based approach achieves better performance than the state-of-the-art methods when evaluated on BreaKHis, a histopathological image dataset for breast tumors.


title: Zee Model with Flavor Dependent Global $U(1)$ Symmetry

abstract: We study a simple extension of the Zee model, in which a discrete $Z_2$ symmetry imposed in the original model is replaced by a global $U(1)$ symmetry retaining the same particle content. Due to the $U(1)$ symmetry with flavor dependent charge assignments, the lepton sector has an additional source of flavor violating Yukawa interactions with a controllable structure, while the quark sector does not at tree level. We show that current neutrino oscillation data can be explained under constraints from lepton flavor violating decays of charged leptons in a successful charge assignment of the $U(1)$ symmetry. In such scenario, we find a characteristic pattern of lepton flavor violating decays of additional Higgs bosons, which can be a smoking gun signature at collider experiments.


title: Amalgamating Filtered Knowledge: Learning Task-customized Student from Multi-task Teachers

abstract: Many well-trained Convolutional Neural Network(CNN) models have now been released online by developers for the sake of effortless reproducing. In this paper, we treat such pre-trained networks as teachers and explore how to learn a target student network for customized tasks, using multiple teachers that handle different tasks. We assume no human-labelled annotations are available, and each teacher model can be either single- or multi-task network, where the former is a degenerated case of the latter. The student model, depending on the customized tasks, learns the related knowledge filtered from the multiple teachers, and eventually masters the complete or a subset of expertise from all teachers. To this end, we adopt a layer-wise training strategy, which entangles the student's network block to be learned with the corresponding teachers. As demonstrated on several benchmarks, the learned student network achieves very promising results, even outperforming the teachers on the customized tasks.


title: Age Based Task Scheduling and Computation Offloading in Mobile-Edge Computing Systems

abstract: To support emerging real-time monitoring and control applications, the timeliness of computation results is of critical importance to mobile-edge computing (MEC) systems. We propose a performance metric called age of task (AoT) based on the concept of age of information (AoI), to evaluate the temporal value of computation tasks. In this paper, we consider a system consisting of a single MEC server and one mobile device running several applications. We study an age minimization problem by jointly considering task scheduling, computation offloading and energy consumption. To solve the problem efficiently, we propose a light-weight task scheduling and computation offloading algorithm. Through performance evaluation, we show that our proposed age-based solution is competitive when compared with traditional strategies.


title: Sustained biexciton emission in colloidal quantum wells assisted by dopant-host interaction

abstract: Biexcitons have been considered as one of the fundamental building blocks for quantum technology because of its overwhelming advantages in generating entangled photon pairs. Although many-body complexes have been demonstrated recently in mono-layer transition metal dichalcogenides (TMDs), the low emission efficiency and scale up capability hinder their applications. Colloidal nanomaterials, with high quantum efficiency and ease of synthesis/processing, are regarded to be an appealing complement to TMDs for biexciton sources. However, a progress towards biexciton emission in colloidal nanomaterials has been challenging largely by small binding energy and ultrafast non-radiative multiexciton recombination. Here, we demonstrate room-temperature biexciton emission in Cu-doped CdSe colloidal quantum wells (CQWs) under continuous-wave excitation with intensity as low as ~10 W/cm2. The characteristics of radiative biexciton states are investigated by their super linear emission with respect to excitation power, thermal stability and transient photophysics. The interaction between the quantum confined host carriers and the dopant ions increases biexciton binding energy by two folds compared to the undoped CQWs. Such strong binding energy together with suppressed Auger recombination and efficient, spectrally narrow photoluminescence in a quasi-2D semiconductor enables sustained biexciton emission at room temperature, providing a potential solution for efficient, scalable and stand-alone quantum devices.


title: On pseudorapidity distribution in p-Pb and Xe-Xe collisions at high energy based on the three-source Landau hydrodynamic model

abstract: The pseudorapidity distributions of charged particles produced in p-Pb collisions and Xe-Xe collisions at LHC energies are described by the revised Landau hydrodynamic model. The research results are in agreement with the experimental data measured by ALICE collaboration at LHC. The related parameters are obtained and analyzed. And, we extracted the values of the squared speed of sound for central source are between 0.4 and 0.5.


title: On the Complexity of Distributed Splitting Problems

abstract: One of the fundamental open problems in the area of distributed graph algorithms is the question of whether randomization is needed for efficient symmetry breaking. While there are fast, $\text{poly}\log n$-time randomized distributed algorithms for all of the classic symmetry breaking problems, for many of them, the best deterministic algorithms are almost exponentially slower. The following basic local splitting problem, which is known as the \emph{weak splitting} problem takes a central role in this context: Each node of a graph $G=(V,E)$ has to be colored red or blue such that each node of sufficiently large degree has at least one node of each color among its neighbors. Ghaffari, Kuhn, and Maus [STOC '17] showed that this seemingly simple problem is complete w.r.t. the above fundamental open question in the following sense: If there is an efficient $\text{poly}\log n$-time determinstic distributed algorithm for weak splitting, then there is such an algorithm for all locally checkable graph problems for which an efficient randomized algorithm exists. In this paper, we investigate the distributed complexity of weak splitting and some closely related problems. E.g., we obtain efficient algorithms for special cases of weak splitting, where the graph is nearly regular. In particular, we show that if $\delta$ and $\Delta$ are the minimum and maximum degrees of $G$ and if $\delta=\Omega(\log n)$, weak splitting can be solved deterministically in time $O\big(\frac{\Delta}{\delta}\cdot\text{poly}(\log n)\big)$. Further, if $\delta = \Omega(\log\log n)$ and $\Delta\leq 2^{\varepsilon\delta}$, there is a randomized algorithm with time complexity $O\big(\frac{\Delta}{\delta}\cdot\text{poly}(\log\log n)\big)$.


title: JGAN: A Joint Formulation of GAN for Synthesizing Images and Labels

abstract: Image generation with explicit condition or label generally works better than unconditional methods. In modern GAN frameworks, both generator and discriminator are formulated to model the conditional distribution of images given with labels. In this paper, we provide an alternative formulation of GAN which models the joint distribution of images and labels. There are two advantages in this joint formulation over conditional approaches. The first advantage is that the joint formulation is more robust to label noises if it's properly modeled. This alleviates the burden of making noise-free labels and allows the use of weakly-supervised labels in image generation. The second is that we can use any kinds of weak labels or image features that have correlations with the original image data to enhance unconditional image generation. We will show the effectiveness of our joint formulation on CIFAR10, CIFAR100, and STL dataset with the state-of-the-art GAN architecture.


title: Improving Action Localization by Progressive Cross-stream Cooperation

abstract: Spatio-temporal action localization consists of three levels of tasks: spatial localization, action classification, and temporal segmentation. In this work, we propose a new Progressive Cross-stream Cooperation (PCSC) framework to use both region proposals and features from one stream (i.e. Flow/RGB) to help another stream (i.e. RGB/Flow) to iteratively improve action localization results and generate better bounding boxes in an iterative fashion. Specifically, we first generate a larger set of region proposals by combining the latest region proposals from both streams, from which we can readily obtain a larger set of labelled training samples to help learn better action detection models. Second, we also propose a new message passing approach to pass information from one stream to another stream in order to learn better representations, which also leads to better action detection models. As a result, our iterative framework progressively improves action localization results at the frame level. To improve action localization results at the video level, we additionally propose a new strategy to train class-specific actionness detectors for better temporal segmentation, which can be readily learnt by focusing on "confusing" samples from the same action class. Comprehensive experiments on two benchmark datasets UCF-101-24 and J-HMDB demonstrate the effectiveness of our newly proposed approaches for spatio-temporal action localization in realistic scenarios.


title: Inversion symmetric non-Hermitian Chern insulator

abstract: We propose a two-dimensional non-Hermitian Chern insulator with inversion symmetry, which is anisotropic and has staggered gain and loss in both x and y directions. In this system, conventional bulk-boundary correspondence holds. The Chern number is a topological invariant that accurately predicts the topological phase transition and the existence of helical edge states in the topologically nontrivial gapped phase. In the gapless phase, the band touching points are isolated and protected by the symmetry. The degenerate points alter the system topology, and the exceptional points can destroy the existence of helical edge states. Topologically protected helical edge states exist in the gapless phase for the system under open boundary condition in one direction, which are predicted by the winding number associated with the vector field of average values of Pauli matrices. The winding number also identifies the detaching points between the edge states and the bulk states in the energy bands. The non-Hermiticity also supports a topological phase with zero Chern number, where a pair of in-gap helical edge states exists. Our findings provide insights into the symmetry protected non-Hermitian topological insulators.

categories: cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el quant-ph


title: Towards Interpretable Sparse Graph Representation Learning with Laplacian Pooling

abstract: Recent work in graph neural networks (GNNs) has led to improvements in molecular activity and property prediction tasks. Unfortunately, GNNs often fail to capture the relative importance of interactions between molecular substructures, in part due to the absence of efficient intermediate pooling steps. To address these issues, we propose LaPool (Laplacian Pooling), a novel, data-driven, and interpretable hierarchical graph pooling method that takes into account both node features and graph structure to improve molecular representation. We benchmark LaPool on molecular graph prediction and understanding tasks and show that it outperforms recent GNNs. Interestingly, LaPool also remains competitive on non-molecular tasks. Both quantitative and qualitative assessments are done to demonstrate LaPool's improved interpretability and highlight its potential benefits in drug design. Finally, we demonstrate LaPool's utility for the generation of valid and novel molecules by incorporating it into an adversarial autoencoder.


title: Circle graphs are quadratically $\chi$-bounded

abstract: We prove that the chromatic number of a circle graph with clique number $\omega$ is at most $7\omega^2$.


title: Topological approach for laser acceleration investigation

abstract: An approach using topology reveals a new understanding and knowledge of laser particle acceleration. Laser pulse irradiation on a thin-foil target is examined using two-dimensional particle-in-cell simulations. Through topology, laser ion acceleration schemes are classified depending on whether the deformed target shape after laser irradiation is homeomorphic with respect to the initial target. High energy ions are generated with high-efficiency when the deformed target shape is non-homeomorphic. In this case, the target thickness greatly affects the obtained ion energy. However, when the deformed target shape is homeomorphic, the obtained ion energy is low, and the effect of the target thickness is small.


title: A near-optimal algorithm for approximating the John Ellipsoid

abstract: We develop a simple and efficient algorithm for approximating the John Ellipsoid of a symmetric polytope. Our algorithm is near optimal in the sense that our time complexity matches the current best verification algorithm. We also provide the MATLAB code for further research.


title: Local Label Propagation for Large-Scale Semi-Supervised Learning

abstract: A significant issue in training deep neural networks to solve supervised learning tasks is the need for large numbers of labelled datapoints. The goal of semi-supervised learning is to leverage ubiquitous unlabelled data, together with small quantities of labelled data, to achieve high task performance. Though substantial recent progress has been made in developing semi-supervised algorithms that are effective for comparatively small datasets, many of these techniques do not scale readily to the large (unlaballed) datasets characteristic of real-world applications. In this paper we introduce a novel approach to scalable semi-supervised learning, called Local Label Propagation (LLP). Extending ideas from recent work on unsupervised embedding learning, LLP first embeds datapoints, labelled and otherwise, in a common latent space using a deep neural network. It then propagates pseudolabels from known to unknown datapoints in a manner that depends on the local geometry of the embedding, taking into account both inter-point distance and local data density as a weighting on propagation likelihood. The parameters of the deep embedding are then trained to simultaneously maximize pseudolabel categorization performance as well as a metric of the clustering of datapoints within each psuedo-label group, iteratively alternating stages of network training and label propagation. We illustrate the utility of the LLP method on the ImageNet dataset, achieving results that outperform previous state-of-the-art scalable semi-supervised learning algorithms by large margins, consistently across a wide variety of training regimes. We also show that the feature representation learned with LLP transfers well to scene recognition in the Places 205 dataset.


title: EncryptGAN: Image Steganography with Domain Transform

abstract: We propose an image steganographic algorithm called EncryptGAN, which disguises private image communication in an open communication channel. The insight is that content transform between two very different domains (e.g., face to flower) allows one to hide image messages in one domain (face) and communicate using its counterpart in another domain (flower). The key ingredient in our method, unlike related approaches, is a specially trained network to extract transformed images from both domains and use them as the public and private keys. We ensure the image communication remain secret except for the intended recipient even when the content transformation networks are exposed. To communicate, one directly pastes the `message' image onto a larger public key image (face). Depending on the location and content of the message image, the `disguise' image (flower) alters its appearance and shape while maintaining its overall objectiveness (flower). The recipient decodes the alternated image to uncover the original image message using its message image key. We implement the entire procedure as a constrained Cycle-GAN, where the public and the private key generating network is used as an additional constraint to the cycle consistency. Comprehensive experimental results show our EncryptGAN outperforms the state-of-arts in terms of both encryption and security measures.


title: Learning Efficient and Effective Exploration Policies with Counterfactual Meta Policy

abstract: A fundamental issue in reinforcement learning algorithms is the balance between exploration of the environment and exploitation of information already obtained by the agent. Especially, exploration has played a critical role for both efficiency and efficacy of the learning process. However, Existing works for exploration involve task-agnostic design, that is performing well in one environment, but be ill-suited to another. To the purpose of learning an effective and efficient exploration policy in an automated manner. We formalized a feasible metric for measuring the utility of exploration based on counterfactual ideology. Based on that, We proposed an end-to-end algorithm to learn exploration policy by meta-learning. We demonstrate that our method achieves good results compared to previous works in the high-dimensional control tasks in MuJoCo simulator.


title: Topological Superconductivity Intertwined with Broken Symmetries

abstract: Recently the superconductor and topological semimetal PbTaSe$_2$ was experimentally found to exhibit surface-only lattice rotational symmetry breaking below $T_c$. We exploit the Ginzburg-Landau free energy and propose a microscopic two-channel model to study possible superconducting states on the surface of PbTaSe$_2$. We identify two types of topological superconducting states. One is time-reversal invariant and preserves the lattice hexagonal symmetry while the other breaks both symmetries. We find that such time-reversal symmetry breaking is unavoidable for a superconducting state in a two dimensional irreducible representation of crystal point group in a system where the spatial inversion symmetry is broken and the strong spin-orbit coupling is present. Our findings will guide the search for topological chiral superconductors.


title: Questioning quark-gluon plasma formation in small collision systems

abstract: A recent letter published in the journal Nature reports observation at the relativistic heavy ion collider (RHIC) of quark-gluon plasma (QGP) formation in small asymmetric collision systems denoted as $p$-Au, $d$-Au and $^3$He-Au. The claimed phenomenon, described as `short-lived QGP droplets,' is inferred from a combination of Glauber Monte Carlo simulations, measurement of two azimuth Fourier amplitudes $v_2$ and $v_3$ and hydro theory calculations. While that claim follows a trend in recent years to report `signals' conventionally attributed to QGP as appearing also in smaller collision systems, the new result remains surprising in the context of expectations before first RHIC operation that small systems, e.g. $d$-Au collisions, would provide control experiments in which a QGP was unlikely to appear. An alternative interpretation of the recent RHIC result is that small-system control experiments do convey an important message: The `signals' conventionally attributed to QGP formation in larger A-A collisions do not actually represent that phenomenon in any system. The present study reviews a broad array of experimental evidence for or against QGP formation in several collision systems. It examines in particular hydro theory descriptions of spectra and correlations usually interpreted to support QGP formation. Available evidence suggests that data features conventionally attributed to QGP formation represent either minimum-bias jet production or a nonjet azimuth quadrupole with properties inconsistent with a hydro hypothesis.


title: Rare Failure Prediction via Event Matching for Aerospace Applications

abstract: In this paper, we consider a problem of failure prediction in the context of predictive maintenance applications. We present a new approach for rare failures prediction, based on a general methodology, which takes into account peculiar properties of technical systems. We illustrate the applicability of the method on the real-world test cases from aircraft operations.


title: Network intrusion detection systems for in-vehicle network - Technical report

abstract: Modern vehicles are complex safety critical cyber physical systems, that are connected to the outside world, with all security implications that brings. To enhance vehicle security several network intrusion detection systems (NIDS) have been proposed for the CAN bus, the predominant type of in-vehicle network. The in-vehicle CAN bus, however, is a challenging place to do intrusion detection as messages provide very little information; interpreting them requires specific knowledge about the implementation that is not readily available. In this technical report we collect how existing solutions address this challenge by providing an organized inventory of various CAN NIDSs present in the literature, categorizing them based on what information they extract from the network and how they build their model.


title: Estimating and Inferring the Maximum Degree of Stimulus-Locked Time-Varying Brain Connectivity Networks

abstract: Neuroscientists have enjoyed much success in understanding brain functions by constructing brain connectivity networks using data collected under highly controlled experimental settings. However, these experimental settings bear little resemblance to our real-life experience in day-to-day interactions with the surroundings. To address this issue, neuroscientists have been measuring brain activity under natural viewing experiments in which the subjects are given continuous stimuli, such as watching a movie or listening to a story. The main challenge with this approach is that the measured signal consists of both the stimulus-induced signal, as well as intrinsic-neural and non-neuronal signals. By exploiting the experimental design, we propose to estimate stimulus-locked brain network by treating non-stimulus-induced signals as nuisance parameters. In many neuroscience applications, it is often important to identify brain regions that are connected to many other brain regions during cognitive process. We propose an inferential method to test whether the maximum degree of the estimated network is larger than a pre-specific number. We prove that the type I error can be controlled and that the power increases to one asymptotically. Simulation studies are conducted to assess the performance of our method. Finally, we analyze a functional magnetic resonance imaging dataset obtained under the Sherlock Holmes movie stimuli.