title: On the Secrecy Performance of NOMA Systems with both External and Internal Eavesdroppers

abstract: Sharing resource blocks in NOMA systems provides more opportunity to the internal users to overhear the messages of the other users. Therefore, some sort of secrecy against the internal users in addition to the external eavesdroppers must be provided. In this paper, we investigate the secrecy performance of a two-user NOMA system in existence of the external and internal passive eavesdroppers, where the far user acts as an internal eavesdropper and tries to overhear the message of the near user. Our system consists of a single antenna base station, two legitimate users and an external passive eavesdropper. We present the closed-forms for the ergodic secrecy rates of the users. Moreover, to derive the secrecy outage probability (SOP) of the system, we use Gaussian-Chebyshev quadrature method, which gives an approximation for the SOP. Numerical results show that this approximation is very close to the exact value of the SOP of the system. Finally, we eliminate the external eavesdropper and present the closed-forms for the ergodic rate of the far user, the ergodic secrecy rate of the near user and also the SOP of the system.


title: Formalization of the Axiom of Choice and its Equivalent Theorems

abstract: In this paper, we describe the formalization of the axiom of choice and several of its famous equivalent theorems in Morse-Kelley set theory. These theorems include Tukey's lemma, the Hausdorff maximal principle, the maximal principle, Zermelo's postulate, Zorn's lemma and the well-ordering theorem. We prove the above theorems by the axiom of choice in turn, and finally prove the axiom of choice by Zermelo's postulate and the well-ordering theorem, thus completing the cyclic proof of equivalence between them. The proofs are checked formally using the Coq proof assistant in which Morse-Kelley set theory is formalized. The whole process of formal proof demonstrates that the Coq-based machine proving of mathematics theorem is highly reliable and rigorous. The formal work of this paper is enough for most applications, especially in set theory, topology and algebra.


title: Families of Toric Chemical Reaction Networks

abstract: We study families of chemical reaction networks whose positive steady states are toric, and therefore can be parameterized by monomials. Families are constructed algorithmically from a core network; we show that if a family member is multistationary, then so are all subsequent networks in the family. Further, we address the questions of model selection and experimental design for families by investigating the algebraic dependencies of the chemical concentrations using matroids. Given a family with toric steady states and a constant number of conservation relations, we construct a matroid that encodes important information regarding the steady state behaviour of the entire family. Among other things, this gives necessary conditions for the distinguishability of families of reaction networks with respect to a data set of measured chemical concentrations. We illustrate our results using multi-site phosphorylation networks.


title: A generalization of Heffter arrays

abstract: In this paper we define a new class of partially filled arrays, called relative Heffter arrays, that are a generalization of the Heffter arrays introduced by Archdeacon in 2015. Let $v=2nk+t$ be a positive integer, where $t$ divides $2nk$, and let $J$ be the subgroup of $\mathbb{Z}_v$ of order $t$. A $H_t(m,n; s,k)$ Heffter array over $\mathbb{Z}_v$ relative to $J$ is an $m\times n$ partially filled array with elements in $\mathbb{Z}_v$ such that: (a) each row contains $s$ filled cells and each column contains $k$ filled cells; (b) for every $x\in \mathbb{Z}_v\setminus J$, either $x$ or $-x$ appears in the array; (c) the elements in every row and column sum to $0$. Here we study the existence of square integer (i.e. with entries chosen in $\pm\left\{1,\dots,\left\lfloor \frac{2nk+t}{2}\right\rfloor \right\}$ and where the sums are zero in $\mathbb{Z}$) relative Heffter arrays for $t=k$, denoted by $H_k(n;k)$. In particular, we prove that for $3\leq k\leq n$, with $k\neq 5$, there exists an integer $H_k(n;k)$ if and only if one of the following holds: (a) $k$ is odd and $n\equiv 0,3\pmod 4$; (b) $k\equiv 2\pmod 4$ and $n$ is even; (c) $k\equiv 0\pmod 4$. Also, we show how these arrays give rise to cyclic cycle decompositions of the complete multipartite graph.


title: Dissipative quantum state preparation and metastability in two-photon micromasers

abstract: We study the preparation of coherent quantum states in a two-photon micromaser for applications in quantum metrology. While this setting can be in principle realized in a host of physical systems, we consider atoms interacting with the field of a cavity. We focus on the case of the interaction described by the Jaynes-Cummings Hamiltonian, which cannot be achieved by the conventional approach with three-level atoms coupled to the cavity field at two-photon resonance. We find that additional levels are required in order to cancel Stark shifts emerging in the leading order. Once this is accomplished, the dynamics of the cavity features a degenerate stationary state manifold of pure states. We derive the analytic form of these states and show that they include Schr\"odinger cat states with a tunable mean photon number. We also confirm these states can be useful in phase estimation protocols with their quantum Fisher information exceeding the standard limit. To account for realistic imperfections, we consider single-photon losses from the cavity, finite lifetime of atom levels, and higher order corrections in the far-detuned limit, which result in metastability of formerly stationary cavity states and long-time dynamics with a unique mixed stationary state. Despite being mixed, this stationary state can still feature quantum Fisher information above the standard limit. Our work delivers a comprehensive overview of the two-photon micromaser dynamics with particular focus on application in phase estimation and, while we consider the setup with atoms coupled to a cavity, the results can be directly translated to optomechanical systems.


title: Atmospheric muons as an imaging tool

abstract: Imaging methods based on the absorption or scattering of atmospheric muons, collectively named under the neologism "muography", exploit the abundant natural flux of muons produced from cosmic-ray interactions in the atmosphere. Recent years have seen a steep rise in the development of muography methods in a variety of innovative multidisciplinary approaches to study the interior of natural or man-made structures, establishing synergies between usually disconnected academic disciplines such as particle physics, geology, and archaeology. Muography also bears promise of immediate societal impact through geotechnical investigations, nuclear waste surveys, homeland security, and natural hazard monitoring. Our aim is to provide an introduction to this vibrant research area, starting from the physical principles at the basis of the methods and reviewing several recent developments in the application of muography methods to specific use cases, without any pretence of exhaustiveness. We then describe the main detector technologies and imaging methods, including their combination with conventional techniques from other disciplines, where appropriate. Finally, we discuss critically some outstanding issues that affect a broad variety of applications, and the current state of the art in addressing them.


title: Learned Sectors: A fundamentals-driven sector reclassification project

abstract: Market sectors play a key role in the efficient flow of capital through the modern Global economy. We analyze existing sectorization heuristics, and observe that the most popular - the GICS (which informs the S&P 500), and the NAICS (published by the U.S. Government) - are not entirely quantitatively driven, but rather appear to be highly subjective and rooted in dogma. Building on inferences from analysis of the capital structure irrelevance principle and the Modigliani-Miller theoretic universe conditions, we postulate that corporation fundamentals - particularly those components specific to the Modigliani-Miller universe conditions - would be optimal descriptors of the true economic domain of operation of a company. We generate a set of potential candidate learned sector universes by varying the linkage method of a hierarchical clustering algorithm, and the number of resulting sectors derived from the model (ranging from 5 to 19), resulting in a total of 60 candidate learned sector universes. We then introduce reIndexer, a backtest-driven sector universe evaluation research tool, to rank the candidate sector universes produced by our learned sector classification heuristic. This rank was utilized to identify the risk-adjusted return optimal learned sector universe as being the universe generated under CLINK (i.e. complete linkage), with 17 sectors. The optimal learned sector universe was tested against the benchmark GICS classification universe with reIndexer, outperforming on both absolute portfolio value, and risk-adjusted return over the backtest period. We conclude that our fundamentals-driven Learned Sector classification heuristic provides a superior risk-diversification profile than the status quo classification heuristic.


title: Centralizers of the superalgebra osp(1|2): the Brauer algebra as a quotient of the Bannai-Ito algebra

abstract: We provide an explicit isomorphism between a quotient of the Bannai--Ito algebra and the Brauer algebra. We clarify also the connection with the action of the Lie superalgebra osp(1|2) on the threefold tensor product of its fundamental representation. Finally, a conjecture is proposed to describe the centralizer of osp(1|2) acting on three copies of an arbitrary finite irreducible representation in terms of a quotient of the Bannai-Ito algebra.


title: Java Generics: An Order-Theoretic Approach (Detailed Outline)

abstract: Generics have been added to Java so as to increase the expressiveness of its type system. Generics in Java, however, include some features---such as Java wildcards, $F$-bounded generics, and Java erasure---that have been hard to analyze and reason about so far, reflecting the fact that the mathematical modeling of generics in Java and other similar nominally-typed object-oriented programming (OOP) languages is a challenge. As a result, the type systems of mainstream nominally-typed OOP languages, which are built based on current models of generics, are overly complex, which hinders the progress of these type systems. In this paper we present a detailed outline of a new approach to modeling Java generics that uses concepts and tools from order theory, and we report on our progress in developing this approach. Fundamentally, we use the nominal subclassing relation (as a partial order) together with some standard and novel order-theoretic tools to construct the generic nominal subtyping relation (as a partial order) and the containment relation between generic type arguments (a third partial order). We further analyze the relation between these three ordering relations---which lie at the heart of mainstream generic OO type systems---using order theoretic tools, and accordingly we explore extensions of OO type systems suggested by such analysis. In our approach we also make use of some concepts and tools from category theory. We believe a combined order-theoretic and category-theoretic approach to modeling generics holds the keys to overcoming much of the adversity found when analyzing features of generic OO type systems.


title: A rational approximation method for solving acoustic nonlinear eigenvalue problems

abstract: We present two approximation methods for computing eigenfrequencies and eigenmodes of large-scale nonlinear eigenvalue problems resulting from boundary element method (BEM) solutions of some types of acoustic eigenvalue problems in three-dimensional space. The main idea of the first method is to approximate the resulting boundary element matrix within a contour in the complex plane by a high accuracy rational approximation using the Cauchy integral formula. The second method is based on the Chebyshev interpolation within real intervals. A Rayleigh-Ritz procedure, which is suitable for parallelization is developed for both the Cauchy and the Chebyshev approximation methods when dealing with large-scale practical applications. The performance of the proposed methods is illustrated with a variety of benchmark examples and large-scale industrial applications with degrees of freedom varying from several hundred up to around two million.


title: Time to Die: Death Prediction in Dota 2 using Deep Learning

abstract: Esports have become major international sports with hundreds of millions of spectators. Esports games generate massive amounts of telemetry data. Using these to predict the outcome of esports matches has received considerable attention, but micro-predictions, which seek to predict events inside a match, is as yet unknown territory. Micro-predictions are however of perennial interest across esports commentators and audience, because they provide the ability to observe events that might otherwise be missed: esports games are highly complex with fast-moving action where the balance of a game can change in the span of seconds, and where events can happen in multiple areas of the playing field at the same time. Such events can happen rapidly, and it is easy for commentators and viewers alike to miss an event and only observe the following impact of events. In Dota 2, a player hero being killed by the opposing team is a key event of interest to commentators and audience. We present a deep learning network with shared weights which provides accurate death predictions within a five-second window. The network is trained on a vast selection of Dota 2 gameplay features and professional/semi-professional level match dataset. Even though death events are rare within a game (1\% of the data), the model achieves 0.377 precision with 0.725 recall on test data when prompted to predict which of any of the 10 players of either team will die within 5 seconds. An example of the system applied to a Dota 2 match is presented. This model enables real-time micro-predictions of kills in Dota 2, one of the most played esports titles in the world, giving commentators and viewers time to move their attention to these key events.


title: Predicting TED Talk Ratings from Language and Prosody

abstract: We use the largest open repository of public speaking---TED Talks---to predict the ratings of the online viewers. Our dataset contains over 2200 TED Talk transcripts (includes over 200 thousand sentences), audio features and the associated meta information including about 5.5 Million ratings from spontaneous visitors of the website. We propose three neural network architectures and compare with statistical machine learning. Our experiments reveal that it is possible to predict all the 14 different ratings with an average AUC of 0.83 using the transcripts and prosody features only. The dataset and the complete source code is available for further analysis.


title: Complex interpolation of vanishing Morrey spaces

abstract: We give the description of the first and second complex interpolation of vanishing Morrey spaces, introduced in \cite{AS, CF}. In addition, we show that the diamond subspace (see \cite{HNS}) and one of the function spaces in \cite{AS} are the same. We also give several examples for showing that each of the complex interpolation of these spaces is different.


title: Unique contributions to the scalar bispectrum in `just enough inflation'

abstract: A scalar field rolling down a potential with a large initial velocity results in inflation of a finite duration. Such a scenario suppresses the scalar power on large scales improving the fit to the cosmological data. We find that the scenario leads to a hitherto unexplored situation wherein the boundary terms dominate the contributions to the scalar bispectrum over the bulk terms. We show that the consistency relation governing the non-Gaussianity parameter $f_{_{\rm NL}}$ is violated on large scales and that the contributions at the initial time can substantially enhance the value of $f_{_{\rm NL}}$.


title: Constraints for nuclear PDFs from the LHCb D-meson data

abstract: We quantify the impact of LHCb D-meson measurements at $\sqrt{s}=5 \, {\rm TeV}$ on the EPPS16 and nCTEQ15 nuclear PDFs. In our study, the theoretical description of D-meson production is based on the recently developed SACOT-$m_{\rm T}$ variant of the general-mass variable-flavour-number formalism, and the impact on PDFs is estimated via reweighting methods. We pay special attention on the theoretical uncertainties known to us, and are led to exclude the $p_{\rm T}<3 \, {\rm GeV}$ region from our main analysis. The LHCb data can be accommodated well within EPPS16 and nCTEQ15, and the data provide stringent constraints on the gluons in the shadowing/antishadowing regions. No evidence of non-linear effects beyond standard DGLAP evolution is found even if the full kinematic region down to zero $p_{\rm T}$ is considered.


title: Solving Electrical Impedance Tomography with Deep Learning

abstract: This paper introduces a new approach for solving electrical impedance tomography (EIT) problems using deep neural networks. The mathematical problem of EIT is to invert the electrical conductivity from the Dirichlet-to-Neumann (DtN) map. Both the forward map from the electrical conductivity to the DtN map and the inverse map are high-dimensional and nonlinear. Motivated by the linear perturbative analysis of the forward map and based on a numerically low-rank property, we propose compact neural network architectures for the forward and inverse maps for both 2D and 3D problems. Numerical results demonstrate the efficiency of the proposed neural networks.


title: Coalescence for supercritical Galton-Watson processes with immigration

abstract: In this paper, we consider Galton-Watson processes with immigration. Pick $i(\ge2)$ individuals randomly without replacement from the $n$-th generation and trace their lines of descent back in time till they coalesce into $1$ individual in a certain generation, which we denote by $X_{i,1}^n$ and is called the coalescence time. Firstly, we give the probability distribution of $X_{i,1}^n$ in terms of the probability generating functions of both the offspring distribution and the immigration law. Then by studying the limit behaviors of various functionals of the Galton-Watson process with immigration, we find the limit distribution of $X_{2,1}^n$ as $n\rightarrow\infty.$


title: Site-resolved hyperfine and lattice dynamical properties of a single-crystal Fe3Si

abstract: A single-crystal sample of a DO3-ordered Fe3Si compound was studied by means of the 57Fe M\"ossbauer spectroscopy. Spectra have been recorded in a transmission geometry in the temperature range between 5 and 850 K. They have been analyzed either in terms of five sextets or five hyperfine field distribution curves. Concerning the former three sub spectra have been attributed to Fe atoms occupying the B sites and having 8Fe, 7Fe1Si and 6Fe2Si atoms in the first coordination shell (1NN), respectively, and two have been attributed to Fe atoms residing on the A and C sites and having 4Fe4Si and 3Fe5Si atoms in the 1NN, respectively. Based on the temperature dependence of the center shifts values the Debye temperature, T_D, have been determined. TD was found to be equal to 491 (11) K for the sites A and C, and to 403 (3) K the site B. The smaller value of T_D coincides with the smaller values of the hyperfine field, H. Changes in H caused by one Si atom present in the 1NN have been determined as ca.13 kOe for Fe atoms occupying the A and C sites and ca.54 kOe for Fe atoms present on the B sites. These changes have been also expressed in terms of the underlying number of polarized s-like electrons, dNs. For the Fe atoms situated on the A and C sites dNs=0.03 was found while for those occupying the B sites dNs=0.17.


title: Non-particle dark matter from Hubble parameter

abstract: The measurements of the Hubble parameter using the cosmic microwave background radiation appear to be inconsistent with the measurements of this parameter using Cepheid variable stars. This inconsistency may be a result of using the $\Lambda$CDM cosmology, which assumes pressureless dark matter, in extrapolating the data from the recombination time to the present time. We show that both measurements are consistent if dark matter satisfies an equation of state in which the pressure $p$ and the energy density $\epsilon$ are related by $p=w\epsilon$ with a negative value of $w$. The data give $w\approx -0.01$. The negative value of $w$ indicates that dark matter would not be formed by particles, which is consistent with the lack of experimental evidence for them.


title: Proposal for Anderson localization in transverse spatial degrees of freedom of photons

abstract: We propose an experimental setup for studying the Anderson localization of light in the continuous transverse spatial degrees of freedom of the photons. This physical phenomenon can be observed in the transverse profile of a paraxial and quasi-monochromatic beam of light using a spatial light modulator. The light modulator acts in the laser beam as a weak random potential. Here, differently from the standard models studied in the literature, our setup splits the dispersion and potential terms along the beam evolution. By numerical simulations we confirm the feasibility of our experimental proposal.


title: Intelligent Reflecting Surface vs. Decode-and-Forward: How Large Surfaces Are Needed to Beat Relaying?

abstract: The rate and energy efficiency of wireless channels can be improved by deploying software-controlled metasurfaces to reflect signals from the source to the destination, especially when the direct path is weak. While previous works mainly optimized the reflections, this letter compares the new technology with classic decode-and-forward (DF) relaying. The main observation is that very high rates and/or large metasurfaces are needed to outperform DF relaying, both in terms of minimizing the total transmit power and maximizing the energy efficiency, which also includes the dissipation in the transceiver hardware.


title: Domain-Specific Batch Normalization for Unsupervised Domain Adaptation

abstract: We propose a novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks. We aim to adapt to both domains by specializing batch normalization layers in convolutional neural networks while allowing them to share all other model parameters, which is realized by a two-stage algorithm. In the first stage, we estimate pseudo-labels for the examples in the target domain using an external unsupervised domain adaptation algorithm---for example, MSTN or CPUA---integrating the proposed domain-specific batch normalization. The second stage learns the final models using a multi-task classification loss for the source and target domains. Note that the two domains have separate batch normalization layers in both stages. Our framework can be easily incorporated into the domain adaptation techniques based on deep neural networks with batch normalization layers. We also present that our approach can be extended to the problem with multiple source domains. The proposed algorithm is evaluated on multiple benchmark datasets and achieves the state-of-the-art accuracy in the standard setting and the multi-source domain adaption scenario.


title: SCAN: A Scalable Neural Networks Framework Towards Compact and Efficient Models

abstract: Remarkable achievements have been attained by deep neural networks in various applications. However, the increasing depth and width of such models also lead to explosive growth in both storage and computation, which has restricted the deployment of deep neural networks on resource-limited edge devices. To address this problem, we propose the so-called SCAN framework for networks training and inference, which is orthogonal and complementary to existing acceleration and compression methods. The proposed SCAN firstly divides neural networks into multiple sections according to their depth and constructs shallow classifiers upon the intermediate features of different sections. Moreover, attention modules and knowledge distillation are utilized to enhance the accuracy of shallow classifiers. Based on this architecture, we further propose a threshold controlled scalable inference mechanism to approach human-like sample-specific inference. Experimental results show that SCAN can be easily equipped on various neural networks without any adjustment on hyper-parameters or neural networks architectures, yielding significant performance gain on CIFAR100 and ImageNet. Codes will be released on github soon.


title: Multimodal Logical Inference System for Visual-Textual Entailment

abstract: A large amount of research about multimodal inference across text and vision has been recently developed to obtain visually grounded word and sentence representations. In this paper, we use logic-based representations as unified meaning representations for texts and images and present an unsupervised multimodal logical inference system that can effectively prove entailment relations between them. We show that by combining semantic parsing and theorem proving, the system can handle semantically complex sentences for visual-textual inference.


title: Global smooth solutions of the 3D Hall-magnetohydrodynamic equations with large data

abstract: In this paper, we establish the global existence to the three-dimensional incompressible Hall-MHD equations for a class of large initial data, whose $L^{\infty}$ norms can be arbitrarily large. In addition , we give an example to show that such a large initial value does exist. Our idea is splitting the generalized heat equations from Hall-MHD system to generate a small quantity for large time $t$.


title: Morse theory for the Yang-Mills energy function near flat connections

abstract: A result (Corollary 4.3) in an article by Uhlenbeck (1985) asserts that the $W^{1,p}$-distance between the gauge-equivalence class of a connection $A$ and the moduli subspace of flat connections $M(P)$ on a principal $G$-bundle $P$ over a closed Riemannian manifold $X$ of dimension $d\geq 2$ is bounded by a constant times the $L^p$ norm of the curvature, $\|F_A\|_{L^p(X)}$, when $G$ is a compact Lie group, $F_A$ is $L^p$-small, and $p>d/2$. While we prove that this estimate holds when the Yang-Mills energy function on the space of Sobolev connections is Morse-Bott along the moduli subspace $M(P)$ of flat connections, it does not hold when the Yang-Mills energy function fails to be Morse-Bott, such as at the product connection in the moduli space of flat $\mathrm{SU}(2)$ connections over a real two-dimensional torus. However, we prove that a useful modification of Uhlenbeck's estimate always holds provided one replaces $\|F_A\|_{L^p(X)}$ by a suitable power $\|F_A\|_{L^p(X)}^\lambda$, where the positive exponent $\lambda$ reflects the structure of non-regular points in $M(P)$. The proof of our refinement involves gradient flow and Morse theory for the Yang-Mills energy function on the quotient space of Sobolev connections and a Lojasiewicz distance inequality for the Yang-Mills energy function. A special case of our estimate, when $X$ has dimension four and the connection $A$ is anti-self-dual, was proved by Fukaya (1998) by entirely different methods. Lastly, we prove that if $A$ is a smooth Yang-Mills connection with small enough energy, then $A$ is necessarily flat.


title: Best-First Width Search for Multi Agent Privacy-preserving Planning

abstract: In multi-agent planning, preserving the agents' privacy has become an increasingly popular research topic. For preserving the agents' privacy, agents jointly compute a plan that achieves mutual goals by keeping certain information private to the individual agents. Unfortunately, this can severely restrict the accuracy of the heuristic functions used while searching for solutions. It has been recently shown that, for centralized planning, the performance of goal oriented search can be improved by combining goal oriented search and width-based search. The combination of these techniques has been called best-first width search. In this paper, we investigate the usage of best-first width search in the context of (decentralised) multi-agent privacy-preserving planning, addressing the challenges related to the agents' privacy and performance. In particular, we show that best-first width search is a very effective approach over several benchmark domains, even when the search is driven by heuristics that roughly estimate the distance from goal states, computed without using the private information of other agents. An experimental study analyses the effectiveness of our techniques and compares them with the state-of-the-art.


title: Topological Data Analysis of Time Series Data for B2B Customer Relationship Management

abstract: Topological Data Analysis (TDA) is a recent approach to analyze data sets from the perspective of their topological structure. Its use for time series data has been limited to the field of financial time series primarily and as a method for feature generation in machine learning applications. In this work, TDA is presented as a technique to gain additional understanding of the customers' loyalty for business-to-business customer relationship management. Increasing loyalty and strengthening relationships with key accounts remain an active topic of discussion both for researchers and managers. Using two public and two proprietary data sets of commercial data, this research shows that the technique enables analysts to better understand their customer base and identify prospective opportunities. In addition, the approach can be used as a clustering method to increase the accuracy of a predictive model for loyalty scoring. This work thus seeks to introduce TDA as a viable tool for data analysis to the quantitate marketing practitioner.


title: Type-Driven Automated Learning with Lale

abstract: Machine-learning automation tools, ranging from humble grid-search to hyperopt, auto-sklearn, and TPOT, help explore large search spaces of possible pipelines. Unfortunately, each of these tools has a different syntax for specifying its search space, leading to lack of portability, missed relevant points, and spurious points that are inconsistent with error checks and documentation of the searchable base components. This paper proposes using types (such as enum, float, or dictionary) both for checking the correctness of, and for automatically searching over, hyperparameters and pipeline configurations. Using types for both of these purposes guarantees consistency. We present Lale, an embedded language that resembles scikit learn but provides better automation, correctness checks, and portability. Lale extends the reach of existing automation tools across data modalities (tables, text, images, time-series) and programming languages (Python, Java, R). Thus, data scientists can leverage automation while remaining in control of their work.


title: Parallel scalable simulations of biological neural networks using TensorFlow: A beginner's guide

abstract: Biological neural networks are often modeled as systems of coupled, nonlinear, ordinary or partial differential equations. The number of differential equations used to model a network increases with the size of the network and the level of detail used to model individual neurons and synapses. As one scales up the size of the simulation, it becomes essential to utilize powerful computing platforms. While many tools exist that solve these equations numerically, they are often platform-specific. Further, there is a high barrier of entry to developing flexible platform-independent general-purpose code that supports hardware acceleration on modern computing architectures such as GPUs/TPUs and Distributed Platforms. TensorFlow is a Python-based open-source package designed for machine learning algorithms. However, it is also a scalable environment for a variety of computations, including solving differential equations using iterative algorithms such as Runge-Kutta methods. In this article and the accompanying tutorials, we present a simple exposition of numerical methods to solve ordinary differential equations using Python and TensorFlow. The tutorials consist of a series of Python notebooks that, over the course of five sessions, will lead novice programmers from writing programs to integrate simple one-dimensional ordinary differential equations using Python to solving a large system (1000's of differential equations) of coupled conductance-based neurons using a highly parallelized and scalable framework. Embedded with the tutorial is a physiologically realistic implementation of a network in the insect olfactory system. This system, consisting of multiple neuron and synapse types, can serve as a template to simulate other networks.


title: Exploration and Exploitation in Symbolic Regression using Quality-Diversity and Evolutionary Strategies Algorithms

abstract: By combining Genetic Programming, MAP-Elites and Covariance Matrix Adaptation Evolution Strategy, we demonstrate very high success rates in Symbolic Regression problems. MAP-Elites is used to improve exploration while preserving diversity and avoiding premature convergence and bloat. Then, a Covariance Matrix Adaptation-Evolution Strategy is used to evaluate free scalars through a non-gradient-based black-box optimizer. Although this evaluation approach is not computationally scalable to high dimensional problems, our algorithm is able to find exactly most of the $31$ targets extracted from the literature on which we evaluate it.


title: Distributive biracks and solutions of the Yang-Baxter equation

abstract: We investigate a class of non-involutive solutions of the Yang-Baxter equation which generalize self-distributive (derived) solutions. In particular, we study generalized multipermutation solutions in this class. We show that the Yang-Baxter (permutation) groups of such solutions are nilpotent. We formulate the results in the language of biracks.


title: Quantum oscillation of thermal conductivity and violation of Weidemann-Franz law in TaAs$_2$ and NbAs$_2$

abstract: We report a study of thermal conductivity and resistivity at ultra-low temperatures and in high magnetic fields for semi-metal materials TaAs$_2$ and NbAs$_2$ by using single crystal samples. The thermal conductivity is strongly suppressed in magnetic fields, having good correspondence with the large positive magnetoresistance, which indicates a dominant electronic contribution to thermal conductivity. In addition, not only the resistivity but also the thermal conductivity display clear quantum oscillations behavior at subKelvin temperatures and in magnetic fields up to 14 T. The most striking phenomenon is that the thermal conductivity show a $T^4$ behavior at very low temperatures, while the resistivity show a $T$-independent behavior. This indicates a strong violation of the Weidemann-Franz law and points to a non-Feimi liquid state of these materials.


title: Coupled Optoelectronic Simulation and Optimization of Thin-Film Photovoltaic Solar Cells

abstract: A design tool was formulated for optimizing the efficiency of inorganic, thin-film, photovoltaic solar cells. The solar cell can have multiple semiconductor layers in addition to antireflection coatings, passivation layers, and buffer layers. The solar cell is backed by a metallic grating which is periodic along a fixed direction. The rigorous coupled-wave approach is used to calculate the electron-hole-pair generation rate. The hybridizable discontinuous Galerkin method is used to solve the drift-diffusion equations that govern charge-carrier transport in the semiconductor layers. The chief output is the solar-cell efficiency which is maximized using the differential evolution algorithm to determine the optimal dimensions and bandgaps of the semiconductor layers.


title: FaRM: Fair Reward Mechanism for Information Aggregation in Spontaneous Localized Settings (Extended Version)

abstract: Although peer prediction markets are widely used in crowdsourcing to aggregate information from agents, they often fail to reward the participating agents equitably. Honest agents can be wrongly penalized if randomly paired with dishonest ones. In this work, we introduce \emph{selective} and \emph{cumulative} fairness. We characterize a mechanism as fair if it satisfies both notions and present FaRM, a representative mechanism we designed. FaRM is a Nash incentive mechanism that focuses on information aggregation for spontaneous local activities which are accessible to a limited number of agents without assuming any prior knowledge of the event. All the agents in the vicinity observe the same information. FaRM uses \textit{(i)} a \emph{report strength score} to remove the risk of random pairing with dishonest reporters, \textit{(ii)} a \emph{consistency score} to measure an agent's history of accurate reports and distinguish valuable reports, \textit{(iii)} a \emph{reliability score} to estimate the probability of an agent to collude with nearby agents and prevents agents from getting swayed, and \textit{(iv)} a \emph{location robustness score} to filter agents who try to participate without being present in the considered setting. Together, report strength, consistency, and reliability represent a fair reward given to agents based on their reports.


title: Diffusion regions and 3D energy mode development in spontaneous reconnection

abstract: The understanding of magnetic reconnection in three-dimension (3D) is far shallower than its counterpart in two-dimension (2D) due to its potential complication, not to mention the evolving of the spontaneously growing turbulence. We investigate the reason for reconnection acceleration on the characters and development of diffusion regions and sheared 3D energy modes (energy modes that are not parallel to the anti-parallel magnetic fields) during the turbulence building stage. We found that multiple reconnection layers emerge due to the growth of 3D sheared tearing instability. Diffusion regions on adjacent reconnection layers form an inflow-outflow coupling that enhances the local reconnection. Further coupling of the existing energy modes breeds new energy modes near the current sheet edge. As reconnection layers span and interact with each other across the whole current sheet, global magnetic energy consumption accelerates. The significant contribution of 3D energy modes and their interaction to the reconnection rate enhancement seems to be independent on magnetic diffusivity. On the other hand, the global guide field changes the layout of 3D reconnection layer thus determines whether the system is fast-reconnection-preferable.


title: Gain Stabilization for Radio Intensity Mapping using a Continuous-Wave Reference Signal

abstract: Stabilizing the gain of a radio astronomy receiver is of great importance for sensitive radio intensity mapping. In this paper we discuss a stabilization method using a continuous-wave reference signal injected into the signal chain and tracked in a single channel of the spectrometer to correct for the gain variations of the receiver. This method depends on the fact that gain fluctuations of the receiver are strongly correlated across the frequency band, which we can show is the case for our experimental setup. This method is especially suited for receivers with a digital back-end with high spectral resolution and moderate dynamic range. The sensitivity of the receiver is unaltered except for one lost frequency channel. We present experimental results using a new 4-8.5 GHz receiver with a digital back-end that shows substantial reduction of the 1/ f noise and the 1/ f knee frequency.


title: Percolation of aligned rigid rods on two-dimensional triangular lattices

abstract: The percolation behavior of aligned rigid rods of length $k$ ($k$-mers) on two-dimensional triangular lattices has been studied by numerical simulations and finite-size scaling analysis. The $k$-mers, containing $k$ identical units (each one occupying a lattice site), were irreversibly deposited along one of the directions of the lattice. The connectivity analysis was carried out by following the probability $R_{L,k}(p)$ that a lattice composed of $L \times L$ sites percolates at a concentration $p$ of sites occupied by particles of size $k$. The results, obtained for $k$ ranging from 2 to 80, showed that the percolation threshold $p_c(k)$ exhibits a increasing function when it is plotted as a function of the $k$-mer size. The dependence of $p_c(k)$ was determined, being $p_c(k)=A+B/(C+\sqrt{k})$, where $A = p_c(k \rightarrow \infty)= 0.582(9)$ is the value of the percolation threshold by infinitely long $k$-mers, $B =-0.47(0.21)$ and $C = 5.79(2.18)$. This behavior is completely different to that observed for square lattices, where the percolation threshold decreases with $k$. In addition, the effect of the anisotropy on the properties of the percolating phase was investigated. The results revealed that, while for finite systems the anisotropy of the deposited layer favors the percolation along the parallel direction to the nematic axis, in the thermodynamic limit, the value of the percolation threshold is the same in both parallel and transversal directions. Finally, an exhaustive study of critical exponents and universality was carried out, showing that the phase transition occurring in the system belongs to the standard random percolation universality class regardless of the value of $k$ considered.


title: Autonomous Goal Exploration using Learned Goal Spaces for Visuomotor Skill Acquisition in Robots

abstract: The automatic and efficient discovery of skills, without supervision, for long-living autonomous agents, remains a challenge of Artificial Intelligence. Intrinsically Motivated Goal Exploration Processes give learning agents a human-inspired mechanism to sequentially select goals to achieve. This approach gives a new perspective on the lifelong learning problem, with promising results on both simulated and real-world experiments. Until recently, those algorithms were restricted to domains with experimenter-knowledge, since the Goal Space used by the agents was built on engineered feature extractors. The recent advances of deep representation learning, enables new ways of designing those feature extractors, using directly the agent experience. Recent work has shown the potential of those methods on simple yet challenging simulated domains. In this paper, we present recent results showing the applicability of those principles on a real-world robotic setup, where a 6-joint robotic arm learns to manipulate a ball inside an arena, by choosing goals in a space learned from its past experience.


title: Plasmon localization and relaxation, and thermal transport in one-dimensional conductors

abstract: We study the localization and decay properties as well as the thermal conductance of one-dimensional plasmons. Our model contains a Luttinger-liquid part with spatially random plasmon velocity and interaction parameter as well as a nonlinearity that is cubic in density. The scaling of the decay rate of plasmons is obtained in several regimes. At sufficiently high frequencies, it describes the inelastic life time of localized plasmon excitations that crosses over to the clean result with lowering frequencies. For higher frequencies, we analyze implications of many-body-localization effects that lead to a suppression of the decay rate. We find that the thermal conductance depends in a non-trivial fashion on the system size $L$. Specifically, it scales as $L^{-1/2}$ for sufficiently short wires and crosses over to $L^{-2/3}$ scaling for longer wires.


title: Datalog Disassembly

abstract: Disassembly is fundamental to binary analysis and rewriting. We present a novel disassembly technique that takes a stripped binary and produces reassembleable assembly code. The resulting assembly code has accurate symbolic information, providing cross-references for analysis and to enable adjustment of code and data pointers to accommodate rewriting. Our technique features multiple static analyses and heuristics in a combined Datalog implementation. We argue that Datalog's inference process is particularly well suited for disassembly and the required analyses. Our implementation and experiments support this claim. We have implemented our approach into an open-source tool called Ddisasm. In extensive experiments in which we rewrite thousands of x64 binaries we find Ddisasm is both faster and more accurate than the current state-of-the-art binary reassembling tool, Ramblr.


title: A scheme for dynamically integrating C library functions into a $\lambda$Prolog implementation

abstract: The Teyjus system realizes the higher-order logic programming language$\lambda$Prolog by compiling programs into bytecode for an abstract machine and executing this translated form using a simulator for the machine. Teyjus supports a number of builtin relations that are realized through C code. In the current scheme, these relations are realized by including the C programs that implement them within the simulator and tailoring the compiler to produce instructions to invoke such code. There are two drawbacks to such an approach. First, the entire collection of library functions must be included within the system, thereby leading to a larger than necessary memory footprint. Second, enhancing the collection of built-in predicates requires changing parts of the simulator and compiler, a task whose accomplishment requires specific knowledge of these two subsystems. This project addresses these problems in three steps. First, the code for the builtin functions is moved from the simulator into a library from where relevant parts, determined by information in the bytecode file, are linked into the runtime system at load time. Second, information is associated with each library function about how it can be invoked from a $\lambda$Prolog program and where the C code for it is to be found. Finally, the compiler is modified to use the preceding information to include relevant linking instructions in the bytecode file and to translate invocations to builtin relations into a special instruction that calls the dynamically linked code. More generally, these ideas are capable of supporting an interface in $\lambda$Prolog to "foreign functions" implemented in C, a possibility that is also discussed.


title: Global existence of weak solutions to the compressible quantum Navier-Stokes equations with degenerate viscosity

abstract: We study the compressible quantum Navier-Stokes (QNS) equations with degenerate viscosity in the three dimensional periodic domains. On the one hand, we consider QNS with additional damping terms. Motivated by the recent works [Li-Xin, arXiv:1504.06826] and [Antonelli-Spirito, Arch. Ration. Mech. Anal., 203(2012), 499--527], we construct a suitable approximate system which has smooth solutions satisfying the energy inequality and the BD entropy estimate. Using this system, we obtain the global existence of weak solutions to the compressible QNS equations with damping terms for large initial data. Moreover, we obtain some new a priori estimates, which can avoid using the assumption that the gradient of the velocity is a well-defined function, which is indeed used directly in [Vasseur-Yu, SIAM J. Math. Anal., 48 (2016), 1489--1511; Invent. Math., 206 (2016), 935--974]. On the other hand, in the absence of damping terms, we also prove the global existence of weak solutions to the compressible QNS equations without the lower bound assumption on the dispersive coefficient, which improves the previous result due to [Antonelli-Spirito, Arch. Ration. Mech. Anal., 203(2012), 499--527].


title: Evaluating the Robustness of Nearest Neighbor Classifiers: A Primal-Dual Perspective

abstract: We study the problem of computing the minimum adversarial perturbation of the Nearest Neighbor (NN) classifiers. Previous attempts either conduct attacks on continuous approximations of NN models or search for the perturbation by some heuristic methods. In this paper, we propose the first algorithm that is able to compute the minimum adversarial perturbation. The main idea is to formulate the problem as a list of convex quadratic programming (QP) problems that can be efficiently solved by the proposed algorithms for 1-NN models. Furthermore, we show that dual solutions for these QP problems could give us a valid lower bound of the adversarial perturbation that can be used for formal robustness verification, giving us a nice view of attack/verification for NN models. For $K$-NN models with larger $K$, we show that the same formulation can help us efficiently compute the upper and lower bounds of the minimum adversarial perturbation, which can be used for attack and verification.


title: E-LPIPS: Robust Perceptual Image Similarity via Random Transformation Ensembles

abstract: It has been recently shown that the hidden variables of convolutional neural networks make for an efficient perceptual similarity metric that accurately predicts human judgment on relative image similarity assessment. First, we show that such learned perceptual similarity metrics (LPIPS) are susceptible to adversarial attacks that dramatically contradict human visual similarity judgment. While this is not surprising in light of neural networks' well-known weakness to adversarial perturbations, we proceed to show that self-ensembling with an infinite family of random transformations of the input --- a technique known not to render classification networks robust --- is enough to turn the metric robust against attack, while retaining predictive power on human judgments. Finally, we study the geometry imposed by our our novel self-ensembled metric (E-LPIPS) on the space of natural images. We find evidence of "perceptual convexity" by showing that convex combinations of similar-looking images retain appearance, and that discrete geodesics yield meaningful frame interpolation and texture morphing, all without explicit correspondences.


title: Lattice QCD Method To Study Proton Spin Crisis

abstract: The proton spin crisis remains an unsolved problem in particle physics. The spin and angular momentum of the partons inside the proton are non-perturbative quantities in QCD which cannot be calculated by using the perturbative QCD (pQCD). In this paper we present the lattice QCD formulation to study the proton spin crisis. We derive the non-perturbative formula of the spin and angular momentum of the partons inside the proton from the first principle in QCD which can be calculated by using the lattice QCD method.


title: Predicting Global Variations in Outdoor PM2.5 Concentrations using Satellite Images and Deep Convolutional Neural Networks

abstract: Here we present a new method of estimating global variations in outdoor PM$_{2.5}$ concentrations using satellite images combined with ground-level measurements and deep convolutional neural networks. Specifically, new deep learning models were trained over the global PM$_{2.5}$ concentration range ($<$1-436 $\mu$g/m$^3$) using a large database of satellite images paired with ground level PM$_{2.5}$ measurements available from the World Health Organization. Final model selection was based on a systematic evaluation of well-known architectures for the convolutional base including InceptionV3, Xception, and VGG16. The Xception architecture performed best and the final global model had a root mean square error (RMSE) value of 13.01 $\mu$g/m$^3$ (R$^2$=0.75) in the disjoint test set. The predictive performance of our new global model (called IMAGE-PM$_{2.5}$) is similar to the current state-of-the-art model used in the Global Burden of Disease study but relies only on satellite images as input. As a result, the IMAGE-PM$_{2.5}$ model offers a fast, cost-effective means of estimating global variations in long-term average PM$_{2.5}$ concentrations and may be particularly useful for regions without ground monitoring data or detailed emissions inventories. The IMAGE-PM$_{2.5}$ model can be used as a stand-alone method of global exposure estimation or incorporated into more complex hierarchical model structures.


title: A higher speed type II blowup for the five dimensional energy critical heat equation

abstract: This paper is concerned with blow-up solutions of the five dimensional energy critical heat equation $u_t=\Delta u+|u|^\frac{4}{3}u$. A goal of this paper is to show the existence of type II blowup solutions which behave as $\|u(t)\|_\infty\sim(T-t)^{-3k}$ ($k=2,3,\cdots$). Our solutions are the same one formally derived by Filippas, Herrero and Vel\'azquez \cite{Filippas}.


title: Command of Collective Dynamics by Topological Defects in Spherical Crystals

abstract: Directing individual motions of many constituents to coherent dynamical state is a fundamental challenge in multiple fields. Here, based on the spherical crystal model, we show that topological defects in particle arrays can be a crucial element in regulating collective dynamics. Specifically, we highlight the defect-driven synchronized breathing modes around disclinations and collective oscillations with strong connection to disruption of crystalline order. This work opens the promising possibility of an organizational principle based on topological defects, and may inspire new strategies for harnessing intriguing collective dynamics in extensive nonequilibrium systems.


title: STAMINA: STochastic Approximate Model-checker for INfinite-state Analysis

abstract: Stochastic model checking is a technique for analyzing systems that possess probabilistic characteristics. However, its scalability is limited as probabilistic models of real-world applications typically have very large or infinite state space. This paper presents a new infinite state CTMC model checker, STAMINA, with improved scalability. It uses a novel state space approximation method to reduce large and possibly infinite state CTMC models to finite state representations that are amenable to existing stochastic model checkers. It is integrated with a new property-guided state expansion approach that improves the analysis accuracy. Demonstration of the tool on several benchmark examples shows promising results in terms of analysis efficiency and accuracy compared with a state-of-the-art CTMC model checker that deploys a similar approximation method.


title: Optimal Exploitation of Clustering and History Information in Multi-Armed Bandit

abstract: We consider the stochastic multi-armed bandit problem and the contextual bandit problem with historical observations and pre-clustered arms. The historical observations can contain any number of instances for each arm, and the pre-clustering information is a fixed clustering of arms provided as part of the input. We develop a variety of algorithms which incorporate this offline information effectively during the online exploration phase and derive their regret bounds. In particular, we develop the META algorithm which effectively hedges between two other algorithms: one which uses both historical observations and clustering, and another which uses only the historical observations. The former outperforms the latter when the clustering quality is good, and vice-versa. Extensive experiments on synthetic and real world datasets on Warafin drug dosage and web server selection for latency minimization validate our theoretical insights and demonstrate that META is a robust strategy for optimally exploiting the pre-clustering information.


title: Mass-energy equivalence in harmonically trapped particles

abstract: Precise understanding of the dynamics of trapped particles is crucial for nascent quantum technologies, including atomic clocks and quantum simulators. Here we present a framework to systematically include quantum effects arising from the mass-energy equivalence in harmonically trapped systems. We find that the mass-energy equivalence leads to squeezing, displacement and frequency changes of harmonic modes associated with different internal energies. The framework predicts new phenomena, notably, the existence of a lower bound to the fractional frequency shift in atomic clocks arising from the interplay between gravitational effects and so-called time dilation shifts. Analogous effects will arise in other trapping potentials, especially in periodic lattices, and may play a role in correlation dynamics and thermalisation process in many-body systems and cold gases.


title: Nonlinear normal modes in the $\beta$-Fermi-Pasta-Ulam-Tsingou chain

abstract: Nonlinear normal mode solutions of the $\beta$-FPUT chain with fixed boundaries are presented in terms of the Jacobi sn function. Exact solutions for the two particle chain are found for arbitrary linear and nonlinear coupling strengths. Solutions for the N-body chain are found for purely nonlinear couplings. Three distinct solution types presented: a linear analogue, a chaotic amplitude mapping, and a localized nonlinear mode. The relaxation of perturbed modes are also explored using $l_{1}$-regularized least squares regression to estimate the free energy functional near the nonlinear normal mode solution. The perturbed modes are observed to decay sigmoidally towards a quasi-equilibrium state and a logarithmic relationship between the perturbation strength and mode lifetime is found.


title: TickTalk -- Timing API for Dynamically Federated Cyber-Physical Systems

abstract: Although timing and synchronization of a dynamically-changing set of elements and their related power considerations are essential to many cyber-physical systems (CPS), they are absent from today's programming languages, forcing programmers to handle these matters outside of the language and on a case-by-case basis. This paper proposes a framework for adding time-related concepts to languages. Complementing prior work in this area, this paper develops the notion of dynamically federated islands of variable-precision synchronization and coordinated entities through synergistic activities at the language, system, network, and device levels. At the language level, we explore constructs that capture key timing and synchronization concepts and, at the system level, we propose a flexible intermediate language that represents both program logic and timing constraints together with run-time mechanisms. At the network level, we argue for architectural extensions that permit the network to act as a combined computing, communication, storage, and synchronization platform and at the device level, we explore architectural concepts that can lead to greater interoperability, easy establishment of timing constraints, and more power-efficient designs.


title: Extension of Malcev algebra and applications to gravity

abstract: We investigate extensions of Malcev algebras and give an explicit example of extended algebras. We present a new algebraic identity, which can be regarded as a generalization of the Jacobi identity or the Malcev identity. As applications to gravity, we demonstrate that the extended algebra can be linked with general relativity.


title: Low-diffusion Xe-He gas mixtures for rare-event detection: Electroluminescence Yield

abstract: High pressure xenon Time Projection Chambers (TPC) based on secondary scintillation (electroluminescence) signal amplification are being proposed for rare event detection such as directional dark matter, double electron capture and double beta decay detection. The discrimination of the rare event through the topological signature of primary ionisation trails is a major asset for this type of TPC when compared to single liquid or double-phase TPCs, limited mainly by the high electron diffusion in pure xenon. Helium admixtures with xenon can be an attractive solution to reduce the electron diffusion significantly, improving the discrimination efficiency of these optical TPCs. We have measured the electroluminescence (EL) yield of Xe-He mixtures, in the range of 0 to 30% He and demonstrated the small impact on the EL yield of the addition of helium to pure xenon. For a typical reduced electric field of 2.5 kV/cm/bar in the scintillation region, the EL yield is lowered by ~ 2%, 3%, 6% and 10% for 10%, 15%, 20% and 30% of helium concentration, respectively. This decrease is less than what has been obtained from the most recent simulation framework in the literature. The impact of the addition of helium on EL statistical fluctuations is negligible, within the experimental uncertainties. The present results are an important benchmark for the simulation tools to be applied to future optical TPCs based on Xe-He mixtures.


title: Characterising elliptic solids of $Q(4,q)$, $q$ even

abstract: Let $E$ be a set of solids (hyperplanes) in $PG(4,q)$, $q$ even, $q>2$, such that every point of $PG(4,q)$ lies in either $0$, $\frac12q^3$ or $\frac12(q^3-q^2)$ solids of $E$, and every plane of $PG(4,q)$ lies in either $0$, $\frac12q$ or $q$ solids of $E$. This article shows that $E$ is either the set of solids that are disjoint from a hyperoval, or the set of solids that meet a non-singular quadric $Q(4,q)$ in an elliptic quadric.


title: Unit Impulse Response as an Explainer of Redundancy in a Deep Convolutional Neural Network

abstract: Convolutional neural networks (CNN) are generally designed with a heuristic initialization of network architecture and trained for a certain task. This often leads to overparametrization after learning and induces redundancy in the information flow paths within the network. This robustness and reliability is at the increased cost of redundant computations. Several methods have been proposed which leverage metrics that quantify the redundancy in each layer. However, layer-wise evaluation in these methods disregards the long-range redundancy which exists across depth on account of the distributed nature of the features learned by the model. In this paper, we propose (i) a mechanism to empirically demonstrate the robustness in performance of a CNN on account of redundancy across its depth, (ii) a method to identify the systemic redundancy in response of a CNN across depth using the understanding of unit impulse response, we subsequently demonstrate use of these methods to interpret redundancy in few networks as example. These techniques provide better insights into the internal dynamics of a CNN


title: A Novel Approach to Quantum Gravity in the Presence of Matter without the Problem of Time

abstract: An approach to the quantization of gravity in the presence matter is examined which starts from the classical Einstein-Hilbert action and matter approximated by "point" particles minimally coupled to the metric. Upon quantization, the Hamilton constraint assumes the form of the Schr\"odinger equation: it contains the usual Wheeler-DeWitt term and the term with the time derivative of the wave function. In addition, the wave function also satisfies the Klein-Gordon equation, which arises as the quantum counterpart of the constraint among particles' momenta. Comparison of the novel approach with the usual one in which matter is represented by scalar fields is performed, and shown that those approaches do not exclude, but complement each other. In final discussion it is pointed out that the classical matter could consist of superparticles or spinning particles, described by the commuting and anticommuting Grassmann coordinates, in which case spinor fields would occur after quantization.


title: Two-dimensional non-Hermitian topological phases induced by asymmetric hopping in a one-dimensional superlattice

abstract: Non-Hermitian systems can host topological states with novel topological invariants and bulk-edge correspondences that are distinct from conventional Hermitian systems. Here we show that two unique classes of non-Hermitian 2D topological phases, a 2$\mathbb{Z}$ non-Hermitian Chern insulator and a $\mathbb{Z}_{2}$ topological semimetal, can be realized by tuning staggered asymmetric hopping strengths in a 1D superlattice. These non-Hermitian topological phases support real edge modes due to robust $\mathcal{PT}$-symmetric-like spectra and can coexist in certain parameter regime. The proposed phases can be experimentally realized in photonic or atomic systems and may open an avenue for exploring novel classes of non-Hermitian topological phases with 1D superlattices.


title: Errors-in-variables Modeling of Personalized Treatment-Response Trajectories

abstract: Estimating the effect of a treatment on a given outcome, conditioned on a vector of covariates, is central in many applications. However, learning the impact of a treatment on a continuous temporal response, when the covariates suffer extensively from measurement error and even the timing of the treatments is uncertain, has not been addressed. We introduce a novel data-driven method that can estimate treatment-response trajectories in this challenging scenario. We model personalized treatment-response curves as a combination of parametric response functions, hierarchically sharing information across individuals, and a sparse Gaussian process for the baseline trend. Importantly, our model considers measurement error not only in treatment covariates, but also in treatment times, a problem which arises in practice for example when treatment information is based on self-reporting. In a challenging and timely problem of estimating the impact of diet on continuous blood glucose measurements, our model leads to significant improvements in estimation accuracy and prediction.


title: 2nd Place and 2nd Place Solution to Kaggle Landmark Recognition andRetrieval Competition 2019

abstract: We present a retrieval based system for landmark retrieval and recognition challenge.There are five parts in retrieval competition system, including feature extraction and matching to get candidates queue; database augmentation and query extension searching; reranking from recognition results and local feature matching. In recognition challenge including: landmark and non-landmark recognition, multiple recognition results voting and reranking using combination of recognition and retrieval results. All of models trained and predicted by PaddlePaddle framework. Using our method, we achieved 2nd place in the Google Landmark Recognition 2019 and 2nd place in the Google Landmark Retrieval 2019 on kaggle. The source code is available at here.


title: Tropical representations and identities of plactic monoids

abstract: We exhibit a faithful representation of the plactic monoid of every finite rank as a monoid of upper triangular matrices over the tropical semiring. This answers a question first posed by Izhakian and subsequently studied by several authors. A consequence is a proof of a conjecture of Kubat and Okni\'{n}ski that every plactic monoid of finite rank satisfies a non-trivial semigroup identity. In the converse direction, we show that every identity satisfied by the plactic monoid of rank $n$ is satisfied by the monoid of $n \times n$ upper triangular tropical matrices. In particular this implies that the variety generated by the $3 \times 3$ upper triangular tropical matrices coincides with that generated by the plactic monoid of rank $3$, answering another question of Izhakian.


title: Automatic Algorithm Selection In Multi-agent Pathfinding

abstract: In a multi-agent pathfinding (MAPF) problem, agents need to navigate from their start to their goal locations without colliding into each other. There are various MAPF algorithms, including Windowed Hierarchical Cooperative A*, Flow Annotated Replanning, and Bounded Multi-Agent A*. It is often the case that there is no a single algorithm that dominates all MAPF instances. Therefore, in this paper, we investigate the use of deep learning to automatically select the best MAPF algorithm from a portfolio of algorithms for a given MAPF problem instance. Empirical results show that our automatic algorithm selection approach, which uses an off-the-shelf convolutional neural network, is able to outperform any individual MAPF algorithm in our portfolio.


title: On the accuracy of stiff-accurate diagonal implicit Runge-Kutta methods for finite volume based Navier-Stokes equations

abstract: The paper aims at developing low-storage implicit Runge-Kutta methods which are easy to implement and achieve higher-order of convergence for both the velocity and pressure in the finite volume formulation of the incompressible Navier-Stokes equations on a static collocated grid. To this end, the effect of the momentum interpolation, a procedure required by the finite volume method for collocated grids, on the differential-algebraic nature of the spatially-discretized Navier-Stokes equations should be examined first. A new framework for the momentum interpolation is established, based on which the semi-discrete Navier-Stokes equations can be strictly viewed as a system of differential-algebraic equations of index 2. The accuracy and convergence of the proposed momentum interpolation framework is examined. We then propose a new method of applying implicit Runge-Kutta schemes to the time-marching of the index 2 system of the incompressible Navier-Stokes equations. Compared to the standard method, the proposed one significantly reduces the numerical difficulties in momentum interpolations and delivers higher-order pressures without requiring additional computational effort. Applying stiff-accurate diagonal implicit Runge-Kutta (DIRK) schemes with the proposed method allows the schemes to attain the classical order of convergence for both the velocity and pressure. We also develop two families of low-storage stiff-accurate DIRK schemes to reduce the storage required by their implementations. Examining the two dimensional Taylor-Green vortex as an example, the spatial and temporal accuracy of the proposed methods in simulating incompressible flow is demonstrated.


title: Smart IoT Cameras for Crowd Analysis based on augmentation for automatic pedestrian detection, simulation and annotation

abstract: Smart video sensors for applications related to surveillance and security are IOT-based as they use Internet for various purposes. Such applications include crowd behaviour monitoring and advanced decision support systems operating and transmitting information over internet. The analysis of crowd and pedestrian behaviour is an important task for smart IoT cameras and in particular video processing. In order to provide related behavioural models, simulation and tracking approaches have been considered in the literature. In both cases ground truth is essential to train deep models and provide a meaningful quantitative evaluation. We propose a framework for crowd simulation and automatic data generation and annotation that supports multiple cameras and multiple targets. The proposed approach is based on synthetically generated human agents, augmented frames and compositing techniques combined with path finding and planning methods. A number of popular crowd and pedestrian data sets were used to validate the model, and scenarios related to annotation and simulation were considered.


title: A differential game analysis of R&D in oligopoly with differentiated goods under general demand and cost functions: Bertrand vs. Cournot

abstract: We study a dynamic oligopoly with differentiated goods by differential game approach under general demand and cost functions. We show that the steady state value of the R&D investment by each firm is decreasing with respect to the number of firms, and the steady state value of the industry R&D investment is increasing with respect to the number of firms. Also we show that if there is no spillover, whether the R&D investment of each firm given the cost level in the memoryless closed-loop case is larger or smaller than that in the open-loop case depends on whether the strategic variables are strategic substitutes or strategic complements. Further we show that the memoryless closed-loop solution and the feedback solution (by the Hamilton-Jacobi-Bellman equation) are equivalent.


title: Rethinking Trajectory Evaluation for SLAM: a Probabilistic, Continuous-Time Approach

abstract: Despite the existence of different error metrics for trajectory evaluation in SLAM, their theoretical justifications and connections are rarely studied, and few methods handle temporal association properly. In this work, we propose to formulate the trajectory evaluation problem in a probabilistic, continuous-time framework. By modeling the groundtruth as random variables, the concepts of absolute and relative error are generalized to be likelihood. Moreover, the groundtruth is represented as a piecewise Gaussian Process in continuous-time. Within this framework, we are able to establish theoretical connections between relative and absolute error metrics and handle temporal association in a principled manner.


title: The Riddle of Togelby

abstract: At the 2017 Artificial and Computational Intelligence in Games meeting at Dagstuhl, Julian Togelius asked how to make spaces where every way of filling in the details yielded a good game. This study examines the possibility of enriching search spaces so that they contain very high rates of interesting objects, specifically game elements. While we do not answer the full challenge of finding good games throughout the space, this study highlights a number of potential avenues. These include naturally rich spaces, a simple technique for modifying a representation to search only rich parts of a larger search space, and representations that are highly expressive and so exhibit highly restricted and consequently enriched search spaces.


title: Multi-waveform cross-correlation search method for intermediate-duration gravitational waves from gamma-ray bursts

abstract: Gamma-ray Bursts (GRBs) are flashes of gamma-rays thought to originate from rare forms of massive star collapse (long GRBs), or from mergers of compact binaries (short GRBs) containing at least one neutron star (NS). The nature of the post-explosion / post-merger remnant (NS versus black hole, BH) remains highly debated. In ~50% of both long and short GRBs, the temporal evolution of the X-ray afterglow that follows the flash of gamma-rays is observed to "plateau" on timescales of 100-10000 s since explosion, possibly signaling the presence of energy injection from a long-lived, highly magnetized NS (magnetar). The Cross-Correlation Algorithm (CoCoA) proposed by [R. Coyne et. al., (2016)] aims to optimize searches for intermediate-duration (100-10000s) gravitational waves (GWs) from GRB remnants. In this work, we test CoCoA on real data collected with ground-based GW detectors. We further develop the detection statistics on which CoCoA is based to allow for multi-waveform searches spanning a physically-motivated parameter space, so as to account for uncertainties in the physical properties of GRB remnants.


title: Collage Inference: Achieving low tail latency during distributed image classification using coded redundancy models

abstract: Reducing the latency variance in machine learning inference is a key requirement in many applications. Variance is harder to control in a cloud deployment in the presence of stragglers. In spite of this challenge, inference is increasingly being done in the cloud, due to the advent of affordable machine learning as a service (MLaaS) platforms. Existing approaches to reduce variance rely on replication which is expensive and partially negates the affordability of MLaaS. In this work, we argue that MLaaS platforms also provide unique opportunities to cut the cost of redundancy. In MLaaS platforms, multiple inference requests are concurrently received by a load balancer which can then create a more cost-efficient redundancy coding across a larger collection of images. We propose a novel convolutional neural network model, Collage-CNN, to provide a low-cost redundancy framework. A Collage-CNN model takes a collage formed by combining multiple images and performs multi-image classification in one shot, albeit at slightly lower accuracy. We then augment a collection of traditional single image classifiers with a single Collage-CNN classifier which acts as a low-cost redundant backup. Collage-CNN then provides backup classification results if a single image classification straggles. Deploying the Collage-CNN models in the cloud, we demonstrate that the 99th percentile tail latency of inference can be reduced by 1.47X compared to replication based approaches while providing high accuracy. Also, variation in inference latency can be reduced by 9X with a slight increase in average inference latency.


title: Intrinsic Stability: Global Stability of Dynamical Networks and Switched Systems Resilient to any Type of Time-Delays

abstract: In real-world networks the interactions between network elements are inherently time-delayed. These time-delays can not only slow the network but can have a destabilizing effect on the network's dynamics leading to poor performance. The same is true in computational networks used for machine learning etc. where time-delays increase the network's memory but can degrade the network's ability to be trained. However, not all networks can be destabilized by time-delays. Previously, it has been shown that if a network or high-dimensional dynamical system is intrinsically stable, which is a stronger form of the standard notion of global stability, then it maintains its stability when constant time-delays are introduced into the system. Here we show that intrinsically stable systems, including intrinsically stable networks and a broad class of switched systems, i.e. systems whose mapping is time-dependent, remain stable in the presence of any type of time-varying time-delays whether these delays are periodic, stochastic, or otherwise. We apply these results to a number of well-studied systems to demonstrate that the notion of intrinsic stability is both computationally inexpensive, relative to other methods, and can be used to improve on some of the best known stability results. We also show that the asymptotic state of an intrinsically stable switched system is exponentially independent of the system's initial conditions.


title: Finding extremal periodic orbits with polynomial optimisation, with application to a nine-mode model of shear flow

abstract: Tobasco et al. [Physics Letters A, 382:382-386, 2018; see https://doi.org/10.1016/j.physleta.2017.12.023] recently suggested that trajectories of ODE systems that optimize the infinite-time average of a certain observable can be localized using sublevel sets of a function that arise when bounding such averages using so-called auxiliary functions. In this paper we demonstrate that this idea is viable and allows for the computation of extremal unstable periodic orbits (UPOs) for polynomial ODE systems. First, we prove that polynomial optimization is guaranteed to produce auxiliary functions that yield near-sharp bounds on time averages, which is required in order to localize the extremal orbit accurately. Second, we show that points inside the relevant sublevel sets can be computed efficiently through direct nonlinear optimization. Such points provide good initial conditions for UPO computations. As a proof of concept, we then combine these methods with a single-shooting Newton-Raphson algorithm to study extremal UPOs for a nine-dimensional model of sinusoidally forced shear flow. We discover three previously unknown families of UPOs, one of which simultaneously minimizes the mean energy dissipation rate and maximizes the mean perturbation energy relative to the laminar state for Reynolds numbers approximately between 81.24 and 125.


title: Detecting Clues for Skill Levels and Machine Operation Difficulty from Egocentric Vision

abstract: With respect to machine operation tasks, the experiences from different skill level operators, especially novices, can provide worthy understanding about the manner in which they perceive the operational environment and formulate knowledge to deal with various operation situations. In this study, we describe the operator's behaviors by utilizing the relations among their head, hand, and operation location (hotspot) during the operation. A total of 40 experiences associated with a sewing machine operation task performed by amateur operators was recorded via a head-mounted RGB-D camera. We examined important features of operational behaviors in different skill level operators and confirmed their correlation to the difficulties of the operation steps. The result shows that the pure-gazing behavior is significantly reduced when the operator's skill improved. Moreover, the hand-approaching duration and the frequency of attention movement before operation are strongly correlated to the operational difficulty in such machine operating environments.


title: Data-driven quasi-interpolant spline surfaces for point cloud approximation

abstract: In this paper we investigate a local surface approximation, the Weighted Quasi Interpolant Spline Approximation (wQISA), specifically designed for large and noisy point clouds. We briefly describe the properties of the wQISA representation and introduce a novel data-driven implementation, which combines prediction capability and complexity efficiency. We provide an extended comparative analysis with other continuous approximations on real data, including different types of surfaces and levels of noise, such as 3D models, terrain data and digital environmental data.


title: On the Monodromy of Meromorphic Cyclic Opers on the Riemann Sphere

abstract: We study the monodromy of meromorphic cyclic $\mathrm{SL}(n,\mathbb{C})$-opers on the Riemann sphere with a single pole. We prove that the monodromy map, sending such an oper to its Stokes data, is an immersion in the case where the order of the pole is a multiple of $n$. To do this, we develop a method based on the work of M. Jimbo, T. Miwa, and K. Ueno from the theory of isomonodromic deformations. Specifically, we introduce a system of equations that is equivalent to the isomonodromy equations of Jimbo-Miwa-Ueno, but which is adapted to the decomposition of the Lie algebra $\mathfrak{sl}(n,\mathbb{C})$ as a direct sum of irreducible representations of $\mathfrak{sl}(2,\mathbb{C})$. Using properties of some structure constants for $\mathfrak{sl}(n,\mathbb{C})$ to analyze this system of equations, we show that deformations of certain families of cyclic $\mathrm{SL}(n,\mathbb{C})$-opers on the Riemann sphere with a single pole are never infinitesimally isomonodromic.


title: Safe Reinforcement Learning Using Robust MPC

abstract: Reinforcement Learning (RL) has recently impressed the world with stunning results in various applications. While the potential of RL is now well-established, many critical aspects still need to be tackled, including safety and stability issues. These issues, while partially neglected by the RL community, are central to the control community which has been widely investigating them. Model Predictive Control (MPC) is one of the most successful control techniques because, among others, of its ability to provide such guarantees even for uncertain constrained systems. Since MPC is an optimization-based technique, optimality has also often been claimed. Unfortunately, the performance of MPC is highly dependent on the accuracy of the model used for predictions. In this paper, we propose to combine RL and MPC in order to exploit the advantages of both and, therefore, obtain a controller which is optimal and safe. We illustrate the results with a numerical example in simulations.


title: MPC-Based Precision Cooling Strategy (PCS) for Efficient Thermal Management of Automotive Air Conditioning System

abstract: In this paper, we propose an MPC-based precision cooling strategy (PCS) for energy efficient thermal management of automotive air conditioning (A/C) system. The proposed PCS is able to provide precise tracking of the time-varying cooling power trajectory, which is assumed to match the passenger comfort requirements. In addition, by leveraging the emerging connected and automated vehicles (CAVs) technology, vehicle speed preview can be incorporated in our A/C thermal management strategy for further energy efficiency improvement. This proposed A/C thermal management strategy is developed and evaluated based on a physics-based A/C system model (ACSim) from Ford Motor Company for the vehicles with electrified powertrains. In a comparison with Ford benchmark case over SC03 cycle, for tracking the same cooling power trajectory, the proposed PCS provides 4.9% energy saving at the cost of a slight increase in the cabin temperature (less than 1$^oC$). It is also demonstrated that by coordinating with future vehicle speed and shifting the A/C power load, the A/C energy consumption can be further reduced.


title: An Empty Chiral Rotation for the Adler-Bell-Jackiw Anomaly

abstract: This is an article which intends to shake down the traditional belief that the celebrated Adler-Bell-Jackiw anomaly stems from the chiral rotation non-invariance of the fermionic measure. The fermionic functional integration measure in quantum field theory should be defined so as to reproduce the standard Feynman diagrammatic expansion. This implies that a plain definition of the fermionic measure automatically serves such a purpose. A dilemma then arises: how could one identify the ABJ anomaly as a nontrivial Jacobian factor for a chiral transformation ? The true answer is indeed surprising and unexpected, that is, the Jacobian factor is actually a random and indeterminate object, hence it carries no physical information. A true explanation for the ABJ anomaly is suggested.


title: A geometric Jacquet-Langlands correspondence for paramodular Siegel threefolds

abstract: We study the Picard-Lefschetz formula for the Siegel modular threefold of paramodular level and prove the weight-monodromy conjecture for its middle degree inner cohomology with arbitrary automorphic coefficients. We give some applications to the Langlands programme: Using Rapoport-Zink uniformisation of the supersingular locus of the special fiber, we construct a geometric Jacquet-Langlands correspondence between $\operatorname{GSp}_4$ and a definite inner form, proving a conjecture of Ibukiyama. We also prove an integral version of the weight-monodromy conjecture and use it to deduce a level lowering result for cohomological cuspidal automorphic representations of $\operatorname{GSp}_4$.


title: Boosting Soft Actor-Critic: Emphasizing Recent Experience without Forgetting the Past

abstract: Soft Actor-Critic (SAC) is an off-policy actor-critic deep reinforcement learning (DRL) algorithm based on maximum entropy reinforcement learning. By combining off-policy updates with an actor-critic formulation, SAC achieves state-of-the-art performance on a range of continuous-action benchmark tasks, outperforming prior on-policy and off-policy methods. The off-policy method employed by SAC samples data uniformly from past experience when performing parameter updates. We propose Emphasizing Recent Experience (ERE), a simple but powerful off-policy sampling technique, which emphasizes recently observed data while not forgetting the past. The ERE algorithm samples more aggressively from recent experience, and also orders the updates to ensure that updates from old data do not overwrite updates from new data. We compare vanilla SAC and SAC+ERE, and show that ERE is more sample efficient than vanilla SAC for continuous-action Mujoco tasks. We also consider combining SAC with Priority Experience Replay (PER), a scheme originally proposed for deep Q-learning which prioritizes the data based on temporal-difference (TD) error. We show that SAC+PER can marginally improve the sample efficiency performance of SAC, but much less so than SAC+ERE. Finally, we propose an algorithm which integrates ERE and PER and show that this hybrid algorithm can give the best results for some of the Mujoco tasks.


title: Topology optimization of unsaturated flows in multi-material porous media: application to a simple diaper model

abstract: We present a mathematical approach to optimize the material distribution for fluid transport in unsaturated porous media. Our benchmark problem is a simplified diaper model as an exemplary liquid absorber. Our model has up to three materials with vastly different properties, which in the reference configuration are arranged in parallel layers. Here, swelling is neglected and the geometry of a swollen diaper is assumed and treated as a porous medium of high porosity. The imbibition process is then simulated by solving an unsaturated flow problem based on Richards' equation. Our aim is to maximize the amount of absorbed liquid by redistributing the materials. To this end, a density based multi-material topology optimization (based on the well known SIMP model) is performed. A sensitivity analysis for the nonlinear transient problem is provided, which enables the application of first order optimization solvers. We perform two- and three-material optimization and discuss several variants of the problem setting. We present designs with up to 45% more absorbed liquid compared to the reference configuration.


title: Visual Backpropagation

abstract: We show how a declarative functional programming specification of backpropagation yields a visual and transparent implementation within spreadsheets. We call our method Visual Backpropagation. This backpropagation implementation exploits array worksheet formulas, manual calculation, and has a sequential order of computation similar to the processing of a systolic array. The implementation uses no hidden macros nor user-defined functions; there are no loops, assignment statements, or links to any procedural programs written in conventional languages. As an illustration, we compare a Visual Backpropagation solution to a Tensorflow (Python) solution on a standard regression problem.


title: PDE Traffic Observer Validated on Freeway Data

abstract: This paper develops boundary observer for estimation of congested freeway traffic states based on Aw-Rascle-Zhang (ARZ) partial differential equations (PDE) model. Traffic state estimation refers to acquisition of traffic state information from partially observed traffic data. This problem is relevant for freeway due to its limited accessibility to real-time traffic information. We propose a model-driven approach in which estimation of aggregated traffic states in a freeway segment are obtained simply from boundary measurement of flow and velocity without knowledge of the initial states. The macroscopic traffic dynamics is represented by the ARZ model, consisting of $2 \times 2$ coupled nonlinear hyperbolic PDEs for traffic density and velocity. Analysis of the linearized ARZ model leads to the study of a hetero-directional hyperbolic PDE model for congested traffic regime. Using spatial transformation and PDE backstepping method, we construct a boundary observer consisting of a copy of the nonlinear plant with output injections from boundary measurement errors. The output injection gains are designed for the estimation error system so that the exponential stability of the error system in the $L^2$ norm and finite-time convergence to zero are guaranteed. Numerical simulations are conducted to validate the boundary observer design for estimation of the nonlinear ARZ model. In data validation, we calibrate model parameters of the ARZ model and then use vehicle trajectory data to test the performance of the observer design.


title: Ultra-Wideband Air-to-Ground Propagation Channel Characterization in an Open Area

abstract: This paper studies the air-to-ground (AG) ultra-wideband (UWB) propagation channel through measurements between 3.1 GHz to 4.8 GHz using unmanned-aerial-vehicles (UAVs). Different line-of-sight (LOS) and obstructed- LOS scenarios and two antenna orientations were used in the experiments. Channel statistics for different propagation scenarios were obtained, and the Saleh-Valenzuela (SV) model was found to provide a good fit for the statistical channel model. An analytical path loss model based on antenna gains in the elevation plane is provided for unobstructed UAV hovering and moving (in a circular path) propagation scenarios.


title: Quarkonium Phenomenology from a Generalised Gauss Law

abstract: We present an improved analytic parametrisation of the complex in-medium heavy quark potential derived rigorously from the generalised Gauss law. To this end we combine in a self-consistent manner a non-perturbative vacuum potential with a weak-coupling description of the QCD medium. The resulting Gauss-law parametrisation is able to reproduce full lattice QCD data by using only a single temperature dependent parameter, the Debye mass $m_D$. Using this parametrisation we model the in-medium potential at finite baryo-chemical potential, which allows us to estimate the $\Psi^\prime$/$J/\Psi$ ratio in heavy-ion collisions at different beam energies.


title: Cormorant: Covariant Molecular Neural Networks

abstract: We propose Cormorant, a rotationally covariant neural network architecture for learning the behavior and properties of complex many-body physical systems. We apply these networks to molecular systems with two goals: learning atomic potential energy surfaces for use in Molecular Dynamics simulations, and learning ground state properties of molecules calculated by Density Functional Theory. Some of the key features of our network are that (a) each neuron explicitly corresponds to a subset of atoms; (b) the activation of each neuron is covariant to rotations, ensuring that overall the network is fully rotationally invariant. Furthermore, the non-linearity in our network is based upon tensor products and the Clebsch-Gordan decomposition, allowing the network to operate entirely in Fourier space. Cormorant significantly outperforms competing algorithms in learning molecular Potential Energy Surfaces from conformational geometries in the MD-17 dataset, and is competitive with other methods at learning geometric, energetic, electronic, and thermodynamic properties of molecules on the GDB-9 dataset.


title: Learning Temporal Pose Estimation from Sparsely-Labeled Videos

abstract: Modern approaches for multi-person pose estimation in video require large amounts of dense annotations. However, labeling every frame in a video is costly and labor intensive. To reduce the need for dense annotations, we propose a PoseWarper network that leverages training videos with sparse annotations (every k frames) to learn to perform dense temporal pose propagation and estimation. Given a pair of video frames---a labeled Frame A and an unlabeled Frame B---we train our model to predict human pose in Frame A using the features from Frame B by means of deformable convolutions to implicitly learn the pose warping between A and B. We demonstrate that we can leverage our trained PoseWarper for several applications. First, at inference time we can reverse the application direction of our network in order to propagate pose information from manually annotated frames to unlabeled frames. This makes it possible to generate pose annotations for the entire video given only a few manually-labeled frames. Compared to modern label propagation methods based on optical flow, our warping mechanism is much more compact (6M vs 39M parameters), and also more accurate (88.7% mAP vs 83.8% mAP). We also show that we can improve the accuracy of a pose estimator by training it on an augmented dataset obtained by adding our propagated poses to the original manual labels. Lastly, we can use our PoseWarper to aggregate temporal pose information from neighboring frames during inference. This allows our system to achieve state-of-the-art pose detection results on the PoseTrack2017 and PoseTrack2018 datasets. Code has been made available at: https://github.com/facebookresearch/PoseWarper.


title: Acceleration of Radiation Transport Solves Using Artificial Neural Networks

abstract: Discontinuous Finite Element Methods (DFEM) have been widely used for solving $S_n$ radiation transport problems in participative and non-participative media. In the DFEM $S_n$ methodology, the transport equation is discretized into a set of algebraic equations that have to be solved for each spatial cell and angular direction, strictly preserving the following of radiation in the system. At the core of a DFEM solver a small matrix-vector system (of 8 independent equations for tri-linear DFEM in 3D hexehdral cells) has to be assembled and solved for each cell, angle, energy group, and time step. These systems are generally solved by direct Gaussian Elimination. The computational cost of the Gaussian Elimination, repeated for each phase-space cell, amounts to a large fraction to the total compute time. Here, we have designed a Machine Learning algorithm based in a shallow Artificial Neural Networks (ANNs) to replace that Gaussian Elimination step, enabling a sizeable speed up in the solution process. The key idea is to train an ANN with a large set of solutions of random one-cell transport problems and then to use the trained ANN to replace Gaussian Elimination large scale transport solvers. It has been observed that ANNs decrease the solution times by at least a factor of 4, while introducing mean absolute errors between 1-3 \% in large scale transport solutions.


title: A general thermodynamical model for adhesive frictional contacts between viscoelastic or poro-viscoelastic bodies at small strains

abstract: A general model covering a large variety of the so-called adhesive or cohesive, possibly also frictional, contact interfaces between visco-elastic bodies with inertia considered in a thermodynamical context is presented. A semi-implicit time discretisation which conserves energy, is numerically stable and convergent, and which advantageously decouples the system is devised. An extension to porous media with adhesive contact influenced by a diffusant concentration is devised, too.