title: Learning Depth With Very Sparse Supervision

abstract: Motivated by the astonishing capabilities of natural intelligent agents and inspired by theories from psychology, this paper explores the idea that perception gets coupled to 3D properties of the world via interaction with the environment. Existing works for depth estimation require either massive amounts of annotated training data or some form of hard-coded geometrical constraint. This paper explores a new approach to learning depth perception requiring neither of those. Specifically, we train a specialized global-local network architecture with what would be available to a robot interacting with the environment: from extremely sparse depth measurements down to even a single pixel per image. From a pair of consecutive images, our proposed network outputs a latent representation of the observer's motion between the images and a dense depth map. Experiments on several datasets show that, when ground truth is available even for just one of the image pixels, the proposed network can learn monocular dense depth estimation up to 22.5% more accurately than state-of-the-art approaches. We believe that this work, despite its scientific interest, lays the foundations to learn depth from extremely sparse supervision, which can be valuable to all robotic systems acting under severe bandwidth or sensing constraints.


title: Collective All-Carbon Magnetism in Triangulene Dimers

abstract: Triangular zigzag nanographenes, such as triangulene and its pi-extended homologues, have received widespread attention as organic nanomagnets for molecular spintronics, and may serve as building blocks for high-spin networks with long-range magnetic order - of immense fundamental and technological relevance. As a first step toward these lines, we present the on-surface synthesis and a proof-of-principle experimental study of magnetism in covalently bonded triangulene dimers. On-surface reactions of rationally-designed precursor molecules on Au(111) lead to the selective formation of triangulene dimers in which the triangulene units are either directly connected through their minority sublattice atoms, or are separated via a 1,4-phenylene spacer. The chemical structures of the dimers have been characterized by bond-resolved scanning tunneling microscopy. Scanning tunneling spectroscopy and inelastic electron tunneling spectroscopy measurements reveal collective singlet-triplet spin excitations in the dimers, demonstrating efficient inter-triangulene magnetic coupling.


title: Plug-and-Play SLAM: A Unified SLAM Architecture for Modularity and Ease of Use

abstract: Nowadays, SLAM (Simultaneous Localization and Mapping) is considered by the Robotics community to be a mature field. Currently, there are many open-source systems that are able to deliver fast and accurate estimation in typical real-world scenarios. Still, all these systems often provide an ad-hoc implementation that entailed to predefined sensor configurations. In this work, we tackle this issue, proposing a novel SLAM architecture specifically designed to address heterogeneous sensors' configuration and to standardize SLAM solutions. Thanks to its modularity and to specific design patterns, the presented architecture is easy to extend, enhancing code reuse and efficiency. Finally, adopting our solution, we conducted comparative experiments for a variety of sensor configurations, showing competitive results that confirm state-of-the-art performance.


title: On the p-width of finite simple groups

abstract: In this paper we measure how efficiently a finite simple group $G$ is generated by its elements of order $p$, where $p$ is a fixed prime. This measure, known as the $p$-width of $G$, is the minimal $k\in \mathbb{N}$ such that any $g\in G$ can be written as a product of at most $k$ elements of order $p$. Using primarily character theoretic methods, we sharply bound the $p$-width of some low rank families of Lie type groups, as well as the simple alternating and sporadic groups.


title: On the appearance of fractional operators in non-linear stress-strain relation of metals

abstract: Finding an accurate stress-strain relation, able to describe the mechanical behavior of metals during {forming} and machining processes, is an important challenge in several fields of mechanics, with significant repercussions in the technological field. Indeed, in order to predict the real mechanical behavior of materials, constitutive laws must be able to take into account elastic, viscous and plastic phenomena. Most constitutive models are based on empirical evidence and/or theoretical approaches, and provide a good prediction of the mechanical behavior of several materials. Here we present a non linear stress-strain relation based on fractional operators. The proposed constitutive law is based on integral formulation, and takes into account the viscoelastic behavior of the material and the inelastic phenomenon that appears when the stress reaches a particular yielding value. A specific case of the proposed constitutive law for imposed strain history is used to fit experimental data obtained from tensile tests on two kind of metal alloys. A best-fitting procedure demonstrates the accuracy of the proposed stress-strain relation and its results are compared to those obtained with some classical models. We conclude that the proposed model provides the best results in predicting the mechanical behavior for low and high values of stress/strain.


title: General trace formula for heat flux fluctuations

abstract: Within the framework of macroscopic quantum electrodynamics and scattering theory, we derive the general expressions for the variance of radiative heat transfer between two arbitrarily shaped objects placed in an arbitrary environment in terms of their T-operators. The such derived expression is valid in the far- and near-field regime of thermal radiation as well as for reciprocal and non-reciprocal objects of any size within a reciprocal or non-reciprocal environment as long as the distances between the objects and their sizes are covered by the macroscopic approach. As special cases we discuss the variance of the radiative heat flux between two nanoparticles and between a nanoparticle and a substrate in near- and far-field regime.


title: Benjamini-Schramm convergence and zeta functions

abstract: In this note we show the equivalence of Benjamini-Schramm convergence and convergence of the zeta functions for compact hyperbolic surfaces.


title: Spatiotemporal Learning of Multivehicle Interaction Patterns in Lane-Change Scenarios

abstract: Interpretation of common-yet-challenging interaction scenarios can benefit well-founded decisions for autonomous vehicles. Previous research achieved this using their prior knowledge of specific scenarios with predefined models, limiting their adaptive capabilities. This paper describes a Bayesian nonparametric approach that leverages continuous (i.e., Gaussian processes) and discrete (i.e., Dirichlet processes) stochastic processes to reveal underlying interaction patterns of the ego vehicle with other nearby vehicles. Our model relaxes dependency on the number of surrounding vehicles by developing an acceleration-sensitive velocity field based on Gaussian processes. The experiment results demonstrate that the velocity field can represent the spatial interactions between the ego vehicle and its surroundings. Then, a discrete Bayesian nonparametric model, integrating Dirichlet processes and hidden Markov models, is developed to learn the interaction patterns over the temporal space by segmenting and clustering the sequential interaction data into interpretable granular patterns automatically. We then evaluate our approach in the highway lane-change scenarios using the highD dataset collected from real-world settings. Results demonstrate that our proposed Bayesian nonparametric approach provides an insight into the complicated lane-change interactions of the ego vehicle with multiple surrounding traffic participants based on the interpretable interaction patterns and their transition properties in temporal relationships. Our proposed approach sheds light on efficiently analyzing other kinds of multi-agent interactions, such as vehicle-pedestrian interactions. View the demos via https://youtu.be/z_vf9UHtdAM.


title: On the heat transfer across a vacuum gap mediated by Casimir force

abstract: Following a recent report on experiments it has been claimed that a phonon heat transfer through a vacuum gap between two solids due to quantum fluctuations had been measured. Here we make a theoretical analyzis of this mechanism and demonstrate that the Casimir force driven heat flux is at least 15 orders of magnitude smaller than the near-field heat flux between two solids at any given separating distance. Moreover, we provide compelling arguments that the measures reported are no more and no less a measure of the virtual temperatures of vibrating modes which does not allow an access to the Casimir force driven heat flux.


title: $5$-rank of ambiguous class groups of quintic Kummer extensions

abstract: Let $k \,=\, \mathbb{Q}(\sqrt[5]{n},\zeta_5)$, where $n$ is a positive integer, $5^{th}$ power-free, whose $5-$class group is isomorphic to $\mathbb{Z}/5\mathbb{Z}\times\mathbb{Z}/5\mathbb{Z}$. Let $k_0\,=\,\mathbb{Q}(\zeta_5)$ be the cyclotomic field containing a primitive $5^{th}$ root of unity $\zeta_5$. Let $C_{k,5}^{(\sigma)}$ the group of the ambiguous classes under the action of $Gal(k/k_0)$ = $<\sigma>$. The aim of this paper is to determine all integers $n$ such that the group of ambiguous classes $C_{k,5}^{(\sigma)}$ has rank $1$ or $2$.


title: Flashlight CNN Image Denoising

abstract: This paper proposes a learning-based denoising method called FlashLight CNN (FLCNN) that implements a deep neural network for image denoising. The proposed approach is based on deep residual networks and inception networks and it is able to leverage many more parameters than residual networks alone for denoising grayscale images corrupted by additive white Gaussian noise (AWGN). FlashLight CNN demonstrates state of the art performance when compared quantitatively and visually with the current state of the art image denoising methods.


title: Chirality transfer & chiral turbulence in gauge theories

abstract: Chirality transfer between fermions and gauge fields plays a crucial role for understanding the dynamics of anomalous transport phenomena such as the Chiral Magnetic Effect. In this proceeding we present a first principles study of these processes based on classical-statistical real-time lattice simulations of strongly coupled QED $(e^2N_f=64)$. Our simulations demonstrate that a chirality imbalance in the fermion sector triggers chiral plasma instabilities in the gauge field sector, which ultimately lead to the generation of long range helical magnetic fields via a self-similar turbulent cascade of the magnetic helicity.


title: Weak deflection angle of a dirty black hole

abstract: In this paper, we present the weak deflection angle in a Schwarzschild black hole of mass $m$ surrounded by the dark matter of mass $M$ and thickness $\Delta r_{s}$. The Gauss-Bonnet theorem, formulated for asymptotic spacetimes, is found to be ill-behaved in the third-order of $1/\Delta r_{s}$ for very large $\Delta r_{s}$. Using the finite-distance for the radial locations of the source and the receiver, we derived the expression for the weak deflection angle up to the third-order of $1/\Delta r_{s}$ using Ishihara (\textit{et al.}) method. The result showed that the required dark matter thickness is $\sim2\sqrt{3mM}$ for the deviations in the weak deflection angle to occur. Such thickness requirement is better by a factor of 2 as compared to the deviations in the shadow radius ($\sim\sqrt{3mM}$). It implies that the use of the weak deflection angle in detecting dark matter effects in one's galaxy is better than using any deviations in the shadow radius.


title: Decompositions of principal series representations of Iwahori-Hecke algebras for Kac-Moody groups over local fields

abstract: Recently, Iwahori-Hecke algebras were associated to Kac-Moody groups over non-Archimedean local fields. In a previous paper, we introduced principal series representations for these algebras and partially generalized Kato's irreducibility criterion. In this paper, we study how some of these representations decompose when they are reducible and deduce information on the irreducible representations of these algebras.


title: Unsupervised Learning of Depth, Optical Flow and Pose with Occlusion from 3D Geometry

abstract: In autonomous driving, monocular sequences contain lots of information. Monocular depth estimation, camera ego-motion estimation and optical flow estimation in consecutive frames are high-profile concerns recently. By analyzing tasks above, pixels in the middle frame are modeled into three parts: the rigid region, the non-rigid region, and the occluded region. In joint unsupervised training of depth and pose, we can segment the occluded region explicitly. The occlusion information is used in unsupervised learning of depth, pose and optical flow, as the image reconstructed by depth-pose and optical flow will be invalid in occluded regions. A less-than-mean mask is designed to further exclude the mismatched pixels interfered with by motion or illumination change in the training of depth and pose networks. This method is also used to exclude some trivial mismatched pixels in the training of the optical flow network. Maximum normalization is proposed for depth smoothness term to restrain depth degradation in textureless regions. In the occluded region, as depth and camera motion can provide more reliable motion estimation, they can be used to instruct unsupervised learning of optical flow. Our experiments in KITTI dataset demonstrate that the model based on three regions, full and explicit segmentation of the occlusion region, the rigid region, and the non-rigid region with corresponding unsupervised losses can improve performance on three tasks significantly. The source code is available at: https://github.com/guangmingw/DOPlearning.


title: On the Existence of Characterization Logics and Fundamental Properties of Argumentation Semantics

abstract: Given the large variety of existing logical formalisms it is of utmost importance to select the most adequate one for a specific purpose, e.g. for representing the knowledge relevant for a particular application or for using the formalism as a modeling tool for problem solving. Awareness of the nature of a logical formalism, in other words, of its fundamental intrinsic properties, is indispensable and provides the basis of an informed choice. In this treatise we consider the existence characterization logics as well as properties like existence and uniqueness, expressibility, replaceability and verifiability in the realm of abstract argumentation


title: Convolutional Sparse Support Estimator Network (CSEN) From energy efficient support estimation to learning-aided Compressive Sensing

abstract: Support estimation (SE) of a sparse signal refers to finding the location indices of the non-zero elements in a sparse representation. Most of the traditional approaches dealing with SE problem are iterative algorithms based on greedy methods or optimization techniques. Indeed, a vast majority of them use sparse signal recovery techniques to obtain support sets instead of directly mapping the non-zero locations from denser measurements (e.g., Compressively Sensed Measurements). This study proposes a novel approach for learning such a mapping from a training set. To accomplish this objective, the Convolutional Support Estimator Networks (CSENs), each with a compact configuration, are designed. The proposed CSEN can be a crucial tool for the following scenarios: (i) Real-time and low-cost support estimation can be applied in any mobile and low-power edge device for anomaly localization, simultaneous face recognition, etc. (ii) CSEN's output can directly be used as "prior information" which improves the performance of sparse signal recovery algorithms. The results over the benchmark datasets show that state-of-the-art performance levels can be achieved by the proposed approach with a significantly reduced computational complexity.


title: SOL-KiT -- fully implicit code for kinetic simulation of parallel electron transport in the tokamak Scrape-Off Layer

abstract: Here we present a new code for modelling electron kinetics in the tokamak Scrape-Off Layer (SOL). SOL-KiT (Scrape-Off Layer Kinetic Transport) is a fully implicit 1D code with kinetic (or fluid) electrons, fluid (or stationary) ions, and diffusive neutrals. The code is designed for fundamental exploration of non-local physics in the SOL and utilizes an arbitrary degree Legendre polynomial decomposition of the electron distribution function, treating both electron-ion and electron-atom collisions. We present a novel method for ensuring particle and energy conservation in inelastic and superelastic collisions, as well as the first full treatment of the logical boundary condition in the Legendre polynomial formalism. To our knowledge, SOL-KiT is the first fully implicit arbitrary degree harmonic kinetic code, offering a conservative and self-consistent approach to fluid-kinetic comparison with its integrated fluid electron mode. In this paper we give the model equations and their discretizations, as well as showing the results of a number of verification/benchmarking simulations.


title: Identity Recognition in Intelligent Cars with Behavioral Data and LSTM-ResNet Classifier

abstract: Identity recognition in a car cabin is a critical task nowadays and offers a great field of applications ranging from personalizing intelligent cars to suit drivers physical and behavioral needs to increasing safety and security. However, the performance and applicability of published approaches are still not suitable for use in series cars and need to be improved. In this paper, we investigate Human Identity Recognition in a car cabin with Time Series Classification (TSC) and deep neural networks. We use gas and brake pedal pressure as input to our models. This data is easily collectable during driving in everyday situations. Since our classifiers have very little memory requirements and do not require any input data preproccesing, we were able to train on one Intel i5-3210M processor only. Our classification approach is based on a combination of LSTM and ResNet. The network trained on a subset of NUDrive outperforms the ResNet and LSTM models trained solely by 35.9 % and 53.85 % accuracy respectively. We reach a final accuracy of 79.49 % on a 10-drivers subset of NUDrive and 96.90 % on a 5-drivers subset of UTDrive.


title: Smooth Strongly Convex Regression

abstract: Convex regression (CR) is the problem of fitting a convex function to a finite number of noisy observations of an underlying convex function. CR is important in many domains and one of its workhorses is the non-parametric least square estimator (LSE). Currently, LSE delivers only non-smooth non-strongly convex function estimates. In this paper, leveraging recent results in convex interpolation, we generalize LSE to smooth strongly convex regression problems. The resulting algorithm relies on a convex quadratically constrained quadratic program. We also propose a parallel implementation, which leverages ADMM, that lessens the overall computational complexity to a tight $O(n^2)$ for $n$ observations. Numerical results support our findings.


title: Short range order and topology of Ge$_{x}$Ga$_{x}$Te$_{100-2x}$ glasses

abstract: Chemical short range order and topology of Ge$_{x}$Ga$_{x}$Te$_{100-2x}$ glasses was investigated by neutron- and x-ray diffraction as well as Ge and Ga K-edge extended x-ray absorption fine structure (EXAFS) measurements. Large scale structural models were obtained by fitting experimental datasets simultaneously with the reverse Monte Carlo simulation technique. Models, relying only on experimental data and basic physical information without constraining the average coordination numbers, give 3.9 - 4.1 for the number of the atoms in the first coordination sphere of Ge atoms, while the average number of first neighbors of Ga atoms scatters around 3.8. The average coordination number of Te atoms is significantly higher than 2 for $x$ = 12.5 and 14.3. It is found that the vast majority of MTe$_4$ (M=Ge or Ga) tetrahedra have at least one corner sharing MTe$_4$ neighbor.


title: Top-K Deep Video Analytics: A Probabilistic Approach

abstract: The impressive accuracy of deep neural networks (DNNs) has created great demands on practical analytics over video data. Although efficient and accurate, the latest video analytic systems have not supported analytics beyond selection and aggregation queries. In data analytics, Top-K is a very important analytical operation that enables analysts to focus on the most important entities. In this paper, we present Everest, the first system that supports efficient and accurate Top-K video analytics. Everest ranks and identifies the most interesting frames/moments from videos with probabilistic guarantees. Everest is a system built with a careful synthesis of deep computer vision models, uncertain data management, and Top-K query processing. Evaluations on real-world videos and the latest Visual Road benchmark show that Everest achieves between 14.3x to 20.6x higher efficiency than baseline approaches with high result accuracy


title: Interfaz Grafica para la Gestion SDWN de un Entorno WLAN

abstract: This paper presents a graphical interface for the management of a wireless local area network that integrates a set of coordinated Wi-Fi access points. The interface interacts with a network application that is responsible for load balancing and mobility management. The graphical application is able to obtain and display the information stored in a system that includes a number of access points, and displays it in a friendly way for the network manager. Finally, the application allows remote management of the system, adjusting its parameters or making transfers between access points.


title: Chloride ions as integral parts of hydrogen bonded networks in aqueous salt solutions: the appearance of solvent separated anion pairs

abstract: Hydrogen bonding to chloride ions has been frequently discussed over the past 5 decades. Still, the possible role of such secondary intermolecular bonding interactions in hydrogen bonded networks has not been investigated in any detail. Here we consider computer models of concentrated aqueous LiCl solutions and compute usual hydrogen bond network characteristics, such as distributions of cluster sizes and of cyclic entities, both for models that take and do not take chloride ions into account. During the analysis of hydrogen bonded rings, a significant amount of 'solvent separated anion pairs' have been detected at high LiCl concentrations. It is demonstrated that taking halide anions into account as organic constituents of the hydrogen bonded network does make the interpretation of structural details significantly more meaningful than when considering water molecules only. Finally, we compare simulated structures generated by 'good' and 'bad' potential sets on the basis of the tools developed here, and show that this novel concept is, indeed, also helpful for distinguishing between reasonable and meaningless structural models.


title: Computational Modeling of Cardiac Growth and Remodeling in Pressure Overloaded Hearts -- Linking Microstructure to Organ Phenotype

abstract: Cardiac growth and remodeling (G&R) refers to structural changes in myocardial tissue in response to chronic alterations in loading conditions. One such condition is pressure overload where elevated wall stresses stimulate the growth in cardiomyocyte thickness, associated with a phenotype of concentric hypertrophy at the organ scale, and promote fibrosis. The initial hypertrophic response can be considered adaptive and beneficial by favoring myocyte survival, but over time if pressure overload conditions persist, maladaptive mechanisms favoring cell death and fibrosis start to dominate, ultimately mediating the transition towards an overt heart failure phenotype. The underlying mechanisms linking biological factors at the myocyte level to biomechanical factors at the systemic and organ level remain poorly understood. Computational models of G&R show high promise as a unique framework for providing a quantitative link between myocardial stresses and strains at the organ scale to biological regulatory processes at the cellular level which govern the hypertrophic response. However, microstructurally motivated, rigorously validated computational models of G&R are still in their infancy. This article provides an overview of the current state-of-the-art of computational models to study cardiac G&R. The microstructure and mechanosensing/mechanotransduction within cells of the myocardium is discussed and quantitative data from previous experimental and clinical studies is summarized. We conclude with a discussion of major challenges and possible directions of future research that can advance the current state of cardiac G&R computational modeling.


title: Better Depth-Width Trade-offs for Neural Networks through the lens of Dynamical Systems

abstract: The expressivity of neural networks as a function of their depth, width and type of activation units has been an important question in deep learning theory. Recently, depth separation results for ReLU networks were obtained via a new connection with dynamical systems, using a generalized notion of fixed points of a continuous map $f$, called periodic points. In this work, we strengthen the connection with dynamical systems and we improve the existing width lower bounds along several aspects. Our first main result is period-specific width lower bounds that hold under the stronger notion of $L^1$-approximation error, instead of the weaker classification error. Our second contribution is that we provide sharper width lower bounds, still yielding meaningful exponential depth-width separations, in regimes where previous results wouldn't apply. A byproduct of our results is that there exists a universal constant characterizing the depth-width trade-offs, as long as $f$ has odd periods. Technically, our results follow by unveiling a tighter connection between the following three quantities of a given function: its period, its Lipschitz constant and the growth rate of the number of oscillations arising under compositions of the function $f$ with itself.


title: New wavelet method based on Shifted Lucas polynomials: A tau approach

abstract: In current work, non-familiar shifted Lucas polynomials are introduced. We have constructed a computational wavelet technique for solution of initial/boundary value second order differential equations. For this numerical scheme, we have developed weight function and Rodrigues' formula for Lucas polynomials. Further, Lucas polynomials and their properties are used to propose shifted Lucas polynomials and then utilization of shifted Lucas polynomials provides us shifted Lucas wavelet. We furnished the operational matrix of differentiation and the product operational matrix of the shifted Lucas wavelets. Moreover, convergence and error analysis ensure accuracy of the proposed method. Illustrative examples show that the present method is numerically fruitful, effective and convenient for solving differential equations


title: Data-Driven Control of Unknown Systems: A Linear Programming Approach

abstract: We consider the problem of discounted optimal state-feedback regulation for general unknown deterministic discrete-time systems. It is well known that open-loop instability of systems, non-quadratic cost functions and complex nonlinear dynamics, as well as the on-policy behavior of many reinforcement learning (RL) algorithms, make the design of model-free optimal adaptive controllers a challenging task. We depart from commonly used least-squares and neural network approximation methods in conventional model-free control theory, and propose a novel family of data-driven optimization algorithms based on linear programming, off-policy Q-learning and randomized experience replay. We develop both policy iteration (PI) and value iteration (VI) methods to compute an approximate optimal feedback controller with high precision and without the knowledge of a system model and stage cost function. Simulation studies confirm the effectiveness of the proposed methods.


title: Risk-Averse Learning by Temporal Difference Methods

abstract: We consider reinforcement learning with performance evaluated by a dynamic risk measure. We construct a projected risk-averse dynamic programming equation and study its properties. Then we propose risk-averse counterparts of the methods of temporal differences and we prove their convergence with probability one. We also perform an empirical study on a complex transportation problem.


title: On non-admissible irreducible modulo $p$ representations of $GL_{2}(\mathbb{Q}_{p^{2}})$

abstract: We use a Diamond diagram attached to a $2$-dimensional reducible split mod $p$ Galois representation of $\mathrm{Gal}(\overline{\mathbb{Q}_{p}}/\mathbb{Q}_{p^{2}})$ to construct a non-admissible smooth irreducible mod $p$ representation of $GL_{2}(\mathbb{Q}_{p^{2}})$ following the approach of Daniel Le.


title: The Multiplicative Jordan Decomposition in the Integral Group Ring $\mathbb{Z}[Q_8 \times C_p]$

abstract: Let $p$ be a prime such that the multiplicative order $m$ of $2$ modulo $p$ is even. We prove that the integral group ring $\mathbb{Z}[Q_8 \times C_p]$ has the multiplicative Jordan decomposition property when $m$ is congruent to $2$ modulo $4$. There are infinitely many such primes and these primes include the case $p \equiv 3 \pmod{4}$. We also prove that $\mathbb{Z}[Q_8 \times C_5]$ has the multiplicative Jordan decomposition property in a new way.


title: Analysis of Gait-Event-related Brain Potentials During Instructed And Spontaneous Treadmill Walking -- Technical Affordances and used Methods

abstract: To improve the understanding of human gait and to facilitate novel developments in gait rehabilitation, the neural correlates of human gait as measured by means of non-invasive electroencephalography (EEG) have been investigated recently. Particularly, gait-related event-related brain potentials (gERPs) may provide information about the functional role of cortical brain regions in human gait control. The purpose of this paper is to explore possible experimental and technical solutions for time-sensitive analysis of human gait-related ERPs during spontaneous and instructed treadmill walking. A solution (HW/SW) for synchronous recording of gait- and EEG data was developed, tested and piloted. The solution consists of a custom-made USB synchronization interface, a time-synchronization module and a data merging module, allowing temporal synchronization of recording devices for time-sensitive extraction of gait markers for analysis of gait-related ERPs and for the training of artificial neural networks. In the present manuscript, the hardware and software components were tested with the following devices: A treadmill with an integrated pressure plate for gait analysis (zebris FDM-T) and an Acticap non-wireless 32-channel EEG-system (Brain Products GmbH). The usability and validity of the developed solution was tested in a pilot study (n = 3 healthy participants, n=3 females, mean age = 22.75 years). Recorded EEG data was segmented and analyzed according to the detected gait markers for the analysis of gait-related ERPs. Finally, EEG periods were used to train a deep learning artificial neural network as classifier of gait phases. The results obtained in this pilot study, although preliminary, support the feasibility of the solution for the application of gait-related EEG analysis..


title: Gaining a Sense of Touch. Physical Parameters Estimation using a Soft Gripper and Neural Networks

abstract: Soft grippers are gaining significant attention in the manipulation of elastic objects, where it is required to handle soft and unstructured objects which are vulnerable to deformations. A crucial problem is to estimate the physical parameters of a squeezed object to adjust the manipulation procedure, which is considered as a significant challenge. To the best of the authors' knowledge, there is not enough research on physical parameters estimation using deep learning algorithms on measurements from direct interaction with objects using robotic grippers. In our work, we proposed a trainable system for the regression of a stiffness coefficient and provided extensive experiments using the physics simulator environment. Moreover, we prepared the application that works in the real-world scenario. Our system can reliably estimate the stiffness of an object using the Yale OpenHand soft gripper based on readings from Inertial Measurement Units (IMUs) attached to its fingers. Additionally, during the experiments, we prepared three datasets of signals gathered while squeezing objects -- two created in the simulation environment and one composed of real data.


title: Joint measurability structures realizable with qubit measurements: incompatibility via marginal surgery

abstract: Measurements in quantum theory exhibit incompatibility, i.e., they can fail to be jointly measurable. An intuitive way to represent the (in)compatibility relations among a set of measurements is via a hypergraph representing their joint measurability structure: its vertices represent measurements and its hyperedges represent (all and only) subsets of compatible measurements. Projective measurements in quantum theory realize (all and only) joint measurability structures that are graphs. On the other hand, general measurements represented by positive operator-valued measures (POVMs) can realize arbitrary joint measurability structures. Here we explore the scope of joint measurability structures realizable with qubit POVMs. We develop a technique that we term marginal surgery to obtain nontrivial joint measurability structures starting from a set of compatible measurements. We show explicit examples of marginal surgery on a special set of qubit POVMs to construct joint measurability structures such as $N$-cycle and $N$-Specker scenarios for any integer $N\geq 3$. We also show the realizability of various joint measurability structures with $N\in\{4,5,6\}$ vertices. In particular, we show that all possible joint measurability structures with $N=4$ vertices are realizable. We conjecture that all joint measurability structures are realizable with qubit POVMs. This contrasts with the unbounded dimension required in R. Kunjwal et al., Phys. Rev. A 89, 052126 (2014). Our results also render this previous construction maximally efficient in terms of the required Hilbert space dimension. We also obtain a sufficient condition for the joint measurability of any set of binary qubit POVMs which powers many of our results and should be of independent interest.


title: Riemann solitons and almost Riemann solitons on almost Kenmotsu manifolds

abstract: The aim of this article is to study the Riemann soliton and gradient almost Riemann soliton on certain class of almost Kenmotsu manifolds. Also some suitable examples of Kenmotsu and $(\kappa,\mu)'$-almost Kenmotsu manifolds are constructed to justify our results.


title: Gopakumar-Vafa type invariants on Calabi-Yau 4-folds via descendent insertions

abstract: The Gopakumar-Vafa type invariants on Calabi-Yau 4-folds (which are non-trivial only for genus zero and one) are defined by Klemm-Pandharipande from Gromov-Witten theory, and their integrality is conjectured. In a previous work of Cao-Maulik-Toda, $\mathrm{DT}_4$ invariants with primary insertions on moduli spaces of one dimensional stable sheaves are used to give a sheaf theoretical interpretation of the genus zero GV type invariants. In this paper, we propose a sheaf theoretical interpretation of the genus one GV type invariants using descendent insertions on the above moduli spaces. The conjectural formula in particular implies nontrivial constraints on genus zero GV type (equivalently GW) invariants of CY 4-folds which can be proved by the WDVV equation.


title: The possibility to study in-medium modification of $J/\psi$ mesons from their photoproduction on nuclei near threshold in the case of presence of the LHCb pentaquark states $P^+_c$ in this photoproduction

abstract: We study the $J/\psi$ photoproduction from nuclei in the near-threshold beam energy region of $E_{\gamma}$=5--11 GeV within the nuclear spectral function approach by considering incoherent direct (${\gamma}N \to {J/\psi}N$) and two-step (${\gamma}p \to P^+_c(4312)$, $P^+_c(4312) \to {J/\psi}p$; ${\gamma}p \to P^+_c(4440)$, $P^+_c(4440) \to {J/\psi}p$; ${\gamma}p \to P^+_c(4457)$, $P^+_c(4457) \to {J/\psi}p$) $J/\psi$ production processes. We calculate the absolute excitation functions for the non-resonant and resonant production of $J/\psi$ mesons off $^{12}$C and $^{208}$Pb target nuclei within the different scenarios for in-medium modification of the directly photoproduced $J/\psi$ mesons and for branching ratios of the decays $P^+_c(4312) \to {J/\psi}p$, $P^+_c(4440) \to {J/\psi}p$ and $P^+_c(4457) \to {J/\psi}p$. We show that the non-resonant subthreshold $J/\psi$ production in ${\gamma}A$ reactions reveals some sensitivity to employed in-medium modification scenarios for $J/\psi$ mesons, which is not masked by the resonantly produced $J/\psi$ mesons, only if above branching ratios are less than 5\%. We also demonstrate that if these branching ratios more than 5\% then the presence of the $P^+_c(4312)$, $P^+_c(4440)$ and $P^+_c(4457)$ resonances in $J/\psi$ photoproduction on nuclei produces above threshold additional enhancements in the behavior of the total $J/\psi$ creation cross section on nuclei, which could be also studied in the future JLab experiments at the CEBAF facility to provide both further evidence for their existence and valuable information on their nature.


title: Towards Identifying and closing Gaps in Assurance of autonomous Road vehicleS -- a collection of Technical Notes Part 1

abstract: This report provides an introduction and overview of the Technical Topic Notes (TTNs) produced in the Towards Identifying and closing Gaps in Assurance of autonomous Road vehicleS (Tigars) project. These notes aim to support the development and evaluation of autonomous vehicles. Part 1 addresses: Assurance-overview and issues, Resilience and Safety Requirements, Open Systems Perspective and Formal Verification and Static Analysis of ML Systems. Part 2: Simulation and Dynamic Testing, Defence in Depth and Diversity, Security-Informed Safety Analysis, Standards and Guidelines.


title: Towards Identifying and closing Gaps in Assurance of autonomous Road vehicleS -- a collection of Technical Notes Part 2

abstract: This report provides an introduction and overview of the Technical Topic Notes (TTNs) produced in the Towards Identifying and closing Gaps in Assurance of autonomous Road vehicleS (Tigars) project. These notes aim to support the development and evaluation of autonomous vehicles. Part 1 addresses: Assurance-overview and issues, Resilience and Safety Requirements, Open Systems Perspective and Formal Verification and Static Analysis of ML Systems. This report is Part 2 and discusses: Simulation and Dynamic Testing, Defence in Depth and Diversity, Security-Informed Safety Analysis, Standards and Guidelines.


title: Design of Mutation Operators for Testing Geographic Information Systems

abstract: In this article, we propose the definition of specific mutation operators for testing Geographic Information Systems. We describe the process for applying the operators and generating mutants, and present a case study where these mutation operators are applied to two real-world applications.


title: Characterisation of rational and NURBS developable surfaces in Computer Aided Design

abstract: In this paper we provide a characterisation of rational developable surfaces in terms of the blossoms of the bounding curves and three rational functions $\Lambda$, $M$, $\nu$. Properties of developable surfaces are revised in this framework. In particular, a closed algebraic formula for the edge of regression of the surface is obtained in terms of the functions $\Lambda$, $M$, $\nu$, which are closely related to the ones that appear in the standard decomposition of the derivative of the parametrisation of one of the bounding curves in terms of the director vector of the rulings and its derivative. It is also shown that all rational developable surfaces can be described as the set of developable surfaces which can be constructed with a constant $\Lambda$, $M$, $\nu$ . The results are readily extended to rational spline developable surfaces.


title: Quantum Many-Body Theory for Exciton-Polaritons in Semiconductor Mie Resonators in the Non-Equilibrium

abstract: We implement externally excited ZnO Mie resonators in a framework of a generalized Hubbard Hamiltonian to investigate the lifetimes of excitons and exciton-polaritons out of thermodynamical equilibrium. Our results are derived by a Floquet-Keldysh-Green's formalism with Dynamical Mean Field Theory (DMFT) and a second order iterative perturbation theory solver (IPT). We find that the Fano resonance which originates from coupling of the continuum of electronic density of states to the semiconductor Mie resonator yields polaritons with lifetimes between 0.6 ps and 1.45 ps. These results are compared to ZnO polariton lasers and to ZnO random lasers. We interpret the peaks of the exciton-polariton lifetimes in our results as a sign of gain narrowing which may lead to stable polariton lasing modes in the single excited ZnO Mie resonator. This form of gain may lead to polariton random lasing in an ensemble of ZnO Mie resonators in the non-equilibrium.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.mtrl-sci physics.optics quant-ph


title: Quantum Refrigeration with Indefinite Causal Order

abstract: We propose a thermodynamic refrigeration cycle which uses Indefinite Causal Orders to achieve non-classical cooling. The cycle cools a cold reservoir while consuming purity in a control qubit. We first show that the application to an input state of two identical thermalizing channels of temperature $T$ in an indefinite causal order can result in an output state with a temperature not equal to $T$. We investigate the properties of the refrigeration cycle and show that thermodynamically, the result is compatible with unitary quantum mechanics in the circuit model but could not be achieved classically. We believe that this cycle could be implemented experimentally using tabletop photonics. Our result suggests the development of a new class of thermodynamic resource theories in which operations are allowed to be performed in an Indefinite Causal Order.


title: Two-temperature Magnetohydrodynamic simulations for sub-relativistic AGN jets:Dependence on the fraction of the electron heating

abstract: We present the results of two-temperature magnetohydrodynamic simulations of the propagation of sub-relativistic jets of active galactic nuclei. The dependence of the electron and ion temperature distributions on the fraction of electron heating fe at the shock front is studied for fe=0, 0.05, and 0.2. Numerical results indicate that in sub-relativistic, rarefied jets, the jet plasma crossing the terminal shock forms a hot, two-temperature plasma in which the ion temperature is higher than the electron temperature. The two-temperature plasma expands and forms a backflow referred to as a cocoon, in which the ion temperature remains higher than the electron temperature for longer than 100 Myr. Electrons in the cocoon are continuously heated by ions through Coulomb collisions, and the electron temperature thus remains at Te > 10^9 K in the cocoon. X-ray emissions from the cocoon are weak because the electron number density is low. Meanwhile, soft X-rays are emitted from the shocked intracluster medium surrounding the cocoon. Mixing of the jet plasma and the shocked intracluster medium through the Kelvin--Helmholtz instability at the interface enhances X-ray emissions around the contact discontinuity between the cocoon and shocked intracluster medium.


title: PenRed: An extensible and parallel Monte-Carlo framework for radiation transport based on PENELOPE

abstract: Monte Carlo methods provide detailed and accurate results for radiation transport simulations. Unfortunately, the high computational cost of these methods limits its usage in real-time applications. Moreover, existing computer codes do not provide a methodology for adapting these kind of simulations to specific problems without advanced knowledge of the corresponding code system, and this restricts their applicability. To help solve these current limitations, we present PenRed, a general-purpose, stand-alone, extensible and modular framework code based on PENELOPE for parallel Monte Carlo simulations of electron-photon transport through matter. It has been implemented in C++ programming language and takes advantage of modern object-oriented technologies. In addition, PenRed offers the capability to read and process DICOM images as well as to construct and simulate image-based voxelized geometries, so as to facilitate its usage in medical applications. Our framework has been successfully verified against the original PENELOPE Fortran code. Furthermore, the implemented parallelism has been tested showing a significant improvement in the simulation time without any loss in precision of results.

categories: physics.comp-ph physics.atom-ph physics.ins-det physics.med-ph


title: On six-photon entangled state emitted from a single third-order parametric down-conversion process

abstract: We consider six-photon entangled state emitted from a single third-order parametric down-conversion process. In the regime of weak nonlinearities, we present a symmetry detector which is capable of analyzing the twin-beam six-photon symmetric states. By cascading the symmetry detectors, as an application, it is shown that one can purify the desired six-photon entangled state from an arbitrary twin-beam six-photon symmetric state. With linear optics we propose a fruitful scheme for exploring a class of multimode-photon entangled states from third-order parametric down-conversion process. Furthermore, we provide a method to generate the six-photon polarization entangled Greenberger-Horne-Zeilinger state based on linear optics and weak nonlinearities.


title: Preventing Clean Label Poisoning using Gaussian Mixture Loss

abstract: Since 2014 when Szegedy et al. showed that carefully designed perturbations of the input can lead Deep Neural Networks (DNNs) to wrongly classify its label, there has been an ongoing research to make DNNs more robust to such malicious perturbations. In this work, we consider a poisoning attack called Clean Labeling poisoning attack (CLPA). The goal of CLPA is to inject seemingly benign instances which can drastically change decision boundary of the DNNs due to which subsequent queries at test time can be mis-classified. We argue that a strong defense against CLPA can be embedded into the model during the training by imposing features of the network to follow a Large Margin Gaussian Mixture distribution in the penultimate layer. By having such a prior knowledge, we can systematically evaluate how unusual the example is, given the label it is claiming to be. We demonstrate our builtin defense via experiments on MNIST and CIFAR datasets. We train two models on each dataset: one trained via softmax, another via LGM. We show that using LGM can substantially reduce the effectiveness of CLPA while having no additional overhead of data sanitization. The code to reproduce our results is available online.


title: Learning to Resolve Alliance Dilemmas in Many-Player Zero-Sum Games

abstract: Zero-sum games have long guided artificial intelligence research, since they possess both a rich strategy space of best-responses and a clear evaluation metric. What's more, competition is a vital mechanism in many real-world multi-agent systems capable of generating intelligent innovations: Darwinian evolution, the market economy and the AlphaZero algorithm, to name a few. In two-player zero-sum games, the challenge is usually viewed as finding Nash equilibrium strategies, safeguarding against exploitation regardless of the opponent. While this captures the intricacies of chess or Go, it avoids the notion of cooperation with co-players, a hallmark of the major transitions leading from unicellular organisms to human civilization. Beyond two players, alliance formation often confers an advantage; however this requires trust, namely the promise of mutual cooperation in the face of incentives to defect. Successful play therefore requires adaptation to co-players rather than the pursuit of non-exploitability. Here we argue that a systematic study of many-player zero-sum games is a crucial element of artificial intelligence research. Using symmetric zero-sum matrix games, we demonstrate formally that alliance formation may be seen as a social dilemma, and empirically that na\"ive multi-agent reinforcement learning therefore fails to form alliances. We introduce a toy model of economic competition, and show how reinforcement learning may be augmented with a peer-to-peer contract mechanism to discover and enforce alliances. Finally, we generalize our agent model to incorporate temporally-extended contracts, presenting opportunities for further work.


title: Real-Time target detection in maritime scenarios based on YOLOv3 model

abstract: In this work a novel ships dataset is proposed consisting of more than 56k images of marine vessels collected by means of web-scraping and including 12 ship categories. A YOLOv3 single-stage detector based on Keras API is built on top of this dataset. Current results on four categories (cargo ship, naval ship, oil ship and tug ship) show Average Precision up to 96% for Intersection over Union (IoU) of 0.5 and satisfactory detection performances up to IoU of 0.8. A Data Analytics GUI service based on QT framework and Darknet-53 engine is also implemented in order to simplify the deployment process and analyse massive amount of images even for people without Data Science expertise.


title: BitcoinF: Achieving Fairness for Bitcoin in Transaction-Fee-Only Model

abstract: A blockchain, such as Bitcoin, is an append-only, secure, transparent, distributed ledger. A fair blockchain is expected to have healthy metrics; high honest mining power, low processing latency, i.e., low wait times for transactions and stable price of consumption, i.e., the minimum transaction fee required to have a transaction processed. As Bitcoin matures, the influx of transactions increases and the block rewards become insignificant. We show that under these conditions, it becomes hard to maintain the health of the blockchain. In Bitcoin, under these mature operating conditions (MOC), the miners would find it challenging to cover their mining costs as there would be no more revenue from merely mining a block. It may cause miners not to continue mining, threatening the blockchain's security. Further, as we show in this paper using simulations, the cost of acting in favor of the health of the blockchain, under MOC, is very high in Bitcoin, causing all miners to process transactions greedily. It leads to stranded transactions, i.e., transactions offering low transaction fees, experiencing unreasonably high processing latency. To make matters worse, a compounding effect of these stranded transactions is the rising price of consumption. Such phenomena not only induce unfairness as experienced by the miners and the users but also deteriorate the health of the blockchain. We propose BitcoinF transaction processing protocol, a simple, yet highly effective modification to the existing Bitcoin protocol to fix these issues of unfairness. BitcoinF resolves these issues of unfairness while preserving the ability of the users to express urgency and have their transactions prioritized.


title: Hypernetwork approach to generating point clouds

abstract: In this work, we propose a novel method for generating 3D point clouds that leverage properties of hyper networks. Contrary to the existing methods that learn only the representation of a 3D object, our approach simultaneously finds a representation of the object and its 3D surface. The main idea of our HyperCloud method is to build a hyper network that returns weights of a particular neural network (target network) trained to map points from a uniform unit ball distribution into a 3D shape. As a consequence, a particular 3D shape can be generated using point-by-point sampling from the assumed prior distribution and transforming sampled points with the target network. Since the hyper network is based on an auto-encoder architecture trained to reconstruct realistic 3D shapes, the target network weights can be considered a parametrization of the surface of a 3D shape, and not a standard representation of point cloud usually returned by competitive approaches. The proposed architecture allows finding mesh-based representation of 3D objects in a generative manner while providing point clouds en pair in quality with the state-of-the-art methods.


title: Ascertaining price formation in cryptocurrency markets with DeepLearning

abstract: The cryptocurrency market is amongst the fastest-growing of all the financial markets in the world. Unlike traditional markets, such as equities, foreign exchange and commodities, cryptocurrency market is considered to have larger volatility and illiquidity. This paper is inspired by the recent success of using deep learning for stock market prediction. In this work, we analyze and present the characteristics of the cryptocurrency market in a high-frequency setting. In particular, we applied a deep learning approach to predict the direction of the mid-price changes on the upcoming tick. We monitored live tick-level data from $8$ cryptocurrency pairs and applied both statistical and machine learning techniques to provide a live prediction. We reveal that promising results are possible for cryptocurrencies, and in particular, we achieve a consistent $78\%$ accuracy on the prediction of the mid-price movement on live exchange rate of Bitcoins vs US dollars.


title: Task Augmentation by Rotating for Meta-Learning

abstract: Data augmentation is one of the most effective approaches for improving the accuracy of modern machine learning models, and it is also indispensable to train a deep model for meta-learning. In this paper, we introduce a task augmentation method by rotating, which increases the number of classes by rotating the original images 90, 180 and 270 degrees, different from traditional augmentation methods which increase the number of images. With a larger amount of classes, we can sample more diverse task instances during training. Therefore, task augmentation by rotating allows us to train a deep network by meta-learning methods with little over-fitting. Experimental results show that our approach is better than the rotation for increasing the number of images and achieves state-of-the-art performance on miniImageNet, CIFAR-FS, and FC100 few-shot learning benchmarks. The code is available on \url{www.github.com/AceChuse/TaskLevelAug}.


title: Firearm Detection and Segmentation Using an Ensemble of Semantic Neural Networks

abstract: In recent years we have seen an upsurge in terror attacks around the world. Such attacks usually happen in public places with large crowds to cause the most damage possible and get the most attention. Even though surveillance cameras are assumed to be a powerful tool, their effect in preventing crime is far from clear due to either limitation in the ability of humans to vigilantly monitor video surveillance or for the simple reason that they are operating passively. In this paper, we present a weapon detection system based on an ensemble of semantic Convolutional Neural Networks that decomposes the problem of detecting and locating a weapon into a set of smaller problems concerned with the individual component parts of a weapon. This approach has computational and practical advantages: a set of simpler neural networks dedicated to specific tasks requires less computational resources and can be trained in parallel; the overall output of the system given by the aggregation of the outputs of individual networks can be tuned by a user to trade-off false positives and false negatives; finally, according to ensemble theory, the output of the overall system will be robust and reliable even in the presence of weak individual models. We evaluated our system running simulations aimed at assessing the accuracy of individual networks and the whole system. The results on synthetic data and real-world data are promising, and they suggest that our approach may have advantages compared to the monolithic approach based on a single deep convolutional neural network.


title: Causal Transfer for Imitation Learning and Decision Making under Sensor-shift

abstract: Learning from demonstrations (LfD) is an efficient paradigm to train AI agents. But major issues arise when there are differences between (a) the demonstrator's own sensory input, (b) our sensors that observe the demonstrator and (c) the sensory input of the agent we train. In this paper, we propose a causal model-based framework for transfer learning under such "sensor-shifts", for two common LfD tasks: (1) inferring the effect of the demonstrator's actions and (2) imitation learning. First we rigorously analyze, on the population-level, to what extent the relevant underlying mechanisms (the action effects and the demonstrator policy) can be identified and transferred from the available observations together with prior knowledge of sensor characteristics. And we device an algorithm to infer these mechanisms. Then we introduce several proxy methods which are easier to calculate, estimate from finite data and interpret than the exact solutions, alongside theoretical bounds on their closeness to the exact ones. We validate our two main methods on simulated and semi-real world data.


title: Fake Review Detection Using Behavioral and Contextual Features

abstract: User reviews reflect significant value of product in the world of e-market. Many firms or product providers hire spammers for misleading new customers by posting spam reviews. There are three types of fake reviews, untruthful reviews, brand reviews and non-reviews. All three types mislead the new customers. A multinomial organization "Yelp" is separating fake reviews from non-fake reviews since last decade. However, there are many e-commerce sites which do not filter fake and non-fake reviews separately. Automatic fake review detection is focused by researcher for last ten years. Many approaches and feature set are proposed for improving classification model of fake review detection. There are two types of dataset commonly used in this research area: psuedo fake and real life reviews. Literature reports low performance of classification model real life dataset if compared with pseudo fake reviews. After investigation behavioral and contextual features are proved important for fake review detection Our research has exploited important behavioral feature of reviewer named as "reviewer deviation". Our study comprises of investigating reviewer deviation with other contextual and behavioral features. We empirically proved importance of selected feature set for classification model to identify fake reviews. We ranked features in selected feature set where reviewer deviation achieved ninth rank. To assess the viability of selected feature set we scaled dataset and concluded that scaling dataset can improve recall as well as accuracy. Our selected feature set contains a contextual feature which capture text similarity between reviews of a reviewer. We experimented on NNC, LTC and BM25 term weighting schemes for calculating text similarity of reviews. We report that BM25 outperformed other term weighting scheme.


title: A Convolutional Baseline for Person Re-Identification Using Vision and Language Descriptions

abstract: Classical person re-identification approaches assume that a person of interest has appeared across different cameras and can be queried by one of the existing images. However, in real-world surveillance scenarios, frequently no visual information will be available about the queried person. In such scenarios, a natural language description of the person by a witness will provide the only source of information for retrieval. In this work, person re-identification using both vision and language information is addressed under all possible gallery and query scenarios. A two stream deep convolutional neural network framework supervised by cross entropy loss is presented. The weights connecting the second last layer to the last layer with class probabilities, i.e., logits of softmax layer are shared in both networks. Canonical Correlation Analysis is performed to enhance the correlation between the two modalities in a joint latent embedding space. To investigate the benefits of the proposed approach, a new testing protocol under a multi modal ReID setting is proposed for the test split of the CUHK-PEDES and CUHK-SYSU benchmarks. The experimental results verify the merits of the proposed system. The learnt visual representations are more robust and perform 22\% better during retrieval as compared to a single modality system. The retrieval with a multi modal query greatly enhances the re-identification capability of the system quantitatively as well as qualitatively.


title: Vision based body gesture meta features for Affective Computing

abstract: Early detection of psychological distress is key to effective treatment. Automatic detection of distress, such as depression, is an active area of research. Current approaches utilise vocal, facial, and bodily modalities. Of these, the bodily modality is the least investigated, partially due to the difficulty in extracting bodily representations from videos, and partially due to the lack of viable datasets. Existing body modality approaches use automatic categorization of expressions to represent body language as a series of specific expressions, much like words within natural language. In this dissertation I present a new type of feature, within the body modality, that represents meta information of gestures, such as speed, and use it to predict a non-clinical depression label. This differs to existing work by representing overall behaviour as a small set of aggregated meta features derived from a person's movement. In my method I extract pose estimation from videos, detect gestures within body parts, extract meta information from individual gestures, and finally aggregate these features to generate a small feature vector for use in prediction tasks. I introduce a new dataset of 65 video recordings of interviews with self-evaluated distress, personality, and demographic labels. This dataset enables the development of features utilising the whole body in distress detection tasks. I evaluate my newly introduced meta-features for predicting depression, anxiety, perceived stress, somatic stress, five standard personality measures, and gender. A linear regression based classifier using these features achieves a 82.70% F1 score for predicting depression within my novel dataset.


title: Medicine Strip Identification using 2-D Cepstral Feature Extraction and Multiclass Classification Methods

abstract: Misclassification of medicine is perilous to the health of a patient, more so if the said patient is visually impaired or simply did not recognize the color, shape or type of medicine strip. This paper proposes a method for identification of medicine strips by 2-D cepstral analysis of their images followed by performing classification that has been done using the K-Nearest Neighbor (KNN), Support Vector Machine (SVM) and Logistic Regression (LR) Classifiers. The 2-D cepstral features extracted are extremely distinct to a medicine strip and consequently make identifying them exceptionally accurate. This paper also proposes the Color Gradient and Pill shape Feature (CGPF) extraction procedure and discusses the Binary Robust Invariant Scalable Keypoints (BRISK) algorithm as well. The mentioned algorithms were implemented and their identification results have been compared.


title: Comment on "`Inconsistency of the conventional theory of superconductivity"' by Hirsch J.E

abstract: A rebuttal of a recent article by Hirsch J.E. is presented below. To begin with, the main assumption, regarding the Meissner effect, which the whole argument relies upon, is disproved. Besides, the subsequent analysis misconstrues an original view of the Meissner effect by other authors [2]. Finally, the discussion of the Joule effect turns out to violate the first law of thermodynamics.


title: An AGI Modifying Its Utility Function in Violation of the Orthogonality Thesis

abstract: An artificial general intelligence (AGI) might have an instrumental drive to modify its utility function to improve its ability to cooperate, bargain, promise, threaten, and resist and engage in blackmail. Such an AGI would necessarily have a utility function that was at least partially observable and that was influenced by how other agents chose to interact with it. This instrumental drive would conflict with the orthogonality thesis since the modifications would be influenced by the AGI's intelligence. AGIs in highly competitive environments might converge to having nearly the same utility function, one optimized to favorably influencing other agents through game theory.


title: Deepfakes for Medical Video De-Identification: Privacy Protection and Diagnostic Information Preservation

abstract: Data sharing for medical research has been difficult as open-sourcing clinical data may violate patient privacy. Traditional methods for face de-identification wipe out facial information entirely, making it impossible to analyze facial behavior. Recent advancements on whole-body keypoints detection also rely on facial input to estimate body keypoints. Both facial and body keypoints are critical in some medical diagnoses, and keypoints invariability after de-identification is of great importance. Here, we propose a solution using deepfake technology, the face swapping technique. While this swapping method has been criticized for invading privacy and portraiture right, it could conversely protect privacy in medical video: patients' faces could be swapped to a proper target face and become unrecognizable. However, it remained an open question that to what extent the swapping de-identification method could affect the automatic detection of body keypoints. In this study, we apply deepfake technology to Parkinson's disease examination videos to de-identify subjects, and quantitatively show that: face-swapping as a de-identification approach is reliable, and it keeps the keypoints almost invariant, significantly better than traditional methods. This study proposes a pipeline for video de-identification and keypoint preservation, clearing up some ethical restrictions for medical data sharing. This work could make open-source high quality medical video datasets more feasible and promote future medical research that benefits our society.


title: Towards information-rich, logical text generation with knowledge-enhanced neural models

abstract: Text generation system has made massive promising progress contributed by deep learning techniques and has been widely applied in our life. However, existing end-to-end neural models suffer from the problem of tending to generate uninformative and generic text because they cannot ground input context with background knowledge. In order to solve this problem, many researchers begin to consider combining external knowledge in text generation systems, namely knowledge-enhanced text generation. The challenges of knowledge enhanced text generation including how to select the appropriate knowledge from large-scale knowledge bases, how to read and understand extracted knowledge, and how to integrate knowledge into generation process. This survey gives a comprehensive review of knowledge-enhanced text generation systems, summarizes research progress to solving these challenges and proposes some open issues and research directions.


title: Sturm-type bounds for modular forms over functions fields

abstract: In this paper, we obtain two analogues of the Sturm bound for modular forms in the function field setting. In the case of mixed characteristic, we prove that any harmonic cochain is uniquely determined by an explicit finite number of its first Fourier coefficients where our bound is much smaller than the ones in the literature. A similar bound is derived for generators of the Hecke algebra on harmonic cochains. As an application, we present a computational criterion for checking whether two elliptic curves over the rational function field $\mathbb{F}_q(\theta)$ with same conductor are isogenous. In the case of equal characteristic, we also prove that any Drinfeld modular form is uniquely determined by an explicit finite number of its first coefficients in the $t$-expansion.


title: Can Primal Methods Outperform Primal-dual Methods in Decentralized Dynamic Optimization?

abstract: In this paper, we consider the decentralized dynamic optimization problem defined over a multi-agent network. Each agent possesses a time-varying local objective function, and all agents aim to collaboratively track the drifting global optimal solution that minimizes the summation of all local objective functions. The decentralized dynamic optimization problem can be solved by primal or primal-dual methods, and when the problem degenerates to be static, it has been proved in literature that primal-dual methods are superior to primal ones. This motivates us to ask: are primal-dual methods necessarily better than primal ones in decentralized dynamic optimization? To answer this question, we investigate and compare convergence properties of the primal method, diffusion, and the primal-dual approach, decentralized gradient tracking (DGT). Theoretical analysis reveals that diffusion can outperform DGT in certain dynamic settings. We find that DGT and diffusion are significantly affected by the drifts and the magnitudes of optimal gradients, respectively. In addition, we show that DGT is more sensitive to the network topology, and a badly-connected network can greatly deteriorate its convergence performance. These conclusions provide guidelines on how to choose proper dynamic algorithms in various application scenarios. Numerical experiments are constructed to validate the theoretical analysis.


title: Recognizing Handwritten Mathematical Expressions as LaTex Sequences Using a Multiscale Robust Neural Network

abstract: In this paper, a robust multiscale neural network is proposed to recognize handwritten mathematical expressions and output LaTeX sequences, which can effectively and correctly focus on where each step of output should be concerned and has a positive effect on analyzing the two-dimensional structure of handwritten mathematical expressions and identifying different mathematical symbols in a long expression. With the addition of visualization, the model's recognition process is shown in detail. In addition, our model achieved 49.459% and 46.062% ExpRate on the public CROHME 2014 and CROHME 2016 datasets. The present model results suggest that the state-of-the-art model has better robustness, fewer errors, and higher accuracy.


title: Development of a novel calorimetry setup based on metallic paramagnetic temperature sensors

abstract: We have developed a new micro-fabricated platform for the measurement of the specific heat of low heat capacity mg-sized metallic samples, such as superconductors, down to temperatures of as low as $10\,\mathrm{mK}$. It addresses challenging aspects of setups of this kind such as the thermal contact between sample and platform, the thermometer resolution, and an addenda heat capacity exceeding that of the samples of interest (typically $\mbox{nJ/K at }20\,\mbox{mK}$). The setup allows us to use the relaxation method, where the thermal relaxation following a well defined heat pulse is monitored to extract the specific heat. The sample platform ($5 \times 5\, \mathrm{mm^2}$) includes a micro-structured paramagnetic \underline{Ag}:Er temperature sensor, which is read out by a dc-SQUID via a superconducting flux transformer. In this way, a relative temperature precision of $30\,\mathrm{nK/\sqrt{Hz}}$ can be reached, while the addenda heat capacity falls well below $0.5\,\mathrm{nJ/K}$ for $T < 300\,\mathrm{mK}$. A gold-coated mounting area ($4.4 \times 3 \, \mathrm{mm^2}$) is included to improve the thermal contact between sample and platform.


title: RiskOracle: A Minute-level Citywide Traffic Accident Forecasting Framework

abstract: Real-time traffic accident forecasting is increasingly important for public safety and urban management (e.g., real-time safe route planning and emergency response deployment). Previous works on accident forecasting are often performed on hour levels, utilizing existed neural networks with static region-wise correlations taken into account. However, it is still challenging when the granularity of forecasting step improves as the highly dynamic nature of road network and inherent rareness of accident records in one training sample, which leads to biased results and zero-inflated issue. In this work, we propose a novel framework RiskOracle, to improve the prediction granularity to minute levels. Specifically, we first transform the zero-risk values in labels to fit the training network. Then, we propose the Differential Time-varying Graph neural network (DTGN) to capture the immediate changes of traffic status and dynamic inter-subregion correlations. Furthermore, we adopt multi-task and region selection schemes to highlight citywide most-likely accident subregions, bridging the gap between biased risk values and sporadic accident distribution. Extensive experiments on two real-world datasets demonstrate the effectiveness and scalability of our RiskOracle framework.


title: MADAN: Multi-source Adversarial Domain Aggregation Network for Domain Adaptation

abstract: Domain adaptation aims to learn a transferable model to bridge the domain shift between one labeled source domain and another sparsely labeled or unlabeled target domain. Since the labeled data may be collected from multiple sources, multi-source domain adaptation (MDA) has attracted increasing attention. Recent MDA methods do not consider the pixel-level alignment between sources and target or the misalignment across different sources. In this paper, we propose a novel MDA framework to address these challenges. Specifically, we design an end-to-end Multi-source Adversarial Domain Aggregation Network (MADAN). First, an adapted domain is generated for each source with dynamic semantic consistency while aligning towards the target at the pixel-level cycle-consistently. Second, sub-domain aggregation discriminator and cross-domain cycle discriminator are proposed to make different adapted domains more closely aggregated. Finally, feature-level alignment is performed between the aggregated domain and the target domain while training the task network. For the segmentation adaptation, we further enforce category-level alignment and incorporate context-aware generation, which constitutes MADAN+. We conduct extensive MDA experiments on digit recognition, object classification, and simulation-to-real semantic segmentation. The results demonstrate that the proposed MADAN and MANDA+ models outperform state-of-the-art approaches by a large margin.


title: Understanding the Location of Resistance Change in the Pr0.7Ca0.3MnO3 RRAM

abstract: Pr1-xCaxMnO3 (PCMO) based resistance random access memory (RRAM) is attractive in large scale memory and neuromorphic applications as it is non-filamentary, area scalable and has multiple resistance states along with excellent endurance and retention. The PCMO RRAM exhibit area scalable resistive switching when in contact with the reactive electrode. The interface redox reaction based resistance switching is observed electrically. Yet, whether resistance change occurs through partial (close to interface) or entire bulk is largely debated. Essentially, a two-terminal device is unable to provide direct evidence of the resistance change location in the PCMO RRAM. In this paper, we propose and experimentally demonstrate a novel three-terminal RRAM device in which a thin third terminal (~20nm) is inserted laterally in a typical vertical 2 terminal RRAM device of PCMO thickness of ~80nm. Using the 3T-RRAM method, we show that resistance change occurs largely at the upper bulk (near reactive electrode interface) - which is highly asymmetric. Yet it produces SCLC based resistance change with symmetric IV characteristics. It is the first time that an interface redox and bulk SCLC based resistance change has been experimentally shown as correlated and consistent - enabled by the 3rd terminal of the RRAM. Such a study enables a critical understanding of the device which enables the design and development of PCMO RRAM for memory and neuromorphic computing applications.


title: Quantized Neural Network Inference with Precision Batching

abstract: We present PrecisionBatching, a quantized inference algorithm for speeding up neural network execution on traditional hardware platforms at low bitwidths without the need for retraining or recalibration. PrecisionBatching decomposes a neural network into individual bitlayers and accumulates them using fast 1-bit operations while maintaining activations in full precision. PrecisionBatching not only facilitates quantized inference at low bitwidths (< 8 bits) without the need for retraining/recalibration, but also 1) enables traditional hardware platforms the ability to realize inference speedups at a finer granularity of quantization (e.g: 1-16 bit execution) and 2) allows accuracy and speedup tradeoffs at runtime by exposing the number of bitlayers to accumulate as a tunable parameter. Across a variety of applications (MNIST, language modeling, natural language inference) and neural network architectures (fully connected, RNN, LSTM), PrecisionBatching yields end-to-end speedups of over 8x on a GPU within a < 1% error margin of the full precision baseline, outperforming traditional 8-bit quantized inference by over 1.5x-2x at the same error tolerance.


title: Breast Cancer Histopathology Image Classification and Localization using Multiple Instance Learning

abstract: Breast cancer has the highest mortality among cancers in women. Computer-aided pathology to analyze microscopic histopathology images for diagnosis with an increasing number of breast cancer patients can bring the cost and delays of diagnosis down. Deep learning in histopathology has attracted attention over the last decade of achieving state-of-the-art performance in classification and localization tasks. The convolutional neural network, a deep learning framework, provides remarkable results in tissue images analysis, but lacks in providing interpretation and reasoning behind the decisions. We aim to provide a better interpretation of classification results by providing localization on microscopic histopathology images. We frame the image classification problem as weakly supervised multiple instance learning problem where an image is collection of patches i.e. instances. Attention-based multiple instance learning (A-MIL) learns attention on the patches from the image to localize the malignant and normal regions in an image and use them to classify the image. We present classification and localization results on two publicly available BreakHIS and BACH dataset. The classification and visualization results are compared with other recent techniques. The proposed method achieves better localization results without compromising classification accuracy.


title: Multi-Scale Representation Learning for Spatial Feature Distributions using Grid Cells

abstract: Unsupervised text encoding models have recently fueled substantial progress in NLP. The key idea is to use neural networks to convert words in texts to vector space representations based on word positions in a sentence and their contexts, which are suitable for end-to-end training of downstream tasks. We see a strikingly similar situation in spatial analysis, which focuses on incorporating both absolute positions and spatial contexts of geographic objects such as POIs into models. A general-purpose representation model for space is valuable for a multitude of tasks. However, no such general model exists to date beyond simply applying discretization or feed-forward nets to coordinates, and little effort has been put into jointly modeling distributions with vastly different characteristics, which commonly emerges from GIS data. Meanwhile, Nobel Prize-winning Neuroscience research shows that grid cells in mammals provide a multi-scale periodic representation that functions as a metric for location encoding and is critical for recognizing places and for path-integration. Therefore, we propose a representation learning model called Space2Vec to encode the absolute positions and spatial relationships of places. We conduct experiments on two real-world geographic data for two different tasks: 1) predicting types of POIs given their positions and context, 2) image classification leveraging their geo-locations. Results show that because of its multi-scale representations, Space2Vec outperforms well-established ML approaches such as RBF kernels, multi-layer feed-forward nets, and tile embedding approaches for location modeling and image classification tasks. Detailed analysis shows that all baselines can at most well handle distribution at one scale but show poor performances in other scales. In contrast, Space2Vec's multi-scale representation can handle distributions at different scales.


title: SIP-SegNet: A Deep Convolutional Encoder-Decoder Network for Joint Semantic Segmentation and Extraction of Sclera, Iris and Pupil based on Periocular Region Suppression

abstract: The current developments in the field of machine vision have opened new vistas towards deploying multimodal biometric recognition systems in various real-world applications. These systems have the ability to deal with the limitations of unimodal biometric systems which are vulnerable to spoofing, noise, non-universality and intra-class variations. In addition, the ocular traits among various biometric traits are preferably used in these recognition systems. Such systems possess high distinctiveness, permanence, and performance while, technologies based on other biometric traits (fingerprints, voice etc.) can be easily compromised. This work presents a novel deep learning framework called SIP-SegNet, which performs the joint semantic segmentation of ocular traits (sclera, iris and pupil) in unconstrained scenarios with greater accuracy. The acquired images under these scenarios exhibit purkinje reflexes, specular reflections, eye gaze, off-angle shots, low resolution, and various occlusions particularly by eyelids and eyelashes. To address these issues, SIP-SegNet begins with denoising the pristine image using denoising convolutional neural network (DnCNN), followed by reflection removal and image enhancement based on contrast limited adaptive histogram equalization (CLAHE). Our proposed framework then extracts the periocular information using adaptive thresholding and employs the fuzzy filtering technique to suppress this information. Finally, the semantic segmentation of sclera, iris and pupil is achieved using the densely connected fully convolutional encoder-decoder network. We used five CASIA datasets to evaluate the performance of SIP-SegNet based on various evaluation metrics. The simulation results validate the optimal segmentation of the proposed SIP-SegNet, with the mean f1 scores of 93.35, 95.11 and 96.69 for the sclera, iris and pupil classes respectively.


title: Realistic River Image Synthesis using Deep Generative Adversarial Networks

abstract: In this paper, we demonstrated a practical application of realistic river image generation using deep learning. Specifically, we explored a generative adversarial network (GAN) model capable of generating high-resolution and realistic river images that can be used to support modeling and analysis in surface water estimation, river meandering, wetland loss, and other hydrological research studies. First, we have created an extensive repository of overhead river images to be used in training. Second, we incorporated the Progressive Growing GAN (PGGAN), a network architecture that iteratively trains smaller-resolution GANs to gradually build up to a very high resolution to generate high quality (i.e., 1024x1024) synthetic river imagery. With simpler GAN architectures, difficulties arose in terms of exponential increase of training time and vanishing/exploding gradient issues, which the PGGAN implementation seemed to significantly reduce. The results presented in this study show great promise in generating high-quality images and capturing the details of river structure and flow to support hydrological research, which often requires extensive imagery for model performance.


title: CheXclusion: Fairness gaps in deep chest X-ray classifiers

abstract: Machine learning systems have received much attention recently for their ability to achieve expert-level performance on clinical tasks, particularly in medical imaging. Here, we examine the extent to which state-of-the-art deep learning classifiers trained to yield diagnostic labels from X-ray images are biased with respect to protected attributes. We train convolution neural networks to predict 14 diagnostic labels in 3 prominent public chest X-ray datasets: MIMIC-CXR, Chest-Xray8, CheXpert, as well as a multi-site aggregation of all those datasets. We evaluate the TPR disparity -- the difference in true positive rates (TPR) -- among different protected attributes such as patient sex, age, race, and insurance type as a proxy for socioeconomic status. We demonstrate that TPR disparities exist in the state-of-the-art classifiers in all datasets, for all clinical tasks, and all subgroups. A multi-source dataset corresponds to the smallest disparities, suggesting one way to reduce bias. We find that TPR disparities are not significantly correlated with a subgroup's proportional disease burden. As clinical models move from papers to products, we encourage clinical decision makers to carefully audit for algorithmic disparities prior to deployment. Our code can be found at, https://github.com/LalehSeyyed/CheXclusion


title: Verifying Deep Learning-based Decisions for Facial Expression Recognition

abstract: Neural networks with high performance can still be biased towards non-relevant features. However, reliability and robustness is especially important for high-risk fields such as clinical pain treatment. We therefore propose a verification pipeline, which consists of three steps. First, we classify facial expressions with a neural network. Next, we apply layer-wise relevance propagation to create pixel-based explanations. Finally, we quantify these visual explanations based on a bounding-box method with respect to facial regions. Although our results show that the neural network achieves state-of-the-art results, the evaluation of the visual explanations reveals that relevant facial regions may not be considered.


title: Critical Study of Markovian Approaches for Batch Arrival Modeling in IEEE 802.15.4-based Networks

abstract: The transient non-stationary nature of network reaction to batch arrivals has led to complex models in order to estimate the network quantities of interest. In this report we focus on the IEEE 802.15.4 standard MAC layer and try to deeply study the current approaches in modeling the network reaction to one-shot data arrivals. In addition to the general description of models, we mention the positive and negative points in each case proposing possible alternations which could improve the accuracy of the models.


title: GSANet: Semantic Segmentation with Global and Selective Attention

abstract: This paper proposes a novel deep learning architecture for semantic segmentation. The proposed Global and Selective Attention Network (GSANet) features Atrous Spatial Pyramid Pooling (ASPP) with a novel sparsemax global attention and a novel selective attention that deploys a condensation and diffusion mechanism to aggregate the multi-scale contextual information from the extracted deep features. A selective attention decoder is also proposed to process the GSA-ASPP outputs for optimizing the softmax volume. We are the first to benchmark the performance of semantic segmentation networks with the low-complexity feature extraction network (FXN) MobileNetEdge, that is optimized for low latency on edge devices. We show that GSANet can result in more accurate segmentation with MobileNetEdge, as well as with strong FXNs, such as Xception. GSANet improves the state-of-art semantic segmentation accuracy on both the ADE20k and the Cityscapes datasets.


title: Character Segmentation in Asian Collector's Seal Imprints: An Attempt to Retrieval Based on Ancient Character Typeface

abstract: Collector's seals provide important clues about the ownership of a book. They contain much information pertaining to the essential elements of ancient materials and also show the details of possession, its relation to the book, the identity of the collectors and their social status and wealth, amongst others. Asian collectors have typically used artistic ancient characters rather than modern ones to make their seals. In addition to the owner's name, several other words are used to express more profound meanings. A system that automatically recognizes these characters can help enthusiasts and professionals better understand the background information of these seals. However, there is a lack of training data and labelled images, as samples of some seals are scarce and most of them are degraded images. It is necessary to find new ways to make full use of such scarce data. While these data are available online, they do not contain information on the characters'position. The goal of this research is to provide retrieval tools assist in obtaining more information from Asian collector's seals imprints without consuming a lot of computational resources. In this paper, a character segmentation method is proposed to predict the candidate characters'area without any labelled training data that contain character coordinate information. A retrieval-based recognition system that focuses on a single character is also proposed to support seal retrieval and matching. The experimental results demonstrate that the proposed character segmentation method performs well on Asian collector's seals, with 92% of the test data being correctly segmented.


title: An End-to-End Visual-Audio Attention Network for Emotion Recognition in User-Generated Videos

abstract: Emotion recognition in user-generated videos plays an important role in human-centered computing. Existing methods mainly employ traditional two-stage shallow pipeline, i.e. extracting visual and/or audio features and training classifiers. In this paper, we propose to recognize video emotions in an end-to-end manner based on convolutional neural networks (CNNs). Specifically, we develop a deep Visual-Audio Attention Network (VAANet), a novel architecture that integrates spatial, channel-wise, and temporal attentions into a visual 3D CNN and temporal attentions into an audio 2D CNN. Further, we design a special classification loss, i.e. polarity-consistent cross-entropy loss, based on the polarity-emotion hierarchy constraint to guide the attention generation. Extensive experiments conducted on the challenging VideoEmotion-8 and Ekman-6 datasets demonstrate that the proposed VAANet outperforms the state-of-the-art approaches for video emotion recognition. Our source code is released at: https://github.com/maysonma/VAANet.


title: CNN Hyperparameter tuning applied to Iris Liveness Detection

abstract: The iris pattern has significantly improved the biometric recognition field due to its high level of stability and uniqueness. Such physical feature has played an important role in security and other related areas. However, presentation attacks, also known as spoofing techniques, can be used to bypass the biometric system with artifacts such as printed images, artificial eyes, and textured contact lenses. To improve the security of these systems, many liveness detection methods have been proposed, and the first Internacional Iris Liveness Detection competition was launched in 2013 to evaluate their effectiveness. In this paper, we propose a hyperparameter tuning of the CASIA algorithm, submitted by the Chinese Academy of Sciences to the third competition of Iris Liveness Detection, in 2017. The modifications proposed promoted an overall improvement, with an 8.48% Attack Presentation Classification Error Rate (APCER) and 0.18% Bonafide Presentation Classification Error Rate (BPCER) for the evaluation of the combined datasets. Other threshold values were evaluated in an attempt to reduce the trade-off between the APCER and the BPCER on the evaluated datasets and worked out successfully.


title: CALVIS: chest, waist and pelvis circumference from 3D human body meshes as ground truth for deep learning

abstract: In this paper we present CALVIS, a method to calculate $\textbf{C}$hest, w$\textbf{A}$ist and pe$\textbf{LVIS}$ circumference from 3D human body meshes. Our motivation is to use this data as ground truth for training convolutional neural networks (CNN). Previous work had used the large scale CAESAR dataset or determined these anthropometrical measurements $\textit{manually}$ from a person or human 3D body meshes. Unfortunately, acquiring these data is a cost and time consuming endeavor. In contrast, our method can be used on 3D meshes automatically. We synthesize eight human body meshes and apply CALVIS to calculate chest, waist and pelvis circumference. We evaluate the results qualitatively and observe that the measurements can indeed be used to estimate the shape of a person. We then asses the plausibility of our approach by generating ground truth with CALVIS to train a small CNN. After having trained the network with our data, we achieve competitive validation error. Furthermore, we make the implementation of CALVIS publicly available to advance the field.


title: Deep Variational Luenberger-type Observer for Stochastic Video Prediction

abstract: Considering the inherent stochasticity and uncertainty, predicting future video frames is exceptionally challenging. In this work, we study the problem of video prediction by combining interpretability of stochastic state space models and representation learning of deep neural networks. Our model builds upon an variational encoder which transforms the input video into a latent feature space and a Luenberger-type observer which captures the dynamic evolution of the latent features. This enables the decomposition of videos into static features and dynamics in an unsupervised manner. By deriving the stability theory of the nonlinear Luenberger-type observer, the hidden states in the feature space become insensitive with respect to the initial values, which improves the robustness of the overall model. Furthermore, the variational lower bound on the data log-likelihood can be derived to obtain the tractable posterior prediction distribution based on the variational principle. Finally, the experiments such as the Bouncing Balls dataset and the Pendulum dataset are provided to demonstrate the proposed model outperforms concurrent works.


title: Marine life through You Only Look Once's perspective

abstract: With the rise of focus on man made changes to our planet and wildlife therein, more and more emphasis is put on sustainable and responsible gathering of resources. In an effort to preserve maritime wildlife the Norwegian government has decided that it is necessary to create an overview over the presence and abundance of various species of wildlife in the Norwegian fjords and oceans. In this paper we apply and analyze an object detection scheme that detects fish in camera images. The data is sampled from a submerged data station at Fulehuk in Norway. We implement You Only Look Once (YOLO) version 3 and create a dataset consisting of 99,961 images with a mAP of $\sim 0.88$. We also investigate intermediate results within YOLO, gaining insight into how it performs object detection.


title: On Parameter Tuning in Meta-learning for Computer Vision

abstract: Learning to learn plays a pivotal role in meta-learning (MTL) to obtain an optimal learning model. In this paper, we investigate mage recognition for unseen categories of a given dataset with limited training information. We deploy a zero-shot learning (ZSL) algorithm to achieve this goal. We also explore the effect of parameter tuning on performance of semantic auto-encoder (SAE). We further address the parameter tuning problem for meta-learning, especially focusing on zero-shot learning. By combining different embedded parameters, we improved the accuracy of tuned-SAE. Advantages and disadvantages of parameter tuning and its application in image classification are also explored.


title: A Machine Learning Framework for Data Ingestion in Document Images

abstract: Paper documents are widely used as an irreplaceable channel of information in many fields, especially in financial industry, fostering a great amount of demand for systems which can convert document images into structured data representations. In this paper, we present a machine learning framework for data ingestion in document images, which processes the images uploaded by users and return fine-grained data in JSON format. Details of model architectures, design strategies, distinctions with existing solutions and lessons learned during development are elaborated. We conduct abundant experiments on both synthetic and real-world data in State Street. The experimental results indicate the effectiveness and efficiency of our methods.