title: Trajectory Prediction by Coupling Scene-LSTM with Human Movement LSTM

abstract: We develop a novel human trajectory prediction system that incorporates the scene information (Scene-LSTM) as well as individual pedestrian movement (Pedestrian-LSTM) trained simultaneously within static crowded scenes. We superimpose a two-level grid structure (grid cells and subgrids) on the scene to encode spatial granularity plus common human movements. The Scene-LSTM captures the commonly traveled paths that can be used to significantly influence the accuracy of human trajectory prediction in local areas (i.e. grid cells). We further design scene data filters, consisting of a hard filter and a soft filter, to select the relevant scene information in a local region when necessary and combine it with Pedestrian-LSTM for forecasting a pedestrian's future locations. The experimental results on several publicly available datasets demonstrate that our method outperforms related works and can produce more accurate predicted trajectories in different scene contexts.


title: Predicting Features of Quantum Systems from Very Few Measurements

abstract: Predicting features of complex, large-scale quantum systems is essential to the characterization and engineering of quantum architectures. We present an efficient approach for constructing an approximate classical description, called the classical shadow, of a quantum system from very few quantum measurements that can later be used to predict a large collection of features. This approach is guaranteed to accurately predict M linear functions with bounded Hilbert-Schmidt norm from only order of log(M) measurements. This is completely independent of the system size and saturates fundamental lower bounds from information theory. We support our theoretical findings with numerical experiments over a wide range of problem sizes (2 to 162 qubits). These highlight advantages compared to existing machine learning approaches.

categories: quant-ph cs.CL cs.IT cs.LG math.IT math.PR


title: Counting pop-stacked permutations in polynomial time

abstract: Permutations in the image of the pop-stack operator are said to be pop-stacked. We give a polynomial-time algorithm to count pop-stacked permutations up to a fixed length and we use it to compute the first 1000 terms of the corresponding counting sequence. Only the first 16 terms had previously been computed. With the 1000 terms we prove some negative results concerning the nature of the generating function for pop-stacked permutations. We also predict the asymptotic behavior of the counting sequence using differential approximation.


title: Parameterized Algorithms for Book Embedding Problems

abstract: A k-page book embedding of a graph G draws the vertices of G on a line and the edges on k half-planes (called pages) bounded by this line, such that no two edges on the same page cross. We study the problem of determining whether G admits a k-page book embedding both when the linear order of the vertices is fixed, called Fixed-Order Book Thickness, or not fixed, called Book Thickness. Both problems are known to be NP-complete in general. We show that Fixed-Order Book Thickness and Book Thickness are fixed-parameter tractable parameterized by the vertex cover number of the graph and that Fixed-Order Book Thickness is fixed-parameter tractable parameterized by the pathwidth of the vertex order.


title: On the Riemannian barycentre of a Markov chain

abstract: The Riemannian barycentre is one of the most widely used statistical descriptors for probability distributions on Riemannian manifolds. At present, existing algorithms are able to compute the Riemannian barycentre of a probability distribution, only if i.i.d. samples of this distribution are readily available. However, there are many cases where i.i.d. samples are quite difficult to obtain, and have to be replaced with non-independent samples, generated by a Markov chain Monte Carlo method. To overcome this difficulty, the present paper proposes a new Markov chain Monte Carlo algorithm for computing the Riemannian barycentre of a probability distribution on a Hadamard manifold (a simply connected, complete Riemannian manifold with non-positive curvature). This algorithm relies on two original propositions, proved in the paper. The first proposition states that the recursive barycentre of samples generated from a geometrically ergodic Markov chain converges in the mean-square to the Riemannian barycentre of the stationary distribution of this chain. The second proposition provides verifiable conditions which ensure a Metropolis-Hastings Markov chain, with its values in a symmetric Hadamard manifold, is geometrically ergodic. This latter result yields a partial solution, in the context of Riemannian manifolds, to the problem of geometric ergodicity of Metropolis-Hastings chains, which has previously attracted extensive attention when considered in Euclidean space. In addition to these two propositions, the new Markov chain Monte Carlo algorithm, proposed in this paper, is applied to a problem of Bayesian inference, arising from computer vision.


title: A Galaxy-Targeted Search for the Optical Counterpart of the Candidate NS-BH Merger S190814bv with Magellan

abstract: On 2019 August 14 the Laser Interferometer Gravitational Wave Observatory (LIGO) and the Virgo gravitational wave interferometer announced the detection of a binary merger, S190814bv, with a low false alarm rate (FAR) of about 1 in $1.6\times 10^{25}$ years, a distance of $267\pm 52$ Mpc, a 90\% (50\%) localization region of about 23 (5) deg$^2$, and a probability of being a neutron star--black hole (NS-BH) merger of $>99\%$. The LIGO/Virgo Collaboration (LVC) defines NS-BH such that the lighter binary member has a mass of $<3$ M$_\odot$ and the more massive one has $>5$ M$_\odot$, and this classification is in principle consistent with a BH-BH merger depending on the actual upper mass cut-off for neutron stars. Additionally, the LVC designated a probability that the merger led to matter outside the final BH remnant of $<1\%$, suggesting that an electromagnetic (EM) counterpart is unlikely. Here we report our optical follow-up observations of S190814bv using the Magellan Baade 6.5 m telescope to target all 96 galaxies in the GLADE catalog within the 50\% localization volume (representing about 70\% of the integrated luminosity within this region). No counterpart was identified to a median $3\sigma$ limiting magnitude of $i=22.2$ ($M_i\approx -14.9$ mag), comparable to the brightness of the optical counterpart of the binary neutron star merger GW170817 at the distance of S190814bv; similarly, we can rule out an on-axis jet typical of short GRBs. However, we cannot rule out other realistic models, such as a kilonova with only $\sim 0.01$ M$_\odot$ of lanthanide-rich material, or an off-axis jet with a viewing angle of $\theta_{\rm obs}\gtrsim 15^\circ$.


title: Region Tracking in an Image Sequence: Preventing Driver Inattention

abstract: Driver inattention is a large problem on the roads around the world. The objective of this project was to develop an eye tracking algorithm with sufficient computational efficiency and accuracy, to successfully realize when the driver was looking away from the road for an extended period. The method of tracking involved the minimization of a functional, using the gradient descent and level set methods. The algorithm was then discretized and implemented using C and MATLAB. Multiple synthetic images, grey-scale and colour images were tested using the final design, with a desired region coverage of 82%. Further work is needed to decrease the computation time, increase the robustness of the algorithm, develop a small device capable of running the algorithm, as well as physically implement this device into various vehicles.


title: On maximum principles for radial solutions to nonlinear elliptic PDE's via Opial-type inequalities

abstract: We consider degenerated nonlinear PDE of elliptic type: $$ - \mathrm{div}(a(|x|)|\nabla w(x)|^{p-2} \nabla w(x)) + h(|x|,w(x),\langle\nabla w(x),\frac{x}{|x|}\rangle)=\phi(w(x)), $$ where $x$ belongs to the ball in $\bf{R}^n$. Using the argument based on Opial-type inequalities, we investigate qualitative properties of their radial solutions, like e.g. maximum principles, monotonicity, as well as nonexistence of the nontrivial solutions.


title: Cross-Enhancement Transform Two-Stream 3D ConvNets for Action Recognition

abstract: Action recognition is an important research topic in computer vision. It is the basic work for visual understanding and has been applied in many fields. Since human actions can vary in different environments, it is difficult to infer actions in completely different states with a same structural model. For this case, we propose a Cross-Enhancement Transform Two-Stream 3D ConvNets algorithm, which considers the action distribution characteristics on the specific dataset. As a teaching model, stream with better performance in both streams is expected to assist in training another stream. In this way, the enhanced-trained stream and teacher stream are combined to infer actions. We implement experiments on the video datasets UCF-101, HMDB-51, and Kinetics-400, and the results confirm the effectiveness of our algorithm.


title: A Lost Croatian Cybernetic Machine Translation Program

abstract: We are exploring the historical significance of research in the field of machine translation conducted by Bulcsu Laszlo, Croatian linguist, who was a pioneer in machine translation in Yugoslavia during the 1950s. We are focused on two important seminal papers written by members of his research group from 1959 and 1962, as well as their legacy in establishing a Croatian machine translation program based around the Faculty of Humanities and Social Sciences of the University of Zagreb in the late 1950s and early 1960s. We are exploring their work in connection with the beginnings of machine translation in the USA and USSR, motivated by the Cold War and the intelligence needs of the period. We also present the approach to machine translation advocated by the Croatian group in Yugoslavia, which is different from the usual logical approaches of the period, and his advocacy of cybernetic methods, which would be adopted as a canon by the mainstream AI community only decades later.


title: DefSLAM: Tracking and Mapping of Deforming Scenes from Monocular Sequences

abstract: Monocular SLAM algorithms perform robustly when observing rigid scenes, however, they fail when the observed scene deforms, for example, in medical endoscopy applications. We present DefSLAM, the first monocular SLAM capable of operating in deforming scenes in real-time. Our approach intertwines Shape-from-Template (SfT) and Non-Rigid Structure-from-Motion (NRSfM) techniques to deal with the exploratory sequences typical of SLAM. A deformation tracking thread recovers the pose of the camera and the deformation of the observed map, at frame rate, by means of SfT processing a template that models the scene shape-at-rest. A deformation mapping thread runs in parallel with the tracking to update the template, at keyframe rate, by means of an isometric NRSfM processing a batch of full perspective keyframes. In our experiments, DefSLAM processes close-up sequences of deforming scenes, both in a laboratory controlled experiment and in medical endoscopy sequences, producing accurate 3D models of the scene with respect to the moving camera.


title: In-bed Pressure-based Pose Estimation using Image Space Representation Learning

abstract: Recent advances in deep pose estimation models have proven to be effective in a wide range of applications such as health monitoring, sports, animations, and robotics. However, pose estimation models fail to generalize when facing images acquired from in-bed pressure sensing systems. In this paper, we address this challenge by presenting a novel end-to-end framework capable of accurately locating body parts from vague pressure data. Our method exploits the idea of equipping an off-the-shelf pose estimator with a deep trainable neural network, which pre-processes and prepares the pressure data for subsequent pose estimation. Our model transforms the ambiguous pressure maps to images containing shapes and structures similar to the common input domain of the pre-existing pose estimation methods. As a result, we show that our model is able to reconstruct unclear body parts, which in turn enables pose estimators to accurately and robustly estimate the pose. We train and test our method on a manually annotated public pressure map dataset using a combination of loss functions. Results confirm the effectiveness of our method by the high visual quality in the generated images and the high pose estimation rates achieved.


title: Automation is no barrier to light vehicle electrification

abstract: Weight, computational load, sensor load, and possibly higher drag may increase the energy use of automated electric vehicles (AEVs) relative to human-driven electric vehicles (EVs), although this increase may be offset by smoother driving. We use a vehicle dynamics model to show that automation is likely to impose a minor penalty on EV range and have negligible effect on battery longevity. As such, while some commentators have suggested that the power and energy requirements of automation mean that the first automated vehicles (AVs) will be gas-electric hybrids, we conclude that this need not be the case. We also find that drivers need to place only a modest value on the time saved by automation for its benefits to exceed direct costs.


title: Intelligence Stratum for IoT. Architecture Requirements and Functions

abstract: The use of Artificial Intelligence (AI) is becoming increasingly pervasive and relevant in many different application areas. Researchers are putting a considerable effort to take full advantage of the power of AI, while trying to overcome the technical challenges that are intrinsically linked to almost any domain area of application, such as the Internet of Things (IoT). One of the biggest problems related to the use of AI in IoT is related to the difficulty of coping with the wide variety of protocols and software technologies used, as well as with the heterogeneity of the hardware resources consuming the AI. The scattered IoT landscape accentuates the limitations on interoperability, especially visible in the deployment of AI, affecting the seamless AI life-cycle management as well. In this paper, it is discussed how to enable AI distribution in IoT by introducing a layered intelligence architecture that aims to face the undertaken challenges taking into account the special requirements of nowadays IoT networks. It describes the main characteristics of the new paradigm architecture, highlighting what are the implications of its adoption from use cases perspective and their requirements. Finally, a set of open technical and research challenges are enumerated to reach the full potential of the intelligence distribution's vision.


title: Distributing Intelligence to the Edge and Beyond

abstract: Machine Intelligence (MI) technologies have revolutionized the design and applications of computational intelligence systems, by introducing remarkable scientific and technological enhancements across domains. MI can improve Internet of Things (IoT) in several ways, such as optimizing the management of large volumes of data or improving automation and transmission in large-scale IoT deployments. When considering MI in the IoT context, MI services deployment must account for the latency demands and network bandwidth requirements. To this extent, moving the intelligence towards the IoT end-device aims to address such requirements and introduces the notion of Distributed MI (D-MI) also in the IoT context. However, current D-MI deployments are limited by the lack of MI interoperability. Currently, the intelligence is tightly bound to the application that exploits it, limiting the provisioning of that specific intelligence service to additional applications. The objective of this article is to propose a novel approach to cope with such constraints. It focuses on decoupling the intelligence from the application by revising the traditional device's stack and introducing an intelligence layer that provides services to the overlying application layer. This paradigm aims to provide final users with more control and accessibility of intelligence services by boosting providers' incentives to develop solutions that could theoretically reach any device. Based on the definition of this emerging paradigm, we explore several aspects related to the intelligence distribution and its impact in the whole MI ecosystem.


title: Exploring anomalous couplings in Higgs boson pair production through shape analysis

abstract: We classify shapes of Higgs boson pair invariant mass distributions $m_{hh}$, calculated at NLO with full top quark mass dependence, and visualise how distinct classes of shapes relate to the underlying coupling parameter space. Our study is based on a five-dimensional parameter space relevant for Higgs boson pair production in a non-linear Effective Field Theory framework. We use two approaches: an analysis based on predefined shape types and a classification into shape clusters based on unsupervised learning. We find that our method based on unsupervised learning is able to capture shape features very well and therefore allows a more detailed study of the impact of anomalous couplings on the $m_{hh}$ shape compared to more conventional approaches to a shape analysis.


title: Linear response theory for Google matrix

abstract: We develop the linear response theory for the Google matrix PageRank algorithm with respect to a general weak perturbation and a numerical efficient and accurate algorithm, called LIRGOMAX algorithm, to compute the linear response of the PageRank with respect to this perturbation. We illustrate its efficiency on the example of the English Wikipedia network with more than 5 millions of articles (nodes). For a group of initial nodes (or simply a pair of nodes) this algorithm allows to identify the effective pathway between initial nodes thus selecting a particular subset of nodes which are most sensitive to the weak perturbation applied to them (injection or pumping at one node and absorption of probability at another node). The further application of the reduced Google matrix algorithm (REGOMAX) allows to determine the effective interactions between the nodes of this subset. General linear response theory already found numerous applications in various areas of science including statistical and mesoscopic physics. Based on these grounds we argue that the developed LIRGOMAX algorithm will find broad applications in the analysis of complex directed networks.


title: Normality Analysis of Current World Record Computations for Catalan's Constant and Arc Length of a Lemniscate with $a=1$

abstract: Catalan's constant and the lemniscate constants have been important mathematical constants of interest to the mathematical society, yet various properties are unknown. An important property of significant mathematical constants is whether they are normal numbers. This paper evaluates the normality of decimal and hexadecimal representations of current world record computations of digits for the Catalan's constant (600,000,000,100 decimal digits and 498,289,214,317 hexadecimal digits) and the arc length of a lemniscate with $a=1$ (600,000,000,000 decimal digits and 498,289,214,234 hexadecimal digits). All analyzed frequencies are persistent to the conjecture of Catalan's constant and the arc length of a lemniscate with $a=1$ being a normal number in bases 10 and 16.


title: Efficient Deep Neural Networks

abstract: The success of deep neural networks (DNNs) is attributable to three factors: increased compute capacity, more complex models, and more data. These factors, however, are not always present, especially for edge applications such as autonomous driving, augmented reality, and internet-of-things. Training DNNs requires a large amount of data, which is difficult to obtain. Edge devices such as mobile phones have limited compute capacity, and therefore, require specialized and efficient DNNs. However, due to the enormous design space and prohibitive training costs, designing efficient DNNs for different target devices is challenging. So the question is, with limited data, compute capacity, and model complexity, can we still successfully apply deep neural networks? This dissertation focuses on the above problems and improving the efficiency of deep neural networks at four levels. Model efficiency: we designed neural networks for various computer vision tasks and achieved more than 10x faster speed and lower energy. Data efficiency: we developed an advanced tool that enables 6.2x faster annotation of a LiDAR point cloud. We also leveraged domain adaptation to utilize simulated data, bypassing the need for real data. Hardware efficiency: we co-designed neural networks and hardware accelerators and achieved 11.6x faster inference. Design efficiency: the process of finding the optimal neural networks is time-consuming. Our automated neural architecture search algorithms discovered, using 421x lower computational cost than previous search methods, models with state-of-the-art accuracy and efficiency.


title: 2D moment invariants from the point of view of the classical invariant theory

abstract: Invariants allow to classify images up to the action of a group of transformations. In this paper we introduce notions of the algebras of simultaneous polynomial and rational 2D moment invariants and prove that they are isomorphic to the algebras of joint polynomial and rational $SO(2)$-invariants of binary forms. Also, to simplify the calculating of invariants we pass from an action of Lie group $SO(2)$ to an action of its Lie algebra $\mathfrak{so}_2$. This allow us to reduce the problem to standard problems of the classical invariant theory.


title: Human activity recognition from skeleton poses

abstract: Human Action Recognition is an important task of Human Robot Interaction as cooperation between robots and humans requires that artificial agents recognise complex cues from the environment. A promising approach is using trained classifiers to recognise human actions through sequences of skeleton poses extracted from images or RGB-D data from a sensor. However, with many different data-sets focused on slightly different sets of actions and different algorithms it is not clear which strategy produces highest accuracy for indoor activities performed in a home environment. This work discussed, tested and compared classic algorithms, namely, support vector machines and k-nearest neighbours, to 2 similar hierarchical neural gas approaches, the growing when required neural gas and the growing neural gas.


title: Identifying Indoor Points of Interest via Mobile Crowdsensing: An Experimental Study

abstract: This paper presents a mobile crowdsensing approach to identify the indoor points of interest (POI) by exploiting Wi-Fi similarity measurements. Since indoor environments are lacking the GPS positioning accuracy when compared to outdoors, we rely on widely available Wi-Fi access points (AP) in contemporary urban indoor environments, to accurately identify user POI. We propose a smartphone application based system architecture to scan the surrounding Wi-Fi AP and measure the cosine similarity of received signal strengths (RSS), and demonstrate through the experimental results that it is possible to identify the distinct POI of users, and the common POI among users of a given indoor environment.


title: Sparse Generative Adversarial Network

abstract: We propose a new approach to Generative Adversarial Networks (GANs) to achieve an improved performance with additional robustness to its so-called and well recognized mode collapse. We first proceed by mapping the desired data onto a frame-based space for a sparse representation to lift any limitation of small support features prior to learning the structure. To that end we start by dividing an image into multiple patches and modifying the role of the generative network from producing an entire image, at once, to creating a sparse representation vector for each image patch. We synthesize an entire image by multiplying generated sparse representations to a pre-trained dictionary and assembling the resulting patches. This approach restricts the output of the generator to a particular structure, obtained by imposing a Union of Subspaces (UoS) model to the original training data, leading to more realistic images, while maintaining a desired diversity. To further regularize GANs in generating high-quality images and to avoid the notorious mode-collapse problem, we introduce a third player in GANs, called reconstructor. This player utilizes an auto-encoding scheme to ensure that first, the input-output relation in the generator is injective and second each real image corresponds to some input noise. We present a number of experiments, where the proposed algorithm shows a remarkably higher inception score compared to the equivalent conventional GANs.


title: Machine Teaching by Domain Experts: Towards More Humane,Inclusive, and Intelligent Machine Learning Systems

abstract: This paper argues that a possible way to escape from the limitations of current machine learning (ML) systems is to allow their development directly by domain experts without the mediation of ML experts. This could be accomplished by making ML systems interactively teachable using concepts, definitions, and similar high level knowledge constructs. Pointing to the recent advances in machine teaching technology, we list key technical challenges specific for such expert-centric ML systems, and suggest that they are more humane and possibly more intelligent than traditional ML systems in many domains. We then argue that ML systems could also benefit greatly from being built by a community of experts as much as open source software did, creating more inclusive systems, in terms of enabling different points-of-view about the same corpus of knowledge. Advantages of the community approach over current ways to build ML systems, as well as specific challenges this approach raises, are also discussed in the paper.


title: Learning Filter Basis for Convolutional Neural Network Compression

abstract: Convolutional neural networks (CNNs) based solutions have achieved state-of-the-art performances for many computer vision tasks, including classification and super-resolution of images. Usually the success of these methods comes with a cost of millions of parameters due to stacking deep convolutional layers. Moreover, quite a large number of filters are also used for a single convolutional layer, which exaggerates the parameter burden of current methods. Thus, in this paper, we try to reduce the number of parameters of CNNs by learning a basis of the filters in convolutional layers. For the forward pass, the learned basis is used to approximate the original filters and then used as parameters for the convolutional layers. We validate our proposed solution for multiple CNN architectures on image classification and image super-resolution benchmarks and compare favorably to the existing state-of-the-art in terms of reduction of parameters and preservation of accuracy.


title: The complete classification of empty lattice $4$-simplices

abstract: An empty simplex is a lattice simplex with only its vertices as lattice points. Their classification in dimension three was completed by White in 1964. In dimension four, the same task was started in 1988 by Mori, Morrison, and Morrison, with their motivation coming from the close relationship between empty simplices and terminal quotient singularities. They conjectured a classification of empty simplices of prime volume, modulo finitely many exceptions. Their conjecture was proved by Sankaran (1990) with a simplified proof by Bober (2009). The same classification was claimed by Barile et al. in 2011 for simplices of non-prime volume, but this statement was proved wrong by Blanco et al. (2016+). In this article we complete the classification of $4$-dimensional empty simplices. In doing so we correct and complete the classification claimed by Barile et al., and we also compute all the finitely many exceptions, by first proving an upper bound for their volume. The whole classification has: - One $3$-parameter family, consisting of simplices of width equal to one. - Two $2$-parameter families (the one in Mori et al., plus a second new one). - Forty-six $1$-parameter families (the 29 in Mori et al., plus 17 new ones). - $2461$ individual simplices not belonging to the above families, with volumes ranging between 29 and 419. We characterize the infinite families of empty simplices in terms of lower dimensional point configurations that they project to, with techniques that can be applied to higher dimensions and larger classes of lattice polytopes.


title: Evolving roles and dynamics for catch and slip bonds during adhesion cluster maturation

abstract: Focal adhesions are the loci of cellular adhesion to the extracellular matrix. At these sites, various integrins forge connections between the intracellular cytoskeleton and the outside world: large patches of multiple types of integrins together grip hold of collagen, fibronectin and other extracellular matrix components. The mixture of integrins composing the FA will, in general, contain both slip bond integrins and catch bond integrins---bonds whose lifetime increases with applied load and bonds for whom it decreases when forced. Prior work suggests that catch bonds are essential for proper FA stability and mechanosensory functionality. In the present work, we investigate, numerically, the interplay between the two distinct types of bonds and ask how the presence, in the same FA cluster, of slip bonds augments the behavior of the catch bonds. We show, that mixing the two components m low-force mechanical integrity, lacking in purely catch systems, while preserving the potential to strengthen the FA bond by force as well as the mechanosensory qualities of the catch bonds. We investigate the spatial distribution in mixed-integrin FA's and show that the differential response to loading leads, via an excluded volume interaction, to a dependence of the individual integrin diffusivities on the applied load, an effect that has been reported in experiments.


title: Slow dynamic nonlinearity in unconsolidated glass bead packs

abstract: Slow dynamic nonlinearity describes a poorly understood, creep-like phenomena that occurs in brittle composite materials such as rocks and cement. It is characterized by a drop in stiffness induced by a mechanical conditioning, followed by a log(time) recovery. A consensus theoretical understanding of the behavior has not been developed. Here we introduce an alternative experimental venue with which to inform theory. Unconsolidated glass bead packs are studied rather than rocks or cement because the structure and internal contacts of bead packs are less complex and better understood. Slow dynamics has been observed in such systems previously. However, the measurements to date tend to be irregular. Particular care is used here in the experimental design to overcome the difficulties inherent in bead pack studies. This includes the design of the bead pack support, the use of low frequency conditioning, and the use of ultrasonic waves as a probe with coda wave interferometry to assess changes. Slow dynamics is observed in our system after three different methods for low-frequency conditioning, one of which has not been reported in the literature previously.

categories: cond-mat.soft cond-mat.other physics.class-ph physics.geo-ph


title: Fatigue-Aware Ad Creative Selection

abstract: In online display advertising, selecting the most effective ad creative (ad image) for each impression is a crucial task for DSPs (Demand-Side Platforms) to fulfill their goals (click-through rate, number of conversions, revenue, and brand improvement). As widely recognized in the marketing literature, the effect of ad creative changes with the number of repetitive ad exposures. In this study, we propose an efficient and easy-to-implement ad creative selection algorithm that explicitly considers user's psychological status when selecting ad creatives. The proposed system was deployed in a real-world production environment and tested against the baseline algorithms. The results show superiority of the proposed algorithm.


title: Tracking Behavioral Patterns among Students in an Online Educational System

abstract: Analysis of log data generated by online educational systems is an essential task to better the educational systems and increase our understanding of how students learn. In this study we investigate previously unseen data from Clio Online, the largest provider of digital learning content for primary schools in Denmark. We consider data for 14,810 students with 3 million sessions in the period 2015-2017. We analyze student activity in periods of one week. By using non-negative matrix factorization techniques, we obtain soft clusterings, revealing dependencies among time of day, subject, activity type, activity complexity (measured by Bloom's taxonomy), and performance. Furthermore, our method allows for tracking behavioral changes of individual students over time, as well as general behavioral changes in the educational system. Based on the results, we give suggestions for behavioral changes, in order to optimize the learning experience and improve performance.


title: Mixed Linear Layouts: Complexity, Heuristics, and Experiments

abstract: A $k$-page linear graph layout of a graph $G = (V,E)$ draws all vertices along a line $\ell$ and each edge in one of $k$ disjoint halfplanes called pages, which are bounded by $\ell$. We consider two types of pages. In a stack page no two edges should cross and in a queue page no edge should be nested by another edge. A crossing (nesting) in a stack (queue) page is called a conflict. The algorithmic problem is twofold and requires to compute (i) a vertex ordering and (ii) a page assignment of the edges such that the resulting layout is either conflict-free or conflict-minimal. While linear layouts with only stack or only queue pages are well-studied, mixed $s$-stack $q$-queue layouts for $s,q \ge 1$ have received less attention. We show NP-completeness results on the recognition problem of certain mixed linear layouts and present a new heuristic for minimizing conflicts. In a computational experiment for the case $s, q = 1$ we show that the new heuristic is an improvement over previous heuristics for linear layouts.


title: AI and Accessibility: A Discussion of Ethical Considerations

abstract: According to the World Health Organization, more than one billion people worldwide have disabilities. The field of disability studies defines disability through a social lens; people are disabled to the extent that society creates accessibility barriers. AI technologies offer the possibility of removing many accessibility barriers; for example, computer vision might help people who are blind better sense the visual world, speech recognition and translation technologies might offer real time captioning for people who are hard of hearing, and new robotic systems might augment the capabilities of people with limited mobility. Considering the needs of users with disabilities can help technologists identify high-impact challenges whose solutions can advance the state of AI for all users; however, ethical challenges such as inclusivity, bias, privacy, error, expectation setting, simulated data, and social acceptability must be considered.


title: Theoretical energy levels of $1sns$ and $1snp$ states of helium-like ions

abstract: Energy levels of the $1sns$ and $1snp$ states of ions along the helium isoelectronic sequence from carbon to uranium are calculated, with $n=3$-$7$. The computation is performed within the relativistic configuration-interaction method, including the relativistic nuclear recoil effect, the leading QED effects, and the frequency dependence of the Breit interaction. All theoretical energies are supplied with uncertainty estimates.


title: Generative stochastic modeling of strongly nonlinear flows with non-Gaussian statistics

abstract: Strongly nonlinear flows, which commonly arise in geophysical and engineering turbulence, are characterized by persistent and intermittent energy transfer between various spatial and temporal scales. These systems are difficult to model and analyze due to combination of high dimensionality and uncertainty, and there has been much interest in obtaining reduced models, in the form of stochastic closures, that can replicate their non-Gaussian statistics in many dimensions. Here, we propose a data-driven framework to model stationary chaotic dynamical systems through nonlinear transformations and a set of decoupled stochastic differential equations (SDEs). Specifically, we use optimal transport to find a transformation from the distribution of time-series data to a multiplicative reference probability measure such as the standard normal distribution. Then we find the set of decoupled SDEs that admit the reference measure as the invariant measure, and also closely match the spectrum of the transformed data. As such, this framework represents the chaotic time series as the evolution of a stochastic system observed through the lens of a nonlinear map. We demonstrate the application of this framework in Lorenz-96 system, a 10-dimensional model of high-Reynolds cavity flow, and reanalysis climate data. These examples show that SDE models generated by this framework can reproduce the non-Gaussian statistics of systems with moderate dimensions (e.g. 10 and more), and predict super-Gaussian tails that are not readily available from little training data. These findings suggest that this class of models provide an efficient hypothesis space for learning strongly nonlinear flows from small amounts of data.


title: Lyapunov exponents for Quantum Channels: an entropy formula and generic properties

abstract: We denote by $M_k$ the set of $k$ by $k$ matrices with complex entries. We consider quantum channels $\phi_L$ of the form: given a measurable function $L:M_k\to M_k$ and a measure $\mu$ on $M_k$ we define the linear operator $\phi_L:M_k \to M_k$, by the law $\rho \,\to\,\phi_L(\rho) = \int_{M_k} L(v) \rho L(v)^\dagger \, \dm(v).$ On a previous work the authors show that for a fixed measure $\mu$ it is generic on the function $L$ the $\Phi$-Erg property (also irreducibility). Here we will show that the purification property is also generic on $L$ for a fixed $\mu$. Given $L$ and $\mu$ there are two related stochastic process: one takes values on the projective space $ P(\C^k)$ and the other on matrices in $M_k$. The $\Phi$-Erg property and the purification condition are good hypothesis for the discrete time evolution given by the natural transition probability. In this way it will follow that generically on $L$, if $\int |L(v)|^2 \log |L(v)|\, \ d\mu(v)<\infty$, then the Lyapunov exponents $\infty > \gamma_1\geq \gamma_2\geq ...\geq \gamma_k\geq -\infty$ are well defined. On the previous work it was presented the concepts of entropy of a channel and of Gibbs channel; and also an example (associated to a stationary Markov chain) where this definition of entropy (for a quantum channel) matches the Kolmogorov-Shanon definition of entropy. We estimate here the larger Lyapunov exponent for the above mentioned example and we show that it is equal to $-\frac{1}{2} \,h$, where $h$ is the entropy of the associated Markov probability.

categories: math.DS math-ph math.MP math.PR quant-ph


title: Is high-dimensional photonic entanglement robust to noise?

abstract: High-dimensional entangled states are of significant interest in quantum science as they increase the information content per photon and can remain entangled in the presence of significant noise. We develop the analytical theory and show experimentally that the noise tolerance of high-dimensional entanglement can be significantly increased by modest increases to the size of the Hilbert space. For example, doubling the size of a Hilbert space with local dimension d=300 leads to a reduction of the threshold detector efficiencies required for entanglement certification by two orders of magnitude. This work is developed in the context of spatial entanglement, but it can easily be translated to photonic states entangled in different degrees of freedom. We also demonstrate that knowledge of a single parameter, the signal-to-noise ratio, precisely links measures of entanglement to a range of experimental parameters quantifying noise in a quantum communication system, enabling accurate predictions of its performance. This work serves to answer a simple question: "Is high-dimensional photonic entaglement robust to noise?". Here we show that the answer is more nuanced than a simple "yes" or "no" and involves a complex interplay between the noise characteristics of the state, channel, and detection system


title: First-order homotopical logic

abstract: We introduce a homotopy-theoretic interpretation of intuitionistic first-order logic based on ideas from Homotopy Type Theory. We provide a categorical formulation of this interpretation using the framework of Grothendieck fibrations. We then use this formulation to prove the central property of this interpretation, namely homotopy invariance. To do this, we use the result from arXiv:1905.10690 that any Grothendieck fibration of the kind being considered can automatically be upgraded to a 2-dimensional fibration, after which the invariance property is reduced to an abstract theorem concerning pseudonatural transformations of morphisms into 2-dimensional fibrations.


title: Background in $\gamma$-ray detectors and carbon beam tests in the Felsenkeller shallow-underground accelerator laboratory

abstract: The relevant interaction energies for astrophysical radiative capture reactions are very low, much below the repulsive Coulomb barrier. This leads to low cross sections, low counting rates in $\gamma$-ray detectors, and therefore the need to perform such experiments at ion accelerators placed in underground settings, shielded from cosmic rays. Here, the feasibility of such experiments in the new shallow-underground accelerator laboratory in tunnels VIII and IX of the Felsenkeller site in Dresden, Germany, is evaluated. To this end, the no-beam background in three different types of germanium detectors, i.e. a Euroball/Miniball triple cluster and two large monolithic detectors, is measured over periods of 26-66 days. The cosmic-ray induced background is found to be reduced by a factor of 500-2400, by the combined effects of, first, the 140 meters water equivalent overburden attenuating the cosmic muon flux by a factor of 40, and second, scintillation veto detectors gating out most of the remaining muon-induced effects. The new background data are compared to spectra taken with the same detectors at the Earth's surface and at other underground sites. Subsequently, the beam intensity from the cesium sputter ion source installed in Felsenkeller has been studied over periods of several hours. Based on the background and beam intensity data reported here, for the example of the $^{12}$C($\alpha$,$\gamma$)$^{16}$O reaction it is shown that highly sensitive experiments will be possible.


title: von K\'arm\'an--Howarth and Corrsin equations closures through Liouville theorem

abstract: In this communication, the closure formulas of von K\'arm\'an--Howarth and Corrsin equations are obtained through the Liouville theorem and the hypothesis of homogeneous isotropic incompressible turbulence. Such closures, based on the concept that, in fully developed turbulence, contiguous fluid particles trajectories continuously diverge, are of non--diffusive nature, and express a correlations spatial propagation phenomenon between the several scales which occurs with a propagation speed depending on length scale and velocity standard deviation. These closure formulas coincide with those just obtained in previous works through the finite scale Lyapunov analysis of the fluid act of motion. Here, unlike the other articles, the present study does not use the Lyapunov theory, and provides the closures showing first an exact relationship between the pair spatial correlations calculated with the velocity distribution function and those obtained using the material separation line distribution function. As this analysis does not adopt the Lyapunov theory, this does not need the definition and/or the existence of the Lyapunov exponents. Accordingly, the present proof of the closures results to be more general and rigorous than that presented in the other works, corroborating the previous results. Finally, the conditions of existence of invariants in isotropic turbulence are studied by means of the proposed closures. In the presence of such invariants and self--similarity, the sole evolution of velocity and temperature standard deviations and of the correlation scales is shown to be adequate to fairly describe the isotropic turbulence.


title: Fast Dynamic Perfusion and Angiography Reconstruction using an end-to-end 3D Convolutional Neural Network

abstract: Hadamard time-encoded pseudo-continuous arterial spin labeling (te-pCASL) is a signal-to-noise ratio (SNR)-efficient MRI technique for acquiring dynamic pCASL signals that encodes the temporal information into the labeling according to a Hadamard matrix. In the decoding step, the contribution of each sub-bolus can be isolated resulting in dynamic perfusion scans. When acquiring te-ASL both with and without flow-crushing, the ASL-signal in the arteries can be isolated resulting in 4D-angiographic information. However, obtaining multi-timepoint perfusion and angiographic data requires two acquisitions. In this study, we propose a 3D Dense-Unet convolutional neural network with a multi-level loss function for reconstructing multi-timepoint perfusion and angiographic information from an interleaved $50\%$-sampled crushed and $50\%$-sampled non-crushed data, thereby negating the additional scan time. We present a framework to generate dynamic pCASL training and validation data, based on models of the intravascular and extravascular te-pCASL signals. The proposed network achieved SSIM values of $97.3 \pm 1.1$ and $96.2 \pm 11.1$ respectively for 4D perfusion and angiographic data reconstruction for 313 test data-sets.


title: Free Bertini's theorem and applications

abstract: The simplest version of Bertini's irreducibility theorem states that the generic fiber of a non-composite polynomial function is an irreducible hypersurface. The main result of this paper is its analog for a free algebra: if $f$ is a noncommutative polynomial such that $f-\lambda$ factors for infinitely many scalars $\lambda$, then there exist a noncommutative polynomial $h$ and a nonconstant univariate polynomial $p$ such that $f=p\circ h$. Two applications of free Bertini's theorem for matrix evaluations of noncommutative polynomials are given. An eigenlevel set of $f$ is the set of all matrix tuples $X$ where $f(X)$ attains some given eigenvalue. It is shown that eigenlevel sets of $f$ and $g$ coincide if and only if $fa=ag$ for some nonzero noncommutative polynomial $a$. The second application pertains quasiconvexity and describes polynomials $f$ such that the connected component of $\{X \text{ tuple of symmetric $n\times n$ matrices}: \lambda I\succ f(X) \}$ about the origin is convex for all natural $n$ and $\lambda>0$. It is shown that such a polynomial is either everywhere negative semidefinite or the composition of a univariate and a convex quadratic polynomial.


title: Quantum Algorithms for Jet Clustering

abstract: Identifying jets formed in high-energy particle collisions requires solving optimization problems over potentially large numbers of final-state particles. In this work, we consider the possibility of using quantum computers to speed up jet clustering algorithms. Focusing on the case of electron-positron collisions, we consider a well-known event shape called thrust whose optimum corresponds to the most jet-like separating plane among a set of particles, thereby defining two hemisphere jets. We show how to formulate thrust both as a quantum annealing problem and as a Grover search problem. A key component of our analysis is the consideration of realistic models for interfacing classical data with a quantum algorithm. With a sequential computing model, we show how to speed up the well-known O(N^3) classical algorithm to an O(N^2) quantum algorithm, including the O(N) overhead of loading classical data from N final-state particles. Along the way, we also identify a way to speed up the classical algorithm to O(N^2 log N) using a sorting strategy inspired by the SISCone jet algorithm, which has no natural quantum counterpart. With a parallel computing model, we achieve O(N log N) scaling in both the classical and quantum cases. Finally, we consider the generalization of these quantum methods to other jet algorithms more closely related to those used for proton-proton collisions at the Large Hadron Collider.


title: Multi-messenger tests of gravity with weakly lensed gravitational waves

abstract: General relativity (GR) predicts concordant trajectories for photons and gravitational waves (GW). We propose a new multi-messenger avenue (GW-CMB-CMB) to prove this aspect of fundamental physics by cross-correlating the GW signal of astrophysical origin with the lensing field derived from the cosmic microwave background (CMB). This new window will allow robust measurement of the prediction from GR with high signal-to-noise and will be able to unveil the true nature of gravity using the GW sources detected by missions such as the Laser Interferometer Space Antenna (LISA), Einstein Telescope and Cosmic Explorer.


title: Probing the theory of gravity with gravitational lensing of gravitational waves and galaxy surveys

abstract: The cross-correlation of gravitational wave strain with upcoming galaxy surveys probe theories of gravity in a new way. This method enables testing the theory of gravity by combining the effects from both gravitational lensing of gravitational waves and the propagation of gravitational waves in spacetime. We find that within 10 years, the combination of the Advanced-LIGO and VIRGO detector networks with planned galaxy surveys should detect weak gravitational lensing of gravitational waves in the low redshift Universe ($z<0.5$). With the next generation gravitational wave experiments such as Voyager, LISA, Cosmic-Explorer and Einstein Telescope, we can extend this test of the theory of gravity to larger redshifts by exploiting the synergies between electromagnetic wave and gravitational wave probes.


title: Gravity and the Nonlinear Growth of Structure in the Carnegie-Spitzer-IMACS Redshift Survey

abstract: A key obstacle to developing a satisfying theory of galaxy evolution is the difficulty in extending analytic descriptions of early structure formation into full nonlinearity, the regime in which galaxy growth occurs. Extant techniques, though powerful, are based on approximate numerical methods whose Monte Carlo-like nature hinders intuition building. Here, we develop a new solution to this problem and its empirical validation. We first derive closed-form analytic expectations for the evolution of fixed percentiles in the real-space cosmic density distribution, {\it averaged over representative volumes observers can track cross-sectionally\}. Using the Lagrangian forms of the fluid equations, we show that percentiles in $\delta$---the density relative to the median---should grow as $\delta(t)\propto\delta_{0}^{\alpha}\,t^{\beta}$, where $\alpha\equiv2$ and $\beta\equiv2$ for Newtonian gravity at epochs after the overdensities transitioned to nonlinear growth. We then use 9.5 sq. deg. of Carnegie-Spitzer-IMACS Redshift Survey data to map {\it galaxy\} environmental densities over $0.2<z<1.5$ ($\sim$7 Gyr) and infer $\alpha=1.98\pm0.04$ and $\beta=2.01\pm0.11$---consistent with our analytic prediction. These findings---enabled by swapping the Eulerian domain of most work on density growth for a Lagrangian approach to real-space volumetric averages---provide some of the strongest evidence that a lognormal distribution of early density fluctuations indeed decoupled from cosmic expansion to grow through gravitational accretion. They also comprise the first exact, analytic description of the nonlinear growth of structure extensible to (arbitrarily) low redshift. We hope these results open the door to new modeling of, and insight-building into, the galaxy growth and its diversity in cosmological contexts.


title: Probing correlated compensated isocurvature perturbations using scale-dependent galaxy bias

abstract: Compensated isocurvature perturbations (CIPs) are modulations of the relative baryon and dark matter density that leave the total matter density constant. The best current constraints from the primary cosmic microwave background (CMB) are consistent with CIPs some two orders of magnitude larger in amplitude than adiabatic perturbations, suggesting that there may be a huge gap in our knowledge of the early Universe. However, it was recently suggested by Barreira~et.~al. that CIPs which are correlated with the primordial curvature perturbation, as arises in some versions of the curvaton model, lead to a new observable: scale dependent galaxy bias. Combining a galaxy survey with an unbiased tracer of the density field facilitates a measurement of the amplitude of correlated CIPs that is free from cosmic variance, the main limitation on constraints from the primary CMB. Among the most promising tracers to use for this purpose is the remote dipole field, reconstructed using the technique of kinetic Sunyaev Zel'dovich (kSZ) tomography. In this paper, we evaluate the detection significance on the amplitude of correlated CIPs possible with next-generation CMB and galaxy surveys using kSZ tomography. Our analysis includes all relativistic contributions to the observed galaxy number counts and allows for both CIPs and primordial non-Gaussianity, which also gives rise to a scale dependent galaxy bias. We find that kSZ tomography can probe CIPs of comparable amplitude to the adiabatic fluctuations, representing an improvement of over two orders of magnitude upon current constraints, and an order of magnitude over what will be possible using future CMB or galaxy surveys alone.


title: A multi-factor polynomial framework for long-term electricity forwards with delivery period

abstract: We propose a multi-factor polynomial framework to model and hedge long-term electricity contracts with delivery period. This framework has several advantages: the computation of forwards, risk premium and correlation between different forwards are fully explicit, and the model can be calibrated to observed electricity forward curves easily and well. Electricity markets suffer from non-storability and poor medium- to long-term liquidity. Therefore, we suggest a rolling hedge which only uses liquid forward contracts and is risk-minimizing in the sense of F\"ollmer and Schweizer. We calibrate the model to over eight years of German power calendar year forward curves and investigate the quality of the risk-minimizing hedge over various time horizons.


title: Superluminal chaos after a quantum quench

abstract: Thermal states holographically dual to black holes in Einstein gravity display maximal Lyapunov growth as well as "butterfly effect cones". We study these effects in highly non-equilibrium states, obtained from an initial thermal state by the sudden injection of energy. We do this by computing out-of-time-order correlators (OTOCs) in BTZ-Vaidya spacetimes, which describe transitions between black holes at different temperatures. If both pairs of boundary operators appearing in the OTOC are inserted before the energy injection, we recover standard results, with butterfly effect cones displaying a light-cone structure. But when one pair of operators is inserted before and the other pair after the energy injection, the Lyapunov growth saturates the chaos bounds set by the local temperatures and the butterfly effect cones "open up", becoming superluminal, albeit in a way that does not violate causality. In the limiting case, in which the initial state is the vacuum, Lyapunov growth only starts after the energy injection. Our computations of the OTOCs are phrased in terms of gravitationally interacting particles, where fields are treated in a geodesic approximation and the eikonal phase shift is expressed in terms of stress tensors and shock waves associated to geodesics.


title: Fade to grey: systematic variation of the galaxy attenuation curves with galaxy properties in EAGLE

abstract: We present a simple model for galaxy attenuation by distilling SKIRT radiative transfer calculations for ~100,000 EAGLE galaxies at redshifts z=2-0. Our model adapts the two component screen model of Charlot & Fall (2000), parametrising the optical depth and slope of the ISM screen using the average dust surface density, $\Sigma_{\rm dust}$. We recover relatively tight relations between these parameters for the EAGLE sample, but also provide the scatter in these parameter owing to the morphological variation and orientation of galaxies. We also find that these relations are nearly independent of redshift in the EAGLE model. By pairing our model with an empirical prescription for birth clouds below the resolution scale of the simulation, we reproduce the observed relation between attenuation slope and optical depth for the first time in a cosmological simulation. We demonstrate that this result is remarkably independent of the attenuation properties assumed for birth cloud screen, merely requiring a boosted attenuation for infant stars. We present this model with a view to interpreting observations, as well as processing semi-analytic models and other hydrodynamic simulations.


title: Coupled electron-impurity and electron-phonon systems as trivial non-Fermi liquids

abstract: We consider an electron gas, both in two (2D) and three (3D) dimensions, interacting with quenched impurities and phonons within leading order finite-temperature many body perturbation theories, calculating the electron self-energies, spectral functions, and momentum distribution functions at finite temperatures. The resultant spectral function is in general highly non-Lorentzian, indicating that the system is not a Fermi liquid in the usual sense. The calculated momentum distribution function cannot be approximated by a Fermi function at any temperature, providing a rather simple example of a non-Fermi liquid with well-understood properties.


title: A 1d lattice model for the boundary of the quantum spin-Hall insulator

abstract: We present a 1d lattice model that mimics the boundary of the conventional 2d quantum spin-Hall insulator (QSHI) with $U(1)$ symmetry and time-reversal $T$, satisfying $T^2 = (-1)^F$. Our construction utilizes a local tensor product Hilbert space of finite site dimension with a non-onsite symmetry action. We discuss how several signature properties of the QSHI, such as the fractional charge on $T$-domain walls and Kramers parity switching upon $\pi$-flux threading, are manifested in our treatment. We also present a 1d Hamiltonian whose ground state realizes the conventional Luttinger-liquid phase of the QSHI edge.


title: Mass Agnostic Jet Taggers

abstract: Searching for new physics in large data sets needs a balance between two competing effects---signal identification vs background distortion. In this work, we perform a systematic study of both single variable and multivariate jet tagging methods that aim for this balance. The methods preserve the shape of the background distribution by either augmenting the training procedure or the data itself. Multiple quantitative metrics to compare the methods are considered, for tagging 2-, 3-, or 4-prong jets from the QCD background. This is the first study to show that the data augmentation techniques of Planing and PCA based scaling deliver similar performance as the augmented training techniques of Adversarial NN and uBoost, but are both easier to implement and computationally cheaper.


title: Neural Text Summarization: A Critical Evaluation

abstract: Text summarization aims at compressing long documents into a shorter form that conveys the most important parts of the original document. Despite increased interest in the community and notable research effort, progress on benchmark datasets has stagnated. We critically evaluate key ingredients of the current research setup: datasets, evaluation metrics, and models, and highlight three primary shortcomings: 1) automatically collected datasets leave the task underconstrained and may contain noise detrimental to training and evaluation, 2) current evaluation protocol is weakly correlated with human judgment and does not account for important characteristics such as factual correctness, 3) models overfit to layout biases of current datasets and offer limited diversity in their outputs.


title: Pareto-optimal data compression for binary classification tasks

abstract: The goal of lossy data compression is to reduce the storage cost of a data set $X$ while retaining as much information as possible about something ($Y$) that you care about. For example, what aspects of an image $X$ contain the most information about whether it depicts a cat? Mathematically, this corresponds to finding a mapping $X\to Z\equiv f(X)$ that maximizes the mutual information $I(Z,Y)$ while the entropy $H(Z)$ is kept below some fixed threshold. We present a method for mapping out the Pareto frontier for classification tasks, reflecting the tradeoff between retained entropy and class information. We first show how a random variable $X$ (an image, say) drawn from a class $Y\in\{1,...,n\}$ can be distilled into a vector $W=f(X)\in \mathbb{R}^{n-1}$ losslessly, so that $I(W,Y)=I(X,Y)$; for example, for a binary classification task of cats and dogs, each image $X$ is mapped into a single real number $W$ retaining all information that helps distinguish cats from dogs. For the $n=2$ case of binary classification, we then show how $W$ can be further compressed into a discrete variable $Z=g_\beta(W)\in\{1,...,m_\beta\}$ by binning $W$ into $m_\beta$ bins, in such a way that varying the parameter $\beta$ sweeps out the full Pareto frontier, solving a generalization of the Discrete Information Bottleneck (DIB) problem. We argue that the most interesting points on this frontier are "corners" maximizing $I(Z,Y)$ for a fixed number of bins $m=2,3...$ which can be conveniently be found without multiobjective optimization. We apply this method to the CIFAR-10, MNIST and Fashion-MNIST datasets, illustrating how it can be interpreted as an information-theoretically optimal image clustering algorithm.


title: Well-Read Students Learn Better: On the Importance of Pre-training Compact Models

abstract: Recent developments in natural language representations have been accompanied by large and expensive models that leverage vast amounts of general-domain text through self-supervised pre-training. Due to the cost of applying such models to down-stream tasks, several model compression techniques on pre-trained language representations have been proposed (Sun et al., 2019; Sanh, 2019). However, surprisingly, the simple baseline of just pre-training and fine-tuning compact models has been overlooked. In this paper, we first show that pre-training remains important in the context of smaller architectures, and fine-tuning pre-trained compact models can be competitive to more elaborate methods proposed in concurrent work. Starting with pre-trained compact models, we then explore transferring task knowledge from large fine-tuned models through standard knowledge distillation. The resulting simple, yet effective and general algorithm, Pre-trained Distillation, brings further improvements. Through extensive experiments, we more generally explore the interaction between pre-training and distillation under two variables that have been under-studied: model size and properties of unlabeled task data. One surprising observation is that they have a compound effect even when sequentially applied on the same data. To accelerate future research, we will make our 24 pre-trained miniature BERT models publicly available.


title: CertiQ: A Mostly-automated Verification of a Realistic Quantum Compiler

abstract: We present CertiQ, a verification framework for writing and verifying compiler passes of Qiskit, the most widely-used quantum compiler. To our knowledge, CertiQ is the first effort enabling the verification of real-world quantum compiler passes in a mostly-automated manner. Compiler passes written in the CertiQ interface with annotations can be used to generate verification conditions, as well as the executable code that can be integrated into Qiskit. CertiQ introduces the quantum circuit calculus to enable the efficient checking of equivalence of quantum circuits by encoding such a checking procedure into an SMT problem. CertiQ also provides a verified library of widely-used data structures, transformation functions for circuits, and conversion functions for different quantum data representations. This verified library not only enables modular verification but also sheds light on future quantum compiler design. We have re-implemented and verified 26 (out of 30) Qiskit compiler passes in CertiQ, during which three bugs are detected in the Qiskit implementation. Our verified compiler pass implementations passed all of Qiskit's regression tests without showing noticeable performance loss.


title: Vector-like quarks with non-renormalizable interactions

abstract: We study the impact of the leading non-renormalizable terms in the effective field theory that describes general extensions of the Standard Model with vector-like quarks. Dropping the usual assumption of renormalizability has several phenomenological consequences for the production and decay of the heavy quarks and also for Higgs physics. The most dramatic effects, including those associated with a long lifetime, occur for vector-like quarks with non-standard quantum numbers.


title: The Intriguing Polar EU Cancri in the Eyes of Kepler K2

abstract: We present the light curve of EU Cnc, the first published analysis of a Kepler light curve of a polar. Although EU Cnc was extremely faint during campaign 16 and 18 its light curve showed a large-amplitude pulse that lasted for half of each orbit, which we interpret to be light from an accretion region that rotates behind the limb of the white dwarf for half of the orbit. Remarkably, the pulse profile showed no appreciable variability in either campaign. Additionally, we note weak dips of unknown origin with a depth of ~10% at the beginning and end of the orbital hump. The K2 waveform is consistent with all previously reported variations on the orbital timescale, suggesting that EU Cnc has possibly been at the same low state for its entire observational history. We then explore the possibility that EU Cnc's unusual combination of a low mass-transfer rate and consistent light curve indicates the possibility that EU Cnc might be a low-accretion-rate polar (LARP).


title: Power Efficient Discontinuous Reception in THz and mmWave Wireless Systems

abstract: Discontinuous reception (DRX), where a user equip-ment (UE) temporarily disables its receiver, is a critical power saving feature in modern cellular systems. DRX is likely tobe particularly aggressively used in the mmWave and THzfrequencies due to the high front end power consumption. A keychallenge of DRX in these frequencies is that individual links are directional and highly susceptible to blockage. MmWave and THz UEs will therefore likely need to monitor multiple cells in multiple directions to ensure continuous reliable connectivity.This work proposes a novel, heuristic algorithm to dynamically select the cells to monitor to attempt to optimally trade-off link reliability and power consumption. The paper provides preliminary estimates of connected mode DRX mode consumption using detailed and realistic statistical models of blockers at both 28 and 140 GHz. It is found that although blockage dynamics are faster at 140 GHz, reliable connectivity at low power can be maintained with sufficient macro-diversity and link prediction


title: Helicity amplitudes in the $\bar{B} \to D^{*} \bar{\nu}_\tau \tau$ decay with $V-A$ breaking in the quark sector

abstract: In view of the recent measurement of the $F_L^{D^*}$ magnitude in the $\bar{B} \to D^{*} \bar{\nu}_\tau \tau$ reaction we evaluate this magnitude within the standard model and for a family of models with the $\gamma^\mu -\alpha\gamma^\mu \gamma_5$ current structure for the quarks for different values of $\alpha$. At the same time we evaluate also the transverse contributions, $M=-1$, $M=+1$, and find that the difference between the $M=-1$ and $M=+1$ contributions is far more sensitive to changes in $\alpha$ than the longitudinal component.


title: Experimental detection of microscopic environments using thermodynamic observables

abstract: Modern thermodynamic theories can be used to study highly complex quantum dynamics. Here, we experimentally demonstrate that the violation of thermodynamic constraints allows to detect the coupling of a quantum system to a hidden environment. By using the IBM quantum superconducting processors, we perform thermodynamic tests to detect a qubit environment interacting with a system composed of up to four qubits. The experiments are complemented by theoretical findings that show efficient scalability of the tests with respect to system size. Hence, they may be useful to detect an open system dynamics in situations where other methods (e.g. quantum state tomography) are practically infeasible.


title: Studies of Bi-layers Growth Mechanism of Silver Bromide Molecular Clusters Prepared Via Electroporation of Vesicles and Quantum Confinement Effects Applications of Molecular Clusters

abstract: Our previous work show that in the molecular cluster regime, the band blue shift associated with cluster growth can be understood by a model that assume electrons are confined to a spherical potential well and the clusters are made of some basic units. A formula is given for the lowest excited electronic state energy. This expression contains an electron-hole-pair (EHP) delocalization constant as an adjustable parameter which, however, can be anchored to a definite value through the known transition energy at the spectra turn-around point. We also proposed symmetry and probability principles in molecular cluster growth range to explain the molecular cluster electron absorption spectra turn-around phenomena and unusual isotopic properties of small silver bromide clusters. In this paper, based on systematical review of Quasi-Elastic Light Scattering (QELS), Fourier-transform infrared spectroscopy (FTIR) and Direct Laser Desorption Mass Spectra (DLD-MS) experiments of silver bromide clusters prepared via the electroporation of vesicles, we show how the symmetry and probability principles in molecular cluster growth range can be used to explain the lager silver bromide molecular cluster formation in a bilayer formation mechanism. The turn round curve of energy gap vs confine sphere size had been proved to be a right curve to describe the molecular cluster quantum confinement behavior. We also defined Electron Delocalized Status (EDS), Electron Localized Status (ELS), and EDS/ELS switch or quantum confinement switch (QCS) in the quantum confine system. These studies pave the theoretical and technical ways for advanced device technology continue shrink and new concept device generation in the atomic and molecular cluster size range.


title: Optimal Heterogeneous Asset Location Modeling for Expected Spatiotemporal Search and Rescue Demands using Historic Event Data

abstract: The United States Coast Guard is charged with the coordination of all search and rescue missions in maritime regions within the United States purview. Given the size of the Pacific Ocean and the limited resources available to respond to search and rescue missions in this region, the service seeks to posture its aligned fleet of maritime and aeronautical assets to reduce the expected response time for such missions. Leveraging historic event records for the region of interest, we propose and demonstrate a two-stage solution approach. In the first stage, we develop and apply a stochastic zonal distribution model to evaluate spatiotemporal trends for emergency event rates and corresponding response strategies to inform the probabilistic modeling of future rescue events respective locations, frequencies, and demands for support. In the second stage, the results from the aforementioned analysis enable the parameterization and solution of a integer linear programming formulation to identify the best locations at which to station limited heterogeneous search and rescue assets. Considering both the 50th and 75th percentile levels of forecast event and asset demand distributions using 7.5 years of historical event data, our models identify asset location strategies that respectively yield a 9.6 percent and 17.6 percent increase in coverage over current asset basing when allowing locations among current homeports and airports, as well as respective 67.3 percent and 57.4 percent increases in coverage when considering a larger set of feasible basing locations. Keywords: search and rescue, spatiotemporal forecasting, location-allocation modeling, p-median location problem, multi-objective optimization


title: Deploying Technology to Save Endangered Languages

abstract: Computer scientists working on natural language processing, native speakers of endangered languages, and field linguists to discuss ways to harness Automatic Speech Recognition, especially neural networks, to automate annotation, speech tagging, and text parsing on endangered languages.


title: Calibration of Deep Probabilistic Models with Decoupled Bayesian Neural Networks

abstract: Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in critical decision scenarios. In this work, we propose to use a decoupled Bayesian stage, implemented with a Bayesian Neural Network (BNN), to map the uncalibrated probabilities provided by a DNN to calibrated ones, consistently improving calibration. Our results evidence that incorporating uncertainty provides more reliable probabilistic models, a critical condition for achieving good calibration. We report a generous collection of experimental results using high-accuracy DNNs in standardized image classification benchmarks, showing the good performance, flexibility and robust behavior of our approach with respect to several state-of-the-art calibration methods. Code for reproducibility is provided.


title: No evidence for critical slowing down prior to human epileptic seizures

abstract: There is a ongoing debate whether generic early warning signals for critical transitions exist that can be applied across diverse systems. The human epileptic brain is often considered as a prototypical system, given the devastating and, at times, even life-threatening nature of the extreme event epileptic seizure. More than three decades of international effort has successfully identified predictors of imminent seizures. However, the suitability of typically applied early warning indicators for critical slowing down, namely variance and lag-1 autocorrelation, for indexing seizure susceptibility is still controversially discussed. Here, we investigated long-term, multichannel recordings of brain dynamics from 28 subjects with epilepsy. Using a surrogate-based evaluation procedure of sensitivity and specificity of time-resolved estimates of early warning indicators, we found no evidence for critical slowing down prior to 105 epileptic seizures.


title: Anomalous Kerr Effect in SrRuO$_3$ Thin Films

abstract: We study the magneto-optical Kerr effect (MOKE) in SrRuO$_3$ thin films, uncovering wide regimes of wavelength, temperature, and magnetic field where the Kerr rotation is not simply proportional to the magnetization but instead displays two-component behavior. One component of the MOKE signal tracks the average magnetization, while the second "anomalous" component bears a resemblance to anomalies in the Hall resistivity which have been previously reported in skyrmion materials. We present a theory showing that the MOKE anomalies arise from the non-monotonic relation between the Kerr angle and the magnetization, when we average over magnetic domains which proliferate near the coercive field. Our results suggest that inhomogeneous domain formation, rather than skyrmions, may provide a common origin for the observed MOKE and Hall resistivity anomalies.


title: Generalized K$\ddot{a}$hler Geometry in Kazama-Suzuki coset models

abstract: It is shown that Kazama-Suzuki conditions for the denominator subgroup of N=2 superconformal $G/H$ coset model determine Generalized K$\ddot{a}$hler geometry on the target space of the corresponding N=2 supersymmetric $\sigma$-model.


title: MASR: A Modular Accelerator for Sparse RNNs

abstract: Recurrent neural networks (RNNs) are becoming the de facto solution for speech recognition. RNNs exploit long-term temporal relationships in data by applying repeated, learned transformations. Unlike fully-connected (FC) layers with single vector matrix operations, RNN layers consist of hundreds of such operations chained over time. This poses challenges unique to RNNs that are not found in convolutional neural networks (CNNs) or FC models, namely large dynamic activation. In this paper we present MASR, a principled and modular architecture that accelerates bidirectional RNNs for on-chip ASR. MASR is designed to exploit sparsity in both dynamic activations and static weights. The architecture is enhanced by a series of dynamic activation optimizations that enable compact storage, ensure no energy is wasted computing null operations, and maintain high MAC utilization for highly parallel accelerator designs. In comparison to current state-of-the-art sparse neural network accelerators (e.g., EIE), MASR provides 2x area 3x energy, and 1.6x performance benefits. The modular nature of MASR enables designs that efficiently scale from resource-constrained low-power IoT applications to large-scale, highly parallel datacenter deployments.


title: Vector Fitting

abstract: We introduce the Vector Fitting algorithm for the creation of reduced-order models from the sampled response of a linear time-invariant system. This data-driven approach to reduction is particularly useful when the system under modeling is known only through experimental measurements. The theory behind Vector Fitting is presented for single- and multiple-input systems, together with numerical details, pseudocodes, and an open-source implementation. We discuss how the reduced model can be made stable and converted to a variety of forms for use in virtually any modeling context. Finally, we survey recent extensions of the Vector Fitting algorithm geared towards time-domain, parametric and distributed systems modeling.


title: Legendrian DGA Representations and the Colored Kauffman Polynomial

abstract: For any Legendrian knot $K$ in standard contact ${\mathbb R}^3$ we relate counts of ungraded ($1$-graded) representations of the Legendrian contact homology DG-algebra $(\mathcal{A}(K),\partial)$ with the $n$-colored Kauffman polynomial. To do this, we introduce an ungraded $n$-colored ruling polynomial, $R^1_{n,K}(q)$, as a linear combination of reduced ruling polynomials of positive permutation braids and show that (i) $R^1_{n,K}(q)$ arises as a specialization $F_{n,K}(a,q)\big|_{a^{-1}=0}$ of the $n$-colored Kauffman polynomial and (ii) when $q$ is a power of two $R^1_{n,K}(q)$ agrees with the total ungraded representation number, $\operatorname{Rep}_1\big(K, \mathbb{F}_q^n\big)$, which is a normalized count of $n$-dimensional representations of $(\mathcal{A}(K),\partial)$ over the finite field $\mathbb{F}_q$. This complements results from [Leverson C., Rutherford D., Quantum Topol. 11 (2020), 55-118, arXiv:1802.10531] concerning the colored HOMFLY-PT polynomial, $m$-graded representation numbers, and $m$-graded ruling polynomials with $m \neq 1$.


title: Controlling for Confounders in Multimodal Emotion Classification via Adversarial Learning

abstract: Various psychological factors affect how individuals express emotions. Yet, when we collect data intended for use in building emotion recognition systems, we often try to do so by creating paradigms that are designed just with a focus on eliciting emotional behavior. Algorithms trained with these types of data are unlikely to function outside of controlled environments because our emotions naturally change as a function of these other factors. In this work, we study how the multimodal expressions of emotion change when an individual is under varying levels of stress. We hypothesize that stress produces modulations that can hide the true underlying emotions of individuals and that we can make emotion recognition algorithms more generalizable by controlling for variations in stress. To this end, we use adversarial networks to decorrelate stress modulations from emotion representations. We study how stress alters acoustic and lexical emotional predictions, paying special attention to how modulations due to stress affect the transferability of learned emotion recognition models across domains. Our results show that stress is indeed encoded in trained emotion classifiers and that this encoding varies across levels of emotions and across the lexical and acoustic modalities. Our results also show that emotion recognition models that control for stress during training have better generalizability when applied to new domains, compared to models that do not control for stress during training. We conclude that is is necessary to consider the effect of extraneous psychological factors when building and testing emotion recognition models.


title: Evaluating probabilistic forecasts of football matches: The case against the Ranked Probability Score

abstract: A scoring rule is a function of a probabilistic forecast and a corresponding outcome that is used to evaluate forecast performance. A wide range of scoring rules have been defined over time and there is some debate as to which are the most appropriate for evaluating the performance of forecasts of sporting events. This paper focuses on forecasts of the outcomes of football matches. The ranked probability score (RPS) is often recommended since it is `sensitive to distance', that is it takes into account the ordering in the outcomes (a home win is `closer' to a draw than it is to an away win, for example). In this paper, this reasoning is disputed on the basis that it adds nothing in terms of the actual aims of using scoring rules. A related property of scoring rules is locality. A scoring rule is local if it only takes the probability placed on the outcome into consideration. Two simulation experiments are carried out in the context of football matches to compare the performance of the RPS, which is non-local and sensitive to distance, the Brier score, which is non-local and insensitive to distance, and the ignorance score, which is local and insensitive to distance. The ignorance score is found to outperform both the RPS and the Brier score, casting doubt on the value of non-locality and sensitivity to distance as properties of scoring rules in this context.


title: Ultraweak formulation of linear PDEs in nondivergence form and DPG approximation

abstract: We develop and analyze an ultraweak formulation of linear PDEs in nondivergence form where the coefficients satisfy the Cordes condition. Based on the ultraweak formulation we propose discontinuous Petrov--Galerkin (DPG) methods. We investigate Fortin operators for the fully discrete schemes and provide a posteriori estimators for the methods under consideration. Numerical experiments are presented in the case of uniform and adaptive mesh-refinement.


title: Non Cooperative Game Theoretic Approach for Residential Energy Management in Smart Grid

abstract: Demand side management (DSM) is one of the main functionalities of the smart grid as it allows the consumer to adjust its energy consumption for an efficient energy management. Most of the existing DSM techniques aim at minimizing the energy cost while not considering the comfort of consumers. Therefore, maintaining a trade-off between these two conflicting objectives is still a challenging task. This paper proposes a novel DSM approach for residential consumers based on a non-cooperative game theoretic approach, where each player is encouraged to reshape its electricity consumption pattern through the dynamic pricing policy applied by the smart grid operator. The players are guided to select the best strategy that consists of scheduling their electric appliances in order to minimize the daily energy cost and their discomfort level. The Nash Equilibrium of the energy management game is achieved using Non-Sorting Genetic Algorithm NSGA-II. Simulation results show the effectiveness of the distributed non cooperative game approach for the residential energy management problem where an appreciable energy cost reduction is reached while maintaining the discomfort in an acceptable level.


title: A Little Annotation does a Lot of Good: A Study in Bootstrapping Low-resource Named Entity Recognizers

abstract: Most state-of-the-art models for named entity recognition (NER) rely on the availability of large amounts of labeled data, making them challenging to extend to new, lower-resourced languages. However, there are now several proposed approaches involving either cross-lingual transfer learning, which learns from other highly resourced languages, or active learning, which efficiently selects effective training data based on model predictions. This paper poses the question: given this recent progress, and limited human annotation, what is the most effective method for efficiently creating high-quality entity recognizers in under-resourced languages? Based on extensive experimentation using both simulated and real human annotation, we find a dual-strategy approach best, starting with a cross-lingual transferred model, then performing targeted annotation of only uncertain entity spans in the target language, minimizing annotator effort. Results demonstrate that cross-lingual transfer is a powerful tool when very little data can be annotated, but an entity-targeted annotation strategy can achieve competitive accuracy quickly, with just one-tenth of training data.


title: Atlas: A Dataset and Benchmark for E-commerce Clothing Product Categorization

abstract: In E-commerce, it is a common practice to organize the product catalog using product taxonomy. This enables the buyer to easily locate the item they are looking for and also to explore various items available under a category. Product taxonomy is a tree structure with 3 or more levels of depth and several leaf nodes. Product categorization is a large scale classification task that assigns a category path to a particular product. Research in this area is restricted by the unavailability of good real-world datasets and the variations in taxonomy due to the absence of a standard across the different e-commerce stores. In this paper, we introduce a high-quality product taxonomy dataset focusing on clothing products which contain 186,150 images under clothing category with 3 levels and 52 leaf nodes in the taxonomy. We explain the methodology used to collect and label this dataset. Further, we establish the benchmark by comparing image classification and Attention based Sequence models for predicting the category path. Our benchmark model reaches a micro f-score of 0.92 on the test set. The dataset, code and pre-trained models are publicly available at \url{https://github.com/vumaasha/atlas}. We invite the community to improve upon these baselines.


title: Who, Where, and What to Wear? Extracting Fashion Knowledge from Social Media

abstract: Fashion knowledge helps people to dress properly and addresses not only physiological needs of users, but also the demands of social activities and conventions. It usually involves three mutually related aspects of: occasion, person and clothing. However, there are few works focusing on extracting such knowledge, which will greatly benefit many downstream applications, such as fashion recommendation. In this paper, we propose a novel method to automatically harvest fashion knowledge from social media. We unify three tasks of occasion, person and clothing discovery from multiple modalities of images, texts and metadata. For person detection and analysis, we use the off-the-shelf tools due to their flexibility and satisfactory performance. For clothing recognition and occasion prediction, we unify the two tasks by using a contextualized fashion concept learning module, which captures the dependencies and correlations among different fashion concepts. To alleviate the heavy burden of human annotations, we introduce a weak label modeling module which can effectively exploit machine-labeled data, a complementary of clean data. In experiments, we contribute a benchmark dataset and conduct extensive experiments from both quantitative and qualitative perspectives. The results demonstrate the effectiveness of our model in fashion concept prediction, and the usefulness of extracted knowledge with comprehensive analysis.


title: Mix & Match: training convnets with mixed image sizes for improved accuracy, speed and scale resiliency

abstract: Convolutional neural networks (CNNs) are commonly trained using a fixed spatial image size predetermined for a given model. Although trained on images of aspecific size, it is well established that CNNs can be used to evaluate a wide range of image sizes at test time, by adjusting the size of intermediate feature maps. In this work, we describe and evaluate a novel mixed-size training regime that mixes several image sizes at training time. We demonstrate that models trained using our method are more resilient to image size changes and generalize well even on small images. This allows faster inference by using smaller images attest time. For instance, we receive a 76.43% top-1 accuracy using ResNet50 with an image size of 160, which matches the accuracy of the baseline model with 2x fewer computations. Furthermore, for a given image size used at test time, we show this method can be exploited either to accelerate training or the final test accuracy. For example, we are able to reach a 79.27% accuracy with a model evaluated at a 288 spatial size for a relative improvement of 14% over the baseline.


title: PCGAN-CHAR: Progressively Trained Classifier Generative Adversarial Networks for Classification of Noisy Handwritten Bangla Characters

abstract: Due to the sparsity of features, noise has proven to be a great inhibitor in the classification of handwritten characters. To combat this, most techniques perform denoising of the data before classification. In this paper, we consolidate the approach by training an all-in-one model that is able to classify even noisy characters. For classification, we progressively train a classifier generative adversarial network on the characters from low to high resolution. We show that by learning the features at each resolution independently a trained model is able to accurately classify characters even in the presence of noise. We experimentally demonstrate the effectiveness of our approach by classifying noisy versions of MNIST, handwritten Bangla Numeral, and Basic Character datasets.


abstract: Explaining the prediction of deep neural networks (DNNs) and semantic image compression are two active research areas of deep learning with a numerous of applications in decision-critical systems, such as surveillance cameras, drones and self-driving cars, where interpretable decision is critical and storage/network bandwidth is limited. In this paper, we propose a novel end-to-end Neural Image Compression and Explanation (NICE) framework that learns to (1) explain the predictions of convolutional neural networks (CNNs), and (2) subsequently compress the input images for efficient storage or transmission. Specifically, NICE generates a sparse mask over an input image by attaching a stochastic binary gate to each pixel of the image, whose parameters are learned through the interaction with the CNN classifier to be explained. The generated mask is able to capture the saliency of each pixel measured by its influence to the final prediction of CNN; it can also be used to produce a mixed-resolution image, where important pixels maintain their original high resolution and insignificant background pixels are subsampled to a low resolution. The produced images achieve a high compression rate (e.g., about 0.6x of original image file size), while retaining a similar classification accuracy. Extensive experiments across multiple image classification benchmarks demonstrate the superior performance of NICE compared to the state-of-the-art methods in terms of explanation quality and semantic image compression rate. Our code is available at: https://github.com/lxuniverse/NICE.


title: Learning Disentangled Representations via Independent Subspaces

abstract: Image generating neural networks are mostly viewed as black boxes, where any change in the input can have a number of globally effective changes on the output. In this work, we propose a method for learning disentangled representations to allow for localized image manipulations. We use face images as our example of choice. Depending on the image region, identity and other facial attributes can be modified. The proposed network can transfer parts of a face such as shape and color of eyes, hair, mouth, etc.~directly between persons while all other parts of the face remain unchanged. The network allows to generate modified images which appear like realistic images. Our model learns disentangled representations by weak supervision. We propose a localized resnet autoencoder optimized using several loss functions including a loss based on the semantic segmentation, which we interpret as masks, and a loss which enforces disentanglement by decomposition of the latent space into statistically independent subspaces. We evaluate the proposed solution w.r.t. disentanglement and generated image quality. Convincing results are demonstrated using the CelebA dataset.


title: Deep Multi-Kernel Convolutional LSTM Networks and an Attention-Based Mechanism for Videos

abstract: Action recognition greatly benefits motion understanding in video analysis. Recurrent networks such as long short-term memory (LSTM) networks are a popular choice for motion-aware sequence learning tasks. Recently, a convolutional extension of LSTM was proposed, in which input-to-hidden and hidden-to-hidden transitions are modeled through convolution with a single kernel. This implies an unavoidable trade-off between effectiveness and efficiency. Herein, we propose a new enhancement to convolutional LSTM networks that supports accommodation of multiple convolutional kernels and layers. This resembles a Network-in-LSTM approach, which improves upon the aforementioned concern. In addition, we propose an attention-based mechanism that is specifically designed for our multi-kernel extension. We evaluated our proposed extensions in a supervised classification setting on the UCF-101 and Sports-1M datasets, with the findings showing that our enhancements improve accuracy. We also undertook qualitative analysis to reveal the characteristics of our system and the convolutional LSTM baseline.


title: Football is becoming more predictable; Network analysis of 88 thousands matches in 11 major leagues

abstract: In recent years excessive monetization of football and professionalism among the players has been argued to have affected the quality of the match in different ways. On the one hand, playing football has become a high-income profession and the players are highly motivated; on the other hand, stronger teams have higher incomes and therefore afford better players leading to an even stronger appearance in tournaments that can make the game more imbalanced and hence predictable. To quantify and document this observation, in this work we take a minimalist network science approach to measure the predictability of football over 26 years in major European leagues. We show that over time, the games in major leagues have indeed become more predictable. We provide further support for this observation by showing that inequality between teams has increased and the home-field advantage has been vanishing ubiquitously. We do not include any direct analysis on the effects of monetization on football's predictability or therefore, lack of excitement, however, we propose several hypotheses which could be tested in future analyses.


title: MEx: Multi-modal Exercises Dataset for Human Activity Recognition

abstract: MEx: Multi-modal Exercises Dataset is a multi-sensor, multi-modal dataset, implemented to benchmark Human Activity Recognition(HAR) and Multi-modal Fusion algorithms. Collection of this dataset was inspired by the need for recognising and evaluating quality of exercise performance to support patients with Musculoskeletal Disorders(MSD). We select 7 exercises regularly recommended for MSD patients by physiotherapists and collected data with four sensors a pressure mat, a depth camera and two accelerometers. The dataset contains three data modalities; numerical time-series data, video data and pressure sensor data posing interesting research challenges when reasoning for HAR and Exercise Quality Assessment. This paper presents our evaluation of the dataset on number of standard classification algorithms for the HAR task by comparing different feature representation algorithms for each sensor. These results set a reference performance for each individual sensor that expose their strengths and weaknesses for the future tasks. In addition we visualise pressure mat data to explore the potential of the sensor to capture exercise performance quality. With the recent advancement in multi-modal fusion, we also believe MEx is a suitable dataset to benchmark not only HAR algorithms, but also fusion algorithms of heterogeneous data types in multiple application domains.