title: Occlusion resistant learning of intuitive physics from videos

abstract: To reach human performance on complex tasks, a key ability for artificial systems is to understand physical interactions between objects, and predict future outcomes of a situation. This ability, often referred to as intuitive physics, has recently received attention and several methods were proposed to learn these physical rules from video sequences. Yet, most of these methods are restricted to the case where no, or only limited, occlusions occur. In this work we propose a probabilistic formulation of learning intuitive physics in 3D scenes with significant inter-object occlusions. In our formulation, object positions are modeled as latent variables enabling the reconstruction of the scene. We then propose a series of approximations that make this problem tractable. Object proposals are linked across frames using a combination of a recurrent interaction network, modeling the physics in object space, and a compositional renderer, modeling the way in which objects project onto pixel space. We demonstrate significant improvements over state-of-the-art in the intuitive physics benchmark of IntPhys. We apply our method to a second dataset with increasing levels of occlusions, showing it realistically predicts segmentation masks up to 30 frames in the future. Finally, we also show results on predicting motion of objects in real videos.


title: Direct geometrical measurement of the Hubble constant from galaxy parallax: predictions for the Vera C. Rubin Observatory and Nancy Grace Roman Space Telescope

abstract: We investigate the possibility that a statistical detection of the galaxy parallax shift due to the Earth's motion with respect to the CMB frame (cosmic secular parallax) could be made by the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) or by the Nancy Grace Roman Space Telescope (NGRST), and used to measure the Hubble constant. We make mock galaxy surveys which extend to redshift z=0.06 from a large N-body simulation, and include astrometric errors from the LSST and NGRST science requirements, redshift errors and peculiar velocities. We include spectroscopic redshifts for the brightest galaxies (r < 18) in the fiducial case. We use these catalogues to make measurements of parallax versus redshift,for various assumed survey parameters and analysis techniques. We find that in order to make a competitive measurement it will be necessary to model and correct for the peculiar velocity component of galaxy proper motions. It will also be necessary to push astrometry of extended sources into a new regime, and combine information from the different elements of resolved galaxies. In an appendix we describe some simple tests of galaxy image registration which yield relatively promising results. For our fiducial survey parameters, we predict an rms error on the direct geometrical measurement of H0 of 2.8% for LSST and 0.8% for NGRST.


title: Magnetic-Field Tunable Intertwined Checkerboard Charge Order and Nematicity in the Surface Layer of Sr$_2$RuO$_4$

abstract: In strongly correlated electron materials, the electronic, spin, and charge degrees of freedom are closely intertwined. This often leads to the stabilization of emergent orders that are highly sensitive to external physical stimuli promising opportunities for technological applications. In perovskite ruthenates, this sensitivity manifests in dramatic changes of the physical properties with subtle structural details of the RuO$_6$ octahedra, stabilizing enigmatic correlated ground states, from a hotly debated superconducting state via electronic nematicity and metamagnetic quantum criticality to ferromagnetism. Here, it is demonstrated that the rotation of the RuO$_6$ octahedra in the surface layer of Sr$_2$RuO$_4$ generates new emergent orders not observed in the bulk material. Through atomic-scale spectroscopic characterization of the low-energy electronic states, four van Hove singularities are identified in the vicinity of the Fermi energy. The singularities can be directly linked to intertwined nematic and checkerboard charge order. Tuning of one of these van Hove singularities by magnetic field is demonstrated, suggesting that the surface layer undergoes a Lifshitz transition at a magnetic field of ~32T. The results establish the surface layer of Sr$_2$RuO$_4$ as an exciting 2D correlated electron system and highlight the opportunities for engineering the low-energy electronic states in these systems.


title: Two Burning Questions on COVID-19: Did shutting down the economy help? Can we (partially) reopen the economy without risking the second wave?

abstract: As we reach the apex of the COVID-19 pandemic, the most pressing question facing us is: can we even partially reopen the economy without risking a second wave? We first need to understand if shutting down the economy helped. And if it did, is it possible to achieve similar gains in the war against the pandemic while partially opening up the economy? To do so, it is critical to understand the effects of the various interventions that can be put into place and their corresponding health and economic implications. Since many interventions exist, the key challenge facing policy makers is understanding the potential trade-offs between them, and choosing the particular set of interventions that works best for their circumstance. In this memo, we provide an overview of Synthetic Interventions (a natural generalization of Synthetic Control), a data-driven and statistically principled method to perform what-if scenario planning, i.e., for policy makers to understand the trade-offs between different interventions before having to actually enact them. In essence, the method leverages information from different interventions that have already been enacted across the world and fits it to a policy maker's setting of interest, e.g., to estimate the effect of mobility-restricting interventions on the U.S., we use daily death data from countries that enforced severe mobility restrictions to create a "synthetic low mobility U.S." and predict the counterfactual trajectory of the U.S. if it had indeed applied a similar intervention. Using Synthetic Interventions, we find that lifting severe mobility restrictions and only retaining moderate mobility restrictions (at retail and transit locations), seems to effectively flatten the curve. We hope this provides guidance on weighing the trade-offs between the safety of the population, strain on the healthcare system, and impact on the economy.


title: Symplectic realization of two interacting spin-two fields in three dimensions

abstract: We constructed a symplectic realization of the dynamic structure of two interacting spin-two fields in three dimensions. A significant simplification refers to the treatment of constraints: instead of performing a Hamiltonian analysis $\grave{a}\, la$ Dirac, we worked out a method that only uses properties of the pre-symplectic two-form matrix and its corresponding zero-modes to investigate the nature of constraints and the gauge structure of the theory. For instance, we demonstrate that the contraction of the zero-modes with the potential gradient, yields explicit expressions for the whole set of constraints on the dynamics of the theory, including the symmetrization condition and an explicit relationship between the coupling and cosmological constants. This way, we further identify the necessary conditions for the existence of a unique non-linear candidate for a partially massless theory, using only the expression for the interaction parameters of the model. In the case of gauge structure, the transformation laws for the entire set of dynamical variables are more straightforwardly derived from the structure of the remaining zero-modes; in this sense, the zero-modes must be viewed as the generators of the corresponding gauge transformations. Thereafter, we use an appropriate gauge-fixing procedure, the time gauge, to compute both the quantization brackets and the functional measure on the path integral associated with our model. Finally, we confirm that three-dimensional bi-gravity has two physical degrees of freedom per space point. With the above, we provide a new perspective for a better understanding of the dynamical structure of theories of interacting spin-two fields, which does not require the constraints to be catalogued as first- and second-class ones as in the case of Dirac's standard method.


title: Levitating Rigid Objects with Hidden Rods and Wires

abstract: We propose a novel algorithm to efficiently generate hidden structures to support arrangements of floating rigid objects. Our optimization finds a small set of rods and wires between objects and each other or a supporting surface (e.g., wall or ceiling) that hold all objects in force and torque equilibrium. Our objective function includes a sparsity inducing total volume term and a linear visibility term based on efficiently pre-computed Monte-Carlo integration, to encourage solutions that are as-hidden-as-possible. The resulting optimization is convex and the global optimum can be efficiently recovered via a linear program. Our representation allows for a user-controllable mixture of tension-, compression-, and shear-resistant rods or tension-only wires. We explore applications to theatre set design, museum exhibit curation, and other artistic endeavours.


title: Functional models up to similarity and $a$-contractions

abstract: We study the generalization of $m$-isometries and $m$-contractions (for positive integers $m$) to what we call $a$-isometries and $a$-contractions for positive real numbers $a$. We show that any Hilbert space operator, satisfying an inequality of certain class (in hereditary form), is similar to $a$-contractions. This result is based on some Banach algebras techniques and is an improvement of a recent result by the last two authors. We also prove that any $a$-contraction $T$ is a $b$-contraction, if $b<a$ and one imposes an additional condition on the growth of the norms of $T^n x$, where $x$ is an arbitrary vector. Here we use some properties of fractional finite differences.


title: The Carnegie Supernova Project II. Observations of the luminous red nova AT 2014ej

abstract: We present optical and near-infrared broadband photometry and optical spectra of AT 2014ej from the the Carnegie Supernova Project-II. These observations are complemented with data from the CHilean Automatic Supernova sEarch, the Public ESO Spectroscopic Survey of Transient Objects, and from the Backyard Observatory Supernova Search. Observational signatures of AT 2014ej reveal that it is similar to other members of the gap-transient subclass known as luminous red novae (LRNe), including the ubiquitous double hump light curve and spectral properties akin to the LRN SN 2017jfs. A medium-dispersion, visual-wavelength spectrum of AT 2014ej taken the Magellan Clay telescope, exhibits a P Cygni H$\alpha$ feature characterized by a blue velocity at zero intensity of $\approx 110$ km s$^{-1}$ and a P Cygni minimum velocity of $\approx70$ km s$^{-1}$, and which we attribute to emission from a circumstellar wind. Inspection of pre-outbust Hubble Space Telescope images yields no conclusive progenitor detection. In comparison with a sample of LRNe from the literature, AT 2014ej lies among the brighter end of the luminosity distribution. Comparison of the ultra-violet, optical, infrared (UVOIR) light curves of well-observed LRNe to common-envelope evolution models from the literature, indicates the models under predict the luminosity of the comparison sample at all phases and also produce inconsistent time-scales of the secondary peak. Future efforts to model LRNe should expand upon the current parameter space explored and therefore may consider more massive systems and a wider range of dynamical timescales.


title: Missing Shapiro steps in topologically trivial Josephson Junction on InAs quantum well

abstract: Josephson junctions hosting Majorana fermions have been predicted to exhibit a 4$\pi$ periodic current phase relation. The experimental consequence of this periodicity is the disappearance of odd steps in Shapiro steps experiments. Experimentally, missing odd Shapiro steps have been observed in a number of materials systems with strong spin-orbit coupling and have been interpreted in the context of topological superconductivity. Here, we report on missing odd steps in topologically trivial Josephson junctions fabricated on InAs quantum wells. We ascribe our observations to the high transparency of our junctions allowing Landau-Zener transitions. The probability of these processes is found to be independent of the drive frequency. We analyze our results using a bi-modal transparency distribution which demonstrates that only few modes carrying 4$\pi$ periodic current are sufficient to describe the disappearance of odd steps. Our findings highlight the elaborate circumstances that have to be considered in the investigation of the 4$\pi$ Josephson junctions in relationship to topological superconductivity.


title: Revisiting longitudinal plasmon-axion conversion in external magnetic fields

abstract: In the presence of an external magnetic field the axion and the photon mix. In particular, the dispersion relation of a longitudinal plasmon always crosses the dispersion relation of the axion (for small axion masses), thus leading to a resonant conversion. Using thermal field theory we concisely derive the axion emission rate, applying it to astrophysical and laboratory scenarios. For the Sun, depending on the magnetic field profile plasmon-axion conversion can dominate over Primakoff production at low energies ($\lesssim 200\,$eV). This both provides a new axion source for future helioscopes and, in the event of discovery, would probe the magnetic field structure of the Sun. In the case of white dwarfs (WDs), plasmon-axion conversion provides a pure photon coupling probe of the axion, which may contribute significantly for low-mass WDs. Finally we rederive and confirm the axion absorption rate of the recently proposed plasma haloscopes.


title: Importance Driven Continual Learning for Segmentation Across Domains

abstract: The ability of neural networks to continuously learn and adapt to new tasks while retaining prior knowledge is crucial for many applications. However, current neural networks tend to forget previously learned tasks when trained on new ones, i.e., they suffer from Catastrophic Forgetting (CF). The objective of Continual Learning (CL) is to alleviate this problem, which is particularly relevant for medical applications, where it may not be feasible to store and access previously used sensitive patient data. In this work, we propose a Continual Learning approach for brain segmentation, where a single network is consecutively trained on samples from different domains. We build upon an importance driven approach and adapt it for medical image segmentation. Particularly, we introduce learning rate regularization to prevent the loss of the network's knowledge. Our results demonstrate that directly restricting the adaptation of important network parameters clearly reduces Catastrophic Forgetting for segmentation across domains.


title: Electrical molecular switch addressed by chemical stimuli

abstract: We demonstrate that the conductance switching of benzo-bis(imidazole) molecules upon protonation depends on the lateral functional groups. The protonated H-substituted molecule shows a higher conductance than the neutral one (Gpro>Gneu), while the opposite (Gneu>Gpro) is observed for a molecule laterally functionalized by amino-phenyl groups. These results are demonstrated at various scale lengths : self-assembled monolayer, tiny nanodot-molecule junction and single molecules. From ab-initio theoretical calculations, we conclude that for the H-substituted molecule, the result Gpro>Gneu is correctly explained by a reduction of the LUMO-HOMO gap, while for the amino-phenyl functionnalized molecule, the result Gneu>Gpro is consistent with a shift of HOMO, which reduces the density of states at the Fermi energy.


title: Scalable Mining of Maximal Quasi-Cliques: An Algorithm-System Codesign Approach

abstract: Given a user-specified minimum degree threshold $\gamma$, a $\gamma$-quasi-clique is a subgraph $g=(V_g,E_g)$ where each vertex $v\in V_g$ connects to at least $\gamma$ fraction of the other vertices (i.e., $\lceil \gamma\cdot(|V_g|-1)\rceil$ vertices) in $g$. Quasi-clique is one of the most natural definitions for dense structures useful in finding communities in social networks and discovering significant biomolecule structures and pathways. However, mining maximal quasi-cliques is notoriously expensive. In this paper, we design parallel algorithms for mining maximal quasi-cliques on G-thinker, a recent distributed framework targeting divide-and-conquer graph mining algorithms that decomposes the mining into compute-intensive tasks to fully utilize CPU cores. However, we found that directly using G-thinker results in the straggler problem due to (i) the drastic load imbalance among different tasks and (ii) the difficulty of predicting the task running time and the time growth with task-subgraph size. We address these challenges by redesigning G-thinker's execution engine to prioritize long-running tasks for mining, and by utilizing a novel timeout strategy to effectively decompose the mining workloads of long-running tasks to improve load balancing. While this system redesign applies to many other expensive dense subgraph mining problems, this paper verifies the idea by adapting the state-of-the-art quasi-clique algorithm, Quick, to our redesigned G-thinker. We improve Quick by integrating new pruning rules, and fixing some missed boundary cases that could lead to missed results. Extensive experiments verify that our new solution scales well with the number of CPU cores, achieving 201$\times$ runtime speedup when mining a graph with 3.77M vertices and 16.5M edges in a 16-node cluster.


title: Software for Microscopy Workshop White Paper

abstract: Microscopes have morphed from purely optical instruments into motorized, robotic machines that form images on digital sensors rather than eyeballs. This continuing trend towards automation and digitization enables many new approaches to microscopy that would have been impossible or impractical without computer interfaces. Accordingly, todays development of new microscopes most often depends on concurrent software development to bring these custom-build systems to life. This dependence on software brings opportunities and challenges. Most importantly, a key challenge while developing new microscopes is to develop the appropriate software. Despite the fact that software is easily copied and distributed, remarkably few opportunities are available to share experiences creating microscope control software. In turn, this brings challenges in creating maintainable and flexible software code and writing User Interfaces (UIs) that are easily used by researchers, who are primarily life scientists. To start to address these challenges by identifying common problems and shared solutions, we assembled a small group of researchers that develop or use software to control their custom-build microscopes at the Janelia Research Campus for a two-day workshop in February 2020. The outcome of the workshop was the definition of clear milestones, as well as the recognition of an involved community, much larger than the one assembled at the workshop. This community encounters similar hurdles and shares a great desire to overcome these by stronger, community-wide collaborations on Open Source Software. This White Paper summarizes the major issues identified, proposes approaches to address these as a community, and outlines the next steps that can be taken to develop a framework facilitating shared microscope software development, significantly speeding up development of new microscopy systems.


title: Boundary Chiral Algebras and Holomorphic Twists

abstract: We study the holomorphic twist of 3d ${\cal N}=2$ gauge theories in the presence of boundaries, and the algebraic structure of bulk and boundary local operators. In the holomorphic twist, both bulk and boundary local operators form chiral algebras (\emph{a.k.a.} vertex operator algebras). The bulk algebra is commutative, endowed with a shifted Poisson bracket and a "higher" stress tensor; while the boundary algebra is a module for the bulk, may not be commutative, and may or may not have a stress tensor. We explicitly construct bulk and boundary algebras for free theories and Landau-Ginzburg models. We construct boundary algebras for gauge theories with matter and/or Chern-Simons couplings, leaving a full description of bulk algebras to future work. We briefly discuss the presence of higher A-infinity like structures.

categories: hep-th math-ph math.AG math.MP math.QA math.RT


title: Aspect-Controlled Neural Argument Generation

abstract: We rely on arguments in our daily lives to deliver our opinions and base them on evidence, making them more convincing in turn. However, finding and formulating arguments can be challenging. In this work, we train a language model for argument generation that can be controlled on a fine-grained level to generate sentence-level arguments for a given topic, stance, and aspect. We define argument aspect detection as a necessary method to allow this fine-granular control and crowdsource a dataset with 5,032 arguments annotated with aspects. Our evaluation shows that our generation model is able to generate high-quality, aspect-specific arguments. Moreover, these arguments can be used to improve the performance of stance detection models via data augmentation and to generate counter-arguments. We publish all datasets and code to fine-tune the language model.


title: AI4Bharat-IndicNLP Corpus: Monolingual Corpora and Word Embeddings for Indic Languages

abstract: We present the IndicNLP corpus, a large-scale, general-domain corpus containing 2.7 billion words for 10 Indian languages from two language families. We share pre-trained word embeddings trained on these corpora. We create news article category classification datasets for 9 languages to evaluate the embeddings. We show that the IndicNLP embeddings significantly outperform publicly available pre-trained embedding on multiple evaluation tasks. We hope that the availability of the corpus will accelerate Indic NLP research. The resources are available at https://github.com/ai4bharat-indicnlp/indicnlp_corpus.


title: Fractional dynamics in nonlinear magnetic metamaterials

abstract: We examine the existence of nonlinear modes and their temporal dynamics, in arrays of split-ring resonators, using a fractional extension of the Laplacian in the evolution equation. We find a closed-form expression for the dispersion relation as a function of the fractional exponent as well as an exact expression for the critical coupling between rings, beyond which no fractional magnetoinductive wave can exist. We also find the low-lying families of bulk and surface nonlinear modes and their bifurcation diagrams. Here the phenomenology is similar for all exponents and resembles what has been observed in other discrete evolution equations, such as the DNLS. The propagation of an initially localized magnetic excitation is always ballistic, with a `speed' that is computed in exact form as a function of the fractional exponent. For a given exponent, it increases with an increase in coupling up to a critical coupling value, beyond which the ballistic speed could diverge inside the fractional interval $[0,1]$. Examination of the modulational instability shows that it tends to increase with an increase in the fractional exponent, where the decay proceeds via the formation of filamentary structures that merge eventually and form pure radiation. The dynamical selftrapping around an initially localized excitation increases with the fractional exponent, but it also shows a degree of trapping in the linear limit. This trapping increases with a decrease in the exponent and can be explained by near-degeneracy considerations.


title: Revisiting Unsupervised Relation Extraction

abstract: Unsupervised relation extraction (URE) extracts relations between named entities from raw text without manually-labelled data and existing knowledge bases (KBs). URE methods can be categorised into generative and discriminative approaches, which rely either on hand-crafted features or surface form. However, we demonstrate that by using only named entities to induce relation types, we can outperform existing methods on two popular datasets. We conduct a comparison and evaluation of our findings with other URE techniques, to ascertain the important features in URE. We conclude that entity types provide a strong inductive bias for URE.


title: Domain Siamese CNNs for Sparse Multispectral Disparity Estimation

abstract: Multispectral disparity estimation is a difficult task for many reasons: it has all the same challenges as traditional visible-visible disparity estimation (occlusions, repetitive patterns, textureless surfaces), in addition of having very few common visual information between images (e.g. color information vs. thermal information). In this paper, we propose a new CNN architecture able to do disparity estimation between images from different spectrum, namely thermal and visible in our case. Our proposed model takes two patches as input and proceeds to do domain feature extraction for each of them. Features from both domains are then merged with two fusion operations, namely correlation and concatenation. These merged vectors are then forwarded to their respective classification heads, which are responsible for classifying the inputs as being same or not. Using two merging operations gives more robustness to our feature extraction process, which leads to more precise disparity estimation. Our method was tested using the publicly available LITIV 2014 and LITIV 2018 datasets, and showed best results when compared to other state of the art methods.


title: The structure of $I_4$-free and triangle-free binary matroids

abstract: A simple binary matroid is called $I_4$-free if none of its rank-4 flats are independent sets. These objects can be equivalently defined as the sets $E$ of points in $PG(n-1,2)$ for which $|E \cap F|$ is not a basis of $F$ for any four-dimensional flat $F$. We prove a decomposition theorem that exactly determines the structure of all $I_4$-free and triangle-free matroids. In particular, our theorem implies that the $I_4$-free and triangle-free matroids have critical number at most $2$.


title: Excitation and characterization of long-lived hydrogenic Rydberg states of nitric oxide

abstract: High Rydberg states of nitric oxide (NO) with principal quantum numbers between 40 and 100 and lifetimes in excess of 10 $\mu$s have been prepared by resonance enhanced two-color two-photon laser excitation from the X $^2\Pi_{1/2}$ ground state through the A $^2\Sigma^+$ intermediate state. Molecules in these long-lived Rydberg states were detected and characterized 126 $\mu$s after laser photoexcitation by state-selective pulsed electric field ionization. The laser excitation and electric field ionization data were combined to construct two-dimensional spectral maps. These maps were used to identify the rotational states of the NO$^+$ ion core to which the observed series of long-lived hydrogenic Rydberg states converge. The results presented pave the way for Rydberg-Stark deceleration and electrostatic trapping experiments with NO, which are expected to shed further light on the decay dynamics of these long-lived excited states, and are of interest for studies of ion-molecule reactions at low temperatures.


title: Derivatives and integrals: matrix order operators as an extension of the fractional calculus

abstract: A natural consequence of the fractional calculus is its extension to a matrix order of differentiation and integration. A matrix-order derivative definition and a matrix-order integration arise from the generalization of the gamma function applied to the fractional differintegration definition. This work focuses on some results applied to the Riemann-Liouville version of the fractional calculus extended to its matrix-order concept. This extension also may apply to other versions of fractional calculus. Some examples of possible ordinary and partial matrix-order differential equations and related exact solutions are shown.


title: Analytically projected rotationally symmetric explicitly correlated Gaussian Functions with one-axis-shifted centers

abstract: A new explicitly correlated functional form for expanding the wave function of an N-particle system with arbitrary angular momentum and parity is presented. We develop the projection-based approach, numerically exploited in our previous work [J. Chem. Phys. 149, 184105 (2018)], to explicitly correlated Gausssians with one-axis shifted centers and derive the matrix elements for the Hamiltonian and the angular momentum operators by analytically solving the integral projection operator. Variational few-body calculations without assuming the Born-Oppenheimer approximation are presented for several rotationally excited states of three- and four-particle systems. We show how the new formalism can be used as a unified framework for high-accuracy calculations of properties of small atoms and molecules.


title: Consumer Wearables and Affective Computing for Wellbeing Support

abstract: Wearables equipped with pervasive sensors enable us to monitor physiological and behavioral signals in our everyday life. We propose the WellAff system able to recognize affective states for wellbeing support. It also includes health care scenarios, in particular patients with chronic kidney disease (CKD) suffering from bipolar disorders. For the need of a large-scale field study, we revised over 50 off-the-shelf devices in terms of usefulness for emotion, stress, meditation, sleep, and physical activity recognition and analysis. Their usability directly comes from the types of sensors they possess as well as the quality and availability of raw signals. We found there is no versatile device suitable for all purposes. Using Empatica E4 and Samsung Galaxy Watch, we have recorded physiological signals from 11 participants over many weeks. The gathered data enabled us to train a classifier that accurately recognizes strong affective states.


title: A simple geometric method for navigating the energy landscape of centroidal Voronoi tessellations

abstract: Finding optimal (or low energy) centroidal Voronoi tessellations (CVTs) on a 2D domain is a challenging problem. One must navigate an energy landscape whose desirable critical points have sufficiently small basins of attractions that they are inaccessible with Monte-Carlo initialized gradient descent methods. We present a simple deterministic method for efficiently navigating the energy landscape in order to it access these low energy CVTs. The method has two parameters and is based upon each generator moving away from the closest neighbor by a certain distance. We give a statistical analysis of the performance of this hybrid method comparing with the results of a large number of runs for both Lloyd's method and state of the art quasi-Newton methods. Stochastic alternatives are also considered.


title: A Systematic Approach to Featurization for Cancer Drug Sensitivity Predictions with Deep Learning

abstract: By combining various cancer cell line (CCL) drug screening panels, the size of the data has grown significantly to begin understanding how advances in deep learning can advance drug response predictions. In this paper we train >35,000 neural network models, sweeping over common featurization techniques. We found the RNA-seq to be highly redundant and informative even with subsets larger than 128 features. We found the inclusion of single nucleotide polymorphisms (SNPs) coded as count matrices improved model performance significantly, and no substantial difference in model performance with respect to molecular featurization between the common open source MOrdred descriptors and Dragon7 descriptors. Alongside this analysis, we outline data integration between CCL screening datasets and present evidence that new metrics and imbalanced data techniques, as well as advances in data standardization, need to be developed.


title: An Early Study on Intelligent Analysis of Speech under COVID-19: Severity, Sleep Quality, Fatigue, and Anxiety

abstract: The COVID-19 outbreak was announced as a global pandemic by the World Health Organisation in March 2020 and has affected a growing number of people in the past few weeks. In this context, advanced artificial intelligence techniques are brought to the fore in responding to fight against and reduce the impact of this global health crisis. In this study, we focus on developing some potential use-cases of intelligent speech analysis for COVID-19 diagnosed patients. In particular, by analysing speech recordings from these patients, we construct audio-only-based models to automatically categorise the health state of patients from four aspects, including the severity of illness, sleep quality, fatigue, and anxiety. For this purpose, two established acoustic feature sets and support vector machines are utilised. Our experiments show that an average accuracy of .69 obtained estimating the severity of illness, which is derived from the number of days in hospitalisation. We hope that this study can foster an extremely fast, low-cost, and convenient way to automatically detect the COVID-19 disease.


title: Controlled Two-Dimensional Ferromagnetism in 1T-CrTe$_2$. The role of charge density wave and strain

abstract: Transition metal dichalcogenides are promising candidates to show long-range ferromagnetic order in the single-layer limit. Based on ab initio calculations, we report the emergence of a charge density wave (CDW) phase in monolayer 1T-CrTe$_2$. We demonstrate that this phase is the ground state in the single-layer limit at any strain value. We obtain an optical phonon mode of $1.96$ THz that connects CDW phase with the undistorted 1T phase. Localization of the $a_{1g}$ orbital of CrTe$_2$ produces an out-of-plane orientation of the magnetic moments, circumventing the restrictions of the Mermin-Wagner theorem and producing ferromagnetic long-range order in the two-dimensional limit. This orbital-localization is enhanced by the CDW phase. Tensile strain also increases the localization of this orbital driving the system to become ordered. CrTe$_2$ becomes an example of a material where the CDW phase produces the stabilization of the long-range ferromagnetic order. Our results show that both strain and phase switching are mechanisms to control the 2D ferromagnetic order of CrTe$_2$.


title: Nearly Optimal Embeddings of Flat Tori

abstract: We show that for any $n$-dimensional lattice $\mathcal{L} \subseteq \mathbb{R}^n$, the torus $\mathbb{R}^n/\mathcal{L}$ can be embedded into Hilbert space with $O(\sqrt{n\log n})$ distortion. This improves the previously best known upper bound of $O(n\sqrt{\log n})$ shown by Haviv and Regev (APPROX 2010) and approaches the lower bound of $\Omega(\sqrt{n})$ due to Khot and Naor (FOCS 2005, Math. Annal. 2006).


title: The topology and geometry of random square-tiled surfaces

abstract: A square-tiled surface (STS) is a branched cover of the standard square torus with branching over exactly one point. In this paper we consider a randomizing model for STSs and generalizations to branched covers of other simple translation surfaces which we call polygon-tiled surfaces. We obtain a local central limit theorem for the genus and subsequently obtain that the distribution of the genus is asymptotically normal. We also study holonomy vectors (Euclidean displacement vectors between cone points) on a random STS. We show that asymptotically almost surely the set of holonomy vectors of a random STS contains the set of primitive vectors of $\mathbb{Z}^2$ and with probability approaching $1/e$, these sets are equal.


title: Linguistic Typology Features from Text: Inferring the Sparse Features of World Atlas of Language Structures

abstract: The use of linguistic typological resources in natural language processing has been steadily gaining more popularity. It has been observed that the use of typological information, often combined with distributed language representations, leads to significantly more powerful models. While linguistic typology representations from various resources have mostly been used for conditioning the models, there has been relatively little attention on predicting features from these resources from the input data. In this paper we investigate whether the various linguistic features from World Atlas of Language Structures (WALS) can be reliably inferred from multi-lingual text. Such a predictor can be used to infer structural features for a language never observed in training data. We frame this task as a multi-label classification involving predicting the set of non-mutually exclusive and extremely sparse multi-valued labels (WALS features). We construct a recurrent neural network predictor based on byte embeddings and convolutional layers and test its performance on 556 languages, providing analysis for various linguistic types, macro-areas, language families and individual features. We show that some features from various linguistic types can be predicted reliably.


title: Delay Adaptation Method for Relay Assisted Optical Wireless Systems

abstract: In this paper, we investigate optical wireless repeaters as relay terminals between a transmitter and a user in an Infrared Optical Wireless Communication (IROWC) system. A delay adaptation method is introduced to solve the problem of irregular signal arrival time from different relay terminals. Three different relay terminal deployment scenarios were investigated in a typical two-phase relay IROWC system with the proposed delay adaptation method. The simulation results indicate that the proposed system has better impulse response compared to the conventional system and that the root-mean-square delay spread of the relay system with the delay adaptation method is on average 30% less than the conventional system.


title: Equilibrium customer and socially optimal balking strategies in a constant retrial queue with multiple vacations and $N$-policy

abstract: In this paper, equilibrium strategies and optimal balking strategies of customers in a constant retrial queue with multiple vacations and the $N$-policy under two information levels, respectively, are investigated. We assume that there is no waiting area in front of the server and an arriving customer is served immediately if the server is idle; otherwise (the server is either busy or on a vacation) it has to leave the system to join a virtual retrial orbit waiting for retrials according to the FCFS rules. After a service completion, if the system is not empty, the server becomes idle, available for serving the next customer, either a new arrival or a retried customer from the virtual retrial orbit; otherwise (if the system is empty), the server starts a vacation. Upon the completion of a vacation, the server is reactivated only if it finds at least $N$ customers in the virtual orbit; otherwise, the server continues another vacation. We study this model at two levels of information, respectively. For each level of information, we obtain both equilibrium and optimal balking strategies of customers, and make corresponding numerical comparisons. Through Particle Swarm Optimization (PSO) algorithm, we explore the impact of parameters on the equilibrium and social optimal thresholds, and obtain the trend in changes, as a function of system parameters, for the optimal social welfare, which provides guiding significance for social planners. Finally, by comparing the social welfare under two information levels, we find that whether the system information should be disclosed to customers depends on how to maintain the growth of social welfare.


title: Markovian Embedding Procedures for Non-Markovian Stochastic Schr\"{o}dinger Equations

abstract: We present embedding procedures for the non-Markovian stochastic Schr\"{o}dinger equations, arising from studies of quantum systems coupled with bath environments. By introducing auxiliary wave functions, it is demonstrated that the non-Markovian dynamics can be embedded in extended, but Markovian, stochastic models. Two embedding procedures are presented. The first method leads to nonlinear stochastic equations, the implementation of which is much more efficient than the non-Markovian stochastic Schr\"{o}dinger equations. The stochastic Schr\"{o}dinger equations obtained from the second procedure involve more auxiliary wave functions, but the equations are linear, and we derive the corresponding generalized quantum master equation for the density-matrix. The accuracy of the embedded models is ensured by fitting to the power spectrum. The stochastic force is represented using a linear superposition of Ornstein-Uhlenbeck processes, which are incorporated as multiplicative noise in the auxiliary Schr\"{o}dinger equations. The asymptotic behavior of the spectral density in the low frequency regime is preserved by using correlated stochastic processes. The approximations are verified by using a spin-boson system as a test example.


title: X-ray Afterglows from the Gamma-Ray Burst "Large(r)-Angle" Emission

abstract: We derive basic analytical results for the timing and decay of the GRB-counterpart and delayed-afterglow light-curves for a brief emission episode from a relativistic surface endowed with angular structure, consisting of a uniform Core of size theta_c (Lorentz factor Gamma_c and surface emissivity i_nu are angle-independent) and an axially-symmetric power-law Envelope (Gamma ~ theta^{-g}). In this Large-Angle Emission (LAE) model, radiation produced during the prompt emission phase (GRB) at angles theta > theta_c arrives at observer well after the burst (delayed emission). The dynamical time-range of the very fast-decaying GRB "tail" and of the flat afterglow "plateau", and the morphology of GRB counterpart/afterglow, are all determined by two parameters: the Core's parameter Gamma_c*theta_c and the Envelope's Lorentz factor index g, leading to three types of light-curves that display three post-GRB phases (type 1: tail, plateau/slow-decay, post-plateau/normal-decay), two post-GRB phases (type 2: tail and fast-decay), or just one (type 3: normal decay). We show how X-ray light-curve features can be used to determine Core and Envelope dynamical and spectral parameters. Testing of the LAE model is done using the Swift/XRT X-ray emission of two afterglows of type 1 (060607A, 061121), one of type 2 (061110A), and one of type 3 (061007). We find that the X-ray afterglows with plateaus require an Envelope Lorentz factor Gamma ~ theta^{-2} and a comoving-frame emissivity i_nu ~ theta^2, thus, for a typical afterglow spectrum F_nu ~ nu^{-1}, the lab-frame energy release is uniform over the emitting surface.


title: Resolving duration and sequence of Na and continuum flashes during MBSL with time-correlated single photon counting

abstract: Time-correlated single photon counting (TCSPC) was used for the first time for resolving a duration and a sequence of the flashes of Na and continuum during MBSL from argon gas saturated aqueous NaCl and SDS solutions. It was found that a bubble giving both kinds of the flashes emits them simultaneously with a negligible delay of about 0.5 ns for Na flash. The duration of Na flash was defined as 4.6 ns, 7.5 ns, 11.2 ns for 5 M NaCl, 0.5 M NaCl, 5 mM SDS solutions, respectively. The duration of continuum flash was varying as 1.6-2.4 ns for all investigated solutions. To explain relatively large duration of Na flash, the scheme of evolution of presumable Na-emission zones is proposed based on the existence of an optimal temperature for Na emission.


title: Effects of weather and policy intervention on COVID-19 infection in Ghana

abstract: Even though laboratory and epidemiological studies have demonstrated the effects of ambient temperature on the transmission and survival of coronaviruses, not much has been done on the effects of weather on the spread of COVID-19. This study investigates the effects of temperature, humidity, precipitation, wind speed and the specific government policy intervention of partial lockdown on the new cases of COVID-19 infection in Ghana. Daily data on confirmed cases of COVID-19 from March 13, 2020 to April 21, 2020 were obtained from the official website of Our World in Data (OWID) dedicated to COVID-19 while satellite climate data for the same period was obtained from the official website of NASA's Prediction of Worldwide Energy Resources (POWER) project. Considering the nature of the data and the objectives of the study, a time series generalized linear model which allows for regressing on past observations of the response variable and covariates was used for model fitting. The results indicate significant effects of maximum temperature, relative humidity and precipitation in predicting new cases of the disease. Also, results of the intervention analysis indicate that the null hypothesis of no significant effect of the specific policy intervention of partial lockdown should be rejected (p-value=0.0164) at a 5\% level of significance. These findings provide useful insights for policymakers and the public.


title: Activity Detection from Wearable Electromyogram Sensors using Hidden Markov Model

abstract: Surface electromyography (sEMG) has gained significant importance during recent advancements in consumer electronics for healthcare systems, gesture analysis and recognition and sign language communication. For such a system, it is imperative to determine the regions of activity in a continuously recorded sEMG signal. The proposed work provides a novel activity detection approach based on Hidden Markov Models (HMM) using sEMG signals recorded when various hand gestures are performed. Detection procedure is designed based on a probabilistic outlook by making use of mathematical models. The requirement of a threshold for activity detection is obviated making it subject and activity independent. Correctness of the predicted outputs is asserted by classifying the signal segments around the detected transition regions as activity or rest. Classified outputs are compared with the transition regions in a stimulus given to the subject to perform the activity. The activity onsets are detected with an average of 96.25% accuracy whereas the activity termination regions with an average of 87.5% accuracy with the considered set of six activities and four subjects.


title: Temporal Quantum Noise Reduction Acquired by an Electron-Multiplying Charge-Coupled-Device Camera

abstract: Electron-multiplying charge-coupled-device cameras (EMCCDs) have been used to observe quantum noise reductions in beams of light in the transverse spatial degree of freedom. For the quantum noise reduction in the temporal domain, "bucket detectors," usually composed of photodiodes with operational amplifiers, are used to register the intensity fluctuations in beams of light within the bandwidth of the detectors. Spatial information, however, is inevitably washed off by the detector. In this paper, we report on measurements of the temporal quantum noise reduction in bright twin beams using an EMCCD camera. The four-wave mixing process in an atomic rubidium vapor cell is used to generate the bright twin beams of light. We observe more than 25% of temporal quantum noise reduction with respect to the shot-noise limit in images captured by the EMCCD camera. Compared with bucket detectors, EMCCD makes it possible to take advantage of the spatial and temporal quantum properties of light simultaneously, which would greatly benefit many applications using quantum protocols.


title: Comparing light-front quantization with instant-time quantization

abstract: We compare light-front quantization and instant-time quantization both at the level of operators and at the level of their Feynman diagram matrix elements. At the level of operators light-front quantization and instant-time quantization lead to equal light-front time commutation (or anticommutation) relations that appear to be quite different from equal instant-time commutation (or anticommutation) relations. Despite this we show that at unequal times instant-time and light-front commutation (or anticommutation) relations actually can be transformed into each other, with it only being the restriction to equal times that makes the commutation (or anticommutation) relations appear to be so different. While our results are valid for both bosons and fermions, for fermions there are subtleties associated with tip of the light cone contributions that need to be taken care of. At the level of Feynman diagrams we show for non-vacuum Feynman diagrams that the pole terms in four-dimensional light-front Feynman diagrams reproduce the three-dimensional light-front on-shell Hamiltonian Fock space formulation in which the light-front energy and light-front momentum are on shell. However, because of circle at infinity contributions we show that this equivalence fails for four-dimensional light-front vacuum tadpole diagrams. Then, precisely because of these circle at infinity contributions, light-front vacuum tadpole diagrams are not only nonzero, they are actually equal to instant-time vacuum tadpole diagrams. Light-front vacuum diagrams are not correctly describable by the on-shell Hamiltonian formalism, and thus not by the closely related infinite momentum frame prescription either. With the transformation from instant-time fields to light-front fields being a spacetime translation, not only are instant-time quantization and light-front quantization equivalent, they are unitarily equivalent.


title: On the Spontaneous Emergence of Discrete and Compositional Signals

abstract: We propose a general framework to study language emergence through signaling games with neural agents. Using a continuous latent space, we are able to (i) train using backpropagation, (ii) show that discrete messages nonetheless naturally emerge. We explore whether categorical perception effects follow and show that the messages are not compositional.


title: Ab initio Leading Order Effective Potentials for Elastic Nucleon-Nucleus Scattering

abstract: Background: Calculating microscopic effective interactions (optical potentials) for elastic nucleon-nucleus scattering has already in the past led to a large body of work. For first-order calculations a nucleon-nucleon (\textit{NN}) interaction and a one-body density of the nucleus were taken as input to rigorous calculations of microscopic full-folding calculations. Purpose: Based on the spectator expansion of the multiple scattering series we employ a chiral next-to-next-to-leading order (NNLO) nucleon-nucleon interaction on the same footing in the structure as well as in the reaction calculation to obtain an in leading-order consistent effective potential for nucleon-nucleus elastic scattering, which includes the spin of the struck target nucleon. Methods: The first order effective folding potential is computed by first deriving a nonlocal scalar density as well as a spin-projected momentum distribution. Those are then integrated with the off-shell Wolfenstein amplitudes $A$, $C$, and $M$. The resulting nonlocal potential serves as input to a momentum-space Lippmann-Schwinger equation, whose solutions are summed to obtain the nucleon-nucleus scattering observables. Results: We calculate elastic scattering observables for $^4$He, $^6$He, $^8$He, $^{12}$C, and $^{16}$O in the energy regime between 100 and 200 MeV projectile kinetic energy, and compare to available data. We also explore the extension down to about 70 MeV, and study the effect of ignoring the spin of the struck nucleon in the nucleus. Conclusions: In our calculations we contrast elastic scattering off closed-shell and open-shell nuclei. We find that for closed-shell nuclei the approximation of ignoring the spin of the struck target nucleon is excellent. We only see effects of the spin of the struck target nucleon when considering $^6$He and $^8$He, which are nuclei with a $N/Z$ ratio larger than 1.


title: Analyzing the Design Space of Re-opening Policies and COVID-19 Outcomes in the US

abstract: Recent re-opening policies in the US, following a period of social distancing measures, introduced a significant increase in daily COVID-19 infections, calling for a roll-back or substantial revisiting of these policies in many states. The situation is suggestive of difficulties modeling the impact of partial distancing/re-opening policies on future epidemic spread for purposes of choosing safe alternatives. More specifically, one needs to understand the impact of manipulating the availability of social interaction venues (e.g., schools, workplaces, and retail establishments) on virus spread. We introduce a model, inspired by social networks research, that answers the above question. Our model compartmentalizes interaction venues into categories we call mixing domains, enabling one to predict COVID-19 contagion trends in different geographic regions under different what if assumptions on partial re-opening of individual domains. We apply our model to several highly impacted states showing (i) how accurately it predicts the extent of current resurgence (from available policy descriptions), and (ii) what alternatives might be more effective at mitigating the second wave. We further compare policies that rely on partial venue closure to policies that espouse wide-spread periodic testing instead (i.e., in lieu of social distancing). Our models predict that the benefits of (mandatory) testing out-shadow the benefits of partial venue closure, suggesting that perhaps more efforts should be directed to such a mitigation strategy.


title: Challenges in Benchmarking Stream Learning Algorithms with Real-world Data

abstract: Streaming data are increasingly present in real-world applications such as sensor measurements, satellite data feed, stock market, and financial data. The main characteristics of these applications are the online arrival of data observations at high speed and the susceptibility to changes in the data distributions due to the dynamic nature of real environments. The data stream mining community still faces some primary challenges and difficulties related to the comparison and evaluation of new proposals, mainly due to the lack of publicly available non-stationary real-world datasets. The comparison of stream algorithms proposed in the literature is not an easy task, as authors do not always follow the same recommendations, experimental evaluation procedures, datasets, and assumptions. In this paper, we mitigate problems related to the choice of datasets in the experimental evaluation of stream classifiers and drift detectors. To that end, we propose a new public data repository for benchmarking stream algorithms with real-world data. This repository contains the most popular datasets from literature and new datasets related to a highly relevant public health problem that involves the recognition of disease vector insects using optical sensors. The main advantage of these new datasets is the prior knowledge of their characteristics and patterns of changes to evaluate new adaptive algorithm proposals adequately. We also present an in-depth discussion about the characteristics, reasons, and issues that lead to different types of changes in data distribution, as well as a critical review of common problems concerning the current benchmark datasets available in the literature.


title: Bitcoin Transaction Networks: an overview of recent results

abstract: Cryptocurrencies are distributed systems that allow exchanges of native (and non-) tokens among participants. The complete historical bookkeeping and its wide availability opens up an unprecedented possibility, i.e. that of understanding the evolution of their network structure while gaining useful insight on the relationships between user' behaviour and cryptocurrency pricing in exchange markets. In this contribution we review some of the most recent results concerning the structural properties of Bitcoin Transaction Networks, a generic name referring to a set of different constructs: the Bitcoin Address Network, the Bitcoin User Network and the Bitcoin Lightning Network. The picture that emerges is that of system growing over time, which becomes increasingly sparse and whose mesoscopic structural organization is characterised by the presence of an increasingly significant core-periphery structure. Such a peculiar topology is matched by a highly uneven distribution of bitcoins, a result suggesting that Bitcoin is becoming an increasingly centralized system at different levels.


title: Learning to Faithfully Rationalize by Construction

abstract: In many settings it is important for one to be able to understand why a model made a particular prediction. In NLP this often entails extracting snippets of an input text `responsible for' corresponding model output; when such a snippet comprises tokens that indeed informed the model's prediction, it is a faithful explanation. In some settings, faithfulness may be critical to ensure transparency. Lei et al. (2016) proposed a model to produce faithful rationales for neural text classification by defining independent snippet extraction and prediction modules. However, the discrete selection over input tokens performed by this method complicates training, leading to high variance and requiring careful hyperparameter tuning. We propose a simpler variant of this approach that provides faithful explanations by construction. In our scheme, named FRESH, arbitrary feature importance scores (e.g., gradients from a trained model) are used to induce binary labels over token inputs, which an extractor can be trained to predict. An independent classifier module is then trained exclusively on snippets provided by the extractor; these snippets thus constitute faithful explanations, even if the classifier is arbitrarily complex. In both automatic and manual evaluations we find that variants of this simple framework yield predictive performance superior to `end-to-end' approaches, while being more general and easier to train. Code is available at https://github.com/successar/FRESH


title: Sequence Information Channel Concatenation for Improving Camera Trap Image Burst Classification

abstract: Camera Traps are extensively used to observe wildlife in their natural habitat without disturbing the ecosystem. This could help in the early detection of natural or human threats to animals, and help towards ecological conservation. Currently, a massive number of such camera traps have been deployed at various ecological conservation areas around the world, collecting data for decades, thereby requiring automation to detect images containing animals. Existing systems perform classification to detect if images contain animals by considering a single image. However, due to challenging scenes with animals camouflaged in their natural habitat, it sometimes becomes difficult to identify the presence of animals from merely a single image. We hypothesize that a short burst of images instead of a single image, assuming that the animal moves, makes it much easier for a human as well as a machine to detect the presence of animals. In this work, we explore a variety of approaches, and measure the impact of using short image sequences (burst of 3 images) on improving the camera trap image classification. We show that concatenating masks containing sequence information and the images from the 3-image-burst across channels, improves the ROC AUC by 20% on a test-set from unseen camera-sites, as compared to an equivalent model that learns from a single image.


title: Discovering universal scaling laws in 3D printing of metals with genetic programming and dimensional analysis

abstract: We leverage dimensional analysis and genetic programming (a type of machine learning) to discover two strikingly simple but universal scaling laws, which remain accurate for different materials, processing conditions, and machines in metal three-dimensional (3D) printing. The first one is extracted from high-fidelity high-speed synchrotron X-ray imaging, and defines a new dimensionless number, Keyhole number, to predict melt-pool vapor depression depth. The second predicts porosity using the Keyhole number and another dimensionless number, normalized energy density. By reducing the dimensions of these longstanding problems, the low-dimensional scaling laws will aid process optimization and defect elimination, and potentially lead to a quantitative predictive framework for the critical issues in metal 3D printing. Moreover, the method itself is broadly applicable to a range of scientific areas.


title: Generalized superharmonic functions with strongly nonlinear operator

abstract: We study properties of $\mathcal{A}$-harmonic and $\mathcal{A}$-superharmonic functions involving an operator having generalized Orlicz-growth embracing besides Orlicz case also natural ranges of variable exponent and double-phase cases. In particular, Harnack's Principle and Minimum Principle are provided for $\mathcal{A}$-superharmonic functions and boundary Harnack inequality is proven for $\mathcal{A}$-harmonic functions.


title: Learning to Rank Intents in Voice Assistants

abstract: Voice Assistants aim to fulfill user requests by choosing the best intent from multiple options generated by its Automated Speech Recognition and Natural Language Understanding sub-systems. However, voice assistants do not always produce the expected results. This can happen because voice assistants choose from ambiguous intents - user-specific or domain-specific contextual information reduces the ambiguity of the user request. Additionally the user information-state can be leveraged to understand how relevant/executable a specific intent is for a user request. In this work, we propose a novel Energy-based model for the intent ranking task, where we learn an affinity metric and model the trade-off between extracted meaning from speech utterances and relevance/executability aspects of the intent. Furthermore we present a Multisource Denoising Autoencoder based pretraining that is capable of learning fused representations of data from multiple sources. We empirically show our approach outperforms existing state of the art methods by reducing the error-rate by 3.8%, which in turn reduces ambiguity and eliminates undesired dead-ends leading to better user experience. Finally, we evaluate the robustness of our algorithm on the intent ranking task and show our algorithm improves the robustness by 33.3%.


title: The real spectrum compactification of character varieties: characterizations and applications

abstract: We announce results on a compactification of general character varieties that has good topological properties and give various interpretations of its ideal points. We relate this to the Weyl chamber length compactification and apply our results to the theory of maximal and Hitchin representations.


title: Leveraging Context-awareness to Better Support the IoT Cloud-Edge Continuum

abstract: Novel Internet of Things (IoT) requirements derived from a broader interconnection of heterogeneous devices have pushed the horizons of Cloud computing and are giving rise to a wider decentralisation of applications and data centers. An answer to the underlying network concerns, such as the need to lower the resulting latency due to heavy computation needs,or safety aspects, gave rise to Edge/Fog computing, where IoT functionality can be also supported closer to data sources. While it is today feasible to perform some IoT functionality on the Edge, the orchestration of operations between Edge and Cloud requires an automated support, where context-awareness plays a key role in assisting the network in deciding when and whereto store data and to perform computation. This work is focused on the application of context-awareness to support a smoother operation of the Edge to Cloud operation, aiming at lowering latency, in particular when real-time or close-to-real-time data exchange is present.


title: Probability of Pilot Interference in Pulsed Radar-Cellular Coexistence: Fundamental Insights on Demodulation and Limited CSI Feedback

abstract: This paper considers an underlay pulsed radar-cellular spectrum sharing scenario, where the cellular system uses pilot-aided demodulation, statistical channel state information (S-CSI) estimation and limited feedback schemes. Under a realistic system model, upper and lower bounds are derived on the probability that at least a specified number of pilot signals are interfered by a radar pulse train in a finite CSI estimation window. Exact probabilities are also derived for important special cases which reveal operational regimes where the lower bound is achieved. Using these results, this paper (a) provides insights on pilot interference-minimizing schemes for accurate coherent symbol demodulation, and (b) demonstrates that pilot-aided methods fail to accurately estimate S-CSI of the pulsed radar interference channel for a wide range of radar repetition intervals.


title: Unsupervised Learning of KB Queries in Task-Oriented Dialogs

abstract: Task-oriented dialog (TOD) systems often need to formulate knowledge base (KB) queries corresponding to the user intent and use the query results to generate system responses. Existing approaches require dialog datasets to explicitly annotate these KB queries -- these annotations can be time consuming, and expensive. In response, we define the novel problems of predicting the KB query and training the dialog agent, without explicit KB query annotation. For query prediction, we propose a reinforcement learning (RL) baseline, which rewards the generation of those queries whose KB results cover the entities mentioned in subsequent dialog. Further analysis reveals that correlation among query attributes in KB can significantly confuse memory augmented policy optimization (MAPO), an existing state of the art RL agent. To address this, we improve the MAPO baseline with simple but important modifications suited to our task. To train the full TOD system for our setting, we propose a pipelined approach: it independently predicts when to make a KB query (query position predictor), then predicts a KB query at the predicted position (query predictor), and uses the results of predicted query in subsequent dialog (next response predictor). Overall, our work proposes first solutions to our novel problem, and our analysis highlights the research challenges in training TOD systems without query annotation.


title: Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging

abstract: Deep learning at scale is dominated by communication time. Distributing samples across nodes usually yields the best performance, but poses scaling challenges due to global information dissemination and load imbalance across uneven sample lengths. State-of-the-art decentralized optimizers mitigate the problem, but require more iterations to achieve the same accuracy as their globally-communicating counterparts. We present Wait-Avoiding Group Model Averaging (WAGMA) SGD, a wait-avoiding stochastic optimizer that reduces global communication via subgroup weight exchange. The key insight is a combination of algorithmic changes to the averaging scheme and the use of a group allreduce operation. We prove the convergence of WAGMA-SGD, and empirically show that it retains convergence rates similar to Allreduce-SGD. For evaluation, we train ResNet-50 on ImageNet; Transformer for machine translation; and deep reinforcement learning for navigation at scale. Compared with state-of-the-art decentralized SGD variants, WAGMA-SGD significantly improves training throughput (e.g., 2.1x on 1,024 GPUs for reinforcement learning), and achieves the fastest time-to-solution (e.g., the highest score using the shortest training time for Transformer).


title: Higher convexity and iterated sum sets

abstract: Let $f$ be a smooth real function with strictly monotone first $k$ derivatives. We show that for a finite set $A$, with $|A+A|\leq K|A|$, $|2^kf(A)-(2^k-1)f(A)|\gg_k |A|^{k+1-o(1)}/K^{O_k(1)}$. We deduce several new sum-product type implications, e.g. that $A+A$ being small implies unbounded growth for a many enough times iterated product set $A \cdots A$.


title: Concentration for integrable directed polymer models

abstract: In this paper, we consider four integrable models of directed polymers for which the free energy is known to exhibit KPZ fluctuations. A common framework for the analysis of these models was introduced in our recent work on the O'Connell-Yor polymer. We derive estimates for the central moments of the partition function, of any order, on the near-optimal scale $N^{1/3+\epsilon}$, using an iterative method. Among the innovations exploiting the invariant structure, we develop formulas for correlations between functions of the free energy and the boundary weights that replace the Gaussian integration by parts appearing in the analysis of the O'Connell-Yor case.


title: Conceptual Design of Human-Drone Communication in Collaborative Environments

abstract: Autonomous robots and drones will work collaboratively and cooperatively in tomorrow's industry and agriculture. Before this becomes a reality, some form of standardised communication between man and machine must be established that specifically facilitates communication between autonomous machines and both trained and untrained human actors in the working environment. We present preliminary results on a human-drone and a drone-human language situated in the agricultural industry where interactions with trained and untrained workers and visitors can be expected. We present basic visual indicators enhanced with flight patterns for drone-human interaction and human signaling based on aircraft marshaling for humane-drone interaction. We discuss preliminary results on image recognition and future work.


title: Incremental Neural Coreference Resolution in Constant Memory

abstract: We investigate modeling coreference resolution under a fixed memory constraint by extending an incremental clustering algorithm to utilize contextualized encoders and neural components. Given a new sentence, our end-to-end algorithm proposes and scores each mention span against explicit entity representations created from the earlier document context (if any). These spans are then used to update the entity's representations before being forgotten; we only retain a fixed set of salient entities throughout the document. In this work, we successfully convert a high-performing model (Joshi et al., 2020), asymptotically reducing its memory usage to constant space with only a 0.3% relative loss in F1 on OntoNotes 5.0.


title: Structure-Tags Improve Text Classification for Scholarly Document Quality Prediction

abstract: Training recurrent neural networks on long texts, in particular scholarly documents, causes problems for learning. While hierarchical attention networks (HANs) are effective in solving these problems, they still lose important information about the structure of the text. To tackle these problems, we propose the use of HANs combined with structure-tags which mark the role of sentences in the document. Adding tags to sentences, marking them as corresponding to title, abstract or main body text, yields improvements over the state-of-the-art for scholarly document quality prediction. The proposed system is applied to the task of accept/reject prediction on the PeerRead dataset and compared against a recent BiLSTM-based model and joint textual+visual model as well as against plain HANs. Compared to plain HANs, accuracy increases on all three domains. On the computation and language domain our new model works best overall, and increases accuracy 4.7% over the best literature result. We also obtain improvements when introducing the tags for prediction of the number of citations for 88k scientific publications that we compiled from the Allen AI S2ORC dataset. For our HAN-system with structure-tags we reach 28.5% explained variance, an improvement of 1.8% over our reimplementation of the BiLSTM-based model as well as 1.0% improvement over plain HANs.


title: Hide-and-Seek: A Template for Explainable AI

abstract: Lack of transparency has been the Achilles heal of Neural Networks and their wider adoption in industry. Despite significant interest this shortcoming has not been adequately addressed. This study proposes a novel framework called Hide-and-Seek (HnS) for training Interpretable Neural Networks and establishes a theoretical foundation for exploring and comparing similar ideas. Extensive experimentation indicates that a high degree of interpretability can be imputed into Neural Networks, without sacrificing their predictive power.


title: COVID-19 societal response captured by seismic noise in China and Italy

abstract: Seismic noise with frequencies above 1 Hz is often called cultural noise and is generally correlated quite well with human activities. Recently, cities in mainland China and Italy imposed lockdown restrictions in response to COVID-19, which gave us an unprecedented opportunity to study the relationship between seismic noise above 1 Hz and human activities. Using seismic records from stations in China and Italy, we show that seismic noise above 1 Hz was primarily generated by the local transportation systems. The lockdown of the cities and the imposition of travel restrictions led to a ~4-12 dB energy decrease in seismic noise in mainland China. Data also show that different Chinese cities experienced distinct periods of diminished cultural noise, related to differences in local response to the epidemic. In contrast, there was only ~1-6 dB energy decrease of seismic noise in Italy, after the country was put under a lockdown. The noise data indicate that traffic flow did not decrease as much in Italy, but show how different cities reacted distinctly to the lockdown conditions.


title: Outer streaming within a two-dimensional channel

abstract: Acoustic streaming is the net time-averaged flow that results from the nonlinearities in an oscillating flow. Extensive research has sought to identify different physical mechanisms and types of acoustic streaming in systems of various geometries. While streaming in a channel maintains one of the simplest geometries, dimensional analysis of the governing equations reveals that multiple regimes of streaming may occur within a channel. In this study, a framework is developed for investigating and understanding the physical streaming regimes in a two-dimensional channel. By taking different limits of the dimensionless number ratios found within the framework, streaming models derived in previous works are recovered to demonstrate the different streaming regimes within a channel. The onset of fast streaming is then analyzed with the framework and nonlinear Reynolds numbers, which indicate whether the streaming is slow or fast, are found for the different physical streaming regimes. As a result, the framework provides a base for analyzing fast streaming in a channel and streaming in multi-scale systems while organizing previous streaming models into a physical spectrum for a channel geometry.


title: First-principles analysis of cross-resonance gate operation

abstract: We present a comprehensive theoretical study of the cross-resonance gate operation covering estimates for gate parameters and gate error as well as analyzing spectator qubits and multi-qubit frequency collisions. We start by revisiting the derivation of effective Hamiltonian models following Magesan et al. (arXiv:1804.04073). Transmon qubits are commonly modeled as a weakly anharmonic Kerr oscillator. Kerr theory only accounts for qubit frequency renormalization, while adopting number states as the eigenstates of the bare qubit Hamiltonian. Starting from the Josephson nonlinearity and by accounting for the eigenstates renormalization, due to counter-rotating terms, we derive a new starting model for the cross-resonance gate with modified qubit-qubit interaction and drive matrix elements. Employing time-dependent Schrieffer-Wolff perturbation theory, we derive an effective Hamiltonian for the cross-resonance gate with estimates for the gate parameters calculated up to the fourth order in drive amplitude. The new model with renormalized eigenstates lead to 10-15 percent relative correction of the effective gate parameters compared to Kerr theory. We find that gate operation is strongly dependent on the ratio of qubit-qubit detuning and anharmonicity. In particular, we characterize five distinct regions of operation, and propose candidate parameter choices for achieving high gate speed and low coherent gate error when the cross-resonance tone is equipped with an echo pulse sequence. Furthermore, we generalize our method to include a third spectator qubit and characterize possible detrimental multi-qubit frequency collisions.


title: A Parameterized Approximation Scheme for Min $k$-Cut

abstract: In the Min $k$-Cut problem, input is an edge weighted graph $G$ and an integer $k$, and the task is to partition the vertex set into $k$ non-empty sets, such that the total weight of the edges with endpoints in different parts is minimized. When $k$ is part of the input, the problem is NP-complete and hard to approximate within any factor less than $2$. Recently, the problem has received significant attention from the perspective of parameterized approximation. Gupta et al.~[SODA 2018] initiated the study of FPT-approximation for the Min $k$-Cut problem and gave an $1.9997$-approximation algorithm running in time $2^{\mathcal{O}(k^6)}n^{\mathcal{O}(1)}$. Later, the same set of authors~[FOCS 2018] designed an $(1 +\epsilon)$-approximation algorithm that runs in time $(k/\epsilon)^{\mathcal{O}(k)}n^{k+\mathcal{O}(1)}$, and a $1.81$-approximation algorithm running in time $2^{\mathcal{O}(k^2)}n^{\mathcal{O}(1)}$. More, recently, Kawarabayashi and Lin~[SODA 2020] gave a $(5/3 + \epsilon)$-approximation for Min $k$-Cut running in time $2^{\mathcal{O}(k^2 \log k)}n^{\mathcal{O}(1)}$. In this paper we give a parameterized approximation algorithm with best possible approximation guarantee, and best possible running time dependence on said guarantee (up to Exponential Time Hypothesis (ETH) and constants in the exponent). In particular, for every $\epsilon > 0$, the algorithm obtains a $(1 +\epsilon)$-approximate solution in time $(k/\epsilon)^{\mathcal{O}(k)}n^{\mathcal{O}(1)}$. The main ingredients of our algorithm are: a simple sparsification procedure, a new polynomial time algorithm for decomposing a graph into highly connected parts, and a new exact algorithm with running time $s^{\mathcal{O}(k)}n^{\mathcal{O}(1)}$ on unweighted (multi-) graphs. Here, $s$ denotes the number of edges in a minimum $k$-cut. The latter two are of independent interest.


title: Spatiotemporal Characterization of Nonlinear Interactions between Selectively Excited Radially Symmetric Modes of a Few-Mode Fiber

abstract: Nonlinear propagation of signals in single-mode fiber is well understood, and is typically observed by measuring the temporal profile or optical spectrum of an emerging signal. In multimode fibers, the nonlinearity has both a spatial and a temporal element, and a complete investigation of the interactions between propagating modes requires resolving the output in both space and time. We report here spatiotemporal measurements of two nonlinear interacting LP$_{0m}$ modes of a step-index few-mode fiber (FMF). We describe a method to selectively excite two propagating modes through the use of a phase-mask directly patterned on the entrance face of the fiber. The output is resolved by raster-scanning a near-field tapered single-mode optical fiber probe that is connected to a high-speed detector. The results show that in the presence of nonlinearity, the output exhibits a spatiotemporal character that cannot be adequately characterized by a camera image or pulse shape alone.


title: Contextual Text Style Transfer

abstract: We introduce a new task, Contextual Text Style Transfer - translating a sentence into a desired style with its surrounding context taken into account. This brings two key challenges to existing style transfer approaches: ($i$) how to preserve the semantic meaning of target sentence and its consistency with surrounding context during transfer; ($ii$) how to train a robust model with limited labeled data accompanied with context. To realize high-quality style transfer with natural context preservation, we propose a Context-Aware Style Transfer (CAST) model, which uses two separate encoders for each input sentence and its surrounding context. A classifier is further trained to ensure contextual consistency of the generated sentence. To compensate for the lack of parallel data, additional self-reconstruction and back-translation losses are introduced to leverage non-parallel data in a semi-supervised fashion. Two new benchmarks, Enron-Context and Reddit-Context, are introduced for formality and offensiveness style transfer. Experimental results on these datasets demonstrate the effectiveness of the proposed CAST model over state-of-the-art methods across style accuracy, content preservation and contextual consistency metrics.


title: How average is average? Temporal patterns in human behaviour as measured by mobile phone data -- or why chose Thursdays

abstract: Mobile phone data -- with file sizes scaling into terabytes -- easily overwhelm the computational capacity available to some researchers. Moreover, for ethical reasons, data access is often granted only to particular subsets, restricting analyses to cover single days, weeks, or geographical areas. Consequently, it is frequently impossible to set a particular analysis or event in its context and know how typical it is, compared to other days, weeks or months. This is important for academic referees questioning research on mobile phone data and for the analysts in deciding how to sample, how much data to process, and which events are anomalous. All these issues require an understanding of variability in Big Data to answer the question of how average is average? This paper provides a method, using a large mobile phone dataset, to answer these basic but necessary questions. We show that file size is a robust proxy for the activity level of phone users by profiling the temporal variability of the data at an hourly, daily and monthly level. We then apply time-series analysis to isolate temporal periodicity. Finally, we discuss confidence limits to anomalous events in the data. We recommend an analytical approach to mobile phone data selection which suggests that ideally data should be sampled across days, across working weeks, and across the year, to obtain a representative average. However, where this is impossible, the temporal variability is such that specific weekdays' data can provide a fair picture of other days in their general structure.


title: The Quantum Totalitarian Property and Exact Symmetries

abstract: We discuss a point, which from time to time has been doubted in the literature: all symmetries, such as those induced by the energy and momentum conservation laws, hold in quantum physics not just "on average", as is sometimes claimed, but exactly in each "branch" of the wavefunction, expressed in the basis where the conserved observable is sharp. We note that for conservation laws to hold exactly for quantum systems in this sense (not just on average), it is necessary to assume the so-called "totalitarian property of quantum theory", namely that any system capable of measuring a quantum observable must itself be quantised. Hence, if conservation laws are to hold exactly, the idea of a `classical measuring apparatus' (i.e., not subject to the branching structure) is untenable. We also point out that any other principle having a well-defined formulation within classical physics, such as the Equivalence principle, is also to be extended to the quantum domain in exactly the same way, i.e., branch by branch.


title: 2-intersecting permutations

abstract: In this paper we consider the Erd\H{o}s-Ko-Rado property for both $2$-pointwise and $2$-setwise intersecting permutations. Two permutations $\sigma,\tau \in Sym(n)$ are $t$-setwise intersecting if there exists a $t$-subset $S$ of $\{1,2,\dots,n\}$ such that $S^\sigma = S^\tau$. If for each $s\in S$, $s^\sigma = s^\tau$, then we say $\sigma$ and $\tau$ are $t$-pointwise intersecting. We say that $Sym(n)$ has the $t$-setwise (resp. $t$-pointwise) intersecting property if for any family $\mathcal{F}$ of $t$-setwise (resp. $t$-pointwise) intersecting permutations, $|\mathcal{F}| \leq (n-t)!t!$ (resp. $|\mathcal{F}| \leq (n-t)!$). Ellis (["Setwise intersecting families of permutation". { Journal of Combinatorial Theory, Series A}, 119(4):825-849, 2012.]), proved that for $n$ sufficiently large relative to $t$, $Sym(n)$ has the $t$-setwise intersecting property. Ellis also conjuctured that this result holds for all $n \geq t$. Ellis, Friedgut and Pilpel [Ellis, David, Ehud Friedgut, and Haran Pilpel. "Intersecting families of permutations." {Journal of the American Mathematical Society} 24(3):649-682, 2011.] also proved that for $n$ sufficiently large relative to $t$, $Sym(n)$ has the $t$-pointwise intersecting property. It is also conjectured that $Sym(n)$ has the $t$-pointwise intersecting propoperty for $n\geq 2t+1$. In this work, we prove these two conjectures for $Sym(n)$ when $t=2$.


title: Towards scalable user-deployed ultra-dense networks: Blockchain-enabled small cells as a service

abstract: Neutral Host Small Cell Providers (SCP) represent a key element of the 5G vision of ultra-dense mobile networks. However, current business models mostly focus on multi-year agreements for large venues, such as stadiums and hotel chains. These business agreements are regulated through binding Service Level Agreements (SLAs), which tend to be too cumbersome and costly for smaller scale SCPs. As a result, the neutral host model does not scale up to its full potential. In this paper, we propose a framework to enable the participation of small- to medium-sized players in the cellular market as providers offering network resources to Mobile Network Operators (MNOs). To this purpose, we review the current and emerging spectrum and technology opportunities that SCPs can use for neutral host deployments. We also propose the use of blockchain-enabled smart contracts as a simple and cost-efficient alternative to traditional SLAs for small-scale SCPs. To demonstrate this, we describe a proof of concept implementation of an Ethereum-based smart contract platform for best-effort service between an SCP and an MNO. Our simulations on potential smart contract-based deployments in city centre Dublin show that the received signal strength in the considered area will increase by an average of $10$ percent.


title: Novel ansatz for charge radii in density functional theories

abstract: Charge radii are one of the most fundamental properties of atomic nuclei characterizing their charge distributions. Though the general trend as a function of the mass number is well described by the $A^{1/3}$ rule, some fine structures, such as the evolution along the calcium isotopic chain and the corresponding odd-even staggerings, are notoriously difficult to describe both in density functional theories and ab initio methods. In this letter, we propose a novel ansatz to describe the charge radii of calcium isotopes, by adding a correction term, proportional to the number of Cooper pairs, and determined by the BCS amplitudes and a single parameter, to the charge radii calculated in the relativistic mean field model with the pairing interaction treated with the BCS method. The new ansatz yields results consistent with data not only for calcium isotopes, but also for ten other isotopic chains, including oxygen, neon, magnesium, chromium, nickel, germanium, zirconium, cadmium, tin, and lead. It is remarkable that this ansatz with a single parameter can describe nuclear charge radii throughout the periodic table, particularly the odd-even staggerings and parabolic behavior. We hope that the present study can stimulate more discussions about its nature and relation with other effects proposed to explain the odd-even staggerings of charge radii.


title: Mass-imbalanced Bose-Einstein condensed mixtures in rotating perturbed trap

abstract: We consider the mass-imbalanced sensibility for the emergence of vortex patterns in the Bose-Einstein condensed binary mixture of rubidium-cesium ($^{85}$Rb-$^{133}$Cs), confined in quasi-two-dimensional harmonic traps, with one species linearly perturbed in one direction. Non-dipolar coupled species are chosen to highlight mass symmetry effects. We first analyze the condensed mixture in the unperturbed non-rotating regime, where radial phase separation is verified in the immiscible regime, which occurs for large ratio between inter- and intra-species repulsive interactions. By going to the linear perturbed regime, the radial phase separation that occurs in the immiscible condition splits up with the two densities having their maxima at distinct positions. In the rotating regime of both unperturbed and perturbed cases, the minimum rotation is determined in terms of the inter-species interaction to observe vortex structures. In the immiscible regime a dramatic spatial interchange between the species is verified by increasing the rotation.


title: Orlicz-Minkowski flows

abstract: We study the long-time existence and behavior for a class of anisotropic non-homogeneous Gauss curvature flows whose stationary solutions, if exist, solve the regular Orlicz-Minkowski problems. As an application, we obtain old and new results for the regular even Orlicz-Minkowski problems; the corresponding $L_p$ version is the even $L_p$-Minkowski problem for $p>-n-1$. Moreover, employing a parabolic approximation method, we give new proofs of some of the existence results for the general Orlicz-Minkowski problems; the $L_p$ versions are the even $L_p$-Minkowski problem for $p>0$ and the $L_p$-Minkowski problem for $p>1$. In the final section, we use a curvature flow with no global term to solve a class of $L_p$-Christoffel-Minkowski type problems.


title: An Efficient Noisy Binary Search in Graphs via Median Approximation

abstract: Consider a generalization of the classical binary search problem in linearly sorted data to the graph-theoretic setting. The goal is to design an adaptive query algorithm, called a strategy, that identifies an initially unknown target vertex in a graph by asking queries. Each query is conducted as follows: the strategy selects a vertex $q$ and receives a reply $v$: if $q$ is the target, then $v=q$, and if $q$ is not the target, then $v$ is a neighbor of $q$ that lies on a shortest path to the target. Furthermore, there is a noise parameter $0\leq p<\frac{1}{2}$, which means that each reply can be incorrect with probability $p$. The optimization criterion to be minimized is the overall number of queries asked by the strategy, called the query complexity. The query complexity is well understood to be $O(\varepsilon^{-2}\log n)$ for general graphs, where $n$ is the order of the graph and $\varepsilon=\frac{1}{2}-p$. However, implementing such a strategy is computationally expensive, with each query requiring possibly $O(n^2)$ operations. In this work we propose two efficient strategies that keep the optimal query complexity. The first strategy achieves the overall complexity of $O(\varepsilon^{-1}n\log n)$ per a single query. The second strategy is dedicated to graphs of small diameter $D$ and maximum degree $\Delta$ and has the average complexity of $O(n+\varepsilon^{-2}D\Delta\log n)$ per query. We stress out that we develop an algorithmic tool of graph median approximation that is of independent interest: the median can be efficiently approximated by finding a vertex minimizing the sum of distances to a randomly sampled vertex subset of size $O(\varepsilon^{-2}\log n)$.


title: Unsupervised Domain Adaptation for Acoustic Scene Classification Using Band-Wise Statistics Matching

abstract: The performance of machine learning algorithms is known to be negatively affected by possible mismatches between training (source) and test (target) data distributions. In fact, this problem emerges whenever an acoustic scene classification system which has been trained on data recorded by a given device is applied to samples acquired under different acoustic conditions or captured by mismatched recording devices. To address this issue, we propose an unsupervised domain adaptation method that consists of aligning the first- and second-order sample statistics of each frequency band of target-domain acoustic scenes to the ones of the source-domain training dataset. This model-agnostic approach is devised to adapt audio samples from unseen devices before they are fed to a pre-trained classifier, thus avoiding any further learning phase. Using the DCASE 2018 Task 1-B development dataset, we show that the proposed method outperforms the state-of-the-art unsupervised methods found in the literature in terms of both source- and target-domain classification accuracy.


title: Addressing Catastrophic Forgetting in Few-Shot Problems

abstract: Neural networks are known to suffer from catastrophic forgetting when trained on sequential datasets. While there have been numerous attempts to solve this problem in large-scale supervised classification, little has been done to overcome catastrophic forgetting in few-shot classification problems. We demonstrate that the popular gradient-based model-agnostic meta-learning algorithm (MAML) indeed suffers from catastrophic forgetting and introduce a Bayesian online meta-learning framework that tackles this problem. Our framework utilises Bayesian online learning and meta-learning along with Laplace approximation and variational inference to overcome catastrophic forgetting in few-shot classification problems. The experimental evaluations demonstrate that our framework can effectively achieve this goal in comparison with various baselines. As an additional utility, we also demonstrate empirically that our framework is capable of meta-learning on sequentially arriving few-shot tasks from a stationary task distribution.


title: Interpretable Entity Representations through Large-Scale Typing

abstract: In standard methodology for natural language processing, entities in text are typically embedded in dense vector spaces with pre-trained models. The embeddings produced this way are effective when fed into downstream models, but they require end-task fine-tuning and are fundamentally difficult to interpret. In this paper, we present an approach to creating entity representations that are human readable and achieve high performance on entity-related tasks out of the box. Our representations are vectors whose values correspond to posterior probabilities over fine-grained entity types, indicating the confidence of a typing model's decision that the entity belongs to the corresponding type. We obtain these representations using a fine-grained entity typing model, trained either on supervised ultra-fine entity typing data (Choi et al. 2018) or distantly-supervised examples from Wikipedia. On entity probing tasks involving recognizing entity identity, our embeddings used in parameter-free downstream models achieve competitive performance with ELMo- and BERT-based embeddings in trained models. We also show that it is possible to reduce the size of our type set in a learning-based way for particular domains. Finally, we show that these embeddings can be post-hoc modified through a small number of rules to incorporate domain knowledge and improve performance.


title: The Stable Rank of Diagonal ASH Algebras and Crossed Products by Minimal Homeomorphisms

abstract: We introduce a subclass of recursive subhomogeneous algebras, in which each of the pullback maps is diagonal in a suitable sense. We define the notion of a diagonal map between two such algebras and show that every simple inductive limit of these algebras with diagonal bonding maps has stable rank one. As an application, we prove that for any infinite compact metric space $T$ and minimal homeomorphism $h\colon T\to T$, the associated dynamical crossed product $\mathrm{C^*}(\mathbb{Z},T,h)$ has stable rank one. This affirms a conjecture of Archey, Niu, and Phillips. We also show that the Toms-Winter Conjecture holds for such crossed products.


title: Three Levels of Modeling: Static (Structure/Trajectories of Flow), Dynamic (Events) and Behavioral (Chronology of Events)

abstract: Constructing a conceptual model as an abstract representation of a portion of the real world involves capturing the (1) static (things/objects and trajectories of flow), (2) the dynamic (event identification), and (3) the behavior (e.g., acceptable chronology of events) of the modeled system. This paper focuses on examining the behavior notion in modeling and current works in the behavior space to illustrate that the problem of behavior and its related concepts in modeling lacks a clear-cut systematic basis. The purpose is to advance the understanding of system behavior to avoid ambiguity-related problems in system specification. It is proposed to base the notion of behavior on a new conceptual model, called the thinging machine, which is a tool for modeling that establishes three levels of representation: (1) a static structural description that is constructed upon the flow of things in five generic operations (activities; i.e., create, process, release, transfer and receive); (2) a dynamic representation that identifies hierarchies of events based on five generic events; and (3) a chronology of events. This is shown through examples that support the thinging machine as a new methodology suitable for all three levels of specification.


title: Subrings of $\mathbb Z[t]/(t^4)$

abstract: In this note we study the distribution of the subrings of $\mathbb Z[t]/(t^4)$ and prove two results. The first result gives an asymptotic formula for the number of subrings of $\mathbb Z[t]/(t^4)$ of bounded index. The method of proof of this theorem is $p$-adic integration a la Grunewald, Segal, and Smith. Our second result is about the distribution of cocyclic subrings in $\mathbb Z[t]/(t^4)$. Our proof of this result is combinatorial and is based on counting certain classes of matrices with Smith normal forms of a special form.