title: Optimization identification of superdiffusion processes in biology: an algorithm for processing observational data and a self-similar solution of the kinetic equation

abstract: This work is an attempt to transfer to biology the methods developed in physics for formulating and solving the kinetic equations in which the kernel of the integral operator in spatial coordinates is slowly decreasing with increasing distance and belongs to the class of Levy distributions. An algorithm is proposed for the reconstruction of the step-length probability density function (PDF) on a moderate number of trajectories of biological objects (migrants) and for the derivation of the Green's function of the corresponding integro-differential kinetic equation for the density of migrants in the entire space-time range, including the construction of an approximate self-similar solution. A wide class of time-dependent superdiffusion processes with a model power-law step-length PDF is considered, which corresponds to "Levy walks with rests" for given values of the migrant's constant velocity and the average time T of the migrant's stay between runs. The algorithm is tested within the framework of a synthetic diagnostics, consisting in the generation of artificial experimental data for trajectories of migrants and the subsequent reconstruction of the parameters of the step-length PDF and T. For different volumes of synthetic data, to obtain a general idea of the distributions under study (non-parametric case) and to evaluate the accuracy of recovering the parameters of the PDF (in the case of a parametric representation), the method of balanced identification is used. The approximate self-similar solution for the parameters of step-length PDF and T is shown to provide reasonable accuracy of the space-time evolution of migrant's density.


title: The Effects of Vacant Lot Greening and the Impact of Land Use and Business Presence on Crime

abstract: We examine the effect of the Philadelphia LandCare (PLC) vacant lot greening initiative on crime and the extent to which surrounding land uses and business types moderate this intervention. We rely on a propensity score matching analysis to account for substantial differences in demographic, economic, land use, and business characteristics between greened and ungreened vacant lots. We estimate larger and more significant crime reductions around vacant lots that are greened in our matched pairs analysis compared to unmatched analyses. The effects of vacant lot greening on crime are larger in areas with high residential and low commercial land use and are moderated by the presence of different types of nearby businesses.


title: The linear arboricity conjecture for graphs of low degeneracy

abstract: A linear forest is an acyclic graph whose each connected component is a path; or in other words, it is an acyclic graph whose maximum degree is at most 2. A linear coloring of a graph $G$ is an edge coloring of $G$ such that the edges in each color class form a linear forest. The linear arboricity of $G$, denoted as $\chi'_l(G)$, is the minimum number of colors required in any linear coloring of $G$. It is easy to see that for any graph $G$, $\chi'_l(G)\geq\left\lceil\frac{\Delta(G)}{2}\right\rceil$, where $\Delta(G)$ is the maximum degree of $G$. The Linear Arboricity Conjecture of Akiyama, Exoo and Harary from 1980 states that for every graph $G$, $\chi'_l(G)\leq \left \lceil \frac{\Delta(G)+1}{2}\right\rceil$. Basavaraju et al. showed that the conjecture is true for 3-degenerate graphs and provided a linear time algorithm for computing a linear coloring using at most $\left\lceil\frac{\Delta(G)+1}{2}\right\rceil$ colors for any input 3-degenerate graph $G$. Recently, Chen, Hao and Yu showed that $\chi'_l(G)=\left\lceil\frac{\Delta(G)}{2}\right\rceil$ for any $k$-degenerate graph $G$ having $\Delta(G)\geq 2k^2-k$. From this result, we have $\chi'_l(G)=\left\lceil\frac{\Delta(G)}{2}\right\rceil$ for every 3-degenerate graph $G$ having $\Delta(G)\geq 15$. We show that this equality holds for every 3-degenerate graph $G$ having $\Delta(G)\geq 9$. Moreover, by extending the techniques used, we show a different proof for the Linear Arboricity Conjecture on 3-degenerate graphs. Next, we prove that for every 2-degenerate graph $G$, $\chi'_l(G)=\left\lceil\frac{\Delta(G)}{2}\right\rceil$ if $\Delta(G)\geq 5$. We conjecture that this equality holds also when $\Delta(G)\in\{3,4\}$ and show that this is the case for some well-known subclasses of 2-degenerate graphs.


title: Motivic decompositions of moduli spaces of vector bundles on curves

abstract: Let $r \geq 2, d$ be two integers which are coprime to each other. Let $C$ be a smooth projective curve of genus $g \geq 2$ and $M(r,L)$ be the moduli space of rank $r$ stable vector bundles on $C$ whose determinants are isomorphic to a fixed line bundle $L$ of degree $d$ on $C.$ In this paper, we study motivic decomposition of $M(r,L)$ for $r=2, 3$ cases. We give a new proof of a version of the main result of arXiv:1806.11101. We also found a new motivic decomposition of $M(3,L).$


title: Visualizing Classification Structure of Large-Scale Classifiers

abstract: We propose a measure to compute class similarity in large-scale classification based on prediction scores. Such measure has not been formally pro-posed in the literature. We show how visualizing the class similarity matrix can reveal hierarchical structures and relationships that govern the classes. Through examples with various classifiers, we demonstrate how such structures can help in analyzing the classification behavior and in inferring potential corner cases. The source code for one example is available as a notebook at https://github.com/bilalsal/blocks


title: On Certain Generalizations of $\mathcal{S}^*(\psi)$

abstract: We deal with different kinds of generalizations of $\mathcal{S}^*(\psi)$, the class of Ma-Minda starlike functions, in addition to a majorization result of $\mathcal{C}(\psi),$ the class of Ma-Minda convex functions, which are enlisted as follows: 1. Let $h$ be an analytic function, $f$ be in $\mathcal{C}(\psi)$ and $h$ be majorized by $f$ in the unit disk $\mathbb{D},$ then for a given $\psi,$ we derive a general equation, which yields the radius constant $r_{\psi}$ such that $|h'(z)|\leq |f'(z)|$ in $|z|\leq r_{\psi}$. Consequently, obtain results associating $\mathcal{S}^*(\psi)$ and others. 2. We find the largest radius $r_0$ so that the product function $g(z)h(z)/z$ belongs to a desired class for $|z|<r_0$ whenever $g\in \mathcal{S}^*(\psi_1)$ and $h\in \mathcal{S}^*(\psi_2).$ Also we obtain a condition for the functions to be in $\mathcal{S}^*(\psi)$ 3. We obtain the modified distortion theorem for $\mathcal{S}^*(\psi)$ with a general perspective. 4. For a fixed $f\in \mathcal{S}^*(\psi),$ the class of subordinants $S_{f}(\psi):= \{g : g\prec f \} $ is introduced and studied for the Bohr-phenomenon and a couple of conjectures are also proposed.


title: Quantum-gravitational trans-Planckian radiation by a rotating black hole

abstract: We recently studied the energy behavior of a quantum-corrected time-dependent black hole. The system analyzed was a quantum-corrected Kerr solution that settles down to a stationary configuration as the time dependence fades out. A trans-Planckian energy scaling in the vicinity of the event horizon resulted, and we proposed the trans-Planckian radiation to be the missing link in the glowing mechanism of active galactic nuclei. The main goal of the present work is to examine the scaling and structure of the radiation by analyzing the quantum momentum density. We again observe a trans-Planckian behavior. Furthermore, the momentum density displays structures that are indicative of a disk-like configuration near the equator and a collimated outflow of matter from the poles. The bipolar outflow (disk-like structure) should be an essential part of the underlying mechanism for jets (accretion disks) of active galactic nuclei.


title: A Comparative Study on Polyp Classification using Convolutional Neural Networks

abstract: Colorectal cancer is the third most common cancer diagnosed in both men and women in the United States. Most colorectal cancers start as a growth on the inner lining of the colon or rectum, called 'polyp'. Not all polyps are cancerous, but some can develop into cancer. Early detection and recognition of the type of polyps is critical to prevent cancer and change outcomes. However, visual classification of polyps is challenging due to varying illumination conditions of endoscopy, variant texture, appearance, and overlapping morphology between polyps. More importantly, evaluation of polyp patterns by gastroenterologists is subjective leading to a poor agreement among observers. Deep convolutional neural networks have proven very successful in object classification across various object categories. In this work, we compare the performance of the state-of-the-art general object classification models for polyp classification. We trained a total of six CNN models end-to-end using a dataset of 157 video sequences composed of two types of polyps: hyperplastic and adenomatous. Our results demonstrate that the state-of-the-art CNN models can successfully classify polyps with an accuracy comparable or better than reported among gastroenterologists. The results of this study can guide future research in polyp classification.


title: A spectral algorithm for robust regression with subgaussian rates

abstract: We study a new linear up to quadratic time algorithm for linear regression in the absence of strong assumptions on the underlying distributions of samples, and in the presence of outliers. The goal is to design a procedure which comes with actual working code that attains the optimal sub-gaussian error bound even though the data have only finite moments (up to $L_4$) and in the presence of possibly adversarial outliers. A polynomial-time solution to this problem has been recently discovered but has high runtime due to its use of Sum-of-Square hierarchy programming. At the core of our algorithm is an adaptation of the spectral method introduced for the mean estimation problem to the linear regression problem. As a by-product we established a connection between the linear regression problem and the furthest hyperplane problem. From a stochastic point of view, in addition to the study of the classical quadratic and multiplier processes we introduce a third empirical process that comes naturally in the study of the statistical properties of the algorithm.


title: Fair Division with Binary Valuations: One Rule to Rule Them All

abstract: We study fair allocation of indivisible goods among agents. Prior research focuses on additive agent preferences, which leads to an impossibility when seeking truthfulness, fairness, and efficiency. We show that when agents have binary additive preferences, a compelling rule -- maximum Nash welfare (MNW) -- provides all three guarantees. Specifically, we show that deterministic MNW with lexicographic tie-breaking is group strategyproof in addition to being envy-free up to one good and Pareto optimal. We also prove that fractional MNW -- known to be group strategyproof, envy-free, and Pareto optimal -- can be implemented as a distribution over deterministic MNW allocations, which are envy-free up to one good. Our work establishes maximum Nash welfare as the ultimate allocation rule in the realm of binary additive preferences.


title: A Learning-boosted Quasi-Newton Method for AC Optimal Power Flow

abstract: Power grid operators typically solve large-scale, nonconvex optimal power flow (OPF) problems throughout the day to determine optimal setpoints for generators while adhering to physical constraints. Despite being at the heart of many OPF solvers, Newton-Raphson can be slow and numerically unstable. To reduce the computational burden associated with calculating the full Jacobian and its inverse, many Quasi-Newton methods attempt to find a solution to the optimality conditions by leveraging an approximate Jacobian matrix. In this paper, a Quasi-Newton method based on machine learning is presented which performs iterative updates for candidate optimal solutions without having to calculate a Jacobian or approximate Jacobian matrix. The proposed learning-based algorithm utilizes a deep neural network with feedback. With proper choice of weights and activation functions, the model becomes a contraction mapping and convergence can be guaranteed. Results shown for networks up to 1,354 buses indicate the proposed method is capable of finding approximate solutions to AC OPF very quickly.


title: Identifying Latent Stochastic Differential Equations

abstract: We present a method for learning latent stochastic differential equations (SDEs) from high-dimensional time series data. Given a high-dimensional time series generated from a lower dimensional latent unknown It\^o process, the proposed method learns the mapping from ambient to latent space, and the underlying SDE coefficients, through a self-supervised learning approach. Using the framework of variational autoencoders, we consider a conditional generative model for the data based on the Euler-Maruyama approximation of SDE solutions. Furthermore, we use recent results on identifiability of latent variable models to show that the proposed model can recover not only the underlying SDE coefficients, but also the original latent variables, up to an isometry, in the limit of infinite data. We validate the method through several simulated video processing tasks, where the underlying SDE is known, and through real world datasets.


title: svReg: Structural Varying-coefficient regression to differentiate how regional brain atrophy affects motor impairment for Huntington disease severity groups

abstract: For Huntington disease, identification of brain regions related to motor impairment can be useful for developing interventions to alleviate the motor symptom, the major symptom of the disease. However, the effects from the brain regions to motor impairment may vary for different groups of patients. Hence, our interest is not only to identify the brain regions but also to understand how their effects on motor impairment differ by patient groups. This can be cast as a model selection problem for a varying-coefficient regression. However, this is challenging when there is a pre-specified group structure among variables. We propose a novel variable selection method for a varying-coefficient regression with such structured variables. Our method is empirically shown to select relevant variables consistently. Also, our method screens irrelevant variables better than existing methods. Hence, our method leads to a model with higher sensitivity, lower false discovery rate and higher prediction accuracy than the existing methods. Finally, we found that the effects from the brain regions to motor impairment differ by disease severity of the patients. To the best of our knowledge, our study is the first to identify such interaction effects between the disease severity and brain regions, which indicates the need for customized intervention by disease severity.


title: Sparse Graph to Sequence Learning for Vision Conditioned Long Textual Sequence Generation

abstract: Generating longer textual sequences when conditioned on the visual information is an interesting problem to explore. The challenge here proliferate over the standard vision conditioned sentence-level generation (e.g., image or video captioning) as it requires to produce a brief and coherent story describing the visual content. In this paper, we mask this Vision-to-Sequence as Graph-to-Sequence learning problem and approach it with the Transformer architecture. To be specific, we introduce Sparse Graph-to-Sequence Transformer (SGST) for encoding the graph and decoding a sequence. The encoder aims to directly encode graph-level semantics, while the decoder is used to generate longer sequences. Experiments conducted with the benchmark image paragraph dataset show that our proposed achieve 13.3% improvement on the CIDEr evaluation measure when comparing to the previous state-of-the-art approach.


title: Fine-grained Language Identification with Multilingual CapsNet Model

abstract: Due to a drastic improvement in the quality of internet services worldwide, there is an explosion of multilingual content generation and consumption. This is especially prevalent in countries with large multilingual audience, who are increasingly consuming media outside their linguistic familiarity/preference. Hence, there is an increasing need for real-time and fine-grained content analysis services, including language identification, content transcription, and analysis. Accurate and fine-grained spoken language detection is an essential first step for all the subsequent content analysis algorithms. Current techniques in spoken language detection may lack on one of these fronts: accuracy, fine-grained detection, data requirements, manual effort in data collection \& pre-processing. Hence in this work, a real-time language detection approach to detect spoken language from 5 seconds' audio clips with an accuracy of 91.8\% is presented with exiguous data requirements and minimal pre-processing. Novel architectures for Capsule Networks is proposed which operates on spectrogram images of the provided audio snippets. We use previous approaches based on Recurrent Neural Networks and iVectors to present the results. Finally we show a ``Non-Class'' analysis to further stress on why CapsNet architecture works for LID task.


title: Helicity-dependent cross sections for the photoproduction of $\pi^0$ pairs from nucleons

abstract: The double-polarization observable $E$ and helicity-dependent cross sections $\sigma_{1/2}$, $\sigma_{3/2}$ have been measured for the photoproduction of $\pi^0$ pairs off quasi-free protons and neutrons at the Mainz MAMI accelerator with the Crystal Ball/TAPS setup. A circularly polarized photon beam was produced by bremsstrahlung from longitudinally polarized electrons and impinged on a longitudinally polarized deuterated butanol target. The reaction products were detected with an almost $4\pi$ covering calorimeter. The results reveal for the first time the helicity- and isospin-dependent structure of the $\gamma N\rightarrow N\pi^0\pi^0$ reaction. They are compared to predictions from reaction models in view of nucleon resonance contributions and also to a refit of one model that predicted results for the proton and for the neutron target. The comparison of the prediction and the refit demonstrate the large impact of the new data.


title: Robotic Non-Destructive Testing of Manmade Structures: A Review of the Literature

abstract: This literature review investigates how robots can be used for the maintenance of manmade structures, such as pipes, reinforced concrete decks, and space stations as a sampling of the broad spectrum of robotic non-destructive testing (NDT) applications. Robotic NDT can be used to find plaque in pipes, corrosion in steel buildings, and impact damage in space stations, which would normally be invisible to the eye. After inspection, the inspected material is preserved in its original condition. The paper's structure is as follows: first, the definition of NDT is elaborated upon with the discussion of specific methods that will be used in the inspection of the structures mentioned above. Second, an explanation follows on why robots are suited to inspection, specifically focusing on robots' advantages over humans. Third, three real-world examples notify the reader of current progress in robot NDT. Lastly, a summary of robot problems serves as a reminder that testing and development must continue for robot NDT to become mainstream.


title: VAFL: a Method of Vertical Asynchronous Federated Learning

abstract: Horizontal Federated learning (FL) handles multi-client data that share the same set of features, and vertical FL trains a better predictor that combine all the features from different clients. This paper targets solving vertical FL in an asynchronous fashion, and develops a simple FL method. The new method allows each client to run stochastic gradient algorithms without coordination with other clients, so it is suitable for intermittent connectivity of clients. This method further uses a new technique of perturbed local embedding to ensure data privacy and improve communication efficiency. Theoretically, we present the convergence rate and privacy level of our method for strongly convex, nonconvex and even nonsmooth objectives separately. Empirically, we apply our method to FL on various image and healthcare datasets. The results compare favorably to centralized and synchronous FL methods.


title: Entanglement and Tensor Networks for Supervised Image Classification

abstract: Tensor networks, originally designed to address computational problems in quantum many-body physics, have recently been applied to machine learning tasks. However, compared to quantum physics, where the reasons for the success of tensor network approaches over the last 30 years is well understood, very little is yet known about why these techniques work for machine learning. The goal of this paper is to investigate entanglement properties of tensor network models in a current machine learning application, in order to uncover general principles that may guide future developments. We revisit the use of tensor networks for supervised image classification using the MNIST data set of handwritten digits, as pioneered by Stoudenmire and Schwab [Adv. in Neur. Inform. Proc. Sys. 29, 4799 (2016)]. Firstly we hypothesize about which state the tensor network might be learning during training. For that purpose, we propose a plausible candidate state $|\Sigma_{\ell}\rangle$ (built as a superposition of product states corresponding to images in the training set) and investigate its entanglement properties. We conclude that $|\Sigma_{\ell}\rangle$ is so robustly entangled that it cannot be approximated by the tensor network used in that work, which must therefore be representing a very different state. Secondly, we use tensor networks with a block product structure, in which entanglement is restricted within small blocks of $n \times n$ pixels/qubits. We find that these states are extremely expressive (e.g. training accuracy of $99.97 \%$ already for $n=2$), suggesting that long-range entanglement may not be essential for image classification. However, in our current implementation, optimization leads to over-fitting, resulting in test accuracies that are not competitive with other current approaches.


title: On almost sure limit theorems for heavy-tailed products of long-range dependent linear processes

abstract: Marcinkiewicz strong law of large numbers, ${n^{-\frac1p}}\sum_{k=1}^{n} (d_{k}- d)\rightarrow 0\ $ almost surely with $p\in(1,2)$, are developed for products $d_k=\prod_{r=1}^s x_k^{(r)}$, where the $x_k^{(r)} = \sum_{l=-\infty}^{\infty}c_{k-l}^{(r)}\xi_l^{(r)}$ are two-sided linear processes with coefficients $\{c_l^{(r)}\}_{l\in \mathbb{Z}}$ and i.i.d. zero-mean innovations $\{\xi_l^{(r)}\}_{l\in \mathbb{Z}}$. The decay of the coefficients $c_l^{(r)}$ as $|l|\to\infty$, can be slow enough for $\{x_k^{(r)}\}$ to have long memory while $\{d_k\}$ can have heavy tails. The long-range dependence and heavy tails for $\{d_k\}$ are handled simultaneously and a decoupling property shows the convergence rate is dictated by the worst of long-range dependence and heavy tails, but not their combination. The Marcinkiewicz strong law of large numbers is also extended to the multivariate linear process case.


title: Bayesian probabilistic models for corporate context, with an application to internal audit activities

abstract: In this paper we present a business case carried out in Poste Italiane, in the context of fair performance evaluations of human resources engaged in internal audit activities. In addition to the development of a Bayesian network supporting the goal of the Internal Audit unit of Poste Italiane, the work has led to the development of a methodological approach to advanced analytics in corporate context, whose usefulness goes well beyond the specific use case described here. We thus present the different stages of such analytical strategy, from feature selection, to model structure inference and model selection, as a general toolbox that allows a completely transparent and explainable process to support data-driven decisions in business environments.


title: Condensation of the invariant measures of the supercritical zero range processes

abstract: For $\alpha\geq 1$, let $g:\mathbb N\to\mathbb R_+$ be given by $g(0)=0$, $g(1)=1$, $g(k)=(k/k-1)^\alpha$, $k\geq 2$. Consider the symmetric nearest neighbour zero range process on the discrete torus $\mathbb T_L$ in which a particle jumps from a site, occupied by $k$ particles, to one of its neighbors with rate $g(k)$. Armend\'ariz and Loulakis\cite{al09} proved a strong form of the equivalence of ensembles for the invariant measure of the supercritical zero range process with $\alpha>2$. We generalize their result to all $\alpha\geq 1$.


title: Fragile Insulator and Electronic Nematicity in a Graphene Moire System

abstract: Strongly correlated quantum matter exhibits a rich variety of remarkable properties, but the organizing principles that underlie the behavior remain to be established. Graphene heterostructures, which can host narrow moire electron bands that amplify the correlation effect, represent a new setting to make progress on this overarching issue. In such correlated moire systems, an insulating state is a prominent feature of the phase diagram and may hold the key to understanding the basic physics. Here we advance the notion of a fragile insulator, a correlation-driven insulating state that is on the verge of a delocalization transition into a bad metal. Using a realistic multiorbital Hubbard model as a prototype for narrow band moire systems, we realize such a fragile insulator and demonstrate a nematic order in this state as well as in the nearby bad metal regime. Our results are consistent with the observed electronic anisotropy in the graphene moire systems and provide a natural understanding of what happens when the insulator is tuned into a bad metal. We propose the fragile insulator and the accompanying bad metal as competing states at integer fillings that analogously anchor the overall phase diagram of the correlated moire systems and beyond.


title: Explosion Energies for Core-collapse Supernovae I: Analytic, Spherically Symmetric Solutions

abstract: Recent multi-dimensional simulations of core-collapse supernovae are producing successful explosions and explosion-energy predictions. In general, the explosion-energy evolution is monotonic and relatively smooth, suggesting a possible analytic solution. We derive analytic solutions for the expansion of the gain region under the following assumptions: spherical symmetry, one-zone shell, and powered by neutrinos and $\alpha$ particle recombination. We consider two hypotheses: I) explosion energy is powered by neutrinos and $\alpha$ recombination, II) explosion energy is powered by neutrinos alone. Under these assumptions, we derive the fundamental dimensionless parameters and analytic scalings. For the neutrino-only hypothesis (II), the asymptotic explosion energy scales as $E_{\infty} \approx 1.5 M_g v_0^2 \eta^{2/3}$, where $M_g$ is the gain mass, $v_0$ is the free-fall velocity at the shock, and $\eta$ is a ratio of the heating and dynamical time scales. Including both neutrinos and recombination (hypothesis I), the asymptotic explosion energy is $E_{\infty} \approx M_g v_0^2 (1.5\eta^{2/3} + \beta f(\rho_0))$, where $\beta$ is the dimensionless recombination parameter. We use Bayesian inference to fit these analytic models to simulations. Both hypotheses fit the simulations of the lowest progenitor masses that tend to explode spherically. The fits do not prefer hypothesis I or II; however, prior investigations suggest that $\alpha$ recombination is important. As expected, neither hypothesis fits the higher-mass simulations that exhibit aspherical explosions. In summary, this explosion-energy theory is consistent with the spherical explosions of low progenitor masses; the inconsistency with higher progenitor-mass simulations suggests that a theory for them must include aspherical dynamics.


title: Statistical stability and linear response for random hyperbolic dynamics

abstract: We consider families of random products of close-by Anosov diffeomorphisms, and show that statistical stability and linear response hold for the associated families of equivariant and stationary measures. Our analysis rely on the study of the top Oseledets space of a parametrized transfer operator cocycle, as well as ad-hoc abstract perturbation statements. As an application, we show that, when the quenched central limit theorem holds, under the conditions that ensure linear response for our cocycle, the variance in the CLT depends differentiably on the parameter.


title: Hawking Radiation of Black Shells

abstract: A black shell consists of a massive thin spherical shell contracting toward its gravitational radius, coinciding with 't Hooft's brick wall, from the point of view of an external observer far from the shell. This object was conceived by J.R.Arenas and W.Israel in order to effectively model the gravitational collapse dynamics and the thermodynamics of a black hole [5,6,21,1]. We show in this article that a black shell presents the same emission rate of a black hole when we consider Klein-Gordon equation in the near horizon limit. We will use Parikh-Wilczek tunneling approach to obtain the black shell emission rate [2].


title: Transferable Potential Function for Flexible H$_2$O Molecules Based on the Single Center Multipole Expansion

abstract: A potential function is presented for describing a system of flexible H$_2$O molecules based on the single center multipole expansion (SCME) of the electrostatic interaction. The model, referred to as SCME/f, includes the variation of the molecular quadrupole moment as well as the dipole moment with changes in bond length and angle so as to reproduce results of high level electronic structure calculations. The multipole expansion also includes fixed octupole and hexadecapole moments, as well as anisotropic dipole-dipole, dipole-quadrupole and quadrupole-quadrupole polarizability tensors. The model contains five adjustable parameters related to the repulsive interaction and damping functions in the electrostatic and dispersion interactions. Their values are adjusted to reproduce the lowest energy isomers of small clusters, (H$_2$O)$_n$ with $n=2-6$, as well as measured properties of the ice Ih crystal. Subsequent calculations of the energy difference between the various isomer configurations of the clusters show that SCME/f gives good agreement with results of electronic structure calculations and represents a significant improvement over the previously presented rigid SCME potential function. Analysis of the vibrational frequencies of the clusters and structural properties of ice Ih crystal show the importance of accurately describing the variation of the quadrupole moment with molecular structure.


title: An infinite antichain of planar tanglegrams

abstract: Contrary to the expectation arising from the tanglegram Kuratowski theorem of \'E. Czabarka, L.A. Sz\'ekely and S. Wagner [SIAM J. Discrete Math. 31(3): 1732--1750, (2017)], we construct an infinite antichain of planar tanglegrams with respect to the induced subtanglegram partial order. R.E. Tarjan, R. Laver, D.A. Spielman and M. B\'ona, and possibly others, showed that the partially ordered set of finite permutations ordered by deletion of entries contains an infinite antichain, i.e. there exists an infinite collection of permutations, such that none of them contains another as a pattern. Our construction adds a twist to the construction of Spielman and B\'ona [Electr. J. Comb, Vol. 7. N2.]


title: Spintronics for neuromorphic computing

abstract: Neuromorphic computing uses brain-inspired principles to design circuits that can perform computational tasks with superior power efficiency to conventional computers. Approaches that use traditional electronic devices to create artificial neurons and synapses are, however, currently limited by the energy and area requirements of these components. Spintronic nanodevices, which exploit both the magnetic and electrical properties of electrons, can increase the energy efficiency and decrease the area of these circuits, and magnetic tunnel junctions are of particular interest as neuromorphic computing elements because they are compatible with standard integrated circuits and can support multiple functionalities. Here we review the development of spintronic devices for neuromorphic computing. We examine how magnetic tunnel junctions can serve as synapses and neurons, and how magnetic textures, such as domain walls and skyrmions, can function as neurons. We also explore spintronics-based implementations of neuromorphic computing tasks, such as pattern recognition in an associative memory, and discuss the challenges that exist in scaling up these systems.


title: Interval Universal Approximation for Neural Networks

abstract: To verify safety and robustness of neural networks, researchers have successfully applied abstract interpretation, primarily using the interval abstract domain. In this paper, we study the theoretical power and limits of the interval domain for neural-network verification. First, we introduce the interval universal approximation (IUA) theorem. IUA shows that neural networks not only can approximate any continuous function $f$ (universal approximation) as we have known for decades, but we can find a neural network, using any well-behaved activation function, whose interval bounds are an arbitrarily close approximation of the set semantics of $f$ (the result of applying $f$ to a set of inputs). We call this notion of approximation interval approximation. Our theorem generalizes the recent result of Baader et al. (2020) from ReLUs to a rich class of activation functions that we call squashable functions. Additionally, the IUA theorem implies that we can always construct provably robust neural networks under $\ell_\infty$-norm using almost any practical activation function. Second, we study the computational complexity of constructing neural networks that are amenable to precise interval analysis. This is a crucial question, as our constructive proof of IUA is exponential in the size of the approximation domain. We boil this question down to the problem of approximating the range of a neural network with squashable activation functions. We show that the range approximation problem (RA) is a $\Delta_2$-intermediate problem, which is strictly harder than $\mathsf{NP}$-complete problems, assuming $\mathsf{coNP}\not\subset \mathsf{NP}$. As a result, IUA is an inherently hard problem: No matter what abstract domain or computational tools we consider to achieve interval approximation, there is no efficient construction of such a universal approximator.


title: Numerically computing the index of mean curvature flow self-shrinkers

abstract: Surfaces that evolve by mean curvature flow develop singularities. These singularities can be modeled by self-shrinkers, surfaces that shrink by dilations under the flow. Singularities modeled on classical self-shrinkers, namely spheres and cylinders, are stable under perturbations of the flow. In contrast, singularities modeled on other self-shrinkers, such as the Angenent torus, are unstable: perturbing the flow will generally change the kind of singularity. One can measure the degree of instability by computing the Morse index of the self-shrinker, viewed as a critical point of an appropriate functional. In this paper, we present a numerical method for computing the index of rotationally symmetric self-shrinkers. We apply this method to the Angenent torus, the first known nontrivial example of a self-shrinker. We find that, excluding dilations and translations, the index of the Angenent torus is $5$, which is consistent with the lower bound of $3$ from the work of Liu and the upper bound of $29$ from our earlier work. Also, we unexpectedly discover two additional variations of the Angenent torus with eigenvalue $-1$.


title: (Non-)Distributivity of the Product for $\sigma$-Algebras with Respect to the Intersection

abstract: We study the validity of the distributivity equation $$(\mathcal{A}\otimes\mathcal{F})\cap(\mathcal{A}\otimes\mathcal{G})=\mathcal{A}\otimes\left(\mathcal{F}\cap\mathcal{G}\right),$$ where $\mathcal{A}$ is a $\sigma$-algebra on a set $X$, and $\mathcal{F}, \mathcal{G}$ are $\sigma$-algebras on a set $U$. We present a counterexample for the general case and in the case of countably generated subspaces of analytic measurable spaces we give an equivalent condition in terms of the $\sigma$-algebras' atoms. Using this, we give a sufficient condition under which distributivity holds.


title: BaCOUn: Bayesian Classifers with Out-of-Distribution Uncertainty

abstract: Traditional training of deep classifiers yields overconfident models that are not reliable under dataset shift. We propose a Bayesian framework to obtain reliable uncertainty estimates for deep classifiers. Our approach consists of a plug-in "generator" used to augment the data with an additional class of points that lie on the boundary of the training data, followed by Bayesian inference on top of features that are trained to distinguish these "out-of-distribution" points.


title: Low-Complexity Set-Membership Normalized LMS Algorithm for Sparse System Modeling

abstract: In this work, we propose two low-complexity set-membership normalized least-mean-square (LCSM-NLMS1 and LCSM-NLMS2) algorithms to exploit the sparsity of an unknown system. For this purpose, in the LCSM-NLMS1 algorithm, we employ a function called the discard function to the adaptive coefficients in order to neglect the coefficients close to zero in the update process. Moreover, in the LCSM-NLMS2 algorithm, to decrease the overall number of computations needed even further, we substitute small coefficients with zero. Numerical results present similar performance of these algorithms when comparing them with some state-of-the-art sparsity-aware algorithms, whereas the proposed algorithms need lower computational cost.


title: Graph Connectivity and Single Element Recovery via Linear and OR Queries

abstract: We study the problem of finding a spanning forest in an undirected, $n$-vertex multi-graph under two basic query models. One is the Linear query model which are linear measurements on the incidence vector induced by the edges; the other is the weaker OR query model which only reveals whether a given subset of plausible edges is empty or not. At the heart of our study lies a fundamental problem which we call the {\em single element recovery} problem: given a non-negative real vector $x$ in $N$ dimension, return a single element $x_j > 0$ from the support. Queries can be made in rounds, and our goals is to understand the trade-offs between the query complexity and the rounds of adaptivity needed to solve these problems, for both deterministic and randomized algorithms. These questions have connections and ramifications to multiple areas such as sketching, streaming, graph reconstruction, and compressed sensing. Our main results are: * For the single element recovery problem, it is easy to obtain a deterministic, $r$-round algorithm which makes $(N^{1/r}-1)$-queries per-round. We prove that this is tight: any $r$-round deterministic algorithm must make $\geq (N^{1/r} - 1)$ linear queries in some round. In contrast, a $1$-round $O(\log^2 N)$-query randomized algorithm which succeeds 99% of the time is known to exist. * We design a deterministic $O(r)$-round, $\tilde{O}(n^{1+1/r})$-OR query algorithm for graph connectivity. We complement this with an $\tilde{\Omega}(n^{1 + 1/r})$-lower bound for any $r$-round deterministic algorithm in the OR-model. * We design a randomized, $2$-round algorithm for the graph connectivity problem which makes $\tilde{O}(n)$-OR queries. In contrast, we prove that any $1$-round algorithm (possibly randomized) requires $\tilde{\Omega}(n^2)$-OR queries.


title: Multiplicative Perturbation Bounds for Multivariate Multiple Linear Regression in Schatten $p$-Norms

abstract: Multivariate multiple linear regression (MMLR), which occurs in a number of practical applications, generalizes traditional least squares (multivariate linear regression) to multiple right-hand sides. We extend recent MLR analyses to sketched MMLR in general Schatten $p$-norms by interpreting the sketched problem as a multiplicative perturbation. Our work represents an extension of Maher's results on Schatten $p$-norms. We derive expressions for the exact and perturbed solutions in terms of projectors for easy geometric interpretation. We also present a geometric interpretation of the action of the sketching matrix in terms of relevant subspaces. We show that a key term in assessing the accuracy of the sketched MMLR solution can be viewed as a tangent of a largest principal angle between subspaces under some assumptions. Our results enable additional interpretation of the difference between an orthogonal and oblique projector with the same range.


title: The Brown measure of the sum of a self-adjoint element and an elliptic element

abstract: We completely determine the Brown measure of the sum of a self-adjoint element and an elliptic element, which is the limiting eigenvalue distribution of the random matrix \[Y_N+\sqrt{s-\frac{t}{2}}X_N+i\sqrt{\frac{t}{2}}X_N'\] where $Y_N$ is an $N\times N$ deterministic Hermitian matrix whose eigenvalue distribution converges as $N\to\infty$ and $X_N$ and $X_N'$ are independent Gaussian unitary ensembles. We also study various asymptotic behaviors of this Brown measure as the variance of the elliptic element approaches infinity.


title: Multiple Imputation and Synthetic Data Generation with the R package NPBayesImputeCat

abstract: In many contexts, missing data and disclosure control are ubiquitous and challenging issues. In particular at statistical agencies, the respondent-level data they collect from surveys and censuses can suffer from high rates of missingness. Furthermore, agencies are obliged to protect respondents' privacy when publishing the collected data for public use. The NPBayesImputeCat R package, introduced in this paper, provides routines to i) create multiple imputations for missing data, and ii) create synthetic data for statistical disclosure control, for multivariate categorical data, with or without structural zeros. We describe the Dirichlet process mixture of products of multinomial distributions model used in the package, and illustrate various uses of the package using data samples from the American Community Survey (ACS). We also compare results of the missing data imputation to the mice R package and those of the synthetic data generation to the synthpop R package.


title: SkyScapes -- Fine-Grained Semantic Understanding of Aerial Scenes

abstract: Understanding the complex urban infrastructure with centimeter-level accuracy is essential for many applications from autonomous driving to mapping, infrastructure monitoring, and urban management. Aerial images provide valuable information over a large area instantaneously; nevertheless, no current dataset captures the complexity of aerial scenes at the level of granularity required by real-world applications. To address this, we introduce SkyScapes, an aerial image dataset with highly-accurate, fine-grained annotations for pixel-level semantic labeling. SkyScapes provides annotations for 31 semantic categories ranging from large structures, such as buildings, roads and vegetation, to fine details, such as 12 (sub-)categories of lane markings. We have defined two main tasks on this dataset: dense semantic segmentation and multi-class lane-marking prediction. We carry out extensive experiments to evaluate state-of-the-art segmentation methods on SkyScapes. Existing methods struggle to deal with the wide range of classes, object sizes, scales, and fine details present. We therefore propose a novel multi-task model, which incorporates semantic edge detection and is better tuned for feature extraction from a wide range of scales. This model achieves notable improvements over the baselines in region outlines and level of detail on both tasks.


title: VINNAS: Variational Inference-based Neural Network Architecture Search

abstract: In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image classification or object detection. In particular, gradient-based NAS approaches have become one of the more popular approaches thanks to their computational efficiency during the search. However, these methods often experience a mode collapse, where the quality of the found architectures is poor due to the algorithm resorting to choosing a single operation type for the entire network, or stagnating at a local minima for various datasets or search spaces. To address these defects, we present a differentiable variational inference-based NAS method for searching sparse convolutional neural networks. Our approach finds the optimal neural architecture by dropping out candidate operations in an over-parameterised supergraph using variational dropout with automatic relevance determination prior, which makes the algorithm gradually remove unnecessary operations and connections without risking mode collapse. The evaluation is conducted through searching two types of convolutional cells that shape the neural network for classifying different image datasets. Our method finds diverse network cells, while showing state-of-the-art accuracy with up to almost 2 times fewer non-zero parameters.


title: Neural disambiguation of lemma and part of speech in morphologically rich languages

abstract: We consider the problem of disambiguating the lemma and part of speech of ambiguous words in morphologically rich languages. We propose a method for disambiguating ambiguous words in context, using a large un-annotated corpus of text, and a morphological analyser -- with no manual disambiguation or data annotation. We assume that the morphological analyser produces multiple analyses for ambiguous words. The idea is to train recurrent neural networks on the output that the morphological analyser produces for unambiguous words. We present performance on POS and lemma disambiguation that reaches or surpasses the state of the art -- including supervised models -- using no manually annotated data. We evaluate the method on several morphologically rich languages.


title: Efficient Labeling for Reachability in Digraphs

abstract: We consider labeling nodes of a directed graph for reachability queries. A reachability labeling scheme for such a graph assigns a binary string, called a label, to each node. Then, given the labels of nodes $u$ and $v$ and no other information about the underlying graph, it should be possible to determine whether there exists a directed path from $u$ to $v$. By a simple information theoretical argument and invoking the bound on the number of partial orders, in any scheme some labels need to consist of at least $n/4$ bits, where $n$ is the number of nodes. On the other hand, it is not hard to design a scheme with labels consisting of $n/2+O(\log n)$ bits. In the classical centralised setting, Munro and Nicholson designed a data structure for reachability queries consisting of $n^2/4+o(n^2)$ bits (which is optimal, up to the lower order term). We extend their approach to obtain a scheme with labels consisting of $n/3+o(n)$ bits.


title: Unsupervised Feature Selection for Tumor Profiles using Autoencoders and Kernel Methods

abstract: Molecular data from tumor profiles is high dimensional. Tumor profiles can be characterized by tens of thousands of gene expression features. Due to the size of the gene expression feature set machine learning methods are exposed to noisy variables and complexity. Tumor types present heterogeneity and can be subdivided in tumor subtypes. In many cases tumor data does not include tumor subtype labeling thus unsupervised learning methods are necessary for tumor subtype discovery. This work aims to learn meaningful and low dimensional representations of tumor samples and find tumor subtype clusters while keeping biological signatures without using tumor labels. The proposed method named Latent Kernel Feature Selection (LKFS) is an unsupervised approach for gene selection in tumor gene expression profiles. By using Autoencoders a low dimensional and denoised latent space is learned as a target representation to guide a Multiple Kernel Learning model that selects a subset of genes. By using the selected genes a clustering method is used to group samples. In order to evaluate the performance of the proposed unsupervised feature selection method the obtained features and clusters are analyzed by clinical significance. The proposed method has been applied on three tumor datasets which are Brain, Renal and Lung, each one composed by two tumor subtypes. When compared with benchmark unsupervised feature selection methods the results obtained by the proposed method reveal lower redundancy in the selected features and a better clustering performance.


title: Backward shift and nearly invariant subspaces of Fock-type spaces

abstract: We study the structure of the backward shift invariant and nearly invariant subspaces in weighted Fock-type spaces $\mathcal{F}_W^p$, whose weight $W$ is not necessarily radial. We show that in the spaces $\mathcal{F}_W^p$ which contain the polynomials as a dense subspace (in particular, in the radial case) all nontrivial backward shift invariant subspaces are of the form $\mathcal{P}_n$, i.e., finite dimensional subspaces consisting of polynomials of degree at most $n$. In general, the structure of the nearly invariant subspaces is more complicated. In the case of spaces of slow growth (up to zero exponential type) we establish an analogue of de Branges' Ordering Theorem. We then construct examples which show that the result fails for general Fock-type spaces of larger growth.


title: Tabletop Roleplaying Games as Procedural Content Generators

abstract: Tabletop roleplaying games (TTRPGs) and procedural content generators can both be understood as systems of rules for producing content. In this paper, we argue that TTRPG design can usefully be viewed as procedural content generator design. We present several case studies linking key concepts from PCG research -- including possibility spaces, expressive range analysis, and generative pipelines -- to key concepts in TTRPG design. We then discuss the implications of these relationships and suggest directions for future work uniting research in TTRPGs and PCG.


title: Asymptotics of greedy energy sequences on the unit circle and the sphere

abstract: For a parameter $\lambda>0$, we investigate greedy $\lambda$-energy sequences $(a_{n})_{n=0}^{\infty}$ on the unit sphere $S^{d}\subset\mathbb{R}^{d+1}$, $d\geq 1$, satisfying the defining property that each $a_{n}$, $n\geq 1$, is a point where the potential $\sum_{k=0}^{n-1}|x-a_{k}|^{\lambda}$ attains its maximum value on $S^{d}$. We show that these sequences satisfy the symmetry property $a_{2k+1}=-a_{2k}$ for every $k\geq 0$. The asymptotic distribution of the sequence undergoes a sharp transition at the value $\lambda=2$, from uniform distribution ($\lambda<2$) to concentration on two antipodal points ($\lambda>2$). We investigate first-order and second-order asymptotics of the $\lambda$-energy of the first $N$ points of the sequence, as well as the asymptotic behavior of the extremal values $\sum_{k=0}^{n-1}|a_{n}-a_{k}|^{\lambda}$. The second-order asymptotics is analyzed on the unit circle. It is shown that this asymptotic behavior differs significantly from that of $N$ equally spaced points on the unit circle, and a transition in the behavior takes place at $\lambda=1$.


title: Unknown I.I.D. Prophets: Better Bounds, Streaming Algorithms, and a New Impossibility

abstract: A prophet inequality states, for some $\alpha\in[0,1]$, that the expected value achievable by a gambler who sequentially observes random variables $X_1,\dots,X_n$ and selects one of them is at least an $\alpha$ fraction of the maximum value in the sequence. We obtain three distinct improvements for a setting that was first studied by Correa et al. (EC, 2019) and is particularly relevant to modern applications in algorithmic pricing. In this setting, the random variables are i.i.d. from an unknown distribution and the gambler has access to an additional $\beta n$ samples for some $\beta\geq 0$. We first give improved lower bounds on $\alpha$ for a wide range of values of $\beta$; specifically, $\alpha\geq(1+\beta)/e$ when $\beta\leq 1/(e-1)$, which is tight, and $\alpha\geq 0.648$ when $\beta=1$, which improves on a bound of around $0.635$ due to Correa et al. (SODA, 2020). Adding to their practical appeal, specifically in the context of algorithmic pricing, we then show that the new bounds can be obtained even in a streaming model of computation and thus in situations where the use of relevant data is complicated by the sheer amount of data available. We finally establish that the upper bound of $1/e$ for the case without samples is robust to additional information about the distribution, and applies also to sequences of i.i.d. random variables whose distribution is itself drawn, according to a known distribution, from a finite set of known candidate distributions. This implies a tight prophet inequality for exchangeable sequences of random variables, answering a question of Hill and Kertz (Contemporary Mathematics, 1992), but leaves open the possibility of better guarantees when the number of candidate distributions is small, a setting we believe is of strong interest to applications.


title: On the quantum origin of inflation in the geometric inflation model

abstract: In this paper we investigate the cosmological dynamics of geometric inflation by means of the tools of the dynamical systems theory. We focus in the study of two explicit models where it is possible to sum the infinite series of higher curvature corrections that arises in the formalism. These would be very interesting possibilities since, if regard gravity as a quantum effective theory, a key feature is that higher powers of the curvature invariants are involved at higher loops. Hence, naively, consideration of the whole infinite tower of curvature invariants amounts to consideration of all of the higher order loops. The global dynamics of these toy models in the phase space is discussed and the quantum origin of primordial inflation is exposed.


title: Computing Floquet Hamiltonians with Symmetries

abstract: Unitary matrices arise in many ways in physics, in particular as a time evolution operator. For a periodically driven system one frequently wishes to compute a Floquet Hamilonian that should be a Hermitian operator $H$ such that $e^{-iTH}=U(T)$ where $U(T)$ is the time evolution operator at time corresponding the period of the system. That is, we want $H$ to be equal to $-i$ times a matrix logarithm of $U(T)$. If the system has a symmetry, such as time reversal symmetry, one can expect $H$ to have a symmetry beyond being Hermitian. We discuss here practical numerical algorithms on computing matrix logarithms that have certain symmetries which can be used to compute Floquet Hamiltonians that have appropriate symmetries. Along the way, we prove some results on how a symmetry in the Floquet operator $U(T)$ can lead to a symmetry in a basis of Floquet eigenstates.


title: Imaging moir\'e flat bands in 3D reconstructed WSe2/WS2 superlattices

abstract: Moir\'e superlattices in transition metal dichalcogenide (TMD) heterostructures can host novel correlated quantum phenomena due to the interplay of narrow moir\'e flat bands and strong, long-range Coulomb interactions1-5. However, microscopic knowledge of the atomically-reconstructed moir\'e superlattice and resulting flat bands is still lacking, which is critical for fundamental understanding and control of the correlated moir\'e phenomena. Here we quantitatively study the moir\'e flat bands in three-dimensional (3D) reconstructed WSe2/WS2 moir\'e superlattices by comparing scanning tunneling spectroscopy (STS) of high quality exfoliated TMD heterostructure devices with ab initio simulations of TMD moir\'e superlattices. A strong 3D buckling reconstruction accompanied by large in-plane strain redistribution is identified in our WSe2/WS2 moir\'e heterostructures. STS imaging demonstrates that this results in a remarkably narrow and highly localized K-point moir\'e flat band at the valence band edge of the heterostructure. A series of moir\'e flat bands are observed at different energies that exhibit varying degrees of localization. Our observations contradict previous simplified theoretical models but agree quantitatively with ab initio simulations that fully capture the 3D structural reconstruction. Here the strain redistribution and 3D buckling dominate the effective moir\'e potential and result in moir\'e flat bands at the Brillouin zone K points.


title: Simultaneous Feature Selection and Outlier Detection with Optimality Guarantees

abstract: Sparse estimation methods capable of tolerating outliers have been broadly investigated in the last decade. We contribute to this research considering high-dimensional regression problems contaminated by multiple mean-shift outliers which affect both the response and the design matrix. We develop a general framework for this class of problems and propose the use of mixed-integer programming to simultaneously perform feature selection and outlier detection with provably optimal guarantees. We characterize the theoretical properties of our approach, i.e. a necessary and sufficient condition for the robustly strong oracle property, which allows the number of features to exponentially increase with the sample size; the optimal estimation of the parameters; and the breakdown point of the resulting estimates. Moreover, we provide computationally efficient procedures to tune integer constraints and to warm-start the algorithm. We show the superior performance of our proposal compared to existing heuristic methods through numerical simulations and an application investigating the relationships between the human microbiome and childhood obesity.


title: Hofstadter subband ferromagnetism and symmetry broken Chern insulators in twisted bilayer graphene

abstract: In bilayer graphene rotationally faulted to theta=1.1 degrees, interlayer tunneling and rotational misalignment conspire to create a pair of low energy flat band that have been found to host various correlated phenomena at partial filling. Most work to date has focused on the zero magnetic field phase diagram, with magnetic field (B) used as a probe of the B=0 band structure. Here, we show that twisted bilayer graphene (tBLG) in a B as low as 2T hosts a cascade of ferromagnetic Chern insulators with Chern number |C|=1,2 and 3. We argue that the emergence of the Chern insulators is driven by the interplay of the moire superlattice with the B, which endow the flat bands with a substructure of topologically nontrivial subbands characteristic of the Hofstadter butterfly. The new phases can be accounted for in a Stoner picture in which exchange interactions favor polarization into one or more spin- and valley-isospin flavors; in contrast to conventional quantum Hall ferromagnets, however, electrons polarize into between one and four copies of a single Hofstadter subband with Chern number C=-1. In the case of the C=\pm3 insulators in particular, B catalyzes a first order phase transition from the spin- and valley-unpolarized B=0 state into the ferromagnetic state. Distinct from other moire heterostructures, tBLG realizes the strong-lattice limit of the Hofstadter problem and hosts Coulomb interactions that are comparable to the full bandwidth W and are consequently much stronger than the width of the individual Hofstadter subbands. In our experimental data, the dominance of Coulomb interactions manifests through the appearance of Chern insulating states with spontaneously broken superlattice symmetry at half filling of a C=-2 subband. Our experiments show that that tBLG may be an ideal venue to explore the strong interaction limit within partially filled Hofstadter bands.


title: Identifying Meaningful Indirect Indicators of Migration for Different Conflicts

abstract: This extended abstract describes an ongoing project that attempts to blend publicly available organic, real time behavioral data, event data, and traditional migration data to determine when and where people will move during times of instability. We present a methodology that was successful for a case study predicting mass movement in Iraq from 2015 - 2017, and discuss how we are extending it to capture indirect indicators of movement in Venezuela.


title: Optimal Experimental Design for Uncertain Systems Based on Coupled Differential Equations

abstract: We consider the optimal experimental design problem for an uncertain Kuramoto model, which consists of N interacting oscillators described by coupled ordinary differential equations. The objective is to design experiments that can effectively reduce the uncertainty present in the coupling strengths between the oscillators, thereby minimizing the cost of robust control of the uncertain Kuramoto model. We demonstrate the importance of quantifying the operational impact of the potential experiments in designing optimal experiments.


title: An Alternating Rank-K Nonnegative Least Squares Framework (ARkNLS) for Nonnegative Matrix Factorization

abstract: Nonnegative matrix factorization (NMF) is a prominent technique for data dimensionality reduction that has been widely used for text mining, computer vision, pattern discovery, and bioinformatics. In this paper, a framework called ARkNLS (Alternating Rank-k Nonnegativity constrained Least Squares) is proposed for computing NMF. First, a recursive formula for the solution of the rank-k nonnegativity-constrained least squares (NLS) is established. This recursive formula can be used to derive the closed-form solution for the Rank-k NLS problem for any integer k $\ge$ 1. As a result, each subproblem for an alternating rank-k nonnegative least squares framework can be obtained based on this closed form solution. Assuming that all matrices involved in rank-k NLS in the context of NMF computation are of full rank, two of the currently best NMF algorithms HALS (hierarchical alternating least squares) and ANLS-BPP (Alternating NLS based on Block Principal Pivoting) can be considered as special cases of ARkNLS with k = 1 and k = r for rank r NMF, respectively. This paper is then focused on the framework with k = 3, which leads to a new algorithm for NMF via the closed-form solution of the rank-3 NLS problem. Furthermore, a new strategy that efficiently overcomes the potential singularity problem in rank-3 NLS within the context of NMF computation is also presented. Extensive numerical comparisons using real and synthetic data sets demonstrate that the proposed algorithm provides state-of-the-art performance in terms of computational accuracy and cpu time.


title: Asymptotic Privacy Loss due to Time Series Matching of Dependent Users

abstract: The Internet of Things (IoT) promises to improve user utility by tuning applications to user behavior, but revealing the characteristics of a user's behavior presents a significant privacy risk. Our previous work has established the challenging requirements for anonymization to protect users' privacy in a Bayesian setting in which we assume a powerful adversary who has perfect knowledge of the prior distribution for each user's behavior. However, even sophisticated adversaries do not often have such perfect knowledge; hence, in this paper, we turn our attention to an adversary who must learn user behavior from past data traces of limited length. We also assume there exists dependency between data traces of different users, and the data points of each user are drawn from a normal distribution. Results on the lengths of training sequences and data sequences that result in a loss of user privacy are presented.


title: Fisher Auto-Encoders

abstract: It has been conjectured that the Fisher divergence is more robust to model uncertainty than the conventional Kullback-Leibler (KL) divergence. This motivates the design of a new class of robust generative auto-encoders (AE) referred to as Fisher auto-encoders. Our approach is to design Fisher AEs by minimizing the Fisher divergence between the intractable joint distribution of observed data and latent variables, with that of the postulated/modeled joint distribution. In contrast to KL-based variational AEs (VAEs), the Fisher AE can exactly quantify the distance between the true and the model-based posterior distributions. Qualitative and quantitative results are provided on both MNIST and celebA datasets demonstrating the competitive performance of Fisher AEs in terms of robustness compared to other AEs such as VAEs and Wasserstein AEs.


title: Reply to Comment on "Chaotic-Integrable Transition in the Sachdev-Ye-Kitaev Model"

abstract: In a recent comment to the paper Chaotic Integrable transition in the SYK model, it was claimed that, in a certain region of parameters, the Lyapunov exponent of the N Majoranas Sachdev-Ye-Kitaev model with a quadratic perturbation, is always positive. This implies that the model is quantum chaotic. In this reply, we show that the employed perturbative formalism breaks down precisely in the range of parameters investigated in the comment due to a lack of separation of time scales. Moreover, based on recent analytical results, we show that for any large and fixed N, the model has indeed a chaotic-integrable transition that invalidate the results of the comment.


title: Industrial Experience of Finding Cryptographic Vulnerabilities in Large-scale Codebases

abstract: Enterprise environment often screens large-scale (millions of lines of code) codebases with static analysis tools to find bugs and vulnerabilities. Parfait is a static code analysis tool used in Oracle to find security vulnerabilities in industrial codebases. Recently, many studies show that there are complicated cryptographic vulnerabilities caused by misusing cryptographic APIs in Java. In this paper, we describe how we realize a precise and scalable detection of these complicated cryptographic vulnerabilities based on Parfait framework. The key challenge in the detection of cryptographic vulnerabilities is the high false alarm rate caused by pseudo-influences. Pseudo-influences happen if security-irrelevant constants are used in constructing security-critical values. Static analysis is usually unable to distinguish them from hard-coded constants that expose sensitive information. We tackle this problem by specializing the backward dataflow analysis used in Parfait with refinement insights, an idea from the tool CryptoGuard. We evaluate our analyzer on a comprehensive Java cryptographic vulnerability benchmark and eleven large real-world applications. The results show that the Parfait-based cryptographic vulnerability detector can find real-world cryptographic vulnerabilities in large-scale codebases with high true-positive rates and low runtime cost.


title: OtoWorld: Towards Learning to Separate by Learning to Move

abstract: We present OtoWorld, an interactive environment in which agents must learn to listen in order to solve navigational tasks. The purpose of OtoWorld is to facilitate reinforcement learning research in computer audition, where agents must learn to listen to the world around them to navigate. OtoWorld is built on three open source libraries: OpenAI Gym for environment and agent interaction, PyRoomAcoustics for ray-tracing and acoustics simulation, and nussl for training deep computer audition models. OtoWorld is the audio analogue of GridWorld, a simple navigation game. OtoWorld can be easily extended to more complex environments and games. To solve one episode of OtoWorld, an agent must move towards each sounding source in the auditory scene and "turn it off". The agent receives no other input than the current sound of the room. The sources are placed randomly within the room and can vary in number. The agent receives a reward for turning off a source. We present preliminary results on the ability of agents to win at OtoWorld. OtoWorld is open-source and available.


title: EAGLE: Large-scale Vehicle Detection Dataset in Real-World Scenarios using Aerial Imagery

abstract: Multi-class vehicle detection from airborne imagery with orientation estimation is an important task in the near and remote vision domains with applications in traffic monitoring and disaster management. In the last decade, we have witnessed significant progress in object detection in ground imagery, but it is still in its infancy in airborne imagery, mostly due to the scarcity of diverse and large-scale datasets. Despite being a useful tool for different applications, current airborne datasets only partially reflect the challenges of real-world scenarios. To address this issue, we introduce EAGLE (oriEnted vehicle detection using Aerial imaGery in real-worLd scEnarios), a large-scale dataset for multi-class vehicle detection with object orientation information in aerial imagery. It features high-resolution aerial images composed of different real-world situations with a wide variety of camera sensor, resolution, flight altitude, weather, illumination, haze, shadow, time, city, country, occlusion, and camera angle. The annotation was done by airborne imagery experts with small- and large-vehicle classes. EAGLE contains 215,986 instances annotated with oriented bounding boxes defined by four points and orientation, making it by far the largest dataset to date in this task. It also supports researches on the haze and shadow removal as well as super-resolution and in-painting applications. We define three tasks: detection by (1) horizontal bounding boxes, (2) rotated bounding boxes, and (3) oriented bounding boxes. We carried out several experiments to evaluate several state-of-the-art methods in object detection on our dataset to form a baseline. Experiments show that the EAGLE dataset accurately reflects real-world situations and correspondingly challenging applications.


title: Localized and delocalized states of a diamine cation: A critical test of wave function methods

abstract: The relative stability of a localized and delocalized electronic state in the same molecule, the N,N' -Dimethylpiperazine cation, is calculated at various levels of theory up to multireference configuration interaction (MRCI+Q). This system has received a great deal of attention because of recent experimental studies of corresponding Rydberg states of the molecule and the failure of most density functional approximations to produce a metastable localized state. A cut through the energy surface involving two dihedral angles is generated at the level of MRCI+Q as well as Hartree-Fock (HF), M\"oller-Plesset second order perturbation theory (MP2), coupled cluster theory with and without perturbative triple excitations (CCSD and CCSD(T)) and complete active space self-consistent field calculations with and without perturbative correction (CASSCF and NEVPT2). Remarkably, while CCSD produces a localized state, CCSD(T) does not, and similarly, large active-space CASSCF does while NEVPT2 does not. The inclusion of dynamic correlation in a perturbative way thus adversely affects the accuracy of the calculation, most notably for CCSD(T), the 'golden standard'. The MRCI+Q results are in close correspondence with the experimental results, as well as CAS(19,20) DMRG-CASSCF calculations. The results presented here establish a benchmark system for the study of electronic state localization.


title: Disentangled Variational Autoencoder based Multi-Label Classification with Covariance-Aware Multivariate Probit Model

abstract: Multi-label classification is the challenging task of predicting the presence and absence of multiple targets, involving representation learning and label correlation modeling. We propose a novel framework for multi-label classification, Multivariate Probit Variational AutoEncoder (MPVAE), that effectively learns latent embedding spaces as well as label correlations. MPVAE learns and aligns two probabilistic embedding spaces for labels and features respectively. The decoder of MPVAE takes in the samples from the embedding spaces and models the joint distribution of output targets under a Multivariate Probit model by learning a shared covariance matrix. We show that MPVAE outperforms the existing state-of-the-art methods on a variety of application domains, using public real-world datasets. MPVAE is further shown to remain robust under noisy settings. Lastly, we demonstrate the interpretability of the learned covariance by a case study on a bird observation dataset.


title: DRWR: A Differentiable Renderer without Rendering for Unsupervised 3D Structure Learning from Silhouette Images

abstract: Differentiable renderers have been used successfully for unsupervised 3D structure learning from 2D images because they can bridge the gap between 3D and 2D. To optimize 3D shape parameters, current renderers rely on pixel-wise losses between rendered images of 3D reconstructions and ground truth images from corresponding viewpoints. Hence they require interpolation of the recovered 3D structure at each pixel, visibility handling, and optionally evaluating a shading model. In contrast, here we propose a Differentiable Renderer Without Rendering (DRWR) that omits these steps. DRWR only relies on a simple but effective loss that evaluates how well the projections of reconstructed 3D point clouds cover the ground truth object silhouette. Specifically, DRWR employs a smooth silhouette loss to pull the projection of each individual 3D point inside the object silhouette, and a structure-aware repulsion loss to push each pair of projections that fall inside the silhouette far away from each other. Although we omit surface interpolation, visibility handling, and shading, our results demonstrate that DRWR achieves state-of-the-art accuracies under widely used benchmarks, outperforming previous methods both qualitatively and quantitatively. In addition, our training times are significantly lower due to the simplicity of DRWR.


title: A Johnson-Kist type representation for truncated vector lattices

abstract: We introduce the notion of (maximal) multi-truncations on a vector lattice as a generalization of the notion of truncations, an object of recent origin. We obtain a Johnson-Kist type representation of vector lattices with maximal multi-truncations as vector lattices of almost-finite extended-real continuous functions. The spectrum that allow such a representation is a particular set of prime ideals equipped with the hull-kernel topology. Various representations from the existing literature will appear as special cases of our general result.


title: The Dependent Dirichlet Process and Related Models

abstract: Standard regression approaches assume that some finite number of the response distribution characteristics, such as location and scale, change as a (parametric or nonparametric) function of predictors. However, it is not always appropriate to assume a location/scale representation, where the error distribution has unchanging shape over the predictor space. In fact, it often happens in applied research that the distribution of responses under study changes with predictors in ways that cannot be reasonably represented by a finite dimensional functional form. This can seriously affect the answers to the scientific questions of interest, and therefore more general approaches are indeed needed. This gives rise to the study of fully nonparametric regression models. We review some of the main Bayesian approaches that have been employed to define probability models where the complete response distribution may vary flexibly with predictors. We focus on developments based on modifications of the Dirichlet process, historically termed dependent Dirichlet processes, and some of the extensions that have been proposed to tackle this general problem using nonparametric approaches.


title: Mean-Field Linear-Quadratic Stochastic Differential Games in an Infinite Horizon

abstract: This paper is concerned with two-person mean-field linear-quadratic non-zero sum stochastic differential games in an infinite horizon. Both open-loop and closed-loop Nash equilibria are introduced. Existence of an open-loop Nash equilibrium is characterized by the solvability of a system of mean-field forward-backward stochastic differential equations in an infinite horizon and the convexity of the cost functionals, and the closed-loop representation of an open-loop Nash equilibrium is given through the solution to a system of two coupled non-symmetric algebraic Riccati equations. The existence of a closed-loop Nash equilibrium is characterized by the solvability of a system of two coupled symmetric algebraic Riccati equations. Two-person mean-field linear-quadratic zero-sum stochastic differential games in an infinite time horizon are also considered. Both the existence of open-loop and closed-loop saddle points are characterized by the solvability of a system of two coupled generalized algebraic Riccati equations with static stabilizing solutions. Mean-field linear-quadratic stochastic optimal control problems in an infinite horizon are discussed as well, for which it is proved that the open-loop solvability and closed-loop solvability are equivalent.


title: Locality Guided Neural Networks for Explainable Artificial Intelligence

abstract: In current deep network architectures, deeper layers in networks tend to contain hundreds of independent neurons which makes it hard for humans to understand how they interact with each other. By organizing the neurons by correlation, humans can observe how clusters of neighbouring neurons interact with each other. In this paper, we propose a novel algorithm for back propagation, called Locality Guided Neural Network(LGNN) for training networks that preserves locality between neighbouring neurons within each layer of a deep network. Heavily motivated by Self-Organizing Map (SOM), the goal is to enforce a local topology on each layer of a deep network such that neighbouring neurons are highly correlated with each other. This method contributes to the domain of Explainable Artificial Intelligence (XAI), which aims to alleviate the black-box nature of current AI methods and make them understandable by humans. Our method aims to achieve XAI in deep learning without changing the structure of current models nor requiring any post processing. This paper focuses on Convolutional Neural Networks (CNNs), but can theoretically be applied to any type of deep learning architecture. In our experiments, we train various VGG and Wide ResNet (WRN) networks for image classification on CIFAR100. In depth analyses presenting both qualitative and quantitative results demonstrate that our method is capable of enforcing a topology on each layer while achieving a small increase in classification accuracy


title: Unconditionally positivity preserving and energy dissipative schemes for Poisson--Nernst--Planck equations

abstract: We develop a set of numerical schemes for the Poisson--Nernst--Planck equations. We prove that our schemes are mass conservative, uniquely solvable and keep positivity unconditionally. Furthermore, the first-order scheme is proven to be unconditionally energy dissipative. These properties hold for various spatial discretizations. Numerical results are presented to validate these properties. Moreover, numerical results indicate that the second-order scheme is also energy dissipative, and both the first- and second-order schemes preserve the maximum principle for cases where the equation satisfies the maximum principle.


title: Explainable Recommendation via Interpretable Feature Mapping and Evaluation of Explainability

abstract: Latent factor collaborative filtering (CF) has been a widely used technique for recommender system by learning the semantic representations of users and items. Recently, explainable recommendation has attracted much attention from research community. However, trade-off exists between explainability and performance of the recommendation where metadata is often needed to alleviate the dilemma. We present a novel feature mapping approach that maps the uninterpretable general features onto the interpretable aspect features, achieving both satisfactory accuracy and explainability in the recommendations by simultaneous minimization of rating prediction loss and interpretation loss. To evaluate the explainability, we propose two new evaluation metrics specifically designed for aspect-level explanation using surrogate ground truth. Experimental results demonstrate a strong performance in both recommendation and explaining explanation, eliminating the need for metadata. Code is available from https://github.com/pd90506/AMCF.


title: Adaptive Periodic Averaging: A Practical Approach to Reducing Communication in Distributed Learning

abstract: Stochastic Gradient Descent (SGD) is the key learning algorithm for many machine learning tasks. Because of its computational costs, there is a growing interest in accelerating SGD on HPC resources like GPU clusters. However, the performance of parallel SGD is still bottlenecked by the high communication costs even with a fast connection among the machines. A simple approach to alleviating this problem, used in many existing efforts, is to perform communication every few iterations, using a constant averaging period. In this paper, we show that the optimal averaging period in terms of convergence and communication cost is not a constant, but instead varies over the course of the execution. Specifically, we observe that reducing the variance of model parameters among the computing nodes is critical to the convergence of periodic parameter averaging SGD. Given a fixed communication budget, we show that it is more beneficial to synchronize more frequently in early iterations to reduce the initial large variance and synchronize less frequently in the later phase of the training process. We propose a practical algorithm, named ADaptive Periodic parameter averaging SGD (ADPSGD), to achieve a smaller overall variance of model parameters, and thus better convergence compared with the Constant Periodic parameter averaging SGD (CPSGD). We evaluate our method with several image classification benchmarks and show that our ADPSGD indeed achieves smaller training losses and higher test accuracies with smaller communication compared with CPSGD. Compared with gradient-quantization SGD, we show that our algorithm achieves faster convergence with only half of the communication. Compared with full-communication SGD, our ADPSGD achieves 1:14x to 1:27x speedups with a 100Gbps connection among computing nodes, and the speedups increase to 1:46x ~ 1:95x with a 10Gbps connection.


title: Solving the max-3-cut problem using synchronized dissipative networks

abstract: Many computational problems are intractable through classical computing and, as Moore's law is drawing to a halt, demand for finding alternative methods in tackling these problems is growing. Here, we realize a liquid light machine for the NP-hard max-3-cut problem based on a network of synchronized exciton-polariton condensates. We overcome the binary limitation of the decision variables in Ising machines using the continuous-phase degrees of freedom of a coherent network of polariton condensates. The condensate network dynamical transients provide optically-fast annealing of the XY Hamiltonian. We apply the Goemans and Williamson random hyperplane technique, discretizing the XY ground state spin configuration to serve as ternary decision variables for an approximate optimal solution to the max-3-cut problem. Applications of the presented coherent network are investigated in image-segmentation tasks and in circuit design.


title: Bayesian Bi-clustering Methods with Applications in Computational Biology

abstract: Bi-clustering is a useful approach in analyzing biological data when observations come from heterogeneous groups and have a large number of features. We outline a general Bayesian approach in tackling bi-clustering problems in moderate to high dimensions, and propose three Bayesian bi-clustering models on categorical data, which increase in complexities in their modeling of the distributions of features across bi-clusters. Our proposed methods apply to a wide range of scenarios: from situations where data are cluster-distinguishable only among a small subset of features but masked by a large amount of noise, to situations where different groups of data are identified by different sets of features or data exhibit hierarchical structures. Through simulation studies, we show that our methods outperform existing (bi-)clustering methods in both identifying clusters and recovering feature distributional patterns across bi-clusters. We apply our methods to two genetic datasets, though the area of application of our methods is even broader.


title: First-principles study of the stability of bimetallic PdPt nanoparticles under a finite temperature

abstract: To understand the vibrational and configurational entropy effects for the stability of core-shell and solid-solution bimetallic nanoparticles, we theoretically investigated the excess energy of PdPt nanoparticles, adopting the (PdPt)201 model of ca. 2 nm by using the density functional method. The vibrational energy and entropy terms contributed to the total energy of both core-shell and solid-solution nanoparticles. The configurational entropy term was defined only for the solid-solution nanoparticles. Although the absolute values of vibrational energy and entropy terms were much larger than that of configurational entropy term, their contributions were limited in the form of excess free energy due to the small difference between different atomic configurations. The large contribution of configurational entropy term to the excess free energy was clearly confirmed from our first-principles calculations. To estimate the stability of core-shell and solid-solution metal nanoparticles based on the excess energy, the configurational entropy term was the dominant factor.


title: Complete Logarithmic Sobolev inequalities via Ricci curvature bounded below

abstract: We prove that for a symmetric Markov semigroup, Ricci curvature bounded from below by a non-positive constant combined with a finite $L_\infty$-mixing time implies the modified log-Sobolev inequality. Such $L_\infty$-mixing time estimates always hold for Markov semigroups that have spectral gap and finite Varopoulos dimension. Our results apply to non-ergodic quantum Markov semigroups with noncommutative Ricci curvature bounds recently introduced by Carlen and Maas. As an application, we prove that the heat semigroup on a compact Riemannian manifold admits a uniform modified log-Sobolev inequality for all its matrix-valued extensions.


title: Spin polarized STM imaging of nanoscale N\'eel skyrmions in an SrIrO3/SrRuO3 Perovskite Bilayer

abstract: Spin-polarized scanning tunneling microscopy (SPSTM) was used to directly image nanoscale N\'eel skyrmions in a SrIrO3 / SrRuO3 bilayer system that are among the smallest reported to date in any system. Off-axis magnetron sputtering was used to cap epitaxial films of the oxide ferromagnet SRO with 2 unit cells of SrIrO3, intended to provide interfacial spin orbit coupling. Atomic resolution STM imaging and tunneling spectroscopy were used to identify island-like SrIrO3 grains and small regions of bare SrRuO3. Isolated skyrmions were only observed in SrIrO3-covered regions of the film, and exhibited a distribution of sizes and shapes with an average diameter of 3 nm. We found that skyrmions must be fully contained within, but may be smaller than, any given SrIrO3 region. Additionally, skyrmions were observed on SrIrO3 islands of varying thickness without loss of SPSTM contrast, suggesting the magnetic texture lies within the SrIrO3 island rather than the underlying ferromagnetic SrRuO3. Density functional theory calculations suggest this could be due to a small induced magnetic moment associated with IrO layers in the SrIrO3 film.


title: Projected Latent Markov Chain Monte Carlo: Conditional Sampling of Normalizing Flows

abstract: We introduce Projected Latent Markov Chain Monte Carlo (PL-MCMC), a technique for sampling from the high-dimensional conditional distributions learned by a normalizing flow. We prove that a Metropolis-Hastings implementation of PL-MCMC asymptotically samples from the exact conditional distributions associated with a normalizing flow. As a conditional sampling method, PL-MCMC enables Monte Carlo Expectation Maximization (MC-EM) training of normalizing flows from incomplete data. Through experimental tests applying normalizing flows to missing data tasks for a variety of data sets, we demonstrate the efficacy of PL-MCMC for conditional sampling from normalizing flows.


title: Gender Classification and Bias Mitigation in Facial Images

abstract: Gender classification algorithms have important applications in many domains today such as demographic research, law enforcement, as well as human-computer interaction. Recent research showed that algorithms trained on biased benchmark databases could result in algorithmic bias. However, to date, little research has been carried out on gender classification algorithms' bias towards gender minorities subgroups, such as the LGBTQ and the non-binary population, who have distinct characteristics in gender expression. In this paper, we began by conducting surveys on existing benchmark databases for facial recognition and gender classification tasks. We discovered that the current benchmark databases lack representation of gender minority subgroups. We worked on extending the current binary gender classifier to include a non-binary gender class. We did that by assembling two new facial image databases: 1) a racially balanced inclusive database with a subset of LGBTQ population 2) an inclusive-gender database that consists of people with non-binary gender. We worked to increase classification accuracy and mitigate algorithmic biases on our baseline model trained on the augmented benchmark database. Our ensemble model has achieved an overall accuracy score of 90.39%, which is a 38.72% increase from the baseline binary gender classifier trained on Adience. While this is an initial attempt towards mitigating bias in gender classification, more work is needed in modeling gender as a continuum by assembling more inclusive databases.


title: Interval posets for permutations

abstract: The interval poset of a permutation catalogues the intervals that appear in its one-line notation, according to set inclusion. We study this poset, describing its structural, characterizing, and enumerative properties.


title: Embedded Deep Bilinear Interactive Information and Selective Fusion for Multi-view Learning

abstract: As a concrete application of multi-view learning, multi-view classification improves the traditional classification methods significantly by integrating various views optimally. Although most of the previous efforts have been demonstrated the superiority of multi-view learning, it can be further improved by comprehensively embedding more powerful cross-view interactive information and a more reliable multi-view fusion strategy in intensive studies. To fulfill this goal, we propose a novel multi-view learning framework to make the multi-view classification better aimed at the above-mentioned two aspects. That is, we seamlessly embed various intra-view information, cross-view multi-dimension bilinear interactive information, and a new view ensemble mechanism into a unified framework to make a decision via the optimization. In particular, we train different deep neural networks to learn various intra-view representations, and then dynamically learn multi-dimension bilinear interactive information from different bilinear similarities via the bilinear function between views. After that, we adaptively fuse the representations of multiple views by flexibly tuning the parameters of the view-weight, which not only avoids the trivial solution of weight but also provides a new way to select a few discriminative views that are beneficial to make a decision for the multi-view classification. Extensive experiments on six publicly available datasets demonstrate the effectiveness of the proposed method.


title: Temporal Self-Ensembling Teacher for Semi-Supervised Object Detection

abstract: This paper focuses on Semi-Supervised Object Detection (SSOD). Knowledge Distillation (KD) has been widely used for semi-supervised image classification. However, adapting these methods for SSOD has the following obstacles. (1) The teacher model serves a dual role as a teacher and a student, such that the teacher predictions on unlabeled images may be very close to those of student, which limits the upper-bound of the student. (2) The class imbalance issue in SSOD hinders an efficient knowledge transfer from teacher to student. To address these problems, we propose a novel method Temporal Self-Ensembling Teacher (TSE-T) for SSOD. Differently from previous KD based methods, we devise a temporally evolved teacher model. First, our teacher model ensembles its temporal predictions for unlabeled images under stochastic perturbations. Second, our teacher model ensembles its temporal model weights with the student model weights by an exponential moving average (EMA) which allows the teacher gradually learn from the student. These self-ensembling strategies increase data and model diversity, thus improving teacher predictions on unlabeled images. Finally, we use focal loss to formulate consistency regularization term to handle the data imbalance problem, which is a more efficient manner to utilize the useful information from unlabeled images than a simple hard-thresholding method which solely preserves confident predictions. Evaluated on the widely used VOC and COCO benchmarks, the mAP of our method has achieved 80.73% and 40.52% on the VOC2007 test set and the COCO2014 minval5k set respectively, which outperforms a strong fully-supervised detector by 2.37% and 1.49%. Furthermore, our method sets the new state-of-the-art in SSOD on VOC2007 test set which outperforms the baseline SSOD method by 1.44%. The source code of this work is publicly available at http://github.com/syangdong/tse-t.


title: Optical response of a topological-insulator--quantum-dot hybrid interacting with a probe electric field

abstract: We study the interaction between a topological insulator nanoparticle and a quantum dot subject to an applied electric field. The electromagnetic response of the topological insulator is derived from axion electrodynamics in the quasistatic approximation. Localized modes are quantized in terms of dipolar bosonic modes, which couples dipolarly to the quantum dot. Hence, we treat the hybrid as a two-level system interacting with a single bosonic mode, where the coupling strength encodes the information concerning the nontrivial topology of the nanoparticle. The interaction of the hybrid with the environment is implemented through the coupling with a continuum reservoir of radiative output modes and a reservoir of phonon modes. In particular, we use the method of Zubarev's Green functions to derive an expression for the optical absorption spectrum of the system. We apply our results to a realistic system which consists of a topological insulator nanoparticle made of TlBiSe$_{2}$ interacting with a cadmium selenide quantum dot, both immersed in a polymer layer such as poly(methyl methacrylate). The optical absorption spectrum exhibits Fano resonances with a line shape that strongly depends on the polarization of the electric field as well as on the topological magnetoelectric polarizability $\theta$. Our results and methods can also be applied to nontopological magnetoelectric materials such as Cr$_{2}$O$_{3}$.


title: Fine-Grained Crowd Counting

abstract: Current crowd counting algorithms are only concerned about the number of people in an image, which lacks low-level fine-grained information of the crowd. For many practical applications, the total number of people in an image is not as useful as the number of people in each sub-category. E.g., knowing the number of people waiting inline or browsing can help retail stores; knowing the number of people standing/sitting can help restaurants/cafeterias; knowing the number of violent/non-violent people can help police in crowd management. In this paper, we propose fine-grained crowd counting, which differentiates a crowd into categories based on the low-level behavior attributes of the individuals (e.g. standing/sitting or violent behavior) and then counts the number of people in each category. To enable research in this area, we construct a new dataset of four real-world fine-grained counting tasks: traveling direction on a sidewalk, standing or sitting, waiting in line or not, and exhibiting violent behavior or not. Since the appearance features of different crowd categories are similar, the challenge of fine-grained crowd counting is to effectively utilize contextual information to distinguish between categories. We propose a two branch architecture, consisting of a density map estimation branch and a semantic segmentation branch. We propose two refinement strategies for improving the predictions of the two branches. First, to encode contextual information, we propose feature propagation guided by the density map prediction, which eliminates the effect of background features during propagation. Second, we propose a complementary attention model to share information between the two branches. Experiment results confirm the effectiveness of our method.


title: Reconstructing unknown inclusions for the biharmonic equation

abstract: Herein, we study an inverse problem for detecting unknown obstacles by the enclosure method using the Dirichlet--to--Neumann map for measurements. We justify the method for an penetrable obstacle case involving a biharmonic equation. We use complex geometrical optics solutions with a logarithmic phase to reconstruct some non--convex parts of the obstacle.