title: Prognostic Value of Transfer Learning Based Features in Resectable Pancreatic Ductal Adenocarcinoma

abstract: Pancreatic Ductal Adenocarcinoma (PDAC) is one of the most aggressive cancers with an extremely poor prognosis. Radiomics has shown prognostic ability in multiple types of cancer including PDAC. However, the prognostic value of traditional radiomics pipelines, which are based on hand-crafted radiomic features alone is limited. Convolutional neural networks (CNNs) have been shown to outperform these feature-based models in computer vision tasks. However, training a CNN from scratch needs a large sample size which is not feasible in most medical imaging studies. As an alternative solution, CNN-based transfer learning has shown potential for achieving reasonable performance using small datasets. In this work, we developed and validated a CNN-based transfer learning approach for prognostication of PDAC patients for overall survival using two independent resectable PDAC cohorts. The proposed deep transfer learning model for prognostication of PDAC achieved the area under the receiver operating characteristic curve of 0.74, which was significantly higher than that of the traditional radiomics model (0.56) as well as a CNN model trained from scratch (0.50). These results suggest that deep transfer learning may significantly improve prognosis performance using small datasets in medical imaging.


title: forgeNet: A graph deep neural network model using tree-based ensemble classifiers for feature extraction

abstract: A unique challenge in predictive model building for omics data has been the small number of samples $(n)$ versus the large amount of features $(p)$. This "$n\ll p$" property brings difficulties for disease outcome classification using deep learning techniques. Sparse learning by incorporating external gene network information such as the graph-embedded deep feedforward network (GEDFN) model has been a solution to this issue. However, such methods require an existing feature graph, and potential mis-specification of the feature graph can be harmful on classification and feature selection. To address this limitation and develop a robust classification model without relying on external knowledge, we propose a \underline{for}est \underline{g}raph-\underline{e}mbedded deep feedforward \underline{net}work (forgeNet) model, to integrate the GEDFN architecture with a forest feature graph extractor, so that the feature graph can be learned in a supervised manner and specifically constructed for a given prediction task. To validate the method's capability, we experimented the forgeNet model with both synthetic and real datasets. The resulting high classification accuracy suggests that the method is a valuable addition to sparse deep learning models for omics data.


title: Topological string entanglement

abstract: We investigate how topological entanglement of Chern-Simons theory is captured in a string theoretic realization. Our explorations are motivated by a desire to understand how quantum entanglement of low energy open string degrees of freedom is encoded in string theory (beyond the oft discussed classical gravity limit). Concretely, we realize the Chern-Simons theory as the worldvolume dynamics of topological D-branes in the topological A-model string theory on a Calabi-Yau target. Via the open/closed topological string duality one can map this theory onto a pure closed topological A-model string on a different target space, one which is related to the original Calabi-Yau geometry by a geometric/conifold transition. We demonstrate how to uplift the replica construction of Chern-Simons theory directly onto the closed string and show that it provides a meaningful definition of reduced density matrices in topological string theory. Furthermore, we argue that the replica construction commutes with the geometric transition, thereby providing an explicit closed string dual for computing reduced states, and Renyi and von Neumann entropies thereof. While most of our analysis is carried out for Chern-Simons on S^3, the emergent picture is rather general. Specifically, we argue that quantum entanglement on the open string side is mapped onto quantum entanglement on the closed string side and briefly comment on the implications of our result for physical holographic theories where entanglement has been argued to be crucial ingredient for the emergence of classical geometry.


title: Adding Intuitive Physics to Neural-Symbolic Capsules Using Interaction Networks

abstract: Many current methods to learn intuitive physics are based on interaction networks and similar approaches. However, they rely on information that has proven difficult to estimate directly from image data in the past. We aim to narrow this gap by inferring all the semantic information needed from raw pixel data in the form of a scene-graph. Our approach is based on neural-symbolic capsules, which identify which objects in the scene are static, dynamic, elastic or rigid, possible joints between them, as well as their collision information. By integrating all this with interaction networks, we demonstrate how our method is able to learn intuitive physics directly from image sequences and apply its knowledge to new scenes and objects, resulting in an inverse-simulation pipeline.


title: A Bulirsch-Stoer algorithm using Gaussian processes

abstract: In this paper, we treat the problem of evaluating the asymptotic error in a numerical integration scheme as one with inherent uncertainty. Adding to the growing field of probabilistic numerics, we show that Gaussian process regression (GPR) can be embedded into a numerical integration scheme to allow for (i) robust selection of the adaptive step-size parameter and; (ii) uncertainty quantification in predictions of putatively converged numerical solutions. We present two examples of our approach using Richardson's extrapolation technique and the Bulirsch-Stoer algorithm. In scenarios where the error-surface is smooth and bounded, our proposed approach can match the results of the traditional polynomial (parametric) extrapolation methods. In scenarios where the error surface is not well approximated by a finite-order polynomial, e.g. in the vicinity of a pole or in the assessment of a chaotic system, traditional methods can fail, however, the non-parametric GPR approach demonstrates the potential to continue to furnish reasonable solutions in these situations.


title: Dipolar and Quadrupolar Excitons Coupled to a Nanoparticle-on-a-Mirror Cavity

abstract: We investigate plasmon-emitter interactions in a nanoparticle-on-a-mirror cavity. We consider two different sorts of emitters, those that sustain dipolar transitions, and those hosting only quadrupolar, dipole-inactive, excitons. By means of a fully analytical two-dimensional transformation optics approach, we calculate the light-matter coupling strengths for the full plasmonic spectrum supported by the nanocavity. We reveal the impact of finite-size effects in the exciton charge distribution and describe the population dynamics in a spontaneous emission configuration. Pushing our model beyond the quasi-static approximation, we extract the plasmonic dipole moments, which enables us to calculate the far-field scattering spectrum of the hybrid plasmon-emitter system. Our findings, tested against fully numerical simulations, reveal the similarities and differences between the strong coupling phenomenology for bright and dark excitons in nanocavities.


title: PHom-GeM: Persistent Homology for Generative Models

abstract: Generative neural network models, including Generative Adversarial Network (GAN) and Auto-Encoders (AE), are among the most popular neural network models to generate adversarial data. The GAN model is composed of a generator that produces synthetic data and of a discriminator that discriminates between the generator's output and the true data. AE consist of an encoder which maps the model distribution to a latent manifold and of a decoder which maps the latent manifold to a reconstructed distribution. However, generative models are known to provoke chaotically scattered reconstructed distribution during their training, and consequently, incomplete generated adversarial distributions. Current distance measures fail to address this problem because they are not able to acknowledge the shape of the data manifold, i.e. its topological features, and the scale at which the manifold should be analyzed. We propose Persistent Homology for Generative Models, PHom-GeM, a new methodology to assess and measure the distribution of a generative model. PHom-GeM minimizes an objective function between the true and the reconstructed distributions and uses persistent homology, the study of the topological features of a space at different spatial resolutions, to compare the nature of the true and the generated distributions. Our experiments underline the potential of persistent homology for Wasserstein GAN in comparison to Wasserstein AE and Variational AE. The experiments are conducted on a real-world data set particularly challenging for traditional distance measures and generative neural network models. PHom-GeM is the first methodology to propose a topological distance measure, the bottleneck distance, for generative models used to compare adversarial samples in the context of credit card transactions.


title: The outer spectral radius and dynamics of completely positive maps

abstract: We examine a special case of an approximation of the joint spectral radius given by Blondel and Nesterov, which we call the outer spectral radius. The outer spectral radius is given by the square root of the ordinary spectral radius of the $n^2$ by $n^2$ matrix $\sum{\overline{X_i}}\otimes{X_i}.$ We give an analogue of the spectral radius formula for the outer spectral radius which can be used to quickly obtain the error bounds in methods based on the work of Blondel and Nesterov. The outer spectral radius is used to analyze the iterates of a completely postive map, including the special case of quantum channels. The average of the iterates of a completely positive map approach to a completely positive map where the Kraus operators span an ideal in the algebra generated by the Kraus operators of the original completely positive map. We also give an elementary treatment of Popescu's theorems on similarity to row contractions in the matrix case, describe connections to the Parrilo-Jadbabaie relaxation, and give a detailed analysis of the maximal spectrum of a completely positive map.


title: Triple differntial cross section for electron impact ionization of hydrogen atom

abstract: The electron impact ionization of atomic hydrogen is calculated for incident elrctron energy 76.46 eV. The Hartree-Fock approximation is used to calculate the initial state which includes both bound and continum wave functions. The final state continuum electron wave functions are obtained in the potential of hydrogen ion. The interaction between the two final state continuum electrons is approximated with the screening potential determined variationally.


title: Robust guarantees for learning an autoregressive filter

abstract: The optimal predictor for a linear dynamical system (with hidden state and Gaussian noise) takes the form of an autoregressive linear filter, namely the Kalman filter. However, a fundamental problem in reinforcement learning and control theory is to make optimal predictions in an unknown dynamical system. To this end, we take the approach of directly learning an autoregressive filter for time-series prediction under unknown dynamics. Our analysis differs from previous statistical analyses in that we regress not only on the inputs to the dynamical system, but also the outputs, which is essential to dealing with process noise. The main challenge is to estimate the filter under worst case input (in $\mathcal H_\infty$ norm), for which we use an $L^\infty$-based objective rather than ordinary least-squares. For learning an autoregressive model, our algorithm has optimal sample complexity in terms of the rollout length, which does not seem to be attained by naive least-squares.


title: Feedback graph regret bounds for Thompson Sampling and UCB

abstract: We study the stochastic multi-armed bandit problem with the graph-based feedback structure introduced by Mannor and Shamir. We analyze the performance of the two most prominent stochastic bandit algorithms, Thompson Sampling and Upper Confidence Bound (UCB), in the graph-based feedback setting. We show that these algorithms achieve regret guarantees that combine the graph structure and the gaps between the means of the arm distributions. Surprisingly this holds despite the fact that these algorithms do not explicitly use the graph structure to select arms; they observe the additional feedback but do not explore based on it. Towards this result we introduce a "layering technique" highlighting the commonalities in the two algorithms.


title: Blockwise Adaptivity: Faster Training and Better Generalization in Deep Learning

abstract: Stochastic methods with coordinate-wise adaptive stepsize (such as RMSprop and Adam) have been widely used in training deep neural networks. Despite their fast convergence, they can generalize worse than stochastic gradient descent. In this paper, by revisiting the design of Adagrad, we propose to split the network parameters into blocks, and use a blockwise adaptive stepsize. Intuitively, blockwise adaptivity is less aggressive than adaptivity to individual coordinates, and can have a better balance between adaptivity and generalization. We show theoretically that the proposed blockwise adaptive gradient descent has comparable convergence rate as its counterpart with coordinate-wise adaptive stepsize, but is faster up to some constant. We also study its uniform stability and show that blockwise adaptivity can lead to lower generalization error than coordinate-wise adaptivity. Experimental results show that blockwise adaptive gradient descent converges faster and improves generalization performance over Nesterov's accelerated gradient and Adam.


title: A Mathematical Model for Simulating Meteor Showers

abstract: This paper presents a mathematical model to simulate the trajectory of a meteor as seen by a single observer located anywhere on Earth. Our strategy is to define a new coordinate system, called Radiant Coordinate System, which is centered on the observer and has its z-axis aligned with the radiant. This new coordinate system allows us to describe the meteors' path by applying a reduced number of equations in a simple solution. We also present a computational implementation of this model, which is developed as a new plug-in of Stellarium, a free and open-source planetarium software. Moreover, we show that our model can be used to simulate both meteor showers and sporadic meteors. In particular, meteor showers are simulated using data provided by real catalogs.


title: Electromigration Response of Microjoints in 3DIC Packaging Systems

abstract: In multilevel 3D integrated packaging, three major microstructures are viable due to the application of low volume of solders in different sizes, and/or processing conditions. Thermodynamics and kinetics of binary compounds in Cu/Sn/Cu low volume interconnection is taken into account. We show that current crowding effects can induce a driving force to cause excess vacancies saturate and ultimately cluster in the form of microvoids. A kinetic analysis is performed for electromigration mediated intermetallic growth using multi-phase-field approach. Faster growth of intermetallic compounds (IMCs) in anode layer in the expense of shrinkage of cathode IMC layer in shown. This work paves the road for computationally study the ductile failure due to formation of microvoids in low volume solder interconnects in 3DICs.


title: Generative training of quantum Boltzmann machines with hidden units

abstract: In this article we provide a method for fully quantum generative training of quantum Boltzmann machines with both visible and hidden units while using quantum relative entropy as an objective. This is significant because prior methods were not able to do so due to mathematical challenges posed by the gradient evaluation. We present two novel methods for solving this problem. The first proposal addresses it, for a class of restricted quantum Boltzmann machines with mutually commuting Hamiltonians on the hidden units, by using a variational upper bound on the quantum relative entropy. The second one uses high-order divided difference methods and linear-combinations of unitaries to approximate the exact gradient of the relative entropy for a generic quantum Boltzmann machine. Both methods are efficient under the assumption that Gibbs state preparation is efficient and that the Hamiltonian are given by a sparse row-computable matrix.


title: Testing Graphs against an Unknown Distribution

abstract: The area of graph property testing seeks to understand the relation between the global properties of a graph and its local statistics. In the classical model, the local statistics of a graph is defined relative to a uniform distribution over the graph's vertex set. A graph property $\mathcal{P}$ is said to be testable if the local statistics of a graph can allow one to distinguish between graphs satisfying $\mathcal{P}$ and those that are far from satisfying it. Goldreich recently introduced a generalization of this model in which one endows the vertex set of the input graph with an arbitrary and unknown distribution, and asked which of the properties that can be tested in the classical model can also be tested in this more general setting. We completely resolve this problem by giving a (surprisingly "clean") characterization of these properties. To this end, we prove a removal lemma for vertex weighted graphs which is of independent interest.


title: CDSA: Cross-Dimensional Self-Attention for Multivariate, Geo-tagged Time Series Imputation

abstract: Many real-world applications involve multivariate, geo-tagged time series data: at each location, multiple sensors record corresponding measurements. For example, air quality monitoring system records PM2.5, CO, etc. The resulting time-series data often has missing values due to device outages or communication errors. In order to impute the missing values, state-of-the-art methods are built on Recurrent Neural Networks (RNN), which process each time stamp sequentially, prohibiting the direct modeling of the relationship between distant time stamps. Recently, the self-attention mechanism has been proposed for sequence modeling tasks such as machine translation, significantly outperforming RNN because the relationship between each two time stamps can be modeled explicitly. In this paper, we are the first to adapt the self-attention mechanism for multivariate, geo-tagged time series data. In order to jointly capture the self-attention across multiple dimensions, including time, location and the sensor measurements, while maintain low computational complexity, we propose a novel approach called Cross-Dimensional Self-Attention (CDSA) to process each dimension sequentially, yet in an order-independent manner. Our extensive experiments on four real-world datasets, including three standard benchmarks and our newly collected NYC-traffic dataset, demonstrate that our approach outperforms the state-of-the-art imputation and forecasting methods. A detailed systematic analysis confirms the effectiveness of our design choices.


title: Neural ODEs with stochastic vector field mixtures

abstract: It was recently shown that neural ordinary differential equation models cannot solve fundamental and seemingly straightforward tasks even with high-capacity vector field representations. This paper introduces two other fundamental tasks to the set that baseline methods cannot solve, and proposes mixtures of stochastic vector fields as a model class that is capable of solving these essential problems. Dynamic vector field selection is of critical importance for our model, and our approach is to propagate component uncertainty over the integration interval with a technique based on forward filtering. We also formalise several loss functions that encourage desirable properties on the trajectory paths, and of particular interest are those that directly encourage fewer expected function evaluations. Experimentally, we demonstrate that our model class is capable of capturing the natural dynamics of human behaviour; a notoriously volatile application area. Baseline approaches cannot adequately model this problem.


title: Optimal Passenger-Seeking Policies on E-hailing Platforms Using Markov Decision Process and Imitation Learning

abstract: Vacant taxi drivers' passenger seeking process in a road network generates additional vehicle miles traveled, adding congestion and pollution into the road network and the environment. This paper aims to employ a Markov Decision Process (MDP) to model idle e-hailing drivers' optimal sequential decisions in passenger-seeking. Transportation network companies (TNC) or e-hailing (e.g., Didi, Uber) drivers exhibit different behaviors from traditional taxi drivers because e-hailing drivers do not need to actually search for passengers. Instead, they reposition themselves so that the matching platform can match a passenger. Accordingly, we incorporate e-hailing drivers' new features into our MDP model. The reward function used in the MDP model is uncovered by leveraging an inverse reinforcement learning technique. We then use 44,160 Didi drivers' 3-day trajectories to train the model. To validate the effectiveness of the model, a Monte Carlo simulation is conducted to simulate the performance of drivers under the guidance of the optimal policy, which is then compared with the performance of drivers following one baseline heuristic, namely, the local hotspot strategy. The results show that our model is able to achieve a 17.5% improvement over the local hotspot strategy in terms of the rate of return. The proposed MDP model captures the supply-demand ratio considering the fact that the number of drivers in this study is sufficiently large and thus the number of unmatched orders is assumed to be negligible. To better incorporate the competition among multiple drivers into the model, we have also devised and calibrated a dynamic adjustment strategy of the order matching probability.


title: Multi-level Texture Encoding and Representation (MuLTER) based on Deep Neural Networks

abstract: In this paper, we propose a multi-level texture encoding and representation network (MuLTER) for texture-related applications. Based on a multi-level pooling architecture, the MuLTER network simultaneously leverages low- and high-level features to maintain both texture details and spatial information. Such a pooling architecture involves few extra parameters and keeps feature dimensions fixed despite of the changes of image sizes. In comparison with state-of-the-art texture descriptors, the MuLTER network yields higher recognition accuracy on typical texture datasets such as MINC-2500 and GTOS-mobile with a discriminative and compact representation. In addition, we analyze the impact of combining features from different levels, which supports our claim that the fusion of multi-level features efficiently enhances recognition performance. Our source code will be published on GitHub (https://github.com/olivesgatech).


title: Three-Component Kinematics of Multiple Stellar Populations in Globular Clusters with Gaia and VLT

abstract: The internal dynamics of multiple stellar populations in Globular Clusters (GCs) provides unique constraints on the physical processes responsible for their formation. Specifically, the present-day kinematics of cluster stars, such as rotation and velocity-dispersion, could be related to the initial configuration of the system. In recent work, we provided the first study of the kinematics of different stellar populations in NGC$\,$0104 over a large field of view in the plane of the sky, exploiting Gaia Data Release 2 (DR2) proper motions combined with multi-band ground-based photometry. In this paper, we combine Gaia DR2 proper motions with Very Large Telescope radial velocities to investigate the kinematics along the line of sight and in the plane of the sky of multiple populations in seven GCs, namely NGC$\,$0104, NGC$\,$0288, NGC$\,$5904, NGC$\,$6121, NGC$\,$6254, NGC$\,$6752 and NGC$\,$6838. Among the analyzed clusters only NGC$\,$0104 and NGC$\,$5904 show significant rotation. Separating our sample into two groups of first- and second-population stars (1P and 2P) we find that overall these two populations exhibit a similar rotation pattern in NGC$\,$0104. However, some hints of different rotation are observed in the external regions of this cluster. Interestingly, 1P and 2P stars in NGC$\,$5904 show different rotation curves, with distinct phases and such difference is significant at the $\sim$2.5-$\sigma$ level. The analysis of the velocity-dispersion profiles of multiple populations confirms that 2P stars of NGC$\,$0104 show stronger anisotropy than the 1P.


title: On some generalized Fermat curves and chords of an affinely regular polygon inscribed in a hyperbola

abstract: Let $\mathcal{G}$ be the projective plane curve defined over $\mathbb{F}_q$ given by $$aX^nY^n-X^nZ^n-Y^nZ^n+bZ^{2n}=0,$$ where $ab\notin\{0,1\}$, and for each $s\in\{2,\ldots,n-1\}$, let $\mathcal{D}_s^{P_1,P_2}$ be the base-point-free linear series cut out on $\mathcal{G}$ by the linear system of all curves of degree $s$ passing through the singular points $P_1=(1:0:0)$ and $P_2=(0:1:0)$ of $\mathcal{G}$. The present work determines an upper bound for the number $N_q(\mathcal{G})$ of $\mathbb{F}_q$-rational points on the nonsingular model of $\mathcal{G}$ in cases where $\mathcal{D}_s^{P_1,P_2}$ is $\mathbb{F}_q$-Frobenius classical. As a consequence, when $\mathbb{F}_q$ is a prime field, the bound obtained for $N_q(\mathcal{G})$ improves in several cases the known bounds for the number $n_P$ of chords of an affinely regular polygon inscribed in a hyperbola passing through a given point $P$ distinct from its vertices.


title: Linear Statistics with Random Coefficients and Characterization of Hyperbolic Secant Distribution

abstract: There is given a characterization of hyperbolic secant distribution by the independence of linear forms with random coefficients. We provide a characterization by the identic distribution property. Keywords: hyperbolic secant distribution; characterization of distributions; linear forms; random coefficients.


title: On the existence of a solution of the Beltrami equation with degeneration

abstract: We have found one of the possible conditions under which the Beltrami equation with degeneration of ellipticity has a continuous solution of the Sobolev class. With some additional requirements, this solution is homeomorphic


title: Stochastic Yield Catastrophes and Robustness in Self-Assembly

abstract: A guiding principle in self-assembly is that, for high production yield, nucleation of structures must be significantly slower than their growth. However, details of the mechanism that impedes nucleation are broadly considered irrelevant. Here, we analyze self-assembly into finite-sized target structures employing mathematical modeling. We investigate two key scenarios to delay nucleation: (i) by introducing a slow activation step for the assembling constituents and, (ii) by decreasing the dimerization rate. These scenarios have widely different characteristics. While the dimerization scenario exhibits robust behavior, the activation scenario is highly sensitive to demographic fluctuations. These demographic fluctuations ultimately disfavor growth compared to nucleation and can suppress yield completely. The occurrence of this stochastic yield catastrophe does not depend on model details but is generic as soon as number fluctuations between constituents are taken into account. On a broader perspective, our results reveal that stochasticity is an important limiting factor for self-assembly and that the specific implementation of the nucleation process plays a significant role in determining the yield.


title: Reflections on the covariance of modified teleparallel theories of gravity

abstract: We review the current status of the Lorentz covariance in teleparallel and modified teleparallel theories of gravity, and discuss the controversial features of the different approaches. We also revisit the issue of the remnant Lorentz gauge symmetries in $f(T)$ gravity.


title: Semi-Quantitative Abstraction and Analysis of Chemical Reaction Networks

abstract: Analysis of large continuous-time stochastic systems is a computationally intensive task. In this work we focus on population models arising from chemical reaction networks (CRNs), which play a fundamental role in analysis and design of biochemical systems. Many relevant CRNs are particularly challenging for existing techniques due to complex dynamics including stochasticity, stiffness or multimodal population distributions. We propose a novel approach allowing not only to predict, but also to explain both the transient and steady-state behaviour. It focuses on qualitative description of the behaviour and aims at quantitative precision only in orders of magnitude. Firstly, we abstract the CRN into a compact model preserving rough timing information, distinguishing only signifcinatly different populations, but capturing relevant sequences of behaviour. Secondly, we approximately analyse the most probable temporal behaviours of the model through most probable transitions. As demonstrated on complex CRNs from literature, our approach reproduces the known results, but in contrast to the state-of-the-art methods, it runs with virtually no computational cost and thus offers unprecedented~scalability.


title: Escaping Locally Optimal Decentralized Control Polices via Damping

abstract: We study the evolution of locally optimal decentralized controllers with the damping of the control system. Empirically it is shown that even for instances with an exponential number of connected components, damping merges all local solutions to the one global solution. We characterize the evolution of locally optimal solutions with the notion of hemi-continuity and further derive asymptotic properties of the objective function and of the locally optimal controllers as the damping becomes large. Especially, we prove that with enough damping, there is no spurious locally optimal controller with favorable control structures. The convoluted behavior of the locally optimal trajectory is illustrated with numerical examples.


title: Generative Grading: Near Human-level Accuracy for Automated Feedback on Richly Structured Problems

abstract: Access to high-quality education at scale is limited by the difficulty of providing student feedback on open-ended assignments in structured domains like computer programming, graphics, and short response questions. This problem has proven to be exceptionally difficult: for humans, it requires large amounts of manual work, and for computers, until recently, achieving anything near human-level accuracy has been unattainable. In this paper, we present generative grading: a novel computational approach for providing feedback at scale that is capable of accurately grading student work and providing nuanced, interpretable feedback. Our approach uses generative descriptions of student cognition, written as probabilistic programs, to synthesise millions of labelled example solutions to a problem; we then learn to infer feedback for real student solutions based on this cognitive model. We apply our methods to three settings. In block-based coding, we achieve a 50% improvement upon the previous best results for feedback, achieving super-human accuracy. In two other widely different domains -- graphical tasks and short text answers -- we achieve major improvement over the previous state of the art by about 4x and 1.5x respectively, approaching human accuracy. In a real classroom, we ran an experiment where we used our system to augment human graders, yielding doubled grading accuracy while halving grading time.


title: Learning spectrograms with convolutional spectral kernels

abstract: We introduce the convolutional spectral kernel (CSK), a novel family of non-stationary, nonparametric covariance kernels for Gaussian process (GP) models, derived from the convolution between two imaginary radial basis functions. We present a principled framework to interpret CSK, as well as other deep probabilistic models, using approximated Fourier transform, yielding a concise representation of input-frequency spectrogram. Observing through the lens of the spectrogram, we provide insight on the interpretability of deep models. We then infer the functional hyperparameters using scalable variational and MCMC methods. On small- and medium-sized spatiotemporal datasets, we demonstrate improved generalization of GP models when equipped with CSK, and their capability to extract non-stationary periodic patterns.


title: The Lifetime Frontier: Search for New Physics with Long-Lived Particles

abstract: The search for new physics with long-lived particles is an ongoing and thriving effort in the High Energy Physics community which necessitates new search strategies such as novel algorithms, novel detectors, etc...For these reasons, one could perhaps add another frontier, the Lifetime Frontier, to the standard three (Energy, Intensity and Cosmic). In this talk, I will describe a BSM physics model whose characteristic signatures are decays of new (mirror) fermions at displaced vertices, a domain belonging to the Lifetime Frontier. It is a model of {\em non-sterile} right-handed neutrinos whose masses are proportional to the electroweak scale $\Lambda_{EW} \sim 246 \, GeV$. The model proposed a solution to the strong CP problem with a surprising connection between the sizes of the neutrino masses and the $\theta$-angle which contributes to the neutron electric dipole moment.


title: Submodular Observation Selection and Information Gathering for Quadratic Models

abstract: We study the problem of selecting most informative subset of a large observation set to enable accurate estimation of unknown parameters. This problem arises in a variety of settings in machine learning and signal processing including feature selection, phase retrieval, and target localization. Since for quadratic measurement models the moment matrix of the optimal estimator is generally unknown, majority of prior work resorts to approximation techniques such as linearization of the observation model to optimize the alphabetical optimality criteria of an approximate moment matrix. Conversely, by exploiting a connection to the classical Van Trees' inequality, we derive new alphabetical optimality criteria without distorting the relational structure of the observation model. We further show that under certain conditions on parameters of the problem these optimality criteria are monotone and (weak) submodular set functions. These results enable us to develop an efficient greedy observation selection algorithm uniquely tailored for quadratic models, and provide theoretical bounds on its achievable utility.


title: Multiwavelength cluster mass estimates and machine learning

abstract: One emerging application of machine learning methods is the inference of galaxy cluster masses. In this note, machine learning is used to directly combine five simulated multiwavelength measurements in order to find cluster masses. This is in contrast to finding mass estimates for each observable, normally by using a scaling relation, and then combining these scaling law based mass estimates using a likelihood. We also illustrate how the contributions of each observable to the accuracy of the resulting mass measurement can be compared via model-agnostic Importance Permutation values. Thirdly, as machine learning relies upon the accuracy of the training set in capturing observables, their correlations, and the observational selection function, and as the machine learning training set originates from simulations, two tests of whether a simulation's correlations are consistent with observations are suggested and explored as well.


title: Cluster integrable systems and spin chains

abstract: We discuss relation between the cluster integrable systems and spin chains in the context of their correspondence with 5d supersymmetric gauge theories. It is shown that $\mathfrak{gl}_N$ XXZ-type spin chain on $M$ sites is isomorphic to a cluster integrable system with $N \times M$ rectangular Newton polygon and $N \times M$ fundamental domain of a 'fence net' bipartite graph. The Casimir functions of the Poisson bracket, labeled by the zig-zag paths on the graph, correspond to the inhomogeneities, on-site Casimirs and twists of the chain, supplemented by total spin. The symmetricity of cluster formulation implies natural spectral duality, relating $\mathfrak{gl}_N$-chain on $M$ sites with the $\mathfrak{gl}_M$-chain on $N$ sites. For these systems we construct explicitly a subgroup of the cluster mapping class group $\mathcal{G}_\mathcal{Q}$ and show that it acts by permutations of zig-zags and, as a consequence, by permutations of twists and inhomogeneities. Finally, we derive Hirota bilinear equations, describing dynamics of the tau-functions or A-cluster variables under the action of some generators of $\mathcal{G}_\mathcal{Q}$.


title: Training language GANs from Scratch

abstract: Generative Adversarial Networks (GANs) enjoy great success at image generation, but have proven difficult to train in the domain of natural language. Challenges with gradient estimation, optimization instability, and mode collapse have lead practitioners to resort to maximum likelihood pre-training, followed by small amounts of adversarial fine-tuning. The benefits of GAN fine-tuning for language generation are unclear, as the resulting models produce comparable or worse samples than traditional language models. We show it is in fact possible to train a language GAN from scratch -- without maximum likelihood pre-training. We combine existing techniques such as large batch sizes, dense rewards and discriminator regularization to stabilize and improve language GANs. The resulting model, ScratchGAN, performs comparably to maximum likelihood training on EMNLP2017 News and WikiText-103 corpora according to quality and diversity metrics.


title: An Integrated Model for User Innovation Knowledge Based on Super-network

abstract: Online user innovation communities are becoming a promising source of user innovation knowledge and creative users. With the purpose of identifying valuable innovation knowledge and users, this study constructs an integrated super-network model, i.e., User Innovation Knowledge Super-Network (UIKSN), to integrate fragmented knowledge, knowledge fields, users and posts in an online community knowledge system. Based on the UIKSN, the core innovation knowledge, core innovation knowledge fields, core creative users, and the knowledge structure of individual users were identified specifically. The findings help capture the innovation trends of products, popular innovations and creative users, and makes contributions on mining, and integrating and analyzing innovation knowledge in community based innovation theory.


title: Thresholdless transition to coherent emission at telecom wavelengths from coaxial nanolasers

abstract: The ongoing miniaturization of semiconductor lasers has enabled ultra-low threshold devices and even provided a path to approach thresholdless lasing with linear input-output characteristics. Such nanoscale lasers have initiated a discourse on the origin of the physical mechanisms involved and their boundaries, such as the required photon number, the importance of optimized light confinement in a resonator and mode-density enhancement. Here, we investigate high-$\beta$ metal-clad coaxial nanolasers, which facilitate thresholdless lasing. We experimentally and theoretically investigate both the conventional lasing characteristics, as well as the photon statistics of the emitted light. While the former lacks adequate information to determine the threshold to coherent radiation, the latter reveals a finite threshold pump power. Our work clearly highlights an important and often misunderstood aspect of high-$\beta$ lasers, namely that a thresholdless laser does have a finite threshold pump power and must not be confused with a hypothetical zero threshold laser.


title: Electromagnetically-induced transparency, absorption, and microwave field sensing in a Rb vapor cell with a three-color all-infrared laser system

abstract: A comprehensive study of three-photon electromagnetically-induced transparency (EIT) and absorption (EIA) on the rubidium cascade $5S_{1/2} \rightarrow 5P_{3/2}$ (laser wavelength 780~nm), $5P_{3/2} \rightarrow 5D_{5/2}$ (776~nm), and $5D_{5/2}\rightarrow 28F_{7/2}$ (1260~nm) is performed. The 780-nm probe and 776-nm dressing beams are counter-aligned through a Rb room-temperature vapor cell, and the 1260-nm coupler beam is co- or counter-aligned with the probe beam. Several cases of EIT and EIA, measured over a range of detunings of the 776-nm beam, are studied. The observed phenomena are modeled by numerically solving the Lindblad equation, and the results are interpreted in terms of the probe-beam absorption behavior of velocity- and detuning-dependent dressed states. To explore the utility of three-photon Rydberg EIA/EIT for microwave electric-field diagnostics, a sub-THz field generated by a signal source and a frequency quadrupler is applied to the Rb cell. The 100.633-GHz field resonantly drives the $28F_{7/2}\leftrightarrow29D_{5/2}$ transition and causes Autler-Townes splittings in the Rydberg EIA/EIT spectra, which are measured and employed to characterize the performance of the microwave quadrupler.


title: Rough sets and three-valued structures

abstract: In recent years, many papers have been published showing relationships between rough sets and some lattice theoretical structures. We present here some strong relations between rough sets and three-valued {\L}ukasiewicz algebras.


title: Sampling of Entire Functions of Several Complex Variables on a Lattice and Multivariate Gabor Frames

abstract: We give a general construction of entire functions in $d$ complex variables that vanish on a lattice of the form $L = A (Z + i Z )^d$ for an invertible complex-valued matrix. As an application we exhibit a class of lattices of density >1 that fail to be a sampling set for the Bargmann-Fock space in $C ^2$. By using an equivalent real-variable formulation, we show that these lattices fail to generate a Gabor frame.


title: About a 'concrete' Rauszer Boolean algebra generated by a preorder

abstract: Inspired by the fundamental results obtained by P. Halmos and A. Monteiro, concerning equivalence relations and monadic Boolean algebras, we recall the `concrete' Rauszer Boolean algebra pointed out by C. Rauszer (1971), via un preorder R. On this algebra we can consider one of the several binary operations defined, in an abstract way, by A. Monteiro (1971). The Heyting-Brouwer subalgebra of constants (fixpoints), allows us to give a general framework to find representations of several special algebraic structures related to logic.


title: Discussion of "Nonparametric generalized fiducial inference for survival functions under censoring"

abstract: The following discussion is inspired by the paper Nonparametric generalized fiducial inference for survival functions under censoring by Cui and Hannig. The discussion consists of comments on the results, but also indicates it's importance more generally in the context of fiducial inference. A two page introduction to fiducial inference is given to provide a context.


title: A generic approach to measuring the strength of completeness/compactness of various types of spaces and ordered structures

abstract: With a simple generic approach, we develop a classification that encodes and measures the strength of completeness (or compactness) properties in various types of spaces and ordered structures. The approach also allows us to encode notions of functions being contractive in these spaces and structures. As a sample of possible applications we discuss metric spaces, ultrametric spaces, ordered groups and fields, topological spaces, partially ordered sets, and lattices. We describe several notions of completeness in these spaces and structures and determine their respective strengths. In order to illustrate some consequences of the levels of strength, we give examples of generic fixed point theorems which then can be specialized to theorems in various applications which work with contracting functions and some completeness property of the underlying space. Ball spaces are nonempty sets of nonempty subsets of a given set. They are called spherically complete if every chain of balls has a nonempty intersection. This is all that is needed for the encoding of completeness notions. We discuss operations on the sets of balls to determine when they lead to larger sets of balls; if so, then the properties of the so obtained new ball spaces are determined. The operations can lead to increased level of strength, or to ball spaces of newly constructed structures, such as products. Further, the general framework makes it possible to transfer concepts and approaches from one application to the other; as examples we discuss theorems analogous to the Knaster--Tarski Fixed Point Theorem for lattices and theorems analogous to the Tychonoff Theorem for topological spaces.


title: Dual Numbers and Operational Umbral Methods

abstract: Dual numbers and their higher order version are important tools for numerical computations, and in particular for finite difference calculus. Based upon the relevant algebraic rules and matrix realizations of dual numbers, we will present a novel point of view, embedding dual numbers within a formalism reminiscent of operational umbral calculus.


title: Precipitation Nowcasting with Satellite Imagery

abstract: Precipitation nowcasting is a short-range forecast of rain/snow (up to 2 hours), often displayed on top of the geographical map by the weather service. Modern precipitation nowcasting algorithms rely on the extrapolation of observations by ground-based radars via optical flow techniques or neural network models. Dependent on these radars, typical nowcasting is limited to the regions around their locations. We have developed a method for precipitation nowcasting based on geostationary satellite imagery and incorporated the resulting data into the Yandex.Weather precipitation map (including an alerting service with push notifications for products in the Yandex ecosystem), thus expanding its coverage and paving the way to a truly global nowcasting service.


title: Modified Gravity Theories Based on the Non-Canonical Volume-Form Formalism

abstract: We present a concise description of the basic features of gravity-matter models based on the formalism of non-canonical spacetime volume-forms in its two versions: the method of non-Riemannian volume-forms (metric-independent covariant volume elements) and the dynamical spacetime formalism. Among the principal outcomes we briefly discuss: (i) quintessential universe evolution with a gravity-"inflaton"-assisted suppression in the "early" universe and, respectively, dynamical generation in the "late" universe of Higgs spontaneous electroweak gauge symmetry breaking; (ii) unified description of dark energy and dark matter as manifestations of a single material entity - a second scalar field "darkon"; (iii)unification of dark energy and dark matter with diffusive interaction among them; (iv) explicit derivation of a stable "emergent universe" solution, i.e., a creation without Big Bang; (v) mechanism for suppression of 5-th force without fine-tuning.


title: Mechatronic Design of a Dribbling System for RoboCup Small Size Robot

abstract: RoboCup SSL is an excellent platform for researching artificial intelligence and robotics. The dribbling system is an essential issue, which is the main part for completing advanced soccer skills such as trapping and dribbling. In this paper, we designed a new dribbling system for SSL robots, including mechatronics design and control algorithms. For the mechatronics design, we analysed and exposed the 3-touch-point model with the simulation in ADAMS. In the motor controller algorithm, we use reinforcement learning to control the torque output. Finally we verified the results on the robot.


title: Correlations of azimuthal anisotropy Fourier harmonics with subevent cumulants in pPb collisions at $\sqrt{s_\mathrm{NN}} =$ 8.16 TeV

abstract: Event-by-event correlations of azimuthal anisotropy Fourier coefficients ($v_n$) in 8.16 TeV pPb collision data, collected by the CMS experiment at the LHC, are extracted using a subevent four-particle cumulant technique. Each combination of four charged particles are selected from either two, three, or four distinct subevent regions of a pseudorapidity range from $-$2.4 to 2.4 of the CMS tracker, and with transverse momentum between 0.3 and 3.0 GeV. Using the subevent cumulant technique, correlations between $v_n$ of different orders are measured as functions of particle multiplicity and compared to the standard cumulant method without subevents over a wide event multiplicity range. At high multiplicity, the $v_2$ and $v_3$ coefficients exhibit an anticorrelation; this behavior is observed consistently using various methods. The $v_2$ and $v_4$ correlation strength is found to depend on the number of subevents used in the calculation. As the event multiplicity decreases, the results from different subevent methods diverge because of different contributions of non-collective or few-particle correlations. Correlations extracted with the four-subevent method exhibit a tendency to diminish monotonically toward the lowest multiplicity region (about 20 charged tracks) investigated. These findings extend previous studies to a significantly lower event multiplicity range and establish the evidence for the onset of long-range collective multiparticle correlations in small system collisions.


title: Linear Dichroism Conversion in Quasi One-Dimensional Perovskite Chalcogenide

abstract: Anisotropic photonic materials with linear dichroism are crucial components in many sensing, imaging and communication applications. Such materials play an important role as polarizers, filters and wave-plates in photonic devices and circuits. Conventional crystalline materials with optical anisotropy typically show unidirectional linear dichroism over a broad wavelength range. The linear dichroism conversion phenomenon has not been observed in crystalline materials. Here, we report the investigation of the unique linear dichroism conversion phenomenon in quasi-one-dimensional (quasi-1D) hexagonal perovskite chalcogenide BaTiS3. The material shows record level of optical anisotropy within the visible wavelength range. In contrast to conventional anisotropic optical materials, the linear dichroism polarity in BaTiS3 makes an orthogonal change at an optical wavelength corresponding to the photon energy of 1.78 eV. First principle calculations reveal that this anomalous linear dichroism conversion behavior originates from different selection rules of the optical transitions from the parallel bands in the BaTiS3 material. Wavelength dependent polarized Raman spectroscopy further confirms this phenomenon. Such material with linear dichroism conversion property can facilitate new ability to control and sense the energy and polarization of light, and lead to novel photonic devices such as polarization-wavelength selective detectors and lasers for multispectral imaging, sensing and optical communication applications.


title: On the Absence of Spurious Local Trajectories in Time-varying Nonconvex Optimization

abstract: In this paper, we study the landscape of an online nonconvex optimization problem, for which the input data vary over time and the solution is a trajectory rather than a single point. To understand the complexity of finding a global solution of this problem, we introduce the notion of \textit{spurious (i.e., non-global) local trajectory} as a generalization to the notion of spurious local solution in nonconvex (time-invariant) optimization. We develop an ordinary differential equation (ODE) associated with a time-varying nonlinear dynamical system which, at limit, characterizes the spurious local solutions of the time-varying optimization problem. We prove that the absence of spurious local trajectory is closely related to the transient behavior of the developed system. In particular, we show that if the problem is time-varying, the data variation may force all of the ODE trajectories initialized at arbitrary local minima at the initial time to gradually converge to the global solution trajectory. We study the Jacobian of the dynamical system along a local minimum trajectory and show how its eigenvalues are manipulated by the natural data variation in the problem, which may consequently trigger escaping poor local minima over time.


title: An Air-Stable and Atomically Thin Graphene/Gallium Superconducting Heterostructure

abstract: Two-dimensional layered and atomically thin elemental superconductors may be key ingredients in next-generation quantum technologies, if they can be stabilized and integrated into heterostructured devices under ambient conditions. However, atomically thin elemental superconductors are largely unexplored outside ultra-high vacuum due to rapid oxidation, and even 2D layered superconductors require complex encapsulation strategies to maintain material quality. Here we demonstrate environmentally stable, single-crystal, few-atom-thick superconducting gallium, 2D-Ga, produced by confinement heteroepitaxy (CHet) at the interface of epitaxial graphene (EG) and silicon carbide (SiC). 2D-Ga becomes superconducting at 4 K; this elevation over bulk alpha-Ga (Tc~1 K) is primarily attributed to an increased density of states at the Fermi level as the incipient Ga-Ga dimerization seen in alpha-Ga is suppressed by epitaxy to SiC. We also demonstrate the importance of controlling SiC surface morphology (i.e. step height) and defect-engineering in graphene layers prior to intercalation to achieve large-area uniform 2D-Ga layers with isotropic transport properties. This work demonstrates that unique 2D forms of 3D materials can be stabilized at the EG/SiC interface, which represents a scalable route towards air-stable crystalline 2D superconductors as a potential foundation for next-generation quantum technologies.


title: Bi-objective Framework for Sensor Fusion in RGB-D Multi-View Systems: Applications in Calibration

abstract: Complete and textured 3D reconstruction of dynamic scenes has been facilitated by mapped RGB and depth information acquired by RGB-D cameras based multi-view systems. One of the most critical steps in such multi-view systems is to determine the relative poses of all cameras via a process known as extrinsic calibration. In this work, we propose a sensor fusion framework based on a weighted bi-objective optimization for refinement of extrinsic calibration tailored for RGB-D multi-view systems. The weighted bi-objective cost function, which makes use of 2D information from RGB images and 3D information from depth images, is analytically derived via the Maximum Likelihood (ML) method. The weighting factor appears as a function of noise in 2D and 3D measurements and takes into account the affect of residual errors on the optimization. We propose an iterative scheme to estimate noise variances in 2D and 3D measurements, for simultaneously computing the weighting factor together with the camera poses. An extensive quantitative and qualitative evaluation of the proposed approach shows improved calibration performance as compared to refinement schemes which use only 2D or 3D measurement information.


title: On the Reusability of Post-Experimental Field Data for Underwater Acoustic Communications R&D

abstract: Field data is often expensive to collect, time-consuming to prepare to collect, and even more time-consuming to process after the experiment has concluded. However, it is often the practice that such data are used for little after the funded research activity that was concomitant with the experiment is completed. Immutability of the original experimental configuration either results in re-gathering of expensive field-data, or in absence of such data, model-dependent analysis that partially captures the real-world dynamics. For underwater acoustic research and development, the standard communication pipeline might be modified to enable greater re-usability of experimental field data. This paper first characterizes the necessary modifications to the standard communication pipeline to prepare signals for transmission and subsequent recording such that research trades for different modulation and coding schemes may be undertaken post-experiment, without the need for re-transmission of additional waveforms. Then, using the modified mathematical framework, sufficient conditions for reliable post-experimental replay of the environment are recognized. Finally, techniques are discussed to collect sufficient environmental statistics such that subsequent research can be accomplished long after the experiment has been completed, and that results from a given experiment may be reasonably compared with those of another. Examples are provided using both synthetic and experimental data collected from at-sea field tests.


title: First order Fermi surface topological (Lifshitz) transition in an interacting two-dimensional Rashba Fermi liquid

abstract: We study the Fermi surface topological transition of the pocket-opening type in a two dimensional Fermi liquid with spin-orbit coupling of Rashba type. We find that the interactions, far from instabilities, drive the transition first order at zero temperature surprisingly in a more pronounced way than in the case of interacting Fermi liquid without spin-orbit coupling. We first gain insight from second order perturbation theory in the self-energy. We then extend the results to stronger interaction, using the self-consistent fluctuation approximation. We discuss existing experimental work on the system BiTeI and suggest further experiments in the light of these results .


title: Nonclassical optical properties of mesoscopic gold

abstract: Gold nanostructures have important applications in nanoelectronics, nano-optics as well as in precision metrology due to their intriguing opto-electronic properties. These properties are governed by the bulk band structure but to some extend are tunable via geometrical resonances. Here we show that the band structure of gold itself exhibits significant size-dependent changes already for mesoscopic critical dimensions below 30 nm. To suppress the effects of geometrical resonances and grain boundaries, we prepared atomically flat ultrathin films of various thicknesses by utilizing large chemically grown single-crystalline gold platelets. We experimentally probe thickness-dependent changes of the band structure by means of two-photon photoluminescence and observe a surprising 100-fold increase of the nonlinear signal when the gold film thickness is reduced below 30 nm allowing us to optically resolve single-unit-cell steps. The effect is well explained by density functional calculations of the thickness-dependent 2D band structure of gold.


title: On Pruning for Score-Based Bayesian Network Structure Learning

abstract: Many algorithms for score-based Bayesian network structure learning (BNSL), in particular exact ones, take as input a collection of potentially optimal parent sets for each variable in the data. Constructing such collections naively is computationally intensive since the number of parent sets grows exponentially with the number of variables. Thus, pruning techniques are not only desirable but essential. While good pruning rules exist for the Bayesian Information Criterion (BIC), current results for the Bayesian Dirichlet equivalent uniform (BDeu) score reduce the search space very modestly, hampering the use of the (often preferred) BDeu. We derive new non-trivial theoretical upper bounds for the BDeu score that considerably improve on the state-of-the-art. Since the new bounds are mathematically proven to be tighter than previous ones and at little extra computational cost, they are a promising addition to BNSL methods.


title: Unsupervised Discovery of Temporal Structure in Noisy Data with Dynamical Components Analysis

abstract: Linear dimensionality reduction methods are commonly used to extract low-dimensional structure from high-dimensional data. However, popular methods disregard temporal structure, rendering them prone to extracting noise rather than meaningful dynamics when applied to time series data. At the same time, many successful unsupervised learning methods for temporal, sequential and spatial data extract features which are predictive of their surrounding context. Combining these approaches, we introduce Dynamical Components Analysis (DCA), a linear dimensionality reduction method which discovers a subspace of high-dimensional time series data with maximal predictive information, defined as the mutual information between the past and future. We test DCA on synthetic examples and demonstrate its superior ability to extract dynamical structure compared to commonly used linear methods. We also apply DCA to several real-world datasets, showing that the dimensions extracted by DCA are more useful than those extracted by other methods for predicting future states and decoding auxiliary variables. Overall, DCA robustly extracts dynamical structure in noisy, high-dimensional data while retaining the computational efficiency and geometric interpretability of linear dimensionality reduction methods.


title: Multifaceted Privacy: How to Express Your Online Persona without Revealing Your Sensitive Attributes

abstract: Recent works in social network stream analysis show that a user's online persona attributes (e.g., gender, ethnicity, political interest, location, etc.) can be accurately inferred from the topics the user writes about or engages with. Attribute and preference inferences have been widely used to serve personalized recommendations, directed ads, and to enhance the user experience in social networks. However, revealing a user's sensitive attributes could represent a privacy threat to some individuals. Microtargeting (e.g.,Cambridge Analytica scandal), surveillance, and discriminating ads are examples of threats to user privacy caused by sensitive attribute inference. In this paper, we propose Multifaceted privacy, a novel privacy model that aims to obfuscate a user's sensitive attributes while publicly preserving the user's public persona. To achieve multifaceted privacy, we build Aegis, a prototype client-centric social network stream processing system that helps preserve multifaceted privacy, and thus allowing social network users to freely express their online personas without revealing their sensitive attributes of choice. Aegis allows social network users to control which persona attributes should be publicly revealed and which ones should be kept private. For this, Aegis continuously suggests topics and hashtags to social network users to post in order to obfuscate their sensitive attributes and hence confuse content-based sensitive attribute inferences. The suggested topics are carefully chosen to preserve the user's publicly revealed persona attributes while hiding their private sensitive persona attributes. Our experiments show that adding as few as 0 to 4 obfuscation posts (depending on how revealing the original post is) successfully hides the user specified sensitive attributes without changing the user's public persona attributes.


title: Composite Non-Abelian Strings with Grassmannian Models on the World Sheet

abstract: Most of the non-Abelian string-vortices studied so far are characterized by two-dimensional \cpn models with various degrees of supersymmetry on their world sheet. We generalize this construction to "composite" non-Abelian strings supporting the Grassmann $\mathcal{G}(L,M)$ models (here $L+M=N$). The generalization is straightforward and provides, among other results, a simple and transparent way for counting the number of vacua in ${\mathcal N}=(2,2)$ Grassmannian model.


title: Affirmative Action Policies for Top-k Candidates Selection, With an Application to the Design of Policies for University Admissions

abstract: We consider the problem of designing affirmative action policies for selecting the top-k candidates from a pool of applicants. We assume that for each candidate we have socio-demographic attributes and a series of variables that serve as indicators of future performance (e.g., results on standardized tests). We further assume that we have access to historical data including the actual performance of previously selected candidates. Critically, performance information is only available for candidates who were selected under some previous selection policy. In this work we assume that due to legal requirements or voluntary commitments, an organization wants to increase the presence of people from disadvantaged socio-demographic groups among the selected candidates. Hence, we seek to design an affirmative action or positive action policy. This policy has two concurrent objectives: (i) to select candidates who, given what can be learnt from historical data, are more likely to perform well, and (ii) to select candidates in a way that increases the representation of disadvantaged socio-demographic groups. Our motivating application is the design of university admission policies to bachelor's degrees. We use a causal model as a framework to describe several families of policies (changing component weights, giving bonuses, and enacting quotas), and compare them both theoretically and through extensive experimentation on a large real-world dataset containing thousands of university applicants. Our paper is the first to place the problem of affirmative-action policy design within the framework of algorithmic fairness. Our empirical results indicate that simple policies could favor the admission of disadvantaged groups without significantly compromising on the quality of accepted candidates.


title: Divide-and-Conquer Information-Based Optimal Subdata Selection Algorithm

abstract: The information-based optimal subdata selection (IBOSS) is a computationally efficient method to select informative data points from large data sets through processing full data by columns. However, when the volume of a data set is too large to be processed in the available memory of a machine, it is infeasible to implement the IBOSS procedure. This paper develops a divide-and-conquer IBOSS approach to solving this problem, in which the full data set is divided into smaller partitions to be loaded into the memory and then subsets of data are selected from each partitions using the IBOSS algorithm. We derive both finite sample properties and asymptotic properties of the resulting estimator. Asymptotic results show that if the full data set is partitioned randomly and the number of partitions is not very large, then the resultant estimator has the same estimation efficiency as the original IBOSS estimator. We also carry out numerical experiments to evaluate the empirical performance of the proposed method.


title: Scene Induced Multi-Modal Trajectory Forecasting via Planning

abstract: We address multi-modal trajectory forecasting of agents in unknown scenes by formulating it as a planning problem. We present an approach consisting of three models; a goal prediction model to identify potential goals of the agent, an inverse reinforcement learning model to plan optimal paths to each goal, and a trajectory generator to obtain future trajectories along the planned paths. Analysis of predictions on the Stanford drone dataset, shows generalizability of our approach to novel scenes.


title: Zero-shot task adaptation by homoiconic meta-mapping

abstract: How can deep learning systems flexibly reuse their knowledge? Toward this goal, we propose a new class of challenges, and a class of architectures that can solve them. The challenges are meta-mappings, which involve systematically transforming task behaviors to adapt to new tasks zero-shot. The key to achieving these challenges is representing the task being performed in such a way that this task representation is itself transformable. We therefore draw inspiration from functional programming and recent work in meta-learning to propose a class of Homoiconic Meta-Mapping (HoMM) approaches that represent data points and tasks in a shared latent space, and learn to infer transformations of that space. HoMM approaches can be applied to any type of machine learning task. We demonstrate the utility of this perspective by exhibiting zero-shot remapping of behavior to adapt to new tasks.


title: PAC Guarantees for Cooperative Multi-Agent Reinforcement Learning with Restricted Communication

abstract: We develop model free PAC performance guarantees for multiple concurrent MDPs, extending recent works where a single learner interacts with multiple non-interacting agents in a noise free environment. Our framework allows noisy and resource limited communication between agents, and develops novel PAC guarantees in this extended setting. By allowing communication between the agents themselves, we suggest improved PAC-exploration algorithms that can overcome the communication noise and lead to improved sample complexity bounds. We provide a theoretically motivated algorithm that optimally combines information from the resource limited agents, thereby analyzing the interaction between noise and communication constraints that are ubiquitous in real-world systems. We present empirical results for a simple task that supports our theoretical formulations and improve upon naive information fusion methods.


title: Fast Algorithms for Computational Optimal Transport and Wasserstein Barycenter

abstract: We provide theoretical complexity analysis for new algorithms to compute the optimal transport (OT) distance between two discrete probability distributions, and demonstrate their favorable practical performance over state-of-art primal-dual algorithms and their capability in solving other problems in large-scale, such as the Wasserstein barycenter problem for multiple probability distributions. First, we introduce the \emph{accelerated primal-dual randomized coordinate descent} (APDRCD) algorithm for computing the OT distance. We provide its complexity upper bound $\bigOtil(\frac{n^{5/2}}{\varepsilon})$ where $n$ stands for the number of atoms of these probability measures and $\varepsilon > 0$ is the desired accuracy. This complexity bound matches the best known complexities of primal-dual algorithms for the OT problems, including the adaptive primal-dual accelerated gradient descent (APDAGD) and the adaptive primal-dual accelerated mirror descent (APDAMD) algorithms. Then, we demonstrate the better performance of the APDRCD algorithm over the APDAGD and APDAMD algorithms through extensive experimental studies, and further improve its practical performance by proposing a greedy version of it, which we refer to as \emph{accelerated primal-dual greedy coordinate descent} (APDGCD). Finally, we generalize the APDRCD and APDGCD algorithms to distributed algorithms for computing the Wasserstein barycenter for multiple probability distributions.


title: A Novel Metal Nanoparticles- Graphene Nanodisks- Quantum Dots Hybrid-System-Based Spaser

abstract: Active nanoplasmonics has recently led to the emergence of many promising applications. One of them is spaser (surface plasmons amplification by stimulated emission of radiation) that has been shown to generate coherent and intense fields of selected surface plasmon modes that are strongly localized in the nanoscale. We propose a novel nanospaser composed of metal nanoparticles-graphene nanodisks hybrid plasmonic system as its resonator and a quantum dots cascade stack as its gain medium. We derive the plasmonic fields induced by pulsed excitation through the use of the effective medium theory. Based on the density matrix approach and by solving the Lindblad quantum master equation, we get ultrafast dynamics of the spaser associated with coherent amplified plasmonic fields. The intensity of the latter is significantly affected by the width of the metallic contact and the time duration of the laser pulse used to launch the surface plasmons. The proposed nanospaser operates in the mid-infrared region that has received much attention due to its wide biomedical, chemical and telecommunication applications.


title: Spatio-Temporal Wind Modeling for UAV Simulations

abstract: Wind affects the stability and maneuverability of UAVs, which can be particularly dangerous when operating near obstacles or each other. In order to test the effectiveness of formation control laws and the impact of windy environments on the vehicles, spatio-temporal wind fields must be modeled. Each vehicle within the formation experiences unique wind conditions, but these conditions are correlated to the conditions experienced by the other vehicles. This report develops a spatio-temporal model for over-land and over-water environments that produces a representative wind field capable of running on a personal computer that also includes turbulence and gusting.


title: Urban Traffic Network Control in Smart Cities; a Distributed Model-based Control Approach

abstract: This paper proposes a distributed model predictive control (DMPC) approach for an urban traffic network (UTN) system. The control objective is to minimize the traffic congestion and the total travel time spent (TTS) in each link. The proposed DMPC algorithm considers traffic demand and disturbance predictions. The CasADi optimization tool is used to solve the constrained optimization problem. The proposed distributed control approach achieved 60% less computation time, 14.3% less TTS, and 15.1% less queue length compared to the centralized approach. Moreover, while the centralized algorithm neglected the input and state constraints, the distributed approach resulted in the satisfaction of all the constraints over the whole horizon.


title: Rare event process and entry times distribution for arbitrary null sets on compact manifolds

abstract: We establish the general equivalence between rare event process for arbitrary continuous functions whose maximal values are achieved on non-trivial sets, and the entry times distribution for arbitrary measure zero sets. We then use it to show that the for differentiable maps on a compact Riemannian manifold that can be modeled by Young's towers, the rare event process and the limiting entry times distribution both converge to compound Poisson distributions. A similar result is also obtained on Gibbs-Markov systems, for both cylinders and open sets. We also give explicit expressions for the parameters of the limiting distribution, and a simple criterion for the limiting distribution to be Poisson. This can be applied to a large family of continuous observables that achieve their maximum on a non-trivial set with zero measure.


title: Robust Attribution Regularization

abstract: An emerging problem in trustworthy machine learning is to train models that produce robust interpretations for their predictions. We take a step towards solving this problem through the lens of axiomatic attribution of neural networks. Our theory is grounded in the recent work, Integrated Gradients (IG), in axiomatically attributing a neural network's output change to its input change. We propose training objectives in classic robust optimization models to achieve robust IG attributions. Our objectives give principled generalizations of previous objectives designed for robust predictions, and they naturally degenerate to classic soft-margin training for one-layer neural networks. We also generalize previous theory and prove that the objectives for different robust optimization models are closely related. Experiments demonstrate the effectiveness of our method, and also point to intriguing problems which hint at the need for better optimization techniques or better neural network architectures for robust attribution training.


title: Characterizing Certain DNS DDoS Attacks

abstract: This paper details data science research in the area of Cyber Threat Intelligence applied to a specific type of Distributed Denial of Service (DDoS) attack. We study a DDoS technique prevalent in the Domain Name System (DNS) for which little malware have been recovered. Using data from a globally distributed set of a passive collectors (pDNS), we create a statistical classifier to identify these attacks and then use unsupervised learning to investigate the attack events and the malware that generates them. The first known major study of this technique, we discovered that current attacks have little resemblance to published descriptions and identify several previously unpublished features of the attacks. Through a combination of text and time series features, we are able to characterize the dominant malware and demonstrate that the number of global-scale attack systems is relatively small.


title: Posterior Distribution for the Number of Clusters in Dirichlet Process Mixture Models

abstract: Dirichlet process mixture models (DPMM) play a central role in Bayesian nonparametrics, with applications throughout statistics and machine learning. DPMMs are generally used in clustering problems where the number of clusters is not known in advance, and the posterior distribution is treated as providing inference for this number. Recently, however, it has been shown that the DPMM is inconsistent in inferring the true number of components in certain cases. This is an asymptotic result, and it would be desirable to understand whether it holds with finite samples, and to more fully understand the full posterior. In this work, we provide a rigorous study for the posterior distribution of the number of clusters in DPMM under different prior distributions on the parameters and constraints on the distributions of the data. We provide novel lower bounds on the ratios of probabilities between $s+1$ clusters and $s$ clusters when the prior distributions on parameters are chosen to be Gaussian or uniform distributions.


title: Tricritical point with fractional supersymmetry from a Fibonacci topological state

abstract: We consider a generic Fibonacci topological wave function on a square lattice, and the norm of this wave function can be mapped into the partition function of two-coupled $\phi ^{2}$-state Potts models with $\phi =(\sqrt{5}+1)/2$ as the golden ratio. A global phase diagram is thus established to display non-abelian topological phase transitions. The Fibonacci topological phase corresponds to an emergent new phase of the two-coupled Potts models, and continuously change into two non-topological phases separately, which are dual each other and divided by a first-order phase transition line. Under the self-duality, the Fibonacci topological state enters into the first-order transition state at a quantum tricritical point, where two continuous quantum phase transitions bifurcate. All the topological phase transitions are driven by condensation of anyonic bosons consisting of Fibonacci anyon and its conjugate. However, a fractional supersymmetry is displayed at the quantum tricritical point, characterized by a coset conformal field theory.


title: Robust Variational Autoencoder

abstract: Machine learning methods often need a large amount of labeled training data. Since the training data is assumed to be the ground truth, outliers can severely degrade learned representations and performance of trained models. Here we apply concepts from robust statistics to derive a novel variational autoencoder that is robust to outliers in the training data. Variational autoencoders (VAEs) extract a lower-dimensional encoded feature representation from which we can generate new data samples. Robustness of autoencoders to outliers is critical for generating a reliable representation of particular data types in the encoded space when using corrupted training data. Our robust VAE is based on beta-divergence rather than the standard Kullback-Leibler (KL) divergence. Our proposed lower bound lead to a RVAE model that has the same computational complexity as the VAE and contains a single tuning parameter to control the degree of robustness. We demonstrate the performance of our $\beta$-divergence based autoencoder for a range of image datasets, showing improved robustness to outliers both qualitatively and quantitatively. We also illustrate the use of our robust VAE for outlier detection.


title: Confinement Heteroepitaxy: Realizing Atomically Thin, Half-van der Waals Materials

abstract: Three-dimensional epitaxial heterostructures are based on covalently-bonded interfaces, whereas those from 2-dimensional (2D) materials exhibit van der Waals interactions. Under the right conditions, however, material structures with mixed interfacial van der Waals and covalent bonding may be realized. Atomically thin layers formed at the epitaxial graphene (EG)/silicon carbide (SiC) interface indicate that EG/SiC interfaces provide this unique environment and enable synthesis of a rich palette of 2D materials not accessible with traditional techniques. Here, we demonstrate a method termed confinement heteroepitaxy (CHet), to realize air-stable, structurally unique, crystalline 2D-Ga, In, and Sn at the EG/SiC interface. The first intercalant layer is covalently-bonded to the SiC, and is accompanied by a vertical bonding gradient that ends with van der Waals interactions. Such structures break out of plane centrosymmetry, thereby introducing atomically thin, non-centrosymmetric 2D allotropes of 3D materials as a foundation for tunable superconductivity, topological states, and plasmonic properties.


title: A First-Order Approach To Accelerated Value Iteration

abstract: Markov decision processes (MDPs) are used to model stochastic systems in many applications. Several efficient algorithms to compute optimal policies have been studied in the literature, including value iteration (VI) and policy iteration. However, these do not scale well especially when the discount factor for the infinite horizon discounted reward, $\lambda$, gets close to $1$. In particular, the running time scales as $O \left( 1/(1-\lambda) \right)$ for these algorithms. In this paper, our goal is to design new algorithms that scale better than previous approaches when $\lambda$ approaches $1$. Our main contribution is to present a connection between VI and gradient descent and adapt the ideas of acceleration and momentum in convex optimization to design faster algorithms for MDPs. We prove theoretical guarantees of a faster convergence of our algorithms for the computation of the value function of a policy, where the running times of our algorithms scale as $O \left( 1/\sqrt{1-\lambda} \right)$ for reversible MDP instances. The improvement is quite analogous to Nesterov's acceleration and momentum in convex optimization. We also provide a lower bound on the convergence properties of any first-order algorithm for solving MDPs, presenting a family of MDPs instances for which no algorithm can converge faster than VI when the number of iterations is smaller than the number of states. We introduce a Safe Accelerated Value Iteration (S-AVI), which alternates between accelerated updates and value iteration updates. Our algorithm S-AVI is worst-case optimal and retains the theoretical convergence properties of VI while exhibiting strong empirical performances, providing significant speedups compared to classical approaches (up to one order of magnitude in many cases) for a large test bed of MDP instances.


title: A Metropolis-class sampler for targets with non-convex support

abstract: We aim to improve upon the exploration of the general-purpose random walk Metropolis algorithm when the target has non-convex support $A \subset \mathbb{R}^d$, by reusing proposals in $A^c$ which would otherwise be rejected. The algorithm is Metropolis-class and under standard conditions the chain satisfies a strong law of large numbers and central limit theorem. Theoretical and numerical evidence of improved performance relative to random walk Metropolis are provided. Issues of implementation are discussed and numerical examples, including applications to global optimisation and rare event sampling, are presented.


title: Quadratic Open Quantum Harmonic Oscillator

abstract: We study the quantum open system evolution described by a Gorini-Kossakowski-Sudarshan-Lindblad generator with creation and annihilation operators arising in Fock representations of the $sl_2$ Lie algebra. We show that any initial density matrix evolves to a fully supported density matrix and converges towards a unique equilibrium state. We show that the convergence is exponentially fast and we exactly compute the rate for a wide range of parameters. We also discuss the connection with the two-photon absorption and emission process.


title: New Examples of Bernoulli Algebraic Actions

abstract: We give examples of principal algebraic actions of the noncommutative free group $F$ of rank two, as well as other groups, by automorphisms of a connected compact abelian group for which there is an explicit measurable isomorphism to a Bernoulli action of the group. The isomorphism is defined using homoclinic points, a method that has been used earlier to construct symbolic covers of algebraic actions. To our knowledge, these are the first nontrivial examples of the Bernoullicity of an algebraic action of $F$.


title: Optoelectronic mixing with high frequency graphene transistors

abstract: Graphene is ideally suited for optoelectronic applications. It offers absorption at telecom wavelengths, high-frequency operation and CMOS-compatibility. We report optoelectronic mixing up to to 67GHz using a back-gated graphene field effect transistor (GFET). We also present a model to describe the resulting mixed current. These results pave the way for GETs optoelectronic mixers for mm-wave applications, such as telecommunications and RADAR/LIDAR systems.


title: Revisiting the conformal invariance of Maxwell's equations in curved spacetime

abstract: We revisit the invariance of the curved spacetime Maxwell equations under conformal transformations. Contrary to standard literature, we include the discussion of the four-current, the wave equations for the four-potential and the field, and the behaviour of gauge conditions under the conformal transformation.


title: Maximin-Aware Allocations of Indivisible Goods

abstract: We study envy-free allocations of indivisible goods to agents in settings where each agent is unaware of the goods allocated to other agents. In particular, we propose the maximin aware (MMA) fairness measure, which guarantees that every agent, given the bundle allocated to her, is aware that she does not envy at least one other agent, even if she does not know how the other goods are distributed among other agents. We also introduce two of its relaxations and discuss their egalitarian guarantee and existence. Finally, we present a polynomial-time algorithm, which computes an allocation that approximately satisfies MMA or its relaxations. Interestingly, the returned allocation is also 1/2 -approximate EFX when all agents have subadditive valuations, which improves the algorithm in [Plaut and Roughgarden, SODA 2018].


title: Shift R-CNN: Deep Monocular 3D Object Detection with Closed-Form Geometric Constraints

abstract: We propose Shift R-CNN, a hybrid model for monocular 3D object detection, which combines deep learning with the power of geometry. We adapt a Faster R-CNN network for regressing initial 2D and 3D object properties and combine it with a least squares solution for the inverse 2D to 3D geometric mapping problem, using the camera projection matrix. The closed-form solution of the mathematical system, along with the initial output of the adapted Faster R-CNN are then passed through a final ShiftNet network that refines the result using our newly proposed Volume Displacement Loss. Our novel, geometrically constrained deep learning approach to monocular 3D object detection obtains top results on KITTI 3D Object Detection Benchmark, being the best among all monocular methods that do not use any pre-trained network for depth estimation.


title: Estimating Convergence of Markov chains with L-Lag Couplings

abstract: Markov chain Monte Carlo (MCMC) methods generate samples that are asymptotically distributed from a target distribution of interest as the number of iterations goes to infinity. Various theoretical results provide upper bounds on the distance between the target and marginal distribution after a fixed number of iterations. These upper bounds are on a case by case basis and typically involve intractable quantities, which limits their use for practitioners. We introduce L-lag couplings to generate computable, non-asymptotic upper bound estimates for the total variation or the Wasserstein distance of general Markov chains. We apply L-lag couplings to the tasks of (i) determining MCMC burn-in, (ii) comparing different MCMC algorithms with the same target, and (iii) comparing exact and approximate MCMC. Lastly, we (iv) assess the bias of sequential Monte Carlo and self-normalized importance samplers.


title: Generative Adversarial Networks for Mitigating Biases in Machine Learning Systems

abstract: In this paper, we propose a new framework for mitigating biases in machine learning systems. The problem of the existing mitigation approaches is that they are model-oriented in the sense that they focus on tuning the training algorithms to produce fair results, while overlooking the fact that the training data can itself be the main reason for biased outcomes. Technically speaking, two essential limitations can be found in such model-based approaches: 1) the mitigation cannot be achieved without degrading the accuracy of the machine learning models, and 2) when the data used for training are largely biased, the training time automatically increases so as to find suitable learning parameters that help produce fair results. To address these shortcomings, we propose in this work a new framework that can largely mitigate the biases and discriminations in machine learning systems while at the same time enhancing the prediction accuracy of these systems. The proposed framework is based on conditional Generative Adversarial Networks (cGANs), which are used to generate new synthetic fair data with selective properties from the original data. We also propose a framework for analyzing data biases, which is important for understanding the amount and type of data that need to be synthetically sampled and labeled for each population group. Experimental results show that the proposed solution can efficiently mitigate different types of biases, while at the same time enhancing the prediction accuracy of the underlying machine learning model.


title: Anatomy of a thermal black hole mimicker

abstract: We are entering a new era to test the strong gravity regime around astrophysical black holes. The possibility that they are actually horizonless ultracompact objects and then free from the information loss paradox can be examined more closely with observational data. In this paper, we systematically develop a thermal gas model of the 2-2-hole in quadratic gravity, as one step further to look for more tractable models of black hole mimickers. Concrete predictions for departures from black holes are made all the way down to the high curvature interior. The simple form of matter further enables an explicit study of the relation between geometry and thermodynamics. Within this unified framework, we identify notably different behaviors at two limits. On one side is the astrophysically large 2-2-hole, as characterized by a minuscule deviation outside the would-be horizon and a highly squeezed interior along the radial direction. Anomalous features of black hole thermodynamics emerge from the ordinary gas. On the other side is the minimal 2-2-hole with an isotropic and shrinking interior, which behaves more like a normal thermodynamic system. This brings a new perspective to the related theoretical questions as well as phenomenological implications.


title: Tensor product decompositions and rigidity of full factors

abstract: We obtain several rigidity results regarding tensor product decompositions of factors. First, we show that any full factor with separable predual has at most countably many tensor product decompositions up to stable unitary conjugacy. We use this to show that the class of separable full factors with countable fundamental group is stable under tensor products. Next, we obtain new primeness and unique prime factorization results for crossed products coming from compact actions of higher rank lattices (e.g.\ $\mathrm{SL}(n,\mathbb{Z}), \: n \geq 3$) and noncommutative Bernoulli shifts with arbitrary base (not necessarily amenable). Finally, we provide examples of full factors without any prime factorization.


title: Computing Long Timescale Biomolecular Dynamics using Quasi-Stationary Distribution Kinetic Monte Carlo (QSD-KMC)

abstract: It is a challenge to obtain an accurate model of the state-to-state dynamics of a complex biological system from molecular dynamics (MD) simulations. In recent years, Markov State Models have gained immense popularity for computing state-to-state dynamics from a pool of short MD simulations. However, the assumption that the underlying dynamics on the reduced space is Markovian induces a systematic bias in the model, especially in biomolecular systems with complicated energy landscapes. To address this problem, we have devised a new approach we call quasi-stationary distribution kinetic Monte Carlo (QSD-KMC) that gives accurate long time state-to-state evolution while retaining the entire time resolution even when the dynamics is highly non-Markovian. The proposed method is a kinetic Monte Carlo approach that takes advantage of two concepts: (i) the quasi-stationary distribution and (ii) dynamical corrections theory. Implementation of QSD-KMC imposes stricter requirements on the lengths of the trajectories than in a Markov State Model approach, as the trajectories must be long enough to dephase. However, the QSD-KMC model produces state-to-state trajectories that are statistically indistinguishable from an MD trajectory mapped onto the discrete set of states, for an arbitrary choice of state decomposition. Furthermore, the aforementioned concepts can be used to construct a Monte Carlo approach to optimize the state boundaries regardless of the initial choice of states. We demonstrate the QSD-KMC method on two one-dimensional model systems, one of which is a driven nonequilibrium system, and on two well-characterized biomolecular systems.


title: Texture retrieval using periodically extended and adaptive curvelets

abstract: Image retrieval is an important problem in the area of multimedia processing. This paper presents two new curvelet-based algorithms for texture retrieval which are suitable for use in constrained-memory devices. The developed algorithms are tested on three publicly available texture datasets: CUReT, Mondial-Marmi, and STex-fabric. Our experiments confirm the effectiveness of the proposed system. Furthermore, a weighted version of the proposed retrieval algorithm is proposed, which is shown to achieve promising results in the classification of seismic activities.


title: Countable approximation of topological $G$-manifolds, III: arbitrary Lie groups $G$

abstract: The Hilbert-Smith conjecture states, for any connected topological manifold $M$, any locally compact subgroup of $\mathrm{Homeo}(M)$ is a Lie group. We generalize basic results of Segal-Kosniowski-tomDieck (2.6), James-Segal (2.12), G Bredon (3.7), Jaworowski-Antonyan et al. (5.5), and E Elfving (7.3). The last is our main result: for any Lie group $G$, any Palais-proper topological $G$-manifold has the equivariant homotopy type of a countable proper $G$-CW complex. Along the way, we verify an $n$-classifying space for principal $G$-bundles (5.10).


title: The role of system-meter entanglement in controlling the resolution and decoherence of quantum measurements

abstract: Measurement processes can be separated into an entangling interaction between the system and a meter and a subsequent read-out of the meter state that does not involve any further interactions with the system. In the interval between these two stages, the system and the meter are in an entangled state that encodes all possible effects of the read-out in the form of non-local quantum correlations between the system and the meter. Here, we show that the entanglement generated in the system-meter interaction expresses a fundamental relation between the amount of decoherence and the conditional probabilities that describe the resolution of the measurement. Specifically, the entanglement generated by the measurement interaction correlates both the target observable and the back-action effects on the system with sets of non-commuting physical properties in the meter. The choice of read-out in the meter determines the trade-off between irreversible decoherence and measurement information by steering the system into a corresponding set of conditional output states. The Hilbert space algebra of entanglement ensures that the irreversible part of the decoherence is exactly equal to the Hellinger distance describing the resolution achieved in the measurement. We can thus demonstrate that the trade-off between measurement resolution and back-action is a fundamental property of the entanglement generated in measurement interactions.


title: EnsembleNet: End-to-End Optimization of Multi-headed Models

abstract: Ensembling is a universally useful approach to boost the performance of machine learning models. However, individual models in an ensemble were traditionally trained independently in separate stages without information access about the overall ensemble. Many co-distillation approaches were proposed in order to treat model ensembling as first-class citizens. In this paper, we reveal a deeper connection between ensembling and distillation, and come up with a simpler yet more effective co-distillation architecture. On large-scale datasets including ImageNet, YouTube-8M, and Kinetics, we demonstrate a general procedure that can convert a single deep neural network to a multi-headed model that has not only a smaller size but also better performance. The model can be optimized end-to-end with our proposed co-distillation loss in a single stage without human intervention.