title: Mapping analytic surgery to homology, higher rho numbers and metrics of positive scalar curvature

abstract: Let $\Gamma$ be a f.g. discrete group and let $\tilde M$ be a Galois $\Gamma$-covering of a smooth closed manifold $M$. Let $S_*^\Gamma(\tilde{M})$ be the analytic structure group, appearing in the Higson-Roe analytic surgery sequence $\to S_*^\Gamma(\tilde M)\to K_*(M)\to K_*(C_r^*\Gamma)\to$. We prove that for an arbitrary discrete group $\Gamma$ it is possible to map the whole Higson-Roe sequence to the long exact sequence of even/odd-graded noncommutative de Rham homology $\to H_{[*-1]}(\mathcal{A}\Gamma)\to H^{del}_{[*-1]}(\mathcal{A}\Gamma)\to H^{e}_{[*]}(\mathcal{A}\Gamma)\to$, with $\mathcal{A}\Gamma$ a dense homomorphically closed subalgebra of $C^*_r\Gamma$. Here, $ H_{*}^{del}(\mathcal{A}\Gamma)$ is the delocalized homology and $H_{*}^{e}(\mathcal{A}\Gamma)$ is the homology localized at the identity element. Then, under additional assumptions on $\Gamma$, we prove the existence of a pairing between $HC^*_{del}(\mathbb{C}\Gamma)$, the delocalized part of the cyclic cohomology of $\mathbb{C}\Gamma$, and $H^{del}_{*-1}(\mathcal{A}\Gamma)$. This, in particular, gives a pairing between $S^\Gamma_*(\tilde M)$ and $HC^{*-1}_{del}(\mathbb{C}\Gamma)$. We also prove the existence of a pairing between $S^\Gamma_*(\tilde M)$ and the relative cohomology $H^{[*-1]}(M\to B\Gamma)$. Both these parings are compatible with known pairings associated with the other terms in the Higson-Roe sequence. In particular, we define higher rho numbers associated to the rho class $\rho(\tilde D)\in S_*^\Gamma(\tilde M)$ of an invertible $\Gamma$-equivariant Dirac type operator on $\tilde M$. Finally, we provide a precise study for the behavior of all previous K-theoretic and homological objects and of the higher rho numbers under the action of the diffeomorphism group of $M$. Then, we establish new results on the moduli space of metrics of positive scalar curvature when $M$ is spin.


title: Video-based Person Re-identification with Two-stream Convolutional Network and Co-attentive Snippet Embedding

abstract: Recently, the applications of person re-identification in visual surveillance and human-computer interaction are sharply increasing, which signifies the critical role of such a problem. In this paper, we propose a two-stream convolutional network (ConvNet) based on the competitive similarity aggregation scheme and co-attentive embedding strategy for video-based person re-identification. By dividing the long video sequence into multiple short video snippets, we manage to utilize every snippet's RGB frames, optical flow maps and pose maps to facilitate residual networks, e.g., ResNet, for feature extraction in the two-stream ConvNet. The extracted features are embedded by the co-attentive embedding method, which allows for the reduction of the effects of noisy frames. Finally, we fuse the outputs of both streams as the embedding of a snippet, and apply competitive snippet-similarity aggregation to measure the similarity between two sequences. Our experiments show that the proposed method significantly outperforms current state-of-the-art approaches on multiple datasets.


title: MolSSI and BioExcel Workflow Workshop 2018 Report

abstract: Workflows in biomolecular science are very important as they are intricately intertwined with the scientific outcomes, as well as algorithmic and methodological innovations. The use and effectiveness of workflow tools to meet the needs of the biomolecular science community is varied. MolSSI co-organized a biomolecular workflows workshop in December 2018 with the goal of identifying specific software gaps and opportunities for improved workflow practices. This report captures presentations and discussion from that workshop. The workshop participants were primary tools developers, along with "neutral observers" and some biomolecular domain scientists. After contextualizing and motivating the workshop, the report covers the existing roles and emerging trends in how workflow systems are utilized. A few recurring observations are presented as recommendations for improving the use and effectiveness of workflow tools. The tools presented are discussed in Appendix B.


title: Sticking Properties of Silicates in Planetesimal Formation Revisited

abstract: In the past, laboratory experiments and theoretical calculations showed a mismatch in derived sticking properties of silicates in the context of planetesimal formation. It has been proposed by Kimura et al. (2015) that this mismatch is due to the value of the surface energy assumed, supposedly correlated to the presence or lack of water layers of different thickness on a grain's surface. We present tensile strength measurements of dust aggregates with different water content here. The results are in support of the suggestion by Kimura et al. (2015). Dry samples show increased strengths by a factor of up to 10 over wet samples. A high value of $\gamma = 0.2 J/m^2$ likely applies to the dry low pressure conditions of protoplanetary disks and should be used in the future.


title: A non-invasive ultra-thin luminophore foil detector system for secondary beam monitoring

abstract: High-intensity secondary beams play a vital role in today's particle physics and materials science research and require suitable detection techniques to adjust beam characteristics to optimally match experimental conditions. To this end we have developed a non-invasive, ultra-thin, CsI(Tl) luminophore foil detector system, based on CCD-imaging. We have used this to quantify the beam characteristics of an intensity-frontier surface muon beam used for next-generation charged lepton-flavour violation (cLFV) search experiments at the Paul Scherrer Institut (PSI) and to assess the possible use for a future High-intensity Muon Beam (HiMB-project), currently under study at PSI. An overview of the production and intrinsic characteristics of such foils is given and their application in a high-intensity beam environment.


title: When can unlabeled data improve the learning rate?

abstract: In semi-supervised classification, one is given access both to labeled and unlabeled data. As unlabeled data is typically cheaper to acquire than labeled data, this setup becomes advantageous as soon as one can exploit the unlabeled data in order to produce a better classifier than with labeled data alone. However, the conditions under which such an improvement is possible are not fully understood yet. Our analysis focuses on improvements in the minimax learning rate in terms of the number of labeled examples (with the number of unlabeled examples being allowed to depend on the number of labeled ones). We argue that for such improvements to be realistic and indisputable, certain specific conditions should be satisfied and previous analyses have failed to meet those conditions. We then demonstrate examples where these conditions can be met, in particular showing rate changes from $1/\sqrt{\ell}$ to $e^{-c\ell}$ and from $1/\sqrt{\ell}$ to $1/\ell$. These results improve our understanding of what is and isn't possible in semi-supervised learning.


title: Interactive Teaching Algorithms for Inverse Reinforcement Learning

abstract: We study the problem of inverse reinforcement learning (IRL) with the added twist that the learner is assisted by a helpful teacher. More formally, we tackle the following algorithmic question: How could a teacher provide an informative sequence of demonstrations to an IRL learner to speed up the learning process? We present an interactive teaching framework where a teacher adaptively chooses the next demonstration based on learner's current policy. In particular, we design teaching algorithms for two concrete settings: an omniscient setting where a teacher has full knowledge about the learner's dynamics and a blackbox setting where the teacher has minimal knowledge. Then, we study a sequential variant of the popular MCE-IRL learner and prove convergence guarantees of our teaching algorithm in the omniscient setting. Extensive experiments with a car driving simulator environment show that the learning progress can be speeded up drastically as compared to an uninformative teacher.


title: Inert drift system in a viscous fluid: Steady state asymptotics and exponential ergodicity

abstract: We analyze a system of stochastic differential equations describing the joint motion of a massive (inert) particle in a viscous fluid in the presence of a gravitational field and a Brownian particle impinging on it from below, which transfers momentum proportional to the local time of collisions. We study the long-time fluctuations of the velocity of the inert particle and the gap between the two particles, and we show convergence in total variation to the stationary distribution is exponentially fast. We also produce matching upper and lower bounds on the tails of the stationary distribution and show how these bounds depend on the system parameters. A renewal structure for the process is established, which is the key technical tool in proving the mentioned results.


title: Cohomology and the Brauer groups of diagonal surfaces

abstract: We present a method for calculating the Brauer group of a surface given by a diagonal equation in the projective space. For diagonal quartic surfaces with coefficients in Q we determine the Brauer groups over Q and Q(i).


title: On the Oosterhoff dichotomy in the Galactic bulge: II. kinematical distribution

abstract: We present a kinematical study of RR~Lyrae stars associated with two Oosterhoff groups in the Galactic bulge. We used data published in the first paper of the series, plus proper motions from the {\it Gaia} Data Release 2, and radial velocities from the literature. A 6D kinematical and spatial solution was obtained for 429 RR~Lyrae stars. We use a model of the Galactic gravitational potential to infer stellar orbits. We did not find a difference between the Oosterhoff groups in the individual components of the space velocity. We report that \textit{foreground} and \textit{background} stars with respect to the Galactic bulge stand out in the mean $V$ velocity component, which we interpret as a sign of the Galactic rotation. The movement of the studied stars in the central region of the Galactic bulge is consistent with random motions expected for a classical bulge component. From the orbital integration, we estimate that 8\,\% of the RR~Lyrae stars are halo interlopers currently located in the Galactic bulge. The majority of the stars' orbits are within a 3\,kpc radius from the Galactic bulge. The fraction of Oosterhoff\,II stars increases with increasing Galactic latitude, as well as towards longer orbital periods. We found several RR~Lyrae stars with high space velocities, one of which has an extremely long orbital period of $\sim$1\,Gyr. We conclude that based on their kinematics, the vast majority of the stars in our sample do not seem to contribute to the boxy/peanut component of the Galactic bulge.


title: Miss Tools and Mr Fruit: Emergent communication in agents learning about object affordances

abstract: Recent research studies communication emergence in communities of deep network agents assigned a joint task, hoping to gain insights on human language evolution. We propose here a new task capturing crucial aspects of the human environment, such as natural object affordances, and of human conversation, such as full symmetry among the participants. By conducting a thorough pragmatic and semantic analysis of the emergent protocol, we show that the agents solve the shared task through genuine bilateral, referential communication. However, the agents develop multiple idiolects, which makes us conclude that full symmetry is not a sufficient condition for a common language to emerge.


title: Factorizations for a Class of Multivariate Polynomial Matrices

abstract: Following the works by Lin et al. (Circuits Syst. Signal Process. 20(6): 601-618, 2001) and Liu et al. (Circuits Syst. Signal Process. 30(3): 553-566, 2011), we investigate how to factorize a class of multivariate polynomial matrices. The main theorem in this paper shows that an $l\times m$ polynomial matrix admits a factorization with respect to a polynomial if the polynomial and all the $(l-1)\times (l-1)$ reduced minors of the matrix generate the unit ideal. This result is a further generalization of previous works, and based on this, we give an algorithm which can be used to factorize more polonomial matrices. In addition, an illustrate example is given to show that our main theorem is non-trivial and valuable.


title: HEDGE: Efficient Traffic Classification of Encrypted and Compressed Packets

abstract: As the size and source of network traffic increase, so does the challenge of monitoring and analysing network traffic. Therefore, sampling algorithms are often used to alleviate these scalability issues. However, the use of high entropy data streams, through the use of either encryption or compression, further compounds the challenge as current state of the art algorithms cannot accurately and efficiently differentiate between encrypted and compressed packets. In this work, we propose a novel traffic classification method named HEDGE (High Entropy DistinGuishEr) to distinguish between compressed and encrypted traffic. HEDGE is based on the evaluation of the randomness of the data streams and can be applied to individual packets without the need to have access to the entire stream. Findings from the evaluation show that our approach outperforms current state of the art. We also make available our statistically sound dataset, based on known benchmarks, to the wider research community.


title: Autonomous skill discovery with Quality-Diversity and Unsupervised Descriptors

abstract: Quality-Diversity optimization is a new family of optimization algorithms that, instead of searching for a single optimal solution to solving a task, searches for a large collection of solutions that all solve the task in a different way. This approach is particularly promising for learning behavioral repertoires in robotics, as such a diversity of behaviors enables robots to be more versatile and resilient. However, these algorithms require the user to manually define behavioral descriptors, which is used to determine whether two solutions are different or similar. The choice of a behavioral descriptor is crucial, as it completely changes the solution types that the algorithm derives. In this paper, we introduce a new method to automatically define this descriptor by combining Quality-Diversity algorithms with unsupervised dimensionality reduction algorithms. This approach enables robots to autonomously discover the range of their capabilities while interacting with their environment. The results from two experimental scenarios demonstrate that robot can autonomously discover a large range of possible behaviors, without any prior knowledge about their morphology and environment. Furthermore, these behaviors are deemed to be similar to handcrafted solutions that uses domain knowledge and significantly more diverse than when using existing unsupervised methods.


title: Can we disregard the whole model? Omnibus non-inferiority testing for $R^{2}$ in multivariable linear regression and $\hat{\eta}^{2}$ in ANOVA

abstract: Determining a lack of association between an outcome variable and a number of different explanatory variables is frequently necessary in order to disregard a proposed model (i.e., to confirm the lack of an association between an outcome and predictors). Despite this, the literature rarely offers information about, or technical recommendations concerning, the appropriate statistical methodology to be used to accomplish this task. This paper introduces non-inferiority tests for ANOVA and linear regression analyses, that correspond to the standard widely used $F$-test for $\hat{\eta}^2$ and $R^{2}$, respectively. A simulation study is conducted to examine the type I error rates and statistical power of the tests, and a comparison is made with an alternative Bayesian testing approach. The results indicate that the proposed non-inferiority test is a potentially useful tool for 'testing the null.'


title: Adversarial Robustness Guarantees for Classification with Gaussian Processes

abstract: We investigate adversarial robustness of Gaussian Process Classification (GPC) models. Given a compact subset of the input space $T\subseteq \mathbb{R}^d$ enclosing a test point $x^*$ and a GPC trained on a dataset $\mathcal{D}$, we aim to compute the minimum and the maximum classification probability for the GPC over all the points in $T$. In order to do so, we show how functions lower- and upper-bounding the GPC output in $T$ can be derived, and implement those in a branch and bound optimisation algorithm. For any error threshold $\epsilon > 0$ selected a priori, we show that our algorithm is guaranteed to reach values $\epsilon$-close to the actual values in finitely many iterations. We apply our method to investigate the robustness of GPC models on a 2D synthetic dataset, the SPAM dataset and a subset of the MNIST dataset, providing comparisons of different GPC training techniques, and show how our method can be used for interpretability analysis. Our empirical analysis suggests that GPC robustness increases with more accurate posterior estimation.


title: Chasing Convex Bodies with Linear Competitive Ratio

abstract: We study the problem of chasing convex bodies online: given a sequence of convex bodies $K_t\subseteq \mathbb{R}^d$ the algorithm must respond with points $x_t\in K_t$ in an online fashion (i.e., $x_t$ is chosen before $K_{t+1}$ is revealed). The objective is to minimize the sum of distances between successive points in this sequence. Bubeck et al. (STOC 2019) gave a $2^{O(d)}$-competitive algorithm for this problem. We give an algorithm that is $O(\min(d, \sqrt{d \log T}))$-competitive for any sequence of length $T$.


title: Candidates for RR~Lyrae in binary systems from the OGLE Galactic bulge survey

abstract: We present 20 newly discovered candidates for binary systems with an RR~Lyrae companion. Using the photometric data from the Optical Gravitational Lensing Experiment (OGLE) and Korea Microlensing Telescope Network (KMTNet) for the Galactic bulge, we searched for binary candidates among non-modulated fundamental-mode RR~Lyrae variables. We constructed and investigated over 9000 $O-C$ diagrams for individual pulsators, in order to find signs of the light-travel time effect. We found 20 variables exhibiting cyclic variation in the $O-C$ (time of the observed minus calculated brightness maximum) diagram, which can be associated with a second component in the system, but for confirmation of binarity, a long-term radial velocity study is necessary. The modeling of the $O-C$ diagrams yields orbital parameters, estimates of the semi-amplitude of the radial velocity curve, and the mass function. The orbital periods of our candidates range from 3 to 15 years. Two of the binary candidates display a minimum mass higher than the assumed mass of the RR~Lyrae component, which points towards an evolved companion that can under some circumstances contribute significantly to the total light of the system.


title: Saving Tachyons in Open String Theory

abstract: Using string scattering amplitudes of open bosonic string on a single $D$-brane, we construct a local field theoretical action for tachyon fields. Cubic local interactions between various particles, belonging to the particle spectrum of string may be directly followed from three-string scattering amplitude. These cubic local interactions may generate perturbative non-local four-particle interactions, which may contribute to four-string scattering amplitude. It was observed that tachyon field in open bosonic string theory must be represented by a complex field in order to reproduce the Veneziano amplitude, describing four-tachyon scattering. The Veneziano amplitude, expanded in terms of $s$-channel poles was compared with the four-tachyon scattering amplitudes in $s$-channel generated perturbatively and it was found that a quartic potential term is needed in the local field theoretical action, which describes open string theory effectively in the low energy regime. With this quartic term, the tachyon potential has a stable minimum point and the tachyon field may condensate. As a result, both tachyon and gauge fields become massive at Planck scale and completely disappear from the low energy particle spectrum.


title: Hydras and IPFS: A Decentralised Playground for Malware

abstract: Modern malware can take various forms, and has reached a very high level of sophistication in terms of its penetration, persistence, communication and hiding capabilities. The use of cryptography, and of covert communication channels over public and widely used protocols and services, is becoming a norm. In this work, we start by introducing Resource Identifier Generation Algorithms. These are an extension of a well-known mechanism called Domain Generation Algorithms (DGA), which are frequently employed by cybercriminals for bot management and communication. Our extension allows, beyond DNS, the use of other protocols. More concretely, we showcase the exploitation of the InterPlanetary file system (IPFS). This is a solution for the "permanent web", which enjoys a steadily growing community interest and adoption. The IPFS is, in addition, one of the most prominent solutions for blockchain storage. We go beyond the straightforward case of using the IPFS for hosting malicious content, and explore ways in which a botmaster could employ it, to manage her bots, validating our findings experimentally. Finally, we discuss the advantages of our approach for malware authors, its efficacy and highlight its extensibility for other distributed storage services.


title: Why gradient clipping accelerates training: A theoretical justification for adaptivity

abstract: We provide a theoretical explanation for the effectiveness of gradient clipping in training deep neural networks. The key ingredient is a new smoothness condition derived from practical neural network training examples. We observe that gradient smoothness, a concept central to the analysis of first-order optimization algorithms that is often assumed to be a constant, demonstrates significant variability along the training trajectory of deep neural networks. Further, this smoothness positively correlates with the gradient norm, and contrary to standard assumptions in the literature, it can grow with the norm of the gradient. These empirical observations limit the applicability of existing theoretical analyses of algorithms that rely on a fixed bound on smoothness. These observations motivate us to introduce a novel relaxation of gradient smoothness that is weaker than the commonly used Lipschitz smoothness assumption. Under the new condition, we prove that two popular methods, namely, \emph{gradient clipping} and \emph{normalized gradient}, converge arbitrarily faster than gradient descent with fixed stepsize. We further explain why such adaptively scaled gradient methods can accelerate empirical convergence and verify our results empirically in popular neural network training settings.


title: Statistical bounds for entropic optimal transport: sample complexity and the central limit theorem

abstract: We prove several fundamental statistical bounds for entropic OT with the squared Euclidean cost between subgaussian probability measures in arbitrary dimension. First, through a new sample complexity result we establish the rate of convergence of entropic OT for empirical measures. Our analysis improves exponentially on the bound of Genevay et al. (2019) and extends their work to unbounded measures. Second, we establish a central limit theorem for entropic OT, based on techniques developed by Del Barrio and Loubes (2019). Previously, such a result was only known for finite metric spaces. As an application of our results, we develop and analyze a new technique for estimating the entropy of a random variable corrupted by gaussian noise.


title: A Case Study on the Effects of Partial Solar Eclipse on Distributed Photovoltaic Systems and Management Areas

abstract: Photovoltaic (PV) systems depend on irradiance, ambient temperature and module temperature. A solar eclipse causes significant changes in these parameters, thereby impacting PV generation profile, performance, and power quality of larger grid where they connect to. This paper presents a case study to evaluate the impacts of the solar eclipse of August 21, 2017 on two real-world grid-tied PV systems (1.4MW and 355kW) in Miami and Daytona, Florida, the feeders they are connected to, and the management areas they belong to. Four types of analyses are conducted to obtain a comprehensive picture of the impacts using 1-minute PV generation data, hourly weather data, real feeder parameters, and daily reliability data. These analyses include: individual PV system performance measurement using power performance index; power quality analysis at the point of interconnection; a study on the operation of voltage regulating devices on the feeders during eclipse peak using an IEEE 8500 test case distribution feeder; and reliability study involving a multilayer perceptron framework for forecasting system reliability of the management areas. Results from this study provide a unique insight into how solar eclipses impact the behavior of PV systems and the grid, which would be of concern to electric utilities in future high penetration scenarios.


title: Sub-100 nanosecond temporally resolved imaging with the Medipix3 direct electron detector

abstract: Detector developments are currently enabling new capabilities in the field of transmission electron microscopy (TEM). We have investigated the limits of a hybrid pixel detector, Medipix3, to record dynamic, time varying, electron signals. Operating with an energy of 60keV, we have utilised electrostatic deflection to oscillate electron beam position on the detector. Adopting a pump-probe imaging strategy we have demonstrated that temporal resolutions three orders of magnitude smaller than are available for typically used TEM imaging detectors are possible. Our experiments have shown that energy deposition of the primary electrons in the hybrid pixel detector limits the overall temporal resolution. Through adjustment of user specifiable thresholds or the use of charge summing mode, we have obtained images composed from summing 10,000s frames containing single electron events to achieve temporal resolution less than 100ns. We propose that this capability can be directly applied to studying repeatable material dynamic processes but also to implement low-dose imaging schemes in scanning transmission electron microscopy.


title: Differentiable Ranks and Sorting using Optimal Transport

abstract: Sorting an array is a fundamental routine in machine learning, one that is used to compute rank-based statistics, cumulative distribution functions (CDFs), quantiles, or to select closest neighbors and labels. The sorting function is however piece-wise constant (the sorting permutation of a vector does not change if the entries of that vector are infinitesimally perturbed) and therefore has no gradient information to back-propagate. We propose a framework to sort elements that is algorithmically differentiable. We leverage the fact that sorting can be seen as a particular instance of the optimal transport (OT) problem on $\mathbb{R}$, from input values to a predefined array of sorted values (e.g. $1,2,\dots,n$ if the input array has $n$ elements). Building upon this link , we propose generalized CDFs and quantile operators by varying the size and weights of the target presorted array. Because this amounts to using the so-called Kantorovich formulation of OT, we call these quantities K-sorts, K-CDFs and K-quantiles. We recover differentiable algorithms by adding to the OT problem an entropic regularization, and approximate it using a few Sinkhorn iterations. We call these operators S-sorts, S-CDFs and S-quantiles, and use them in various learning settings: we benchmark them against the recently proposed neuralsort [Grover et al. 2019], propose applications to quantile regression and introduce differentiable formulations of the top-k accuracy that deliver state-of-the art performance.


title: Towards a Model-Independent Measurement of the Halo Mass Function with Observables

abstract: In the CDM paradigm, the halo mass function is a sensitive probe of the cosmic structure. In observations, halo mass is typically estimated from its relation with other observables. The resulting halo mass function is subject to systematic bias, such as the Eddington bias, due to the scatter or uncertainty in the observable - mass relation. Exact correction for the bias is not easy, as predictions for the observables are typically model-dependent in simulations. In this paper, we point out an interesting feature in the halo mass function of the concordence $\Lambda$CDM model: the total halo mass within each evenly-spaced logarithmic mass bin is approximately the same over a large mass range. We show that this property allows us to construct an almost bias-free halo mass function using only an observable (as a halo mass estimator) and stacked weak lensing measurements as long as the scatter between the true halo mass and the observable-inferred mass has a stable form in logarithmic units. The method is not sensitive to the form of the mass-observable relation. We test the idea using cosmological simulations, and show that the method performs very well for realistic observables.


title: On Dropout and Nuclear Norm Regularization

abstract: We give a formal and complete characterization of the explicit regularizer induced by dropout in deep linear networks with squared loss. We show that (a) the explicit regularizer is composed of an $\ell_2$-path regularizer and other terms that are also re-scaling invariant, (b) the convex envelope of the induced regularizer is the squared nuclear norm of the network map, and (c) for a sufficiently large dropout rate, we characterize the global optima of the dropout objective. We validate our theoretical findings with empirical results.


title: Communication Complexity in Locally Private Distribution Estimation and Heavy Hitters

abstract: We consider the problems of distribution estimation and heavy hitter (frequency) estimation under privacy and communication constraints. While these constraints have been studied separately, optimal schemes for one are sub-optimal for the other. We propose a sample-optimal $\varepsilon$-locally differentially private (LDP) scheme for distribution estimation, where each user communicates only one bit, and requires no public randomness. We show that Hadamard Response, a recently proposed scheme for $\varepsilon$-LDP distribution estimation is also utility-optimal for heavy hitter estimation. Finally, we show that unlike distribution estimation, without public randomness where only one bit suffices, any heavy hitter estimation algorithm that communicates $o(\min \{\log n, \log k\})$ bits from each user cannot be optimal.


title: Heavy neutrino production via $Z'$ at the lifetime frontier

abstract: We investigate the pair production of right-handed neutrinos from the decay of an additional neutral $Z^{\prime}$ boson in the gauged $B-L$ model. Taking into account current constraints on the $Z^{\prime}$ mass and the associated gauge coupling $g_{1}^{\prime}$, we analyse the sensitivity of proposed experiments at the lifetime frontier, FASER 2, CODEX-b, MATHUSLA as well as a hypothetical version of the MAPP detector to a long lived heavy neutrino $N$ originating in the decays of the $Z^{\prime}$. We further complement this study with determining the reach of LHCb and a CMS-type detector for the high-luminosity LHC run. We demonstrate that in a background free scenario with $g_1^\prime = 10^{-3}$ near the current limit, FASER 2 is sensitive to the active-sterile neutrino mixing down to $V_{\mu N} \approx 10^{-4}$, while a reach of $V_{\mu N} \approx 10^{-5}$ can be obtained for CODEX-b and LHCb, in a mass regime of $m_N \approx 5-20$ GeV and $m_{Z^{\prime}} \approx 20-70$ GeV. Finally, MATHUSLA can probe $V_{\mu N} \approx 10^{-7}$ and cover the mixing regime expected in a canonical seesaw scenario of light neutrino mass generation.


title: Anomaly scores for generative models

abstract: Reconstruction error is a prevalent score used to identify anomalous samples when data are modeled by generative models, such as (variational) auto-encoders or generative adversarial networks. This score relies on the assumption that normal samples are located on a manifold and all anomalous samples are located outside. Since the manifold can be learned only where the training data lie, there are no guarantees how the reconstruction error behaves elsewhere and the score, therefore, seems to be ill-defined. This work defines an anomaly score that is theoretically compatible with generative models, and very natural for (variational) auto-encoders as they seem to be prevalent. The new score can be also used to select hyper-parameters and models. Finally, we explain why reconstruction error delivers good experimental results despite weak theoretical justification.


title: Polynomial Scaling of Numerical Diagonalization of the 1D Transverse Field Ising Model into a Commuting Basis using the Pauli Product Representation

abstract: We report numerical results on the diagonalization of 1D transverse field Ising model. Numerical simulations using the Pauli product representation yield diagonalization from 3 spins to 22 spins in the transverse field Ising model with the number of global Jacobi unitary transformations and number of final terms in diagonalized spin z representation both grew polynomial with the number of spins. These results computed on a classical computer show promise in constructing a quantum circuit to simulate diagonalized generic many-particle Hamiltonians using polynomial number of gates.


title: Is it possible for a perovskite p-n homojunction to persist in the presence of mobile ionic charge?

abstract: Recently Cui et al. reported on the fabrication a p-n homojunction perovskite solar cell (PSC) using stoichiometric control of sequentially-deposited perovskite layers. The authors propose that the junction leads to an enhanced electric field in the perovskite absorber resulting in improved charge separation. In this response to Cui et al. 2019 we show that the experimental data presented in the paper does not directly support this claim. Furthermore, Cui et al.'s thesis is not compatible with the large body of existing literature showing that mobile ionic defects present in methyl-ammonium lead iodide (MAPI) and its derivatives are highly mobile at room temperature. Using drift diffusion device simulations we show that large densities of mobile ionic charge in the system are likely to the screen any beneficial effects of a p-n homojunction.


title: BreizhCrops: A Time Series Dataset for Crop Type Mapping

abstract: We present Breizhcrops, a novel benchmark dataset for the supervised classification of field crops from satellite time series. We aggregated label data and Sentinel-2 top-of-atmosphere as well as bottom-of-atmosphere time series in the region of Brittany (Breizh in local language), north-east France. We compare seven recently proposed deep neural networks along with a Random Forest baseline. The dataset, model (re-)implementations and pre-trained model weights are available at the associated GitHub repository (https://github.com/dl4sits/BreizhCrops) that has been designed with applicability for practitioners in mind. We plan to maintain the repository with additional data and welcome contributions of novel methods to build a state-of-the-art benchmark on methods for crop type mapping.


title: Jet hadronization at LHCb

abstract: In high energy proton-proton collisions, collimated sprays of particles, called jets, result from hard scattered quarks or gluons. Jets are copiously produced in these collisions; however, the dynamic process through which quarks and gluons, collectively referred to as partons, become bound state hadrons is still not well understood. Jets provide an excellent tool to study this process as they are proxies for the scattered parton; therefore, final-state hadrons can be measured with respect to an observable that is correlated to the scattered parton. The LHCb experiment is in an excellent position to measure hadrons within jets due to its excellent tracking and particle-identification capabilities. In this talk, new measurements of charged hadrons within jets measured opposite a $Z$ boson will be presented from the LHCb collaboration.


title: Mesh Refinement Method for Solving Bang-Bang Optimal Control Problems Using Direct Collocation

abstract: A mesh refinement method is developed for solving bang-bang optimal control problems using direct collocation. The method starts by finding a solution on a coarse mesh. Using this initial solution, the method then determines automatically if the Hamiltonian is linear with respect to the control, and, if so, estimates the locations of the discontinuities in the control. The switch times are estimated by determining the roots of the switching functions, where the switching functions are determined using estimates of the state and costate obtained from the collocation method. The accuracy of the switch times is then improved on subsequent meshes by dividing the original optimal control problem into multiple domains and including variables that define the locations of the switch times. While in principle any collocation method can be used, in this research the previously developed Legendre-Gauss-Radau collocation method is employed because it provides an accurate approximation of the costate which in turn improves the approximation of the switching functions. The method of this paper is designed to be used with a previously developed mesh refinement method in order to accurately approximate the solution in segments where the solution is smooth. The method is demonstrated on three examples where it is shown to accurately determine the switching structure of a bang-bang optimal control problem. When compared with previously developed mesh refinement methods, the results demonstrate that the method developed in this paper improves computational efficiency when solving bang-bang optimal control problems.


title: Results from the STEREO Experiment with 119 days of Reactor-on Data

abstract: In the past decades, short baseline neutrino oscillation studies around experimental or commercial reactor cores have revealed two anomalies. The first one is linked to the absolute flux and the second one to the spectral shape. The first anomaly, called Reactor Antineutrino Anomaly (RAA), could be explained by the introduction of a new oscillation of antineutrinos towards a sterile state of the eV mass. The \stereo detector has been taking data since the end of 2016 at 10~m from the core of the Institut Laue-Langevin research reactor, Grenoble, France. The separation of its Target volume along the neutrino propagation axis allows for measurements of the neutrino spectrum at multiple baselines, providing a clear test of an oscillation at short baseline. In this contribution, a special focus is put on the data analysis and the neutrino extraction using the Pulse Shape Discrimination observable. The results from 119 days of reactor turned on and 210 days of reactor turned off are then reported. The resulting antineutrino rate is (365.7~$\pm$~3.2) \anue /day. The test of a new oscillation towards a sterile neutrino is found to be compatible with the non-oscillation hypothesis and the best fit of the RAA is excluded at 99\% C.L.


title: Spectropolarimetry of the superwind filaments of the starburst galaxy M82 II: kinematics of the dust surrounding the nuclear starburst

abstract: We performed deep spectropolarimetric observations of a prototypical starburst galaxy M82 with the Subaru Telescope in order to study the kinematics of the dust outflow. We obtained optical polarized emission-line spectra up to $\sim$4~kpc away from the nucleus of the galaxy along three position angles within the conical outflowing wind (superwind). The H$\alpha$ emission line in the superwind is strongly polarized and the polarization pattern shows dust scattering of central light sources, being consistent with the previous works. The intensity weighted polarization degree of the H$\alpha$ line reaches $\sim$30\%\ at maximum. There are at least two light sources at the central region of the galaxy; one of which is located at the near-infrared nucleus and the other resides at one of the peaks of the 3 mm radio and molecular gas emission. The outer (> 1 kpc) dust is illuminated by the former, whereas the inner dust is scattering the light from the latter. We investigated as well the dust motion from the velocity field of the polarized H$\alpha$ emission line. The dust is accelerated outward on the northwest side of the nucleus. A simple bi-conical dust outflow model shows that the outflow velocity of the dust reaches $\gtrsim 300-450$ km/s at $\sim 4$ kpc from the nucleus, suggesting that some portion of the dust escapes from the gravitational potential of M82 into the intergalactic space. At some regions on the southeast side, in particular along the position angle of 138$^\circ$, the dust has radial velocity slower than the systemic velocity of the galaxy, apparently suggesting inflowing motion toward the nucleus. These components are spatially consistent with a part of the molecular gas stream, which is kinematically independent of the outflow gas, thus the apparent inflow motion of the dust reflects the streaming motion associated with the molecular gas stream.


title: CGPOPS: A C++ Software for Solving Multiple-Phase Optimal Control Problems Using Adaptive Gaussian Quadrature Collocation and Sparse Nonlinear Programming

abstract: A general-purpose C++ software program called $\mathbb{CGPOPS}$ is described for solving multiple-phase optimal control problems using adaptive Gaussian quadrature collocation. The software employs a Legendre-Gauss-Radau direct orthogonal collocation method to transcribe the continuous-time optimal control problem into a large sparse nonlinear programming problem. A class of $hp$ mesh refinement methods are implemented which determine the number of mesh intervals and the degree of the approximating polynomial within each mesh interval to achieve a specified accuracy tolerance. The software is interfaced with the open source Newton NLP solver IPOPT. All derivatives required by the NLP solver are computed using either central finite differencing, bicomplex-step derivative approximation, hyper-dual derivative approximation, or automatic differentiation. The key components of the software are described in detail and the utility of the software is demonstrated on five optimal control problems of varying complexity. The software described in this article provides a computationally efficient and accurate approach for solving a wide variety of complex constrained optimal control problems.


title: Analysis of backward Euler/Spectral discretization for an evolutionary mass and heat transfer in porous medium

abstract: This paper presents the unsteady Darcy's equations coupled with two nonlinear reaction-diffusion equations, namely this system describes the mass concentration and heat transfer in porous media. The existence and uniqueness of the solution are established for both the variational formulation problem and for its discrete one obtained using spectral discretization. Optimal a priori estimates are given using the Brezzi-Rappaz-Raviart theorem. We conclude by some numerical tests which are in agreement with our theoretical results.


title: Beyond Personalization: Social Content Recommendation for Creator Equality and Consumer Satisfaction

abstract: An effective content recommendation in modern social media platforms should benefit both creators to bring genuine benefits to them and consumers to help them get really interesting content. In this paper, we propose a model called Social Explorative Attention Network (SEAN) for content recommendation. SEAN uses a personalized content recommendation model to encourage personal interests driven recommendation. Moreover, SEAN allows the personalization factors to attend to users' higher-order friends on the social network to improve the accuracy and diversity of recommendation results. Constructing two datasets from a popular decentralized content distribution platform, Steemit, we compare SEAN with state-of-the-art CF and content based recommendation approaches. Experimental results demonstrate the effectiveness of SEAN in terms of both Gini coefficients for recommendation equality and F1 scores for recommendation performance.


title: Revisiting Low-Resource Neural Machine Translation: A Case Study

abstract: It has been shown that the performance of neural machine translation (NMT) drops starkly in low-resource conditions, underperforming phrase-based statistical machine translation (PBSMT) and requiring large amounts of auxiliary data to achieve competitive results. In this paper, we re-assess the validity of these results, arguing that they are the result of lack of system adaptation to low-resource settings. We discuss some pitfalls to be aware of when training low-resource NMT systems, and recent techniques that have shown to be especially helpful in low-resource settings, resulting in a set of best practices for low-resource NMT. In our experiments on German--English with different amounts of IWSLT14 training data, we show that, without the use of any auxiliary monolingual or multilingual data, an optimized NMT system can outperform PBSMT with far less data than previously claimed. We also apply these techniques to a low-resource Korean-English dataset, surpassing previously reported results by 4 BLEU.


title: Correlation Clustering with Adaptive Similarity Queries

abstract: In correlation clustering, we are given $n$ objects together with a binary similarity score between each pair of them. The goal is to partition the objects into clusters so to minimise the disagreements with the scores. In this work we investigate correlation clustering as an active learning problem: each similarity score can be learned by making a query, and the goal is to minimise both the disagreements and the total number of queries. On the one hand, we describe simple active learning algorithms, which provably achieve an almost optimal trade-off while giving cluster recovery guarantees, and we test them on different datasets. On the other hand, we prove information-theoretical bounds on the number of queries necessary to guarantee a prescribed disagreement bound. These results give a rich characterization of the trade-off between queries and clustering error.


title: Efficient Object Embedding for Spliced Image Retrieval

abstract: Detecting spliced images is one of the emerging challenges in computer vision. Unlike prior methods that focus on detecting low-level artifacts generated during the manipulation process, we use an image retrieval approach to tackle this problem. When given a spliced query image, our goal is to retrieve the original image from a database of authentic images. To achieve this goal, we propose representing an image by its constituent objects based on the intuition that the finest granularity of manipulations is oftentimes at the object-level. We introduce a framework, object embeddings for spliced image retrieval (OE-SIR), that utilizes modern object detectors to localize object regions. Each region is then embedded and collectively used to represent the image. Further, we propose a student-teacher training paradigm for learning discriminative embeddings within object regions to avoid expensive multiple forward passes. Detailed analysis of the efficacy of different feature embedding models is also provided in this study. Extensive experimental results show that the OE-SIR achieves state-of-the-art performance in spliced image retrieval.


title: A Bregman forward-backward linesearch algorithm for nonconvex composite optimization: superlinear convergence to nonisolated local minima

abstract: We introduce Bella, a locally superlinearly convergent Bregman forward backward splitting method for minimizing the sum of two nonconvex functions, one of which satisfying a relative smoothness condition and the other one possibly nonsmooth. A key tool of our methodology is the Bregman forward-backward envelope (BFBE), an exact and continuous penalty function with favorable first- and second-order properties, and enjoying a nonlinear error bound when the objective function satisfies a Lojasiewicz-type property. The proposed algorithm is of linesearch type over the BFBE along candidate update directions, and converges subsequentially to stationary points, globally under a KL condition, and owing to the given nonlinear error bound can attain superlinear convergence rates even when the limit point is a nonisolated minimum, provided the directions are suitably selected.


title: Monetary Stabilization in Cryptocurrencies - Design Approaches and Open Questions

abstract: The price volatility of cryptocurrencies is often cited as a major hindrance to their wide-scale adoption. Consequently, during the last two years, multiple so called stablecoins have surfaced---cryptocurrencies focused on maintaining stable exchange rates. In this paper, we systematically explore and analyze the stablecoin landscape. Based on a survey of 24 specific stablecoin projects, we go beyond individual coins for extracting general concepts and approaches. We combine our findings with learnings from classical monetary policy, resulting in a comprehensive taxonomy of cryptocurrency stabilization. We use our taxonomy to highlight the current state of development from different perspectives and show blank spots. For instance, while over 91% of projects promote 1-to-1 stabilization targets to external assets, monetary policy literature suggests that the smoothing of short term volatility is often a more sustainable alternative. Our taxonomy bridges computer science and economics, fostering the transfer of expertise. For example, we find that 38% of the reviewed projects use a combination of exchange rate targeting and specific stabilization techniques that can render them vulnerable to speculative economic attacks - an avoidable design flaw.


title: Exact Solutions in Poincar\'e Gauge Gravity Theory

abstract: In the framework of the gauge theory based on the Poincar\'e symmetry group, the gravitational field is described in terms of the coframe and the local Lorentz connection. Considered as gauge field potentials, they give rise to the corresponding field strength which are naturally identified with the torsion and the curvature on the Riemann--Cartan spacetime. We study the class of quadratic Poincar\'e gauge gravity models with the most general Yang--Mills type Lagrangian which contains all possible parity-even and parity-odd invariants built from the torsion and the curvature. Exact vacuum solutions of the gravitational field equations are constructed as a certain deformation of de Sitter geometry. They are black holes with nontrivial torsion.


title: Dusty disk winds at the sublimation rim of the highly inclined, low mass YSO SU Aurigae

abstract: T Tauri stars are low-mass young stars whose disks provide the setting for planet formation. Despite this, their structure is poorly understood. We present new infrared interferometric observations of the SU Aurigae circumstellar environment that offer 3 x higher resolution and better baseline position angle coverage over previous observations. We investigate the characteristics of circumstellar material around SU Aur, constrain the disk geometry, composition and inner dust rim structure. The CHARA array offers opportunities for long baseline observations, with baselines up to 331 m. Using the CLIMB 3-telescope combiner in the K-band allows us to measure visibilities as well as closure phase. We undertook image reconstruction for model-independent analysis, and geometric modeling. Additionally, the fitting of radiative transfer models constrains the physical parameters of the disk. For the first time, a dusty disk wind is introduced to the radiative transfer code TORUS to model protoplanetary disks. Our implementation is motivated by theoretical dusty disk winds, where magnetic field lines drive dust above the disk plane close to the sublimation zone. Image reconstruction reveals an inclined disk with slight asymmetry along its minor-axis, likely due to inclination effects obscuring the inner disk rim through absorption of incident star light on the near-side and thermal re-emission/scattering of the far-side. Geometric modelling of a skewed ring finds the inner rim at 0.17+/-0.02 au with an inclination of 50.9+/-1.0 degrees and minor axis position angle 60.8+/-1.2 degrees. Radiative transfer modelling shows a flared disk with an inner radius at 0.18 au which implies a grain size of 0.4 um and a scale height of 15.0 au at 100 au. Among the tested radiative transfer models, only the dusty disk wind successfully accounts for the K-band excess by introducing dust above the mid-plane.


title: Big Vector Bundles on Surfaces and Fourfolds

abstract: The aim of this note is to exhibit explicit sufficient criteria ensuring bigness of globally generated, rank-$r$ vector bundles, $r \geqslant 2$, on smooth, projective varieties of even dimension $d \leqslant 4$. We also discuss connections of our general criteria to some recent results of other authors, as well as applications to tangent bundles of Fano varieties, to suitable Lazarsfeld-Mukai bundles on four-folds, etcetera.


title: Electrical conductivity in extremely disordered molybdenum oxynitrides thin films

abstract: We report on the influence of the chemical composition on the electronic properties of molybdenum oxynitrides thin films grown by reactive sputtering on Si (100) substrates at room temperature. The partial pressure of Ar was fixed at 90 %, and the remaining 10 % was adjusted with mixtures N$_2$:O$_2$ (varying from pure N$_2$ to pure O$_2$). The crystalline and electronic structures and the electrical transport of the films depend on the chemical composition. Thin films grown using oxygen mixtures up 2 % have gamma-Mo$_2$N phase and display superconductivity. The superconducting critical temperature T$_c$ reduces from ~ 6.8 K to below 3.0 K as the oxygen increases. On the other hand, films grown using oxygen mixtures richer than 2 % are mostly amorphous. The electrical transport shows a semiconductor-like behavior with variable-range hopping conduction at low temperatures. The analysis of the optical properties reveals that the samples have not a defined semiconductor band gap, which can be related to the high structural disorder and the excitation of electrons in a wide range of energies


title: RecNets: Channel-wise Recurrent Convolutional Neural Networks

abstract: In this paper, we introduce Channel-wise recurrent convolutional neural networks (RecNets), a family of novel, compact neural network architectures for computer vision tasks inspired by recurrent neural networks (RNNs). RecNets build upon Channel-wise recurrent convolutional (CRC) layers, a novel type of convolutional layer that splits the input channels into disjoint segments and processes them in a recurrent fashion. In this way, we simulate wide, yet compact models, since the number of parameters is vastly reduced via the parameter sharing of the RNN formulation. Experimental results on the CIFAR-10 and CIFAR-100 image classification tasks demonstrate the superior size-accuracy trade-off of RecNets compared to other compact state-of-the-art architectures.


title: Controlling Neural Level Sets

abstract: The level sets of neural networks represent fundamental properties such as decision boundaries of classifiers and are used to model non-linear manifold data such as curves and surfaces. Thus, methods for controlling the neural level sets could find many applications in machine learning. In this paper we present a simple and scalable approach to directly control level sets of a deep neural network. Our method consists of two parts: (i) sampling of the neural level sets, and (ii) relating the samples' positions to the network parameters. The latter is achieved by a sample network that is constructed by adding a single fixed linear layer to the original network. In turn, the sample network can be used to incorporate the level set samples into a loss function of interest. We have tested our method on three different learning tasks: improving generalization to unseen data, training networks robust to adversarial attacks, and curve and surface reconstruction from point clouds. For surface reconstruction, we produce high fidelity surfaces directly from raw 3D point clouds. When training small to medium networks to be robust to adversarial attacks we obtain robust accuracy comparable to state-of-the-art methods.


title: A Cross-Domain Transferable Neural Coherence Model

abstract: Coherence is an important aspect of text quality and is crucial for ensuring its readability. One important limitation of existing coherence models is that training on one domain does not easily generalize to unseen categories of text. Previous work advocates for generative models for cross-domain generalization, because for discriminative models, the space of incoherent sentence orderings to discriminate against during training is prohibitively large. In this work, we propose a local discriminative neural model with a much smaller negative sampling space that can efficiently learn against incorrect orderings. The proposed coherence model is simple in structure, yet it significantly outperforms previous state-of-art methods on a standard benchmark dataset on the Wall Street Journal corpus, as well as in multiple new challenging settings of transfer to unseen categories of discourse on Wikipedia articles.


title: Maximal correlation and the rate of Fisher information convergence in the Central Limit Theorem

abstract: We consider the behaviour of the Fisher information of scaled sums of independent and identically distributed random variables in the Central Limit Theorem regime. We show how this behaviour can be related to the second-largest non-trivial eigenvalue associated with the Hirschfeld--Gebelein--R\'{e}nyi maximal correlation. We prove that assuming this eigenvalue satisfies a strict inequality, an $O(1/n)$ rate of convergence and a strengthened form of monotonicity hold.


title: Comer Schemes, Relation Algebras, and the Flexible Atom Conjecture

abstract: In this paper, we consider relational structures arising from Comer's finite field construction, where the cosets need not be sum free. These Comer schemes generalize the notion of a Ramsey scheme and may be of independent interest. As an application, we give the first finite representation of $34_{65}$. This leaves $33_{65}$ as the only remaining relation algebra in the family $N_{65}$ with a flexible atom that is not known to be finitely representable. Motivated by this, we complement our upper bounds with some lower bounds. Using a SAT solver, we show that $33_{65}$ is not finitely representable on fewer than $24$ points, and that $33_{65}$ does not admit a cyclic group representation on fewer than $120$ points. We also employ a SAT solver to show that $34_{65}$ is not representable on fewer than $24$ points.


title: Remarks on generic stability in independent theories

abstract: In NIP theories, generically stable Keisler measures can be characterized in several ways. We analyze these various forms of "generic stability" in arbitrary theories. Among other things, we show that the standard definition of generic stability for types coincides with the notion of a frequency interpretation measure. We also give combinatorial examples of types in NSOP theories that are finitely approximated but not generically stable, as well as $\phi$-types in simple theories that are definable and finitely satisfiable in a small model, but not finitely approximated. Our proofs demonstrate interesting connections to classical results from Ramsey theory for finite graphs and hypergraphs.


title: Selecting the Metric in Hamiltonian Monte Carlo

abstract: We present a selection criterion for the Euclidean metric adapted during warmup in a Hamiltonian Monte Carlo sampler that makes it possible for a sampler to automatically pick the metric based on the model and the availability of warmup draws. Additionally, we present a new adaptation inspired by the selection criterion that requires significantly fewer warmup draws to be effective. The effectiveness of the selection criterion and adaptation are demonstrated on a number of applied problems. An implementation for the Stan probabilistic programming language is provided.


title: Polarization of $\Lambda$ ($\bar{\Lambda}$) hyperons along the beam direction in Au+Au collisions at $\sqrt{s_{_{NN}}}$ = 200 GeV

abstract: The $\Lambda$ ($\bar{\Lambda}$) hyperon polarization along the beam direction has been measured for the first time in Au+Au collisions at $\sqrt{s_{_{NN}}}$ = 200 GeV. The polarization dependence on the hyperons' emission angle relative to the second-order event plane exhibits a sine modulation, indicating a quadrupole pattern of the vorticity component along the beam direction. The polarization is found to increase in more peripheral collisions, and shows no strong transverse momentum ($p_T$) dependence at $p_T>1$ GeV/$c$. The magnitude of the signal is about five times smaller than those predicted by hydrodynamic and multiphase transport models; the observed phase of the emission angle dependence is also opposite to these model predictions. In contrast, blast-wave model calculations reproduce the modulation phase measured in the data and capture the centrality and transverse momentum dependence of the signal once the model is required to reproduce the azimuthal dependence of the Gaussian source radii measured via the Hanbury-Brown and Twiss intensity interferometry technique.


title: Time-dependent relaxation of observables in complex quantum systems

abstract: We consider time-dependent relaxation of observables in quantum systems of chaotic and regular type. We show that the spread of the wave function in the Hilbert space is determined by the survival probability which is known to have pre-exponential, exponential, and long-term power-law limiting behaviors. This result relies on complexity of the wave functions and thus is generic to many systems. In the chaotic limit modeled by the Gaussian Orthogonal Ensemble we show that the survival probability obtained analytically also fully defines the relaxation timescale of observables. This is not the case in general, using realistic nuclear shell model and the quadrupole moment as an observable we demonstrate that the relaxation time is significantly longer than defined by the survival probability of the initial state. An example of the non-chaotic limit of coherent and squeezed states provides an additional illustration.


title: Hamiltonian Analysis In New General Relativity

abstract: It is known that one can formulate an action in teleparallel gravity which is equivalent to general relativity, up to a boundary term. In this geometry we have vanishing curvature, and non-vanishing torsion. The action is constructed by three different contractions of torsion with specific coefficients. By allowing these coefficients to be arbitrary we get the theory which is called `new general relativity'. In this note, the Lagrangian for new general relativity is written down in ADM-variables. In order to write down the Hamiltonian we need to invert the velocities to canonical variables. However, the inversion depends on the specific combination of constraints satisfied by the theory (which depends on the coefficients in the Lagrangian). It is found that one can combine these constraints in 9 different ways to obtain non-trivial theories, each with a different inversion formula.


title: Quantum-capacity bounds in spin-network communication channels

abstract: Using the Lieb-Robinson inequality and the continuity property of the quantum capacities in terms of the diamond norm, we derive an upper bound on the values that these capacities can attain in spin-network communication i.i.d. models of arbitrary topology. Differently from previous results we make no assumptions on the encoding mechanisms that the sender of the messages adopts in loading information on the network.


title: Time-changed Stochastic Control Problem and its Maximum Principle Theory

abstract: This paper studies a time-changed stochastic control problem, where the underlying stochastic process is a L\'evy noise time-changed by an inverse subordinator. We establish a maximum principle theory for the time-changed stochastic control problem. We also prove the existence and uniqueness of the corresponding time-changed backward stochastic differential equation involved in the stochastic control problem. Some examples are provided for illustration.


title: FireNet: A Specialized Lightweight Fire & Smoke Detection Model for Real-Time IoT Applications

abstract: Fire disasters typically result in lot of loss to life and property. It is therefore imperative that precise, fast, and possibly portable solutions to detect fire be made readily available to the masses at reasonable prices. There have been several research attempts to design effective and appropriately priced fire detection systems with varying degrees of success. However, most of them demonstrate a trade-off between performance and model size (which decides the model's ability to be installed on portable devices). The work presented in this paper is an attempt to deal with both the performance and model size issues in one design. Toward that end, a `designed-from-scratch' neural network, named FireNet, is proposed which is worthy on both the counts: (i) it has better performance than existing counterparts, and (ii) it is lightweight enough to be deploy-able on embedded platforms like Raspberry Pi. Performance evaluations on a standard dataset, as well as our own newly introduced custom-compiled fire dataset, are extremely encouraging.


title: Lifting of states in 2-dimensional $N=4$ supersymmetric CFTs

abstract: We consider states of the D1-D5 CFT where only the left-moving sector is excited. As we deform away from the orbifold point, some of these states will remain BPS while others can `lift'. The lifting can be computed by a path integral containing two twist deformations; however, the relevant 4-point amplitude cannot be computed explicitly in many cases. We analyze an older proposal by Gava and Narain where the lift can be computed in terms of a finite number of 3-point functions. A direct Hamiltonian decomposition of the path integral involves an infinite number of 3-point functions, as well the first order correction to the starting state. We note that these corrections to the state account for the infinite number of 3-point functions arising from higher energy states, and one can indeed express the path-integral result in terms of a finite number of 3-point functions involving only the leading order states that are degenerate. The first order correction to the supercharge $\bar G^{(1)}$ gets replaced by a projection $\bar G^{(P)}$; this projected operator can also be used to group the states into multiplets whose members have the same lifting.


title: Paper Matching with Local Fairness Constraints

abstract: Automatically matching reviewers to papers is a crucial step of the peer review process for venues receiving thousands of submissions. Unfortunately, common paper matching algorithms often construct matchings suffering from two critical problems: (1) the group of reviewers assigned to a paper do not collectively possess sufficient expertise, and (2) reviewer workloads are highly skewed. In this paper, we propose a novel local fairness formulation of paper matching that directly addresses both of these issues. Since optimizing our formulation is not always tractable, we introduce two new algorithms, FairIR and FairFlow, for computing fair matchings that approximately optimize the new formulation. FairIR solves a relaxation of the local fairness formulation and then employs a rounding technique to construct a valid matching that provably maximizes the objective and only compromises on fairness with respect to reviewer loads and papers by a small constant. In contrast, FairFlow is not provably guaranteed to produce fair matchings, however it can be 2x as efficient as FairIR and an order of magnitude faster than matching algorithms that directly optimize for fairness. Empirically, we demonstrate that both FairIR and FairFlow improve fairness over standard matching algorithms on real conference data. Moreover, in comparison to state-of-the-art matching algorithms that optimize for fairness only, FairIR achieves higher objective scores, FairFlow achieves competitive fairness, and both are capable of more evenly allocating reviewers.


title: Cost-Based Approach to Complexity: A Common Denominator?

abstract: Complexity remains one of the central challenges in science and technology. Although several approaches at defining and/or quantifying complexity have been proposed, at some point each of them seems to run into intrinsic limitations or mutual disagreement. Two are the main objectives of the present work: (i) to review some of the main approaches to complexity; and (ii) to suggest a cost-based approach that, to a great extent, can be understood as an integration of the several facets of complexity while keeping its meaning for humans in mind. More specifically, it is poised that complexity, an inherently relative and subjective concept, can be summarized as the cost of developing a model, plus the cost of its respective operation. As a consequence, complexity can vary along time and space. The proposal is illustrated respectively to several applications examples, including a real-data base situation.


title: Network Deconvolution

abstract: Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels are in effect re-learning redundant data. In this work, we show that this redundancy has made neural network training challenging, and propose network deconvolution, a procedure which optimally removes pixel-wise and channel-wise correlations before the data is fed into each layer. Network deconvolution can be efficiently calculated at a fraction of the computational cost of a convolution layer. We also show that the deconvolution filters in the first layer of the network resemble the center-surround structure found in biological neurons in the visual regions of the brain. Filtering with such kernels results in a sparse representation, a desired property that has been missing in the training of neural networks. Learning from the sparse representation promotes faster convergence and superior results without the use of batch normalization. We apply our network deconvolution operation to 10 modern neural network models by replacing batch normalization within each. Extensive experiments show that the network deconvolution operation is able to deliver performance improvement in all cases on the CIFAR-10, CIFAR-100, MNIST, Fashion-MNIST, Cityscapes, and ImageNet datasets.


title: Consistency of two different approaches to determine the strength of a pairing residual interaction in the rare-earth region

abstract: Two fits of the pairing residual interaction in the rare-earth region are independently performed. One is made on the odd-even staggering of masses by comparing measured and explicitly calculated three-point binding-energy differences centered on odd-even nuclei. Another deals with the moments of inertia of the first 2+ states of well deformed even-even nuclei upon comparing experimental data with the results of Inglis-Belyaev moments (supplemented by a crude estimate of the so-called Thouless-Valatin corrections). The sample includes 24 even-even and 31 odd-mass nuclei selected according to two criteria: they should have good rotor properties and should not correspond to low pairing-correlation regimes in their ground states. Calculations are performed in the self-consistent Hartree-Fock plus BCS framework (implementing a self-consistent blocking in the case of odd-mass nuclei). The Skyrme SIII parametrization is used in the particle-hole channel and the fitted quantities are the strengths of |Tz|=1 proton and neutron seniority residual interactions. As a result, the two fits yield sets of strengths in excellent agreement: about 0.1% for the neutron parameters and 0.2% for protons. In contrast when one performs such a fit on odd-even staggering from quantities deduced from BCS gaps or minimal quasiparticle energies in even-even nuclei, as is traditional, one obtains results significantly different from those obtained in the same nuclei by a fit of moments of inertia. As a conclusion, beyond providing a phenomenological tool for microscopic calculations in this region, we have illustrated the proposition made in the seminal paper of Bohr, Mottelson and Pines that moments of inertia and odd-even staggering in selected nuclei were excellent measuring sticks of nuclear pairing correlations.


title: SignalTrain: Profiling Audio Compressors with Deep Neural Networks

abstract: In this work we present a data-driven approach for predicting the behavior of (i.e., profiling) a given non-linear audio signal processing effect (henceforth "audio effect"). Our objective is to learn a mapping function that maps the unprocessed audio to the processed by the audio effect to be profiled, using time-domain samples. To that aim, we employ a deep auto-encoder model that is conditioned on both time-domain samples and the control parameters of the target audio effect. As a test-case study, we focus on the offline profiling of two dynamic range compression audio effects, one software-based and the other analog. Compressors were chosen because they are a widely used and important set of effects and because their parameterized nonlinear time-dependent nature makes them a challenging problem for a system aiming to profile "general" audio effects. Results from our experimental procedure show that the primary functional and auditory characteristics of the compressors can be captured, however there is still sufficient audible noise to merit further investigation before such methods are applied to real-world audio processing workflows.


title: Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses

abstract: Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more computationally efficient than the conventional artificial neural networks, though their full computational capabilities are yet to be explored. Recently, computational memory architectures based on non-volatile memory crossbar arrays have shown great promise to implement parallel computations in artificial and spiking neural networks. In this work, we experimentally demonstrate for the first time, the feasibility to realize high-performance event-driven in-situ supervised learning systems using nanoscale and stochastic phase-change synapses. Our SNN is trained to recognize audio signals of alphabets encoded using spikes in the time domain and to generate spike trains at precise time instances to represent the pixel intensities of their corresponding images. Moreover, with a statistical model capturing the experimental behavior of the devices, we investigate architectural and systems-level solutions for improving the training and inference performance of our computational memory-based system. Combining the computational potential of supervised SNNs with the parallel compute power of computational memory, the work paves the way for next-generation of efficient brain-inspired systems.


title: Efficient Kirszbraun Extension with Applications to Regression

abstract: We introduce a framework for performing regression between two Hilbert spaces. This is done based on Kirszbraun's extension theorem, to the best of our knowledge, the first application of this technique to supervised learning. We analyze the statistical and computational aspects of this method. We decompose this task into two stages: training (which corresponds operationally to smoothing/regularization) and prediction (which is achieved via Kirszbraun extension). Both are solved algorithmically via a novel multiplicative weight updates (MWU) scheme, which, for our problem formulation, achieves a quadratic runtime improvement over the state of the art. Our empirical results indicate a dramatic improvement over standard off-the-shelf solvers in our setting.


title: Adversarial Domain Adaptation Being Aware of Class Relationships

abstract: Adversarial training is a useful approach to promote the learning of transferable representations across the source and target domains, which has been widely applied for domain adaptation (DA) tasks based on deep neural networks. Until very recently, existing adversarial domain adaptation (ADA) methods ignore the useful information from the label space, which is an important factor accountable for the complicated data distributions associated with different semantic classes. Especially, the inter-class semantic relationships have been rarely considered and discussed in the current work of transfer learning. In this paper, we propose a novel relationship-aware adversarial domain adaptation (RADA) algorithm, which first utilizes a single multi-class domain discriminator to enforce the learning of inter-class dependency structure during domain-adversarial training and then aligns this structure with the inter-class dependencies that are characterized from training the label predictor on source domain. Specifically, we impose a regularization term to penalize the structure discrepancy between the inter-class dependencies respectively estimated from domain discriminator and label predictor. Through this alignment, our proposed method makes the adversarial domain adaptation aware of the class relationships. Empirical studies show that the incorporation of class relationships significantly improves the performance on benchmark datasets.


title: Distributed Antenna Selection for Massive MIMO using Reversing Petri Nets

abstract: Distributed antenna selection for Distributed Massive MIMO (Multiple Input Multiple Output) communication systems reduces computational complexity compared to centralised approaches, and provides high fault tolerance while retaining diversity and spatial multiplexity. We propose a novel distributed algorithm for antenna selection and show its advantage over existing centralised and distributed solutions. The proposed algorithm is shown to perform well with imperfect channel state information, and to execute a small number of simple computational operations per node, converging fast to a steady state. We base it on Reversing Petri Nets, a variant of Petri nets inspired by reversible computation, capable of both forward and backward execution while obeying conservation laws.


title: A Survey of Data Fusion in Smart City Applications

abstract: The advancement of various research sectors such as Internet of Things (IoT), Machine Learning, Data Mining, Big Data, and Communication Technology has shed some light in transforming an urban city integrating the aforementioned techniques to a commonly known term - Smart City. With the emergence of smart city, plethora of data sources have been made available for wide variety of applications. The common technique for handling multiple data sources is data fusion, where it improves data output quality or extracts knowledge from the raw data. In order to cater evergrowing highly complicated applications, studies in smart city have to utilize data from various sources and evaluate their performance based on multiple aspects. To this end, we introduce a multi-perspectives classification of the data fusion to evaluate the smart city applications. Moreover, we applied the proposed multi-perspectives classification to evaluate selected applications in each domain of the smart city. We conclude the paper by discussing potential future direction and challenges of data fusion integration.


title: Downlink Coverage and Rate Analysis of an Aerial User in Vertical Heterogeneous Networks (VHetNets)

abstract: In this paper, we analyze the downlink coverage probability and rate of an aerial user in vertical HetNets (VHetNets) comprising aerial base stations (aerial-BSs) and terrestrial-BSs. The locations of terrestrial-BSs are modeled as an infinite 2-D Poisson Point Process (PPP), while the locations of aerial-BSs are modeled as a finite 2-D Binomial Point Process (BPP). Our cellular-to-air (C2A) channel model incorporates line-of-sight (LoS) and non-LoS transmissions between terrestrial-BSs and a typical aerial user, while we assume LoS transmissions for all aerial links. We assume that the aerial user is associated with an aerial-BS or terrestrial-BS that provides the strongest average received power. Using stochastic geometry, we derive exact and approximate expressions of the coverage probability and rate in terms of interference power's Laplace transform. The expressions are simplified assuming only LoS transmissions for the C2A channels. This enables easy-to-compute equations with good accuracy at elevated aerial user heights. We find that aerial users hovering at low altitudes tend to connect to aerial-BSs in denser terrestrial environments. Employing directive beamforming at aerial-BSs guarantees an acceptable performance at the aerial user by reducing interference signals received from the aerial-BSs. In denser terrestrial networks, the performance at the aerial user degrades substantially despite beamforming.


title: Reconstruction of FRI Signals using Deep Neural Network Approaches

abstract: Finite Rate of Innovation (FRI) theory considers sampling and reconstruction of classes of non-bandlimited continuous signals that have a small number of free parameters, such as a stream of Diracs. The task of reconstructing FRI signals from discrete samples is often transformed into a spectral estimation problem and solved using Prony's method and matrix pencil method which involve estimating signal subspaces. They achieve an optimal performance given by the Cram\'{e}r-Rao bound yet break down at a certain peak signal-to-noise ratio (PSNR). This is probably due to the so-called subspace swap event. In this paper, we aim to alleviate the subspace swap problem and investigate alternative approaches including directly estimating FRI parameters using deep neural networks and utilising deep neural networks as denoisers to reduce the noise in the samples. Simulations show significant improvements on the breakdown PSNR over existing FRI methods, which still outperform learning-based approaches in medium to high PSNR regimes.


title: Bichaoticity Induced by Inherent Birhythmicity during the Oscillatory Electrodissolution of Silicon

abstract: The electrodissolution of p-type silicon in a fluoride-containing electrolyte is a prominent electrochemical oscillator with a still unknown oscillation mechanism. In this article, we present a study of its dynamical states occurring in a wide range of the applied voltage - external resistance parameter plane. We provide evidence that the system possesses inherent birhythmicity, and thus at least two distinct feedback loops promoting oscillatory behaviour. The two parameter regions in which the different limit cycles exist are separated by a band in which the dynamics exhibit bistability between two branches with different multimode oscillations. Following the states along one path through this bistable region, one observes that each branch undergoes a different transition to chaos, namely a period-doubling cascade and a quasiperiodic route with a torus-breakdown, respectively, making Si electrodissolution one of the few experimental systems exhibiting bichaoticity.


title: Efficient MCMC Sampling with Dimension-Free Convergence Rate using ADMM-type Splitting

abstract: Performing exact Bayesian inference for complex models is computationally intractable. Markov chain Monte Carlo (MCMC) algorithms can provide reliable approximations of the posterior distribution but are expensive for large datasets and high-dimensional models. A standard approach to mitigate this complexity consists in using subsampling techniques or distributing the data across a cluster. However, these approaches are typically unreliable in high-dimensional scenarios. We focus here on a recent alternative class of MCMC schemes exploiting a splitting strategy akin to the one used by the celebrated alternating direction of multipliers (ADMM) optimization algorithm. These methods appear to provide empirically state-of-the-art performance but their theoretical behavior in high dimension is currently unknown. In this paper, we propose a detailed theoretical study of one of these algorithms known as the split Gibbs sampler. Under regularity conditions, we establish explicit convergence rates for this scheme using Ricci curvature and coupling ideas. We support our theory with numerical illustrations.


title: Effect of local Peregrine soliton emergence on statistics of random waves in the 1-D focusing Nonlinear Schr\"odinger equation

abstract: The Peregrine soliton is often considered as a prototype of the rogue waves. After recent advances in the semi-classical limit of the 1-D focusing Nonlinear Schr\"odinger (NLS) equation this conjecture can be seen from another perspective. In the present paper, connecting deterministic and statistical approaches, we numerically demonstrate the effect of the universal local appearance of Peregrine solitons on the evolution of statistical properties of random waves. Evidences of this effect are found in recent experimental studies in the contexts of fiber optics and hydrodynamics. The present approach can serve as a powerful tool for the description of the transient dynamics of random waves and provide new insights into the problem of the rogue waves formation.


title: Quantum noise radar: superresolution with quantum antennas by accessing spatiotemporal correlations

abstract: We suggest overcoming the "Rayleigh catastrophe" and reaching superresolution for imaging with both spatially and temporally-correlated field of a superradiant quantum antenna. Considering far-field radiation of two interacting spontaneously emitting two-level systems, we show that for the measurement of the temporally-delayed second-order correlation function of the scattered field, the Fisher information does not tend to zero with diminishing the distance between a pair of scatterers even for non-sharp time-averaged detection. For position estimation of a larger number of scatterers, measurement of the time-delayed function is able to provide a considerable accuracy gain over the zero-delayed function. We show also that the superresolution with the considered quantum antenna can be achieved for both near-field imaging and estimating parameters of the antenna.


title: Cerberus: A Multi-headed Derenderer

abstract: To generalize to novel visual scenes with new viewpoints and new object poses, a visual system needs representations of the shapes of the parts of an object that are invariant to changes in viewpoint or pose. 3D graphics representations disentangle visual factors such as viewpoints and lighting from object structure in a natural way. It is possible to learn to invert the process that converts 3D graphics representations into 2D images, provided the 3D graphics representations are available as labels. When only the unlabeled images are available, however, learning to derender is much harder. We consider a simple model which is just a set of free floating parts. Each part has its own relation to the camera and its own triangular mesh which can be deformed to model the shape of the part. At test time, a neural network looks at a single image and extracts the shapes of the parts and their relations to the camera. Each part can be viewed as one head of a multi-headed derenderer. During training, the extracted parts are used as input to a differentiable 3D renderer and the reconstruction error is backpropagated to train the neural net. We make the learning task easier by encouraging the deformations of the part meshes to be invariant to changes in viewpoint and invariant to the changes in the relative positions of the parts that occur when the pose of an articulated body changes. Cerberus, our multi-headed derenderer, outperforms previous methods for extracting 3D parts from single images without part annotations, and it does quite well at extracting natural parts of human figures.


title: Broadband enhancement of the magneto-optical activity of hybrid Au loaded Bi:YIG

abstract: We unravel the underlying near-field mechanism of the enhancement of the magneto-optical activity of bismuth-substituted yttrium iron garnet films (Bi:YIG) loaded with gold nanoparticles. The experimental results show that the embedded gold nanoparticles lead to a broadband enhancement of the magneto-optical activity with respect to the activity of the bare Bi:YIG films. Full vectorial near- and far-field simulations demonstrate that this broadband enhancement is the result of a magneto-optically enabled cross-talking of orthogonal localized plasmon resonances. Our results pave the way to the on-demand design of the magneto-optical properties of hybrid magneto-plasmonic circuitry.


title: Electron pairing in nanostructures driven by an oscillating field

abstract: It is shown theoretically that the confinement of an electron at a repulsive potential can exist in nanostructures subjected to a strong high-frequency electromagnetic field. As a result of the confinement, the metastable bound electron state of the repulsive potential appears. This effect can lead, particularly, to electron pairing in nanostructures containing conduction electrons with different effective masses.


title: Pseudo-differential representation of the metaplectic transform and its application to fast algorithms

abstract: The metaplectic transform (MT), also known as the linear canonical transform, is a unitary integral mapping which is widely used in signal processing and can be viewed as a generalization of the Fourier transform. For a given function $\psi$ on an $N$-dimensional continuous space $\textbf{q}$, the MT of $\psi$ is parameterized by a rotation (or more generally, a linear symplectic transformation) of the $2N$-dimensional phase space $(\textbf{q},\textbf{p})$, where $\textbf{p}$ is the wavevector space dual to $\textbf{q}$. Here, we derive a pseudo-differential form of the MT. For small-angle rotations, or near-identity transformations of the phase space, it readily yields asymptotic \textit{differential} representations of the MT, which are easy to compute numerically. Rotations by larger angles are implemented as successive applications of $K \gg 1$ small-angle MTs. The algorithm complexity scales as $O(K N^3 N_p)$, where $N_p$ is the number of grid points. We present a numerical implementation of this algorithm and discuss how to mitigate the associated numerical instabilities.


title: Mapping the Galactic disk with the LAMOST and Gaia Red clump sample. II. 3D asymmetrical kinematics of mono-age populations in the disk between 6$-14$ \,kpc

abstract: We perform analysis of the three-dimensional kinematics of Milky Way disk stars in mono-age populations. We focus on stars between Galactocentric distances of $R=6$ and 14 \,kpc, selected from the combined LAMOST DR4 red clump giant stars and Gaia DR2 proper motion catalogue. We confirm the 3D asymmetrical motions of recent works and provide time tagging of the Galactic outer disk asymmetrical motions near the anticenter direction out to Galactocentric distances of 14\,kpc. Radial Galactocentric motions reach values up to 10 km s$^{-1}$, depending on the age of the population, and present a north-south asymmetry in the region corresponding to density and velocity substructures that were sensitive to the perturbations in the early 6 \,Gyr. After that time, the disk stars in this asymmetrical structure have become kinematically hotter, and are thus not sensitive to perturbations, and we find the structure is a relatively younger population. With quantitative analysis, we find stars both above and below the plane at $R\gtrsim 9$ kpc that exhibit bending mode motions of which the sensitive duration is around 8 \,Gyr. We speculate that the in-plane asymmetries might not be mainly caused by a fast rotating bar, intrinsically elliptical outer disk, secular expansion of the disk, or streams. Spiral arm dynamics, out-of-equilibrium models, minor mergers or others are important contributors. Vertical motions might be dominated by bending and breathing modes induced by complicated inner or external perturbers. It is likely that many of these mechanisms are coupled together.


title: A Compact Representation of Histopathology Images using Digital Stain Separation & Frequency-Based Encoded Local Projections

abstract: In recent years, histopathology images have been increasingly used as a diagnostic tool in the medical field. The process of accurately diagnosing a biopsy sample requires significant expertise in the field, and as such can be time-consuming and is prone to uncertainty and error. With the advent of digital pathology, using image recognition systems to highlight problem areas or locate similar images can aid pathologists in making quick and accurate diagnoses. In this paper, we specifically consider the encoded local projections (ELP) algorithm, which has previously shown some success as a tool for classification and recognition of histopathology images. We build on the success of the ELP algorithm as a means for image classification and recognition by proposing a modified algorithm which captures the local frequency information of the image. The proposed algorithm estimates local frequencies by quantifying the changes in multiple projections in local windows of greyscale images. By doing so we remove the need to store the full projections, thus significantly reducing the histogram size, and decreasing computation time for image retrieval and classification tasks. Furthermore, we investigate the effectiveness of applying our method to histopathology images which have been digitally separated into their hematoxylin and eosin stain components. The proposed algorithm is tested on the publicly available invasive ductal carcinoma (IDC) data set. The histograms are used to train an SVM to classify the data. The experiments showed that the proposed method outperforms the original ELP algorithm in image retrieval tasks. On classification tasks, the results are found to be comparable to state-of-the-art deep learning methods and better than many handcrafted features from the literature.


title: EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks

abstract: Convolutional Neural Networks (ConvNets) are commonly developed at a fixed resource budget, and then scaled up for better accuracy if more resources are available. In this paper, we systematically study model scaling and identify that carefully balancing network depth, width, and resolution can lead to better performance. Based on this observation, we propose a new scaling method that uniformly scales all dimensions of depth/width/resolution using a simple yet highly effective compound coefficient. We demonstrate the effectiveness of this method on scaling up MobileNets and ResNet. To go even further, we use neural architecture search to design a new baseline network and scale it up to obtain a family of models, called EfficientNets, which achieve much better accuracy and efficiency than previous ConvNets. In particular, our EfficientNet-B7 achieves state-of-the-art 84.3% top-1 accuracy on ImageNet, while being 8.4x smaller and 6.1x faster on inference than the best existing ConvNet. Our EfficientNets also transfer well and achieve state-of-the-art accuracy on CIFAR-100 (91.7%), Flowers (98.8%), and 3 other transfer learning datasets, with an order of magnitude fewer parameters. Source code is at https://github.com/tensorflow/tpu/tree/master/models/official/efficientnet.


title: Private Identity Testing for High-Dimensional Distributions

abstract: In this work we present novel differentially private identity (goodness-of-fit) testers for natural and widely studied classes of multivariate product distributions: Gaussians in $\mathbb{R}^d$ with known covariance and product distributions over $\{\pm 1\}^{d}$. Our testers have improved sample complexity compared to those derived from previous techniques, and are the first testers whose sample complexity matches the order-optimal minimax sample complexity of $O(d^{1/2}/\alpha^2)$ in many parameter regimes. We construct two types of testers, exhibiting tradeoffs between sample complexity and computational complexity. Finally, we provide a two-way reduction between testing a subclass of multivariate product distributions and testing univariate distributions, and thereby obtain upper and lower bounds for testing this subclass of product distributions.