title: Two-Dimensional Tomography From Noisy Projection Tilt Series Taken At Unknown View Angles With Non-Uniform Distribution

abstract: We consider a problem that recovers a 2-D object and the underlying view angle distribution from its noisy projection tilt series taken at unknown view angles. Traditional approaches rely on the estimation of the view angles of the projections, which do not scale well with the sample size and are sensitive to noise. We introduce a new approach using the moment features to simultaneously recover the underlying object and the distribution of view angles. This problem is formulated as constrained nonlinear least squares in terms of the truncated Fourier-Bessel expansion coefficients of the object and is solved by a new alternating direction method of multipliers (ADMM)-based algorithm. Our numerical experiments show that the new approach outperforms the expectation maximization (EM)-based maximum marginalized likelihood estimation in efficiency and accuracy. Furthermore, the hybrid method that uses EM to refine ADMM solution achieves the best performance.


title: Canonical interpretation of $Y(10750)$ and $\Upsilon(10860)$ in the $\Upsilon$ family

abstract: Inspired by the new resonance $Y(10750)$, we calculate the masses and two-body OZI-allowed strong decays of the higher vector bottomonium sates within both screened and linear potential models. We discuss the possibilities of $\Upsilon(10860)$ and $Y(10750)$ as mixed states via the $S-D$ mixing. Our results suggest that $Y(10750)$ and $\Upsilon(10860)$ might be explained as mixed states between $5S$- and $4D$-wave vector $b\bar{b}$ states. The $Y(10750)$ and $\Upsilon(10860)$ resonances may correspond to the mixed states dominated by the $4D$- and $5S$-wave components, respectively. The mass and the strong decay behaviors of the $\Upsilon(11020)$ resonance are consistent with the assignment of the $\Upsilon(6S)$ state in the potential models.


title: Automatic Machine Learning by Pipeline Synthesis using Model-Based Reinforcement Learning and a Grammar

abstract: Automatic machine learning is an important problem in the forefront of machine learning. The strongest AutoML systems are based on neural networks, evolutionary algorithms, and Bayesian optimization. Recently AlphaD3M reached state-of-the-art results with an order of magnitude speedup using reinforcement learning with self-play. In this work we extend AlphaD3M by using a pipeline grammar and a pre-trained model which generalizes from many different datasets and similar tasks. Our results demonstrate improved performance compared with our earlier work and existing methods on AutoML benchmark datasets for classification and regression tasks. In the spirit of reproducible research we make our data, models, and code publicly available.


title: Mask-Guided Portrait Editing with Conditional GANs

abstract: Portrait editing is a popular subject in photo manipulation. The Generative Adversarial Network (GAN) advances the generating of realistic faces and allows more face editing. In this paper, we argue about three issues in existing techniques: diversity, quality, and controllability for portrait synthesis and editing. To address these issues, we propose a novel end-to-end learning framework that leverages conditional GANs guided by provided face masks for generating faces. The framework learns feature embeddings for every face component (e.g., mouth, hair, eye), separately, contributing to better correspondences for image translation, and local face editing. With the mask, our network is available to many applications, like face synthesis driven by mask, face Swap+ (including hair in swapping), and local manipulation. It can also boost the performance of face parsing a bit as an option of data augmentation.


title: Discrete Flows: Invertible Generative Models of Discrete Data

abstract: While normalizing flows have led to significant advances in modeling high-dimensional continuous distributions, their applicability to discrete distributions remains unknown. In this paper, we show that flows can in fact be extended to discrete events---and under a simple change-of-variables formula not requiring log-determinant-Jacobian computations. Discrete flows have numerous applications. We consider two flow architectures: discrete autoregressive flows that enable bidirectionality, allowing, for example, tokens in text to depend on both left-to-right and right-to-left contexts in an exact language model; and discrete bipartite flows that enable efficient non-autoregressive generation as in RealNVP. Empirically, we find that discrete autoregressive flows outperform autoregressive baselines on synthetic discrete distributions, an addition task, and Potts models; and bipartite flows can obtain competitive performance with autoregressive baselines on character-level language modeling for Penn Tree Bank and text8.


title: Predicting Brazilian court decisions

abstract: Predicting case outcomes is useful but still an extremely hard task for attorneys and other Law professionals. It is not easy to search case information to extract valuable information as this requires dealing with huge data sets and their complexity. For instance, the complexity of Brazil legal system along with the high litigation rates makes this problem even harder. This paper introduces an approach for predicting Brazilian court decisions which is also able to predict whether the decision will be unanimous. We developed a working prototype which performs 79% of accuracy (F1-score) on a data set composed of 4,043 cases from a Brazilian court. To our knowledge, this is the first study to forecast judge decisions in Brazil.


title: Multistability of Driven-Dissipative Quantum Spins

abstract: We study the dynamics of lattice models of quantum spins one-half, driven by a coherent drive and subject to dissipation. Generically the meanfield limit of these models manifests multistable parameter regions of coexisting steady states with different magnetizations. We introduce an efficient scheme accounting for the corrections to meanfield by correlations at leading order, and benchmark this scheme using high-precision numerics based on matrix-product-operators in one- and two-dimensional lattices. Correlations are shown to wash the meanfield bistability in dimension one, leading to a unique steady state. In dimension two and higher, we find that multistability is again possible, provided the thermodynamic limit of an infinitely large lattice is taken first with respect to the long time limit. Variation of the system parameters results in jumps between the different steady states, each showing a critical slowing down in the convergence of perturbations towards the steady state. Experiments with trapped ions can realize the model and possibly answer open questions in the nonequilibrium many-body dynamics of these quantum systems, beyond the system sizes accessible to present numerics.


title: Unsupervised Community Detection with Modularity-Based Attention Model

abstract: In this paper we take a problem of unsupervised nodes clustering on graphs and show how recent advances in attention models can be applied successfully in a "hard" regime of the problem. We propose an unsupervised algorithm that encodes Bethe Hessian embeddings by optimizing soft modularity loss and argue that our model is competitive to both classical and Graph Neural Network (GNN) models while it can be trained on a single graph.


title: Tempus Volat, Hora Fugit -- A Survey of Tie-Oriented Dynamic Network Models in Discrete and Continuous Time

abstract: Given the growing number of available tools for modeling dynamic networks, the choice of a suitable model becomes central. The goal of this survey is to provide an overview of tie-oriented dynamic network models. The survey is focused on introducing binary network models with their corresponding assumptions, advantages, and shortfalls. The models are divided according to generating processes, operating in discrete and continuous time. First, we introduce the Temporal Exponential Random Graph Model (TERGM) and the Separable TERGM (STERGM), both being time-discrete models. These models are then contrasted with continuous process models, focusing on the Relational Event Model (REM). We additionally show how the REM can handle time-clustered observations, i.e., continuous time data observed at discrete time points. Besides the discussion of theoretical properties and fitting procedures, we specifically focus on the application of the models on two networks that represent international arms transfers and email exchange. The data allow to demonstrate the applicability and interpretation of the network models.


title: Topological recursion for Masur-Veech volumes

abstract: We study the Masur-Veech volumes $MV_{g,n}$ of the principal stratum of the moduli space of quadratic differentials of unit area on curves of genus $g$ with $n$ punctures. We show that the volumes $MV_{g,n}$ are the constant terms of a family of polynomials in $n$ variables governed by the topological recursion/Virasoro constraints. This is equivalent to a formula giving these polynomials as a sum over stable graphs, and retrieves a result of \cite{Delecroix} proved by combinatorial arguments. Our method is different: it relies on the geometric recursion and its application to statistics of hyperbolic lengths of multicurves developed in \cite{GRpaper}. We also obtain an expression of the area Siegel--Veech constants in terms of hyperbolic geometry. The topological recursion allows numerical computations of Masur--Veech volumes, and thus of area Siegel--Veech constants, for low $g$ and $n$, which leads us to propose conjectural formulas for low $g$ but all $n$. We also relate our polynomials to the asymptotic counting of square-tiled surfaces with large boundaries.


title: Robust preconditioners for a new stabilized discretization of the poroelastic equations

abstract: In this paper, we present block preconditioners for a stabilized discretization of the poroelastic equations developed in [45]. The discretization is proved to be well-posed with respect to the physical and discretization parameters, and thus provides a framework to develop preconditioners that are robust with respect to such parameters as well. We construct both norm-equivalent (diagonal) and field-of-value-equivalent (triangular) preconditioners for both the stabilized discretization and a perturbation of the stabilized discretization that leads to a smaller overall problem after static condensation. Numerical tests for both two- and three-dimensional problems confirm the robustness of the block preconditioners with respect to the physical and discretization parameters.


title: Likelihood ratio tests for many groups in high dimensions

abstract: In this paper we investigate the asymptotic distribution of likelihood ratio tests in models with several groups, when the number of groups converges with the dimension and sample size to infinity. We derive central limit theorems for the logarithm of various test statistics and compare our results with the approximations obtained from a central limit theorem using a two step procedure: first consider the number of groups fixed and assume that the sample size and dimension converge to infinity, secondly investigating the resulting distribution if the number of groups converges to infinity.


title: Taylor expansions of groups and filtered-formality

abstract: Let $G$ be a finitely generated group, and let $\Bbbk{G}$ be its group algebra over a field of characteristic $0$. A Taylor expansion is a certain type of map from $G$ to the degree completion of the associated graded algebra of $\Bbbk{G}$ which generalizes the Magnus expansion of a free group. The group $G$ is said to be filtered-formal if its Malcev Lie algebra is isomorphic to the degree completion of its associated graded Lie algebra. We show that $G$ is filtered-formal if and only if it admits a Taylor expansion, and derive some consequences.


title: Signatures of the non-Maxwellian $\kappa$-distributions in optically thin line spectra. II. Synthetic Fe XVII--XVIII X-ray coronal spectra and predictions for the Marshall Grazing-Incidence X-ray Spectrometer (MaGIXS)

abstract: We investigated the possibility of diagnosing the degree of departure from the Maxwellian distribution using the Fe XVII - Fe XVIII spectra originating in plasmas in collisional ionization equilibrium, such as in the cores of solar active regions or microflares. The original collision strengths for excitation are integrated over the non-Maxwellian electron $\kappa$-distributions characterized by a high-energy tail. Synthetic X-ray emission line spectra were calculated for a range of temperatures and $\kappa$. We focus on the 6-24 A spectral range to be observed by the upcoming Marshall Grazing-Incidence X-ray Spectrometer MaGIXS. We find that many line intensity ratios are sensitive to both $T$ and $\kappa$. Best diagnostic options are provided if a ratio involving both Fe XVII and Fe XVIII is combined with another ratio involving lines formed within a single ion. The sensitivity of such diagnostics to $\kappa$ is typically a few tens of per cent. Much larger sensitivity, of about a factor of two to three, can be obtained if the Fe XVIII 93.93 A line observed by SDO/AIA is used in conjuction with the X-ray lines. We conclude that the MaGIXS instrument is well-suited for detection of departures from the Maxwellian distribution, especially in active region cores.


title: Deep Trajectory for Recognition of Human Behaviours

abstract: Identifying human actions in complex scenes is widely considered as a challenging research problem due to the unpredictable behaviors and variation of appearances and postures. For extracting variations in motion and postures, trajectories provide meaningful way. However, simple trajectories are normally represented by vector of spatial coordinates. In order to identify human actions, we must exploit structural relationship between different trajectories. In this paper, we propose a method that divides the video into N number of segments and then for each segment we extract trajectories. We then compute trajectory descriptor for each segment which capture the structural relationship among different trajectories in the video segment. For trajectory descriptor, we project all extracted trajectories on the canvas. This will result in texture image which can store the relative motion and structural relationship among the trajectories. We then train Convolution Neural Network (CNN) to capture and learn the representation from dense trajectories. . Experimental results shows that our proposed method out performs state of the art methods by 90.01% on benchmark data set.


title: On the Global Minimizers of Real Robust Phase Retrieval with Sparse Noise

abstract: We study a class of real robust phase retrieval problems under a Gaussian assumption on the coding matrix when the received signal is sparsely corrupted by noise. The goal is to establish conditions on the sparsity under which the input vector can be exactly recovered. The recovery problem is formulated as the minimization of the $\ell_1$ norm of the residual. The main contribution is a robust phase retrieval counterpart to the seminal paper by Candes and Tao on compressed sensing ($\ell_1$ regression) [Decoding by linear programming. IEEE Transactions on Information Theory, 51(12):4203-4215, 2005]. Our analysis depends on a key new property on the coding matrix which we call the {Absolute Range Property} (ARP). This property is an analogue to the Null Space Property (NSP) in compressed sensing. When the residuals are computed using squared magnitudes, we show that ARP follows from a standard Restricted Isometry Property (RIP). However, when the residuals are computed using absolute magnitudes, a new and very different kind of RIP or growth property is required. We conclude by showing that the robust phase retrieval objectives are sharp with respect to their minimizers with high probability.


title: Stellar systems following the $R^{1/m}$ luminosity law. III. Photometric, intrinsic, and dynamical properties for all S\'ersic indices

abstract: The S\'ersic or $R^{1/m}$ model has become the de facto standard model to describe the surface brightness profiles of early-type galaxies and the bulges of spiral galaxies. The photometric, intrinsic, and dynamical properties of this model have been investigated, but mainly for fairly large S\'ersic indices $m$. For small values of $m$, appropriate for low-mass and dwarf ellipticals, a detailed investigation of these properties is still lacking. In this study, we used a combination of numerical and analytical techniques to investigate the S\'ersic model over the entire range of S\'ersic parameters, focussing on the small $m$ regime, where a number of interesting and surprising properties are found. For all values $m<1$, the model is characterised by a finite central luminosity density, and for $m<\tfrac12$, even a central depression in the luminosity density profile. This behaviour translates to the dynamical properties: we show that all S\'ersic models with $m \geqslant\tfrac12$ can be supported by an isotropic velocity dispersion tensor, and that these isotropic models are stable to both radial and non-radial perturbations. The models with $m < \tfrac12$, on the other hand, cannot be supported by an isotropic velocity dispersion tensor.


title: The advantages of multiple classes for reducing overfitting from test set reuse

abstract: Excessive reuse of holdout data can lead to overfitting. However, there is little concrete evidence of significant overfitting due to holdout reuse in popular multiclass benchmarks today. Known results show that, in the worst-case, revealing the accuracy of $k$ adaptively chosen classifiers on a data set of size $n$ allows to create a classifier with bias of $\Theta(\sqrt{k/n})$ for any binary prediction problem. We show a new upper bound of $\tilde O(\max\{\sqrt{k\log(n)/(mn)},k/n\})$ on the worst-case bias that any attack can achieve in a prediction problem with $m$ classes. Moreover, we present an efficient attack that achieve a bias of $\Omega(\sqrt{k/(m^2 n)})$ and improves on previous work for the binary setting ($m=2$). We also present an inefficient attack that achieves a bias of $\tilde\Omega(k/n)$. Complementing our theoretical work, we give new practical attacks to stress-test multiclass benchmarks by aiming to create as large a bias as possible with a given number of queries. Our experiments show that the additional uncertainty of prediction with a large number of classes indeed mitigates the effect of our best attacks. Our work extends developments in understanding overfitting due to adaptive data analysis to multiclass prediction problems. It also bears out the surprising fact that multiclass prediction problems are significantly more robust to overfitting when reusing a test (or holdout) dataset. This offers an explanation as to why popular multiclass prediction benchmarks, such as ImageNet, may enjoy a longer lifespan than what intuition from literature on binary classification suggests.


title: Engineering Gender-Inclusivity into Software: Tales from the Trenches

abstract: Although the need for gender-inclusivity in software itself is gaining attention among both SE researchers and SE practitioners, and methods have been published to help, little has been reported on how to make such methods work in real-world settings. For example, how do busy software practitioners use such methods in low-cost ways? How do they endeavor to maximize benefits from using them? How do they avoid the controversies that can arise in talking about gender? To find out how teams were handling these and similar questions, we turned to 10 real-world software teams. We present these teams experiences "in the trenches," in the form of 12 practices and 3 potential pitfalls, so as to provide their insights to other real-world software teams trying to engineer gender-inclusivity into their software products.


title: Lower Order Terms for the One-Level Density of a Symplectic Family of Hecke L-Functions

abstract: In this paper we apply the $L$-function Ratios Conjecture to compute the one-level density for a symplectic family of $L$-functions attached to Hecke characters of infinite order. When the support of the Fourier transform of the corresponding test function $f$ reaches $1$, we observe a transition in the main term, as well as in the lower order term. The transition in the lower order term is in line with behavior recently observed by D. Fiorilli, J. Parks, and A. S\"odergren in their study of a symplectic family of quadratic Dirichlet $L$-functions. We then directly calculate main and lower order terms for test functions $f$ such that supp($\widehat{f}) \subset [-\alpha,\alpha]$ for some $\alpha <1$, and observe that this unconditional result is in agreement with the prediction provided by the Ratios Conjecture. As the analytic conductor of these L-functions grow twice as large (on a logarithmic scale) as the cardinality of the family in question, this is the optimal support that can be expected with current methods. Finally as a corollary we deduce that, under GRH, at least 75$\%$ of these $L$-functions do not vanish at the central point.


title: User-Device Authentication in Mobile Banking using APHEN for Paratuck2 Tensor Decomposition

abstract: The new financial European regulations such as PSD2 are changing the retail banking services. Noticeably, the monitoring of the personal expenses is now opened to other institutions than retail banks. Nonetheless, the retail banks are looking to leverage the user-device authentication on the mobile banking applications to enhance the personal financial advertisement. To address the profiling of the authentication, we rely on tensor decomposition, a higher dimensional analogue of matrix decomposition. We use Paratuck2, which expresses a tensor as a multiplication of matrices and diagonal tensors, because of the imbalance between the number of users and devices. We highlight why Paratuck2 is more appropriate in this case than the popular CP tensor decomposition, which decomposes a tensor as a sum of rank-one tensors. However, the computation of Paratuck2 is computational intensive. We propose a new APproximate HEssian-based Newton resolution algorithm, APHEN, capable of solving Paratuck2 more accurately and faster than the other popular approaches based on alternating least square or gradient descent. The results of Paratuck2 are used for the predictions of users' authentication with neural networks. We apply our method for the concrete case of targeting clients for financial advertising campaigns based on the authentication events generated by mobile banking applications.


title: Deep learning based high-resolution incoherent x-ray imaging with a single-pixel detector

abstract: X-ray "ghost" imaging has drawn great attention for its potential to lower radiation dose in medical diagnosis. For practical implementation, however, the efficiency and image quality have to be greatly improved. Here we demonstrate a computational ghost imaging scheme where a bucket detector and specially designed modulation masks are used, together with a new robust deep learning algorithm in which a compressed set of Hadamard matrices is incorporated into a multi-level wavelet convolutional neural network. By this means we have obtained an image of a real object from only 18.75% of the Nyquist sampling rate, using a portable tabletop incoherent x-ray source of ~37 {\mu}m diameter. A high imaging resolution of ~10 {\mu}m is achieved, which represents a concrete step towards the realization of a practical low cost x-ray ghost imaging camera for applications in biomedicine, archeology, material science, and so forth.


title: The statistical properties of turbulence in the presence of a smart small-scale control

abstract: By means of high-resolution numerical simulations, we compare the statistical properties of homogeneous and isotropic turbulence to those of the Navier-Stokes equation where small-scale vortex filaments are strongly depleted, thanks to a non-linear extra viscosity acting preferentially on high vorticity regions. We show that the presence of such smart small-scale drag can strongly reduce intermittency and non-Gaussian fluctuations. Our results pave the way towards a deeper understanding on the fundamental role of degrees of freedom in turbulence as well as on the impact of (pseudo)coherent structures on the statistical small-scale properties. Our work can be seen as a first attempt to develop smart-Lagrangian forcing/drag mechanisms to control turbulence.


title: Would Gaze-Contingent Rendering Improve Depth Perception in Virtual and Augmented Reality?

abstract: Near distances are overestimated in virtual reality, and far distances are underestimated, but an explanation for these distortions remains elusive. One potential concern is that whilst the eye rotates to look at the virtual scene, the virtual cameras remain static. Could using eye-tracking to change the perspective of the virtual cameras as the eye rotates improve depth perception in virtual reality? This paper identifies 14 distinct perspective distortions that could in theory occur from keeping the virtual cameras fixed whilst the eye rotates in the context of near-eye displays. However, the impact of eye movements on the displayed image depends on the optical, rather than physical, distance of the display. Since the optical distance of most head-mounted displays is over 1m, most of these distortions will have only a negligible effect. The exception are 'gaze-contingent disparities', which will leave near virtual objects looking displaced from physical objects that are meant to be at the same distance in augmented reality.


title: The inverse conductivity problem via the calculus of functions of bounded variation

abstract: In this work, a novel approach for the solution of the inverse conductivity problem from one and multiple boundary measurements has been developed on the basis of the implication of the framework of BV - functions. The space of the functions of bounded variation is here recommended as the most appropriate functional space hosting the conductivity profile under reconstruction. For the numerical solution, we propose and implement a suitable minimization scheme of an enriched - constructed herein - functional, by exploiting the inner structure of BV - space. Finally, we validate and illustrate our theoretical results with numerical experiments.


title: X-ray diffraction from strongly bent crystals and spectroscopy of XFEL pulses

abstract: The use of strongly bent crystals in spectrometers for pulses of a hard x-ray free-electron laser is explored theoretically. Diffraction is calculated in both dynamical and kinematical theories. It is shown that diffraction can be treated kinematically when the bending radius is small compared to the critical radius given by the ratio of the Bragg-case extinction length for the actual reflection to the Darwin width of this reflection. As a result, the spectral resolution is limited by the crystal thickness, rather than the extinction length, and can become better than the resolution of a planar dynamically diffracting crystal. As an example, we demonstrate that spectra of the 12 keV pulses can be resolved in 440 reflection from a 20 micron thick diamond crystal bent to a radius of 10 cm.


title: Re$^3$counting the rationals

abstract: In 1999, Neil Calkin and Herbert Wilf wrote "Recounting the rationals" which gave an explicit bijection between the positive integers and the positive rationals. We find several different (some new) ways to construct this enumeration and thus create pointers for generalizing. Next, we use circle packings to generalize and find two other enumerations. Surprisingly, the three enumerations are all that are possible by using this technique. The proofs involve, among other things, "negative" continued fractions, Chebyshev polynomials, Euler's totient function, and generalizations of Stern's diatomic sequence. Finally we look at some of the remarkable similarities -- and differences -- of these sequences.


title: Polarization Modeling and Predictions for DKIST Part 5: Impacts of enhanced mirror and dichroic coatings on system polarization calibration

abstract: The DKIST is designed to deliver accurate spectropolarimetric calibrations across a wide wavelength range and large field of view for solar observations. Instruments deliver spectral resolving powers up to 300,000 in multiple cameras of several instrument. We require detailed knowledge of optical coatings on all optics to ensure we can predict and calibrate the polarization behavior of the system. Optical coatings can be metals protected by many dielectric layers or several-micron thick dichroics. Strong spectral gradients up to 60deg retardance per nanometer wavelength and several percent diattenuation per nanometer wavelength are observed in such coatings. Often, optical coatings are not specified with spectral gradient targets for polarimetry in combination to both average and spectral threshold type specifications. DKIST has a suite of interchangeable dichroic beam splitters using up to 96 layers. We apply the Berreman formalism in open-source Python scripts to derive coating polarization behavior. We present high spectral resolution examples on dichroics where transmission can drop 10% with associated polarization changes over a 1 nm spectral bandpass in both mirrors and dichroics. We design dichroic coatings that pass polarization spectral gradient requirements in addition to reflectivity. We now can fit multi-layer coating designs to predict system level polarization properties of mirrors, anti-reflection coatings and dichroics at arbitrary incidence angles, high spectral resolving power on curved surfaces through optical modeling software packages. Polarization predictions for large astronomical telescopes require significant metrology efforts on individual optical components combined with systems-level modeling efforts. We show our custom-built laboratory spectropolarimeter and metrology efforts on protected metal mirrors, anti-reflection coatings and dichroic mirror samples.


title: A Compression Objective and a Cycle Loss for Neural Image Compression

abstract: In this manuscript we propose two objective terms for neural image compression: a compression objective and a cycle loss. These terms are applied on the encoder output of an autoencoder and are used in combination with reconstruction losses. The compression objective encourages sparsity and low entropy in the activations. The cycle loss term represents the distortion between encoder outputs computed from the original image and from the reconstructed image (code-domain distortion). We train different autoencoders by using the compression objective in combination with different losses: a) MSE, b) MSE and MSSSIM, c) MSE, MS-SSIM and cycle loss. We observe that images encoded by these differently-trained autoencoders fall into different points of the perception-distortion curve (while having similar bit-rates). In particular, MSE-only training favors low image-domain distortion, whereas cycle loss training favors high perceptual quality.


title: Looking at the axionic dark sector with ANITA

abstract: The ANITA experiment has recently observed two anomalous events emerging from well below the horizon. Even though they are consistent with tau cascades, a high energy Standard Model or Beyond the Standard Model explanation is challenging and in tension with other experiments. We study under which conditions the reflection of generic radio pulses can reproduce these signals. We propose that these pulses can be resonantly produced in the ionosphere via axion-photon conversion. This naturally explains the direction and polarization of the events and avoids other experimental bounds.


title: Spatially Resolved Stellar Kinematics of the Ultra-Diffuse Galaxy Dragonfly 44: II. Constraints on Fuzzy Dark Matter

abstract: Given the absence of directly detected dark matter (DM) as weakly interacting massive particles, there is strong interest in the possibility that DM is an ultra-light scalar field, here denoted as fuzzy DM. Ultra-diffuse galaxies, with the sizes of giant galaxies and the luminosities of dwarf galaxies, have a wide range of DM halo masses, thus providing new opportunities for exploring the connections between galaxies and their DM halos. Following up on new integral field unit spectroscopic observations and dynamics modeling of the DM-dominated ultra-diffuse galaxy Dragonfly 44 in the outskirts of the Coma Cluster, we present models of fuzzy DM constrained by the stellar dynamics of this galaxy. We infer a scalar field mass of $\sim 3 \times 10^{-22}$ eV, consistent with other constraints from galaxy dynamics but in tension with constraints from Ly$\alpha$ forest power spectrum modeling. While we are unable to statistically distinguish between fuzzy DM and normal cold DM models, we find that the inferred properties of the fuzzy DM halo satisfy a number of predictions for halos in a fuzzy DM cosmology. In particular, we find good agreement with the predicted core size--halo mass relation and the predicted transition radius between the quantum pressure-dominated inner region and the outer halo region.


title: Optically variable active galactic nuclei in the 3 yr VST survey of the COSMOS field

abstract: The analysis of the variability of active galactic nuclei (AGNs) at different wavelengths and the study of possible correlations among different spectral windows are nowadays a major field of inquiry. Optical variability has been largely used to identify AGNs in multivisit surveys. The strength of a selection based on optical variability lies in the chance to analyze data from surveys of large sky areas by ground-based telescopes. However the effectiveness of optical variability selection, with respect to other multiwavelength techniques, has been poorly studied down to the depth expected from next generation surveys. Here we present the results of our r-band analysis of a sample of 299 optically variable AGN candidates in the VST survey of the COSMOS field, counting 54 visits spread over three observing seasons spanning > 3 yr. This dataset is > 3 times larger in size than the one presented in our previous analysis (De Cicco et al. 2015), and the observing baseline is ~8 times longer. We push towards deeper magnitudes (r(AB) ~23.5 mag) compared to past studies; we make wide use of ancillary multiwavelength catalogs in order to confirm the nature of our AGN candidates, and constrain the accuracy of the method based on spectroscopic and photometric diagnostics. We also perform tests aimed at assessing the relevance of dense sampling in view of future wide-field surveys. We demonstrate that the method allows the selection of high-purity (> 86%) samples. We take advantage of the longer observing baseline to achieve great improvement in the completeness of our sample with respect to X-ray and spectroscopically confirmed samples of AGNs (59%, vs. ~15% in our previous work), as well as in the completeness of unobscured and obscured AGNs. The effectiveness of the method confirms the importance to develop future, more refined techniques for the automated analysis of larger datasets.


title: Measuring the growth of structure by matching dark matter haloes to galaxies with VIPERS and SDSS

abstract: We test the history of structure formation from redshift 1 to today by matching galaxies from VIPERS and SDSS with dark matter haloes in the MultiDark SMDPL N-body simulation. We first show that the standard subhalo abundance matching (SHAM) recipe implemented with MultiDark characterizes the clustering of galaxies well both at redshift 0 for SDSS and at redshift 1 for VIPERS. This is an important validation of the SHAM model at high redshift. We then remap the simulation timesteps to test alternative growth histories and infer the growth index $\gamma=0.6\pm0.3$. This analysis demonstrates the power of using N-body simulations to forward model galaxy surveys for cosmological inference.


title: Deconfusing intensity maps with neural networks

abstract: Line intensity maps (LIMs) are in principle sensitive to a large amount of information about faint, distant galaxies which are invisible to conventional surveys. However, actually extracting that information from a confused, foreground-contaminated map can be challenging. In this work we present the first application of convolutional neural network (CNN) to directly determine the underlying luminosity function of a LIM, including a treatment of extragalactic foregrounds and instrumental noise. We apply the CNN to simulations of mock Carbon Monoxide (CO) line intensity maps similar to those which will be produced by the currently-active COMAP experiment. We evaluate the trained CNN on a number of noise scenarios in order to determine how robust the network predictions are for application to realistic data. We find that, in the ideal case where the mock data capture all of the features of the real data, the CNN performs comparably to or better than conventional analyses. However, the network's accuracy degrades considerably when tested on signals and systematics outside of those it was trained on. For both intensity mapping and cosmology as a whole, this motivates a broad-based study of whether simulated data can ever be generated with sufficient detail to realize the enormous potential of machine learning methods.


title: P-band induced self-organization and dynamics with repulsively driven ultracold atoms in an optical cavity

abstract: We investigate a Bose-Einstein condensate strongly coupled to an optical cavity via a repulsive optical lattice. We detect a stable self-ordered phase in this regime, and show that the atoms order through an antisymmetric coupling to the P-band of the lattice, limiting the extent of the phase and changing the geometry of the emergent density modulation. Furthermore, we find a non-equilibrium phase with repeated intense bursts of the intra-cavity photon number, indicating non-trivial driven-dissipative dynamics.


title: Jackiw-Teitelboim Gravity and Rotating Black Holes

abstract: We show that the free energy at low temperatures for near-extremal black holes is correctly obtained from the Jackiw-Teitelboim (JT) model of gravity. Our arguments apply to all black holes, including rotating ones, whose metric has a near-horizon $\mathrm{AdS}_2$ factor and the associated $\mathrm{SL}(2,\mathbb{R})$ symmetry. We verify these arguments by explicit calculations for rotating black holes in $4$ and $5$ dimensions. Our results suggest that the JT model could prove useful in analysing the dynamics of near-extremal Kerr black holes found in nature.


title: Bringing manifold learning and dimensionality reduction to SED fitters

abstract: We show unsupervised machine learning techniques are a valuable tool for both visualizing and computationally accelerating the estimation of galaxy physical properties from photometric data. As a proof of concept, we use self organizing maps (SOMs) to visualize a spectral energy distribution (SED) model library in the observed photometry space. The resulting visual maps allow for a better understanding of how the observed data maps to physical properties and to better optimize the model libraries for a given set of observational data. Next, the SOMs are used to estimate the physical parameters of 14,000 z~1 galaxies in the COSMOS field and found to be in agreement with those measured with SED fitting. However, the SOM method is able to estimate the full probability distribution functions for each galaxy up to about a million times faster than direct model fitting. We conclude by discussing how this speed up and learning how the galaxy data manifold maps to physical parameter space and visualizing this mapping in lower dimensions helps overcome other challenges in galaxy formation and evolution.


title: A Zero-Parameter Extension of General Relativity with Varying Cosmological Constant

abstract: We provide a new extension of general relativity (GR) which has the remarkable property of being more constrained than GR plus a cosmological constant, having one less free parameter. This is implemented by allowing the cosmological constant to have a consistent space-time variation, through coding its dynamics in the torsion tensor. We demonstrate this mechanism by adding a `quasi-topological' term to the Einstein action, which naturally realizes a dynamical torsion with an automatic satisfaction of the Bianchi identities. Moreover, variation of the action with respect to this dynamical $\Lambda$ fixes it in terms of other variables, thus providing a scenario with less freedom than general relativity with a cosmological constant. Once matter is introduced, at least in the homogeneous and isotropic reduction, $\Lambda$ is uniquely determined by the field content of the model. We make an explicit construction using the Palatini formulation of GR and describe the striking properties of this new theory. We also highlight some possible extensions to the theory. A companion paper [1] explores the Friedmann--Robertson--Walker reduction for cosmology, and future work will study Solar System tests of the theory.


title: SOFIA/EXES observations of warm H$_2$ at high spectral resolution: witnessing para-to-ortho conversion behind a molecular shock wave in HH7

abstract: Spectrally-resolved observations of three pure rotational lines of H$_2$, conducted with the EXES instrument on SOFIA toward the classic bow shock HH7, reveal systematic velocity shifts between the S(5) line of ortho-H$_2$ and the two para-H$_2$ lines [S(4) and S(6)] lying immediately above and below it on the rotational ladder. These shifts, reported here for the first time, imply that we are witnessing the conversion of para-H$_2$ to ortho-H$_2$ within a shock wave driven by an outflow from a young stellar object. The observations are in good agreement with the predictions of models for non-dissociative, C-type molecular shocks. They provide a clear demonstration of the chemical changes wrought by interstellar shock waves, in this case the conversion of para-H$_2$ to ortho-H$_2$ in reactive collisions with atomic hydrogen, and provide among the most compelling evidence yet obtained for C-type shocks in which the flow velocity changes continuously.


title: The cosmology of minimal varying Lambda theories

abstract: Inserting a varying Lambda in Einstein's field equations can be made consistent with the Bianchi identities by allowing for torsion, without the need to add scalar field degrees of freedom. In the minimal such theory, Lambda is totally free and undetermined by the field equations in the absence of matter. Inclusion of matter ties Lambda algebraically to it, at least when homogeneity and isotropy are assumed, i.e. when there is no Weyl curvature. We show that Lambda is proportional to the matter density, with a proportionality constant depending on the equation of state. Unfortunately, the proportionality constant becomes infinite for pure radiation, ruling out the minimal theory prima facie despite of its novel internal consistency. It is possible to generalize the theory still without the addition of kinetic terms, leading to a new algebraically-enforced proportionality between Lambda and the matter density. Lambda and radiation may now coexist in a form consistent with Big Bang Nucleosynthesis, though this places strict constraints on the single free parameter of the theory, $\theta$. In the matter epoch Lambda behaves just like a dark matter component. Its density is proportional to the baryonic and/or dark matter, and its presence and gravitational effects would need to be included in accounting for the necessary dark matter in our Universe. This is a companion paper to Ref. [1] where the underlying gravitational theory is developed in detail.


title: The Close AGN Reference Survey (CARS). Discovery of a global [CII] 158 $\mu$m line excess in AGN HE1353-1917

abstract: The [CII]158$\mu$m line is one of the strongest far-infrared (FIR) lines and an important coolant in the interstellar medium of galaxies that is accessible out to high redshifts. The excitation of [CII] is complex and can best be studied in detail at low redshifts. Here we report the discovery of the highest global [CII] excess with respect to the FIR luminosity in the nearby AGN host galaxy HE1353-1917. This galaxy is exceptional among a sample of five targets because the AGN ionization cone and radio jet directly intercept the cold galactic disk. As a consequence, a massive multiphase gas outflow on kiloparsec scales is embedded in an extended narrow-line region. Because HE1353-1917 is distinguished by these special properties from our four bright AGN, we propose that a global [CII] excess in AGN host galaxies could be a direct signature of a multiphase AGN-driven outflow with a high mass-loading factor.


title: Adversarially-trained autoencoders for robust unsupervised new physics searches

abstract: Machine learning techniques in particle physics are most powerful when they are trained directly on data, to avoid sensitivity to theoretical uncertainties or an underlying bias on the expected signal. To be able to train on data in searches for new physics, anomaly detection methods are imperative, which can be realised by an autoencoder acting as an unsupervised classifier. The last source of uncertainties affecting the classifier are then experimental uncertainties in the reconstruction of the final-state objects. To mitigate their effect on the classifier and to allow for a realistic assessment of the method, we propose to combine the autoencoder with an adversarial neural network to remove its sensitivity to the smearing of the final-state objects. We quantify its effect and show that one can achieve a robust anomaly detection in resonance-induced $t\bar{t}$ final states.


title: The Close AGN Reference Survey (CARS). A massive multi-phase outflow impacting the edge-on galaxy HE1353-1917

abstract: [Abridged] We combine extensive spatially-resolved multi-wavelength observations, taken as part of the Close AGN Reference Survey (CARS), for the edge-on disc galaxy HE1353-1917 to characterize the impact of the AGN on its host galaxy via outflows and radiation. Multi-color broad-band photometry is combined with spatially-resolved optical, NIR and sub-mm and radio observations taken with VLT/MUSE, Gemini-N/NIFS, ALMA and the VLA to map the physical properties and kinematics of the multi-phase inter-stellar medium (ISM). We detect a biconical extended narrow-line region (ENLR) ionized by the luminous AGN oriented nearly parallel to the galaxy disc, extending out to at least 25kpc. The extra-planar gas originates from galactic fountains initiated by star formation processes in the disc, rather than an AGN outflow, as shown by the kinematics and the metallicity of the gas. Nevertheless, a fast multi-phase AGN-driven outflow with speeds up to 1000km/s is detected close to the nucleus at 1kpc distance. A radio jet, in connection with the AGN radiation field, is likely responsible for driving the outflow as confirmed by the energetics and the spatial alignment of the jet and multi-phase outflow. Evidence for negative AGN feedback suppressing the star formation rate (SFR) is mild and restricted to the central kpc. But while any SFR suppression must have happened recently, the outflow has the potential to greatly impact the future evolution of the galaxy disc due to its geometrical orientation. Our observations reveal that low-power radio jets can play a major role in driving fast multi-phase galaxy-scale outflows even in radio-quiet AGN. Since the outflow energetics for HE1353-1917 are consistent with literature scaling relations of AGN-driven outflows the contribution of radio jets as the driving mechanisms still needs to be systematically explored.


title: Cosmological implications of the composite spectra of galactic X-ray binaries constructed using MAXI data

abstract: We have investigated the long term average spectral properties of galactic X-ray binaries in the energy range of 3-20 keV, using long term monitoring data from MAXI -Gas Slit Camera (GSC). These long term average spectra are used to construct separately the composite spectra of galactic High Mass X-ray binaries (HMXBs) and Low Mass X-ray binaries (LMXBs). These composite spectra can be described empirically with piece-wise power-law with three components. X-rays from HMXBs are considered as important contributors to heating and ionization of neutral hydrogen in the intergalactic medium during the Epoch of Reionization. Using the above empirical form of the composite HMXB spectra extrapolated to lower energies as an input, we have studied the impact of these sources on the 21-cm signal using the outputs of N-body simulation and 1D radiative transfer. The heating due to the composite spectrum is less patchy compared to power-law spectrum with a spectral index $\alpha = 1.5$, used in previous studies. The amplitude of the heating peak of large scale power spectrum, when plotted as a function of the redshift, is less for the composite spectrum.


title: Jet-driven galaxy-scale gas outflows in the hyper-luminous quasar 3C273

abstract: We present an unprecedented view on the morphology and kinematics of the extended narrow-line region (ENLR) and molecular gas around the prototypical hyper-luminous quasar 3C273 ($L\sim10^{47}$ erg/s at z=0.158) based on VLT-MUSE optical 3D spectroscopy and ALMA observations. We find that: 1) The ENLR size of 12.1$\pm$0.2kpc implies a smooth continuation of the size-luminosity relation out to large radii or a much larger break radius as previously proposed. 2) The kinematically disturbed ionized gas with line splits reaching 1000km/s out to 6.1$\pm$1.5kpc is aligned along the jet axis. 3) The extreme line broadening on kpc scales is caused by spatial and spectral blending of many distinct gas clouds separated on sub-arcsecond scales with different line-of-sight velocities. The ENLR velocity field combined with the known jet orientation rule out a simple scenario of a radiatively-driven radial expansion of the outflow. Instead we propose that a pressurized expanding hot gas cocoon created by the radio jet is impacting on an inclined gas disk leading to transverse and/or backflow motion with respect to our line-of-sight. The molecular gas morphology may either be explained by a density wave at the front of the outflow expanding along the jet direction as predicted by positive feedback scenario or the cold gas may be trapped in a stellar over-density caused by a recent merger event. Using 3C273 as a template for observations of high-redshift hyper-luminous AGN reveals that large-scale ENLRs and kpc scale outflows may often be missed due to the brightness of the nuclei and the limited sensitivity of current near-IR instrumentation.


title: Dedalus: A Flexible Framework for Numerical Simulations with Spectral Methods

abstract: Numerical solutions of partial differential equations enable a broad range of scientific research. The Dedalus Project is a flexible, open-source, parallelized computational framework for solving general partial differential equations using spectral methods. Dedalus translates plain-text strings describing partial differential equations into efficient solvers. This paper details the numerical method that enables this translation, describes the design and implementation of the codebase, and illustrates its capabilities with a variety of example problems. The numerical method is a first-order generalized tau formulation that discretizes equations into banded matrices. This method is implemented with an object-oriented design. Classes for spectral bases and domains manage the discretization and automatic parallel distribution of variables. Discretized fields and mathematical operators are symbolically manipulated with a basic computer algebra system. Initial value, boundary value, and eigenvalue problems are efficiently solved using high-performance linear algebra, transform, and parallel communication libraries. Custom analysis outputs can also be specified in plain text and stored in self-describing portable formats. The performance of the code is evaluated with a parallel scaling benchmark and a comparison to a finite-volume code. The features and flexibility of the codebase are illustrated by solving several examples: the nonlinear Schrodinger equation on a graph, a supersonic magnetohydrodynamic vortex, quasigeostrophic flow, Stokes flow in a cylindrical annulus, normal modes of a radiative atmosphere, and diamagnetic levitation. The Dedalus code and the example problems are available online at http://dedalus-project.org/.


title: Reinforcement Learning in Feature Space: Matrix Bandit, Kernels, and Regret Bound

abstract: Exploration in reinforcement learning (RL) suffers from the curse of dimensionality when the state-action space is large. A common practice is to parameterize the high-dimensional value and policy functions using given features. However existing methods either have no theoretical guarantee or suffer a regret that is exponential in the planning horizon $H$. In this paper, we propose an online RL algorithm, namely the MatrixRL, that leverages ideas from linear bandit to learn a low-dimensional representation of the probability transition model while carefully balancing the exploitation-exploration tradeoff. We show that MatrixRL achieves a regret bound ${O}\big(H^2d\log T\sqrt{T}\big)$ where $d$ is the number of features. MatrixRL has an equivalent kernelized version, which is able to work with an arbitrary kernel Hilbert space without using explicit features. In this case, the kernelized MatrixRL satisfies a regret bound ${O}\big(H^2\widetilde{d}\log T\sqrt{T}\big)$, where $\widetilde{d}$ is the effective dimension of the kernel space. To our best knowledge, for RL using features or kernels, our results are the first regret bounds that are near-optimal in time $T$ and dimension $d$ (or $\widetilde{d}$) and polynomial in the planning horizon $H$.


title: A new strategy to microscopic modelling of topological entanglement in polymers based on field theory

abstract: In this work a new strategy is proposed in order to build analytic and microscopic models of fluctuating polymer rings subjected to topological constraints. The topological invariants used to fix these constraints belong to a wide class of the so-called numerical topological invariants. For each invariant it is possible to derive a field theory that describes the statistical behavior of knotted and linked polymer rings following a straightforward algorithm. The treatment is not limited to the partition function of the system, but it allows also to express the expectation values of general observables as field theory amplitudes. Our strategy is illustrated taking as examples the Gauss linking number and a topological invariant belonging to a class of invariants due to Massey. The consistency of the new method developed here is checked by reproducing a previous field theoretical model of two linked polymer rings. After the passage to field theory, the original topological constraints imposed on the fluctuating paths of the polymers become constraints over the configurations of the topological fields that mediate the interactions of topological origin between the monomers. These constraints involve quantities like the cross-helicity which are of interest in other disciplines, like for instance in modeling the solar magnetic field. While the calculation of the vacuum expectation values of generic observables remains still challenging due to the complexity of the problem of topological entanglement in polymer systems, we succeed here to reduce the evaluation of the moments of the Gauss linking number for two linked polymer rings to the computation of the amplitudes of a free field theory.


title: Coarse Graining of Partitioned Cellular Automata

abstract: Partitioned cellular automata are known to be an useful tool to simulate linear and nonlinear problems in physics, specially because they allow for a straightforward way to define conserved quantities and reversible dynamics. Here we show how to construct a local coarse graining description of partitioned cellular automata. By making use of this tool we investigate the effective dynamics in this model of computation. All examples explored are in the scenario of lattice gases, so that the information lost after the coarse graining is related to the number of particles. It becomes apparent how difficult it is to remain with a deterministic dynamics after coarse graining. Several examples are shown where an effective stochastic dynamics is obtained after a deterministic dynamics is coarse grained. These results suggest why random processes are so common in nature.


title: A Generalization Error Bound for Multi-class Domain Generalization

abstract: Domain generalization is the problem of assigning labels to an unlabeled data set, given several similar data sets for which labels have been provided. Despite considerable interest in this problem over the last decade, there has been no theoretical analysis in the setting of multi-class classification. In this work, we study a kernel-based learning algorithm and establish a generalization error bound that scales logarithmically in the number of classes, matching state-of-the-art bounds for multi-class classification in the conventional learning setting. We also demonstrate empirically that the proposed algorithm achieves significant performance gains compared to a pooling strategy.


title: Reconciling spontaneous scalarization with cosmology

abstract: We discuss the Damour--Esposito-Far\`ese model of gravity, which predicts the spontaneous scalarization of neutron stars in a certain range of parameter space. In the cosmological setup, the scalar field responsible for scalarization is subject to a tachyonic instability during inflation and the matter domination stage, resulting in a large value of the field today. This value feeds into the PPN parameters, which turn out to be in gross conflict with the Solar system measurements. We modify the original Damour--Esposito-Far\`ese model by coupling the scalar to the inflaton field. This coupling acts as an effective mass for the scalar during inflation. For generic couplings that are not extremely small, the scalar (including its perturbations) relaxes to zero with an exponential accuracy by the beginning of the hot stage. While the scalar exhibits growth during the subsequent cosmological stages, the resulting present value remains very small---in a comfortable agreement with the Solar system tests.


title: Enhanced solar evaporation using a photo-thermal umbrella: towards zero liquid discharge wastewater management

abstract: Rising water demands and depleting freshwater resources have brought desalination and wastewater treatment technologies to the forefront. For sustainable water management, there is a global push towards Zero Liquid Discharge (ZLD) with the goal to maximize water recovery for reuse, and to produce solid waste that lowers the environmental impact of wastewater disposal. Evaporation ponds harvest solar energy as heat for ZLD, but require large land areas due to low evaporation rates. Here, we demonstrate a passive and non-contact approach to enhance evaporation by more than 100% using a photo-thermal umbrella. By converting sunlight into only mid-infrared radiation where water is strongly absorbing, efficient utilization of solar energy and heat localization at the water surface through radiative coupling are achieved. The non-contact nature of the device makes it uniquely suited to treat a wide range of wastewater, and the use of commercially available materials enables a potentially low cost and scalable technology for the sustainable disposal of wastewater, with the added benefit of salt recovery.


title: Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models: Extension

abstract: We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by the currently best-performing worker (leader). Our method differs from the parameter-averaging scheme EASGD in a number of ways: (i) our objective formulation does not change the location of stationary points compared to the original optimization problem; (ii) we avoid convergence decelerations caused by pulling local workers descending to different local minima to each other (i.e. to the average of their parameters); (iii) our update by design breaks the curse of symmetry (the phenomenon of being trapped in poorly generalizing sub-optimal solutions in symmetric non-convex landscapes); and (iv) our approach is more communication efficient since it broadcasts only parameters of the leader rather than all workers. We provide theoretical analysis of the batch version of the proposed algorithm, which we call Leader Gradient Descent (LGD), and its stochastic variant (LSGD). Finally, we implement an asynchronous version of our algorithm and extend it to the multi-leader setting, where we form groups of workers, each represented by its own local leader (the best performer in a group), and update each worker with a corrective direction comprised of two attractive forces: one to the local, and one to the global leader (the best performer among all workers). The multi-leader setting is well-aligned with current hardware architecture, where local workers forming a group lie within a single computational node and different groups correspond to different nodes. For training convolutional neural networks, we empirically demonstrate that our approach compares favorably to state-of-the-art baselines. This work is a gentle extension of [2].


title: Structure-preserving Method for Reconstructing Unknown Hamiltonian Systems from Trajectory Data

abstract: We present a numerical approach for approximating unknown Hamiltonian systems using observation data. A distinct feature of the proposed method is that it is structure-preserving, in the sense that it enforces conservation of the reconstructed Hamiltonian. This is achieved by directly approximating the underlying unknown Hamiltonian, rather than the right-hand-side of the governing equations. We present the technical details of the proposed algorithm and its error estimate in a special case, along with a practical de-noising procedure to cope with noisy data. A set of numerical examples are then presented to demonstrate the structure-preserving property and effectiveness of the algorithm.

categories: math.NA cs.LG cs.NA math.DS physics.comp-ph stat.ML


title: Generalized Ornstein-Uhlenbeck Model for Active Motion

abstract: We investigate a one-dimensional model of active motion, which takes into account the effects of persistent self-propulsion through a memory function in a dissipative-like term of the generalized Langevin equation for particle swimming velocity. The proposed model is a generalization of the active Ornstein-Uhlenbeck model introduced by G. Szamel [Phys. Rev. E {\bf 90}, 012111 (2014)]. We focus on two different kinds of memory which arise in many natural systems: an exponential decay and a power law, supplemented with additive colored noise. We provide analytical expressions for the velocity autocorrelation function and the mean-squared displacement, which are in excellent agreement with numerical simulations. For both models, damped oscillatory solutions emerge due to the competition between the memory of the system and the persistence of velocity fluctuations. In particular, for a power-law model with fractional Brownian noise, we show that long-time active subdiffusion occurs with increasing long-term memory.


title: An Application of Fractional Differential Equations to Risk Theory

abstract: This paper defines a new class of fractional differential operators alongside a family of random variables whose density functions solve fractional differential equations equipped with these operators. These equations can be further used to construct fractional integro-differential equations for the ruin probabilities in collective renewal risk models, with inter-arrival time distributions from the aforementioned family. Gamma-time risk models and fractional Poisson risk models are two specific cases among them, whose ruin probabilities have explicit solutions, when claim sizes distributions exhibit rational Laplace transforms.


title: Fast computation of loudness using a deep neural network

abstract: The present paper introduces a deep neural network (DNN) for predicting the instantaneous loudness of a sound from its time waveform. The DNN was trained using the output of a more complex model, called the Cambridge loudness model. While a modern PC can perform a few hundred loudness computations per second using the Cambridge loudness model, it can perform more than 100,000 per second using the DNN, allowing real-time calculation of loudness. The root-mean-square deviation between the predictions of instantaneous loudness level using the two models was less than 0.5 phon for unseen types of sound. We think that the general approach of simulating a complex perceptual model by a much faster DNN can be applied to other perceptual models to make them run in real time.


title: Electron-capture Rates in $^{20}$Ne for a Forbidden Transition to the Ground State of $^{20}$F Relevant to Final Evolution of High-density O-Ne-Mg Cores

abstract: Electron capture on $^{20}$Ne is critically important for the final stage of evolution of stars with the initial masses of 8 - 10 $M_{\odot}$. In the present paper, we evaluate electron capture rates for a forbidden transition $^{20}$Ne (0$_{g.s.}^{+}$) $\rightarrow$ $^{20}$F (2$_{g.s.}^{+}$) in stellar environments by the multipole expansion method with the use of shell-model Hamiltonians. These rates have not been accurately determined in theory as well as in experiments. Our newly evaluated rates are compared with those obtained by a prescription that treats the transition as an allowed Gamow-Teller (GT) transition with the strength determined from a recent $\beta$-decay experiment for $^{20}$F (2$_{g.s.}^{+}$) $\rightarrow$ $^{20}$Ne (0$_{g.s.}^{+}$) \citep{Kirsebom}. We find that different electron energy dependence of the transition strengths between the two methods leads to sizable differences in the weak rates of the two methods. We also find that the Coulomb effects, that is, the effects of screening on ions and electrons are non-negligible. We apply our e-capture rates on $^{20}$Ne to the calculation of the evolution of high-density O-Ne-Mg cores of 8 - 10 $M_{\odot}$ stars. We find that our new rates affect the abundance distribution and the central density at the final stage of evolution.


title: Tailored ensembles of neural networks optimize sensitivity to stimulus statistics

abstract: The dynamic range of stimulus processing in living organisms is much larger than a single neural network can explain. For a generic, tunable spiking network we derive that while the dynamic range is maximal at criticality, the interval of discriminable intensities is very similar for any network tuning due to coalescence. Compensating coalescence enables adaptation of discriminable intervals. Thus, we can tailor an ensemble of networks optimized to the distribution of stimulus intensities, e.g., extending the dynamic range arbitrarily. We discuss potential applications in machine learning.


title: Description of spreading dynamics by microscopic network models and macroscopic branching processes can differ due to coalescence

abstract: Spreading processes are conventionally monitored on a macroscopic level by counting the number of incidences over time. The spreading process can then be modeled either on the microscopic level, assuming an underlying interaction network, or directly on the macroscopic level, assuming that microscopic contributions are negligible. The macroscopic characteristics of both descriptions are commonly assumed to be identical. In this work, we show that these characteristics of microscopic and macroscopic descriptions can be different due to coalescence, i.e., a node being activated at the same time by multiple sources. In particular, we consider a (microscopic) branching network (probabilistic cellular automaton) with annealed connectivity disorder, record the macroscopic activity, and then approximate this activity by a (macroscopic) branching process. In this framework, we analytically calculate the effect of coalescence on the collective dynamics. We show that coalescence leads to a universal non-linear scaling function for the conditional expectation value of successive network activity. This allows us to quantify the difference between the microscopic model parameter and established macroscopic estimates. To overcome this difference, we propose a non-linear estimator that correctly infers the model branching parameter for all system sizes.


abstract: Many time series are effectively generated by a combination of deterministic continuous flows along with discrete jumps sparked by stochastic events. However, we usually do not have the equation of motion describing the flows, or how they are affected by jumps. To this end, we introduce Neural Jump Stochastic Differential Equations that provide a data-driven approach to learn continuous and discrete dynamic behavior, i.e., hybrid systems that both flow and jump. Our approach extends the framework of Neural Ordinary Differential Equations with a stochastic process term that models discrete events. We then model temporal point processes with a piecewise-continuous latent trajectory, where the discontinuities are caused by stochastic events whose conditional intensity depends on the latent state. We demonstrate the predictive capabilities of our model on a range of synthetic and real-world marked point process datasets, including classical point processes (such as Hawkes processes), awards on Stack Overflow, medical records, and earthquake monitoring.


title: InfoRL: Interpretable Reinforcement Learning using Information Maximization

abstract: Recent advances in reinforcement learning have proved that given an environment we can learn to perform a task in that environment if we have access to some form of a reward function (dense, sparse or derived from IRL). But most of the algorithms focus on learning a single best policy to perform a given set of tasks. In this paper, we focus on an algorithm that learns to not just perform a task but different ways to perform the same task. As we know when the environment is complex enough there always exists multiple ways to perform a task. We show that using the concept of information maximization it is possible to learn latent codes for discovering multiple ways to perform any given task in an environment.


title: Strain Induced Enhancement of Thermoelectric Properties of Monolayer WS2 through Valley Degeneracy

abstract: Two-dimensional transition metal dichalcogenides show great potential as promising thermoelectric materials due to their lower dimensionality, the unique density of states and quantum confinement of carriers. The effect of mechanical strain on the thermoelectric performances of monolayer WS 2 has been investigated using density functional theory associated with semiclassical Boltzmann transport theory. The variation of Seebeck coefficient and band gap with applied strain has followed the same type of trend. For n-type material the relaxation time scaled power factor(S 2 {\sigma}/{\tau}) increases by the application of compressive strain whereas for p- type material it increases with the application of tensile strain. A 77% increase in the power factor has been observed for the n-type material by the application of uniaxial compressive strain. A decrease in lattice thermal conductivity with the increase in temperature causes an almost 40% increase in ZT product under applied uniaxial compressive strain. From the study, it is observed that uniaxial compressive strain is more effective among all types of strain to enhance the thermoelectric performance of monolayer WS 2 . Such strain induced enhancement of thermoelectric properties in monolayer WS 2 could open a new window for the fabrication of high-quality thermoelectric devices.


title: New Sense of a Circle

abstract: New condition is found for the set of points in the plane, for which the locus is a circle. It is proved: the locus of points, such that the sum of the $(2m)$-th powers $S_n^{(2m)}$}of the distances to the vertexes of fixed regular $n$-sided polygon is constant, is a circle if $$ S_n^{(2m)}>nr^{2m},\ {\rm where}\ m=1,2,\dots,n-1 $$ and $r$ is the distance from the center of the regular polygon to the vertex. The radius $\ell$ satisfies: $$ S_n^{(2m)}=n\Bigg[(r^2+\ell^2)^m+\sum_{k=1}^{[\frac{m}{2}]} {m\choose 2k} (r^2+\ell^2)^{m-2k}(r\ell)^{2k} {2k\choose m}\Bigg]. $$


title: De novo exploration and self-guided learning of potential-energy surfaces

abstract: Interatomic potential models based on machine learning (ML) are rapidly developing as tools for materials simulations. However, because of their flexibility, they require large fitting databases that are normally created with substantial manual selection and tuning of reference configurations. Here, we show that ML potentials can be built in a largely automated fashion, exploring and fitting potential-energy surfaces from the beginning (de novo) within one and the same protocol. The key enabling step is the use of a configuration-averaged kernel metric that allows one to select the few most relevant structures at each step. The resulting potentials are accurate and robust for the wide range of configurations that occur during structure searching, despite only requiring a relatively small number of single-point DFT calculations on small unit cells. We apply the method to materials with diverse chemical nature and coordination environments, marking a milestone toward the more routine application of ML potentials in physics, chemistry, and materials science.


title: Search for Higgs and Z boson decays to J/$\psi$ or $\Upsilon$ pairs in the four-muon final state in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: A search for decays of the Higgs and Z boson to pairs of J/$\psi$ or $\Upsilon$(nS) (n = 1, 2, 3) mesons, with their subsequent decay to $\mu^+\mu^-$ pairs, is presented. The analysis uses data from proton-proton collisions at $\sqrt{s} =$ 13 TeV, collected with the CMS detector at the LHC in 2017 and corresponding to an integrated luminosity of 37.5 fb$^{-1}$. While an observation of such a decay with this sample would indicate the presence of physics beyond the standard model, no significant excess is observed. Upper limits at 95% confidence level are placed on the branching fractions of these decays. In the J/$\psi$ pair channel, the limits are 1.8 $\times$ 10$^{-3}$ and 2.2 $\times$ 10$^{-6}$ for the Higgs and Z boson, respectively, while in the combined $\Upsilon$(nS) pair channel, the limits are 1.4 $\times$ 10$^{-3}$ and 1.5 $\times$ 10$^{-6}$, respectively, when the mesons from the Higgs and Z boson decay are assumed to be unpolarized. When fully longitudinal and transverse polarizations are considered the limits reduce by about 22-29% and increase by about 10-13%, respectively.


title: Greedy Shallow Networks: An Approach for Constructing and Training Neural Networks

abstract: We present a greedy-based approach to construct an efficient single hidden layer neural network with the ReLU activation that approximates a target function. In our approach we obtain a shallow network by utilizing a greedy algorithm with the prescribed dictionary provided by the available training data and a set of possible inner weights. To facilitate the greedy selection process we employ an integral representation of the network, based on the ridgelet transform, that significantly reduces the cardinality of the dictionary and hence promotes feasibility of the greedy selection. Our approach allows for the construction of efficient architectures which can be treated either as improved initializations to be used in place of random-based alternatives, or as fully-trained networks in certain cases, thus potentially nullifying the need for backpropagation training. Numerical experiments demonstrate the tenability of the proposed concept and its advantages compared to the conventional techniques for selecting architectures and initializations for neural networks.


title: Primordial Gravitational Waves in Nonstandard Cosmologies

abstract: Assuming that inflation is followed by a phase where the energy density of the Universe is dominated by a component with a general equation of state, we evaluate the spectrum of primordial gravitational waves induced in the post-inflationary Universe. We show that if the energy density of the Universe is dominated by a component $\phi$ before Big Bang nucleosynthesis, its equation of state could be constrained by gravitational wave experiments depending on the ratio of energy densities of $\phi$ and radiation, and also the temperature at the end of the $\phi$ dominated era. Also, we discuss the impact of scale dependence of tensor modes on the primordial gravitational wave spectrum during the $\phi$-domination. These models are motivated by beyond Standard Model physics and scenarios for non-thermal production of dark matter in the early Universe. We also constrain the parameter space of the tensor spectral index and the tensor-to-scalar ratio, using the experimental limits from gravitational wave experiments.


title: Additive manufacturing for high precision structural properties via feedback control

abstract: This paper discusses the possibility of making an object that precisely meets global structural requirements using additive manufacturing and feedback control. An experimental validation is presented by printing a cantilever beam with a prescribed stiffness requirement. The printing process is formalized as a model-based finite-horizon discrete control problem, where the control variables are the widths of the successive layers. Sensing is performed by making {\em in situ} intermediate stiffness measurements on the partially built part. The hypothesis that feedback control is effective in enabling the 3D-printed beam to meet precise stiffness requirements is validated experimentally.


title: Using Deep Networks and Transfer Learning to Address Disinformation

abstract: We apply an ensemble pipeline composed of a character-level convolutional neural network (CNN) and a long short-term memory (LSTM) as a general tool for addressing a range of disinformation problems. We also demonstrate the ability to use this architecture to transfer knowledge from labeled data in one domain to related (supervised and unsupervised) tasks. Character-level neural networks and transfer learning are particularly valuable tools in the disinformation space because of the messy nature of social media, lack of labeled data, and the multi-channel tactics of influence campaigns. We demonstrate their effectiveness in several tasks relevant for detecting disinformation: spam emails, review bombing, political sentiment, and conversation clustering.


title: Modeling Dynamic Functional Connectivity with Latent Factor Gaussian Processes

abstract: Dynamic functional connectivity, as measured by the time-varying covariance of neurological signals, is believed to play an important role in many aspects of cognition. While many methods have been proposed, reliably establishing the presence and characteristics of brain connectivity is challenging due to the high dimensionality and noisiness of neuroimaging data. We present a latent factor Gaussian process model which addresses these challenges by learning a parsimonious representation of connectivity dynamics. The proposed model naturally allows for inference and visualization of time-varying connectivity. As an illustration of the scientific utility of the model, application to a data set of rat local field potential activity recorded during a complex non-spatial memory task provides evidence of stimuli differentiation.


title: A 3+1 Decomposition of the Minimal Standard-Model Extension Gravitational Sector

abstract: The 3+1 (ADM) formulation of General Relativity is used in, for example, canonical quantum gravity and numerical relativity. Here we present a 3+1 decomposition of the minimal Standard-Model Extension gravity Lagrangian. By choosing the leaves of foliation to lie along a timelike vector field we write the theory in a form which will allow for comparison and matching to other gravity models.


title: Quantum-inspired algorithms in practice

abstract: We study the practical performance of quantum-inspired algorithms for recommendation systems and linear systems of equations. These algorithms were shown to have an exponential asymptotic speedup compared to previously known classical methods for problems involving low-rank matrices, but with complexity bounds that exhibit a hefty polynomial overhead compared to quantum algorithms. This raised the question of whether these methods were actually useful in practice. We conduct a theoretical analysis aimed at identifying their computational bottlenecks, then implement and benchmark the algorithms on a variety of problems, including applications to portfolio optimization and movie recommendations. On the one hand, our analysis reveals that the performance of these algorithms is better than the theoretical complexity bounds would suggest. On the other hand, their performance as seen in our implementation degrades noticeably as the rank and condition number of the input matrix are increased. Overall, our results indicate that quantum-inspired algorithms can perform well in practice provided that stringent conditions are met: low rank, low condition number, and very large dimension of the input matrix. By contrast, practical datasets are often sparse and high-rank, precisely the type that can be handled by quantum algorithms.


title: Fluid Dynamics of Earth's core: geodynamo, inner core dynamics, core formation

abstract: This chapter is build from three 1.5 hours lectures given in Udine in april 2018 on various aspects of Earth's core dynamics. The chapter starts with a short historical note on the discovery of Earth's magnetic field and core (section 1). We then turn to an introduction of magnetohydrodynamics (section 2), introducing and discussing the induction equation and the form and effects of the Lorentz force. Section 3 is devoted to the description of Earth's magnetic field, introducing its spherical harmonics description and showing how it can be used to demonstrate the internal origin of the geomagnetic origin. We then move to an introduction of the convection-driven model of the geodynamo (section 4), discussing our current understanding of the dynamics of Earth's core, obtaining heuristically the Ekman dependency of the critical Rayleigh number for natural rotating convection, and introducing the equations and non-dimensional parameters used to model a convectively driven dynamo. The following section deals with the energetics of the geodynamo (section 5). The final two section deal with the dynamics of the inner core, focusing on the effect of the magnetic field (section 6), and with the formation of the core (section 7). Given the wide scope of this chapter and the limited time available, this introduction to Earth's core dynamics is by no means intended to be comprehensive. For more informations, the interested reader may refer to Jones (2011), Olson (2013), or Christensen and Wicht (2015) on the geomagnetic field and the geodynamo, to Sumita and Bergman (2015), Deguen (2012) and Lasbleis and Deguen (2015) on the dynamics of the inner core, and to Rubie et al. (2015) on core formation.


title: Differentiable Representations For Multihop Inference Rules

abstract: We present efficient differentiable implementations of second-order multi-hop reasoning using a large symbolic knowledge base (KB). We introduce a new operation which can be used to compositionally construct second-order multi-hop templates in a neural model, and evaluate a number of alternative implementations, with different time and memory trade offs. These techniques scale to KBs with millions of entities and tens of millions of triples, and lead to simple models with competitive performance on several learning tasks requiring multi-hop reasoning.


title: Learning to Identify High Betweenness Centrality Nodes from Scratch: A Novel Graph Neural Network Approach

abstract: Betweenness centrality (BC) is one of the most used centrality measures for network analysis, which seeks to describe the importance of nodes in a network in terms of the fraction of shortest paths that pass through them. It is key to many valuable applications, including community detection and network dismantling. Computing BC scores on large networks is computationally challenging due to high time complexity. Many approximation algorithms have been proposed to speed up the estimation of BC, which are mainly sampling-based. However, these methods are still prone to considerable execution time on large-scale networks, and their results are often exacerbated when small changes happen to the network structures. In this paper, we focus on identifying nodes with high BC in a graph, since many application scenarios are built upon retrieving nodes with top-k BC. Different from previous heuristic methods, we turn this task into a learning problem and design an encoder-decoder based framework to resolve the problem. More specifcally, the encoder leverages the network structure to encode each node into an embedding vector, which captures the important structural information of the node. The decoder transforms the embedding vector for each node into a scalar, which captures the relative rank of this node in terms of BC. We use the pairwise ranking loss to train the model to identify the orders of nodes regarding their BC. By training on small-scale networks, the learned model is capable of assigning relative BC scores to nodes for any unseen networks, and thus identifying the highly-ranked nodes. Comprehensive experiments on both synthetic and real-world networks demonstrate that, compared to representative baselines, our model drastically speeds up the prediction without noticeable sacrifce in accuracy, and outperforms the state-of-the-art by accuracy on several large real-world networks.


title: Rescattering effects in antiproton-induced exclusive $J/\psi$ and $\psi^\prime$ production on the deuteron

abstract: On the basis of the generalized eikonal approximation we study the exclusive reactions $\bar p d \to J/\psi\, n$ and $\bar p d \to \psi^\prime\, n$ in vicinity of the thresholds for charmonium production on a free proton target. It is shown that the rescattering of the incoming antiproton and outgoing charmonium on the spectator neutron leads to a depletion of the charmonium production at low- and to an enhancement at high transverse momenta. This is in qualitative agreement with previous studies of hard proton knockout in proton-deuteron collisions. We analyze different physical sources of uncertainty which may influence the extraction of the total charmonium-neutron cross section. The color transparency effect for the incoming $\bar p$ largely compensates the influence of charmonium rescattering both at low and high transverse momenta. Different choices of the deuteron wave function lead to significant uncertainties at high transverse momenta. As an outcome of the calculations of charmonium production, we also provide predictions on the production of open charm hadrons due to the dissociation of the charmonium on the neutron. It is shown that the open charm production cross section is proportional to the total charmonium-nucleon cross section and quite stable with respect to the variation of other parameters of the model. We thus suggest that open charm channels are most suited for future studies of charmonium-nucleon interactions at PANDA with a deuteron target.


title: Convolution identities for Dunkl orthogonal polynomials from the $\mathfrak{osp}(1|2)$ Lie superalgebra

abstract: New convolution identities for orthogonal polynomials belonging to the $q=-1$ analog of the Askey-scheme are obtained. A specialization of the Chihara polynomials will play a central role as the eigenfunctions of a special element of the Lie superalgebra $\mathfrak{osp}(1|2)$ in the positive discrete series representation. Using the Clebsch-Gordan coefficients, a convolution identity for the Specialized Chihara, the dual -1 Hahn and the Big -1 Jacobi polynomials is found. Using the Racah coefficients, a convolution identity for the Big -1 Jacobi and the Bannai-Ito polynomials is found. Finally, these results are applied to construct a bilinear generating function for the Big -1 Jacobi polynomials.


title: Two-qubit entangling gates within arbitrarily long chains of trapped ions

abstract: Ion trap systems are a leading platform for large scale quantum computers. Trapped ion qubit crystals are fully-connected and reconfigurable, owing to their long range Coulomb interaction that can be modulated with external optical forces. However, the spectral crowding of collective motional modes could pose a challenge to the control of such interactions for large numbers of qubits. Here, we show that high-fidelity quantum gate operations are still possible with very large trapped ion crystals, simplifying the scaling of ion trap quantum computers. To this end, we present analytical work that determines how parallel entangling gates produce a crosstalk error that falls off as the inverse cube of the distance between the pairs. We also show experimental work demonstrating entangling gates on a fully-connected chain of seventeen $^{171}{\rm{Yb}}^{+}$ ions with fidelities as high as $97(1)\%$.


title: Some remarks on the spectral functions of the Abelian Higgs Model

abstract: We consider the unitary Abelian Higgs model and investigate its spectral functions at one-loop order. This analysis allows to disentangle what is physical and what is not at the level of the elementary particle propagators, in conjunction with the Nielsen identities. We highlight the role of the tadpole graphs and the gauge choices to get sensible results. We also introduce an Abelian Curci-Ferrari action coupled to a scalar field to model a massive photon which, like the non-Abelian Curci-Ferarri model, is left invariant by a modified non-nilpotent BRST symmetry. We clearly illustrate its non-unitary nature directly from the spectral function viewpoint. This provides a functional analogue of the Ojima observation in the canonical formalism: there are ghost states with nonzero norm in the BRST-invariant states of the Curci-Ferrari model.


title: Emotion Classification in Response to Tactile Enhanced Multimedia using Frequency Domain Features of Brain Signals

abstract: Tactile enhanced multimedia is generated by synchronizing traditional multimedia clips, to generate hot and cold air effect, with an electric heater and a fan. This objective is to give viewers a more realistic and immersing feel of the multimedia content. The response to this enhanced multimedia content (mulsemedia) is evaluated in terms of the appreciation/emotion by using human brain signals. We observe and record electroencephalography (EEG) data using a commercially available four channel MUSE headband. A total of 21 participants voluntarily participated in this study for EEG recordings. We extract frequency domain features from five different bands of each EEG channel. Four emotions namely: happy, relaxed, sad, and angry are classified using a support vector machine in response to the tactile enhanced multimedia. An increased accuracy of 76:19% is achieved when compared to 63:41% by using the time domain features. Our results show that the selected frequency domain features could be better suited for emotion classification in mulsemedia studies.


title: A general method for regularizing tensor decomposition methods via pseudo-data

abstract: Tensor decomposition methods allow us to learn the parameters of latent variable models through decomposition of low-order moments of data. A significant limitation of these algorithms is that there exists no general method to regularize them, and in the past regularization has mostly been performed using bespoke modifications to the algorithms, tailored for the particular form of the desired regularizer. We present a general method of regularizing tensor decomposition methods which can be used for any likelihood model that is learnable using tensor decomposition methods and any differentiable regularization function by supplementing the training data with pseudo-data. The pseudo-data is optimized to balance two terms: being as close as possible to the true data and enforcing the desired regularization. On synthetic, semi-synthetic and real data, we demonstrate that our method can improve inference accuracy and regularize for a broad range of goals including transfer learning, sparsity, interpretability, and orthogonality of the learned parameters.


title: Human vs. Muppet: A Conservative Estimate of Human Performance on the GLUE Benchmark

abstract: The GLUE benchmark (Wang et al., 2019b) is a suite of language understanding tasks which has seen dramatic progress in the past year, with average performance moving from 70.0 at launch to 83.9, state of the art at the time of writing (May 24, 2019). Here, we measure human performance on the benchmark, in order to learn whether significant headroom remains for further progress. We provide a conservative estimate of human performance on the benchmark through crowdsourcing: Our annotators are non-experts who must learn each task from a brief set of instructions and 20 examples. In spite of limited training, these annotators robustly outperform the state of the art on six of the nine GLUE tasks and achieve an average score of 87.1. Given the fast pace of progress however, the headroom we observe is quite limited. To reproduce the data-poor setting that our annotators must learn in, we also train the BERT model (Devlin et al., 2019) in limited-data regimes, and conclude that low-resource sentence classification remains a challenge for modern neural network approaches to text understanding.


title: Thin film synthesis of semiconductors in the Mg-Sb-N materials system

abstract: Nitrides feature many interesting properties, such as a wide range of bandgaps suitable for optoelectronic devices including light-emitting diodes (LEDs), and piezoelectric response used in microelectromechanical systems (MEMS). Nitrides are also significantly underexplored compared to oxides and other chemistries, with many being thermochemically metastable, sparking interest from a basic science point of view. This paper reports on experimental and computational exploration of the Mg-Sb-N material system, featuring both metastable materials and interesting semiconducting properties. Using sputter deposition, we discovered a new Mg2SbN3 nitride with a wurtzite-derived crystal structure and synthesized the antimonide-nitride Mg3SbN with an antiperovskite crystal structure for the first time in thin film form. Theoretical calculations indicate that Mg2SbN3 is metastable and has properties relevant to LEDs and MEMS, whereas Mg3SbN has a large dielectric constant (28\epsilon_0) and low hole effective masses (0.9m_0), of interest for photovoltaic solar cell absorbers. The experimental solar-matched 1.3 eV optical absorption onset of the Mg3SbN antiperovskite agrees with the theoretical prediction (1.3 eV direct, 1.1 eV indirect), and with the measurements of room-temperature near-bandgap photoluminescence. These results make an important contribution towards understanding semiconductor properties and chemical trends in the Mg-Sb-N materials system, paving the way to future practical applications of these novel materials.


title: DIVA: Domain Invariant Variational Autoencoders

abstract: We consider the problem of domain generalization, namely, how to learn representations given data from a set of domains that generalize to data from a previously unseen domain. We propose the Domain Invariant Variational Autoencoder (DIVA), a generative model that tackles this problem by learning three independent latent subspaces, one for the domain, one for the class, and one for any residual variations. We highlight that due to the generative nature of our model we can also incorporate unlabeled data from known or previously unseen domains. To the best of our knowledge this has not been done before in a domain generalization setting. This property is highly desirable in fields like medical imaging where labeled data is scarce. We experimentally evaluate our model on the rotated MNIST benchmark and a malaria cell images dataset where we show that (i) the learned subspaces are indeed complementary to each other, (ii) we improve upon recent works on this task and (iii) incorporating unlabelled data can boost the performance even further.


title: LdSM: Logarithm-depth Streaming Multi-label Decision Trees

abstract: We consider multi-label classification where the goal is to annotate each data point with the most relevant $\textit{subset}$ of labels from an extremely large label set. Efficient annotation can be achieved with balanced tree predictors, i.e. trees with logarithmic-depth in the label complexity, whose leaves correspond to labels. Designing prediction mechanism with such trees for real data applications is non-trivial as it needs to accommodate sending examples to multiple leaves while at the same time sustain high prediction accuracy. In this paper we develop the LdSM algorithm for the construction and training of multi-label decision trees, where in every node of the tree we optimize a novel objective function that favors balanced splits, maintains high class purity of children nodes, and allows sending examples to multiple directions but with a penalty that prevents tree over-growth. Each node of the tree is trained once the previous node is completed leading to a streaming approach for training. We analyze the proposed objective theoretically and show that minimizing it leads to pure and balanced data splits. Furthermore, we show a boosting theorem that captures its connection to the multi-label classification error. Experimental results on benchmark data sets demonstrate that our approach achieves high prediction accuracy and low prediction time and position LdSM as a competitive tool among existing state-of-the-art approaches.