title: A simulation of a COVID-19 epidemic based on a deterministic SEIR model

abstract: An epidemic disease caused by a new coronavirus has spread in Northern Italy with a strong contagion rate. We implement an SEIR model to compute the infected population and number of casualties of this epidemic. The example may ideally regard the situation in the Italian Region of Lombardy, where the epidemic started on February 25. We calibrate the model with the number of dead individuals to date (May 5, 2020) and constraint the parameters on the basis of values reported in the literature. The peak occurs at day 37 (March 31) approximately, when there is a rapid decrease, with a reproduction ratio R0 = 3 initially, 1.36 at day 22 and 0.8 after day 35, indicating different degrees of lockdown. The predicted death toll is approximately 15600 casualties, with 2.7 million infected individuals at the end of the epidemic. The incubation period providing a better fit of the dead individuals is 4.25 days and the infection period is 4 days, with a fatality rate of 0.00144/day [values based on the reported (official) number of casualties]. The infection fatality rate (IFR) is 0.57 %, and 2.36 % if twice the reported number of casualties is assumed. However, these rates depend on the initially exposed individuals. If approximately nine times more individuals are exposed, there are three times more infected people at the end of the epidemic and IFR = 0.47 %. If we relax these constraints and use a wider range of lower and upper bounds for the incubation and infection periods, we observe that a higher incubation period (13 versus 4.25 days) gives the same IFR (0.6 versus 0.57 %), but nine times more exposed individuals in the first case. Therefore, a precise determination of the fatality rate is subject to the knowledge of the characteristics of the epidemic.


title: Non-perturbative renormalization scheme for the CP-odd three-gluon operator

abstract: We define a regularization-independent momentum-subtraction scheme for the $CP$-odd three-gluon operator at dimension six. This operator appears in effective field theories for heavy physics beyond the Standard Model, describing the indirect effect of new sources of $CP$-violation at low energies. In a hadronic context, it induces permanent electric dipole moments. The hadronic matrix elements of the three-gluon operator are non-perturbative objects that should ideally be evaluated with lattice QCD. We define a non-perturbative renormalization scheme that can be implemented on the lattice and we compute the scheme transformation to $\overline{\text{MS}}$ at one loop. Our calculation can be used as an interface to future lattice-QCD calculations of the matrix elements of the three-gluon operator, in order to obtain theoretically robust constraints on physics beyond the Standard Model from measurements of the neutron electric dipole moment.


title: Event Based, Near Eye Gaze Tracking Beyond 10,000Hz

abstract: The cameras in modern gaze-tracking systems suffer from fundamental bandwidth and power limitations, constraining data acquisition speed to 300 Hz realistically. This obstructs the use of mobile eye trackers to perform, e.g., low latency predictive rendering, or to study quick and subtle eye motions like microsaccades using head-mounted devices in the wild. Here, we propose a hybrid frame-event-based near-eye gaze tracking system offering update rates beyond 10,000 Hz with an accuracy that matches that of high-end desktop-mounted commercial trackers when evaluated in the same conditions. Our system builds on emerging event cameras that simultaneously acquire regularly sampled frames and adaptively sampled events. We develop an online 2D pupil fitting method that updates a parametric model every one or few events. Moreover, we propose a polynomial regressor for estimating the point of gaze from the parametric pupil model in real time. Using the first event-based gaze dataset, available at https://github.com/aangelopoulos/event_based_gaze_tracking , we demonstrate that our system achieves accuracies of 0.45 degrees--1.75 degrees for fields of view from 45 degrees to 98 degrees. With this technology, we hope to enable a new generation of ultra-low-latency gaze-contingent rendering and display techniques for virtual and augmented reality.


title: Isolas of multi-pulse solutions to lattice dynamical systems

abstract: This work investigates the existence and bifurcation structure of multi-pulse steady-state solutions to bistable lattice dynamical systems. Such solutions are characterized by multiple compact disconnected regions where the solution resembles one of the bistable states and resembles another trivial bistable state outside of these compact sets. It is shown that the bifurcation curves of these multi-pulse solutions lie along closed and bounded curves (isolas), even when single-pulse solutions lie along unbounded curves. These results are applied to a discrete Nagumo differential equation and we show that the hypotheses of this work can be confirmed analytically near the anti-continuum limit. Results are demonstrated with a number of numerical investigations.


title: Quantifying Tri-partite Entanglement with Entropic Correlations

abstract: We show how to quantify tri-partite entanglement using entropies derived from experimental correlations. We use a multi-partite generalization of the entanglement of formation that is greater than zero if and only if the state is genuinely multi-partite entangled. We develop an entropic witness for tripartite entanglement, and show that the degree of violation of this witness places a lower limit on the tripartite entanglement of formation. We test our results in the three-qubit regime using the GHZ-Werner state and the W-Werner state, and in the high-dimensional pure-state regime using the triple-Gaussian wavefunction describing the spatial and energy-time entanglement in photon triplets generated in third-order spontaneous parametric down-conversion. In addition, we discuss the challenges in quantifying the entanglement for progressively larger numbers of parties, and give both entropic and target-state-based witnesses of multi-partite entanglement that circumvent this issue.


title: Feature Pyramid Grids

abstract: Feature pyramid networks have been widely adopted in the object detection literature to improve feature representations for better handling of variations in scale. In this paper, we present Feature Pyramid Grids (FPG), a deep multi-pathway feature pyramid, that represents the feature scale-space as a regular grid of parallel bottom-up pathways which are fused by multi-directional lateral connections. FPG can improve single-pathway feature pyramid networks by significantly increasing its performance at similar computation cost, highlighting importance of deep pyramid representations. In addition to its general and uniform structure, over complicated structures that have been found with neural architecture search, it also compares favorably against such approaches without relying on search. We hope that FPG with its uniform and effective nature can serve as a strong component for future work in object recognition.


title: Zeros of $\mathrm{GL}_2$ $L$-functions on the critical line

abstract: We use Levinson's method and the work of Blomer and Harcos on the $\mathrm{GL}_2$ shifted convolution problem to prove that at least 6.96% of the zeros of the L-function of any holomorphic or Maass cusp form lie on the critical line.


title: On quantum channels and operations preserving finiteness of the von Neumann entropy

abstract: We describe the class (semigroup) of quantum channels mapping states with finite entropy into states with finite entropy. We show, in particular, that this class is naturally decomposed into three convex subclasses, two of them are closed under concatenations and tensor products. We obtain asymptotically tight universal continuity bounds for the output entropy of two types of quantum channels: channels with finite output entropy and energy-constrained channels preserving finiteness of the entropy.


title: Surgery operations to fold maps to increase connected components of singular sets by two

abstract: In geometry, understanding the topologies and the differentiable structures of manifolds in constructive ways is fundamental and important. It is in general difficult, especially for higher dimensional manifolds. The author is interested in this and trying to understand manifolds via construction of explicit fold maps: differentiable maps locally represented as product maps of Morse functions and identity maps on open balls. Fold maps have been fundamental and useful in investigating the manifolds by observing (the sets of) singular points and values and preimages as Thom and Whitney's pioneering studies and recent studies of Kobayashi, Saeki, Sakuma, and so on, show. Here, construction of explicit fold maps on explicit manifolds is difficult. The author constructed several explicit families of fold maps and investigated the manifolds admitting the maps. Main fundamental methods are surgery operations (bubbling operations), the author recently introduced motivated by Kobayashi and Saeki's studies such as operations to deform generic differentiable maps whose codimensions are negative into the plane preserving the differentiable structure of the manifold in 1996 and so on. We remove a neighborhood of a (an immersed) submanifold consisting of regular values in the target space, attach a new map and obtain a new fold map such that the number of connected components of the set consisting of singular points increases. In this paper, we investigate cases where the numbers increase by two and obtain cases of a new type.


title: Numerical Simulations of the Molecular Behavior and Entropy of Non-Ideal Argon

abstract: A numerical model is built, simulating the principles of kinetic gas theory, to predict pressures of molecules in a spherical pressure vessel; the model tracks a single particle and multiplies the force on the spherical walls by a mole of molecules to predict the net pressure. An intermolecular attractive force is added for high-density simulations, to replicate a real fluid; the force is chosen to ensure the fluid matches the Peng-Robinson equation of state as it is compressed to a near supercritical density. The standard deviations of the molecule position and velocity with respect to temperature and density is studied to define the entropy. A parametric study of a Stirling cycle heat engine utilizing near-supercritical densities is modeled, to study how the temperature dependence of the attractive intermolecular Van der Waal forces can affect the net total entropy change to the surrounding environment.


title: Bi-interpretability with $\mathbb{Z}$ and models of the complete elementary theories of $\text{SL}_n(\mathcal{O})$, $\text{T}_n(\mathcal{O})$ and $\text{GL}_n(\mathcal{O})$, $n\geq 3$

abstract: Let $\mathcal{O}$ be the ring of integers of a number field, and let $n\geq 3$. This paper studies bi-interpretability of the ring of integers $\mathbb{Z}$ with the special linear group $\text{SL}_n(\mathcal{O})$, the general linear group $\text{GL}_n(\mathcal{O})$ and solvable group of all invertible uppertriangular matrices over $\mathcal{O}$, $\text{T}_n(\mathcal{O})$. For each of these groups we provide a complete characterization of arbitrary models of their complete elementary theories.


title: From Artificial Neural Networks to Deep Learning for Music Generation -- History, Concepts and Trends

abstract: The current wave of deep learning (the hyper-vitamined return of artificial neural networks) applies not only to traditional statistical machine learning tasks: prediction and classification (e.g., for weather prediction and pattern recognition), but has already conquered other areas, such as translation. A growing area of application is the generation of creative content, notably the case of music, the topic of this paper. The motivation is in using the capacity of modern deep learning techniques to automatically learn musical styles from arbitrary musical corpora and then to generate musical samples from the estimated distribution, with some degree of control over the generation. This paper provides a tutorial on music generation based on deep learning techniques. After a short introduction to the topic illustrated by a recent exemple, the paper analyzes some early works from the late 1980s using artificial neural networks for music generation and how their pioneering contributions have prefigured current techniques. Then, we introduce some conceptual framework to analyze the various concepts and dimensions involved. Various examples of recent systems are introduced and analyzed to illustrate the variety of concerns and of techniques.


title: Good Basic Invariants for Elliptic Weyl Groups and Frobenius Structures

abstract: In this paper, we define a set of good basic invariants for the elliptic Weyl group for the elliptic root system. For an elliptic root system of codimension $1$, we show that a set of good basic invariants gives a set of flat invariants obtained by Saito and Taylor coefficients of the good basic invariants give the structure constants of the multiplication of the Frobenius structure obtained by the author.


title: Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots

abstract: In this paper, we study the problem of employing pre-trained language models for multi-turn response selection in retrieval-based chatbots. A new model, named Speaker-Aware BERT (SA-BERT), is proposed in order to make the model aware of the speaker change information, which is an important and intrinsic property of multi-turn dialogues. Furthermore, a speaker-aware disentanglement strategy is proposed to tackle the entangled dialogues. This strategy selects a small number of most important utterances as the filtered context according to the speakers' information in them. Finally, domain adaptation is performed to incorporate the in-domain knowledge into pre-trained language models. Experiments on five public datasets show that our proposed model outperforms the present models on all metrics by large margins and achieves new state-of-the-art performances for multi-turn response selection.


title: Salience Estimation with Multi-Attention Learning for Abstractive Text Summarization

abstract: Attention mechanism plays a dominant role in the sequence generation models and has been used to improve the performance of machine translation and abstractive text summarization. Different from neural machine translation, in the task of text summarization, salience estimation for words, phrases or sentences is a critical component, since the output summary is a distillation of the input text. Although the typical attention mechanism can conduct text fragment selection from the input text conditioned on the decoder states, there is still a gap to conduct direct and effective salience detection. To bring back direct salience estimation for summarization with neural networks, we propose a Multi-Attention Learning framework which contains two new attention learning components for salience estimation: supervised attention learning and unsupervised attention learning. We regard the attention weights as the salience information, which means that the semantic units with large attention value will be more important. The context information obtained based on the estimated salience is incorporated with the typical attention mechanism in the decoder to conduct summary generation. Extensive experiments on some benchmark datasets in different languages demonstrate the effectiveness of the proposed framework for the task of abstractive summarization.


title: Multimodal Image Synthesis with Conditional Implicit Maximum Likelihood Estimation

abstract: Many tasks in computer vision and graphics fall within the framework of conditional image synthesis. In recent years, generative adversarial nets (GANs) have delivered impressive advances in quality of synthesized images. However, it remains a challenge to generate both diverse and plausible images for the same input, due to the problem of mode collapse. In this paper, we develop a new generic multimodal conditional image synthesis method based on Implicit Maximum Likelihood Estimation (IMLE) and demonstrate improved multimodal image synthesis performance on two tasks, single image super-resolution and image synthesis from scene layouts. We make our implementation publicly available.


title: Horizontal Line Nodes in Sr2RuO4 Proved by Spin Resonance

abstract: We investigated the low-energy incommensurate (IC) magnetic fluctuations in Sr$_2$RuO$_4$ by the high-resolution inelastic neutron scattering measurements and random phase approximation (RPA) calculations. We observed a spin resonance with energy of $\hbar\omega_\text{res}=0.56$~meV centered at a characteristic wavevector $\mathbf{Q}_\text{res}=(0.3, 0.3, 0.5)$. The resonance energy corresponds well to the superconducting gap $2\Delta=0.56$~meV estimated by the tunneling spectroscopy. The spin resonance shows the $L$ modulation with a maximum at around $L = 0.5$. The $L$ modulated intensity of the spin resonance and our RPA calculations indicate that the superconducting gaps regarding the quasi-one-dimensional $\alpha$ and $\beta$ sheets at the Fermi surfaces have the horizontal line nodes. These results may set a strong constraint on the pairing symmetry of Sr$_2$RuO$_4$. We also discuss the implications on possible superconducting order parameters.


title: A Structural Approach to Dynamic Migration in Petri Net Models of Structured Workflows

abstract: In the context of dynamic evolution of workflow processes, the change region identifies the part of the old process from which migration to the new process is guaranteed to be inconsistent. However, this approach may lead to overestimated regions, incorrectly identifying migratable instances as non-migratable. This overestimation causes delays due to postponement of immediate migration. The paper analyzes this overestimation problem on a class of Petri nets models. Structural properties leading to conditions for minimal change regions and overestimations are developed resulting into classification of change regions into two types of change regions called Structural Change Regions and Perfect Structural Change Regions. Necessary and sufficient conditions for perfect regions are identified. The paper also discusses ways for computing the same in terms of structural properties of the old and the new processes.


title: On lattice-ordered $t_{r}$-norms for type-2 fuzzy sets

abstract: In this paper, it is proved that, for the truth value algebra of interval-valued fuzzy sets, the distributive laws do not imply the monotonicity condition for the set inclusion operation. Then, a lattice-ordered $t_{r}$-norm, which is not the convolution of $t$-norms on $[0, 1]$, is obtained. These results negatively answer two open problems posed by Walker and Walker in [15].


title: Jordan constants of quaternion algebras over number fields and simple abelian surfaces over fields of positive characteristic

abstract: We compute and provide a detailed description on the Jordan constants of the multiplicative subgroup of quaternion algebras over number fields of small degree. As an application, we determine the Jordan constants of the multiplicative subgroup of the endomorphism algebras of simple abelian surfaces over fields of positive characteristic.


title: A Front Fixing Implicit Finite Difference Method for the American Put Options Model

abstract: In this paper, we present an implicit finite difference method for the numerical solution of the Black-Scholes model of American put options without dividend payments. We combine the proposed numerical method by using a front fixing approach where the option price and the early exercise boundary are computed simultaneously. Consistency and stability properties of the method are studied. We choose to improve the accuracy of the computed solution via a mesh refinement based on Richardson's extrapolation. Comparisons with some proposed methods for the American options problem are carried out to validate the obtained numerical results and to show the efficiency of the proposed numerical methods. Finally, by \textit{a posteriori} error estimator, we find a suitable computational grid requiring that the computed solution verifies a prefixed tolerance.


title: On certain partition bijections related to Euler's partition problem

abstract: We give short elementary expositions of combinatorial proofs of some variants of Euler's partitition problem that were first addressed analytically by George Andrews, and later combinatorially by others. Our methods, based on ideas from a previous paper by the author , enable us to state and prove new generalizations of two of these results.


title: JHU-CROWD++: Large-Scale Crowd Counting Dataset and A Benchmark Method

abstract: Due to its variety of applications in the real-world, the task of single image-based crowd counting has received a lot of interest in the recent years. Recently, several approaches have been proposed to address various problems encountered in crowd counting. These approaches are essentially based on convolutional neural networks that require large amounts of data to train the network parameters. Considering this, we introduce a new large scale unconstrained crowd counting dataset (JHU-CROWD++) that contains "4,372" images with "1.51 million" annotations. In comparison to existing datasets, the proposed dataset is collected under a variety of diverse scenarios and environmental conditions. Specifically, the dataset includes several images with weather-based degradations and illumination variations, making it a very challenging dataset. Additionally, the dataset consists of a rich set of annotations at both image-level and head-level. Several recent methods are evaluated and compared on this dataset. The dataset can be downloaded from http://www.crowd-counting.com . Furthermore, we propose a novel crowd counting network that progressively generates crowd density maps via residual error estimation. The proposed method uses VGG16 as the backbone network and employs density map generated by the final layer as a coarse prediction to refine and generate finer density maps in a progressive fashion using residual learning. Additionally, the residual learning is guided by an uncertainty-based confidence weighting mechanism that permits the flow of only high-confidence residuals in the refinement path. The proposed Confidence Guided Deep Residual Counting Network (CG-DRCN) is evaluated on recent complex datasets, and it achieves significant improvements in errors.


title: One-generated nilpotent Novikov algebras

abstract: We give a classification of 5- and 6-dimensional complex one-generated nilpotent Novikov algebras


title: Orbital and asymptotic stability of a train of peakons for the Novikov equation

abstract: The Novikov equation is an integrable Camassa-Holm type equation with cubic nonlinearity. One of the most important features of this equation is the existence of peakon and multi-peakon solutions, i.e. peaked traveling waves behaving as solitons. This paper aims to prove both, the orbital and asymptotic stability of peakon trains solutions, i.e. multi-peakon solutions such that their initial configuration is increasingly ordered. Furthermore, we give an improvement of the orbital stability of a single peakon so that we can drop the non-negativity hypothesis on the momentum density. The same result also holds for the orbital stability for peakon trains, i.e. in this latter case we can also avoid assuming non-negativity of the initial momentum density. Finally, as a corollary of these results together with some asymptotic formulas for the position and momenta vectors for multi-peakon solutions, we obtain the orbital and asymptotic stability for initially not well-ordered multipeakons.


title: Erosion driven size-redistribution of protoplanetary disk solids and the onset of streaming Instability and Pebble Accretion

abstract: The formation of the first planetesimals and the final growth of planetary cores relies on the abundance of small pebbles. The efficiencies of both the streaming instability (SI) process, suggested to catalyze the early growth of planetesimals, and the pebble-accretion process, suggested to accelerate the growth of planetary cores, depend on the sizes of solids residing in the disk. In particular, these processes were found to be sensitive to size distribution of solids, and efficient planetesimal formation and growth through these channels require a limited pebble size distribution. Here we show that aeolian erosion, a process that efficiently grinds down boulders into a mono-sized distribution of pebbles, provides a natural upper limit for the maximal pebble sizes (in terms of their Stokes number). We find the dependence of this upper limit on the radial separation, disk age, turbulence strength, and the grain-size composition of the boulders in the disk. SI is favorable in areas with a Stokes number less than 0.1, which is found in the inner sub-astronomical-unit regions of the disk. This upper limit shapes the size distribution of small pebbles and thereby catalyzes the early onset of planetesimal formation due to SI, and the later core accretion growth through pebble accretion.


title: Updated Parameters and a New Transmission Spectrum of HD 97658b

abstract: Recent years have seen increasing interest in the characterization of sub-Neptune sized planets because of their prevalence in the Galaxy, contrasted with their absence in our solar system. HD 97658 is one of the brightest stars hosting a planet of this kind, and we present the transmission spectrum of this planet by combining four HST transits, twelve Spitzer/IRAC transits, and eight MOST transits of this system. Our transmission spectrum has higher signal to noise ratio than that from previous works, and the result suggests that the slight increase in transit depth from wavelength 1.1 to 1.7 microns reported in previous works on the transmission spectrum of this planet is likely systematic. Nonetheless, our atmospheric modeling results are not conclusive as no model provides an excellent match to our data. Nonetheless we find that atmospheres with high C/O ratios (C/O >~ 0.8) and metallicities of >~ 100x solar metallicity are favored. We combine the mid-transit times from all the new Spitzer and MOST observations and obtain an updated orbital period of P=9.489295 +/- 0.000005 d, with a best-fit transit time center at T_0 = 2456361.80690 +/- 0.00038 (BJD). No transit timing variations are found in this system. We also present new measurements of the stellar rotation period (34 +/- 2 d) and stellar activity cycle (9.6 yr) of the host star HD 97658. Finally, we calculate and rank the Transmission Spectroscopy Metric of all confirmed planets cooler than 1000 K and with sizes between 1 and 4 R_Earth. We find that at least a third of small planets cooler than 1000 K can be well characterized using JWST, and of those, HD 97658b is ranked fifth, meaning it remains a high-priority target for atmospheric characterization.


title: Light Quark Mediated Higgs Boson Threshold Production in the Next-to-Leading Logarithmic Approximation

abstract: We study the amplitude of the Higgs boson production in gluon fusion mediated by a light quark loop and evaluate the logarithmically enhanced radiative corrections to the next-to-leading logarithmic approximation which sums up the terms of the form $\alpha_s^n\ln^{2n-1}(m_H/m_q)$ to all orders in the strong coupling constant. This result is used for the calculation of the process cross section near the production threshold and gives a quantitative estimate of the three and four-loop bottom quark contribution to the Higgs boson production at the Large Hadron Collider.


title: Cosmic archaeology with massive stellar black hole binaries

abstract: The existence of massive stellar black hole binaries (MBHBs), with primary black hole (BH) masses $\ge 31 \, M_\odot$, was proven by the detection of the gravitational wave (GW) event GW150914 during the first LIGO/Virgo observing run (O1), and successively confirmed by seven additional GW signals discovered in the O1 and O2 data. By adopting the galaxy formation model \texttt{GAMESH} coupled with binary population synthesis (BPS) calculations, here we investigate the origin of these MBHBs by selecting simulated binaries compatible in mass and coalescence redshifts. We find that their cosmic birth rates peak in the redshift range $6.5 \leq z \leq 10$, regardless of the adopted BPS. These MBHBs are then old systems forming in low-metallicity ($Z \sim [0.01-0.1] \, Z_{\odot}$), low-stellar-mass galaxies, before the end of cosmic reionization, i.e. significantly beyond the peak of cosmic star formation. GW signals generated by coalescing MBHBs open up new possibilities to probe the nature of stellar populations in remote galaxies, at present too faint to be detected by available electromagnetic facilities.


title: Learning about learning by many-body systems

abstract: Diverse many-body systems, from soap bubbles to suspensions to polymers, learn and remember patterns in the drives that push them far from equilibrium. This learning may be leveraged for computation, memory, and engineering. Until now, many-body learning has been detected with thermodynamic properties, such as work absorption and strain. We progress beyond these macroscopic properties first defined for equilibrium contexts: We quantify statistical mechanical learning using representation learning, a machine-learning model in which information squeezes through a bottleneck. By calculating properties of the bottleneck, we measure four facets of many-body systems' learning: classification ability, memory capacity, discrimination ability, and novelty detection. Numerical simulations of a classical spin glass illustrate our technique. This toolkit exposes self-organization that eludes detection by thermodynamic measures: Our toolkit more reliably and more precisely detects and quantifies learning by matter while providing a unifying framework for many-body learning.

categories: cond-mat.stat-mech cond-mat.dis-nn cond-mat.soft physics.bio-ph


title: Topological critical states and anomalous electronic transmittance in one dimensional quasicrystals

abstract: Due to the absence of periodic length scale, electronic states and their topological properties in quasicrystals have been barely understood. Here, we focus on one dimensional quasicrystal and reveal that their electronic critical states are topologically robust. Based on tiling space cohomology, we exemplify the case of one dimensional aperiodic tilings especially Fibonacci quasicrystal and prove the existence of topological critical states at zero energy. Furthermore, we also show exotic electronic transmittance behavior near such topological critical states. Within the perturbative regime, we discuss lack of translational symmetries and presence of topological critical states lead to unconventional scaling behavior in transmittance. Considering both analytic analysis and numerics, electronic transmittance is computed in cases where the system is placed in air or is connected by semi-infinite periodic leads. Finally, we also discuss generalization of our analysis to other quasicrystals. Our findings open a new class of topological quantum states which solely exist in quasicrystals due to exotic tiling patterns in the absence of periodic length scale, and their anomalous electronic transport properties applicable to many experiments.


title: On the significance of relativistically hot pairs in the jets of FR II radio galaxies

abstract: The energetic composition of radio lobes in the FR II galaxies $-$ estimated by comparing their radio luminosities with the powers required to inflate cavities in the external medium $-$ seems to exclude the possibility of their energetic domination by protons. Furthermore, if the jets were dominated by the kinetic energy of cold protons, it would be difficult to efficiently accelerate leptons in the jets' terminal shocks. Assuming that the relative energy contents of leptons, protons and magnetic fields are preserved across the shocks, the above implies that the large-scale jets should also be energetically dominated by leptons: $P_{\rm e,j} \gtrsim P_{\rm p,j}$. On the other hand, previous studies of small-scale jets in blazars and radio cores suggest a pair content (number of electrons and positrons per proton) of the order of $n_{\rm e}/n_{\rm p} \sim 20$. Assuming further that the particle composition of jets does not evolve beyond the blazar scales, we show that this implies an average random Lorentz factor of leptons in large-scale jets of $\bar\gamma_{\rm e,j} \gtrsim 70(1+\chi_{\rm p})(20n_{\rm p}/n_{\rm e})$, and that the protons should be mildly relativistic with $\chi_{\rm p} \equiv (\epsilon_{\rm p} + p_{\rm p})/\rho_{\rm p} c^2 \lesssim 2$, $p_{\rm p}$ the pressure of protons, $\epsilon_{\rm p}$ the internal energy density of protons, and $\rho_{\rm p} c^2$ the rest-mass energy density of protons. We derive the necessary conditions for loading the inner jets by electron-positron pairs and proton-electron plasma, and provide arguments that heating of leptons in jets is dominated by magnetic reconnection.


title: TuringAdvice: A Generative and Dynamic Evaluation of Language Use

abstract: We propose TuringAdvice, a new challenge task and dataset for language understanding models. Given a written situation that a real person is currently facing, a model must generate helpful advice in natural language. Our evaluation framework tests a fundamental aspect of human language understanding: our ability to use language to resolve open-ended situations by communicating with each other. Empirical results show that today's models struggle at TuringAdvice, even multibillion parameter models finetuned on 600k in-domain training examples. The best model, a finetuned T5, writes advice that is at least as helpful as human-written advice in only 14% of cases; a much larger non-finetunable GPT3 model does even worse at 4%. This low performance reveals language understanding errors that are hard to spot outside of a generative setting, showing much room for progress.


title: Uncertainties in supernova input rates drive qualitative differences in simulations of galaxy evolution

abstract: Feedback from core collapse supernovae (SNe), the final stage of evolution of massive stars, is a key element in galaxy formation theory. The energy budget of SN feedback, as well as the duration over which SNe occur, are constrained by stellar lifetime models and the minimum mass star that ends its life as a SN. Simplifying approximations for this SN rate are ubiquitous in simulation studies. We show here how the choice of SN budget and timings ($t_0$ for the delay between star formation and the first SN, $\tau_{\rm SN}$ for the duration of SN injection, and the minimum SN progenitor mass) drive changes in the regulation of star formation and outflow launching. Extremely long delays for instantaneous injection of SN energy $(t_0 << 20\;\rm{Myr})$ reduces star formation and drive stronger outflows compared smaller delays. This effect is primarily driven by enhanced clustering of young stars. With continuous injection of energy, longer SN durations results in a larger fraction of SN energy deposited in low ambient gas densities, where cooling losses are lower. This is effect is particularly when driven by the choice of the minimum SN progenitor mass, which also sets the total SN energy budget. These underlying uncertainties mean that despite advances in the sub-grid modeling of SN feedback, serious difficulties in constraining the strength of SN feedback remain. We recommend future simulations use realistic SN injection durations, and bound their results using SN energy budgets and durations for minimum SN progenitors of $7M_\odot$ and $9M_\odot$.


title: Dual Haldane sphere and quantized band geometry in chiral multifold fermions

abstract: We show that the chiral multifold fermions present a dual Haldane sphere problem in momentum space. Owing to the Berry monopole at the degenerate point, a dual Landau level emerges in the trace of quantum metric, with which a quantized geometric invariant is defined through a surface integration. We further demonstrate potential manifestations in the measurable, physical observables. With a lower bound derived for the finite spread of Wannier functions, anomalous phase coherence is identified accordingly for the flat band superconductivity. We briefly comment on the stability of these results under perturbations. Potential experimental probes of the quantum metric are also discussed.


title: Adding crust to BPS Skyrme neutron stars

abstract: The Skyrme model and its generalisations provide a conceptually appealing field-theory basis for the description of nuclear matter and, after its coupling to gravity, also of neutron stars. In particular, a specific Skyrme submodel, the so-called Bogomol'nyi-Prasad-Sommerfield (BPS) Skyrme model, allows both for an exact field-theoretic and a mean-field treatment of neutron stars, as a consequence of its perfect fluid property. A pure BPS Skyrme model description of neutron stars, however, only describes the neutron star core, by construction. Here we consider different possibilities to extrapolate a BPS Skyrme neutron star at high baryon density to a description valid at lower densities. In the exact field-theoretic case, a simple effective description of the neutron star crust can be used, because the exact BPS Skyrme neutron star solutions formally extend to sufficiently low densities. In the mean-field case, on the other hand, the BPS Skyrme neutron star solutions always remain above the nuclear saturation density and, therefore, must be joined to a different nuclear physics equation of state already for the outer core. We study the resulting neutron stars in both cases, facilitating an even more complete comparison between Skyrmionic neutron stars and neutron stars obtained from other approaches, as well as with observations.


title: Modelling a bright z = 6 galaxy at the faint end of the AGN luminosity function

abstract: Recent deep surveys have unravelled a population of faint active galactic nuclei (AGN) in the high redshift Universe, leading to various discussions on their nature and their role during the Epoch of Reionization. We use cosmological radiation-hydrodynamics simulations of a bright galaxy at z = 6 ($M_\star \gtrsim 10^{10} M_\odot$) hosting an actively growing super-massive black hole to study the properties of these objects. In particular, we study how the black hole and the galaxy co-evolve and what is the relative contribution of the AGN and of the stellar populations to the luminosity budget of the system. We find that the feedback from the AGN has no strong effect on the properties of the galaxy, and does not increase the total ionizing luminosity of the host. The average escape fraction of our galaxy is around $f_{\rm esc} \sim 5\%$. While our galaxy would be selected as an AGN in deep X-ray surveys, most of the UV luminosity is originating from stellar populations. This confirms that there is a transition in the galaxy population from star forming galaxies to quasar hosts, with bright Lyman-Break Galaxies (LBGs) with $M_{\rm UV}$ around -22 falling in the overlap region. Our results also suggest that faint AGN do not contribute significantly to reionizing the Universe.


title: Outside the Wall: Hydrodynamics of Type I Supernovae Interacting with a Partially Swept-Up Circumstellar Medium

abstract: Explaining the observed diversity of supernovae (SNe) and the physics of explosion requires knowledge of their progenitor stars, which can be obtained by constraining the circumstellar medium (CSM). Models of the SN ejecta colliding with CSM are necessary to infer the structure of the CSM and tie it back to a progenitor model. Recent SNe I revealed CSM concentrated at a distance $r\sim10^16$ cm, for which models of SN interaction are extremely limited. In this paper, we assume the concentrated region is a "wall" representing swept-up material, and unswept material lies outside the wall. We simulate one-dimensional hydrodynamics of SNe Ia & Ib impacting 300 unique CSM configurations using RT1D, which captures the Rayleigh-Taylor instability. We find that the density ratio between the wall and ejecta -- denoted $A_0$ or "wall height" -- is key, and higher walls deviate more from self-similar evolution. Functional fits accounting for $A_0$ are presented for the forward shock radius evolution. We show that higher walls have more degeneracy between CSM properties in the deceleration parameter, slower shocks, deeper-probing reverse shocks, slower shocked ejecta, less ejecta mass than CSM in the shock, and more mixing of ejecta into the CSM at early times. We analyze observations of SN 2014C (Type Ib) and suggest that it had a moderately high wall ($10 < A_0 < 200$) and wind-like outer CSM. We also postulate an alternate interpretation for the radio data of SN 2014C, that the radio rise occurs in the wind rather than the wall. Finally, we find that hydrodynamic measurements at very late times cannot distinguish the presence of a wall, except perhaps as an anomalously wide shock region.


title: Excitonic Laughlin States in Ideal Topological Insulator Flat Bands and Possible Presence in Moir\'e Superlattice Materials

abstract: We investigate few- and many-body states in half-filled maximally symmetric topological insulator flat bands realized by two degenerate Landau levels which experience opposite magnetic fields. This serves as a toy model of flat bands in moir\'e materials in which valleys have Chern numbers $C= \pm 1$. We argue that although the spontaneously polarized Ising Chern magnet is a natural ground state for repulsive Coulomb interactions, it can be in reasonable energetic competition with correlated states which can be viewed as Laughlin states of excitons when short distance corrections to the interaction are included. This is because charge neutral excitons in these bands behave effectively as charged particles in ordinary Landau levels. In particular, the Ising Chern magnet is no longer the ground state once the strength of a short range intra-valley repulsion is about $30\%$ larger than the inter-valley repulsion. Remarkably, these excitonic Laughlin states feature valley number fractionalization but no charge fractionalization and a quantized charge Hall conductivity identical to the Ising magnet, $\sigma_{xy}= \pm e^2/h$, and thus cannot be distinguished from it by ordinary charge transport measurements. The most compact excitonic Laughlin state that can be constructed in these bands is an analogue of $\nu=1/4$ bosonic Laughlin state and has no valley polarization even though it spontaneously breaks time reversal symmetry with a charge Hall conductivity $\sigma_{xy}= \pm e^2/h$.


title: Topological Phase Transitions Induced by Varying Topology and Boundaries in the Toric Code

abstract: One of the important characteristics of topological phases of matter is the topology of the underlying manifold on which they are defined. In this paper, we present the sensitivity of such phases of matter to the underlying topology, by studying the phase transitions induced due to the change in the boundary conditions. We claim that these phase transitions are accompanied by broken symmetries in the excitation space and to gain further insight we analyze various signatures like the ground state degeneracy, topological entanglement entropy while introducing the open-loop operator whose expectation value effectively captures the phase transition. Further, we extend the analysis to an open quantum setup by defining effective collapse operators, the dynamics of which cool the system to different topologically ordered steady states. We show that the phase transition between such steady states is effectively captured by the expectation value of the open-loop operator.


title: High-resolution, 3D radiative transfer modelling. II. The early-type spiral galaxy M81

abstract: Interstellar dust absorbs stellar light very efficiently and thus shapes the energetic output of galaxies. Studying the impact of different stellar populations on the dust heating remains hard because it requires decoupling the relative geometry of stars and dust, and involves complex processes as scattering and non-local dust heating. We aim to constrain the relative distribution of dust and stellar populations in the spiral galaxy M81 and create a realistic model of the radiation field that describes the observations. Investigating the dust-starlight interaction on local scales, we want to quantify the contribution of young and old stellar populations to the dust heating. We aim to standardise the setup and model selection of such inverse radiative transfer simulations so this can be used for comparable modelling of other nearby galaxies. We present a semi-automated radiative transfer modelling pipeline that implements the necessary steps such as the geometric model construction and the normalisation of the components through an optimisation routine. We use the Monte Carlo radiative transfer code SKIRT to calculate a self-consistent, panchromatic model of the interstellar radiation field. By looking at different stellar populations independently, we can quantify to what extent different stellar age populations contribute to the dust heating. Our method takes into account the effects of non-local heating. We obtain a realistic 3D radiative transfer model of the face-on galaxy M81. We find that only 50.2\% of the dust heating can be attributed to young stellar populations. We confirm a tight correlation between the specific star formation rate and the heating fraction by young stellar populations, both in sky projection and in 3D, also found for radiative transfer models of M31 and M51. We conclude that... (abridged)


title: High-resolution, 3D radiative transfer modelling III. The DustPedia barred galaxies

abstract: Context: Dust in late-type galaxies in the local Universe is responsible for absorbing approximately one third of the energy emitted by stars. It is often assumed that dust heating is mainly attributable to the absorption of UV and optical photons emitted by the youngest (<= 100 Myr) stars. Consequently, thermal re-emission by dust at FIR wavelengths is often linked to the star-formation activity of a galaxy. However, several studies argue that the contribution to dust heating by much older stars might be more significant. Advances in radiation transfer (RT) simulations finally allow us to actually quantify the heating mechanisms of diffuse dust by the stellar radiation field. Aims: As one of the main goals in the DustPedia project, we have constructed detailed 3D stellar and dust RT models for nearby galaxies. We analyse the contribution of the different stellar populations to the dust heating in four face-on barred galaxies: NGC1365, M83, M95, and M100. We aim to quantify the fraction directly related to young stars, both globally and on local scales, and to assess the influence of the bar on the heating fraction. Results: We derive global attenuation laws for each galaxy and confirm that galaxies of high sSFR have shallower attenuation curves and weaker UV bumps. On average, 36.5% of the bolometric luminosity is absorbed by dust. We report a clear effect of the bar structure on the radial profiles of the dust-heating fraction by the young stars, and the dust temperature. We find that the young stars are the main contributors to the dust heating, donating, on average ~59% of their luminosity to this purpose throughout the galaxy. This dust-heating fraction drops to ~53% in the bar region and ~38% in the bulge region where the old stars are the dominant contributors to the dust heating. We also find a strong link between the heating fraction by the young stars and the sSFR.


title: Strongly coupled quantum phonon fluid in a solvable model

abstract: We study a model of a large number of strongly coupled phonons that can be viewed as a bosonic variant of the Sachdev-Ye-Kitaev model. We determine the phase diagram of the model which consists of a glass phase and a disordered phase, with a first-order phase transition separating them. We compute the specific heat of the disordered phase, with which we diagnose the high-temperature crossover to the classical limit. We further study the real-time dynamics of the disordered phase, where we identify three dynamical regimes as a function of temperature. Low temperatures are associated with a semiclassical regime, where the phonons can be described as long-lived normal modes. High temperatures are associated with the classical limit of the model. For a large region in parameter space, we identify an intermediate-temperatures regime, where the phonon lifetime is of the order of the Planckian time scale $\hbar/k_B T$.


title: Detection of squeezed phonons in pump-probe spectroscopy

abstract: Robust engineering of phonon squeezed states in optically excited solids has emerged as a promising tool to control and manipulate their properties. However, in contrast to quantum optical systems, detection of phonon squeezing is subtle and elusive, and an important question is what constitutes an unambiguous signature of it. The state of the art involves observing oscillations at twice the phonon frequency in time resolved measurements of the out of equilibrium phonon fluctuation. Using Keldysh formalism we show that such a signal is a necessary but not a sufficient signature of a squeezed phonon, since we identify several mechanisms that do not involve squeezing and yet which produce similar oscillations. We show that a reliable detection requires a time and frequency resolved measurement of the phonon spectral function.


title: Complexity measures from geometric actions on Virasoro and Kac-Moody orbits

abstract: We further advance the study of the notion of computational complexity for 2d CFTs based on a gate set built out of conformal symmetry transformations. Previously, it was shown that by choosing a suitable cost function, the resulting complexity functional is equivalent to geometric (group) actions on coadjoint orbits of the Virasoro group, up to a term that originates from the central extension. We show that this term can be recovered by modifying the cost function, making the equivalence exact. Moreover, we generalize our approach to Kac-Moody symmetry groups, finding again an exact equivalence between complexity functionals and geometric actions. We then determine the optimal circuits for these complexity measures and calculate the corresponding costs for several examples of optimal transformations. In the Virasoro case, we find that for all choices of reference state except for the vacuum state, the complexity only measures the cost associated to phase changes, while assigning zero cost to the non-phase changing part of the transformation. For Kac-Moody groups in contrast, there do exist non-trivial optimal transformations beyond phase changes that contribute to the complexity, yielding a finite gauge invariant result. Furthermore, we also show that the alternative complexity proposal of path integral optimization is equivalent to the Virasoro proposal studied here. Finally, we sketch a new proposal for a complexity definition for the Virasoro group that measures the cost associated to non-trivial transformations beyond phase changes. This proposal is based on a cost function given by a metric on the Lie group of conformal transformations. The minimization of the corresponding complexity functional is achieved using the Euler-Arnold method yielding the Korteweg-de Vries equation as equation of motion.


title: Very large thermal rectification in ferromagnetic insulator-based superconducting tunnel junctions

abstract: We investigate electronic thermal rectification in ferromagnetic insulator-based superconducting tunnel junctions. Ferromagnetic insulators coupled to superconductors are known to induce sizable spin splitting in the superconducting density of states, and also lead to efficient spin filtering if operated as tunnel barriers. The combination of spin splitting and spin filtering is shown to yield a substantial self-amplification of the electronic heat diode effect due to breaking of the electron-hole symmetry in the system which is added to the thermal asymmetry of the junction. Large spin splitting and large spin polarization can potentially lead to thermal rectification efficiency exceeding 5 .10^4 for realistic parameters in a suitable temperature range, thereby outperforming up to a factor of 250 the heat diode effect achievable with conventional superconducting tunnel junctions. These results could be relevant for improved mastering of the heat currents in innovative phase-coherent caloritronic nanodevices, and for enhanced thermal management of quantum circuits at the nanoscale.


title: New Datasets and a Benchmark of Document Network Embedding Methods for Scientific Expert Finding

abstract: The scientific literature is growing faster than ever. Finding an expert in a particular scientific domain has never been as hard as today because of the increasing amount of publications and because of the ever growing diversity of expertise fields. To tackle this challenge, automatic expert finding algorithms rely on the vast scientific heterogeneous network to match textual queries with potential expert candidates. In this direction, document network embedding methods seem to be an ideal choice for building representations of the scientific literature. Citation and authorship links contain major complementary information to the textual content of the publications. In this paper, we propose a benchmark for expert finding in document networks by leveraging data extracted from a scientific citation network and three scientific question & answer websites. We compare the performances of several algorithms on these different sources of data and further study the applicability of embedding methods on an expert finding task.


title: Spectra and Decay Constants of $B_c$-like and $B^*_0$ Mesons in QCD

abstract: Using the existing state of art of the QCD expressions of the two-point correlators into the Inverse Laplace sum rules (LSR) within stability criteria, we present a first analysis of the spectra and decay constants of B_c-like scalar (0^{++}) and axial-vector (1^{++}) mesons and revisit the ones of the B^*_c(1^{--}) vector meson. Improved predictions are obtained by combining these LSR results with the some mass-splittings from Heavy Quark Symmetry (HQS). We complete the analysis by revisiting the B^*_{0}(0^{++}) mass which might be likely identified with the B^*_J(5732) experimental candidate. The results for the spectra collected in Table 2 are compared with some recent lattice and potential models ones. New estimates of the decay constants are given in Table 3.


title: PatchVAE: Learning Local Latent Codes for Recognition

abstract: Unsupervised representation learning holds the promise of exploiting large amounts of unlabeled data to learn general representations. A promising technique for unsupervised learning is the framework of Variational Auto-encoders (VAEs). However, unsupervised representations learned by VAEs are significantly outperformed by those learned by supervised learning for recognition. Our hypothesis is that to learn useful representations for recognition the model needs to be encouraged to learn about repeating and consistent patterns in data. Drawing inspiration from the mid-level representation discovery work, we propose PatchVAE, that reasons about images at patch level. Our key contribution is a bottleneck formulation that encourages mid-level style representations in the VAE framework. Our experiments demonstrate that representations learned by our method perform much better on the recognition tasks compared to those learned by vanilla VAEs.


title: The relationship between Fully Connected Layers and number of classes for the analysis of retinal images

abstract: This paper experiments with the number of fully-connected layers in a deep convolutional neural network as applied to the classification of fundus retinal images. The images analysed corresponded to the ODIR 2019 (Peking University International Competition on Ocular Disease Intelligent Recognition) [9], which included images of various eye diseases (cataract, glaucoma, myopia, diabetic retinopathy, age-related macular degeneration (AMD), hypertension) as well as normal cases. This work focused on the classification of Normal, Cataract, AMD and Myopia. The feature extraction (convolutional) part of the neural network is kept the same while the feature mapping (linear) part of the network is changed. Different data sets are also explored on these neural nets. Each data set differs from another by the number of classes it has. This paper hence aims to find the relationship between number of classes and number of fully-connected layers. It was found out that the effect of increasing the number of fully-connected layers of a neural networks depends on the type of data set being used. For simple, linearly separable data sets, addition of fully-connected layer is something that should be explored and that could result in better training accuracy, but a direct correlation was not found. However as complexity of the data set goes up(more overlapping classes), increasing the number of fully-connected layers causes the neural network to stop learning. This phenomenon happens quicker the more complex the data set is.


title: Robustness of superconducting properties to transition metal substitution and impurity phases in Fe1-xVxSe

abstract: We have performed transverse- and zero-field muon spin rotation/relaxation experiments, as well as magnetometry measurements, on samples of Fe1-xVxSe and their Li+NH3 intercalates Li0.6(NH2)0.2(NH3)0.8 Fe1-x Vx Se. We examine the low vanadium substitution regime: x = 0.005, 0.01, and 0.02. The intercalation reaction significantly increases the critical temperature (Tc) and the superfluid stiffness for all x. The nonintercalated samples all exhibit Tc = 8.5 K while the intercalated samples all show an enhanced Tc > 40 K. Vanadium substitution has a negligible effect on Tc, but seems to suppress the superfluid stiffness for the nonintercalated samples and weakly enhance it for the intercalated materials. The optimal substitution level for the intercalated samples is found to be x = 0.01, with Tc = 41 K and {\lambda}_{ab}(0) = 0.18 {\mu}m. The nonintercalated samples can be modeled with either a single d-wave superconducting gap or with an anisotropic gap function based on recent quasiparticle imaging experiments, whereas the intercalates display multigap nodal behavior which can be fitted using s + d- or d + d-wave models. Magnetism, likely from iron impurities, appears after the intercalation reaction and coexists and competes with the superconductivity. However, it appears that the superconductivity is remarkably robust to the impurity phase, providing an avenue to stably improve the superconducting properties of transition metal substituted FeSe.


title: Tests of general relativity with stellar-mass black hole binaries observed by LISA

abstract: We consider the observation of stellar-mass black holes binaries with the Laser Interferometer Space Antenna (LISA). Preliminary results based on Fisher information matrix analyses have suggested that gravitational waves from those sources could be very sensitive to possible deviations from the theory of general relativity and from the strong equivalence principle during the low-frequency binary inspiral. We perform a full Markov Chain Monte Carlo Bayesian analysis to quantify the sensitivity of these signals to two phenomenological modifications of general relativity, namely a putative gravitational dipole emission and a non-zero mass for the graviton, properly accounting for the detector's response. Moreover, we consider a scenario where those sources could be observed also with Earth-based detectors, which should measure the coalescence time with precision better than $1 \ {\rm ms}$. This constraint on the coalescence time further improves the bounds that we can set on those phenomenological deviations from general relativity. We show that tests of dipole radiation and the graviton's mass should improve respectively by seven and half an order(s) of magnitude over current bounds. Finally, we discuss under which conditions one may claim the detection of a modification to general relativity.


title: TypeNet: Scaling up Keystroke Biometrics

abstract: We study the suitability of keystroke dynamics to authenticate 100K users typing free-text. For this, we first analyze to what extent our method based on a Siamese Recurrent Neural Network (RNN) is able to authenticate users when the amount of data per user is scarce, a common scenario in free-text keystroke authentication. With 1K users for testing the network, a population size comparable to previous works, TypeNet obtains an equal error rate of 4.8% using only 5 enrollment sequences and 1 test sequence per user with 50 keystrokes per sequence. Using the same amount of data per user, as the number of test users is scaled up to 100K, the performance in comparison to 1K decays relatively by less than 5%, demonstrating the potential of TypeNet to scale well at large scale number of users. Our experiments are conducted with the Aalto University keystroke database. To the best of our knowledge, this is the largest free-text keystroke database captured with more than 136M keystrokes from 168K users.


title: Minimality of polytopes in a nonlocal anisotropic isoperimetric problem

abstract: We consider the minimization of an energy functional given by the sum of a crystalline perimeter and a nonlocal interaction of Riesz type, under volume constraint. We show that, in the small mass regime, if the Wulff shape of the anisotropic perimeter has certain symmetry properties, then it is the unique global minimizer of the total energy. In dimension two this applies to convex polygons which are reflection symmetric with respect to the bisectors of the angles. We further prove a rigidity result for the structure of (local) minimizers in two dimensions.


title: Fast Calculation of Nonlinear Redshift-space Galaxy Power Spectrum Including Selection Bias

abstract: We present a fast implementation of the next-to-leading order (1-loop) redshift-space galaxy power spectrum by using FFTlog-based methods. [V. Desjacques, D. Jeong, and F. Schmidt, JCAP 1812 (12), 035] have shown that the 1-loop galaxy power spectrum in redshift space can be computed with 28 independent loop integrals with 22 bias parameters. Analytical calculation of the angular part of the loop integrals leaves the radial part in the form of a spherical Bessel transformation that is ready to be integrated numerically by using the FFTLog transformation. We find that the original 28 loop integrals can be solved with a total of 85 unique FFTLog transformations, yet leading to a few orders of magnitude speed up over traditional multi-dimensional integration. The code used in this work is publicly available at https://github.com/JosephTomlinson/GeneralBiasPk


title: A GPU-friendly Geometric Data Model and Algebra for Spatial Queries: Extended Version

abstract: The availability of low cost sensors has led to an unprecedented growth in the volume of spatial data. However, the time required to evaluate even simple spatial queries over large data sets greatly hampers our ability to interactively explore these data sets and extract actionable insights. Graphics Processing Units~(GPUs) are increasingly being used to speedup spatial queries. However, existing GPU-based solutions have two important drawbacks: they are often tightly coupled to the specific query types they target, making it hard to adapt them for other queries; and since their design is based on CPU-based approaches, it can be difficult to effectively utilize all the benefits provided by the GPU. As a first step towards making GPU spatial query processing mainstream, we propose a new model that represents spatial data as geometric objects and define an algebra consisting of GPU-friendly composable operators that operate over these objects. We demonstrate the expressiveness of the proposed algebra by formulating standard spatial queries as algebraic expressions. We also present a proof-of-concept prototype that supports a subset of the operators and show that it is at least two orders of magnitude faster than a CPU-based implementation. This performance gain is obtained both using a discrete Nvidia mobile GPU and the less powerful integrated GPUs common in commodity laptops.


title: Detectability of Life Using Oxygen on Pelagic Planets and Water Worlds

abstract: The search for life on exoplanets is one of the grand scientific challenges of our time. The strategy to date has been to find (e.g., through transit surveys like Kepler) Earth-like exoplanets in their stars habitable zone, then use transmission spectroscopy to measure biosignature gases, especially oxygen, in the planets atmospheres (e.g., using JWST, the James Webb Space Telescope). Already there are more such planets than can be observed by JWST, and missions like the Transiting Exoplanet Survey Satellite and others will find more. A better understanding of the geochemical cycles relevant to biosignature gases is needed, to prioritize targets for costly follow-up observations and to help design future missions. We define a Detectability Index to quantify the likelihood that a biosignature gas could be assigned a biological vs. non-biological origin. We apply this index to the case of oxygen gas, O2, on Earth-like planets with varying water contents. We demonstrate that on Earth-like exoplanets with 0.2 weight percent (wt%) water (i.e., no exposed continents) a reduced flux of bioessential phosphorus limits the export of photosynthetically produced atmospheric O2 to levels indistinguishable from geophysical production by photolysis of water plus hydrogen escape. Higher water contents >1wt% that lead to high-pressure ice mantles further slow phosphorus cycling. Paradoxically, the maximum water content allowing use of O2 as a biosignature, 0.2wt%, is consistent with no water based on mass and radius. Thus, the utility of an O2 biosignature likely requires the direct detection of both water and land on a planet.


title: On a probabilistic derivation of the basic particle statistics (Bose-Einstein, Fermi-Dirac, canonical, grand-canonical, intermediate) and related distributions

abstract: Combining intuitive probabilistic assumptions with the basic laws of classical thermodynamics, using the latter to express probabilistic parameters in terms of the thermodynamic quantities, we get a simple unified derivation of the fundamental ensembles of statistical physics avoiding any limiting procedures, quantum hypothesis and even statistical entropy maximization. This point of view leads also to some related classes of correlated particle statistics.


title: Microscale crystalline rare-earth doped resonators for strain-coupled optomechanics

abstract: Rare-earth ion doped crystals for hybrid quantum technologies is an area of growing interest in the solid-state physics community. We have earlier theoretically proposed a hybrid scheme of a mechanical resonator which is fabricated out of a rare-earth doped mono-crystalline structure. The rare-earth ion dopants have absorption energies which are sensitive to crystal strain, and it is thus possible to couple the ions to the bending motion of the crystal cantilever. Here, we present the design and fabrication method based on focused-ion-beam etching techniques which we have successfully employed in order to create such microscale resonators, as well as the design of the environment which will allow to study the quantum behavior of the resonators.


title: Recovery of the time-dependent source term in the stochastic fractional diffusion equation with heterogeneous medium

abstract: In this work, an inverse problem in the fractional diffusion equation with random source is considered. The measurements used are the statistical moments of the realizations of single point data $u(x_0,t,\omega).$ We build the representation of the solution $u$ in integral sense, then prove that the unknowns can be bounded by the moments theoretically. For the numerical reconstruction, we establish an iterative algorithm with regularized Levenberg-Marquardt type and some numerical results generated from this algorithm are displayed. For the case of highly heterogeneous media, the Generalized Multiscale finite element method (GMsFEM) will be employed.


title: Constructing Clock-Transition-Based Two-Qubit Gates from Dimers of Molecular Nanomagnets

abstract: A good qubit must have a coherence time long enough for gate operations to be performed. Avoided level crossings allow for clock transitions in which coherence is enhanced by the insensitivity of the transition to fluctuations in external fields. Because of this insensitivity, it is not obvious how to effectively couple qubits together while retaining clock-transition behavior. Here we present a scheme for using a heterodimer of two coupled molecular nanomagnets, each with a clock transition at zero magnetic field, in which all of the gate operations needed to implement one- and two-qubit gates can be implemented with pulsed radio-frequency radiation. We show that given realistic coupling strengths between the nanomagnets in the dimer, good gate fidelities ($\sim$99.4\%) can be achieved. We identify the primary sources of error in implementing gates and discuss how these may be mitigated, and investigate the range of coherence times necessary for such a system to be a viable platform for implementing quantum computing protocols.


title: Efficient long-distance relation extraction with DG-SpanBERT

abstract: In natural language processing, relation extraction seeks to rationally understand unstructured text. Here, we propose a novel SpanBERT-based graph convolutional network (DG-SpanBERT) that extracts semantic features from a raw sentence using the pre-trained language model SpanBERT and a graph convolutional network to pool latent features. Our DG-SpanBERT model inherits the advantage of SpanBERT on learning rich lexical features from large-scale corpus. It also has the ability to capture long-range relations between entities due to the usage of GCN on dependency tree. The experimental results show that our model outperforms other existing dependency-based and sequence-based models and achieves a state-of-the-art performance on the TACRED dataset.


title: Probabilistic Spatial Transformer Networks

abstract: Spatial Transformer Networks (STNs) estimate image transformations that can improve downstream tasks by `zooming in' on relevant regions in an image. However, STNs are hard to train and sensitive to mis-predictions of transformations. To circumvent these limitations, we propose a probabilistic extension that estimates a stochastic transformation rather than a deterministic one. Marginalizing transformations allows us to consider each image at multiple poses, which makes the localization task easier and the training more robust. As an additional benefit, the stochastic transformations act as a localized, learned data augmentation that improves the downstream tasks. We show across standard imaging benchmarks and on a challenging real-world dataset that these two properties lead to improved classification performance, robustness and model calibration. We further demonstrate that the approach generalizes to non-visual domains by improving model performance on time-series data.


title: Duality and $H_{\infty}$-Optimal Control Of Coupled ODE-PDE Systems

abstract: In this paper, we present a convex formulation of $H_{\infty}$-optimal control problem for coupled linear ODE-PDE systems with one spatial dimension. First, we reformulate the coupled ODE-PDE system as a Partial Integral Equation (PIE) system and show that stability and $H_{\infty}$ performance of the PIE system implies that of the ODE-PDE system. We then construct a dual PIE system and show that asymptotic stability and $H_{\infty}$ performance of the dual system is equivalent to that of the primal PIE system. Next, we pose a convex dual formulation of the stability and $H_{\infty}$-performance problems using the Linear PI Inequality (LPI) framework. LPIs are a generalization of LMIs to Partial Integral (PI) operators and can be solved using PIETOOLS, a MATLAB toolbox. Next, we use our duality results to formulate the stabilization and $H_{\infty}$-optimal state-feedback control problems as LPIs. Finally, we illustrate the accuracy and scalability of the algorithms by constructing controllers for several numerical examples.


title: Orthant Based Proximal Stochastic Gradient Method for $\ell_1$-Regularized Optimization

abstract: Sparsity-inducing regularization problems are ubiquitous in machine learning applications, ranging from feature selection to model compression. In this paper, we present a novel stochastic method -- Orthant Based Proximal Stochastic Gradient Method (OBProx-SG) -- to solve perhaps the most popular instance, i.e., the l1-regularized problem. The OBProx-SG method contains two steps: (i) a proximal stochastic gradient step to predict a support cover of the solution; and (ii) an orthant step to aggressively enhance the sparsity level via orthant face projection. Compared to the state-of-the-art methods, e.g., Prox-SG, RDA and Prox-SVRG, the OBProx-SG not only converges to the global optimal solutions (in convex scenario) or the stationary points (in non-convex scenario), but also promotes the sparsity of the solutions substantially. Particularly, on a large number of convex problems, OBProx-SG outperforms the existing methods comprehensively in the aspect of sparsity exploration and objective values. Moreover, the experiments on non-convex deep neural networks, e.g., MobileNetV1 and ResNet18, further demonstrate its superiority by achieving the solutions of much higher sparsity without sacrificing generalization accuracy.


title: ESP4ML: Platform-Based Design of Systems-on-Chip for Embedded Machine Learning

abstract: We present ESP4ML, an open-source system-level design flow to build and program SoC architectures for embedded applications that require the hardware acceleration of machine learning and signal processing algorithms. We realized ESP4ML by combining two established open-source projects (ESP and HLS4ML) into a new, fully-automated design flow. For the SoC integration of accelerators generated by HLS4ML, we designed a set of new parameterized interface circuits synthesizable with high-level synthesis. For accelerator configuration and management, we developed an embedded software runtime system on top of Linux. With this HW/SW layer, we addressed the challenge of dynamically shaping the data traffic on a network-on-chip to activate and support the reconfigurable pipelines of accelerators that are needed by the application workloads currently running on the SoC. We demonstrate our vertically-integrated contributions with the FPGA-based implementations of complete SoC instances booting Linux and executing computer-vision applications that process images taken from the Google Street View database.


title: Elasticity Theory in General Relativity

abstract: The general relativistic theory of elasticity is reviewed from a Lagrangian, as opposed to Eulerian, perspective. The equations of motion and stress-energy-momentum tensor for a hyperelastic body are derived from the gauge-invariant action principle first considered by DeWitt. This action is a natural extension of the action for a single relativistic particle. The central object in the Lagrangian treatment is the Landau-Lifshitz radar metric, which is the relativistic version of the right Cauchy-Green deformation tensor. We also introduce relativistic definitions of the deformation gradient, Green strain, and first and second Piola-Kirchhoff stress tensors. A gauge-fixed description of relativistic hyperelasticity is also presented, and the nonrelativistic theory is derived in the limit as the speed of light becomes infinite.


title: Effective self-similar expansion of a Bose-Einstein condensate: Free space vs confined geometries

abstract: We compare the exact evolution of an expanding three-dimensional Bose-Einstein condensate with that obtained from the effective scaling approach introduced in D. Gu\'ery-Odelin [Phys. Rev. A 66, 033613 (2002)]. This approach, which consists in looking for self-similar solutions to be satisfied on average, is tested here in different geometries and configurations. We find that, in case of almost isotropic traps, the effective scaling reproduces with high accuracy the exact evolution dictated by the Gross-Pitaevskii equation for arbitrary values of the interactions, in agreement with the proof-of-concept of M. Modugno, G. Pagnini, and M. A. Valle-Basagoiti [Phys. Rev. A 97, 043604 (2018)]. Conversely, it is shown that the hypothesis of universal self-similarity breaks down in case of strong anisotropies and trapped geometries.


title: Re-translation versus Streaming for Simultaneous Translation

abstract: There has been great progress in improving streaming machine translation, a simultaneous paradigm where the system appends to a growing hypothesis as more source content becomes available. We study a related problem in which revisions to the hypothesis beyond strictly appending words are permitted. This is suitable for applications such as live captioning an audio feed. In this setting, we compare custom streaming approaches to re-translation, a straightforward strategy where each new source token triggers a distinct translation from scratch. We find re-translation to be as good or better than state-of-the-art streaming systems, even when operating under constraints that allow very few revisions. We attribute much of this success to a previously proposed data-augmentation technique that adds prefix-pairs to the training data, which alongside wait-k inference forms a strong baseline for streaming translation. We also highlight re-translation's ability to wrap arbitrarily powerful MT systems with an experiment showing large improvements from an upgrade to its base model.


title: Causal Relational Learning

abstract: Causal inference is at the heart of empirical research in natural and social sciences and is critical for scientific discovery and informed decision making. The gold standard in causal inference is performing randomized controlled trials; unfortunately these are not always feasible due to ethical, legal, or cost constraints. As an alternative, methodologies for causal inference from observational data have been developed in statistical studies and social sciences. However, existing methods critically rely on restrictive assumptions such as the study population consisting of homogeneous elements that can be represented in a single flat table, where each row is referred to as a unit. In contrast, in many real-world settings, the study domain naturally consists of heterogeneous elements with complex relational structure, where the data is naturally represented in multiple related tables. In this paper, we present a formal framework for causal inference from such relational data. We propose a declarative language called CaRL for capturing causal background knowledge and assumptions and specifying causal queries using simple Datalog-like rules.CaRL provides a foundation for inferring causality and reasoning about the effect of complex interventions in relational domains. We present an extensive experimental evaluation on real relational data to illustrate the applicability of CaRL in social sciences and healthcare.


title: Interaction of ultraintense radially-polarized laser pulses with plasma mirrors

abstract: We present experimental results of vacuum laser acceleration (VLA) of electrons using radially polarized laser pulses interacting with a plasma mirror. Tightly focused radially polarized laser pulses have been proposed for electron acceleration because of their strong longitudinal electric field, making them ideal for VLA. However, experimental results have been limited until now because injecting electrons into the laser field has remained a considerable challenge. Here, we demonstrate experimentally that using a plasma mirror as an injector solves this problem and permits to inject electrons at the ideal phase of the laser, resulting in the acceleration of electrons along the laser propagation direction while reducing the electron beam divergence compared to the linear polarization case. We obtain electron bunches with few-MeV energies and a 200 pC charge, thus demonstrating for the first time electron acceleration to relativistic energies using a radially polarized laser. High-harmonic generation from the plasma surface is also measured and provides additional insight into the injection of electrons into the laser field upon its reflection on the plasma mirror. Detailed comparisons between experimental results and full 3D simulations unravel the complex physics of electron injection and acceleration in this new regime: we find that electrons are injected into the radially polarized pulse in the form of two spatially-separated bunches emitted from the p-polarized regions of the focus. Finally, we leverage on the insight brought by this study to propose and validate a more optimal experimental configuration that can lead to extremely peaked electron angular distributions and higher energy beams.


title: The Franzese-Stanley Coarse Grained Model for Hydration Water

abstract: Water modeling is a challenging problem. Its anomalies are difficult to reproduce, promoting the proliferation of a large number of computational models, among which researchers select the most appropriate for the property they study. In this chapter, we introduce a coarse-grained model introduced by Franzese and Stanley (FS) that accounts for the many-body interactions of water. We review mean-field calculations and Monte Carlo simulations on water monolayers for a wide range of pressures and temperatures, including extreme conditions. The results show the presence of two dynamic crossovers and explain the origin of diffusion anomalies. Moreover, the model shows that all the different scenarios, proposed in the last decades as alternative explanations of the experimental anomalies of water, can be related by the fine-tuning of the many-body (cooperative) interaction. Once this parameter is set from the experiments, the FS model predicts a phase transition between two liquids with different densities and energies in the supercooled water region, ending in a liquid-liquid critical point. From this critical point stems a liquid-liquid Widom line, i.e., the locus of maxima of the water correlation length, that in the FS model can be directly calculated. The results are consistent with the extrapolations from experiments. Furthermore, they agree with those from atomistic models but make predictions over a much wider thermodynamic region, allowing for a better interpretation of the available experimental data. All these findings provide a coherent picture of the properties of water and confirm the validity of the FS model that has proved to be useful for large-scale simulations of biological systems.


title: Global phase-amplitude description of oscillatory dynamics via the parameterization method

abstract: In this paper we use the parameterization method to provide a complete description of the dynamics of an $n$-dimensional oscillator beyond the classical phase reduction. The parameterization method allows, via efficient algorithms, to obtain a parameterization of the attracting invariant manifold of the limit cycle in terms of the phase-amplitude variables. The method has several advantages. It provides analytically a Fourier-Taylor expansion of the parameterization up to any order, as well as a simplification of the dynamics that allows for a numerical globalization of the manifolds. Thus, one can obtain the local and global isochrons and isostables, including the slow attracting manifold, up to high accuracy, which offer a geometrical portrait of the oscillatory dynamics. Furthermore, it provides straightforwardly the infinitesimal Phase and Amplitude Response Functions, that is, the extended infinitesimal Phase and Amplitude Response Curves, which monitor the phase and amplitude shifts beyond the asymptotic state. Thus, the methodology presented yields an accurate description of the phase dynamics for perturbations not restricted to the limit cycle but to its attracting invariant manifold. Finally, we explore some strategies to reduce the dimension of the dynamics, including the reduction of the dynamics to the slow stable submanifold. We illustrate our methods by applying them to different three dimensional single neuron and neural population models in neuroscience.


title: LQG Control Performance with Low Bitrate Periodic Coding

abstract: Specific low-bitrate coding strategies are examined through their effect on LQ control performance. By limiting the subject to these methods, we are able to identify principles underlying coding for control; a subject of significant recent interest but few tangible results. In particular, we consider coding the quantized output signal deploying period-two codes of differing delay-versus-accuracy tradeoff. The quantification of coding performance is via the LQ control cost. The feedback control system comprises the coder-decoder in the path between the output and the state estimator, which is followed by linear state-variable feedback, as is optimal in the memoryless case. The quantizer is treated as the functional composition of an infinitely-long linear staircase function and a saturation. This permits the analysis to subdivide into estimator computations, seemingly independent of the control performance criterion, and an escape time evaluation, which ties the control back into the choice of quantizer saturation bound. An example is studied which illustrates the role of the control objective in determining the efficacy of coding using these schemes. The results mesh well with those observed in signal coding. However, the introduction of a realization-based escape time is a novelty departing significantly from mean square computations.


title: Characterization and Mitigation of Sinusoidal Carrier Modulation Signals by Short-Term Sinusoidal Analysis

abstract: Most radio signals can be described as a form of sinusoidal carrier modulation. These signals have the property that when observed over a sufficiently short period of time, the waveform is approximately sinusoidal, exhibiting constant magnitude, frequency, and phase. When coherently digitized with sufficiently high sample rate, it is possible to discern this sinusoid. The associated signal can be represented as a sinusoid with time-varying frequency, magnitude, and phase. These parameters can subsequently be used for detection and characterization, including identification. The parameters can also be used to synthesize a noise-free estimate of the signal. The synthesized signal can be coherently subtracted from the original data in order to cancel the signal, nominally without distortion of the associated noise or nearby signals. In this report, the conditions required for the short-time sinusoidal approximation are described. Performance of the canceling technique is examined in the case of a VHF-band narrowband FM-modulated signal.


title: High density of states in the pseudogap phase of the cuprate superconductor HgBa$_2$CuO$_{4 + \delta}$

abstract: The specific heat $C$ of the single-layer cuprate superconductor HgBa$_2$CuO$_{4 + \delta}$ was measured in an underdoped crystal with $T_{\rm c} = 72$ K at temperatures down to $2$ K in magnetic fields up to $35$ T, a field large enough to suppress superconductivity at that doping ($p \simeq 0.09$). In the normal state at $H = 35$ T, a residual linear term of magnitude $\gamma = 12 \pm 2$ mJ/K$^2$mol is observed in $C/T$ as $T \to 0$, a direct measure of the electronic density of states. This high value of $\gamma$ has two major implications. First, it is significantly larger than the value measured in overdoped cuprates outside the pseudogap phase ($p >p^\star$), such as La$_{2-x}$Sr$_x$CuO$_4$ and Tl$_2$Ba$_2$CuO$_{6 + \delta}$ at $p \simeq 0.3$, where $\gamma \simeq 7$ mJ/K$^2$mol. Given that the pseudogap causes a loss of density of states, and assuming that HgBa$_2$CuO$_{4 + \delta}$ has the same $\gamma$ value as other cuprates at $p \simeq 0.3$, this implies that $\gamma$ in HgBa$_2$CuO$_{4 + \delta}$ must peak between $p \simeq 0.09$ and $p \simeq 0.3$, namely at (or near) the critical doping $p^\star$ where the pseudogap phase is expected to end ($p^\star\simeq 0.2$). Secondly, the high $\gamma$ value implies that the Fermi surface must consist of more than the single electron-like pocket detected by quantum oscillations in HgBa$_2$CuO$_{4 + \delta}$ at $p \simeq 0.09$, whose effective mass $m^\star= 2.7\times m_0$ yields only $\gamma = 4.0$ mJ/K$^2$mol. This missing mass imposes a revision of the current scenario for how pseudogap and charge order respectively transform and reconstruct the Fermi surface of cuprates.


title: Source Coding for Synthesizing Correlated Randomness

abstract: We consider a scenario wherein two parties Alice and Bob are provided $X_{1}^{n}$ and $X_{2}^{n}$ -- samples that are IID from a PMF $P_{X_1 X_2}$. Alice and Bob can communicate to Charles over (noiseless) communication links of rate $R_1$ and $R_2$ respectively. Their goal is to enable Charles generate samples $Y^{n}$ such that the triple $(X_{1}^{n},X_{2}^{n},Y^{n})$ has a PMF that is close, in total variation, to $\prod P_{X_1 X_2 Y}$. In addition, the three parties may posses pairwise shared common randomness at rates $C_1$ and $C_2$. We address the problem of characterizing the set of rate quadruples $(R_1,R_2,C_1,C_2)$ for which the above goal can be accomplished. We provide a set of sufficient conditions, i.e. an inner bound to the achievable rate region, and necessary conditions, i.e. an outer bound to the rate region for this three party setup. We provide a joint-typicality based random coding argument involving encoding and decoding operations to perform soft covering and a pertinent relaxation of the PMF requirement for the encoders.


title: Global regularity for a 1D Euler-alignment system with misalignment

abstract: We study one-dimensional Eulerian dynamics with nonlocal alignment interactions, featuring strong short-range alignment, and long-range misalignment. Compared with the well-studied Euler-alignment system, the presence of the misalignment brings different behaviors of the solutions, including the possible creation of vacuum at infinite time, which destabilizes the solutions. We show that with a strongly singular short-range alignment interaction, the solution is globally regular, despite the effect of misalignment.


title: Reserved: Dissecting Internet Traffic on Port 0

abstract: Transport protocols use port numbers to allow connection multiplexing on Internet hosts. TCP as well as UDP, the two most widely used transport protocols, have limitations on what constitutes a valid and invalid port number. One example of an invalid port number for these protocols is port 0. In this work, we present preliminary results from analyzing port 0 traffic at a large European IXP. In one week of traffic we find 74GB port 0 traffic. The vast majority of this traffic has both source and destination ports set to 0, suggesting scanning or reconnaissance as its root cause. Our analysis also shows that more than half of all port 0 traffic is targeted to just 18 ASes, whereas more than half of all traffic is originated by about 100 ASes, suggesting a more diverse set of source ASes.


title: Flux growth of Sr(n+1)Ir(n)O(3n+1) [n=1, 2, infinity] crystals

abstract: Single crystals of iridates are usually grown by a flux method well above the boiling point of the SrCl2 solvent. This leads to non-equilibrium growth conditions and dramatically shortens the lifetime of expensive Pt crucibles. Here, we report the growth of Sr2IrO4, Sr3Ir2O7 and SrIrO3 single crystals in a reproducible way by using anhydrous SrCl2 flux well below its boiling point. We show that the yield of the different phases strongly depends on the nutrient/solvent ratio for fixed soak temperature and cooling rate. Using this low-temperature growth approach generally leads to a lower temperature-independent contribution to the magnetic susceptibility than previously reported. Crystals of SrIrO3 exhibit a paramagnetic behavior that can be remarkably well fitted with a Curie-Weiss law yielding physically reasonable parameters, in contrast to previous reports. Hence, reducing the soak temperature below the solvent boiling point not only provides more stable and controllable growth conditions in contrast to previously reported growth protocols, but also extends considerably the lifetime of expensive platinum crucibles and reduces the corrosion of heating and thermoelements of standard furnaces, thereby reducing growth costs.


title: Extrapolation: Stories and Problems

abstract: We discuss some aspects of Extrapolation theory. The presentation includes many examples and open problems.


title: Gauge-invariance in cellular automata

abstract: Gauge-invariance is a fundamental concept in Physics -- known to provide mathematical justification for the fundamental forces. In this paper, we provide discrete counterparts to the main gauge theoretical concepts directly in terms of Cellular Automata. More precisely, the notions of gauge-invariance and gauge-equivalence in Cellular Automata are formalized. A step-by-step gauging procedure to enforce this symmetry upon a given Cellular Automaton is developed, and three examples of gauge-invariant Cellular Automata are examined.


title: FedMAX: Mitigating Activation Divergence for Accurate and Communication-Efficient Federated Learning

abstract: In this paper, we identify a new phenomenon called activation-divergence which occurs in Federated Learning (FL) due to data heterogeneity (i.e., data being non-IID) across multiple users. Specifically, we argue that the activation vectors in FL can diverge, even if subsets of users share a few common classes with data residing on different devices. To address the activation-divergence issue, we introduce a prior based on the principle of maximum entropy; this prior assumes minimal information about the per-device activation vectors and aims at making the activation vectors of same classes as similar as possible across multiple devices. Our results show that, for both IID and non-IID settings, our proposed approach results in better accuracy (due to the significantly more similar activation vectors across multiple devices), and is more communication-efficient than state-of-the-art approaches in FL. Finally, we illustrate the effectiveness of our approach on a few common benchmarks and two large medical datasets.


title: Faithful Embeddings for Knowledge Base Queries

abstract: The deductive closure of an ideal knowledge base (KB) contains exactly the logical queries that the KB can answer. However, in practice KBs are both incomplete and over-specified, failing to answer some queries that have real-world answers. \emph{Query embedding} (QE) techniques have been recently proposed where KB entities and KB queries are represented jointly in an embedding space, supporting relaxation and generalization in KB inference. However, experiments in this paper show that QE systems may disagree with deductive reasoning on answers that do not require generalization or relaxation. We address this problem with a novel QE method that is more faithful to deductive reasoning, and show that this leads to better performance on complex queries to incomplete KBs. Finally we show that inserting this new QE module into a neural question-answering system leads to substantial improvements over the state-of-the-art.


title: The Russian Drug Reaction Corpus and Neural Models for Drug Reactions and Effectiveness Detection in User Reviews

abstract: The Russian Drug Reaction Corpus (RuDReC) is a new partially annotated corpus of consumer reviews in Russian about pharmaceutical products for the detection of health-related named entities and the effectiveness of pharmaceutical products. The corpus itself consists of two parts, the raw one and the labelled one. The raw part includes 1.4 million health-related user-generated texts collected from various Internet sources, including social media. The labelled part contains 500 consumer reviews about drug therapy with drug- and disease-related information. Labels for sentences include health-related issues or their absence. The sentences with one are additionally labelled at the expression level for identification of fine-grained subtypes such as drug classes and drug forms, drug indications, and drug reactions. Further, we present a baseline model for named entity recognition (NER) and multi-label sentence classification tasks on this corpus. The macro F1 score of 74.85% in the NER task was achieved by our RuDR-BERT model. For the sentence classification task, our model achieves the macro F1 score of 68.82% gaining 7.47% over the score of BERT model trained on Russian data. We make the RuDReC corpus and pretrained weights of domain-specific BERT models freely available at https://github.com/cimm-kzn/RuDReC