title: Constraining Screened Modified Gravity by Space-borne Gravitational-wave Detectors

abstract: The screened modified gravity (SMG) is a unified theoretical framework, which describes the scalar-tensor gravity with screening mechanism. Based on the gravitational-wave (GW) waveform derived in our previous work \citep{liu2018waveforms}, in this article we investigate the potential constraints on SMG theory through the GW observation of the future space-borne GW detectors, including LISA, TianQin and Taiji. We find that, for the EMRIs consisting of a massive black hole and a neutron star, if the EMRIs are at Virgo cluster, the GW signals can be detected by the detectors at quite high significant level, and the screened parameter $\epsilon_{\rm NS}$ can be constrained at about $\mathcal{O}(10^{-5})$, which is more than one order of magnitude tighter than the potential constraint given by ground-based Einstein telescope. However, for the EMRIs consisting of a massive black hole and a white dwarf, it is more difficult to be detected than the previous case. For the specific SMG models, including chameleon, symmetron and dilaton, we find these constraints are complementary with that from Cassini experiment, but weaker than those from lunar laser ranging observations and binary pulsars, due to the strong gravitational potentials on the surface of neutron stars. By analyzing the deviation of GW waveform in SMG from that in general relativity, as anticipated, we find the dominant contribution of the SMG constraining comes from the correction terms in the GW phases, rather than the extra polarization modes or the correction terms in the GW amplitudes.


title: Neural Execution of Graph Algorithms

abstract: Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs. In almost all cases so far, however, they have been applied to directly recovering a final solution from raw inputs, without explicit guidance on how to structure their problem-solving. Here, instead, we focus on learning in the space of algorithms: we train several state-of-the-art GNN architectures to imitate individual steps of classical graph algorithms, parallel (breadth-first search, Bellman-Ford) as well as sequential (Prim's algorithm). As graph algorithms usually rely on making discrete decisions within neighbourhoods, we hypothesise that maximisation-based message passing neural networks are best-suited for such objectives, and validate this claim empirically. We also demonstrate how learning in the space of algorithms can yield new opportunities for positive transfer between tasks---showing how learning a shortest-path algorithm can be substantially improved when simultaneously learning a reachability algorithm.


title: A self-assembled two-dimensional thermo-functional material for radiative cooling

abstract: The regulation of temperature at the macro and microscale is a major energy-consuming process of humankind. Modern cooling systems account for 15% of the global energy consumption and are responsible for 10% of greenhouse gas emissions. Due to global warming, a ten-fold growth in the demand of cooling technologies is expected in the next 30 years, thus linking global warming and cooling needs through a worrying negative feedback loop. Here, we propose an inexpensive solution to this global challenge based on a single-layer of silica microspheres self-assembled on a soda-lime glass substrate. This two-dimensional (2D) crystal acts as a visibly translucent thermal blackbody for above-ambient daytime radiative cooling and can be used to passively improve the thermal performance of devices that undergo critical heating during operation. The temperature of a crystalline silicon wafer was found to be 14K lower during daytime when covered with our thermal emitter, reaching an average temperature difference of 19K when the structure was backed with a silver layer. In comparison, the soda-lime glass used as a reference in our measurements lowered the temperature of the silicon wafer by just 5 K. The cooling power density of this rather simple radiative cooler under direct sunlight was found to be up to 350 W/m2 when applied to hot surfaces with relative temperatures of 50 K above the ambient. This is crucial to radiatively cool down electronic devices, such as solar cells, where an increase in temperature has drastic effects on performance. Our 2D thermo-functional material includes a single layer of spheres emitting long-wave radiation through the infrared atmospheric window and over a broad wavelength ange, thus providing effective radiative cooling using the outer space as a heat sink at 3 K.


title: The effect of turbulence on drifting snow sublimation

abstract: Sublimation of drifting snow, which is significant for the balances of mass and energy of the polar ice sheet, is a complex physical process with intercoupling between ice crystals, wind field, temperature, and moisture. Here a three-dimensional drifting snow sublimation model in a turbulent boundary layer is proposed. In contrast to most previous models, it takes into account turbulent diffusion of moisture from lower to higher elevations, allowing the air humidity near the surface to be undersaturated and thus sublimation to occur. From simulations with this model, we find that snow sublimation in the saltation layer near the surface dominates overall snow sublimation, despite an only marginal departure from humidity saturation ($<1\%$), because of a large particle concentration.


title: Sparse Orthogonal Variational Inference for Gaussian Processes

abstract: We introduce a new interpretation of sparse variational approximations for Gaussian processes using inducing points, which can lead to more scalable algorithms than previous methods. It is based on decomposing a Gaussian process as a sum of two independent processes: one spanned by a finite basis of inducing points and the other capturing the remaining variation. We show that this formulation recovers existing approximations and at the same time allows to obtain tighter lower bounds on the marginal likelihood and new stochastic variational inference algorithms. We demonstrate the efficiency of these algorithms in several Gaussian process models ranging from standard regression to multi-class classification using (deep) convolutional Gaussian processes and report state-of-the-art results on CIFAR-10 among purely GP-based models.


title: Sample Complexity of Reinforcement Learning using Linearly Combined Model Ensembles

abstract: Reinforcement learning (RL) methods have been shown to be capable of learning intelligent behavior in rich domains. However, this has largely been done in simulated domains without adequate focus on the process of building the simulator. In this paper, we consider a setting where we have access to an ensemble of pre-trained and possibly inaccurate simulators (models). We approximate the real environment using a state-dependent linear combination of the ensemble, where the coefficients are determined by the given state features and some unknown parameters. Our proposed algorithm provably learns a near-optimal policy with a sample complexity polynomial in the number of unknown parameters, and incurs no dependence on the size of the state (or action) space. As an extension, we also consider the more challenging problem of model selection, where the state features are unknown and can be chosen from a large candidate set. We provide exponential lower bounds that illustrate the fundamental hardness of this problem, and develop a provably efficient algorithm under additional natural assumptions.


title: On the exponential stability of a stratified flow to the 2D IDEAL MHD equations with damping

abstract: We study the stability of a type of stratified flows of the two dimensional inviscid incompressible MHD equations with velocity damping. The exponential stability for the perturbation near certain stratified flow is investigated in a strip-type area R*[0,1]. Although the magnetic filed potential is governed by a transport equation, by using the algebraic structure of the incompressible condition, it turns out that the linearized MHD equations around the given stratified flow retain a non-local damping mechanism. After carefully analyzing the non-linear structure and introducing some suitable weighted energy norms, we get the exponential stability by combining the exponential decay in time in the lower order energy with that in the high order energy.


title: End-to-end architectures for ASR-free spoken language understanding

abstract: Spoken Language Understanding (SLU) is the problem of extracting the meaning from speech utterances. It is typically addressed as a two-step problem, where an Automatic Speech Recognition (ASR) model is employed to convert speech into text, followed by a Natural Language Understanding (NLU) model to extract meaning from the decoded text. Recently, end-to-end approaches were emerged, aiming at unifying the ASR and NLU into a single SLU deep neural architecture, trained using combinations of ASR and NLU-level recognition units. In this paper, we explore a set of recurrent architectures for intent classification, tailored to the recently introduced Fluent Speech Commands (FSC) dataset, where intents are formed as combinations of three slots (action, object, and location). We show that by combining deep recurrent architectures with standard data augmentation, state-of-the-art results can be attained, without using ASR-level targets or pretrained ASR models. We also investigate its generalizability to new wordings, and we show that the model can perform reasonably well on wordings unseen during training.


title: Polytope duality for families of $K3$ surfaces associated to singularities $Q_{16}$ and $S_{16}$

abstract: There are strange dual pairs of bimodal singularities that are not assigned an invertible projectivisation in EbelingPloog. We study families of $K3$ surfaces associated to such pairs.


title: Empirical Review of Automated Analysis Tools on 47,587 Ethereum Smart Contracts

abstract: Over the last few years, there has been substantial research on automated analysis, testing, and debugging of Ethereum smart contracts. However, it is not trivial to compare and reproduce that research. To address this, we present an empirical evaluation of 9 state-of-the-art automated analysis tools using two new datasets: i) a dataset of 69 annotated vulnerable smart contracts that can be used to evaluate the precision of analysis tools; and ii) a dataset with all the smart contracts in the Ethereum Blockchain that have Solidity source code available on Etherscan (a total of 47,518 contracts). The datasets are part of SmartBugs, a new extendable execution framework that we created to facilitate the integration and comparison between multiple analysis tools and the analysis of Ethereum smart contracts. We used SmartBugs to execute the 9 automated analysis tools on the two datasets. In total, we ran 428,337 analyses that took approximately 564 days and 3 hours, being the largest experimental setup to date both in the number of tools and in execution time. We found that only 42% of the vulnerabilities from our annotated dataset are detected by all the tools, with the tool Mythril having the higher accuracy (27%). When considering the largest dataset, we observed that 97% of contracts are tagged as vulnerable, thus suggesting a considerable number of false positives. Indeed, only a small number of vulnerabilities (and of only two categories) were detected simultaneously by four or more tools.


title: Primordial black hole formation in inflationary $\alpha$-attractor models

abstract: The formation of primordial black holes is studied using superconformal inflationary $\alpha$-attractors. An inflaton potential is constructed with a plateau-like region which brings about the onset of an ultra slow-roll region where the required enhancement in the curvature power spectrum takes place. This is accomplished by carefully fine-tuning the parameters in the potential. For the parameter sets, the amount of observable inflation is such that the curvature perturbation $\mathcal{P}_{\mathcal{R}}$ peaks at $\sim 10^{14}\text{Mpc}^{-1}$, producing PBHs in the mass window $10^{16}\text{g}\leq M \leq 10^{18}\text{g}$. The reheating period after inflation is taken into account to determine whether or not PBH formation takes place in such a phase. Finally, the spectrum of second order gravitational waves, that can arise due to the curvature perturbation enhancement, is calculated.


title: SalGaze: Personalizing Gaze Estimation Using Visual Saliency

abstract: Traditional gaze estimation methods typically require explicit user calibration to achieve high accuracy. This process is cumbersome and recalibration is often required when there are changes in factors such as illumination and pose. To address this challenge, we introduce SalGaze, a framework that utilizes saliency information in the visual content to transparently adapt the gaze estimation algorithm to the user without explicit user calibration. We design an algorithm to transform a saliency map into a differentiable loss map that can be used for the optimization of CNN-based models. SalGaze is also able to greatly augment standard point calibration data with implicit video saliency calibration data using a unified framework. We show accuracy improvements over 24% using our technique on existing methods.


title: Cocoa: Congestion Control Aware Queuing

abstract: Recent model-based congestion control algorithms such as BBR use repeated measurements at the endpoint to build a model of the network connection and use it to achieve optimal throughput with low queuing delay. Conversely, applying this model-based approach to Active Queue Management (AQM) has so far received less attention. We propose the new AQM scheduler cocoa based on fair queuing, which adapts the buffer size depending on the needs of each flow without requiring active participation from the endpoint. We implement this scheduler for the Linux kernel and show that it interacts well with the most common congestion control algorithms and can significantly increase throughput compared to fair CoDel while avoiding overbuffering.


title: Speaker Adaptive Training using Model Agnostic Meta-Learning

abstract: Speaker adaptive training (SAT) of neural network acoustic models learns models in a way that makes them more suitable for adaptation to test conditions. Conventionally, model-based speaker adaptive training is performed by having a set of speaker dependent parameters that are jointly optimised with speaker independent parameters in order to remove speaker variation. However, this does not scale well if all neural network weights are to be adapted to the speaker. In this paper we formulate speaker adaptive training as a meta-learning task, in which an adaptation process using gradient descent is encoded directly into the training of the model. We compare our approach with test-only adaptation of a standard baseline model and a SAT-LHUC model with a learned speaker adaptation schedule and demonstrate that the meta-learning approach achieves comparable results.


title: Inference of Binary Regime Models with Jump Discontinuities

abstract: Identifying the instances of jumps in a discrete-time-series sample of a jump diffusion model is a challenging task. We have developed a novel statistical technique for jump detection and volatility estimation in a return time series data using a threshold method. The consistency of the volatility estimator has been obtained. Since we have derived the threshold and the volatility estimator simultaneously by solving an implicit equation, we have obtained unprecedented accuracy across a wide range of parameter values. Using this method, the increments attributed to jumps have been removed from a large collection of historical data of Indian sectorial indices. Subsequently, we have tested the presence of regime-switching dynamics in the volatility coefficient using a new discriminating statistic. The statistic has been shown to be sensitive to the transition kernel of the regime-switching model. We perform the testing using the Bootstrap method and find a clear indication of presence of multiple regimes of volatility in the data. A link to all Python codes is given in the conclusion. The methodology is suitable for analyzing high-frequency data and may be applied for algorithmic trading.


title: Transonic shocks for 3-D axisymmetric compressible inviscid flows in cylinders

abstract: We establish the existence of an axisymmetric weak solution to the steady Euler system with a transonic shock, nonzero vorticity, and nonzero swirl in a three-dimensional cylinder. When prescribing the supersonic solution in the upstream region by axisymmetric functions with variable entropy and variable angular momentum density(=swirl), we construct such a solution by using a Helmholtz decomposition of the velocity field and the method of iteration. An iteration scheme is developed using a delicate decomposition of the Rankine-Hugoniot conditions on the transonic shock via Helmholtz decomposition.


title: An $H\alpha$ Imaging Survey of the all (Ultra-)Luminous Infrared Galaxies at $Dec. \ge -30^{\circ}$ in the GOALS Sample

abstract: This paper presents the result of $H\alpha$ imaging for luminous infrared galaxies (LIRGs) and ultra-luminous infrared galaxies (ULIRGs). \textbf{It is } a \textbf{complete subsample of Great Observatories All-sky LIRG Survery (GOALS) with $Dec. \ge -30^{\circ}$}, \textbf{and} consists 148 galaxies with $log(L_{IR}/L_{\odot}) \ge 11.0$. All the $H\alpha$ images were carried out using the 2.16-m telescope \textbf{at the Xinglong Station of the} National Astronomy Observatories, Chinese Academy of Sciences\textbf{ (NAOC),} during the year from 2006 to 2009. We obtained pure $H\alpha$ luminosity for each galaxy and corrected the luminosity for $[NII]$ emission, filter transmission and extinction. We also classified these galaxies based on their morphology and interaction. We found that the distribution of star-forming \textbf{regions} in these galaxies is related to this classification. As the merging process advanced, these galaxies tend to have a more compact distribution of star-forming region, higher \textbf{$L_{IR}$} and warmer IR-color ($f_{60}/f_{100}$). \textbf{These} results imply that the degree of dynamical disturbance plays an important role in determining the distribution of star-forming region.


title: Laser Cooling of Silica Glass

abstract: Laser cooling of a solid is achieved when a coherent laser illuminates the material in the red tail of its absorption spectrum, and the heat is carried out by anti-Stokes fluorescence of the blue-shifted photons. Solid-state laser cooling has been successfully demonstrated in several materials, including rare-earth-doped crystals and glasses. Silica glass, being the most widely used optical material, has so far evaded all laser cooling attempts. In addition to its fundamental importance, many potential applications can be conceived for anti-Stokes fluorescence cooling of silica. These potential applications range from the substrate cooling of optical circuits for quantum information processing and cryogenic cooling of mirrors in high-sensitivity interferometers for gravitational wave detection to the heating reduction in high-power fiber lasers and amplifiers. Here we report the net cooling of high-purity Yb-doped silica glass samples that are primarily developed for high-power fiber laser applications, where special care has been taken in the fabrication process to reduce their impurities and lower their parasitic background loss. The non-radiative decay rate of the excited state in Yb ions is very small in these glasses due to the low level of impurities, resulting in near-unity quantum efficiency. We report the measurement of the cooling efficiency as a function of the laser wavelength, from which the quantum efficiency of the silica glass is calculated.


title: Nanostructural insights into the dissolution behavior of Sr doped hydroxyapatite

abstract: In this study, high resolution transmission electron microscopy, HRTEM, was employed to characterize the nanostructure of strontium substituted hydroxyapatite, Sr HA, and its evolution following in vitro immersion in physiological solutions.


title: Generalizations of Fibonacci-Lucas inverse tangent summation identities of Hoggatt and Ruggels

abstract: We derive generalizations of a couple of inverse tangent summation identities involving Fibonacci and Lucas numbers. As byproducts we establish many new inverse tangent identities involving the Fibonacci and Lucas numbers.


title: Combinatorial study of stable categories of graded Cohen--Macaulay modules over skew quadric hypersurfaces

abstract: In this paper, we present a new connection between representation theory of noncommutative hypersurfaces and combinatorics. Let $S$ be a graded ($\pm 1$)-skew polynomial algebra in $n$ variables of degree $1$ and $f =x_1^2 + \cdots +x_n^2 \in S$. We prove that the stable category $\mathsf{\underline{CM}}^{\mathbb Z}(S/(f))$ of graded maximal Cohen--Macaulay module over $S/(f)$ can be completely computed using the four graphical operations. As a consequence, $\mathsf{\underline{CM}}^{\mathbb Z}(S/(f))$ is equivalent to the derived category $\mathsf{D^b}(\operatorname{\mathsf{mod}} k^{2^r})$, and this $r$ is obtained as the nullity of a certain matrix over ${\mathbb F}_2$. Using the properties of Stanley--Reisner ideals, we also show that the number of irreducible components of the point scheme of $S$ that are isomorphic to ${\mathbb P}^1$ is less than or equal to $\binom{r+1}{2}$.


title: Comparison between optimal control and shortcut to adiabaticity protocols in a linear control system

abstract: We analyze the control of the motion of a charged particle by means of an external electric field. The system is constrained to move along a given direction. The goal of the control is to change the speed of the particle in a fixed time with zero initial and final accelerations, while minimizing a cost functional in order to achieve a smooth transport of the system. We solve this linear control problem by using shortcut to adiabaticity methods and optimal control techniques. STA protocols are built upon local constraints. By extending the number of space variables, we explain how optimal control protocols can accommodate for such constraints and provide robust solutions against slight initial and final time uncertainties. Conversely, optimal control can guide the choice of the class of functions involved in STA processes. Such mutual benefices of the two approaches remain valid beyond the specific example studied here.


title: Application of integral equations to simulate local fields in carbon nanotube reinforced composites

abstract: We consider the steady heat conduction problem within a thermal isotropic and homogeneous square ring composite reinforced by non-overlapping and randomly distributed carbon nanotubes (CNTs). We treat the CNTs as rigid line inclusions and assume their temperature distribution to be fixed to an undetermined constant value along each line. We suppose also that the temperature distribution is known on the outer boundary and that there is no heat flux through the inner square. The equations for the temperature distribution are governed by the two-dimensional Laplace equation with mixed Dirichlet- Neumann boundary conditions. This boundary value problem is solved using a boundary integral equation method. We demonstrate the performance of our approach through four numerical examples with small and large numbers of CNTs and different side length of the inner square.


title: Applying tiling and pattern theory in the design of hollow-core photonic crystal fibers for multi-wavelength beam guidance

abstract: We show how to apply tiling and pattern theory in the design of hollow-core photonic crystal fibers and guide light in multiple bandgaps. By combining two different glass apexes in a single [$3^6$;$3^2$.$4.3.4$] 2-uniform tiling, transmission regions with fundamental, second and third harmonic wavelengths are supported. This cladding design may also be an excellent candidate for high power beam delivery of Er/Yb, Nd:YAG and Ti:Sapphire laser sources.


title: Spatial structure of the pair wavefunction and the density correlation functions at the BEC-BCS crossover

abstract: By an exact numerical calculation of the BCS pair wavefunction and the density correlation functions both between atoms in the same and in different spin states, we extract the spatial large distance behavior of the respective functions. After different initial transients, those distributions show an algebraic dependence accompanied with their own exponential decay and a well defined periodic oscillatory behavior. While in general, in the BCS side there are long-range correlations and in the BEC region the behavior is dominated by tight pairs formation, each distribution shows its own overall behavior. We derive analytic expressions for the mean pair size and the correlation lengths of the same and different density correlation functions. The whole analysis yields a quite complete description of the spatial structure of the superfluid along the crossover.


title: Two Stage Algorithm for Semi-Discrete Optimal Transport on Disconnected Domains

abstract: In this paper we present a two-stage algorithm to solve the semi-discrete Optimal Transport Problem in the case where the support of the source measure is disconnected. We establish global linear convergence and local superlinear convergence. We also find convergence of the associated Laguerre cells in the vein of \cite{BansilKitagawa19b}.


title: Dynamical phase transition in Floquet optical bistable systems: An approach from finite-size quantum systems

abstract: We study a dynamical phase transition in optical bistable systems subject to a time-periodic driving field. The phase transition occurs in the structure of limit cycle as a function of the frequency of the driving field. In the thermodynamic limit, a single limit cycle is divided into two separated limit cycles at the transition point. In finite-size systems, however, there is always a single limit cycle due to the quantum tunneling effect. We use a Floquet dissipative map, which is a time-evolution operator over one period in a dynamics given by a quantum master equation, and discuss the decay rate of relaxation dynamics into the limit cycle based on the dominant eigenvalue of the map. We found that the decay rate exhibits qualitatively different system-size dependence before and after the phase transition, and it shows a finite-size scaling of spinodal phenomena around the transition point. The present work provides a systematic way of studying dynamical phase transition observed in time-periodically driven open systems in terms of the Floquet dissipative map.


title: Gauging Defects in Quantum Spin Systems

abstract: The goal of this work is to build a dynamical theory of defects for quantum spin systems. A kinematic theory for an indefinite number of defects is first introduced exploiting distinguishable Fock space. Dynamics are then incorporated by allowing the defects to become mobile via a microscopic Hamiltonian. This construction is extended to topologically ordered systems by restricting to the ground state eigenspace of Hamiltonians generalizing the golden chain. We illustrate the construction with the example of a spin chain with $\mathbf{Vec}(\mathbb{Z}/2\mathbb{Z})$ fusion rules, employing generalized tube algebra techniques to model the defects in the chain. The resulting dynamical defect model is equivalent to the critical transverse Ising model.


title: Learning Humanoid Robot Running Skills through Proximal Policy Optimization

abstract: In the current level of evolution of Soccer 3D, motion control is a key factor in team's performance. Recent works takes advantages of model-free approaches based on Machine Learning to exploit robot dynamics in order to obtain faster locomotion skills, achieving running policies and, therefore, opening a new research direction in the Soccer 3D environment. In this work, we present a methodology based on Deep Reinforcement Learning that learns running skills without any prior knowledge, using a neural network whose inputs are related to robot's dynamics. Our results outperformed the previous state-of-the-art sprint velocity reported in Soccer 3D literature by a significant margin. It also demonstrated improvement in sample efficiency, being able to learn how to run in just few hours. We reported our results analyzing the training procedure and also evaluating the policies in terms of speed, reliability and human similarity. Finally, we presented key factors that lead us to improve previous results and shared some ideas for future work.


title: Towards Automated Management and Analysis of Heterogeneous Data Within Cannabinoids Domain

abstract: Cannabinoid research requires the cooperation of experts from various field biochemistry and chemistry to psychological and social sciences. The data that have to be managed and analysed are highly heterogeneous, especially because they are provided by a very diverse range of sources. A number of approaches focused on data collection and the corresponding analysis, restricting the scope to a sub-domain. Our goal is to elaborate a solution that would allow for automated management and analysis of heterogeneous data within the complete cannabinoids domain. The corresponding integration of diverse data sources would increase the quality and preciseness of the analysis. In this paper, we introduce the core ideas of the proposed framework as well as present the implemented prototype of a cannabinoids data platform.


title: Development and evaluation of an open-source, machine learning-based average annual daily traffic estimation software

abstract: Traditionally, Departments of Transportation (DOTs) use the factor-based model to estimate Annual Average Daily Traffic (AADT) from short-term traffic counts. The expansion factors, derived from the permanent traffic count stations, are applied to the short-term counts for AADT estimation. The inherent challenges of the factor-based method (i.e., grouping the count stations, applying proper expansion factors) make the estimated AADT values erroneous. Based on a survey conducted by the authors, 97% of the 39 public transportation agencies use the factor-based AADT estimation model, and these agencies face the aforementioned challenges while using factor-based models to estimate AADT. To derive a more accurate AADT, this paper presents the "estimAADTion" software, which is an open-source software developed based on a machine learning method called support vector regression (SVR) for estimating AADT using 24-hour short-term count data. DOTs conduct short-term counts at different locations periodically. This software has been designed to estimate AADT at a particular location from the short-term counts collected at those locations. In order to estimate AADT from short-term counts, the software uses data from permanent count stations to train the SVR model. The performance of the "estimAADTion" software is validated using the short-term count data from South Carolina. The Mean Absolute Percentage Error (MAPE) of the AADT estimated from the software is 3%, while the factor-based method produces a MAPE value of 6%.


title: A Metamodel of the Telemac Errors

abstract: A Telemac study is a computationally intensive application for the real cases and in the context of quantifying or optimizing uncertainties, the running times can be too long. This paper is an example of an approximation of the Telemac results by a more abstract but significantly faster model. It shows how a metamodel can be easily built with low computational costs, and how it can help to understand and improve some global results of Telemac. I. INTRODUCTION Many sources of uncertainty lie in the real-world problems. Telemac as any model (i.e. approximation of reality) is error prone since uncertainties appear in the initial or boundary conditions, the system parameters, the modelling simplification or the numerical calculations themselves. Therefore, it is difficult to say with confidence if the design of a Telemac model has met all the requirements to be optimal. Calibration consists of tuning the model parameters so that the results are in better agreement with a set of observations. This phase is crucial before any further study can be conducted by avoiding a meaningless analysis or prediction based on false or too inaccurate results. This paper presents a statistical calibration of a Telemac 2D model (Gironde Estuary in France) with the learning of Telemac errors by a metamodel (i.e. a model of the simulation errors) to make the best use of limited observations data over a short time period. The metamodel here is a simplified version of Telemac behaving the same for all the locations where observation points are available. If the metamodel is correct, it will be able to compute as Telemac would do but with a highly reduced computational cost.


title: Doubly robust treatment effect estimation with missing attributes

abstract: Missing attributes are ubiquitous in causal inference, as they are in most applied statistical work. In this paper, we consider various sets of assumptions under which causal inference is possible despite missing attributes and discuss corresponding approaches to average treatment effect estimation, including generalized propensity score methods and multiple imputation. Across an extensive simulation study, we show that no single method systematically out-performs others. We find, however, that doubly robust modifications of standard methods for average treatment effect estimation with missing data repeatedly perform better than their non-doubly robust baselines; for example, doubly robust generalized propensity score methods beat inverse-weighting with the generalized propensity score. This finding is reinforced in an analysis of an observations study on the effect on mortality of tranexamic acid administration among patients with traumatic brain injury in the context of critical care management. Here, doubly robust estimators recover confidence intervals that are consistent with evidence from randomized trials, whereas non-doubly robust estimators do not.


title: The Accuracy of Weak Lensing Simulations

abstract: We investigate the accuracy of weak lensing simulations by comparing the results of five independently developed lensing simulation codes run on the same input $N$-body simulation. Our comparison focuses on the lensing convergence maps produced by the codes, and in particular on the corresponding PDFs, power spectra and peak counts. We find that the convergence power spectra of the lensing codes agree to $\lesssim 2\%$ out to scales $\ell \approx 4000$. For lensing peak counts, the agreement is better than $5\%$ for peaks with signal-to-noise $\lesssim 6$. We also discuss the systematic errors due to the Born approximation, line-of-sight discretization, particle noise and smoothing. The lensing codes tested deal in markedly different ways with these effects, but they nonetheless display a satisfactory level of agreement. Our results thus suggest that systematic errors due to the operation of existing lensing codes should be small. Moreover their impact on the convergence power spectra for a lensing simulation can be predicted given its numerical details, which may then serve as a validation test.


title: Microscopic theory of fractional excitations in gapless bilayer quantum Hall states: semi-quantized quantum Hall states

abstract: We derive the low-energy theory of semi-quantized quantum Hall states, a recently observed class of gapless bilayer fractional quantum Hall states. Our theory shows these states to feature gapless quasiparticles of fractional charge coupled to an emergent Chern-Simons gauge field. These gapless quasiparticles can be understood as composites of electrons and Laughlin-like quasiparticles. We show that semi-quantized quantum Hall states exhibit perfect interlayer drag, host non-Fermi liquid physics, and serve as versatile parent states for fully gapped topological phases hosting anyonic excitations.


title: Stochastic wave-current interaction in thermal shallow water dynamics

abstract: Holm (Proc. Roy. Soc 2015) introduced a variational framework for stochastically parametrising unresolved scales of hydrodynamic motion. This variational framework preserves fundamental features of fluid dynamics, such as Kelvin's circulation theorem, while also allowing for dispersive nonlinear wave propagation, both within a stratified fluid and at its free surface. The present paper combines asymptotic expansions and vertical averaging with the stochastic variational framework to formulate a new approach for developing stochastic parametrisation schemes for nonlinear wave fields. The approach is applied to a variety of shallow water equations which descend from Euler's three-dimensional fluid equations with rotation and stratification under approximation by asymptotic expansions and vertical averaging. In the entire family of nonlinear stochastic wave-current interaction equations derived here using this approach, Kelvin's circulation theorem reveals a barotropic mechanism for wave generation of horizontal circulation or convection (cyclogenesis) which is activated whenever the gradients of wave elevation and/or topography are not aligned with the gradient of the vertically averaged buoyancy.


title: Learning Deep Parameterized Skills from Demonstration for Re-targetable Visuomotor Control

abstract: Robots need to learn skills that can not only generalize across similar problems but also be directed to a specific goal. Previous methods either train a new skill for every different goal or do not infer the specific target in the presence of multiple goals from visual data. We introduce an end-to-end method that represents targetable visuomotor skills as a goal-parameterized neural network policy. By training on an informative subset of available goals with the associated target parameters, we are able to learn a policy that can zero-shot generalize to previously unseen goals. We evaluate our method in a representative 2D simulation of a button-grid and on both button-pressing and peg-insertion tasks on two different physical arms. We demonstrate that our model trained on 33% of the possible goals is able to generalize to more than 90% of the targets in the scene for both simulation and robot experiments. We also successfully learn a mapping from target pixel coordinates to a robot policy to complete a specified goal.


title: The effect of forcing axioms on the tightness of the $G_\delta$ modification

abstract: We show that $\mathsf{PFA}$ implies that the tightness $t(X_\delta)$ of the $G_\delta$-modification of a Fr\'echet $\alpha_1$-space $X$ is at most $\omega_1$, while $\Box(\kappa)$ implies that there is a Fr\'echet $\alpha_1$-space with $G_\delta$-tightness equal to $\kappa$. We use the example constructed from $\Box(\kappa)$ to show that a local version of the bound $t(X_\delta)\le 2^{t(X)L(X)}$ does not hold. We also construct, assuming $\mathsf{MA}$, an example of a Fr\'echet space whose $G_\delta$-tightness is larger than $\omega_1$.


title: Michael Atiyah and Physics: the Later Years

abstract: I review aspects of Michael Atiyah's research in fundamental theoretical physics during the last ten years of his life, and contrast his deliberate interest in physics during this period with the inadvertent impact on physics of his early mathematical work.


title: Resolution of the Burrows-Wheeler Transform Conjecture

abstract: The Burrows-Wheeler Transform (BWT) is an invertible text transformation that permutes symbols of a text according to the lexicographical order of its suffixes. BWT is the main component of popular lossless compression programs (such as bzip2) as well as recent powerful compressed indexes (such as $r$-index [Gagie et al., J. ACM, 2020]), central in modern bioinformatics. The compression ratio of BWT is quantified by the number $r$ of equal-letter runs. Despite the practical significance of BWT, no non-trivial bound on the value of $r$ is known. This is in contrast to nearly all other known compression methods, whose sizes have been shown to be either always within a ${\rm polylog}\,n$ factor (where $n$ is the length of text) from $z$, the size of Lempel-Ziv (LZ77) parsing of the text, or significantly larger in the worst case (by a $n^{\varepsilon}$ factor for $\varepsilon > 0$). In this paper, we show that $r = \mathcal{O}(z \log^2n)$ holds for every text. This result has numerous implications for text indexing and data compression; for example: (1) it proves that many results related to BWT automatically apply to methods based on LZ77, e.g., it is possible to obtain functionality of the suffix tree in $\mathcal{O}(z\,{\rm polylog}\,n)$ space; (2) it shows that many text processing tasks can be solved in the optimal time assuming the text is compressible using LZ77 by a sufficiently large ${\rm polylog}\,n$ factor; (3) it implies the first non-trivial relation between the number of runs in the BWT of the text and its reverse. In addition, we provide an $\mathcal{O}(z\,{\rm polylog}\,n)$-time algorithm converting the LZ77 parsing into the run-length compressed BWT. To achieve this, we develop a number of new data structures and techniques of independent interest.


title: Weyl metrics and Wiener-Hopf factorization

abstract: We consider the Riemann-Hilbert factorization approach to the construction of Weyl metrics in four space-time dimensions. We present, for the first time, a rigorous proof of the remarkable fact that the canonical Wiener-Hopf factorization of a matrix obtained from a general (possibly unbounded) monodromy matrix, with respect to an appropriately chosen contour, yields a solution to the non-linear gravitational field equations. This holds regardless of whether the dimensionally reduced metric in two dimensions has Minkowski or Euclidean signature. We show moreover that, by taking advantage of a certain degree of freedom in the choice of the contour, the same monodromy matrix generally yields various distinct solutions to the field equations. Our proof, which fills various gaps in the existing literature, is based on the solution of a second Riemann-Hilbert problem and highlights the deep role of the spectral curve, the normalization condition in the factorization and the choice of the contour. This approach allows us to construct explicit solutions, including new ones, to the non-linear gravitational field equations, using simple complex analytic results.


title: Impact-Aware Online Motion Planning for Fully-Actuated Bipedal Robot Walking

abstract: The ability to track a general walking path with specific timing is crucial to the operational safety and reliability of bipedal robots for avoiding dynamic obstacles, such as pedestrians, in complex environments. This paper introduces an online, full-body motion planner that generates the desired impact-aware motion for fully-actuated bipedal robotic walking. The main novelty of the proposed planner lies in its capability of producing desired motions in real-time that respect the discrete impact dynamics and the desired impact timing. To derive the proposed planner, a full-order hybrid dynamic model of fully-actuated bipedal robotic walking is presented, including both continuous dynamics and discrete lading impacts. Next, the proposed impact-aware online motion planner is introduced. Finally, simulation results of a 3-D bipedal robot are provided to confirm the effectiveness of the proposed online impact-aware planner. The online planner is capable of generating full-body motion of one walking step within 0.6 second, which is shorter than a typical bipedal walking step.


title: Selectivity properties of spaces

abstract: This paper addresses several questions of Feng, Gruenhage, and Shen which arose from Michael's theory of continuous selections from countable spaces. We construct an example of a space which is $L$-selective but not $\mathbb{Q}$-selective from $\mathfrak{d}=\omega_1$, and an $L$-selective space which is not selective for a $P$-point ultrafilter from the assumption of $\mathsf{CH}$. We also produce $\mathsf{ZFC}$ examples of Fr\'echet spaces where countable subsets are first countable which are not $L$-selective.


title: One-step implementation of a multi-target-qubit controlled phase gate with cat-state qubits in circuit QED

abstract: We propose a single-step implementation of a muti-target-qubit controlled phase gate with one cat-state qubit (\textit{cqubit}) simultaneously controlling $n-1$ target \textit{cqubits}. The two logic states of a \textit{cqubit} are represented by two orthogonal cat states of a single cavity mode. In this proposal, the gate is implemented with $n$ microwave cavities coupled to a superconducting transmon qutrit. Because the qutrit remains in the ground state during the gate operation, decoherence caused due to the qutrit's energy relaxation and dephasing is greatly suppressed. The gate implementation is quite simple because only a single-step operation is needed and neither classical pulse nor measurement is required. Numerical simulations demonstrate that high-fidelity realization of a controlled phase gate with one cqubit simultaneously controlling two target cqubits is feasible with present circuit QED technology. This proposal can be extended to a wide range of physical systems to realize the proposed gate, such as multiple microwave or optical cavities coupled to a natural or artificial three-level atom.


title: Farkas certificates and minimal witnesses for probabilistic reachability constraints

abstract: This paper introduces Farkas certificates for lower and upper bounds on minimal and maximal reachability probabilities in Markov decision processes (MDP), which we derive using an MDP-variant of Farkas' Lemma. The set of all such certificates is shown to form a polytope whose points correspond to witnessing subsystems of the model and the property. Using this correspondence we can translate the problem of finding minimal witnesses to the problem of finding vertices with a maximal number of zeros. While computing such vertices is computationally hard in general, we derive new heuristics from our formulations that exhibit competitive performance compared to state-of-the-art techniques. As an argument that asymptotically better algorithms cannot be hoped for, we show that the decision version of finding minimal witnesses is NP-complete even for acyclic Markov chains.


title: Ideal Magnetohydrodynamic Equations on a Sphere and Elliptic-Hyperbolic Property

abstract: This work contains the derivation and type analysis of the conical Ideal Magnetohydrodynamic equations. The 3D Ideal MHD equations with Powell source terms, subject to the assumption that the solution is conically invariant, are projected onto a unit sphere using tools from tensor calculus. Conical flows provide valuable insight into supersonic and hypersonic flow past bodies, but are simpler to analyze and solve numerically. Previously, work has been done on conical inviscid flows governed by the Euler equations with great success. It is known that some flight regimes involve flows of ionized gases, and thus there is motivation to extend the study of conical flows to the case where the gas is electrically conducting. To the authors' knowledge, the conical magnetohydrodynamic equations have never been derived and so this paper is the first invesitgation of that system. Among the results, we show that conical flows for this case do exist mathematically and that the governing system of partial differential equations is of mixed type. Throughout the domain it can be either hyperbolic or elliptic depending on the solution.


title: Blockchain Methods for Trusted Avionics Systems

abstract: Blockchain is a popular method to ensure security for trusted systems. The benefits include an auditable method to provide decentralized security without a trusted third party, but the drawback is the large computational resources needed to process and store the ever-expanding chain of security blocks. The promise of blockchain for edge devices (e.g., internet of things) poses a variety of challenges and strategies before adoption. In this paper, we explore blockchain methods and examples, with experimental data to determine the merits of the capabilities. As for an aerospace example, we address a notional example for Automatic dependent surveillance-broadcast (ADS-B) from Flight24 data (https://www.flightradar24.com/) to determine whether blockchain is feasible for avionics systems. The methods are incorporated into the Lightweight Internet of Things (IoT) based Smart Public Safety (LISPS) framework. By decoupling a complex system into independent sub-tasks, the LISPS system possesses high flexibility in the design process and online maintenance. The Blockchain-enabled decentralized avionics services provide a secured data sharing and access control mechanism. The experimental results demonstrate the feasibility of the approach.


title: Chance-constrained Unit Commitment via the Scenario Approach

abstract: Keeping the balance between supply and demand is a fundamental task in power system operational planning practices. This task becomes particularly challenging due to the deepening penetration of renewable energy resources, which induces a significant amount of uncertainties. In this paper, we propose a chance-constrained Unit Commitment (c-UC) framework to tackle challenges from uncertainties of renewables. The proposed c-UC framework seeks cost-efficient scheduling of generators while ensuring operation constraints with guaranteed probability. We show that the scenario approach can be used to solve c-UC despite of the non-convexity from binary decision variables. We reveal the salient structural properties of c-UC, which could significantly reduce the sample complexity required by the scenario approach and speed up computation. Case studies are performed on a modified 118-bus system.


title: Third Order Anomalies in the Causal Approach

abstract: We consider gauge models in the causal approach and study the third order of the perturbation theory. We are interested in the computation of the anomalies in this order of the perturbation theory and for this purpose we analyse in detail the causal splitting of the distributions with causal support relevant to tree and loop anomalies.


title: An Optimized, Parallel Computation of the Ghost Layer for Adaptive Hybrid Forest Meshes

abstract: We discuss parallel algorithms to gather topological information about off-process mesh neighbor elements. This information is commonly called the ghost layer, whose creation is a fundamental, necessary task in executing most parallel, element-based computer simulations. Approaches differ in that the ghost layer may either be inherently part of the mesh data structure that is maintained and modified, or kept separate and constructed/deleted as needed. In this work, we present an updated design following the latter approach, which we favor for its modularity of algorithms and data structures. We target arbitrary adaptive, non-conforming forest-of-(oc)trees meshes of mixed element shapes, such as cubes, prisms, and tetrahedra, and restrict ourselves to face-ghosts. Our algorithm has low complexity and redundancy since we reduce it to generic codimension-1 subalgorithms that can be flexibly combined. We cover several existing solutions as special cases and optimize further using recursive, amortized tree searches and traversals.


title: Quantum Kinetic Theory of Thermoelectric and Thermal Transport in a Magnetic Field

abstract: We present a general quantum kinetic theory that accounts for the interplay between a temperature gradient, momentum-space Berry curvatures of Bloch electrons, and Bloch-state scattering. Using a theory that incorporates the presence of a temperature gradient by introducing a "thermal vector potential", we derive a quantum kinetic equation for Bloch electrons in the presence of disorder and a temperature gradient. Taking also into account the presence of electric and magnetic fields, the quantum kinetic equation we derive makes it possible to compute transport coefficients at arbitrary orders of electric-field $\vec{E}$, magnetic-field $\vec{B}$, and temperature-gradient $\nabla T$ strengths $|\vec{E}|^a |\vec{B}|^b |\nabla T|^c$. Our theory enables a systematic calculation of magnetothermoelectric and magnetothermal conductivities of systems with momentum-space Berry curvatures. As an illustration, we derive from a general microscopic electron model a general expression for the rate of pumping of electrons between valleys in parallel temperature gradient and magnetic field. From this expression we find a relation, which is analogous to the Mott relation, between the rate of pumping due to a temperature gradient and that due to an electric field. We also apply our theory to a two-band model for Weyl semimetals to study thermoelectric and thermal transport in a magnetic field. We show that the Mott relation is satisfied in the chiral-anomaly induced thermoelectric conductivity, and that the Wiedemann-Franz law is violated in the chiral-anomaly induced thermal conductivity, which are both consistent with the results obtained by invoking semiclassical wave-packet dynamics.


title: Embedding Complete Multipartite Graphs into Certain Trees

abstract: One of the important features of an interconnection network is its ability to efficiently simulate programs or parallel algorithms written for other architectures. Such a simulation problem can be mathematically formulated as a graph embedding problem. In this paper, we embed complete multipartite graphs into certain trees, such as $k$-rooted complete binary trees and $k$-rooted sibling trees.


title: Lattice QCD study of the rare kaon decay $K^+\to\pi^+\nu\bar{\nu}$ at a near-physical pion mass

abstract: The rare kaon decay $K^+\to\pi^+\nu\bar{\nu}$ is an ideal process in which to search for signs of new physics and is the primary goal of the NA62 experiment at CERN. In this paper we report on a lattice QCD calculation of the long-distance contribution to the $K^+\to\pi^+\nu\bar{\nu}$ decay amplitude at the near-physical pion mass $m_\pi=170$ MeV. The calculations are however, performed on a coarse lattice and hence with a lighter charm quark mass ($m_c^{\bar{\mathrm{MS}}}(\mbox{3 GeV})=750$ MeV) than the physical one. The main aims of this study are two-fold. Firstly we study the momentum dependence of the amplitude and conclude that it is very mild so that a computation at physical masses even at a single kinematic point would provide a good estimate of the long-distance contribution to the decay rate. Secondly we compute the contribution to the branching ratio from the two-pion intermediate state whose energy is below the kaon mass and find that it is less than 1% after its exponentially growing unphysical contribution has been removed and that the corresponding non-exponential finite-volume effects are negligibly small.


title: Selfadjoint extensions of relations whose domain and range are orthogonal

abstract: The selfadjoint extensions of a closed linear relation $R$ from a Hilbert space ${\mathfrak H}_1$ to a Hilbert space ${\mathfrak H}_2$ are considered in the Hilbert space ${\mathfrak H}_1\oplus{\mathfrak H}_2$ that contains the graph of $R$. They will be described by $2 \times 2$ blocks of linear relations and by means of boundary triplets associated with a closed symmetric relation $S$ in ${\mathfrak H}_1 \oplus {\mathfrak H}_2$ that is induced by $R$. Such a relation is characterized by the orthogonality property ${\rm dom\,} S \perp {\rm ran\,} S$ and it is nonnegative. All nonnegative selfadjoint extensions $A$, in particular the Friedrichs and Kre\u{\i}n-von Neumann extensions, are parametrized via an explicit block formula. In particular, it is shown that $A$ belongs to the class of extremal extensions of $S$ if and only if ${\rm dom\,} A \perp {\rm ran\,} A$. In addition, using asymptotic properties of an associated Weyl function, it is shown that there is a natural correspondence between semibounded selfadjoint extensions of $S$ and semibounded parameters describing them if and only if the operator part of $R$ is bounded.


title: Nonparametric identification of an interdependent value model with buyer covariates from first-price auction bids

abstract: This paper introduces a version of the interdependent value model of Milgrom and Weber (1982), where the signals are given by an index gathering signal shifters observed by the econometrician and private ones specific to each bidders. The model primitives are shown to be nonparametrically identified from first-price auction bids under a testable mild rank condition. Identification holds for all possible signal values. This allows to consider a wide range of counterfactuals where this is important, as expected revenue in second-price auction. An estimation procedure is briefly discussed.


title: Optimized design of a Silica encapsulated photonic crystal nanobeam cavity for integrated Silicon-based nonlinear and quantum photonics

abstract: Photonic resonators allowing to confine the electromagnetic field in ultra-small volumes and with long decay times are crucial to a number of applications requiring enhanced nonlinear effects. For applications to integrated photonic devices on chip, compactness and optimized in-plane transmission become relevant figures of merit as well. Here we optimize an encapsulated Si/SiO$_2$ photonic crystal nanobeam cavity at telecom wavelengths by means of a global optimization procedure, where only the first few holes surrounding the cavity are varied to decrease its radiative losses. This strategy allows to achieve close to 10 million intrinsic quality factor, sub-diffraction limited mode volumes, and in-plane transmission above 65\%, in a structure with a record small footprint of around $8~\mu$m$^2$. We address and quantitatively assess the dependence of the main figures of merit on the nanobeam length and fabrication disorder. Finally, we theoretically give a realistic estimate of the single-photon nonlinearity in such a device, which holds promise for prospective experiments in low-power nonlinear and quantum photonics.


title: Effect of Demagnetization Method on Remnance Magnetization States in Metallic Ferromagnets

abstract: Parametric plots of the remagnetization versus demagnetization remnances were found for four metallic ferromagnets -- nickel wire, two types of AlNiCo, and samarium cobalt 2:17. These plots, known as Henkel plots, were compared to Wohlfarth's model for noninteracting magnetic particles and several Preisach models. The remagnetization data were taken with a variety of paths to the net zero magnetization state. The resulting Henkel plots exhibit similarities to independent Monte Carlo simulations. The differences can be mostly explained by considering that the magnetization in the metallic ferromagnets occur by domain wall motion.


title: Fast quantum subroutines for the simplex method

abstract: We propose quantum subroutines for the simplex method that avoid classical computation of the basis inverse. We show how to quantize all steps of the simplex algorithm, including checking optimality, unboundedness, and identifying a pivot (i.e., pricing the columns and performing the ratio test) according to Dantzig's rule or the steepest edge rule. The quantized subroutines obtain a polynomial speedup in the dimension of the problem, but have worse dependence on other numerical parameters. For example, for a problem with $m$ constraints, $n$ variables, at most $d_c$ nonzero elements per column of the costraint matrix, at most $d$ nonzero elements per column or row of the basis, basis condition number $\kappa$, and optimality tolerance $\epsilon$, pricing can be performed in $\tilde{O}(\frac{1}{\epsilon}\kappa d \sqrt{n}(d_c n + d m))$ time, where the $\tilde{O}$ notation hides polylogarithmic factors; classically, pricing requires $O(d_c^{0.7} m^{1.9} + m^{2 + o(1)} + d_c n)$ time in the worst case using the fastest known algorithm for sparse matrix multiplication. For well-conditioned sparse problems the quantum subroutines scale better in $m$ and $n$, and may therefore have an advantage for very large problems. The running time of the quantum subroutines can be improved if the constraint matrix admits an efficient algorithmic description, or if quantum RAM is available.


title: Local description of the Aharonov-Bohm effect with a quantum electromagnetic field

abstract: In the seminal works from Santos and Gozalo [Europhys. Lett. $\mathbf{45}$, 418 (1999)] and Marletto and Vedral [Phys. Rev. Lett. $\mathbf{125}$, 040401 (2020)], it is shown how the Aharonov-Bohm effect can be described as the result of an exchange of virtual photons between the solenoid and the quantum charged particle along its propagation through the interferometer, where both the particle and the solenoid interact locally with the quantum electromagnetic field. This interaction results in a local and gauge-independent phase generation for the particle propagation in each path of the interferometer. Here we improve the cited treatments by using the quantum electrodynamics formalism in the Lorentz gauge, with a manifestly gauge-independent Hamiltonian for the interaction and the presence of virtual longitudinal photons. Only with this more complete and gauge-independent treatment it is possible to justify the acquired phases for interferometers with arbitrary geometries, and this is an advantage of our treatment. We also extend the results to the electric version of the Aharonov-Bohm effect. Finally, we propose an experiment that could test the locality of the Aharonov-Bohm phase generation.


title: Occlusions for Effective Data Augmentation in Image Classification

abstract: Deep networks for visual recognition are known to leverage "easy to recognise" portions of objects such as faces and distinctive texture patterns. The lack of a holistic understanding of objects may increase fragility and overfitting. In recent years, several papers have proposed to address this issue by means of occlusions as a form of data augmentation. However, successes have been limited to tasks such as weak localization and model interpretation, but no benefit was demonstrated on image classification on large-scale datasets. In this paper, we show that, by using a simple technique based on batch augmentation, occlusions as data augmentation can result in better performance on ImageNet for high-capacity models (e.g., ResNet50). We also show that varying amounts of occlusions used during training can be used to study the robustness of different neural network architectures.


title: Breast Anatomy Enriched Tumor Saliency Estimation

abstract: Breast cancer investigation is of great significance, and developing tumor detection methodologies is a critical need. However, it is a challenging task for breast ultrasound due to the complicated breast structure and poor quality of the images. In this paper, we propose a novel tumor saliency estimation model guided by enriched breast anatomy knowledge to localize the tumor. Firstly, the breast anatomy layers are generated by a deep neural network. Then we refine the layers by integrating a non-semantic breast anatomy model to solve the problems of incomplete mammary layers. Meanwhile, a new background map generation method weighted by the semantic probability and spatial distance is proposed to improve the performance. The experiment demonstrates that the proposed method with the new background map outperforms four state-of-the-art TSE models with increasing 10% of F_meansure on the BUS public dataset.


title: Accurate 6D Object Pose Estimation by Pose Conditioned Mesh Reconstruction

abstract: Current 6D object pose methods consist of deep CNN models fully optimized for a single object but with its architecture standardized among objects with different shapes. In contrast to previous works, we explicitly exploit each object's distinct topological information i.e. 3D dense meshes in the pose estimation model, with an automated process and prior to any post-processing refinement stage. In order to achieve this, we propose a learning framework in which a Graph Convolutional Neural Network reconstructs a pose conditioned 3D mesh of the object. A robust estimation of the allocentric orientation is recovered by computing, in a differentiable manner, the Procrustes' alignment between the canonical and reconstructed dense 3D meshes. 6D egocentric pose is then lifted using additional mask and 2D centroid projection estimations. Our method is capable of self validating its pose estimation by measuring the quality of the reconstructed mesh, which is invaluable in real life applications. In our experiments on the LINEMOD, OCCLUSION and YCB-Video benchmarks, the proposed method outperforms state-of-the-arts.


title: Fast Independent Vector Extraction by Iterative SINR Maximization

abstract: We propose fast independent vector extraction (FIVE), a new algorithm that blindly extracts a single non-Gaussian source from a Gaussian background. The algorithm iteratively computes beamforming weights maximizing the signal-to-interference-and-noise ratio for an approximate noise covariance matrix. We demonstrate that this procedure minimizes the negative log-likelihood of the input data according to a well-defined probabilistic model. The minimization is carried out via the auxiliary function technique whereas, unlike related methods, the auxiliary function is globally minimized at every iteration. Numerical experiments are carried out to assess the performance of FIVE. We find that it is vastly superior to competing methods in terms of convergence speed, and has high potential for real-time applications.


title: End-to-end Domain-Adversarial Voice Activity Detection

abstract: Voice activity detection is the task of detecting speech regions in a given audio stream or recording. First, we design a neural network combining trainable filters and recurrent layers to tackle voice activity detection directly from the waveform. Experiments on the challenging DIHARD dataset show that the proposed end-to-end model reaches state-of-the-art performance and outperforms a variant where trainable filters are replaced by standard cepstral coefficients. Our second contribution aims at making the proposed voice activity detection model robust to domain mismatch. To that end, a domain classification branch is added to the network and trained in an adversarial manner. The same DIHARD dataset, drawn from 11 different domains is used for evaluation under two scenarios. In the in-domain scenario where the training and test sets cover the exact same domains, we show that the domain-adversarial approach does not degrade performance of the proposed end-to-end model. In the out-domain scenario where the test domain is different from training domains, it brings a relative improvement of more than 10%. Finally, our last contribution is the provision of a fully reproducible open-source pipeline than can be easily adapted to other datasets.


title: A comparison of the Georgescu and Vasy spaces associated to the N-body problems and applications

abstract: We provide new insight into the analysis of N-body problems by studying a compactification $M_N$ of $\mathbb{R}^{3N}$ that is compatible with the analytic properties of the $N$-body Hamiltonian $H_N$. We show that our compactification coincides with the compactification introduced by Vasy using blow-ups in order to study the scattering theory of N-body Hamiltonians and with a compactification introduced by Georgescu using $C^*$-algebras. In particular, the compactifications introduced by Georgescu and by Vasy coincide (up to a homeomorphism that is the identity on $\mathbb{R}^{3N}$). Our result has applications to the spectral theory of $N$-body problems and to some related approximation properties. For instance, results about the essential spectrum, the resolvents, and the scattering matrices of $H_N$ (when they exist) may be related to the behavior near $M_N\setminus \mathbb{R}^{3N}$ (i.e. "at infinity") of their distribution kernels, which can be efficiently studied using our methods. The compactification $M_N$ is compatible with the action of the permutation group $S_N$, which allows to implement bosonic and fermionic (anti-)symmetry relations. We also indicate how our results lead to a regularity result for the eigenfunctions of $H_N$.


title: Reducibility of Schr\"odinger equation on a Zoll manifold with unbounded potential

abstract: In this article we prove a reducibility result for the linear Schr\"odinger equation on a Zoll manifold with quasi-periodic in time pseudo-differential perturbation of order less or equal than $1/2$. As far as we know, this is the first reducibility results for an unbounded perturbation of a linear system which is not integrable.


title: Enhancing the bond strength in meta-crystal lattice of architected materials

abstract: Architected materials produced by powder bed fusion metal additive manufacturing technique offer realization of complex structural hierarchies that mimic the principles of crystal plasticity while still being ultralight-weight, though suffering from deep-rooted multiscale defects including microstructural heterogeneity caused by the complex thermo-mechanical transients in the melt pool. Here we manufacture meta-crystal 316L stainless steel microlattice structures by selective laser melting process for utilizing the strain localization mechanism in bulk structures akin to dislocation slip mediated plasticity. The build angle was observed to be the primary influencer of defects generated and the presence of inherent voids was the major drawback that would undermine their structural performance as mechanical metamaterials. However, other defects in the form of spatially correlated dislocation networks and micro-segregated cellular substructures overcome the strength-ductility trade-off and render the bulk structures comparable to other engineering materials including conventional steels. By exploiting this intrinsic strengthening mechanism, the bond strength of meta-crystals (i.e. strut strength) can be enhanced (or controlled) on top of employing hardening principles of metallurgy to design materials with desired properties.


title: Existence and asymptotic behavior of solutions for a Klein-Gordon system

abstract: In this paper we study the global existence and uniqueness of solution for a Klein-Gordon equations system with mixed boundary conditions. Also we analyze the asymptotic behavior of this solution.


title: Deep learning guided Android malware and anomaly detection

abstract: In the past decade, the cyber-crime related to mobile devices has increased. Mobile devices, especially the ones running on Android operating system are particularly interesting to malware creators, as the users often keep the biggest amount of personal information on their mobile devices, such as their contacts, social media profiles, emails, and bank accounts. Both dynamic and static malware analysis is necessary to prevent and detect malware, as both techniques have their benefits and shortcomings. In this paper, we propose a deep learning technique that relies on LSTM and encoder-decoder neural network architectures for dynamic malware analysis based on CPU, memory and battery usage. The proposed system is able to detect and notify users about anomalies in system that is likely consequence of malware behaviour. The method was implemented as a part of OWASP Seraphimdroids anti-malware mechanism and notifies users about anomalies on their devices. The method proved to perform with an F1-score of 79.2%.


title: A Comparative Study of Multilateration Methods for Single-Source Localization in Distributed Audio

abstract: In this article we analyze the state-of-the-art in multilateration - the family of localization methods enabled by the range difference observations. These methods are computationally efficient, signal-independent, and flexible with regards to the number of sensing nodes and their spatial arrangement. However, the multilateration problem does not admit a closed-form solution in the general case, and the localization performance is conditioned on the accuracy of range difference estimates. For that reason, we consider a simplified use case where multiple distributed microphones capture the signal coming from a near field sound source, and discuss their robustness to the estimation errors. In addition to surveying the relevant bibliography, we present the results of a small-scale benchmark of few "mainstream" multilateration algorithms, based on an in-house Room Impulse Response dataset.


title: Flavour Physics from Present to Future Colliders

abstract: In these proceedings we provide a brief overview of the status of flavour physics, with focus on opportunities to discover New Physics in flavour-violating decays at current and future colliders.


title: Instance-Based Model Adaptation For Direct Speech Translation

abstract: Despite recent technology advancements, the effectiveness of neural approaches to end-to-end speech-to-text translation is still limited by the paucity of publicly available training corpora. We tackle this limitation with a method to improve data exploitation and boost the system's performance at inference time. Our approach allows us to customize "on the fly" an existing model to each incoming translation request. At its core, it exploits an instance selection procedure to retrieve, from a given pool of data, a small set of samples similar to the input query in terms of latent properties of its audio signal. The retrieved samples are then used for an instance-specific fine-tuning of the model. We evaluate our approach in three different scenarios. In all data conditions (different languages, in/out-of-domain adaptation), our instance-based adaptation yields coherent performance gains over static models.


title: Krylov Methods for Low-Rank Regularization

abstract: This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit projections onto low-rank subspaces are already used for well-posed systems that arise from discretizing stochastic or time-dependent PDEs, we are mainly concerned with algorithms that solve the so-called nuclear norm regularized problem, where a suitable nuclear norm penalization on the solution is imposed alongside a fit-to-data term expressed in the 2-norm: this has the effect of implicitly enforcing low-rank solutions. By adopting an iteratively reweighted norm approach, the nuclear norm regularized problem is reformulated as a sequence of quadratic problems, which can then be efficiently solved using Krylov methods, giving rise to an inner-outer iteration scheme. Our approach differs from the other solvers available in the literature in that: (a) Kronecker product properties are exploited to define the reweighted 2-norm penalization terms; (b) efficient preconditioned Krylov methods replace gradient (projection) methods; (c) the regularization parameter can be efficiently and adaptively set along the iterations. Furthermore, we reformulate within the framework of flexible Krylov methods both the new inner-outer methods for nuclear norm regularization and some of the existing Krylov methods incorporating low-rank projections. This results in an even more computationally efficient (but heuristic) strategy, that does not rely on an inner-outer iteration scheme. Numerical experiments show that our new solvers are competitive with other state-of-the-art solvers for low-rank problems, and deliver reconstructions of increased quality with respect to other classical Krylov methods.


title: Mimicking Networks Parameterized by Connectivity

abstract: Given a graph $G=(V,E)$, capacities $w(e)$ on edges, and a subset of terminals $\mathcal{T} \subseteq V: |\mathcal{T}| = k$, a mimicking network for $(G,\mathcal{T})$ is a graph $(H,w')$ that contains copies of $\mathcal{T}$ and preserves the value of minimum cuts separating any subset $A, B \subseteq \mathcal{T}$ of terminals. Mimicking networks of size $2^{2^k}$ are known to exist and can be constructed algorithmically, while the best known lower bound is $2^{\Omega(k)}$; therefore, an exponential size is required if one aims at preserving cuts exactly. In this paper, we study mimicking networks that preserve connectivity of the graph exactly up to the value of $c$, where $c$ is a parameter. This notion of mimicking network is sufficient for some applications, as we will elaborate. We first show that a mimicking of size $3^c \cdot k$ exists, that is, we can preserve cuts with small capacity using a network of size linear in $k$. Next, we show an algorithm that finds such a mimicking network in time $2^{O(c^2)} \operatorname{poly}(m)$.


title: Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

abstract: This paper proposes a novel family of primal-dual-based distributed algorithms for smooth, convex, multi-agent optimization over networks that uses only gradient information and gossip communications. The algorithms can also employ acceleration on the computation and communications. We provide a unified analysis of their convergence rate, measured in terms of the Bregman distance associated to the saddle point reformation of the distributed optimization problem. When acceleration is employed, the rate is shown to be optimal, in the sense that it matches (under the proposed metric) existing complexity lower bounds of distributed algorithms applicable to such a class of problem and using only gradient information and gossip communications. Preliminary numerical results on distributed least-square regression problems show that the proposed algorithm compares favorably on existing distributed schemes.


title: Extreme value statistics of correlated random variables: a pedagogical review

abstract: Extreme value statistics (EVS) concerns the study of the statistics of the maximum or the minimum of a set of random variables. This is an important problem for any time-series and has applications in climate, finance, sports, all the way to physics of disordered systems where one is interested in the statistics of the ground state energy. While the EVS of `uncorrelated' variables are well understood, little is known for strongly correlated random variables. Only recently this subject has gained much importance both in statistical physics and in probability theory. In this review, we will first recall the classical EVS for uncorrelated variables and discuss the three universality classes of extreme value limiting distribution, known as the Gumbel, Fr\'echet and Weibull distribution. We then show that, for weakly correlated random variables with a finite correlation length/time, the limiting extreme value distribution can still be inferred from that of the uncorrelated variables using a renormalisation group-like argument. Finally, we consider the most interesting examples of strongly correlated variables for which there are very few exact results for the EVS. We discuss few examples of such strongly correlated systems (such as the Brownian motion and the eigenvalues of a random matrix) where some analytical progress can be made. We also discuss other observables related to extremes, such as the density of near-extreme events, time at which an extreme value occurs, order and record statistics, etc.

categories: cond-mat.stat-mech cond-mat.dis-nn math-ph math.MP


title: Inter-Party Avalanche Involvements May Increase Quadratically With Party Density

abstract: We estimate, from first-principles, the rate of inter-party avalanche involvements. The model suggests that the likelihood of inter-party involvements is quadratic in the density of parties -- twice as many parties quadruples the likelihood. The model predicts that when the product of the party-density and the area of a day's potential avalanches approaches one, inter-party avalanche involvements will become a substantial fraction of all avalanche involvements. As a corollary, the relative rate of inter-party involvements is expected to increase with avalanche size. We argue, with selected North American inter-party incidents from 2001-2019, that inter-party involvements are a timely concern. To spur conversation, we enumerate a variety of strategies that may mitigate inter-party hazard.


title: Kernel Methods for Bayesian Elliptic Inverse Problems on Manifolds

abstract: This paper investigates the formulation and implementation of Bayesian inverse problems to learn input parameters of partial differential equations (PDEs) defined on manifolds. Specifically, we study the inverse problem of determining the diffusion coefficient of a second-order elliptic PDE on a closed manifold from noisy measurements of the solution. Inspired by manifold learning techniques, we approximate the elliptic differential operator with a kernel-based integral operator that can be discretized via Monte-Carlo without reference to the Riemannian metric. The resulting computational method is mesh-free and easy to implement, and can be applied without full knowledge of the underlying manifold, provided that a point cloud of manifold samples is available. We adopt a Bayesian perspective to the inverse problem, and establish an upper-bound on the total variation distance between the true posterior and an approximate posterior defined with the kernel forward map. Supporting numerical results show the effectiveness of the proposed methodology.


title: Efficient Dynamic WFST Decoding for Personalized Language Models

abstract: We propose a two-layer cache mechanism to speed up dynamic WFST decoding with personalized language models. The first layer is a public cache that stores most of the static part of the graph. This is shared globally among all users. A second layer is a private cache that caches the graph that represents the personalized language model, which is only shared by the utterances from a particular user. We also propose two simple yet effective pre-initialization methods, one based on breadth-first search, and another based on a data-driven exploration of decoder states using previous utterances. Experiments with a calling speech recognition task using a personalized contact list demonstrate that the proposed public cache reduces decoding time by factor of three compared to decoding without pre-initialization. Using the private cache provides additional efficiency gains, reducing the decoding time by a factor of five.


title: A practical two-stage training strategy for multi-stream end-to-end speech recognition

abstract: The multi-stream paradigm of audio processing, in which several sources are simultaneously considered, has been an active research area for information fusion. Our previous study offered a promising direction within end-to-end automatic speech recognition, where parallel encoders aim to capture diverse information followed by a stream-level fusion based on attention mechanisms to combine the different views. However, with an increasing number of streams resulting in an increasing number of encoders, the previous approach could require substantial memory and massive amounts of parallel data for joint training. In this work, we propose a practical two-stage training scheme. Stage-1 is to train a Universal Feature Extractor (UFE), where encoder outputs are produced from a single-stream model trained with all data. Stage-2 formulates a multi-stream scheme intending to solely train the attention fusion module using the UFE features and pretrained components from Stage-1. Experiments have been conducted on two datasets, DIRHA and AMI, as a multi-stream scenario. Compared with our previous method, this strategy achieves relative word error rate reductions of 8.2--32.4%, while consistently outperforming several conventional combination methods.


title: gradSLAM: Automagically differentiable SLAM

abstract: Blending representation learning approaches with simultaneous localization and mapping (SLAM) systems is an open question, because of their highly modular and complex nature. Functionally, SLAM is an operation that transforms raw sensor inputs into a distribution over the state(s) of the robot and the environment. If this transformation (SLAM) were expressible as a differentiable function, we could leverage task-based error signals to learn representations that optimize task performance. However, several components of a typical dense SLAM system are non-differentiable. In this work, we propose gradSLAM, a methodology for posing SLAM systems as differentiable computational graphs, which unifies gradient-based learning and SLAM. We propose differentiable trust-region optimizers, surface measurement and fusion schemes, and raycasting, without sacrificing accuracy. This amalgamation of dense SLAM with computational graphs enables us to backprop all the way from 3D maps to 2D pixels, opening up new possibilities in gradient-based learning for SLAM. TL;DR: We leverage the power of automatic differentiation frameworks to make dense SLAM differentiable.


title: Pricing Economic Dispatch with AC Power Flow via Local Multipliers and Conic Relaxation

abstract: We analyze pricing mechanisms in electricity markets with AC power flow equations that define a nonconvex feasible set for the economic dispatch problem. Specifically, we consider two possible pricing schemes. The first among these prices are derived from Lagrange multipliers that satisfy Karush-Kuhn-Tucker conditions for local optimality of the nonconvex market clearing problem. The second is derived from optimal dual multipliers of the convex semidefinite programming (SDP) based relaxation of the market clearing problem. Relationships between these prices, their revenue adequacy and market equilibrium properties are derived and compared. The SDP prices are shown to equal distribution locational marginal prices derived with second-order conic relaxations of power flow equations over radial distribution networks. We illustrate our theoretical findings through numerical experiments.


title: Generalized Planar Feynman Diagrams: Collections

abstract: Tree-level Feynman diagrams in a cubic scalar theory can be given a metric such that each edge has a length. The space of metric trees is made out of orthants joined where a tree degenerates. Here we restrict to planar trees since each degeneration of a tree leads to a single planar neighbor. Amplitudes are computed as an integral over the space of metrics where edge lengths are Schwinger parameters. In this work we propose that a natural generalization of Feynman diagrams is provided by what are known as metric tree arrangements. These are collections of metric trees subject to a compatibility condition on the metrics. We introduce the notion of planar collections of Feynman diagrams and argue that using planarity one can generate all planar collections starting from any one. Moreover, we identify a canonical initial collection for all $n$. Generalized $k=3$ biadjoint amplitudes, introduced by Early, Guevara, Mizera, and one of the authors, are easily computed as an integral over the space of metrics of planar collections of Feynman diagrams.


title: Classical Quantum Optimization with Neural Network Quantum States

abstract: The classical simulation of quantum systems typically requires exponential resources. Recently, the introduction of a machine learning-based wavefunction ansatz has led to the ability to solve the quantum many-body problem in regimes that had previously been intractable for existing exact numerical methods. Here, we demonstrate the utility of the variational representation of quantum states based on artificial neural networks for performing quantum optimization. We show empirically that this methodology achieves high approximation ratio solutions with polynomial classical computing resources for a range of instances of the Maximum Cut (MaxCut) problem whose solutions have been encoded into the ground state of quantum many-body systems up to and including 256 qubits.


title: Strong Generators in Dperf(X) for Schemes with a Separator

abstract: This paper extends the result from Amnon Neeman regarding strong generators in Dperf(X), from X being a quasicompact, separated scheme to X being quasicompact, quasiseparated scheme that admits a separator. Neeman's result states a necessary and sufficient condition for Dperf(X) being regular. Together with being proper over a noetherian commutative ring, those conditions give an interesting description for when an R-linear functor H is representable.


title: Towards efficient density functional theory calculations without self-interaction: The Fermi-L\"owdin orbital self-interaction correction

abstract: The Fermi-L\"owdin orbital (FLO) approach to the Perdew-Zunger self-interaction correction (PZ-SIC) to density functional theory (DFT) is described and an improved approach to the problem of optimizing the Fermi-orbitals in order to minimize the DFT-SIC total energy is introduced. To illustrate the use of the FLO-SIC method, results are given for several applications involving problems where self-interaction errors are pronounced.


title: Microscopic derivation of the Bekenstein-Hawking entropy for Schwarzschild black holes

abstract: In this paper, we successfully derive the Bekenstein-Hawking entropy for Schwarzschild black holes in various dimensions by using a non-trivial phase space. It is appealing to notice that the thermodynamics of a Schwarzschild black hole actually behaves like that of a $1$-dimensional quantum mechanical system. Our result suggests that black hole should be viewed as a system with the equation of state $P=\rho$, and it also suggests that a holographic stage should exist in the early universe.


title: A Useful Taxonomy for Adversarial Robustness of Neural Networks

abstract: Adversarial attacks and defenses are currently active areas of research for the deep learning community. A recent review paper divided the defense approaches into three categories; gradient masking, robust optimization, and adversarial example detection. We divide gradient masking and robust optimization differently: (1) increasing intra-class compactness and inter-class separation of the feature vectors improves adversarial robustness, and (2) marginalization or removal of non-robust image features also improves adversarial robustness. By reframing these topics differently, we provide a fresh perspective that provides insight into the underlying factors that enable training more robust networks and can help inspire novel solutions. In addition, there are several papers in the literature of adversarial defenses that claim there is a cost for adversarial robustness, or a trade-off between robustness and accuracy but, under this proposed taxonomy, we hypothesis that this is not universal. We follow up on our taxonomy with several challenges to the deep learning research community that builds on the connections and insights in this paper.


title: Learning One-Clock Timed Automata

abstract: We present an algorithm for active learning of deterministic timed automata with a single clock. The algorithm is within the framework of Angluin's $L^*$ algorithm and inspired by existing work on the active learning of symbolic automata. Due to the need of guessing for each transition whether it resets the clock, the algorithm is of exponential complexity in the size of the learned automata. Before presenting this algorithm, we propose a simpler version where the teacher is assumed to be smart in the sense of being able to provide the reset information. We show that this simpler setting yields a polynomial complexity of the learning process. Both of the algorithms are implemented and evaluated on a collection of randomly generated examples. We furthermore demonstrate the simpler algorithm on the functional specification of the TCP protocol.


title: Continuous Control Set Nonlinear Model Predictive Control of Reluctance Synchronous Machines

abstract: In this paper we describe the design and implementation of a current controller for a reluctance synchronous machine based on continuous set nonlinear model predictive control. A computationally efficient grey box model of the flux linkage map is employed in a tracking formulation which is implemented using the high-performance framework for nonlinear model predictive control acados. The resulting controller is validated in simulation and deployed on a dSPACE real-time system connected to a physical reluctance synchronous machine. Experimental results are presented where the proposed implementation can reach sampling times in the range typical for electrical drives and can achieve large improvements in terms of control performance with respect to state-of-the-art classical control strategies.


title: Feature Selection and Extraction for Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have been a latest hot research topic in data science, due to the fact that they use the ubiquitous data structure graphs as the underlying elements for constructing and training neural networks. In a GNN, each node has numerous features associated with it. The entire task (for example, classification, or clustering) utilizes the features of the nodes to make decisions, at node level or graph level. In this paper, (1) we extend the feature selection algorithm presented in via Gumbel Softmax to GNNs. We conduct a series of experiments on our feature selection algorithms, using various benchmark datasets: Cora, Citeseer and Pubmed. (2) We implement a mechanism to rank the extracted features. We demonstrate the effectiveness of our algorithms, for both feature selection and ranking. For the Cora dataset, (1) we use the algorithm to select 225 features out of 1433 features. Our experimental results demonstrate their effectiveness for the same classification problem. (2) We extract features such that they are linear combinations of the original features, where the coefficients for each extracted features are non-negative and sum up to one. We propose an algorithm to rank the extracted features in the sense that when using them for the same classification problem, the accuracy goes down gradually for the extracted features within the rank 1 - 50, 51 - 100, 100 - 150, and 151 - 200.


title: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

abstract: Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP). The effectiveness of transfer learning has given rise to a diversity of approaches, methodology, and practice. In this paper, we explore the landscape of transfer learning techniques for NLP by introducing a unified framework that converts all text-based language problems into a text-to-text format. Our systematic study compares pre-training objectives, architectures, unlabeled data sets, transfer approaches, and other factors on dozens of language understanding tasks. By combining the insights from our exploration with scale and our new ``Colossal Clean Crawled Corpus'', we achieve state-of-the-art results on many benchmarks covering summarization, question answering, text classification, and more. To facilitate future work on transfer learning for NLP, we release our data set, pre-trained models, and code.


title: Electric Oscillations Generated by Fluctuation Cooper Pairs

abstract: A short review of the history and the contemporary numerical calculations of the operation of an electronic device for generation of electric oscillations by negative differential conductivity of a supercooled below the critical temperature superconductor. The superconductor is cooled below the critical temperature at applied small constant electric field, which keeps the superconductor in normal state. To simulate the device operation, beforehand analytical expressions for the conductivity of nano-structured superconductors supercooled below the critical temperature in electric field are used. The numerical analysis meant to alleviate the development of a device shows that the region of negative differential conductivity of the current voltage characteristics leads to generation of electric oscillations. The study of layered high temperature superconductors and radiated electromagnetic waves in space will be an important problem of the future space technology.


title: Machine Learning for Scent: Learning Generalizable Perceptual Representations of Small Molecules

abstract: Predicting the relationship between a molecule's structure and its odor remains a difficult, decades-old task. This problem, termed quantitative structure-odor relationship (QSOR) modeling, is an important challenge in chemistry, impacting human nutrition, manufacture of synthetic fragrance, the environment, and sensory neuroscience. We propose the use of graph neural networks for QSOR, and show they significantly out-perform prior methods on a novel data set labeled by olfactory experts. Additional analysis shows that the learned embeddings from graph neural networks capture a meaningful odor space representation of the underlying relationship between structure and odor, as demonstrated by strong performance on two challenging transfer learning tasks. Machine learning has already had a large impact on the senses of sight and sound. Based on these early results with graph neural networks for molecular properties, we hope machine learning can eventually do for olfaction what it has already done for vision and hearing.


title: Barnes-Ismagilov integrals and hypergeometric functions of the complex field

abstract: We examine a family ${}_pG_{q}^{\mathbb C}\big[\genfrac{}{}{0pt}{}{(a)}{(b)};z\big]$ of integrals of Mellin-Barnes type over the space ${\mathbb Z}\times {\mathbb R}$, such functions $G$ naturally arise in representation theory of the Lorentz group. We express ${}_pG_{q}^{\mathbb C}(z)$ as quadratic expressions in the generalized hypergeometric functions ${}_{p}F_{q-1}$ and discuss further properties of the functions ${}_pG_{q}^{\mathbb C}(z)$.