title: An Auxiliary Task for Learning Nuclei Segmentation in 3D Microscopy Images

abstract: Segmentation of cell nuclei in microscopy images is a prevalent necessity in cell biology. Especially for three-dimensional datasets, manual segmentation is prohibitively time-consuming, motivating the need for automated methods. Learning-based methods trained on pixel-wise ground-truth segmentations have been shown to yield state-of-the-art results on 2d benchmark image data of nuclei, yet a respective benchmark is missing for 3d image data. In this work, we perform a comparative evaluation of nuclei segmentation algorithms on a database of manually segmented 3d light microscopy volumes. We propose a novel learning strategy that boosts segmentation accuracy by means of a simple auxiliary task, thereby robustly outperforming each of our baselines. Furthermore, we show that one of our baselines, the popular three-label model, when trained with our proposed auxiliary task, outperforms the recent StarDist-3D. As an additional, practical contribution, we benchmark nuclei segmentation against nuclei detection, i.e. the task of merely pinpointing individual nuclei without generating respective pixel-accurate segmentations. For learning nuclei detection, large 3d training datasets of manually annotated nuclei center points are available. However, the impact on detection accuracy caused by training on such sparse ground truth as opposed to dense pixel-wise ground truth has not yet been quantified. To this end, we compare nuclei detection accuracy yielded by training on dense vs. sparse ground truth. Our results suggest that training on sparse ground truth yields competitive nuclei detection rates.


title: The VIRUS-P Exploration of Nearby Galaxies (VENGA): The stellar populations and assembly of NGC 2903's bulge, bar, and outer disc

abstract: We study the stellar populations and assembly of the nearby spiral galaxy NGC 2903's bulge, bar, and outer disc using the VIRUS-P Exploration of Nearby Galaxies IFS survey. We observe NGC 2903 with a spatial resolution of 185 pc using the Mitchell Spectrograph's 4.25 arcsec fibres at the 2.7 Harlan J. Smith telescope. Bulge-bar-disc decomposition on the 2MASS Ks-band image of NGC 2903 shows that it has ~6%, 6%, and 88%, of its stellar mass in the bulge, bar, and outer disc, respectively, and its bulge has a low Sersic index of ~0.27, suggestive of a disky bulge. We perform stellar population synthesis and find that the outer disc has 46% of its mass in stars >5 Gyr, 48% in stars between 1 and 5 Gyr, and <10% in younger stars. Its stellar bar has 65% of its mass in ages 1-5 Gyr and has metallicities similar to the outer disc, suggestive of the evolutionary picture where the bar forms from disc material. Its bulge is mainly composed of old high-metallicity stars though it also has a small fraction of young stars. We find enhanced metallicity in the spiral arms and central region, tracing areas of high star formation as seen in the Halpha map. These results are consistent with the idea that galaxies of low bulge-to-total mass ratio and low bulge Sersic index like NGC 2903 has not had a recent major merger event, but has instead grown mostly through minor mergers and secular processes.


title: Harvest-and-Opportunistically-Relay: Analyses on Transmission Outage and Covertness

abstract: For enhancing transmission performance, privacy level and energy manipulating efficiency of wireless networks, this paper initiates a novel simultaneous wireless information and power transfer (SWIPT) full-duplex (FD) relaying protocol, termed harvest-and-opportunistically-relay (HOR). In the proposed HOR protocol, the relay can work opportunistically in either pure energy harvesting (PEH) or the FD SWIPT mode. Due to the FD characteristics, the dynamic fluctuation of R's residual energy is difficult to quantify and track. To solve this problem, we apply a novel discrete-state Markov Chain (MC) method in which the practical finite-capacity energy storage is considered. Furthermore, to improve the privacy level of the proposed HOR relaying system, covert transmission performance analysis is developed and investigated, where closed-form expressions of optimal detection threshold and minimum detection error probability are derived. Last but not least, with the aid of stationary distribution of the MC, closed-form expression of transmission outage probability is calculated, based on which transmission outage performance is analyzed. Numerical results have validated the correctness of analyses on transmission outage and covert communication. The impacts of key system parameters on the performance of transmission outage and covert communication are given and discussed. Based on mathematical analysis and numerical results, it is fair to say that the proposed HOR model is able to not only reliably enhance the transmission performance via smartly managing residual energy but also efficiently improve the privacy level of the legitimate transmission party via dynamically adjust the optimal detection threshold.


title: Slices of groupoids are group-like

abstract: Given a category, one may construct slices of it. That is, one builds a new category whose objects are the morphisms from the category with a fixed codomain and morphisms certain commutative triangles. If the category is a groupoid, so that every morphism is invertible, then its slices are (connected) groupoids. We give a number of constructions that show how slices of groupoids have properties even closer to those of groups than the groupoids they come from. These include natural notions of kernels and coset spaces.


title: Microlensing Analysis for the gravitational lens systems SDSS0924+0219, Q1355-2257, and SDSS1029+2623

abstract: We use spectroscopic observations of the gravitationally lensed systems SDSS0924+0219(BC), Q1355-2257(AB), and SDSS1029+2623(BC) to analyze microlensing and dust extinction in the observed components. We detect chromatic microlensing effects in the continuum and microlensing in the broad emission line profiles of the systems SDSS0924+0219(BC), and Q1355-2257(AB). Using magnification maps to simulate microlensing and modeling the emitting region as a Gaussian intensity profile with size $r_s \propto \lambda ^p$, we obtain the probability density functions for a logarithmic size prior at $\lambda_{rest-frame}=3533$ {\AA}. In the case of SDSS0924+0219, we obtain: $r_s = 4^{+3}_{-2}$ $\sqrt{M/M_{\odot}}$ light-days (at $1 \sigma$), which is larger than the range of other estimates, and $p = 0.8 \pm 0.2$ (at $1 \sigma$), which is smaller than predicted by the thin disk theory, but still in agreement with previous results. In the case of Q1355-2257 we obtain (at $1 \sigma$): $r_s = 3.6^{+3.0}_{-1.6}$ $\sqrt{M/M_{\odot}}$ light-days, which is also larger than the theoretical prediction, and $p = 2.0 \pm 0.7$ that is in agreement with the theory within errors. SDSS1029+2326 spectra show evidence of extinction, probably produced by a galaxy in the vicinity of image C. Fitting an extinction curve to the data we estimate $\Delta E \sim 0.2$ in agreement with previous results. We found no evidence of microlensing for this system.


title: Learning Implicit Generative Models with Theoretical Guarantees

abstract: We propose a \textbf{uni}fied \textbf{f}ramework for \textbf{i}mplicit \textbf{ge}nerative \textbf{m}odeling (UnifiGem) with theoretical guarantees by integrating approaches from optimal transport, numerical ODE, density-ratio (density-difference) estimation and deep neural networks. First, the problem of implicit generative learning is formulated as that of finding the optimal transport map between the reference distribution and the target distribution, which is characterized by a totally nonlinear Monge-Amp\`{e}re equation. Interpreting the infinitesimal linearization of the Monge-Amp\`{e}re equation from the perspective of gradient flows in measure spaces leads to the continuity equation or the McKean-Vlasov equation. We then solve the McKean-Vlasov equation numerically using the forward Euler iteration, where the forward Euler map depends on the density ratio (density difference) between the distribution at current iteration and the underlying target distribution. We further estimate the density ratio (density difference) via deep density-ratio (density-difference) fitting and derive explicit upper bounds on the estimation error. Experimental results on both synthetic datasets and real benchmark datasets support our theoretical findings and demonstrate the effectiveness of UnifiGem.


title: Representation of Reinforcement Learning Policies in Reproducing Kernel Hilbert Spaces

abstract: We propose a general framework for policy representation for reinforcement learning tasks. This framework involves finding a low-dimensional embedding of the policy on a reproducing kernel Hilbert space (RKHS). The usage of RKHS based methods allows us to derive strong theoretical guarantees on the expected return of the reconstructed policy. Such guarantees are typically lacking in black-box models, but are very desirable in tasks requiring stability. We conduct several experiments on classic RL domains. The results confirm that the policies can be robustly embedded in a low-dimensional space while the embedded policy incurs almost no decrease in return.


title: Hopf algebra of multi-decorated rooted forests, free matching Rota-Baxter algebras and Gr\"obner-Shirshov bases

abstract: Recent advances in stochastic PDEs, Hopf algebras of typed trees and integral equations have inspired the study of algebraic structures with replicating operations. To understand their algebraic and combinatorial nature, we first use rooted forests with multiple decoration sets to construct free Hopf algebras with multiple Hochschild 1-cocycle conditions. Applying the universal property of the underlying operated algebras and the method of Gr\"obner-Shirshov bases, we then construct free objects in the category of matching Rota-Baxter algebras which is a generalization of Rota-Baxter algebras to allow multiple Rota-Baxter operators. Finally the free matching Rota-Baxter algebras are equipped with a cocycle Hopf algebra structure.


title: Model of damping and anisotropy at elevated temperatures: application to granular FePt films

abstract: Understanding the damping mechanism in finite size systems and its dependence on temperature is a critical step in the development of magnetic nanotechnologies. In this work, nano-sized materials are modeled via atomistic spin dynamics, the damping parameter being extracted from Ferromagnetic Resonance (FMR) simulations applied for FePt systems, generally used for heat-assisted magnetic recording media (HAMR). We find that the damping increases rapidly close to Tc and the effect is enhanced with decreasing system size, which is ascribed to scattering at the grain boundaries. Additionally, FMR methods provide the temperature dependence of both damping and the anisotropy, important for the development of HAMR. Semi-analytical calculations show that, in the presence of a grain size distribution, the FMR linewidth can decrease close to the Curie temperature due to a loss of inhomogeneous line broadening. Although FePt has been used in this study, the results presented in the current work are general and valid for any ferromagnetic material.


title: Scale setting for $N_f=3+1$ QCD

abstract: We present the scale setting for a new set of gauge configurations generated with $N_f=3+1$ Wilson quarks with a non-perturbatively determined clover coefficient in a massive O($a$) improvement scheme. The three light quarks are degenerate, with the sum of their masses being equal to its value in nature and the charm quark has its physical mass. We use open boundary conditions in time direction to avoid the problem of topological freezing at small lattice spacings and twisted-mass reweighting for improved stability of the simulations. The decoupling of charm at low energy allows us to set the scale by measuring the value of the low-energy quantity $t_0^\star/a^2$, which is the flow scale $t_0$ at our mass point, and comparing it to an $N_f=2+1$ result in physical units. We present the details of the algorithmic setup and tuning procedure and give the bare parameters of ensembles with two lattice spacings a=0.054 fm and a=0.043 fm. We discuss finite volume effects and lattice artifacts and present physical results for the charmonium spectrum. In particular the hyperfine splitting between the $\eta_c$ and $J/\psi$ mesons agrees very well with its physical value.


title: Quantum scrambling and the growth of mutual information

abstract: Quantum information scrambling refers to the loss of local recoverability of quantum information, which has found widespread attention from high energy physics to quantum computing. In the present analysis we propose a possible starting point for the development of a comprehensive framework for the thermodynamics of scrambling. To this end, we prove that the growth of entanglement as quantified by the mutual information is lower bounded by the time-dependent change of Out-Of-Time-Ordered Correlator. We further show that the rate of increase of the mutual information can be upper bounded by the sum of local entropy productions, and the exchange entropy arising from the flow of information between separate partitions of a quantum system. Our results are illustrated for the ion trap system, that was recently used to verify information scrambling in an experiment, and for the Sachdev-Ye-Kitaev model.


title: Differentiable Forward and Backward Fixed-Point Iteration Layers

abstract: Recently, several studies proposed methods to utilize some classes of optimization problems in designing deep neural networks to encode constraints that conventional layers cannot capture. However, these methods are still in their infancy and require special treatments, such as analyzing the KKT condition, for deriving the backpropagation formula. In this paper, we propose a new layer formulation called the fixed-point iteration (FPI) layer that facilitates the use of more complicated operations in deep networks. The backward FPI layer is also proposed for backpropagation, which is motivated by the recurrent back-propagation (RBP) algorithm. But in contrast to RBP, the backward FPI layer yields the gradient by a small network module without an explicit calculation of the Jacobian. In actual applications, both the forward and backward FPI layers can be treated as nodes in the computational graphs. All components in the proposed method are implemented at a high level of abstraction, which allows efficient higher-order differentiations on the nodes. In addition, we present two practical methods of the FPI layer, FPI_NN and FPI_GD, where the update operations of FPI are a small neural network module and a single gradient descent step based on a learnable cost function, respectively. FPI\_NN is intuitive, simple, and fast to train, while FPI_GD can be used for efficient training of energy networks that have been recently studied. While RBP and its related studies have not been applied to practical examples, our experiments show the FPI layer can be successfully applied to real-world problems such as image denoising, optical flow, and multi-label classification.


title: Differential Evolution with Reversible Linear Transformations

abstract: Differential evolution (DE) is a well-known type of evolutionary algorithms (EA). Similarly to other EA variants it can suffer from small populations and loose diversity too quickly. This paper presents a new approach to mitigate this issue: We propose to generate new candidate solutions by utilizing reversible linear transformation applied to a triplet of solutions from the population. In other words, the population is enlarged by using newly generated individuals without evaluating their fitness. We assess our methods on three problems: (i) benchmark function optimization, (ii) discovering parameter values of the gene repressilator system, (iii) learning neural networks. The empirical results indicate that the proposed approach outperforms vanilla DE and a version of DE with applying differential mutation three times on all testbeds.


title: The Effect of Data Augmentation on Classification of Atrial Fibrillation in Short Single-Lead ECG Signals Using Deep Neural Networks

abstract: Cardiovascular diseases are the most common cause of mortality worldwide. Detection of atrial fibrillation (AF) in the asymptomatic stage can help prevent strokes. It also improves clinical decision making through the delivery of suitable treatment such as, anticoagulant therapy, in a timely manner. The clinical significance of such early detection of AF in electrocardiogram (ECG) signals has inspired numerous studies in recent years, of which many aim to solve this task by leveraging machine learning algorithms. ECG datasets containing AF samples, however, usually suffer from severe class imbalance, which if unaccounted for, affects the performance of classification algorithms. Data augmentation is a popular solution to tackle this problem. In this study, we investigate the impact of various data augmentation algorithms, e.g., oversampling, Gaussian Mixture Models (GMMs) and Generative Adversarial Networks (GANs), on solving the class imbalance problem. These algorithms are quantitatively and qualitatively evaluated, compared and discussed in detail. The results show that deep learning-based AF signal classification methods benefit more from data augmentation using GANs and GMMs, than oversampling. Furthermore, the GAN results in circa $3\%$ better AF classification accuracy in average while performing comparably to the GMM in terms of f1-score.


title: On the excitation of the $2^+_1$ state in $^{12}$C in the $(e,e'\gamma)$ reaction

abstract: The excitation of the carbon $2^+$ state at 4.439 MeV by $70-150$ MeV electron impact and its subsequent decay to the ground state by photon emission is described within the distorted-wave Born approximation. The transition densities are obtained from the nuclear quasiparticle phonon model. The photon angular distributions are compared with earlier results and with experiment, including the influence of bremsstrahlung. Predictions for spin asymmetries in the case of polarized electron impact are also made.


title: Run-and-tumble bacteria slowly approaching the diffusive regime

abstract: The run-and-tumble (RT) dynamics followed by bacterial swimmers gives rise first to a ballistic motion due to their persistence, and later, through consecutive tumbles, to a diffusive process. Here we investigate how long it takes for a dilute swimmer suspension to reach the diffusive regime as well as what is the amplitude of the deviations from the diffusive dynamics. A linear time dependence of the mean-squared displacement (MSD) is insufficient to characterize diffusion and thus we also focus on the excess kurtosis of the displacement distribution. Four swimming strategies are considered: (i) the conventional RT model with complete reorientation after tumbling, (ii) the case of partial reorientation, characterized by a distribution of tumbling angles, (iii) a run-and-reverse model with rotational diffusion, and (iv) a RT particle where the tumbling rate depends on the stochastic concentration of an internal protein. By analyzing the associated kinetic equations for the probability density function and simulating the models, we find that for models (ii), (iii), and (iv) the relaxation to diffusion can take much longer than the mean time between tumble events, evidencing the existence of large tails in the particle displacements. Moreover, the excess kurtosis can assume large positive values. In model (ii) it is possible for some distributions of tumbling angles that the MSD reaches a linear time dependence but, still, the dynamics remains non-Gaussian for long times. This is also the case in model (iii) for small rotational diffusivity. For all models, the long-time diffusion coefficients are also obtained. The theoretical approach, which relies on eigenvalue and angular Fourier expansions of the van Hove function, is in excellent agreement with the simulations.


title: Convergence Rates of Accelerated Markov Gradient Descent with Applications in Reinforcement Learning

abstract: Motivated by broad applications in machine learning, we study the popular accelerated stochastic gradient descent (ASGD) algorithm for solving (possibly nonconvex) optimization problems. We characterize the finite-time performance of this method when the gradients are sampled from Markov processes, and hence biased and dependent from time step to time step; in contrast, the analysis in existing work relies heavily on the stochastic gradients being independent and sometimes unbiased. Our main contributions show that under certain (standard) assumptions on the underlying Markov chain generating the gradients, ASGD converges at the nearly the same rate with Markovian gradient samples as with independent gradient samples. The only difference is a logarithmic factor that accounts for the mixing time of the Markov chain. One of the key motivations for this study are complicated control problems that can be modeled by a Markov decision process and solved using reinforcement learning. We apply the accelerated method to several challenging problems in the OpenAI Gym and Mujoco, and show that acceleration can significantly improve the performance of the classic temporal difference learning and REINFORCE algorithms.


title: Recovering missing data in coherent diffraction imaging

abstract: In coherent diffraction imaging (CDI) experiments, the intensity of the scattered wave impinging on an object is measured on an array of detectors. This signal can be interpreted as the square of the modulus of the Fourier transform of the unknown scattering density. A beam-stop obstructs the forward scattered wave and, hence, the modulus Fourier data from a neighborhood of k=0 cannot be measured. In this note, we describe a linear method for recovering this unmeasured modulus Fourier data from the measured values and an estimate of the support of the image's autocorrelation function without consideration of phase retrieval. We analyze the conditioning of this problem, which grows exponentially with the modulus of the maximum spatial frequency not measured, and the effects of noise.


title: Four-loop QCD MOM beta functions from the three-loop vertices at the symmetric point

abstract: For the first time, we compute three-loop contributions to all triple vertices in QCD at the symmetric point. The analytic results are obtained in massless QCD with an arbitrary color group in the Landau gauge. All new loop integrals are expressed in terms of harmonic polylogarithms at the sixth root of unity. These corrections allow us to derive expressions for the four-loop QCD beta function in a set of momentum-subtraction schemes.


title: Equal Risk Pricing and Hedging of Financial Derivatives with Convex Risk Measures

abstract: In this paper, we consider the problem of equal risk pricing and hedging in which the fair price of an option is the price that exposes both sides of the contract to the same level of risk. Focusing for the first time on the context where risk is measured according to convex risk measures, we establish that the problem reduces to solving independently the writer and the buyer's hedging problem with zero initial capital. By further imposing that the risk measures decompose in a way that satisfies a Markovian property, we provide dynamic programming equations that can be used to solve the hedging problems for both the case of European and American options. All of our results are general enough to accommodate situations where the risk is measured according to a worst-case risk measure as is typically done in robust optimization. Our numerical study illustrates the advantages of equal risk pricing over schemes that only account for a single party, pricing based on quadratic hedging (i.e. $\epsilon$-arbitrage pricing), or pricing based on a fixed equivalent martingale measure (i.e. Black-Scholes pricing). In particular, the numerical results confirm that when employing an equal risk price both the writer and the buyer end up being exposed to risks that are more similar and on average smaller than what they would experience with the other approaches.


title: Anomalous low-energy properties in amorphous solids and the interplay of electric and elastic interactions of tunneling two-level systems

abstract: Tunneling two-level systems (TLSs), generic to amorphous solids, dictate the low-temperature properties of amorphous solids and dominate noise and decoherence in quantum nano-devices. The properties of the TLSs are generally described by the phenomenological standard tunneling model. Yet, significant deviations from the predictions of this model found experimentally suggest the need for a more precise model in describing TLSs. Here we show that the temperature dependence of the sound velocity, dielectric constant, specific heat, and thermal conductivity, can be explained using an energy-dependent TLS density of states reduced at low energies due to TLS-TLS interactions. This reduction is determined by the ratio between the strengths of the TLS-TLS interactions and the random potential, which is enhanced in systems with dominant electric dipolar interactions.


title: I love your chain mail! Making knights smile in a fantasy game world: Open-domain goal-oriented dialogue agents

abstract: Dialogue research tends to distinguish between chit-chat and goal-oriented tasks. While the former is arguably more naturalistic and has a wider use of language, the latter has clearer metrics and a straightforward learning signal. Humans effortlessly combine the two, for example engaging in chit-chat with the goal of exchanging information or eliciting a specific response. Here, we bridge the divide between these two domains in the setting of a rich multi-player text-based fantasy environment where agents and humans engage in both actions and dialogue. Specifically, we train a goal-oriented model with reinforcement learning against an imitation-learned ``chit-chat'' model with two approaches: the policy either learns to pick a topic or learns to pick an utterance given the top-K utterances from the chit-chat model. We show that both models outperform an inverse model baseline and can converse naturally with their dialogue partner in order to achieve goals.


title: Targeted display advertising: the case of preferential attachment

abstract: An average adult is exposed to hundreds of digital advertisements daily (https://www.mediadynamicsinc.com/uploads/files/PR092214-Note-only-150-Ads-2mk.pdf), making the digital advertisement industry a classic example of a big-data-driven platform. As such, the ad-tech industry relies on historical engagement logs (clicks or purchases) to identify potentially interested users for the advertisement campaign of a partner (a seller who wants to target users for its products). The number of advertisements that are shown for a partner, and hence the historical campaign data available for a partner depends upon the budget constraints of the partner. Thus, enough data can be collected for the high-budget partners to make accurate predictions, while this is not the case with the low-budget partners. This skewed distribution of the data leads to "preferential attachment" of the targeted display advertising platforms towards the high-budget partners. In this paper, we develop "domain-adaptation" approaches to address the challenge of predicting interested users for the partners with insufficient data, i.e., the tail partners. Specifically, we develop simple yet effective approaches that leverage the similarity among the partners to transfer information from the partners with sufficient data to cold-start partners, i.e., partners without any campaign data. Our approaches readily adapt to the new campaign data by incremental fine-tuning, and hence work at varying points of a campaign, and not just the cold-start. We present an experimental analysis on the historical logs of a major display advertising platform (https://www.criteo.com/). Specifically, we evaluate our approaches across 149 partners, at varying points of their campaigns. Experimental results show that the proposed approaches outperform the other "domain-adaptation" approaches at different time points of the campaigns.


title: Multilayer Routing and Resource Assignment in Spatial Channel Networks (SCNs): Oriented Toward the Massive SDM Era

abstract: In the past few decades, optical transport networks (OTNs) have undergone significant evolution, from the earliest wavelength-division multiplexing (WDM) OTNs to elastic optical networks (EONs) and later to space-division multiplexing (SDM) OTNs, to address the continuous growth of Internet traffic. By 2024, Pbps-level OTNs are expected, far exceeding the capacity limit of single-mode fibers. The massive SDM era is on the horizon. In this context, newly designed OTNs called spatial channel networks (SCNs), which achieve high cost efficiency by means of practical hierarchical optical cross-connects, have recently been proposed. However, the evolution of OTNs will simultaneously present challenges related to resource allocation in networking. For instance, with the evolution from WDM-OTNs to EONs, the resource allocation problem was transformed from the routing and wavelength assignment (RWA) problem to the routing and spectrum assignment (RSA) problem due to the additionally introduced constraint of spectrum contiguity. Similarly, specially designed algorithms are also expected to be essential for addressing the resource allocation problem in SCNs. In this paper, we define this new problem as the routing, spatial channel, and spectrum assignment (RSCSA) problem. We propose an integer linear programming (ILP) model and a heuristic algorithm to solve the RSCSA problem. We examine the performance of the proposed approaches via simulation experiments. The results show that both proposed approaches are effective in finding the optimal solutions or solutions close to the lower bounds. To the best of our knowledge, this is the first work to focus on the problem of resource allocation in SCNs.


title: Low Rank Saddle Free Newton: A Scalable Method for Stochastic Nonconvex Optimization

abstract: In modern deep learning, highly subsampled stochastic approximation (SA) methods are preferred to sample average approximation (SAA) methods because of large data sets as well as generalization properties. Additionally, due to perceived costs of forming and factorizing Hessians, second order methods are not used for these problems. In this work we motivate the extension of Newton methods to the SA regime, and argue for the use of the scalable low rank saddle free Newton (LRSFN) method, which avoids forming the Hessian in favor of making a low rank approximation. Additionally, LRSFN can facilitate fast escape from indefinite regions leading to better optimization solutions. In the SA setting, iterative updates are dominated by stochastic noise, and stability of the method is key. We introduce a continuous time stability analysis framework, and use it to demonstrate that stochastic errors for Newton methods can be greatly amplified by ill-conditioned Hessians. The LRSFN method mitigates this stability issue via Levenberg-Marquardt damping. However, generally the analysis shows that second order methods with stochastic Hessian and gradient information may need to take small steps, unlike in deterministic problems. Numerical results show that LRSFN can escape indefinite regions that other methods have issues with; and even under restrictive step length conditions, LRSFN can outperform popular first order methods on large scale deep learning tasks in terms of generalizability for equivalent computational work.


title: Ill-Posedness and Optimization Geometry for Nonlinear Neural Network Training

abstract: In this work we analyze the role nonlinear activation functions play at stationary points of dense neural network training problems. We consider a generic least squares loss function training formulation. We show that the nonlinear activation functions used in the network construction play a critical role in classifying stationary points of the loss landscape. We show that for shallow dense networks, the nonlinear activation function determines the Hessian nullspace in the vicinity of global minima (if they exist), and therefore determines the ill-posedness of the training problem. Furthermore, for shallow nonlinear networks we show that the zeros of the activation function and its derivatives can lead to spurious local minima, and discuss conditions for strict saddle points. We extend these results to deep dense neural networks, showing that the last activation function plays an important role in classifying stationary points, due to how it shows up in the gradient from the chain rule.


title: Understanding the effects of artifacts on automated polyp detection and incorporating that knowledge via learning without forgetting

abstract: Survival rates for colorectal cancer are higher when polyps are detected at an early stage and can be removed before they develop into malignant tumors. Automated polyp detection, which is dominated by deep learning based methods, seeks to improve early detection of polyps. However, current efforts rely heavily on the size and quality of the training datasets. The quality of these datasets often suffers from various image artifacts that affect the visibility and hence, the detection rate. In this work, we conducted a systematic analysis to gain a better understanding of how artifacts affect automated polyp detection. We look at how six different artifact classes, and their location in an image, affect the performance of a RetinaNet based polyp detection model. We found that, depending on the artifact class, they can either benefit or harm the polyp detector. For instance, bubbles are often misclassified as polyps, while specular reflections inside of a polyp region can improve detection capabilities. We then investigated different strategies, such as a learning without forgetting framework, to leverage artifact knowledge to improve automated polyp detection. Our results show that such models can mitigate some of the harmful effects of artifacts, but require more work to significantly improve polyp detection capabilities.


title: Grammar Filtering For Syntax-Guided Synthesis

abstract: Programming-by-example (PBE) is a synthesis paradigm that allows users to generate functions by simply providing input-output examples. While a promising interaction paradigm, synthesis is still too slow for realtime interaction and more widespread adoption. Existing approaches to PBE synthesis have used automated reasoning tools, such as SMT solvers, as well as works applying machine learning techniques. At its core, the automated reasoning approach relies on highly domain specific knowledge of programming languages. On the other hand, the machine learning approaches utilize the fact that when working with program code, it is possible to generate arbitrarily large training datasets. In this work, we propose a system for using machine learning in tandem with automated reasoning techniques to solve Syntax Guided Synthesis (SyGuS) style PBE problems. By preprocessing SyGuS PBE problems with a neural network, we can use a data driven approach to reduce the size of the search space, then allow automated reasoning-based solvers to more quickly find a solution analytically. Our system is able to run atop existing SyGuS PBE synthesis tools, decreasing the runtime of the winner of the 2019 SyGuS Competition for the PBE Strings track by 47.65% to outperform all of the competing tools.


title: Understanding and Optimizing Packed Neural Network Training for Hyper-Parameter Tuning

abstract: As neural networks are increasingly employed in machine learning practice, how to efficiently share limited training resources among a diverse set of model training tasks becomes a crucial issue. To achieve better utilization of the shared resources, we explore the idea of jointly training multiple neural network models on a single GPU in this paper. We realize this idea by proposing a primitive, called pack. We further present a comprehensive empirical study of pack and end-to-end experiments that suggest significant improvements for hyperparameter tuning. The results suggest: (1) packing two models can bring up to 40% performance improvement over unpacked setups for a single training step and the improvement increases when packing more models; (2) the benefit of the pack primitive largely depends on a number of factors including memory capacity, chip architecture, neural network structure, and batch size; (3) there exists a trade-off between packing and unpacking when training multiple neural network models on limited resources; (4) a pack-aware Hyperband is up to 2.7x faster than the original Hyperband, with this improvement growing as memory size increases and subsequently the density of models packed.


title: Weakly-Supervised Disentanglement Without Compromises

abstract: Intelligent agents should be able to learn useful representations by observing changes in their environment. We model such observations as pairs of non-i.i.d. images sharing at least one of the underlying factors of variation. First, we theoretically show that only knowing how many factors have changed, but not which ones, is sufficient to learn disentangled representations. Second, we provide practical algorithms that learn disentangled representations from pairs of images without requiring annotation of groups, individual factors, or the number of factors that have changed. Third, we perform a large-scale empirical study and show that such pairs of observations are sufficient to reliably learn disentangled representations on several benchmark data sets. Finally, we evaluate our learned representations and find that they are simultaneously useful on a diverse suite of tasks, including generalization under covariate shifts, fairness, and abstract reasoning. Overall, our results demonstrate that weak supervision enables learning of useful disentangled representations in realistic scenarios.


title: Meta-learning framework with applications to zero-shot time-series forecasting

abstract: Can meta-learning discover generic ways of processing time series (TS) from a diverse dataset so as to greatly improve generalization on new TS coming from different datasets? This work provides positive evidence to this using a broad meta-learning framework which we show subsumes many existing meta-learning algorithms. Our theoretical analysis suggests that residual connections act as a meta-learning adaptation mechanism, generating a subset of task-specific parameters based on a given TS input, thus gradually expanding the expressive power of the architecture on-the-fly. The same mechanism is shown via linearization analysis to have the interpretation of a sequential update of the final linear layer. Our empirical results on a wide range of data emphasize the importance of the identified meta-learning mechanisms for successful zero-shot univariate forecasting, suggesting that it is viable to train a neural network on a source TS dataset and deploy it on a different target TS dataset without retraining, resulting in performance that is at least as good as that of state-of-practice univariate forecasting models.


title: Detecting the anisotropic astrophysical gravitational wave background in the presence of shot noise through cross-correlations

abstract: The spatial and temporal discreteness of gravitational wave sources leads to shot noise that may, in some regimes, swamp any attempts at measuring the anisotropy of the gravitational wave background. Cross-correlating a gravitational wave background map with a sufficiently dense galaxy survey can alleviate this issue, and potentially recover some of the underlying properties of the gravitational wave background. We quantify the shot noise level and we explicitly show that cross-correlating the gravitational wave background and a galaxy catalog improves the chances of a first detection of the background anisotropy with a gravitational wave observatory operating in the frequency range (10Hz,100Hz), given sufficient sensitivity.

categories: astro-ph.CO astro-ph.GA astro-ph.IM gr-qc hep-th


title: Derived category of moduli of pointed curves -- II

abstract: We show that the moduli space of stable rational curves with $n$ marked points has a full exceptional collection equivariant under the action of the symmetric group $S_n$ permuting the marked points. In particular, its K-group with integer coefficients is a permutation $S_n$-lattice.


title: Session-Based Recommender Systems for Action Selection in GUI Test Generation

abstract: Test generation at the graphical user interface (GUI) level has proven to be an effective method to reveal faults. When doing so, a test generator has to repeatably decide what action to execute given the current state of the system under test (SUT). This problem of action selection usually involves random choice, which is often referred to as monkey testing. Some approaches leverage other techniques to improve the overall effectiveness, but only a few try to create human-like actions---or even entire action sequences. We have built a novel session-based recommender system that can guide test generation. This allows us to mimic past user behavior, reaching states that require complex interactions. We present preliminary results from an empirical study, where we use GitHub as the SUT. These results show that recommender systems appear to be well-suited for action selection, and that the approach can significantly contribute to the improvement of GUI-based test generation.


title: Geometry from divergence functions and complex structures

abstract: Motivated by the geometrical structures of quantum mechanics, we introduce an almost-complex structure $J$ on the product $M\times M$ of any parallelizable statistical manifold $M$. Then, we use $J$ to extract a pre-symplectic form and a metric-like tensor on $M\times M$ from a divergence function. These tensors may be pulled back to $M$, and we compute them in the case of an N-dimensional symplex with respect to the Kullback-Leibler relative entropy, and in the case of (a suitable unfolding space of) the manifold of faithful density operators with respect to the von Neumann-Umegaki relative entropy.


title: Sparse and Smooth: improved guarantees for Spectral Clustering in the Dynamic Stochastic Block Model

abstract: In this paper, we analyse classical variants of the Spectral Clustering (SC) algorithm in the Dynamic Stochastic Block Model (DSBM). Existing results show that, in the relatively sparse case where the expected degree grows logarithmically with the number of nodes, guarantees in the static case can be extended to the dynamic case and yield improved error bounds when the DSBM is sufficiently smooth in time, that is, the communities do not change too much between two time steps. We improve over these results by drawing a new link between the sparsity and the smoothness of the DSBM: the more regular the DSBM is, the more sparse it can be, while still guaranteeing consistent recovery. In particular, a mild condition on the smoothness allows to treat the sparse case with bounded degree. We also extend these guarantees to the normalized Laplacian, and as a by-product of our analysis, we obtain to our knowledge the best spectral concentration bound available for the normalized Laplacian of matrices with independent Bernoulli entries.


title: Long-lived circular Rydberg states of laser-cooled Rubidium atoms in a cryostat

abstract: The exquisite properties of Rydberg levels make them particularly appealing for emerging quantum technologies. The lifetime of low-angular-momentum laser-accessible levels is however limited to a few $100\,\mu\mathrm{s}$ by optical transitions and microwave blackbody radiation (BBR) induced transfers at room temperature. A considerable improvement would be obtained with the few $10\,\mathrm{ms}$ lifetime of circular Rydberg levels in a cryogenic environment reducing the BBR temperature. We demonstrate the preparation of long-lived circular Rydberg levels of laser-cooled Rubidium atoms in a cryostat. We observe a $3.7\,\mathrm{ms}$ lifetime for the circular level of principal quantum number $n=52$. By monitoring the transfers between adjacent circular levels, we estimate in situ the microwave BBR temperature to be $(11\pm 2)\,\mathrm{K}$. The measured atomic coherence time ($270\,\mu\mathrm{s}$) is limited here only by technical magnetic field fluctuations. This work opens interesting perspectives for quantum simulation and sensing with cold circular Rydberg atoms.


title: A Massive Young Runaway Star in W49 North

abstract: We analyzed high angular resolution 45.5 GHz images of the W49 North massive star forming region obtained in 1998 and 2016 with the Very Large Array. Most of the ultracompact HII regions show no detectable changes over the time interval of the observations. However, subcomponents B1, B2, G2a and G2c have increased its peak flux densities by values in the range of 3.8 to 21.4 \%. Most interestingly, the cometary region C clearly shows proper motions that at the distance of the region are equivalent to a velocity of 76$\pm$6 km s$^{-1}$ in the plane of the sky. We interpret this region as the ionized bowshock produced by a runaway O6 ZAMS star that was ejected from the eastern edge of Welch's ring about 6,400 years ago.


title: From Thermodynamic Sufficiency to Information Causality

abstract: The principle called information causality has been used to deduce Tsirelson's bound. In this paper we derive information causality from monotonicity of divergence and relate it to more basic principles related to measurements on thermodynamic systems. This principle is more fundamental in the sense that it can be formulated for both unipartite systems and multipartite systems while information causality is only defined for multipartite systems. Thermodynamic sufficiency is a strong condition that put severe restrictions to shape of the state space to an extend that we conjecture that under very weak regularity conditions it can be used to deduce the complex Hilbert space formalism of quantum theory. Since the notion of sufficiency is relevant for all convex optimization problems there are many examples where it does not apply.


title: Physics of Beer Tapping -- Lower vs. Upper Bottle

abstract: "Beer tapping" is a well known prank where a bottle of carbonised liquid strikes another bottle of carbonised liquid from above, with the usual result that the lower bottle foams over whereas the upper one does not. Though the physics leading to the foaming process in the lower bottle has been investigated and well documented, no explanation to date has been provided why the upper bottle produces little to no foam. In this article we describe the reasons for the entirely different behaviours of the two bottles.


title: MDLdroid: a ChainSGD-reduce Approach to Mobile Deep Learning for Personal Mobile Sensing

abstract: Personal mobile sensing is fast permeating our daily lives to enable activity monitoring, healthcare and rehabilitation. Combined with deep learning, these applications have achieved significant success in recent years. Different from conventional cloud-based paradigms, running deep learning on devices offers several advantages including data privacy preservation and low-latency response for both model inference and update. Since data collection is costly in reality, Google's Federated Learning offers not only complete data privacy but also better model robustness based on multiple user data. However, personal mobile sensing applications are mostly user-specific and highly affected by environment. As a result, continuous local changes may seriously affect the performance of a global model generated by Federated Learning. In addition, deploying Federated Learning on a local server, e.g., edge server, may quickly reach the bottleneck due to resource constraint and serious failure by attacks. Towards pushing deep learning on devices, we present MDLdroid, a novel decentralized mobile deep learning framework to enable resource-aware on-device collaborative learning for personal mobile sensing applications. To address resource limitation, we propose a ChainSGD-reduce approach which includes a novel chain-directed Synchronous Stochastic Gradient Descent algorithm to effectively reduce overhead among multiple devices. We also design an agent-based multi-goal reinforcement learning mechanism to balance resources in a fair and efficient manner. Our evaluations show that our model training on off-the-shelf mobile devices achieves 2x to 3.5x faster than single-device training, and 1.5x faster than the master-slave approach.


title: One from many: Estimating a function of many parameters

abstract: Difficult it is to formulate achievable sensitivity bounds for quantum multiparameter estimation. Consider a special case, one parameter from many: many parameters of a process are unknown; estimate a specific linear combination of these parameters without having the ability to control any of the parameters. Superficially similar to single-parameter estimation, the problem retains genuinely multiparameter aspects. Geometric reasoning demonstrates the conditions, necessary and sufficient, for saturating the fundamental and attainable quantum-process bound in this context.


title: Maximality of reversible gate sets

abstract: In order to better understand the structure of closed collections of reversible gates, we investigate the lattice of closed sets and the maximal members of this lattice. In this note, we find the maximal closed sets over a finite alphabet. We find that for odd sized alphabets, there are a finite number of maximal closed sets, while for the even case we have a countable infinity, almost all of which are related to an alternating permutations. We then extend to other forms of closure for reversible gates, ancilla and borrow closure. Here we find some structural results, including some examples of maximal closed sets.


title: Solutions of $BC_{n}$ Type of WDVV Equations

abstract: We give a family of solutions of Witten-Dijkgraaf-Verlinde-Verlinde equations in $n$-dimensional space. It is defined in terms of $BC_{n}$ root system and $n+2$ independent multiplicity parameters. We also apply these solutions to define some ${\mathcal N}=4$ supersymmetric mechanical systems.


title: Oblivious Data for Fairness with Kernels

abstract: We investigate the problem of algorithmic fairness in the case where sensitive and non-sensitive features are available and one aims to generate new, `oblivious', features that closely approximate the non-sensitive features, and are only minimally dependent on the sensitive ones. We study this question in the context of kernel methods. We analyze a relaxed version of the Maximum Mean Discrepancy criterion which does not guarantee full independence but makes the optimization problem tractable. We derive a closed-form solution for this relaxed optimization problem and complement the result with a study of the dependencies between the newly generated features and the sensitive ones. Our key ingredient for generating such oblivious features is a Hilbert-space-valued conditional expectation, which needs to be estimated from data. We propose a plug-in approach and demonstrate how the estimation errors can be controlled. While our techniques help reduce the bias, we would like to point out that no post-processing of any dataset could possibly serve as an alternative to well-designed experiments.


title: Parton Distribution Functions of the Charged Pion Within The xFitter Framework

abstract: We present the first open-source analysis of parton distribution functions (PDFs) of charged pions using xFitter, an open-source QCD fit framework to facilitate PDF extraction and analyses. Our calculations are implemented at next-to-leading order (NLO) using APPLgrids generated by MCFM generator. Using currently available Drell-Yan and photon production data, we find the valence distribution is well constrained; however, the considered data are not sensitive enough to unambiguously determine sea and gluon distributions. Fractions of momentum carried by the valence, sea and gluon components are discussed, and we compare with the results of JAM collaboration and the GRV group.


title: Subsampling Winner Algorithm for Feature Selection in Large Regression Data

abstract: Feature selection from a large number of covariates (aka features) in a regression analysis remains a challenge in data science, especially in terms of its potential of scaling to ever-enlarging data and finding a group of scientifically meaningful features. For example, to develop new, responsive drug targets for ovarian cancer, the actual false discovery rate (FDR) of a practical feature selection procedure must also match the target FDR. The popular approach to feature selection, when true features are sparse, is to use a penalized likelihood or a shrinkage estimation, such as a LASSO, SCAD, Elastic Net, or MCP procedure (call them benchmark procedures). We present a different approach using a new subsampling method, called the Subsampling Winner algorithm (SWA). The central idea of SWA is analogous to that used for the selection of US national merit scholars. SWA uses a "base procedure" to analyze each of the subsamples, computes the scores of all features according to the performance of each feature from all subsample analyses, obtains the "semifinalist" based on the resulting scores, and then determines the "finalists," i.e., the most important features. Due to its subsampling nature, SWA can scale to data of any dimension in principle. The SWA also has the best-controlled actual FDR in comparison with the benchmark procedures and the randomForest, while having a competitive true-feature discovery rate. We also suggest practical add-on strategies to SWA with or without a penalized benchmark procedure to further assure the chance of "true" discovery. Our application of SWA to the ovarian serous cystadenocarcinoma specimens from the Broad Institute revealed functionally important genes and pathways, which we verified by additional genomics tools. This second-stage investigation is essential in the current discussion of the proper use of P-values.


title: RHLE: Modular Deductive Verification of Relational $\forall\exists$ Properties

abstract: Hoare-style program logics are a popular and effective technique for software verification. Relational program logics are an instance of this approach that enables reasoning about relationships between the execution of two or more programs. Existing relational program logics have focused on verifying that all runs of a collection of programs do not violate a specified relational behavior. Several important relational properties, including refinement and noninterference, do not fit into this category, as they also mandate the existence of specific desirable executions. This paper presents RHLE, a logic for verifying these sorts of relational $\forall\exists$ properties. Key to our approach is a novel form of function specification that employs a variant of ghost variables to ensure that valid implementations exhibit certain behaviors. We have used a program verifier based on RHLE to verify a diverse set of relational $\forall\exists$ properties drawn from the literature.


title: Some $A$-spectral radius inequalities for $A$-bounded Hilbert space operators

abstract: Let $r_A(T)$ denote the $A$-spectral radius of an operator $T$ which is bounded with respect to the seminorm induced by a positive operator $A$ on a complex Hilbert space $\mathcal{H}$. In this paper, we aim to establish some $A$-spectral radius inequalities for products, sums and commutators of $A$-bounded operators. Moreover, under suitable conditions on $T$ and $A$ we show that \begin{equation*} r_A\left( \sum_{k=0}^{+\infty}c_{k}T^{k}\right) \leq \sum_{k=0}^{+\infty}|c_{k}|\left[r_A(T)\right]^{k}, \end{equation*} where $c_k$ are complex numbers for all $k\in \mathbb{N}$.


title: MUSE observations of NGC330 in the Small Magellanic Cloud. Helium abundance of bright main sequence stars

abstract: We present observations of the most bright main sequence stars in the Small Magellanic Cloud stellar cluster NGC330 obtained with the integral field spectrograph MUSE@VLT. The use of this valuable instrument allows us to study both photometric and spectroscopic properties of stellar populations of this young star cluster. The photometric data provide us a precise color magnitude diagram, which seems to support the presence of two stellar populations of ages of $\sim$ 18 Myr and $\sim$ 30 Myr assuming a metallicity of Z = 0.002. Thanks to the spectroscopic data, we derive helium abundance of 10 main sequence stars within the effective radius Reff= 20" of NGC330, thus leading to an estimation of $\epsilon(He)$ = 10.93 $\pm$ 0.05 (1$\sigma$ ). The helium elemental abundances of stars likely belonging to the two possible stellar populations, do not show differences or dichotomy within the uncertainties. Thus, our results suggest that the two stellar populations of NGC330, if they exist, share similar original He abundances. If we consider stellar rotation velocity in our analysis, a coeval (30 Myr) stellar population, experiencing different values of rotation, cannot be excluded. In this case, the mean helium abundance < $\epsilon(He)$ >rot obtained in our analysis is 11.00 $\pm$ 0.05 dex. We also verified that possible NLTE effects cannot be identified with our analysis because of the spectral resolution and they are within our derived abundance He uncertainties. Moreover, the analysis of the He abundance as a function of the distance from the cluster center of the observed stars do not show any correlation.


title: Precision Gravity Tests and the Einstein Equivalence Principle

abstract: General Relativity is today the best theory of gravity addressing a wide range of phenomena. Our understanding of physical laws, from cosmology to local scales, cannot be properly formulated without taking into account it. It is based on one of the most fundamental principles of Nature, the Equivalence Principle, which represents the core of the Einstein theory of gravity. The confirmation of its validity at different scales and in different contexts represents one of the main challenges of modern physics both from the theoretical and the experimental points of view. A major issue related to this principle is the fact that we actually do not know if it is valid at quantum level. Furthermore, recent progress on relativistic theories of gravity have to take into account new issues like Dark Matter and Dark Energy, as well as the validity of fundamental principles like local Lorentz and position invariance. Experiments allow to set stringent constraints on well established symmetry laws, on the physics beyond the Standard Model of particles and interactions, and on General Relativity and its possible extensions. In this review, we discuss precision tests of gravity in General Relativity and alternative theories and their relation with the Equivalence Principle. In the first part, we discuss the Einstein Equivalence Principle according to its weak and strong formulation. We recall some basic topics of General Relativity and the necessity of its extension. Some models of modified gravity are presented in some details. The second part of the paper is devoted to the experimental tests of the Equivalence Principle in its weak formulation. We present the results and methods used in high-precision experiments, and discuss the potential and prospects for future experimental tests.


title: Probing approach of the Parton-Hadron-String Dynamics in production for K$_S$ mesons

abstract: Heavy ion collisions provide a unique probe of the quark-gluon plasma properties. The role of partonic degrees of freedom in p-Pb collisions at $\sqrt{s_{NN}}$ = 5 TeV by studying the production cross section is studied. Experimental observable like the number of K$_S$ mesons is sensitive to the kinematic properties of the reaction. Our results demonstrate the importance of angular distribution for the partonic degrees of freedom in hadronization process.


title: Domain Embedded Multi-model Generative Adversarial Networks for Image-based Face Inpainting

abstract: Prior knowledge of face shape and structure plays an important role in face inpainting. However, traditional face inpainting methods mainly focus on the generated image resolution of the missing portion without consideration of the special particularities of the human face explicitly and generally produce discordant facial parts. To solve this problem, we present a domain embedded multi-model generative adversarial model for inpainting of face images with large cropped regions. We firstly represent only face regions using the latent variable as the domain knowledge and combine it with the non-face parts textures to generate high-quality face images with plausible contents. Two adversarial discriminators are finally used to judge whether the generated distribution is close to the real distribution or not. It can not only synthesize novel image structures but also explicitly utilize the embedded face domain knowledge to generate better predictions with consistency on structures and appearance. Experiments on both CelebA and CelebA-HQ face datasets demonstrate that our proposed approach achieved state-of-the-art performance and generates higher quality inpainting results than existing ones.


title: Commensurated subgroups and micro-supported actions

abstract: Let $\Gamma$ be a finitely generated group and $X$ be a minimal compact $\Gamma$-space. We assume that the $\Gamma$-action is micro-supported, i.e. for every non-empty open subset $U \subseteq X$, there is an element of $\Gamma$ acting non-trivially on $U$ and trivially on the complement $X \setminus U$. We show that, under suitable assumptions, the existence of certain commensurated subgroups in $\Gamma$ yields strong restrictions on the dynamics of the $\Gamma$-action: the space $X$ has compressible open subsets, and it is an almost $\Gamma$-boundary. Those properties yield in turn restrictions on the structure of $\Gamma$: $\Gamma$ is neither amenable nor residually finite. Among the applications, we show that the (alternating subgroup of the) topological full group associated to a minimal and expansive Cantor action of a finitely generated amenable group has no commensurated subgroups other than the trivial ones. Similarly, every commensurated subgroup of a finitely generated branch group is commensurate to a normal subgroup; the latter assertion relies on an appendix by Dominik Francoeur, and generalizes a result of Phillip Wesolek on finitely generated just-infinite branch groups. Other applications concern discrete groups acting on the circle, and the centralizer lattice of non-discrete totally disconnected locally compact (tdlc) groups. Our results rely, in an essential way, on recent results on the structure of tdlc groups, on the dynamics of their micro-supported actions, and on the notion of uniformly recurrent subgroups.


title: Concrete method for recovering the Euler characteristic of quantum graphs

abstract: Trace formulas play a central role in the study of spectral geometry and in particular of quantum graphs. The basis of our work is the result by Kurasov which links the Euler characteristic $\chi$ of metric graphs to the spectrum of their standard Laplacian. These ideas were shown to be applicable even in an experimental context where only a finite number of eigenvalues from a physical realization of quantum graph can be measured. In the present work we analyse sufficient hypotheses which guarantee the successful recovery of $\chi$. We also study how to improve the efficiency of the method and in particular how to minimise the number of eigenvalues required. Finally, we compare our findings with numerical examples---surprisingly, just a few dozens of eigenvalues can be enough.


title: Universal Equivariant Multilayer Perceptrons

abstract: Group invariant and equivariant Multilayer Perceptrons (MLP), also known as Equivariant Networks, have achieved remarkable success in learning on a variety of data structures, such as sequences, images, sets, and graphs. Using tools from group theory, this paper proves the universality of a broad class of equivariant MLPs with a single hidden layer. In particular, it is shown that having a hidden layer on which the group acts regularly is sufficient for universal equivariance (invariance). A corollary is unconditional universality of equivariant MLPs for Abelian groups, such as CNNs with a single hidden layer. A second corollary is the universality of equivariant MLPs with a high-order hidden layer, where we give both group-agnostic bounds and means for calculating group-specific bounds on the order of hidden layer that guarantees universal equivariance (invariance).


title: Learning Autoencoders with Relational Regularization

abstract: A new algorithmic framework is proposed for learning autoencoders of data distributions. We minimize the discrepancy between the model and target distributions, with a \emph{relational regularization} on the learnable latent prior. This regularization penalizes the fused Gromov-Wasserstein (FGW) distance between the latent prior and its corresponding posterior, allowing one to flexibly learn a structured prior distribution associated with the generative model. Moreover, it helps co-training of multiple autoencoders even if they have heterogeneous architectures and incomparable latent spaces. We implement the framework with two scalable algorithms, making it applicable for both probabilistic and deterministic autoencoders. Our relational regularized autoencoder (RAE) outperforms existing methods, $e.g.$, the variational autoencoder, Wasserstein autoencoder, and their variants, on generating images. Additionally, our relational co-training strategy for autoencoders achieves encouraging results in both synthesis and real-world multi-view learning tasks. The code is at https://github.com/HongtengXu/ Relational-AutoEncoders.


title: Improving the GP 2 Compiler

abstract: GP 2 is an experimental programming language based on graph transformation rules which aims to facilitate program analysis and verification. Writing efficient programs in such a language is hard because graph matching is expensive, however GP 2 addresses this problem by providing rooted rules which, under mild conditions, can be matched in constant time using the GP 2 to C compiler. In this report, we document various improvements made to the compiler; most notably the introduction of node lists to improve iteration performance for destructive programs, meaning that binary DAG recognition by reduction need only take linear time where the previous implementation required quadratic time.


title: Bergman spaces under maps of monomial type

abstract: For appropriate domains $\Omega_{1}, \Omega_{2}$ we consider mappings $\Phi_{\mathbf A}:\Omega_{1}\to\Omega_{2}$ of monomial type. We obtain an orthogonal decomposition of the Bergman space $\mathcal A^{2}(\Omega_{1})$ into finitely many closed subspaces indexed by characters of a finite Abelian group associated to the mapping $\Phi_{\mathbf A}$. We then show that each subspace is isomorphic to a weighted Bergman space on $\Omega_{2}$. This leads to a formula for the Bergman kernel on $\Omega_{1}$ as a sum of weighted Bergman kernels on $\Omega_{2}$


title: Slightly supercritical percolation on nonamenable graphs I: The distribution of finite clusters

abstract: We study the distribution of finite clusters in slightly supercritical ($p \downarrow p_c$) Bernoulli bond percolation on transitive nonamenable graphs, proving in particular that if $G$ is a transitive nonamenable graph satisfying the $L^2$ boundedness condition ($p_c<p_{2\to 2}$) and $K$ denotes the cluster of the origin then there exists $\delta>0$ such that $$ \mathbf{P}_p(n \leq |K| < \infty) \asymp n^{-1/2} \exp\left[ -\Theta \Bigl( |p-p_c|^2 n\Bigr) \right] $$ and \[ \mathbf{P}_p(r \leq \operatorname{Rad}(K) < \infty) \asymp r^{-1} \exp\left[ -\Theta \Bigl( |p-p_c| r\Bigr) \right] \] for every $p\in (p_c-\delta,p_c+\delta)$ and $n,r\geq 1$, where all implicit constants depend only on $G$. We deduce in particular that the critical exponents $\gamma'$ and $\Delta'$ describing the rate of growth of the moments of a finite cluster as $p \downarrow p_c$ take their mean-field values of $1$ and $2$ respectively. These results apply in particular to Cayley graphs of nonelementary hyperbolic groups, to products with trees, and to transitive graphs of spectral radius $\rho<1/2$. In particular, every finitely generated nonamenable group has a Cayley graph to which these results apply. They are new for graphs that are not trees. The corresponding facts are yet to be understood on $\mathbb{Z}^d$ even for $d$ very large. In a second paper in this series, we will apply these results to study the geometric and spectral properties of infinite slightly supercritical clusters in the same setting.


title: Data augmentation with Mobius transformations

abstract: Data augmentation has led to substantial improvements in the performance and generalization of deep models, and remain a highly adaptable method to evolving model architectures and varying amounts of data---in particular, extremely scarce amounts of available training data. In this paper, we present a novel method of applying Mobius transformations to augment input images during training. Mobius transformations are bijective conformal maps that generalize image translation to operate over complex inversion in pixel space. As a result, Mobius transformations can operate on the sample level and preserve data labels. We show that the inclusion of Mobius transformations during training enables improved generalization over prior sample-level data augmentation techniques such as cutout and standard crop-and-flip transformations, most notably in low data regimes.


title: iqiyi Submission to ActivityNet Challenge 2019 Kinetics-700 challenge: Hierarchical Group-wise Attention

abstract: In this report, the method for the iqiyi submission to the task of ActivityNet 2019 Kinetics-700 challenge is described. Three models are involved in the model ensemble stage: TSN, HG-NL and StNet. We propose the hierarchical group-wise non-local (HG-NL) module for frame-level features aggregation for video classification. The standard non-local (NL) module is effective in aggregating frame-level features on the task of video classification but presents low parameters efficiency and high computational cost. The HG-NL method involves a hierarchical group-wise structure and generates multiple attention maps to enhance performance. Basing on this hierarchical group-wise structure, the proposed method has competitive accuracy, fewer parameters and smaller computational cost than the standard NL. For the task of ActivityNet 2019 Kinetics-700 challenge, after model ensemble, we finally obtain an averaged top-1 and top-5 error percentage 28.444% on the test set.


title: Extended Stochastic Gradient MCMC for Large-Scale Bayesian Variable Selection

abstract: Stochastic gradient Markov chain Monte Carlo (MCMC) algorithms have received much attention in Bayesian computing for big data problems, but they are only applicable to a small class of problems for which the parameter space has a fixed dimension and the log-posterior density is differentiable with respect to the parameters. This paper proposes an extended stochastic gradient MCMC lgoriathm which, by introducing appropriate latent variables, can be applied to more general large-scale Bayesian computing problems, such as those involving dimension jumping and missing data. Numerical studies show that the proposed algorithm is highly scalable and much more efficient than traditional MCMC algorithms. The proposed algorithms have much alleviated the pain of Bayesian methods in big data computing.


title: On the connected components of fractal cubes

abstract: We show that a fractal cube $F$ in $\mathbb R^3$ may have an uncountable set $Q$ of connected components $K_\alpha$ neither of which is contained in any plane, whereas the set $Q$ is a totally disconnected self-similar subset of the hyperspace $C(\mathbb R^3)$, isomorphic to a Cantor set.


title: Temporal Segmentation of Surgical Sub-tasks through Deep Learning with Multiple Data Sources

abstract: Many tasks in robot-assisted surgeries (RAS) can be represented by finite-state machines (FSMs), where each state represents either an action (such as picking up a needle) or an observation (such as bleeding). A crucial step towards the automation of such surgical tasks is the temporal perception of the current surgical scene, which requires a real-time estimation of the states in the FSMs. The objective of this work is to estimate the current state of the surgical task based on the actions performed or events occurred as the task progresses. We propose Fusion-KVE, a unified surgical state estimation model that incorporates multiple data sources including the Kinematics, Vision, and system Events. Additionally, we examine the strengths and weaknesses of different state estimation models in segmenting states with different representative features or levels of granularity. We evaluate our model on the JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS), as well as a more complex dataset involving robotic intra-operative ultrasound (RIOUS) imaging, created using the da Vinci Xi surgical system. Our model achieves a superior frame-wise state estimation accuracy up to 89.4%, which improves the state-of-the-art surgical state estimation models in both JIGSAWS suturing dataset and our RIOUS dataset.


title: One-sided reflected Brownian motions and the KPZ fixed point

abstract: We consider the system of one-sided reflected Brownian motions which is in variational duality with Brownian last passage percolation. We show that it has integrable transition probabilities, expressed in terms of Hermite polynomials and hitting times of exponential random walks, and that it converges in the 1:2:3 scaling limit to the KPZ fixed point, the scaling invariant Markov process defined in [MQR17] and believed to govern the long time large scale fluctuations for all models in the KPZ universality class. Brownian last passage percolation was shown recently in [DOV18] to converge to the Airy sheet (or directed landscape), defined there as a strong limit of a functional of the Airy line ensemble. This establishes the variational formula for the KPZ fixed point in terms of the Airy sheet.


title: Geometric Dataset Distances via Optimal Transport

abstract: The notion of task similarity is at the core of various machine learning paradigms, such as domain adaptation and meta-learning. Current methods to quantify it are often heuristic, make strong assumptions on the label sets across the tasks, and many are architecture-dependent, relying on task-specific optimal parameters (e.g., require training a model on each dataset). In this work we propose an alternative notion of distance between datasets that (i) is model-agnostic, (ii) does not involve training, (iii) can compare datasets even if their label sets are completely disjoint and (iv) has solid theoretical footing. This distance relies on optimal transport, which provides it with rich geometry awareness, interpretable correspondences and well-understood properties. Our results show that this novel distance provides meaningful comparison of datasets, and correlates well with transfer learning hardness across various experimental settings and datasets.


title: Subspace Capsule Network

abstract: Convolutional neural networks (CNNs) have become a key asset to most of fields in AI. Despite their successful performance, CNNs suffer from a major drawback. They fail to capture the hierarchy of spatial relation among different parts of an entity. As a remedy to this problem, the idea of capsules was proposed by Hinton. In this paper, we propose the SubSpace Capsule Network (SCN) that exploits the idea of capsule networks to model possible variations in the appearance or implicitly defined properties of an entity through a group of capsule subspaces instead of simply grouping neurons to create capsules. A capsule is created by projecting an input feature vector from a lower layer onto the capsule subspace using a learnable transformation. This transformation finds the degree of alignment of the input with the properties modeled by the capsule subspace. We show that SCN is a general capsule network that can successfully be applied to both discriminative and generative models without incurring computational overhead compared to CNN during test time. Effectiveness of SCN is evaluated through a comprehensive set of experiments on supervised image classification, semi-supervised image classification and high-resolution image generation tasks using the generative adversarial network (GAN) framework. SCN significantly improves the performance of the baseline models in all 3 tasks.


title: BERT-of-Theseus: Compressing BERT by Progressive Module Replacing

abstract: In this paper, we propose a novel model compression approach to effectively compress BERT by progressive module replacing. Our approach first divides the original BERT into several modules and builds their compact substitutes. Then, we randomly replace the original modules with their substitutes to train the compact modules to mimic the behavior of the original modules. We progressively increase the probability of replacement through the training. In this way, our approach brings a deeper level of interaction between the original and compact models. Compared to the previous knowledge distillation approaches for BERT compression, our approach does not introduce any additional loss function. Our approach outperforms existing knowledge distillation approaches on GLUE benchmark, showing a new perspective of model compression.


title: Tilings with the Minimal Tile Property

abstract: A square tiling of the unit square is said to have the minimal tile property if the smallest tile can tile all the other tiles. We show that in such a tiling, the smallest tile cannot be too small.


title: SPN-CNN: Boosting Sensor-Based Source Camera Attribution With Deep Learning

abstract: We explore means to advance source camera identification based on sensor noise in a data-driven framework. Our focus is on improving the sensor pattern noise (SPN) extraction from a single image at test time. Where existing works suppress nuisance content with denoising filters that are largely agnostic to the specific SPN signal of interest, we demonstrate that a~deep learning approach can yield a more suitable extractor that leads to improved source attribution. A series of extensive experiments on various public datasets confirms the feasibility of our approach and its applicability to image manipulation localization and video source attribution. A critical discussion of potential pitfalls completes the text.


title: Towards Integrated Perception and Motion Planning with Distributionally Robust Risk Constraints

abstract: Safely deploying robots in uncertain and dynamic environments requires a systematic accounting of various risks, both within and across layers in an autonomy stack from perception to motion planning and control. Many widely used motion planning algorithms do not adequately incorporate inherent perception and prediction uncertainties, often ignoring them altogether or making questionable assumptions of Gaussianity. We propose a distributionally robust incremental sampling-based motion planning framework that explicitly and coherently incorporates perception and prediction uncertainties. We design output feedback policies and consider moment-based ambiguity sets of distributions to enforce probabilistic collision avoidance constraints under the worst-case distribution in the ambiguity set. Our solution approach, called Output Feedback Distributionally Robust $RRT^{*}$(OFDR-$RRT^{*})$, produces asymptotically optimal risk-bounded trajectories for robots operating in dynamic, cluttered, and uncertain environments, explicitly incorporating mapping and localization error, stochastic process disturbances, unpredictable obstacle motion, and uncertain obstacle locations. Numerical experiments illustrate the effectiveness of the proposed algorithm.


title: Intuitionistic Euler-Venn Diagrams (extended)

abstract: We present an intuitionistic interpretation of Euler-Venn diagrams with respect to Heyting algebras. In contrast to classical Euler-Venn diagrams, we treat shaded and missing zones differently, to have diagrammatic representations of conjunction, disjunction and intuitionistic implication. We present a cut-free sequent calculus for this language, and prove it to be sound and complete. Furthermore, we show that the rules of cut, weakening and contraction are admissible.


title: An Eulerian-Lagrangian discontinuous Galerkin method for transport problems and its application to nonlinear dynamics

abstract: We propose a new Eulerian-Lagrangian (EL) discontinuous Galerkin (DG) method. The method is designed as a generalization of the semi-Lagrangian (SL) DG method for linear advection problems proposed in [J. Sci. Comput. 73: 514-542, 2017], which is formulated based on an adjoint problem and tracing upstream cells by tracking characteristics curves highly accurately. In the SLDG method, depending on the velocity field, upstream cells could be of arbitrary shape. Thus, a more sophisticated approximation to sides of the upstream cells is required to get high order approximation. For example, quadratic-curved (QC) quadrilaterals were proposed to approximate upstream cells for a third-order spatial accuracy in a swirling deformation example. In this paper, for linear advection problems, we propose a more general formulation, named the ELDG method. The scheme is formulated based on a {\em modified} adjoint problem for which the upstream cells are always quadrilaterals, which avoids the need to use QC quadrilaterals in the SLDG algorithm. The newly proposed ELDG method can be viewed as a new general framework, in which both the classical Eulerian Runge-Kutta DG formulation and the SL DG formulation can fit in. Numerical results on linear transport problems, as well as the nonlinear Vlasov and incompressible Euler dynamics using the exponential RK time integrators, are presented to demonstrate the effectiveness of the ELDG method.

categories: math.NA cs.NA physics.comp-ph physics.flu-dyn


title: Resonant osmosis across active switchable membranes

abstract: To overcome the traditional paradigm of filtration, where separation is essentially performed upon steric sieving principles, we explore the concept of dynamic osmosis through active membranes. A partially permeable membrane presents a time-tuneable feature that changes the effective pore interaction with the solute and thus actively changes permeability with time. In general we find that slow flickering frequencies effectively decrease the osmotic pressure, and large flickering frequencies do not change it. In the presence of an asymmetric membrane, we find a resonant frequency where pumping of solute is performed and can be analyzed in terms of ratchet transport. We discuss and highlight the properties of this resonant osmotic transport. Furthermore, we show that dynamic osmosis allows to pump solute at the nanoscale using less energy than reverse osmosis. This opens new possibilities to build advanced filtration devices and design artificial ionic machinery.


title: Cellularity of generalized Schur algebras via Cauchy decomposition

abstract: We describe a generalization of Hashimoto and Kurano's Cauchy filtration for divided powers algebras. This filtration is then used to provide a cellular structure for generalized Schur algebras associated to an arbitrary cellular algebra. Applications to the cellularity of wreath product algebras $A \wr \mathfrak{S}_d$ are also considered.


title: A mathematical framework for raw counts of single-cell RNA-seq data analysis

abstract: Single-cell RNA-seq data are challenging because of the sparseness of the read counts, the tiny expression of many relevant genes, and the variability in the efficiency of RNA extraction for different cells. We consider a simple probabilistic model for read counts, based on a negative binomial distribution for each gene, modified by a cell-dependent coefficient interpreted as an extraction efficiency. We provide two alternative fast methods to estimate the model parameters, together with the probability that a cell results in zero read counts for a gene. This allows to measure genes co-expression and differential expression in a novel way.


title: How Does Gender Balance In Training Data Affect Face Recognition Accuracy?

abstract: Deep learning methods have greatly increased the accuracy of face recognition, but an old problem still persists: accuracy is usually higher for men than women. It is often speculated that lower accuracy for women is caused by under-representation in the training data. This work investigates female under-representation in the training data is truly the cause of lower accuracy for females on test data. Using a state-of-the-art deep CNN, three different loss functions, and two training datasets, we train each on seven subsets with different male/female ratios, totaling forty two trainings, that are tested on three different datasets. Results show that (1) gender balance in the training data does not translate into gender balance in the test accuracy, (2) the "gender gap" in test accuracy is not minimized by a gender-balanced training set, but by a training set with more male images than female images, and (3) training to minimize the accuracy gap does not result in highest female, male or average accuracy


title: Constraints on long range force from perihelion precession of planets in a gauged $L_e-L_{\mu,\tau}$ scenario

abstract: The standard model particles can be gauged in an anomaly free way by three possible gauge symmetries namely ${L_e-L_\mu}$, ${L_e-L_\tau}$, and ${L_\mu-L_\tau}$. Of these, ${L_e-L_\mu}$ and ${L_e-L_\tau}$ forces can mediate between the Sun and the planets and change the perihelion precession of planetary orbits. It is well known that a deviation from the $1/r^2$ Newtonian force can give rise to a perihelion advancement in the planetary orbit, for instance, as in the well known case of Einstein's gravity which was tested from the observation of the perihelion advancement of the Mercury. We consider the long range Yukawa potential which arises between the Sun and the planets if the mass of the gauge boson is $M_{Z^{\prime}}\leq \mathcal{O}(10^{-19})\rm {eV}$. We derive the formula of perihelion advancement for Yukawa type fifth force due to the mediation of such $U(1)_{L_e-L_{\mu,\tau}}$ gauge bosons. The perihelion advancement for Yukawa potential is proportional to the square of the semi major axis of the orbit for small $M_{Z^{\prime}}$, unlike GR, where it is largest for the nearest planet. However for higher values of $M_{Z^{\prime}}$, an exponential suppression of the perihelion advancement occurs. We take the observational limits for all planets for which the perihelion advancement is measured and we obtain the upper bound on the gauge boson coupling $g$ for all the planets. The Mars gives the stronger bound on $g$ for the mass range $\leq 10^{-19}\rm{eV}$ and we obtain the exclusion plot. This mass range of gauge boson can be a possible candidate of fuzzy dark matter whose effect can therefore be observed in the precession measurement of the planetary orbits.

categories: hep-ph astro-ph.EP astro-ph.HE gr-qc hep-th


title: Neurogenetics of the Human Adenosine Receptor Genes: Genetic Structures and Involvement in Brain Diseases

abstract: Adenosine receptors are G-protein-coupled receptors involved in a wide range of physiological and pathological phenomena in most mammalian systems. All four receptors are widely expressed in the central nervous system, where they modulate neurotransmitter release and neuronal plasticity. A large number of gene association studies have shown that common genetic variants of the adenosine receptors (encoded by the ADORA1, ADORA2A, ADORA2B and ADORA3 genes) have a neuroprotective or neurodegenerative role in neurologic/psychiatric diseases. New genetic studies of rare variants and few novel associations with depression or epilepsy subtypes have recently been reported. Here, we review the literature on the genetics of adenosine receptors in neurologic and/or psychiatric diseases in humans, and discuss perspectives for further genetic research. We also provide an update on the genetic structures of the four human adenosine receptor genes and their regulation - a topic that has not been extensively addressed. Our review emphasizes the importance of (i) better characterizing the genetics of adenosine receptor genes and (ii) understanding how these genes are regulated.


title: Singular doubly nonlocal elliptic problems with Choquard type critical growth nonlinearities

abstract: The theory of elliptic equations involving singular nonlinearities is well studied topic but the interaction of singular type nonlinearity with nonlocal nonlinearity in elliptic problems has not been investigated so far. In this article, we study the very singular and doubly nonlocal singular problem $(P_\lambda)$(See below). Firstly, we establish a very weak comparison principle and the optimal Sobolev regularity. Next using the critical point theory of non-smooth analysis and the geometry of the energy functional, we establish the global multiplicity of positive weak solutions.


title: Student/Teacher Advising through Reward Augmentation

abstract: Transfer learning is an important new subfield of multiagent reinforcement learning that aims to help an agent learn about a problem by using knowledge that it has gained solving another problem, or by using knowledge that is communicated to it by an agent who already knows the problem. This is useful when one wishes to change the architecture or learning algorithm of an agent (so that the new knowledge need not be built "from scratch"), when new agents are frequently introduced to the environment with no knowledge, or when an agent must adapt to similar but different problems. Great progress has been made in the agent-to-agent case using the Teacher/Student framework proposed by (Torrey and Taylor 2013). However, that approach requires that learning from a teacher be treated differently from learning in every other reinforcement learning context. In this paper, I propose a method which allows the teacher/student framework to be applied in a way that fits directly and naturally into the more general reinforcement learning framework by integrating the teacher feedback into the reward signal received by the learning agent. I show that this approach can significantly improve the rate of learning for an agent playing a one-player stochastic game; I give examples of potential pitfalls of the approach; and I propose further areas of research building on this framework.


title: Phase Retrieval for Partially Coherent Observations

abstract: Phase retrieval is in general a non-convex and non-linear task and the corresponding algorithms struggle with the issue of local minima. We consider the case where the measurement samples within typically very small and disconnected subsets are coherently linked to each other - which is a reasonable assumption for our objective of antenna measurements. Two classes of measurement setups are discussed which can provide this kind of extra information: multi-probe systems and holographic measurements with multiple reference signals. We propose several formulations of the corresponding phase retrieval problem. The simplest of these formulations poses a linear system of equations similar to an eigenvalue problem where a unique non-trivial null-space vector needs to be found. Accurate phase reconstruction for partially coherent observations is, thus, possible by a reliable solution process and with judgment of the solution quality. Under ideal, noise-free conditions, the required sampling density is less than two times the number of unknowns. Noise and other observation errors increase this value slightly. Simulations for Gaussian random matrices and for antenna measurement scenarios demonstrate that reliable phase reconstruction is possible with the presented approach.

categories: eess.SP cs.IT cs.NA math.IT math.NA math.OC physics.optics


title: A geometric proof of the Quasi-linearity of the water-waves system

abstract: In the first part of this paper we prove that the flow associated to the Burgers equation with a non local term of the form $\partial_x |D|^{\alpha-1} u$ fails to be uniformly continuous from bounded sets of $H^s({\mathbb D})$ to $C^0([0,T],H^s({\mathbb D}))$ for $T>0$, $s>\frac{1}{2}+2$, $0\leq \alpha <2$, ${\mathbb D}={\mathbb R} \ \text{or} \ {\mathbb T} $. Furthermore we show that the flow cannot be $C^1$ from bounded sets of $H^s({\mathbb D})$ to $C^0([0,T],H^{s-1+(\alpha-1)^+ +\epsilon}({\mathbb D}))$ for $\epsilon>0$. We generalize this result to a large class of nonlinear transport-dispersive equations in any dimension, that in particular contains the Whitham equation and the paralinearization of the water waves system with and without surface tension. The current result is optimal in the sense that for $\alpha=2$ and ${\mathbb D}={\mathbb T}$ the flow associated to the Benjamin-Ono equation is Lipschitz on function with $0$ mean value $H^s_0$. In the second part of this paper we apply this method to deduce the quasi-linearity of the water waves system, which is the main result of this paper.


title: Swampland, Trans-Planckian Censorship and Fine-Tuning Problem for Inflation: Tunnelling Wavefunction to the Rescue

abstract: The trans-Planckian censorship conjecture implies that single-field models of inflation require an extreme fine-tuning of the initial conditions due to the very low-scale of inflation. In this work, we show how a quantum cosmological proposal -- namely the tunneling wavefunction -- naturally provides the necessary initial conditions without requiring such fine-tunings. More generally, we show how the tunneling wavefunction can provide suitable initial conditions for hilltop inflation models, the latter being typically preferred by the swampland constraints.


title: On the Robustness of Face Recognition Algorithms Against Attacks and Bias

abstract: Face recognition algorithms have demonstrated very high recognition performance, suggesting suitability for real world applications. Despite the enhanced accuracies, robustness of these algorithms against attacks and bias has been challenged. This paper summarizes different ways in which the robustness of a face recognition algorithm is challenged, which can severely affect its intended working. Different types of attacks such as physical presentation attacks, disguise/makeup, digital adversarial attacks, and morphing/tampering using GANs have been discussed. We also present a discussion on the effect of bias on face recognition models and showcase that factors such as age and gender variations affect the performance of modern algorithms. The paper also presents the potential reasons for these challenges and some of the future research directions for increasing the robustness of face recognition models.


title: On paracomposition and change of variables in Paradifferential operators

abstract: In this paper we revisit the hypothesis needed to define the "paracomposition" operator, an analogue to the classic pull-back operation in the low regularity setting, first introduced by S. Alinhac in [3]. More precisely we do so in two directions. First we drop the diffeomorphism hypothesis. Secondly we give estimates in global Sobolev and Zygmund spaces. Thus we fully generalize Bony's classic paralinearasition theorem giving sharp estimates for composition in Sobolev and Zygmund spaces. In order to prove that the new class of operations benefits of symbolic calculus properties when composed by a paradifferential operator, we discuss the pull-back of pseudodifferential and paradifferential operators which then become Fourier Integral Operators. In this discussion we show that those Fourier Integral Operators obtained by pull-back are pseudodifferential or paradifferential operators if and only if they are pulled-back by a diffeomorphism that is a change of variable. We give a proof of the change of variables in paradifferential operators. Finally we study the cutoff defining paradifferential operators and it's stability by successive composition. It is known that the cutoff becomes worse after each composition, we give a slightly refined version of the cutoffs proposed by H\"ormander in [14] for which give an optimal estimate on the support of the cutoff after composition.