title: Degree-based Outlier Detection within IP Traffic Modelled as a Link Stream

abstract: This paper aims at precisely detecting and identifying anomalous events in IP traffic. To this end, we adopt the link stream formalism which properly captures temporal and structural features of the data. Within this framework, we focus on finding anomalous behaviours with respect to the degree of IP addresses over time. Due to diversity in IP profiles, this feature is typically distributed heterogeneously, preventing us to directly find anomalies. To deal with this challenge, we design a method to detect outliers as well as precisely identify their cause in a sequence of similar heterogeneous distributions. We apply it to several MAWI captures of IP traffic and we show that it succeeds in detecting relevant patterns in terms of anomalous network activity.


title: Cross-Lingual Training for Automatic Question Generation

abstract: Automatic question generation (QG) is a challenging problem in natural language understanding. QG systems are typically built assuming access to a large number of training instances where each instance is a question and its corresponding answer. For a new language, such training instances are hard to obtain making the QG problem even more challenging. Using this as our motivation, we study the reuse of an available large QG dataset in a secondary language (e.g. English) to learn a QG model for a primary language (e.g. Hindi) of interest. For the primary language, we assume access to a large amount of monolingual text but only a small QG dataset. We propose a cross-lingual QG model which uses the following training regime: (i) Unsupervised pretraining of language models in both primary and secondary languages and (ii) joint supervised training for QG in both languages. We demonstrate the efficacy of our proposed approach using two different primary languages, Hindi and Chinese. We also create and release a new question answering dataset for Hindi consisting of 6555 sentences.


title: Removing Rain in Videos: A Large-scale Database and A Two-stream ConvLSTM Approach

abstract: Rain removal has recently attracted increasing research attention, as it is able to enhance the visibility of rain videos. However, the existing learning based rain removal approaches for videos suffer from insufficient training data, especially when applying deep learning to remove rain. In this paper, we establish a large-scale video database for rain removal (LasVR), which consists of 316 rain videos. Then, we observe from our database that there exist the temporal correlation of clean content and similar patterns of rain across video frames. According to these two observations, we propose a two-stream convolutional long- and short- term memory (ConvLSTM) approach for rain removal in videos. The first stream is composed of the subnet for rain detection, while the second stream is the subnet of rain removal that leverages the features from the rain detection subnet. Finally, the experimental results on both synthetic and real rain videos show the proposed approach performs better than other state-of-the-art approaches.


title: Diffusible crosslinkers cause superexponential friction forces

abstract: The mitotic spindle lies at the heart of the spatio-temporal control over cellular components during cell division. The spindle consists of microtubules, which are not only crosslinked by motor proteins but also by passive binding proteins. These passive crosslinkers stabilize the highly dynamic mitotic spindle by generating friction forces between sliding filaments. However, it remains unclear how the friction coefficient depends on the number of crosslinkers and the size of the overlap between the microtubules. Here, we use theory and computer simulations to study the friction between two filaments that are crosslinked by passive proteins, which can hop between neighboring binding sites while physically excluding each other. The simulations reveal that the movement of one microtubule relative to the other is limited by free-energy barrier crossings, causing rare and discrete jumps of the microtubule that span the distance between adjacent crosslinker binding sites. We derive an exact analytical expression for the free-energy landscape and identify the reaction coordinate that governs the relative movement, which allows us to determine the effective barrier height for the microtubule jumps. Both through simulations and reaction rate theory, we make the experimentally testable prediction that the friction between the microtubules increases superexponentially with the density of crosslinkers.


title: Enantioselective manipulation of chiral nanoparticles using optical tweezers

abstract: We put forward an enantioselective method for chiral nanoparticles using optical tweezers. We demonstrate that the optical trapping force in a typical, realistic optical tweezing setup with circularly-polarized trapping beams is sensitive to the chirality of core-shell nanoparticles, allowing for efficient enantioselection. It turns out that the handedness of the trapped particles can be selected by choosing the appropriate circular polarization of the trapping beam. The chirality of each individual trapped nanoparticle can be characterized by measuring the rotation of the equilibrium position under the effect of a transverse Stokes drag force. We show that the chirality of the shell gives rise to an additional twist, leading to a strong enhancement of the optical torque driving the rotation. Both methods are shown to be robust against variations of size and material parameters, demonstrating that they are particularly useful in (but not restricted to) several situations of practical interest in chiral plasmonics, where enantioselection and characterization of single chiral nanoparticles, each and every with its unique handedness and optical properties, are in order. In particular, our method could be employed to unveil the chiral response arising from disorder in individual plasmonic raspberries, synthesized by close-packing a large number of metallic nanospheres around a dielectric core.


title: Uncertainty Principles For the continuous Gabor quaternion linear canonical transform

abstract: Gabor transform is one of the performed tools for time-frequency signal analysis. The principal aim of this paper is to generalize the Gabor Fourier transform to the quaternion linear canonical transform. Actually, this transform gives us more flexibility to studied nonstationary and local signals associated with the quaternion linear canonical transform. Some useful properties are derived, such as Plancherel and inversion formulas. And we prove some uncertainty principles: those including Heisenberg's, Lieb's and logarithmic inequalities. We finish by analogs of concentration and Benedick's type theorems.


title: Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

abstract: Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying uncertainty is especially critical in real-world settings, which often involve input distributions that are shifted from the training distribution due to a variety of factors including sample bias and non-stationarity. In such settings, well calibrated uncertainty estimates convey information about when a model's output should (or should not) be trusted. Many probabilistic deep learning methods, including Bayesian-and non-Bayesian methods, have been proposed in the literature for quantifying predictive uncertainty, but to our knowledge there has not previously been a rigorous large-scale empirical comparison of these methods under dataset shift. We present a large-scale benchmark of existing state-of-the-art methods on classification problems and investigate the effect of dataset shift on accuracy and calibration. We find that traditional post-hoc calibration does indeed fall short, as do several other previous methods. However, some methods that marginalize over models give surprisingly strong results across a broad spectrum of tasks.


title: Approximation by Fourier sums in classes of differentiable functions with high exponents of smoothness

abstract: We find asymptotic equalities for the exact upper bounds of approximations by Fourier sums of Weyl-Nagy classes $W^r_{\beta,p}, 1\le p\le\infty,$ for rapidly growing exponents of smoothness $r$ $(r/n\rightarrow\infty)$ in the uniform metric. We obtain similar estimates for approximations of the classes $W^r_{\beta,1}$ in metrics of the spaces $L_p, 1\le p\le\infty$.


title: Unusual plasma and particle signatures at Mars and STEREO-A related to CME-CME interaction

abstract: On July 25 2017 a multi-step Forbush decrease (FD) with the remarkable total amplitude of more than 15\% was observed by MSL/RAD at Mars. We find that these particle signatures are related to very pronounced plasma and magnetic field signatures detected in situ by STEREO-A on July 24 2017, with a higher than average total magnetic field strength reaching more than 60 nT. In the observed time period STEREO-A was at a relatively small longitudinal separation (46 degrees) to Mars and both were located at the back side of the Sun as viewed from Earth. We analyse a number of multi-spacecraft and multi-instrument (both in situ and remote-sensing) observations, and employ modelling to understand these signatures. We find that the solar sources are two CMEs which erupted on July 23 2017 from the same source region on the back side of the Sun as viewed from Earth. Moreover, we find that the two CMEs interact non-uniformly, inhibiting the expansion of one of the CMEs in STEREO-A direction, whereas allowing it to expand more freely in the Mars direction. The interaction of the two CMEs with the ambient solar wind adds up to the complexity of the event, resulting in a long, sub-structured interplanetary disturbance at Mars, where different sub-structures correspond to different steps of the FD, adding-up to a globally large-amplitude FD.


title: Boosting Operational DNN Testing Efficiency through Conditioning

abstract: With the increasing adoption of Deep Neural Network (DNN) models as integral parts of software systems, efficient operational testing of DNNs is much in demand to ensure these models' actual performance in field conditions. A challenge is that the testing often needs to produce precise results with a very limited budget for labeling data collected in field. Viewing software testing as a practice of reliability estimation through statistical sampling, we re-interpret the idea behind conventional structural coverages as conditioning for variance reduction. With this insight we propose an efficient DNN testing method based on the conditioning on the representation learned by the DNN model under testing. The representation is defined by the probability distribution of the output of neurons in the last hidden layer of the model. To sample from this high dimensional distribution in which the operational data are sparsely distributed, we design an algorithm leveraging cross entropy minimization. Experiments with various DNN models and datasets were conducted to evaluate the general efficiency of the approach. The results show that, compared with simple random sampling, this approach requires only about a half of labeled inputs to achieve the same level of precision.


title: Contextual Relabelling of Detected Objects

abstract: Contextual information, such as the co-occurrence of objects and the spatial and relative size among objects provides deep and complex information about scenes. It also can play an important role in improving object detection. In this work, we present two contextual models (rescoring and re-labeling models) that leverage contextual information (16 contextual relationships are applied in this paper) to enhance the state-of-the-art RCNN-based object detection (Faster RCNN). We experimentally demonstrate that our models lead to enhancement in detection performance using the most common dataset used in this field (MSCOCO).


title: (Pen-) Ultimate DNN Pruning

abstract: DNN pruning reduces memory footprint and computational work of DNN-based solutions to improve performance and energy-efficiency. An effective pruning scheme should be able to systematically remove connections and/or neurons that are unnecessary or redundant, reducing the DNN size without any loss in accuracy. In this paper we show that prior pruning schemes require an extremely time-consuming iterative process that requires retraining the DNN many times to tune the pruning hyperparameters. We propose a DNN pruning scheme based on Principal Component Analysis and relative importance of each neuron's connection that automatically finds the optimized DNN in one shot without requiring hand-tuning of multiple parameters.


title: Statistical solutions of hyperbolic systems of conservation laws: numerical approximation

abstract: Statistical solutions are time-parameterized probability measures on spaces of integrable functions, that have been proposed recently as a framework for global solutions and uncertainty quantification for multi-dimensional hyperbolic system of conservation laws. By combining high-resolution finite volume methods with a Monte Carlo sampling procedure, we present a numerical algorithm to approximate statistical solutions. Under verifiable assumptions on the finite volume method, we prove that the approximations, generated by the proposed algorithm, converge in an appropriate topology to a statistical solution. Numerical experiments illustrating the convergence theory and revealing interesting properties of statistical solutions, are also presented.


title: Symbol Message Passing Decoding of Nonbinary Low-Density Parity-Check Codes

abstract: We present a novel decoding algorithm for q-ary low-density parity-check codes, termed symbol message passing. The proposed algorithm can be seen as a generalization of Gallager B and the binary message passing algorithm by Lechner et al. to q-ary codes. We derive density evolution equations for the q-ary symmetric channel, compute thresholds for a number of regular low-density parity-check code ensembles, and verify those by Monte Carlo simulations of long channel codes. The proposed algorithm shows performance advantages with respect to an algorithm of comparable complexity from the literature.


title: Ternary quadratic forms representing a given arithmetic progression

abstract: A positive quadratic form is $(k,\ell)$-universal if it represents all the numbers $kx+\ell$ where $x$ is a non-negative integer, and almost $(k,\ell)$-universal if it represents all but finitely many of them. We prove that for any $k,\ell$ such that $k\nmid\ell$ there exists an almost $(k,\ell)$-universal diagonal ternary form. We also conjecture that there are only finitely many primes $p$ for which a $(p,\ell)$-universal diagonal ternary form exists (for any $\ell<p$) and we show the results of computer experiments that speak in favor of the conjecture.


title: STN-Homography: estimate homography parameters directly

abstract: In this paper, we introduce the STN-Homography model to directly estimate the homography matrix between image pair. Different most CNN-based homography estimation methods which use an alternative 4-point homography parameterization, we use prove that, after coordinate normalization, the variance of elements of coordinate normalized $3\times3$ homography matrix is very small and suitable to be regressed well with CNN. Based on proposed STN-Homography, we use a hierarchical architecture which stacks several STN-Homography models and successively reduce the estimation error. Effectiveness of the proposed method is shown through experiments on MSCOCO dataset, in which it significantly outperforms the state-of-the-art. The average processing time of our hierarchical STN-Homography with 1 stage is only 4.87 ms on the GPU, and the processing time for hierarchical STN-Homography with 3 stages is 17.85 ms. The code will soon be open sourced.


title: Hierarchical Bayesian myocardial perfusion quantification

abstract: Purpose: Tracer-kinetic models can be used for the quantitative assessment of contrast-enhanced MRI data. However, the model-fitting can produce unreliable results due to the limited data acquired and the high noise levels. Such problems are especially prevalent in myocardial perfusion MRI leading to the compromise of constrained numerical deconvolutions and segmental signal averaging being commonly used as alternatives to the more complex tracer-kinetic models. Methods: In this work, the use of hierarchical Bayesian inference for the parameter estimation is explored. It is shown that with Bayesian inference it is possible to reliably fit the two-compartment exchange model to perfusion data. The use of prior knowledge on the ranges of kinetic parameters and the fact that neighbouring voxels are likely to have similar kinetic properties combined with a Markov chain Monte Carlo based fitting procedure significantly improves the reliability of the perfusion estimates with compared to the traditional least-squares approach. The method is assessed using both simulated and patient data. Results: The average (standard deviation) normalised mean square error for the distinct noise realisations of a simulation phantom falls from 0.32 (0.55) with the least-squares fitting to 0.13 (0.2) using Bayesian inference. The assessment of the presence of coronary artery disease based purely on the quantitative MBF maps obtained using Bayesian inference matches the visual assessment in all 24 slices. When using the maps obtained by the least-squares fitting, a corresponding assessment is only achieved in 16/24 slices. Conclusion: Bayesian inference allows a reliable, fully automated and user-independent assessment of myocardial perfusion on a voxel-wise level using the two-compartment exchange model.


title: Multidimensional Outlier Detection in Temporal Interaction Networks: An Application to Political Communication on Twitter

abstract: In social network Twitter, users can interact with each other and spread information via retweets. These millions of interactions may result in media events whose influence goes beyond Twitter framework. In this paper, we thoroughly explore interactions to provide a better understanding of the emergence of certain trends. First, we consider an interaction on Twitter to be a triplet $(s,a,t)$ meaning that user $s$, called the spreader, has retweeted a tweet of user $a$, called the author, at time $t$. We model this set of interactions as a data cube with three dimensions: spreaders, authors and time. Then, we provide a method which builds different contexts, where a context is a set of features characterizing the circumstances of an event. Finally, these contexts allow us to find relevant unexpected behaviors, according to several dimensions and various perspectives: a user during a given hour which is abnormal compared to its usual behavior, a relationship between two users which is abnormal compared to all other relationships, \textit{etc.} We apply our method to a set of retweets related to the 2017 French presidential election and show that one can build interesting insights regarding political organization on Twitter.


title: Charactering the magnetic properties of the copper chalcopyrite semiconductor CuGaSe2 via Monte Carlo simulations

abstract: This manuscript presents a model and simulation of the copper chalcopyrite semiconductor CuGaSe2 in order to predict its magnetic properties. In the semiconductor material CuGaSe2 (CGS), the atom Cu is the only magnetic element with a magnetic moment value S = 1/2. We propose a Hamiltonian to calculate the energies corresponding to different configurations of the system. In a first step, we presented the magnetization behavior by using the Monte Carlo simulations (MCS). The magnetizations as a function of the temperature, the exchange coupling have been studied and discussed. We have also deduced and studied the magnetic susceptibilities. To complete this study, we have established and discussed the magnetic hysteresis loops of the studied compound. Also we have calculated the corresponding critical exponents and compared them with the standard 3D Ising model.


title: Organic Light-Emitting Diode Beam Shaping: Pixel Design for Variable Angular Emission Profile Control

abstract: Organic light-emitting diodes (OLEDs) are the leading self-emitting pixel technology in current and future small and large area displays. Once integrated with a certain layer architecture into the backplane layout, their emission colour and angular distribution is set by the optical properties of the layered system. In this paper, we demonstrate a pixel design that allows for actively controlled variation of the angular emission profile of the individual vertical pixel. For this, a tandem device is developed that comprises two units optimized for different angular emission pattern. We constrained the system to operate in a narrow emission band to maintain monochromaticity of the individual pixel. We discuss this concept for a red phosphorescence-based OLED stack and give an outlook based on simulations for the other primary display colours green and blue. The tandem unit can be operated with only two electrodes making use of the AC/DC driving concept, where the outer electrodes are in direct connection. In this paper, we will discuss the potential, status, and technology challenges for this concept.


title: Theoretical evidence for the sensitivity of charge-rearrangement-enhanced x-ray ionization to molecular size

abstract: It was recently discovered that molecular ionization at high x-ray intensity is enhanced, in comparison with that of isolated atoms, through a phenomenon called CREXIM (charge-rearrangement-enhanced x-ray ionization of molecules). X-ray absorption selectively ionizes heavy atoms within molecules, triggering electron transfer from neighboring atoms to the heavy atom sites and enabling further ionization there. The present theoretical study demonstrates that the CREXIM effect increases with the size of the molecule, as a consequence of increased intramolecular electron transfer from the larger molecular constituents attached to the heavy atoms. We compare x-ray multiphoton ionization dynamics of xenon, iodomethane, and iodobenzene after interacting with an intense x-ray pulse. Although their photoionization cross sections are similar, iodomethane and iodobenzene molecules are more ionized than xenon atoms. Moreover, we predict that the average total charge of iodobenzene is much larger than that of iodomethane, because of the large number of electrons in the benzene ring. The positive charges transferred from the iodine site to the benzene ring are redistributed such that the higher carbon charges are formed at the far end from the iodine site. Our first-principles calculations provide fundamental insights into the interaction of molecules with x-ray free-electron laser (XFEL) pulses. These insights need to be taken into account for interpreting and designing future XFEL experiments.


title: Role of Velocity Field and Principal Axis of Tilted Dirac Cones in Effective Hamlitonan of Non-Coplanar Nodal Loop

abstract: Nodal line in single-component molecular conductor [Pd(dddt)_2] has been examined to understand the tilted Dirac cone on the non-coplanar loop. In the previous work [J. Phys. Soc. Jpn. 87, 113701 (2018)], the velocity of the cone was calculated at respective Dirac points on the nodal loop based on our first-principles band structure calculations, which was a new method to derive an effective Hamiltonian with a 2 x 2 matrix. However, the Dirac cones on the nodal line are fully reproduced only at symmetric points. In the present paper, we show that our improved method well reproduces reasonable behaviors of all the Dirac cones and a very small energy dispersion of 6~meV among the Dirac points. The variation of velocities along the nodal line are shown by using principal axes of the gap function between the conduction and valence bands. Further, the density of states close to the chemical potential and orbital magnetic susceptibility are calculated using such an effective Hamiltonian.


title: Criticality of measures on 2-d Ising configurations: from square to hexagonal graphs

abstract: On the space of Ising configurations on the 2-d square lattice, we consider a family of non Gibbsian measures introduced by using a pair Hamiltonian, depending on an additional inertial parameter $q$. These measures are related to the usual Gibbs measure on $\Z^2$ and turn out to be the marginal of the Gibbs measure of a suitable Ising model on the hexagonal lattice. The inertial parameter $q$ tunes the geometry of the system. The critical behaviour and the decay of correlation functions of these measures are studied thanks to relation with the Random Cluster model.


title: Combining Generative and Discriminative Models for Hybrid Inference

abstract: A graphical model is a structured representation of the data generating process. The traditional method to reason over random variables is to perform inference in this graphical model. However, in many cases the generating process is only a poor approximation of the much more complex true data generating process, leading to suboptimal estimation. The subtleties of the generative process are however captured in the data itself and we can `learn to infer', that is, learn a direct mapping from observations to explanatory latent variables. In this work we propose a hybrid model that combines graphical inference with a learned inverse model, which we structure as in a graph neural network, while the iterative algorithm as a whole is formulated as a recurrent neural network. By using cross-validation we can automatically balance the amount of work performed by graphical inference versus learned inference. We apply our ideas to the Kalman filter, a Gaussian hidden Markov model for time sequences, and show, among other things, that our model can estimate the trajectory of a noisy chaotic Lorenz Attractor much more accurately than either the learned or graphical inference run in isolation.


title: Gravitational production of superheavy baryonic and dark matter in quintessential inflation: nonconformally coupled case

abstract: The gravitational production of superheavy dark matter is studied in the context of quintessential inflation. The superheavy particles, whose decay products are baryonic matter and are the responsible for the reheating of the universe after the end of the inflationary period, are not conformally coupled with gravity. On the contrary, dark matter is assumed to be conformally coupled with gravity. We show that the viability of these scenarios requires the mass of the superheavy dark matter to be greater than 8 x 10^{15} GeV.


title: Weakly-Supervised Spatio-Temporally Grounding Natural Sentence in Video

abstract: In this paper, we address a novel task, namely weakly-supervised spatio-temporally grounding natural sentence in video. Specifically, given a natural sentence and a video, we localize a spatio-temporal tube in the video that semantically corresponds to the given sentence, with no reliance on any spatio-temporal annotations during training. First, a set of spatio-temporal tubes, referred to as instances, are extracted from the video. We then encode these instances and the sentence using our proposed attentive interactor which can exploit their fine-grained relationships to characterize their matching behaviors. Besides a ranking loss, a novel diversity loss is introduced to train the proposed attentive interactor to strengthen the matching behaviors of reliable instance-sentence pairs and penalize the unreliable ones. Moreover, we also contribute a dataset, called VID-sentence, based on the ImageNet video object detection dataset, to serve as a benchmark for our task. Extensive experimental results demonstrate the superiority of our model over the baseline approaches.


title: Role of the exchange-correlation functional on the structural, electronic and optical properties of cubic and tetragonal SrTiO$_3$ including many-body effects

abstract: SrTiO$_3$ is a model perovskite compound with unique properties and technological relevance. At 105 K it undergoes a transition from a cubic to a tetragonal phase with characteristic antiferrodistortive rotations of the TiO$_6$ octahedra. Here we study systematically the effect of different exchange correlation functionals on the structural, electronic and optical properties of cubic and tetragonal STO by comparing the recently implemented strongly constrained and appropriately normed (SCAN) meta-GGA functional with the generalized gradient approximation (PBE96 and PBEsol) and the hybrid functional (HSE06). SCAN is found to significantly improve the description of the structural properties, in particular the rotational angle of the tetragonal phase, comparable to HSE06 at a computational cost similar to GGA. The addition of a Hubbard $U$-term (SCAN+$U$, $U=7.45$ eV) allows to achieve the experimental band gap of 3.25 eV with a moderate increase in the lattice constant, whereas within GGA+$U$ the gap is underestimated even for high $U$ values. The effect of the exchange-correlation functional on the optical properties is progressively reduced from 1.5 eV variance in the onset of the spectrum in the independent particle picture to 0.3 eV upon inclusion of many-body effects within the framework of the $GW$ approximation (single-shot $G_0W_0$) and excitonic corrections by solving the Bethe-Salpeter equation (BSE). Moreover, a model BSE approach is shown to reproduce the main features of the optical spectrum at a lower cost compared to $G_0W_0$+BSE. Strong excitonic effects are found in agreement with previous results and their origin is analyzed based on the contributing interband transitions. Last but not least, the effect of the tetragonal distortion on the optical spectrum is discussed and compared to available experimental data.


title: Deep Curve-dependent PDEs for affine rough volatility

abstract: We introduce a new deep-learning based algorithm to evaluate options in affine rough stochastic volatility models. Viewing the pricing function as the solution to a curve-dependent PDE (CPDE), depending on forward curves rather than the whole path of the process, for which we develop a numerical scheme based on deep learning techniques. Numerical simulations suggest that the latter is a promising alternative to classical Monte Carlo simulations.


title: Planck 2018 results. VII. Isotropy and Statistics of the CMB

abstract: Analysis of the Planck 2018 data set indicates that the statistical properties of the cosmic microwave background (CMB) temperature anisotropies are in excellent agreement with previous studies using the 2013 and 2015 data releases. In particular, they are consistent with the Gaussian predictions of the $\Lambda$CDM cosmological model, yet also confirm the presence of several so-called "anomalies" on large angular scales. The novelty of the current study, however, lies in being a first attempt at a comprehensive analysis of the statistics of the polarization signal over all angular scales, using either maps of the Stokes parameters, $Q$ and $U$, or the $E$-mode signal derived from these using a new methodology (which we describe in an appendix). Although remarkable progress has been made in reducing the systematic effects that contaminated the 2015 polarization maps on large angular scales, it is still the case that residual systematics (and our ability to simulate them) can limit some tests of non-Gaussianity and isotropy. However, a detailed set of null tests applied to the maps indicates that these issues do not dominate the analysis on intermediate and large angular scales (i.e., $\ell \lesssim 400$). In this regime, no unambiguous detections of cosmological non-Gaussianity, or of anomalies corresponding to those seen in temperature, are claimed. Notably, the stacking of CMB polarization signals centred on the positions of temperature hot and cold spots exhibits excellent agreement with the $\Lambda$CDM cosmological model, and also gives a clear indication of how Planck provides state-of-the-art measurements of CMB temperature and polarization on degree scales.


title: Scanning Tunneling Shot Noise Spectroscopy in Kondo Systems

abstract: Using a large-N theory in combination with the Keldysh non-equilibrium Greens function formalism, we investigate the current, differential conductance, zero-frequency shot-noise and Fano factor as measured by scanning tunneling shot noise spectroscopy (STSNS) using a scanning tunneling microscope (STM) near single Kondo impurities and in Kondo lattices. We show that the Fano factor $F$ exhibits a characteristic bias dependence arising from Kondo screening that is similar to the Kondo resonance observed in the differential conductance. Moreover, the lineshape of $F$ is strongly dependent on the ratio of the tunneling amplitudes for electron tunneling from the STM tip into the conduction band and electronic levels of the magnetic adatoms. We demonstrate that the Fano factor can be enhanced or suppressed due to interference effects and as such, is not only a sensitive probe for the correlation effects arising from Kondo screening, but also for quantum interference between tunneling electrons. We identify a correlation between the form of the differential conductance and the Fano factor that could be tested in future STSNS experiments.


title: Long-term temperature evolution of neutron stars undergoing episodic accretion outbursts

abstract: Transient neutron star (NS) LMXBs undergo episodes of accretion, alternated with quiescent periods. During an accretion outburst, the NS heats up due to exothermic accretion-induced processes taking place in the crust. Besides the long-known deep crustal heating of nuclear origin, a likely non-nuclear source of heat, dubbed 'shallow heating', is present at lower densities. Most of the accretion-induced heat slowly diffuses into the core on a timescale of years. Over many outburst cycles, a state of equilibrium is reached when the core temperature is high enough that the heating and cooling (photon and neutrino emission) processes are in balance. We investigate how stellar characteristics and outburst properties affect the long-term temperature evolution of a transiently accreting NS. For the first time the effects of crustal properties are considered, particularly that of shallow heating. Using our code NSCool, we tracked the thermal evolution of a NS undergoing outbursts over a period of $10^5$ yr. The outburst sequence is based on the regular outbursts observed from Aql X-1. For each model, we calculated the timescale over which equilibrium was reached and we present these timescales along with the temperature and luminosity parameters of the equilibrium state. We find that shallow heating significantly contributes to the equilibrium state. Increasing its strength raises the equilibrium core temperature. We find that if deep crustal heating is replaced by shallow heating alone, the core would still heat up, reaching only a 2% lower equilibrium core temperature. Deep crustal heating may therefore not be vital to the heating of the core. Additionally, shallow heating can increase the quiescent luminosity to values higher than previously expected.


title: Assouad spectrum thresholds for some random constructions

abstract: The Assouad dimension of a metric space determines its extremal scaling properties. The derived notion of the Assouad spectrum fixes relative scales by a scaling function to obtain interpolation behaviour between the quasi-Assouad and box-counting dimensions. While the quasi-Assouad and Assouad dimensions often coincide, they generally differ in random constructions. In this paper we consider a generalised Assouad spectrum that interpolates between the quasi-Assouad to the Assouad dimension. For common models of random fractal sets we obtain a dichotomy of its behaviour by finding a threshold function where the quasi-Assouad behaviour transitions to the Assouad dimension. This threshold can be considered a phase transition and we compute the threshold for the Gromov boundary of Galton-Watson trees and one-variable random self-similar and self-affine constructions. We describe how the stochastically self-similar model can be derived from the Galton-Watson tree result.


title: Duality on generalized cuspidal edges preserving singular set images and first fundamental forms

abstract: In the second, fourth and fifth authors' previous work, a duality on generic real analytic cuspidal edges in the Euclidean 3-space $\boldsymbol R^3$ preserving their singular set images and first fundamental forms, was given. Here, we call this an `isometric duality'. When the singular set image has no symmetries and does not lie in a plane, the dual cuspidal edge is not congruent to the original one. In this paper, we show that this duality extends to generalized cuspidal edges in $\boldsymbol R^3$, including cuspidal cross caps, and $5/2$-cuspidal edges. Moreover, we give several new geometric insights on this duality.


title: Virtual classes and virtual motives of Quot schemes on threefolds

abstract: For a simple, rigid vector bundle $F$ on a Calabi-Yau $3$-fold $Y$, we construct a symmetric obstruction theory on the Quot scheme $\textrm{Quot}_Y(F,n)$, and we solve the associated enumerative theory. We discuss the case of other $3$-folds. Exploiting the critical structure on $\textrm{Quot}_{\mathbb A^3}(\mathscr O^r,n)$, we construct a virtual motive (in the sense of Behrend-Bryan-Szendr\H{o}i) for $\textrm{Quot}_Y(F,n)$ for an arbitrary vector bundle $F$ on a smooth $3$-fold $Y$. We compute the associated motivic partition function. We obtain new examples of higher rank (motivic) Donaldson-Thomas invariants.


title: The Substrates of Integrated Neurocognitive Rehabilitation Platforms (INCRPs)

abstract: The integrated neurocognitive rehabilitation platforms (INCRPs) refer to infrastructures and teams integrated for set of interventions which aim to restore, or compensate for cognitive deficits. Cognitive skills may be lost or altered due to brain damage resulting from diseases or injury. The INCRP is a two-way interactive process whereby people with neurological impairments work with specialists, professional staff, families, and community members to alleviate the impact of cognitive deficits. This perspective paper would highlight key elements required in INCRPs.


title: Model of lamellipodium initiation during cell spreading

abstract: Cell spreading requires a major reorganisation of the actin cytoskeleton, from a cortical structure to a lamellipodium where filaments are mostly parallel to the substrate. We propose a model inspired by the physics of nematic liquid crystals and fluid membranes, in which the coupling between actin mechanics, filaments orientation, and the local curvature of the cell membrane naturally yields the collective reorientation of actin filaments at the highly curved edge of a spreading cell. Filament orientation increases the traction force exerted by the frictional flow of polymerising actin on the substrate, creating a positive feedback loop between edge curvature, filament alignment, and traction force that promotes cell spreading. We establish the condition under which this feedback leads to a full wetting transition, which we interpret as the initiation of a lamellipodium, and we uncover the existence of bi-stability between partial and full spreading which could trigger spontaneous cell polarization and lead to migration.


title: An End-to-End Learning-based Cost Estimator

abstract: Cost and cardinality estimation is vital to query optimizer, which can guide the plan selection. However traditional empirical cost and cardinality estimation techniques cannot provide high-quality estimation, because they cannot capture the correlation between multiple columns. Recently the database community shows that the learning-based cardinality estimation is better than the empirical methods. However, existing learning-based methods have several limitations. Firstly, they can only estimate the cardinality, but cannot estimate the cost. Secondly, convolutional neural network (CNN) with average pooling is hard to represent complicated structures, e.g., complex predicates, and the model is hard to be generalized. To address these challenges, we propose an effective end-to-end learning-based cost estimation framework based on a tree-structured model, which can estimate both cost and cardinality simultaneously. To the best of our knowledge, this is the first end-to-end cost estimator based on deep learning. We propose effective feature extraction and encoding techniques, which consider both queries and physical operations in feature extraction. We embed these features into our tree-structured model. We propose an effective method to encode string values, which can improve the generalization ability for predicate matching. As it is prohibitively expensive to enumerate all string values, we design a patten-based method, which selects patterns to cover string values and utilizes the patterns to embed string values. We conducted experiments on real-world datasets and experimental results showed that our method outperformed baselines.


title: Funding Adjustments in Equity Linear Products

abstract: Valuation adjustments are nowadays a common practice to include credit and liquidity effects in option pricing. Funding costs arising from collateral procedures, hedging strategies and taxes are added to option prices to take into account the production cost of financial contracts so that a profitability analysis can be reliably assessed. In particular, when dealing with linear products, we need a precise evaluation of such contributions since bid-ask spreads may be very tight. In this paper we start from a general pricing framework inclusive of valuation adjustments to derive simple evaluation formulae for the relevant case of total return equity swaps when stock lending and borrowing is adopted as hedging strategy.


title: Judicious QoS using Cloud Overlays

abstract: We revisit the long-standing problem of providing network QoS to applications, and propose the concept of judicious QoS -- combining the cheaper, best effort IP service with the cloud, which offers a highly reliable infrastructure and the ability to add in-network services, albeit at higher cost. Our proposed J-QoS framework offers a range of reliability services with different cost vs. delay trade-offs, including: i) a forwarding service that forwards packets over the cloud overlay, ii) a caching service, which stores packets inside the cloud and allows them to be pulled in case of packet loss or disruption on the Internet, and iii) a novel coding service that provides the least expensive packet recovery option by combining packets of multiple application streams and sending a small number of coded packets across the more expensive cloud paths. We demonstrate the feasibility of these services using measurements from RIPE Atlas and a live deployment on PlanetLab. We also consider case studies on how J-QoS works with services up and down the network stack, including Skype video conferencing, TCP-based web transfers, and cellular access networks.


title: Measuring the compositionality of noun-noun compounds over time

abstract: We present work in progress on the temporal progression of compositionality in noun-noun compounds. Previous work has proposed computational methods for determining the compositionality of compounds. These methods try to automatically determine how transparent the meaning of the compound as a whole is with respect to the meaning of its parts. We hypothesize that such a property might change over time. We use the time-stamped Google Books corpus for our diachronic investigations, and first examine whether the vector-based semantic spaces extracted from this corpus are able to predict compositionality ratings, despite their inherent limitations. We find that using temporal information helps predicting the ratings, although correlation with the ratings is lower than reported for other corpora. Finally, we show changes in compositionality over time for a selection of compounds.


title: Analysis of Automatic Annotation Suggestions for Hard Discourse-Level Tasks in Expert Domains

abstract: Many complex discourse-level tasks can aid domain experts in their work but require costly expert annotations for data creation. To speed up and ease annotations, we investigate the viability of automatically generated annotation suggestions for such tasks. As an example, we choose a task that is particularly hard for both humans and machines: the segmentation and classification of epistemic activities in diagnostic reasoning texts. We create and publish a new dataset covering two domains and carefully analyse the suggested annotations. We find that suggestions have positive effects on annotation speed and performance, while not introducing noteworthy biases. Envisioning suggestion models that improve with newly annotated texts, we contrast methods for continuous model adjustment and suggest the most effective setup for suggestions in future expert tasks.


title: Cylindric Hecke characters and Gromov-Witten invariants via the asymmetric six-vertex model

abstract: We construct a family of infinite-dimensional positive sub-coalgebras within the Grothendieck ring of Hecke algebras, when viewed as a Hopf algebra with respect to the induction and restriction functor. These sub-coalgebras have as structure constants the 3-point genus zero Gromov-Witten invariants of Grassmannians and are spanned by what we call cylindric Hecke characters, a particular set of virtual characters for whose computation we give several explicit combinatorial formulae. One of these expressions is a generalisation of Ram's formula for irreducible Hecke characters and uses cylindric broken rim hook tableaux. We show that the latter are in bijection with so-called `ice configurations' on a cylindrical square lattice, which define the asymmetric six-vertex model in statistical mechanics. A key ingredient of our construction is an extension of the boson-fermion correspondence to Hecke algebras and employing the latter we find new expressions for Jing's vertex operators of Hall-Littlewood functions in terms of the six-vertex transfer matrices on the infinite planar lattice.


title: On four-point connectivities in the critical 2d Potts model

abstract: We perform Monte-Carlo computations of four-point cluster connectivities in the critical 2d Potts model, for numbers of states $Q\in (0,4)$ that are not necessarily integer. We compare these connectivities to four-point functions in a CFT that interpolates between D-series minimal models. We find that 3 combinations of the 4 independent connectivities agree with CFT four-point functions, down to the $2$ to $4$ significant digits of our Monte-Carlo computations. However, we argue that the agreement is exact only in the special cases $Q=0, 3, 4$. We conjecture that the Potts model can be analytically continued to a double cover of the half-plane $\{\Re c <13\}$, where $c$ is the central charge of the Virasoro symmetry algebra.

categories: hep-th cond-mat.stat-mech math-ph math.MP


title: An Information-Theoretical Approach to the Information Capacity and Cost-Effectiveness Evaluation of Color Palettes

abstract: Colors are used as effective tools of representing and transferring information. Number of colors in a palette is the direct arbiter of the information conveying capacity. Yet it should be well elaborated, since increasing the entropy by adding colors comes with its cost on decoding. Despite the possible effects upon diverse applications, a methodology for cost-effectiveness evaluation of palettes seems deficient. In this work, this need is being addressed from an information-theoretical perspective, via the articulated metrics and formulae. Besides, the proposed metrics are computed for some developed and known palettes, and observed results are evaluated.


title: Localizing Catastrophic Forgetting in Neural Networks

abstract: Artificial neural networks (ANNs) suffer from catastrophic forgetting when trained on a sequence of tasks. While this phenomenon was studied in the past, there is only very limited recent research on this phenomenon. We propose a method for determining the contribution of individual parameters in an ANN to catastrophic forgetting. The method is used to analyze an ANNs response to three different continual learning scenarios.


title: Gradio: Hassle-Free Sharing and Testing of ML Models in the Wild

abstract: Accessibility is a major challenge of machine learning (ML). Typical ML models are built by specialists and require specialized hardware/software as well as ML experience to validate. This makes it challenging for non-technical collaborators and endpoint users (e.g. physicians) to easily provide feedback on model development and to gain trust in ML. The accessibility challenge also makes collaboration more difficult and limits the ML researcher's exposure to realistic data and scenarios that occur in the wild. To improve accessibility and facilitate collaboration, we developed an open-source Python package, Gradio, which allows researchers to rapidly generate a visual interface for their ML models. Gradio makes accessing any ML model as easy as sharing a URL. Our development of Gradio is informed by interviews with a number of machine learning researchers who participate in interdisciplinary collaborations. Their feedback identified that Gradio should support a variety of interfaces and frameworks, allow for easy sharing of the interface, allow for input manipulation and interactive inference by the domain expert, as well as allow embedding the interface in iPython notebooks. We developed these features and carried out a case study to understand Gradio's usefulness and usability in the setting of a machine learning collaboration between a researcher and a cardiologist.


title: On typical encodings of multivariate ergodic sources

abstract: We show that the typical coordinate-wise encoding of multivariate ergodic source into prescribed alphabets has the entropy profile close to the convolution of the entropy profile of the source and the modular polymatroid that is determined by the cardinalities of the output alphabets. We show that the proportion of the exceptional encodings that are not close to the convolution goes to zero doubly exponentially. The result holds for a class of multivariate sources that satisfy asymptotic equipartition property described via the mean fluctuation of the information functions. This class covers asymptotically mean stationary processes with ergodic mean, ergodic processes, irreducible Markov chains with an arbitrary initial distribution. We also proved that typical encodings yield the asymptotic equipartition property for the output variables. These asymptotic results are based on an explicit lower bound of the proportion of encodings that transform a multivariate random variable into a variable with the entropy profile close to the suitable convolution.


title: Hubbard-Stratonovich transformation and consistent ordering in the coherent state path integral: insights from stochastic calculus

abstract: Recently, doubts have been cast on the validity of the continuous-time coherent state path integral. This has led to controversies regarding the correct way of performing calculations with path integrals, and to several alternative definitions of what should be their continuous limit. Furthermore, the issue of a supposedly proper ordering of the Hamiltonian operator, entangled with the continuous-time limit, has led to considerable confusion in the literature. Since coherent state path integrals are at the basis of the modern formulation of many-body quantum theory, it should be laid on solid foundations. Here, we show that the issues raised above are coming from the illegitimate use of the (standard) rules of calculus, which are not necessarily valid in path integrals. This is well known in the context of stochastic equations, in particular in their path integral formulation. This insight allows for solving these issues and addressing the correspondence between the various orderings at the level of the path integral. We also use this opportunity to address the proper calculation of a functional determinant in the presence of a Hubbard-Stratonovich field, which shares in the controversies.


title: GIBBONFINDR: An R package for the detection and classification of acoustic signals

abstract: The recent improvements in recording technology, data storage and battery life have led to an increased interest in the use of passive acoustic monitoring for a variety of research questions. One of the main obstacles in implementing wide scale acoustic monitoring programs in terrestrial environments is the lack of user-friendly, open source programs for processing large sound archives. Here we describe the new, open-source R package GIBBONFINDR which has functions for detection, classification and visualization of acoustic signals using a variety of readily available machine learning algorithms in the R programming environment. We provide a case study showing how GIBBONFINDR functions can be used in a workflow to detect and classify Bornean gibbon (Hylobates muelleri) calls in long-term acoustic data sets recorded in Danum Valley Conservation Area, Sabah, Malaysia. Machine learning is currently one of the most rapidly growing fields-- with applications across many disciplines-- and our goal is to make commonly used signal processing techniques and machine learning algorithms readily available for ecologists who are interested in incorporating bioacoustics techniques into their research.


title: Estimation and Tracking of a Moving Target by Unmanned Aerial Vehicles

abstract: An image-based control strategy along with estimation of target motion is developed to track dynamic targets without motion constraints. To the best of our knowledge, this is the first work that utilizes a bounding box as image features for tracking control and estimation of dynamic target without motion constraint. The features generated from a You-Only-Look-Once (YOLO) deep neural network can relax the assumption of continuous availability of the feature points in most literature and minimize the gap for applications. The challenges are that the motion pattern of the target is unknown and modeling its dynamics is infeasible. To resolve these issues, the dynamics of the target is modeled by a constant-velocity model and is employed as a process model in the unscented Kalman filter (UKF), but process noise is uncertain and sensitive to system instability. To ensure convergence of the estimate error, the noise covariance matrix is estimated according to history data within a moving window. The estimated motion from the UKF is implemented as a feedforward term in the developed controller, so that tracking performance is enhanced. Simulations are demonstrated to verify the efficacy of the developed estimator and controller.


title: Nearly $k$-distance sets

abstract: We say that a set of points $S\subset \mathbb{R}^d$ is an $\varepsilon$-nearly $k$-distance set if there exist $1\le t_1\le \ldots\le t_k,$ such that the distance between any two distinct points in $S$ falls into $[t_1,t_1+\varepsilon]\cup\ldots\cup[t_k,t_k+\varepsilon]$. In this paper, we study the quantity $M_k(d) = \lim_{\varepsilon\to 0}\max\{|S|\ :\ S\text{ is an }\varepsilon\text{-nearly } k \text{-distance set in } \mathbb{R}^d\}$ and its relation to the classical quantity $m_k(d)$: the size of the largest $k$-distance set in $\mathbb{R}^d$. We obtain that $M_k(d) = m_k(d)$ for $k=2,3$, as well as for any fixed $k$, provided that $d$ is sufficiently large. The last result answers a question, proposed by Erd\H{o}s, Makai and Pach. We also address a closely related Tur\'an-type problem, studied by Erd\H{o}s, Makai, Pach, and Spencer in the 80's: given $n$ points in $\mathbb{R}^d$, how many pairs of them form a distance that belongs to $[t_1,t_1+1]\cup\ldots\cup[t_k,t_k+1],$ where $t_1,\ldots, t_k$ are fixed and any two points in the set are at distance at least $1$ apart? We establish the connection between this quantity and a quantity closely related to $M_k(d-1)$, as well as obtain an exact answer for the same ranges $k,d$ as above.


title: On the physical (im)possibility of lightsabers

abstract: In this paper, we use a science fiction theme (i.e. the iconic lightsaber from the Star Wars universe) as a pedagogical tool to introduce aspects of nonlinear electrodynamics due to the quantum vacuum to an audience with an undergraduate physics background. In particular, we focus on one major problem with lightsabers that is commonly invoked as an argument to dismiss them as unrealistic: light blades are not solid and thus cannot be used in a duel as normal swords would. Using techniques coming from ultra intense laser science, we show that for high enough laser intensities, two lightsaber blades can `feel' solid to each other. We argue that this aspect of lightsabers is not impossible due to limitations of the laws of physics, but is very implausible due to the high intensities and energy needed for their operation.


title: Class-Conditional Compression and Disentanglement: Bridging the Gap between Neural Networks and Naive Bayes Classifiers

abstract: In this draft, which reports on work in progress, we 1) adapt the information bottleneck functional by replacing the compression term by class-conditional compression, 2) relax this functional using a variational bound related to class-conditional disentanglement, 3) consider this functional as a training objective for stochastic neural networks, and 4) show that the latent representations are learned such that they can be used in a naive Bayes classifier. We continue by suggesting a series of experiments along the lines of Nonlinear In-formation Bottleneck [Kolchinsky et al., 2018], Deep Variational Information Bottleneck [Alemi et al., 2017], and Information Dropout [Achille and Soatto, 2018]. We furthermore suggest a neural network where the decoder architecture is a parameterized naive Bayes decoder.


title: Algorithm for filling curves on surfaces

abstract: Let $\Sigma$ be a compact, orientable surface of negative Euler characteristic, and let $h$ be a complete hyperbolic metric on $\Sigma$. A geodesic curve $\gamma$ in $\Sigma$ is filling, if it cuts the surface into topological disks and annuli. We propose an efficient algorithm for deciding whether a geodesic curve, represented as a word in some generators of $\pi_1(\Sigma)$, is filling. In the process, we find an explicit bound for the combinatorial length of a curve given by its Dehn-Thurston coordinate, in terms of the hyperbolic length. This gives us an efficient method for producing a collection which is guaranteed to contain all words corresponding to simple geodesics of bounded hyperbolic length.


title: Combining Reinforcement Learning and Configuration Checking for Maximum k-plex Problem

abstract: The Maximum k-plex Problem is an important combinatorial optimization problem with increasingly wide applications. Due to its exponential time complexity, many heuristic methods have been proposed which can return a good-quality solution in a reasonable time. However, most of the heuristic algorithms are memoryless and unable to utilize the experience during the search. Inspired by the multi-armed bandit (MAB) problem in reinforcement learning (RL), we propose a novel perturbation mechanism named BLP, which can learn online to select a good vertex for perturbation when getting stuck in local optima. To our best of knowledge, this is the first attempt to combine local search with RL for the maximum $ k $-plex problem. Besides, we also propose a novel strategy, named Dynamic-threshold Configuration Checking (DTCC), which extends the original Configuration Checking (CC) strategy from two aspects. Based on the BLP and DTCC, we develop a local search algorithm named BDCC and improve it by a hyperheuristic strategy. The experimental result shows that our algorithms dominate on the standard DIMACS and BHOSLIB benchmarks and achieve state-of-the-art performance on massive graphs.


title: Patterns of polar domains in a spatiotemporal model of interacting polarities

abstract: Polarity fields are known to exhibit long distance patterns, in both physical and biological systems. The mechanisms behind such patterns are poorly understood. Here, we describe the dynamics of polarity fields using an original physical model that generalizes classical spin models on a lattice by incorporating effective transport of polarity molecules between neighboring sites. We account for an external field and for ferromagnetic interactions between sites and prescribe the time-evolution of the system using two distinct dissipative classes for non-conserved and conserved variables representing polarity orientation and magnitude, respectively. We observe two main types of steady-state configurations --disordered configurations and patterns of highly polar spots surrounded by regions with low polarity-- and we characterise patterns and transitions between configurations. Our results may provide alternative pattern-generating mechanisms for materials endowed with polarity fields.


title: Model predictive control with stage cost shaping inspired by reinforcement learning

abstract: This work presents a suboptimality study of a particular model predictive control with a stage cost shaping based on the ideas of reinforcement learning. The focus of the suboptimality study is to derive quantities relating the infinite-horizon cost function under the said variant of model predictive control to the respective infinite-horizon value function. The basis control scheme involves usual stabilizing constraints comprising of a terminal set and a terminal cost in the form of a local Lyapunov function. The stage cost is adapted using the principles of Q-learning, a particular approach to reinforcement learning. The work is concluded by case studies with two systems for wide ranges of initial conditions.


title: How the High-energy Part of the Spectrum Affects the Adiabatic Computation Gap

abstract: Towards better understanding of how to design efficient adiabatic quantum algorithms, we study how the adiabatic gap depends on the spectra of the initial and final Hamiltonians in a natural family of test-bed examples. We show that perhaps counter-intuitively, changing the energy in the initial and final Hamiltonians of only highly excited states (we do this by assigning all eigenstates above a certain cutoff the same value), can turn the adiabatic algorithm from being successful to failing. Interestingly, our system exhibits a phase transition; when the cutoff in the spectrum becomes smaller than roughly $n/2$, $n$ being the number of qubits, the behavior transitions from a successful adiabatic process to a failed one. To analyze this behavior, and provide an upper bound on both the minimal gap as well as the success of the adiabatic algorithm, we introduce the notion of "escape rate", which quantifies the rate by which the system escapes the initial ground state (a related notion was also used by Ilin and Lychkovskiy in arXiv:1805.04083). Our results indicate a phenomenon that is interesting on its own right: an adiabatic evolution may be robust to bounded-rank perturbations, even when the latter closes the gap or makes it exponentially small.


title: Modeling the effect of microstructure on elastic wave propagation in platelet-reinforced composites and ceramics

abstract: Dense ceramics are irreplaceable in applications requiring high mechanical stiffness, chemical and temperature resistance and low weight. To improve their toughness, ceramics can be reinforced with elongated inclusions. Recent manufacturing strategies have been developed to control the orientations of disc-like micro-particles in polymeric and ceramic matrices and to build periodic microstructures. Given the infinite number of possible microstructures available, modeling tools are required to select the potentially best design. Periodic microstructures can be involved in elastic wave scattering to dissipate mechanical energy from vibrations. In this paper, a model is proposed to determine the frequency bandgaps associated to periodic architectures in composites and ceramics and the influence of microstructural parameters are investigated. The results are used to define guidelines for the future fabrication of hard bulk ceramic materials that combine traditional ceramic properties with high vibration resistance.


title: Accuracy Assessment of Perturbative Master Equations -- Embracing Non-Positivity

abstract: The reduced dynamics of an open quantum system obtained from an underlying microscopic Hamiltonian can in general only approximately be described by a time local master equation. The quality of that approximation depends primarily on the coupling strength and the structure of the environment. Various such master equations have been proposed with different aims. Choosing the most suitable one for a specific system is not straight forward. By focusing on the accuracy of the reduced dynamics we provide a thorough assessment for a selection of methods (Redfield Equation, Quantum Optical Master Equation, Coarse-Grained Master Equation, a related dynamical map approach and a partial-secular approximation). Whether or not an approach guarantees positivity we consider secondary, here. We use two qubits coupled to a Lorentzian environment in a spin-boson like fashion modeling a generic situation with various system and bath time scales. We see that, independent of the initial state, the simple Redfield Equation with time dependent coefficients is significantly more accurate than all other methods under consideration. We emphasize that positivity violation in the Redfield formalism becomes relevant only in a regime where any of the perturbative master equations considered here are rendered invalid anyway. This implies that the loss of positivity should in fact be welcomed as an important feature: it indicates the breakdown of the weak coupling assumption. In addition we present the various approaches in a self-contained way and use the behavior of their errors to provide further insight into the range of validity of each method.


title: Sufficient and necessary conditions for local rigidity of CR mappings and higher order infinitesimal deformations

abstract: In this paper we continue our study of local rigidity for maps of CR submanifolds of the complex space. We provide a linear sufficient condition for local rigidity of finitely nondegenerate maps between minimal CR manifolds. Furthermore, we show higher order infinitesimal conditions can be used to give a characterization of local rigidity.


title: BRST-BFV and BRST-BV Descriptions for Bosonic Fields with Continuous Spin on $R^{1,d-1}$

abstract: Gauge-invariant descriptions for a free bosonic scalar field of continuous spin in a $d$-dimensional Minkowski space-time using a metric-like formulation are constructed on the basis of a constrained BRST-BFV approach we propose. The resulting BRST-BFV equations of motion for a scalar field augmented by ghost operators contains different sets of auxiliary fields, depending on the manner of a partial gauge-fixing and a resolution of some of the equations of motion for a BRST-unfolded first-stage reducible gauge theory. To achieve an equivalence of the resulting BRST-unfolded constrained equations of motion with the initial irreducible Poincare group conditions of a Bargmann--Wigner type, it is demonstrated that one should replace the field in these conditions by a class of gauge-equivalent configurations. Triplet-like, doublet-like constrained descriptions, as well as an unconstrained quartet-like non-Lagrangian and Lagrangian formulations, are derived using both Fronsdal-like and new tensor fields. In particular, the BRST--BV equations of motion and Lagrangian using an appropriate set of Lagrangian multipliers in the minimal sector of the respective field and antifield configurations are constructed in a manifest way.


title: Deformations of CR maps and applications

abstract: We study the deformation theory of CR maps in the positive codimensional case. In particular, we study structural properties of the {\em mapping locus} $E$ of (germs of nondegenerate) holomorphic maps $H \colon (M,p) \to M'$ between generic real submanifolds $M \subset \mathbb C^N$ and $M' \subset \mathbb C^{N'}$, defined to be the set of points $p' \in M'$ which admit such a map with $H(p) = p'$. We show that this set $E$ is semi-analytic and provide examples for which $E$ posseses (prescribed) singularities.


title: The reflection map and infinitesimal deformations of sphere mappings

abstract: The reflection map introduced by D'Angelo is applied to deduce simpler descriptions of nondegeneracy conditions for sphere maps and to the study of infinitesimal deformations of sphere maps. It is shown that the dimension of the space of infinitesimal deformations of a nondegenerate sphere map is bounded from above by the explicitly computed dimension of the space of infinitesimal deformations of the homogeneous sphere map. Moreover a characterization of the homogeneous sphere map in terms of infinitesimal deformations is provided.


title: Relativistic bubble collisions -- a closer look

abstract: We study scalar bubble collisions in first-order phase transitions focusing on the relativistic limit. We propose 'trapping equation' which describes the wall behavior after collision, and test it with numerical simulations in several setups. We also examine the energy dynamics after collision and discuss its implications to gravitational wave production.


title: Flexibly Fair Representation Learning by Disentanglement

abstract: We consider the problem of learning representations that achieve group and subgroup fairness with respect to multiple sensitive attributes. Taking inspiration from the disentangled representation learning literature, we propose an algorithm for learning compact representations of datasets that are useful for reconstruction and prediction, but are also \emph{flexibly fair}, meaning they can be easily modified at test time to achieve subgroup demographic parity with respect to multiple sensitive attributes and their conjunctions. We show empirically that the resulting encoder---which does not require the sensitive attributes for inference---enables the adaptation of a single representation to a variety of fair classification tasks with new target labels and subgroup definitions.


title: Linear and Quadratic Discriminant Analysis: Tutorial

abstract: This tutorial explains Linear Discriminant Analysis (LDA) and Quadratic Discriminant Analysis (QDA) as two fundamental classification methods in statistical and probabilistic learning. We start with the optimization of decision boundary on which the posteriors are equal. Then, LDA and QDA are derived for binary and multiple classes. The estimation of parameters in LDA and QDA are also covered. Then, we explain how LDA and QDA are related to metric learning, kernel principal component analysis, Mahalanobis distance, logistic regression, Bayes optimal classifier, Gaussian naive Bayes, and likelihood ratio test. We also prove that LDA and Fisher discriminant analysis are equivalent. We finally clarify some of the theoretical concepts with simulations we provide.


title: On the Use of Information Retrieval to Automate the Detection of Third-Party Java Library Migration at the Method Level

abstract: The migration process between different third-party libraries is hard, complex and error-prone. Typically, during a library migration, developers need to find methods in the new library that are most adequate in replacing the old methods of the retired library. This process is subjective and time-consuming as developers need to fully understand the documentation of both libraries Application Programming Interfaces, and find the right matching between their methods if it exists. In this context, several studies rely on mining existing library migrations to provide developers with by-example approaches for similar scenarios. In this paper, we introduce a novel mining approach that extracts existing instances of library method replacements that are manually performed by developers for a given library migration to automatically generate migration patterns in the method level. Thereafter, our approach combines the mined method-change patterns with method-related lexical similarity to accurately detect mappings between replacing/replaced methods. We conduct a large scale empirical study to evaluate our approach on a benchmark of 57,447 open-source Java projects leading to 9 popular library migrations. Our qualitative results indicate that our approach significantly increases the accuracy of mining method-level mappings by an average accuracy of 12%, as well as increasing the number of discovered method mappings, in comparison with existing state-of-the-art studies. Finally, we provide the community with an open source mining tool along with a dataset of all mined migrations at the method level.


title: Light (anti)nuclei production in Cu+Cu collisions at $\sqrt{s_{\rm{NN}}}=200$GeV

abstract: The production of light (anti)nuclei have been investigated using the dynamically constrained phase-space coalescence model based on the final-state hadrons generated by the PACIAE model in Cu+Cu collisions at $\sqrt{s_{\rm{NN}}}=200$GeV with $|\eta|<0.5$ and $0<p_T<8$GeV/c. The results show that there is a strong centrality dependence of yields of $\rm d$, $\rm\overline d$, $\rm ^3He$, $\rm^3\overline {He}$, $\rm ^4He$, and $\rm^4\overline {He}$, i.e., their yields decrease rapidly with the increase of centrality, and the greater the mass is, the greater the dependence shows; whereas their ratio of antinucleus to nucleus and coalescence parameter $B_A$ remain constant as the centrality increases. In addition, the yields of (anti)nuclei are strongly dependent on the mass of the (anti)nuclei, indicating that the (anti)nuclei produced have mass scaling properties in high-energy heavy-ion collisions. Our results are consistent with the STAR experimental data.


title: Choke flutter instability sources tracking with linearized calculations

abstract: Purpose :The choke flutter is a fluid-structure interaction that can lead to the failure of fan or compressor blade in turbojet engines. In Ultra High Bypass Ratio (UHBR) fan, the choke flutter appears at part speed regimes and at low or negative incidence when a strong shock-wave chokes the blade to blade channel. Localization of main excitation sources and the understanding of the different work exchange mechanisms will help to avoid deficient and dangerous fan design. Design/methodology/approach :In this paper, an UHBR fan is analyzed using a time-linearized Reynolds-Averaged Navier-Stokes equation solver to investigate the choke flutter. The steady state and the imposed vibration (inter blade phase angle, reduced frequency and mode shape) are selected to be in choke flutter situation. Superposition principle induced by the linearization allow to decompose the blade in numerous small subsections to track the contribution of each local vibration to the global damping. All simulations have been performed on a 2D blade to blade extraction. Findings :Result analysis points to a restricted number of excitation sources at the trailing edge which induce a large part of the work exchange in a limited region of the airfoil. Main phenomena suspected are the shock-wave motion and the shock-wave/boundary layer interaction. Originality/value :An original excitation source tracking methodology allowed by the linearized calculation is addressed and applied to a UHBR fan test-case.


title: Quaternion Collaborative Filtering for Recommendation

abstract: This paper proposes Quaternion Collaborative Filtering (QCF), a novel representation learning method for recommendation. Our proposed QCF relies on and exploits computation with Quaternion algebra, benefiting from the expressiveness and rich representation learning capability of Hamilton products. Quaternion representations, based on hypercomplex numbers, enable rich inter-latent dependencies between imaginary components. This encourages intricate relations to be captured when learning user-item interactions, serving as a strong inductive bias as compared with the real-space inner product. All in all, we conduct extensive experiments on six real-world datasets, demonstrating the effectiveness of Quaternion algebra in recommender systems. The results exhibit that QCF outperforms a wide spectrum of strong neural baselines on all datasets. Ablative experiments confirm the effectiveness of Hamilton-based composition over multi-embedding composition in real space.


title: On the Effectiveness of Laser Speckle Contrast Imaging and Deep Neural Networks for Detecting Known and Unknown Fingerprint Presentation Attacks

abstract: Fingerprint presentation attack detection (FPAD) is becoming an increasingly challenging problem due to the continuous advancement of attack techniques, which generate `realistic-looking' fake fingerprint presentations. Recently, laser speckle contrast imaging (LSCI) has been introduced as a new sensing modality for FPAD. LSCI has the interesting characteristic of capturing the blood flow under the skin surface. Toward studying the importance and effectiveness of LSCI for FPAD, we conduct a comprehensive study using different patch-based deep neural network architectures. Our studied architectures include 2D and 3D convolutional networks as well as a recurrent network using long short-term memory (LSTM) units. The study demonstrates that strong FPAD performance can be achieved using LSCI. We evaluate the different models over a new large dataset. The dataset consists of 3743 bona fide samples, collected from 335 unique subjects, and 218 presentation attack samples, including six different types of attacks. To examine the effect of changing the training and testing sets, we conduct a 3-fold cross validation evaluation. To examine the effect of the presence of an unseen attack, we apply a leave-one-attack out strategy. The FPAD classification results of the networks, which are separately optimized and tuned for the temporal and spatial patch-sizes, indicate that the best performance is achieved by LSTM.


title: Learning Pugachev's Cobra Maneuver for Tail-sitter UAVs Using Acceleration Model

abstract: The Pugachev's cobra maneuver is a dramatic and demanding maneuver requiring the aircraft to fly at extremely high Angle of Attacks (AOA) where stalling occurs. This paper considers this maneuver on tail-sitter UAVs. We present a simple yet very effective feedback-iterative learning position control structure to regulate the altitude error and lateral displacement during the maneuver. Both the feedback controller and the iterative learning controller are based on the aircraft acceleration model, which is directly measurable by the onboard accelerometer. Moreover, the acceleration model leads to an extremely simple dynamic model that does not require any model identification in designing the position controller, greatly simplifying the implementation of the iterative learning control. Real-world outdoor flight experiments on the "Hong Hu" UAV, an aerobatic yet efficient quadrotor tail-sitter UAV of small-size, are provided to show the effectiveness of the proposed controller.


title: Thermalization/Relaxation in integrable and free field theories: an Operator Thermalization Hypothesis

abstract: Free or integrable theories are usually considered to be too constrained to thermalize. For example, the retarded two-point function of a free field, even in a thermal state, does not decay to zero at long times. On the other hand, the magnetic susceptibility of the critical transverse field Ising is known to thermalize, even though that theory can be mapped by a Jordan-Wigner transformation to that of free fermions. We reconcile these two statements by clarifying under which conditions conserved charges can prevent relaxation at the level of linear response and how such obstruction can be overcome. In particular, we give a necessary condition for the decay of retarded Green's functions. We give explicit examples of composite operators in free theories that nevertheless satisfy that condition and therefore do thermalize. We call this phenomenon the Operator Thermalization Hypothesis as a converse to the Eigenstate Thermalization Hypothesis.

categories: cond-mat.stat-mech cond-mat.str-el hep-th quant-ph


title: Unified framework for modeling multivariate distributions in biological sequences

abstract: Revealing the functional sites of biological sequences, such as evolutionary conserved, structurally interacting or co-evolving protein sites, is a fundamental, and yet challenging task. Different frameworks and models were developed to approach this challenge, including Position-Specific Scoring Matrices, Markov Random Fields, Multivariate Gaussian models and most recently Autoencoders. Each of these methods has certain advantages, and while they have generated a set of insights for better biological predictions, these have been restricted to the corresponding methods and were difficult to translate to the complementary domains. Here we propose a unified framework for the above-mentioned models, that allows for interpretable transformations between the different methods and naturally incorporates the advantages and insight gained individually in the different communities. We show how, by using the unified framework, we are able to achieve state-of-the-art performance for protein structure prediction, while enhancing interpretability of the prediction process.


title: New Features in the Second Version of the Cadabra Computer Algebra System

abstract: In certain scientific domains, there is a need for tensor operations. To facilitate tensor computations,computer algebra systems are employed. In our research, we have been using Cadabra as the main computer algebra system for several years. Recently, an operable second version of this software was released. In this version, a number of improvements were made that can be regarded as revolutionary ones. The most significant improvements are the implementation of component computations and the change in the ideology of the Cadabra's software mechanism as compared to the first version. This paper provides a brief overview of the key improvements in the Cadabra system.


title: An efficient data-driven solver for Fokker-Planck equations: algorithm and analysis

abstract: Computing the invariant probability measure of a randomly perturbed dynamical system usually means solving the stationary Fokker-Planck equation. This paper studies several key properties of a novel data-driven solver for low-dimensional Fokker-Planck equations proposed in [15]. Based on these results, we propose a new `block solver' for the stationary Fokker-Planck equation, which significantly improves the performance of the original algorithm. Some possible ways of reducing numerical artifacts caused by the block solver are discussed and tested with examples.


title: Micromechanics of high pressure compaction in granular quartz aggregates

abstract: The mechanical behaviour of porous sandstones is generally modelled using concepts from granular mechanics, often overlooking the effect of cementation. To probe the key differences between sand and sandstone mechanics, we performed triaxial deformation experiments on Ottawa quartz sand at $5-40$ MPa effective confining pressure. At $5$ MPa, the samples are able to dilate. At higher confinement, the aggregates show continuous compaction, displaying strain hardening. The stress-strain behaviour is non-linear and the exact onset of inelastic compaction could not be determined accurately. Measured P-wave velocities show the development of anisotropy. With increasing axial strain, the along-axis velocities tend to increase, while velocities perpendicular to the compression axis tend to decrease (at low pressure) or remain constant (at high pressure). In samples deformed under elevated pressure conditions, acoustic emission event locations are diffuse. Microstructural investigations show an increase in grain chipping and crushing with increasing confining pressure, but no evidence of localised compaction could be observed. The nature of the pore-fluid, either decane or water, does not significantly influence the mechanical behaviour at strain rates of $10^{-6}$ to $10^{-4}$ $s^{-1}$. Grain angularity and grain-size distribution also did not significantly change the mechanical behaviour. We infer that our observations indicate that the lack of cementation introduces additional degrees of freedom for grains to slide, rotate, and reorganise at the sample-scale, precluding the existence and sustainability of stress concentrations beyond the grain-scale. This results in progressive compaction and hardening, and lack of compaction localisation.


title: Circular automata synchronize with high probability

abstract: In this paper we prove that a uniformly distributed random circular automaton $\mathcal{A}_n$ of order $n$ synchronizes with high probability (whp). More precisely, we prove that $$ \mathbb{P}\left[\mathcal{A}_n \text{ synchronizes}\right] = 1- O\left(\frac{1}{n}\right). $$ The main idea of the proof is to translate the synchronization problem into properties of a random matrix; these properties are then handled with tools of the probabilistic method. Additionally, we provide an upper bound for the probability of synchronization of circular automata in terms of chromatic polynomials of circulant graphs.


title: The first order statistics of backscatter from the fractal branching vasculature

abstract: The issue of speckle statistics from ultrasound images of soft tissues such as the liver has a long and rich history. A number of theoretical distributions, some related to random scatterers or fades in optics and radar, have been formulated for pulse-echo interference patterns. This work proposes an alternative framework in which the dominant echoes are presumed to result from Born scattering from fluid filled vessels that permeate the tissue parenchyma. These are modeled as a branching, fractal, self-similar, multi scale collection of cylindrical scatterers governed by a power law distribution relating the number of branches at each radius. A deterministic accounting of the echo envelopes across the scales from small to large is undertaken, leading to a closed form theoretical formula for the histogram of the envelope of the echoes. The normalized histogram is found to be related to the classical Burr distribution, with the key power law parameter directly related to that of the number density of vessels vs. diameter, frequently reported in the range of 2 to 4. Examples are given from liver scans to demonstrate the applicability of the theory.


title: Readout of fluorescence functional signals through highly scattering tissue

abstract: Fluorescence is a powerful mean to probe information processing in the mammalian brain. However, neuronal tissues are highly heterogeneous and thus opaque to light. A wide set of non-invasive or invasive techniques for scattered light rejection, optical sectioning or localized excitation, have been developed, but non-invasive optical recording of activity through highly scattering layer beyond the ballistic regime is to date impossible. Here, we show that functional signals from fluorescent time-varying sources located below an highly scattering tissue can be retrieved efficiently, by exploiting matrix factorization algorithms to demix this information from low contrast fluorescence speckle patterns.


title: Multi-Frequency Vector Diffusion Maps

abstract: We introduce multi-frequency vector diffusion maps (MFVDM), a new framework for organizing and analyzing high dimensional datasets. The new method is a mathematical and algorithmic generalization of vector diffusion maps (VDM) and other non-linear dimensionality reduction methods. MFVDM combines different nonlinear embeddings of the data points defined with multiple unitary irreducible representations of the alignment group that connect two nodes in the graph. We illustrate the efficacy of MFVDM on synthetic data generated according to a random graph model and cryo-electron microscopy image dataset. The new method achieves better nearest neighbor search and alignment estimation than the state-of-the-arts VDM and diffusion maps (DM) on extremely noisy data.


title: Impact of Prior Knowledge and Data Correlation on Privacy Leakage: A Unified Analysis

abstract: It has been widely understood that differential privacy (DP) can guarantee rigorous privacy against adversaries with arbitrary prior knowledge. However, recent studies demonstrate that this may not be true for correlated data, and indicate that three factors could influence privacy leakage: the data correlation pattern, prior knowledge of adversaries, and sensitivity of the query function. This poses a fundamental problem: what is the mathematical relationship between the three factors and privacy leakage? In this paper, we present a unified analysis of this problem. A new privacy definition, named \textit{prior differential privacy (PDP)}, is proposed to evaluate privacy leakage considering the exact prior knowledge possessed by the adversary. We use two models, the weighted hierarchical graph (WHG) and the multivariate Gaussian model to analyze discrete and continuous data, respectively. We demonstrate that positive, negative, and hybrid correlations have distinct impacts on privacy leakage. Considering general correlations, a closed-form expression of privacy leakage is derived for continuous data, and a chain rule is presented for discrete data. Our results are valid for general linear queries, including count, sum, mean, and histogram. Numerical experiments are presented to verify our theoretical analysis.


title: Complete optical valley polarization in Weyl semimetals in strong magnetic fields

abstract: We present a theory of an optically induced valley polarization in an interacting, time-reversal symmetric Weyl semimetal placed under strong magnetic fields. Because the application of a magnetic field reduces the symmetry of the crystal, the optical absorption intensity differs at Weyl nodes that were equivalent by symmetry at zero field. At strong magnetic field, the difference in the absorption intensity reaches 100% for a sizeable frequency interval of the incident light. This complete valley polarization originates from interband transitions involving the chiral Landau level, and can be controlled by changing the directions of the magnetic field and the light propagation. We identify the splitting of $0\to 1$ or $-1\to 0$ inter Landau level transitions as an observable signature of the complete valley polarization, and discuss its manifestation in the TaAs family of materials.


title: Hamiltonian descent for composite objectives

abstract: In optimization the duality gap between the primal and the dual problems is a measure of the suboptimality of any primal-dual point. In classical mechanics the equations of motion of a system can be derived from the Hamiltonian function, which is a quantity that describes the total energy of the system. In this paper we consider a convex optimization problem consisting of the sum of two convex functions, sometimes referred to as a composite objective, and we identify the duality gap to be the 'energy' of the system. In the Hamiltonian formalism the energy is conserved, so we add a contractive term to the standard equations of motion so that this energy decreases linearly (i.e., geometrically) with time. This yields a continuous-time ordinary differential equation (ODE) in the primal and dual variables which converges to zero duality gap, i.e., optimality. This ODE has several useful properties: it induces a natural operator splitting; at convergence it yields both the primal and dual solutions; and it is invariant to affine transformation despite only using first order information. We provide several discretizations of this ODE, some of which are new algorithms and others correspond to known techniques, such as the alternating direction method of multipliers (ADMM). We conclude with some numerical examples that show the promise of our approach. We give an example where our technique can solve a convex quadratic minimization problem orders of magnitude faster than several commonly-used gradient methods, including conjugate gradient, when the conditioning of the problem is poor. Our framework provides new insights into previously known algorithms in the literature as well as providing a technique to generate new primal-dual algorithms.


title: Double phase transonic flow problems with variable growth: nonlinear patterns and stationary waves

abstract: In this paper we are concerned with a class of double phase energy functionals arising in the theory of transonic flows. Their main feature is that the associated Euler equation is driven by the Baouendi-Grushin operator with variable coefficient. This partial differential equation is of mixed type and possesses both elliptic and hyperbolic regions. After establishing a weighted inequality for the Baouendi-Grushin operator and a related compactness property, we establish the existence of stationary waves under arbitrary perturbations of the reaction.


title: The early life of millisecond magnetars

abstract: Some neutron stars may be born spinning fast and with strong magnetic fields---the so-called \emph{millisecond magnetars}. It is important to understand how a star's magnetic axis moves with respect to the spin axis in the star's early life, as this effects both electromagnetic and gravitational wave emission. Previous studies have highlighted the importance of viscous dissipation within the star in this process. We advance this program by additionally considering the effect of the electromagnetic torque. We find an interesting interplay between the viscous dissipation, which makes the magnetic axis orthogonalise with respect to the spin, verses magnetic torques that tend to make the magnetic axis align with the spin axis. We present some results, and highlight areas where our model needs to be made more realistic.


title: Improving Robustness Without Sacrificing Accuracy with Patch Gaussian Augmentation

abstract: Deploying machine learning systems in the real world requires both high accuracy on clean data and robustness to naturally occurring corruptions. While architectural advances have led to improved accuracy, building robust models remains challenging. Prior work has argued that there is an inherent trade-off between robustness and accuracy, which is exemplified by standard data augment techniques such as Cutout, which improves clean accuracy but not robustness, and additive Gaussian noise, which improves robustness but hurts accuracy. To overcome this trade-off, we introduce Patch Gaussian, a simple augmentation scheme that adds noise to randomly selected patches in an input image. Models trained with Patch Gaussian achieve state of the art on the CIFAR-10 and ImageNetCommon Corruptions benchmarks while also improving accuracy on clean data. We find that this augmentation leads to reduced sensitivity to high frequency noise(similar to Gaussian) while retaining the ability to take advantage of relevant high frequency information in the image (similar to Cutout). Finally, we show that Patch Gaussian can be used in conjunction with other regularization methods and data augmentation policies such as AutoAugment, and improves performance on the COCO object detection benchmark.


title: Self-intersecting interfaces for stationary solutions of the two-fluid Euler equations

abstract: We prove that there are stationary solutions to the 2D incompressible free boundary Euler equations with two fluids, possibly with a small gravity constant, that feature a splash singularity. More precisely, in the solutions we construct the interface is a $C^{2,\alpha}$ smooth curve that intersects itself at one point, and the vorticity density on the interface is of class $C^\alpha$. The proof consists in perturbing Crapper's family of formal stationary solutions with one fluid, so the crux is to introduce a small but positive second-fluid density. To do so, we use a novel set of weighted estimates for self-intersecting interfaces that squeeze an incompressible fluid. These estimates will also be applied to interface evolution problems in a forthcoming paper.


title: Bad Global Minima Exist and SGD Can Reach Them

abstract: Several works have aimed to explain why overparameterized neural networks generalize well when trained by Stochastic Gradient Descent (SGD). The consensus explanation that has emerged credits the randomized nature of SGD for the bias of the training process towards low-complexity models and, thus, for implicit regularization. We take a careful look at this explanation in the context of image classification with common deep neural network architectures. We find that if we do not regularize \emph{explicitly}, then SGD can be easily made to converge to poorly-generalizing, high-complexity models: all it takes is to first train on a random labeling on the data, before switching to properly training with the correct labels. In contrast, we find that in the presence of explicit regularization, pretraining with random labels has no detrimental effect on SGD. We believe that our results give evidence that explicit regularization plays a far more important role in the success of overparameterized neural networks than what has been understood until now. Specifically, by penalizing complicated models independently of their fit to the data, regularization affects training dynamics also far away from optima, making simple models that fit the data well discoverable by local methods, such as SGD.