title: Double Double Descent: On Generalization Errors in Transfer Learning between Linear Regression Tasks

abstract: We study the transfer learning process between two linear regression problems. An important and timely special case is when the regressors are overparameterized and perfectly interpolate their training data. We examine a parameter transfer mechanism whereby a subset of the parameters of the target task solution are constrained to the values learned for a related source task. We analytically characterize the generalization error of the target task in terms of the salient factors in the transfer learning architecture, i.e., the number of examples available, the number of (free) parameters in each of the tasks, the number of parameters transferred from the source to target task, and the relation between the two tasks. Our non-asymptotic analysis shows that the generalization error of the target task follows a two-dimensional double descent trend (with respect to the number of free parameters in each of the tasks) that is controlled by the transfer learning factors. Our analysis points to specific cases where the transfer of parameters is beneficial as a substitute for extra overparameterization (i.e., additional free parameters in the target task). Specifically, we show that the usefulness of a transfer learning setting is fragile and depends on a delicate interplay among the set of transferred parameters, the relation between the tasks, and the true solution. We also demonstrate that overparameterized transfer learning is not necessarily more beneficial when the source task is closer or identical to the target task.


title: Lonely planets and light belts: the Statistical Mechanics of Gravitational Systems

abstract: In this paper we propose a notion of stability, that we call $\epsilon -N$-stability, for systems of particles interacting via Newton's gravitational potential, and orbiting a much bigger object. For these systems the usual thermodynamical stability condition, ensuring the possibility to perform the thermodynamical limit, fails, but one can use as relevant parameter the maximum number of particles $N$ that guarantees the $\epsilon -N$-stability. With some judicious but not particularly optimized estimates, borrowed from the classical theory of equilibrium statistical mechanics, we show that our model has a good fit with the data observed in the Solar System, and it gives a reasonable interpretation of some of its global properties.


title: On the Impact of Finite-Length Probabilistic Shaping on Fiber Nonlinear Interference

abstract: The interplay of shaped signaling and fiber nonlinearities is reviewed in the asymptotic and finite-length regime. We present explanations and discuss implications of an optimum shaping length of just a few hundred symbols.


title: Tailoring femtosecond hot-electron pulses for ultrafast spin manipulation

abstract: We have measured the hot-electron induced demagnetization of a [Co/Pt]2 multilayer in M(x nm)/Cu(100 nm)/[Co(0.6 nm)/Pt(1.1 nm)]2 samples depending on the nature of the capping layer M and its thickness x. We found out that a Pt layer is more efficient than [Co/Pt]X, Cu or MgO layers in converting IR photon pulses into hot-electron pulses at a given laser power. We also found out that the maximum relative demagnetization amplitude is reached for M(x) = Pt (7 nm). Our experimental results show qualitative agreement with numerical simulations based on the superdiffusive spin transport model. We concluded that the maximum relative demagnetization amplitude, which corresponds to the highest photon conversion into hot-electrons, is an interplay between the IR penetration depth and the hot-electron inelastic mean free path within the capping layer.


title: Weakly-supervised Temporal Action Localization by Uncertainty Modeling

abstract: Weakly-supervised temporal action localization aims to learn detecting temporal intervals of action classes with only video-level labels. To this end, it is crucial to separate frames of action classes from the background frames (i.e., frames not belonging to any action classes). In this paper, we present a new perspective on background frames where they are modeled as out-of-distribution samples regarding their inconsistency. Then, background frames can be detected by estimating the probability of each frame being out-of-distribution, known as uncertainty, but it is infeasible to directly learn uncertainty without frame-level labels. To realize the uncertainty learning in the weakly-supervised setting, we leverage the multiple instance learning formulation. Moreover, we further introduce a background entropy loss to better discriminate background frames by encouraging their in-distribution (action) probabilities to be uniformly distributed over all action classes. Experimental results show that our uncertainty modeling is effective at alleviating the interference of background frames and brings a large performance gain without bells and whistles. We demonstrate that our model significantly outperforms state-of-the-art methods on the benchmarks, THUMOS'14 and ActivityNet (1.2 & 1.3). Our code is available at https://github.com/Pilhyeon/WTAL-Uncertainty-Modeling.


title: Channel covariance estimation in multiuser massive MIMO systems with an approach based on infinite dimensional Hilbert spaces

abstract: We propose a novel algorithm to estimate the channel covariance matrix of a desired user in multiuser massive MIMO systems. The algorithm uses only knowledge of the array response and rough knowledge of the angular support of the incoming signals, which are assumed to be separated in a well-defined sense. To derive the algorithm, we study interference patterns with realistic models that treat signals as continuous functions in infinite dimensional Hilbert spaces. By doing so, we can avoid common and unnatural simplifications such as the presence of discrete signals, ideal isotropic antennas, and infinitely large antenna arrays. An additional advantage of the proposed algorithm is its computational simplicity: it only requires a single matrix-vector multiplication. In some scenarios, simulations show that the estimates obtained with the proposed algorithm are close to those obtained with standard estimation techniques operating in interference-free and noiseless systems.


title: Besov spaces associated with non-negative operators on Banach spaces

abstract: Motivated by a variety of representations of fractional powers of operators, we develop the theory of abstract Besov spaces $B^{ s, A }_{ q, X }$ for non-negative operators $A$ on Banach spaces $X$ with a full range of indices $s \in \mathbb{R}$ and $0 < q \leq \infty$. The approach we use is the dyadic decomposition of resolvents for non-negative operators, an analogue of the Littlewood-Paley decomposition in the construction of the classical Besov spaces. In particular, by using the reproducing formulas for fractional powers of operators and explicit quasi-norms estimates for Besov spaces we discuss the connections between the smoothness of Besov spaces associated with operators and the boundedness of fractional powers of the underlying operators.


title: Space quasiconformal composition operators with applications to Neumann eigenvalues

abstract: In this article we obtain estimates of Neumann eigenvalues of $p$-Laplace operators in a large class of space domains satisfying quasihyperbolic boundary conditions. The suggested method is based on composition operators generated by quasiconformal mappings and their applications to Sobolev-Poincar\'e-inequalities. By using a sharp version of the inverse H\"older inequality we refine our estimates for quasi-balls, that is, images of balls under quasiconformal mappings of the whole space.


title: Efficient determination of HPGe {\gamma}-ray efficiencies at high energies with ready-to-use simulation software

abstract: The full-energy-peak efficiency of HPGe detectors at $\gamma$-ray energies around 10 MeV is not easily accessible with experimental methods. Monte-Carlo simulations with Geant4 can provide these efficiencies. G4Horus is a ready-to-use Geant4 application for the HORUS HPGe-detector array. Users can configure the modular parts to match their experiment with minimal knowledge of the simulation software and limited time commitment. In our case, knowing and implementing the geometry with high precision is the biggest challenge. To implement the different target chambers, we transform the existing CAD models to Geant4 geometry with CADMesh. We also found a large discrepancy between experimental and simulated efficiency for some older HPGe detectors, which could be remedied by introducing a large dead region around the inner core. This project is open source and available from https://github.com/janmayer/G4Horus We invite everyone to adapt the project or adopt parts of the code for other projects.


title: Shear measurement bias II: a fast machine learning calibration method

abstract: We present a new shear calibration method based on machine learning. The method estimates the individual shear responses of the objects from the combination of several measured properties on the images using supervised learning. The supervised learning uses the true individual shear responses obtained from copies of the image simulations with different shear values. On simulated GREAT3data, we obtain a residual bias after the calibration compatible with 0 and beyond Euclid requirements for a signal-to-noise ratio > 20 within ~15 CPU hours of training using only ~10^5 objects. This efficient machine-learning approach can use a smaller data set because the method avoids the contribution from shape noise. The low dimensionality of the input data also leads to simple neural network architectures. We compare it to the recently described method Metacalibration, which shows similar performances. The different methods and systematics suggest that the two methods are very good complementary methods. Our method can therefore be applied without much effort to any survey such as Euclid or the Vera C. Rubin Observatory, with fewer than a million images to simulate to learn the calibration function.


title: Evidence for magnon-phonon coupling in the topological magnet Cu$_3$TeO$_6$

abstract: We perform thermodynamic and inelastic neutron scattering (INS) measurements to study the lattice dynamics (phonons) of a cubic collinear antiferromagnet Cu$_3$TeO$_6$ which hosts topological spin excitations (magnons). While the specific heat and thermal conductivity results show that the thermal transport is dominated by phonons, the deviation of the thermal conductivity from a pure phononic model indicates that there is a strong coupling between magnons and phonons. In the INS measurements, we find a mode in the excitation spectra at 4.5 K, which exhibits a slight downward dispersion around the Brillouin zone center. This mode disappears above the N\'{e}el temperature, and thus cannot be a phonon. Furthermore, the dispersion is distinct from that of a magnon. Instead, it can be explained by the magnon-polaron mode, which is new collective excitations resulting from the hybridization between magnons and phonons. We consider the suppression of the thermal conductivity and emergence of the magnon-polaron mode to be evidence for magnon-phonon coupling in Cu$_3$TeO$_6$.


title: A Unified Analysis of Stochastic Gradient Methods for Nonconvex Federated Optimization

abstract: In this paper, we study the performance of a large family of SGD variants in the smooth nonconvex regime. To this end, we propose a generic and flexible assumption capable of accurate modeling of the second moment of the stochastic gradient. Our assumption is satisfied by a large number of specific variants of SGD in the literature, including SGD with arbitrary sampling, SGD with compressed gradients, and a wide variety of variance-reduced SGD methods such as SVRG and SAGA. We provide a single convergence analysis for all methods that satisfy the proposed unified assumption, thereby offering a unified understanding of SGD variants in the nonconvex regime instead of relying on dedicated analyses of each variant. Moreover, our unified analysis is accurate enough to recover or improve upon the best-known convergence results of several classical methods, and also gives new convergence results for many new methods which arise as special cases. In the more general distributed/federated nonconvex optimization setup, we propose two new general algorithmic frameworks differing in whether direct gradient compression (DC) or compression of gradient differences (DIANA) is used. We show that all methods captured by these two frameworks also satisfy our unified assumption. Thus, our unified convergence analysis also captures a large variety of distributed methods utilizing compressed communication. Finally, we also provide a unified analysis for obtaining faster linear convergence rates in this nonconvex regime under the PL condition.


title: How many winning tickets are there in one DNN?

abstract: The recent lottery ticket hypothesis proposes that there is one sub-network that matches the accuracy of the original network when trained in isolation. We show that instead each network contains several winning tickets, even if the initial weights are fixed. The resulting winning sub-networks are not instances of the same network under weight space symmetry, and show no overlap or correlation significantly larger than expected by chance. If randomness during training is decreased, overlaps higher than chance occur, even if the networks are trained on different tasks. We conclude that there is rather a distribution over capable sub-networks, as opposed to a single winning ticket.


title: Speaker Sensitive Response Evaluation Model

abstract: Automatic evaluation of open-domain dialogue response generation is very challenging because there are many appropriate responses for a given context. Existing evaluation models merely compare the generated response with the ground truth response and rate many of the appropriate responses as inappropriate if they deviate from the ground truth. One approach to resolve this problem is to consider the similarity of the generated response with the conversational context. In this paper, we propose an automatic evaluation model based on that idea and learn the model parameters from an unlabeled conversation corpus. Our approach considers the speakers in defining the different levels of similar context. We use a Twitter conversation corpus that contains many speakers and conversations to test our evaluation model. Experiments show that our model outperforms the other existing evaluation metrics in terms of high correlation with human annotation scores. We also show that our model trained on Twitter can be applied to movie dialogues without any additional training. We provide our code and the learned parameters so that they can be used for automatic evaluation of dialogue response generation models.


title: Distance-based phylogenetic inference from typing data: a unifying view

abstract: Typing methods are widely used in the surveillance of infectious diseases, outbreaks investigation and studies of the natural history of an infection. And their use is becoming standard, in particular with the introduction of High Throughput Sequencing (HTS). On the other hand, the data being generated is massive and many algorithms have been proposed for phylogenetic analysis of typing data, addressing both correctness and scalability issues. Most of the distance-based algorithms for inferring phylogenetic trees follow the closest-pair joining scheme. This is one of the approaches used in hierarchical clustering. And although phylogenetic inference algorithms may seem rather different, the main difference among them resides on how one defines cluster proximity and on which optimization criterion is used. Both cluster proximity and optimization criteria rely often on a model of evolution. In this work we review, and we provide an unified view of these algorithms. This is an important step not only to better understand such algorithms, but also to identify possible computational bottlenecks and improvements, important to deal with large data sets.


title: Learning Effective Representations for Person-Job Fit by Feature Fusion

abstract: Person-job fit is to match candidates and job posts on online recruitment platforms using machine learning algorithms. The effectiveness of matching algorithms heavily depends on the learned representations for the candidates and job posts. In this paper, we propose to learn comprehensive and effective representations of the candidates and job posts via feature fusion. First, in addition to applying deep learning models for processing the free text in resumes and job posts, which is adopted by existing methods, we extract semantic entities from the whole resume (and job post) and then learn features for them. By fusing the features from the free text and the entities, we get a comprehensive representation for the information explicitly stated in the resume and job post. Second, however, some information of a candidate or a job may not be explicitly captured in the resume or job post. Nonetheless, the historical applications including accepted and rejected cases can reveal some implicit intentions of the candidates or recruiters. Therefore, we propose to learn the representations of implicit intentions by processing the historical applications using LSTM. Last, by fusing the representations for the explicit and implicit intentions, we get a more comprehensive and effective representation for person-job fit. Experiments over 10 months real data show that our solution outperforms existing methods with a large margin. Ablation studies confirm the contribution of each component of the fused representation. The extracted semantic entities help interpret the matching results during the case study.


title: Production of secondary particles in heavy nuclei interactions in supernova remnants

abstract: Depending on their type, supernova remnants may have ejecta material with high abundance of heavy elements such as carbon or oxygen. In addition, core-collapse supernovae explode in the wind material of their progenitor star that may also have a high abundance of heavy elements. Hadronic collisions in these enriched media spawn the production of gamma rays, neutrinos, and secondary electrons with spectra that cannot be scaled from those calculated for pp collisions, potentially leading to erroneous results. We used Monte-Carlo event generators to calculate the differential production rate of particles such as gamma rays, neutrinos, and secondary electrons for H, He, C, and O nuclei as projectiles and as target material. The cross sections and the multiplicity spectra are separately computed for each of the 16 combinations of projectile and target. We describe characteristic effects of heavy nuclei in the shape and normalization of the spectra of various particles produced.


title: Improved Fixed-Budget Results via Drift Analysis

abstract: Fixed-budget theory is concerned with computing or bounding the fitness value achievable by randomized search heuristics within a given budget of fitness function evaluations. Despite recent progress in fixed-budget theory, there is a lack of general tools to derive such results. We transfer drift theory, the key tool to derive expected optimization times, to the fixed-budged perspective. A first and easy-to-use statement concerned with iterating drift in so-called greed-admitting scenarios immediately translates into bounds on the expected function value. Afterwards, we consider a more general tool based on the well-known variable drift theorem. Applications of this technique to the LeadingOnes benchmark function yield statements that are more precise than the previous state of the art.


title: On Voronoi diagrams and dual Delaunay complexes on the information-geometric Cauchy manifolds

abstract: We study the Voronoi diagrams of a finite set of Cauchy distributions and their dual complexes from the viewpoint of information geometry by considering the Fisher-Rao distance, the Kullback-Leibler divergence, the chi square divergence, and a flat divergence derived from Tsallis' quadratic entropy related to the conformal flattening of the Fisher-Rao curved geometry. We prove that the Voronoi diagrams of the Fisher-Rao distance, the chi square divergence, and the Kullback-Leibler divergences all coincide with a hyperbolic Voronoi diagram on the corresponding Cauchy location-scale parameters, and that the dual Cauchy hyperbolic Delaunay complexes are Fisher orthogonal to the Cauchy hyperbolic Voronoi diagrams. The dual Voronoi diagrams with respect to the dual forward/reverse flat divergences amount to dual Bregman Voronoi diagrams, and their dual complexes are regular triangulations. The primal Bregman-Tsallis Voronoi diagram corresponds to the hyperbolic Voronoi diagram and the dual Bregman-Tsallis Voronoi diagram coincides with the ordinary Euclidean Voronoi diagram. Besides, we prove that the square root of the Kullback-Leibler divergence between Cauchy distributions yields a metric distance which is Hilbertian for the Cauchy scale families.


title: A benchmark study on reliable molecular supervised learning via Bayesian learning

abstract: Virtual screening aims to find desirable compounds from chemical library by using computational methods. For this purpose with machine learning, model outputs that can be interpreted as predictive probability will be beneficial, in that a high prediction score corresponds to high probability of correctness. In this work, we present a study on the prediction performance and reliability of graph neural networks trained with the recently proposed Bayesian learning algorithms. Our work shows that Bayesian learning algorithms allow well-calibrated predictions for various GNN architectures and classification tasks. Also, we show the implications of reliable predictions on virtual screening, where Bayesian learning may lead to higher success in finding hit compounds.


title: A Study of the Minimum Safe Distance between Human Driven and Driverless Cars Using Safe Distance Model

abstract: When driving,it is vital to maintain the right following distance between the vehicles to avoid rear-end collisions. The minimum safe distance depends on many factors, however, in this study the safe distance between the human-driven vehicles and a fully autonomous vehicle at a sudden stop by an automatic emergency brake was studied based on the human driver ability to react in an accident, the vehicles' braking system performance, and the speed of vehicles. For this approach, a safe distance car-following model was proposed to describe the safe distance between vehicles on a single lane dry road under conditions where both vehicles keep moving at a constant speed, and a lead autonomous vehicle suddenly stops by automatic emergency braking at an imminent incident. The proposed model then finally was being tested using MATLAB simulation, and results showed that confirmed the effectiveness of this model and the influence of driving speed and inter-vehicle distance on the rear-end collision was also indicated as well compared with the two and three seconds rule of safe following distance. The three seconds safe distance following rules is safe to be applied for all speed limits; however, the two seconds can be used on speed limits up to 45 Km/hr. A noticeable increase in rear-end collision was observed according to the simulation results if a car follows a driverless vehicle with two seconds rule above 45 km/hr.


title: Maximally flexible solutions of a random $K$-satisfiability formula

abstract: Random $K$-satisfiability ($K$-SAT) is a paradigmatic model system for studying phase transitions in constraint satisfaction problems and for developing empirical algorithms. The statistical properties of the random $K$-SAT solution space have been extensively investigated, but most earlier efforts focused on solutions that are typical. Here we consider maximally flexible solutions which satisfy all the constraints only using the minimum number of variables. Such atypical solutions have high internal entropy because they contain a maximum number of null variables which are completely free to choose their states. Each maximally flexible solution indicates a dense region of the solution space. We estimate the maximum fraction of null variables by the replica-symmetric cavity method, and implement message-passing algorithms to construct maximally flexible solutions for single $K$-SAT instances.


title: Provably Robust Metric Learning

abstract: Metric learning is an important family of algorithms for classification and similarity search, but the robustness of learned metrics against small adversarial perturbations is less studied. In this paper, we show that existing metric learning algorithms, which focus on boosting the clean accuracy, can result in metrics that are less robust than the Euclidean distance. To overcome this problem, we propose a novel metric learning algorithm to find a Mahalanobis distance that is robust against adversarial perturbations, and the robustness of the resulting model is certifiable. Experimental results show that the proposed metric learning algorithm improves both certified robust errors and empirical robust errors (errors under adversarial attacks). Furthermore, unlike neural network defenses which usually encounter a trade-off between clean and robust errors, our method does not sacrifice clean errors compared with previous metric learning methods. Our code is available at https://github.com/wangwllu/provably_robust_metric_learning.


title: Response to Office of the Privacy Commissioner of Canada Consultation Proposals pertaining to amendments to PIPEDA relative to Artificial Intelligence

abstract: In February 2020, the Montreal AI Ethics Institute (MAIEI) was invited by the Office of the Privacy Commissioner of Canada (OPCC) to provide for comments both at a closed roundtable and in writing on the OPCC consultation proposal for amendments relative to Artificial Intelligence (AI), to the Canadian privacy legislation, the Personal Information Protection and Electronic Documents Act (PIPEDA). The present document includes MAIEI comments and recommendations in writing. Per MAIEI's mission and mandate to act as a catalyst for public feedback pertaining to AI Ethics and regulatory technology developments, as well as to provide for public competence-building workshops on critical topics in such domains, the reader will also find such public feedback and propositions by Montrealers who participated at MAIEI's workshops, submitted as Schedule 1 to the present report. For each of OPCC 12 proposals, and underlying questions, as described on its website, MAIEI provides a short reply, a summary list of recommendations, as well as comments relevant to the question at hand. We leave you with three general statements to keep in mind while going through the next pages: 1) AI systems should be used to augment human capacity for meaningful and purposeful connections and associations, not as a substitute for trust. 2) Humans have collectively accepted to uphold the rule of law, but for machines, the code is rule. Where socio-technical systems are deployed to make important decisions, profiles or inferences about individuals, we will increasingly have to attempt the difficult exercise of drafting and encoding our law in a manner learnable by machines. 3) Let us work collectively towards a world where Responsible AI becomes the rule, before our socio-technical systems become "too connected to fail".


title: Backdoor Attacks on Federated Meta-Learning

abstract: Federated learning allows multiple users to collaboratively train a shared classification model while preserving data privacy. This approach, where model updates are aggregated by a central server, was shown to be vulnerable to poisoning backdoor attacks: a malicious user can alter the shared model to arbitrarily classify specific inputs from a given class. In this paper, we analyze the effects of backdoor attacks on federated meta-learning, where users train a model that can be adapted to different sets of output classes using only a few examples. While the ability to adapt could, in principle, make federated learning frameworks more robust to backdoor attacks (when new training examples are benign), we find that even 1-shot~attacks can be very successful and persist after additional training. To address these vulnerabilities, we propose a defense mechanism inspired by matching networks, where the class of an input is predicted from the similarity of its features with a support set of labeled examples. By removing the decision logic from the model shared with the federation, success and persistence of backdoor attacks are greatly reduced.


title: Seq2Tens: An Efficient Representation of Sequences by Low-Rank Tensor Projections

abstract: Sequential data such as time series, video, or text can be challenging to analyse as the ordered structure gives rise to complex dependencies. At the heart of this is non-commutativity, in the sense that reordering the elements of a sequence can completely change its meaning. We use a classical mathematical object -- the tensor algebra -- to capture such dependencies. To address the innate computational complexity of high degree tensors, we use compositions of low-rank tensor projections. This yields modular and scalable building blocks for neural networks that give state-of-the-art performance on standard benchmarks such as multivariate time series classification and generative models for video.


title: Ancilla-assisted probing of temporal quantum correlations of large spins

abstract: When measuring quantum spins at two or more different times, the later measurements are affected by measurement backaction occurring due to the earlier measurements. This makes the measurement of temporal quantum correlation functions challenging. In this paper, I propose a measurement protocol that mitigates the effect of measurement backaction by exploiting spin selection rules. I show that, under suitable conditions, the effect of measurement backaction on two-time quantum correlations becomes negligible when probing a system consisting of spins with large spin quantum numbers $l\gg s$ by coupling it to a spin-$s$ ancilla degree of freedom. A potential application of such a measurement protocol is the probing of an array of Bose-Einstein condensates by light.


title: Rethinking Sampling in 3D Point Cloud Generative Adversarial Networks

abstract: In this paper, we examine the long-neglected yet important effects of point sampling patterns in point cloud GANs. Through extensive experiments, we show that sampling-insensitive discriminators (e.g.PointNet-Max) produce shape point clouds with point clustering artifacts while sampling-oversensitive discriminators (e.g.PointNet++, DGCNN) fail to guide valid shape generation. We propose the concept of sampling spectrum to depict the different sampling sensitivities of discriminators. We further study how different evaluation metrics weigh the sampling pattern against the geometry and propose several perceptual metrics forming a sampling spectrum of metrics. Guided by the proposed sampling spectrum, we discover a middle-point sampling-aware baseline discriminator, PointNet-Mix, which improves all existing point cloud generators by a large margin on sampling-related metrics. We point out that, though recent research has been focused on the generator design, the main bottleneck of point cloud GAN actually lies in the discriminator design. Our work provides both suggestions and tools for building future discriminators. We will release the code to facilitate future research.


title: Occupation switching of $d$ orbitals probed via hyperfine interactions in vanadium dioxide

abstract: Metal-insulator transition was microscopically investigated by orbital-resolved nuclear magnetic resonance (OR-NMR) spectroscopy in a single crystal of vanadium dioxide VO$_2$. Observations of the anisotropic $^{51}$V Knight shift and the nuclear quadrupole frequency allow us to evaluate orbital-dependent spin susceptibility and $d$ orbital occupations. The result is consistent with the degenerated $t_{2g}$ orbitals in a correlated metallic phase and the $d$ orbital ordering in a nonmagnetic insulating phase. The predominant orbital pointing along the chain facilitates a spin-singlet formation triggering metal-insulator transition. The asymmetry of magnetic and electric hyperfine tensors suggests the $d$ orbital reformation favored by a low-symmetry crystal field, forming a localized molecular orbital. The result highlights the cooperative electron correlation and electron-phonon coupling in Mott transition with orbital degrees of freedom.


title: Almost Ricci-like solitons with torse-forming vertical potential of constant length on almost contact B-metric manifolds

abstract: A generalization of Ricci-like solitons with torse-forming potential, which is a constant multiple of the Reeb vector field, is studied. The conditions under which these solitons are equivalent to almost Einstein-like metrics are given. Some results are obtained for a parallel symmetric second-order covariant tensor. Finally, an explicit example of an arbitrary dimension is given and some of the results are illustrated.


title: Heavy-flavor PDF evolution and variable-flavor number scheme uncertainties in deep-inelastic scattering

abstract: We consider a detailed account on the construction of the heavy-quark parton distribution functions for charm and bottom, starting from $n_f=3$ light flavors in the fixed-flavor number (FFN) scheme and by using the standard decoupling relations for heavy quarks in QCD. We also account for two-mass effects. Furthermore, different implementations of the variable-flavor-number (VFN) scheme in deep-inelastic scattering (DIS) are studied, with the particular focus on the resummation of large logarithms in $Q^2/m_h^2$, the ratio the virtuality of the exchanged gauge-boson $Q^2$ to the heavy-quark mass squared $m_h^2$. A little impact of resummation effects if found in the kinematic range of the existing data on the DIS charm-quark production so that they can be described very well within the FFN scheme. Finally, we study the theoretical uncertainties associated to the VFN scheme, which manifest predominantly at small $Q^2$.


title: Scattering medium: randomly packed pinhole cameras

abstract: When light travels through scattering media, speckles (spatially random distribution of fluctuated intensities) are formed due to the interference of light travelling along different optical paths, preventing the perception of structure, absolute location and dimension of a target within or on the other side of the medium. Currently, the prevailing techniques such as wavefront shaping, optical phase conjugation, scattering matrix measurement, and speckle autocorrelation imaging can only picture the target structure in the absence of prior information. Here we show that a scattering medium can be conceptualized as an assembly of randomly packed pinhole cameras, and the corresponding speckle pattern is a superposition of randomly shifted pinhole images. This provides a new perspective to bridge target, scattering medium, and speckle pattern, allowing one to localize and profile a target quantitatively from speckle patterns perceived from the other side of the scattering medium, which is impossible with all existing methods. The method also allows us to interpret some phenomena of diffusive light that are otherwise challenging to understand. For example, why the morphological appearance of speckle patterns changes with the target, why information is difficult to be extracted from thick scattering media, and what determines the capability of seeing through scattering media. In summary, the concept, whilst in its infancy, opens a new door to unveiling scattering media and information extraction from scattering media in real time.


title: Benchmarking Unsupervised Object Representations for Video Sequences

abstract: Perceiving the world in terms of objects and tracking them through time is a crucial prerequisite for reasoning and scene understanding. Recently, several methods have been proposed for unsupervised learning of object-centric representations. However, since these models were evaluated on different downstream tasks, it remains unclear how they compare in terms of basic perceptual abilities such as detection, figure-ground segmentation and tracking of objects. To close this gap, we design a benchmark with four data sets of varying complexity and seven additional test sets featuring challenging tracking scenarios relevant for natural videos. Using this benchmark, we compare the perceptual abilities of four object-centric approaches: ViMON, a video-extension of MONet, based on recurrent spatial attention, OP3, which exploits clustering via spatial mixture models, as well as TBA and SCALOR, which use explicit factorization via spatial transformers. Our results suggest that the architectures with unconstrained latent representations learn more powerful representations in terms of object detection, segmentation and tracking than the spatial transformer based architectures. We also observe that none of the methods are able to gracefully handle the most challenging tracking scenarios despite their synthetic nature, suggesting that our benchmark may provide fruitful guidance towards learning more robust object-centric video representations.


title: Fast multi-qubit gates by adiabatic evolution in interacting excited state manifolds

abstract: Quantum computing and quantum simulation can be implemented by concatenation of one- and two-qubit gates and interactions. For most physical implementations, however, it may be advantageous to explore state components and interactions that depart from this universal paradigm and offer faster or more robust access to more advanced operations on the system. In this article, we show that adiabatic passage along the dark eigenstate of excitation exchange interactions can be used to implement fast multi-qubit Toffoli (C$_k$-NOT) and fan-out (C-NOT$^k$) gates. This mechanism can be realized by simultaneous excitation of atoms to Rydberg levels, featuring resonant exchange interaction. Our theoretical estimates and numerical simulations show that these multi-qubit Rydberg gates are possible with errors below 1% for up to 20 qubits. The excitation exchange mechanism is ubiquitous across experimental platforms and we show that similar multi-qubit gates can be implemented in superconducting circuits.


title: Approximate Inference for Spectral Mixture Kernel

abstract: A spectral mixture (SM) kernel is a flexible kernel used to model any stationary covariance function. Although it is useful in modeling data, the learning of the SM kernel is generally difficult because optimizing a large number of parameters for the SM kernel typically induces an over-fitting, particularly when a gradient-based optimization is used. Also, a longer training time is required. To improve the training, we propose an approximate Bayesian inference for the SM kernel. Specifically, we employ the variational distribution of the spectral points to approximate SM kernel with a random Fourier feature. We optimize the variational parameters by applying a sampling-based variational inference to the derived evidence lower bound (ELBO) estimator constructed from the approximate kernel. To improve the inference, we further propose two additional strategies: (1) a sampling strategy of spectral points to estimate the ELBO estimator reliably and thus its associated gradient, and (2) an approximate natural gradient to accelerate the convergence of the parameters. The proposed inference combined with two strategies accelerates the convergence of the parameters and leads to better optimal parameters.


title: Adaptive Gradient Methods Can Be Provably Faster than SGD after Finite Epochs

abstract: Adaptive gradient methods have attracted much attention of machine learning communities due to the high efficiency. However their acceleration effect in practice, especially in neural network training, is hard to analyze, theoretically. The huge gap between theoretical convergence results and practical performances prevents further understanding of existing optimizers and the development of more advanced optimization methods. In this paper, we provide adaptive gradient methods a novel analysis with an additional mild assumption, and revise AdaGrad to \radagrad for matching a better provable convergence rate. To find an $\epsilon$-approximate first-order stationary point in non-convex objectives, we prove random shuffling \radagrad achieves a $\tilde{O}(T^{-1/2})$ convergence rate, which is significantly improved by factors $\tilde{O}(T^{-1/4})$ and $\tilde{O}(T^{-1/6})$ compared with existing adaptive gradient methods and random shuffling SGD, respectively. To the best of our knowledge, it is the first time to demonstrate that adaptive gradient methods can deterministically be faster than SGD after finite epochs. Furthermore, we conduct comprehensive experiments to validate the additional mild assumption and the acceleration effect benefited from second moments and random shuffling.


title: Learning Graph Models for Retrosynthesis Prediction

abstract: Retrosynthesis prediction is a fundamental problem in organic synthesis, where the task is to identify precursor molecules that can be used to synthesize a target molecule. A key consideration in building neural models for this task is aligning model design with strategies adopted by chemists. Building on this viewpoint, this paper introduces a graph-based approach that capitalizes on the idea that the graph topology of precursor molecules is largely unaltered during a chemical reaction. The model first predicts the set of graph edits transforming the target into incomplete molecules called synthons. Next, the model learns to expand synthons into complete molecules by attaching relevant leaving groups. This decomposition simplifies the architecture, making its predictions more interpretable, and also amenable to manual correction. Our model achieves a top-1 accuracy of $53.7\%$, outperforming previous template-free and semi-template-based methods.


title: Analysis of Nonlinear Fiber Interactions for Finite-Length Constant-Composition Sequences

abstract: In order to realize probabilistically shaped signaling within the probabilistic amplitude shaping (PAS) framework, a shaping device outputs sequences that follow a certain nonuniform distribution. In case of constant-composition (CC) distribution matching (CCDM), the sequences differ only in the ordering of their constituent symbols, whereas the number of occurrences of each symbol is constant in every output block. Recent results by Amari \textit{et al.} have shown that the CCDM block length can have a considerable impact on the effective signal-to-noise ratio (SNR) after fiber transmission. So far, no explanation for this behavior has been presented. Furthermore, the block-length dependence of the SNR seems not to be fully aligned with previous results in the literature. This paper is devoted to a detailed analysis of the nonlinear fiber interactions for CC sequences. We confirm in fiber simulations the inverse proportionality of SNR with CCDM block length and present two explanations. The first one, which only holds in the short-length regime, is based on how two-dimensional symbols are generated from shaped amplitudes in the PAS framework. The second, more general explanation relates to an induced shuffling within a sequence, or equivalently a limited concentration of identical symbols, that is an inherent property for short CC blocks, yet not necessarily present for long blocks. This temporal property results in weaker nonlinear interactions, and thus higher SNR, for short CC sequences. For a typical multi-span fiber setup, the SNR difference is numerically demonstrated to be up to 0.7dB. Finally, we evaluate a heuristic figure of merit that captures the number of runs of identical symbols in a concatenation of several CC sequences. For moderate block lengths up to approximately 100 symbols, this metric suggests that limiting the number of identical-symbol runs can be beneficial.


title: Learning Decomposed Representation for Counterfactual Inference

abstract: The fundamental problem in treatment effect estimation from observational data is confounder identification and balancing. Most of the previous methods realized confounder balancing by treating all observed pre-treatment variables as confounders, ignoring further identifying confounders and non-confounders. In general, not all the observed pre-treatment variables are confounders that refer to the common causes of the treatment and the outcome, some variables only contribute to the treatment and some only contribute to the outcome. Balancing those non-confounders, including instrumental variables and adjustment variables, would generate additional bias for treatment effect estimation. By modeling the different causal relations among observed pre-treatment variables, treatment and outcome, we propose a synergistic learning framework to 1) identify confounders by learning decomposed representations of both confounders and non-confounders, 2) balance confounder with sample re-weighting technique, and simultaneously 3) estimate the treatment effect in observational studies via counterfactual inference. Empirical results on synthetic and real-world datasets demonstrate that the proposed method can precisely decompose confounders and achieve a more precise estimation of treatment effect than baselines.


title: Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch

abstract: Deep reinforcement learning (RL) algorithms have achieved great success on a wide variety of sequential decision-making tasks. However, many of these algorithms suffer from high sample complexity when learning from scratch using environmental rewards, due to issues such as credit-assignment and high-variance gradients, among others. Transfer learning, in which knowledge gained on a source task is applied to more efficiently learn a different but related target task, is a promising approach to improve the sample complexity in RL. Prior work has considered using pre-trained teacher policies to enhance the learning of the student policy, albeit with the constraint that the teacher and the student MDPs share the state-space or the action-space. In this paper, we propose a new framework for transfer learning where the teacher and the student can have arbitrarily different state- and action-spaces. To handle this mismatch, we produce embeddings which can systematically extract knowledge from the teacher policy and value networks, and blend it into the student networks. To train the embeddings, we use a task-aligned loss and show that the representations could be enriched further by adding a mutual information loss. Using a set of challenging simulated robotic locomotion tasks involving many-legged centipedes, we demonstrate successful transfer learning in situations when the teacher and student have different state- and action-spaces.


title: Recurrent Neural Networks for Stochastic Control in Real-Time Bidding

abstract: Bidding in real-time auctions can be a difficult stochastic control task; especially if underdelivery incurs strong penalties and the market is very uncertain. Most current works and implementations focus on optimally delivering a campaign given a reasonable forecast of the market. Practical implementations have a feedback loop to adjust and be robust to forecasting errors, but no implementation, to the best of our knowledge, uses a model of market risk and actively anticipates market shifts. Solving such stochastic control problems in practice is actually very challenging. This paper proposes an approximate solution based on a Recurrent Neural Network (RNN) architecture that is both effective and practical for implementation in a production environment. The RNN bidder provisions everything it needs to avoid missing its goal. It also deliberately falls short of its goal when buying the missing impressions would cost more than the penalty for not reaching it.


title: Language-Conditioned Goal Generation: a New Approach to Language Grounding for RL

abstract: In the real world, linguistic agents are also embodied agents: they perceive and act in the physical world. The notion of Language Grounding questions the interactions between language and embodiment: how do learning agents connect or ground linguistic representations to the physical world ? This question has recently been approached by the Reinforcement Learning community under the framework of instruction-following agents. In these agents, behavioral policies or reward functions are conditioned on the embedding of an instruction expressed in natural language. This paper proposes another approach: using language to condition goal generators. Given any goal-conditioned policy, one could train a language-conditioned goal generator to generate language-agnostic goals for the agent. This method allows to decouple sensorimotor learning from language acquisition and enable agents to demonstrate a diversity of behaviors for any given instruction. We propose a particular instantiation of this approach and demonstrate its benefits.


title: Molecular gas in 21 and 30 micron sources: the 2\,mm and 1.3\,mm spectra of IRAS\,21318+5631 and 22272+5435

abstract: The carriers of the 21 and 30\,$\mu$m emission features in infrared spectra of circumstellar envelopes are a long-standing enigma. In this paper, we present the results of molecular line observations toward two circumstellar envelopes exhibiting the 21 and/or 30\,$\mu$m features, IRAS\,21318+5631 and 22272+5435, aiming at investigating whether they have unusual gas-phase chemistry and searching for possible gas-phase precursor of the carriers of the two dust features. The spectra cover several discrete frequency ranges of 130--164\,GHz and 216.5--273\,GHz, resulting in a detection of 13 molecular species and isotopologues in each object. Rotation-diagram analysis is carried out to determine the molecular abundances, column densities, and excitation temperatures. We did not discover any molecular species that is unexpected in a normal C-rich star. Nevertheless, there exists subtle difference between their molecular abundances. IRAS\,22272+5435 shows stronger SiC$_2$ and HC$_3$N lines and weaker SiS lines than IRAS\,21318+5631, presumably suggesting that this 21\,$\mu$m source is more carbon rich and has experienced a more efficient dust formation. We discuss the potential implications of the results for the carriers of the 21\,$\mu$m and 30\,$\mu$m features.


title: Huffman-coded Sphere Shaping and Distribution Matching Algorithms via Lookup Tables

abstract: In this paper, we study amplitude shaping schemes for the probabilistic amplitude shaping (PAS) framework as well as algorithms for constant-composition distribution matching (CCDM). Huffman-coded sphere shaping (HCSS) is discussed in detail, which internally uses Huffman coding to determine the composition to be used and relies on conventional CCDM algorithms for mapping and demapping. Numerical simulations show that HCSS closes the performance gap between distribution matching schemes and sphere shaping techniques such as enumerative sphere shaping (ESS). HCSS is based on an architecture that is different from the trellis-based setup of ESS. It allows to tailor the used HCSS compositions to the transmission channel and to take into account complexity constraints. We further discuss in detail multiset ranking (MR) and subset ranking (SR) as alternatives to arithmetic-coding (AC) CCDM. The advantage of MR over AC is that it requires less sequential operations for mapping. SR operates on binary alphabets only, which can introduce some additional rate loss when a nonbinary-to-binary transformation is required. However, the binomial coefficients required for SR can be precomputed and stored in a lookup table (LUT). We perform an analysis of rate loss and decoding performance for the proposed techniques and compare them to other prominent amplitude shaping schemes. For medium to long block lengths, MR-HCSS and SR-HCSS are shown to have similar performance to ESS. SR-HCSS and uniform 64QAM are compared in additive white Gaussian noise simulations and shaping gains of 0.5 dB and 1 dB are demonstrated with 1 kbit and 100 kbit LUT size, respectively.


title: Disentangled Representation Learning and Generation with Manifold Optimization

abstract: Disentanglement is a useful property in representation learning which increases the interpretability of generative models such as Variational autoencoders (VAE), Generative Adversarial Models, and their many variants. Typically in such models, an increase in disentanglement performance is traded-off with generation quality. In the context of latent space models, this work presents a representation learning framework that explicitly promotes disentanglement by encouraging orthogonal directions of variations. The proposed objective is the sum of an autoencoder error term along with a Principal Component Analysis reconstruction error in the feature space. This has an interpretation of a Restricted Kernel Machine with the eigenvector matrix-valued on the Stiefel manifold. Our analysis shows that such a construction promotes disentanglement by matching the principal directions in the latent space with the directions of orthogonal variation in data space. In an alternating minimization scheme, we use Cayley ADAM algorithm - a stochastic optimization method on the Stiefel manifold along with the ADAM optimizer. Our theoretical discussion and various experiments show that the proposed model improves over many VAE variants in terms of both generation quality and disentangled representation learning.


title: A relational perspective on the Wigner-Araki-Yanase theorem

abstract: We present a novel interpretation of the Wigner-Araki-Yanase (WAY) theorem based on a relational view of quantum mechanics. Several models are analysed in detail, backed up by general considerations, which serve to illustrate that the moral of the WAY theorem may be that in the presence of symmetry, a measuring apparatus must fulfil the dual purpose of both reflecting the statistical behaviour of the system under investigation, and acting as a physical reference system serving to define those quantities which must be understood as relative.


title: Blocking of conducting channels widens window for ferroelectric resistive switching in interface-engineered Hf0.5Zr0.5O2 tunnel devices

abstract: Films of Hf0.5Z0.5O2 (HZO) contain a network of grain boundaries. In (111) HZO epitaxial films on (001) SrTiO3, for instance, twinned orthorhombic (o-HZO) ferroelectric crystallites coexist with grain boundaries between o-HZO and a residual paraelectric monoclinic (m-HZO) phase. These grain boundaries contribute to the resistive switching response in addition to the genuine ferroelectric polarization switching and have detrimental effects on device performance. Here, it is shown that, by using suitable nanometric capping layers deposited on HZO film, a radical improvement of the operation window of the tunnel device can be achieved. Crystalline SrTiO3 and amorphous AlOx are explored as capping layers. It is observed that these layers conformally coat the HZO surface and allow to increase the yield and homogeneity of functioning ferroelectric junctions while strengthening endurance. Data show that the capping layers block ionic-like transport channels across grain boundaries. It is suggested that they act as oxygen suppliers to the oxygen-getters grain boundaries in HZO. In this scenario it could be envisaged that these and other oxides could also be explored and tested for fully compatible CMOS technologies.


title: Reply to the Comment by S. Wirth et al. on "Tuning low-energy scales in YbRh$_2$Si$_2$ by non-isoelectronic substitution and pressure"

abstract: Previously, we reported that the doping and pressure dependence of the $T^\ast(B)$ crossover in YbRh$_2$Si$_2$ is incompatible with its interpretation as signature of a Kondo breakdown [M.-H. Schubert et al., Phys. Rev. Research 1, 032004(R) (2019)]. The comment by S. Wirth et al. [arXiv:1910.04108] refers to Hall measurements on undoped YbRh$_2$Si$_2$ and criticizes our study as incomplete and inconclusive. We thoroughly inspect these data and rebut the arguments of the comment.


title: Sallow: a heuristic algorithm for treedepth decompositions

abstract: We describe a heuristic algorithm for computing treedepth decompositions, submitted for the PACE 2020 challenge. It relies on a variety of greedy algorithms computing elimination orderings, as well as a Divide & Conquer approach on balanced cuts obtained using a from-scratch reimplementation of the 2016 FlowCutter algorithm by Hamann & Strasser [ACM JEA 2018].


title: The Finite-Time Turnpike Phenomenon for Optimal Control Problems: Stabilization by Non-Smooth Tracking Terms

abstract: In this paper, problems of optimal control are considered where in the objective function, in addition to the control cost there is a tracking term that measures the distance to a desired stationary state. The tracking term is given by some norm and therefore it is in general not differentiable. In the optimal control problem, the initial state is prescribed. We assume that the system is either exactly controllable in the classical sense or nodal profile controllable. We show that both for systems that are governed by ordinary differential equations and for infinite-dimensional systems, for example for boundary control systems governed by the wave equation, under certain assumptions the optimal system state is steered exactly to the desired state after finite time.


title: Bayesian Predictive Density Estimation for a Chi-squared Model Using Information from a Normal Observation with Unknown Mean and Variance

abstract: In this paper, we consider the problem of estimating the density function of a Chi-squared variable on the basis of observations of another Chi-squared variable and a normal variable under the Kullback-Leibler divergence. We assume that these variables have a common unknown scale parameter and that the mean of the normal variable is also unknown. We compare the risk functions of two Bayesian predictive densities: one with respect to a hierarchical shrinkage prior and the other based on a noninformative prior. The hierarchical Bayesian predictive density depends on the normal variable while the Bayesian predictive density based on the noninformative prior does not. Sufficient conditions for the former to dominate the latter are obtained. These predictive densities are compared by simulation.


title: Are fulleranes responsible for the 21 micron feature?

abstract: Recent detections of C$_{60}$, C$_{70}$, and C$_{60}^+$ in space induced extensive studies of fullerene derivatives in circumstellar environments. As the promising fullerene sources, protoplanetary nebulae (PPNe) show a number of unidentified bands in their infrared spectra, among which a small sample exhibits an enigmatic feature at $\sim21$\,$\mu$m. Hydrogenation of fullerenes can produce fulleranes emitting new infrared bands. In this paper, we investigate the possibility of fulleranes (C$_{60}$H$_m$) as the carrier of the 21\,$\mu$m feature in terms of theoretical vibrational spectra of fulleranes. The evidences favoring and disfavoring the fullerane hypothesis are presented. We made an initial guess for the hydrogen coverage of C$_{60}$H$_m$ that may contribute to the 21\,$\mu$m feature.


title: Learning the Travelling Salesperson Problem Requires Rethinking Generalization

abstract: End-to-end training of neural network solvers for graph combinatorial optimization problems such as the Travelling Salesperson Problem (TSP) have seen a surge of interest recently, but remain intractable and inefficient beyond graphs with few hundreds of nodes. While state-of-the-art learning-driven approaches for TSP perform closely to classical solvers when trained on trivially small sizes, they are unable to generalize the learnt policy to larger instances at practical scales. This work presents an end-to-end neural combinatorial optimization pipeline that unifies several recent papers in order to identify the inductive biases, model architectures and learning algorithms that promote generalization to instances larger than those seen in training. Our controlled experiments provide the first principled investigation into such zero-shot generalization, revealing that extrapolating beyond training data requires rethinking the neural combinatorial optimization pipeline, from network layers and learning paradigms to evaluation protocols. Additionally, we analyze recent advances in deep learning for routing problems through the lens of our pipeline and provide new directions to stimulate future research.


title: Searching for dark matter with an unequal delay interferometer

abstract: We propose a new type of experiment that compares the frequency of a clock (an ultra-stable optical cavity in this case) at time $t$ to its own frequency some time $t-T$ earlier, by "storing" the output signal (photons) in a fibre delay line. In ultra-light oscillating dark matter (DM) models, such an experiment is sensitive to coupling of DM to the standard model fields, through oscillations of the cavity and fibre lengths and of the fibre refractive index. Additionally, the sensitivity is significantly enhanced around the mechanical resonances of the cavity. We present experimental result of such an experiment and report no evidence of DM for masses in the [$4.1\times 10^{-11}$, $8.3\times 10^{-10}$]~eV region. In addition, we improve constraints on the involved coupling constants by one order of magnitude in a standard galactic DM model, at the mass corresponding to the resonant frequency of our cavity. Furthermore, in the model of relaxion DM, we improve on existing constraints over the whole DM mass range by about one order of magnitude, and up to six orders of magnitude at resonance.


title: The Sobolev embedding constant on Lie groups

abstract: In this paper we estimate the Sobolev embedding constant on general noncompact Lie groups, for sub-Riemannian inhomogeneous Sobolev spaces endowed with a left invariant measure. The bound that we obtain, up to a constant depending only on the group and its sub-Riemannian structure, reduces to the best known bound for the classical inhomogeneous Sobolev embedding constant on $\mathbb{R}^d$. As an application, we prove local and global Moser--Trudinger inequalities.


title: Linear Time Sinkhorn Divergences using Positive Features

abstract: Although Sinkhorn divergences are now routinely used in data sciences to compare probability distributions, the computational effort required to compute them remains expensive, growing in general quadratically in the size $n$ of the support of these distributions. Indeed, solving optimal transport (OT) with an entropic regularization requires computing a $n\times n$ kernel matrix (the neg-exponential of a $n\times n$ pairwise ground cost matrix) that is repeatedly applied to a vector. We propose to use instead ground costs of the form $c(x,y)=-\log\dotp{\varphi(x)}{\varphi(y)}$ where $\varphi$ is a map from the ground space onto the positive orthant $\RR^r_+$, with $r\ll n$. This choice yields, equivalently, a kernel $k(x,y)=\dotp{\varphi(x)}{\varphi(y)}$, and ensures that the cost of Sinkhorn iterations scales as $O(nr)$. We show that usual cost functions can be approximated using this form. Additionaly, we take advantage of the fact that our approach yields approximation that remain fully differentiable with respect to input distributions, as opposed to previously proposed adaptive low-rank approximations of the kernel matrix, to train a faster variant of OT-GAN \cite{salimans2018improving}.


title: Task-Oriented API Usage Examples Prompting Powered By Programming Task Knowledge Graph

abstract: Programming tutorials are often created to demonstrate programming tasks with code examples. However, our study of Stack Overflow questions reveals the low utilization of high-quality programming tutorials, which is caused task description mismatch and code information overload. Document search can find relevant tutorial documents, but they often cannot find specific programming actions and code solutions relevant to the developers' task needs. The recently proposed activity-centric search over knowledge graph supports direct search of programming actions, but it has limitations in action coverage, natural language based task search, and coarse-grained code example recommendation. In this work, we enhance action coverage in knowledge graph with actions extracted from comments in code examples and more forms of activity sentences. To overcome the task description mismatch problem, we develop a code matching based task search method to find relevant programming actions and code examples to the code under development. We integrate our knowledge graph and task search method in the IDE, and develop an observe-push based tool to prompt developers with task-oriented API usage examples. To alleviate the code information overload problem, our tool highlights programming action and API information in the prompted tutorial task excerpts and code examples based on the underlying knowledge graph. Our evaluation confirms the high quality of the constructed knowledge graph, and show that our code matching based task search can recommend effective code solutions to programming issues asked on Stack Overflow. A small-scale user study demonstrates that our tool is useful for assisting developers in finding and using relevant programming tutorials in their programming tasks.


title: Linear polarization in the nucleus of M87 at 7 mm and 1.3 cm

abstract: We report on high angular resolution polarimetric observations of the nearby radio galaxy M87 using the Very Long Baseline Array at 24 GHz ($\lambda=$1.3 cm) and 43 GHz ($\lambda=$7 mm) in 2017-2018. New images of the linear polarization substructure in the nuclear region are presented, characterized by a two-component pattern of polarized intensity and smooth rotation of the polarization plane around the 43 GHz core. From a comparison with an analogous dataset from 2007, we find that this global polarization pattern remains stable on a time interval of 11 yr, while showing smaller month-scale variability. We discuss the possible Faraday rotation toward the M87 nucleus at centimeter to millimeter wavelengths. These results can be interpreted in a scenario where the observed polarimetric pattern is associated with the magnetic structure in the confining magnetohydrodynamic wind, which also serves as the source of the observed Faraday rotation.


title: Structural Patterns and Generative Models of Real-world Hypergraphs

abstract: Graphs have been utilized as a powerful tool to model pairwise relationships between people or objects. Such structure is a special type of a broader concept referred to as hypergraph, in which each hyperedge may consist of an arbitrary number of nodes, rather than just two. A large number of real-world datasets are of this form - for example, list of recipients of emails sent from an organization, users participating in a discussion thread or subject labels tagged in an online question. However, due to complex representations and lack of adequate tools, little attention has been paid to exploring the underlying patterns in these interactions. In this work, we empirically study a number of real-world hypergraph datasets across various domains. In order to enable thorough investigations, we introduce the multi-level decomposition method, which represents each hypergraph by a set of pairwise graphs. Each pairwise graph, which we refer to as a k-level decomposed graph, captures the interactions between pairs of subsets of k nodes. We empirically find that at each decomposition level, the investigated hypergraphs obey five structural properties. These properties serve as criteria for evaluating how realistic a hypergraph is, and establish a foundation for the hypergraph generation problem. We also propose a hypergraph generator that is remarkably simple but capable of fulfilling these evaluation metrics, which are hardly achieved by other baseline generator models.


title: Finite entropy vs finite energy

abstract: Probability measures with either finite Monge-Amp\`ere energy or finite entropy have played a central role in recent developments in K\"ahler geometry. In this note we make a systematic study of quasi-plurisubharmonic potentials whose Monge-Amp\`ere measures have finite entropy. We show that these potentials belong to the finite energy class ${\mathcal E}^{\frac{n}{n-1}}$, where $n$ denotes the complex dimension, and provide examples showing that this critical exponent is sharp. Our proof relies on refined Moser-Trudinger inequalities for quasi-plurisubharmonic functions.


title: The spectra of evolved stars at 20--25\,GHz: tracing circumstellar chemistry during the asymptotic giant branch to planetary nebula transition

abstract: We report an unbiased radio line survey towards the circumstellar envelopes of evolved stars at the frequency range from 20 to 25 GHz, aiming to obtain a more complete unbiased picture of the chemical evolution in the final stages of stellar evolution. The observation sample includes the asymptotic giant branch (AGB) star IRC+10216, the proto-planetary nebulae (PPNs) CRL\,2688 and CRL\,618, and the young planetary nebula (PN) NGC\,7027, representing an evolutionary sequence spanning about 10,000 years. Rotational transitions from cyanopolyyne chains and inversion lines from ammonia are detected in the AGB star and PPNs, while the PN displays several recombination lines. The different spectral behaviors of these evolved stars clearly reflect the evolution of circumstellar chemistry during the AGB-PPN-PN transitions.


title: Privacy Against Adversarial Classification in Cyber-Physical Systems

abstract: For a class of Cyber-Physical Systems (CPSs), we address the problem of performing computations over the cloud without revealing private information about the structure and operation of the system. We model CPSs as a collection of input-output dynamical systems (the system operation modes). Depending on the mode the system is operating on, the output trajectory is generated by one of these systems in response to driving inputs. Output measurements and driving inputs are sent to the cloud for processing purposes. We capture this "processing" through some function (of the input-output trajectory) that we require the cloud to compute accurately - referred here as the trajectory utility. However, for privacy reasons, we would like to keep the mode private, i.e., we do not want the cloud to correctly identify what mode of the CPS produced a given trajectory. To this end, we distort trajectories before transmission and send the corrupted data to the cloud. We provide mathematical tools (based on output-regulation techniques) to properly design distorting mechanisms so that: 1) the original and distorted trajectories lead to the same utility; and the distorted data leads the cloud to misclassify the mode.


title: Indexing Data on the Web: A Comparison of Schema-level Indices for Data Search -- Extended Technical Report

abstract: Indexing the Web of Data offers many opportunities, in particular, to find and explore data sources. One major design decision when indexing the Web of Data is to find a suitable index model, i.e., how to index and summarize data. Various efforts have been conducted to develop specific index models for a given task. With each index model designed, implemented, and evaluated independently, it remains difficult to judge whether an approach generalizes well to another task, set of queries, or dataset. In this work, we empirically evaluate six representative index models with unique feature combinations. Among them is a new index model incorporating inferencing over RDFS and owl:sameAs. We implement all index models for the first time into a single, stream-based framework. We evaluate variations of the index models considering sub-graphs of size 0, 1, and 2 hops on two large, real-world datasets. We evaluate the quality of the indices regarding the compression ratio, summarization ratio, and F1-score denoting the approximation quality of the stream-based index computation. The experiments reveal huge variations in compression ratio, summarization ratio, and approximation quality for different index models, queries, and datasets. However, we observe meaningful correlations in the results that help to determine the right index model for a given task, type of query, and dataset.


title: ACMo: Angle-Calibrated Moment Methods for Stochastic Optimization

abstract: Due to its simplicity and outstanding ability to generalize, stochastic gradient descent (SGD) is still the most widely used optimization method despite its slow convergence. Meanwhile, adaptive methods have attracted rising attention of optimization and machine learning communities, both for the leverage of life-long information and for the profound and fundamental mathematical theory. Taking the best of both worlds is the most exciting and challenging question in the field of optimization for machine learning. Along this line, we revisited existing adaptive gradient methods from a novel perspective, refreshing understanding of second moments. Our new perspective empowers us to attach the properties of second moments to the first moment iteration, and to propose a novel first moment optimizer, \emph{Angle-Calibrated Moment method} (\method). Our theoretical results show that \method is able to achieve the same convergence rate as mainstream adaptive methods. Furthermore, extensive experiments on CV and NLP tasks demonstrate that \method has a comparable convergence to SOTA Adam-type optimizers, and gains a better generalization performance in most cases.


title: Workflow environments for advanced cyberinfrastructure platforms

abstract: Progress in science is deeply bound to the effective use of high-performance computing infrastructures and to the efficient extraction of knowledge from vast amounts of data. Such data comes from different sources that follow a cycle composed of pre-processing steps for data curation and preparation for subsequent computing steps, and later analysis and analytics steps applied to the results. However, scientific workflows are currently fragmented in multiple components, with different processes for computing and data management, and with gaps in the viewpoints of the user profiles involved. Our vision is that future workflow environments and tools for the development of scientific workflows should follow a holistic approach, where both data and computing are integrated in a single flow built on simple, high-level interfaces. The topics of research that we propose involve novel ways to express the workflows that integrate the different data and compute processes, dynamic runtimes to support the execution of the workflows in complex and heterogeneous computing infrastructures in an efficient way, both in terms of performance and energy. These infrastructures include highly distributed resources, from sensors and instruments, and devices in the edge, to High-Performance Computing and Cloud computing resources. This paper presents our vision to develop these workflow environments and also the steps we are currently following to achieve it.


title: Traversal-invariant characterizations of logarithmic space

abstract: We give a novel descriptive-complexity theoretic characterization of L and NL computable queries over finite structures using traversal invariance. We summarize this as (N)L = FO + (breadth-first) traversal-invariance.


title: A Computational Assessment of the Efficacy of Halides as Shape-Directing Agents in Nanoparticle Growth

abstract: We report a comprehensive study of aqueous halide adsorption on nanoparticles of gold and palladium that addresses several limitations hampering the use of atomistic modeling as a tool for understanding and improving wet-chemical synthesis and related applications. A combination of thermodynamic modeling with density functional theory (DFT) calculations and experimental data is used to predict equilibrium shapes of halide-covered nanoparticles as a function of the chemical environment. To ensure realistic and experimentally relevant results, we account for solvent effects and include a large set of vicinal surfaces, several adsorbate coverages as well as decahedral particles. While the observed stabilization is not significant enough to result in thermodynamic stability of anisotropic shapes such as nanocubes, non-uniformity in the halide coverage indicates the possibility of obtaining such shapes as kinetic products. With regard to technical challenges, we show that inclusion of surface-solvent interactions lead to qualitative changes in the predicted shape. Furthermore, accounting for non-local interactions on the functional level yields a more accurate description of surface systems.


title: Diophantine approximation with one prime of the form $p=x^2+y^2+1$

abstract: Let $\varepsilon>0$ be a small constant. In the present paper we prove that whenever $\eta$ is real and constants $\lambda _i$ satisfy some necessary conditions, then there exist infinitely many prime triples $p_1,\, p_2,\, p_3$ satisfying the inequality \begin{equation*} |\lambda _1p_1 + \lambda _2p_2 + \lambda _3p_3+\eta|<\varepsilon \end{equation*} and such that $p_3=x^2 + y^2 +1$.


title: Optimal Allocation of Real-Time-Bidding and Direct Campaigns

abstract: In this paper, we consider the problem of optimizing the revenue a web publisher gets through real-time bidding (i.e. from ads sold in real-time auctions) and direct (i.e. from ads sold through contracts agreed in advance). We consider a setting where the publisher is able to bid in the real-time bidding auction for each impression. If it wins the auction, it chooses a direct campaign to deliver and displays the corresponding ad. This paper presents an algorithm to build an optimal strategy for the publisher to deliver its direct campaigns while maximizing its real-time bidding revenue. The optimal strategy gives a formula to determine the publisher bid as well as a way to choose the direct campaign being delivered if the publisher bidder wins the auction, depending on the impression characteristics. The optimal strategy can be estimated on past auctions data. The algorithm scales with the number of campaigns and the size of the dataset. This is a very important feature, as in practice a publisher may have thousands of active direct campaigns at the same time and would like to estimate an optimal strategy on billions of auctions. The algorithm is a key component of a system which is being developed, and which will be deployed on thousands of web publishers worldwide, helping them to serve efficiently billions of ads a day to hundreds of millions of visitors.


title: Astrochemistry During the Formation of Stars

abstract: Star-forming regions show a rich and varied chemistry, including the presence of complex organic molecules - both in the cold gas distributed on large scales, and in the hot regions close to young stars where protoplanetary disks arise. Recent advances in observational techniques have opened new possibilities for studying this chemistry. In particular, the Atacama Large Millimeter/submillimeter Array (ALMA) has made it possible to study astrochemistry down to Solar System size scales, while also revealing molecules of increasing variety and complexity. In this review, we discuss recent observations of the chemistry of star-forming environments, with a particular focus on complex organic molecules, taking context from the laboratory experiments and chemical models that they have stimulated. The key takeaway points are: The physical evolution of individual sources plays a crucial role in their inferred chemical signatures, and remains an important area for observations and models to elucidate. Comparisons of the abundances measured toward different star-forming environments (high-mass versus low-mass, Galactic center versus Galactic disk) reveal a remarkable similarity, an indication that the underlying chemistry is relatively independent of variations in their physical conditions. Studies of molecular isotopologs in star-forming regions provide a link with measurements in our own Solar System, and thus may shed light on the chemical similarities and differences expected in other planetary systems.


title: Liouville quantum gravity -- holography, JT and matrices

abstract: We study two-dimensional Liouville gravity and minimal string theory on spaces with fixed length boundaries. We find explicit formulas describing the gravitational dressing of bulk and boundary correlators in the disk. Their structure has a striking resemblance with observables in 2d BF (plus a boundary term), associated to a quantum deformation of $SL(2,\mathbb{R})$, a connection we develop in some detail. For the case of the $(2,p)$ minimal string theory, we compare and match the results from the continuum approach with a matrix model calculation, and verify that in the large $p$ limit the correlators match with Jackiw-Teitelboim gravity. We consider multi-boundary amplitudes that we write in terms of gluing bulk one-point functions using a quantum deformation of the Weil-Petersson volumes and gluing measures. Generating functions for genus zero Weil-Petersson volumes are derived, taking the large $p$ limit. Finally, we present preliminary evidence that the bulk theory can be interpreted as a 2d dilaton gravity model with a $\sinh \Phi$ dilaton potential.


title: Parametric solutions of turbulent incompressible flows in OpenFOAM via the proper generalised decomposition

abstract: An a priori reduced order method based on the proper generalised decomposition (PGD) is proposed to compute parametric solutions involving turbulent incompressible flows of interest in an industrial context, using OpenFOAM. The PGD framework is applied for the first time to the incompressible Navier-Stokes equations in the turbulent regime, to compute a generalised solution for velocity, pressure and turbulent viscosity, explicitly depending on the design parameters of the problem. In order to simulate flows of industrial interest, a minimally intrusive implementation based on OpenFOAM SIMPLE algorithm applied to the Reynolds-averaged Navier-Stokes equations with the Spalart-Allmaras turbulence model is devised. The resulting PGD strategy is applied to parametric flow control problems and achieves both qualitative and quantitative agreement with the full order OpenFOAM solution for convection-dominated fully-developed turbulent incompressible flows, with Reynolds number up to one million.


title: Seemingly Unrelated Regression with Measurement Error: Estimation via Markov chain Monte Carlo and Mean Field Variational Bayes Approximation

abstract: Linear regression with measurement error in the covariates is a heavily studied topic, however, the statistics/econometrics literature is almost silent to estimating a multi-equation model with measurement error. This paper considers a seemingly unrelated regression model with measurement error in the covariates and introduces two novel estimation methods: a pure Bayesian algorithm (based on Markov chain Monte Carlo techniques) and its mean field variational Bayes (MFVB) approximation. The MFVB method has the added advantage of being computationally fast and can handle big data. An issue pertinent to measurement error models is parameter identification, and this is resolved by employing a prior distribution on the measurement error variance. The methods are shown to perform well in multiple simulation studies, where we analyze the impact on posterior estimates arising due to different values of reliability ratio or variance of the true unobserved quantity used in the data generating process. The paper further implements the proposed algorithms in an application drawn from the health literature and shows that modeling measurement error in the data can improve model fitting.


title: Non-convergence of stochastic gradient descent in the training of deep neural networks

abstract: Deep neural networks have successfully been trained in various application areas with stochastic gradient descent. However, there exists no rigorous mathematical explanation why this works so well. The training of neural networks with stochastic gradient descent has four different discretization parameters: (i) the network architecture; (ii) the amount of training data; (iii) the number of gradient steps; and (iv) the number of randomly initialized gradient trajectories. While it can be shown that the approximation error converges to zero if all four parameters are sent to infinity in the right order, we demonstrate in this paper that stochastic gradient descent fails to converge for ReLU networks if their depth is much larger than their width and the number of random initializations does not increase to infinity fast enough.


title: $C^*$-extreme points of positive operator valued measures and unital completely positive maps

abstract: We study the quantum ($C^*$) convexity structure of normalized positive operator valued measures (POVMs) on measurable spaces. In particular, it is seen that unlike extreme points under classical convexity, $C^*$-extreme points of normalized POVMs on countable spaces (in particular for finite sets) are always spectral measures (normalized projection valued measures). More generally it is shown that atomic $C^*$-extreme points are spectral. A Krein-Milman type theorem for POVMs has also been proved. As an application it is shown that a map on any commutative unital $C^*$-algebra with countable spectrum (in particular ${\mathbb C}^n$) is $C^*$-extreme in the set of unital completely positive maps if and only if it is a unital $*$-homomorphism.


title: Algebraic exponentiation for Lie algebras

abstract: It is known that the category of Lie algebras over a ring admits algebraic exponents. The aim of this paper is to show that the same is true for the category of internal Lie algebras in an additive, cocomplete, symmetric, closed, monoidal category. In this way, we add some new examples to the brief list of known locally algebraically cartesian closed categories, including the categories of Lie superalgebras and differentially graded Lie algebras amongst others.


title: TorsionNet: A Reinforcement Learning Approach to Sequential Conformer Search

abstract: Molecular geometry prediction of flexible molecules, or conformer search, is a long-standing challenge in computational chemistry. This task is of great importance for predicting structure-activity relationships for a wide variety of substances ranging from biomolecules to ubiquitous materials. Substantial computational resources are invested in Monte Carlo and Molecular Dynamics methods to generate diverse and representative conformer sets for medium to large molecules, which are yet intractable to chemoinformatic conformer search methods. We present TorsionNet, an efficient sequential conformer search technique based on reinforcement learning under the rigid rotor approximation. The model is trained via curriculum learning, whose theoretical benefit is explored in detail, to maximize a novel metric grounded in thermodynamics called the Gibbs Score. Our experimental results show that TorsionNet outperforms the highest scoring chemoinformatics method by 4x on large branched alkanes, and by several orders of magnitude on the previously unexplored biopolymer lignin, with applications in renewable energy.


title: The non semi-simple TQFT of the sphere with four punctures

abstract: In this work, we compute the representation of the mapping class group of the sphere with $4$ punctures arising from the non semi-simple TQFT (constructed by Blanchet--Costantino--Geer--Patureau). We show that it is faithful. Lastly, we compare quantum representations of punctured spheres in general with those of braid groups.


title: Two Strengths of Ordinary Chondritic Meteoroids as Derived from their Atmospheric Fragmentation Modeling

abstract: The internal structure and strength of small asteroids and large meteoroids is poorly known. Observation of bright fireballs in the Earth's atmosphere can prospect meteoroid structure by studying meteoroid fragmentation during the flight. Earlier evaluations showed that meteoroid strength is significantly lower than that of the recovered meteorites. We present detailed study of atmospheric fragmentation of seven meteorite falls, all ordinary chondrites, and 14 other fireballs, where meteorite fall was predicted but the meteorites, probably also ordinary chondrites, were not recovered. All observations were made by the autonomous observatories of the European Fireball Network and include detailed radiometric light curves. A model, called the semi-empirical fragmentation model, was developed to fit the light curves and decelerations. Videos showing individual fragments were available in some cases. The results demonstrated that meteoroids do not fragment randomly but in two distinct phases. The first phase typically corresponds to low strengths of 0.04 - 0.12 MPa. In 2/3 of cases, the first phase was catastrophic or nearly catastrophic with at least 40% of mass lost. The second phase corresponds to 0.9 - 5 MPa for confirmed meteorite falls and to somewhat lower strengths, from about 0.5 MPa for smaller meteoroids. All these strengths are lower than tensile strengths of ordinary chondritic meteorites cited in the literature, 20 - 40 MPa. We interpret the second phase as being due by cracks in meteoroids and the first phase as separation of weakly cemented fragments, which reaccumulated at surfaces of asteroids after asteroid collisions.


title: Model Predictive Control of a Food Production Unit: A Case Study for Lettuce Production

abstract: Plant factories with artificial light are widely researched for food production in a controlled environment. For such control tasks, models of the energy and resource exchange in the production unit as well as those of the plant's growth process may be used. To achieve minimal operation cost, optimal control strategies can be applied to the system, taking into account the availability of resources by control reference specification. A particular advantage of model predictive control (MPC) is the incorporation of constraints that comply with actuator limitations and general plant growth conditions. In this work, a model of a production unit is derived including a description of the relation between the actuators' electrical signals and the input values to the model. Furthermore, a preliminary model based state tracking control is evaluated for production unit containing Lettuce. It could be observed that the controller is capable to track the reference while satisfying the constraint under changing weather conditions and resource availability.


title: Resource dependency and survivability in complex networks

abstract: Components in many real-world complex systems depend on each other for the resources required for survival, and may die of a shortage. These patterns of dependencies often take the form of a complex network whose structure potentially affects how the resources produced in the system are efficiently shared among its components, which in turn decides a network's survivability. Here we present a simple threshold model that provides insight into this relationship between the network structure and survivability. We show that, as a combined effect of local sharing and finite lifetime of resources, many components in a complex system may die of lack of resources even when sufficient amount is available in the system. We also obtain a surprising result that although the scale-free networks exhibit a significantly higher survivability compared to their homogeneous counterparts, a vertex in the later survives longer on average. Finally, we demonstrate that the system's survivability can be substantially improved by changing the way vertices distribute resources among the neighbours. Our work is a step towards understanding the relationship between intricate resource dependencies present in many real-world complex systems and their survivability.


title: Real-Time Optimization Of Web Publisher RTB Revenues

abstract: This paper describes an engine to optimize web publisher revenues from second-price auctions. These auctions are widely used to sell online ad spaces in a mechanism called real-time bidding (RTB). Optimization within these auctions is crucial for web publishers, because setting appropriate reserve prices can significantly increase revenue. We consider a practical real-world setting where the only available information before an auction occurs consists of a user identifier and an ad placement identifier. The real-world challenges we had to tackle consist mainly of tracking the dependencies on both the user and placement in an highly non-stationary environment and of dealing with censored bid observations. These challenges led us to make the following design choices: (i) we adopted a relatively simple non-parametric regression model of auction revenue based on an incremental time-weighted matrix factorization which implicitly builds adaptive users' and placements' profiles; (ii) we jointly used a non-parametric model to estimate the first and second bids' distribution when they are censored, based on an on-line extension of the Aalen's Additive model. Our engine is a component of a deployed system handling hundreds of web publishers across the world, serving billions of ads a day to hundreds of millions of visitors. The engine is able to predict, for each auction, an optimal reserve price in approximately one millisecond and yields a significant revenue increase for the web publishers.


title: Investigating the Impact of Pre-processing and Prediction Aggregation on the DeepFake Detection Task

abstract: Recent advances in content generation technologies (widely known as DeepFakes) along with the online proliferation of manipulated media content render the detection of such manipulations a task of increasing importance. Even though there are many DeepFake detection methods, only a few focus on the impact of dataset preprocessing and the aggregation of frame-level to video-level prediction on model performance. In this paper, we propose a pre-processing step to improve the training data quality and examine its effect on the performance of DeepFake detection. We also propose and evaluate the effect of video-level prediction aggregation approaches. Experimental results show that the proposed pre-processing approach leads to considerable improvements in the performance of detection models, and the proposed prediction aggregation scheme further boosts the detection efficiency in cases where there are multiple faces in a video.


title: Lyapunov coefficients for Hopf bifurcations in systems with piecewise smooth nonlinearity

abstract: Motivated by models that arise in controlled ship maneuvering, we analyze Hopf bifurcations in systems with piecewise smooth nonlinear part. In particular, we derive explicit formulas for the generalization of the first Lyapunov coefficient to this setting. This generically determines the direction of branching (super- versus sub-criticality), but in general this differs from any fixed smoothing of the vector field. We focus on nonsmooth nonlinearities of the form $u_i|u_j|$, but our results are formulated in broader generality for systems in any dimension with piecewise smooth nonlinear part. In addition, we discuss some codimension-one degeneracies and apply the results to a model of a shimmying wheel.


title: An Adaptive Approach to Recoverable Mutual Exlcusion

abstract: Mutual exclusion (ME) is one of the most commonly used techniques to handle conflicts in concurrent systems. Traditionally, mutual exclusion algorithms have been designed under the assumption that a process does not fail while acquiring/releasing a lock or while executing its critical section. However, failures do occur in real life, potentially leaving the lock in an inconsistent state. This gives rise to the problem of \emph{recoverable mutual exclusion (RME)} that involves designing a mutual exclusion algorithm that can tolerate failures, while maintaining safety and liveness properties. One of the important measures of performance of any ME algorithm, including an RME algorithm, is the number of \emph{remote memory references (RMRs)} made by a process (for acquiring and releasing a lock as well as recovering the lock structure after a failure). The best known RME algorithm solves the problem for $n$ processes in sub-logarithmic number of RMRs, given by $\mathcal{O}(\frac{\log n}{\log \log n})$, irrespective of the number of failures in the system. In this work, we present a new algorithm for solving the RME problem whose RMR complexity gradually \emph{adapts} to the number of failures that have occurred in the system "recently". In the absence of failures, our algorithm generates only $\mathcal{O}(1)$ RMRs. Furthermore, its RMR complexity is given by $\mathcal{O}(\min\{ \sqrt{F}, \frac{\log n}{\log \log n} \})$ where $F$ is the total number of failures in the "recent" past. In addition to read and write instructions, our algorithm uses compare-and-swap (\CAS{}) and fetch-and-store (\FAS{}) hardware instructions, both of which are commonly available in most modern processors.