title: ASMFS: Adaptive-Similarity-based Multi-modality Feature Selection for Classification of Alzheimer's Disease

abstract: With the increasing amounts of high-dimensional heterogeneous data to be processed, multi-modality feature selection has become an important research direction in medical image analysis. Traditional methods usually depict the data structure using fixed and predefined similarity matrix for each modality separately, without considering the potential relationship structure across different modalities. In this paper, we propose a novel multi-modality feature selection method, which performs feature selection and local similarity learning simultaniously. Specially, a similarity matrix is learned by jointly considering different imaging modalities. And at the same time, feature selection is conducted by imposing sparse l_{2, 1} norm constraint. The effectiveness of our proposed joint learning method can be well demonstrated by the experimental results on Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset, which outperforms existing the state-of-the-art multi-modality approaches.


title: RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering

abstract: In open-domain question answering, dense passage retrieval has become a new paradigm to retrieve relevant passages for finding answers. Typically, the dual-encoder architecture is adopted to learn dense representations of questions and passages for semantic matching. However, it is difficult to effectively train a dual-encoder due to the challenges including the discrepancy between training and inference, the existence of unlabeled positives and limited training data. To address these challenges, we propose an optimized training approach, called RocketQA, to improving dense passage retrieval. We make three major technical contributions in RocketQA, namely cross-batch negatives, denoised hard negatives and data augmentation. The experiment results show that RocketQA significantly outperforms previous state-of-the-art models on both MSMARCO and Natural Questions. We also conduct extensive experiments to examine the effectiveness of the three strategies in RocketQA. Besides, we demonstrate that the performance of end-to-end QA can be improved based on our RocketQA retriever.


title: On a question of Pietch

abstract: The main result is that a finite dimensional normed space embeds isometrically in $\ell_p$ if and only if it has a discrete Levy $p$-representation. This provides an alternative answer to a question raised by Pietch, and as a corollary, a simple proof of the fact that unless $p$ is an even integer, the two-dimensional Hilbert space $\ell_2^2$ is not isometric to a subspace of $\ell_p$. The situation for $\ell_q^2$ with $q\neq 2$ turns out to be much more restrictive. The main result combined with a result of Dor provides a proof of the fact that if $q\neq 2$ then $\ell_q^2$ is not isometric to a subspace of $\ell_p$ unless $q=p$. Further applications concerning restrictions on the degree of smoothness of finite dimensional subspaces of $\ell_p$ are included as well.


title: Decentralized Multi-Agent Pursuit using Deep Reinforcement Learning

abstract: Pursuit-evasion is the problem of capturing mobile targets with one or more pursuers. We use deep reinforcement learning for pursuing an omni-directional target with multiple, homogeneous agents that are subject to unicycle kinematic constraints. We use shared experience to train a policy for a given number of pursuers that is executed independently by each agent at run-time. The training benefits from curriculum learning, a sweeping-angle ordering to locally represent neighboring agents and encouraging good formations with reward structure that combines individual and group rewards. Simulated experiments with a reactive evader and up to eight pursuers show that our learning-based approach, with non-holonomic agents, performs on par with classical algorithms with omni-directional agents, and outperforms their non-holonomic adaptations. The learned policy is successfully transferred to the real world in a proof-of-concept demonstration with three motion-constrained pursuer drones.


title: Co-rotating vortices with N fold symmetry for the inviscid surface quasi-geostrophic equation

abstract: We provide a variational construction of special solutions to the generalized surface quasi-geostrophic equations. These solutions take the form of N vortex patches with N-fold symmetry , which are steady in a uniformly rotating frame. Moreover, we investigate their asymptotic properties when the size of the corresponding patches vanishes. In this limit, we prove these solutions to be a desingularization of N Dirac masses with the same intensity, located on the N vertices of a regular polygon rotating at a constant angular velocity.


title: Stochastic Models of Neural Synaptic Plasticity

abstract: In neuroscience, learning and memory are usually associated to long-term changes of neuronal connectivity. In this context, synaptic plasticity refers to the set of mechanisms driving the dynamics of neuronal connections, called {\em synapses} and represented by a scalar value, the synaptic weight. Spike-Timing Dependent Plasticity (STDP) is a biologically-based model representing the time evolution of the synaptic weight as a functional of the past spiking activity of adjacent neurons. If numerous models of neuronal cells have been proposed in the mathematical literature, few of them include a variable for the time-varying strength of the connection. A new, general, mathematical framework is introduced to study synaptic plasticity associated to different STDP rules. The system composed of two neurons connected by a single synapse is investigated and a stochastic process describing its dynamical behavior is presented and analyzed. The notion of plasticity kernel is introduced as a key component of plastic neural networks models, generalizing a notion used for pair-based models. We show that a large number of STDP rules from neuroscience and physics can be represented by this formalism. Several aspects of these models are discussed and compared to canonical models of computational neuroscience. An important sub-class of plasticity kernels with a Markovian formulation is also defined and investigated. In these models, the time evolution of cellular processes such as the neuronal membrane potential and the concentrations of chemical components created/suppressed by spiking activity has the Markov property.


title: FAST-LIO: A Fast, Robust LiDAR-inertial Odometry Package by Tightly-Coupled Iterated Kalman Filter

abstract: This paper presents a computationally efficient and robust LiDAR-inertial odometry framework. We fuse LiDAR feature points with IMU data using a tightly-coupled iterated extended Kalman filter to allow robust navigation in fast-motion, noisy or cluttered environments where degeneration occurs. To lower the computation load in the presence of large number of measurements, we present a new formula to compute the Kalman gain. The new formula has computation load depending on the state dimension instead of the measurement dimension. The proposed method and its implementation are tested in various indoor and outdoor environments. In all tests, our method produces reliable navigation results in real-time: running on a quadrotor onboard computer, it fuses more than 1,200 effective feature points in a scan and completes all iterations of an iEKF step within 25 ms. Our codes are open-sourced on Github.


title: Lexicon-constrained Copying Network for Chinese Abstractive Summarization

abstract: Copy mechanism allows sequence-to-sequence models to choose words from the input and put them directly into the output, which is finding increasing use in abstractive summarization. However, since there is no explicit delimiter in Chinese sentences, most existing models for Chinese abstractive summarization can only perform character copy, resulting in inefficient. To solve this problem, we propose a lexicon-constrained copying network that models multi-granularity in both encoder and decoder. On the source side, words and characters are aggregated into the same input memory using a Transformerbased encoder. On the target side, the decoder can copy either a character or a multi-character word at each time step, and the decoding process is guided by a word-enhanced search algorithm that facilitates the parallel computation and encourages the model to copy more words. Moreover, we adopt a word selector to integrate keyword information. Experiments results on a Chinese social media dataset show that our model can work standalone or with the word selector. Both forms can outperform previous character-based models and achieve competitive performances.


title: Variable Horizon MPC with Swing Foot Dynamics for Bipedal Walking Control

abstract: In this paper, we present a novel two-level variable Horizon Model Predictive Control (VH-MPC) framework for bipedal locomotion. In this framework, the higher level computes the landing location and timing (horizon length) of the swing foot to stabilize the unstable part of the center of mass (CoM) dynamics, using feedback from the CoM states. The lower level takes into account the swing foot dynamics and generates dynamically consistent trajectories for landing at the desired time as close as possible to the desired location. To do that, we use a simplified model of the robot dynamics projected in swing foot space that takes into account joint torque constraints as well as the friction cone constraints of the stance foot. We show the effectiveness of our proposed control framework by implementing robust walking patterns on our torque-controlled and open-source biped robot, Bolt. We report extensive simulations and real robot experiments in the presence of various disturbances and uncertainties.


title: Emergent and Unspecified Behaviors in Streaming Decision Trees

abstract: Hoeffding trees are the state-of-the-art methods in decision tree learning for evolving data streams. These very fast decision trees are used in many real applications where data is created in real-time due to their efficiency. In this work, we extricate explanations for why these streaming decision tree algorithms for stationary and nonstationary streams (HoeffdingTree and HoeffdingAdaptiveTree) work as well as they do. In doing so, we identify thirteen unique unspecified design decisions in both the theoretical constructs and their implementations with substantial and consequential effects on predictive accuracy---design decisions that, without necessarily changing the essence of the algorithms, drive algorithm performance. We begin a larger conversation about explainability not just of the model but also of the processes responsible for an algorithm's success.


title: Unsupervised Natural Language Inference via Decoupled Multimodal Contrastive Learning

abstract: We propose to solve the natural language inference problem without any supervision from the inference labels via task-agnostic multimodal pretraining. Although recent studies of multimodal self-supervised learning also represent the linguistic and visual context, their encoders for different modalities are coupled. Thus they cannot incorporate visual information when encoding plain text alone. In this paper, we propose Multimodal Aligned Contrastive Decoupled learning (MACD) network. MACD forces the decoupled text encoder to represent the visual information via contrastive learning. Therefore, it embeds visual knowledge even for plain text inference. We conducted comprehensive experiments over plain text inference datasets (i.e. SNLI and STS-B). The unsupervised MACD even outperforms the fully-supervised BiLSTM and BiLSTM+ELMO on STS-B.


title: Extracting Signals of Higgs Boson From Background Noise Using Deep Neural Networks

abstract: Higgs boson is a fundamental particle, and the classification of Higgs signals is a well-known problem in high energy physics. The identification of the Higgs signal is a challenging task because its signal has a resemblance to the background signals. This study proposes a Higgs signal classification using a novel combination of random forest, auto encoder and deep auto encoder to build a robust and generalized Higgs boson prediction system to discriminate the Higgs signal from the background noise. The proposed ensemble technique is based on achieving diversity in the decision space, and the results show good discrimination power on the private leaderboard; achieving an area under the Receiver Operating Characteristic curve of 0.9 and an Approximate Median Significance score of 3.429.


title: Manipulation-Oriented Object Perception in Clutter through Affordance Coordinate Frames

abstract: In order to enable robust operation in unstructured environments, robots should be able to generalize manipulation actions to novel object instances. For example, to pour and serve a drink, a robot should be able to recognize novel containers which afford the task. Most importantly, robots should be able to manipulate these novel containers to fulfill the task. To achieve this, we aim to provide robust and generalized perception of object affordances and their associated manipulation poses for reliable manipulation. In this work, we combine the notions of affordance and category-level pose, and introduce the Affordance Coordinate Frame (ACF). With ACF, we represent each object class in terms of individual affordance parts and the compatibility between them, where each part is associated with a part category-level pose for robot manipulation. In our experiments, we demonstrate that ACF outperforms state-of-the-art methods for object detection, as well as category-level pose estimation for object parts. We further demonstrate the applicability of ACF to robot manipulation tasks through experiments in a simulated environment.


title: Equilibrium and Nonequilibrium Quantum Correlations Between Two Accelerated Detectors

abstract: We quantify the quantum correlations between two accelerated detectors coupled to a scalar field in a cavity. It has been realized that an accelerated detector will experience a thermal bath, which is termed the Unruh effect. We examine the similarities and differences for quantum correlations regarding either temperature or acceleration. As the accelerations (resp. temperatures) of the detectors increase, the entanglement decreases to zero at some instant but the mutual information (resp. discord) can be amplified. As the accelerations increase but are in opposite directions, the quantum correlations decay. Importantly, we also reveal that larger quantum correlations can appear in certain nonequilibrium scenarios in which either the acceleration difference or the coupling difference becomes significant.


title: Modelling of a spherical deflagration at constant speed

abstract: We build in this paper a numerical solution procedure to compute the flow induced by a spherical flame expanding from a point source at a constant expansion velocity, with an instantaneous chemical reaction. The solution is supposed to be self-similar and the flow is split in three zones: an inner zone composed of burnt gases at rest, an intermediate zone where the solution is regular and the initial atmosphere composed of fresh gases at rest. The intermediate zone is bounded by the reactive shock (inner side) and the so-called precursor shock (outer side), for which Rankine-Hugoniot conditions are written; the solution in this zone is governed by two ordinary differential equations which are solved numerically. We show that, for any admissible precursor shock speed, the construction combining this numerical resolution with the exploitation of jump conditions is unique, and yields decreasing pressure, density and velocity profiles in the intermediate zone. In addition, the reactive shock speed is larger than the velocity on the outer side of the shock, which is consistent with the fact that the difference of these two quantities is the so-called flame velocity, i.e. the (relative) velocity at which the chemical reaction progresses in the fresh gases. Finally, we also observe numerically that the function giving the flame velocity as a function of the precursor shock speed is increasing; this allows to embed the resolution in a Newton-like procedure to compute the flow for a given flame speed (instead of for a given precursor shock speed). The resulting numerical algorithm is applied to stoichiometric hydrogen-air mixtures. Key words. spherical flames, reactive Euler equations, Riemann problems burnt zone (constant state) intermediate zone (regular solution) unburnt zone (constant initial state) W b W 2 W 1 W 0 reactive shock, r = $\sigma$ r t. precursor shock, r = $\sigma$ p t. W = ($\rho$, u, p): local fluid state. Fig. 1.1. Structure of the solution. 1. Problem position. We address the flame propagation in a reactive infinite atmosphere of initial constant composition. The ignition is supposed to occur at a single point (chosen to be the origin of R 3) and the flow is supposed to satisfy a spherical symmetry property: the density $\rho$, the pressure p, the internal energy e and the entropy s only depend on the distance r to the origin and the velocity reads u = ur/r, where r stands for the position vector. The flame is supposed to be infinitely thin and to move at a constant speed. The flow is governed by the Euler equations, and we seek a solution with the following structure:


title: Quantum Mechanics of Gravitational Waves

abstract: For the purpose of analyzing observed phenomena, it has been convenient, and thus far sufficient, to regard gravity as subject to the deterministic principles of classical physics, with the gravitational field obeying Newton's law or Einstein's equations. Here we treat the gravitational field as a quantum field and determine the implications of such treatment for experimental observables. We find that falling bodies in gravity are subject to random fluctuations ("noise") whose characteristics depend on the quantum state of the gravitational field. We derive a stochastic equation for the separation of two falling particles. Detection of this fundamental noise, which may be measurable at gravitational wave detectors, would vindicate the quantization of gravity, and reveal important properties of its sources.


title: Towards the surface hydroxyl species in CeO$_2$ nanoparticles

abstract: Understanding the complex chemistry of functional nanomaterials is of fundamental importance. Controlled synthesis and characterization at the atomic level is essential to gain deeper insight into the unique chemical reactivity exhibited by many nanomaterials. Cerium oxide nanoparticles have many industrial and commercial applications,resulting from very strong catalytic, pro-and anti-oxidant activity. However, the identity of the active species and the chemical mechanisms imparted by nanoceria remain elusive, impeding the further development of new applications. Here, we explore the behavior of cerium oxide nanoparticles of different sizes at different temperatures and trace the electronic structure changes by state-of-the-art soft and hard X-ray experiments combined with computational methods. We confirm the absence of the Ce(III) oxidation state at the surface of CeO2nanoparticles, even for particles as small as 2 nm. Synchrotron X-ray absorption experiments at Ce L3and M5edges, combined with X-ray diffraction (XRD), high-resolution transmission electron microscopy (HRTEM) and small angle X-ray scattering (SAXS) and theoretical calculations demonstrate that in addition to the nanoceria charge stability, the formation of hydroxyl groups at the surface profoundly affects the chemical performance of these nanomaterials


title: On Scalar and Ricci Curvatures

abstract: The purpose of this report is to acknowledge the influence of M. Gromov's vision of geometry on our own works. It is two-fold: in the first part we aim at describing some results, in dimension 3, around the question: which open 3-manifolds carry a complete Riemannian metric of positive or non negative scalar curvature? In the second part we look for weak forms of the notion of "lower bounds of the Ricci curvature" on non necessarily smooth metric measure spaces. We describe recent results some of which are already posted in [arXiv:1712.08386] where we proposed to use the volume entropy. We also attempt to give a new synthetic version of Ricci curvature bounded below using Bishop-Gromov's inequality.


title: Signatures of the Quantization of Gravity at Gravitational Wave Detectors

abstract: We develop a formalism to calculate the response of a model gravitational wave detector to a quantized gravitational field. Coupling a detector to a quantum field induces stochastic fluctuations ("noise") in the length of the detector arm. The statistical properties of this noise depend on the choice of quantum state of the gravitational field. We characterize the noise for vacuum, coherent, thermal, and squeezed states. For coherent states, corresponding to classical gravitational configurations, we find that the effect of gravitational field quantization is small. However, the standard deviation in the arm length can be enhanced -- possibly significantly -- when the gravitational field is in a non-coherent state. The detection of this fundamental noise could provide direct evidence for the quantization of gravity and for the existence of gravitons.


title: Human Perception-based Evaluation Criterion for Ultra-high Resolution Cell Membrane Segmentation

abstract: Computer vision technology is widely used in biological and medical data analysis and understanding. However, there are still two major bottlenecks in the field of cell membrane segmentation, which seriously hinder further research: lack of sufficient high-quality data and lack of suitable evaluation criteria. In order to solve these two problems, this paper first proposes an Ultra-high Resolution Image Segmentation dataset for the Cell membrane, called U-RISC, the largest annotated Electron Microscopy (EM) dataset for the Cell membrane with multiple iterative annotations and uncompressed high-resolution raw data. During the analysis process of the U-RISC, we found that the current popular segmentation evaluation criteria are inconsistent with human perception. This interesting phenomenon is confirmed by a subjective experiment involving twenty people. Furthermore, to resolve this inconsistency, we propose a new evaluation criterion called Perceptual Hausdorff Distance (PHD) to measure the quality of cell membrane segmentation results. Detailed performance comparison and discussion of classic segmentation methods along with two iterative manual annotation results under existing evaluation criteria and PHD is given.


title: Coarse-to-Fine Pre-training for Named Entity Recognition

abstract: More recently, Named Entity Recognition hasachieved great advances aided by pre-trainingapproaches such as BERT. However, currentpre-training techniques focus on building lan-guage modeling objectives to learn a gen-eral representation, ignoring the named entity-related knowledge. To this end, we proposea NER-specific pre-training framework to in-ject coarse-to-fine automatically mined entityknowledge into pre-trained models. Specifi-cally, we first warm-up the model via an en-tity span identification task by training it withWikipedia anchors, which can be deemed asgeneral-typed entities. Then we leverage thegazetteer-based distant supervision strategy totrain the model extract coarse-grained typedentities. Finally, we devise a self-supervisedauxiliary task to mine the fine-grained namedentity knowledge via clustering.Empiricalstudies on three public NER datasets demon-strate that our framework achieves significantimprovements against several pre-trained base-lines, establishing the new state-of-the-art per-formance on three benchmarks. Besides, weshow that our framework gains promising re-sults without using human-labeled trainingdata, demonstrating its effectiveness in label-few and low-resource scenarios


title: Second Harmonic Imaging Enhanced by Deep Learning Decipher

abstract: Wavefront sensing and reconstruction are widely used for adaptive optics, aberration correction, and high-resolution optical phase imaging. Traditionally, interference and/or microlens arrays are used to convert the optical phase into intensity variation. Direct imaging of distorted wavefront usually results in complicated phase retrieval with low contrast and low sensitivity. Here, a novel approach has been developed and experimentally demonstrated based on the phase-sensitive information encoded into second harmonic signals, which are intrinsically sensitive to wavefront modulations. By designing and implementing a deep neural network, we demonstrate the second harmonic imaging enhanced by deep learning decipher (SHIELD) for efficient and resilient phase retrieval. Inheriting the advantages of two-photon microscopy, SHIELD demonstrates single-shot, reference-free, and video-rate phase imaging with sensitivity better than {\lambda}/100 and high robustness against noises, facilitating numerous applications from biological imaging to wavefront sensing.


title: Rate of mixing for equilibrium states in negative curvature and trees

abstract: In this survey based on the book by the authors [BPP], we recall the Patterson-Sullivan construction of equilibrium states for the geodesic flow on negatively curved orbifolds or tree quotients, and discuss their mixing properties, emphazising the rate of mixing for (not necessarily compact) tree quotients via coding by countable (not necessarily finite) topological shifts. We give a new construction of numerous nonuniform tree lattices such that the (discrete time) geodesic flow on the tree quotient is exponentially mixing with respect to the maximal entropy measure: we construct examples whose tree quotients have an arbitrary space of ends or an arbitrary (at most exponential) growth type.


title: Collaborative Training of GANs in Continuous and Discrete Spaces for Text Generation

abstract: Applying generative adversarial networks (GANs) to text-related tasks is challenging due to the discrete nature of language. One line of research resolves this issue by employing reinforcement learning (RL) and optimizing the next-word sampling policy directly in a discrete action space. Such methods compute the rewards from complete sentences and avoid error accumulation due to exposure bias. Other approaches employ approximation techniques that map the text to continuous representation in order to circumvent the non-differentiable discrete process. Particularly, autoencoder-based methods effectively produce robust representations that can model complex discrete structures. In this paper, we propose a novel text GAN architecture that promotes the collaborative training of the continuous-space and discrete-space methods. Our method employs an autoencoder to learn an implicit data manifold, providing a learning objective for adversarial training in a continuous space. Furthermore, the complete textual output is directly evaluated and updated via RL in a discrete space. The collaborative interplay between the two adversarial trainings effectively regularize the text representations in different spaces. The experimental results on three standard benchmark datasets show that our model substantially outperforms state-of-the-art text GANs with respect to quality, diversity, and global consistency.


title: Which form of the molecular Hamiltonian is the most suitable for simulating the nonadiabatic quantum dynamics at a conical intersection?

abstract: Choosing an appropriate representation of the molecular Hamiltonian is one of the challenges faced by simulations of the nonadiabatic quantum dynamics around a conical intersection. The adiabatic, exact quasidiabatic, and strictly diabatic representations are exact and unitary transforms of each other, whereas the approximate quasidiabatic Hamiltonian ignores the residual nonadiabatic couplings in the exact quasidiabatic Hamiltonian. A rigorous numerical comparison of the four different representations is difficult because of the exceptional nature of systems where the four representations can be defined exactly and the necessity of an exceedingly accurate numerical algorithm that avoids mixing numerical errors with errors due to the different forms of the Hamiltonian. Using the quadratic Jahn-Teller model and high-order geometric integrators, we are able to perform this comparison and find that only the rarely employed exact quasidiabatic Hamiltonian yields nearly identical results to the benchmark results of the strictly diabatic Hamiltonian, which is not available in general. In this Jahn-Teller model and with the same Fourier grid, the commonly employed approximate quasidiabatic Hamiltonian led to inaccurate wavepacket dynamics, while the Hamiltonian in the adiabatic basis was the least accurate, due to the singular nonadiabatic couplings at the conical intersection.


title: BALM: Bundle Adjustment for Lidar Mapping

abstract: A local Bundle Adjustment (BA) on a sliding window of keyframes has been widely used in visual SLAM and proved to be very effective in lowering the drift. But in lidar SLAM, BA method is hardly used because the sparse feature points (e.g., edge and plane) make the exact point matching impossible. In this paper, we formulate the lidar BA as minimizing the distance from a feature point to its matched edge or plane. Unlike the visual SLAM (and prior plane adjustment method in lidar SLAM) where the feature has to be co-determined along with the pose, we show that the feature can be analytically solved and removed from the BA, the resultant BA is only dependent on the scan poses. This greatly reduces the optimization scale and allows large-scale dense plane and edge features to be used. To speedup the optimization, we derive the analytical derivatives of the cost function, up to second order, in closed form. Moreover, we propose a novel adaptive voxelization method to search feature correspondence efficiently. The proposed formulations are incorporated into a LOAM back-end for map refinement. Results show that, although as a back-end, the local BA can be solved very efficiently, even in real-time at 10Hz when optimizing 20 scans of point-cloud. The local BA also considerably lowers the LOAM drift. Our implementation of the BA optimization and LOAM are open-sourced to benefit the community.


title: Complexity of dipolar exciton Mott transition in GaN/(AlGa)N nanostructures

abstract: The Mott transition from a dipolar excitonic liquid to an electron-hole plasma is demonstrated in a wide GaN/(Al,Ga)N quantum well at $T=7$K by means of spatially-resolved magneto-photoluminescence spectroscopy. Increasing optical excitation density we drive the system from the excitonic state, characterized by a diamagnetic behavior and thus a quadratic energy dependence on the magnetic field, to the unbound electron-hole state, characterized by a linear shift of the emission energy with the magnetic field. The complexity of the system requires to take into account both the density-dependence of the exciton binding energy and the exciton-exciton interaction and correlation energy that are of the same order of magnitude. We estimate the carrier density at Mott transition as $n_\mathrm{Mott}\approx 2\times 10^{11}$cm$^{-2}$ and address the role played by excitonic correlations in this process. Our results strongly rely on the spatial resolution of the photoluminescence and the assessment of the carrier transport. We show, that in contrast to GaAs/(Al,Ga)As systems, where transport of dipolar magnetoexcitons is strongly quenched by the magnetic field due to exciton mass enhancement, in GaN/(Al,Ga)N the band parameters are such that the transport is preserved up to $9$T.


title: Convergence rates analysis of a multiobjective proximal gradient method

abstract: Many descent algorithms for multiobjective optimization have been developed in the last two decades. Tanabe et al. (Comput Optim Appl 72(2):339--361, 2019) proposed a proximal gradient method for multiobjective optimization, which can solve multiobjective problems, whose objective function is the sum of a continuously differentiable function and a closed, proper, and convex one. Under reasonable assumptions, it is known that the accumulation points of the sequences generated by this method are Pareto stationary. However, the convergence rates were not established in that paper. Here, we show global convergence rates for the multiobjective proximal gradient method, matching what is known in scalar optimization. More specifically, by using merit functions to measure the complexity, we present the convergence rates for non-convex ($O(\sqrt{1 / k})$), convex ($O(1 / k)$), and strongly convex ($O(r^k)$ for some $r \in (0, 1)$) problems. We also extend the so-called Polyak-{\L}ojasiewicz (PL) inequality for multiobjective optimization and establish the linear convergence rate for multiobjective problems that satisfy such inequalities ($O(r^k)$ for some $r \in (0, 1)$).


title: Deep-HOSeq: Deep Higher Order Sequence Fusion for Multimodal Sentiment Analysis

abstract: Multimodal sentiment analysis utilizes multiple heterogeneous modalities for sentiment classification. The recent multimodal fusion schemes customize LSTMs to discover intra-modal dynamics and design sophisticated attention mechanisms to discover the inter-modal dynamics from multimodal sequences. Although powerful, these schemes completely rely on attention mechanisms which is problematic due to two major drawbacks 1) deceptive attention masks, and 2) training dynamics. Nevertheless, strenuous efforts are required to optimize hyperparameters of these consolidate architectures, in particular their custom-designed LSTMs constrained by attention schemes. In this research, we first propose a common network to discover both intra-modal and inter-modal dynamics by utilizing basic LSTMs and tensor based convolution networks. We then propose unique networks to encapsulate temporal-granularity among the modalities which is essential while extracting information within asynchronous sequences. We then integrate these two kinds of information via a fusion layer and call our novel multimodal fusion scheme as Deep-HOSeq (Deep network with higher order Common and Unique Sequence information). The proposed Deep-HOSeq efficiently discovers all-important information from multimodal sequences and the effectiveness of utilizing both types of information is empirically demonstrated on CMU-MOSEI and CMU-MOSI benchmark datasets. The source code of our proposed Deep-HOSeq is and available at https://github.com/sverma88/Deep-HOSeq--ICDM-2020.


title: How Does Supernet Help in Neural Architecture Search?

abstract: Weight sharing, as an approach to speed up architecture performance estimation has received wide attention. Instead of training each architecture separately, weight sharing builds a supernet that assembles all the architectures as its submodels. However, there has been debate over whether the NAS process actually benefits from weight sharing, due to the gap between supernet optimization and the objective of NAS. To further understand the effect of weight sharing on NAS, we conduct a comprehensive analysis on five search spaces, including NAS-Bench-101, NAS-Bench-201, DARTS-CIFAR10, DARTS-PTB, and ProxylessNAS. We find that weight sharing works well on some search spaces but fails on others. Taking a step forward, we further identified biases accounting for such phenomenon and the capacity of weight sharing. Our work is expected to inspire future NAS researchers to better leverage the power of weight sharing.


title: Predicting the Post-Impact Velocity of a Robotic Arm via Rigid Multibody Models: an Experimental Study

abstract: Accurate post-impact velocity predictions are essential in developing impact-aware manipulation strategies for robots, where contacts are intentionally established at non-zero speed mimicking human manipulation abilities in dynamic grasping and pushing of objects. Starting from the recorded dynamic response of a 7DOF torque-controlled robot that intentionally impacts a rigid surface, we investigate the possibility and accuracy of predicting the post-impact robot velocity from the pre-impact velocity and impact configuration. The velocity prediction is obtained by means of an impact map, derived using the framework of nonsmooth mechanics, that makes use of the known rigid-body robot model and the assumption of a frictionless inelastic impact.The main contribution is proposing a methodology that allows for a meaningful quantitative comparison between the recorded post-impact data, that exhibits a damped oscillatory response after the impact, and the post-impact velocity prediction derived via the readily available rigid-body robot model, that presents no oscillations and that is the one typically obtained via mainstream robot simulator software. The results of this new approach are promising in terms of prediction accuracy and thus relevant for the growing field of impact-aware robot control. The recorded impact data (18 experiments) is made publicly available, together with the numerical routines employed to generate the quantitative comparison, to further stimulate interest/research in this field.


title: HPERL: 3D Human Pose Estimation from RGB and LiDAR

abstract: In-the-wild human pose estimation has a huge potential for various fields, ranging from animation and action recognition to intention recognition and prediction for autonomous driving. The current state-of-the-art is focused only on RGB and RGB-D approaches for predicting the 3D human pose. However, not using precise LiDAR depth information limits the performance and leads to very inaccurate absolute pose estimation. With LiDAR sensors becoming more affordable and common on robots and autonomous vehicle setups, we propose an end-to-end architecture using RGB and LiDAR to predict the absolute 3D human pose with unprecedented precision. Additionally, we introduce a weakly-supervised approach to generate 3D predictions using 2D pose annotations from PedX [1]. This allows for many new opportunities in the field of 3D human pose estimation.


title: Towards Tight Communication Lower Bounds for Distributed Optimisation

abstract: We consider a standard distributed optimisation setting where $N$ machines, each holding a $d$-dimensional function $f_i$, aim to jointly minimise the sum of the functions $\sum_{i = 1}^N f_i (x)$. This problem arises naturally in large-scale distributed optimisation, where a standard solution is to apply variants of (stochastic) gradient descent. We focus on the communication complexity of this problem: our main result provides the first fully unconditional bounds on total number of bits which need to be sent and received by the $N$ machines to solve this problem under point-to-point communication, within a given error-tolerance. Specifically, we show that $\Omega( Nd \log d / N\varepsilon)$ total bits need to be communicated between the machines to find an additive $\epsilon$-approximation to the minimum of $\sum_{i = 1}^N f_i (x)$. The result holds for both deterministic and randomised algorithms, and, importantly, requires no assumptions on the algorithm structure. The lower bound is tight under certain restrictions on parameter values, and is matched within constant factors for quadratic objectives by a new variant of quantised gradient descent, which we describe and analyse. Our results bring over tools from communication complexity to distributed optimisation, which has potential for further applications.


title: Collisional Pumping of OH Masers near Supernova Remnants

abstract: The collisional pumping of OH masers in non-dissociative C-type shocks near supernova remnants is considered. The emergence of maser emission in OH lines is investigated for various shock parameters - the shock speed, the preshock gas density, the cosmic-ray ionization rate, and the magnetic field strength. The largest optical depth in the 1720 MHz line is reached at high gas ionization rates $\zeta \geq 10^{-15}$ s$^{-1}$, an initial density $n_{\rm H,0} \leq 2 \times 10^4$ cm$^{-3}$, and a shock speed $u_{\rm s} \geq 20$ km s$^{-1}$. According to our calculations, there is also a level population inversion for the 6049 and 4765 MHz transitions of excited OH rotational states. However, the optical depth in these lines is small for all of the investigated shock parameters, which explains the non-detection of maser emission in these lines in supernova remnants.


title: Signatures of triplet correlations in density of states of Ising superconductors

abstract: The few-layer transition metal dichalcogenides (TMDs) have been recently suggested as a platform for controlled unconventional superconductivity. We study the manifestations of unconventional triplet pairing in the density of states of a disordered TMD based monolayer. The conventional singlet pairing attraction is assumed to be the dominant pairing interaction. We map the phase diagrams of disordered Ising superconductors in the plane of temperature and the in-plane magnetic field. The latter suppresses singlet and promote triplet correlations. The triplet order parameters of a trivial (non-trivial) symmetry compete (cooperate) with the singlet order parameter which gives rise to a rich phase diagram. We locate the model-dependent phase boundaries and compute the order parameters in each of the distinct phases. With this information, we obtain the density of states by solving the Gorkov equation. The triplet components of the order parameters may change an apparent width of the density of states by significantly increasing the critical field. The triplet components of the order parameters lead to the density of states broadening significantly exceeding the broadening induced by magnetic field and disorder in the singlet superconductor.


title: Extinction-free Census of AGNs in the $AKARI$/IRC North Ecliptic Pole Field from 23-band Infrared Photometry from Space Telescopes

abstract: In order to understand the interaction between the central black hole and the whole galaxy or their co-evolution history along with cosmic time, a complete census of active galactic nuclei (AGN) is crucial. However, AGNs are often missed in optical, UV and soft X-ray observations since they could be obscured by gas and dust. A mid-infrared (mid-IR) survey supported by multiwavelength data is one of the best ways to find obscured AGN activities because it suffers less from extinction. Previous large IR photometric surveys, e.g., $WISE$ and $Spitzer$, have gaps between the mid-IR filters. Therefore, star forming galaxy (SFG)-AGN diagnostics in the mid-IR were limited. The $AKARI$ satellite has a unique continuous 9-band filter coverage in the near to mid-IR wavelengths. In this work, we take advantage of the state-of-the-art spectral energy distribution (SED) modelling software, CIGALE, to find AGNs in mid-IR. We found 126 AGNs in the NEP-Wide field with this method. We also investigate the energy released from the AGN as a fraction of the total IR luminosity of a galaxy. We found that the AGN contribution is larger at higher redshifts for a given IR luminosity. With the upcoming deep IR surveys, e.g., $JWST$, we expect to find more AGNs with our method.


title: On connectedness of non-klt loci of singularities of pairs

abstract: We study the non-klt locus of singularities of pairs. We show that given a pair $(X,B)$ and a projective morphism $X\to Z$ with connected fibres such that $-(K_X+B)$ is nef over $Z$, the non-klt locus of $(X,B)$ has at most two connected components near each fibre of $X\to Z$. This was conjectured by Hacon and Han. In a different direction we answer a question of Mark Gross on connectedness of the non-klt loci of certain pairs. This is motivated by constructions in Mirror Symmetry.


title: Quantum computing approach to railway dispatching and conflict management optimization on single-track railway lines

abstract: In this work, we consider a practical railway dispatching problem: delay and conflict management on a single-track railway line. We examine the issue of train dispatching consequences caused by the arrival of an already delayed train to the segment being considered. This problem is computationally hard and often needs to be solved timely. Here, we introduce a quadratic unconstrained binary optimization (QUBO) model of the problem in question, compatible with the emerging quantum annealing technology. The model's instances can be executed on present-day quantum annealers. As a proof-of-concept, we solve selected real-life problems from the Polish railway network using D-Wave quantum annealers. As a reference, we also provide solutions calculated with classical methods, including those relevant to the community (linear integer programming) and a sophisticated algorithm based on tensor networks for solving QUBO problems.


title: Nitride-based interfacial layers for monolithic tandem integration of new solar energy materials on Si: The case of CZTS

abstract: The monolithic tandem integration of third-generation solar energy materials on silicon holds great promise for photoelectrochemistry and photovoltaics. However, this can be challenging when it involves high-temperature reactive processes, which would risk damaging the Si bottom cell. One such case is the high-temperature sulfurization/selenization in thin film chalcogenide solar cells, of which the kesterite Cu2ZnSnS4 (CZTS) is an example. Here, by using very thin (<10 nm) TiN-based diffusion barriers at the interface, with different composition and properties, we demonstrate on a device level that the protection of the Si bottom cell is largely dependent on the barrier layer engineering. Several monolithic CZTS/Si tandem solar cells with open-circuit voltages (Voc) up to 1.06 V and efficiencies up to 3.9% are achieved, indicating a performance comparable to conventional interfacial layers based on transparent conductive oxides, and pointing to a promising alternative design in solar energy conversion devices.


title: Rapidly accreting supermassive stars: reliable determination of the final mass

abstract: Supermassive black holes might form by direct collapse, with a supermassive star (SMS) as progenitor. In this scenario, the SMS accretes at > 0.1 Msun/yr until it collapses into a massive black hole seed due to the general-relativistic (GR) instability. However, the exact mass at which the collapse occurs is not known, as existing numerical simulations give divergent results. Here, this problem is addressed analytically, which allows for ab initio, reliable determination of the onset point of the GR instability, for given hydrostatic structures. We apply the relativistic equation of radial pulsations in its general form to the hydrostatic GENEC models already published. We show that the mass of spherical SMSs forming in atomically cooled haloes cannot exceed 500 000 Msun, in contrast to previous claims. On the other hand, masses in excess of this limit, up to 10^6 Msun, could be reached in alternative versions of direct collapse. Our method can be used to test the consistency of GR hydrodynamical stellar evolution codes.


title: Graph Rewriting and Relabeling with PBPO+

abstract: We extend the powerful Pullback-Pushout (PBPO) approach for graph rewriting with strong matching. Our approach, called \pbpostrong, exerts more control over the embedding of the pattern in the host graph, which is important for a large class of graph rewrite systems. In addition, we show that \pbpostrong is well-suited for rewriting labeled graphs and certain classes of attributed graphs. For this purpose, we employ a lattice structure on the label set and use order-preserving graph morphisms. We argue that our approach is simpler and more general than related relabeling approaches in the literature.


title: The application of HEXS and HERFD XANES for accurate structural characterization of actinide nanomaterials: application to ThO2

abstract: Structural characterization of actinide nanoparticles (NPs) is of primary importance and hard to achieve, especially for non-homogeneous samples with NPs below 3 nm. By combining High Energy X-ray Scattering (HEXS) and High-Energy-Resolution Fluorescence Detected X-ray Near-Edge Structure (HERFD XANES), we characterized for the first time both short- and medium-range order of ThO2 NPs obtained by chemical precipitation. With this methodology, a novel insight into the structure of NPs at different steps of their formation process is achieved. The Pair Distribution Function (PDF) reveals a high concentration of ThO2 small units similar to Th hexamer clusters mixed with 1 nm ThO2 NPs in the initial steps of formation. Drying the precipitates at 150 C promotes recrystallization of the smallest units into more thermodynamically stable ThO2 NPs. HERFD XANES at Th M4 edge, a direct probe of the f states, shows variations that we correlate to the break of the local symmetry around Th atoms, which most likely concerns surface atoms. Together, HEXS and HERFD are a powerful methodology to investigate actinide NPs and their formation mechanism.


title: WNUT-2020 Task 2: Identification of Informative COVID-19 English Tweets

abstract: In this paper, we provide an overview of the WNUT-2020 shared task on the identification of informative COVID-19 English Tweets. We describe how we construct a corpus of 10K Tweets and organize the development and evaluation phases for this task. In addition, we also present a brief summary of results obtained from the final system evaluation submissions of 55 teams, finding that (i) many systems obtain very high performance, up to 0.91 F1 score, (ii) the majority of the submissions achieve substantially higher results than the baseline fastText (Joulin et al., 2017), and (iii) fine-tuning pre-trained language models on relevant language data followed by supervised training performs well in this task.


title: Concurrent Process Histories and Resource Transducers

abstract: We identify the algebraic structure of the material histories generated by concurrent processes. Specifically, we extend existing categorical theories of resource convertibility to capture concurrent interaction. Our formalism admits an intuitive graphical presentation via string diagrams for proarrow equipments. We also consider certain induced categories of resource transducers, which are of independent interest due to their unusual structure.


title: Improved Predictive Deep Temporal Neural Networks with Trend Filtering

abstract: Forecasting with multivariate time series, which aims to predict future values given previous and current several univariate time series data, has been studied for decades, with one example being ARIMA. Because it is difficult to measure the extent to which noise is mixed with informative signals within rapidly fluctuating financial time series data, designing a good predictive model is not a simple task. Recently, many researchers have become interested in recurrent neural networks and attention-based neural networks, applying them in financial forecasting. There have been many attempts to utilize these methods for the capturing of long-term temporal dependencies and to select more important features in multivariate time series data in order to make accurate predictions. In this paper, we propose a new prediction framework based on deep neural networks and a trend filtering, which converts noisy time series data into a piecewise linear fashion. We reveal that the predictive performance of deep temporal neural networks improves when the training data is temporally processed by a trend filtering. To verify the effect of our framework, three deep temporal neural networks, state of the art models for predictions in time series finance data, are used and compared with models that contain trend filtering as an input feature. Extensive experiments on real-world multivariate time series data show that the proposed method is effective and significantly better than existing baseline methods.


title: Understanding the size effects on the electronic structure of ThO2 nanoparticles

abstract: Developing characterization techniques and analysis methods adapted to the investigation of nanoparticles (NPs) is of fundamental importance considering the role of these materials in many fields of research. The study of actinide based NPs, despite their environmental relevance, is still underdeveloped compared to that of NPs based on stable and lighter elements. We present here an investigation of ThO2 NPs performed with High-Energy Resolution Fluorescence Detected (HERFD) X-ray Absorption Near-Edge Structure (XANES) and with ab initio XANES simulations. The first post-edge feature of Th L3 edge HERFD XANES disappears in small NPs and simulations considering non-relaxed structural models reproduce the trends observed in experimental data. Inspection of the simulations from Th atoms in the core and on the surface of the NP indeed demonstrates that the the first post-edge feature is very sensitive to the lowering of the number of coordinating atoms and therefore to the more exposed Th atoms at the surface of the NP. The sensitivity of the L3 edge HERFD XANES to low coordinated atoms at the surface stems from the hybridization of the d-Density of States (DOS) of Th with both O and Th neighboring atoms. This may be a common feature to other oxide systems that can be exploited to investigate surface interactions.


title: Quantile regression with deep ReLU Networks: Estimators and minimax rates

abstract: Quantile regression is the task of estimating a specified percentile response, such as the median, from a collection of known covariates. We study quantile regression with rectified linear unit (ReLU) neural networks as the chosen model class. We derive an upper bound on the expected mean squared error of a ReLU network used to estimate any quantile conditional on a set of covariates. This upper bound only depends on the best possible approximation error, the number of layers in the network, and the number of nodes per layer. We further show upper bounds that are tight for two large classes of functions: compositions of H\"older functions and members of a Besov space. These tight bounds imply ReLU networks with quantile regression achieve minimax rates for broad collections of function types. Unlike existing work, the theoretical results hold under minimal assumptions and apply to general error distributions, including heavy-tailed distributions. Empirical simulations on a suite of synthetic response functions demonstrate the theoretical results translate to practical implementations of ReLU networks. Overall, the theoretical and empirical results provide insight into the strong performance of ReLU neural networks for quantile regression across a broad range of function classes and error distributions. All code for this paper is publicly available at https://github.com/tansey/quantile-regression.


title: Electrical detection of the spin reorientation transition in antiferromagnetic TmFeO$_3$ thin films by spin Hall magnetoresistance

abstract: TmFeO$_3$ (TFO) is a canted antiferromagnet that undergoes a spin reorientation transition (SRT) with temperature between 82 K and 94 K in single crystals. In this temperature region, the N\'eel vector continuously rotates from the crystallographic $c$-axis (below 82 K) to the $a$-axis (above 94 K). The SRT allows for a temperature control of distinct antiferromagnetic states without the need for a magnetic field, making it apt for applications working at THz frequencies. For device applications, thin films of TFO are required as well as an electrical technique for reading out the magnetic state. Here we demonstrate that orthorhombic TFO thin films can be grown by pulsed laser deposition and the detection of the SRT in TFO thin films can be accessed by making use of the all electrical spin Hall magnetoresistance (SMR), in good agreement for the temperature range where the SRT occurs. Our results demonstrate that one can electrically detect the SRT in insulators.


title: Toward Evaluating Re-identification Risks in the Local Privacy Model

abstract: LDP (Local Differential Privacy) has recently attracted much attention as a metric of data privacy that prevents the inference of personal data from obfuscated data in the local model. However, there are scenarios in which the adversary wants to perform re-identification attacks to link the obfuscated data to users in this model. LDP can cause excessive obfuscation and destroy the utility in these scenarios because it is not designed to directly prevent re-identification. In this paper, we propose a measure of re-identification risks, which we call PIE (Personal Information Entropy). The PIE is designed so that it directly prevents re-identification attacks in the local model. It lower-bounds the lowest possible re-identification error probability (i.e., Bayes error probability) of the adversary. We analyze the relation between LDP and the PIE, and analyze the PIE and utility in distribution estimation for two obfuscation mechanisms providing LDP. Through experiments, we show that when we consider re-identification as a privacy risk, LDP can cause excessive obfuscation and destroy the utility. Then we show that the PIE can be used to guarantee low re-identification risks for the local obfuscation mechanisms while keeping high utility.


title: Vertical 3-manifolds in simplified (2, 0)-trisections of 4-manifolds

abstract: We classify the $3$-manifolds obtained as the preimages of arcs on the plane for simplified $(2, 0)$-trisection maps, which we call vertical $3$-manifolds. Such a $3$-manifold is a connected sum of a $6$-tuple of vertical $3$-manifolds over specific $6$ arcs. Consequently, we show that each of the $6$-tuples determines the source $4$-manifold uniquely up to orientation reversing diffeomorphisms. We also show that, in contrast to the fact that summands of vertical $3$-manifolds of simplified $(2, 0)$-trisection maps are lens spaces, there exist infinitely many simplified $(2, 0)$-$4$-section maps that admit hyperbolic vertical $3$-manifolds.


title: Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks

abstract: There are two approaches for pairwise sentence scoring: Cross-encoders, which perform full-attention over the input pair, and Bi-encoders, which map each input independently to a dense vector space. While cross-encoders often achieve higher performance, they are too slow for many practical use cases. Bi-encoders, on the other hand, require substantial training data and fine-tuning over the target task to achieve competitive performance. We present a simple yet efficient data augmentation strategy called Augmented SBERT, where we use the cross-encoder to label a larger set of input pairs to augment the training data for the bi-encoder. We show that, in this process, selecting the sentence pairs is non-trivial and crucial for the success of the method. We evaluate our approach on multiple tasks (in-domain) as well as on a domain adaptation task. Augmented SBERT achieves an improvement of up to 6 points for in-domain and of up to 37 points for domain adaptation tasks compared to the original bi-encoder performance.


title: Detecting invariant expanding cones for generating word sets to identify chaos in piecewise-linear maps

abstract: We show how the existence of three objects, $\Omega_{\rm trap}$, ${\bf W}$, and $C$, for a continuous piecewise-linear map $f$ on $\mathbb{R}^N$, implies that $f$ has a topological attractor with a positive Lyapunov exponent. First, $\Omega_{\rm trap} \subset \mathbb{R}^N$ is trapping region for $f$. Second, ${\bf W}$ is a finite set of words that encodes the forward orbits of all points in $\Omega_{\rm trap}$. Finally, $C \subset T \mathbb{R}^N$ is an invariant expanding cone for derivatives of compositions of $f$ formed by the words in ${\bf W}$. We develop an algorithm that identifies these objects for two-dimensional homeomorphisms comprised of two affine pieces. The main effort is in the explicit construction of $\Omega_{\rm trap}$ and $C$. Their existence is equated to a set of computable conditions in a general way. This results in a computer-assisted proof of chaos throughout a relatively large regime of parameter space. We also observe how the failure of $C$ to be expanding can coincide with a bifurcation of $f$. Lyapunov exponents are evaluated using one-sided directional derivatives so that forward orbits that intersect a switching manifold (where $f$ is not differentiable) can be included in the analysis.


title: Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers

abstract: Unsupervised extractive document summarization aims to select important sentences from a document without using labeled summaries during training. Existing methods are mostly graph-based with sentences as nodes and edge weights measured by sentence similarities. In this work, we find that transformer attentions can be used to rank sentences for unsupervised extractive summarization. Specifically, we first pre-train a hierarchical transformer model using unlabeled documents only. Then we propose a method to rank sentences using sentence-level self-attentions and pre-training objectives. Experiments on CNN/DailyMail and New York Times datasets show our model achieves state-of-the-art performance on unsupervised summarization. We also find in experiments that our model is less dependent on sentence positions. When using a linear combination of our model and a recent unsupervised model explicitly modeling sentence positions, we obtain even better results.


title: SF-UDA$^{3D}$: Source-Free Unsupervised Domain Adaptation for LiDAR-Based 3D Object Detection

abstract: 3D object detectors based only on LiDAR point clouds hold the state-of-the-art on modern street-view benchmarks. However, LiDAR-based detectors poorly generalize across domains due to domain shift. In the case of LiDAR, in fact, domain shift is not only due to changes in the environment and in the object appearances, as for visual data from RGB cameras, but is also related to the geometry of the point clouds (e.g., point density variations). This paper proposes SF-UDA$^{3D}$, the first Source-Free Unsupervised Domain Adaptation (SF-UDA) framework to domain-adapt the state-of-the-art PointRCNN 3D detector to target domains for which we have no annotations (unsupervised), neither we hold images nor annotations of the source domain (source-free). SF-UDA$^{3D}$ is novel on both aspects. Our approach is based on pseudo-annotations, reversible scale-transformations and motion coherency. SF-UDA$^{3D}$ outperforms both previous domain adaptation techniques based on features alignment and state-of-the-art 3D object detection methods which additionally use few-shot target annotations or target annotation statistics. This is demonstrated by extensive experiments on two large-scale datasets, i.e., KITTI and nuScenes.


title: Auxiliary Task Reweighting for Minimum-data Learning

abstract: Supervised learning requires a large amount of training data, limiting its application where labeled data is scarce. To compensate for data scarcity, one possible method is to utilize auxiliary tasks to provide additional supervision for the main task. Assigning and optimizing the importance weights for different auxiliary tasks remains an crucial and largely understudied research question. In this work, we propose a method to automatically reweight auxiliary tasks in order to reduce the data requirement on the main task. Specifically, we formulate the weighted likelihood function of auxiliary tasks as a surrogate prior for the main task. By adjusting the auxiliary task weights to minimize the divergence between the surrogate prior and the true prior of the main task, we obtain a more accurate prior estimation, achieving the goal of minimizing the required amount of training data for the main task and avoiding a costly grid search. In multiple experimental settings (e.g. semi-supervised learning, multi-label classification), we demonstrate that our algorithm can effectively utilize limited labeled data of the main task with the benefit of auxiliary tasks compared with previous task reweighting methods. We also show that under extreme cases with only a few extra examples (e.g. few-shot domain adaptation), our algorithm results in significant improvement over the baseline.


title: Exploring the Origin of CP Violation in the Standard Model

abstract: In this article, we present a very general but not ultimate solution of CPV problem in the standard model. Our study starts from a naturally Hermitian ${\bf M^2}\equiv M^q \cdot M^{q\dagger}$ rather than the previously assumed Hermitian $M^q$. The only assumption employed here is that the real part and imaginary part of $\bf M^2$ can be, respectively, diagonalized by a common $\bf U^q$ matrix. Such an assumption leads to a $\bf M^2$ pattern which depends on only five parameters and can be diagonalized analytically by a $\bf U^q$ matrix which depends on only two of the parameters. Two of the derived mass eigenvalues are predicted degenerate if one of the parameters $\bf C ~(C')$ in up- (down-) quark sector is zero. As the $\bf U^q$ patterns are obtained, thirty-six $V_{CKM}$ candidates are yielded and only eight of them, classified into two groups, fit empirical data within the order of $O(\lambda)$. One of the groups is further excluded in a numerical test, and the surviving group predicts that the degenerate pair in a quark type are the lightest and the heaviest generations rather than the lighter two generations assumed in previous researches. However, there is still one unsatisfactory prediction in this research, a quadruple equality in which four CKM elements of very different values are predicted to be equal. It indicates the $\bf M^2$ pattern studied here is still oversimplified by that employed assumption and the ultimate solution can only be obtained by diagonalizing the unsimplified $\bf M^2$ matrix containing nine parameters directly. The $V_{CKM}$ presented here is already very close to such an ultimate CPV solution.


title: SIGTYP 2020 Shared Task: Prediction of Typological Features

abstract: Typological knowledge bases (KBs) such as WALS (Dryer and Haspelmath, 2013) contain information about linguistic properties of the world's languages. They have been shown to be useful for downstream applications, including cross-lingual transfer learning and linguistic probing. A major drawback hampering broader adoption of typological KBs is that they are sparsely populated, in the sense that most languages only have annotations for some features, and skewed, in that few features have wide coverage. As typological features often correlate with one another, it is possible to predict them and thus automatically populate typological KBs, which is also the focus of this shared task. Overall, the task attracted 8 submissions from 5 teams, out of which the most successful methods make use of such feature correlations. However, our error analysis reveals that even the strongest submitted systems struggle with predicting feature values for languages where few features are known.


title: Numerical study of quantum mechanical systems using a quantum wave impedance approach

abstract: The approximate numerical method for a calculation of a quantum wave impedance in a case of a potential energy with a complicated spatial structure is considered. It was proved that the approximation of a real potential by a piesewise constant function is also reasonable in a case of using a quantum impedance approach.The dependence of an accuracy of numerical calculations on a number of cascads by which a real potential is represented was found. The method of including into a consideration of zero-range singular potentials was developed.


title: Persistent double layer formation in kesterite solar cells: a critical review

abstract: In kesterite CZTSSe solar cell research, an asymmetric crystallization profile is often obtained after annealing, resulting in a bilayered or double-layered absorber. So far, only segregated pieces of research exist to characterize this double layer, its formation dynamics and its effect on the performance of devices. Here, we review the existing research on double-layered kesterites and evaluate the different mechanisms proposed. Using a cosputtering-based approach, we show that the two layers can differ significantly in morphology, composition and optoelectronic properties, and complement the results with a statistical dataset of over 850 individual CZTS solar cells. By reducing the absorber thickness from above 1000 nm to 300 nm, we show that the double layer segregation is alleviated. In turn, we see a progressive improvement in the device performance for lower thickness, which alone would be inconsistent with the known case of ultrathin CIGS solar cells. By comparing the results with CZTS grown on monocrystalline Si substrates, without a native Na supply, we show that the alkali metal supply does not determine the double layer formation, but merely reduces the threshold for its occurrence. Instead, we propose that the main formation mechanism is the early migration of Cu to the surface during annealing and formation of Cu2-xS phases, in a self-regulating process akin to the Kirkendall effect. We comment on the generality of the mechanism proposed, comparing our results to other synthesis routes, including our own in-house results from solution processing and pulsed laser deposition of sulfide and oxide-based targets. Although the double layer occurrence largely depends on the kesterite synthesis route, the common factors determining the double layer occurrence appear to be the presence of metallic Cu and/or a chalcogen deficiency in the precursor matrix.


title: The Capacity of Symmetric Private Information Retrieval under Arbitrary Collusion and Eavesdropping Patterns

abstract: We study the symmetric private information retrieval (SPIR) problem under arbitrary collusion and eavesdropping patterns for replicated databases. We find its capacity, which is the same as the capacity of the original SPIR problem with the number of databases $N$ replaced by a number $F^*$. The number $F^*$ is the optimal solution to a linear programming problem that is a function of the joint pattern, which is the union of the collusion and eavesdropping pattern. This is the first result that shows how two arbitrary patterns collectively affect the capacity of the PIR problem. We draw the conclusion that for SPIR problems, the collusion and eavesdropping constraints are interchangeable in terms of capacity. As special cases of our result, the capacity of the SPIR problem under arbitrary collusion patterns and the capacity of the PIR problem under arbitrary eavesdropping patterns are also found.


title: Biodegradable Polymeric Micro/Nano-Structures with Intrinsic Antifouling/Antimicrobial Properties:Relevance in Damaged Skin and Other Biomedical Applications

abstract: Bacterial colonization ofimplanted biomedical devicesis themain cause of healthcare-associated infections, estimated to be 8.8 million per year in Europe. Many infections originate from damaged skin, which lets microorganisms exploit injuries and surgical accesses as passageways to reach the implant site and inner organs. Therefore, an effective treatment of skin damage is highly desirable for the success of many biomaterial-related surgical procedures. Due to gained resistance to antibiotics, new antibacterial treatments are becoming vital to control nosocomial infections arising as surgical and post-surgical complications. Surface coatings can avoid biofouling and bacterial colonization thanks to biomaterial inherent properties (e.g., super hydrophobicity), specifically without using drugs, which may cause bacterial resistance. The focus of this review is to highlight the emerging role of degradable polymeric micro- and nano-structures that show intrinsic antifouling and antimicrobial properties, with a special outlook towards biomedical applications dealing with skin and skin damage. The intrinsic properties owned by the biomaterials encompass three main categories: (1) physical-mechanical, (2) chemical, and (3) electrostatic. Clinical relevance in ear prostheses and breast implants is reported. Collecting and discussing the updated outcomes in this field would help the development of better performing biomaterial-based antimicrobial strategies, which are useful to prevent infections.


title: Filtered Batch Normalization

abstract: It is a common assumption that the activation of different layers in neural networks follow Gaussian distribution. This distribution can be transformed using normalization techniques, such as batch-normalization, increasing convergence speed and improving accuracy. In this paper we would like to demonstrate, that activations do not necessarily follow Gaussian distribution in all layers. Neurons in deeper layers are more selective and specific which can result extremely large, out-of-distribution activations. We will demonstrate that one can create more consistent mean and variance values for batch normalization during training by filtering out these activations which can further improve convergence speed and yield higher validation accuracy.


title: Hyperparameter Auto-tuning in Self-Supervised Robotic Learning

abstract: Policy optimization in reinforcement learning requires the selection of numerous hyperparameters across different environments. Fixing them incorrectly may negatively impact optimization performance leading notably to insufficient or redundant learning. Insufficient learning (due to convergence to local optima) results in under-performing policies whilst redundant learning wastes time and resources. The effects are further exacerbated when using single policies to solve multi-task learning problems. Observing that the Evidence Lower Bound (ELBO) used in Variational Auto-Encoders correlates with the diversity of image samples, we propose an auto-tuning technique based on the ELBO for self-supervised reinforcement learning. Our approach can auto-tune three hyperparameters: the replay buffer size, the number of policy gradient updates during each epoch, and the number of exploration steps during each epoch. We use a state-of-the-art self-supervised robot learning framework (Reinforcement Learning with Imagined Goals (RIG) using Soft Actor-Critic) as baseline for experimental verification. Experiments show that our method can auto-tune online and yields the best performance at a fraction of the time and computational resources. Code, video, and appendix for simulated and real-robot experiments can be found at the project page \url{www.JuanRojas.net/autotune}.


title: Adaptive time series analysis of Mauna Loa CO2 data: tvf-EMD based detrend and extraction of seasonal variability

abstract: Adaptive time series analysis has been applied to investigate variability of CO2 concentration data, sampled weekly at Mauna Loa monitoring station. Due to its ability to mitigate mode mixing, the recent time varying filter Empirical Mode Decomposition (tvf-EMD) methodology is employed to extract local narrowband oscillatory modes. In order to perform data analysis, we developed a Python implementation of the tvf-EMD algorithm, referred to as pytvfemd. The algorithm allowed to extract the trend and both the six month and the one year periodicities, without mode mixing, even though the analysed data are noisy. Furthermore, subtracting such modes the residuals are obtained, which are found to be described by a normal distribution. Outliers occurrence was also investigated and it is found that they occur in higher number toward the end of the dataset, corresponding to solar cycles characterised by smaller sunspot numbers. A more pronounced oscillation of the residuals is also observed in this regard, in relation to the solar cycles activity too.


title: Neutrino oscillation in the $q$-metric

abstract: We investigate neutrino oscillation in the field of an axially symmetric space-time, employing the so-called $q$-metric, in the context of general relativity. Following the standard approach, we compute the phase shift invoking the weak and strong field limits and small deformation. To do so, we consider neutron stars, white dwarfs and supernovae as strong gravitational regimes whereas the Solar System as weak field regime. We argue that the inclusion of the quadrupole parameter leads to the modification of the well-known results coming from the spherical solution due to the Schwarschild space-time. Hence, we show that in the Solar System regime, considering the Earth and Sun, there is a weak probability to detect deviations from the flat case, differently from the case of neutron stars and white dwarfs in which this probability is larger. Thus, we heuristically discuss some implications on constraining the free parameters of the phase shift by means of astrophysical neutrinos. A few consequences in cosmology and possible applications for future space experiments are also discussed throughout the text.


title: The Classical Double Copy for M-theory from a Kerr-Schild Ansatz for Exceptional Field Theory

abstract: We construct the classical double copy formalism for M-theory. This extends the current state of the art by including the three form potential of eleven dimensional supergravity along with the metric. The key for this extension is to construct a Kerr-Schild type Ansatz for exceptional field theory. This Kerr-Schild Ansatz then allows us to find the solutions of charged objects such as the membrane from a set of single copy fields. The exceptional field theory formalism then automatically produces the IIB Kerr-Schild ansatz allowing the construction of the single copy for the fields of IIB supergravity (with manifest $SL(2)$ symmetry).


title: Saturation problems about forbidden $0$-$1$ submatrices

abstract: A $0$-$1$ matrix $M$ is saturating for a $0$-$1$ matrix $P$ if $M$ does not contain a submatrix that can be turned into $P$ by changing some $1$ entries to $0$ entries, and changing an arbitrary $0$ to $1$ in $M$ introduces such a submatrix in $M$. In saturation problems for $0$-$1$ matrices we are interested in estimating the minimum number of $1$ entries in an $m \times n$ matrix that is saturating for $P$, in terms of $m$ and $n$. In other words, we wish to give good estimates for the saturation function of $P$. Recently, Brualdi and Cao initiated the study of saturation problems in the context of $0$-$1$ matrices. We extend their work in several directions. We prove that every $0$-$1$ forbidden matrix has its saturation function either in $\Theta(1)$ or $\Theta(n)$ in the case when we restrict ourselves to square saturating matrices. Then we give a partial answer to a question posed by Brualdi and Cao about the saturation function of $J_k$, which is obtained from the identity matrix $I_k$ by putting the first row after the last row. Furthermore, we exhibit a $5\times 5$ permutation matrix with the saturation function bounded from the above by a fixed constant. We complement this result by identifying large classes of $0$-$1$ matrices with linear saturation function. Finally, we completely resolve the related semisaturation problem as far as the constant vs. linear dichotomy is concerned.


title: Vector modes in $\Lambda$CDM: the gravitomagnetic potential in dark matter haloes from relativistic $N$-body simulations

abstract: We investigate the transverse modes of the gravitational and velocity fields in $\Lambda$CDM, based on a high-resolution simulation performed using the adaptive-mesh refinement general-relativistic $N$-body code GRAMSES. We study the generation of vorticity in the dark matter velocity field at low redshift, providing fits to the shape and evolution of its power spectrum over a range of scales. By analysing the gravitomagnetic vector potential, which is absent in Newtonian simulations, in dark matter haloes with masses ranging from $\sim10^{12.5}~h^{-1}{M}_{\odot}$ to $\sim10^{15}~h^{-1}{M}_{\odot}$, we find that its magnitude correlates with the halo mass, peaking in the inner regions. Nevertheless, on average, its ratio against the scalar gravitational potential remains fairly constant, below percent level, decreasing roughly linearly with redshift and showing a weak dependence on halo mass. Furthermore, we show that the gravitomagnetic acceleration in haloes peaks towards the core and reaches almost $10^{-10}$ $h$ cm/s$^2$ in the most massive halo of the simulation. However, regardless of the halo mass, the ratio between the magnitudes of the gravitomagnetic force and the standard gravitational force is typically at around the $10^{-5}$ level inside the haloes, again without significant radius dependence. This result confirms that the gravitomagnetic effects have a negligible impact on structure formation, even for the most massive structures, although its behaviour in low density regions remains to be explored. Likewise, the impact on observations remains to be understood in the future.


title: Variational (Gradient) Estimate of the Score Function in Energy-based Latent Variable Models

abstract: The learning and evaluation of energy-based latent variable models (EBLVMs) without any structural assumptions are highly challenging, because the true posteriors and the partition functions in such models are generally intractable. This paper presents variational estimates of the score function and its gradient with respect to the model parameters in a general EBLVM, referred to as VaES and VaGES respectively. The variational posterior is trained to minimize a certain divergence to the true model posterior and the bias in both estimates can be bounded by the divergence theoretically. With a minimal model assumption, VaES and VaGES can be applied to the kernelized Stein discrepancy (KSD) and score matching (SM)-based methods to learn EBLVMs. Besides, VaES can also be used to estimate the exact Fisher divergence between the data and general EBLVMs.


title: Unconventional Policies Effects on Stock Market Volatility: A MAP Approach

abstract: Taking the European Central Bank unconventional policies as a reference, we suggest a class of Multiplicative Error Models (MEM) taylored to analyze the impact such policies have on stock market volatility. The new set of models, called MEM with Asymmetry and Policy effects (MAP), keeps the base volatility dynamics separate from a component reproducing policy effects, with an increase in volatility on announcement days and a decrease unfolding implementation effects. When applied to four Eurozone markets, a Model Confidence Set approach finds a significant improvement of the forecasting power of the proxy after the Expanded Asset Purchase Programme implementation; a multi--step ahead forecasting exercise estimates the duration of the effect, and, by shocking the policy variable, we are able to quantify the reduction in volatility which is more marked for debt--troubled countries.


title: Quantitative Digital Microscopy with Deep Learning

abstract: Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time consuming, and computationally expensive. Recently, alternative data-driven approaches using deep learning have greatly improved quantitative digital microscopy, potentially offering automatized, accurate, and fast image analysis. However, the combination of deep learning and video microscopy remains underutilized primarily due to the steep learning curve involved in developing custom deep-learning solutions. To overcome this issue, we introduce a software, DeepTrack 2.0, to design, train and validate deep-learning solutions for digital microscopy. We use it to exemplify how deep learning can be employed for a broad range of applications, from particle localization, tracking and characterization to cell counting and classification. Thanks to its user-friendly graphical interface, DeepTrack 2.0 can be easily customized for user-specific applications, and, thanks to its open-source object-oriented programming, it can be easily expanded to add features and functionalities, potentially introducing deep-learning-enhanced video microscopy to a far wider audience.


title: Relating Functional and Imperative Session Types

abstract: Imperative session types provide an imperative interface to session-typed communication. In such an interface, channel references are first-class objects with operations that change the typestate of the channel. Compared to functional session type APIs, the program structure is simpler at the surface, but typestate is required to model the current state of communication throughout. Following an early work that explored the imperative approach, a significant body of work on session types has neglected the imperative approach and opts for a functional approach that uses linear types to manage channel references soundly. We demonstrate that the functional approach subsumes the early work on imperative session types by exhibiting a typing and semantics preserving translation into a system of linear functional session types. We further show that the untyped backwards translation from the functional to the imperative calculus is semantics preserving. We restrict the type system of the functional calculus such that the backwards translation becomes type preserving. Thus, we precisely capture the difference in expressiveness of the two calculi and conclude that the lack of expressiveness in the imperative calculus is largely due to restrictions imposed by its type system.


title: Local plasticity rules can learn deep representations using self-supervised contrastive predictions

abstract: Learning in the brain is poorly understood and learning rules that respect biological constraints, yet yield deep hierarchical representations, are still unknown. Here, we propose a learning rule that takes inspiration from neuroscience and recent advances in self-supervised deep learning. Learning minimizes a simple layer-specific loss function and does not need to back-propagate error signals within or between layers. Instead, weight updates follow a local, Hebbian, learning rule that only depends on pre- and post-synaptic neuronal activity, predictive dendritic input and widely broadcasted modulation factors which are identical for large groups of neurons. The learning rule applies contrastive predictive learning to a causal, biological setting using saccades (i.e. rapid shifts in gaze direction). We find that networks trained with this self-supervised and local rule build deep hierarchical representations of images, speech and video.


title: Parsimonious Quantile Regression of Financial Asset Tail Dynamics via Sequential Learning

abstract: We propose a parsimonious quantile regression framework to learn the dynamic tail behaviors of financial asset returns. Our model captures well both the time-varying characteristic and the asymmetrical heavy-tail property of financial time series. It combines the merits of a popular sequential neural network model, i.e., LSTM, with a novel parametric quantile function that we construct to represent the conditional distribution of asset returns. Our model also captures individually the serial dependences of higher moments, rather than just the volatility. Across a wide range of asset classes, the out-of-sample forecasts of conditional quantiles or VaR of our model outperform the GARCH family. Further, the proposed approach does not suffer from the issue of quantile crossing, nor does it expose to the ill-posedness comparing to the parametric probability density function approach.


title: Theta functions and optimal lattices for a grid cells model

abstract: Certain types of neurons, called "grid cells", have been shown to fire on a triangular grid when an animal is navigating on a two-dimensional environment, whereas recent studies suggest that the face-centred-cubic (FCC) lattice is the good candidate for the same phenomenon in three dimensions. The goal of this paper is to give new evidences of these phenomena by considering a infinite set of independent neurons (a module) with Poisson statistics and periodic spread out Gaussian tuning curves. This question of the existence of an optimal grid is transformed into a maximization problem among all possible unit density lattices for a Fisher Information which measures the accuracy of grid-cells representations in $\mathbb{R}^d$. This Fisher Information has translated lattice theta functions as building blocks. We first derive asymptotic and numerical results showing the (non-)maximality of the triangular lattice with respect to the Gaussian parameter and the size of the firing field. In a particular case where the size of the firing fields and the lattice spacing match with experiments, we have numerically checked that it is possible to find a value for the Gaussian parameter above which the triangular lattice is always optimal. In the case of a radially symmetric distribution of firing locations, we also characterize all the lattices that are critical points for the Fisher Information at fixed scales belonging to an open interval (we call these lattices "volume stationary"). It allows us to compare the Fisher Information of a finite number of lattices in dimension 2 and 3 and to give another evidences of the optimality of the triangular and FCC lattices.


title: Training Flexible Depth Model by Multi-Task Learning for Neural Machine Translation

abstract: The standard neural machine translation model can only decode with the same depth configuration as training. Restricted by this feature, we have to deploy models of various sizes to maintain the same translation latency, because the hardware conditions on different terminal devices (e.g., mobile phones) may vary greatly. Such individual training leads to increased model maintenance costs and slower model iterations, especially for the industry. In this work, we propose to use multi-task learning to train a flexible depth model that can adapt to different depth configurations during inference. Experimental results show that our approach can simultaneously support decoding in 24 depth configurations and is superior to the individual training and another flexible depth model training method -- LayerDrop.


title: Supercards, Sunshines and Caterpillar Graphs

abstract: The vertex-deleted subgraph G-v, obtained from the graph G by deleting the vertex v and all edges incident to v, is called a card of G. The deck of G is the multiset of its unlabelled cards. The number of common cards b(G,H) of G and H is the cardinality of the multiset intersection of the decks of G and H. A supercard G+ of G and H is a graph whose deck contains at least one card isomorphic to G and at least one card isomorphic to H. We show how maximum sets of common cards of G and H correspond to certain sets of permutations of the vertices of a supercard, which we call maximum saturating sets. We apply the theory of supercards and maximum saturating sets to the case when G is a sunshine graph and H is a caterpillar graph. We show that, for large enough n, there exists some maximum saturating set that contains at least b(G,H)-2 automorphisms of G+, and that this subset is always isomorphic to either a cyclic or dihedral group. We prove that b(G,H)<=2(n+1)/5 for large enough n, and that there exists a unique family of pairs of graphs that attain this bound. We further show that, in this case, the corresponding maximum saturating set is isomorphic to the dihedral group.


title: Nanoscale Rigidity in Cross-Linked Micelle Networks Revealed by XPCS Nanorheology

abstract: Solutions of wormlike micelles can form cross-linked networks on microscopic length scales. The unique mechanical properties of these complex fluids are driven by the interplay between the network structure and dynamics which are investigated by plate-plate rheometry and X-ray photon correlation spectroscopy~(XPCS) nanorheology. Intensity auto-correlation functions of tracer nanoparticles~(NPs) dispersed in micelle solutions were recorded which captured both the slow structural network relaxation and the short-time dynamics of NPs trapped in the network. The results are indicative of a resonance-like dynamic behavior of the network on the nanoscale that develops as a consequence of the intrinsic short-range rigidity of individual micelle chains.


title: On the mass and metallicity distribution of parent AGB stars of presolar SiC

abstract: The vast majority (>=90%) of presolar SiC grains identified in primitive meteorites are relics of ancient asymptotic giant branch (AGB) stars, whose ejecta were incorporated into the Solar System during its formation. Detailed characterization of these ancient stardust grains has revealed precious information on mixing processes in AGB interiors in great detail. However, the mass and metallicity distribution of their parent stars still remains ambiguous, although such information is crucial to investigating the slow neutron capture process, whose efficiency is mass- and metallicity-dependent. Using a well-known Milky Way chemo-dynamical model, we follow the evolution of the AGB stars that polluted the Solar System at 4.57 Gyr ago and weighted the stars based on their SiC dust productions. We find that presolar SiC in the Solar System predominantly originated from AGB stars with M~2 Msun and Z~Zsun. Our finding well explains the grain-size distribution of presolar SiC identified in situ in primitive meteorites. Moreover, it provides complementary results to very recent papers dealing with the characterization of parent stars of presolar SiC.


title: Effective Distributed Representations for Academic Expert Search

abstract: Expert search aims to find and rank experts based on a user's query. In academia, retrieving experts is an efficient way to navigate through a large amount of academic knowledge. Here, we study how different distributed representations of academic papers (i.e. embeddings) impact academic expert retrieval. We use the Microsoft Academic Graph dataset and experiment with different configurations of a document-centric voting model for retrieval. In particular, we explore the impact of the use of contextualized embeddings on search performance. We also present results for paper embeddings that incorporate citation information through retrofitting. Additionally, experiments are conducted using different techniques for assigning author weights based on author order. We observe that using contextual embeddings produced by a transformer model trained for sentence similarity tasks produces the most effective paper representations for document-centric expert retrieval. However, retrofitting the paper embeddings and using elaborate author contribution weighting strategies did not improve retrieval performance.


title: Fast Graph Kernel with Optical Random Features

abstract: The graphlet kernel is a classical method in graph classification. It however suffers from a high computation cost due to the isomorphism test it includes. As a generic proxy, and in general at the cost of losing some information, this test can be efficiently replaced by a user-defined mapping that computes various graph characteristics. In this paper, we propose to leverage kernel random features within the graphlet framework, and establish a theoretical link with a mean kernel metric. If this method can still be prohibitively costly for usual random features, we then incorporate optical random features that can be computed in constant time. Experiments show that the resulting algorithm is orders of magnitude faster that the graphlet kernel for the same, or better, accuracy.


title: Constraining resonances by using the electroweak effective theory

abstract: In the light of the mass gap between Standard Model (SM) states and possible new particles, effective field theories are a suitable approach. We take on the non-linear realization of the electroweak symmetry breaking: the electroweak effective theory (EWET), also known as Higgs effective field theory (HEFT) or electroweak chiral Lagrangian (EWChL). At higher scales we consider a resonance electroweak Lagrangian, coupling SM fields to resonances. Integrating out these resonances and assuming a well-behaved high-energy behavior, some of the bosonic low-energy constants are determined or constrained in terms of resonance masses. Present experimental bounds on these low-energy constants allow us to push the resonance mass scale to the TeV range, $M_R \geq 2\,$TeV, in good agreement with previous estimations.


title: Fingerprinting Heatwaves and Cold Spells and Assessing Their Response to Climate Change using Large Deviation Theory

abstract: Extreme events provide relevant insights into the dynamics of climate and their understanding is key for mitigating the impact of climate variability and climate change. By applying large deviation theory to a state-of-the-art Earth system model, we define the climatology of persistent heatwaves and cold spells in key target geographical regions by estimating the rate functions for the surface temperature, and we assess the impact of increasing CO$_2$ concentration on such persistent anomalies. Hence, we can better quantify the increasing hazard {\color{black}due} to heatwaves in a warmer climate. We show that two 2010 high impact events - summer Russian heatwave and winter Dzud in Mongolia - are associated with atmospheric patterns that are exceptional compared to the typical ones, but typical compared to the climatology of extremes. Their dynamics is encoded in the natural variability of the climate. Finally, we propose and test an approximate formula for the return times of large and persistent temperature fluctuations from easily accessible statistical properties.

categories: physics.ao-ph cond-mat.stat-mech physics.flu-dyn physics.geo-ph