title: Variance Reduction for Evolution Strategies via Structured Control Variates

abstract: Evolution Strategies (ES) are a powerful class of blackbox optimization techniques that recently became a competitive alternative to state-of-the-art policy gradient (PG) algorithms for reinforcement learning (RL). We propose a new method for improving accuracy of the ES algorithms, that as opposed to recent approaches utilizing only Monte Carlo structure of the gradient estimator, takes advantage of the underlying MDP structure to reduce the variance. We observe that the gradient estimator of the ES objective can be alternatively computed using reparametrization and PG estimators, which leads to new control variate techniques for gradient estimation in ES optimization. We provide theoretical insights and show through extensive experiments that this RL-specific variance reduction approach outperforms general purpose variance reduction methods.


title: A data-driven approach to sampling matrix selection for compressive sensing

abstract: Sampling is a fundamental aspect of any implementation of compressive sensing. Typically, the choice of sampling method is guided by the reconstruction basis. However, this approach can be problematic with respect to certain hardware constraints and is not responsive to domain-specific context. We propose a method for defining an order for a sampling basis that is optimal with respect to capturing variance in data, thus allowing for meaningful sensing at any desired level of compression. We focus on the Walsh-Hadamard sampling basis for its relevance to hardware constraints, but our approach applies to any sampling basis of interest. We illustrate the effectiveness of our method on the Physical Sciences Inc. Fabry-P\'{e}rot interferometer sensor multispectral dataset, the Johns Hopkins Applied Physics Lab FTIR-based longwave infrared sensor hyperspectral dataset, and a Colorado State University Swiss Ranger depth image dataset. The spectral datasets consist of simulant experiments, including releases of chemicals such as GAA and SF6. We combine our sampling and reconstruction with the adaptive coherence estimator (ACE) and bulk coherence for chemical detection and we incorporate an algorithmic threshold for ACE values to determine the presence or absence of a chemical. We compare results across sampling methods in this context. We have successful chemical detection at a compression rate of 90%. For all three datasets, we compare our sampling approach to standard orderings of sampling basis such as random, sequency, and an analog of sequency that we term `frequency.' In one instance, the peak signal to noise ratio was improved by over 30% across a test set of depth images.


title: 2019 Evolutionary Algorithms Review

abstract: Evolutionary algorithm research and applications began over 50 years ago. Like other artificial intelligence techniques, evolutionary algorithms will likely see increased use and development due to the increased availability of computation, more robust and available open source software libraries, and the increasing demand for artificial intelligence techniques. As these techniques become more adopted and capable, it is the right time to take a perspective of their ability to integrate into society and the human processes they intend to augment. In this review, we explore a new taxonomy of evolutionary algorithms and resulting classifications that look at five main areas: the ability to manage the control of the environment with limiters, the ability to explain and repeat the search process, the ability to understand input and output causality within a solution, the ability to manage algorithm bias due to data or user design, and lastly, the ability to add corrective measures. These areas are motivated by today's pressures on industry to conform to both societies concerns and new government regulatory rules. As many reviews of evolutionary algorithms exist, after motivating this new taxonomy, we briefly classify a broad range of algorithms and identify areas of future research.


title: Advancing Speech Recognition With No Speech Or With Noisy Speech

abstract: In this paper we demonstrate end-to-end continuous speech recognition (CSR) using electroencephalography (EEG) signals with no speech signal as input. An attention model based automatic speech recognition (ASR) and connectionist temporal classification (CTC) based ASR systems were implemented for performing recognition. We further demonstrate CSR for noisy speech by fusing with EEG features.


title: CostMAP: An open-source software package for developing cost surfaces

abstract: Cost Surfaces are a quantitative means of assigning social, environmental, and engineering costs that impact movement across landscapes. Cost surfaces are a crucial aspect of route optimization and least cost path (LCP) calculations and are used in a wide range of disciplines including computer science, landscape ecology, and energy infrastructure modeling. Linear features present a key weakness to traditional routing calculations along costs surfaces because they cannot identify whether moving from a cell to its adjacent neighbors constitutes crossing a linear barrier (increased cost) or following a corridor (reduced cost). Following and avoiding linear features can drastically change predicted routes. In this paper, we introduce an approach to address this "adjacency" issue using a search kernel that identifies these critical barriers and corridors. We have built this approach into a new Java-based open-source software package called CostMAP (cost surface multi-layer aggregation program), which calculates cost surfaces and cost networks using the search kernel. CostMAP not only includes the new adjacency capability, it is also a versatile multi-platform package that allows users to input multiple GIS data layers and to set weights and rules for developing a weighted-cost network. We compare CostMAP performance with traditional cost surface approaches and show significant performance gains, both following corridors and avoiding barriers, using examples in a movement ecology framework and pipeline routing for carbon capture, and storage (CCS). We also demonstrate that the new software can straightforwardly calculate cost surfaces on a national scale.


title: Learning Discriminative features using Center Loss and Reconstruction as Regularizer for Speech Emotion Recognition

abstract: This paper proposes a Convolutional Neural Network (CNN) inspired by Multitask Learning (MTL) and based on speech features trained under the joint supervision of softmax loss and center loss, a powerful metric learning strategy, for the recognition of emotion in speech. Speech features such as Spectrograms and Mel-frequency Cepstral Coefficient s (MFCCs) help retain emotion-related low-level characteristics in speech. We experimented with several Deep Neural Network (DNN) architectures that take in speech features as input and trained them under both softmax and center loss, which resulted in highly discriminative features ideal for Speech Emotion Recognition (SER). Our networks also employ a regularizing effect by simultaneously performing the auxiliary task of reconstructing the input speech features. This sharing of representations among related tasks enables our network to better generalize the original task of SER. Some of our proposed networks contain far fewer parameters when compared to state-of-the-art architectures.


title: Customer Segmentation of Wireless Trajectory Data

abstract: Wireless trajectory data consists of a number of (time, point) entries where each point is associated with a particular wireless device (WAP or BLE beacon) tied to a location identifier, such as a place name. A trajectory relates to a particular mobile device. Such data can be clustered `semantically' to identify similar trajectories, where similarity relates to non-geographic characteristics such as the type of location visited. Here we present a new approach to semantic trajectory clustering for such data. The approach is applicable to interpreting data that does not contain geographical coordinates, and thus contributes to the current literature on semantic trajectory clustering. The literature does not appear to provide such an approach, instead focusing on trajectory data where latitude and longitude data is available. We apply the techniques developed above in the context of the Onward Journey Planner Application, with the motivation of providing on-line recommendations for onward journey options in a context-specific manner. The trajectories analysed indicate commute patterns on the London Underground. Points are only recorded for communication with WAP and BLE beacons within the rail network. This context presents additional challenge since the trajectories are `truncated', with no true origin and destination details. In the above context we find that there are a range of travel patterns in the data, without the existence of distinct clusters. Suggestions are made concerning how to approach the problem of provision of on-line recommendations with such a data set. Thoughts concerning the related problem of prediction of journey route and destination are also provided.


title: Measuring the engagement level in encrypted group conversations by using temporal networks

abstract: Chat groups are well-known for their capacity to promote viral political and marketing campaigns, spread fake news, and create rallies by hundreds of thousands on the streets. Also, with the increasing public awareness regarding privacy and surveillance, many platforms have started to deploy end-to-end encrypted protocols. In this context, the group's conversations are not accessible in plain text or readable format by third-party organizations or even the platform owner. Then, the main challenge that emerges is related to getting insights from users' activity of those groups, but without accessing the messages. Previous approaches evaluated the user engagement by assessing user's activity, however, on limited conditions where the data is encrypted, they cannot be applied. In this work, we present a framework for measuring the level of engagement of group conversations and users, without reading the messages. Our framework creates an ensemble of interaction networks that represent the temporal evolution of the conversation, then, we apply the proposed Engagement Index (EI) for each interval of conversations to assess users' participation. Our results in five datasets from real-world WhatsApp Groups indicate that, based on the EI, it is possible to identify the most engaged users within a time interval, create rankings, and group users according to their engagement and monitor their performance over time.


title: Informative Image Captioning with External Sources of Information

abstract: An image caption should fluently present the essential information in a given image, including informative, fine-grained entity mentions and the manner in which these entities interact. However, current captioning models are usually trained to generate captions that only contain common object names, thus falling short on an important "informativeness" dimension. We present a mechanism for integrating image information together with fine-grained labels (assumed to be generated by some upstream models) into a caption that describes the image in a fluent and informative manner. We introduce a multimodal, multi-encoder model based on Transformer that ingests both image features and multiple sources of entity labels. We demonstrate that we can learn to control the appearance of these entity labels in the output, resulting in captions that are both fluent and informative.


title: Radio spectral index distribution of SDSS-FIRST sources across optical diagnostic diagrams

abstract: A detailed understanding of how the activity of a galactic nucleus regulates the growth of its host is still missing. To understand the activity and the types of accretion of supermassive black holes in different hosts, it is essential to study radio-optical properties of a large sample of extragalactic sources. In particular, we aim at studying the radio spectral index trends across the optical emission line diagnostic diagrams to search for potential (anti)correlations. To this goal, we combine flux densities from the radio FIRST survey at $1.4\,{\rm GHz}$ (with the flux density range $10\,{\rm mJy} \leq F_{1.4} \leq 1000\,{\rm mJy}$) for 209 SDSS sources at intermediate redshift $(0.04\leq z \leq 0.4)$ with the Effelsberg radiotelescope measurements at $4.85\,{\rm GHz}$ and $10.45\,{\rm GHz}$. The information about the optical emission-line ratios is obtained from the SDSS-DR7 catalogue. Using the Effelsberg data, we were able to infer the two-point radio spectral index distributions for star-forming galaxies, composite galaxies (with a combined contribution to the line emission from the star-formation and AGN activity), Seyferts, and low ionization narrow emission region (LINER) galaxies. While studying the distribution of steep, flat, and inverted sources across optical diagnostic diagrams, we found three distinct classes of radio emitters for our sample: (i) sources with steep radio index, high ionization ratio and high radio loudness, (ii) sources with flat radio index, lower ionization ratio and intermediate radio loudness, (iii) sources with inverted radio index, low ionization ratio and low radio loudness. The classes (i), (ii), (iii) cluster mainly along the transition from Seyfert to LINER sources in the BPT diagram. We interpret these groups as a result of the recurrent nuclear-jet activity.


title: Bayesian Optimisation over Multiple Continuous and Categorical Inputs

abstract: Efficient optimisation of black-box problems that comprise both continuous and categorical inputs is important, yet poses significant challenges. We propose a new approach, Continuous and Categorical Bayesian Optimisation (CoCaBO), which combines the strengths of multi-armed bandits and Bayesian optimisation to select values for both categorical and continuous inputs. We model this mixed-type space using a Gaussian Process kernel, designed to allow sharing of information across multiple categorical variables, each with multiple possible values; this allows CoCaBO to leverage all available data efficiently. We extend our method to the batch setting and propose an efficient selection procedure that dynamically balances exploration and exploitation whilst encouraging batch diversity. We demonstrate empirically that our method outperforms existing approaches on both synthetic and real-world optimisation tasks with continuous and categorical inputs.


title: Placeto: Learning Generalizable Device Placement Algorithms for Distributed Machine Learning

abstract: We present Placeto, a reinforcement learning (RL) approach to efficiently find device placements for distributed neural network training. Unlike prior approaches that only find a device placement for a specific computation graph, Placeto can learn generalizable device placement policies that can be applied to any graph. We propose two key ideas in our approach: (1) we represent the policy as performing iterative placement improvements, rather than outputting a placement in one shot; (2) we use graph embeddings to capture relevant information about the structure of the computation graph, without relying on node labels for indexing. These ideas allow Placeto to train efficiently and generalize to unseen graphs. Our experiments show that Placeto requires up to 6.1x fewer training steps to find placements that are on par with or better than the best placements found by prior approaches. Moreover, Placeto is able to learn a generalizable placement policy for any given family of graphs, which can then be used without any retraining to predict optimized placements for unseen graphs from the same family. This eliminates the large overhead incurred by prior RL approaches whose lack of generalizability necessitates re-training from scratch every time a new graph is to be placed.


title: Variable Impedance Control in End-Effector Space: An Action Space for Reinforcement Learning in Contact-Rich Tasks

abstract: Reinforcement Learning (RL) of contact-rich manipulation tasks has yielded impressive results in recent years. While many studies in RL focus on varying the observation space or reward model, few efforts focused on the choice of action space (e.g. joint or end-effector space, position, velocity, etc.). However, studies in robot motion control indicate that choosing an action space that conforms to the characteristics of the task can simplify exploration and improve robustness to disturbances. This paper studies the effect of different action spaces in deep RL and advocates for Variable Impedance Control in End-effector Space (VICES) as an advantageous action space for constrained and contact-rich tasks. We evaluate multiple action spaces on three prototypical manipulation tasks: Path Following (task with no contact), Door Opening (task with kinematic constraints), and Surface Wiping (task with continuous contact). We show that VICES improves sample efficiency, maintains low energy consumption, and ensures safety across all three experimental setups. Further, RL policies learned with VICES can transfer across different robot models in simulation, and from simulation to real for the same robot. Further information is available at https://stanfordvl.github.io/vices.


title: Universal properties of concentration sensing in large ligand-receptor networks

abstract: Cells estimate concentrations of chemical ligands in their environment using a limited set of receptors. Recent work has shown that the temporal sequence of binding and unbinding events on just a single receptor can be used to estimate the concentrations of multiple ligands. Here, for a network of many ligands and many receptors, we show that such temporal sequences can be used to estimate the concentration of a few times as many ligand species as there are receptors. Crucially, we show that the spectrum of the inverse covariance matrix of these estimates has several universal properties, which we trace to properties of Vandermonde matrices. We argue that this can be used by cells in realistic biochemical decoding networks.


title: Maximum Approximate Bernstein Likelihood Estimation in Proportional Hazard Model for Interval-Censored Data

abstract: Maximum approximate Bernstein likelihood estimates of the baseline density function and the regression coefficients in the proportional hazard regression models based on interval-censored event time data are proposed. This results in not only a smooth estimate of the survival function which enjoys faster convergence rate but also improved estimates of the regression coefficients. Simulation shows that the finite sample performance of the proposed method is better than the existing ones. The proposed method is illustrated by real data applications.


title: Influence of atomic kinetics on inverse Bremsstrahlung heating and non-local thermal transport

abstract: This paper describes a computational model that self-consistently combines physics of kinetic electrons and atomic processes in a single framework. The formulation consists of a kinetic Vlasov- Boltzmann-Fokker-Planck equation for free electrons and a non-Maxwellian collisional-radiative model for atomic state populations. We utilize this model to examine the influence of atomic kinetics on inverse Bremsstrahlung (IB) heating and non-local thermal transport. We show that atomic kinetics affects non-linear IB absorption rates by further modifying the electron distribution in addition to laser heating. We also show that accurate modeling of non-local heat flow requires a self-consistent treatment of atomic kinetics, because the effective thermal conductivity strongly depends on the ionization balance of the plasma.


title: A Multiscale Scan Statistic for Adaptive Submatrix Localization

abstract: We consider the problem of localizing a submatrix with larger-than-usual entry values inside a data matrix, without the prior knowledge of the submatrix size. We establish an optimization framework based on a multiscale scan statistic, and develop algorithms in order to approach the optimizer. We also show that our estimator only requires a signal strength of the same order as the minimax estimator with oracle knowledge of the submatrix size, to exactly recover the anomaly with high probability. We perform some simulations that show that our estimator has superior performance compared to other estimators which do not require prior submatrix knowledge, while being comparatively faster to compute.


title: Low-Resource Corpus Filtering using Multilingual Sentence Embeddings

abstract: In this paper, we describe our submission to the WMT19 low-resource parallel corpus filtering shared task. Our main approach is based on the LASER toolkit (Language-Agnostic SEntence Representations), which uses an encoder-decoder architecture trained on a parallel corpus to obtain multilingual sentence representations. We then use the representations directly to score and filter the noisy parallel sentences without additionally training a scoring function. We contrast our approach to other promising methods and show that LASER yields strong results. Finally, we produce an ensemble of different scoring methods and obtain additional gains. Our submission achieved the best overall performance for both the Nepali-English and Sinhala-English 1M tasks by a margin of 1.3 and 1.4 BLEU respectively, as compared to the second best systems. Moreover, our experiments show that this technique is promising for low and even no-resource scenarios.


title: Identifying the magnetospheric driver of STEVE

abstract: For the first time, we identify the magnetospheric driver of STEVE, east-west aligned narrow emissions in the subauroral region. In the ionosphere, STEVE is associated with subauroral ion drift (SAID) features of high electron temperature peak, density gradient, and strong westward ion flow. In this study, we present STEVE's magnetospheric driver region at a sharp plasmapause containing: strong tailward quasi-static electric field, kinetic Alfven waves, parallel electron acceleration, perpendicular ion drift. The observed continuous emissions of STEVE are possibly caused by ionospheric electron heating due to heat conduction and/or auroral acceleration process powered by Alfven waves, both driven by the observed equatorial magnetospheric processes. The observed green emissions are likely optical manifestations of electron precipitations associated with wave structures traveling along the plasmapause. The observed SAR arc at lower latitudes likely corresponds to the formation of low-energy plasma inside the plasmapause by Coulomb collisions between ring current ions and plasmaspheric plasma.


title: Dirac point formation revealed by Andreev tunneling in superlattice-graphene/superconductor junctions

abstract: A graphene superlattice is formed by a one-dimensional periodic potential and is characterized by the emergence of new Dirac points in the electronic structure. The group velocity of graphene's massless Dirac fermions at the new points is drastically reduced, resulting in a measurable effect in the conductance spectroscopy. We show here that tunnel spectroscopy using a superconducting hybrid junction is more sensitive to the formation of Dirac points in the spectrum of graphene superlattices due to the additional contribution of Andreev processes. We examine the transport properties of a graphene-based superlattice--superconductor hybrid junction and demonstrate that a superlattice potential can coexist with proximity-induced superconducting correlations. Both effects contribute to change graphene's spectrum for subgap energies and, as a result, the normalized tunneling conductance features sharp changes for voltages proportional to the energy separation between the original and the newly generated Dirac points.


title: A Performance and Cost Assessment of Machine Learning Interatomic Potentials

abstract: Machine learning of the quantitative relationship between local environment descriptors and the potential energy surface of a system of atoms has emerged as a new frontier in the development of interatomic potentials (IAPs). Here, we present a comprehensive evaluation of ML-IAPs based on four local environment descriptors --- Behler-Parrinello symmetry functions, smooth overlap of atomic positions (SOAP), the Spectral Neighbor Analysis Potential (SNAP) bispectrum components, and moment tensors --- using a diverse data set generated using high-throughput density functional theory (DFT) calculations. The data set comprising bcc (Li, Mo) and fcc (Cu, Ni) metals and diamond group IV semiconductors (Si, Ge) is chosen to span a range of crystal structures and bonding. All descriptors studied show excellent performance in predicting energies and forces far surpassing that of classical IAPs, as well as predicting properties such as elastic constants and phonon dispersion curves. We observe a general trade-off between accuracy and the degrees of freedom of each model, and consequently computational cost. We will discuss these trade-offs in the context of model selection for molecular dynamics and other applications.


title: SGANVO: Unsupervised Deep Visual Odometry and Depth Estimation with Stacked Generative Adversarial Networks

abstract: Recently end-to-end unsupervised deep learning methods have achieved an effect beyond geometric methods for visual depth and ego-motion estimation tasks. These data-based learning methods perform more robustly and accurately in some of the challenging scenes. The encoder-decoder network has been widely used in the depth estimation and the RCNN has brought significant improvements in the ego-motion estimation. Furthermore, the latest use of Generative Adversarial Nets(GANs) in depth and ego-motion estimation has demonstrated that the estimation could be further improved by generating pictures in the game learning process. This paper proposes a novel unsupervised network system for visual depth and ego-motion estimation: Stacked Generative Adversarial Network(SGANVO). It consists of a stack of GAN layers, of which the lowest layer estimates the depth and ego-motion while the higher layers estimate the spatial features. It can also capture the temporal dynamic due to the use of a recurrent representation across the layers. See Fig.1 for details. We select the most commonly used KITTI [1] data set for evaluation. The evaluation results show that our proposed method can produce better or comparable results in depth and ego-motion estimation.


title: Exponential separation between shallow quantum circuits and unbounded fan-in shallow classical circuits

abstract: Recently, Bravyi, Gosset, and K\"{o}nig (Science, 2018) exhibited a search problem called the 2D Hidden Linear Function (2D HLF) problem that can be solved exactly by a constant-depth quantum circuit using bounded fan-in gates (or QNC^0 circuits), but cannot be solved by any constant-depth classical circuit using bounded fan-in AND, OR, and NOT gates (or NC^0 circuits). In other words, they exhibited a search problem in QNC^0 that is not in NC^0. We strengthen their result by proving that the 2D HLF problem is not contained in AC^0, the class of classical, polynomial-size, constant-depth circuits over the gate set of unbounded fan-in AND and OR gates, and NOT gates. We also supplement this worst-case lower bound with an average-case result: There exists a simple distribution under which any AC^0 circuit (even of nearly exponential size) has exponentially small correlation with the 2D HLF problem. Our results are shown by constructing a new problem in QNC^0, which we call the Relaxed Parity Halving Problem, which is easier to work with. We prove our AC^0 lower bounds for this problem, and then show that it reduces to the 2D HLF problem. As a step towards even stronger lower bounds, we present a search problem that we call the Parity Bending Problem, which is in QNC^0/qpoly (QNC^0 circuits that are allowed to start with a quantum state of their choice that is independent of the input), but is not even in AC^0[2] (the class AC^0 with unbounded fan-in XOR gates). All the quantum circuits in our paper are simple, and the main difficulty lies in proving the classical lower bounds. For this we employ a host of techniques, including a refinement of H{\aa}stad's switching lemmas for multi-output circuits that may be of independent interest, the Razborov-Smolensky AC^0[2] lower bound, Vazirani's XOR lemma, and lower bounds for non-local games.


title: Predicting Future Opioid Incidences Today

abstract: According to the Center of Disease Control (CDC), the Opioid epidemic has claimed more than 72,000 lives in the US in 2017 alone. In spite of various efforts at the local, state and federal level, the impact of the epidemic is becoming progressively worse, as evidenced by the fact that the number of Opioid related deaths increased by 12.5\% between 2016 and 2017. Predictive analytics can play an important role in combating the epidemic by providing decision making tools to stakeholders at multiple levels - from health care professionals to policy makers to first responders. Generating Opioid incidence heat maps from past data, aid these stakeholders to visualize the profound impact of the Opioid epidemic. Such post-fact creation of the heat map provides only retrospective information, and as a result, may not be as useful for preventive action in the current or future time-frames. In this paper, we present a novel deep neural architecture, which learns subtle spatio-temporal variations in Opioid incidences data and accurately predicts future heat maps. We evaluated the efficacy of our model on two open source datasets- (i) The Cincinnati Heroin Overdose dataset, and (ii) Connecticut Drug Related Death Dataset.


title: Macroscopic theorem of the portfolio optimization problem with a risk-free asset

abstract: The investment risk minimization problem with budget and return constraints has been the subject of research using replica analysis but there are shortcomings in the extant literature. With respect to Tobin's separation theorem and the capital asset pricing model, it is necessary to investigate the implications of a risk-free asset and examine its influence on the optimal portfolio. Accordingly, in this work, we explore the investment risk minimization problem in the presence of a risk-free asset with budget and return constraints. Moreover, we discuss opportunity loss, the Pythagorean theorem of the Sharpe ratio, and Tobin's separation theorem.

categories: q-fin.PM cond-mat.dis-nn cond-mat.stat-mech math.OC q-fin.MF


title: Local vs global master equation with common and separate baths: superiority of the global approach in partial secular approximation

abstract: Open systems of coupled qubits are ubiquitous in quantum physics. Finding a suitable master equation to describe their dynamics is therefore a crucial task that must be addressed with utmost attention. In the recent past, many efforts have been made toward the possibility of employing local master equations, which compute the interaction with the environment neglecting the direct coupling between the qubits, and for this reason may be easier to solve. Here, we provide a detailed derivation of the Markovian master equation for two coupled qubits interacting with common and separate baths, considering pure dephasing as well as dissipation. Then, we explore the differences between the local and global master equation, showing that they intrinsically depend on the way we apply the secular approximation. Our results prove that the global approach with partial secular approximation always provides the most accurate choice for the master equation when Born-Markov approximations hold, even for small inter-system coupling constants. Using different master equations we compute the stationary heat current between two separate baths, the entanglement dynamics generated by a common bath, and the emergence of spontaneous synchronization, showing the importance of the accurate choice of approach.


title: Large Sample Mean-Field Stochastic Optimization

abstract: We study a class of sampled stochastic optimization problems, where the underlying state process has diffusive dynamics of the mean-field type. We establish the existence of optimal relaxed controls when the sample set has finite size. The core of our paper is to prove, via $\Gamma$-convergence, that the minimizer of the finite sample relaxed problem converges to that of the limiting optimization problem. We connect the limit of the sampled objective functional to the unique solution, in the trajectory sense, of a nonlinear Fokker-Planck-Kolmogorov (FPK) equation in a random environment. We highlight the connection between the minimizers of our optimization problems and the optimal training weights of a deep residual neural network.


title: Plan-Driven approaches are alive and kicking in agile Global Software Development

abstract: Background: Agile methods are no longer restricted to small projects and co-located teams. The last decade has seen the spread of agile into large scale, distributed and regulated domains. Many case studies show successful agile adoption in GSD, however, taken as a whole, it remains unclear how widespread this trend is, and what form the agile adoption takes in a global software development (GSD) setting. Aims: Our objective is to gain a deeper understanding of how organisations adopt agile development methods in distributed settings. Specifically we aim to plot the current development process landscape in GSD. Method: We analyse industrial survey data from 33 different countries collected as part of the project that explored the wider use of hybrid development approaches in software development. We extract and analyse the results of 263 surveys completed by participants involved in globally distributed projects. Results: In our sample, 72 of globally distributed projects implement a mix of both agile and traditional approaches (termed `hybrid'). 25 of GSD organisations are predominantly agile, with only very few (5) opting for traditional approaches. GSD projects that used only agile methods tended to be very large. Conclusions: Globally Distributed Software Development (and project size) is not a barrier to adopting agile practices. Yet, to facilitate project coordination and general project management, many adopt traditional approaches, resulting in a hybrid approach that follows defined rules.


title: Solar Chromospheric Temperature Diagnostics: a joint ALMA-H$\alpha$ analysis

abstract: We present the first high-resolution, simultaneous observations of the solar chromosphere in the optical and millimeter wavelength ranges, obtained with ALMA and the IBIS instrument at the Dunn Solar Telescope. In this paper we concentrate on the comparison between the brightness temperature observed in ALMA Band 3 (3 mm; 100 GHz) and the core width of the H$\alpha$ 656.3 nm line, previously identified as a possible diagnostic of the chromospheric temperature. We find that in the area of plage, network and fibrils covered by our FOV the two diagnostics are well correlated, with similar spatial structures observed in both. The strength of the correlation is remarkable, given that the source function of the mm-radiation obeys local thermodynamic equilibrium, while the H$\alpha$ line has a source function that deviates significantly from the local Planck function. The observed range of ALMA brightness temperatures is sensibly smaller than the temperature range that was previously invoked to explain the observed width variations in H$\alpha$. We employ analysis from forward modeling with the RH code to argue that the strong correlation between H$\alpha$ width and ALMA brightness temperature is caused by their shared dependence on the population number $n_2$ of the first excited level of hydrogen. This population number drives millimeter opacity through hydrogen ionization via the Balmer continuum, and H$\alpha$ width through a curve-of-growth-like opacity effect. Ultimately, the $n_2$ population is regulated by the enhancement or lack of downward Ly$\alpha$ flux, which coherently shifts the formation height of both diagnostics to regions with different temperature, respectively.


title: Hiding in the crowd: Spectral signatures of overcoordinated hydrogen bond environments

abstract: Molecules with an excess number of hydrogen-bonding partners play a crucial role in fundamental chemical processes, ranging from the anomalous diffusion in supercooled water to the transport of aqueous proton defects and the ordering of water around hydrophobic solutes. Here we show that overcoordinated hydrogen bond environments can be identified in both the ambient and supercooled regimes of liquid water by combining experimental Raman multivariate curve resolution measurements and machine learning accelerated quantum simulations. In particular, we find that OH groups appearing in spectral regions usually associated with non-hydrogen-bonded species actually correspond to hydrogen bonds formed in overcoordinated environments. We further show that only these species exhibit a turnover in population as a function of temperature, which is robust and persists under both constant pressure and density conditions. This work thus provides a new tool to identify, interpret, and elucidate the spectral signatures of crowded hydrogen bond networks.

categories: physics.chem-ph cond-mat.other cond-mat.stat-mech physics.comp-ph


title: Sparse Spectrum Gaussian Process for Bayesian Optimization

abstract: We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this particular form of sparse approximations generates an overconfident GP, i.e. it produces less epistemic uncertainty than the original GP. Since the balance between predictive mean and the predictive variance is the key determinant to the success of Bayesian optimization, the current sparse spectrum methods are less suitable for it. We derive a new regularized marginal likelihood for finding the optimal frequencies to fix this over-confidence issue, particularly for Bayesian optimization. The regularizer trades off the accuracy in the model fitting with a targeted increase in the predictive variance of the resultant GP. Specifically, we use the entropy of the global maximum distribution from the posterior GP as the regularizer that needs to be maximized. Since this distribution cannot be calculated analytically, we first propose a Thompson sampling based approach and then a more efficient sequential Monte Carlo based approach to estimate it. Later, we also show that the Expected Improvement acquisition function can be used as a proxy for the maximum distribution, thus making the whole process further efficient. Experiments show considerable improvement to Bayesian optimization convergence rate over the vanilla sparse spectrum method and over a full GP when its covariance matrix is ill-conditioned due to the presence of a large number of observations.


title: Limitations of Lazy Training of Two-layers Neural Networks

abstract: We study the supervised learning problem under either of the following two models: (1) Feature vectors ${\boldsymbol x}_i$ are $d$-dimensional Gaussians and responses are $y_i = f_*({\boldsymbol x}_i)$ for $f_*$ an unknown quadratic function; (2) Feature vectors ${\boldsymbol x}_i$ are distributed as a mixture of two $d$-dimensional centered Gaussians, and $y_i$'s are the corresponding class labels. We use two-layers neural networks with quadratic activations, and compare three different learning regimes: the random features (RF) regime in which we only train the second-layer weights; the neural tangent (NT) regime in which we train a linearization of the neural network around its initialization; the fully trained neural network (NN) regime in which we train all the weights in the network. We prove that, even for the simple quadratic model of point (1), there is a potentially unbounded gap between the prediction risk achieved in these three training regimes, when the number of neurons is smaller than the ambient dimension. When the number of neurons is larger than the number of dimensions, the problem is significantly easier and both NT and NN learning achieve zero risk.


title: Consistent KK truncations for M5-branes wrapped on Riemann surfaces

abstract: We construct a consistent Kaluza-Klein reduction of $D=11$ supergravity on $\Sigma_2\times S^4$, where $\Sigma_2=S^2,\mathbb{R}^2$ or $H^2$, or a quotient thereof, at the level of the bosonic fields. The result is a gauged $N=4$, $D=5$ supergravity theory coupled to three vector multiplets, with the gauging lying in an $SO(2)\times SE(3)\subset SO(5,3)$ subgroup of the $SO(1,1)\times SO(5,3)$ global symmetry group of the ungauged theory. For $\Sigma_2=H^2$, the $D=5$ theory has a maximally supersymmetric $AdS_5$ vacuum which uplifts to the known solution of $D=11$ supergravity corresponding to M5-branes wrapping a Riemann surface with genus greater than one and dual to an $N=2$ SCFT in $d=4$. For $\Sigma_2=S^2$, we find two $AdS_5$ solutions, one of which is new, and both of which are unstable. There is an additional subtruncation to an $N=2$ gauged supergravity coupled to two vector multiplets, with very special real manifold $SO(1,1)\times SO(1,1)$, and a single hypermultiplet, with quaternionic K\"ahler manifold $SU(2,1)/S[U(2)\times U(1)]$ and gauging associated with an $SO(2)\times\mathbb{R}\subset SU(2,1)$ subgroup.


title: Neural Topographic Factor Analysis for fMRI Data

abstract: Neuroimaging studies produce gigabytes of spatio-temporal data for a small number of participants and stimuli. Rarely do researchers attempt to model and examine how individual participants vary from each other -- a question that should be addressable even in small samples given the right statistical tools. We propose Neural Topographic Factor Analysis (NTFA), a probabilistic factor analysis model that infers embeddings for participants and stimuli. These embeddings allow us to reason about differences between participants and stimuli as signal rather than noise. We evaluate NTFA on data from an in-house pilot experiment, as well as two publicly available datasets. We demonstrate that inferring representations for participants and stimuli improves predictive generalization to unseen data when compared to previous topographic methods. We also demonstrate that the inferred latent factor representations are useful for downstream tasks such as multivoxel pattern analysis and functional connectivity.


title: Quantum-Inspired Support Vector Machine

abstract: Support vector machine (SVM) is a particularly powerful and flexible supervised learning model that analyzes data for both classification and regression, whose usual algorithm complexity scales polynomially with the dimension of data space and the number of data points. To tackle the big data challenge, a quantum SVM algorithm was proposed, which is claimed to achieve exponential speedup for least squares SVM (LS-SVM). Here, inspired by the quantum SVM algorithm, we present a quantum-inspired classical algorithm for LS-SVM. In our approach, a improved fast sampling technique, namely indirect sampling, is proposed for sampling the kernel matrix and classifying. We first consider the LS-SVM with a linear kernel, and then discuss the generalization of our method to non-linear kernels. Theoretical analysis shows our algorithm can make classification with arbitrary success probability in logarithmic runtime of both the dimension of data space and the number of data points for low rank, low condition number and high dimensional data matrix, matching the runtime of the quantum SVM.


title: Harnessing Evolution for Multi-Hunk Program Repair

abstract: Despite significant advances in automatic program repair (APR)techniques over the past decade, practical deployment remains an elusive goal. One of the important challenges in this regard is the general inability of current APR techniques to produce patches that require edits in multiple locations, i.e., multi-hunk patches. In this work, we present a novel APR technique that generalizes single-hunk repair techniques to include an important class of multi-hunk bugs, namely bugs that may require applying a substantially similar patch at a number of locations. We term such sets of repair locations as evolutionary siblings - similar looking code, instantiated in similar contexts, that are expected to undergo similar changes. At the heart of our proposed method is an analysis to accurately identify a set of evolutionary siblings, for a given bug. This analysis leverages three distinct sources of information, namely the test-suite spectrum, a novel code similarity analysis, and the revision history of the project. The discovered siblings are then simultaneously repaired in a similar fashion. We instantiate this technique in a tool called Hercules and demonstrate that it is able to correctly fix 49 bugs in the Defects4J dataset, the highest of any individual APR technique to date. This includes 15 multi-hunk bugs and overall 13 bugs which have not been fixed by any other technique so far.


title: Mars in the aftermath of a colossal impact

abstract: The abundance of highly siderophile elements (HSEs) inferred for Mars' mantle from martian meteorites implies a Late Veneer (LV) mass addition of ~0.8 wt% with broadly chondritic composition. Late accretion to Mars by a differentiated Ceres-sized (~1000 km diameter) object can account for part of the requisite LV mass, and geochronological constraints suggests that this must have occurred no later than ca. 4480 Ma. Here, we analyze the outcome of the hypothetical LV giant impact to Mars with smoothed particle hydrodynamics simulations together with analytical theory. Results show that, in general about 50% of the impactor's metallic core shatters into ~10m fragments that subsequently fragment into sub-mm metallic hail at re-accretion. This returns a promising delivery of HSEs into martian mantle compared to either a head-on and hit-and-run collision; in both cases,<10% of impactor's core materials are fragmented and finally embedded in the martian mantle. Isotopic evidence from martian meteorites, and interpretations from atmospheric mapping data show that a global surface water reservoir could be present during the early Noachian (before ca. 4100 Ma). The millimeter-sized metal hail could thus react with a martian hydrosphere to generate ~3 bars of H2, which is adequate to act as a greenhouse and keep early Mars warm. Yet, we also find that this atmosphere is transient. It typically survives shorter than 3 Myr based on the expected extreme ultraviolet (EUV) flux of the early Sun; if the Sun was a slow rotator an accordingly weaker EUV flux could extend this lifetime to >10 Myr. A dense pre-Noachian CO2 atmosphere should lower the escape efficiency of hydrogen by IR emission. A more detailed hydrodynamic atmospheric model of this early hydrogen atmosphere is warranted to examine its effect on pre-Noachian Mars.


title: Intrinsic Weight Learning Approach for Multi-view Clustering

abstract: Exploiting different representations, or views, of the same object for better clustering has become very popular these days, which is conventionally called multi-view clustering. Generally, it is essential to measure the importance of each individual view, due to some noises, or inherent capacities in description. Many previous works model the view importance as weight, which is simple but effective empirically. In this paper, instead of following the traditional thoughts, we propose a new weight learning paradigm in context of multi-view clustering in virtue of the idea of re-weighted approach, and we theoretically analyze its working mechanism. Meanwhile, as a carefully achieved example, all of the views are connected by exploring a unified Laplacian rank constrained graph, which will be a representative method to compare with other weight learning approaches in experiments. Furthermore, the proposed weight learning strategy is much suitable for multi-view data, and it can be naturally integrated with many existing clustering learners. According to the numerical experiments, the proposed intrinsic weight learning approach is proved effective and practical to use in multi-view clustering.


title: Explicit modular forms from the divided beta family

abstract: We compute modular forms known to arise from the order 5 generators of the 5-local Adams-Novikov spectral sequence 2-line, generalizing and contextualizing previous computations of M. Behrens and G. Laures. We exhibit analogous computations at other primes and conjecture formulas for some of the modular forms arising in this way at arbitrary primes greater than or equal to 5.


title: A New Strategy for Estimating Photometric Redshifts of Quasars

abstract: Based on the SDSS and SDSS-WISE quasar datasets, we put forward two schemes to estimate the photometric redshifts of quasars. Our schemes are based on the idea that the samples are firstly classified into subsamples by a classifier and then photometric redshift estimation of different subsamples is performed by a regressor. Random Forest is adopted as the core algorithm of the classifiers, while Random Forest and kNN are applied as the key algorithms of regressors. The samples are divided into two subsamples and four subsamples depending on the redshift distribution. The performance based on different samples, different algorithms and different schemes are compared. The experimental results indicate that the accuracy of photometric redshift estimation for the two schemes generally improve to some extent compared to the original scheme in terms of the percents in \frac{|\Delta z|}{1+z_{i}}<0.1 and \frac{|\Delta z|}{1+z_{i}}<0.2 and mean absolute error. Only given the running speed, kNN shows its superiority to Random Forest. The performance of Random Forest is a little better than or comparable to that of kNN with the two datasets. The accuracy based on the SDSS-WISE sample outperforms that based on the SDSS sample no matter by kNN or by Random Forest. More information from more bands is considered and helpful to improve the accuracy of photometric redshift estimation. Evidently it can be found that our strategy to estimate photometric redshift is applicable and may be applied to other datasets or other kinds of objects. Only talking about the percent in \frac{|\Delta z|}{1+z_{i}}<0.3, there is still large room for further improvement in the photometric redshift estimation.


title: Estimation of the Kronecker Covariance Model by Quadratic Form

abstract: We propose a new estimator, the quadratic form estimator, of the Kronecker product model for covariance matrices. We show that this estimator has good properties in the large dimensional case (i.e., the cross-sectional dimension $n$ is large relative to the sample size $T$). In particular, the quadratic form estimator is consistent in a relative Frobenius norm sense provided $\log^3n/T\to 0$. We obtain the limiting distributions of Lagrange multiplier (LM) and Wald tests under both the null and local alternatives concerning the mean vector $\mu$. Testing linear restrictions of $\mu$ is also investigated. Finally, our methodology performs well in the finite-sample situations both when the Kronecker product model is true, and when it is not true.


title: Forecasting the Interaction in Dark Matter-Dark Energy Models with Standard Sirens From the Einstein Telescope

abstract: Gravitational Waves (GW's) can determine the luminosity distance of the progenitor directly from the amplitude of the wave, without assuming any specific cosmological model. Thus, it can be considered as a standard siren. The coalescence of binary neutron stars (BNS) or neutron star-black hole pair (NSBH) can generate GW's as well as the electromagnetic counterpart, which can be detected in a form of Gamma-Ray Bursts (GRB) and can be used to determine the redshift of the source. Consequently, such a standard siren can be a very useful probe to constrain the cosmological parameters. In this work, we consider an interacting Dark Matter-Dark Energy (DM-DE) model. Assuming some fiducial values for the parameters of our model, we simulate the luminosity distance for a "realistic" and "optimistic" GW+GRB events , which can be detected by the third-generation GW detector Einstein Telescope (ET). Using these simulated events, we perform a Monte Carlo Markov Chain (MCMC) to constrain the DM-DE coupling constant and other model parameters in $1\sigma$ and $2\sigma$ confidence levels. We also investigate how GW's can improve the constraints obtained by current cosmological probes.


title: Zero Latency for Emergencies: A Machine Learning based Approach to Quantify Impact of Construction Projects on Emergency Response in Urban Settings

abstract: Continuous construction and rehabilitation in urban settings have unavoidable impacts on arrival times of first responders to emergency locations. Current research efforts on emergency response assessments focus on case studies, where specific periods (e.g., super storm Sandy) of emergency response times are analyzed. Simulation based studies that aim to evaluate response times in relation to various constraints/fleet sizes also exist. However, they do not analyze how specific changes (e.g., new and ongoing construction projects) in urban settings impact emergency response times of first responders. This paper aims to fill the gap and proposes a novel approach to predict the expected emergency response time for a given location using the fabric of zones regarding construction activities. This approach relies on historical records of emergency response and construction permits issued by city agencies. The approach first defines the signature of a zone (by zip codes) for construction activities based on the distribution of historical construction work types permitted in that zone over time. Then, zones that share similar signatures are clustered to find if there exists a relationship between construction signatures and emergency response times. Next, supervised learning algorithms are deployed to predict the average emergency response times for each cluster. The approach was tested using New York City's construction permit and emergency response records, and can be easily replicated for other cities with similar public datasets. This study serves as the first step towards quantitatively understanding construction projects' impact on a quality of life (QoL) indicator (specifically emergency response times) in urban settings.


title: Toward a Standard Interface for User-Defined Scheduling in OpenMP

abstract: Parallel loops are an important part of OpenMP programs. Efficient scheduling of parallel loops can improve performance of the programs. The current OpenMP specification only offers three options for loop scheduling, which are insufficient in certain instances. Given the large number of other possible scheduling strategies, it is infeasible to standardize each one. A more viable approach is to extend the OpenMP standard to allow for users to define loop scheduling strategies. The approach will enable standard-compliant application-specific scheduling. This work analyzes the principal components required by user-defined scheduling and proposes two competing interfaces as candidates for the OpenMP standard. We conceptually compare the two proposed interfaces with respect to the three host languages of OpenMP, i.e., C, C++, and Fortran. These interfaces serve the OpenMP community as a basis for discussion and prototype implementation for user-defined scheduling.


title: Experimental study for leptonic and semileptonic decays in the charm sector

abstract: Leptonic and semileptonic decays in the charm sector have been well studied in recent years. With the largest data sample near $D\bar D$ threshold, precision measurements of leptonic and semileptonic decays of charm meson and baryon are perfromed at BESIII. Test for letpon flavor universality is also performed. Sensitivity for rare leptonic and semileptonic charm decays is significantly improved taking advantage of the huge statistics in LHCb and the $B$ factories.


title: CWISEP J193518.59$-$154620.3: An Extremely Cold Brown Dwarf in the Solar Neighborhood Discovered with CatWISE

abstract: We present the discovery of an extremely cold, nearby brown dwarf in the solar neighborhood, found in the CatWISE catalog (Eisenhardt et al., in prep.). Photometric follow-up with Spitzer reveals that the object, CWISEP J193518.59-154620.3, has ch1$-$ch2 = 3.24$\,\pm\,$0.31 mag, making it one of the reddest brown dwarfs known. Using the Spitzer photometry and the polynomial relations from Kirkpatrick et al. (2019) we estimate an effective temperature in the $\sim$270--360 K range, and a distance estimate in the 5.6$-$10.9 pc range. We combined the WISE, NEOWISE, and Spitzer data to measure a proper motion of $\mu_\alpha \cos \delta = 337\pm69$ mas yr$^{-1}$, $\mu_\delta = -50\pm97$ mas yr$^{-1}$, which implies a relatively low tangential velocity in the range 7$-$22 km s$^{-1}$.


title: Systematic Opacity Calculations for Kilonovae

abstract: Coalescence of neutron stars gives rise to kilonova, thermal emission powered by radioactive decays of freshly synthesized r-process nuclei. Although observational properties are largely affected by bound-bound opacities of r-process elements, available atomic data have been limited. In this paper, we study element-to-element variation of the opacities in the ejecta of neutron star mergers by performing systematic atomic structure calculations of r-process elements for the first time. We show that the distributions of energy levels tend to be higher as electron occupation increases for each electron shell due to the larger energy spacing caused by larger effects of spin-orbit and electron-electron interactions. As a result, elements with a fewer number of electrons in the outermost shells tend to give larger contributions to the bound-bound opacities. This implies that Fe is not representative for the opacities of light r-process elements. The average opacities for the mixture of r-process elements are found to be kappa ~ 20-30 cm^2 g^{-1} for the electron fraction of Ye < 0.20, kappa ~ 3-5 cm^2 g^{-1} for Ye = 0.25-0.35, and kappa ~ 1 cm^2 g^{-1} for Ye = 0.40 at T = 5,000-10,000 K, and they steeply decrease at lower temperature. We show that, even with the same abundance or Ye, the opacity in the ejecta changes with time by one order of magnitude from 1 to 10 days after the merger. Our radiative transfer simulations with the new opacity data confirm that ejecta with a high electron fraction (Ye >~ 0.25, with no lanthanide) are needed to explain the early, blue emission in GW170817/AT2017gfo while lanthanide-rich ejecta (with a mass fraction of lanthanides ~ 5 x 10^{-3}) reproduce the long-lasting near-infrared emission.


title: Measuring Momentum-Dependent Flow Fluctuations in Heavy-Ion Collisions

abstract: In heavy-ion collisions, momentum-dependent pair correlations can be characterized by a principal component analysis (PCA), in which subleading modes are expected to reveal new information on flow fluctuations. However, we find that, as currently measured, these modes can be dominated by multiplicity fluctuations, which serve as an unwanted background. Here, we propose new PCA observables that are robust against multiplicity fluctuations and isolate novel sources of flow fluctuations, thus being suited to provide fresh insight into the initial stages of the system at small length scales.


title: Understanding and Classifying Cultural Music Using Melodic Features Case Of Hindustani, Carnatic And Turkish Music

abstract: We present a melody based classification of musical styles by exploiting the pitch and energy based characteristics derived from the audio signal. Three prominent musical styles were chosen which have improvisation as integral part with similar melodic principles, theme, and structure of concerts namely, Hindustani, Carnatic and Turkish music. Listeners of one or more of these genres can discriminate between these based on the melodic contour alone. Listening tests were carried out using melodic attributes alone, on similar melodic pieces with respect to raga/makam, and removing any instrumentation cue to validate our hypothesis that style distinction is evident in the melody. Our method is based on finding a set of highly discriminatory features, derived from musicology, to capture distinct characteristics of the melodic contour. Behavior in terms of transitions of the pitch contour, the presence of micro-tonal notes and the nature of variations in the vocal energy are exploited. The automatically classified style labels are found to correlate well with subjective listening judgments. This was verified by using statistical tests to compare the labels from subjective and objective judgments. The melody based features, when combined with timbre based features, were seen to improve the classification performance.


title: Observation of the Kondo Screening Cloud of Micron Lengths

abstract: When a magnetic impurity exists in a metal, conduction electrons form a spin cloud that screens the impurity spin. This basic phenomenon is called the Kondo effect. Contrary to electric charge screening, the spin screening cloud occurs quantum coherently, forming spin-singlet entanglement with the impurity. Although the spins interact locally around the impurity, the cloud can spread out over micrometers. The Kondo cloud has never been detected to date, and its existence, a fundamental aspect of the Kondo effect, remains as a long-standing controversial issue. Here we present experimental evidence of a Kondo cloud extending over a length of micrometers comparable to the theoretical length $\xi_\mathrm{K}$. In our device, a Kondo impurity is formed in a quantum dot (QD), one-sided coupling to a quasi-one dimensional channel~\cite{Theory_Proposal_HS} that houses a Fabry-Perot (FP) interferometer of various gate-defined lengths $L > 1 \, \mu$m. When we sweep a voltage on the interferometer end gate separated from the QD by the length $L$ to induce FP oscillations in conductance, we observe oscillations in measured Kondo temperature $T_\mathrm{K}$, a sign of the cloud at distance $L$. For $L \lesssim \xi_\mathrm{K}$ the $T_\mathrm{K}$ oscillation amplitude becomes larger for the smaller $L$, obeying a scaling function of a single parameter $L/ \xi_\mathrm{K}$, while for $L>\xi_\mathrm{K}$ the oscillation is much weaker. The result reveals that $\xi_\mathrm{K}$ is the only length parameter associated with the Kondo effect, and that the cloud lies mostly inside the length $\xi_\mathrm{K}$ which reaches microns. Our experimental method of using electron interferometers offers a way of detecting the spatial distribution of exotic non-Fermi liquids formed by multiple magnetic impurities or multiple screening channels and solving long-standing issues of spin-correlated systems.


title: Magnetic lattices for ultracold atoms

abstract: This article reviews the development in our laboratory of magnetic lattices comprising periodic arrays of magnetic microtraps created by patterned magnetic films to trap periodic arrays of ultracold atoms. Recent achievements include the realisation of multiple Bose-Einstein condensates in a 10 micron-period one-dimensional magnetic lattice; the fabrication of sub-micron-period square and triangular magnetic lattice structures suitable for quantum tunnelling experiments; the trapping of ultracold atoms in a sub-micron-period triangular magnetic lattice; and a proposal to use long-range interacting Rydberg atoms to achieve spin-spin interactions between sites in a large-spacing magnetic lattice.


title: A Geometry-aided Message Passing Method for AoA-Based Short Range MIMO Channel Estimation

abstract: Short range channels commonly arise in millimeter wave (mmWave) wearable settings, where the length of the antenna arrays can be comparable to the distance between the radios. Conventional mmWave MIMO channel estimation techniques based on the far field assumption may perform poorly in short range settings due to the large angular spread and, hence, high available rank. We propose a geometry-aided message passing algorithm that exploits structure in short range line-of-sight (LoS) channels for spatial sub-Nyquist channel estimation. Our approach parametrizes the channel using angle-of-arrivals (AoAs) that are locally defined for subarrays of an antenna array. Furthermore, it leverages the dependencies between the local AoAs using factors based on the array geometry. We show that the LoS MIMO channel can be reconstructed using the derived local AoA estimates and the known transceiver geometry. The proposed approach achieves a reasonable rate with greatly reduced pilot transmissions when compared to exhaustive beam search-based local AoA estimation.


title: Cosmology in symmetric teleparallel gravity and its dynamical system

abstract: We explore an extension of the symmetric teleparallel gravity denoted the $f(Q)$ theory, by considering a function of the nonmetricity invariant $Q$ as the gravitational Lagrangian. Some interesting properties could be found in the $f(Q)$ theory by comparing with the $f(R)$ and $f(T)$ theories. The field equations are derived in the $f(Q)$ theory. The cosmological application is investigated. In this theory the accelerating expansion is an intrinsic property of the universe geometry without need of either exotic dark energy or extra fields. And the state equation of the geometrical dark energy can cross over the phantom divide line in the $f(Q)$ theory. In addition, the dynamical system method are investigated. It is shown that there are five critical points in the STG model for taking $f(Q)=Q+\alpha Q^2$. The critical points $P_{4}$ and $P_{5}$ are stable. $P_{4}$ corresponds to the geometrical dark energy dominated de Sitter universe ($w_{tot}^{eff}$=-1), while $P_{5}$ corresponds to the matter dominated universe ($w_{tot}^{eff}$=0). Given that $P_{4}$ represents an attractor, the cosmological constant problems, such as the fine tuning problem, could be solved in the STG model.


title: Fluctuating exchange interactions enable quintet multiexciton formation in singlet fission

abstract: Several recent electron spin resonance studies have observed a quintet multiexciton state during the singlet fission process. Here we provide a general theoretical explanation for the generation of this state by invoking a time-varying exchange coupling between pairs of triplet excitons, and subsequently solving the relevant time-varying spin Hamiltonian for a range of transition times. We simulate experimental ESR spectra and draw qualitative conclusions about the adiabatic/diabatic transition between triplet pair spin states.


title: Several classes of stationary points for rank regularized minimization problems

abstract: For the rank regularized minimization problem, we introduce several kinds of stationary points by the problem itself and its equivalent reformulations including the mathematical program with an equilibrium constraint (MPEC), the global exact penalty of the MPEC,the surrogate yielded by eliminating the dual part in the exact penalty. A clear relation chart is established for these stationary points, which guides the user to choose an appropriate reformulation for seeking a low-rank solution. As a byproduct, we also provide a weaker condition for a local minimizer of the MPEC to be the M-stationary point by characterizing the directional limiting normal cone to the graph of the normal cone mapping of the positive semidefinite (PSD) cone.


title: Control of eigenfunctions on surfaces of variable curvature

abstract: We prove a microlocal lower bound on the mass of high energy eigenfunctions of the Laplacian on compact surfaces of negative curvature, and more generally on surfaces with Anosov geodesic flows. This implies controllability for the Schr\"odinger equation by any nonempty open set, and shows that every semiclassical measure has full support. We also prove exponential energy decay for solutions to the damped wave equation on such surfaces, for any nontrivial damping coefficient. These results extend previous works [arXiv:1705.05019], [arXiv:1712.02692], which considered the setting of surfaces of constant negative curvature. The proofs use the strategy of [arXiv:1705.05019], [arXiv:1712.02692] and rely on the fractal uncertainty principle of [arXiv:1612.09040]. However, in the variable curvature case the stable/unstable foliations are not smooth, so we can no longer associate to these foliations a pseudodifferential calculus of the type used in [arXiv:1504.06589]. Instead, our argument uses Egorov's Theorem up to local Ehrenfest time and the hyperbolic parametrix of [arXiv:0706.3242], together with the $C^{1+}$ regularity of the stable/unstable foliations.


title: Anisotropic Interactions in Electric Field Polarized Ultracold Rydberg Gases

abstract: We calculate pair potential curves for interacting Rydberg atoms in a constant electric field and use them to determine the effective $C_3$ dipole-dipole and $C_6$ van der Waals coefficients. We compare the $C_3$ and $C_6$ with experiments where the angle of a polarizing electric field is varied with respect to the axis of a quasi-1-dimensional trap at ultracold temperatures. The dipoles produced via polarization of the atoms have an angular dependent dipole-dipole interaction. We focus on the interaction potential of two rubidium Rydberg atoms in $50S_{1/2}$ states in the blockade regime. For internuclear distances close to the blockade radius, $R_{bl} \approx 4 - 6\,\mu$m, molecular calculations are in much better agreement with experimental results than those based on the properties of single atoms and independent calculations of $C_3$ and $C_6$ which were used to analyze the original experiment. We find that the calculated $C_6$ coefficient is within $8\%$ of the experimental value while the $C_3$ coefficient is within $20\%$ of the experimental value.


title: Herding an Adversarial Swarm in an Obstacle Environment

abstract: This paper studies a defense approach against a swarm of adversarial agents. We employ a closed formation (`StringNet') of defending agents around the adversarial agents to restrict their motion and guide them to a safe area while navigating in an obstacle-populated environment. Control laws for forming the StringNet and guiding it to a safe area are developed, and the stability of the closed-loop system is analyzed formally. The adversarial swarm is assumed to move as a flock in the presence of rectangular obstacles. Simulation results are provided to demonstrate the efficacy of the approach.


title: Scheduling for Flexible Manufacturing System with Objective Function to be Minimization of Total Processing Time and Unbalance of Machine Load

abstract: For scheduling in flexible manufacturing system (FMS), many factors should be considered, it is difficult to solve the scheduling problem by satisfying different criteria (production cost, utilization of system, number of movements of part, make-span, and tardiness in due date and so on) and constrains. The paper proposes mathematical model of a job shop scheduling problem (JSSP) to balance the load of all machines and utilize effectively all machines in FMS. This paper defines the evaluation function of the unbalance of the machine load and formulates the optimization problem with two objectives minimizing unbalance of the machine load and the total processing time, scheduling problem having been solved by integer linear programming, thus scheduling problem having been solved. The results of calculation show that the total processing time on all machines is reduced and machine loading is balanced better than previous works, and job shop scheduling also could be scheduled more easily in FMS.


title: Convergence of stochastic structure-preserving schemes for computing effective diffusivity in random flows

abstract: In this paper, we propose stochastic structure-preserving schemes to compute the effective diffusivity for particles moving in random flows. We first introduce the motion of particles using the Lagrangian formulation, which is modeled by stochastic differential equations (SDEs). We also discuss the definition of the corrector problem and effective diffusivity. Then we propose stochastic structure-preserving schemes to solve the SDEs and provide a sharp convergence analysis for the numerical schemes in computing effective diffusivity. The convergence analysis follows a probabilistic approach, which interprets the solution process generated by our numerical schemes as a Markov process. By using the central limit theorem for the solution process, we obtain the convergence analysis of our method in computing long time solutions. Most importantly our convergence analysis reveals the connection of discrete-type and continuous-type corrector problems, which is fundamental and interesting. We present numerical results to demonstrate the accuracy and efficiency of the proposed method and investigate the convection-enhanced diffusion phenomenon in two- and three-dimensional incompressible random flows.


title: Learning Reward Functions by Integrating Human Demonstrations and Preferences

abstract: Our goal is to accurately and efficiently learn reward functions for autonomous robots. Current approaches to this problem include inverse reinforcement learning (IRL), which uses expert demonstrations, and preference-based learning, which iteratively queries the user for her preferences between trajectories. In robotics however, IRL often struggles because it is difficult to get high-quality demonstrations; conversely, preference-based learning is very inefficient since it attempts to learn a continuous, high-dimensional function from binary feedback. We propose a new framework for reward learning, DemPref, that uses both demonstrations and preference queries to learn a reward function. Specifically, we (1) use the demonstrations to learn a coarse prior over the space of reward functions, to reduce the effective size of the space from which queries are generated; and (2) use the demonstrations to ground the (active) query generation process, to improve the quality of the generated queries. Our method alleviates the efficiency issues faced by standard preference-based learning methods and does not exclusively depend on (possibly low-quality) demonstrations. In numerical experiments, we find that DemPref is significantly more efficient than a standard active preference-based learning method. In a user study, we compare our method to a standard IRL method; we find that users rated the robot trained with DemPref as being more successful at learning their desired behavior, and preferred to use the DemPref system (over IRL) to train the robot.


title: Irregularities in nuclear radii at magic numbers

abstract: Influence of magic numbers on nuclear radii is investigated via the Hartree-Fock-Bogolyubov calculations and available experimental data. With the $\ell s$ potential including additional density-dependence suggested from the chiral effective field theory, kinks are universally predicted at the $jj$-closed magic numbers and anti-kinks (\textit{i.e.} inverted kinks) are newly predicted at the $\ell s$-closed magic numbers, both in the charge radii and in the matter radii along the isotopic and isotonic chains where nuclei stay spherical. These results seem consistent with the kinks of the charge radii observed in Ca, Sn and Pb and the anti-kink in Ca. The kinks and the anti-kinks could be a peculiar indicator for magic numbers, discriminating $jj$-closure and $\ell s$-closure.


title: BESIII Exotics

abstract: Since few years, a new family of exotic states has been appearing above the open-heavy meson thresholds: the so-called $XYZ$ states. BESIII at the BEPCII $e^+e^-$ collider plays a unique role in the study of those particles in the charmonium sector. Changing the beam energy, BESIII can collect large data samples by means of scans of the resonant region, accessing directly to all vector states. As part of a larger upgrade program, BESIII has planned to increase the center of mass energy to reach $4.7$ GeV: this will allow BESIII to investigate the nature of the $Y(4660)$, that was at first observed by Belle and BaBar after Initial State Radiation only in $\pi\pi \psi(2s)$ and $\Lambda_c$ $\bar{\Lambda}_c$ final states. The relative branching ratio seems to point toward a baryonium interpretation of the resonance, as expected in Rossi-Veneziano model. BESIII can directly measure the cross sections around the expected peak position and verify this prediction. In this presentation, the status of the $XYZ$ searches at BESIII will be presented, with a focus also on the plans for the newest data taking and for the $Y(4660)$ studies.


title: Exploiting Entity BIO Tag Embeddings and Multi-task Learning for Relation Extraction with Imbalanced Data

abstract: In practical scenario, relation extraction needs to first identify entity pairs that have relation and then assign a correct relation class. However, the number of non-relation entity pairs in context (negative instances) usually far exceeds the others (positive instances), which negatively affects a model's performance. To mitigate this problem, we propose a multi-task architecture which jointly trains a model to perform relation identification with cross-entropy loss and relation classification with ranking loss. Meanwhile, we observe that a sentence may have multiple entities and relation mentions, and the patterns in which the entities appear in a sentence may contain useful semantic information that can be utilized to distinguish between positive and negative instances. Thus we further incorporate the embeddings of character-wise/word-wise BIO tag from the named entity recognition task into character/word embeddings to enrich the input representation. Experiment results show that our proposed approach can significantly improve the performance of a baseline model with more than 10% absolute increase in F1-score, and outperform the state-of-the-art models on ACE 2005 Chinese and English corpus. Moreover, BIO tag embeddings are particularly effective and can be used to improve other models as well.


title: Quasiexact Kondo Dynamics of Fermionic Alkaline-Earth-Like Atoms at Finite Temperatures

abstract: A recent experiment has observed the antiferromagnetic interaction between the ground state $^1S_0$ and the metastable state $^3P_0$ of $^{171}$Yb atoms, which are fermionic. This observation combined with the use of state-dependent optical lattices allows for quantum simulation of the Kondo model. We propose that in this Kondo simulator the anomalous temperature dependence of transport, namely the Kondo effect, can be detected through quench dynamics triggered by the shift of a trap potential. For this purpose, we improve the numerical efficiency of the minimally entangled typical thermal states (METTS) algorithm by applying additional Trotter gates. Using the improved METTS algorithm, we compute the quench dynamics of the one-dimensional Kondo model at finite temperatures quasi-exactly. We find that the center-of-mass motion exhibits a logarithmic suppression with decreasing the temperature, which is a characteristic feature of the Kondo effect.


title: A bibliometric analysis of Bitcoin scientific production

abstract: Blockchain technology, and more specifically Bitcoin (one of its foremost applications), have been receiving increasing attention in the scientific community. The first publications with Bitcoin as a topic, can be traced back to 2012. In spite of this short time span, the production magnitude (1162 papers) makes it necessary to make a bibliometric study in order to observe research clusters, emerging topics, and leading scholars. Our paper is aimed at studying the scientific production only around bitcoin, excluding other blockchain applications. Thus, we restricted our search to papers indexed in the Web of Science Core Collection, whose topic is "bitcoin". This database is suitable for such diverse disciplines such as economics, engineering, mathematics, and computer science. This bibliometric study draws the landscape of the current state and trends of Bitcoin-related research in different scientific disciplines.


title: Meta-learning of textual representations

abstract: Recent progress in AutoML has lead to state-of-the-art methods (e.g., AutoSKLearn) that can be readily used by non-experts to approach any supervised learning problem. Whereas these methods are quite effective, they are still limited in the sense that they work for tabular (matrix formatted) data only. This paper describes one step forward in trying to automate the design of supervised learning methods in the context of text mining. We introduce a meta learning methodology for automatically obtaining a representation for text mining tasks starting from raw text. We report experiments considering 60 different textual representations and more than 80 text mining datasets associated to a wide variety of tasks. Experimental results show the proposed methodology is a promising solution to obtain highly effective off the shell text classification pipelines.


title: Deep Leakage from Gradients

abstract: Exchanging gradients is a widely used method in modern multi-node machine learning system (e.g., distributed training, collaborative learning). For a long time, people believed that gradients are safe to share: i.e., the training data will not be leaked by gradient exchange. However, we show that it is possible to obtain the private training data from the publicly shared gradients. We name this leakage as Deep Leakage from Gradient and empirically validate the effectiveness on both computer vision and natural language processing tasks. Experimental results show that our attack is much stronger than previous approaches: the recovery is pixel-wise accurate for images and token-wise matching for texts. We want to raise people's awareness to rethink the gradient's safety. Finally, we discuss several possible strategies to prevent such deep leakage. The most effective defense method is gradient pruning.


title: Scalable and Probabilistic Leaderless BFT Consensus through Metastability

abstract: This paper introduces a family of leaderless Byzantine fault tolerance protocols, built around a metastable mechanism via network subsampling. These protocols provide a strong probabilistic safety guarantee in the presence of Byzantine adversaries while their concurrent and leaderless nature enables them to achieve high throughput and scalability. Unlike blockchains that rely on proof-of-work, they are quiescent and green. Unlike traditional consensus protocols where one or more nodes typically process linear bits in the number of total nodes per decision, no node processes more than logarithmic bits. It does not require accurate knowledge of all participants and exposes new possible tradeoffs and improvements in safety and liveness for building consensus protocols. The paper describes the Snow protocol family, analyzes its guarantees, and describes how it can be used to construct the core of an internet-scale electronic payment system called Avalanche, which is evaluated in a large scale deployment. Experiments demonstrate that the system can achieve high throughput (3400 tps), provide low confirmation latency (1.35 sec), and scale well compared to existing systems that deliver similar functionality. For our implementation and setup, the bottleneck of the system is in transaction verification.


title: Investigating the Essential of Meaningful Automated Formative Feedback for Programming Assignments

abstract: This study investigated the essential of meaningful automated feedback for programming assignments. Three different types of feedback were tested, including (a) What's wrong - what test cases were testing and which failed, (b) Gap - comparisons between expected and actual outputs, and (c) Hint - hints on how to fix problems if test cases failed. 46 students taking a CS2 participated in this study. They were divided into three groups, and the feedback configurations for each group were different: (1) Group One - What's wrong, (2) Group Two - What's wrong + Gap, (3) Group Three - What's wrong + Gap + Hint. This study found that simply knowing what failed did not help students sufficiently, and might stimulate system gaming behavior. Hints were not found to be impactful on student performance or their usage of automated feedback. Based on the findings, this study provides practical guidance on the design of automated feedback.


title: LPD Communication: A Sequential Change-Point Detection Perspective

abstract: In this paper, we establish a framework for low probability of detection (LPD) communication from a sequential change-point detection (SCPD) perspective, where a transmitter, Alice, wants to hide her signal transmission to a receiver, Bob, under the surveillance of an adversary, Willie. The new framework facilitates to model LPD communication and further evaluate its performance under the condition that Willie has no prior knowledge on when the transmission from Alice starts and that Willie wants to detect the existence of the communication as quickly as possible in real-time manner. We consider three different sequential tests for Willie, i.e., the Shewhart test, the cumulative sum (CUSUM) test, and the Shiryaev-Roberts (SR) test, to model the detection procedure. Communication is said to be covert if it stops before detection by Willie with high probability. Covert probability defined as the probability that Willie is not alerted during the communication procedure is investigated. We formulate an optimization problem aimed at finding the transmit power and transmission duration such that the total amount of information that can be transmitted is maximized subject to a high covert probability. Under Shewhart test, closed-form approximations of the optimal transmit power and transmission duration are derived, which well approximate the solutions obtained from exhaustive search. As for CUSUM and SR tests, we provide an effective algorithm to search the optimal solution. Numeric results are presented to show the performance of LPD communication.


title: Learning Bilingual Word Embeddings Using Lexical Definitions

abstract: Bilingual word embeddings, which representlexicons of different languages in a shared em-bedding space, are essential for supporting se-mantic and knowledge transfers in a variety ofcross-lingual NLP tasks. Existing approachesto training bilingual word embeddings requireoften require pre-defined seed lexicons that areexpensive to obtain, or parallel sentences thatcomprise coarse and noisy alignment. In con-trast, we propose BilLex that leverages pub-licly available lexical definitions for bilingualword embedding learning. Without the needof predefined seed lexicons, BilLex comprisesa novel word pairing strategy to automati-cally identify and propagate the precise fine-grained word alignment from lexical defini-tions. We evaluate BilLex in word-level andsentence-level translation tasks, which seek tofind the cross-lingual counterparts of wordsand sentences respectively.BilLex signifi-cantly outperforms previous embedding meth-ods on both tasks.


title: B lifetime and $B^0-\bar B^0$ mixing results from early Belle II data

abstract: The Belle II experiment at the SuperKEKB energy-asymmetric $e^+ e^-$ collider is a substantial upgrade of the B factory facility at the Japanese KEK laboratory. The design luminosity of the machine is $8\times 10^{35}$ cm$^{-2}$s$^{-1}$ and the Belle II experiment aims to record 50 ab$^{-1}$ of data, a factor of 50 more than its predecessor. From February to July 2018, the machine has completed a commissioning run, achieved a peak luminosity of $5.5\times 10^{33}$ cm$^{-2}$s$^{-1}$, and Belle II has recorded a data sample of about 0.5 fb$^{-1}$. Main operation of SuperKEKB has started in March 2019. We use this dataset to characterize the performance of the detector regarding the tracking of charged particles, the reconstruction of known resonances, and the capability of identifying displaced decay vertices. To assess the B Physics capabilities of the experiment, one of the first benchmarks consists in the measurement of the lifetime of B mesons and of the $B^0-\bar B^0$ mixing frequency. We present the first results, based on samples of B mesons that decay to hadronic and semileptonic final states.


title: Remnants of Subdwarf Helium Donor Stars Ejected from Close Binaries with Thermonuclear Supernovae

abstract: Some binary systems composed of a white dwarf (WD) and a hot subdwarf (sdB) helium star will make contact within the helium burning lifetime of the sdB star. The accreted helium on the WD inevitably undergoes a thermonuclear instability, causing a detonation that is expected to transition into the WD core and lead to a thermonuclear supernova while the donor orbits nearby with high velocity. Motivated by the recent discovery of fast-moving objects that occupy unusual locations on the HR diagram, we explore the impact of the thermonuclear supernovae on the donors in this specific double detonation scenario. We use MESA to model the binary up to the moment of detonation, then 3D Athena++ to model the hydrodynamic interaction of the supernova ejecta with the donor star, calculating the amount of mass that is stripped and the entropy deposited in the deep stellar interior by the strong shock that traverses it. We show that these donor remnants are ejected with velocities primarily set by their orbital speeds: $700-900\ \rm km\ s^{-1}$. We model the long-term thermal evolution of remnants by introducing the shock entropy into MESA models. In response to this entropy change, donor remnants expand and brighten for timescales ranging from $10^6-10^8$ years, giving ample time for these runaway stars to be observed in their inflated state before they leave the galaxy. Even after surface layers are stripped, some donors retain enough mass to resume core helium burning and further delay fading for more than $10^8$ years.


title: Be Consistent! Improving Procedural Text Comprehension using Label Consistency

abstract: Our goal is procedural text comprehension, namely tracking how the properties of entities (e.g., their location) change with time given a procedural text (e.g., a paragraph about photosynthesis, a recipe). This task is challenging as the world is changing throughout the text, and despite recent advances, current systems still struggle with this task. Our approach is to leverage the fact that, for many procedural texts, multiple independent descriptions are readily available, and that predictions from them should be consistent (label consistency). We present a new learning framework that leverages label consistency during training, allowing consistency bias to be built into the model. Evaluation on a standard benchmark dataset for procedural text, ProPara (Dalvi et al., 2018), shows that our approach significantly improves prediction performance (F1) over prior state-of-the-art systems.


title: The 21 cm Power Spectrum from the Cosmic Dawn: First Results from the OVRO-LWA

abstract: The 21\,cm transition of neutral hydrogen is opening an observational window into the cosmic dawn of the universe---the epoch of first star formation. We use 28\,hr of data from the Owens Valley Radio Observatory Long Wavelength Array (OVRO-LWA) to place upper limits on the spatial power spectrum of 21\,cm emission at $z \approx 18.4$ ($\Delta_{21} \lesssim 10^4\,\text{mK}$), and within the absorption feature reported by the EDGES experiment (Bowman et al. 2018). In the process we demonstrate the first application of the double Karhunen-Lo\`{e}ve transform for foreground filtering, and diagnose the systematic errors that are currently limiting the measurement. We also provide an updated model for the angular power spectrum of low-frequency foreground emission measured from the northern hemisphere, which can be used to refine sensitivity forecasts for next-generation experiments.


title: Explicit Artin maps into ${\rm PGL}_2$

abstract: Let $G$ be a subgroup of ${\rm PGL}_2({\mathbb F}_q)$, where $q$ is any prime power, and let $Q \in {\mathbb F}_q[x]$ such that ${\mathbb F}_q(x)/{\mathbb F}_q(Q(x))$ is a Galois extension with group $G$. By explicitly computing the Artin map on unramified degree-1 primes in ${\mathbb F}_q(Q)$ for various groups $G$, interesting new results emerge about finite fields, additive polynomials, and conjugacy classes of ${\rm PGL}_2({\mathbb F}_q)$. For example, by taking $G$ to be a unipotent group, one obtains a new characterization for when an additive polynomial splits completely over ${\mathbb F}_q$. When $G = {\rm PGL}_2({\mathbb F}_q)$, one obtains information about conjugacy classes of ${\rm PGL}_2({\mathbb F}_q)$. When $G$ is the group of order 3 generated by $x \mapsto 1 - 1/x$, one obtains a natural tripartite symbol on ${\mathbb F}_q$ with values in ${\mathbb Z}/3{\mathbb Z}$. Some of these results generalize to ${\rm PGL}_2(K)$ for arbitrary fields $K$. Apart from the introduction, this article is written from first principles, with the aim to be accessible to graduate students or advanced undergraduates. An earlier draft of this article was published on the Math arXiv in June 2019 under the title {\it More structure theorems for finite fields}.


title: Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactions

abstract: We focus on the problem of predicting future states of entities in complex, real-world driving scenarios. Previous research has used low-level signals to predict short time horizons, and has not addressed how to leverage key assets relied upon heavily by industry self-driving systems: (1) large 3D perception efforts which provide highly accurate 3D states of agents with rich attributes, and (2) detailed and accurate semantic maps of the environment (lanes, traffic lights, crosswalks, etc). We present a unified representation which encodes such high-level semantic information in a spatial grid, allowing the use of deep convolutional models to fuse complex scene context. This enables learning entity-entity and entity-environment interactions with simple, feed-forward computations in each timestep within an overall temporal model of an agent's behavior. We propose different ways of modelling the future as a distribution over future states using standard supervised learning. We introduce a novel dataset providing industry-grade rich perception and semantic inputs, and empirically show we can effectively learn fundamentals of driving behavior.


title: Appliance of network theory in economic geography

abstract: A continuously evolving geography requires a good understanding in networks. As such, this paper accounts for theories and applications of complex networks and their role both in geography in general, as well as in determining various geographical network trajectories. It assesses how links between agents lead to an evolutionary process of network retention, as well as network variation, and how geography influences these mechanisms.


title: Randomized Exploration in Generalized Linear Bandits

abstract: We study two randomized algorithms for generalized linear bandits. The first, GLM-TSL, samples a generalized linear model (GLM) from the Laplace approximation to the posterior distribution. The second, GLM-FPL, fits a GLM to a randomly perturbed history of past rewards. We analyze both algorithms and derive $\tilde{O}(d \sqrt{n \log K})$ upper bounds on their $n$-round regret, where $d$ is the number of features and $K$ is the number of arms. The former improves on prior work while the latter is the first for Gaussian noise perturbations in non-linear models. We empirically evaluate both GLM-TSL and GLM-FPL in logistic bandits, and apply GLM-FPL to neural network bandits. Our work showcases the role of randomization, beyond posterior sampling, in exploration.


title: Quantum Annealing: a journey through Digitalization, Control, and hybrid Quantum Variational schemes

abstract: We establish and discuss a number of connections between a digitized version of Quantum Annealing (QA) with the Quantum Approximate Optimization Algorithm (QAOA) introduced by Farhi et al. (arXiv:1411.4028) as an alternative hybrid quantum-classical variational scheme for quantum-state preparation and optimization. We introduce a technique that allows to prove, for instance, a rigorous bound concerning the performance of QAOA for MaxCut on a $2$-regular graph, equivalent to an unfrustrated antiferromagnetic Ising chain. The bound shows that the optimal variational error of a depth-$\mathrm{P}$ quantum circuit has to satisfy $\epsilon^\mathrm{res}_{\mathrm{P}}\ge (2\mathrm{P}+2)^{-1}$. In a separate work (Mbeng et al., arXiv:1911.12259) we have explicitly shown, exploiting a Jordan-Wigner transformation, that among the $2^{\mathrm{P}}$ degenerate variational minima which can be found for this problem, all strictly satisfying the equality $\epsilon^\mathrm{res}_{\mathrm{P}}=(2\mathrm{P}+2)^{-1}$, one can construct a special {\em regular} optimal solution, which is computationally optimal and does not require any prior knowledge about the spectral gap. We explicitly demonstrate here that such a schedule is adiabatic, in a digitized sense, and can therefore be interpreted as an optimized digitized-QA protocol. We also discuss and compare our bound on the residual energy to well-known results on the Kibble-Zurek mechanism behind a continuous-time QA. These findings help elucidating the intimate relation between digitized-QA, QAOA, and optimal Quantum Control.


title: Chiral magnetic effect in the hadronic phase

abstract: We study the chiral magnetic effect (CME) in the hadronic phase. The CME current involves pseudoscalar mesons to modify its functional form. This conclusion is independent of microscopic details. The strength of the CME current in the hadronic phase would decrease for two flavors.