title: Streaming Variational Monte Carlo

abstract: Nonlinear state-space models are powerful tools to describe dynamical structures in complex time series. In a streaming setting where data are processed one sample at a time, simultaneous inference of the state and its nonlinear dynamics has posed significant challenges in practice. We develop a novel online learning framework, leveraging variational inference and sequential Monte Carlo, which enables flexible and accurate Bayesian joint filtering. Our method provides an approximation of the filtering posterior which can be made arbitrarily close to the true filtering distribution for a wide class of dynamics models and observation models. Specifically, the proposed framework can efficiently approximate a posterior over the dynamics using sparse Gaussian processes, allowing for an interpretable model of the latent dynamics. Constant time complexity per sample makes our approach amenable to online learning scenarios and suitable for real-time applications.


title: Towards Task and Architecture-Independent Generalization Gap Predictors

abstract: Can we use deep learning to predict when deep learning works? Our results suggest the affirmative. We created a dataset by training 13,500 neural networks with different architectures, on different variations of spiral datasets, and using different optimization parameters. We used this dataset to train task-independent and architecture-independent generalization gap predictors for those neural networks. We extend Jiang et al. (2018) to also use DNNs and RNNs and show that they outperform the linear model, obtaining $R^2=0.965$. We also show results for architecture-independent, task-independent, and out-of-distribution generalization gap prediction tasks. Both DNNs and RNNs consistently and significantly outperform linear models, with RNNs obtaining $R^2=0.584$.


title: Learning Rotation Adaptive Correlation Filters in Robust Visual Object Tracking

abstract: Visual object tracking is one of the major challenges in the field of computer vision. Correlation Filter (CF) trackers are one of the most widely used categories in tracking. Though numerous tracking algorithms based on CFs are available today, most of them fail to efficiently detect the object in an unconstrained environment with dynamically changing object appearance. In order to tackle such challenges, the existing strategies often rely on a particular set of algorithms. Here, we propose a robust framework that offers the provision to incorporate illumination and rotation invariance in the standard Discriminative Correlation Filter (DCF) formulation. We also supervise the detection stage of DCF trackers by eliminating false positives in the convolution response map. Further, we demonstrate the impact of displacement consistency on CF trackers. The generality and efficiency of the proposed framework is illustrated by integrating our contributions into two state-of-the-art CF trackers: SRDCF and ECO. As per the comprehensive experiments on the VOT2016 dataset, our top trackers show substantial improvement of 14.7% and 6.41% in robustness, 11.4% and 1.71% in Average Expected Overlap (AEO) over the baseline SRDCF and ECO, respectively.


title: Assessing Disparate Impacts of Personalized Interventions: Identifiability and Bounds

abstract: Personalized interventions in social services, education, and healthcare leverage individual-level causal effect predictions in order to give the best treatment to each individual or to prioritize program interventions for the individuals most likely to benefit. While the sensitivity of these domains compels us to evaluate the fairness of such policies, we show that actually auditing their disparate impacts per standard observational metrics, such as true positive rates, is impossible since ground truths are unknown. Whether our data is experimental or observational, an individual's actual outcome under an intervention different than that received can never be known, only predicted based on features. We prove how we can nonetheless point-identify these quantities under the additional assumption of monotone treatment response, which may be reasonable in many applications. We further provide a sensitivity analysis for this assumption by means of sharp partial-identification bounds under violations of monotonicity of varying strengths. We show how to use our results to audit personalized interventions using partially-identified ROC and xROC curves and demonstrate this in a case study of a French job training dataset.


title: Design principles, architectural smells and refactorings for microservices: A multivocal review

abstract: Potential benefits such as agile service delivery have led many companies to deliver their business capabilities through microservices. Bad smells are however always around the corner, as witnessed by the considerable body of literature discussing architectural smells that possibly violate the design principles of microservices. In this paper, we systematically review the white and grey literature on the topic, in order to identify the most recognised architectural smells for microservices and to discuss the architectural refactorings allowing to resolve them.


title: Stabilizing Traffic via Autonomous Vehicles: A Continuum Mean Field Game Approach

abstract: This paper presents scalable traffic stability analysis for both pure autonomous vehicle (AV) traffic and mixed traffic based on continuum traffic flow models. Human vehicles are modeled by a non-equilibrium traffic flow model, i.e., Aw-Rascle-Zhang (ARZ), which is unstable. AVs are modeled by the mean field game which assumes AVs are rational agents with anticipation capacities. It is shown from linear stability analysis and numerical experiments that AVs help stabilize the traffic. Further, we quantify the impact of AV's penetration rate and controller design on the traffic stability. The results may provide insights for AV manufacturers and city planners.


title: Controllable pulse patterns in fiber lasers

abstract: An all-optical pulse power editing (PPE) technique is reported. Using the PPE technique, pulses with different peak powers are output and directed to the positive or reverse saturable absorption (SA) range of the saturable absorber. Further, under the combined action of the PPE technique and SA, four pulse patterns including dissipative soliton (DS), DS molecules, soliton compounds composed of DS and noise-like pulse (NLP), and pure NLP are controllably generated in fiber lasers. The results are conducive for developing advanced DS lasers and can further clarify the onset of pulse dynamic patterns.


title: A Note on Estimates for Elliptic Systems with $L^1$ Data

abstract: In this paper we give necessary and sufficient conditions on the compatibility of a $k$th order homogeneous linear elliptic differential operator $\mathbb{A}$ and differential constraint $\mathcal{C}$ for solutions of \begin{align*} \mathbb{A} u=f\quad\text{subject to}\quad \mathcal{C} f=0\quad\text{ in }\mathbb{R}^n \end{align*} to satisfy the estimates \begin{align*} \|D^{k-j}u\|_{L^{\frac{n}{n-j}}(\mathbb{R}^n)}\leq c\|f\|_{L^1(\mathbb{R}^n)} \end{align*} for $j\in \{1,\ldots,\min\{k,n-1\}\}$ and \begin{align*} \|D^{k-n}u\|_{L^{\infty}(\mathbb{R}^n)}\leq c\|f\|_{L^1(\mathbb{R}^n)} \end{align*} when $k\geq n$.


title: Probing the Glashow resonance at electron-positron colliders

abstract: The Glashow resonance is a rapid enhancement of the cross section for scattering of electron antineutrinos on electrons at the $W^-$ boson production threshold due to the $s$-channel contribution. This resonance is being searched for at large volume neutrino detectors in which the reaction $\bar\nu_ee^-\rightarrow W^-$ to be initiated by cosmic ray antineutrinos of energies about 6.3 PeV. The relatively small neutrino flux reaching the Earth together with the necessity of analyzing ultra-high-energy final states make such searches challenging. We argue here that the Glashow resonance may contribute to the process $e^+e^-\rightarrow~W^+W^-$. By extending the method of the effective (equivalent) particles to the neutral leptons, we relate the distribution of the effective neutrinos in the electron to the total cross section for $e^+e^-\rightarrow~W^+W^-$. Our approach gives a good fit to existing experimental data measured at the collider LEP at CERN and allows one to interpret these measurements as an observation of the Glashow resonance. We also discuss an advantage of future electron-positron colliders for probing the resonance.


title: Disentangling neural mechanisms for perceptual grouping

abstract: Forming perceptual groups and individuating objects in visual scenes is an essential step towards visual intelligence. This ability is thought to arise in the brain from computations implemented by bottom-up, horizontal, and top-down connections between neurons. However, the relative contributions of these connections to perceptual grouping are poorly understood. We address this question by systematically evaluating neural network architectures featuring combinations bottom-up, horizontal, and top-down connections on two synthetic visual tasks, which stress low-level "Gestalt" vs. high-level object cues for perceptual grouping. We show that increasing the difficulty of either task strains learning for networks that rely solely on bottom-up connections. Horizontal connections resolve straining on tasks with Gestalt cues by supporting incremental grouping, whereas top-down connections rescue learning on tasks with high-level object cues by modifying coarse predictions about the position of the target object. Our findings dissociate the computational roles of bottom-up, horizontal and top-down connectivity, and demonstrate how a model featuring all of these interactions can more flexibly learn to form perceptual groups.


title: Distortions of Robertson-Walker metric in perturbative cosmology and interpretation as dark matter and cosmological constant

abstract: In the last years, we saw more and more attempts to explain dark matter as a general relativistic effect, at least for some fraction. Following this philosophy, we considered the gravitational distortions due to the inhomogeneous distribution of matter in the universe, which we know from general relativity to be retarded distortions. This provides a magnification effect, since the distortions we feel now depend not on the present matter density, but on the past one, which is greater. The expansion rate of the universe is perturbed as well, in a not negligible way, despite matter inhomogeneities are small, because of the same magnification effect. The deceleration parameter, which is a way to evaluate the quantity of dark matter in the universe, is perturbed in turn, so that the real amount of dark matter is less than what is usually believed.


title: Thickness dependence of spin Peltier effect visualized by thermal imaging technique

abstract: Magnon propagation length in a ferrimagnetic insulator yttrium iron garnet (YIG) has been investigated by measuring and analyzing the YIG-thickness t_YIG dependence of the spin Peltier effect (SPE) in a Pt/YIG junction system. By means of the lock-in thermography technique, we measured the spatial distribution of the SPE-induced temperature modulation in the Pt/YIG system with the t_YIG gradation, allowing us to obtain the accurate t_YIG dependence of SPE with high t_YIG resolution. Based on the t_YIG dependence of SPE, we verified the applicability of several phenomenological models to estimate the magnon diffusion length in YIG.


title: How much can the eigenvalues of a random Hermitian matrix fluctuate?

abstract: The goal of this article is to study how much the eigenvalues of large Hermitian random matrices deviate from certain deterministic locations -- or in other words, to investigate optimal rigidity estimates for the eigenvalues. We do this in the setting of one-cut regular unitary invariant ensembles of random Hermitian matrices -- the Gaussian Unitary Ensemble being the prime example of such an ensemble. Our approach to this question combines extreme value theory of log-correlated stochastic processes, and in particular the theory of multiplicative chaos, with asymptotic analysis of large Hankel determinants with Fisher-Hartwig symbols of various types, such as merging jump singularities, size-dependent impurities, and jump singularities approaching the edge of the spectrum. In addition to optimal rigidity estimates, our approach sheds light on the fractal geometry of the eigenvalue counting function.


title: Privacy-preserving Crowd-guided AI Decision-making in Ethical Dilemmas

abstract: With the rapid development of artificial intelligence (AI), ethical issues surrounding AI have attracted increasing attention. In particular, autonomous vehicles may face moral dilemmas in accident scenarios, such as staying the course resulting in hurting pedestrians or swerving leading to hurting passengers. To investigate such ethical dilemmas, recent studies have adopted preference aggregation, in which each voter expresses her/his preferences over decisions for the possible ethical dilemma scenarios, and a centralized system aggregates these preferences to obtain the winning decision. Although a useful methodology for building ethical AI systems, such an approach can potentially violate the privacy of voters since moral preferences are sensitive information and their disclosure can be exploited by malicious parties. In this paper, we report a first-of-its-kind privacy-preserving crowd-guided AI decision-making approach in ethical dilemmas. We adopt the notion of differential privacy to quantify privacy and consider four granularities of privacy protection by taking voter-/record-level privacy protection and centralized/distributed perturbation into account, resulting in four approaches VLCP, RLCP, VLDP, and RLDP. Moreover, we propose different algorithms to achieve these privacy protection granularities, while retaining the accuracy of the learned moral preference model. Specifically, VLCP and RLCP are implemented with the data aggregator setting a universal privacy parameter and perturbing the averaged moral preference to protect the privacy of voters' data. VLDP and RLDP are implemented in such a way that each voter perturbs her/his local moral preference with a personalized privacy parameter. Extensive experiments on both synthetic and real data demonstrate that the proposed approach can achieve high accuracy of preference aggregation while protecting individual voter's privacy.


title: Hamiltonian Neural Networks

abstract: Even though neural networks enjoy widespread use, they still struggle to learn the basic laws of physics. How might we endow them with better inductive biases? In this paper, we draw inspiration from Hamiltonian mechanics to train models that learn and respect exact conservation laws in an unsupervised manner. We evaluate our models on problems where conservation of energy is important, including the two-body problem and pixel observations of a pendulum. Our model trains faster and generalizes better than a regular neural network. An interesting side effect is that our model is perfectly reversible in time.


title: Quantifying allowable motion to achieve safe dose escalation in pancreatic SBRT

abstract: Tumor motion plays a key role in the safe delivery of Stereotactic Body Radiotherapy (SBRT) for pancreatic cancer. The purpose of this study was to use tumor motion data measured in patients to establish limits on motion magnitude for safe delivery of pancreatic SBRT. Using 91 sets of pancreatic tumor motion data measured in patients, we calculated motion-convolved dose for 25 pancreatic cancer patients, and established the maximum amount of motion allowable while satisfying error thresholds on key dose metrics. In our patient cohort, the mean [min-max] allowable motion for 33/40/50 Gy to the PTV was 11.9 [6.3-22.4], 10.4 [5.2-19.1] and 9.0 [4.2-16.0] mm, respectively. Maximum allowable motion decreased as dose was escalated, and was smaller in patients with larger tumors. The effects of motion on pancreatic SBRT are highly variable between patients and there is potential to allow more motion in certain patients, even in dose-escalated scenarios. In our dataset, a conservative limit of 6.3 mm would ensure safe treatment of all patients treated to 33 Gy in 5 fractions.


title: On Euler systems for the multiplicative group over general number fields

abstract: We formulate, and provide strong evidence for, a natural generalization of a conjecture of Robert Coleman concerning Euler systems for the multiplicative group over arbitrary number fields.


title: GAMMA: A General Agent Motion Model for Autonomous Driving

abstract: This paper presents GAMMA, a general motion prediction model that enables large-scale real-time simulation and planning for autonomous driving. GAMMA models heterogeneous, interactive traffic agents. They operate under diverse road conditions, with various geometric and kinematic constraints. GAMMA treats the prediction task as constrained optimization in traffic agents' velocity space. The objective is to optimize an agent's driving performance, while obeying all the constraints resulting from the agent's kinematics, collision avoidance with other agents, and the environmental context. Further, GAMMA explicitly conditions the prediction on human behavioral states as parameters of the optimization model, in order to account for versatile human behaviors. We evaluated GAMMA on a set of real-world benchmark datasets. The results show that GAMMA achieves high prediction accuracy on both homogeneous and heterogeneous traffic datasets, with sub-millisecond execution time. Further, the computational efficiency and the flexibility of GAMMA enable (i) simulation of mixed urban traffic at many locations worldwide and (ii) planning for autonomous driving in dense traffic with uncertain driver behaviors, both in real-time. The open-source code of GAMMA is available online.


title: Transition Probabilities in the Two-Level Quantum System with PT-Symmetric Non-Hermitian Hamiltonians

abstract: We investigate how to define in a consistent way the probabilities of the transitions between the "flavor" states of the two-level quantum system, which is described by a non-Hermitian but parity and time-reversal (PT) symmetric Hamiltonian. Explicit calculations are carried out to demonstrate the conservation of probability if a proper definition of the final state is adopted. Finally, this formalism is applied to two-flavor neutrino oscillations $\nu^{}_\mu \to \nu^{}_\mu$ and $\nu^{}_\mu \to \nu^{}_\tau$ in vacuum, where the exact PT symmetry requires the vacuum mixing angle to be maximal, which is compatible with current neutrino oscillation experiments. A possible generalization to the three-flavor case is briefly discussed.

categories: quant-ph hep-ph hep-th math-ph math.MP physics.atom-ph


title: Photo-Geometric Autoencoding to Learn 3D Objects from Unlabelled Images

abstract: We show that generative models can be used to capture visual geometry constraints statistically. We use this fact to infer the 3D shape of object categories from raw single-view images. Differently from prior work, we use no external supervision, nor do we use multiple views or videos of the objects. We achieve this by a simple reconstruction task, exploiting the symmetry of the objects' shape and albedo. Specifically, given a single image of the object seen from an arbitrary viewpoint, our model predicts a symmetric canonical view, the corresponding 3D shape and a viewpoint transformation, and trains with the goal of reconstructing the input view, resembling an auto-encoder. Our experiments show that this method can recover the 3D shape of human faces, cat faces, and cars from single view images, without supervision. On benchmarks, we demonstrate superior accuracy compared to other methods that use supervision at the level of 2D image correspondences.


title: Sequence Tagging with Contextual and Non-Contextual Subword Representations: A Multilingual Evaluation

abstract: Pretrained contextual and non-contextual subword embeddings have become available in over 250 languages, allowing massively multilingual NLP. However, while there is no dearth of pretrained embeddings, the distinct lack of systematic evaluations makes it difficult for practitioners to choose between them. In this work, we conduct an extensive evaluation comparing non-contextual subword embeddings, namely FastText and BPEmb, and a contextual representation method, namely BERT, on multilingual named entity recognition and part-of-speech tagging. We find that overall, a combination of BERT, BPEmb, and character representations works best across languages and tasks. A more detailed analysis reveals different strengths and weaknesses: Multilingual BERT performs well in medium- to high-resource languages, but is outperformed by non-contextual subword embeddings in a low-resource setting.


title: Distribution Network Marginal Costs - Part I: A Novel AC OPF Including Transformer Degradation

abstract: This two-part paper considers the day-ahead operational planning problem of a radial distribution network hosting Distributed Energy Resources (DERs) including Solar Photovoltaic (PV) and storage-like loads such as Electric Vehicles (EVs). We estimate dynamic Distribution nodal Location Marginal Costs (DLMCs) of real and reactive power and employ them to co-optimize distribution network and DER schedules. In Part I, we develop a novel AC Optimal Power Flow (OPF) model encompassing transformer degradation as a short-run network variable cost, and we decompose real/reactive power DLMCs into additive marginal cost components related to (i) the costs of real/reactive power transactions at the T&D interface/substation, (ii) real/reactive power marginal losses, (iii) voltage and (iv) ampacity congestion, and (v) a new transformer degradation marginal cost component. Our detailed transformer degradation model captures the impact of incremental transformer loading during a specific time period, not only on its Loss of Life (LoL) during that period, but also during subsequent time periods. To deal with this phenomenon, we develop methods that internalize the marginal LoL occurring beyond the daily horizon into the DLMCs evaluated within this horizon. In Part II, we use real distribution feeders to exemplify the use of DLMCs as financial incentives that convey sufficient information to optimize Distribution Network, and DER (PV and EV) operation.


title: Driving with temperature the synthesis of graphene films on Ge(110)

abstract: We systematically investigate the chemical vapor deposition growth of graphene on Ge(110) as a function of the deposition temperature close to the Ge melting point. By merging spectroscopic and morphological information, we find that the quality of graphene films depends critically on the growth temperature improving significantly by increasing this temperature in the 910-930 {\deg}C range. We correlate the abrupt improvement of the graphene quality to the formation of a quasi-liquid Ge surface occurring in the same temperature range, which determines increased atom diffusivity and sublimation rate. Being observed for diverse Ge orientations, this process is of general relevance for graphene synthesis on Ge.


title: Distribution Network Marginal Costs -- Part II: Case Study Based Numerical Findings

abstract: This two-part paper considers the day-ahead operational planning problem of a radial distribution network hosting Distributed Energy Resources (DERs), such as Solar Photovoltaic (PV) and Electric Vehicles (EVs). In Part I, we develop a novel AC Optimal Power Flow (OPF) model that estimates dynamic Distribution nodal Location Marginal Costs (DLMCs) of real and reactive power including transformer degradation. These all-inclusive DLMCs are key in the co-optimization of the distribution network and DER schedules. Part II discusses the implication of using DLMCs to represent the benefit of shifting real/reactive power across time and achieve optimal Distribution Network and DER operation. Moreover, it evaluates, elaborates and analyzes the novel AC OPF through extensive numerical results of actual distribution feeder-based case studies involving a wealth of future EV and PV adoption scenarios. Optimal schedules are compared to schedules that rely on apparently reasonable approaches, namely Business as Usual (i.e., do nothing), Time of Use, and traditional line loss minimization. The overwhelming evidence of extensive numerical results supports the significant benefits of internalizing short-run marginal asset - primarily transformer - degradation. Apart from optimal short-run scheduling, the proposed approach can harvest otherwise idle DER (PV/EV) reactive power compensation capabilities, increase distribution network DER (PV/EV) hosting capacity, and mitigate investments in distribution infrastructure that would be otherwise required to support distribution utilities' obligation to serve. Finally, numerical evidence on the benefits of AC OPF modeling intertemporal transformer life degradation suggests that it may be worth considering the introduction of intra-day markets.


title: A Study of Feature Extraction techniques for Sentiment Analysis

abstract: Sentiment Analysis refers to the study of systematically extracting the meaning of subjective text . When analysing sentiments from the subjective text using Machine Learning techniques,feature extraction becomes a significant part. We perform a study on the performance of feature extraction techniques TF-IDF(Term Frequency-Inverse Document Frequency) and Doc2vec (Document to Vector) using Cornell movie review datasets, UCI sentiment labeled datasets, stanford movie review datasets,effectively classifying the text into positive and negative polarities by using various pre-processing methods like eliminating StopWords and Tokenization which increases the performance of sentiment analysis in terms of accuracy and time taken by the classifier.The features obtained after applying feature extraction techniques on the text sentences are trained and tested using the classifiers Logistic Regression,Support Vector Machines,K-Nearest Neighbours , Decision Tree and Bernoulli Nave Bayes


title: Non-invasive light focusing in scattering media using speckle variance optimization

abstract: Optical imaging deep inside scattering media remains a fundamental problem in bio-imaging. While wavefront shaping has been shown to allow focusing of coherent light at depth, achieving it non-invasively remains a challenge. Various feedback mechanisms, in particular acoustic or non-linear fluorescence-based, have been put forward for this purpose. Non-invasive focusing at depth on fluorescent objects with linear excitation is, however, still unresolved. Here we report a simple method for focusing inside a scattering medium in an epi-detection geometry with a linear signal: optimizing the spatial variance of low contrast speckle patterns emitted by a set of fluorescent sources. Experimentally, we demonstrate robust and efficient focusing of scattered light on a single source, and show that this variance optimization method is formally equivalent to previous optimization strategies based on two-photon fluorescence. Our technique should generalize to a large variety of incoherent contrast mechanisms and holds interesting prospects for deep bio-imaging.


title: Pitfalls in the Evaluation of Sentence Embeddings

abstract: Deep learning models continuously break new records across different NLP tasks. At the same time, their success exposes weaknesses of model evaluation. Here, we compile several key pitfalls of evaluation of sentence embeddings, a currently very popular NLP paradigm. These pitfalls include the comparison of embeddings of different sizes, normalization of embeddings, and the low (and diverging) correlations between transfer and probing tasks. Our motivation is to challenge the current evaluation of sentence embeddings and to provide an easy-to-access reference for future research. Based on our insights, we also recommend better practices for better future evaluations of sentence embeddings.


title: Note on an eigenvalue problem with applications to a Minkowski type regularity problem in $\mathbb{R}$^n

abstract: We consider existence and uniqueness of homogeneous solutions $ u > 0 $ to certain PDE of $p$-Laplace type, $ p $ fixed, $ n - 1 <p< \infty, n \geq 2, $ when $ u $ is a solution in $K(\alpha)\subset\mathbb{R}^n$ where \[ K (\alpha) := \{ x = (x_1, \dots, x_n ): x_1 > \cos \alpha \, | x| \} \quad \mbox{for fixed}\, \, \alpha \in (0, \pi ], \] with continuous boundary value zero on $ \partial K ( \alpha ) \setminus \{0\}$. In our main result we show that if $ u $ has continuous boundary value $0$ on $ \partial K ( \pi )$ then $u$ is homogeneous of degree $ 1 - (n-1)/p $ when $ p > n - 1. $ Applications of this result are given to a Minkowski type regularity problem in $ \mathbb{R}^{n}$ when $n=2,3$.


title: Gamification of Enterprise Systems: A Synthesis of Mechanics, Dynamics, and Risks

abstract: Organizations highly depend on enterprise systems (ES), which are unlikely to develop their full potential if end-users neglect system usage. Accordingly, organizations attempt to overcome barriers to end-user acceptance in the ES context, which can be attributed to several factors on ES, organizational, and end-user level. Trying to take advantage of the growing passion for games, Gamification is a phenomenon proposed to motivate people by applying elements common to games in other contexts that have the potential to increase end-user acceptance. While first applications of Gamification exist in areas such as finance, health, and education, utility of gamifying ES has not been explored in-depth. Aiming to understand how Gamification can be applied to ES to increase user motivation, we analyze literature concerning game elements (i.e., mechanics and dynamics) used in Gamification and related risks. Our study yields a synthesis of mechanics in clusters of system design, challenges, rewards, and user specifics as well as related dynamics. We discuss the extent to which the game elements can be used to address ES acceptance barriers. While our study reveals that Gamification has potential for motivating ES users, future research should analyze concrete implementations of Gamification in ES contexts to investigate long-term effects.


title: Effective LHC measurements with matrix elements and machine learning

abstract: One major challenge for the legacy measurements at the LHC is that the likelihood function is not tractable when the collected data is high-dimensional and the detector response has to be modeled. We review how different analysis strategies solve this issue, including the traditional histogram approach used in most particle physics analyses, the Matrix Element Method, Optimal Observables, and modern techniques based on neural density estimation. We then discuss powerful new inference methods that use a combination of matrix element information and machine learning to accurately estimate the likelihood function. The MadMiner package automates all necessary data-processing steps. In first studies we find that these new techniques have the potential to substantially improve the sensitivity of the LHC legacy measurements.


title: On Post-Minkowskian Hamiltonians in General Relativity

abstract: We describe the computation of post-Minkowskian Hamiltonians in General Relativity from scattering amplitudes. Using a relativistic Lippmann-Schwinger equation, we relate perturbative amplitudes of massive scalars coupled to gravity to the post-Minkowskian Hamiltonians of classical General Relativity to any order in Newton's constant. We illustrate this by deriving an Hamiltonian for binary black holes without spin up to 2nd order in the post-Minkowskian expansion and demonstrate explicitly the equivalence with the recently proposed method based on an effective field theory matching.


title: Geometry and Perturbative Sensitivity of non-Smooth Caustics of the Helmholtz Equation

abstract: The geometry of non-smooth $A_{n>2}$ caustics in solutions of the Helmholtz equation is analyzed using a Fock-Schwinger proper-time formulation. In this description, $A_3$ or cusp caustics are intimately related to poles of a quantity called the einbein action in the complex proper-time, or einbein, plane. The residues of the poles vanish on spatial curves known as ghost sources, to which cusps are bound. The positions of cusps along the ghost sources is related to the value of the poles. A similar map is proposed to relate essential singularities of the einbein action to higher order caustics. The singularities are shown to originate from degenerations of a certain Dirichlet problem as the einbein is varied. It follows that the singularities of the einbein action, along with the associated aspects of caustic geometry, are invariant with respect to large classes of perturbations of the index of refraction.

categories: math-ph hep-th math.MP physics.ao-ph physics.optics


title: Statistically Significant Discriminative Patterns Searching

abstract: Discriminative pattern mining is an essential task of data mining. This task aims to discover patterns which occur more frequently in a class than other classes in a class-labeled dataset. This type of patterns is valuable in various domains such as bioinformatics, data classification. In this paper, we propose a novel algorithm, named SSDPS, to discover patterns in two-class datasets. The SSDPS algorithm owes its efficiency to an original enumeration strategy of the patterns, which allows to exploit some degrees of anti-monotonicity on the measures of discriminance and statistical significance. Experimental results demonstrate that the performance of the SSDPS algorithm is better than others. In addition, the number of generated patterns is much less than the number of other algorithms. Experiment on real data also shows that SSDPS efficiently detects multiple SNPs combinations in genetic data.


title: Dust Production of Comet 21P/Giacobini-Zinner Throughout its 2018 Apparition

abstract: We present the results of a long term telescopic observation campaign of comet 21P/Giacobini-Zinner, parent body of the Draconid meteor shower, spanning $\sim 240$ days during its 2018 apparition. Determinations of comet 21P's dust production rate through the $Af\rho$ parameter derived from these images show that the comet had a highly asymmetric dust production rate that peaked $\sim 10-30$ days before perihelion, when the comet was at a heliocentric distance of $\sim 1.02 - 1.08 \thinspace \mathrm{AU}$. The single highest $Af\rho$ measurement occurred on 2018-Aug-14 (27 days before perihelion), and had a measured value of $Af\rho = 1594 \thinspace \mathrm{cm}$. The comet's $Af\rho$ profile is well described by a double-exponential model that rises rapidly during ingress and declines even more rapidly during its egress. These results are fully consistent with observations of comet 21P's dust and gas production rates during past apparitions, and suggest that the double-exponential model we have derived provides a reasonable and stable approximation for the comet's activity over the past thirty to forty years.


title: Interpolating Strong Induction

abstract: The principle of strong induction, also known as k-induction is one of the first techniques for unbounded SAT-based Model Checking (SMC). While elegant and simple to apply, properties as such are rarely k-inductive and when they can be strengthened, there is no effective strategy to guess the depth of induction. It has been mostly displaced by techniques that compute inductive strengthenings based on interpolation and property directed reachability (Pdr). In this paper, we present kAvy, an SMC algorithm that effectively uses k-induction to guide interpolation and Pdr-style inductive generalization. Unlike pure k-induction, kAvy uses Pdr-style generalization to compute and strengthen an inductive trace. Unlike pure Pdr, kAvy uses relative k-induction to construct an inductive invariant. The depth of induction is adjusted dynamically by minimizing a proof of unsatisfiability. We have implemented kAvy within the Avy Model Checker and evaluated it on HWMCC instances. Our results show that kAvy is more effective than both Avy and Pdr, and that using k-induction leads to faster running time and solving more instances. Further, on a class of benchmarks, called shift, kAvy is orders of magnitude faster than Avy, Pdr and k-induction.


title: Robust exploration in linear quadratic reinforcement learning

abstract: This paper concerns the problem of learning control policies for an unknown linear dynamical system to minimize a quadratic cost function. We present a method, based on convex optimization, that accomplishes this task robustly: i.e., we minimize the worst-case cost, accounting for system uncertainty given the observed data. The method balances exploitation and exploration, exciting the system in such a way so as to reduce uncertainty in the model parameters to which the worst-case cost is most sensitive. Numerical simulations and application to a hardware-in-the-loop servo-mechanism demonstrate the approach, with appreciable performance and robustness gains over alternative methods observed in both.


title: A geometrical characterization of proportionally modular affine semigroups

abstract: A proportionally modular affine semigroup is the set of nonnegative integer solutions of a modular Diophantine inequality $f_1x_1+\cdots +f_nx_n \mod b \le g_1x_1+\cdots +g_nx_n$ where $g_1,\dots,g_n,$ $f_1,\ldots ,f_n\in \mathbb{Z}$ and $b\in\mathbb{N}$. In this work, a geometrical characterization of these semigroups is given. Moreover, some algorithms to check if a semigroup $S$ in $\mathbb{N}^n$, with $\mathbb{N}^n\setminus S$ a finite set, is a proportionally modular affine semigroup are provided by means of that geometrical approach.


title: Phylogenetic Networks

abstract: Phylogenetics is the study of the evolutionary relationships between organisms. One of the main challenges in the field is to take biological data for a group of organisms and to infer an evolutionary tree, a graph that represents these relationships. Developing practical and efficient methods for inferring phylogenetic trees has lead to a number of interesting mathematical questions across a variety of fields. However, due to hybridization and gene flow, a phylogenetic network may be a better representation of the evolutionary history of some groups of organisms. In this chapter, we introduce some of the basic concepts in phylogenetics, and present related undergraduate research projects on phylogenetic networks that touch on areas of graph theory and abstract algebra. In the first section, we describe several open research questions related to the combinatorics of phylogenetic networks. In the second, we describe problems related to understanding phylogenetic statistical models as algebraic varieties.


title: Clarification on Generalized Lau condition for X-ray interferometers based on dual phase gratings

abstract: To implement dual phase grating x-ray interferometry with x-ray tubes, one needs to incorporate an absorbing source grating. In order to attain good fringe visibility, the period of a source grating should be subject to a stringent condition. In literature some authors claim that the Lau-condition in Talbot-Lau interferometry can be literally transferred to dual phase grating interferometry. In this work we show that this statement in literature is incorrect. Instead, through an intuitive geometrical analysis of fringe formation, we derived a new generalized Lau-condition that provides a useful design tool for implementation of dual phase grating interferometry.


title: Recurrence in generalized semigroup

abstract: In [arXiv:1904.12333], we introduced the concept of escaping set in general setting for a topological space and extended the notion of limit set and escaping set for the general semigroup generated by continuous self maps. In this paper we continue with extending the other notions of recurrence for the generalized semigroup analogs to their counterpart in the classical theory of dynamics. We discuss the concept of periodic point, nonwandering point and chain recurrent point in the more general setting of a semigroup and establish the correlation between them.


title: A d\'evissage theorem of non-connective $K$-theory

abstract: The purpose of this article is to show a version of d\'evissage theorem of non-connective $K$-theory. Our theorem contains Quillen's d\'evissage theorem, Waldhausen's cell filtration theorem and theorem of heart as special cases. In this sense, we give an affirmative answer to Thomason's problem in Thomason-Trobaugh's paper. We introduce the notions of cell structures and d\'evissage spaces and our main theorem states a structure of non-connective $K$-theory of d\'evissage spaces in terms of non-connective $K$-theory of heart of cell structures. A specific feature in our proof is 'motivic' in the sense that properties of $K$-theory which we will utilze to prove the theorem are only categorical homotopy invariance, localization and co-continuity. On the other hands, it is well-known that the analogue of the d\'evissage theorem for $K$-theory does not hold for Hochschild homology theory. In this point of view, we could say that d\'evissage theorem is not 'motivic' over dg-categories. To overcome this dilemma, the notion of d\'evissage spaces should not be expressed by the language of dg-categories. First three sections are devoted to the foundation of our model of stable $(\infty,1)$-categories which we will play on to give a description of d\'evissage spaces.


title: On the contribution of different coupling constants in the infrared regime of Yang-Mills theory: a Curci-Ferrari approach

abstract: We investigate the influence of the different vertices of two-point correlation functions in the infrared regime of Yang-Mills theory using a phenomenological description. This regime is studied in Landau-gauge and using perturbation theory within a phenomenological massive model. We perform a one-loop calculation for two-point correlation functions taking into account the different role of the various interactions in the infrared. Our results show a good agreement with the lattice data.


title: Pair State Transfer

abstract: Let $L$ denote the Laplacian matrix of a graph $G$. We study continuous quantum walks on $G$ defined by the transition matrix $U(t)=\exp\left(itL\right)$. The initial state is of the pair state form, $e_a-e_b$ with $a,b$ being any two vertices of $G$. We provide two ways to construct infinite families of graphs that have perfect pair transfer. We study a "transitivity" phenomenon which cannot occur in vertex state transfer. We characterize perfect pair state transfer on paths and cycles. We also study the case when quantum walks are generated by the unsigned Laplacians of underlying graphs and the initial states are of the plus state form, $e_a+e_b$. When the underlying graphs are bipartite, plus state transfer is equivalent to pair state transfer.


title: Dominant Set Clustering and Pooling for Multi-View 3D Object Recognition

abstract: View based strategies for 3D object recognition have proven to be very successful. The state-of-the-art methods now achieve over 90% correct category level recognition performance on appearance images. We improve upon these methods by introducing a view clustering and pooling layer based on dominant sets. The key idea is to pool information from views which are similar and thus belong to the same cluster. The pooled feature vectors are then fed as inputs to the same layer, in a recurrent fashion. This recurrent clustering and pooling module, when inserted in an off-the-shelf pretrained CNN, boosts performance for multi-view 3D object recognition, achieving a new state of the art test set recognition accuracy of 93.8% on the ModelNet 40 database. We also explore a fast approximate learning strategy for our cluster-pooling CNN, which, while sacrificing end-to-end learning, greatly improves its training efficiency with only a slight reduction of recognition accuracy to 93.3%. Our implementation is available at https://github.com/fate3439/dscnn.


title: Testing modified gravity at cosmological distances with LISA standard sirens

abstract: Modifications of General Relativity leave their imprint both on the cosmic expansion history through a non-trivial dark energy equation of state, and on the evolution of cosmological perturbations in the scalar and in the tensor sectors. In particular, the modification in the tensor sector gives rise to a notion of gravitational-wave (GW) luminosity distance, different from the standard electromagnetic luminosity distance, that can be studied with standard sirens at GW detectors such as LISA or third-generation ground based experiments. We discuss the predictions for modified GW propagation from some of the best studied theories of modified gravity, such as Horndeski or the more general degenerate higher order scalar-tensor (DHOST) theories, non-local infrared modifications of gravity, bigravity theories and the corresponding phenomenon of GW oscillation, as well as theories with extra or varying dimensions. We show that modified GW propagation is a completely generic phenomenon in modified gravity. We then use a simple parametrization of the effect in terms of two parameters $(\Xi_0,n)$, that is shown to fit well the results from a large class of models, to study the prospects of observing modified GW propagation using supermassive black hole binaries as standard sirens with LISA. We construct mock source catalogs and perform detailed Markov Chain Monte Carlo studies of the likelihood obtained from LISA standard sirens alone, as well as by combining them with CMB, BAO and SNe data to reduce the degeneracies between cosmological parameters. We find that the combination of LISA with the other cosmological datasets allows one to measure the parameter $\Xi_0$ that characterizes modified GW propagation to the percent level accuracy, sufficient to test several modified gravity theories. [Abridged]


title: Finding Syntactic Representations in Neural Stacks

abstract: Neural network architectures have been augmented with differentiable stacks in order to introduce a bias toward learning hierarchy-sensitive regularities. It has, however, proven difficult to assess the degree to which such a bias is effective, as the operation of the differentiable stack is not always interpretable. In this paper, we attempt to detect the presence of latent representations of hierarchical structure through an exploration of the unsupervised learning of constituency structure. Using a technique due to Shen et al. (2018a,b), we extract syntactic trees from the pushing behavior of stack RNNs trained on language modeling and classification objectives. We find that our models produce parses that reflect natural language syntactic constituencies, demonstrating that stack RNNs do indeed infer linguistically relevant hierarchical structure.


title: A Nonlinear Acceleration Method for Iterative Algorithms

abstract: Iterative methods have led to better understanding and solving problems such as missing sampling, deconvolution, inverse systems, impulsive and Salt and Pepper noise removal problems. However, the challenges such as the speed of convergence and or the accuracy of the answer still remain. In order to improve the existing iterative algorithms, a non-linear method is discussed in this paper. The mentioned method is analyzed from different aspects, including its convergence and its ability to accelerate recursive algorithms. We show that this method is capable of improving Iterative Method (IM) as a non-uniform sampling reconstruction algorithm and some iterative sparse recovery algorithms such as Iterative Reweighted Least Squares (IRLS), Iterative Method with Adaptive Thresholding (IMAT), Smoothed l0 (SL0) and Alternating Direction Method of Multipliers (ADMM) for solving LASSO problems family (including Lasso itself, Lasso-LSQR and group-Lasso). It is also capable of both accelerating and stabilizing the well-known Chebyshev Acceleration (CA) method. Furthermore, the proposed algorithm can extend the stability range by reducing the sensitivity of iterative algorithms to the changes of adaptation rate.


title: Improving the Josephson energy in High-T$_c$ superconducting junctions for ultra-fast electronics

abstract: We report the electrical transport in vertical Josephson tunnel junctions (area 400 $\mu m$$^2$) using GdBa$_2$Cu$_3$O$_7$$_{-\delta}$ electrodes and SrTiO$_3$ as an insulating barrier (with thicknesses between 1 nm and 4 nm). The results show Josephson coupling for junctions with SrTiO$_3$ barriers of 1 nm and 2 nm. The latter displays a Josephson of 8.9 mV at 12 K. This value is larger than the usually observed in planar arrays of junctions. Our results are promising for the development of superconducting electronic devices in the terahertz regime.


title: Chandra reveals a possible ultra-fast outflow in the super-Eddington Be/X-ray binary Swift J0243.6+6124

abstract: Accretion at super-Eddington rates is expected to be accompanied by strong outflows. Such outflows are observed in Galactic X-ray binaries and extragalactic Ultra-luminous X-ray sources (ULXs). However, due to their large source distances, ULX outflows are challenging to detect and study in detail. Galactic neutron stars accreting from a Be-star companion at super-Eddington rates show many similarities to ULX pulsars, and therefore offer an alternative approach to study outflows in this accretion regime. Here, we present Chandra high-resolution spectroscopy of such a super-Eddington accreting neutron star, Swift J0243.6+6124, to search for wind outflow signatures during the peak of its 2017/2018 giant outburst. We detect narrow emission features at rest from Ne, Mg, S, Si, and Fe. In addition, we detect a collection of absorption features which can be identified in two ways: either as all Fe transitions at rest (with a possible contribution from Mg), or a combination of three blue-shifted Ne and Mg lines at $\sim 0.22c$, while the remaining lines are at rest. The second scenario would imply an outflow with a velocity similar to those seen in ULXs, including the ULX pulsar NGC 300 ULX-1. This result would also imply that Swift J0243.6+6124 launches both a jet, detected in radio and reported previously, and an ultra-fast wind outflow simultaneously at super-Eddington accretion rates.


title: A parameter uniform essentially first order convergent numerical method for a parabolic singularly perturbed differential equation of reaction-diffusion type with initial and Robin boundary conditions

abstract: In this paper, a class of linear parabolic singularly perturbed second order differential equations of reaction-diffusion type with initial and Robin boundary conditions is considered. The solution u of this equation is smooth, whereas the first derivative in the space variable exhibits parabolic boundary layers. A numerical method composed of a classical finite difference scheme on a piecewise uniform Shishkin mesh is suggested. This method is proved to be first order convergent in time and essentially first order convergent in the space variable in the maximum norm uniformly in the perturbation parameters.


title: Motivo: fast motif counting via succinct color coding and adaptive sampling

abstract: The randomized technique of color coding is behind state-of-the-art algorithms for estimating graph motif counts. Those algorithms, however, are not yet capable of scaling well to very large graphs with billions of edges. In this paper we develop novel tools for the `motif counting via color coding' framework. As a result, our new algorithm, Motivo, is able to scale well to larger graphs while at the same time provide more accurate graphlet counts than ever before. This is achieved thanks to two types of improvements. First, we design new succinct data structures that support fast common color coding operations, and a biased coloring trick that trades accuracy versus running time and memory usage. These adaptations drastically reduce the time and memory requirements of color coding. Second, we develop an adaptive graphlet sampling strategy, based on a fractional set cover problem, that breaks the additive approximation barrier of standard sampling. This strategy gives multiplicative approximations for all graphlets at once, allowing us to count not only the most frequent graphlets but also extremely rare ones. To give an idea of the improvements, in $40$ minutes Motivo counts $7$-nodes motifs on a graph with $65$M nodes and $1.8$B edges; this is $30$ and $500$ times larger than the state of the art, respectively in terms of nodes and edges. On the accuracy side, in one hour Motivo produces accurate counts of $\approx \! 10.000$ distinct $8$-node motifs on graphs where state-of-the-art algorithms fail even to find the second most frequent motif. Our method requires just a high-end desktop machine. These results show how color coding can bring motif mining to the realm of truly massive graphs using only ordinary hardware.


title: Nemesyst: A Hybrid Parallelism Deep Learning-Based Framework Applied for Internet of Things Enabled Food Retailing Refrigeration Systems

abstract: Deep Learning has attracted considerable attention across multiple application domains, including computer vision, signal processing and natural language processing. Although quite a few single node deep learning frameworks exist, such as tensorflow, pytorch and keras, we still lack a complete processing structure that can accommodate large scale data processing, version control, and deployment, all while staying agnostic of any specific single node framework. To bridge this gap, this paper proposes a new, higher level framework, i.e. Nemesyst, which uses databases along with model sequentialisation to allow processes to be fed unique and transformed data at the point of need. This facilitates near real-time application and makes models available for further training or use at any node that has access to the database simultaneously. Nemesyst is well suited as an application framework for internet of things aggregated control systems, deploying deep learning techniques to optimise individual machines in massive networks. To demonstrate this framework, we adopted a case study in a novel domain; deploying deep learning to optimise the high speed control of electrical power consumed by a massive internet of things network of retail refrigeration systems in proportion to load available on the UK National Grid (a demand side response). The case study demonstrated for the first time in such a setting how deep learning models, such as Recurrent Neural Networks (vanilla and Long-Short-Term Memory) and Generative Adversarial Networks paired with Nemesyst, achieve compelling performance, whilst still being malleable to future adjustments as both the data and requirements inevitably change over time.


title: Sparse Representation Classification via Screening for Graphs

abstract: The sparse representation classifier (SRC) is shown to work well for image recognition problems that satisfy a subspace assumption. In this paper we propose a new implementation of SRC via screening, establish its equivalence to the original SRC under regularity conditions, and prove its classification consistency for random graphs drawn from stochastic blockmodels. The results are demonstrated via simulations and real data experiments, where the new algorithm achieves comparable numerical performance but significantly faster.


title: On Provisioning Cellular Networks for Distributed Inference

abstract: Wireless traffic attributable to machine learning (ML) inference workloads is increasing with the proliferation of applications and smart wireless devices leveraging ML inference. Owing to limited compute capabilities at these "edge" devices, achieving high inference accuracy often requires coordination with a remote compute node or "cloud" over the wireless cellular network. The accuracy of this distributed inference is, thus, impacted by the communication rate and reliability offered by the cellular network. In this paper, an analytical framework is proposed to characterize inference accuracy as a function of cellular network design. Using the developed framework, it is shown that cellular network should be provisioned with a minimum density of access points (APs) to guarantee a target inference accuracy, and the inference accuracy achievable at asymptotically high AP density is limited by the air-interface bandwidth. Furthermore, the minimum accuracy required of edge inference to deliver a target inference accuracy is shown to be inversely proportional to the density of APs and the bandwidth.


title: Do Neural Dialog Systems Use the Conversation History Effectively? An Empirical Study

abstract: Neural generative models have been become increasingly popular when building conversational agents. They offer flexibility, can be easily adapted to new domains, and require minimal domain engineering. A common criticism of these systems is that they seldom understand or use the available dialog history effectively. In this paper, we take an empirical approach to understanding how these models use the available dialog history by studying the sensitivity of the models to artificially introduced unnatural changes or perturbations to their context at test time. We experiment with 10 different types of perturbations on 4 multi-turn dialog datasets and find that commonly used neural dialog architectures like recurrent and transformer-based seq2seq models are rarely sensitive to most perturbations such as missing or reordering utterances, shuffling words, etc. Also, by open-sourcing our code, we believe that it will serve as a useful diagnostic tool for evaluating dialog systems in the future.


title: KERMIT: Generative Insertion-Based Modeling for Sequences

abstract: We present KERMIT, a simple insertion-based approach to generative modeling for sequences and sequence pairs. KERMIT models the joint distribution and its decompositions (i.e., marginals and conditionals) using a single neural network and, unlike much prior work, does not rely on a prespecified factorization of the data distribution. During training, one can feed KERMIT paired data $(x, y)$ to learn the joint distribution $p(x, y)$, and optionally mix in unpaired data $x$ or $y$ to refine the marginals $p(x)$ or $p(y)$. During inference, we have access to the conditionals $p(x \mid y)$ and $p(y \mid x)$ in both directions. We can also sample from the joint distribution or the marginals. The model supports both serial fully autoregressive decoding and parallel partially autoregressive decoding, with the latter exhibiting an empirically logarithmic runtime. We demonstrate through experiments in machine translation, representation learning, and zero-shot cloze question answering that our unified approach is capable of matching or exceeding the performance of dedicated state-of-the-art systems across a wide range of tasks without the need for problem-specific architectural adaptation.


title: Transferable Neural Projection Representations

abstract: Neural word representations are at the core of many state-of-the-art natural language processing models. A widely used approach is to pre-train, store and look up word or character embedding matrices. While useful, such representations occupy huge memory making it hard to deploy on-device and often do not generalize to unknown words due to vocabulary pruning. In this paper, we propose a skip-gram based architecture coupled with Locality-Sensitive Hashing (LSH) projections to learn efficient dynamically computable representations. Our model does not need to store lookup tables as representations are computed on-the-fly and require low memory footprint. The representations can be trained in an unsupervised fashion and can be easily transferred to other NLP tasks. For qualitative evaluation, we analyze the nearest neighbors of the word representations and discover semantically similar words even with misspellings. For quantitative evaluation, we plug our transferable projections into a simple LSTM and run it on multiple NLP tasks and show how our transferable projections achieve better performance compared to prior work.


title: Nonsinglet polarized nucleon structure function in infrared-safe QCD

abstract: The polarized nucleon structure function in the nonsinglet case is investigated here by a new insight rather than conventional perturbative QCD (pQCD). For this purpose we note that the solution of the evolution equations in moment space involves noninteger powers of the coupling constant. Therefore it is possible to employ a new approach which is called fractional analytical perturbation theory Consequently, it is possible to remove the Landau singularities of the renormalized coupling, i.e., at the scales $Q \sim \Lambda$, using this approach. This provides an opportunity to continue the desired calculations toward small values of energy scales even less than the $\Lambda$ scale. To modify the analytical perturbation theory, a newer approach is introduced, called 2$\delta$anQCD, in which the spectral function of the holomorphic coupling is parameterized in the low-energy region by two delta functions. This model gives us more reliable results for the considered QCD observables, even in the deep infrared region. We calculate the nonsinglet part of the polarized nucleon structure function, using the 2$\delta$anQCD model, and compare it with the result from the underlying pQCD where both are in a new defined scheme, called the Lambert scheme. For this purpose we employ the anQCD package in the \textit{Mathematica} environment to establish the analytic (holomorphic) coupling constant. The results at various energy scales are also compared with the available experimental data, and it turns out that there is a good consistency between them. The results show that the obtained nucleon structure function at small energy scales has smoother behavior when using the 2$\delta$anQCD model than the underlying pQCD. In fact the coupling constant in analytic QCD behaves moderately and it makes the result approach the available data in a better way.


title: Torsional Newton Cartan gravity from non-relativistic strings

abstract: We study propagation of closed bosonic strings in torsional Newton-Cartan geometry based on a recently proposed Polyakov type action derived by dimensional reduction of the ordinary bosonic string along a null direction. We generalize the Polyakov action proposal to include matter, i.e. the 2-form and the 1-form that originates from the Kalb-Ramond field and the dilaton. We determine the conditions for Weyl invariance which we express as the beta-function equations on the worldsheet, in analogy with the usual case of strings propagating on a pseudo-Riemannian manifold. The critical dimension of the TNC space-time turns out to be 25. We find that Newton's law of gravitation follows from the requirement of quantum Weyl invariance in the absence of torsion. Presence of the 1-form requires torsion to be non vanishing. Torsion has interesting consequences, in particular it yields a mass term and an advection term in the generalized Newton's law. U(1) mass invariance of the theory is an important ingredient in deriving the beta functions.


title: A time-frequency approach to relativistic correlations in quantum field theory

abstract: Moving detectors in relativistic quantum field theories reveal the fundamental entangled structure of the vacuum which manifests, for instance, through its thermal character when probed by a uniformly accelerated detector. In this paper, we propose a general formalism inspired both from signal processing and correlation functions of quantum optics to analyze the response of point-like detectors following a generic, non-stationary trajectory. In this context, the Wigner representation of the first-order correlation of the quantum field is a natural time-frequency tool to understand single-detection events. This framework offers a synthetic perspective on the problem of detection in relativistic theory and allows us to analyze various non-stationary situations (adiabatic, periodic) and how excitations and superpositions are deformed by motion. It opens up interesting perspective on the issue of the definition of particles.


title: Near-Optimal Online Egalitarian learning in General Sum Repeated Matrix Games

abstract: We study two-player general sum repeated finite games where the rewards of each player are generated from an unknown distribution. Our aim is to find the egalitarian bargaining solution (EBS) for the repeated game, which can lead to much higher rewards than the maximin value of both players. Our most important contribution is the derivation of an algorithm that achieves simultaneously, for both players, a high-probability regret bound of order $\mathcal{O}(\sqrt[3]{\ln T}\cdot T^{2/3})$ after any $T$ rounds of play. We demonstrate that our upper bound is nearly optimal by proving a lower bound of $\Omega(T^{2/3})$ for any algorithm.


title: Theory of the electron-ion temperature relaxation rate spanning the hot solid metals and plasma phases

abstract: We present a theory for the rate of energy exchange between electrons and ions -- also known as the electron-ion coupling factor -- in physical systems ranging from hot solid metals to plasmas, including liquid metals and warm dense matter. The paper provides the theoretical foundations of a recent work [J. Simoni and J. Daligault, Phys. Rev. Lett. {\bf 122}, 205001 (2019)], where first-principles quantum molecular dynamics calculations based on this theory were presented for representative materials and conditions. We first derive a general expression for the electron-ion coupling factor that includes self-consistently the quantum mechanical and statistical nature of electrons, the thermal and disorder effects, and the correlations between particles. We show that our theory reduces to well-known models in limiting cases. In particular, we show that it simplifies to the standard electron-phonon coupling formula in the limit of hot solids with lattice and electronic temperatures much greater than the Debye temperature, and that it extends the electron-phonon coupling formula beyond the harmonic phonon approximation. For plasmas, we show that the theory readily reduces to well-know Spitzer formula in the hot plasma limit, to the Fermi golden rule formula in the limit of weak electron-ion interactions, and to other models proposed to go beyond the latter approximation. We explain that the electron-ion coupling is particularly well adapted to averaged atom models, which offer an effective way to include non-ideal interaction effects to the standard models and at a much reduced computational cost in comparison to first-principles quantum molecular dynamics simulations.


title: Covariate-Powered Empirical Bayes Estimation

abstract: We study methods for simultaneous analysis of many noisy experiments in the presence of rich covariate information. The goal of the analyst is to optimally estimate the true effect underlying each experiment. Both the noisy experimental results and the auxiliary covariates are useful for this purpose, but neither data source on its own captures all the information available to the analyst. In this paper, we propose a flexible plug-in empirical Bayes estimator that synthesizes both sources of information and may leverage any black-box predictive model. We show that our approach is within a constant factor of minimax for a simple data-generating model. Furthermore, we establish robust convergence guarantees for our method that hold under considerable generality, and exhibit promising empirical performance on both real and simulated data.


title: A combinatorial criterion for macroscopic circles in planar triangulations

abstract: Given a finite simple triangulation, we estimate the sizes of circles in its circle packing in terms of Cannon's vertex extremal length. Our estimates provide control over the size of the largest circle in the packing. We use them, combined with results from [12], to prove that in a proper circle packing of the discrete mating-of-trees random map model of Duplantier, Gwynne, Miller and Sheffield, the size of the largest circle goes to zero with high probability.


title: The Dirichlet problem for orthodiagonal maps

abstract: We prove that the discrete harmonic function corresponding to smooth Dirichlet boundary conditions on orthodiagonal maps, that is, plane graphs having quadrilateral faces with orthogonal diagonals, converges to its continuous counterpart as the mesh size goes to 0. This provides a convergence statement for discrete holomorphic functions, similar to the one obtained by Chelkak and Smirnov for isoradial graphs. We observe that by the double circle packing theorem, any finite, simple, 3-connected planar map admits an orthodiagonal representation. Our result improves the work of Skopenkov and Werness by dropping all regularity assumptions required in their work and providing effective bounds. In particular, no bound on the vertex degrees is required. Thus, the result can be applied to models of random planar maps that with high probability admit orthodiagonal representation with mesh size tending to 0. In a companion paper, we show that this can be done for the discrete mating-of-trees random map model of Duplantier, Gwynne, Miller and Sheffield.


title: Confidence Regions in Wasserstein Distributionally Robust Estimation

abstract: Wasserstein distributionally robust optimization estimators are obtained as solutions of min-max problems in which the statistician selects a parameter minimizing the worst-case loss among all probability models within a certain distance (in a Wasserstein sense) from the underlying empirical measure. While motivated by the need to identify optimal model parameters or decision choices that are robust to model misspecification, these distributionally robust estimators recover a wide range of regularized estimators, including square-root lasso and support vector machines, among others, as particular cases. This paper studies the asymptotic normality of these distributionally robust estimators as well as the properties of an optimal (in a suitable sense) confidence region induced by the Wasserstein distributionally robust optimization formulation. In addition, key properties of min-max distributionally robust optimization problems are also studied, for example, we show that distributionally robust estimators regularize the loss based on its derivative and we also derive general sufficient conditions which show the equivalence between the min-max distributionally robust optimization problem and the corresponding max-min formulation.


title: Sequential Neural Networks as Automata

abstract: This work attempts to explain the types of computation that neural networks can perform by relating them to automata. We first define what it means for a real-time network with bounded precision to accept a language. A measure of network memory follows from this definition. We then characterize the classes of languages acceptable by various recurrent networks, attention, and convolutional networks. We find that LSTMs function like counter machines and relate convolutional networks to the subregular hierarchy. Overall, this work attempts to increase our understanding and ability to interpret neural networks through the lens of theory. These theoretical insights help explain neural computation, as well as the relationship between neural networks and natural language grammar.


title: Cavity-mediated dissipative spin-spin coupling

abstract: We study dissipative spin-spin coupling in dispersive regime mediated by virtual photons in a microwave cavity. Dissipative coupling between magnetization of each magnetic material and the cavity photons is established by means of two phase shifted driving forces acting on each magnetization. We show that when only one of the magnetization is dissipatively coupled to the cavity, the cavity-mediated spin-spin coupling too, exhibits mode level attraction in the spectrum. By tuning the phase parameter at each ferromagnetic insulator we can shift the order of "dark" and "bright" collective modes with phase difference equal to 0 or \pi. Moreover, by selectively applying the phase shifted field it is possible to construct "dark" and "bright" collective modes with phase difference equal to \pm \pi/2:


title: Self-Attentional Models for Lattice Inputs

abstract: Lattices are an efficient and effective method to encode ambiguity of upstream systems in natural language processing tasks, for example to compactly capture multiple speech recognition hypotheses, or to represent multiple linguistic analyses. Previous work has extended recurrent neural networks to model lattice inputs and achieved improvements in various tasks, but these models suffer from very slow computation speeds. This paper extends the recently proposed paradigm of self-attention to handle lattice inputs. Self-attention is a sequence modeling technique that relates inputs to one another by computing pairwise similarities and has gained popularity for both its strong results and its computational efficiency. To extend such models to handle lattices, we introduce probabilistic reachability masks that incorporate lattice structure into the model and support lattice scores if available. We also propose a method for adapting positional embeddings to lattice structures. We apply the proposed model to a speech translation task and find that it outperforms all examined baselines while being much faster to compute than previous neural lattice models during both training and inference.


title: Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations

abstract: Unsupervised learning with generative models has the potential of discovering rich representations of 3D scenes. While geometric deep learning has explored 3D-structure-aware representations of scene geometry, these models typically require explicit 3D supervision. Emerging neural scene representations can be trained only with posed 2D images, but existing methods ignore the three-dimensional structure of scenes. We propose Scene Representation Networks (SRNs), a continuous, 3D-structure-aware scene representation that encodes both geometry and appearance. SRNs represent scenes as continuous functions that map world coordinates to a feature representation of local scene properties. By formulating the image formation as a differentiable ray-marching algorithm, SRNs can be trained end-to-end from only 2D images and their camera poses, without access to depth or shape. This formulation naturally generalizes across scenes, learning powerful geometry and appearance priors in the process. We demonstrate the potential of SRNs by evaluating them for novel view synthesis, few-shot reconstruction, joint shape and appearance interpolation, and unsupervised discovery of a non-rigid face model.


title: Torque equilibrium spin wave theory study of anisotropy and Dzyaloshinskii-Moriya interaction effects on the indirect K$-$ edge RIXS spectrum of a triangular lattice antiferromagnet

abstract: We apply the recently formulated torque equilibrium spin wave theory (TESWT) to compute the $1/S$-order interacting $K$ -edge bimagnon resonant inelastic x-ray scattering (RIXS) spectra of an anisotropic triangular lattice antiferromagnet with Dzyaloshinskii-Moriya (DM) interaction. We extend the interacting torque equilibrium formalism, incorporating the effects of DM interaction, to appropriately account for the zero-point quantum fluctuation that manifests as the emergence of spin Casimir effect in a noncollinear spin spiral state. Using inelastic neutron scattering data from Cs$_2$CuCl$_4$ we fit the 1/S corrected TESWT dispersion to extract exchange and DM interaction parameters. We use these new fit coefficients alongside other relevant model parameters to investigate, compare, and contrast the effects of spatial anisotropy and DM interaction on the RIXS spectra at various points across the magnetic Brillouin zone. We highlight the key features of the bi- and trimagnon RIXS spectrum at the two inequivalent rotonlike points, $M(0,2 \pi/\sqrt{3})$ and $M^{\prime}(\pi,\pi/\sqrt{3})$, whose behavior is quite different from an isotropic triangular lattice system. While the roton RIXS spectrum at the $M$ point undergoes a spectral downshift with increasing anisotropy, the peak at the $M^\prime$ location loses its spectral strength without any shift. With the inclusion of DM interaction the spiral phase is more stable and the peak at both $M$ and $M^\prime$ point exhibits a spectral upshift. Our calculation offers a practical example of how to calculate interacting RIXS spectra in a non-collinear quantum magnet using TESWT. Our findings provide an opportunity to experimentally test the predictions of interacting TESWT formalism using RIXS, a spectroscopic method currently in vogue.


title: Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Vision

abstract: While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial, for example in automotive applications. In Bayesian deep learning, predictive uncertainty is commonly decomposed into the distinct types of aleatoric and epistemic uncertainty. The former can be estimated by letting a neural network output the parameters of a certain probability distribution. Epistemic uncertainty estimation is a more challenging problem, and while different scalable methods recently have emerged, no extensive comparison has been performed in a real-world setting. We therefore accept this task and propose a comprehensive evaluation framework for scalable epistemic uncertainty estimation methods in deep learning. Our proposed framework is specifically designed to test the robustness required in real-world computer vision applications. We also apply this framework to provide the first properly extensive and conclusive comparison of the two current state-of-the-art scalable methods: ensembling and MC-dropout. Our comparison demonstrates that ensembling consistently provides more reliable and practically useful uncertainty estimates. Code is available at https://github.com/fregu856/evaluating_bdl.


title: Higher-Order Accelerated Methods for Faster Non-Smooth Optimization

abstract: We provide improved convergence rates for various \emph{non-smooth} optimization problems via higher-order accelerated methods. In the case of $\ell_\infty$ regression, we achieves an $O(\epsilon^{-4/5})$ iteration complexity, breaking the $O(\epsilon^{-1})$ barrier so far present for previous methods. We arrive at a similar rate for the problem of $\ell_1$-SVM, going beyond what is attainable by first-order methods with prox-oracle access for non-smooth non-strongly convex problems. We further show how to achieve even faster rates by introducing higher-order regularization. Our results rely on recent advances in near-optimal accelerated methods for higher-order smooth convex optimization. In particular, we extend Nesterov's smoothing technique to show that the standard softmax approximation is not only smooth in the usual sense, but also \emph{higher-order} smooth. With this observation in hand, we provide the first example of higher-order acceleration techniques yielding faster rates for \emph{non-smooth} optimization, to the best of our knowledge.


title: Are Girls Neko or Sh\=ojo? Cross-Lingual Alignment of Non-Isomorphic Embeddings with Iterative Normalization

abstract: Cross-lingual word embeddings (CLWE) underlie many multilingual natural language processing systems, often through orthogonal transformations of pre-trained monolingual embeddings. However, orthogonal mapping only works on language pairs whose embeddings are naturally isomorphic. For non-isomorphic pairs, our method (Iterative Normalization) transforms monolingual embeddings to make orthogonal alignment easier by simultaneously enforcing that (1) individual word vectors are unit length, and (2) each language's average vector is zero. Iterative Normalization consistently improves word translation accuracy of three CLWE methods, with the largest improvement observed on English-Japanese (from 2% to 44% test accuracy).


title: And yet it flips: connecting galactic spin and the cosmic web

abstract: We study the spin alignment of galaxies and halos with respect to filaments and walls of the cosmic web, identified with DisPerSE, using the SIMBA simulation from z=0-2. Massive halos' spins are oriented perpendicularly to their closest filament's axis and walls, while low mass halos tend to have their spins parallel to filaments and in the plane of walls. A similar mass-dependent spin flip is found for galaxies, albeit with a weaker signal particularly at low mass and low-z, suggesting that galaxies' spins retain memory of their larger-scale environment. Low-z star-forming and rotation-dominated galaxies tend to have spins parallel to nearby filaments, while quiescent and dispersion-dominated galaxies show preferentially perpendicular orientation; the star formation trend can be fully explained by the stellar mass correlation, but the morphology trend cannot. There is a strong dependence on HI mass, such that high-HI galaxies tend to have parallel spins while low-HI galaxies are perpendicular, which persists even when matching samples in stellar mass, suggesting that HI content traces anisotropic infall more faithfully than the stellar component. Finally, at fixed stellar mass, the strength of spin alignments correlates with the filament's density, with parallel alignment for galaxies in high density environments. These findings are consistent with conditional tidal torque theory, and highlight a significant correlation between galactic spin and the larger scale tides that are important e.g. for interpreting weak lensing studies. SIMBA allows us to rule out numerical grid locking as the cause of previously-seen low mass alignment.


title: Off-Policy Evaluation via Off-Policy Classification

abstract: In this work, we consider the problem of model selection for deep reinforcement learning (RL) in real-world environments. Typically, the performance of deep RL algorithms is evaluated via on-policy interactions with the target environment. However, comparing models in a real-world environment for the purposes of early stopping or hyperparameter tuning is costly and often practically infeasible. This leads us to examine off-policy policy evaluation (OPE) in such settings. We focus on OPE for value-based methods, which are of particular interest in deep RL, with applications like robotics, where off-policy algorithms based on Q-function estimation can often attain better sample complexity than direct policy optimization. Existing OPE metrics either rely on a model of the environment, or the use of importance sampling (IS) to correct for the data being off-policy. However, for high-dimensional observations, such as images, models of the environment can be difficult to fit and value-based methods can make IS hard to use or even ill-conditioned, especially when dealing with continuous action spaces. In this paper, we focus on the specific case of MDPs with continuous action spaces and sparse binary rewards, which is representative of many important real-world applications. We propose an alternative metric that relies on neither models nor IS, by framing OPE as a positive-unlabeled (PU) classification problem with the Q-function as the decision function. We experimentally show that this metric outperforms baselines on a number of tasks. Most importantly, it can reliably predict the relative performance of different policies in a number of generalization scenarios, including the transfer to the real-world of policies trained in simulation for an image-based robotic manipulation task.


title: New quantum toroidal algebras from 5D $\mathcal{N}=1$ instantons on orbifolds

abstract: Quantum toroidal algebras are obtained from quantum affine algebras by a further affinization, and, like the latter, can be used to construct integrable systems. These algebras also describe the symmetries of instanton partition functions for 5D $\mathcal{N}=1$ supersymmetric quiver gauge theories. We consider here the gauge theories defined on an orbifold $S^1\times\mathbb{C}^2/\mathbb{Z}_p$ where the action of $\mathbb{Z}_p$ is determined by two integer parameters $(\nu_1,\nu_2)$. The corresponding quantum toroidal algebra is introduced as a deformation of the quantum toroidal algebra of $\mathfrak{gl}(p)$. We show that it has the structure of a Hopf algebra, and present two representations, called vertical and horizontal, obtained by deforming respectively the Fock representation and Saito's vertex representations of the quantum toroidal algebra of $\mathfrak{gl}(p)$. We construct the vertex operator intertwining between these two types of representations. This object is identified with a $(\nu_1,\nu_2)$-deformation of the refined topological vertex, allowing us to reconstruct the Nekrasov partition function and the $qq$-characters of the quiver gauge theories.


title: Encoding Invariances in Deep Generative Models

abstract: Reliable training of generative adversarial networks (GANs) typically require massive datasets in order to model complicated distributions. However, in several applications, training samples obey invariances that are \textit{a priori} known; for example, in complex physics simulations, the training data obey universal laws encoded as well-defined mathematical equations. In this paper, we propose a new generative modeling approach, InvNet, that can efficiently model data spaces with known invariances. We devise an adversarial training algorithm to encode them into data distribution. We validate our framework in three experimental settings: generating images with fixed motifs; solving nonlinear partial differential equations (PDEs); and reconstructing two-phase microstructures with desired statistical properties. We complement our experiments with several theoretical results.


title: Benchmark of Polygon Quality Metrics for Polytopal Element Methods

abstract: Polytopal Element Methods (PEM) allow to solve differential equations on general polygonal and polyhedral grids, potentially offering great flexibility to mesh generation algorithms. Differently from classical finite element methods, where the relation between the geometric properties of the mesh and the performances of the solver are well known, the characterization of a good polytopal element is still subject to ongoing research. Current shape regularity criteria are quite restrictive, and greatly limit the set of valid meshes. Nevertheless, numerical experiments revealed that PEM solvers can perform well on meshes that are far outside the strict boundaries imposed by the current theory, suggesting that the real capabilities of these methods are much higher. In this work, we propose a benchmark to study the correlation between general 2D polygonal meshes and PEM solvers. The benchmark aims to explore the space of 2D polygonal meshes and polygonal quality metrics, in order to identify weaker shape-regularity criteria under which the considered methods can reliably work. The proposed tool is quite general, and can be potentially used to study any PEM solver. Besides discussing the basics of the benchmark, in the second part of the paper we demonstrate its application on a representative member of the PEM family, namely the Virtual Element Method, also discussing our findings.


title: Spectroscopy of spinons in Coulomb quantum spin liquids

abstract: We calculate the effect of the emergent photon on threshold production of spinons in $U(1)$ Coulomb spin liquids such as quantum spin ice. The emergent Coulomb interaction modifies the threshold production cross-section dramatically, changing the weak turn-on expected from the density of states to an abrupt onset reflecting the basic coupling parameters. The slow photon typical in existing lattice models and materials suppresses the intensity at finite momentum and allows profuse Cerenkov radiation beyond a critical momentum. These features are broadly consistent with recent numerical and experimental results.


title: Exact Combinatorial Optimization with Graph Convolutional Neural Networks

abstract: Combinatorial optimization problems are typically tackled by the branch-and-bound paradigm. We propose a new graph convolutional neural network model for learning branch-and-bound variable selection policies, which leverages the natural variable-constraint bipartite graph representation of mixed-integer linear programs. We train our model via imitation learning from the strong branching expert rule, and demonstrate on a series of hard problems that our approach produces policies that improve upon state-of-the-art machine-learning methods for branching and generalize to instances significantly larger than seen during training. Moreover, we improve for the first time over expert-designed branching rules implemented in a state-of-the-art solver on large problems. Code for reproducing all the experiments can be found at https://github.com/ds4dm/learn2branch.


title: Resilient State Estimation for Discrete-Time Linear Systems

abstract: This paper proposes a resilient state estimator for LTI discrete-time systems. The dynamic equation of the system is assumed to be affected by a bounded process noise. As to the available measurements, they are potentially corrupted by a noise of both dense and impulsive natures. In this setting, we construct the estimator as the map which associates to the measurements, the minimizing set of an appropriate (convex) performance function. It is then shown that the proposed estimator enjoys the property of resilience, that is, it induces an estimation error which, under certain conditions, is independent of the extreme values of the (impulsive) measurement noise. Therefore, the estimation error may be bounded while the measurement noise is virtually unbounded. Moreover, the expression of the bound depends explicitly on the degree of observability of the system being observed and on the considered performance function. Finally, a few simulation results are provided to illustrate the resilience property.


title: Discussing the first velocity dispersion profile of an ultra-diffuse galaxy in MOND

abstract: Using Jeans modelling, we calculate the velocity dispersion profile of the ultra-diffuse galaxy (UDG) Dragonfly 44 in MOND. For the nominal mass-to-light ratio from the literature and an isotropic profile, the agreement with the data is excellent near the center of the galaxy. However, in modified gravity, close to the cluster core, the gravitational environment should bring the galaxy back towards the Newtonian behavior. This success of the isolated MOND prediction for the central velocity dispersion could then mean that the galaxy is at large distances ($\gg5$ Mpc) from the cluster core, as hinted by the fact that close-by UDGs share similar velocities with a dispersion well below that of the cluster itself. There is however a two-sigma tension in the outer part of the UDG due to an increase of the observed dispersion profile with respect to the flat MOND prediction. This deviation could simply be a measurement error. Other possibilities could be, for a UDG far from the cluster, a higher-than-nominal baryonic mass with a tangentially anisotropic dispersion profile, or even a sign of a dark baryonic halo. If the UDG is closer to the cluster core, the deviation could be a sign that it is in the process of disruption.


title: Solution of the 3D density-driven groundwater flow problem with uncertain porosity and permeability

abstract: As groundwater is an essential nutrition and irrigation resource, its pollution may lead to catastrophic consequences. Therefore, accurate modeling of the pollution of the soil and groundwater aquifer is highly important. As a model, we consider a density-driven groundwater flow problem with uncertain porosity and permeability. This problem may arise in geothermal reservoir simulation, natural saline-disposal basins, modeling of contaminant plumes, and subsurface flow. This strongly nonlinear time-dependent problem describes the convection of the two-phase flow. This liquid streams under the gravity force, building so-called "fingers". The accurate numerical solution requires fine spatial resolution with an unstructured mesh and, therefore, high computational resources. Consequently, we run the parallelized simulation toolbox \myug with the geometric multigrid solver on Shaheen II supercomputer. The parallelization is done in physical and stochastic spaces. Additionally, we demonstrate how the \myug toolbox can be run in a black-box fashion for testing different scenarios in the density-driven flow. As a benchmark, we solve the Elder-like problem in a 3D domain. For approximations in the stochastic space, we use the generalized polynomial chaos expansion. We compute the mean, variance, and exceedance probabilities of the mass fraction. As a reference solution, we use the solution, obtained from the quasi-Monte Carlo method.


title: Fractionalized pair density wave in the pseudo-gap phase of cuprate superconductors

abstract: The mysterious pseudo-gap (PG) phase of cuprate superconductors has been the subject of intense investigation over the last thirty years, but without a clear agreement about its origin. Owing to a recent observation in Raman spectroscopy, of a precursor in the charge channel, on top of the well known fact of a precursor in the superconducting channel, we present here a novel idea: the PG is formed through a Higgs mechanism, where two kinds of preformed pairs, in the particle-particle and particle-hole channels, become entangled through a freezing of their global phase. Remarkably, this entanglement is equivalent to fractionalizing a Cooper pair density wave (PDW) into its elementary parts; the particle-hole pair, giving rise to both density modulations and current modulations, and the particle-particle counterpart, leading to the formation of Cooper pairs. From this perspective, the "fractionalized PDW" becomes the central object around the formation of the pseudo-gap. The "locking" of phases between the charge and superconducting modes gives a unique explanation for the unusual global phase coherence of short-range charge modulations, observed below $T_{c}$ on phase sensitive scanning tunneling microscopy (STM). A simple microscopic model enables us to estimate the mean-field values of the precursor gaps in each channel and the PG energy scale, and to compare them to the values observed in Raman scattering spectroscopy. We also discuss the possibility of a multiplicity of orders in the PG phase and give an overview of the phase diagram.


title: On the Realization of Compositionality in Neural Networks

abstract: We present a detailed comparison of two types of sequence to sequence models trained to conduct a compositional task. The models are architecturally identical at inference time, but differ in the way that they are trained: our baseline model is trained with a task-success signal only, while the other model receives additional supervision on its attention mechanism (Attentive Guidance), which has shown to be an effective method for encouraging more compositional solutions (Hupkes et al.,2019). We first confirm that the models with attentive guidance indeed infer more compositional solutions than the baseline, by training them on the lookup table task presented by Li\v{s}ka et al. (2019). We then do an in-depth analysis of the structural differences between the two model types, focusing in particular on the organisation of the parameter space and the hidden layer activations and find noticeable differences in both these aspects. Guided networks focus more on the components of the input rather than the sequence as a whole and develop small functional groups of neurons with specific purposes that use their gates more selectively. Results from parameter heat maps, component swapping and graph analysis also indicate that guided networks exhibit a more modular structure with a small number of specialized, strongly connected neurons.


title: Detecting Ghostwriters in High Schools

abstract: Students hiring ghostwriters to write their assignments is an increasing problem in educational institutions all over the world, with companies selling these services as a product. In this work, we develop automatic techniques with special focus on detecting such ghostwriting in high school assignments. This is done by training deep neural networks on an unprecedented large amount of data supplied by the Danish company MaCom, which covers 90% of Danish high schools. We achieve an accuracy of 0.875 and a AUC score of 0.947 on an evenly split data set.


title: Formulating basic notions of finite group theory via the lifting property

abstract: We reformulate several basic notions of notions in finite group theory in terms of iterations of the lifting property (orthogonality) with respect to particular morphisms. Our examples include the notions being nilpotent, solvable, perfect, torsion-free; p-groups and prime-to-p-groups; Fitting subgroup, perfect core, p-core, and prime-to-p core. We also reformulate as in similar terms the conjecture that a localisation of a (transfinitely) nilpotent group is (transfinitely) nilpotent.