title: Multitask Learning for Network Traffic Classification

abstract: Traffic classification has various applications in today's Internet, from resource allocation, billing and QoS purposes in ISPs to firewall and malware detection in clients. Classical machine learning algorithms and deep learning models have been widely used to solve the traffic classification task. However, training such models requires a large amount of labeled data. Labeling data is often the most difficult and time-consuming process in building a classifier. To solve this challenge, we reformulate the traffic classification into a multi-task learning framework where bandwidth requirement and duration of a flow are predicted along with the traffic class. The motivation of this approach is twofold: First, bandwidth requirement and duration are useful in many applications, including routing, resource allocation, and QoS provisioning. Second, these two values can be obtained from each flow easily without the need for human labeling or capturing flows in a controlled and isolated environment. We show that with a large amount of easily obtainable data samples for bandwidth and duration prediction tasks, and only a few data samples for the traffic classification task, one can achieve high accuracy. We conduct two experiment with ISCX and QUIC public datasets and show the efficacy of our approach.


title: Orbital Selectivity and Magnetic Ordering in Fe intercalated Dirac Semimetal Bi$_2$Se$_3$

abstract: In this paper we investigate the intercalation effects of Iron (Fe) in the van der Waals gap of Bi$_2$Se$_3$ on the magnetic and transport properties using first-principles band structure estimations combined using dynamical mean-field theory. Inclusion of electronic correlations and spin-orbit coupling effects are found to result in the emergence of ferromagnetic properties in an intercalated Bi$_2$Se$_3$. Further the Dirac cone in the band structure of Bismuth Selenide is modified via Fe intercalation at moderate densities. Accompanied by novel structural effects, the onset of an orbital selective metal insulator transition in the Fe 3$d$ orbitals brings about a magnetic phase transition in the Fe intercalated Bi$_2$Se$_3$. Further we have explored the dependency of the inter-orbital electron-electron correlations on the magnetic ordering and the effects of intercalation in establishing new physical properties.


title: On The XUV Luminosity Evolution of TRAPPIST-1

abstract: We model the long-term XUV luminosity of TRAPPIST-1 to constrain the evolving high-energy radiation environment experienced by its planetary system. Using Markov Chain Monte Carlo (MCMC), we derive probabilistic constraints for TRAPPIST-1's stellar and XUV evolution that account for observational uncertainties, degeneracies between model parameters, and empirical data of low-mass stars. We constrain TRAPPIST-1's mass to $m_{\star} = 0.089 \pm{0.001}$ M$_{\odot}$ and find that its early XUV luminosity likely saturated at $\log_{10}(L_{XUV}/L_{bol}) = -3.03^{+0.23}_{-0.12}$. From the posterior distribution, we infer that there is a ${\sim}40\%$ chance that TRAPPIST-1 is still in the saturated phase today, suggesting that TRAPPIST-1 has maintained high activity and $L_{XUV}/L_{bol} \approx 10^{-3}$ for several Gyrs. TRAPPIST-1's planetary system therefore likely experienced a persistent and extreme XUV flux environment, potentially driving significant atmospheric erosion and volatile loss. The inner planets likely received XUV fluxes ${\sim}10^3 - 10^4\times$ that of the modern Earth during TRAPPIST-1's ${\sim}1$ Gyr-long pre-main sequence phase. Deriving these constraints via MCMC is computationally non-trivial, so scaling our methods to constrain the XUV evolution of a larger number of M dwarfs that harbor terrestrial exoplanets would incur significant computational expenses. We demonstrate that approxposterior, an open source Python machine learning package for approximate Bayesian inference using Gaussian processes, accurately and efficiently replicates our analysis using $980\times$ less computational time and $1330\times$ fewer simulations than MCMC sampling using emcee. We find that approxposterior derives constraints with mean errors on the best fit values and $1\sigma$ uncertainties of $0.61\%$ and $5.5\%$, respectively, relative to emcee.


title: Compressed Sensing MRI via a Multi-scale Dilated Residual Convolution Network

abstract: Magnetic resonance imaging (MRI) reconstruction is an active inverse problem which can be addressed by conventional compressed sensing (CS) MRI algorithms that exploit the sparse nature of MRI in an iterative optimization-based manner. However, two main drawbacks of iterative optimization-based CSMRI methods are time-consuming and are limited in model capacity. Meanwhile, one main challenge for recent deep learning-based CSMRI is the trade-off between model performance and network size. To address the above issues, we develop a new multi-scale dilated network for MRI reconstruction with high speed and outstanding performance. Comparing to convolutional kernels with same receptive fields, dilated convolutions reduce network parameters with smaller kernels and expand receptive fields of kernels to obtain almost same information. To maintain the abundance of features, we present global and local residual learnings to extract more image edges and details. Then we utilize concatenation layers to fuse multi-scale features and residual learnings for better reconstruction. Compared with several non-deep and deep learning CSMRI algorithms, the proposed method yields better reconstruction accuracy and noticeable visual improvements. In addition, we perform the noisy setting to verify the model stability, and then extend the proposed model on a MRI super-resolution task.


title: A sufficient condition for uniqueness of weak solutions of the incompressible Euler system

abstract: We give a new sufficient criteria to prove the uniqueness of the incompressible Euler equation in dimension $N\geq2$. In their celebrated works by V. Scheffer [18], A. Shnirelman [19], C. De Lellis and L. Sz\'ekelyhidi Jr. [7] they have obtained the nonuniqeness of weak solutions of incompressible Euler equation. Here we obtain uniqueness criteria for the same equation under some mild regularity condition on weak solutions. Our proof is simple and can be employed to other equations like inhomogeneous incompressible Euler and Euler-Boussinesq equations. One of the key ingredients in our proof is commutator estimate [5, 11].


title: Search on the Replay Buffer: Bridging Planning and Reinforcement Learning

abstract: The history of learning for control has been an exciting back and forth between two broad classes of algorithms: planning and reinforcement learning. Planning algorithms effectively reason over long horizons, but assume access to a local policy and distance metric over collision-free paths. Reinforcement learning excels at learning policies and the relative values of states, but fails to plan over long horizons. Despite the successes of each method in various domains, tasks that require reasoning over long horizons with limited feedback and high-dimensional observations remain exceedingly challenging for both planning and reinforcement learning algorithms. Frustratingly, these sorts of tasks are potentially the most useful, as they are simple to design (a human only need to provide an example goal state) and avoid reward shaping, which can bias the agent towards finding a sub-optimal solution. We introduce a general control algorithm that combines the strengths of planning and reinforcement learning to effectively solve these tasks. Our aim is to decompose the task of reaching a distant goal state into a sequence of easier tasks, each of which corresponds to reaching a subgoal. Planning algorithms can automatically find these waypoints, but only if provided with suitable abstractions of the environment -- namely, a graph consisting of nodes and edges. Our main insight is that this graph can be constructed via reinforcement learning, where a goal-conditioned value function provides edge weights, and nodes are taken to be previously seen observations in a replay buffer. Using graph search over our replay buffer, we can automatically generate this sequence of subgoals, even in image-based environments. Our algorithm, search on the replay buffer (SoRB), enables agents to solve sparse reward tasks over one hundred steps, and generalizes substantially better than standard RL algorithms.


title: MASCARA-3b: A hot Jupiter transiting a bright F7 star in an aligned orbit

abstract: We report the discovery of MASCARA-3b, a hot Jupiter orbiting its bright (V = 8.33) late F-type host every $5.55149\pm 0.00001$ days in an almost circular orbit ($e = 0.050^{+0.020}_{-0.017}$). This is the fourth exoplanet discovered with the Multi-site All-Sky CAmeRA (MASCARA), and the first of these that orbits a late-type star. Follow-up spectroscopic measurements were obtained in and out of transit with the Hertzsprung SONG telescope. Combining the MASCARA photometry and SONG radial velocities reveals a radius and mass of $1.36\pm 0.05$ $R_{\text{Jup}}$ and $4.2\pm 0.2$ $M_{\text{Jup}}$. In addition, SONG spectroscopic transit observations were obtained on two separate nights. From analyzing the mean out-of-transit broadening function, we obtain $v\sin i_{\star} = 20.4\pm 0.4$ km s$^{-1}$. In addition, investigating the Rossiter-McLaughlin effect, as observed in the distortion of the stellar lines directly and through velocity anomalies, we find the projected obliquity to be $\lambda = 1.2^{+8.2}_{-7.4}$ deg, which is consistent with alignment.


title: A Simple Text Mining Approach for Ranking Pairwise Associations in Biomedical Applications

abstract: We present a simple text mining method that is easy to implement, requires minimal data collection and preparation, and is easy to use for proposing ranked associations between a list of target terms and a key phrase. We call this method KinderMiner, and apply it to two biomedical applications. The first application is to identify relevant transcription factors for cell reprogramming, and the second is to identify potential drugs for investigation in drug repositioning. We compare the results from our algorithm to existing data and state-of-the-art algorithms, demonstrating compelling results for both application areas. While we apply the algorithm here for biomedical applications, we argue that the method is generalizable to any available corpus of sufficient size.


title: Linear Analysis of the Nonaxisymmetric Secular Gravitational Instability

abstract: In protoplanetary discs (PPDs) consisting of gas and dust particles, fluid instabilities induced by the drag force, including secular gravitational instability (SGI) can facilitate planet formation. Although SGI subject to the axisymmetric perturbations was originally studied in the absence of gas feedback and it then generalized using a two-fluid approach, the fate of the nonaxisymmetric SGI, in either case, is an unexplored problem. We present a linear perturbation analysis of the nonaxisymmetric SGI in a PPD by implementing a two-fluid model. We explore the growth of the local, nonaxisymmetric perturbations using a set of linearized perturbation equations in a sheared frame. The nonaxisymmetric perturbations display significant growth during a finite time interval even when the system is stable against the axisymmetric perturbations. Furthermore, the surface density perturbations do not show continuous growth but are temporally amplified. We also study cases where the dust component undergoes amplification whereas the gas component remains stable. The amplitude amplification, however, strongly depends on the model parameters. In the minimum mass solar nebula (MMSN), for instance, the dust fluid amplification at the radial distance 100 au occurs when the Stokes number is about unity. But the amplification factor reduces as the dust and gas coupling becomes weaker. Furthermore, perturbations with a larger azimuthal wavelength exhibit a larger amplification factor.


title: Higher extensions for gentle algebras

abstract: In this paper we determine extensions of higher degree between indecomposable modules over gentle algebras. In particular, our results show how such extensions either eventually vanish or become periodic. We give a geometric interpretation of vanishing and periodicity of higher extensions in terms of the surface underlying the gentle algebra. For gentle algebras arising from triangulations of surfaces, we give an explicit basis of higher extension spaces between indecomposable modules.


title: The hessian in spin foam models

abstract: We fill one of the remaining gaps in the asymptotic analysis of the vertex amplitudes of the Engle-Pereira-Rovelli-Livine (EPRL) spin foam models: We show that the hessian is nondegenerate for the stationary points that corresponds to geometric nondegenerate $4$ simplices. Our analysis covers the case when all faces are spacelike.


title: Analyticity of Steklov eigenvalues of nearly-circular and nearly-spherical domains

abstract: We consider the Dirichlet-to-Neumann operator (DNO) on nearly-circular and nearly-spherical domains in two and three dimensions, respectively. Treating such domains as perturbations of the ball, we prove the analyticity of the DNO with respect to the domain perturbation parameter. Consequently, the Steklov eigenvalues are also shown to be analytic in the domain perturbation parameter. To obtain these results, we use the strategy of Nicholls and Nigam (2004); we transform the equation on the perturbed domain to a ball and geometrically bound the Neumann expansion of the transformed Dirichlet-to-Neumann operator.


title: VIPER: Volume Invariant Position-based Elastic Rods

abstract: We extend the formulation of position-based rods to include elastic volumetric deformations. We achieve this by introducing an additional degree of freedom per vertex -- isotropic scale (and its velocity). Including scale enriches the space of possible deformations, allowing the simulation of volumetric effects, such as a reduction in cross-sectional area when a rod is stretched. We rigorously derive the continuous formulation of its elastic energy potentials, and hence its associated position-based dynamics (PBD) updates to realize this model, enabling the simulation of up to 26000 DOFs at 140 Hz in our GPU implementation. We further show how rods can provide a compact alternative to tetrahedral meshes for the representation of complex muscle deformations, as well as providing a convenient representation for collision detection. This is achieved by modeling a muscle as a bundle of rods, for which we also introduce a technique to automatically convert a muscle surface mesh into a rods-bundle. Finally, we show how rods and/or bundles can be skinned to a surface mesh to drive its deformation, resulting in an alternative to cages for real-time volumetric deformation.


title: LAEO-Net: revisiting people Looking At Each Other in videos

abstract: Capturing the `mutual gaze' of people is essential for understanding and interpreting the social interactions between them. To this end, this paper addresses the problem of detecting people Looking At Each Other (LAEO) in video sequences. For this purpose, we propose LAEO-Net, a new deep CNN for determining LAEO in videos. In contrast to previous works, LAEO-Net takes spatio-temporal tracks as input and reasons about the whole track. It consists of three branches, one for each character's tracked head and one for their relative position. Moreover, we introduce two new LAEO datasets: UCO-LAEO and AVA-LAEO. A thorough experimental evaluation demonstrates the ability of LAEONet to successfully determine if two people are LAEO and the temporal window where it happens. Our model achieves state-of-the-art results on the existing TVHID-LAEO video dataset, significantly outperforming previous approaches. Finally, we apply LAEO-Net to social network analysis, where we automatically infer the social relationship between pairs of people based on the frequency and duration that they LAEO.


title: Rouch\'e's Theorem and the Geometry of Rational Functions

abstract: In this note, we use Rouch\'e's theorem and the pleasant properties of the arithmetic of the logarithmic derivative to establish several new results regarding the geometry of the zeros, poles, and critical points of a rational function. Included is an improvement on a result by Alexander and Walsh regarding the distance from a given zero or pole of a rational function to the nearest critical point.


title: Gallai-Ramsey number of even cycles with chords

abstract: For a graph $H$ and an integer $k\ge1$, the $k$-color Ramsey number $R_k(H)$ is the least integer $N$ such that every $k$-coloring of the edges of the complete graph $K_N$ contains a monochromatic copy of $H$. Let $C_m$ denote the cycle on $m\ge4$ vertices and let $\Theta_m$ denote the family of graphs obtained from $C_m$ by adding an additional edge joining two non-consecutive vertices. Unlike Ramsey number of odd cycles, little is known about the general behavior of $R_k(C_{2n})$ except that $R_k(C_{2n})\ge (n-1)k+n+k-1$ for all $k\ge2$ and $n\ge2$. In this paper, we study Ramsey number of even cycles with chords under Gallai colorings, where a Gallai coloring is a coloring of the edges of a complete graph without rainbow triangles. For an integer $k\geq 1$, the Gallai-Ramsey number $GR_k(H)$ of a graph $H$ is the least positive integer $N$ such that every Gallai $k$-coloring of the complete graph $K_N$ contains a monochromatic copy of $H$. We prove that $GR_k(\Theta_{2n})=(n-1)k+n+1$ for all $k\geq 2$ and $n\geq 3$. This implies that $GR_k(C_{2n})=(n-1)k+n+1$ all $k\geq 2$ and $n\geq 3$. Our result yields a unified proof for the Gallai-Ramsey number of all even cycles on at least four vertices.


title: GluonTS: Probabilistic Time Series Models in Python

abstract: We introduce Gluon Time Series (GluonTS, available at https://gluon-ts.mxnet.io), a library for deep-learning-based time series modeling. GluonTS simplifies the development of and experimentation with time series models for common tasks such as forecasting or anomaly detection. It provides all necessary components and tools that scientists need for quickly building new models, for efficiently running and analyzing experiments and for evaluating model accuracy.


title: Relations in the Cremona group over perfect fields

abstract: For perfect fields $k$ satisfying $[\bar k:k]>2$, we construct new normal subgroups of the plane Cremona group and provide an elementary proof of its non-simplicity, following the melody of the recent proof by Blanc, Lamy and Zimmermann that the Cremona group of rank $n$ over (subfields of) the complex numbers is not simple for $n\geq3$.


title: The Tandem Duplication Distance is NP-hard

abstract: In computational biology, tandem duplication is an important biological phenomenon which can occur either at the genome or at the DNA level. A tandem duplication takes a copy of a genome segment and inserts it right after the segment - this can be represented as the string operation $AXB \Rightarrow AXXB$. For example, Tandem exon duplications have been found in many species such as human, fly or worm, and have been largely studied in computational biology. The Tandem Duplication (TD) distance problem we investigate in this paper is defined as follows: given two strings $S$ and $T$ over the same alphabet, compute the smallest sequence of tandem duplications required to convert $S$ to $T$. The natural question of whether the TD distance can be computed in polynomial time was posed in 2004 by Leupold et al. and had remained open, despite the fact that tandem duplications have received much attention ever since. In this paper, we prove that this problem is NP-hard. We further show that this hardness holds even if all characters of $S$ are distinct. This is known as the exemplar TD distance, which is of special relevance in bioinformatics. One of the tools we develop for the reduction is a new problem called the Cost-Effective Subgraph, for which we obtain W[1]-hardness results that might be of independent interest. We finally show that computing the exemplar TD distance between $S$ and $T$ is fixed-parameter tractable. Our results open the door to many other questions, and we conclude with several open problems.


title: Developing an improved Crystal Graph Convolutional Neural Network framework for accelerated materials discovery

abstract: The recently proposed crystal graph convolutional neural network (CGCNN) offers a highly versatile and accurate machine learning (ML) framework by learning material properties directly from graph-like representations of crystal structures ("crystal graphs"). Here, we develop an improved variant of the CGCNN model (iCGCNN) that outperforms the original by incorporating information of the Voronoi tessellated crystal structure, explicit 3-body correlations of neighboring constituent atoms, and an optimized chemical representation of interatomic bonds in the crystal graphs. We demonstrate the accuracy of the improved framework in two distinct illustrations: First, when trained/validated on 180,000/20,000 density functional theory (DFT) calculated thermodynamic stability entries taken from the Open Quantum Materials Database (OQMD) and evaluated on a separate test set of 230,000 entries, iCGCNN achieves a predictive accuracy that is significantly improved, i.e., 20% higher than that of the original CGCNN. Second, when used to assist high-throughput search for materials in the ThCr2Si2 structure-type, iCGCNN exhibited a success rate of 31% which is 310 times higher than an undirected high-throughput search and 2.4 times higher than that of the original CGCNN. Using both CGCNN and iCGCNN, we screened 132,600 compounds with elemental decorations of the ThCr2Si2 prototype crystal structure and identified a total of 97 new unique stable compounds by performing 757 DFT calculations, accelerating the computational time of the high-throughput search by a factor of 130. Our results suggest that the iCGCNN can be used to accelerate high-throughput discoveries of new materials by quickly and accurately identifying crystalline compounds with properties of interest.


title: Differential Imaging Forensics

abstract: We introduce some new forensics based on differential imaging, where a novel category of visual evidence created via subtle interactions of light with a scene, such as dim reflections, can be computationally extracted and amplified from an image of interest through a comparative analysis with an additional reference baseline image acquired under similar conditions. This paradigm of differential imaging forensics (DIF) enables forensic examiners for the first time to retrieve the said visual evidence that is readily available in an image or video footage but would otherwise remain faint or even invisible to a human observer. We demonstrate the relevance and effectiveness of our approach through practical experiments. We also show that DIF provides a novel method for detecting forged images and video clips, including deep fakes.


title: Growing green: the role of path dependency and structural jumps in the green economy expansion

abstract: Existing research argues that countries increase their production basket by adding products which require similar capabilities to those they already produce, a process referred to as path dependency. Green economic growth is a global movement that seeks to achieve economic expansion while at the same time mitigating environmental risks. We postulate that countries engaging in green economic growth are motivated to invest strategically to develop new capabilities that will help them transition to a green economy. As a result, they could potentially increase their production baskets not only by a path dependent process but also by the non path dependent process we term, high investment structural jumps. The main objective of this research is to determine whether countries increase their green production basket mainly by a process of path dependency, or alternatively, by a process of structural jumps. We analyze data from 65 countries and over a period from years 2007 to 2017. We focus on China as our main case study. The results of this research show that countries not only increase their green production baskets based on their available capabilities, following path dependency, but also expand to products that path dependency does not predict by investing in innovating and developing new environmental related technologies.


title: Artificial Intelligence Enabled Material Behavior Prediction

abstract: Artificial Intelligence and Machine Learning algorithms have considerable potential to influence the prediction of material properties. Additive materials have a unique property prediction challenge in the form of surface roughness effects on fatigue behavior of structural components. Traditional approaches using finite element methods to calculate stress risers associated with additively built surfaces have been challenging due to the computational resources required, often taking over a day to calculate a single sample prediction. To address this performance challenge, Deep Learning has been employed to enable low cycle fatigue life prediction in additive materials in a matter of seconds.


title: Does Learning Require Memorization? A Short Tale about a Long Tail

abstract: State-of-the-art results on image recognition tasks are achieved using over-parameterized learning algorithms that (nearly) perfectly fit the training set and are known to fit well even random labels. This tendency to memorize the labels of the training data is not explained by existing theoretical analyses. Memorization of the training data also presents significant privacy risks when the training data contains sensitive personal information and thus it is important to understand whether such memorization is necessary for accurate learning. We provide the first conceptual explanation and a theoretical model for this phenomenon. Specifically, we demonstrate that for natural data distributions memorization of labels is necessary for achieving close-to-optimal generalization error. Crucially, even labels of outliers and noisy labels need to be memorized. The model is motivated and supported by the results of several recent empirical works. In our model, data is sampled from a mixture of subpopulations and our results show that memorization is necessary whenever the distribution of subpopulation frequencies is long-tailed. Image and text data is known to be long-tailed and therefore our results establish a formal link between these empirical phenomena. Our results allow to quantify the cost of limiting memorization in learning and explain the disparate effects that privacy and model compression have on different subgroups.


title: Presence-Only Geographical Priors for Fine-Grained Image Classification

abstract: Appearance information alone is often not sufficient to accurately differentiate between fine-grained visual categories. Human experts make use of additional cues such as where, and when, a given image was taken in order to inform their final decision. This contextual information is readily available in many online image collections but has been underutilized by existing image classifiers that focus solely on making predictions based on the image contents. We propose an efficient spatio-temporal prior, that when conditioned on a geographical location and time, estimates the probability that a given object category occurs at that location. Our prior is trained from presence-only observation data and jointly models object categories, their spatio-temporal distributions, and photographer biases. Experiments performed on multiple challenging image classification datasets show that combining our prior with the predictions from image classifiers results in a large improvement in final classification performance.


title: Critical Point Finding with Newton-MR by Analogy to Computing Square Roots

abstract: Understanding of the behavior of algorithms for resolving the optimization problem (hereafter shortened to OP) of optimizing a differentiable loss function (OP1), is enhanced by knowledge of the critical points of that loss function, i.e. the points where the gradient is 0. Here, we describe a solution to the problem of finding critical points by proposing and solving three optimization problems: 1) minimizing the norm of the gradient (OP2), 2) minimizing the difference between the pre-conditioned update direction and the gradient (OP3), and 3) minimizing the norm of the gradient along the update direction (OP4). The result is a recently-introduced algorithm for optimizing invex functions, Newton-MR, which turns out to be highly effective at the problem of finding the critical points of the loss surfaces of neural networks. We precede this derivation with an analogous, but simpler, derivation of the nested-optimization algorithm for computing square roots by combining Heron's Method with Newton-Raphson division.


title: Efficient Exploration via State Marginal Matching

abstract: Exploration is critical to a reinforcement learning agent's performance in its given environment. Prior exploration methods are often based on using heuristic auxiliary predictions to guide policy behavior, lacking a mathematically-grounded objective with clear properties. In contrast, we recast exploration as a problem of State Marginal Matching (SMM), where we aim to learn a policy for which the state marginal distribution matches a given target state distribution. The target distribution is a uniform distribution in most cases, but can incorporate prior knowledge if available. In effect, SMM amortizes the cost of learning to explore in a given environment. The SMM objective can be viewed as a two-player, zero-sum game between a state density model and a parametric policy, an idea that we use to build an algorithm for optimizing the SMM objective. Using this formalism, we further demonstrate that prior work approximately maximizes the SMM objective, offering an explanation for the success of these methods. On both simulated and real-world tasks, we demonstrate that agents that directly optimize the SMM objective explore faster and adapt more quickly to new tasks as compared to prior exploration methods.


title: Keeping Notes: Conditional Natural Language Generation with a Scratchpad Mechanism

abstract: We introduce the Scratchpad Mechanism, a novel addition to the sequence-to-sequence (seq2seq) neural network architecture and demonstrate its effectiveness in improving the overall fluency of seq2seq models for natural language generation tasks. By enabling the decoder at each time step to write to all of the encoder output layers, Scratchpad can employ the encoder as a "scratchpad" memory to keep track of what has been generated so far and thereby guide future generation. We evaluate Scratchpad in the context of three well-studied natural language generation tasks --- Machine Translation, Question Generation, and Text Summarization --- and obtain state-of-the-art or comparable performance on standard datasets for each task. Qualitative assessments in the form of human judgements (question generation), attention visualization (MT), and sample output (summarization) provide further evidence of the ability of Scratchpad to generate fluent and expressive output.


title: Programming Technologies for the Development of Web-Based Platform for Digital Psychological Tools

abstract: The choice of the tools and programming technologies for information systems creation is relevant. For every projected system, it is necessary to define a number of criteria for development environment, used libraries and technologies. The paper describes the choice of technological solutions using the example of the developed web-based platform of the Russian Academy of Education. This platform is used to provide information support for the activities of psychologists in their research (including population and longitudinal researches). There are following system features: large scale and significant amount of developing time that needs implementation and ensuring the guaranteed computing reliability of a wide range of digital tools used in psychological research; ensuring functioning in different environments when conducting mass research in schools that have different characteristics of computing resources and communication channels; possibility of services scaling; security and privacy of data; use of technologies and programming tools that would ensure the compatibility and conversion of data with other tools of psychological research processing. Some criteria were introduced for the developed system. These criteria take into account the feature of the functioning and life cycle of the software. A specific example shows the selection of appropriate technological solutions.


title: A Combination of Temporal Sequence Learning and Data Description for Anomaly-based NIDS

abstract: Through continuous observation and modeling of normal behavior in networks, Anomaly-based Network Intrusion Detection System (A-NIDS) offers a way to find possible threats via deviation from the normal model. The analysis of network traffic based on the time series model has the advantage of exploiting the relationship between packages within network traffic and observing trends of behaviors over a period of time. It will generate new sequences with good features that support anomaly detection in network traffic and provide the ability to detect new attacks. Besides, an anomaly detection technique, which focuses on the normal data and aims to build a description of it, will be an effective technique for anomaly detection in imbalanced data. In this paper, we propose a combination model of Long Short Term Memory (LSTM) architecture for processing time series and a data description Support Vector Data Description (SVDD) for anomaly detection in A-NIDS to obtain the advantages of them. This model helps parameters in LSTM and SVDD are jointly trained with the joint optimization method. Our experimental results with KDD99 dataset show that the proposed combined model obtains high performance in intrusion detection, especially DoS and Probe attacks with 98.0% and 99.8%, respectively.


title: How the modified Bertrand theorem explains regularities of the periodic table I. From conformal invariance to Hopf mapping

abstract: Bertrand theorem permits closed orbits in 3d Euclidean space only for 2 types of central potentials. These are of Kepler-Coulomb and harmonic oscillator type. Volker Perlick recently extended Bertrand theorem. He designed new static spherically symmetric (Bertrand) spacetimes obeying Einsteins equations and supporting closed orbits. In this work we prove that the topology and geometry of these spacetimes permits to solve quantum many-body problem for any atom of periodic system exactly. The computations of spectrum for any atom of periodic system becomes analogous to that for hydrogen atom. Initially the exact solution of the Schr\"odinger equation for any multielectron atom was obtained by Tietz in 1956. However, neither himself nor others fully comprehended what actually was obtained. We recalculated Tietz results by applying the methodology consistent with new (different from that developed by Fock in 1936) way of solving Schro"odingers equation for hydrogen atom. In the light of this new result it had become possible to demonstrate rigorously that the Tietz-type Schro"odingers equation is in fact describing the quantum motion in Bertrand spacetime. As a bonus, we obtained the analytical proof of the Madelung rule defined in the text


title: Universality classes of surface wave turbulence as probed by laser Doppler velocimetry in viscous fluids

abstract: By taking advantage of laser Doppler velocimetry (LDV), we explore the existence of discrete wave cascades on fluid interfaces excited upon monochromatic excitation. We study viscous liquids of variable capillarity spanning a broad range of frictional stresses. The existence of an inertial regime of weak surface wave turbulence (weak-SWT) has been pointed out as a cascade of discrete modes with amplitudes compatible with universal Kolmogorov`s scaling. The transit from weak to strong surface turbulence has been explored with this tool revealing the importance of inertia over surface forces to describe the crossover.


title: Can we find steady-state solutions to multiscale rarefied gas flows within dozens of iterations?

abstract: One of the central problems in the study of rarefied gas dynamics is to find the steady-state solution of the Boltzmann equation quickly. When the Knudsen number is large, i.e. the system is highly rarefied, the conventional iteration scheme can lead to convergence within a few iterations. However, when the Knudsen number is small, i.e. the flow falls in the near-continuum regime, hundreds of thousands iterations are needed, and yet the "converged" solutions are prone to be contaminated by accumulated error and large numerical dissipation. Recently, based on the gas kinetic models, the implicit unified gas kinetic scheme (UGKS) and its variants have significantly reduced the iterations in the near-continuum flow regime, but still much higher than that of the highly rarefied gas flows. In this paper, we put forward a general synthetic iteration scheme (GSIS) to find the steady-state solutions of general rarefied gas flows within dozens of iterations at any Knudsen number. As the GSIS does not rely on the specific kinetic model/collision operator, it can be naturally extended to quickly find converged solutions for mixture flows and even flows involving chemical reactions. These two superior advantages are also expected to accelerate the slow convergence in simulation of near-continuum flows via the direct simulation Monte Carlo method and its low-variance version.


title: Remarks on screen integrable null hypersurfaces in Lorentzian manifolds

abstract: In the present paper, we show that the geometry of a screen integrable null hypersurface can be generated from an isometric immersion of a leaf of its screen distribution into the ambient space. We prove, under certain geometric conditions, that such immersions are contained in semi-Euclidean spheres or hyperbolic spaces, and the underlying null hypersurfaces are necessarily umbilic and screen totally umbilic. Where necessary, examples have been given to illustrate the main ideas.


title: The Correlative Method of Unsymmetrized Self-Consistent Field (CUSF)

abstract: In this work we describe the Correlative Method of Unsymmetrized Self-Consistent Field (CUSF). This method is based on a set of nonlinear integrodifferential equations for the one-particle configurational distribution functions and for the self-consistent potentials of the atoms. Here we present the fundamental concepts of the CUSF, the hypotheses of the method, the basic equations, the self-consistent potential, the thermodynamics of the anharmonic crystalline solids, and the quantum corrections in the quasi-classical approximation. Keywords: lattice theory and statistics; anharmonic crystals; thermodynamics.


title: Hackers vs. Security: Attack-Defence Trees as Asynchronous Multi-Agent Systems

abstract: Attack-Defence Trees (ADTs) are well-suited to assess possible attacks to systems and the efficiency of counter-measures. In this paper, we first enrich the available constructs with reactive patterns that cover further security scenarios, and equip all constructs with attributes such as time and cost to allow quantitative analyses. Then, ADTs are modelled as (an extension of) Asynchronous Multi-Agents Systems--EAMAS. The ADT-EAMAS transformation is performed in a systematic manner that ensures correctness. The transformation allows us to quantify the impact of different agents configurations on metrics such as attack time. Using EAMAS also permits parametric verification: we derive constraints for property satisfaction. Our approach is exercised on several case studies using the Uppaal and IMITATOR tools.


title: Image-Adaptive GAN based Reconstruction

abstract: In the recent years, there has been a significant improvement in the quality of samples produced by (deep) generative models such as variational auto-encoders and generative adversarial networks. However, the representation capabilities of these methods still do not capture the full distribution for complex classes of images, such as human faces. This deficiency has been clearly observed in previous works that use pre-trained generative models to solve imaging inverse problems. In this paper, we suggest to mitigate the limited representation capabilities of generators by making them image-adaptive and enforcing compliance of the restoration with the observations via back-projections. We empirically demonstrate the advantages of our proposed approach for image super-resolution and compressed sensing.


title: A model-independent characterisation of strong gravitational lensing by observables

abstract: When light from a distant source object, like a galaxy or a supernova, travels towards us, it is deflected by massive objects that lie on its path. When the mass density of the deflecting object exceeds a certain threshold, multiple, highly distorted images of the source are observed. This strong gravitational lensing effect has so far been treated as a model-fitting problem. Using the observed multiple images as constraints yields a self-consistent model of the deflecting mass density and the source object. As several models meet the constraints equally well, we develop a lens characterisation that separates data-based information from model assumptions. The observed multiple images allow us to determine local properties of the deflecting mass distribution on any mass scale from one simple set of equations. Their solution is unique and free of model-dependent degeneracies. The reconstruction of source objects can be performed completely model-independently, enabling us to study galaxy evolution without a lens-model bias. Our approach reduces the lens and source description to its data-based evidence that all models agree upon, simplifies an automated treatment of large datasets, and allows for an extrapolation to a global description resembling model-based descriptions.


title: Nambu-Goldstone Affleck-Dine Baryogenesis

abstract: The Affleck-Dine mechanism creates the baryon asymmetry of the universe from an angular motion of a complex scalar field. The mechanism is efficient and allows for a low reheating temperature of the universe if the scalar field has a flat potential along its radial direction. We consider a possibility where the scalar field is a pseudo-Nambu-Goldstone boson arising from spontaneous breaking of an approximate global symmetry, so that the flatness of the potential is naturally understood. We construct a concrete realization of the idea based on chiral symmetry breaking in an SU(N) gauge theory. The Peccei-Quinn mechanism can be consistently incorporated into the model. We also comment on a possible impact of the model on early universe physics.


title: A Correlated Search for Local Dwarf Galaxies in GALFA-HI and Pan-STARRS

abstract: In recent years, ultrafaint dwarf (UFD) galaxies have been found through systematic searches of large optical surveys. However, the existence of Leo T, a nearby gas-rich dwarf, suggests that there could be other nearby UFDs that are optically obscured but have gas detectable at nonoptical wavelengths. With this in mind, we perform a search of the full Galactic Arecibo $L-$band Feed Array HI (GALFA-HI) survey, a radio survey which covers one-third of the sky at velocities $-650 < V_{\rm{LSR}} < +650 \; \rm{km} \; \rm{s^{-1}}$, for neutral hydrogen sources. We are able to probe regions of the sky at lower Galactic latitudes and smaller $|V_{LSR}|$ compared to previous explorations. We use the Source Finding Application (SoFiA) on GALFA-HI and select all sources with similar properties to Leo T and other local dwarf galaxies. We find 690 dwarf galaxy candidates, one of which is particularly promising and likely a new galaxy near the Galactic plane ($b=-8^{\circ}$) that is comparable in velocity width and HI-flux to other recently discovered local volume galaxies. We find we are sensitive to Leo T-like objects out to $1 \; \rm{Mpc}$ at velocities clear from background HI emission. We check each candidate's corresponding optical fields from Pan-STARRS and fit stars drawn from isochrones, but find no evidence of stellar populations. We thus find no other Leo T-like dwarfs within $500 \; \rm{kpc}$ of the Milky Way in the one-third of the sky covered by the GALFA-HI footprint and discuss our nondetection in a cosmological context.


title: Binary neutron star mergers: Effects of spin and post-merger dynamics

abstract: Spin can have significant effects on the electromagnetic transients accompanying binary neutron star mergers. The measurement of spin can provide important information about binary formation channels. In the absence of a strong neutron star spin prior, the degeneracy of spin with other parameters leads to significant uncertainties in their estimation, in particular limiting the power of gravitational waves to place tight constraints on the nuclear equation of state. Thus detailed studies of highly spinning neutron star mergers are essential to understand all aspects of multimessenger observation of such events. We perform a systematic investigation of the impact of neutron star spin---considering dimensionless spin values up to $a_{\rm NS}=0.33$---on the merger of equal mass, quasicircular binary neutron stars using fully general-relativistic simulations. We find that the peak frequency of the post-merger gravitational wave signal is only weakly influenced by the neutron star spin, with cases where the spin is aligned (antialigned) with the orbital angular momentum giving slightly lower (higher) values compared to the irrotational case. We find that the one-arm instability arises in a number of cases, with some dependence on spin. Spin has a pronounced impact on the mass, velocity, and angular distribution of the dynamical ejecta, and the mass of the disk that remains outside the merger remnant. We discuss the implications of these findings on anticipated electromagnetic signals, and on constraints that have been placed on the equation of state based on multimessenger observations of GW170817.


title: Probing a Scalar Singlet-Catalyzed Electroweak Phase Transition with Resonant Di-Higgs Production in the $4b$ Channel

abstract: We investigate the prospective reach of the 14 TeV HL-LHC for resonant production of a heavy Higgs boson that decays to two SM-like Higgs bosons in the $4b$ final state in the scalar singlet extended Standard Model. We focus on the reach for choices of parameters yielding a strong first order electroweak phase transition. The event selection follows the $4b$ analysis by the ATLAS Collaboration, enhanced with the use of a boosted decision tree method to optimize the discrimination between signal and background events. The output of the multivariate discriminant is used directly in the statistical analysis. The prospective reach of the $4b$ channel is compatible with previous projections for the $bb\gamma\gamma$ and $4\tau$ channels for heavy Higgs boson mass $m_2$ below 500 GeV and superior to these channels for $m_2 > 500$ GeV. With 3 ab$^{-1}$ of integrated luminosity, it is possible to discover the heavy Higgs boson in the $4b$ channel for $m_2< 500$ GeV in regions of parameter space yielding a strong first order electroweak phase transition and satisfying all other phenomenological constraints.


title: Long-Lived Eccentricities in Accretion Disks

abstract: Accretion disks can be eccentric: they support $m=1$ modes that are global and slowly precessing. But whether the modes remain trapped in the disk---and hence are long-lived---depends on conditions at the outer edge of the disk. Here we show that in disks with realistic boundaries, in which the surface density drops rapidly beyond a given radius, eccentric modes are trapped and hence long-lived. We focus on pressure-only disks around a central mass, and show how this result can be understood with the help of a simple second-order WKB theory. We show that the longest lived mode is the zero-node mode in which all of the disk's elliptical streamlines are aligned, and that this mode decays coherently on the viscous timescale of the disk. Hence such a mode, once excited, will live for the lifetime of the disk. It may be responsible for asymmetries seen in recent images of protoplanetary disks.


title: Halo Meteors

abstract: The stellar halo contains some of the oldest stars in the Milky Way galaxy and in the universe. The detections of `Oumuamua, CNEOS 2014-01-08, and interstellar dust serve to calibrate the production rate of interstellar objects. We study the feasibility of a search for interstellar meteors with origins in the stellar halo. We find the mean heliocentric impact speed for halo meteors to be $\sim 270 \mathrm{\;km\;s^{-1}}$, and the standard deviation is $\sim 90 \mathrm{\;km\;s^{-1}}$, making the population kinematically distinct from all other meteors, which are an order-of-magnitude slower. We explore the expected abundance of halo meteors, finding that a network of all-sky cameras covering all land on Earth can take spectra and determine the orbits of a few hundred halo meteors larger than a few mm per year. The compositions of halo meteors would provide information on the characteristics of planetary system formation for the oldest stars. In addition, one could place tight constraints on baryonic dark matter objects of low masses.


title: Quantum Many-body Scars in a Landau Level on a Thin Torus

abstract: We study a kinetically constrained pair hopping model that arises within a Landau level in the quantum Hall effect. At filling $\nu = 1/3$, the model exactly maps onto the so-called "PXP model", a constrained model for the Rydberg atom chain that is numerically known to exhibit ETH-violating states in the middle of the spectrum or quantum many-body scars. Indeed, particular charge density wave configurations exhibit the same revivals seen in the PXP model. We generalize the mapping to fillings factors $\nu = p/(2p+1)$, and show that the model is equivalent to non-integrable spin-chains within particular constrained Krylov Hilbert spaces. These lead to new examples of quantum many-body scars which manifest as revivals and slow thermalization of particular charge density wave states. Finally, we investigate the stability of the quantum scars under certain Hamiltonian perturbations motivated by the fractional quantum Hall physics.


title: Mott quantum criticality in the one-band Hubbard model: Dynamical mean-field theory, power-law spectra, and scaling

abstract: Recent studies of electrical transport, both theoretical and experimental, near the bandwidth-tuned Mott metal-insulator transition have uncovered apparent quantum critical scaling of the electrical resistivity at elevated temperatures, despite the fact that the actual low-temperature phase transition is of first order. This raises the question whether there is a hidden Mott quantum critical point. Here we argue that the dynamical mean-field theory of the Hubbard model admits, in the low-temperature limit, asymptotically scale-invariant (i.e. power-law) solutions, corresponding to the metastable insulator at the boundary of metal-insulator coexistence region, which can be linked to the physics of the pseudogap Anderson model. While our state-of-the-art numerical renormalization group calculations reveal that this asymptotic regime is restricted to very small energies and temperatures and hence difficult to access numerically, we uncover the existence of a wide crossover regime where the single-particle spectrum displays a \emph{different} power law. We show that it is this power-law regime, corresponding to approximate local quantum criticality, which is continuously connected to and responsible for the apparent quantum critical scaling above the classical critical end point. We connect our findings to experiments on tunable Mott materials.


title: Partial Equilibration of the Anti-Pfaffian edge due to Majorana Disorder

abstract: We consider electrical and thermal equilibration of the edge modes of the Anti-Pfaffian quantum Hall state at $\nu=5/2$ due to tunneling of the Majorana edge mode to trapped Majorana zero modes in the bulk. Such tunneling breaks translational invariance and allows scattering between Majorana and other edge modes in such a way that there is a parametric difference between the length scales for equilibration of charge and heat transport between integer and Bose mode on the one hand, and for thermal equilibration of the Majorana edge mode on the other hand. We discuss a parameter regime in which this mechanism could explain the recent observation of quantized heat transport [Banerjee et all, Nature 559, 7713 (2018)].


title: Escape speed of stellar clusters from multiple-generation black-hole mergers in the upper mass gap

abstract: Pair instabilities in supernovae might prevent the formation of black holes with masses between $\sim 50 M_\odot$ and $\sim 130 M_\odot$. Multiple generations of black-hole mergers provide a possible way to populate this "mass gap" from below. However this requires an astrophysical environment with a sufficiently large escape speed to retain merger remnants, and prevent them from being ejected by gravitational-wave recoils. We show that, if the mass gap is indeed populated by multiple mergers, the observation of a single black-hole binary component in the mass gap implies that its progenitors grew in an environment with escape speed $v_{\rm esc} \gtrsim 50$ km/s. This is larger than the escape speeds of most globular clusters, requiring denser and heavier environments such as nuclear star clusters or disks-assisted migration in galactic nuclei. A single detection in the upper mass gap would hint at the existence of a much larger population of first-generation events from the same environment, thus providing a tool to disentangle the contribution of different formation channels to the observed merger rate.


title: Constraining the SMEFT with Bayesian reweighting

abstract: We illustrate how Bayesian reweighting can be used to incorporate the constraints provided by new measurements into a global Monte Carlo analysis of the Standard Model Effective Field Theory (SMEFT). This method, extensively applied to study the impact of new data on the parton distribution functions of the proton, is here validated by means of our recent SMEFiT analysis of the top quark sector. We show how, under well-defined conditions and for the SMEFT operators directly sensitive to the new data, the reweighting procedure is equivalent to a corresponding new fit. We quantify the amount of information added to the SMEFT parameter space by means of the Shannon entropy and of the Kolmogorov-Smirnov statistic. We investigate the dependence of our results upon the choice of either the NNPDF or the Giele-Keller expressions of the weights.


title: Variations in $\alpha$-element ratios trace the chemical evolution of the disk

abstract: It is well established that the chemical structure of the Milky Way exhibits a bimodality with respect to the $\alpha$-enhancement of stars at a given [Fe/H]. This has been studied largely based on a bulk $\alpha$ abundance, computed as a summary of several individual $\alpha$-elements. Inspired by the expected subtle differences in their nucleosynthetic origins, here we probe the higher level of granularity encoded in the inter-family [Mg/Si] abundance ratio. Using a large sample of stars with APOGEE abundance measurements, we first demonstrate that there is additional information in this ratio beyond what is already apparent in [$\alpha$/Fe] and [Fe/H] alone. We then consider Gaia astrometry and stellar age estimates to empirically characterize the relationships between [Mg/Si] and various stellar properties. We find small but significant trends between this ratio and $\alpha$-enhancement, age, [Fe/H], location in the Galaxy, and orbital actions. To connect these observed [Mg/Si] variations to a physical origin, we attempt to predict the Mg and Si abundances of stars with the galactic chemical evolution model Chempy. We find that we are unable to reproduce abundances for the stars that we fit, which highlights tensions between the yield tables, the chemical evolution model, and the data. We conclude that a more data-driven approach to nucleosynthetic yield tables and chemical evolution modeling is necessary to maximize insights from large spectroscopic surveys.


title: Signatures of stellar accretion in MaNGA early-type galaxies

abstract: The late assembly of massive galaxies is thought to be dominated by stellar accretion in their outskirts (beyond 2 effective radii Re) due to dry, minor galaxy mergers. We use observations of 1010 passive early-type galaxies (ETGs) within z<0.15 from SDSS IV MaNGA to search for evidence of this accretion. The outputs from the stellar population fitting codes FIREFLY, pPXF, and Prospector are compared to control for systematic errors in stellar metallicity (Z) estimation. We find that the average radial logZ/Zsun profiles of ETGs in various stellar mass (M) bins are not linear. As a result, these profiles are poorly characterized by a single gradient value, explaining why weak trends reported in previous work can be difficult to interpret. Instead, we examine the full radial extent of stellar metallicity profiles and find them to flatten in the outskirts of M>10^{11}Msun ETGs. This is a signature of stellar accretion. Based on a toy model for stellar metallicity profiles, we infer the ex-situ stellar mass fraction in ETGs as a function of M and galactocentric radius. We find that ex-situ stars at 2Re make up 20% of the projected stellar mass of M<10^{10.5}Msun ETGs, rising up to 80% for M>10^{11.5}Msun ETGs.


title: Ignorance is Cheap: From Black Hole Entropy To Energy-Minimizing States In QFT

abstract: Behind certain marginally trapped surfaces one can construct a geometry containing an extremal surface of equal, but not larger area. This construction underlies the Engelhardt-Wall proposal for explaining Bekenstein-Hawking entropy as a coarse-grained entropy. The construction can be proven to exist classically but fails if the Null Energy Condition is violated. Here we extend the coarse-graining construction to semiclassical gravity. Its validity is conjectural, but we are able to extract an interesting nongravitational limit. Our proposal implies Wall's ant conjecture on the minimum energy of a completion of a quantum field theory state on a half-space. It further constrains the properties of the minimum energy state; for example, the minimum completion energy must be localized as a shock at the cut. We verify that the predicted properties hold in a recent explicit construction of Ceyhan and Faulkner, which proves our conjecture in the nongravitational limit.


title: Primordial dark matter halos from fifth forces

abstract: We argue that primordial dark matter halos could be generated during radiation domination by long range attractive forces stronger than gravity. In this paper we derive the conditions under which these structures could dominate the dark matter content of the Universe while passing microlensing constraints and cosmic microwave background energy injection bounds. The dark matter particles would be clumped in objects in the solar mass range with typical sizes of the order of the solar system. Consequences for direct dark matter searches are important.


title: Learning Curves for Deep Neural Networks: A Gaussian Field Theory Perspective

abstract: In the past decade, deep neural networks (DNNs) came to the fore as the leading machine learning algorithms for a variety of tasks. Their raise was founded on market needs and engineering craftsmanship, the latter based more on trial and error than on theory. While still far behind the application forefront, the theoretical study of DNNs has recently made important advancements in analyzing the highly over-parameterized regime where some exact results have been obtained. Leveraging these ideas and adopting a more physics-like approach, here we construct a versatile field-theory formalism for supervised deep learning, involving renormalization group, Feynman diagrams and replicas. In particular we show that our approach leads to highly accurate predictions of learning curves of truly deep DNNs trained on polynomial regression tasks and that these predictions can be used for efficient hyper-parameter optimization. In addition, they explain how DNNs generalize well despite being highly over-parameterized, this due to an entropic bias to simple functions which, for the case of fully-connected DNNs with data sampled on the hypersphere, are low order polynomials in the input vector. Being a complex interacting system of artificial neurons, we believe that such tools and methodologies borrowed from condensed matter physics would prove essential for obtaining an accurate quantitative understanding of deep learning.

categories: cs.LG cond-mat.stat-mech cs.NE physics.data-an stat.ML


title: High energy neutrino flux from individual blazar flares

abstract: Motivated by the recently reported evidence of an association between a high-energy neutrino and a gamma-ray flare from the blazar TXS 0506+056, we calculate the expected high-energy neutrino signal from past, individual flares, from twelve blazars, selected in declinations favourable for detection with IceCube. To keep the number of free parameters to a minimum, we mainly focus on BL Lac objects and assume the synchrotron self-Compton mechanism produces the bulk of the high-energy emission. We consider a broad range of the allowed parameter space for the efficiency of proton acceleration, the proton content of BL Lac jets, and the presence of external photon fields. To model the expected neutrino fluence we use simultaneous multi-wavelength observations. We find that in the absence of external photon fields and with jet proton luminosity normalised to match the observed production rate of ultra-high-energy cosmic rays, individual flaring sources produce a modest neutrino flux in IceCube, $\lesssim10^{-3}$ muon neutrinos with energy exceeding 100 TeV, stacking ten years of flare periods selected in the >800 MeV Fermi energy range from each source. Under optimistic assumptions about the jet proton luminosity and in the presence of external photon fields, we find that the two most powerful sources in our sample, AO 0235+164, and OJ 287, would produce, in total, $\approx 3$ muon neutrinos during ten years of Fermi flaring periods, in future neutrino detectors with total instrumented volume $\sim$ten times larger than IceCube,or otherwise, constrain the proton luminosity of blazar jets.


title: Calculations for deep inelastic scattering using fast interpolation grid techniques at NNLO in QCD and the extraction of $\alpha_s$ from HERA data

abstract: The extension of interpolation-grid frameworks for perturbative QCD calculations at next-to-next-to-leading order (NNLO) is presented for deep inelastic scattering (DIS) processes. A fast and flexible evaluation of higher-order predictions for any a posteriori choice of parton distribution functions (PDFs) or value of the strong coupling constant is essential in iterative fitting procedures to extract PDFs and Standard Model parameters as well as for a detailed study of the scale dependence. The APPLfast project, described here, provides a generic interface between the parton-level Monte Carlo program NNLOJET and both the APPLgrid and fastNLO libraries for the production of interpolation grids at NNLO accuracy. Details of the interface for DIS processes are presented together with the required interpolation grids at NNLO, which are made available. They cover numerous inclusive jet measurements by the H1 and ZEUS experiments at HERA. An extraction of the strong coupling constant is performed as an application of the use of such grids and a best-fit value of $\alpha_s(M_Z) = 0.1178\,(15)_\text{exp}\,(21)_\text{th}$ is obtained using the HERA inclusive jet cross section data.


title: Probing the shape of the mixing profile and of the thermal structure at the convective core boundary through asteroseismology

abstract: Aims: We investigate from a theoretical perspective if space asteroseismology can be used to distinguish between different thermal structures and shapes of the near-core mixing profiles for different types of coherent oscillation modes in massive stars with convective cores, and if this capacity depends on the evolutionary stage of the models along the main sequence. Methods: We compute 1D stellar structure and evolution models for four different prescriptions of the mixing and temperature gradient in the near-core region. Their effect on the frequencies of dipole prograde gravity modes in both Slowly Pulsating B and $\beta$ Cep stars is investigated, as well as for pressure modes in $\beta$ Cep stars. Results: A comparison between the mode frequencies of the different models at various stages during the main sequence evolution reveals that they are more sensitive to a change in temperature gradient than to the exact shape of the mixing profile in the near-core region. Depending on the duration of the observed light curve, one can distinguish between either just the temperature gradient, or also between the shapes of the mixing coefficient. The relative frequency differences are in general larger for more evolved models, and are largest for the higher-frequency pressure modes in $\beta$ Cep stars. Conclusions:In order to unravel the core boundary mixing and thermal structure of the near-core region, one must have asteroseismic masses and radii with $\sim 1\%$ relative precision for hundreds of stars.


title: $20'$ Five-Point Function from $AdS_5\times S^5$ Supergravity

abstract: We develop new techniques to compute five-point correlation functions from IIB supergravity on $AdS_5\times S^5$. Our methods rely entirely on symmetry and general consistency conditions, and eschew detailed knowledge of the supergravity effective action. We demonstrate our methods by computing the five-point function of the $\mathbf{20'}$ operator, which is the superconformal primary of the stress tensor multiplet. We also develop systematic methods to compute the five-point conformal blocks in series expansions. Using the explicit expressions of the conformal blocks, we perform a Euclidean OPE analysis of the $\mathbf{20'}$ five-point function. We find expected agreement with non-renormalized quantities and also extract new CFT data at strong coupling.


title: Order parameter dynamics of the non-linear sigma model in the large $N$ limit

abstract: We study non-equilibrium order parameter dynamics of the non-linear sigma model in the large $N$ limit, using Keldysh formalism. We provide a scheme for obtaining stable numerical solutions of the Keldysh saddle point equations, and use them to study the order parameter dynamics of the model either following a ramp, or in the presence of a periodic drive. We find that the transient dynamics of the order parameter in the presence of a periodic drive is controlled by the drive frequency displaying the phenomenon of synchronization. We also study the approach of the order parameter to its steady state value following a ramp and find out the effective temperature of the steady state. We chart out the steady state temperature of the ordered phase as a function of ramp time and amplitude, and discuss the relation of our results to experimentally realizable spin models.


title: Universal shift of the fidelity susceptibility peak away from the critical point of the Berezinskii-Kosterlitz-Thouless quantum phase transition

abstract: We show that the peak which can be observed in fidelity susceptibility around the Berezinskii-Kosterlitz-Thouless transition is shifted from the quantum critical point (QCP) at $J_c$ to $J^*$ in the gapped phase by a value $|J^* - J_c| = B^2/36$, where $B^2$ is a transition width controlling the asymptotic form of the correlation length $\xi \sim \exp(-B/\sqrt{|J-J_c|})$ in that phase. This is in contrast to the conventional continuous QCP where the maximum is an indicator of the position of the critical point. The shape of the peak is universal, emphasizing the close connection between fidelity susceptibility and the correlation length. We support those arguments with numerical matrix product state simulations of the one-dimensional Bose-Hubbard model in the thermodynamic limit, where the broad peak is located at $J^*=0.212$ that is significantly different from $J_c=0.3048(3)$. In the spin-$3/2$ XXZ model the shift from $J_c=1$ to $J^*=1.0021$ is small but the narrow universal peak is much more pronounced over the non-universal background.


title: ALMA and HST kiloparsec-scale imaging of a quasar-galaxy merger at $z\approx 6.2$

abstract: We present kpc-scale ALMA and HST imaging of the quasar PJ308-21 at $z$=$6.2342$, tracing dust, gas (via the [CII] 158 $\mu$m line) and young stars. At a resolution of $\sim0.3''$ ($\approx1.7$ kpc), the system is resolved over $>4''$ ($>$20 kpc). In particular, it features a main component, identified to be the quasar host galaxy, centered on the accreting supermassive black hole; and two other extended components on the West and East side, one redshifted and the other blueshifted relative to the quasar. The [CII] emission of the entire system stretches over $>$1500 km/s along the line of sight. All the components of the system are observed in dust, [CII], and rest-frame UV emission. The inferred [CII] luminosities [(0.9-4.6)$\times 10^9$ L$_\odot$], dust luminosities [(0.15-2.6)$\times10^{12}$ L$_\odot$], and rest-frame UV luminosities [(6.6-15)$\times10^{10}$ L$_\odot$], their ratios, and the implied gas/dust masses and star formation rates [11-290 M$_\odot$ yr$^{-1}$] are typical of high-redshift star-forming galaxies. A toy model of a single satellite galaxy that is tidally stripped by the interaction with the quasar host galaxy can account for the observed velocity and spatial extent of the two extended components. An outflow interpretation of the unique features in PJ308-21 is not supported by the data. PJ308-21 is thus one of the earliest galaxy mergers imaged at cosmic dawn.


title: The Orbital Lense-Thirring Precession in a Strong Field

abstract: We study the exact evolution of the orbital angular momentum of a massive particle in the gravitational field of a Kerr black hole. We show analytically that, for a wide class of orbits, the angular momentum's hodograph is always close to a circle. This applies to both bounded and unbounded orbits that do not end up in the black hole. Deviations from the circular shape do not exceed $\approx10\%$ and $\approx7\%$ for bounded and unbounded orbits, respectively. We also find that nutation provides an accurate approximation for those deviations, which fits the exact curve within $\sim 0.01\%$ for the orbits of maximal deviation. Remarkably, the more the deviation, the better the nutation approximates it. Thus, we demonstrate that the orbital Lense-Thirring precession, originally obtained in the weak-field limit, is also a valid description in the general case of (almost) arbitrary exact orbits. As a by-product, we also derive the parameters of unstable spherical timelike orbits as a function of their radii and arbitrary rotation parameter $a$ and Carter's constant $Q$. We verify our results numerically for all the kinds of orbits studied.


title: Liouville description of conical defects in dS$_4$, Gibbons-Hawking entropy as modular entropy, and dS$_3$ holography

abstract: We model the back-reaction of a static observer in four-dimensional de Sitter spacetime by means of a singular $\mathbb Z_q$ quotient. The set of fixed points of the $\mathbb Z_q$ action consists of a pair of codimension two minimal surfaces given by 2-spheres in the Euclidean geometry. The introduction of an orbifold parameter $q>1$ permits the construction of an effective action for the bulk gravity theory with support on each of these minimal surfaces. The effective action corresponds to that of Liouville field theory on a 2-sphere with a finite vacuum expectation value of the Liouville field. The intrinsic Liouville theory description yields a thermal Cardy entropy that we reintrepret as a modular free energy at temperature $T=q^{-1}$, whereupon the Gibbons--Hawking entropy arises as the corresponding modular entropy. We further observe that in the limit $q\to\infty$ the four-dimensional geometry reduces to that of global dS$_3$ spacetime, where the two original minimal surfaces can be mapped to the future and past infinities of dS$_3$ by means of a double Wick rotation. In this limit, the Liouville theories on the minimal surfaces become boundary theories at zero temperature whose total central charge equals that computed using the dS$_3$/CFT$_2$ correspondence.


title: The energetics of starburst-driven outflows at z=1 from KMOS

abstract: We present an analysis of the gas outflow energetics of 529 main-sequence star-forming galaxies at z~1 using KMOS observations of the broad, underlying H-alpha and forbidden lines of [N II] and [S II]. Based on the stacked spectra for a sample with median star-formation rates and stellar masses of SFR ~ 7 Mo/yr and M* = (1.0+/-0.1)x10^10 Mo respectively, we derive a typical mass outflow rate of dM/dt = 1-4 Mo/yr and a mass loading of dM/dt/SFR = 0.2--0.4. The mass loading of the wind does not show a strong trend with star-formation rate over the range SFR ~ 2--20 Mo/yr, although we identify a trend with stellar mass such that dM/dt/SFR ~ M*^(0.26+/-0.07). Finally, we find that the line width of the broad H-alpha increases with disk circular velocity with a sub-linear scaling relation FWHM_broad ~ v^(0.21+/-0.05). As a result of this behavior, in the lowest mass galaxies (M* < 10^10 Mo), a significant fraction of the outflowing gas should have sufficient velocity to escape the gravitational potential of the halo whilst in the highest mass galaxies (M* > 10^10 Mo) most of the gas will be retained, flowing back on to the galaxy disk at later times.


title: Towards the nucleon hadronic tensor from lattice QCD

abstract: We present the first calculation of the hadronic tensor on the lattice for the nucleon. The hadronic tensor can be used to extract the structure functions in deep inelastic scatterings and also provide information for the neutrino-nucleon scattering which is crucial to the neutrino-nucleus scattering experiments at low energies. The most challenging part in the calculation is to solve an inverse problem. We have implemented and tested three algorithms using mock data, showing that the Bayesian Reconstruction method has the best resolution in extracting peak structures while the Backus-Gilbert and Maximum Entropy methods are somewhat more stable for the flat spectral function. Numerical results are presented for both the elastic case (clover fermions on domain wall configuration with $m_\pi\sim$ 370 MeV and $a\sim$ 0.06 fm) and a case (anisotropic clover lattice with $m_\pi\sim$ 380 MeV and $a_t\sim$ 0.035 fm) with large momentum transfer. For the former case, the reconstructed Minkowski hadronic tensor gives precisely the vector charge which proves the feasibility of the approach. While for the latter case, the nucleon resonances and possibly shallow inelastic scattering contributions around $\nu=1$ GeV are clearly observed but no information is obtained for higher excited states with $\nu>2$ GeV. A check of the effective masses of $\rho$ meson with different lattice setups indicates that, in order to reach higher energy transfers, using lattices with smaller lattice spacings is essential.


title: CR Singularities and Generalizations of Moser's Theorem II

abstract: Let a real-analytic manifold $M$ formally (holomorphically) equivalent to the following model \begin{equation*}w=z_{1}\overline{z}_{1}+\dots+z_{N}\overline{z}_{N}+\lambda_{1}\left(z_{1}^{2}+\overline{z}_{1}^{2}\right)+\dots+\lambda_{N}\left(z_{N}^{2}+\overline{z}_{N}^{2}\right),{equation*} assuming that $$ \lambda_{1},\dots, \lambda_{N}\in \left[0,\frac{1}{2}\right).$$ It is proven that $M$ is holomorphically equivalent to this model by developing a partial normal form for such real-analytic submanifold using generalized Fischer Decompositions. In particular, there are defined certain Spaces of Normalizations used also in proving other analogues of The Theorem of Moser in certain non-equidimensional situations. There presented also other applications for the methods considered.


title: Quantum imaging using relativistic detectors

abstract: Imaging in quantum optics (QO) is usually formulated in the languages of quantum mechanics and Fourier optics. While relatively advanced fields, notions such as different reference frames and the degradation of entanglement due to acceleration do not usually feature. Here we propose the idea of using so-called Unruh-DeWitt (UDW) detectors to model the imaging process in QO. In particular, we first present a quantum field theory version of a state describing Spontaneous Parametric Down Conversion (SPDC), one of the principal processes employed to create entangled photons in the laboratory. This state, coupled to UDW detectors, is used to investigate a single-pixel ghost image under both inertial and non-inertial settings, and a two-pixel image under inertial conditions. The reconstructed images obtained for various possible inputs can be distinguished better than a pure guess, hence the formalism can be used to describe imaging between non-inertial frames. We briefly consider the origin of the correlations between the UDW detectors, which don't appear to arise from the usual notion of entanglement. Finally, we find that the contrast between the possible outcomes in the single-pixel case follows a curious coupling time dependent behaviour.


title: Emergent de Sitter epoch of the Loop Quantum Cosmos: a detailed analysis

abstract: We present a detailed analysis of a quantum model for Loop Quantum Cosmology based on strict application of the Thiemann regularization algorithm for the Hamiltonian in Loop Quantum Gravity, extending the results presented previously in our brief report. This construction leads to a qualitative modification of the bounce paradigm. Quantum gravity effects still lead to a quantum bounce connecting deterministically large classical Universes. However, the evolution features a large epoch of de Sitter Universe, with emergent cosmological constant of Planckian order, smoothly transiting into a spatially flat expanding Universe. Moreover, we present an effective Hamiltonian describing the quantum evolution to high accuracy and for which the dynamics can be solved analytically.


title: Matrix Mittag--Leffler distributions and modeling heavy-tailed risks

abstract: In this paper we define the class of matrix Mittag-Leffler distributions and study some of its properties. We show that it can be interpreted as a particular case of an inhomogeneous phase-type distribution with random scaling factor, and alternatively also as the absorption time of a semi-Markov process with Mittag-Leffler distributed interarrival times. We then identify this class and its power transforms as a remarkably parsimonious and versatile family for the modelling of heavy-tailed risks, which overcomes some disadvantages of other approaches like the problem of threshold selection in extreme value theory. We illustrate this point both on simulated data as well as on a set of real-life MTPL insurance data that were modeled differently in the past.


title: COMET: Commonsense Transformers for Automatic Knowledge Graph Construction

abstract: We present the first comprehensive study on automatic knowledge base construction for two prevalent commonsense knowledge graphs: ATOMIC (Sap et al., 2019) and ConceptNet (Speer et al., 2017). Contrary to many conventional KBs that store knowledge with canonical templates, commonsense KBs only store loosely structured open-text descriptions of knowledge. We posit that an important step toward automatic commonsense completion is the development of generative models of commonsense knowledge, and propose COMmonsEnse Transformers (COMET) that learn to generate rich and diverse commonsense descriptions in natural language. Despite the challenges of commonsense modeling, our investigation reveals promising results when implicit knowledge from deep pre-trained language models is transferred to generate explicit knowledge in commonsense knowledge graphs. Empirical results demonstrate that COMET is able to generate novel knowledge that humans rate as high quality, with up to 77.5% (ATOMIC) and 91.7% (ConceptNet) precision at top 1, which approaches human performance for these resources. Our findings suggest that using generative commonsense models for automatic commonsense KB completion could soon be a plausible alternative to extractive methods.


title: On the group of infinite $p$-adic matrices with integer elements

abstract: Let $G$ be an infinite-dimensional real classical group containing the complete unitary group (or complete orthogonal group) as a subgroup. Then $G$ generates a category of double cosets (train) and any unitary representation of $G$ can be canonically extended to the train. We prove a technical lemma about the complete group $GL$ of infinite $p$-adic matrices with integer coefficients, this lemma implies that the phenomenon of automatic extension of unitary representations to trains is valid for infinite-dimensional $p$-adic groups.


title: Fundamental mechanisms of hBN growth by MOVPE

abstract: Hexagonal boron nitride is a promising material for many applications ranging from deep UV emission to an ideal substrate for other two dimensional crystals. Although efforts towards the growth of wafer-scale, high quality material strongly increased in recent years, the understanding of the actual growth mechanism still remains fragmentary and premature. Here, we unveil fundamental growth mechanisms by investigating the growth of hBN by metalorganic vapor phase epitaxy (MOVPE) in a wide range of growth conditions. The obtained results contradict the widespread opinion about the importance of parasitic gas-phase reactions decreasing the growth efficiency. Two different growth mechanisms that depend on ammonia flow and reactor pressure can be distinguished. Both mechanisms are effective in the case of polycrystalline growth, but the growth of highly ordered, flat layers, is strongly hindered. The problem is caused by a low efficiency of boron chemisorption on N-terminated edges of sp2-BN sheets forming the atomic steps on the surface of the layer. Two-dimensional growth can be activated and sustained by the flow modulation epitaxy (FME) method, an alternate switching of ammonia and TEB flows. The success of the FME method is explained in terms of periodic changes between N- and B-terminated reconstructions at the edges of sp2- BN sheets, which restore boron chemisorption. The presented results identify the fundamental growth mechanisms, which is the prerequisite for any further deterministic development of efficient, high-quality, large-scale hBN growth with MOVPE.


title: Statistical stellar mass corrections for high-z galaxies observed with JWST broad-band filters due to template degeneracies

abstract: Stellar masses in future James Webb Space Telescope (JWST) deep blank-fields will be mainly derived fitting the spectral energy distribution with theoretical galaxy templates. We investigate the uncertainties and biases of the stellar masses derived by using the LePhare code for spectral energy distribution fitting and the Yggdrasil theoretical templates. We consider a sample of mock galaxies at z$=$7-10 with mock JWST observations with S/N$_{F150W}\geqslant$ 10. Our goal is to provide a list of statistical stellar mass corrections to include on the stellar mass derivation for different output galaxy properties and JWST filter combinations to correct for template degeneracies. Median statistical stellar mass corrections vary from -0.83 dex to 0.87 dex, while 25$\%$ (75$\%$) quartiles range from -0.83 dex (-0.67 dex) to 0.51 dex (0.88 dex), depending on filter combinations and galaxy models. The most challenging cases are galaxies with nebular emission lines, especially the ones that are wrongly identified as galaxies without, relative dust-free galaxies and galaxies with small metallicities (i.e. Z$=1/50Z_{\odot}$). The stellar mass estimation of galaxies correctly identified without emission lines is generally fine, except at z$=$10 when considering only the 8 NIRCam bands, which make the MIRI bands very valuable. We have tested our stellar mass corrections using the public JAGUAR galaxy catalogue, deriving that the average discrepancy in the recovered stellar mass distribution decreases by 20-50$\%$ at z$>$7 after the correction. We found that without the stellar-mass corrections the number of low-mass galaxies (M$^{*}<10^{7}M_{\odot}$) is overestimated, which can potentially lead to systematic errors in the calculation of the galaxy stellar mass function faint-end slope at high z.


title: All-Multiplicity One-Loop Amplitudes in Born-Infeld Electrodynamics from Generalized Unitarity

abstract: We initiate a study of non-supersymmetric Born-Infeld electrodynamics in 4d at the quantum level. Explicit all-multiplicity expressions are calculated for the purely rational one-loop amplitudes in the self-dual ($++\ldots+$) and next-to-self-dual ($-+\ldots+$) helicity sectors. Using a supersymmetric decomposition, $d$-dimensional unitarity cuts of the integrand factorize into tree-amplitudes in a 4d model of Born-Infeld photons coupled to a massive complex scalar. The two-scalar tree-amplitudes needed to construct the Born-Infeld integrand are computed using two complimentary approaches: (1) as a double-copy of Yang-Mills coupled to a massive adjoint scalar with a dimensionally reduced form of Chiral Perturbation Theory, and (2) by imposing consistency with low-energy theorems under a reduction from 4d to 3d and T-duality. The Born-Infeld integrand is integrated in $d=4-2\epsilon$ dimensions at order $\mathcal{O}(\epsilon^0)$ using the dimension-shifting formalism. We comment on the implications for electromagnetic duality in quantum Born-Infeld theory.


title: Thermally induced band gap increase and high thermoelectric figure of merit of n-type PbTe

abstract: Unlike in many other semiconductors, the band gap of PbTe increases considerably with temperature. We compute the thermoelectric transport properties of n-type PbTe from first principles including the temperature variation of the electronic band structure. The calculated temperature dependence of the thermoelectric quantities of PbTe is in good agreement with previous experiments when the temperature changes of the band structure are accounted for. We also calculate the optimum band gap values which would maximize the thermoelectric figure of merit of n-type PbTe at various temperatures. We show that the actual gap values in PbTe closely follow the optimum ones between 300 K and 900 K, resulting in the high figure of merit. Our results indicate that an appreciable increase of the band gap with temperature in direct narrow-gap semiconductors is very beneficial for achieving high thermoelectric performance.


title: Specifying Weight Priors in Bayesian Deep Neural Networks with Empirical Bayes

abstract: Stochastic variational inference for Bayesian deep neural network (DNN) requires specifying priors and approximate posterior distributions over neural network weights. Specifying meaningful weight priors is a challenging problem, particularly for scaling variational inference to deeper architectures involving high dimensional weight space. We propose MOdel Priors with Empirical Bayes using DNN (MOPED) method to choose informed weight priors in Bayesian neural networks. We formulate a two-stage hierarchical modeling, first find the maximum likelihood estimates of weights with DNN, and then set the weight priors using empirical Bayes approach to infer the posterior with variational inference. We empirically evaluate the proposed approach on real-world tasks including image classification, video activity recognition and audio classification with varying complex neural network architectures. We also evaluate our proposed approach on diabetic retinopathy diagnosis task and benchmark with the state-of-the-art Bayesian deep learning techniques. We demonstrate MOPED method enables scalable variational inference and provides reliable uncertainty quantification.


title: Degree-d-invariant laminations

abstract: Degree-$d$-invariant laminations of the disk model the dynamical action of a degree-$d$ polynomial; such a lamination defines an equivalence relation on $S^1$ that corresponds to dynamical rays of an associated polynomial landing at the same multi-accessible points in the Julia set. Primitive majors are certain subsets of degree-$d$-invariant laminations consisting of critical leaves and gaps. The space $\textrm{PM}(d)$ of primitive degree-$d$ majors is a spine for the set of monic degree-$d$ polynomials with distinct roots and serves as a parameterization of a subset of the boundary of the connectedness locus for degree-$d$ polynomials. The core entropy of a postcritically finite polynomial is the topological entropy of the action of the polynomial on the associated Hubbard tree. Core entropy may be computed directly, bypassing the Hubbard tree, using a combinatorial analogue of the Hubbard tree within the context of degree-$d$-invariant laminations.


title: Transfer conditions and transmission bias in capillaries of vacuum interfaces

abstract: A detailed study of the transfer of ions in transfer capillaries of electrospray ion sources is presented. The laminar flow field for various capillary sizes and wall temperatures is calculated. It forms the base of ion transfer simulation of a large number of ions with space charge. This allows to study the thermodynamical conditions of the ions during transfer, which are found to vary strongly with the capillary dimensions. The dependence of mass flow and ion current on the size of the capillary is presented. Simple scaling relations are derived and tested. The method also allows to predict a transfer bias between different ion species depending on the difference in ion mobility and the composition of transferred ions.


title: Magnetism and superconductivity in Fe$_{1+y}$Te$_{1-x}$Se$_x$

abstract: Neutron scattering has played a significant role in characterizing magnetic and structural correlations in Fe$_{1+y}$Te$_{1-x}$Se$_x$ and their connections with superconductivity. Here we review several key aspects of the physics of iron chalcogenide superconductors where neutron studies played a key role. These topics include the phase diagram of Fe$_{1+y}$Te$_{1-x}$Se$_{x}$, where the doping-dependence of structural transitions can be understood from a mapping to the anisotropic random field Ising model. We then discuss orbital-selective Mott physics in the Fe chalcogenide series, where temperature-dependent magnetism in the parent material provided one of the earliest cases for orbital-selective correlation effects in a Hund's metal. Finally, we elaborate on the character of local magnetic correlations revealed by neutron scattering, its dependence on temperature and composition, and the connections to nematicity and superconductivity.


title: Neural Network Models for Stock Selection Based on Fundamental Analysis

abstract: Application of neural network architectures for financial prediction has been actively studied in recent years. This paper presents a comparative study that investigates and compares feed-forward neural network (FNN) and adaptive neural fuzzy inference system (ANFIS) on stock prediction using fundamental financial ratios. The study is designed to evaluate the performance of each architecture based on the relative return of the selected portfolios with respect to the benchmark stock index. The results show that both architectures possess the ability to separate winners and losers from a sample universe of stocks, and the selected portfolios outperform the benchmark. Our study argues that FNN shows superior performance over ANFIS.


title: Quenched and averaged large deviation rate functions for random walks in random environments: the impact of disorder

abstract: In 2003, Varadhan [V03] developed a robust method for proving quenched and averaged large deviations for random walks in a uniformly elliptic and i.i.d. environment (RWRE) on $\mathbb Z^d$. One fundamental question which remained open was to determine when the quenched and averaged large deviation rate functions agree, and when they do not. In this article we show that for RWRE in uniformly elliptic and i.i.d. environment in $d\geq 4$, the two rate functions agree on any compact set contained in the interior of their domain which does not contain the origin, provided that the disorder of the environment is sufficiently low. Our result provides a new formulation which encompasses a set of sufficient conditions under which these rate functions agree without assuming that the RWRE is ballistic (see [Y11]), satisfies a CLT or even a law of large numbers ([Zer02,Ber08]). Also, the equality of rate functions is not restricted to neighborhoods around given points, as long as the disorder of the environment is kept low. One of the novelties of our approach is the introduction of an auxiliary random walk in a deterministic environment which is itself ballistic (regardless of the actual RWRE behavior) and whose large deviation properties approximate those of the original RWRE in a robust manner, even if the original RWRE is not ballistic itself.


title: Sub-Goal Trees -- a Framework for Goal-Directed Trajectory Prediction and Optimization

abstract: Many AI problems, in robotics and other domains, are goal-directed, essentially seeking a trajectory leading to some goal state. In such problems, the way we choose to represent a trajectory underlies algorithms for trajectory prediction and optimization. Interestingly, most all prior work in imitation and reinforcement learning builds on a sequential trajectory representation -- calculating the next state in the trajectory given its predecessors. We propose a different perspective: a goal-conditioned trajectory can be represented by first selecting an intermediate state between start and goal, partitioning the trajectory into two. Then, recursively, predicting intermediate points on each sub-segment, until a complete trajectory is obtained. We call this representation a sub-goal tree, and building on it, we develop new methods for trajectory prediction, learning, and optimization. We show that in a supervised learning setting, sub-goal trees better account for trajectory variability, and can predict trajectories exponentially faster at test time by leveraging a concurrent computation. Then, for optimization, we derive a new dynamic programming equation for sub-goal trees, and use it to develop new planning and reinforcement learning algorithms. These algorithms, which are not based on the standard Bellman equation, naturally account for hierarchical sub-goal structure in a task. Empirical results on motion planning domains show that the sub-goal tree framework significantly improves both accuracy and prediction time.


title: Pairwise Fairness for Ranking and Regression

abstract: We present pairwise fairness metrics for ranking models and regression models that form analogues of statistical fairness notions such as equal opportunity, equal accuracy, and statistical parity. Our pairwise formulation supports both discrete protected groups, and continuous protected attributes. We show that the resulting training problems can be efficiently and effectively solved using existing constrained optimization and robust optimization techniques developed for fair classification. Experiments illustrate the broad applicability and trade-offs of these methods.


title: Twin-beam sub-shot-noise raster-scanning microscope with a hybrid detection scheme

abstract: By exploiting the quantised nature of light, we demonstrate a sub-shot-noise scanning optical transmittance microscope. Our microscope demonstrates, with micron scale resolution, a factor of improvement in precision of 1.76(9) in transmittance estimation gained per probe photon relative to an optimal classical version at the same optical power. This would allow us to observe photosensitive samples with nearly twice the precision,without sacrificing image resolution or increasing optical power to improve signal-to-noise ratio. Our setup uses correlated twin-beams produced by parametric down-conversion, and a hybrid detection scheme comprising photon-counting-based feed-forward and a highly efficient CCD camera.


title: HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Clouds

abstract: We present a novel deep neural network architecture for end-to-end scene flow estimation that directly operates on large-scale 3D point clouds. Inspired by Bilateral Convolutional Layers (BCL), we propose novel DownBCL, UpBCL, and CorrBCL operations that restore structural information from unstructured point clouds, and fuse information from two consecutive point clouds. Operating on discrete and sparse permutohedral lattice points, our architectural design is parsimonious in computational cost. Our model can efficiently process a pair of point cloud frames at once with a maximum of 86K points per frame. Our approach achieves state-of-the-art performance on the FlyingThings3D and KITTI Scene Flow 2015 datasets. Moreover, trained on synthetic data, our approach shows great generalization ability on real-world data and on different point densities without fine-tuning.


title: Paraxial Skyrmionic beams

abstract: Vector vortex beams possess a topological property that derives both from the spatially varying amplitude of the field and also from its varying polarization. This property arises as a consequence of the inherent Skyrmionic nature of such beams and is quantified by the associated Skyrmion number, which embodies a topological property of the beam. We illustrate this idea for some of the simplest vector beams and discuss the physical significance of the Skyrmion number in this context.