title: Generating Automatic Curricula via Self-Supervised Active Domain Randomization

abstract: Goal-directed Reinforcement Learning (RL) traditionally considers an agent interacting with an environment, prescribing a real-valued reward to an agent proportional to the completion of some goal. Goal-directed RL has seen large gains in sample efficiency, due to the ease of reusing or generating new experience by proposing goals. One approach,self-play, allows an agent to "play" against itself by alternatively setting and accomplishing goals, creating a learned curriculum through which an agent can learn to accomplish progressively more difficult goals. However, self-play has been limited to goal curriculum learning or learning progressively harder goals within a single environment. Recent work on robotic agents has shown that varying the environment during training, for example with domain randomization, leads to more robust transfer. As a result, we extend the self-play framework to jointly learn a goal and environment curriculum, leading to an approach that learns the most fruitful domain randomization strategy with self-play. Our method, Self-Supervised Active Domain Randomization(SS-ADR), generates a coupled goal-task curriculum, where agents learn through progressively more difficult tasks and environment variations. By encouraging the agent to try tasks that are just outside of its current capabilities, SS-ADR builds a domain randomization curriculum that enables state-of-the-art results on varioussim2real transfer tasks. Our results show that a curriculum of co-evolving the environment difficulty together with the difficulty of goals set in each environment provides practical benefits in the goal-directed tasks tested.


title: Simplex based Steiner tree instances yield large integrality gaps for the bidirected cut relaxation

abstract: The bidirected cut relaxation is the characteristic representative of the bidirected relaxations ($\mathrm{\mathcal{BCR}}$) which are a well-known class of equivalent LP-relaxations for the NP-hard Steiner Tree Problem in Graphs (STP). Although no general approximation algorithm based on $\mathrm{\mathcal{BCR}}$ with an approximation ratio better than $2$ for STP is known, it is mostly preferred in integer programming as an implementation of STP, since there exists a formulation of compact size, which turns out to be very effective in practice. It is known that the integrality gap of $\mathrm{\mathcal{BCR}}$ is at most $2$, and a long standing open question is whether the integrality gap is less than $2$ or not. The best lower bound so far is $\frac{36}{31} \approx 1.161$ proven by Byrka et al. [BGRS13]. Based on the work of Chakrabarty et al. [CDV11] about embedding STP instances into simplices by considering appropriate dual formulations, we improve on this result by constructing a new class of instances and showing that their integrality gaps tend at least to $\frac{6}{5} = 1.2$. More precisely, we consider the class of equivalent LP-relaxations $\mathrm{\mathcal{BCR}}^{+}$, that can be obtained by strengthening $\mathrm{\mathcal{BCR}}$ by already known straightforward Steiner vertex degree constraints, and show that the worst case ratio regarding the optimum value between $\mathrm{\mathcal{BCR}}$ and $\mathrm{\mathcal{BCR}}^{+}$ is at least $\frac{6}{5}$. Since $\mathrm{\mathcal{BCR}}^{+}$ is a lower bound for the hypergraphic relaxations ($\mathrm{\mathcal{HYP}}$), another well-known class of equivalent LP-relaxations on which the current best $(\ln(4) + \varepsilon)$-approximation algorithm for STP by Byrka et al. [BGRS13] is based, this worst case ratio also holds for $\mathrm{\mathcal{BCR}}$ and $\mathrm{\mathcal{HYP}}$.


title: Dataset of Segmented Nuclei in Hematoxylin and Eosin Stained Histopathology Images of 10 Cancer Types

abstract: The distribution and appearance of nuclei are essential markers for the diagnosis and study of cancer. Despite the importance of nuclear morphology, there is a lack of large scale, accurate, publicly accessible nucleus segmentation data. To address this, we developed an analysis pipeline that segments nuclei in whole slide tissue images from multiple cancer types with a quality control process. We have generated nucleus segmentation results in 5,060 Whole Slide Tissue images from 10 cancer types in The Cancer Genome Atlas. One key component of our work is that we carried out a multi-level quality control process (WSI-level and image patch-level), to evaluate the quality of our segmentation results. The image patch-level quality control used manual segmentation ground truth data from 1,356 sampled image patches. The datasets we publish in this work consist of roughly 5 billion quality controlled nuclei from more than 5,060 TCGA WSIs from 10 different TCGA cancer types and 1,356 manually segmented TCGA image patches from the same 10 cancer types plus additional 4 cancer types. Data is available at https://doi.org/10.7937/tcia.2019.4a4dkp9u


title: Theory of Neutrino Detection -- Flavor Oscillations and Weak Values

abstract: We show that, in the relativistic limit, the quantum theory of neutrino oscillations can be described through the theory of weak measurements with pre and post-selection. The weak nature of neutrino detection allows simultaneous determination of flavor and energy without problems related to the collapse of the wavefunction. Together with post-selection, a non-trivial quantum interference emerges, allowing one to describe a flavor neutrino as one single particle, despite its superposition of masses. We write down the flavor equation of motion and calculate the flavor oscillation probability by showing precisely how a single neutrino interferes with itself.


title: Magnetic polarisability of the nucleon using a Laplacian mode projection

abstract: Conventional hadron interpolating fields, which utilise gauge-covariant Gaussian smearing, are ineffective in isolating ground state nucleons in a uniform background magnetic field. There is evidence that residual Landau mode physics remains at the quark level, even when QCD interactions are present. In this work, quark-level projection operators are constructed from the $SU(3) \times U(1)$ eigenmodes of the two-dimensional lattice Laplacian operator associated with Landau modes. These quark-level modes are formed from a periodic finite lattice where both the background field and strong interactions are present. Using these eigenmodes, quark-propagator projection operators provides the enhanced hadronic energy-eigenstate isolation necessary for calculation of nucleon energy shifts in a magnetic field. The magnetic polarisability of both the proton and neutron is calculated using this method on the $32^3 \times 64$ dynamical QCD lattices provided by the PACS-CS Collaboration. A chiral effective-field theory analysis is used to connect the lattice QCD results to the physical regime, obtaining magnetic polarisabilities of $\beta^p = 2.79(22)({}^{+13}_{-18}) \times 10^{-4}$ fm$^3$ and $\beta^n = 2.06(26)({}^{+15}_{-20}) \times 10^{-4}$ fm$^3$, where the numbers in parantheses describe statistical and systematic uncertainties.


title: Information Condensing Active Learning

abstract: We introduce Information Condensing Active Learning (ICAL), a batch mode model agnostic Active Learning (AL) method targeted at Deep Bayesian Active Learning that focuses on acquiring labels for points which have as much information as possible about the still unacquired points. ICAL uses the Hilbert Schmidt Independence Criterion (HSIC) to measure the strength of the dependency between a candidate batch of points and the unlabeled set. We develop key optimizations that allow us to scale our method to large unlabeled sets. We show significant improvements in terms of model accuracy and negative log likelihood (NLL) on several image datasets compared to state of the art batch mode AL methods for deep learning.


title: TIES: Temporal Interaction Embeddings For Enhancing Social Media Integrity At Facebook

abstract: Since its inception, Facebook has become an integral part of the online social community. People rely on Facebook to make connections with others and build communities. As a result, it is paramount to protect the integrity of such a rapidly growing network in a fast and scalable manner. In this paper, we present our efforts to protect various social media entities at Facebook from people who try to abuse our platform. We present a novel Temporal Interaction EmbeddingS (TIES) model that is designed to capture rogue social interactions and flag them for further suitable actions. TIES is a supervised, deep learning, production ready model at Facebook-scale networks. Prior works on integrity problems are mostly focused on capturing either only static or certain dynamic features of social entities. In contrast, TIES can capture both these variant behaviors in a unified model owing to the recent strides made in the domains of graph embedding and deep sequential pattern learning. To show the real-world impact of TIES, we present a few applications especially for preventing spread of misinformation, fake account detection, and reducing ads payment risks in order to enhance the platform's integrity.


title: Constructing Love-Q-Relations with Gravitational Wave Detections

abstract: Quasi-universal relations connecting the tidal deformability and the quadrupole moment of individual neutron stars are predicted by theoretical computations, but have not been measured experimentally. However, such relations are employed during the interpretation of gravitational waves and, therefore, have a direct impact on the interpretation of real data. In this work, we study how quasi-universal relations can be tested and measured from gravitational wave signals connected to binary neutron star coalescences. We study a population of $120$ binary neutron star systems and find that Advanced LIGO and Advanced Virgo at design sensitivity could find possible deviations of predicted relations if the observed neutron stars are highly spinning. In the future, a network of third generation (3G) detectors will be able to even allow a measurement of quasi-universal relations. Thus, the outlined approach provides a new test of general relativity and nuclear physics predictions.


title: Efficient Search of First-Order Nash Equilibria in Nonconvex-Concave Smooth Min-Max Problems

abstract: We propose an efficient algorithm for finding first-order Nash equilibria in min-max problems of the form $\min_{x \in X}\max_{y\in Y} F(x,y)$, where the objective function is smooth in both variables and concave with respect to $y$; the sets $X$ and $Y$ are convex and "projection-friendly," and $Y$ is compact. Our goal is to find an $(\varepsilon_x,\varepsilon_y)$-first-order Nash equilibrium with respect to a stationarity criterion that is stronger than the commonly used proximal gradient norm. The proposed approach is fairly simple: we perform approximate proximal-point iterations on the primal function, with inexact oracle provided by Nesterov's algorithm run on the regularized function $F(x_t,\cdot)$, $x_t$ being the current primal iterate. The resulting iteration complexity is $O(\varepsilon_x{}^{-2} \varepsilon_y{}^{-1/2})$ up to a logarithmic factor. As a byproduct, the choice $\varepsilon_y = O(\varepsilon_x{}^2)$ allows for the $O(\varepsilon_x{}^{-3})$ complexity of finding an $\varepsilon_x$-stationary point for the standard Moreau envelope of the primal function. Moreover, when the objective is strongly concave with respect to $y$, the complexity estimate for our algorithm improves to $O(\varepsilon_x{}^{-2}{\kappa_y}^{1/2})$ up to a logarithmic factor, where $\kappa_y$ is the condition number appropriately adjusted for coupling. In both scenarios, the complexity estimates are the best known so far, and are only known for the (weaker) proximal gradient norm criterion. Meanwhile, our approach is "user-friendly:" (i) the algorithm is built upon running a variant of Nesterov's accelerated algorithm as subroutine and avoids extragradient steps; (ii) the convergence analysis recycles the well-known results on accelerated methods with inexact oracle. Finally, we extend the approach to non-Euclidean proximal geometries.


title: Block Switching: A Stochastic Approach for Deep Learning Security

abstract: Recent study of adversarial attacks has revealed the vulnerability of modern deep learning models. That is, subtly crafted perturbations of the input can make a trained network with high accuracy produce arbitrary incorrect predictions, while maintain imperceptible to human vision system. In this paper, we introduce Block Switching (BS), a defense strategy against adversarial attacks based on stochasticity. BS replaces a block of model layers with multiple parallel channels, and the active channel is randomly assigned in the run time hence unpredictable to the adversary. We show empirically that BS leads to a more dispersed input gradient distribution and superior defense effectiveness compared with other stochastic defenses such as stochastic activation pruning (SAP). Compared to other defenses, BS is also characterized by the following features: (i) BS causes less test accuracy drop; (ii) BS is attack-independent and (iii) BS is compatible with other defenses and can be used jointly with others.


title: MEM_GE: a new maximum entropy method for image reconstruction from solar X-ray visibilities

abstract: Maximum Entropy is an image reconstruction method conceived to image a sparsely occupied field of view and therefore particularly appropriate to achieve super-resolution effects. Although widely used in image deconvolution, this method has been formulated in radio astronomy for the analysis of observations in the spatial frequency domain, and an Interactive Data Language (IDL) code has been implemented for image reconstruction from solar X-ray Fourier data. However, this code relies on a non-convex formulation of the constrained optimization problem addressed by the Maximum Entropy approach and this sometimes results in unreliable reconstructions characterized by unphysical shrinking effects. This paper introduces a new approach to Maximum Entropy based on the constrained minimization of a convex functional. In the case of observations recorded by the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI), the resulting code provides the same super-resolution effects of the previous algorithm, while working properly also when that code produces unphysical reconstructions. Results are also provided of testing the algorithm with synthetic data simulating observations of the Spectrometer/Telescope for Imaging X-rays (STIX) in Solar Orbiter. The new code is available in the {\em{HESSI}} folder of the Solar SoftWare (SSW)tree.


title: Short-Term Traffic Flow Prediction Using Variational LSTM Networks

abstract: Traffic flow characteristics are one of the most critical decision-making and traffic policing factors in a region. Awareness of the predicted status of the traffic flow has prime importance in traffic management and traffic information divisions. The purpose of this research is to suggest a forecasting model for traffic flow by using deep learning techniques based on historical data in the Intelligent Transportation Systems area. The historical data collected from the Caltrans Performance Measurement Systems (PeMS) for six months in 2019. The proposed prediction model is a Variational Long Short-Term Memory Encoder in brief VLSTM-E try to estimate the flow accurately in contrast to other conventional methods. VLSTM-E can provide more reliable short-term traffic flow by considering the distribution and missing values.


title: Algebraic blinding and cryptographic trilinear maps

abstract: It has been shown recently that cryptographic trilinear maps are sufficient for achieving indistinguishability obfuscation. In this paper we develop algebraic blinding techniques for constructing such maps. An earlier approach involving Weil restriction can be regarded as a special case of blinding in our framework. However, the techniques developed in this paper are more general, more robust, and easier to analyze. The trilinear maps constructed in this paper are efficiently computable. The relationship between the published entities and the hidden entities under the blinding scheme is described by algebraic conditions. Finding points on an algebraic set defined by such conditions for the purpose of unblinding is difficult as these algebraic sets have dimension at least linear in $n$ and involves $\Omega(n^2)$ variables, where $n$ is the security parameter. Finding points on such algebraic sets in general takes time exponential in $n^2\log n$ with the best known methods. Additionally these algebraic sets are characterized as being {\em triply confusing} and most likely {\em uniformly confusing} as well. These properties provide additional evidence that efficient algorithms to find points on such algebraic sets seems unlikely to exist. In addition to algebraic blinding, the security of the trilinear maps also depends on the computational complexity of a trapdoor discrete logarithm problem which is defined in terms of an associative non-commutative polynomial algebra acting on torsion points of a blinded product of elliptic curves.


title: Low work function in the 122-family of iron-based superconductors

abstract: We determine the work functions of the iron arsenic compounds $A$Fe$_2$As$_2$ ($A=\mathrm{Ca, Ba, Cs}$) using photoemission spectroscopy to be 2.7 eV for CaFe$_2$As$_2$, 1.8 eV for BaFe$_2$As$_2$, and 1.3 eV for CsFe$_2$As$_2$. The work functions of these 122 iron-based superconductors track those of the elementary metal $A$ but are substantially smaller. The most likely explanation of this observation is that the cleaving surface exposes only half an $A$-layer. The low work function and good photoemission cross section of BaFe$_2$As$_2$ and CsFe$_2$As$_2$ enable photoemission even from a common white LED light.


title: On Tuza's conjecture for triangulations and graphs with small treewidth

abstract: Tuza (1981) conjectured that the size $\tau(G)$ of a minimum set of edges that intersects every triangle of a graph $G$ is at most twice the size $\nu(G)$ of a maximum set of edge-disjoint triangles of $G$. In this paper we present three results regarding Tuza's Conjecture. We verify it for graphs with treewidth at most $6$; we show that $\tau(G)\leq \frac{3}{2}\,\nu(G)$ for every planar triangulation $G$ different from $K_4$; and that $\tau(G)\leq\frac{9}{5}\,\nu(G) + \frac{1}{5}$ if $G$ is a maximal graph with treewidth 3. Our first result strengthens a result of Tuza, implying that $\tau(G) \leq 2\,\nu(G)$ for every $K_8$-free chordal graph $G$.


title: About tensor products of Hilbert quasi *-algebras and their representability properties

abstract: This note aims to investigate the tensor product of two given Hilbert quasi *-algebras and its properties. The construction proposed in this note turns out to be again a Hilbert quasi *-algebra, thus interesting representability properties studed in \cite{AT} are maintained. Furthermore, if two functionals are representable and continuous respectively on the two Hilbert quasi *-algebras, then so is their tensor product.


title: Studying the Effects of Cognitive Biases in Evaluation of Conversational Agents

abstract: Humans quite frequently interact with conversational agents. The rapid advancement in generative language modeling through neural networks has helped advance the creation of intelligent conversational agents. Researchers typically evaluate the output of their models through crowdsourced judgments, but there are no established best practices for conducting such studies. Moreover, it is unclear if cognitive biases in decision-making are affecting crowdsourced workers' judgments when they undertake these tasks. To investigate, we conducted a between-subjects study with 77 crowdsourced workers to understand the role of cognitive biases, specifically anchoring bias, when humans are asked to evaluate the output of conversational agents. Our results provide insight into how best to evaluate conversational agents. We find increased consistency in ratings across two experimental conditions may be a result of anchoring bias. We also determine that external factors such as time and prior experience in similar tasks have effects on inter-rater consistency.


title: Bridging data science and dynamical systems theory

abstract: This short review describes mathematical techniques for statistical analysis and prediction in dynamical systems. Two problems are discussed, namely (i) the supervised learning problem of forecasting the time evolution of an observable under potentially incomplete observations at forecast initialization; and (ii) the unsupervised learning problem of identification of observables of the system with a coherent dynamical evolution. We discuss how ideas from from operator-theoretic ergodic theory combined with statistical learning theory provide an effective route to address these problems, leading to methods well-adapted to handle nonlinear dynamics, with convergence guarantees as the amount of training data increases.


title: Designed Pseudo-Laplacians

abstract: We elaborate and make rigorous various speculations about the implications of spectral properties of self-adjoint operators on spaces of automorphic forms for location of zeros of $L$-functions. Some of these ideas arose in work of Colin de Verdi\`ere, Lax-Phillips, and Hejhal, from the late 1970s and early 1980s, not to mention semi-apocryphal attributions to P\'olya and Hilbert. For example, given a complex quadratic extension $k$ of $\mathbb Q$, we give a natural self-adjoint extension of a restriction of the invariant Laplacian on the modular curve whose discrete spectrum, if any, consists of values $s(s-1)$ for zeros $s$ of $\zeta_k(s)$. Unfortunately, there seems to be no reason for this discrete spectrum to be large. In fact, Montgomery's pair correlation, and the behavior of $\zeta(1+it)$, imply that at most $94\%$ of zeros of $\zeta(s)$ can appear in this discrete spectrum. Less naively, some preliminary positive results about the dynamics of zeros do follow from these considerations.


title: Tensor products of normed and Banach quasi *-algebras

abstract: Quasi *-algebras form an essential class of partial *-algebras, which are algebras of unbounded operators. In this work, we aim to construct tensor products of normed, respectively Banach quasi *-algebras, and study their capacity to preserve some important properties of their tensor factors, like for instance, *-semisimplicity and full representability.


title: Shock Drift Acceleration of Ions in an Interplanetary Shock Observed by MMS

abstract: An interplanetary (IP) shock wave was recorded crossing the Magnetospheric Multiscale (MMS) constellation on 2018 January 8. Plasma measurements upstream of the shock indicate efficient proton acceleration in the IP shock ramp: 2-7 keV protons are observed upstream for about three minutes (~8000 km) ahead of the IP shock ramp, outrunning the upstream waves. The differential energy flux (DEF) of 2-7 keV protons decays slowly with distance from the ramp towards the upstream region (dropping by about half within 8 Earth radii from the ramp) and is lessened by a factor of about four in the downstream compared to the ramp (within a distance comparable to the gyroradius of ~keV protons). Comparison with test-particle simulations has confirmed that the mechanism accelerating the solar wind protons and injecting them upstream is classical shock drift acceleration. This example of observed proton acceleration by a low-Mach, quasi-perpendicular shock may be applicable to astrophysical contexts, such as supernova remnants or the acceleration of cosmic rays.


title: A unified construction of all the hypergeometric and basic hypergeometric families of orthogonal polynomial sequences

abstract: We construct a set $H$ of orthogonal polynomial sequences that contains all the families in the Askey scheme and the $q$-Askey scheme. The polynomial sequences in $H$ are solutions of a generalized first-order difference equation which is determined by three linearly recurrent sequences of numbers. Two of these sequences are solutions of a difference equation of order three and the other sequence satisfies a related difference equation of order five. We obtain explicit expressions for the coefficients of the orthogonal polynomials and for the generalized moments with respect to a basis of Newton type of the space of polynomials. We also obtain explicit formulas for the coefficients of the three-term recurrence relation satisfied by the polynomial sequences in $H$. The set $H$ contains all the 15 families in the Askey scheme and all the 29 families in the $q$-Askey scheme. Each of these families is obtained by direct substitution of appropriate values for the parameters in our general formulas. The only cases that require some limits are the Hermite and continuous $q$-Hermite polynomials. We present the values of the parameters for some of the families.


title: Improving Generalization by Controlling Label-Noise Information in Neural Network Weights

abstract: In the presence of noisy or incorrect labels, neural networks have the undesirable tendency to memorize information about the noise. Standard regularization techniques such as dropout, weight decay or data augmentation sometimes help, but do not prevent this behavior. If one considers neural network weights as random variables that depend on the data and stochasticity of training, the amount of memorized information can be quantified with the Shannon mutual information between weights and the vector of all training labels given inputs, $I(w ; \mathbf{y} \mid \mathbf{x})$. We show that for any training algorithm, low values of this term correspond to reduction in memorization of label-noise and better generalization bounds. To obtain these low values, we propose training algorithms that employ an auxiliary network that predicts gradients in the final layers of a classifier without accessing labels. We illustrate the effectiveness of our approach on versions of MNIST, CIFAR-10, and CIFAR-100 corrupted with various noise models, and on a large-scale dataset Clothing1M that has noisy labels.


title: A sensitivity study of the primary correlators used to characterize chiral-magnetically-driven charge separation

abstract: A Multi-Phase Transport (AMPT) model is used to study the detection sensitivity of two of the primary correlators -- $\Delta\gamma$ and $R_{\Psi_{2}}$ -- employed to characterize charge separation induced by the Chiral Magnetic Effect (CME). The study, performed relative to several event planes for different input "CME signals", indicates a detection threshold for the fraction $f_{\rm CME}=\Delta\gamma_{\rm CME}/\Delta\gamma$, which renders the $\Delta\gamma$-correlator insensitive to values of the Fourier dipole coefficient $a_1 \lesssim 2.5\%$, that is larger than the purported signal(signal difference) for ion-ion(isobaric) collisions. By contrast, the $R_{\Psi_{2}}$ correlator indicates concave-shaped distributions with inverse widths ($\mathrm{\sigma^{-1}_{R_{\Psi_2}}}$) that are linearly proportional to $a_1$, and independent of the character of the event plane used for their extraction. The sensitivity of the $R_{\Psi_{2}}$ correlator to minimal CME-driven charge separation in the presence of realistic backgrounds, could aid better characterization of the CME in heavy-ion collisions.


title: Weighted Hurwitz numbers, $\tau$-functions and matrix integrals

abstract: The basis elements spanning the Sato Grassmannian element corresponding to the KP $\tau$-function that serves as generating function for rationally weighted Hurwitz numbers are shown to be Meijer $G$-functions. Using their Mellin-Barnes integral representation the $\tau$-function, evaluated at the trace invariants of an externally coupled matrix, is expressed as a matrix integral. Using the Mellin-Barnes integral transform of an infinite product of $\Gamma$ functions, a similar matrix integral representation is given for the KP $\tau$-function that serves as generating function for quantum weighted Hurwitz numbers.


title: PTAuth: Temporal Memory Safety via Robust Points-to Authentication

abstract: Temporal memory corruptions are commonly exploited software vulnerabilities that can lead to powerful attacks. Despite significant progress made by decades of research on mitigation techniques, existing countermeasures fall short due to either limited coverage or overly high overhead. Furthermore, they require external mechanisms (e.g., spatial memory safety) to protect their metadata. Otherwise, their protection can be bypassed or disabled. To address these limitations, we present robust points-to authentication, a novel runtime scheme for detecting all kinds of temporal memory corruptions. We built a prototype system, called PTAuth, that realizes this scheme on ARM architectures. PTAuth contains a customized compiler for code analysis and instrumentation and a runtime library for performing the points-to authentication as a protected program runs. PTAuth leverages the Pointer Authentication Code (PAC) feature, provided by the ARMv8.3 and later CPUs, which serves as a simple hardware-based encryption primitive. PTAuth uses minimal in-memory metadata and protects its metadata without requiring spatial memory safety. We report our evaluation of PTAuth in terms of security, robustness and performance using 150 vulnerable programs from Juliet test suite and the SPEC CPU2006 benchmarks. PTAuth detects all three categories of heap-based temporal memory corruptions, generates zero false alerts, and slows down program execution by 26% (this number was measured based on software-emulated PAC; it is expected to decrease to 20% when using hardware-based PAC). We also show that PTAuth incurs 2% memory overhead thanks to the efficient use of metadata.


title: Long-time asymptotics of non-degenerate non-linear diffusion equations

abstract: We study the long-time asymptotics of prototypical non-linear diffusion equations. Specifically, we consider the case of a non-degenerate diffusivity function that is a (non-negative) polynomial of the dependent variable of the problem. We motivate these types of equations using Einstein's random walk paradigm, leading to a partial differential equation in non-divergence form. On the other hand, using conservation principles leads to a partial differential equation in divergence form. A transformation is derived to handle both cases. Then, a maximum principle (on both an unbounded and a bounded domain) is proved, in order to obtain bounds above and below for the time-evolution of the solutions to the non-linear diffusion problem. Specifically, these bounds are based on the fundamental solution of the linear problem (the so-called Aronson's Green function). Having thus sandwiched the long-time asymptotics of solutions to the non-linear problems between two fundamental solutions of the linear problem, we prove that, unlike the case of degenerate diffusion, a non-degenerate diffusion equation's solution converges onto the linear diffusion solution at long times. Select numerical examples support the mathematical theorems and illustrate the convergence process. Our results have implications on how to interpret asymptotic scalings of potentially anomalous diffusion processes (such as in the flow of particulate materials) that have been discussed in the applied physics literature.


title: A slow-down time-transformed symplectic integrator for solving the few-body problem

abstract: An accurate and efficient method dealing with the few-body dynamics is important for simulating collisional N-body systems like star clusters and to follow the formation and evolution of compact binaries. We describe such a method which combines the time-transformed explicit symplectic integrator (Preto & Tremaine 1999; Mikkola & Tanikawa 1999) and the slow-down method (Mikkola & Aarseth 1996). The former conserves the Hamiltonian and the angular momentum for a long-term evolution, while the latter significantly reduces the computational cost for a weakly perturbed binary. In this work, the Hamilton equations of this algorithm are analyzed in detail. We mathematically and numerically show that it can correctly reproduce the secular evolution like the orbit averaged method and also well conserve the angular momentum. For a weakly perturbed binary, the method is possible to provide a few order of magnitude faster performance than the classical algorithm. A publicly available code written in the c++ language, SDAR, is available on GitHub (https://github.com/lwang-astro/SDAR). It can be used either as a stand alone tool or a library to be plugged in other $N$-body codes. The high precision of the floating point to 62 digits is also supported.


title: An application of the weighted discrete Hardy inequality

abstract: In a note published in 1925, G. H. Hardy stated the inequality \begin{equation*} \sum_{n=1}^\infty \left(\frac{1}{n}\sum_{k=1}^n a_k \right)^p \leq \left(\frac{p}{p-1}\right)^p \sum_{n=1}^\infty a_n^p, \end{equation*} for any non-negative sequence $\{a_n\}_{n \geq 1}$, and $p>1$. This inequality is known in the literature as the classical discrete Hardy inequality. It has been widely studied and several applications and new versions have been shown. In this work, we use a characterization of a weighted version of this inequality to exhibit a sufficient condition for the existence of solutions of the differential equation ${\rm div}\,{\bf u}=f$ in weighted Sobolev spaces over a certain plane irregular domain. The solvability of this equation is fundamental for the analysis of the Stokes equations. The proof follows from a local-to-global argument based on a certain decomposition of functions which is also of interest for its applications to other inequalities or related results in Sobolev spaces, such as the Korn inequality.


title: A unified framework for 21cm tomography sample generation and parameter inference with Progressively Growing GANs

abstract: Creating a database of 21cm brightness temperature signals from the Epoch of Reionisation (EoR) for an array of reionisation histories is a complex and computationally expensive task, given the range of astrophysical processes involved and the possibly high-dimensional parameter space that is to be probed. We utilise a specific type of neural network, a Progressively Growing Generative Adversarial Network (PGGAN), to produce realistic tomography images of the 21cm brightness temperature during the EoR, covering a continuous three-dimensional parameter space that models varying X-ray emissivity, Lyman band emissivity, and ratio between hard and soft X-rays. The GPU-trained network generates new samples at a resolution of $\sim 3'$ in a second (on a laptop CPU), and the resulting global 21cm signal, power spectrum, and pixel distribution function agree well with those of the training data, taken from the 21SSD catalogue \citep{Semelin2017}. Finally, we showcase how a trained PGGAN can be leveraged for the converse task of inferring parameters from 21cm tomography samples via Approximate Bayesian Computation.


title: Asteroid Diameters and Albedos from NEOWISE Reactivation Mission Years Four and Five

abstract: The Near-Earth Object Wide-field Infrared Survey Explorer (NEOWISE) spacecraft has been conducting a two-band thermal infrared survey to detect and characterize asteroids and comets since its reactivation in Dec 2013. Using the observations collected during the fourth and fifth years of the survey, our automated pipeline detected candidate moving objects which were verified and reported to the Minor Planet Center. Using these detections, we perform thermal modeling of each object from the near-Earth object and Main Belt asteroid populations to constrain their sizes. We present thermal model fits of asteroid diameters for 189 NEOs and 5831 MBAs detected during the fourth year of the survey, and 185 NEOs and 5776 MBAs from the fifth year. To date, the NEOWISE Reactivation survey has provided thermal model characterization for 957 unique NEOs. Including all phases of the original WISE survey brings the total to 1473 unique NEOs that have been characterized between 2010 and the present.


title: Source Separation with Deep Generative Priors

abstract: Despite substantial progress in signal source separation, results for richly structured data continue to contain perceptible artifacts. In contrast, recent deep generative models can produce authentic samples in a variety of domains that are indistinguishable from samples of the data distribution. This paper introduces a Bayesian approach to source separation that uses generative models as priors over the components of a mixture of sources, and noise-annealed Langevin dynamics to sample from the posterior distribution of sources given a mixture. This decouples the source separation problem from generative modeling, enabling us to directly use cutting-edge generative models as priors. The method achieves state-of-the-art performance for MNIST digit separation. We introduce new methodology for evaluating separation quality on richer datasets, providing quantitative evaluation of separation results on CIFAR-10. We also provide qualitative results on LSUN.


title: Modeling the atomic structure in the vicinity of the spherical voids and calculation of void growth rate anisotropy in bcc iron and tungsten

abstract: We study the influence of the atomic structure in the vicinity of voids on their growth rate anisotropy. In the first part, we model the atomic structure in the vicinity of nanovoids in Fe and W using the advanced Molecular Statics method. In the second part, we use the earlier obtained equations that taking the influence of elastic fields into account to calculate the shifting rate of the void surface elements, and to evaluate the components of the strain tensor we use the atomic structure modeling results from the first part. The calculations are performed for voids of several sizes at certain oversaturation's in a wide temperature range. The simulation results for the mentioned metals with a bcc structure show that displacements of atoms located along the crystallographic directions of the 100, 110, 111 types in the vicinity of the voids are significantly different, and this anisotropy of atom displacements leads to a reduction of spherical symmetry for the shifting rate of the surface elements. As the result, the initially spherical void shape becomes faceted.


title: Functional Pearl: The Distributive $\lambda$-Calculus

abstract: We introduce a simple extension of the $\lambda$-calculus with pairs---called the distributive $\lambda$-calculus---obtained by adding a computational interpretation of the valid distributivity isomorphism $A \Rightarrow (B\wedge C)\ \ \equiv\ \ (A\Rightarrow B) \wedge (A\Rightarrow C)$ of simple types. We study the calculus both as an untyped and as a simply typed setting. Key features of the untyped calculus are confluence, the absence of clashes of constructs, that is, evaluation never gets stuck, and a leftmost-outermost normalization theorem, obtained with straightforward proofs. With respect to simple types, we show that the new rules satisfy subject reduction if types are considered up to the distributivity isomorphism. The main result is strong normalization for simple types up to distributivity. The proof is a smooth variation over the one for the $\lambda$-calculus with pairs and simple types.


title: On the Planar Two-Center Problem and Circular Hulls

abstract: Given a set $S$ of $n$ points in the Euclidean plane, the two-center problem is to find two congruent disks of smallest radius whose union covers all points of $S$. Previously, Eppstein [SODA'97] gave a randomized algorithm of $O(n\log^2n)$ expected time and Chan [CGTA'99] presented a deterministic algorithm of $O(n\log^2 n\log^2\log n)$ time. In this paper, we propose an $O(n\log^2 n)$ time deterministic algorithm, which improves Chan's deterministic algorithm and matches the randomized bound of Eppstein. If $S$ is in convex position, then we solve the problem in $O(n\log n\log\log n)$ deterministic time. Our results rely on new techniques for dynamically maintaining circular hulls under point insertions and deletions, which are of independent interest.


title: Brauer Spaces of Spectral Algebraic Stacks

abstract: We study the question of whether the Brauer group is isomorphic to the cohomological one in spectral algebraic geometry. For this, we prove the compact generation of the derived category of twisted sheaves for quasi-compact spectral algebraic stacks with quasi-affine diagonal, which admit a quasi-finite presentation; in particular, we obtain the compact generation of the unbounded derived category of quasi-coherent sheaves and the existence of compact perfect complexes with prescribed support for such stacks. We also study the relationship between derived and spectral algebraic stacks, so that our results can be extended to the setting of derived algebraic geometry.


title: Charge-Density Wave Order on a $\pi$-flux Square Lattice

abstract: The effect of electron-phonon coupling (EPC) on Dirac fermions has recently been explored numerically on a honeycomb lattice, leading to precise quantitative values for the finite temperature and quantum critical points. In this paper, we use the unbiased determinant Quantum Monte Carlo (DQMC) method to study the Holstein model on a half-filled staggered-flux square lattice, and compare with the honeycomb lattice geometry, presenting results for a range of phonon frequencies $0.1 \leqslant \omega \leqslant 2.0$. We find that the interactions give rise to charge-density wave (CDW) order, but only above a finite coupling strength $\lambda_{\rm crit}$. The transition temperature is evaluated and presented in a $T_c$-$\lambda$ phase diagram. An accompanying mean-field theory (MFT) calculation also predicts the existence of quantum phase transition (QPT), but at a substantially smaller coupling strength.


title: Personalized Federated Learning: A Meta-Learning Approach

abstract: In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of all users and allows users to obtain a richer model as their models are trained over a larger set of data points. However, this scheme only develops a common output for all the users, and, therefore, it does not adapt the model to each user. This is an important missing feature, especially given the heterogeneity of the underlying data distribution for various users. In this paper, we study a personalized variant of the federated learning in which our goal is to find an initial shared model that current or new users can easily adapt to their local dataset by performing one or a few steps of gradient descent with respect to their own data. This approach keeps all the benefits of the federated learning architecture, and, by structure, leads to a more personalized model for each user. We show this problem can be studied within the Model-Agnostic Meta-Learning (MAML) framework. Inspired by this connection, we study a personalized variant of the well-known Federated Averaging algorithm and evaluate its performance in terms of gradient norm for non-convex loss functions. Further, we characterize how this performance is affected by the closeness of underlying distributions of user data, measured in terms of distribution distances such as Total Variation and 1-Wasserstein metric.


title: Vanishing of Higher Order Alexander-type Invariants of Plane Curves

abstract: The higher order degrees are Alexander-type invariants of complements to an affine plane curve. In this paper we characterize the vanishing of such invariants for transversal unions of plane curves $C'$ and $C''$ in terms of the finiteness, the vanishing properties of the invariants of $C'$ and $C''$, and whether they are irreducible or not. As a consequence, we characterize which of these types of curves have trivial multivariable Alexander polynomial in terms of their defining equations. Our results impose obstructions on the class of groups that can be realized as fundamental groups of complements of a transversal union of curves.


title: Survey on Individual Differences in Visualization

abstract: Developments in data visualization research have enabled visualization systems to achieve great general usability and application across a variety of domains. These advancements have improved not only people's understanding of data, but also the general understanding of people themselves, and how they interact with visualization systems. In particular, researchers have gradually come to recognize the deficiency of having one-size-fits-all visualization interfaces, as well as the significance of individual differences in the use of data visualization systems. Unfortunately, the absence of comprehensive surveys of the existing literature impedes the development of this research. In this paper, we review the research perspectives, as well as the personality traits and cognitive abilities, visualizations, tasks, and measures investigated in the existing literature. We aim to provide a detailed summary of existing scholarship, produce evidence-based reviews, and spur future inquiry.


title: SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra

abstract: Machine learning algorithms are commonly specified in linear algebra (LA). LA expressions can be rewritten into more efficient forms, by taking advantage of input properties such as sparsity, as well as program properties such as common subexpressions and fusible operators. The complex interaction among these properties' impact on the execution cost poses a challenge to optimizing compilers. Existing compilers resort to intricate heuristics that complicate the codebase and add maintenance cost but fail to search through the large space of equivalent LA expressions to find the cheapest one. We introduce a general optimization technique for LA expressions, by converting the LA expressions into Relational Algebra (RA) expressions, optimizing the latter, then converting the result back to (optimized) LA expressions. One major advantage of this method is that it is complete, meaning that any equivalent LA expression can be found using the equivalence rules in RA. The challenge is the major size of the search space, and we address this by adopting and extending a technique used in compilers, called equality saturation. We integrate the optimizer into SystemML and validate it empirically across a spectrum of machine learning tasks; we show that we can derive all existing hand-coded optimizations in SystemML, and perform new optimizations that lead to speedups from 1.2X to 5X.


title: A physically unclonable function using NV diamond magnetometry and micromagnet arrays

abstract: A physically unclonable function (PUF) is an embedded hardware security measure that provides protection against counterfeiting. Here we present our work on using an array of randomly-magnetized micron-sized ferromagnetic bars (micromagnets) as a PUF. We employ a 4 $\mu$m thick surface layer of nitrogen-vacancy (NV) centers in diamond to image the magnetic fields from each micromagnet in the array, after which we extract the magnetic polarity of each micromagnet using image analysis techniques. After evaluating the randomness of the micromagnet array PUF and the sensitivity of the NV readout, we conclude by discussing the possible future enhancements for improved security and magnetic readout.


title: Universal Domain Adaptation through Self Supervision

abstract: Unsupervised domain adaptation methods traditionally assume that all source categories are present in the target domain. In practice, little may be known about the category overlap between the two domains. While some methods address target settings with either partial or open-set categories, they assume that the particular setting is known a priori. We propose a more universally applicable domain adaptation framework that can handle arbitrary category shift, called Domain Adaptative Neighborhood Clustering via Entropy optimization (DANCE). DANCE combines two novel ideas: First, as we cannot fully rely on source categories to learn features discriminative for the target, we propose a novel neighborhood clustering technique to learn the structure of the target domain in a self-supervised way. Second, we use entropy-based feature alignment and rejection to align target features with the source, or reject them as unknown categories based on their entropy. We show through extensive experiments that DANCE outperforms baselines across open-set, open-partial and partial domain adaptation settings. Implementation is available at https://github.com/VisionLearningGroup/DANCE.


title: Comment on "Path integral action of a particle with the generalized uncertainty principle and correspondence with noncommutativity"

abstract: Recently in [Phys. Rev. D $99$ $(2019)$ 104010] the non-relativistic Feynman propagator for harmonic oscillator system is presented when the generalized uncertainty principle is employed. In this short comment it is shown that the expression is incorrect. We also derive the correct expression of it.


title: Improved Classical and Quantum Algorithms for the Shortest Vector Problem via Bounded Distance Decoding

abstract: The most important computational problem on lattices is the Shortest Vector Problem (SVP). In this paper, we present new algorithms that improve the state-of-the-art for provable classical/quantum algorithms for SVP. We present the following results. $\bullet$ A new algorithm for SVP that provides a smooth tradeoff between time complexity and memory requirement. For any positive integer $4\leq q\leq \sqrt{n}$, our algorithm takes $q^{13n+o(n)}$ time and requires $poly(n)\cdot q^{16n/q^2}$ memory. This tradeoff which ranges from enumeration ($q=\sqrt{n}$) to sieving ($q$ constant), is a consequence of a new time-memory tradeoff for Discrete Gaussian sampling above the smoothing parameter. $\bullet$ A quantum algorithm for SVP that runs in time $2^{0.950n+o(n)}$ and requires $2^{0.5n+o(n)}$ classical memory and poly(n) qubits. In Quantum Random Access Memory (QRAM) model this algorithm takes only $2^{0.835n+o(n)}$ time and requires a QRAM of size $2^{0.293n+o(n)}$, poly(n) qubits and $2^{0.5n}$ classical space. This improves over the previously fastest classical (which is also the fastest quantum) algorithm due to [ADRS15] that has a time and space complexity $2^{n+o(n)}$. $\bullet$ A classical algorithm for SVP that runs in time $2^{1.669n+o(n)}$ time and $2^{0.5n+o(n)}$ space. This improves over an algorithm of [CCL18] that has the same space complexity. The time complexity of our classical and quantum algorithms are obtained using a known upper bound on a quantity related to the lattice kissing number which is $2^{0.402n}$. We conjecture that for most lattices this quantity is a $2^{o(n)}$. Assuming that this is the case, our classical algorithm runs in time $2^{1.292n+o(n)}$, our quantum algorithm runs in time $2^{0.750n+o(n)}$ and our quantum algorithm in QRAM model runs in time $2^{0.667n+o(n)}$.


title: Curriculum in Gradient-Based Meta-Reinforcement Learning

abstract: Gradient-based meta-learners such as Model-Agnostic Meta-Learning (MAML) have shown strong few-shot performance in supervised and reinforcement learning settings. However, specifically in the case of meta-reinforcement learning (meta-RL), we can show that gradient-based meta-learners are sensitive to task distributions. With the wrong curriculum, agents suffer the effects of meta-overfitting, shallow adaptation, and adaptation instability. In this work, we begin by highlighting intriguing failure cases of gradient-based meta-RL and show that task distributions can wildly affect algorithmic outputs, stability, and performance. To address this problem, we leverage insights from recent literature on domain randomization and propose meta Active Domain Randomization (meta-ADR), which learns a curriculum of tasks for gradient-based meta-RL in a similar as ADR does for sim2real transfer. We show that this approach induces more stable policies on a variety of simulated locomotion and navigation tasks. We assess in- and out-of-distribution generalization and find that the learned task distributions, even in an unstructured task space, greatly improve the adaptation performance of MAML. Finally, we motivate the need for better benchmarking in meta-RL that prioritizes \textit{generalization} over single-task adaption performance.


title: Massive IoT Access With NOMA in 5G Networks and Beyond Using Online Competitiveness and Learning

abstract: This paper studies the problem of online user grouping, scheduling and power allocation in beyond 5G cellular-based Internet of things networks. Due to the massive number of devices trying to be granted to the network, non-orthogonal multiple access method is adopted in order to accommodate multiple devices in the same radio resource block. Different from most previous works, the objective is to maximize the number of served devices while allocating their transmission powers such that their real-time requirements as well as their limited operating energy are respected. First, we formulate the general problem as a mixed integer non-linear program (MINLP) that can be transformed easily to MILP for some special cases. Second, we study its computational complexity by characterizing the NP-hardness of different special cases. Then, by dividing the problem into multiple NOMA grouping and scheduling subproblems, efficient online competitive algorithms are proposed. Further, we show how to use these online algorithms and combine their solutions in a reinforcement learning setting to obtain the power allocation and hence the global solution to the problem. Our analysis are supplemented by simulation results to illustrate the performance of the proposed algorithms with comparison to optimal and state-of-the-art methods.


title: Quantum droplets of quasi-one-dimensional dipolar Bose-Einstein condensates

abstract: Ultracold dipolar droplets have been realized in a series of ground-breaking experiments, where the stability of the droplet state is attributed to beyond-mean-field effects in the form of the celebrated Lee-Huang-Yang (LHY) correction. We scrutinize the dipolar droplet states in a one-dimensional context using a combination of analytical and numerical approaches, and identify experimentally viable parameters for accessing our findings for future experiments. In particular we identify regimes of stability in the restricted geometry, finding multiple roton instabilities as well as regions supporting quasi-one-dimensional droplet states. By applying an interaction quench to the droplet, a modulational instability is induced and multiple droplets are produced, along with bright solitons and atomic radiation. We also assess the droplets robustness to collisions, revealing population transfer and droplet fission.


title: Photon Self-energy in Magnetized Chiral Plasma from Kinetic Theory

abstract: We study the photon self-energy in magnetized chiral plasma by solving the response of electromagnetic field perturbations in chiral kinetic theory with Landau level states. With lowest Landau level approximation and in collisionless limit, we find solutions for three particular perturbations: parallel electric field, static perpendicular electric and magnetic field, corresponding to chiral magnetic wave, drift state and tilted state, from which we extract components of photon self-energy in different kinematics. We show no solution is possible for more general field perturbations. We argue this is an artifact of the collisionless limit: while static solution corresponding to drift state and tilted state can be found, they cannot be realized dynamically without interaction between Landau levels. We also discuss possible manifestation of side-jump effect due to both boost and rotation, with the latter due to the presence of background magnetic field.


title: Pressure-Induced Restoration of the Reversed Crystal-Field Splitting in $\alpha$-Sr$_2$CrO$_4$

abstract: Motivated by an experimental finding that the successive phase transitions in $\alpha$-Sr$_2$CrO$_4$ observed at ambient pressure ceases to exist under high pressures, we carry out the density-functional-theory-based electronic structure calculations and demonstrate that the reversal of the crystal-field splitting reported previously is restored under high pressures, so that the orbital degrees of freedom disappears, resulting in the single phase transition that divides the system into high-temperature Mott insulating and low-temperature antiferromagnetic insulating phases.


title: Reconstruction of projective curves from the derived category

abstract: We prove that integral projective curves with Cohen-Macaulay singularities over an algebraically closed field of characteristic zero are determined by their triangulated category of perfect complexes.This partially extends a theorem of Bondal and Orlov to the case of singular projective varieties, and in particular shows that all integral complex projective curves are determined by their category of perfect complexes


title: Inductive Representation Learning on Temporal Graphs

abstract: Inductive representation learning on temporal graphs is an important step toward salable machine learning on real-world dynamic networks. The evolving nature of temporal dynamic graphs requires handling new nodes as well as capturing temporal patterns. The node embeddings, which are now functions of time, should represent both the static node features and the evolving topological structures. Moreover, node and topological features can be temporal as well, whose patterns the node embeddings should also capture. We propose the temporal graph attention (TGAT) layer to efficiently aggregate temporal-topological neighborhood features as well as to learn the time-feature interactions. For TGAT, we use the self-attention mechanism as building block and develop a novel functional time encoding technique based on the classical Bochner's theorem from harmonic analysis. By stacking TGAT layers, the network recognizes the node embeddings as functions of time and is able to inductively infer embeddings for both new and observed nodes as the graph evolves. The proposed approach handles both node classification and link prediction task, and can be naturally extended to include the temporal edge features. We evaluate our method with transductive and inductive tasks under temporal settings with two benchmark and one industrial dataset. Our TGAT model compares favorably to state-of-the-art baselines as well as the previous temporal graph embedding approaches.


title: Partial Persistence of Excitation in RKHS Embedded Adaptive Estimation

abstract: In this paper, an adaptive non-parametric method is proposed to estimate the scalar-valued nonlinear function that appears in uncertain systems governed by ordinary differential equations (ODEs). By employing an infinite-dimensional reproducing kernel Hilbert space (RKHS) as the hypothesis space, the nonlinear estimation problem in finite-dimensional Euclidean space is recast into that of constructing a linear observer in the infinite-dimensional RKHS. The analysis of convergence is facilitated by the introduction of a novel condition of partial persistent excitation (partial PE), which is defined for a subspace of the RKHS. Using this condition, we prove that the projection of the function estimation error onto the PE subspace converges in norm asymptotically to zero. While this is an abstract notion of convergence that depends implicitly on the kernel used to define the RKHS, we derive conditions that ensure the pointwise convergence of the function estimates over the PE subset. This paper additionally introduces a weaker but geometrically intuitive notion of a partial PE condition, one that resembles PE conditions as they have been formulated historically in Euclidean spaces. Sufficient conditions are derived that describe when the two conditions are equivalent. Finally, qualitative properties of the convergence proofs derived in the paper are illustrated with numerical simulations.


title: Tourism Demand Forecasting: An Ensemble Deep Learning Approach

abstract: The availability of tourism-related big data increases the potential to improve the accuracy of tourism demand forecasting, but presents significant challenges for forecasting, including curse of dimensionality and high model complexity. A novel bagging-based multivariate ensemble deep learning approach integrating stacked autoencoders and kernel-based extreme learning machines (B-SAKE) is proposed to address these challenges in this study. By using historical tourist arrival data, economic variable data and search intensity index (SII) data, we forecast tourist arrivals in Beijing from four countries. The consistent results of multiple schemes suggest that our proposed B-SAKE approach outperforms benchmark models in terms of level accuracy, directional accuracy and even statistical significance. Both bagging and stacked autoencoder can effectively alleviate the challenges brought by tourism big data and improve the forecasting performance of the models. The ensemble deep learning model we propose contributes to tourism forecasting literature and benefits relevant government officials and tourism practitioners.


title: Being Bayesian about Categorical Probability

abstract: Neural networks utilize the softmax as a building block in classification tasks, which contains an overconfidence problem and lacks an uncertainty representation ability. As a Bayesian alternative to the softmax, we consider a random variable of a categorical probability over class labels. In this framework, the prior distribution explicitly models the presumed noise inherent in the observed label, which provides consistent gains in generalization performance in multiple challenging tasks. The proposed method inherits advantages of Bayesian approaches that achieve better uncertainty estimation and model calibration. Our method can be implemented as a plug-and-play loss function with negligible computational overhead compared to the softmax with the cross-entropy loss function.


title: Integrated organic inference (IOI): A reconciliation of statistical paradigms

abstract: It is recognised that the Bayesian approach to inference can not adequately cope with all the types of pre-data beliefs about population quantities of interest that are commonly held in practice. In particular, it generally encounters difficulty when there is a lack of such beliefs over some or all the parameters of a model, or within certain partitions of the parameter space concerned. To address this issue, a fairly comprehensive theory of inference is put forward called integrated organic inference that is based on a fusion of Fisherian and Bayesian reasoning. Depending on the pre-data knowledge that is held about any given model parameter, inferences are made about the parameter conditional on all other parameters using one of three methods of inference, namely organic fiducial inference, bispatial inference and Bayesian inference. The full conditional post-data densities that result from doing this are then combined using a framework that allows a joint post-data density for all the parameters to be sensibly formed without requiring these full conditional densities to be compatible. Various examples of the application of this theory are presented. Finally, the theory is defended against possible criticisms partially in terms of what was previously defined as generalised subjective probability.


title: Effective field theory of degenerate higher-order inflation

abstract: We extend the effective field theory of inflation to a general Lagrangian constructed from Arnowitt-Deser-Misner variables that encompasses the most general interactions with up to second derivatives of the scalar field whose background breaks temporal diffeomorphism invariance. Degeneracy conditions, corresponding to 8 distinct types -- only one of which corresponds to known degenerate higher-order scalar-tensor models -- provide necessary conditions for eliminating the Ostrogradsky ghost in a covariant theory at the level of the quadratic action in unitary gauge. Novel implications of the degenerate higher-order system for the Cauchy problem are illustrated with the phase space portrait of an explicit inflationary example: not all field configurations lead to physical solutions for the metric even for positive potentials; solutions are unique for a given configuration only up to a branch choice; solutions on one branch can apparently end at nonsingular points of the metric and their continuation on alternate branches lead to nonsingular bouncing solutions; unitary gauge perturbations can go unstable even when degenerate terms in the Lagrangian are infinitesimal. The attractor solution leads to an inflationary scenario where slow-roll parameters vary and running of the tilt can be large even with no explicit features in the potential far from the end of inflation, requiring the optimized slow-roll approach for predicting observables.


title: Familiarization tours for first-time users of highly automated cars: Comparing the effects of virtual environments with different levels of interaction fidelity

abstract: Research in aviation and driving has highlighted the importance of training as an effective approach to reduce the costs associated with the supervisory role of the human in automated systems. However, only a few studies have investigated the effect of pre-trip familiarization tours on highly automated driving. In the present study, a driving simulator experiment compared the effectiveness of four familiarization groups, control, video, low fidelity virtual reality (VR), and high fidelity VR on automation trust and driving performance in several critical and non-critical transition tasks. The results revealed the positive impact of familiarization tours on trust, takeover, and handback performance at the first time of measurement. Takeover quality only improved when practice was presented in high-fidelity VR. After three times of exposure to transition requests, trust and transition performance of all groups converged to those of the high fidelity VR group, demonstrating that: a) experiencing automation failures during the training may reduce costs associated with first failures in highly automated driving; b) the VR tour with high level of interaction fidelity is superior to other types of familiarization tour, and c) uneducated and less-educated drivers learn about automation by experiencing it. Knowledge resulting from this research could help develop cost-effective familiarization tours for highly automated vehicles in dealerships and car rental centers.


title: A Physics-Guided Modular Deep-Learning Based Automated Framework for Tumor Segmentation in PET Images

abstract: The objective of this study was to develop a PET tumor-segmentation framework that addresses the challenges of limited spatial resolution, high image noise, and lack of clinical training data with ground-truth tumor boundaries in PET imaging. We propose a three-module PET-segmentation framework in the context of segmenting primary tumors in 3D FDG-PET images of patients with lung cancer on a per-slice basis. The first module generates PET images containing highly realistic tumors with known ground-truth using a new stochastic and physics-based approach, addressing lack of training data. The second module trains a modified U-net using these images, helping it learn the tumor-segmentation task. The third module fine-tunes this network using a small-sized clinical dataset with radiologist-defined delineations as surrogate ground-truth, helping the framework learn features potentially missed in simulated tumors. The framework's accuracy, generalizability to different scanners, sensitivity to partial volume effects (PVEs) and efficacy in reducing the number of training images were quantitatively evaluated using Dice similarity coefficient (DSC) and several other metrics. The framework yielded reliable performance in both simulated (DSC: 0.87 (95% CI: 0.86, 0.88)) and patient images (DSC: 0.73 (95% CI: 0.71, 0.76)), outperformed several widely used semi-automated approaches, accurately segmented relatively small tumors (smallest segmented cross-section was 1.83 cm2), generalized across five PET scanners (DSC: 0.74), was relatively unaffected by PVEs, and required low training data (training with data from even 30 patients yielded DSC of 0.70). In conclusion, the proposed framework demonstrated the ability for reliable automated tumor delineation in FDG-PET images of patients with lung cancer.


title: Supporting OpenMP 5.0 Tasks in hpxMP -- A study of an OpenMP implementation within Task Based Runtime Systems

abstract: OpenMP has been the de facto standard for single node parallelism for more than a decade. Recently, asynchronous many-task runtime (AMT) systems have increased in popularity as a new programming paradigm for high performance computing applications. One of the major challenges of this new paradigm is the incompatibility of the OpenMP thread model and other AMTs. Highly optimized OpenMP-based libraries do not perform well when coupled with AMTs because the threading of both libraries will compete for resources. This paper is a follow-up paper on the fundamental implementation of hpxMP, an implementation of the OpenMP standard which utilizes the C++ standard library for Parallelism and Concurrency (HPX) to schedule and manage tasks. In this paper, we present the implementation of task features, e.g. taskgroup, task depend, and task_reduction, of the OpenMP 5.0 standard and optimization of the #pragma omp parallel for pragma. We use the daxpy benchmark, the Barcelona OpenMP Tasks Suite, Parallel research kernels, and OpenBLAS benchmarks to compare the different OpenMp implementations: hpxMP, llvm-OpenMP, and GOMP.


title: Gradient Boosting Neural Networks: GrowNet

abstract: A novel gradient boosting framework is proposed where shallow neural networks are employed as ``weak learners''. General loss functions are considered under this unified framework with specific examples presented for classification, regression, and learning to rank. A fully corrective step is incorporated to remedy the pitfall of greedy function approximation of classic gradient boosting decision tree. The proposed model rendered outperforming results against state-of-the-art boosting methods in all three tasks on multiple datasets. An ablation study is performed to shed light on the effect of each model components and model hyperparameters.


title: The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding

abstract: We present MT-DNN, an open-source natural language understanding (NLU) toolkit that makes it easy for researchers and developers to train customized deep learning models. Built upon PyTorch and Transformers, MT-DNN is designed to facilitate rapid customization for a broad spectrum of NLU tasks, using a variety of objectives (classification, regression, structured prediction) and text encoders (e.g., RNNs, BERT, RoBERTa, UniLM). A unique feature of MT-DNN is its built-in support for robust and transferable learning using the adversarial multi-task learning paradigm. To enable efficient production deployment, MT-DNN supports multi-task knowledge distillation, which can substantially compress a deep neural model without significant performance drop. We demonstrate the effectiveness of MT-DNN on a wide range of NLU applications across general and biomedical domains. The software and pre-trained models will be publicly available at https://github.com/namisan/mt-dnn.


title: A Counterexample to $C^k$-regularity for the Newlander-Nirenberg Theorem

abstract: We give an example of $C^k$-integrable almost complex structure that does not admit a corresponding $C^{k+1}$-complex coordinate system.


title: Nanoscale zero-field electron spin resonance spectroscopy

abstract: Electron spin resonance (ESR) spectroscopy has broad applications in physics, chemistry and biology. As a complementary tool, zero-field ESR (ZF-ESR) spectroscopy has been proposed for decades and shown its own benefits for investigating the electron fine and hyperfine interaction. However, the ZF-ESR method has been rarely used due to the low sensitivity and the requirement of much larger samples than conventional ESR. In this work, we present a method for deploying ZF-ESR spectroscopy at the nanoscale by using a highly sensitive quantum sensor, the nitrogen-vacancy center in diamond. We also measure the nanoscale ZF-ESR spectrum of a few P1 centers in diamond, and show that the hyperfine coupling constant can be directly extracted from the spectrum. This method opens the door to practical applications of ZF-ESR spectroscopy, such as investigation of the structure and polarity information in spin-modified organic and biological systems.


title: A refined Green's function estimate of the time measurable parabolic operators with conic domains

abstract: We present a refined Green's function estimate of the time measurable parabolic operators on conic domains that involves mixed weights consisting of appropriate powers of the distance to the vertex and of the distance to the boundary.


title: High-dynamic-range transmission-mode detection of synchrotron radiation using X-ray excited optical luminescence in diamond

abstract: We demonstrate enhancement of X-ray excited optical luminescence in a 100-micron-thick diamond plate by introduction of defect states via electron beam irradiation and subsequent high-temperature annealing. The resulting X-ray transmission-mode scintillator features a linear response to incident photon flux in the range of 7.6$\times$10$^8$ to 1.26$\times10^{12}$ photons/s/mm$^2$ for hard X-rays (15.9 keV) using exposure times from 0.01 to 5 s. These characteristics enable a real-time transmission-mode imaging of X-ray photon flux density without disruption of X-ray instrument operation.


title: Automorphisms and opposition in spherical buildings of exceptional type, I

abstract: To each automorphism of a spherical building there is naturally associated an "opposition diagram", which encodes the types of the simplices of the building that are mapped onto opposite simplices. If no chamber (that is, no maximal simplex) of the building is mapped onto an opposite chamber then the automorphism is called "domestic". In this paper we give the complete classification of domestic automorphisms of split spherical buildings of types $\mathsf{E}_6$, $\mathsf{F}_4$, and $\mathsf{G}_2$. Moreover, for all split spherical buildings of exceptional type we classify (i) the domestic homologies, (ii) the opposition diagrams arising from elements of the standard unipotent subgroup of the Chevalley group, and (iii) the automorphisms with opposition diagrams with at most $2$ distinguished orbits encircled. Our results provide unexpected characterisations of long root elations and products of perpendicular long root elations in long root geometries, and analogues of the density theorem for connected linear algebraic groups in the setting of Chevalley groups over arbitrary fields.


title: Reflection principle for lightlike line segments on maximal surfaces

abstract: As in the case of minimal surfaces in the Euclidean 3-space, the reflection principle for maximal surfaces in the Lorentz-Minkowski 3-space asserts that if a maximal surface has a spacelike line segment $L$, the surface is invariant under the $180^\circ$-rotation with respect to $L$. However, such a reflection property does not hold for lightlike line segments on the boundaries of maximal surfaces in general. In this paper, we show some kind of reflection principle for lightlike line segments on the boundaries of maximal surfaces when lightlike line segments are connecting shrinking singularities. As an application, we construct various examples of periodic maximal surfaces with lightlike lines from tessellations of $\mathbb{R}^2$.


title: Sympathetic eruptions of two filaments with an identifiable causal link observed by the Solar Dynamics Observatory

abstract: Filament eruptions occurring at different places within a relatively short time internal, but with a certain physical causal connection are usually known as sympathetic eruption. Studies on sympathetic eruptions are not uncommon. However, in the existed reports, the causal links between sympathetic eruptions remain rather speculative. In this work, we present detailed observations of a sympathetic filament eruption event, where an identifiable causal link between two eruptive filaments is observed. On 2015 November 15, two filaments (F1 in the north and F2 in the south) were located at the southwestern quadrant of solar disk. The main axes of them were almost parallel to each other. Around 22:20 UT, F1 began to erupt, forming two flare ribbons. The southwestern ribbon apparently moved to southwest and intruded southeast part of F2. This continuous intrusion caused F2's eventual eruption. Accompanying the eruption of F2, flare ribbons and post-flare loops appeared in northwest region of F2. Meanwhile, neither flare ribbons nor post-flare loops could be observed in southeastern area of F2. In addition, the nonlinear force-free field (NLFFF) extrapolations show that the magnetic fields above F2 in the southeast region are much weaker than that in the northwest region. These results imply that the overlying magnetic fields of F2 were not uniform. So we propose that the southwest ribbon formed by eruptive F1 invaded F2 from its southeast region with relatively weaker overlying magnetic fields in comparison with its northwest region, disturbing F2 and leading F2 to erupt eventually.


title: Softening of breathing elastic mode and trigonal elastic mode in disordered pyrochlore magnet NaCaCo$_2$F$_7$

abstract: Cobalt pyrochlore fluoride NaCaCo$_2$F$_7$ is a disordered frustrated magnet composed of Co$^{2+}$ ions with an effective spin-$\frac{1}{2}$ magnetic moment and exhibits spin freezing below $T_f \sim$2.4 K. We perform ultrasound velocity measurements on a single crystal of the cubic NaCaCo$_2$F$_7$. The temperature dependence of the bulk modulus (the breathing elastic mode) exhibits Curie-type softening upon cooling below $\sim$20 K down to $T_f$, which is suppressed by the magnetic field. This Curie-type softening should be a precursor to the enhancement of the strength of exchange disorder via the spin-lattice coupling, which causes the spin freezing. In contrast to the magnetic-field-suppressed Curie-type softening in the bulk modulus, the trigonal shear modulus exhibits softening with a characteristic minimum upon cooling, which is enhanced by the magnetic field at temperatures below $\sim$20 K. This magnetic-field-enhanced elastic anomaly in the trigonal shear modulus suggests a coupling of the lattice to the dynamical spin-cluster state. For NaCaCo$_2$F$_7$, the observed elastic anomalies reveal an occurrence of magnetic-field-induced crossover from an isostructural lattice instability toward the spin freezing to a trigonal lattice instability arising from the emergent dynamical spin-cluster state.


title: Beyond the Starobinsky model for inflation

abstract: We single out the Starobinsky model and its extensions among generic $f(R)$ gravity as attractors at large field values for chaotic inflation. Treating a $R^3$ curvature term as a perturbation of the Starobinsky model, we impose the phenomenological bounds on the additional term satisfying the successful inflationary predictions. We find that the scalar spectral index can vary in both the red or blue tilted direction, depending on the sign of the coefficient of the $R^3$ term, whereas the tensor-to-scalar ratio is less affected in the Planck-compatible region. We also discuss the role of higher order curvature term for stability and the reheating dynamics for the unambiguous prediction for the number of efoldings up to the $R^3$ term.


title: Towards Making the Most of Context in Neural Machine Translation

abstract: Document-level machine translation manages to outperform sentence level models by a small margin, but have failed to be widely adopted. We argue that previous research did not make a clear use of the global context, and propose a new document-level NMT framework that deliberately models the local context of each sentence with the awareness of the global context of the document in both source and target languages. We specifically design the model to be able to deal with documents containing any number of sentences, including single sentences. This unified approach allows our model to be trained elegantly on standard datasets without needing to train on sentence and document level data separately. Experimental results demonstrate that our model outperforms Transformer baselines and previous document-level NMT models with substantial margins of up to 2.1 BLEU on state-of-the-art baselines. We also provide analyses which show the benefit of context far beyond the neighboring two or three sentences, which previous studies have typically incorporated.


title: An introduction to Weinstein handlebodies for complements of smoothed toric divisors

abstract: In this article, we provide an introduction to an algorithm for constructing Weinstein handlebodies for complements of certain smoothed toric divisors using explicit coordinates and a simple example. This article also serves to welcome newcomers to Weinstein handlebody diagrams and Weinstein Kirby calculus. Finally, we include one complicated example at the end of the article to showcase the algorithm and the types of Weinstein Kirby diagrams it produces.


title: 3-degenerate induced subgraph of a planar graph

abstract: A graph $G$ is $d$-degenerate if every non-null subgraph of $G$ has a vertex of degree at most $d$. We prove that every $n$-vertex planar graph has a $3$-degenerate induced subgraph of order at least $3n/4$.


title: Interpreting Interpretations: Organizing Attribution Methods by Criteria

abstract: Motivated by distinct, though related, criteria, a growing number of attribution methods have been developed tointerprete deep learning. While each relies on the interpretability of the concept of "importance" and our ability to visualize patterns, explanations produced by the methods often differ. As a result, input attribution for vision models fail to provide any level of human understanding of model behaviour. In this work we expand the foundationsof human-understandable concepts with which attributionscan be interpreted beyond "importance" and its visualization; we incorporate the logical concepts of necessity andsufficiency, and the concept of proportionality. We definemetrics to represent these concepts as quantitative aspectsof an attribution. This allows us to compare attributionsproduced by different methods and interpret them in novelways: to what extent does this attribution (or this method)represent the necessity or sufficiency of the highlighted inputs, and to what extent is it proportional? We evaluate our measures on a collection of methods explaining convolutional neural networks (CNN) for image classification. We conclude that some attribution methods are more appropriate for interpretation in terms of necessity while others are in terms of sufficiency, while no method is always the most appropriate in terms of both.


title: Some New Positive Observations

abstract: We revisit Bressoud's generalized Borwein conjecture. Making use of new positivity-preserving transformations for q-binomial coefficients we establish the truth of infinitely many cases of the Bressoud conjecture. In addition, we prove new bounded version of Lebesgue's identity and of Euler's Pentagonal Number Theorem. Finally, we discuss new companions to Andrews-Gordon mod 21 and Bressoud mod 20 identities.


title: Urgency of Information for Context-Aware Timely Status Updates in Remote Control Systems

abstract: As 5G and Internet-of-Things (IoT) are deeply integrated into vertical industries such as autonomous driving and industrial robotics, timely status update is crucial for remote monitoring and control. In this regard, Age of Information (AoI) has been proposed to measure the freshness of status updates. However, it is just a metric changing linearly with time and irrelevant of context-awareness. We propose a context-based metric, named as Urgency of Information (UoI), to measure the nonlinear time-varying importance and the non-uniform context-dependence of the status information. This paper first establishes a theoretical framework for UoI characterization and then provides UoI-optimal status updating and user scheduling schemes in both single-terminal and multi-terminal cases. Specifically, an update-index-based scheme is proposed for a single-terminal system, where the terminal always updates and transmits when its update index is larger than a threshold. For the multi-terminal case, the UoI of the proposed scheduling scheme is proven to be upper-bounded and its decentralized implementation by Carrier Sensing Multiple Access with Collision Avoidance (CSMA/CA) is also provided. In the simulations, the proposed updating and scheduling schemes notably outperform the existing ones such as round robin and AoI-optimal schemes in terms of UoI, error-bound violation and control system stability.


title: Globally optimal point set registration by joint symmetry plane fitting

abstract: The present work proposes a solution to the challenging problem of registering two partial point sets of the same object with very limited overlap. We leverage the fact that most objects found in man-made environments contain a plane of symmetry. By reflecting the points of each set with respect to the plane of symmetry, we can largely increase the overlap between the sets and therefore boost the registration process. However, prior knowledge about the plane of symmetry is generally unavailable or at least very hard to find, especially with limited partial views, and finding this plane could strongly benefit from a prior alignment of the partial point sets. We solve this chicken-and-egg problem by jointly optimizing the relative pose and symmetry plane parameters, and notably do so under global optimality by employing the branch-and-bound (BnB) paradigm. Our results demonstrate a great improvement over the current state-of-the-art in globally optimal point set registration for common objects. We furthermore show an interesting application of our method to dense 3D reconstruction of scenes with repetitive objects.


title: Implicit bias with Ritz-Galerkin method in understanding deep learning for solving PDEs

abstract: This paper aims at studying the difference between Ritz-Galerkin (R-G) method and deep neural network (DNN) method in solving partial differential equations (PDEs) to better understand deep learning. To this end, we consider solving a particular Poisson problem, where the information of the right-hand side of the equation f is only available at n sample points, that is, f is known at finite sample points. Through both theoretical and numerical studies, we show that solution of the R-G method converges to a piecewise linear function for the one dimensional (1D) problem or functions of lower regularity for high dimensional problems. With the same setting, DNNs however learn a relative smooth solution regardless of the dimension, this is, DNNs implicitly bias towards functions with more low-frequency components among all functions that can fit the equation at available data points. This bias is explained by the recent study of frequency principle (Xu et al., (2019) [17] and Zhang et al., (2019) [11, 19]). In addition to the similarity between the traditional numerical methods and DNNs in the approximation perspective, our work shows that the implicit bias in the learning process, which is different from traditional numerical methods, could help better understand the characteristics of DNNs.


title: The GlueX DIRC Program

abstract: The GlueX experiment is located in experimental Hall D at Jefferson Lab (JLab) and provides a unique capability to search for hybrid mesons in high-energy photoproduction, utilizing a ~9 GeV linearly polarized photon beam. The initial, low-intensity phase of GlueX was recently completed and a high-intensity phase has begun in 2020 which includes an upgraded kaon identification system, known as the DIRC (Detection of Internally Reflected Cherenkov light), utilizing components from the decommissioned BaBar DIRC. The identification of kaon final states will significantly enhance the GlueX physics program, to aid in inferring the quark flavor content of conventional (and potentially hybrid) mesons. In these proceedings we describe the installation of the GlueX DIRC and the analysis of initial commissioning data


title: Deep learning for intensity mapping observations: Component extraction

abstract: Line intensity mapping (LIM) is an emerging observational method to study the large-scale structure of the Universe and its evolution. LIM does not resolve individual sources but probes the fluctuations of integrated line emissions. A serious limitation with LIM is that contributions of different emission lines from sources at different redshifts are all confused at an observed wavelength. We propose a deep learning application to solve this problem. We use conditional generative adversarial networks to extract designated information from LIM. We consider a simple case with two populations of emission line galaxies; H$\rm\alpha$ emitting galaxies at $z = 1.3$ are confused with [OIII] emitters at $z = 2.0$ in a single observed waveband at 1.5 $\rm\mu$m. Our networks trained with 30,000 mock observation maps are able to extract the total intensity and the spatial distribution of H$\rm\alpha$ emitting galaxies at $z = 1.3$. The intensity peaks are successfully located with 74% precision. The precision increases to 91% when we combine the results of 5 networks. The mean intensity and the power spectrum are reconstructed with an accuracy of $\sim$10%. The extracted galaxy distributions at a wider range of redshift can be used for studies on cosmology and on galaxy formation and evolution.


title: Joint Data and Active User Detection for Grant-free FTN-NOMA in Dynamic Networks

abstract: Both faster than Nyquist (FTN) signaling and non-orthogonal multiple access (NOMA) are promising next generation wireless communications techniques as a benefit of their capability of improving the system's spectral efficiency. This paper considers an uplink system that combines the advantages of FTN and NOMA. Consequently, an improved spectral efficiency is achieved by deliberately introducing both inter-symbol interference (ISI) and inter-user interference (IUI). More specifically, we propose a grant-free transmission scheme to reduce the signaling overhead and transmission latency of the considered NOMA system. To distinguish the active and inactive users, we develop a novel message passing receiver that jointly estimates the channel state, detects the user activity, and performs decoding. We conclude by quantifying the significant spectral efficiency gain achieved by our amalgamated FTN-NOMA scheme compared to the orthogonal transmission system, which is up to 87.5%.


title: Beyond Clicks: Modeling Multi-Relational Item Graph for Session-Based Target Behavior Prediction

abstract: Session-based target behavior prediction aims to predict the next item to be interacted with specific behavior types (e.g., clicking). Although existing methods for session-based behavior prediction leverage powerful representation learning approaches to encode items' sequential relevance in a low-dimensional space, they suffer from several limitations. Firstly, they focus on only utilizing the same type of user behavior for prediction, but ignore the potential of taking other behavior data as auxiliary information. This is particularly crucial when the target behavior is sparse but important (e.g., buying or sharing an item). Secondly, item-to-item relations are modeled separately and locally in one behavior sequence, and they lack a principled way to globally encode these relations more effectively. To overcome these limitations, we propose a novel Multi-relational Graph Neural Network model for Session-based target behavior Prediction, namely MGNN-SPred for short. Specifically, we build a Multi-Relational Item Graph (MRIG) based on all behavior sequences from all sessions, involving target and auxiliary behavior types. Based on MRIG, MGNN-SPred learns global item-to-item relations and further obtains user preferences w.r.t. current target and auxiliary behavior sequences, respectively. In the end, MGNN-SPred leverages a gating mechanism to adaptively fuse user representations for predicting next item interacted with target behavior. The extensive experiments on two real-world datasets demonstrate the superiority of MGNN-SPred by comparing with state-of-the-art session-based prediction methods, validating the benefits of leveraging auxiliary behavior and learning item-to-item relations over MRIG.


title: Best-item Learning in Random Utility Models with Subset Choices

abstract: We consider the problem of PAC learning the most valuable item from a pool of $n$ items using sequential, adaptively chosen plays of subsets of $k$ items, when, upon playing a subset, the learner receives relative feedback sampled according to a general Random Utility Model (RUM) with independent noise perturbations to the latent item utilities. We identify a new property of such a RUM, termed the minimum advantage, that helps in characterizing the complexity of separating pairs of items based on their relative win/loss empirical counts, and can be bounded as a function of the noise distribution alone. We give a learning algorithm for general RUMs, based on pairwise relative counts of items and hierarchical elimination, along with a new PAC sample complexity guarantee of $O(\frac{n}{c^2\epsilon^2} \log \frac{k}{\delta})$ rounds to identify an $\epsilon$-optimal item with confidence $1-\delta$, when the worst case pairwise advantage in the RUM has sensitivity at least $c$ to the parameter gaps of items. Fundamental lower bounds on PAC sample complexity show that this is near-optimal in terms of its dependence on $n,k$ and $c$.


title: A Survey on Deep Geometry Learning: From a Representation Perspective

abstract: Researchers have now achieved great success on dealing with 2D images using deep learning. In recent years, 3D computer vision and Geometry Deep Learning gain more and more attention. Many advanced techniques for 3D shapes have been proposed for different applications. Unlike 2D images, which can be uniformly represented by regular grids of pixels, 3D shapes have various representations, such as depth and multi-view images, voxel-based representation, point-based representation, mesh-based representation, implicit surface representation, etc. However, the performance for different applications largely depends on the representation used, and there is no unique representation that works well for all applications. Therefore, in this survey, we review recent development in deep learning for 3D geometry from a representation perspective, summarizing the advantages and disadvantages of different representations in different applications. We also present existing datasets in these representations and further discuss future research directions.


title: Obtaining magnetic field strength using differential measure approach and velocity channel maps

abstract: We introduce two new ways of obtaining the strength of plane-of-sky (POS) magnetic field by simultaneous use of spectroscopic Doppler-shifted lines and the information on magnetic field direction. The latter can be obtained either through polarization measurements or using the velocity gradient technique. We show the advantages that our techniques have compared to the traditional Davis-Chandrasekhar-Fermi (DCF) technique of estimating magnetic field strength from observations. The first technique that we describe in detail employs structure functions of velocity centroids and structure functions of Stokes parameters. We provide analytical expressions for obtaining magnetic field strength from observational data. We successfully test our results using synthetic observations obtained with results of MHD turbulence simulations. We measure velocity and magnetic field fluctuations at small scales using two, three and four point structure functions and compare the performance of these tools. We show that, unlike the DCF, our technique is capable of providing the detailed distribution of POS magnetic field and it can measure magnetic field strength in the presence of both velocity and magnetic field distortions arising from external shear and self-gravity. The second technique applies the velocity gradient technique to velocity channel maps in order to obtain the Alfven Mach number and uses the amplitudes of the gradients to obtain the sonic Mach number. The ratio of these two Mach numbers provides the intensity of magnetic field in the region contributing to the emission in the channel map. We test the technique and discuss obtaining the 3D distribution of POS galactic Magnetic field with it. We discuss the application of the second technique to synchrotron data.