title: Building High-Quality Auction Fraud Dataset

abstract: Given the magnitude of online auction transactions, it is difficult to safeguard consumers from dishonest sellers, such as shill bidders. To date, the application of Machine Learning Techniques (MLTs) to auction fraud has been limited, unlike their applications for combatting other types of fraud. Shill Bidding (SB) is a severe auction fraud, which is driven by modern-day technologies and clever scammers. The difficulty of identifying the behavior of sophisticated fraudsters and the unavailability of training datasets hinder the research on SB detection. In this study, we developed a high-quality SB dataset. To do so, first, we crawled and preprocessed a large number of commercial auctions and bidders' history as well. We thoroughly preprocessed both datasets to make them usable for the computation of the SB metrics. Nevertheless, this operation requires a deep understanding of the behavior of auctions and bidders. Second, we introduced two new SB pattern s and implemented other existing SB patterns. Finally, we removed outliers to improve the quality of training SB data.


title: Independence in Arithmetic: The Method of $(\mathcal L, n)$-Models

abstract: I develop in depth the machinery of $(\mathcal L, n)$-models originally introduced by Shelah and, independently in a slightly different form by Kripke. This machinery allows fairly routine constructions of true but unprovable sentences in $\mathsf{PA}$. I give two applications: 1. Shelah's alternative proof of the Paris-Harrington theorem, and 2. The independence over $\mathsf{PA}$ of a new $\Pi^0_1$ Ramsey theoretic statement about colorings of finite sequences of structures.


title: Lyman-alpha in the GJ 1132 System: Stellar Emission and Planetary Atmospheric Evolution

abstract: GJ 1132b, which orbits an M dwarf, is one of the few known Earth-sized planets, and at 12 pc away it is one of the closest known transiting planets. Receiving roughly 19x Earth's insolation, this planet is too hot to be habitable but can inform us about the volatile content of rocky planet atmospheres around cool stars. Using Hubble STIS spectra, we search for a transit in the Lyman-alpha line of neutral hydrogen (Ly-alpha). If we were to observe a deep Ly-alpha absorption signature, that would indicate the presence of a neutral hydrogen envelope flowing from GJ 1132b. On the other hand, ruling out deep absorption from neutral hydrogen may indicate that this planet does not have a detectable amount of hydrogen loss, is not losing hydrogen, or lost hydrogen and other volatiles early in the star's life. We do not detect a transit and determine a 2-sigma upper limit on the effective envelope radius of 0.36 R* in the red wing of the Ly-alpha line, which is the only portion of the spectrum we detect after absorption by the ISM. We analyze the Ly-alpha spectrum and stellar variability of GJ1132, which is a slowly-rotating 0.18 solar mass M dwarf with previously uncharacterized UV activity. Our data show stellar variabilities of 5-22%, which is consistent with the M dwarf UV variabilities of up to 41% found by \citet{Loyd2014}. Understanding the role that UV variability plays in planetary atmospheres is crucial to assess atmospheric evolution and the habitability of cooler rocky exoplanets.


title: A method for identifying stability regimes using roots of a reduced-order polynomial

abstract: For dispersive Hamiltonian partial differential equations of order 2N+1, N integer, there are two criteria to analyse to examine the stability of small-amplitude, periodic travelling wave solutions to high-frequency perturbations. The first necessary condition for instability is given via the dispersion relation. The second criterion for instability is the signature of the eigenvalues of the spectral stability problem given by the sign of the Hamiltonian. In this work, we show how to combine these two conditions for instability into a polynomial of degree N. If the polynomial contains no real roots, then the travelling wave solutions are stable. We present the method for deriving the polynomial and analyse its roots using Sturm's theory via an example.


title: Full counting statistics of energy transfers in inhomogeneous nonequilibrium states of (1+1)D CFT

abstract: Employing the conformal welding technique, we find an exact expression for the Full Counting Statistics of energy transfers in a class of inhomogeneous nonequilibrium states of a (1+1)-dimensional unitary Conformal Field Theory. The expression involves the Schwarzian action of a complex field obtained by solving a Riemann-Hilbert type problem related to conformal welding of infinite cylinders. On the way, we obtain a formula for the extension of characters of unitary positive-energy representations of the Virasoro algebra to 1-parameter groups of circle diffeomorphisms and we develop techniques, based on the analysis of certain classes of Fredholm operators, that allow to control the leading asymptotics of such extensions for small real part of the modular parameter \tau


title: On singular Frobenius for linear differential equations of second and third order, part 1: ordinary differential equations

abstract: We study second order and third order linear differential equations with analytic coefficients under the viewpoint of finding formal solutions and studying their convergence. We address some untouched aspects of Frobenius methods for second order as the convergence of formal solutions and the existence of Liouvillian solutions. A characterization of regular singularities is given in terms of the space of solutions. An analytic classification of such linear homogeneous ODEs is obtained. This is done by associating to such an ODE a Riccati differential equation and therefore a global holonomy group. This group is a computable group of Moebius maps. These techniques apply to classical equations as Bessel and Legendre equations. In the second part of this work we study third order equations. We prove a theorem similar to classical Frobenius theorem, which describes all the possible cases and solutions to this type of ODE. Once armed with this we pass to investigate the existence of solutions in the non-homogeneous case and also the existence of a convergence theorem in the same line as done for second order above. Our results are concrete and (computationally) constructive and are aimed to shed a new light in this important, useful and attractive field of science.


title: Performance Analysis and Characterization of Training Deep Learning Models on Mobile Devices

abstract: Training deep learning models on mobile devices recently becomes possible, because of increasing computation power on mobile hardware and the advantages of enabling high user experiences. Most of the existing work on machine learning at mobile devices is focused on the inference of deep learning models (particularly convolutional neural network and recurrent neural network), but not training. The performance characterization of training deep learning models on mobile devices is largely unexplored, although understanding the performance characterization is critical for designing and implementing deep learning models on mobile devices. In this paper, we perform a variety of experiments on a representative mobile device (the NVIDIA TX2) to study the performance of training deep learning models. We introduce a benchmark suite and tools to study performance of training deep learning models on mobile devices, from the perspectives of memory consumption, hardware utilization, and power consumption. The tools can correlate performance results with fine-grained operations in deep learning models, providing capabilities to capture performance variance and problems at a fine granularity. We reveal interesting performance problems and opportunities, including under-utilization of heterogeneous hardware, large energy consumption of the memory, and high predictability of workload characterization. Based on the performance analysis, we suggest interesting research directions.


title: Exploration via Hindsight Goal Generation

abstract: Goal-oriented reinforcement learning has recently been a practical framework for robotic manipulation tasks, in which an agent is required to reach a certain goal defined by a function on the state space. However, the sparsity of such reward definition makes traditional reinforcement learning algorithms very inefficient. Hindsight Experience Replay (HER), a recent advance, has greatly improved sample efficiency and practical applicability for such problems. It exploits previous replays by constructing imaginary goals in a simple heuristic way, acting like an implicit curriculum to alleviate the challenge of sparse reward signal. In this paper, we introduce Hindsight Goal Generation (HGG), a novel algorithmic framework that generates valuable hindsight goals which are easy for an agent to achieve in the short term and are also potential for guiding the agent to reach the actual goal in the long term. We have extensively evaluated our goal generation algorithm on a number of robotic manipulation tasks and demonstrated substantially improvement over the original HER in terms of sample efficiency.


title: Mean estimation and regression under heavy-tailed distributions--a survey

abstract: We survey some of the recent advances in mean estimation and regression function estimation. In particular, we describe sub-Gaussian mean estimators for possibly heavy-tailed data both in the univariate and multivariate settings. We focus on estimators based on median-of-means techniques but other methods such as the trimmed mean and Catoni's estimator are also reviewed. We give detailed proofs for the cornerstone results. We dedicate a section on statistical learning problems--in particular, regression function estimation--in the presence of possibly heavy-tailed data.


title: Towards Amortized Ranking-Critical Training for Collaborative Filtering

abstract: Collaborative filtering is widely used in modern recommender systems. Recent research shows that variational autoencoders (VAEs) yield state-of-the-art performance by integrating flexible representations from deep neural networks into latent variable models, mitigating limitations of traditional linear factor models. VAEs are typically trained by maximizing the likelihood (MLE) of users interacting with ground-truth items. While simple and often effective, MLE-based training does not directly maximize the recommendation-quality metrics one typically cares about, such as top-N ranking. In this paper we investigate new methods for training collaborative filtering models based on actor-critic reinforcement learning, to directly optimize the non-differentiable quality metrics of interest. Specifically, we train a critic network to approximate ranking-based metrics, and then update the actor network (represented here by a VAE) to directly optimize against the learned metrics. In contrast to traditional learning-to-rank methods that require to re-run the optimization procedure for new lists, our critic-based method amortizes the scoring process with a neural network, and can directly provide the (approximate) ranking scores for new lists. Empirically, we show that the proposed methods outperform several state-of-the-art baselines, including recently-proposed deep learning approaches, on three large-scale real-world datasets. The code to reproduce the experimental results and figure plots is on Github: https://github.com/samlobel/RaCT_CF


title: Stochastic Neural Network with Kronecker Flow

abstract: Recent advances in variational inference enable the modelling of highly structured joint distributions, but are limited in their capacity to scale to the high-dimensional setting of stochastic neural networks. This limitation motivates a need for scalable parameterizations of the noise generation process, in a manner that adequately captures the dependencies among the various parameters. In this work, we address this need and present the Kronecker Flow, a generalization of the Kronecker product to invertible mappings designed for stochastic neural networks. We apply our method to variational Bayesian neural networks on predictive tasks, PAC-Bayes generalization bound estimation, and approximate Thompson sampling in contextual bandits. In all setups, our methods prove to be competitive with existing methods and better than the baselines.


title: Quantum Coherence from Periodic Driving with Laser Pulses and Decay

abstract: Non-equilibrium physics is a particularly fascinating field of current research. Generically, driven systems are gradually heated up so that quantum effects die out. In contrast, we show that a driven central spin model including controlled dissipation in a highly excited state allows us to distill quantum coherent states, indicated by a substantial reduction of entropy. The model is experimentally accessible in quantum dots or molecules with unpaired electrons. The potential of preparing and manipulating coherent states by designed driving potentials is pointed out.


title: Analyzing the Structure of Attention in a Transformer Language Model

abstract: The Transformer is a fully attention-based alternative to recurrent networks that has achieved state-of-the-art results across a range of NLP tasks. In this paper, we analyze the structure of attention in a Transformer language model, the GPT-2 small pretrained model. We visualize attention for individual instances and analyze the interaction between attention and syntax over a large corpus. We find that attention targets different parts of speech at different layer depths within the model, and that attention aligns with dependency relations most strongly in the middle layers. We also find that the deepest layers of the model capture the most distant relationships. Finally, we extract exemplar sentences that reveal highly specific patterns targeted by particular attention heads.


title: Continuous Time Analysis of Momentum Methods

abstract: Gradient descent-based optimization methods underpin the parameter training of neural networks, and hence comprise a significant component in the impressive test results found in a number of applications. Introducing stochasticity is key to their success in practical problems, and there is some understanding of the role of stochastic gradient descent in this context. Momentum modifications of gradient descent such as Polyak's Heavy Ball method (HB) and Nesterov's method of accelerated gradients (NAG), are also widely adopted. In this work our focus is on understanding the role of momentum in the training of neural networks, concentrating on the common situation in which the momentum contribution is fixed at each step of the algorithm. To expose the ideas simply we work in the deterministic setting. Our approach is to derive continuous time approximations of the discrete algorithms; these continuous time approximations provide insights into the mechanisms at play within the discrete algorithms. We prove three such approximations. Firstly we show that standard implementations of fixed momentum methods approximate a time-rescaled gradient descent flow, asymptotically as the learning rate shrinks to zero; this result does not distinguish momentum methods from pure gradient descent, in the limit of vanishing learning rate. We then proceed to prove two results aimed at understanding the observed practical advantages of fixed momentum methods over gradient descent. We achieve this by proving approximations to continuous time limits in which the small but fixed learning rate appears as a parameter. Furthermore in a third result we show that the momentum methods admit an exponentially attractive invariant manifold on which the dynamics reduces, approximately, to a gradient flow with respect to a modified loss function.


title: Towards Run Time Estimation of the Gaussian Chemistry Code for SEAGrid Science Gateway

abstract: Accurate estimation of the run time of computational codes has a number of significant advantages for scientific computing. It is required information for optimal resource allocation, improving turnaround times and utilization of science gateways. Furthermore, it allows users to better plan and schedule their research, streamlining workflows and improving the overall productivity of cyberinfrastructure. Predicting run time is challenging, however. The inputs to scientific codes can be complex and high dimensional. Their relationship to the run time may be highly non-linear, and, in the most general case is completely arbitrary and thus unpredictable (i.e., simply a random mapping from inputs to run time). Most codes are not so arbitrary, however, and there has been significant prior research on predicting the run time of applications and workloads. Such predictions are generally application-specific, however. In this paper, we focus on the Gaussian computational chemistry code. We characterize a data set of runs from the SEAGrid science gateway with a number of different studies. We also explore a number of different potential regression methods and present promising future directions.


title: Chinese Embedding via Stroke and Glyph Information: A Dual-channel View

abstract: Recent studies have consistently given positive hints that morphology is helpful in enriching word embeddings. In this paper, we argue that Chinese word embeddings can be substantially enriched by the morphological information hidden in characters which is reflected not only in strokes order sequentially, but also in character glyphs spatially. Then, we propose a novel Dual-channel Word Embedding (DWE) model to realize the joint learning of sequential and spatial information of characters. Through the evaluation on both word similarity and word analogy tasks, our model shows its rationality and superiority in modelling the morphology of Chinese.


title: Exponential lower bound for Berge-Ramsey problems

abstract: We give an exponential lower bound for Berge-Ramsey problems.


title: Artificial Noisy MIMO Systems under Correlated Scattering Rayleigh Fading -- A Physical Layer Security Approach

abstract: The existing investigations on artificial noise (AN) security systems assumed that only null spaces is used to send AN signals, and all eigen-subchannels should be used to transmit messages. Our previous work proposed an AN scheme that allocates some of eigen-subchannels to transmit AN signals for improving secrecy rates. Nevertheless, our previous work considered only uncorrelated MIMO Rayleigh fading channels. In fact, the correlations among antennas exist in realistic scattering channel environments. In this paper, we extend our previous AN scheme to spatially correlated Rayleigh fading channels at both legitimate receiver- and eavesdropper-sides and derive an exact theoretical expression for the ergodic secrecy rate of the AN scheme, along with an approximate analysis. Both numerical and simulation results show that the proposed AN scheme offers a higher ergodic secrecy rate than the existing schemes, revealing a fact that the correlation among eavesdropper's antennas can potentially improve the secrecy rate of an MIMO system.


title: No signs of star formation being regulated in the most luminous quasars at z~2 with ALMA

abstract: We present ALMA Band~7 observations at $850\mu$m of 20 luminous ($\log\, L_{\rm bol}>46.9$ [erg s$^{-1}$]) unobscured quasars at $z\sim2$. We detect continuum emission for 19/20 quasars. After subtracting an AGN contribution, we measure the total far-IR luminosity for 18 quasars, assuming a modified blackbody model, and attribute the emission as indicative of the star formation rate (SFR). Our sample can be characterized with a log-normal SFR distribution having a mean of 140 $M_\odot$ yr$^{-1}$ and a dispersion of 0.5 dex. Based on an inference of their stellar masses, the SFRs are similar, in both the mean and dispersion, with star-forming main-sequence galaxies at the equivalent epoch. Thus, there is no evidence for a systematic enhancement or suppression (i.e., regulation or quenching) of star formation in the hosts of the most luminous quasars at $z\sim2$. These results are consistent with the Magneticum cosmological simulation, while in disagreement with a widely recognized phenomenological model that predicts higher SFRs than observed here based on the high bolometric luminosities of this sample. Furthermore, there is only a weak relation between SFR and accretion rate onto their supermassive black holes both for average and individual measurements. We interpret these results as indicative of star formation and quasar accretion being fed from the available gas reservoir(s) in their host with a disconnect due to their different physical sizes, temporal scales, and means of gas processing.


title: Automated Curriculum Learning for Turn-level Spoken Language Understanding with Weak Supervision

abstract: We propose a learning approach for turn-level spoken language understanding, which facilitates a user to speak one or more utterances compositionally in a turn for completing a task (e.g., voice ordering). A typical pipelined approach for these understanding tasks requires non-trivial annotation effort for developing its multiple components. Also, the pipeline is difficult to port to a new domain or scale up. To address these problems, we propose an end-to-end statistical model with weak supervision. We employ randomized beam search with memory augmentation (RBSMA) to solve complicated problems for which long promising trajectories are usually difficult to explore. Furthermore, considering the diversity of problem complexity, we explore automated curriculum learning (CL) for weak supervision to accelerate exploration and learning. We evaluate the proposed approach on real-world user logs of a commercial voice ordering system. Results demonstrate that when trained on a small number of end-to-end annotated sessions collected with low cost, our model performs comparably to the deployed pipelined system, saving the development labor over an order of magnitude. The RBSMA algorithm improves the test set accuracy by 7.8% relative compared to the standard beam search. Automated CL leads to better generalization and further improves the test set accuracy by 5% relative.


title: Bilevel Optimization for Planning through Contact: A Semidirect Method

abstract: Many robotics applications, from object manipulation to locomotion, require planning methods that are capable of handling the dynamics of contact. Trajectory optimization has been shown to be a viable approach that can be made to support contact dynamics. However, the current state-of-the art methods remain slow and are often difficult to get to converge. In this work, we leverage recent advances in bilevel optimization to design an algorithm capable of efficiently generating trajectories that involve making and breaking contact. We demonstrate our method's efficiency by outperforming an alternative state-of-the-art method on two benchmark problems. We moreover demonstrate the method's ability to design a simple periodic gait for a quadruped with 15 degrees of freedom and four contact points.


title: Inter-Tier Process Variation-Aware Monolithic 3D NoC Architectures

abstract: Monolithic 3D (M3D) technology enables high density integration, performance, and energy-efficiency by sequentially stacking tiers on top of each other. M3D-based network-on-chip (NoC) architectures can exploit these benefits by adopting tier partitioning for intra-router stages. However, conventional fabrication methods are infeasible for M3D-enabled designs due to temperature related issues. This has necessitated lower temperature and temperature-resilient techniques for M3D fabrication, leading to inferior performance of transistors in the top tier and interconnects in the bottom tier. The resulting inter-tier process variation leads to performance degradation of M3D-enabled NoCs. In this work, we demonstrate that without considering inter-tier process variation, an M3D-enabled NoC architecture overestimates the energy-delay-product (EDP) on average by 50.8% for a set of SPLASH-2 and PARSEC benchmarks. As a countermeasure, we adopt a process variation aware design approach. The proposed design and optimization method distribute the intra-router stages and inter-router links among the tiers to mitigate the adverse effects of process variation. Experimental results show that the NoC architecture under consideration improves the EDP by 27.4% on average across all benchmarks compared to the process-oblivious design.


title: Extensions of immersions of surfaces into $\mathbb{R}^{3}$

abstract: This paper is to study the $\mathbb{R}^{3}$ case of \hyperref[Zhao]{[9]}. We determine all equivalence classes of immersed $3$-manifolds bounded by an arbitrary immersed surface in $\mathbb{R}^{3}$.


title: Structure of chaotic eigenstates and their entanglement entropy

abstract: We consider a chaotic many-body system (i.e., one that satisfies the eigenstate thermalization hypothesis) that is split into two subsystems, with an interaction along their mutual boundary, and study the entanglement properties of an energy eigenstate with nonzero energy density. When the two subsystems have nearly equal volumes, we find a universal correction to the entanglement entropy that is proportional to the square root of the system's heat capacity (or a sum of capacities, if there are conserved quantities in addition to energy). This phenomenon was first noted by Vidmar and Rigol in a specific system; our analysis shows that it is generic, and expresses it in terms of thermodynamic properties of the system. Our conclusions are based on a refined version of a model of a chaotic eigenstate originally due to Deutsch, and analyzed more recently by Lu and Grover.

categories: cond-mat.stat-mech cond-mat.quant-gas cond-mat.str-el hep-th quant-ph


title: Assessing the effects of exposure to sulfuric acid aerosol on respiratory function in adults

abstract: Sulfuric acid aerosol is suspected to be a major contributor to mortality and morbidity associated with air pollution. The objective of the study is to determine if exposure of human participants to anticipated levels of sulfuric acid aerosol ($\sim 100\mu g/m^3 $) in the near future would have an adverse effect on respiratory function. We used data from 28 adults exposed to sulfuric acid for 4 hours in a controlled exposure chamber over a 3 day period with repeated measures of pulmonary function (FEV1) recorded at 2-hour intervals. Measurements were also recorded after 2 and 24 hours post exposure. We formulated a linear mixed effect model for FEV1 with fixed effects (day of treatment, hour, day-hour interaction, and smoking status), a random intercept and an AR1 covariance structure to estimate the effect of aerosol exposure on FEV1. We further assessed whether smoking status modified the exposure effects and compared the analysis to the method used by Kerr et al.,1981. The findings of the study show that the effect of day 3 exposure is negatively associated with lung function (coefficient ($\beta$), -0.08; 95% CI, -0.16 to -0.01). A weak negative association is also observed with increasing hours of exposure ($\beta$, -0.01; 95% CI, -0.03 to 0.00). Among the smokers, we found a significant negative association with hours of exposure ($\beta$, -0.02; 95% CI, -0.03 to -0.00), day 3 exposure ($\beta$, -0.11; 95% CI, -0.14 to -0.02) and a borderline adverse effect for day 2 treatment ($\beta$, -0.06; 95% CI, -0.14 to 0.03) whilst no significant association was observed for nonsmokers. In conclusion, anticipated deposits of sulfuric acid aerosol in the near would adversely affect respiratory function. The effect observed in smokers is significantly more adverse than in nonsmokers.


title: Thermodynamic Bounds on Coherent Transport in Periodically Driven Conductors

abstract: Periodically driven coherent conductors provide a universal platform for the development of quantum transport devices. Here, we lay down a comprehensive theory to describe the thermodynamics of these systems. We first focus on moderate thermo-electrical biases and low driving frequencies. For this linear response regime, we establish generalized Onsager-Casimir relations and an extended fluctuation-dissipation theorem. Furthermore, we derive a family of thermodynamic bounds proving that any local matter or heat current puts a non-trivial lower limit on the overall dissipation rate of a coherent transport process. These bounds do not depend on system-specific parameters, are robust against dephasing and involve only experimentally accessible quantities. They thus provide powerful tools to optimize the performance of mesoscopic devices and for thermodynamic inference, as we demonstrate by working out three specific applications. We then show that physically transparent extensions of our bounds hold also for strong biases and high frequencies. These generalized bounds imply a thermodynamic uncertainty relation that fully accounts for quantum effects and periodic driving. Moreover, they lead to a universal and operationally accessible bound on entropy production that can be readily used for thermodynamic inference and device engineering far from equilibrium. Connecting a broad variety of topics that range from thermodynamic geometry over thermodynamic uncertainty relations to quantum engineering, our work provides a unifying thermodynamic theory of coherent transport that can be tested and utilized with current technologies.


title: Extensions to the halo occupation distribution model for more accurate clustering predictions

abstract: We test different implementations of the halo occupation distribution (HOD) model to reconstruct the spatial distribution of galaxies as predicted by a publicly available semi-analytical model (SAM). We compare the measured two-point correlation functions of the HOD mock catalogues and the SAM samples to quantify the fidelity of the reconstruction. We use fixed number density galaxy samples selected according to stellar mass or star formation rate (SFR). We develop three different schemes to populate haloes with galaxies with increasing complexity, considering the scatter of the satellite HOD as an additional parameter in the modelling. We first modify the SAM output, removing assembly bias and using a standard Navarro-Frenk-White density profile for the satellite galaxies as the target to reproduce with our HOD mocks. We find that all models give similar reproductions of the two-halo contribution to the clustering signal, but there are differences in the one-halo term. In particular, the HOD mock reproductions work equally well using either the HOD of central and satellites separately or using a model that also accounts for whether or not the haloes contain a central galaxy. We find that the HOD scatter does not have an important impact on the clustering predictions for stellar mass selected samples. For SFR selections, we obtain the most accurate results assuming a negative binomial distribution for the number of satellites in a halo. The scatter in the satellites HOD is a key consideration for HOD mock catalogues that mimic ELG or SFR selected samples in future galaxy surveys.


title: ALMA observations of A0620-00: fresh clues on the nature of quiescent black hole X-ray binary jets

abstract: We report on ALMA continuum observations of the black hole X-ray binary A0620-00, at an X-ray luminosity nine orders of magnitude sub-Eddington. The system was significantly detected at 98 GHz (at $44 \pm 7~\mu{\rm Jy}$) and only marginally at 233 GHz ($20 \pm 8~\mu{\rm Jy}$), about 40 days later. These results suggest either an optically thin sub-mm synchrotron spectrum, or highly variable sub-mm jet emission on month timescales. Although the latter appears more likely, we note that, at the time of the ALMA observations, A0620-00 was in a somewhat less active optical-IR state than during all published multi-wavelength campaigns when a flat-spectrum, partially self-absorbed jet has been suggested to extend from the radio to the mid-IR regime. Either interpretation is viable in the context of an internal shock model, where the jet's spectral shape and variability are set by the power density spectrum of the shells' Lorentz factor fluctuations. While strictly simultaneous radio-mm-IR observations are necessary to draw definitive conclusions for A0620-00, the data presented here, in combination with recent radio and sub-mm results from higher luminosity systems, demonstrate that jets from black hole X-ray binaries exhibit a high level of variability - either in flux density or intrinsic spectral shape, or both - across a wide spectrum of Eddington ratios. This is not in contrast with expectations from an internal shock model, where lower jet power systems can be expected to exhibit larger fractional variability owing to an overall decrease in synchrotron absorption.


title: Multiple Exclusion Statistics

abstract: A new distribution for systems of particles in equilibrium obeying exclusion of correlated states is presented following the Haldane's state counting. It relies upon an ansatz to deal with the multiple exclusion that takes place when the states accessible to single particles are spatially correlated and it can be simultaneously excluded by more than one particle. The Haldane's statistics and Wu's distribution are recovered in the limit of non-correlated states of the multiple exclusion statistics. In addition, an exclusion spectrum function $\mathcal{G}(n)$ is introduced to account for the dependence of the state exclusion on the occupation-number $n$. Results of thermodynamics and state occupation are shown for ideal lattice gases of linear particles of size $k$ ($k$-mers) where multiple exclusion occurs. Remarkable agreement is found with Grand-Canonical Monte Carlo simulations from $k$=2 to 10 where multiple exclusion dominates as $k$ increases.


title: Transfer Learning for Ultrasound Tongue Contour Extraction with Different Domains

abstract: Medical ultrasound technology is widely used in routine clinical applications such as disease diagnosis and treatment as well as other applications like real-time monitoring of human tongue shapes and motions as visual feedback in second language training. Due to the low-contrast characteristic and noisy nature of ultrasound images, it might require expertise for non-expert users to recognize tongue gestures. Manual tongue segmentation is a cumbersome, subjective, and error-prone task. Furthermore, it is not a feasible solution for real-time applications. In the last few years, deep learning methods have been used for delineating and tracking tongue dorsum. Deep convolutional neural networks (DCNNs), which have shown to be successful in medical image analysis tasks, are typically weak for the same task on different domains. In many cases, DCNNs trained on data acquired with one ultrasound device, do not perform well on data of varying ultrasound device or acquisition protocol. Domain adaptation is an alternative solution for this difficulty by transferring the weights from the model trained on a large annotated legacy dataset to a new model for adapting on another different dataset using fine-tuning. In this study, after conducting extensive experiments, we addressed the problem of domain adaptation on small ultrasound datasets for tongue contour extraction. We trained a U-net network comprises of an encoder-decoder path from scratch, and then with several surrogate scenarios, some parts of the trained network were fine-tuned on another dataset as the domain-adapted networks. We repeat scenarios from target to source domains to find a balance point for knowledge transfer from source to target and vice versa. The performance of new fine-tuned networks was evaluated on the same task with images from different domains.

categories: cs.LG cs.CL cs.SD eess.AS eess.IV stat.ML


title: Linking dissipation, anisotropy and intermittency in rotating stratified turbulence

abstract: Analyzing a large data base of high-resolution three-dimensional direct numerical simulations of decaying rotating stratified flows, we show that anomalous mixing and dissipation, marked anisotropy, and strong intermittency are all observed simultaneously in an intermediate regime of parameters in which both waves and eddies interact nonlinearly. A critical behavior governed by the stratification occurs at Richardson numbers of order unity, and with the flow close to being in a state of instability. This confirms the central dynamical role, in rotating stratified turbulence, of large-scale intermittency, which occurs in the vertical velocity and temperature fluctuations, as an adjustment mechanism of the energy transfer in the presence of strong waves.


title: Closed-form expressions for Farhi's constant and related integrals and its generalization

abstract: In a recent work, Farhi developed a Fourier series expansion for the function $\,\ln{\Gamma(x)}\,$ on the interval $(0,1)$, which allowed him to derive a nice formula for the constant $\,\eta := 2 \int_0^1{\ln{\Gamma(x)} \, \sin{(2 \pi x)} \, dx}$. At the end of that paper, he asks whether $\eta$ could be written in terms of other known mathematical constants. Here in this work, after deriving a simple closed-form expression for $\eta$, I show how it can be used for evaluating other related integrals, as well as certain logarithmic series, which allows for a generalization in the form of a continuous function $\eta(x)$, $x \in [0,1]$. Finally, from the Fourier series expansion of $\,\ln{\Gamma(x)}$, $x \in (0,1)$, I make use of Parseval's theorem to derive a closed-form expression for $\,\int_0^1{\ln^2{\Gamma(x)}~dx}$.


title: Meta-Learning Neural Bloom Filters

abstract: There has been a recent trend in training neural networks to replace data structures that have been crafted by hand, with an aim for faster execution, better accuracy, or greater compression. In this setting, a neural data structure is instantiated by training a network over many epochs of its inputs until convergence. In applications where inputs arrive at high throughput, or are ephemeral, training a network from scratch is not practical. This motivates the need for few-shot neural data structures. In this paper we explore the learning of approximate set membership over a set of data in one-shot via meta-learning. We propose a novel memory architecture, the Neural Bloom Filter, which is able to achieve significant compression gains over classical Bloom Filters and existing memory-augmented neural networks.


title: Determining the average prompt-fission-neutron multiplicity for $^{239}$Pu($n$,$f$) via a $^{240}$Pu($\alpha$,$\alpha^{\prime}f$) surrogate reaction

abstract: The average prompt-fission-neutron multiplicity $\bar{\nu}$ is of significance in the areas of nuclear theory, nuclear nonproliferation, and nuclear energy. In this work, the surrogate-reaction method has been used for the first time to indirectly determine $\bar{\nu}$ for $^{239}$Pu($n$,$f$) via $^{240}$Pu($\alpha$,$\alpha^{\prime}f$) reactions. A $^{240}$Pu target was bombarded with a beam of 53.9-MeV $\alpha$ particles. Scattered $\alpha$ particles, fission products, and neutrons were measured with the NeutronSTARS detector array. Values of $\bar{\nu}$ were obtained for a continuous range of equivalent incident neutron energies between 0.25--26.25~MeV, and the results agree well with direct neutron measurements.


title: Semantic-guided Encoder Feature Learning for Blurry Boundary Delineation

abstract: Encoder-decoder architectures are widely adopted for medical image segmentation tasks. With the lateral skip connection, the models can obtain and fuse both semantic and resolution information in deep layers to achieve more accurate segmentation performance. However, in many applications (e.g., blurry boundary images), these models often cannot precisely locate complex boundaries and segment tiny isolated parts. To solve this challenging problem, we firstly analyze why simple skip connections are not enough to help accurately locate indistinct boundaries and argue that it is due to the fuzzy information in the skip connection provided in the encoder layers. Then we propose a semantic-guided encoder feature learning strategy to learn both high resolution and rich semantic encoder features so that we can more accurately locate the blurry boundaries, which can also enhance the network by selectively learning discriminative features. Besides, we further propose a soft contour constraint mechanism to model the blurry boundary detection. Experimental results on real clinical datasets show that our proposed method can achieve state-of-the-art segmentation accuracy, especially for the blurry regions. Further analysis also indicates that our proposed network components indeed contribute to the improvement of performance. Experiments on additional datasets validate the generalization ability of our proposed method.


title: Secondary atomization of liquid columns in compressible crossflows

abstract: The secondary atomization of liquid droplets is a common physical phenomenon in many industrial and engineering applications. Atomization in high speed compressible flows is less well understood than its more frequently studied low Mach number counterpart. The key to understanding the mechanisms of secondary atomization is examination of the breakup characteristics and droplet trajectories across a range of physical conditions. In this study, a planar shock wave impacting a cylindrical water column ($\rho_l=1000 \rm~kg/m^3$) is simulated for a range of Weber numbers ranging three orders of magnitude ($\sim 10^0-10^3$). Four different incident shock speeds are simulated ($M_s=1.47, 2, 2.5, 3$) which induce subsonic, transonic, and supersonic crossflow across the column. The flowfield is solved using a compressible multicomponent Navier-Stokes solver with capillary forces. Fluid immiscibility is maintained with an interface sharpening scheme. Overall, a diverse range of complex interface dynamics are captured across the range of physical conditions studied. Additionally, while the unsteady drag coefficient of the liquid column shows a dependence on the Weber number using the undeformed diameter, calculations using the deformed diameter significantly reduce the dependence, particularly for the supersonic cases, with implications for subgrid droplet modeling in atomization simulations. A preliminary under-resolved three-dimensional simulation of droplet breakup shows reasonable agreement with experimental data, indicating the potential of the numerical approach for future investigations.


title: Odd Order Group Actions on Alternating Knots

abstract: Let K be a an alternating prime knot in the 3-sphere. We investigate the category of flypes between reduced alternating diagrams for K. As a consequence, we show that any odd prime order action on K is isotopic through maps of pairs to a single flype. This implies that for any odd prime order action on K there is either a reduced alternating periodic diagram or a reduced alternating free periodic diagram. Finally, we deduce that the quotient of an odd periodic alternating knot is also alternating.


title: Associative Convolutional Layers

abstract: Motivated by the necessity for parameter efficiency in distributed machine learning and AI-enabled edge devices, we provide a general and easy to implement method for significantly reducing the number of parameters of Convolutional Neural Networks (CNNs), during both the training and inference phases. We introduce a simple auxiliary neural network which can generate the convolutional filters of any CNN architecture from a low dimensional latent space. This auxiliary neural network, which we call "Convolutional Slice Generator" (CSG), is unique to the network and provides the association between its convolutional layers. During the training of the CNN, instead of training the filters of the convolutional layers, only the parameters of the CSG and their corresponding "code vectors" are trained. This results in a significant reduction of the number of parameters due to the fact that the CNN can be fully represented using only the parameters of the CSG, the code vectors, the fully connected layers, and the architecture of the CNN. We evaluate our approach by applying it to ResNet and DenseNet models when trained on CIFAR-10 and ImageNet datasets. While reducing the number of parameters by $\approx 2 \times$ on average, the accuracies of these networks remain within 1$\%$ of their original counterparts and in some cases there is an increase in the accuracy.


title: Estimation of 2D Velocity Model using Acoustic Signals and Convolutional Neural Networks

abstract: The parameters estimation of a system using indirect measurements over the same system is a problem that occurs in many fields of engineering, known as the inverse problem. It also happens in the field of underwater acoustic, especially in mediums that are not transparent enough. In those cases, shape identification of objects using only acoustic signals is a challenge because it is carried out with information of echoes that are produced by objects with different densities from that of the medium. In general, these echoes are difficult to understand since their information is usually noisy and redundant. In this paper, we propose a model of convolutional neural network with an Encoder-Decoder configuration to estimate both localization and shape of objects, which produce reflected signals. This model allows us to obtain a 2D velocity model. The model was trained with data generated by the finite-difference method, and it achieved a value of 98.58% in the intersection over union metric 75.88% in precision and 64.69% in sensibility.


title: Linear recurrences indexed by $\mathbb{Z}$

abstract: This note considers linear recurrences (also called linear difference equations) in unknowns indexed by the integers. We characterize a unique \emph{reduced} linear recurrence with the same solutions as a given linear recurrence, and construct a \emph{solution matrix} which parametrizes the space of solutions. Several properties of solution matrices are shown, including a combinatorial characterization of bases and dimension of the space of solutions.


title: Online Object Representations with Contrastive Learning

abstract: We propose a self-supervised approach for learning representations of objects from monocular videos and demonstrate it is particularly useful in situated settings such as robotics. The main contributions of this paper are: 1) a self-supervising objective trained with contrastive learning that can discover and disentangle object attributes from video without using any labels; 2) we leverage object self-supervision for online adaptation: the longer our online model looks at objects in a video, the lower the object identification error, while the offline baseline remains with a large fixed error; 3) to explore the possibilities of a system entirely free of human supervision, we let a robot collect its own data, train on this data with our self-supervise scheme, and then show the robot can point to objects similar to the one presented in front of it, demonstrating generalization of object attributes. An interesting and perhaps surprising finding of this approach is that given a limited set of objects, object correspondences will naturally emerge when using contrastive learning without requiring explicit positive pairs. Videos illustrating online object adaptation and robotic pointing are available at: https://online-objects.github.io/.


title: Bell's Theorem and Locally-Mediated Reformulations of Quantum Mechanics

abstract: Bell's Theorem rules out many potential reformulations of quantum mechanics, but within a generalized framework, it does not exclude all "locally-mediated" models. Such models describe the correlations between entangled particles as mediated by intermediate parameters which track the particle world-lines and respect Lorentz covariance. These locally-mediated models require the relaxation of an arrow-of-time assumption which is typically taken for granted. Specifically, some of the mediating parameters in these models must functionally depend on measurement settings in their future, i.e., on input parameters associated with later times. This option (often called "retrocausal") has been repeatedly pointed out in the literature, but the exploration of explicit locally-mediated toy-models capable of describing specific entanglement phenomena has begun only in the past decade. A brief survey of such models is included here. These models provide a continuous and consistent description of events associated with spacetime locations, with aspects that are solved "all-at-once" rather than unfolding from the past to the future. The tension between quantum mechanics and relativity which is usually associated with Bell's Theorem does not occur here. Unlike conventional quantum models, the number of parameters needed to specify the state of a system does not grow exponentially with the number of entangled particles. The promise of generalizing such models to account for all quantum phenomena is identified as a grand challenge.


title: The shape of shortest paths in random spatial networks

abstract: In the classic model of first passage percolation, for pairs of vertices separated by a Euclidean distance $L$, geodesics exhibit deviations from their mean length $L$ that are of order $L^\chi$, while the transversal fluctuations, known as wandering, grow as $L^\xi$. We find that when weighting edges directly with their Euclidean span in various spatial network models, we have two distinct classes defined by different exponents $\xi=3/5$ and $\chi = 1/5$, or $\xi=7/10$ and $\chi = 2/5$, depending only on coarse details of the specific connectivity laws used. Also, the travel time fluctuations are Gaussian, rather than Tracy-Widom, which is rarely seen in first passage models. The first class contains proximity graphs such as the hard and soft random geometric graph, and the $k$-nearest neighbour random geometric graphs, where via Monte Carlo simulations we find $\xi=0.60\pm 0.01$ and $\chi = 0.20\pm 0.01$, showing a theoretical minimal wandering. The second class contains graphs based on excluded regions such as $\beta$-skeletons and the Delaunay triangulation and are characterised by the values $\xi=0.70\pm 0.01$ and $\chi = 0.40\pm 0.01$, with a nearly theoretically maximal wandering exponent. We also show numerically that the KPZ relation $\chi = 2\xi -1$ is satisfied for all these models. These results shed some light on the Euclidean first passage process, but also raise some theoretical questions about the scaling laws and the derivation of the exponent values, and also whether a model can be constructed with maximal wandering, or non-Gaussian travel fluctuations, while embedded in space.

categories: cond-mat.stat-mech cond-mat.dis-nn math.PR physics.soc-ph


title: Many-body effects in strongly-disordered III-nitride quantum wells: interplay between carrier localization and Coulomb interaction

abstract: The joint impact of Anderson localization and many-body interaction is observed in the optical properties of strongly-disordered III-nitride quantum wells, a system where the Coulomb interaction and the fluctuating potential are pronounced effects with similar magnitude. A numerical method is introduced to solve the 6-dimensional coupled Schrodinger equation in the presence of disorder and Coulomb interaction, a challenging numerical task. It accurately reproduces the measured absorption and luminescence dynamics of InGaN quantum wells at room-temperature: absorption spectra reveal the existence of a broadened excitonic peak, and carrier lifetime measurements show that luminescence departs from a conventional bimolecular behavior. These results reveal that luminescence is governed by the interplay between localization and Coulomb interaction, and provide practical insight in the physics of modern light-emitting diodes.


title: Spectral fluctuation analysis of ionospheric inhomogeneities over Brazilian territory Part II: E-F valley region plasma instabilities

abstract: The turbulent-like process associated with ionospheric instabilities, has been identified as the main nonlinear process that drives the irregularities observed in the different ionospheric regions. In this complementary study, as proposed in the first article of this two-paper series [Fornari et al., Adv. Space Res. 58, 2016], we performed the detrended fluctuation analysis of the equatorial E-F valley region electron density fluctuations measured from an in situ experiment performed over the Brazilian territory. The spectral consistency with the K41 turbulent universality class is analyzed for E-F valley region from the DFA spectra for four electron density time series. A complementary detrended fluctuation analysis for four time series of the F-layer electric field is also presented. Consistent with the results obtained for the F region, the analysis for the E-F valley region also shows a very high spectral variation ($\gg50\%$). Thus, the spectral analysis performed in both parts of the series suggest that a process such as the homogeneous turbulence K41 ($\beta =-5/3\pm 2\%$) is inappropriate to describe both the fluctuations of electron density and the electric field associated with the main ionospheric instabilities.


title: Cosmic Ray Spectrum and Composition from PeV to EeV Using 3 Years of Data From IceTop and IceCube

abstract: We report on measurements of the all-particle cosmic ray energy spectrum and composition in the PeV to EeV energy range using three years of data from the IceCube Neutrino Observatory. The IceTop detector measures cosmic ray induced air showers on the surface of the ice, from which the energy spectrum of cosmic rays is determined by making additional assumptions about the mass composition. A separate measurement is performed when IceTop data are analyzed in coincidence with the high-energy muon energy loss information from the deep in-ice IceCube detector. In this measurement, both the spectrum and the mass composition of the primary cosmic rays are simultaneously reconstructed using a neural network trained on observables from both detectors. The performance and relative advantages of these two distinct analyses are discussed, including the systematic uncertainties and the dependence on the hadronic interaction models, and both all-particle spectra as well as individual spectra for elemental groups are presented.


title: A characterisation of Baer subplanes

abstract: Let $K$ be a set of $q^2+2q+1$ points in $PG(4,q)$. We show that if every 3-space meets $K$ in either one, two or three lines, a line and a non-degenerate conic, or a twisted cubic, then $K$ is a ruled cubic surface. Moreover, $K$ corresponds via the Bruck-Bose representation to a tangent Baer subplane of $PG(2,q^2)$. We use this to prove a characterisation in $PG(2,q^2)$ of a set of points $B$ as a tangent Baer subplane by looking at the intersections of $B$ with Baer-pencils.


title: A ruled quintic surface in $PG(6,q)$

abstract: In this article we look at a scroll of $PG(6,q)$ that uses a projectivity to rule a conic and a twisted cubic. We show this scroll is a ruled quintic surface $\mathcal V^5_2$, and study its geometric properties. The motivation in studying this scroll lies in its relationship with an $\mathbb F_q$-subplane of $PG(2,q^3)$ via the Bruck-Bose representation.


title: The metallicity sensitivity of a surface brightness temperature scale

abstract: To obtain the accuracy now sought in the extragalactic distance scale through standard candles and rulers, calibration of stellar photometry must be improved. The sensitivity of the V-K color surface brightness relation is examined here by means of model atmosphere fluxes. It has previously been neglected, but is shown here to be a significant term in the error budget of a recent high precision distance of the Large Magellanic Cloud, an anchor in galaxy distances based on Cepheids.


title: Efficiently escaping saddle points on manifolds

abstract: Smooth, non-convex optimization problems on Riemannian manifolds occur in machine learning as a result of orthonormality, rank or positivity constraints. First- and second-order necessary optimality conditions state that the Riemannian gradient must be zero, and the Riemannian Hessian must be positive semidefinite. Generalizing Jin et al.'s recent work on perturbed gradient descent (PGD) for optimization on linear spaces [How to Escape Saddle Points Efficiently (2017), Stochastic Gradient Descent Escapes Saddle Points Efficiently (2019)], we propose a version of perturbed Riemannian gradient descent (PRGD) to show that necessary optimality conditions can be met approximately with high probability, without evaluating the Hessian. Specifically, for an arbitrary Riemannian manifold $\mathcal{M}$ of dimension $d$, a sufficiently smooth (possibly non-convex) objective function $f$, and under weak conditions on the retraction chosen to move on the manifold, with high probability, our version of PRGD produces a point with gradient smaller than $\epsilon$ and Hessian within $\sqrt{\epsilon}$ of being positive semidefinite in $O((\log{d})^4 / \epsilon^{2})$ gradient queries. This matches the complexity of PGD in the Euclidean case. Crucially, the dependence on dimension is low. This matters for large-scale applications including PCA and low-rank matrix completion, which both admit natural formulations on manifolds. The key technical idea is to generalize PRGD with a distinction between two types of gradient steps: "steps on the manifold" and "perturbed steps in a tangent space of the manifold." Ultimately, this distinction makes it possible to extend Jin et al.'s analysis seamlessly.


title: Likelihood Evaluation of Jump-Diffusion Models Using Deterministic Nonlinear Filters

abstract: In this study, we develop a deterministic nonlinear filtering algorithm based on a high-dimensional version of Kitagawa (1987) to evaluate the likelihood function of models that allow for stochastic volatility and jumps whose arrival intensity is also stochastic. We show numerically that the deterministic filtering method is precise and much faster than the particle filter, in addition to yielding a smooth function over the parameter space. We then find the maximum likelihood estimates of various models that include stochastic volatility, jumps in the returns and variance, and also stochastic jump arrival intensity with the S&P 500 daily returns. During the Great Recession, the jump arrival intensity increases significantly and contributes to the clustering of volatility and negative returns.


title: Word-level Speech Recognition with a Letter to Word Encoder

abstract: We propose a direct-to-word sequence model which uses a word network to learn word embeddings from letters. The word network can be integrated seamlessly with arbitrary sequence models including Connectionist Temporal Classification and encoder-decoder models with attention. We show our direct-to-word model can achieve word error rate gains over sub-word level models for speech recognition. We also show that our direct-to-word approach retains the ability to predict words not seen at training time without any retraining. Finally, we demonstrate that a word-level model can use a larger stride than a sub-word level model while maintaining accuracy. This makes the model more efficient both for training and inference.


title: Adaptively Preconditioned Stochastic Gradient Langevin Dynamics

abstract: Stochastic Gradient Langevin Dynamics infuses isotropic gradient noise to SGD to help navigate pathological curvature in the loss landscape for deep networks. Isotropic nature of the noise leads to poor scaling, and adaptive methods based on higher order curvature information such as Fisher Scoring have been proposed to precondition the noise in order to achieve better convergence. In this paper, we describe an adaptive method to estimate the parameters of the noise and conduct experiments on well-known model architectures to show that the adaptively preconditioned SGLD method achieves convergence with the speed of adaptive first order methods such as Adam, AdaGrad etc. and achieves generalization equivalent of SGD in the test set.


title: Equitable factorizations of edge-connected graphs

abstract: In this paper, we show that every $(3k-3)$-edge-connected graph $G$, under a certain condition on whose degrees, can be edge-decomposed into $k$ factors $G_1,\ldots, G_k$ such that for each vertex $v\in V(G_i)$, $|d_{G_i}(v)-d_G(v)/k|< 1$, where $1\le i\le k$. As application, we deduce that every $6$-edge-connected graph $G$ can be edge-decomposed into three factors $G_1$, $G_2$, and $G_3$ such that for each vertex $v\in V(G_i)$, $|d_{G_i}(v)-d_{G}(v)/3|< 1$, unless $G$ has exactly one vertex $z$ with $d_G(z) \stackrel{3}{\not\equiv}0$. Next, we show that every odd-$(3k-2)$-edge-connected graph $G$ can be edge-decomposed into $k$ factors $G_1,\ldots, G_k$ such that for each vertex $v\in V(G_i)$, $d_{G_i}(v)$ and $d_G(v)$ have the same parity and $|d_{G_i}(v)-d_G(v)/k|< 2$, where $k$ is an odd positive integer and $1\le i\le k$. Finally, we give a sufficient edge-connectivity condition for a graph $G$ to have a parity factor $F$ with specified odd-degree vertices such that for each vertex $v$, $| d_{F}(v)-\varepsilon d_G(v)|< 2$, where $\varepsilon $ is a real number with $0< \varepsilon < 1$.


title: Top-Hat Spherical Collapse with Clustering Dark Energy. I. Radius Evolution and Critical Contrast Density

abstract: Understanding the influence of dark energy on the formation of structures is currently a major challenge in Cosmology, since it can distinguish otherwise degenerated viable models. In this work we consider the Top-Hat Spherical-Collapse (SC) model with dark energy, which can partially (or totally) cluster, according to a free parameter $\gamma$. The {\it lack of} energy conservation has to be taken into account accordingly, as we will show. We determine characteristic quantities for the SC model, such as the critical contrast density and radius evolution, with particular emphasis on their dependence on the clustering parameter $\gamma$.


title: Low Rank Approximation at Sublinear Cost

abstract: Low Rank Approximation (LRA) of an m-by-n matrix is a hot research subject, fundamental for Matrix and Tensor Computations and Big Data Mining and Analysis. Computations with LRA can be performed at sublinear cost -- by using much fewer than mn memory cells and arithmetic operations, but can we compute LRA at sublinear cost? Yes and no. No, because spectral, Frobenius, and all other norms of the error matrix of LRA output by any sublinear cost deterministic or randomized algorithm exceed their minimal values for LRA by infinitely large factors for the worst case input and even for the inputs from the small families of our Appendix. Yes, because for about two decades Cross-Approximation (C-A) iterations, running at sublinear cost, have been consistently computing close LRA worldwide. We provide new insight into that "yes" and "no" coexistence by identifying C-A iterations as recursive sketching algorithms for LRA that use sampling test matrices and run at sublinear cost. As we prove in good accordance with our numerical tests, already at a single recursive step they compute close LRA. except for a narrow class of hard inputs, which tends to shrink in the recursive process. We also discuss enhancing the power of sketching by means of using leverage scores.


title: Importance Resampling for Off-policy Prediction

abstract: Importance sampling (IS) is a common reweighting strategy for off-policy prediction in reinforcement learning. While it is consistent and unbiased, it can result in high variance updates to the weights for the value function. In this work, we explore a resampling strategy as an alternative to reweighting. We propose Importance Resampling (IR) for off-policy prediction, which resamples experience from a replay buffer and applies standard on-policy updates. The approach avoids using importance sampling ratios in the update, instead correcting the distribution before the update. We characterize the bias and consistency of IR, particularly compared to Weighted IS (WIS). We demonstrate in several microworlds that IR has improved sample efficiency and lower variance updates, as compared to IS and several variance-reduced IS strategies, including variants of WIS and V-trace which clips IS ratios. We also provide a demonstration showing IR improves over IS for learning a value function from images in a racing car simulator.


title: Federated Learning for Emoji Prediction in a Mobile Keyboard

abstract: We show that a word-level recurrent neural network can predict emoji from text typed on a mobile keyboard. We demonstrate the usefulness of transfer learning for predicting emoji by pretraining the model using a language modeling task. We also propose mechanisms to trigger emoji and tune the diversity of candidates. The model is trained using a distributed on-device learning framework called federated learning. The federated model is shown to achieve better performance than a server-trained model. This work demonstrates the feasibility of using federated learning to train production-quality models for natural language understanding tasks while keeping users' data on their devices.


title: General Linear Group Action on Tensors: A Candidate for Post-Quantum Cryptography

abstract: Starting from the one-way group action framework of Brassard and Yung (Crypto '90), we revisit building cryptography based on group actions. Several previous candidates for one-way group actions no longer stand, due to progress both on classical algorithms (e.g., graph isomorphism) and quantum algorithms (e.g., discrete logarithm). We propose the general linear group action on tensors as a new candidate to build cryptography based on group actions. Recent works (Futorny--Grochow--Sergeichuk, Lin. Alg. Appl., 2019) suggest that the underlying algorithmic problem, the tensor isomorphism problem, is the hardest one among several isomorphism testing problems arising from areas including coding theory, computational group theory, and multivariate cryptography. We present evidence to justify the viability of this proposal from comprehensive study of the state-of-art heuristic algorithms, theoretical algorithms, and hardness results, as well as quantum algorithms. We then introduce a new notion called pseudorandom group actions to further develop group-action based cryptography. Briefly speaking, given a group $G$ acting on a set $S$, we assume that it is hard to distinguish two distributions of $(s, t)$ either uniformly chosen from $S\times S$, or where $s$ is randomly chosen from $S$ and $t$ is the result of applying a random group action of $g\in G$ on $s$. This subsumes the classical decisional Diffie-Hellman assumption when specialized to a particular group action. We carefully analyze various attack strategies that support the general linear group action on tensors as a candidate for this assumption. Finally, we establish the quantum security of several cryptographic primitives based on the one-way group action assumption and the pseudorandom group action assumption.


title: Parallel Scheduled Sampling

abstract: Auto-regressive models are widely used in sequence generation problems. The output sequence is typically generated in a predetermined order, one discrete unit (pixel or word or character) at a time. The models are trained by teacher-forcing where ground-truth history is fed to the model as input, which at test time is replaced by the model prediction. Scheduled Sampling aims to mitigate this discrepancy between train and test time by randomly replacing some discrete units in the history with the model's prediction. While teacher-forced training works well with ML accelerators as the computation can be parallelized across time, Scheduled Sampling involves undesirable sequential processing. In this paper, we introduce a simple technique to parallelize Scheduled Sampling across time. Experimentally, we find the proposed technique leads to equivalent or better performance on image generation, summarization, dialog generation, and translation compared to teacher-forced training. In dialog response generation task, Parallel Scheduled Sampling achieves 1.6 BLEU score (11.5%) improvement over teacher-forcing while in image generation it achieves 20% and 13.8% improvement in Frechet Inception Distance (FID) and Inception Score (IS) respectively. Further, we discuss the effects of different hyper-parameters associated with Scheduled Sampling on the model performance.


title: A Novel Discrete Theory of a Screw Dislocation in the BCC Crystal Lattice

abstract: In this paper, we proposed a novel method using the elementary number theory to investigate the discrete nature of the screw dislocations in crystal lattices, simple cubic (SC) lattice and body centered cubic (BCC) lattice, by developing the algebraic description of the dislocations in the previous report (Hamada, Matsutani, Nakagawa, Saeki, Uesaka, Pacific J. Math.~for Industry {\bf{10}} (2018), 3). Using the method, we showed that the stress energy of the screw dislocations in the BCC lattice and the SC lattice are naturally described; the energy of the BCC lattice was expressed by the truncated Epstein-Hurwitz zeta function of the Eisenstein integers, whereas that of SC lattice is associated with the truncated Epstein-Hurwitz zeta function of the Gauss integers.

categories: math-ph cond-mat.mes-hall cond-mat.stat-mech math.MP physics.atm-clus


title: Multiscale Nakagami parametric imaging for improved liver tumor localization

abstract: Effective ultrasound tissue characterization is usually hindered by complex tissue structures. The interlacing of speckle patterns complicates the correct estimation of backscatter distribution parameters. Nakagami parametric imaging based on localized shape parameter mapping can model different backscattering conditions. However, performance of the constructed Nakagami image depends on the sensitivity of the estimation method to the backscattered statistics and scale of analysis. Using a fixed focal region of interest in estimating the Nakagami parametric image would increase estimation variance. In this work, localized Nakagami parameters are estimated adaptively by means of maximum likelihood estimation on a multiscale basis. The varying size kernel integrates the goodness-of-fit of the backscattering distribution parameters at multiple scales for more stable parameter estimation. Results show improved quantitative visualization of changes in tissue specular reflections, suggesting a potential approach for improving tumor localization in low contrast ultrasound images.


title: FAMED-Net: A Fast and Accurate Multi-scale End-to-end Dehazing Network

abstract: Single image dehazing is a critical image pre-processing step for subsequent high-level computer vision tasks. However, it remains challenging due to its ill-posed nature. Existing dehazing models tend to suffer from model overcomplexity and computational inefficiency or have limited representation capacity. To tackle these challenges, here we propose a fast and accurate multi-scale end-to-end dehazing network called FAMED-Net, which comprises encoders at three scales and a fusion module to efficiently and directly learn the haze-free image. Each encoder consists of cascaded and densely connected point-wise convolutional layers and pooling layers. Since no larger convolutional kernels are used and features are reused layer-by-layer, FAMED-Net is lightweight and computationally efficient. Thorough empirical studies on public synthetic datasets (including RESIDE) and real-world hazy images demonstrate the superiority of FAMED-Net over other representative state-of-the-art models with respect to model complexity, computational efficiency, restoration accuracy, and cross-set generalization. The code will be made publicly available.


title: Residual Entropy and Spin Fractionalizations in the Mixed-Spin Kitaev Model

abstract: We investigate ground-state and finite temperature properties of the mixed-spin $(s, S)$ Kitaev model. When one of spins is half-integer and the other is integer, we introduce two kinds of local symmetries, which results in a macroscopic degeneracy in each energy level. Applying the exact diagonalization to several clusters with $(s, S)=(1/2, 1)$, we confirm the presence of this large degeneracy in the ground states, in contrast to the conventional Kitaev models. By means of the thermal pure quantum state technique, we calculate the specific heat, entropy, and spin-spin correlations in the system. We find that in the mixed-spin Kitaev model with $(s, S)=(1/2, 1)$, at least, the double peak structure appears in the specific heat and the plateau in the entropy at intermediate temperatures, indicating the existence of the spin fractionalization. Deducing the entropy in the mixed-spin system with $s, S\le 2$ systematically, we clarify that the smaller spin-$s$ is responsible for the thermodynamic properties at higher temperatures.


title: Magnetic Skyrmion State in Janus Monolayers of Chromium Trihalides Cr(I,X)3

abstract: Magnetic skyrmions are nano-scale spin structures that are promising for ultra-dense memory and logic devices. Recent progresses in two-dimensional magnets encourage the idea to realize skyrmionic states in freestanding monolayers. However, monolayers such as CrI3 lack Dzyaloshinskii-Moriya interactions (DMI) and thus do not naturally exhibit skyrmions but rather a ferromagnetic state. Here we propose the fabrication of Cr(I,X)3 Janus monolayers, in which the Cr atoms are covalently bonded to the underlying I ions and top-layer Br or Cl atoms. By performing first-principles calculations and Monte-Carlo simulations, we identify strong enough DMI, which leads to not only helical cycloid phases, but also to intrinsic skyrmionic states in Cr(I,Br)3 and magnetic-field-induced skyrmions in Cr(I,Cl)3.


title: Intrinsic persistent spin helix in two-dimensional group-IV monochalcogenide MX (M : Sn, Ge; X: S, Se, Te) monolayer

abstract: Energy-saving spintronics are believed to be implementable on the systems hosting persistent spin helix (PSH) since they support an extraordinarily long spin lifetime of carriers. However, achieving the PSH requires a unidirectional spin configuration in the momentum space, which is practically non-trivial due to the stringent conditions for fine-tuning the Rashba and Dresselhaus spin-orbit couplings. Here, we predict that the PSH can be intrinsically achieved on a two-dimensional (2D) group-IV monochalcogenide M X monolayer, a new class of the noncentrosymmetric 2D materials having in-plane ferroelctricity. Due to the C2v point group symmetry in the MX monolayer, a unidirectional spin configuration is preserved in the out-of-plane direction and thus maintains the PSH that is similar to the [110] Dresselhaus model in the [110]-oriented quantum well. Our first-principle calculations on various MX (M : Sn, Ge; X: S, Se, Te) monolayers confirmed that such typical spin configuration is observed, in particular, at near the valence band maximum where a sizable spin splitting and a substantially small wavelength of the spin polarization are achieved. Importantly, we observe reversible out-of-plane spin orientation under opposite in-plane ferroelectric polarization, indicating that an electrically controllable PSH for spintronic applications is plausible.


title: SALT: Subspace Alignment as an Auxiliary Learning Task for Domain Adaptation

abstract: Unsupervised domain adaptation aims to transfer and adapt knowledge learned from a labeled source domain to an unlabeled target domain. Key components of unsupervised domain adaptation include: (a) maximizing performance on the target, and (b) aligning the source and target domains. Traditionally, these tasks have either been considered as separate, or assumed to be implicitly addressed together with high-capacity feature extractors. When considered separately, alignment is usually viewed as a problem of aligning data distributions, either through geometric approaches such as subspace alignment or through distributional alignment such as optimal transport. This paper represents a hybrid approach, where we assume simplified data geometry in the form of subspaces, and consider alignment as an auxiliary task to the primary task of maximizing performance on the source. The alignment is made rather simple by leveraging tractable data geometry in the form of subspaces. We synergistically allow certain parameters derived from the closed-form auxiliary solution, to be affected by gradients from the primary task. The proposed approach represents a unique fusion of geometric and model-based alignment with gradients from a data-driven primary task. Our approach termed SALT, is a simple framework that achieves comparable or sometimes outperforms state-of-the-art on multiple standard benchmarks.


title: Resistance distance-based graph invariants and spanning trees of graphs derived from the strong product of $P_2$ and $C_n$

abstract: Let $G_n$ be a graph obtained by the strong product of $P_2$ and $C_n$, where $n\geqslant3$. In this paper, explicit expressions for the Kirchhoff index, multiplicative degree-Kirchhoff index and number of spanning trees of $G_n$ are determined, respectively. It is surprising to find that the Kirchhoff (resp. multiplicative degree-Kirchhoff) index of $G_n$ is almost one-sixth of its Wiener (resp. Gutman) index. Moreover, let $\mathcal{G}^r_n$ be the set of subgraphs obtained from $G_n$ by deleting any $r$ vertical edges of $G_n$, where $0\leqslant r\leqslant n$. Explicit formulas for the Kirchhoff index and the number of spanning trees for any graph $G^r_n\in \mathcal{G}^r_{n}$ are completely established, respectively. Finally, it is interesting to see that the Kirchhoff index of $G^r_n$ is almost one-sixth of its Wiener index.


title: Inflation in the general Poincar\'e gauge cosmology

abstract: The general Poincar\'e gauge cosmology given by a nine-parameter gravitational Lagrangian with ghost- and tachyon-free conditions is studied from the perspective of field theory. By introducing new variables for replacing two (pseudo-) scalar torsions, the Poincar\'e gauge cosmological system can be recast into a gravitational system coupled to two-scalar fields with a potential up to quartic-order. We discussed the possibility of this system producing two types of inflation without any extra inflatons. The hybrid inflation with a first-order phase transition can be ruled out, while the slow rollover can be achieved. The numerical analysis shows that the two-scalar fields system evolved in a potential well processes spontaneously four stages: "pre-inflation", slow-roll inflation with large enough e-folds, "pre-reheating" and reheating. We also studied the stableness of this system by setting large values of initial kinetic energies. The results show that even if the system evolves past the highest point of the potential well, the scalar fields can still return to the potential well and cause inflation. The general Poincar\'e gauge cosmology provides us with a self-consistent candidate of inflation.


title: What Does BERT Look At? An Analysis of BERT's Attention

abstract: Large pre-trained neural networks such as BERT have had great recent success in NLP, motivating a growing body of research investigating what aspects of language they are able to learn from unlabeled data. Most recent analysis has focused on model outputs (e.g., language model surprisal) or internal vector representations (e.g., probing classifiers). Complementary to these works, we propose methods for analyzing the attention mechanisms of pre-trained models and apply them to BERT. BERT's attention heads exhibit patterns such as attending to delimiter tokens, specific positional offsets, or broadly attending over the whole sentence, with heads in the same layer often exhibiting similar behaviors. We further show that certain attention heads correspond well to linguistic notions of syntax and coreference. For example, we find heads that attend to the direct objects of verbs, determiners of nouns, objects of prepositions, and coreferent mentions with remarkably high accuracy. Lastly, we propose an attention-based probing classifier and use it to further demonstrate that substantial syntactic information is captured in BERT's attention.


title: Secure Software-Defined Networking Based on Blockchain

abstract: Software-Defined Networking (SDN) separates the network control plane and data plane, which provides a network-wide view with centralized control (in the control plane) and programmable network configuration for data plane injected by SDN applications (in the application plane). With these features, a number of drawbacks of the traditional network architectures such as static configuration, non-scalability and low efficiency can be effectively avoided. However, SDN also brings with it some new security challenges, such as single-point failure of the control plane, malicious flows from applications, exposed network-wide resources and a vulnerable channel between the control plane and the data plane. In this paper, we design a monolithic security mechanism for SDN based on Blockchain. Our mechanism decentralizes the control plane to overcome single-point failure while maintaining a network-wide view. The mechanism also guarantees the authenticity, traceability, and accountability of application flows, and hence secures the programmable configuration. Moreover, the mechanism provides a fine-grained access control of network-wide resources and a secure controller-switch channel to further protect resources and communication in SDN.


title: The K"ahler-Ricci flow with Log Canonical Singularities

abstract: We establish the existence of the K"ahler-Ricci flow on projective varieties with log canonical singularities. This generalizes some of the existence results of Song-Tian \cite{ST3} in case of projective varieties with klt singularities. We also prove that the normalized K"ahler-Ricci flow will converge to the \ka-Einstein metric with negative Ricci curvature on semi-log canonical models in the sense of currents. Finally we also construct K"ahler-Ricci flow solutions performing divisorial contractions and flips with log canonical singularities.


title: An Introduction to Combinatorics of Determinacy

abstract: This article is an introduction to combinatorics under the axiom of determinacy with a focus on partition properties and infinity Borel codes.


title: The logarithmic gauged linear sigma model

abstract: We introduce the notion of log R-maps, and develop a proper moduli stack of stable log R-maps in the case of a hybrid gauged linear sigma model. Two virtual cycles (canonical and reduced) are constructed for these moduli stacks. The main results are two comparison theorems relating the reduced virtual cycle to the cosection localized virtual cycle, as well as the reduced virtual cycle to the canonical virtual cycle. This sets the foundation of a new technique for computing higher genus Gromov-Witten invariants of complete intersections.


title: Heterogeneous network approach to predict individuals' mental health

abstract: Depression and anxiety are critical public health issues affecting millions of people around the world. To identify individuals who are vulnerable to depression and anxiety, predictive models have been built that typically utilize data from one source. Unlike these traditional models, in this study, we leverage a rich heterogeneous data set from the University of Notre Dame's NetHealth study that collected individuals' (student participants') social interaction data via smartphones, health-related behavioral data via wearables (Fitbit), and trait data from surveys. To integrate the different types of information, we model the NetHealth data as a heterogeneous information network (HIN). Then, we redefine the problem of predicting individuals' mental health conditions (depression or anxiety) in a novel manner, as applying to our HIN a popular paradigm of a recommender system (RS), which is typically used to predict the preference that a person would give to an item (e.g., a movie or book). In our case, the items are the individuals' different mental health states. We evaluate four state-of-the-art RS approaches. Also, we model the prediction of individuals' mental health as another problem type - that of node classification (NC) in our HIN, evaluating in the process four node features under logistic regression as a proof-of-concept classifier. We find that our RS and NC network methods produce more accurate predictions than a logistic regression model using the same NetHealth data in the traditional non-network fashion as well as a random-approach. Also, we find that the best of the considered RS approaches outperforms all considered NC approaches. This is the first study to integrate smartphone, wearable sensor, and survey data in an HIN manner and use RS or NC on the HIN to predict individuals' mental health conditions.


title: Likelihood-free approximate Gibbs sampling

abstract: Likelihood-free methods such as approximate Bayesian computation (ABC) have extended the reach of statistical inference to problems with computationally intractable likelihoods. Such approaches perform well for small-to-moderate dimensional problems, but suffer a curse of dimensionality in the number of model parameters. We introduce a likelihood-free approximate Gibbs sampler that naturally circumvents the dimensionality issue by focusing on lower-dimensional conditional distributions. These distributions are estimated by flexible regression models either before the sampler is run, or adaptively during sampler implementation. As a result, and in comparison to Metropolis-Hastings based approaches, we are able to fit substantially more challenging statistical models than would otherwise be possible. We demonstrate the sampler's performance via two simulated examples, and a real analysis of Airbnb rental prices using a intractable high-dimensional multivariate non-linear state space model containing 13,140 parameters, which presents a real challenge to standard ABC techniques.


title: Establishing a relativistic model for atomic gravimeters

abstract: This work establishes a high-precision relativistic theoretical model: start from studying finite speed of light effect based on a coordinate transformation, and further extend the research methods to analyze the overall relativistic effects. This model promotes the development of testing General Relativity with atomic interferometry.


title: Learning to Score Behaviors for Guided Policy Optimization

abstract: We introduce a new approach for comparing reinforcement learning policies, using Wasserstein distances (WDs) in a newly defined latent behavioral space. We show that by utilizing the dual formulation of the WD, we can learn score functions over policy behaviors that can in turn be used to lead policy optimization towards (or away from) (un)desired behaviors. Combined with smoothed WDs, the dual formulation allows us to devise efficient algorithms that take stochastic gradient descent steps through WD regularizers. We incorporate these regularizers into two novel on-policy algorithms, Behavior-Guided Policy Gradient and Behavior-Guided Evolution Strategies, which we demonstrate can outperform existing methods in a variety of challenging environments. We also provide an open source demo.


title: Anderson-Bernoulli Localization on the 3D lattice and discrete unique continuation principle

abstract: We consider the Anderson model with Bernoulli potential on the 3D lattice, and prove localization of eigenfunctions corresponding to eigenvalues near zero, the lower boundary of the spectrum. We follow the framework by Bourgain-Kenig and Ding-Smart, and our main contribution is a 3D discrete unique continuation, which says that any eigenfunction of the harmonic operator with bounded potential cannot be too small on a significant fractional portion of all the points. Its proof relies on geometric arguments about the 3D lattice.


title: Bounds on Scott Ranks of Some Polish Metric Spaces

abstract: If $\mathcal{N}$ is a proper Polish metric space and $\mathcal{M}$ is any countable dense submetric space of $\mathcal{N}$, then the Scott rank of $\mathcal{N}$ in the natural first order language of metric spaces is countable and in fact at most $\omega_1^{\mathcal{M}} + 1$, where $\omega_1^{\mathcal{M}}$ is the Church-Kleene ordinal of $\mathcal{M}$ (construed as a subset of $\omega$) which is the least ordinal with no presentation on $\omega$ computable from $\mathcal{M}$. If $\mathcal{N}$ is a rigid Polish metric space and $\mathcal{M}$ is any countable dense submetric space, then the Scott rank of $\mathcal{N}$ is countable and in fact less than $\omega_1^{\mathcal{M}}$.


title: Boosting Students' Performance With The Aid Of Social Network Analysis

abstract: There are various teaching methods developed in order to attain successful delivery of a subject without prior knowledge of the interaction among the students in a class. Social network analysis can be used to identify individual, intermediate and group measures of interaction in a classroom. The idea is on identifying ways to boost the students performance by means of lecturers intervention based on their interaction. The case study was conducted involving third year batch that consisted of 76 female and 24 male students. A friendship network was drawn based on the information obtained at the end of semester 5 and it was investigated based on two metrics namely centrality measures and Girvan Newman algorithm. At the end of semester 5, grades were added as the attributes of the network. 12 clusters were found in this batch and a distinct pattern was identified between performing and poor achieving students. At the beginning of the 6th semester, the students were given the option to choose between 2 groups. Group 1 was unperturbed without any lecturers intervention whereas the performing students clusters in Group 1 were preserved but the students in poor performing clusters were distributed among performing clusters. The students were then asked to carry out assignments and quizzes in their respective groups. The final grades indicated that the performance of the students of Group 1 was much superior and there was clear evidence that those poor performing students in the 5th semester performed much better in semester 6. This shows that by understanding the students interaction and incorporating instructors minimal intervention, the performance of the students can be improved by creating a social contagion effect through group assignment clustering.


title: Six new rapidly oscillating Ap stars in the Kepler long-cadence data using super-Nyquist asteroseismology

abstract: We perform a search for rapidly oscillating Ap stars in the Kepler long-cadence data, where true oscillations above the Nyquist limit of 283.21 {\mu}Hz can be reliably distinguished from aliases as a consequence of the barycentric time corrections applied to the Kepler data. We find evidence for rapid oscillations in six stars: KIC 6631188, KIC 7018170, KIC 10685175, KIC 11031749, KIC 11296437 and KIC 11409673, and identify each star as chemically peculiar through either pre-existing classifications or spectroscopic measurements. For each star, we identify the principal pulsation mode, and are able to observe several additional pulsation modes in KIC 7018170. We find that KIC 7018170 and KIC 11409673 both oscillate above their theoretical acoustic cutoff frequency, whilst KIC 11031749 oscillates at the cutoff frequency within uncertainty. All but KIC 11031749 exhibit strong amplitude modulation consistent with the oblique pulsator model, confirming their mode geometry and periods of rotation.


title: Dependence of outer boundary condition on protoneutron star asteroseismology with gravitational-wave signatures

abstract: To obtain the eigenfrequencies of a protoneutron star (PNS) in the postbounce phase of core-collapse supernovae (CCSNe), we perform a linear perturbation analysis of the angle-averaged PNS profiles using results from a general relativistic CCSN simulation of a $15 M_{\odot}$ star. In this work, we investigate how the choice of the outer boundary condition could affect the PNS oscillation modes in the linear analysis. By changing the density at the outer boundary of the PNS surface in a parametric manner, we show that the eigenfrequencies strongly depend on the surface density. By comparing with the gravitational wave (GW) signatures obtained in the hydrodynamics simulation, the so-called surface $g$-mode of the PNS can be well ascribed to the fundamental oscillations of the PNS. The frequency of the fundamental oscillations can be fitted by a function of the mass and radius of the PNS similar to the case of cold neutron stars. In the case that the position of the outer boundary is chosen to cover not only the PNS but also the surrounding postshock region, we obtain the eigenfrequencies close to the modulation frequencies of the standing accretion-shock instability (SASI). However, we point out that these oscillation modes are unlikely to have the same physical origin of the SASI modes seen in the hydrodynamics simulation. We discuss possible limitations of applying the angle-averaged, linear perturbation analysis to extract the full ingredients of the CCSN GW signatures.


title: Learning Powerful Policies by Using Consistent Dynamics Model

abstract: Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based approaches lead to `compounding errors' when the model is unrolled step by step. Essentially, the state transitions that the learner predicts (by unrolling the model for multiple steps) and the state transitions that the learner experiences (by acting in the environment) may not be consistent. There is enough evidence that humans build a model of the environment, not only by observing the environment but also by interacting with the environment. Interaction with the environment allows humans to carry out experiments: taking actions that help uncover true causal relationships which can be used for building better dynamics models. Analogously, we would expect such interactions to be helpful for a learning agent while learning to model the environment dynamics. In this paper, we build upon this intuition by using an auxiliary cost function to ensure consistency between what the agent observes (by acting in the real world) and what it imagines (by acting in the `learned' world). We consider several tasks - Mujoco based control tasks and Atari games - and show that the proposed approach helps to train powerful policies and better dynamics models.


title: Ultra Fast Medoid Identification via Correlated Sequential Halving

abstract: The medoid of a set of n points is the point in the set that minimizes the sum of distances to other points. It can be determined exactly in O(n^2) time by computing the distances between all pairs of points. Previous works show that one can significantly reduce the number of distance computations needed by adaptively querying distances. The resulting randomized algorithm is obtained by a direct conversion of the computation problem to a multi-armed bandit statistical inference problem. In this work, we show that we can better exploit the structure of the underlying computation problem by modifying the traditional bandit sampling strategy and using it in conjunction with a suitably chosen multi-armed bandit algorithm. Four to five orders of magnitude gains over exact computation are obtained on real data, in terms of both number of distance computations needed and wall clock time. Theoretical results are obtained to quantify such gains in terms of data parameters. Our code is publicly available online at https://github.com/TavorB/Correlated-Sequential-Halving.


title: Contextual Documentation Referencing on Stack Overflow

abstract: Software engineering is knowledge-intensive and requires software developers to continually search for knowledge, often on community question answering platforms such as Stack Overflow. Such information sharing platforms do not exist in isolation, and part of the evidence that they exist in a broader software documentation ecosystem is the common presence of hyperlinks to other documentation resources found in forum posts. With the goal of helping to improve the information diffusion between Stack Overflow and other documentation resources, we conducted a study to answer the question of how and why documentation is referenced in Stack Overflow threads. We sampled and classified 759 links from two different domains, regular expressions and Android development, to qualitatively and quantitatively analyze the links' context and purpose, including attribution, awareness, and recommendations. We found that links on Stack Overflow serve a wide range of distinct purposes, ranging from citation links attributing content copied into Stack Overflow, over links clarifying concepts using Wikipedia pages, to recommendations of software components and resources for background reading. This purpose spectrum has major corollaries, including our observation that links to documentation resources are a reflection of the information needs typical to a technology domain. We contribute a framework and method to analyze the context and purpose of Stack Overflow links, a public dataset of annotated links, and a description of five major observations about linking practices on Stack Overflow. We further point to potential tool support to enhance the information diffusion between Stack Overflow and other documentation resources.