title: Safe, Efficient, and Comfortable Velocity Control based on Reinforcement Learning for Autonomous Driving

abstract: A model used for velocity control during car following was proposed based on deep reinforcement learning (RL). To fulfil the multi-objectives of car following, a reward function reflecting driving safety, efficiency, and comfort was constructed. With the reward function, the RL agent learns to control vehicle speed in a fashion that maximizes cumulative rewards, through trials and errors in the simulation environment. A total of 1,341 car-following events extracted from the Next Generation Simulation (NGSIM) dataset were used to train the model. Car-following behavior produced by the model were compared with that observed in the empirical NGSIM data, to demonstrate the model's ability to follow a lead vehicle safely, efficiently, and comfortably. Results show that the model demonstrates the capability of safe, efficient, and comfortable velocity control in that it 1) has small percentages (8\%) of dangerous minimum time to collision values (\textless\ 5s) than human drivers in the NGSIM data (35\%); 2) can maintain efficient and safe headways in the range of 1s to 2s; and 3) can follow the lead vehicle comfortably with smooth acceleration. The results indicate that reinforcement learning methods could contribute to the development of autonomous driving systems.


title: Data-driven acceleration of Photonic Simulations

abstract: Designing modern photonic devices often involves traversing a large parameter space via an optimization procedure, gradient based or otherwise, and typically results in the designer performing electromagnetic simulations of correlated devices. In this paper, we present an approach to accelerate the Generalized Minimal Residual (GMRES) algorithm for the solution of frequency-domain Maxwell's equations using two machine learning models (principal component analysis and a convolutional neural network) trained on simulations of correlated devices. These data-driven models are trained to predict a subspace within which the solution of the frequency-domain Maxwell's equations lie. This subspace can then be used for augmenting the Krylov subspace generated during the GMRES iterations. By training the proposed models on a dataset of grating wavelength-splitting devices, we show an order of magnitude reduction ($\sim 10 - 50$) in the number of GMRES iterations required for solving frequency-domain Maxwell's equations.


title: Fast Neural Network Predictions from Constrained Aerodynamics Datasets

abstract: Incorporating computational fluid dynamics in the design process of jets, spacecraft, or gas turbine engines is often challenged by the required computational resources and simulation time, which depend on the chosen physics-based computational models and grid resolutions. An ongoing problem in the field is how to simulate these systems faster but with sufficient accuracy. While many approaches involve simplified models of the underlying physics, others are model-free and make predictions based only on existing simulation data. We present a novel model-free approach in which we reformulate the simulation problem to effectively increase the size of constrained pre-computed datasets and introduce a novel neural network architecture (called a cluster network) with an inductive bias well-suited to highly nonlinear computational fluid dynamics solutions. Compared to the state-of-the-art in model-based approximations, we show that our approach is nearly as accurate, an order of magnitude faster, and easier to apply. Furthermore, we show that our method outperforms other model-free approaches.


title: Image reconstruction enhancement via masked regularization

abstract: Image reconstruction based on an edge-sparsity assumption has become popular in recent years. Many methods of this type are capable of reconstructing nearly perfect edge-sparse images using limited data. In this paper, we present a method to improve the accuracy of a suboptimal image resulting from an edge-sparsity image reconstruction method when compressed sensing or empirical data requirements are not met. The method begins with an edge detection from an initial edge-sparsity based reconstruction. From this edge map, a mask matrix is created which allows us to regularize exclusively in regions away from edges. By accounting for the spatial distribution of the sparsity, our method preserves edge information and and furthermore enhances suboptimal reconstructions to be nearly perfect from fewer data than needed by the initial method. We present results for two phantom images using a variety of initial reconstruction methods.


title: A spatially adaptive high-order meshless method for fluid-structure interactions

abstract: We present a scheme implementing an a posteriori refinement strategy in the context of a high-order meshless method for problems involving point singularities and fluid-solid interfaces. The generalized moving least squares (GMLS) discretization used in this work has been previously demonstrated to provide high-order compatible discretization of the Stokes and Darcy problems, offering a high-fidelity simulation tool for problems with moving boundaries. The meshless nature of the discretization is particularly attractive for adaptive h-refinement, especially when resolving the near-field aspects of variables and point singularities governing lubrication effects in fluid-structure interactions. We demonstrate that the resulting spatially adaptive GMLS method is able to achieve optimal convergence in the presence of singularities for both the div-grad and Stokes problems. Further, we present a series of simulations for flows of colloid suspensions, in which the refinement strategy efficiently achieved highly accurate solutions, particularly for colloids with complex geometries.


title: Gravitational form factors within light-cone sum rules at leading order

abstract: We develop an approach based on the light-cone sum rules at the leading order of $\alpha_S$ to calculate the gravitational form factors $A(t)$ and $B(t)$ for the valence quark combinations in nucleon. Within the proposed model, the predictions for the gravitational form factor $D(t)$ ($D$-term contributions) have been presented. Comparison with the experimental data and with the results of different models is discussed.


title: A block preconditioner for non-isothermal flow in porous media

abstract: In petroleum reservoir simulation, the industry standard preconditioner, the constrained pressure residual method (CPR), is a two-stage process which involves solving a restricted pressure system with Algebraic Multigrid (AMG). Initially designed for isothermal models, this approach is often used in the thermal case. However, it does not have a specific treatment of the additional energy conservation equation and temperature variable. We seek to develop preconditioners which better capture thermal effects such as heat diffusion. In order to study the effects of both pressure and temperature on fluid and heat flow, we consider a model of non-isothermal single phase flow through porous media. For this model, we develop a block preconditioner with an efficient Schur complement approximation. Both the pressure block and the approximate Schur complement are approximately inverted using an AMG V-cycle. The resulting solver is scalable with respect to problem size and parallelization.

categories: math.NA cs.NA physics.comp-ph physics.flu-dyn


title: A maximal function for families of Hilbert transforms along homogeneous curves

abstract: Let $H^{(u)}$ be the Hilbert transform along the parabola $(t, ut^2)$ where $u\in \mathbb R$. For a set $U$ of positive numbers consider the maximal function $\mathcal{H}^U \!f= \sup\{|H^{(u)}\! f|: u\in U\}$. We obtain an (essentially) optimal result for the $L^p$ operator norm of $\mathcal{H}^U$ when $2<p<\infty$. The results are proved for families of Hilbert transforms along more general nonflat homogeneous curves.


title: Ensembling methods for countrywide short term forecasting of gas demand

abstract: Gas demand is made of three components: Residential, Industrial, and Thermoelectric Gas Demand. Herein, the one-day-ahead prediction of each component is studied, using Italian data as a case study. Statistical properties and relationships with temperature are discussed, as a preliminary step for an effective feature selection. Nine "base forecasters" are implemented and compared: Ridge Regression, Gaussian Processes, Nearest Neighbours, Artificial Neural Networks, Torus Model, LASSO, Elastic Net, Random Forest, and Support Vector Regression (SVR). Based on them, four ensemble predictors are crafted: simple average, weighted average, subset average, and SVR aggregation. We found that ensemble predictors perform consistently better than base ones. Moreover, our models outperformed Transmission System Operator (TSO) predictions in a two-year out-of-sample validation. Such results suggest that combining predictors may lead to significant performance improvements in gas demand forecasting.


title: The Second Conversational Intelligence Challenge (ConvAI2)

abstract: We describe the setting and results of the ConvAI2 NeurIPS competition that aims to further the state-of-the-art in open-domain chatbots. Some key takeaways from the competition are: (i) pretrained Transformer variants are currently the best performing models on this task, (ii) but to improve performance on multi-turn conversations with humans, future systems must go beyond single word metrics like perplexity to measure the performance across sequences of utterances (conversations) -- in terms of repetition, consistency and balance of dialogue acts (e.g. how many questions asked vs. answered).


title: Probability of Error for Detecting a Change in a Parameter, Total Variation of the Posterior Distribution, and Bayesian Fisher Information

abstract: The van Trees inequality relates the Ensemble Mean Squared Error of an estimator to a Bayesian version of the Fisher Information. The Ziv-Zakai inequality relates the Ensemble Mean Squared Error of an estimator to the Minimum Probability of Error for the task of detecting a change in the parameter. In this work we complete this circle by deriving an inequality that relates this Minimum Probability of Error to the Bayesian version of the Fisher Information. We discuss this result for both scalar and vector parameters. In the process we discover that an important intermediary in the calculation is the Total Variation of the posterior probability distribiution function for the parameter given the data. This total variation is of interest in its own right since it may be easier to compute than the other figures of merit discussed here. Examples are provided to show that the inequality derived here is sharp.


title: Learning Metric Graphs for Neuron Segmentation In Electron Microscopy Images

abstract: In the deep metric learning approach to image segmentation, a convolutional net densely generates feature vectors at the pixels of an image. Pairs of feature vectors are trained to be similar or different, depending on whether the corresponding pixels belong to same or different ground truth segments. To segment a new image, the feature vectors are computed and clustered. Both empirically and theoretically, it is unclear whether or when deep metric learning is superior to the more conventional approach of directly predicting an affinity graph with a convolutional net. We compare the two approaches using brain images from serial section electron microscopy images, which constitute an especially challenging example of instance segmentation. We first show that seed-based postprocessing of the feature vectors, as originally proposed, produces inferior accuracy because it is difficult for the convolutional net to predict feature vectors that remain uniform across large objects. Then we consider postprocessing by thresholding a nearest neighbor graph followed by connected components. In this case, segmentations from a "metric graph" turn out to be competitive or even superior to segmentations from a directly predicted affinity graph. To explain these findings theoretically, we invoke the property that the metric function satisfies the triangle inequality. Then we show with an example where this constraint suppresses noise, causing connected components to more robustly segment a metric graph than an unconstrained affinity graph.


title: On the statistical evaluation of algorithmic's computational experimentation with infeasible solutions

abstract: The experimental evaluation of algorithms results in a large set of data which generally do not follow a normal distribution or are not heteroscedastic. Besides, some of its entries may be missing, due to the inability of an algorithm to find a feasible solution until a time limit is met. Those characteristics restrict the statistical evaluation of computational experiments. This work proposes a bi-objective lexicographical ranking scheme to evaluate datasets with such characteristics. The output ranking can be used as input to any desired statistical test. We used the proposed ranking scheme to assess the results obtained by the Iterative Rounding heuristic (IR). A Friedman's test and a subsequent post-hoc test carried out on the ranked data demonstrated that IR performed significantly better than the Feasibility Pump heuristic when solving 152 benchmark problems of Nonconvex Mixed-Integer Nonlinear Problems. However, is also showed that the RECIPE heuristic was significantly better than IR when solving the same benchmark problems.


title: Log surfaces of Picard rank one from four lines in the plane

abstract: We derive simple formulas for the basic numerical invariants of a singular surface with Picard number one obtained by blowups and contractions of the four-line configuration in the plane. As an application, we establish the smallest positive volume and the smallest accumulation point of volumes of log canonical surfaces obtained in this way.


title: The Relation Between Bayesian Fisher Information and Shannon Information for Detecting a Change in a Parameter

abstract: We derive a connection between performance of estimators the performance of the ideal observer on related detection tasks. Specifically we show how Shannon Information for the task of detecting a change in a parameter is related to the Fisher Information and the Bayesian Fisher Information. We have previously shown that this Shannon Information is related via an integral transform to the Minimum Probability of Error on the same task. We then outline a circle of relations starting with this Minimum Probability of Error and Ensemble Mean Squared Error via the Ziv-Zakai inequality, then the Ensemble Mean Squared error for an estimator and the Bayesian Fisher Information via the van Trees Inequality, and finally the Bayesian Fisher Information and the Shannon Information for a detection task via the work here.


title: Phase Transition in the Recovery of Rank One Matrices Corrupted by Gaussian Noise

abstract: In datasets where the number of parameters is fixed and the number of samples is large, principal component analysis (PCA) is a powerful dimension reduction tool. However, in many contemporary datasets, when the number of parameters is comparable to the sample size, PCA can be misleading. A closely related problem is the following: is it possible to recover a rank-one matrix in the presence of a large amount of noise? In both situations, there is a phase transition in the eigen-structure of the matrix.


title: Geometric Interpretation of side-sharing and point-sharing solutions in the P3P Problem

abstract: It is well known that the P3P problem could have 1, 2, 3 and at most 4 positive solutions under different configurations among its 3 control points and the position of the optical center. Since in any real applications, the knowledge on the exact number of possible solutions is a prerequisite for selecting the right one among all the possible solutions, the study on the phenomenon of multiple solutions in the P3P problem has been an active topic . In this work, we provide some new geometric interpretations on the multi-solution phenomenon in the P3P problem, our main results include: (1): The necessary and sufficient condition for the P3P problem to have a pair of side-sharing solutions is the two optical centers of the solutions both lie on one of the 3 vertical planes to the base plane of control points; (2): The necessary and sufficient condition for the P3P problem to have a pair of point-sharing solutions is the two optical centers of the solutions both lie on one of the 3 so-called skewed danger cylinders;(3): If the P3P problem has other solutions in addition to a pair of side-sharing ( point-sharing) solutions, these remaining solutions must be a point-sharing ( side-sharing ) pair. In a sense, the side-sharing pair and the point-sharing pair are companion pairs. In sum, our results provide some new insights into the nature of the multi-solution phenomenon in the P3P problem, in addition to their academic value, they could also be used as some theoretical guidance for practitioners in real applications to avoid occurrence of multiple solutions by properly arranging the control points.


title: Key $^{19}$Ne states identified affecting $\gamma$-ray emission from $^{18}$F in novae

abstract: Detection of nuclear-decay $\gamma$ rays provides a sensitive thermometer of nova nucleosynthesis. The most intense $\gamma$-ray flux is thought to be annihilation radiation from the $\beta^+$ decay of $^{18}$F, which is destroyed prior to decay by the $^{18}$F($p$,$\alpha$)$^{15}$O reaction. Estimates of $^{18}$F production had been uncertain, however, because key near-threshold levels in the compound nucleus, $^{19}$Ne, had yet to be identified. This Letter reports the first measurement of the $^{19}$F($^{3}$He,$t\gamma$)$^{19}$Ne reaction, in which the placement of two long-sought 3/2$^+$ levels is suggested via triton-$\gamma$-$\gamma$ coincidences. The precise determination of their resonance energies reduces the upper limit of the rate by a factor of $1.5-17$ at nova temperatures and reduces the average uncertainty on the nova detection probability by a factor of 2.1.


title: Parallel Black-Box Complexity with Tail Bounds

abstract: We propose a new black-box complexity model for search algorithms evaluating $\lambda$ search points in parallel. The parallel unary unbiased black-box complexity gives lower bounds on the number of function evaluations every parallel unary unbiased black-box algorithm needs to optimise a given problem. It captures the inertia caused by offspring populations in evolutionary algorithms and the total computational effort in parallel metaheuristics. We present complexity results for LeadingOnes and OneMax. Our main result is a general performance limit: we prove that on every function every $\lambda$-parallel unary unbiased algorithm needs at least $\Omega(\frac{\lambda n}{\ln \lambda} + n \log n)$ evaluations to find any desired target set of up to exponential size, with an overwhelming probability. This yields lower bounds for the typical optimisation time on unimodal and multimodal problems, for the time to find any local optimum, and for the time to even get close to any optimum. The power and versatility of this approach is shown for a wide range of illustrative problems from combinatorial optimisation. Our performance limits can guide parameter choice and algorithm design; we demonstrate the latter by presenting an optimal $\lambda$-parallel algorithm for OneMax that uses parallelism most effectively.


title: The Special Aronszajn Tree Property at $\kappa^+$ and $\square_{\kappa, 2}$

abstract: We show that for any regular cardinal $\kappa$, $\square_{\kappa, 2}$ is consistent with "all $\kappa^+$-Aronszajn trees are special." By a result of Shelah and Stanley this is optimal in the sense that $\square_{\kappa, 2}$ may not be strengthened to $\square_{\kappa}$. Using methods of Golshani and Hayut we obtain our consistency result simultaneously for all regular $\kappa$.


title: L\'evy imaging of elastic hadron-hadron scattering: Odderon and inner structure of the proton

abstract: A novel model-independent L\'evy imaging method is employed for reconstruction of the elastic $pp$ and $p\bar p$ scattering amplitudes at low and high energies. The four-momentum transfer $t$ dependent elastic slope $B(t)$, the nuclear phase $\phi(t)$ as well as the excitation function of the shadow profile $P(b)$ have been extracted from data at ISR, Tevatron and LHC energies. We found qualitative differences in properties of $B(t)$ and $\phi(t)$ between $pp$ and for $p\bar p$ collisions, that indicate an Odderon effect. A proton substructure has also been identified and found to have two different sizes, comparable to that of a dressed quark at the ISR and of a dressed diquark at the LHC energies, respectively.


title: Beam test performance of the highly granular SiW-ECAL technological prototype for the ILC

abstract: The technological prototype of the CALICE highly granular silicon-tungsten electromagnetic calorimeter (SiW-ECAL) was tested in a beam at DESY in 2017. The setup comprised seven layers of silicon sensors. Each layer comprised four sensors, with each sensor containing an array of 256 $5.5\times5.5$ mm$^2$ silicon PIN diodes. The four sensors covered a total area of $18\times18$ cm$^2$, and comprised a total of 1024 channels. The readout was split into a trigger line and a charge signal line. Key performance results for signal over noise for the two output lines are presented, together with a study of the uniformity of the detector response. Measurements of the response to electrons for the tungsten loaded version of the detector are also presented.


title: Glassiness and Lack of Equipartition in Random Lasers: the common roots of Ergodicity Breaking in Disordered and Non-linear Systems

abstract: We present here for the first time a unifying perspective for the lack of equipartition in non-linear ordered systems and the low temperature phase-space fragmentation in disordered systems. We demonstrate that they are just two manifestation of the same underlying phenomenon: ergodicity breaking. Inspired by recent experiments, suggesting that lasing in optically active disordered media is related to an ergodicity-breaking transition, we studied numerically a statistical mechanics model for the nonlinearly coupled light modes in a disordered medium under external pumping. Their collective behavior appears to be akin to the one displayed around the ergodicity-breaking transition in glasses, as we show measuring the glass order parameter of the replica-symmetry-breaking theory. Most remarkably, we also find that at the same critical point a breakdown of energy equipartition among light modes occurs, the typical signature of ergodicity breaking in non-linear systems as the celebrated Fermi-Pasta-Ulam model. The crucial ingredient of our system which allows us to find equipartition breakdown together with replica symmetry breaking is that the amplitudes of light modes are locally unbounded, i.e., they are only subject to a global constraint. The physics of random lasers appears thus as a unique test-bed to develop under a unifying perspective the study of ergodicity breaking in statistical disordered systems and non-linear ordered ones.


title: HashCore: Proof-of-Work Functions for General Purpose Processors

abstract: Over the past five years, the rewards associated with mining Proof-of-Work blockchains have increased substantially. As a result, miners are heavily incentivized to design and utilize Application Specific Integrated Circuits (ASICs) that can compute hashes far more efficiently than existing general purpose hardware. Currently, it is difficult for most users to purchase and operate ASICs due to pricing and availability constraints, resulting in a relatively small number of miners with respect to total user base for most popular cryptocurrencies. In this work, we aim to invert the problem of ASIC development by constructing a Proof-of-Work function for which an existing general purpose processor (GPP, such as an x86 IC) is already an optimized ASIC. In doing so, we will ensure that any would-be miner either already owns an ASIC for the Proof-of-Work system they wish to participate in or can attain one at a competitive price with relative ease. In order to achieve this, we present HashCore, a Proof-of-Work function composed of "widgets" generated pseudo-randomly at runtime that each execute a sequence of general purpose processor instructions designed to stress the computational resources of such a GPP. The widgets will be modeled after workloads that GPPs have been optimized for, for example, the SPEC CPU 2017 benchmark suite for x86 ICs, in a technique we refer to as inverted benchmarking. We provide a proof that HashCore is collision-resistant regardless of how the widgets are implemented. We observe that GPP designers/developers essentially create an ASIC for benchmarks such as SPEC CPU 2017. By modeling HashCore after such benchmarks, we create a Proof-of-Work function that can be run most efficiently on a GPP, resulting in a more accessible, competitive, and balanced mining market.


title: Episodic Training for Domain Generalization

abstract: Domain generalization (DG) is the challenging and topical problem of learning models that generalize to novel testing domains with different statistics than a set of known training domains. The simple approach of aggregating data from all source domains and training a single deep neural network end-to-end on all the data provides a surprisingly strong baseline that surpasses many prior published methods. In this paper, we build on this strong baseline by designing an episodic training procedure that trains a single deep network in a way that exposes it to the domain shift that characterises a novel domain at runtime. Specifically, we decompose a deep network into feature extractor and classifier components, and then train each component by simulating it interacting with a partner who is badly tuned for the current domain. This makes both components more robust, ultimately leading to our networks producing state-of-the-art performance on three DG benchmarks. Furthermore, we consider the pervasive workflow of using an ImageNet trained CNN as a fixed feature extractor for downstream recognition tasks. Using the Visual Decathlon benchmark, we demonstrate that our episodic-DG training improves the performance of such a general-purpose feature extractor by explicitly training a feature for robustness to novel problems. This shows that DG training can benefit standard practice in computer vision.


title: Production and detection of an axion dark matter echo

abstract: Electromagnetic radiation with angular frequency equal to half the axion mass stimulates the decay of cold dark matter axions and produces an echo, i.e. faint electromagnetic radiation traveling in the opposite direction. We propose to search for axion dark matter by sending out to space a powerful beam of microwave radiation and listening for its echo. We estimate the sensitivity of this technique in the isothermal and caustic ring models of the Milky Way halo, and find it to be a promising approach to axion, or axion-like, dark matter detection.


title: Continuous-time Quantum Error Correction with Noise-assisted Quantum Feedback

abstract: We address the standard quantum error correction using the three-qubit bit-flip code, yet in continuous-time. This entails rendering a target manifold of quantum states globally attractive. Previous feedback designs could feature spurious equilibria, or resort to discrete kicks pushing the system away from these equilibria to ensure global asymptotic stability. We present a new approach that consists of introducing controls driven by Brownian motions. Unlike the previous methods, the resulting closed-loop dynamics can be shown to stabilize the target manifold exponentially. We further present a reduced-order filter formulation with classical probabilities. The exponential property is important to quantify the protection induced by the closed-loop error-correction dynamics against disturbances. We study numerically the performance of this control law and of the reduced filter.


title: Generalized uncertainty principle in graphene

abstract: We show that, by going beyond the low-energy approximation for which the dispersion relations of graphene are linear, the corresponding emergent field theory is a specific generalization a Dirac field theory. The generalized Dirac Hamiltonians one obtains are those compatible with specific generalizations of the uncertainty principle. We also briefly comment on the compatibility of the latter with noncommuting positions, $[x_i,x_j] \neq 0$, and on their possible physical realization.


title: Perdew-Zunger self-interaction correction: How wrong for uniform densities and large-Z atoms?

abstract: Semi-local density functionals for the exchange-correlation energy of a many-electron system cannot be exact for all one-electron densities. In 1981, Perdew and Zunger (PZ) subtracted the fully-nonlocal self-interaction error orbital-by-orbital, making the corrected functional exact for all collections of separated one-electron densities, and making no correction to the exact functional. Although the PZ self-interaction correction (SIC) eliminates many errors of semi-local functionals, it is often worse for equilibrium properties of sp-bonded molecules and solids. Non-empirical semi-local functionals are usually designed to be exact for electron gases of uniform density, and thus also make 0% error for neutral atoms in the limit of large atomic number Z, but PZ SIC is not so designed. For localized SIC orbitals, we show analytically that the LSDA-SIC correlation energy per electron of the uniform gas in the high-density limit makes an error of -50% in the spin-unpolarized case, and -100% in the fully-spin-polarized case. Then we extrapolate from the Ne, Ar, Kr, and Xe atoms to estimate the relative errors of the PZ SIC exchange-correlation energies (with localized SIC orbitals) in the limit of large atomic number: about +5.5% for the local spin density approximation (LSDA-SIC), and about -3.5% for nonempirical generalized gradient (PBE-SIC) and meta-generalized gradient (SCAN-SIC) approximations. The SIC errors are considerably larger than those that have been estimated for LSDA-SIC by approximating the localized SIC orbitals for the uniform gas, and may explain the errors of PZ SIC for equilibrium properties, opening the door to a generalized SIC that is more widely accurate.


title: $t\bar{t}$ + $Z$ / $W$ / $t\bar{t}$ at ATLAS

abstract: The newest results from the ATLAS Collaboration for the production of a top-quark pair in association with a $Z$ or $W$ boson, and for the production of four top quarks, are summarised in these proceedings. The measurements were performed with 36.1 fb$^{-1}$ of proton-proton collision data from the Large Hadron Collider at a centre-of-mass energy of 13 TeV.


title: Race, Ethnicity and National Origin-based Discrimination in Social Media and Hate Crimes Across 100 U.S. Cities

abstract: We study malicious online content via a specific type of hate speech: race, ethnicity and national-origin based discrimination in social media, alongside hate crimes motivated by those characteristics, in 100 cities across the United States. We develop a spatially-diverse training dataset and classification pipeline to delineate targeted and self-narration of discrimination on social media, accounting for language across geographies. Controlling for census parameters, we find that the proportion of discrimination that is targeted is associated with the number of hate crimes. Finally, we explore the linguistic features of discrimination Tweets in relation to hate crimes by city, features used by users who Tweet different amounts of discrimination, and features of discrimination compared to non-discrimination Tweets. Findings from this spatial study can inform future studies of how discrimination in physical and virtual worlds vary by place, or how physical and virtual world discrimination may synergize.


title: Learning to Make Analogies by Contrasting Abstract Relational Structure

abstract: Analogical reasoning has been a principal focus of various waves of AI research. Analogy is particularly challenging for machines because it requires relational structures to be represented such that they can be flexibly applied across diverse domains of experience. Here, we study how analogical reasoning can be induced in neural networks that learn to perceive and reason about raw visual data. We find that the critical factor for inducing such a capacity is not an elaborate architecture, but rather, careful attention to the choice of data and the manner in which it is presented to the model. The most robust capacity for analogical reasoning is induced when networks learn analogies by contrasting abstract relational structures in their input domains, a training method that uses only the input data to force models to learn about important abstract features. Using this technique we demonstrate capacities for complex, visual and symbolic analogy making and generalisation in even the simplest neural network architectures.


title: Off-shell $N=2\to N=1$ reduction in 4D conformal supergravity

abstract: We discuss $N=2\to N=1$ reduction in four dimensional conformal supergravity. In particular, we keep the off-shell structure of supermultiplets (except hypermultiplets). As we will show, starting with (almost) off-shell conformal supergravity makes the procedure simpler than that from $N=2$ Poincar\'e supergravity, which makes it easier to show the correspondence to the standard $N=1$ conformal supergravity. We find that the $N=1$ superconformal symmetry is simply realized by truncating the gravitino multiplet. We also discuss the consistency with the original $N=2$ system and show the reduced $N=1$ conformal supergravity action.


title: Ab Initio Study on Superconductivity and Inhomogeneity in Hg-based Cuprate Superconductor

abstract: Understanding physics of high-$T_c$ cuprate superconductors remains one of the important problems in materials science. Though a number of diverse theories argue about the superconductivity and competing orders, ab initio and quantitative understanding is lacking. Here, we reproduce the experimental phase diagram of HgBa$_2$CuO$_{4+y}$ by solving its ab initio low-energy effective Hamiltonian without adjustable parameters. It shows a superconducting phase in a wide range of hole density $\delta$, and its competition with charge period-4 plus spin period-8 stripe order near $\delta \sim 0.1$, in agreement with experimental results including recent X-ray scattering. Then a crucial role of off-site interactions in stabilizing the superconductivity is elucidated with emphasis on charge fluctuations. It also clarifies the condensation energy mainly contributed from the onsite Coulomb interaction. The present achievement will enable deeper, predictable understanding on open issues of the high-$T_c$ superconducting mechanism and promote ab initio studies on strongly correlated electrons beyond parametrized model studies.


title: Embedded Delaunay triangulations for point clouds of surfaces in $\mathbb{R}^3$

abstract: In the following article we discuss Delaunay triangulations for a point cloud on an embedded surface in $\mathbb{R}^3$. We give sufficient conditions on the point cloud to show that the diagonal switch algorithm finds an embedded Delaunay triangulation.


title: On the Classification of Certain Real Rank Zero $\mathrm{C}^*$-Algebras

abstract: In this paper, a classification is given of real rank zero $C^*$-algebras that can be expressed as inductive limits of a sequence of a subclass of Elliott-Thomsen algebras $\mathcal{C}$.


title: US-net for robust and efficient nuclei instance segmentation

abstract: We present a novel neural network architecture, US-Net, for robust nuclei instance segmentation in histopathology images. The proposed framework integrates the nuclei detection and segmentation networks by sharing their outputs through the same foundation network, and thus enhancing the performance of both. The detection network takes into account the high-level semantic cues with contextual information, while the segmentation network focuses more on the low-level details like the edges. Extensive experiments reveal that our proposed framework can strengthen the performance of both branch networks in an integrated architecture and outperforms most of the state-of-the-art nuclei detection and segmentation networks.


title: Almost surely constrained convex optimization

abstract: We propose a stochastic gradient framework for solving stochastic composite convex optimization problems with (possibly) infinite number of linear inclusion constraints that need to be satisfied almost surely. We use smoothing and homotopy techniques to handle constraints without the need for matrix-valued projections. We show for our stochastic gradient algorithm $\mathcal{O}(\log(k)/\sqrt{k})$ convergence rate for general convex objectives and $\mathcal{O}(\log(k)/k)$ convergence rate for restricted strongly convex objectives. These rates are known to be optimal up to logarithmic factors, even without constraints. We demonstrate the performance of our algorithm with numerical experiments on basis pursuit, a hard margin support vector machines and a portfolio optimization and show that our algorithm achieves state-of-the-art practical performance.


title: initKmix -- A Novel Initial Partition Generation Algorithm for Clustering Mixed Data using k-means-based Clustering

abstract: Mixed datasets consist of both numeric and categorical attributes. Various k-means-based clustering algorithms have been developed for these datasets. Generally, these algorithms use random partition as a starting point, which tends to produce different clustering results for different runs. In this paper, we propose, initKmix, a novel algorithm for finding an initial partition for k-means-based clustering algorithms for mixed datasets. In the initKmix algorithm, a k-means-based clustering algorithm is run many times, and in each run, one of the attributes is used to create initial clusters for that run. The clustering results of various runs are combined to produce the initial partition. This initial partition is then used as a seed to a k-means-based clustering algorithm to cluster mixed data. Experiments with various categorical and mixed datasets showed that initKmix produced accurate and consistent results, and outperformed the random initial partition method and other state-of-the-art initialization methods. Experiments also showed that k-means-based clustering for mixed datasets with initKmix performed similar to or better than many state-of-the-art clustering algorithms for categorical and mixed datasets.


title: Experimental limit on an exotic parity-odd spin- and velocity-dependent interaction using an optically polarized vapor

abstract: Exotic spin-dependent interactions between fermions have recently attracted attention in relation to theories beyond the Standard Model. The exotic interactions can be mediated by hypothetical fundamental bosons which may explain several unsolved mysteries in physics. Here we expand this area of research by probing an exotic parity-odd spin- and velocity-dependent interaction between the axial-vector electron coupling and the vector nucleon coupling for polarized electrons. This experiment utilizes a high-sensitivity atomic magnetometer, based on an optically polarized vapor that is a source of polarized electrons, and a solid-state mass containing unpolarized nucleons. The atomic magnetometer can detect an effective magnetic field induced by the exotic interaction between unpolarized nucleons and polarized electrons. We set an experimental limit on the electron-nucleon coupling $g_\text{A}^\text{e} g_\text{V}^\text{N}<$ $10^{-30}$ at the mediator boson mass below $10^{-4}$ eV, significantly improving the current limit by up to 17 orders of magnitude.


title: A time-reversible quantum causal model

abstract: Modern approaches to causal modeling give a central role to interventions, which require the active input of an observer and introduces an explicit `causal arrow of time'. Causal models typically adopt a mechanistic interpretation, according to which the direction of the causal arrow is intrinsic to the process being studied. Here we investigate whether the direction of the causal arrow might be a contribution from the observer, rather than an intrinsic property of the process. Working within a counterfactual and non-mechanistic interpretation of causal modeling developed in arXiv:1806.00895, we propose a definition of a `quantum observational scheme' that we argue characterizes the observer-invariant properties of a causal model. By restricting to quantum processes that preserve the maximally mixed state (unbiasedness) we find that the statistics is symmetric under reversal of the time-ordering. The resulting model can therefore accommodate the idea that the causal arrow is observer-dependent, indicating a route towards reconciling the causal arrow with time-symmetric laws of physics.


title: Anisotropic evolution of D-dimensional FRW spacetime

abstract: We examine the time evolution of the D=d+4 dimensional Einstein field equations subjected to a flat Robertson-Walker metric where the 3D and higher-dimensional scale factors are allowed to evolve at different rates. We find the exact solution to these equations for a single fluid component, which yields two limiting regimes offering the 3D scale factor as a function of the time. The fluid regime solution closely mimics that described by 4D FRW cosmology, offering a late-time behavior for the 3D scale factor after becoming valid in the early universe, and can give rise to a late-time accelerated expansion driven by vacuum energy. This is shown to be preceded by an earlier volume regime solution, which offers a very early-time epoch of accelerated expansion for a radiation-dominated universe for d=1. The time scales describing these phenomena, including the transition from volume to fluid regime, are shown to fall within a small fraction of the first second when the fundamental constants of the theory are aligned with the Planck time. This model potentially offers a higher-dimensional alternative to scalar-field inflationary theory and a consistent cosmological theory, yielding a unified description of early- and late-time accelerated expansions via a 5D spacetime scenario.


title: High-performance quantization for spectral super-resolution

abstract: We show that the method of distributed noise-shaping beta-quantization offers superior performance for the problem of spectral super-resolution with quantization whenever there is redundancy in the number of measurements. More precisely, if the (integer) oversampling ratio $\lambda$ is such that $\lfloor M/\lambda\rfloor - 1\geq 4/\Delta$, where $M$ denotes the number of Fourier measurements and $\Delta$ is the minimum separation distance associated with the atomic measure to be resolved, then for any number $K\geq 2$ of quantization levels available for the real and imaginary parts of the measurements, our quantization method guarantees reconstruction accuracy of order $O(\lambda K^{- \lambda/2})$, up to constants which are independent of $K$ and $\lambda$. In contrast, memoryless scalar quantization offers a guarantee of order $O(K^{-1})$ only.


title: Plan-Structured Deep Neural Network Models for Query Performance Prediction

abstract: Query performance prediction, the task of predicting the latency of a query, is one of the most challenging problem in database management systems. Existing approaches rely on features and performance models engineered by human experts, but often fail to capture the complex interactions between query operators and input relations, and generally do not adapt naturally to workload characteristics and patterns in query execution plans. In this paper, we argue that deep learning can be applied to the query performance prediction problem, and we introduce a novel neural network architecture for the task: a plan-structured neural network. Our approach eliminates the need for human-crafted feature selection and automatically discovers complex performance models both at the operator and query plan level. Our novel neural network architecture can match the structure of any optimizer-selected query execution plan and predict its latency with high accuracy. We also propose a number of optimizations that reduce training overhead without sacrificing effectiveness. We evaluated our techniques on various workloads and we demonstrate that our plan-structured neural network can outperform the state-of-the-art in query performance prediction.


title: Lattice-valued Overlap and Quasi-Overlap Functions

abstract: Overlap functions were introduced as class of bivariate aggregation functions on [0, 1] to be applied in image processing. This paper has as main objective to present appropriates definitions of overlap functions considering the scope of lattices and introduced a more general definition, called of quasi-overlaps, which arise of abolishes the continuity condition. In addition, are investigated the main properties of (quasi-)overlaps on bounded lattices, namely, convex sum, migrativity, homogeneity, idempotency and cancellation law. Moreover, we make a characterization of Archimedian overlaps.


title: Higgs Physics at the HL-LHC and HE-LHC

abstract: The discovery of the Higgs boson in 2012, by the ATLAS and CMS experiments, was a success achieved with only a percent of the entire dataset foreseen for the LHC. It opened a landscape of possibilities in the study of Higgs boson properties, Electroweak Symmetry breaking and the Standard Model in general, as well as new avenues in probing new physics beyond the Standard Model. Six years after the discovery, with a conspicuously larger dataset collected during LHC Run 2 at a 13 TeV centre-of-mass energy, the theory and experimental particle physics communities have started a meticulous exploration of the potential for precision measurements of its properties. This includes studies of Higgs boson production and decays processes, the search for rare decays and production modes, high energy observables, and searches for an extended electroweak symmetry breaking sector. This report summarises the potential reach and opportunities in Higgs physics during the High Luminosity phase of the LHC, with an expected dataset of pp collisions at 14 TeV, corresponding to an integrated luminosity of 3 ab$^{-1}$. These studies are performed in light of the most recent analyses from LHC collaborations and the latest theoretical developments. The potential of an LHC upgrade, colliding protons at a centre-of-mass energy of 27 TeV and producing a dataset corresponding to an integrated luminosity of 15 ab$^{-1}$, is also discussed.


title: Cache-aided Interference Management Using Hypercube Combinatorial Cache Designs

abstract: We consider a cache-aided interference network which consists of a library of $N$ files, $K_T$ transmitters and $K_R$ receivers (users), each equipped with a local cache of size $M_T$ and $M_R$ files respectively, and connected via a discrete-time additive white Gaussian noise channel. Each receiver requests an arbitrary file from the library. The objective is to design a cache placement without knowing the receivers' requests and a communication scheme such that the sum Degrees of Freedom (sum-DoF) of the delivery is maximized. This network model has been investigated by Naderializadeh {\em et al.}, who proposed a prefetching and a delivery schemes that achieves a sum-DoF of $\min\{\frac{{M_TK_T+K_RM_R}}{{N}}, K_R\}$. One of biggest limitations of this scheme is the requirement of high subpacketization level. This paper is the first attempt in the literature (according to our knowledge) to reduce the file subpacketization in such a network. In particular, we propose a new approach for both prefetching and linear delivery schemes based on a combinatorial design called {\em hypercube}. We show that required number of packets per file can be exponentially reduced compared to the state of the art scheme proposed by Naderializadeh {\em et al.}, or the NMA scheme. When $M_TK_T+K_RM_R \geq K_R$, the achievable one-shot sum-DoF using this approach is $\frac{{M_TK_T+K_RM_R}}{{N}}$ , which shows that 1) the one-shot sum-DoF scales linearly with the aggregate cache size in the network and 2) it is within a factor of $2$ to the information-theoretic optimum. Surprisingly, the identical and near optimal sum-DoF performance can be achieved using the hypercube approach with a much less file subpacketization.


title: On an exactly solvable toy model and its dynamics

abstract: The eigenstates and eigenenergies of a toy model, which arose in idealizing a local quenched tight-binding model in a previous publication [Zhang and Yang, EPL 114, 60001 (2016)], are solved analytically. This enables us to study its dynamics in a different way. This model can serve as a good exercise in quantum mechanics at the undergraduate level.


title: Tsallis Reinforcement Learning: A Unified Framework for Maximum Entropy Reinforcement Learning

abstract: In this paper, we present a new class of Markov decision processes (MDPs), called Tsallis MDPs, with Tsallis entropy maximization, which generalizes existing maximum entropy reinforcement learning (RL). A Tsallis MDP provides a unified framework for the original RL problem and RL with various types of entropy, including the well-known standard Shannon-Gibbs (SG) entropy, using an additional real-valued parameter, called an entropic index. By controlling the entropic index, we can generate various types of entropy, including the SG entropy, and a different entropy results in a different class of the optimal policy in Tsallis MDPs. We also provide a full mathematical analysis of Tsallis MDPs, including the optimality condition, performance error bounds, and convergence. Our theoretical result enables us to use any positive entropic index in RL. To handle complex and large-scale problems, we propose a model-free actor-critic RL method using Tsallis entropy maximization. We evaluate the regularization effect of the Tsallis entropy with various values of entropic indices and show that the entropic index controls the exploration tendency of the proposed method. For a different type of RL problems, we find that a different value of the entropic index is desirable. The proposed method is evaluated using the MuJoCo simulator and achieves the state-of-the-art performance.


title: Optimal Contract Design for Incentive-Based Demand Response

abstract: We design an optimal contract between a demand response aggregator (DRA) and a customer for incentive-based demand response. We consider a setting in which the customer is asked to reduce her consumption by the DRA and she is compensated for this reduction. However, since the DRA must supply the customer with as much power as she desires, a strategic customer can temporarily increase her base load to report a larger reduction as a part of the demand response event. The DRA wishes to incentivize the customer both to make the maximal effort in reducing the load and to not falsify the base load. We model the problem of designing the contract by the DRA for the customer as a management contract design problem and present a solution. The optimal contract consists of two parts: a part that depends on (the possibly inflated) load reduction as measured and another that provides a share of the profit that ensues to the DRA through the demand response event to the customer.


title: Passed & Spurious: Descent Algorithms and Local Minima in Spiked Matrix-Tensor Models

abstract: In this work we analyse quantitatively the interplay between the loss landscape and performance of descent algorithms in a prototypical inference problem, the spiked matrix-tensor model. We study a loss function that is the negative log-likelihood of the model. We analyse the number of local minima at a fixed distance from the signal/spike with the Kac-Rice formula, and locate trivialization of the landscape at large signal-to-noise ratios. We evaluate in a closed form the performance of a gradient flow algorithm using integro-differential PDEs as developed in physics of disordered systems for the Langevin dynamics. We analyze the performance of an approximate message passing algorithm estimating the maximum likelihood configuration via its state evolution. We conclude by comparing the above results: while we observe a drastic slow down of the gradient flow dynamics even in the region where the landscape is trivial, both the analyzed algorithms are shown to perform well even in the part of the region of parameters where spurious local minima are present.

categories: cs.LG cond-mat.dis-nn math.ST stat.ML stat.TH


title: Advances of Machine Learning in Molecular Modeling and Simulation

abstract: In this review, we highlight recent developments in the application of machine learning for molecular modeling and simulation. After giving a brief overview of the foundations, components, and workflow of a typical supervised learning approach for chemical problems, we showcase areas and state-of-the-art examples of their deployment. In this context, we discuss how machine learning relates to, supports, and augments more traditional physics-based approaches in computational research. We conclude by outlining challenges and future research directions that need to be addressed in order to make machine learning a mainstream chemical engineering tool.


title: Graph Resistance and Learning from Pairwise Comparisons

abstract: We consider the problem of learning the qualities of a collection of items by performing noisy comparisons among them. Following the standard paradigm, we assume there is a fixed "comparison graph" and every neighboring pair of items in this graph is compared $k$ times according to the Bradley-Terry-Luce model (where the probability than an item wins a comparison is proportional the item quality). We are interested in how the relative error in quality estimation scales with the comparison graph in the regime where $k$ is large. We prove that, after a known transition period, the relevant graph-theoretic quantity is the square root of the resistance of the comparison graph. Specifically, we provide an algorithm that is minimax optimal. The algorithm has a relative error decay that scales with the square root of the graph resistance, and provide a matching lower bound (up to log factors). The performance guarantee of our algorithm, both in terms of the graph and the skewness of the item quality distribution, outperforms earlier results.


title: Polariton Laser in the Bardeen-Cooper-Schrieffer Regime

abstract: Microcavity exciton polariton systems can have a wide range of macroscopic quantum effects that may be turned into better photonic technologies. Polariton Bose-Einstein condensation and photon lasing have been widely accepted in the limits of low and high carrier densities, but identification of the expected Bardeen-Cooper-Schrieffer (BCS) state at intermediate densities remains elusive, as the optical-gain mechanism cannot be directly inferred from existing experiments. Here, using a microcavity with strong polarization selectivity, we gain direct experimental access to the reservoir absorption in the presence of polariton condensation and lasing, which reveals a fermionic gain mechanism underlying the polariton laser. A microscopic many-particle theory shows that this polariton lasing state is consistent with an open-dissipative-pumped system analog of a polaritonic BCS state.


title: Quantum affine wreath algebras

abstract: To each symmetric algebra we associate a family of algebras that we call quantum affine wreath algebras. These can be viewed both as symmetric algebra deformations of affine Hecke algebras of type $A$ and as quantum deformations of affine wreath algebras. We study the structure theory of these new algebras and their natural cyclotomic quotients.


title: Neutron Star Interior Composition Explorer X-ray Timing of the Radio and Gamma-ray Quiet Pulsars PSR J1412+7922 AND PSR J1849-0001

abstract: We present new timing and spectral analyses of PSR J1412+7922 (Calvera) and PSR J1849-0001, which are only seen as pulsars in X-rays, based on observations conducted with the Neutron Star Interior Composition Explorer (NICER). We obtain updated and substantially improved pulse ephemerides compared to previous X-ray studies, as well as spectra that can be well-fit by simple blackbodies and/or a power law. Our refined timing measurements enable deeper searches for pulsations at other wavelengths and sensitive targeted searches by LIGO/Virgo for continuous gravitational waves from these neutron stars. Using the sensitivity of LIGO's first observing run, we estimate constraints that a gravitational wave search of these pulsars would obtain on the size of their mass deformation and r-mode fluid oscillation.


title: Geodesic Structure of Naked Singularities in AdS$_3$ Spacetime

abstract: We present a complete study of the geodesics around naked singularities in AdS$_3$, the three-dimensional anti-de Sitter spacetime. These stationary spacetimes, characterized by two conserved charges --mass and angular momentum--, are obtained through identifications along spacelike Killing vectors with a fixed point. They are interpreted as massive spinning point particles, and can be viewed as three-dimensional analogues of cosmic strings in four spacetime dimensions. The geodesic equations are completely integrated and the solutions are expressed in terms of elementary functions. We classify different geodesics in terms of their radial bounds, which depend on the constants of motion. Null and spacelike geodesics approach the naked singularity from infinity and either fall into the singularity or wind around and go back to infinity, depending on the values of these constants, except for the extremal and massless cases for which a null geodesic could have a circular orbit. Timelike geodesics never escape to infinity and do not always fall into the singularity, namely, they can be permanently bounded between two radii. The spatial projections of the geodesics (orbits) exhibit self-intersections, whose number is particularly simple for null geodesics. As a particular application, we also compute the lengths of fixed-time spacelike geodesics of the static naked singularity using two different regularizations.


title: Agnostic Federated Learning

abstract: A key learning scenario in large-scale applications is that of federated learning, where a centralized model is trained based on data originating from a large number of clients. We argue that, with the existing training and inference, federated models can be biased towards different clients. Instead, we propose a new framework of agnostic federated learning, where the centralized model is optimized for any target distribution formed by a mixture of the client distributions. We further show that this framework naturally yields a notion of fairness. We present data-dependent Rademacher complexity guarantees for learning with this objective, which guide the definition of an algorithm for agnostic federated learning. We also give a fast stochastic optimization algorithm for solving the corresponding optimization problem, for which we prove convergence bounds, assuming a convex loss function and hypothesis set. We further empirically demonstrate the benefits of our approach in several datasets. Beyond federated learning, our framework and algorithm can be of interest to other learning scenarios such as cloud computing, domain adaptation, drifting, and other contexts where the training and test distributions do not coincide.


title: Towards Collaborative Intelligence Friendly Architectures for Deep Learning

abstract: Modern mobile devices are equipped with high-performance hardware resources such as graphics processing units (GPUs), making the end-side intelligent services more feasible. Even recently, specialized silicons as neural engines are being used for mobile devices. However, most mobile devices are still not capable of performing real-time inference using very deep models. Computations associated with deep models for today's intelligent applications are typically performed solely on the cloud. This cloud-only approach requires significant amounts of raw data to be uploaded to the cloud over the mobile wireless network and imposes considerable computational and communication load on the cloud server. Recent studies have shown that the latency and energy consumption of deep neural networks in mobile applications can be notably reduced by splitting the workload between the mobile device and the cloud. In this approach, referred to as collaborative intelligence, intermediate features computed on the mobile device are offloaded to the cloud instead of the raw input data of the network, reducing the size of the data needed to be sent to the cloud. In this paper, we design a new collaborative intelligence friendly architecture by introducing a unit responsible for reducing the size of the feature data needed to be offloaded to the cloud to a greater extent, where this unit is placed after a selected layer of a deep model. Our proposed method, across different wireless networks, achieves on average 53x improvements for end-to-end latency and 68x improvements for mobile energy consumption compared to the status quo cloud-only approach for ResNet-50, while the accuracy loss is less than 2%.


title: Bifidelity data-assisted neural networks in nonintrusive reduced-order modeling

abstract: In this paper, we present a new nonintrusive reduced basis method when a cheap low-fidelity model and expensive high-fidelity model are available. The method relies on proper orthogonal decomposition (POD) to generate the high-fidelity reduced basis and a shallow multilayer perceptron to learn the high-fidelity reduced coefficients. In contrast to other methods, one distinct feature of the proposed method is to incorporate the features extracted from the low-fidelity data as the input feature, this approach not only improves the predictive capability of the neural network but also enables the decoupling the high-fidelity simulation from the online stage. Due to its nonintrusive nature, it is applicable to general parameterized problems. We also provide several numerical examples to illustrate the effectiveness and performance of the proposed method.


title: Towards Smart Wireless Body-Centric Networks

abstract: We investigate the existence of 'long-memory' or long-range dependence (LRD) of the wireless body-centric channels, e.g., on-body, body-to-body (B2B), with real-life experimental dataset collected from 10 co-located wireless body area networks or BANs (people fitted with wearable sensors). We examine two different factors on that purpose such as: the pattern of the decaying autocorrelation function (ACF) and the Hurst exponent. From the experimental outcome, we show that, the ACF decay of the body-centric channels follows a power-like decay and the channels have a Hurst exponent much greater than 0.5 on average. These results indicate that the body-centric channels can possess long-memory or LRD characteristic which can be used for predictive analysis and intelligent decision making to build futuristic wireless human-centered networks that can sense and act autonomously. We also clarify whether the presence of the LRD property is sufficient for reliable prediction of the body-centric channels.


title: An Analysis of State Evolution for Approximate Message Passing with Side Information

abstract: A common goal in many research areas is to reconstruct an unknown signal x from noisy linear measurements. Approximate message passing (AMP) is a class of low-complexity algorithms for efficiently solving such high-dimensional regression tasks. Often, it is the case that side information (SI) is available during reconstruction. For this reason a novel algorithmic framework that incorporates SI into AMP, referred to as approximate message passing with side information (AMP-SI), has been recently introduced. An attractive feature of AMP is that when the elements of the signal are exchangeable, the entries of the measurement matrix are independent and identically distributed (i.i.d.) Gaussian, and the denoiser applies the same non-linearity at each entry, the performance of AMP can be predicted accurately by a scalar iteration referred to as state evolution (SE). However, the AMP-SI framework uses different entry-wise scalar denoisers, based on the entry-wise level of the SI, and therefore is not supported by the standard AMP theory. In this work, we provide rigorous performance guarantees for AMP-SI when the input signal and SI are drawn i.i.d. according to some joint distribution subject to finite moment constraints. Moreover, we provide numerical examples to support the theory which demonstrate empirically that the SE can predict the AMP-SI mean square error accurately.


title: A dual Newton based preconditioned proximal point algorithm for exclusive lasso models

abstract: The exclusive lasso (also known as elitist lasso) regularization has become popular recently due to its superior performance on group sparsity. Compared to the group lasso regularization which enforces the competition on variables among different groups, the exclusive lasso regularization also enforces the competition within each group. In this paper, we propose a highly efficient dual Newton based preconditioned proximal point algorithm (PPDNA) to solve machine learning models involving the exclusive lasso regularizer. As an important ingredient, we provide a rigorous proof for deriving the closed-form solution to the proximal mapping of the weighted exclusive lasso regularizer. In addition, we derive the corresponding HS-Jacobian to the proximal mapping and analyze its structure --- which plays an essential role in the efficient computation of the PPA subproblem via applying a semismooth Newton method on its dual. Various numerical experiments in this paper demonstrate the superior performance of the proposed PPDNA against other state-of-the-art numerical algorithms.


title: Simultaneous current graph constructions for minimum triangulations and complete graph embeddings

abstract: The problems of the genus of the complete graphs and minimum triangulations for each surface were both solved using the theory of current graphs, and each of them divided into twelve different cases, depending on the residue modulo 12 of the number of vertices. Cases 8 and 11 were of particular difficulty for both problems, with multiple families of current graphs developed to solve these cases. We solve these cases in a unified manner with families of current graphs applicable to both problems. Additionally, we give new constructions to both problems for Cases 6 and 9, which greatly simplify previous constructions by Ringel, Youngs, Guy, and Jungerman. All these new constructions are index 3 current graphs sharing nearly all of the structure of the simple solution for Case 5 of the Map Color Theorem.


title: Deep Triplet Quantization

abstract: Deep hashing establishes efficient and effective image retrieval by end-to-end learning of deep representations and hash codes from similarity data. We present a compact coding solution, focusing on deep learning to quantization approach that has shown superior performance over hashing solutions for similarity retrieval. We propose Deep Triplet Quantization (DTQ), a novel approach to learning deep quantization models from the similarity triplets. To enable more effective triplet training, we design a new triplet selection approach, Group Hard, that randomly selects hard triplets in each image group. To generate compact binary codes, we further apply a triplet quantization with weak orthogonality during triplet training. The quantization loss reduces the codebook redundancy and enhances the quantizability of deep representations through back-propagation. Extensive experiments demonstrate that DTQ can generate high-quality and compact binary codes, which yields state-of-the-art image retrieval performance on three benchmark datasets, NUS-WIDE, CIFAR-10, and MS-COCO.


title: Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models

abstract: Variational autoencoders (VAEs) have received much attention recently as an end-to-end architecture for text generation with latent variables. In this paper, we investigate several multi-level structures to learn a VAE model to generate long, and coherent text. In particular, we use a hierarchy of stochastic layers between the encoder and decoder networks to generate more informative latent codes. We also investigate a multi-level decoder structure to learn a coherent long-term structure by generating intermediate sentence representations as high-level plan vectors. Empirical results demonstrate that a multi-level VAE model produces more coherent and less repetitive long text compared to the standard VAE models and can further mitigate the posterior-collapse issue.


title: Quantum work distributions associated with the dynamical Casimir effect

abstract: We study the joint probability distribution function of the work and the change of photon number of the nonequilibrium process of driving the electromagnetic (EM) field in a three-dimensional cavity with an oscillating boundary. The system is initially prepared in a grand canonical equilibrium state and we obtain the analytical expressions of the characteristic functions of work distributions in the single-resonance and multiple-resonance conditions. Our study demonstrates the validity of the fluctuation theorems of the grand canonical ensemble in nonequilibrium processes with particle creation and annihilation. In addition, our work illustrates that in the high temperature limit, the work done on the quantized EM field approaches its classical counterpart; while in the low temperature limit, similar to Casimir effect, it differs significantly from its classical counterpart.


title: Quark-Hadron Crossover with Vortices

abstract: The quark-hadron crossover conjecture was proposed as a continuity between hadronic matter and quark matter with no phase transition. It is based on matching of symmetry and excitations in both the phases. It connects hyperon matter and color-flavor locked (CFL) phase of color superconductivity in the limit of light strange quark mass. We study generalization of this conjecture in the presence of topological vortices. We propose a picture where hadronic superfluid vortices in hyperon matter could be connected to non-Abelian vortices (color magnetic flux tubes) in the CFL phase during this crossover. We propose that three hadronic superfluid vortices must join together to three non-Abelian vortices with different color fluxes with the total color magnetic fluxes canceled out, where the junction is called a colorful boojum.


title: Self-Control in Cyberspace: Applying Dual Systems Theory to a Review of Digital Self-Control Tools

abstract: Many people struggle to control their use of digital devices. However, our understanding of the design mechanisms that support user self-control remains limited. In this paper, we make two contributions to HCI research in this space: first, we analyse 367 apps and browser extensions from the Google Play, Chrome Web, and Apple App stores to identify common core design features and intervention strategies afforded by current tools for digital self-control. Second, we adapt and apply an integrative dual systems model of self-regulation as a framework for organising and evaluating the design features found. Our analysis aims to help the design of better tools in two ways: (i) by identifying how, through a well-established model of self-regulation, current tools overlap and differ in how they support self-control; and (ii) by using the model to reveal underexplored cognitive mechanisms that could aid the design of new tools.


title: Free boundaries subject to topological constraints

abstract: We discuss the extent to which solutions to one-phase free boundary problems can be characterized according to their topological complexity. Our questions are motivated by fundamental work of Luis Caffarelli on free boundaries and by striking results of T. Colding and W. Minicozzi concerning finitely connected, embedded, minimal surfaces. We review our earlier work on the simplest case, one-phase free boundaries in the plane in which the positive phase is simply connected. We also prove a new, purely topological, effective removable singularities theorem for free boundaries. At the same time, we formulate some open problems concerning the multiply connected case and make connections with the theory of minimal surfaces and semilinear variational problems.


title: Compressing GANs using Knowledge Distillation

abstract: Generative Adversarial Networks (GANs) have been used in several machine learning tasks such as domain transfer, super resolution, and synthetic data generation. State-of-the-art GANs often use tens of millions of parameters, making them expensive to deploy for applications in low SWAP (size, weight, and power) hardware, such as mobile devices, and for applications with real time capabilities. There has been no work found to reduce the number of parameters used in GANs. Therefore, we propose a method to compress GANs using knowledge distillation techniques, in which a smaller "student" GAN learns to mimic a larger "teacher" GAN. We show that the distillation methods used on MNIST, CIFAR-10, and Celeb-A datasets can compress teacher GANs at ratios of 1669:1, 58:1, and 87:1, respectively, while retaining the quality of the generated image. From our experiments, we observe a qualitative limit for GAN's compression. Moreover, we observe that, with a fixed parameter budget, compressed GANs outperform GANs trained using standard training methods. We conjecture that this is partially owing to the optimization landscape of over-parameterized GANs which allows efficient training using alternating gradient descent. Thus, training an over-parameterized GAN followed by our proposed compression scheme provides a high quality generative model with a small number of parameters.


title: Classical and quantum scattering of maximally charged dilaton black holes

abstract: The classical and the quantum scattering of two maximally-charged dilaton black holes which have low velocities are studied. We find a critical value for the dilaton coupling, $a^2=1/3$. For $a^2>1/3$, two black holes are always scattered away and never coalesce together, regardless of the value of the impact parameter.


title: Optimality of testing procedures for survival data

abstract: Most statistical tests for treatment effects used in randomized clinical trials with survival outcomes are based on the proportional hazards assumption, which often fails in practice. Data from early exploratory studies may provide evidence of non-proportional hazards which can guide the choice of alternative tests in the design of practice-changing confirmatory trials. We study a test to detect treatment effects in a late-stage trial which accounts for the deviations from proportional hazards suggested by early-stage data. Conditional on early-stage data, among all tests which control the frequentist Type I error rate at a fixed $\alpha$ level, our testing procedure maximizes the Bayesian prediction of the finite-sample power. Hence, the proposed test provides a useful benchmark for other tests commonly used in presence of non-proportional hazards, for example weighted log-rank tests. We illustrate the approach in a simulations based on data from a published cancer immunotherapy phase III trial.


title: Nanoscale ferroelastic twins formed in strained LaCoO3 films

abstract: The coexistence and coupling of ferroelasticity and magnetic ordering in a single material offers a great opportunity to realize novel devices with multiple tuning knobs. Complex oxides are a particularly promising class of materials to find multiferroic interactions as they often possess rich phase diagrams and the interactions are very sensitive to external perturbations. Still, there are very few examples of these systems. Here we report the observation of twinning domains in ferroelastic LaCoO3 epitaxial thin films and their geometric control of structural symmetry that are intimately linked to the material electronic and magnetic states. A unidirectional structural modulation is achieved by selective choice of substrates possessing two-fold rotational symmetry. This modulation perturbs the crystal field splitting energy, leading to unexpected in plane anisotropy of orbital configuration and magnetization. These findings demonstrate the utilization of structural modulation to control multiferroic interactions and may enable a great potential for stimulation of exotic phenomena through artificial domain engineering.


title: Lift-the-flap: what, where and when for context reasoning

abstract: Context reasoning is critical in a wide variety of applications where current inputs need to be interpreted in the light of previous experience and knowledge. Both spatial and temporal contextual information play a critical role in the domain of visual recognition. Here we investigate spatial constraints (what image features provide contextual information and where they are located), and temporal constraints (when different contextual cues matter) for visual recognition. The task is to reason about the scene context and infer what a target object hidden behind a flap is in a natural image. To tackle this problem, we first describe an online human psychophysics experiment recording active sampling via mouse clicks in lift-the-flap games and identify clicking patterns and features which are diagnostic for high contextual reasoning accuracy. As a proof of the usefulness of these clicking patterns and visual features, we extend a state-of-the-art recurrent model capable of attending to salient context regions, dynamically integrating useful information, making inferences, and predicting class label for the target object over multiple clicks. The proposed model achieves human-level contextual reasoning accuracy, shares human-like sampling behavior and learns interpretable features for contextual reasoning.


title: DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehension

abstract: We present DREAM, the first dialogue-based multiple-choice reading comprehension dataset. Collected from English-as-a-foreign-language examinations designed by human experts to evaluate the comprehension level of Chinese learners of English, our dataset contains 10,197 multiple-choice questions for 6,444 dialogues. In contrast to existing reading comprehension datasets, DREAM is the first to focus on in-depth multi-turn multi-party dialogue understanding. DREAM is likely to present significant challenges for existing reading comprehension systems: 84% of answers are non-extractive, 85% of questions require reasoning beyond a single sentence, and 34% of questions also involve commonsense knowledge. We apply several popular neural reading comprehension models that primarily exploit surface information within the text and find them to, at best, just barely outperform a rule-based approach. We next investigate the effects of incorporating dialogue structure and different kinds of general world knowledge into both rule-based and (neural and non-neural) machine learning-based reading comprehension models. Experimental results on the DREAM dataset show the effectiveness of dialogue structure and general world knowledge. DREAM will be available at https://dataset.org/dream/.


title: Low temperature properties in the Bilayer Kitaev model

abstract: The ground state of the bilayer Kitaev model with the Heisenberg-type interlayer exchange interaction is investigated by means of the exact diagonalization. Calculating the ground-state energy, local quantity defined on each plaquette, and dynamical spin structure factor, we obtain results suggesting the existence of a quantum phase transition between the Kitaev quantum spin liquid (QSL) and dimer singlet states when the interlayer coupling is antiferromagnetic. On the other hand, increasing the ferromagnetic interlayer coupling, there exists no singularity in the physical quantities, suggesting that the $S=1/2$ Kitaev QSL state realized in each layer adiabatically connects to another QSL state realized in the $S=1$ Kitaev model. Thermodynamic properties are also studied by means of the thermal pure quantum state method.


title: LCuts: Linear Clustering of Bacteria using Recursive Graph Cuts

abstract: Bacterial biofilm segmentation poses significant challenges due to lack of apparent structure, poor imaging resolution, limited contrast between conterminous cells and high density of cells that overlap. Although there exist bacterial segmentation algorithms in the existing art, they fail to delineate cells in dense biofilms, especially in 3D imaging scenarios in which the cells are growing and subdividing in a complex manner. A graph-based data clustering method, LCuts, is presented with the application on bacterial cell segmentation. By constructing a weighted graph with node features in locations and principal orientations, the proposed method can automatically classify and detect differently oriented aggregations of linear structures (represent by bacteria in the application). The method assists in the assessment of several facets, such as bacterium tracking, cluster growth, and mapping of migration patterns of bacterial biofilms. Quantitative and qualitative measures for 2D data demonstrate the superiority of proposed method over the state of the art. Preliminary 3D results exhibit reliable classification of the cells with 97% accuracy.


title: Private Secure Coded Computation

abstract: We introduce a variation of coded computation that ensures data security and master's privacy against workers, which is referred to as private secure coded computation. In private secure coded computation, the master needs to compute a function of its own dataset and one of the datasets in a library exclusively shared by external workers. After recovering the desired function, the workers must not be able to know which dataset in the library was desired by the master or obtain any information about the master's own data. We propose a private secure coded computation scheme for matrix multiplication, namely private secure polynomial codes, based on private polynomial codes for private coded computation. In simulations, we show that the private secure polynomial codes achieves better computation time than private polynomial codes modified for private secure coded computation.


title: The Synthetic ALMA Multiband Analysis of the Dust Properties of the TW Hya Protoplanetary Disk

abstract: Analyzing multiband observations of dust continuum emission is one of the useful tools to constrain dust properties which help us to understand the physical properties of the disks. We perform the synthetic ALMA multiband analysis to find the best ALMA band set for constraining the dust properties of the TW Hya protoplanetary disk. We find that the Band [10,6,3] set is the best set among the possible combinations of ALMA Band [3,4,5,6,7,8,9,10]. We also find two conditions for the good ALMA band sets providing narrow constraint ranges on dust properties; (1) Band 9 or 10 is included in the band set and (2) Enough frequency intervals between the bands. These are related with the conditions which give good constraints on dust properties: the combination of optically thick and thin bands are required, and large beta (beta is the power-law index of dust opacity), and low dust temperature are preferable. To examine our synthetic analysis results, we apply the multiband analysis to ALMA archival data of the TW Hya disk at Band 4, 6, 7, and 9. Band [9,6,4] set provides the dust properties close to the model profile, while Band [7,6,4] set gives the dust properties deviating from the model at all radii with too broad constraint range to specify the accurate values of dust temperature, optical depth, and \b{eta}. Since these features are expected by the synthetic multiband analysis, we confirm that the synthetic multiband analysis is well consistent with the results derived from real data.


title: Recovering the spectral and spatial information of an object behind a scattering media

abstract: Light passing through scattering media will be strongly scattered and diffused into complex speckle pattern, which contains almost all the spatial information and spectral information of the objects. Although various methods have been proposed to recover the spatial information of the hidden objects, it is still a challenge to simultaneously obtain their spectral information. Here, we present an effective approach to realize spectral imaging through scattering media by combining the spectra retrieval and the speckle-correlation. Compared to the traditional imaging spectrometer, our approach is more flexible in the choice of core element. In this paper, we have demonstrated employing the frosted glass as the core element to achieve spectral imaging. Obtaining the spectral information and spatial information are demonstrated via numerical simulations. Experiment results further demonstrate the performance of our scheme in spectral imaging through scattering media. The spectral imaging based on scattering media is well suited for new type spectral imaging applications.


title: Laser-Driven Electron Lensing in Silicon Microstructures

abstract: We demonstrate a laser-driven, tunable electron lens fabricated in monolithic silicon. The lens consists of an array of silicon pillars pumped symmetrically by two 300 fs, 1.95 $\mu$m wavelength, nJ-class laser pulses from an optical parametric amplifier. The optical near-field of the pillar structure focuses electrons in the plane perpendicular to the pillar axes. With 100 $\pm$ 10 MV/m incident laser fields, the lens focal length is measured to be 50 $\pm$ 4 $\mu$m, which corresponds to an equivalent quadrupole focusing gradient $B'$ of 1.4 $\pm$ 0.1 MT/m. By varying the incident laser field strength, the lens can be tuned from a 21 $\pm$ 2 $\mu$m focal length ($B'>3.3$ MT/m) to focal lengths on the cm-scale.


title: Social Network Based Substance Abuse Prevention via Network Modification (A Preliminary Study)

abstract: Substance use and abuse is a significant public health problem in the United States. Group-based intervention programs offer a promising means of preventing and reducing substance abuse. While effective, unfortunately, inappropriate intervention groups can result in an increase in deviant behaviors among participants, a process known as deviancy training. This paper investigates the problem of optimizing the social influence related to the deviant behavior via careful construction of the intervention groups. We propose a Mixed Integer Optimization formulation that decides on the intervention groups, captures the impact of the groups on the structure of the social network, and models the impact of these changes on behavior propagation. In addition, we propose a scalable hybrid meta-heuristic algorithm that combines Mixed Integer Programming and Large Neighborhood Search to find near-optimal network partitions. Our algorithm is packaged in the form of GUIDE, an AI-based decision aid that recommends intervention groups. Being the first quantitative decision aid of this kind, GUIDE is able to assist practitioners, in particular social workers, in three key areas: (a) GUIDE proposes near-optimal solutions that are shown, via extensive simulations, to significantly improve over the traditional qualitative practices for forming intervention groups; (b) GUIDE is able to identify circumstances when an intervention will lead to deviancy training, thus saving time, money, and effort; (c) GUIDE can evaluate current strategies of group formation and discard strategies that will lead to deviancy training. In developing GUIDE, we are primarily interested in substance use interventions among homeless youth as a high risk and vulnerable population. GUIDE is developed in collaboration with Urban Peak, a homeless-youth serving organization in Denver, CO, and is under preparation for deployment.


title: CESI: Canonicalizing Open Knowledge Bases using Embeddings and Side Information

abstract: Open Information Extraction (OpenIE) methods extract (noun phrase, relation phrase, noun phrase) triples from text, resulting in the construction of large Open Knowledge Bases (Open KBs). The noun phrases (NPs) and relation phrases in such Open KBs are not canonicalized, leading to the storage of redundant and ambiguous facts. Recent research has posed canonicalization of Open KBs as clustering over manuallydefined feature spaces. Manual feature engineering is expensive and often sub-optimal. In order to overcome this challenge, we propose Canonicalization using Embeddings and Side Information (CESI) - a novel approach which performs canonicalization over learned embeddings of Open KBs. CESI extends recent advances in KB embedding by incorporating relevant NP and relation phrase side information in a principled manner. Through extensive experiments on multiple real-world datasets, we demonstrate CESI's effectiveness.


title: Dataset Culling: Towards Efficient Training Of Distillation-Based Domain Specific Models

abstract: Real-time CNN-based object detection models for applications like surveillance can achieve high accuracy but are computationally expensive. Recent works have shown 10 to 100x reduction in computation cost for inference by using domain-specific networks. However, prior works have focused on inference only. If the domain model requires frequent retraining, training costs can pose a significant bottleneck. To address this, we propose Dataset Culling: a pipeline to reduce the size of the dataset for training, based on the prediction difficulty. Images that are easy to classify are filtered out since they contribute little to improving the accuracy. The difficulty is measured using our proposed confidence loss metric with little computational overhead. Dataset Culling is extended to optimize the image resolution to further improve training and inference costs. We develop fixed-angle, long-duration video datasets across several domains, and we show that the dataset size can be culled by a factor of 300x to reduce the total training time by 47x with no accuracy loss or even with slight improvement. Codes are available: https://github.com/kentaroy47/DatasetCulling


title: Privacy Preserving Off-Policy Evaluation

abstract: Many reinforcement learning applications involve the use of data that is sensitive, such as medical records of patients or financial information. However, most current reinforcement learning methods can leak information contained within the (possibly sensitive) data on which they are trained. To address this problem, we present the first differentially private approach for off-policy evaluation. We provide a theoretical analysis of the privacy-preserving properties of our algorithm and analyze its utility (speed of convergence). After describing some results of this theoretical analysis, we show empirically that our method outperforms previous methods (which are restricted to the on-policy setting).


title: Dating Documents using Graph Convolution Networks

abstract: Document date is essential for many important tasks, such as document retrieval, summarization, event detection, etc. While existing approaches for these tasks assume accurate knowledge of the document date, this is not always available, especially for arbitrary documents from the Web. Document Dating is a challenging problem which requires inference over the temporal structure of the document. Prior document dating systems have largely relied on handcrafted features while ignoring such document internal structures. In this paper, we propose NeuralDater, a Graph Convolutional Network (GCN) based document dating approach which jointly exploits syntactic and temporal graph structures of document in a principled way. To the best of our knowledge, this is the first application of deep learning for the problem of document dating. Through extensive experiments on real-world datasets, we find that NeuralDater significantly outperforms state-of-the-art baseline by 19% absolute (45% relative) accuracy points.


title: Fast and Optimal Laplacian Solver for Gradient-Domain Image Editing using Green Function Convolution

abstract: In computer vision, the gradient and Laplacian of an image are used in different applications, such as edge detection, feature extraction, and seamless image cloning. Computing the gradient of an image is straightforward since numerical derivatives are available in most computer vision toolboxes. However, the reverse problem is more difficult, since computing an image from its gradient requires to solve the Laplacian equation, also called Poisson equation. Current discrete methods are either slow or require heavy parallel computing. The objective of this paper is to present a novel fast and robust method of solving the image gradient or Laplacian with minimal error, which can be used for gradient domain editing. By using a single convolution based on a numerical Green's function, the whole process is faster and straightforward to implement with different computer vision libraries. It can also be optimized on a GPU using fast Fourier transforms and can easily be generalized for an n dimension image. The tests show that, for images of resolution 801x1200, the proposed GFC can solve 100 Laplacian in parallel in around 1.0 milliseconds ms. This is orders of magnitude faster than our nearest competitor which requires 294ms for a single image. Furthermore, we prove mathematically and demonstrate empirically that the proposed method is the least error solver for gradient domain editing. The developed method is also validated with examples of Poisson blending, gradient removal, and the proposed gradient domain merging GDM. Finally, we present how the GDM can be leveraged in future works for convolutional neural networks CNN.


title: Critical initialisation in continuous approximations of binary neural networks

abstract: The training of stochastic neural network models with binary ($\pm1$) weights and activations via continuous surrogate networks is investigated. We derive new surrogates using a novel derivation based on writing the stochastic neural network as a Markov chain. This derivation also encompasses existing variants of the surrogates presented in the literature. Following this, we theoretically study the surrogates at initialisation. We derive, using mean field theory, a set of scalar equations describing how input signals propagate through the randomly initialised networks. The equations reveal whether so-called critical initialisations exist for each surrogate network, where the network can be trained to arbitrary depth. Moreover, we predict theoretically and confirm numerically, that common weight initialisation schemes used in standard continuous networks, when applied to the mean values of the stochastic binary weights, yield poor training performance. This study shows that, contrary to common intuition, the means of the stochastic binary weights should be initialised close to $\pm 1$, for deeper networks to be trainable.


title: The lattice and electronic thermal conductivity of doped SnSe: a first-principles study

abstract: Recently, it has been found that crystalline tin selenide (SnSe) holds great potential as a thermoelectric material due to its ultralow thermal conductivity and moderate electronic transport performance. As thermoelectric application usually requires doped material, charge carriers can play a role in the thermal transport in doped SnSe, but such an effect has not been clearly elucidated in previous theoretical and experimental studies. Here we performed a fully first-principles study on the effects of electrons to the thermal transport in doped SnSe. The electron-phonon coupling (EPC) effects on both phonons and charge carriers were considered using the mode specific calculation in our work. It is found that for phonons, EPC are weak compared to the intrinsic phonon-phonon scattering even at high carrier concentrations and thus have negligible effects on the lattice thermal conductivity. The electronic thermal conductivity is not negligible when the carrier concentration is higher than $10^{19} cm^{-3}$ and the values can be as high as 1.55, 1.45 and 1.77 $Wm^{-1}K^{-1}$ on a, b and c axes, respectively, for $10^{20} cm^{-3}$ electron concentration at 300K. The Lorenz number of SnSe is also calculated and it is dependent on crystal orientations, carrier concentrations, and carrier types. The simple estimation of electronic thermal conductivity using Wiedemann-Franz law can cause large uncertainties for doped SnSe.


title: Compressing Gradient Optimizers via Count-Sketches

abstract: Many popular first-order optimization methods (e.g., Momentum, AdaGrad, Adam) accelerate the convergence rate of deep learning models. However, these algorithms require auxiliary parameters, which cost additional memory proportional to the number of parameters in the model. The problem is becoming more severe as deep learning models continue to grow larger in order to learn from complex, large-scale datasets. Our proposed solution is to maintain a linear sketch to compress the auxiliary variables. We demonstrate that our technique has the same performance as the full-sized baseline, while using significantly less space for the auxiliary variables. Theoretically, we prove that count-sketch optimization maintains the SGD convergence rate, while gracefully reducing memory usage for large-models. On the large-scale 1-Billion Word dataset, we save 25% of the memory used during training (8.6 GB instead of 11.7 GB) by compressing the Adam optimizer in the Embedding and Softmax layers with negligible accuracy and performance loss. For an Amazon extreme classification task with over 49.5 million classes, we also reduce the training time by 38%, by increasing the mini-batch size 3.5x using our count-sketch optimizer.