title: Non-thermal Dark Matter from Modified Early Matter Domination

abstract: Thermal freeze-out or freeze-in during a period of early matter domination can give rise to the correct dark matter abundance for $\langle \sigma_{\rm ann} v \rangle_{\rm f} < 3 \times 10^{-26}$ cm$^3$ s$^{-1}$. In the standard scenario, a single field that behaves like matter drives the early matter dominated era. However, in realistic models, this epoch may involve more than one field. In this paper, we study the effect of such a modification on the production of dark matter during early matter domination. We show that even a subdominant second field that decays much faster than the dominant one can considerably enhance the temperature of the universe during an early matter-dominated phase. This in turn affects dark matter production via freeze-out/in and opens up the allowed parameter space toward significantly larger dark matter masses. As a result, one can comfortably obtain the correct relic abundance for PeV-scale dark matter for reheating temperatures at or below 10 GeV.


title: Corner Modes and Ground-State Degeneracy in Models with Gauge-Like Subsystem Symmetries

abstract: Subsystem symmetries are intermediate between global and gauge symmetries. One can treat these symmetries either like global symmetries that act on subregions of a system, or gauge symmetries that act on the regions transverse to the regions acted upon by the symmetry. We show that this latter interpretation can lead to an understanding of global, topology-dependent features in systems with subsystem symmetries. We demonstrate this with an exactly-solvable lattice model constructed from a 2D system of bosons coupled to a vector field with a 1D subsystem symmetry. The model is shown to host a robust ground state degeneracy that depends on the spatial topology of the underlying manifold, and localized zero energy modes on corners of the system. A continuum field theory description of these phenomena is derived in terms of an anisotropic, modified version of the Abelian K-matrix Chern-Simons field theory. We show that this continuum description can lead to geometric-type effects such as corner states and edge states whose character depends on the orientation of the edge.


title: Exploring the Challenges towards Lifelong Fact Learning

abstract: So far life-long learning (LLL) has been studied in relatively small-scale and relatively artificial setups. Here, we introduce a new large-scale alternative. What makes the proposed setup more natural and closer to human-like visual systems is threefold: First, we focus on concepts (or facts, as we call them) of varying complexity, ranging from single objects to more complex structures such as objects performing actions, and objects interacting with other objects. Second, as in real-world settings, our setup has a long-tail distribution, an aspect which has mostly been ignored in the LLL context. Third, facts across tasks may share structure (e.g., <person, riding, wave> and <dog, riding, wave>). Facts can also be semantically related (e.g., "liger" relates to seen categories like "tiger" and "lion"). Given the large number of possible facts, a LLL setup seems a natural choice. To avoid model size growing over time and to optimally exploit the semantic relations and structure, we combine it with a visual semantic embedding instead of discrete class labels. We adapt existing datasets with the properties mentioned above into new benchmarks, by dividing them semantically or randomly into disjoint tasks. This leads to two large-scale benchmarks with 906,232 images and 165,150 unique facts, on which we evaluate and analyze state-of-the-art LLL methods.


title: The K-User DM Broadcast Channel with Two Groupcast Messages: Achievable Rate Regions and the Combination Network as a Case Study

abstract: A novel class of achievable rate regions is obtained for the K-receiver broadcast channel with two groupcast messages. The associated achievability schemes are parameterized by an expansion of the message set which then determines how random coding techniques are employed, which include generalized versions of {\em up-set} message-splitting, the generation of possibly multiple auxiliary codebooks for certain compositions of split messages using superposition coding, partial interference decoding at all receivers, and joint unique and non-unique decoding. New capacity results are established for certain partially ordered classes of general broadcast channels for certain two non-nested messages. Moreover, when specialized to the combination network (CN), some of the inner bounds are shown, via converse results, to result in the capacity region for (a) the two messages intended for two sets of K-1 receivers each and (b) two nested messages in which one message is intended for one or (c) two (common) receivers. In the latter two cases, we hence recover previous results by Bidokhti et al obtained therein using network coding schemes based on rate-splitting and linear superposition coding. Furthermore, we show the achievability of rate pairs in two examples of CNs, with three and four common receivers each, used in the previous literature to show the sub-optimality of rate-splitting and linear superposition coding, and to motivate a pre-encoding technique and a block-Markov linear superposition coding for the CN, with the latter then lifted to the general broadcast channel. Our results suggest that the proposed framework here, when specialized to the CN, is strong enough to incorporate the enhancements afforded by those two latter techniques, thereby suggesting among other things, that perhaps block-Markov superposition coding is not necessary for the general broadcast channel.


title: Cosmological constant problem: deflation during inflation

abstract: We argue that the discrepancy between the Planck mass scale and the observed value of the cosmological constant can be largely attenuated if those quantities are understood as a result of effective, and thus scale-dependent, couplings. We exemplify this mechanism for the early inflationary epoch of the universe by solving the corresponding effective gap equations, subject to an energy condition. Several non-trivial checks and extensions are discussed. A comparison of our results to the renormalization group flow, obtained within the asymptotic safety program reveals a stunning agreement.


title: An Elementary Approach to Truncations

abstract: We study truncated objects using elementary methods. Concretely, we use universes and the resulting natural number object to define internal truncation levels and prove they behave similar to standard truncated objects. Moreover, we take an elementary approach to localizations, giving various equivalent conditions that characterize localizations and constructing a localization out of a sub-universe of local objects via an internal right Kan extension. We then use this general approach, as well as an inductive approach, to construct truncation functors. We use the resulting truncation functors to prove classical results about truncations, such as Blakers-Massey theorem, in the elementary setting. We also give examples of non-presentable $(\infty, 1)$-categories where the elementary approach can be used to define and compute truncations. Finally, we turn around and use truncations to study elementary $(\infty, 1)$-toposes and show how they can help us better understand subobject classifiers and universes


title: Adversarial Attack and Defense on Graph Data: A Survey

abstract: Deep neural networks (DNNs) have been widely applied to various applications, including image classification, text generation, audio recognition, and graph data analysis. However, recent studies have shown that DNNs are vulnerable to adversarial attacks. Though there are several works about adversarial attack and defense strategies on domains such as images and natural language processing, it is still difficult to directly transfer the learned knowledge to graph data due to its representation structure. Given the importance of graph analysis, an increasing number of studies over the past few years have attempted to analyze the robustness of machine learning models on graph data. Nevertheless, existing research considering adversarial behaviors on graph data often focuses on specific types of attacks with certain assumptions. In addition, each work proposes its own mathematical formulation, which makes the comparison among different methods difficult. Therefore, this review is intended to provide an overall landscape of more than 100 papers on adversarial attack and defense strategies for graph data, and establish a unified formulation encompassing most graph adversarial learning models. Moreover, we also compare different graph attacks and defenses along with their contributions and limitations, as well as summarize the evaluation metrics, datasets and future trends. We hope this survey can help fill the gap in the literature and facilitate further development of this promising new field.


title: Measurement of the differential Drell-Yan cross section in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: Measurements of the differential cross section for the Drell-Yan process, based on proton-proton collision data at a centre-of-mass energy of 13 TeV, collected by the CMS experiment, are presented. The data correspond to an integrated luminosity of 2.8 (2.3) fb$^{-1}$ in the dimuon (dielectron) channel. The total and fiducial cross section measurements are presented as a function of dilepton invariant mass in the range 15 to 3000 GeV, and compared with the perturbative predictions of the standard model. The measured differential cross sections are in good agreement with the theoretical calculations.


title: Group evolution patterns in running races

abstract: We address the problem of tracking and detecting interactions between the different groups of runners that form during a race. In athletic races control points are set to monitor the progress of athletes over the course. Intuitively, a {\it group} is a sufficiently large set of athletes that cross a control point together. After adapting an existing definition of group to our setting we go on to study two types of group evolution patterns. The primary focus of this work are {\it evolution patterns}, i.e. the transformation and interaction of groups of athletes between two consecutive control points. We provide an accurate geometric model of the following evolution patterns: survives, appears, disappears, expands, shrinks, merges, splits, coheres and disbands, and present algorithms to efficiently compute these patterns. Next, based on the algorithms introduced for identifying evolution patterns, algorithms to detect {\it long-term patterns} are introduced. These patterns track global properties over several control points: surviving, traceable forward, traceable backward and related forward and backward. Experimental evaluation of the algorithms provided is presented using real and synthetic data. Using the data currently available, our experiments show how our algorithms can provide valuable insight into how running races develop. Moreover, we also show how, even if dense (synthetic) data is considered, our algorithms are also able to process it in real time.


title: Theory of Quantum Transport at Nanoscale (introduction and contents)

abstract: Preface, introduction and contents to the book "Theory of Quantum Transport at Nanoscale", published in 2016 by Springer, the author version.


title: A Unified Learning Based Framework for Light Field Reconstruction from Coded Projections

abstract: Light field presents a rich way to represent the 3D world by capturing the spatio-angular dimensions of the visual signal. However, the popular way of capturing light field (LF) via a plenoptic camera presents spatio-angular resolution trade-off. Computational imaging techniques such as compressive light field and programmable coded aperture reconstruct full sensor resolution LF from coded projections obtained by multiplexing the incoming spatio-angular light field. Here, we present a unified learning framework that can reconstruct LF from a variety of multiplexing schemes with minimal number of coded images as input. We consider three light field capture schemes: heterodyne capture scheme with code placed near the sensor, coded aperture scheme with code at the camera aperture and finally the dual exposure scheme of capturing a focus-defocus pair where there is no explicit coding. Our algorithm consists of three stages 1) we recover the all-in-focus image from the coded image 2) we estimate the disparity maps for all the LF views from the coded image and the all-in-focus image, 3) we then render the LF by warping the all-in-focus image using disparity maps and refine it. For these three stages we propose three deep neural networks - ViewNet, DispairtyNet and RefineNet. Our reconstructions show that our learning algorithm achieves state-of-the-art results for all the three multiplexing schemes. Especially, our LF reconstructions from focus-defocus pair is comparable to other learning-based view synthesis approaches from multiple images. Thus, our work paves the way for capturing high-resolution LF (~ a megapixel) using conventional cameras such as DSLRs. Please check our supplementary materials $\href{https://docs.google.com/presentation/d/1Vr-F8ZskrSd63tvnLfJ2xmEXY6OBc1Rll3XeOAtc11I/}{online}$ to better appreciate the reconstructed light fields.


title: Consistent relativistic mean field models constrained by GW170817

abstract: We have obtained the Love number and corresponding tidal deformabilites ($\Lambda$) associated with the relativistic mean-field parametrizations shown to be consistent (CRMF) with the nuclear matter, pure neutron matter, symmetry energy and its derivatives [Dutra, et al., Phys. Rev. C 90, 055203 (2014)]. Our results show that CRMF models present very good agreement with the recent data from binary neutron star merger event GW170817. They also confirm the strong correlation between $\Lambda_{1.4}$ and the radius of canonical stars ($R_{1.4}$). When a recently GW170817 constraint on $\Lambda_{1.4}$ and the corresponding radius $R_{1.4}$ is used, the majority of the models tested are shown to satisfy it.


title: Measurement of the top quark mass in the all-jets final state at $\sqrt{s} =$ 13 TeV and combination with the lepton+jets channel

abstract: A top quark mass measurement is performed using 35.9 fb$^{-1}$ of LHC proton-proton collision data collected with the CMS detector at $\sqrt{s} =$ 13 TeV. The measurement uses the $\mathrm{t\overline{t}}$ all-jets final state. A kinematic fit is performed to reconstruct the decay of the $\mathrm{t\overline{t}}$ system and suppress the multijet background. Using the ideogram method, the top quark mass ($m_\mathrm{t}$) is determined, simultaneously constraining an additional jet energy scale factor (JSF). The resulting value of $m_\mathrm{t}$ = 172.34 $\pm$ 0.20 (stat+JSF) $\pm$ 0.70 (syst) GeV is in good agreement with previous measurements. In addition, a combined measurement that uses the $\mathrm{t\overline{t}}$ lepton+jets and all-jets final states is presented, using the same mass extraction method, and provides an $m_\mathrm{t}$ measurement of 172.26 $\pm$ 0.07 (stat+JSF) $\pm$ 0.61 (syst) GeV. This is the first combined $m_\mathrm{t}$ extraction from the lepton+jets and all-jets channels through a single likelihood function.


title: The top quark charge asymmetry in $t\bar{t}\gamma$ production at the LHC

abstract: We consider the top quark charge asymmetry in the process $pp \to t\bar{t}+\gamma$ at the 13 TeV LHC. The genuine tree level asymmetry in the $q\bar{q}$ channel is large with about -12%. However, the symmetric $gg$ channel, photon radiation off top quark decay products, and higher order corrections wash out the asymmetry and obscure its observability. In this work, we investigate these effects at next-to-leading order QCD and check the robustness of theoretical predictions. We find a sizable perturbative correction and discuss its origins and implications. We also study dedicated cuts for enhancing the asymmetry and show that a measurement is possible with an integrated luminosity of 150 fb$^{-1}$.


title: Formation and composition-dependent properties of alloys of cubic halide perovskites

abstract: Distinct shortcomings of individual halide perovskites for solar applications, such as restricted range of band gaps, propensity of ABX3 to decompose into AX+BX2, or oxidation of 2ABX3 into A2BX6 have led to the need to consider alloys of individual perovskites. This creates a non-trivial material-selection problem, spanning a continuum of three sets of compositions (one for each sub lattice), and requiring control of phase-separation or ordering in each alloyed subfield. Not surprisingly, material and structure choices were made thus far mostly via trial-and-error explorations. We use ideas from solid state theory of semiconductor alloys to analyze the behaviors of the (FA,Cs)(Pb,Sn)I3 alloys system. Density functional calculations utilizing specially constructed supercells (SQS) are used to calculate the composition dependence of band gaps, energy of decomposition and alloy mixing enthalpies. A number of trends are observed for A-site as well as for B-site alloys. To understand the physical reasons that control these trends we decompose the alloy properties into distinct physical terms: (i) the energies associated with removing the octahedral deformations (tilting, rotations, B site displacements), (ii) the energies of compressing the larger component and expanding the smaller one to the alloy volume, (iii) the charge transfer energies associated with placing the alloyed units onto a common lattice, and finally, (iv) structural relaxation of all bonds within the cells., This analysis clarifies the origin of the observed trends in bang gaps, decomposition energies and mixing enthalpies. Unlike a number of previous calculations we find that the a proper description of alloy physics requires that even the pure, non-alloyed end-point compounds be allowed to develop local environment dependent octahedral deformation that lowers significantly the total energy and raises their band gaps.


title: Prediction of Industrial Process Parameters using Artificial Intelligence Algorithms

abstract: In the present paper, a method of defining the industrial process parameters for a new product using machine learning algorithms will be presented. The study will describe how to go from the product characteristics till the prediction of the suitable machine parameters to produce a good quality of this product, and this is based on an historical training dataset of similar products with their respective process parameters. In the first part of our study, we will focus on the ultrasonic welding process definition, welding parameters and on how it operate. While in second part, we present the design and implementation of the prediction models such multiple linear regression, support vector regression, and we compare them to an artificial neural networks algorithm. In the following part, we present a new application of Convolutional Neural Networks (CNN) to the industrial process parameters prediction. In addition, we will propose the generalization approach of our CNN to any prediction problem of industrial process parameters. Finally the results of the four methods will be interpreted and discussed.


title: A Greedy Approach to $\ell_{0,\infty}$ Based Convolutional Sparse Coding

abstract: Sparse coding techniques for image processing traditionally rely on a processing of small overlapping patches separately followed by averaging. This has the disadvantage that the reconstructed image no longer obeys the sparsity prior used in the processing. For this purpose convolutional sparse coding has been introduced, where a shift-invariant dictionary is used and the sparsity of the recovered image is maintained. Most such strategies target the $\ell_0$ "norm" or the $\ell_1$ norm of the whole image, which may create an imbalanced sparsity across various regions in the image. In order to face this challenge, the $\ell_{0,\infty}$ "norm" has been proposed as an alternative that "operates locally while thinking globally". The approaches taken for tackling the non-convexity of these optimization problems have been either using a convex relaxation or local pursuit algorithms. In this paper, we present an efficient greedy method for sparse coding and dictionary learning, which is specifically tailored to $\ell_{0,\infty}$, and is based on matching pursuit. We demonstrate the usage of our approach in salt-and-pepper noise removal and image inpainting. A code package which reproduces the experiments presented in this work is available at https://web.eng.tau.ac.il/~raja


title: Uncertainty Autoencoders: Learning Compressed Representations via Variational Information Maximization

abstract: Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised representation learning inspired by compressed sensing. We treat the low-dimensional projections as noisy latent representations of an autoencoder and directly learn both the acquisition (i.e., encoding) and amortized recovery (i.e., decoding) procedures. Our learning objective optimizes for a tractable variational lower bound to the mutual information between the datapoints and the latent representations. We show how our framework provides a unified treatment to several lines of research in dimensionality reduction, compressed sensing, and generative modeling. Empirically, we demonstrate a 32% improvement on average over competing approaches for the task of statistical compressed sensing of high-dimensional datasets.


title: An approximate dynamic programming approach to food security of communities following hazards

abstract: Food security can be threatened by extreme natural hazard events for households of all social classes within a community. To address food security issues following a natural disaster, the recovery of several elements of the built environment within a community, including its building portfolio, must be considered. Building portfolio restoration is one of the most challenging elements of recovery owing to the complexity and dimensionality of the problem. This study introduces a stochastic scheduling algorithm for the identification of optimal building portfolio recovery strategies. The proposed approach provides a computationally tractable formulation to manage multi-state, large-scale infrastructure systems. A testbed community modeled after Gilroy, California, is used to illustrate how the proposed approach can be implemented efficiently and accurately to find the near-optimal decisions related to building recovery following a severe earthquake.


title: A Transfer Operator Methodology for Optimal Sensor Placement Accounting for Uncertainty

abstract: Sensors in buildings are used for a wide variety of applications such as monitoring air quality, contaminants, indoor temperature, and relative humidity. These are used for accessing and ensuring indoor air quality, and also for ensuring safety in the event of chemical and biological attacks. It follows that optimal placement of sensors become important to accurately monitor contaminant levels in the indoor environment. However, contaminant transport inside the indoor environment is governed by the indoor flow conditions which are affected by various uncertainties associated with the building systems including occupancy and boundary fluxes. Therefore, it is important to account for all associated uncertainties while designing the sensor layout. The transfer operator based framework provides an effective way to identify optimal placement of sensors. Previous work has been limited to sensor placements under deterministic scenarios. In this work we extend the transfer operator based approach for optimal sensor placement while accounting for building systems uncertainties. The methodology provides a probabilistic metric to gauge coverage under uncertain conditions. We illustrate the capabilities of the framework with examples exhibiting boundary flux uncertainty.


title: Probing Cosmic Acceleration by Using Model-Independent Parametrizations and Three Kinds of Supernova Statistics Techniques

abstract: In this work, we explore the evolution of the dark energy equation of state {\omega} by using Chevalliear-PolarskiLinder (CPL) parametrization and the binned parametrizations. For binned parametrizations, we adopt three methods to choose the redshift interval: I. Ensure that "{\Delta}z = const", where {\Delta}z is the width of each bin; II.Ensure that "n{\Delta}z = const", where n is the number of SNIa in each bin; III. Treat redshift discontinuity points as models parameters, i.e. "free {\Delta}z". For observational data, we adopt JLA type Ia supernova (SNIa) samples, SDSS DR12 data, and Planck 2015 distance priors. In particular, for JLA SNIa samples, we consider three statistic techniques: I. Magnitude statistics, which is the traditional method; II. Flux statistics, which reduces the systematic uncertainties of SNIa; III. Improve flux statistics, which can reduce the systematic uncertainties and give tighter constrains at the same time. The results are as follows: (1) For all the cases, {\omega} = -1 is always satisfied at 1{\sigma} confidence regions; It means that {\Lambda}CDM is still favored by current observations. (2) For magnitude statistics, "free {\Delta}z" model will give the smallest error bars; this conclusion does not hold true for flux statistics and improved flux statistic. (3) The improved flux statistic yields a largest present fractional density of matter {\Omega}m; in addition, this technique will give a largest current deceleration parameter q0 , which reveals a universe with a slowest cosmic acceleration.


title: Time evolution of rotating and magnetized white dwarf stars

abstract: We investigate the evolution of isolated, zero and finite temperature, massive, uniformly rotating and highly magnetized white dwarf stars under angular momentum loss driven by magnetic dipole braking. We consider the structure and thermal evolution of white dwarf isothermal cores taking also into account the nuclear burning and neutrino emission processes. We estimate the white dwarf lifetime before it reaches the condition either for a type Ia supernova explosion or for the gravitational collapse to a neutron star. We study white dwarfs with surface magnetic fields from $10^6$ to $10^{9}$~G and masses from $1.39$ to $1.46~M_\odot$ and analyze the behavior of the white dwarf parameters such as moment of inertia, angular momentum, central temperature and magnetic field intensity as a function of lifetime. The magnetic field is involved only to slow down white dwarfs, without affecting their equation of state and structure. In addition, we compute the characteristic time of nuclear reactions and dynamical time scale. The astrophysical consequences of the results are discussed.


title: Basic mechanisms of escape of a harmonically forced classical particle from a potential well

abstract: In various models and systems involving the escape of periodically forced particle from the potential well, a common pattern is observed. Namely, the minimal forcing amplitude required for the escape exhibits sharp minimum for the excitation frequency below the natural frequency of small oscillations in the well. The paper explains this regularity by exploring the transient escape dynamics in simple benchmark potential wells. In the truncated parabolic well, in absence of the damping the minimal forcing amplitude obviously tends to zero for the natural excitation frequency. Addition of weak symmetric softening nonlinearity to the truncated parabolic well leads to the nonzero forcing minimum below the natural frequency. We explicitly compute this shift in the principal approximation by considering the slow-flow dynamics in conditions of the principal 1:1 resonance. Essentially nonlinear model, analyzed with the help of transformation to action-angle variables, demonstrates very similar qualitative features of the transient escape dynamics.

categories: nlin.CD math.DS nlin.PS physics.class-ph


title: On symmetric primitive potentials

abstract: The concept of a primitive potential for the Schroedinger operator on the line was introduced in [2,3,4]. Such a potential is determined by a pair of positive functions on a finite interval, called the dressing functions, which are not uniquely determined by the potential. The potential is constructed by solving a contour problem on the complex plane. In this paper, we consider a reduction where the dressing functions are equal. We show that in this case, the resulting potential is symmetric, and describe how to analytically compute the potential as a power series. In addition, we establish that if the dressing functions are both equal to one, then the resulting primitive potential is the elliptic one-gap potential.


title: Deep Item-based Collaborative Filtering for Sparse Implicit Feedback

abstract: Recommender systems are ubiquitous in the domain of e-commerce, used to improve the user experience and to market inventory, thereby increasing revenue for the site. Techniques such as item-based collaborative filtering are used to model users' behavioral interactions with items and make recommendations from items that have similar behavioral patterns. However, there are challenges when applying these techniques on extremely sparse and volatile datasets. On some e-commerce sites, such as eBay, the volatile inventory and minimal structured information about items make it very difficult to aggregate user interactions with an item. In this work, we describe a novel deep learning-based method to address the challenges. We propose an objective function that optimizes a similarity measure between binary implicit feedback vectors between two items. We demonstrate formally and empirically that a model trained to optimize this function estimates the log of the cosine similarity between the feedback vectors. We also propose a neural network architecture optimized on this objective. We present the results of experiments comparing the output of the neural network with traditional item-based collaborative filtering models on an implicit-feedback dataset, as well as results of experiments comparing different neural network architectures on user purchase behavior on eBay. Finally, we discuss the results of an A/B test that show marked improvement of the proposed technique over eBay's existing collaborative filtering recommender system.


title: Coulomb cluster explosion boosted by an electrical pulse -- neutron source, diagnostic tool, and test of nuclear fusion efficiency

abstract: To greatly enhance output of fusion-produced neutrons in a laser-initiated Coulomb explosion of $D$ clusters, we propose to accelerate $D^+$ ions by an electrical pulse to the energies where the $D^+ + D$ collision cross-section is the highest. With $D^+$ ions bombarding a $D$-rich cathode, this solves a few problems simultaneously by (a) removing electron cloud hindering the Coulomb explosion, (b) utilizing up to $100 \%$ of the ions to hit the high-density packed nuclei, and (c) reaching highly increased cross-section of neutron production in a single $D^+ + D$ collision, by using a multi-layered target. We show that neutron output can reach up to $10^{15}$ per shot, which provides for a powerful and compact neutron source. We also consider the use of $E$-pulse acceleration for diagnostic purposes.


title: A minimal non-supersymmetric SO(10) model with Peccei--Quinn symmetry

abstract: We present a minimal non-supersymmetric SO(10) GUT breaking directly to the Standard Model gauge group. Precise gauge coupling unification is achieved due to the presence of two color-octet scalars, one of which is accessible to LHC searches. Proton lifetime is predicted to be below $4.5\times 10^{34}$ years, which is within the projected five-year sensitivity of the proposed Hyper-Kamiokande experiment. We find that the Standard Model observables are reproduced to a reasonable accuracy in a numerical fit, which also predicts the unknown neutrino parameters. Finally, the two scalar representations stabilize the electroweak vacuum and the dark matter is comprised of axions.


title: Automatic Summarization of Natural Language

abstract: Automatic summarization of natural language is a current topic in computer science research and industry, studied for decades because of its usefulness across multiple domains. For example, summarization is necessary to create reviews such as this one. Research and applications have achieved some success in extractive summarization (where key sentences are curated), however, abstractive summarization (synthesis and re-stating) is a hard problem and generally unsolved in computer science. This literature review contrasts historical progress up through current state of the art, comparing dimensions such as: extractive vs. abstractive, supervised vs. unsupervised, NLP (Natural Language Processing) vs Knowledge-based, deep learning vs algorithms, structured vs. unstructured sources, and measurement metrics such as Rouge and BLEU. Multiple dimensions are contrasted since current research uses combinations of approaches as seen in the review matrix. Throughout this summary, synthesis and critique is provided. This review concludes with insights for improved abstractive summarization measurement, with surprising implications for detecting understanding and comprehension in general.


title: Learning to Recognize 3D Human Action from A New Skeleton-based Representation Using Deep Convolutional Neural Networks

abstract: Recognizing human actions in untrimmed videos is an important challenging task. An effective 3D motion representation and a powerful learning model are two key factors influencing recognition performance. In this paper we introduce a new skeleton-based representation for 3D action recognition in videos. The key idea of the proposed representation is to transform 3D joint coordinates of the human body carried in skeleton sequences into RGB images via a color encoding process. By normalizing the 3D joint coordinates and dividing each skeleton frame into five parts, where the joints are concatenated according to the order of their physical connections, the color-coded representation is able to represent spatio-temporal evolutions of complex 3D motions, independently of the length of each sequence. We then design and train different Deep Convolutional Neural Networks (D-CNNs) based on the Residual Network architecture (ResNet) on the obtained image-based representations to learn 3D motion features and classify them into classes. Our method is evaluated on two widely used action recognition benchmarks: MSR Action3D and NTU-RGB+D, a very large-scale dataset for 3D human action recognition. The experimental results demonstrate that the proposed method outperforms previous state-of-the-art approaches whilst requiring less computation for training and prediction.


title: Generalized Score Matching for Non-Negative Data

abstract: A common challenge in estimating parameters of probability density functions is the intractability of the normalizing constant. While in such cases maximum likelihood estimation may be implemented using numerical integration, the approach becomes computationally intensive. The score matching method of Hyv\"arinen [2005] avoids direct calculation of the normalizing constant and yields closed-form estimates for exponential families of continuous distributions over $\mathbb{R}^m$. Hyv\"arinen [2007] extended the approach to distributions supported on the non-negative orthant, $\mathbb{R}_+^m$. In this paper, we give a generalized form of score matching for non-negative data that improves estimation efficiency. As an example, we consider a general class of pairwise interaction models. Addressing an overlooked inexistence problem, we generalize the regularized score matching method of Lin et al. [2016] and improve its theoretical guarantees for non-negative Gaussian graphical models.


title: The Coherent Crooks Equality

abstract: This chapter reviews an information theoretic approach to deriving quantum fluctuation theorems. When a thermal system is driven from equilibrium, random quantities of work are required or produced: the Crooks equality is a classical fluctuation theorem that quantifies the probabilities of these work fluctuations. The framework summarised here generalises the Crooks equality to the quantum regime by modeling not only the driven system but also the control system and energy supply that enables the system to be driven. As is reasonably common within the information theoretic approach but high unusual for fluctuation theorems, this framework explicitly accounts for the energy conservation using only time independent Hamiltonians. We focus on explicating a key result derived by Johan {\AA}berg: a Crooks-like equality for when the energy supply is allowed to exist in a superposition of energy eigenstates states.


title: Solving Archaeological Puzzles

abstract: Puzzle solving is a difficult problem in its own right, even when the pieces are all square and build up a natural image. But what if these ideal conditions do not hold? One such application domain is archaeology, where restoring an artifact from its fragments is highly important. From the point of view of computer vision, archaeological puzzle solving is very challenging, due to three additional difficulties: the fragments are of general shape; they are abraded, especially at the boundaries (where the strongest cues for matching should exist); and the domain of valid transformations between the pieces is continuous. The key contribution of this paper is a fully-automatic and general algorithm that addresses puzzle solving in this intriguing domain. We show that our state-of-the-art approach manages to correctly reassemble dozens of broken artifacts and frescoes.


title: Some remarks on the subrack lattice of finite racks

abstract: The set of all subracks $\mathcal{R}(X)$ of a finite rack $X$ form a lattice under inclusion. We prove that if a rack $X$ satisfies a certain condition then the homotopy type of the order complex of $\mathcal{R}(X)$ is a $(m-2)$-sphere, where $m$ is the number of maximal subracks of $X$. The rack $X$ satisfying the condition of this general result is necessarily decomposable. Two particular instances occur when \begin{itemize} \item $X=G$ is a group rack, and when \item $X=C$ is a conjugacy class rack of a nilpotent group. \end{itemize} We also studied the subrack lattices of indecomposable racks by focusing on the conjugacy class racks of symmetric or alternating groups and determined the homotopy types of the corresponding order complexes in some cases.


title: Translating Ecological Integrity terms into operational language to inform societies

abstract: It is crucial that societies are informed on the risks of impoverished ecosystem health for their well-being. For this purpose, Ecological Integrity (EI) is a useful concept that seeks to capture the complex nature of ecosystems and their interaction with social welfare. But the challenge remains to measure EI and translate scientific terminology into operational language to inform society. We propose an approach that simplifies marine ecosystem complexity by applying scientific knowledge to identify which components reflect the state or state change of ecosystems. It follows a bottom-up structure that identifies, based on expert knowledge, biological components related with past and present changing conditions. It is structured in 5 stages that interact in an adaptive way: stage 1, in situ observations suggest changes could be happening; stage 2 explores available data that represent EI; stage 3, experts' workshops target the identification of the minimum set of variables needed to define EI, or the risk of losing EI; an optative stage 4, where deviance from EI, or risk of deviance, is statistically assessed; stage 5, findings are communicated to society. We demonstrate the framework effectiveness in three case studies, including a data poor situation, an area where lack of reference sites hampers the identification of historical changes, and an area where diffuse sources of stress make it difficult to identify simple relationships with of ecological responses. The future challenge is to operationalize the approach and trigger desirable society actions to strengthen a social-nature link.


title: Bayesian Approach for Parameter Estimation of Continuous-Time Stochastic Volatility Models using Fourier Transform Methods

abstract: We propose a two stage procedure for the estimation of the parameters of a fairly general, continuous-time stochastic volatility. An important ingredient of the proposed method is the Cuchiero-Teichmann volatility estimator, which is based on Fourier transforms and provides a continuous time estimate of the latent process. This estimate is then used to construct an approximate likelihood for the parameters of interest, whose restrictions are taken into account through prior distributions. The procedure is shown to be highly successful for constructing the posterior distribution of the parameters of a Heston model, while limited success is achieved when applied to the highly parametrized exponential-Ornstein-Uhlenbeck.


title: Energy conservation in explicit solutions as a simple illustration of Noether's theorem

abstract: Noether's theorem is widely regarded as one of the most elegant results in theoretical physics. The article presents two simple examples that can be used to demonstrate the basic idea behind Noether's theorem, by deriving a relation between translational symmetry in the time coordinate and energy conservation in a way that is accessible to beginning students.


title: Deception Detection by 2D-to-3D Face Reconstruction from Videos

abstract: Lies and deception are common phenomena in society, both in our private and professional lives. However, humans are notoriously bad at accurate deception detection. Based on the literature, human accuracy of distinguishing between lies and truthful statements is 54% on average, in other words it is slightly better than a random guess. While people do not much care about this issue, in high-stakes situations such as interrogations for series crimes and for evaluating the testimonies in court cases, accurate deception detection methods are highly desirable. To achieve a reliable, covert, and non-invasive deception detection, we propose a novel method that jointly extracts reliable low- and high-level facial features namely, 3D facial geometry, skin reflectance, expression, head pose, and scene illumination in a video sequence. Then these features are modeled using a Recurrent Neural Network to learn temporal characteristics of deceptive and honest behavior. We evaluate the proposed method on the Real-Life Trial (RLT) dataset that contains high-stake deceptive and honest videos recorded in courtrooms. Our results show that the proposed method (with an accuracy of 72.8%) improves the state of the art as well as outperforming the use of manually coded facial attributes 67.6%) in deception detection.


title: Roton-Induced Trapping in Strongly Correlated Rydberg Gases

abstract: Atoms excited into high-lying Rydberg states and under strong dipole-dipole interactions exhibit phenomena associated with highly correlated and complex systems. We perform first principles numerical simulations on the dynamics of such systems. The emergence of a roton minimum in the excitation spectrum, as expected in strongly correlated gases and accurately described by Feynman's theory of liquid helium, is shown to significantly inhibit particle transport, with a strong suppression of the diffusion coefficient, due to the emerging spatial order. We also demonstrate how the ability to temporally tune the interaction strength among Rydberg atoms can be used in order to overcome the effects of disorder induced heating, allowing the study of unprecedented highly coupled regimes.


title: Metastable ferroelectricity in optically strained $SrTiO_3$

abstract: Fluctuating orders in solids are generally considered high-temperature precursors of broken symmetry phases. However, in some cases these fluctuations persist to zero temperature and prevent the emergence of long-range order, as for example observed in quantum spin and dipolar liquids. $SrTiO_3$ is a quantum paraelectric in which dipolar fluctuations grow when the material is cooled, although a long-range ferroelectric order never sets in. We show that the nonlinear excitation of lattice vibrations with mid-infrared optical pulses can induce polar order in $SrTiO_3$ up to temperatures in excess of 290 K. This metastable phase, which persists for hours after the optical pump is interrupted, is evidenced by the appearance of a large second-order optical nonlinearity that is absent in equilibrium. Hardening of a low-frequency mode indicates that the polar order may be associated with a photo-induced ferroelectric phase transition. The spatial distribution of the optically induced polar domains suggests that a new type of photo-flexoelectric coupling triggers this effect.


title: Quantization of color Lie bialgebras

abstract: The main purpose of this paper is to study Quantization of color Lie bialgebras, generalizing to color case the approach by Etingof-Kazhdan which were considered for superbialgebras by Geer. Moreover we discuss Drinfeld category, Quantization of Triangular color Lie bialgebras and Simple color Lie bialgebras of Cartan type.


title: Spinor-vector duality and sterile neutrinos in string derived models

abstract: The MiniBooNE collaboration found evidence for the existence of sterile neutrinos, at a mass scale comparable to the active left-handed neutrinos. While sterile neutrinos arise naturally in large volume string scenarios, they are more difficult to accommodate in heterotic-string derived models that reproduce the GUT embedding of the Standard Model particles. Sterile neutrinos in heterotic-string models imply the existence of an additional Abelian gauge symmetry at low scales, possibly within reach of contemporary colliders. I discuss the construction of string derived Z' models that utilise the spinor-vector duality to guarantee that the extra $U(1)_{Z^\prime}$ symmetry can remain unbroken down to low scales.


title: The Prophet Inequality Can Be Solved Optimally with a Single Set of Samples

abstract: The setting of the classic prophet inequality is as follows: a gambler is shown the probability distributions of $n$ independent, non-negative random variables with finite expectations. In their indexed order, a value is drawn from each distribution, and after every draw the gambler may choose to accept the value and end the game, or discard the value permanently and continue the game. What is the best performance that the gambler can achieve in comparison to a prophet who can always choose the highest value? Krengel, Sucheston, and Garling solved this problem in 1978, showing that there exists a strategy for which the gambler can achieve half as much reward as the prophet in expectation. Furthermore, this result is tight. In this work, we consider a setting in which the gambler is allowed much less information. Suppose that the gambler can only take one sample from each of the distributions before playing the game, instead of knowing the full distributions. We provide a simple and intuitive algorithm that recovers the original approximation of $\frac{1}{2}$. Our algorithm works against even an almighty adversary who always chooses a worst-case ordering, rather than the standard offline adversary. The result also has implications for mechanism design -- there is much interest in designing competitive auctions with a finite number of samples from value distributions rather than full distributional knowledge.


title: BlinkML: Efficient Maximum Likelihood Estimation with Probabilistic Guarantees

abstract: The rising volume of datasets has made training machine learning (ML) models a major computational cost in the enterprise. Given the iterative nature of model and parameter tuning, many analysts use a small sample of their entire data during their initial stage of analysis to make quick decisions (e.g., what features or hyperparameters to use) and use the entire dataset only in later stages (i.e., when they have converged to a specific model). This sampling, however, is performed in an ad-hoc fashion. Most practitioners cannot precisely capture the effect of sampling on the quality of their model, and eventually on their decision-making process during the tuning phase. Moreover, without systematic support for sampling operators, many optimizations and reuse opportunities are lost. In this paper, we introduce BlinkML, a system for fast, quality-guaranteed ML training. BlinkML allows users to make error-computation tradeoffs: instead of training a model on their full data (i.e., full model), BlinkML can quickly train an approximate model with quality guarantees using a sample. The quality guarantees ensure that, with high probability, the approximate model makes the same predictions as the full model. BlinkML currently supports any ML model that relies on maximum likelihood estimation (MLE), which includes Generalized Linear Models (e.g., linear regression, logistic regression, max entropy classifier, Poisson regression) as well as PPCA (Probabilistic Principal Component Analysis). Our experiments show that BlinkML can speed up the training of large-scale ML tasks by 6.26x-629x while guaranteeing the same predictions, with 95% probability, as the full model.


title: Concentration phenomena for the fractional $Q$-curvature equation in dimension 3 and fractional Poisson formulas

abstract: We study the compactness properties of metrics of prescribed fractional $Q$-curvature of order $3$ in $\R^3$. We will use an approach inspired from conformal geometry, seeing a metric on a subset of $\R^3$ as the restriction of a metric on $\R^4_+$ with vanishing fourth-order $Q$-curvature. We will show that a sequence of such metrics with uniformly bounded fractional $Q$-curvature can blow up on a large set (roughly, the zero set of the trace of a nonpositive biharmonic function $\Phi$ in $\R^4_+$), in analogy with a $4$-dimensional result of Adimurthi-Robert-Struwe, and construct examples of such behaviour. In doing so, we produce general Poisson-type representation formulas (also for higher dimension), which are of independent interest.


title: Classical entanglement underpins the propagation invariance of space-time wave packets

abstract: Space-time wave packets are propagation-invariant pulsed beams that travel in free space without diffraction or dispersion by virtue of tight correlations introduced into their spatio-temporal spectrum. Such correlations constitute an embodiment of classical entanglement between continuous degrees of freedom. Using a measure of classical entanglement based on the Schmidt number of the field, we demonstrate theoretically and experimentally that the degree of classical entanglement determines the diffraction-free propagation distance of ST wave packets. Reduction in the degree of classical entanglement manifests itself in an increased uncertainty in the measured spatio-temporal spectral correlations.


title: Self-healing of space-time light sheets

abstract: Space-time wave packets are diffraction-free, dispersion-free pulsed beams whose propagation-invariance stems from correlations introduced into their spatio-temporal spectrum. We demonstrate here experimentally and computationally that space-time light sheets exhibit self-healing properties upon traversing obstacles in the form of opaque obstructions. The unscattered fraction of the wave packet retains the spatio-temporal correlations and thus propagation-invariance is maintained. The scattered component does not satisfy the requisite correlation and thus undergoes diffractive spreading. These results indicate the robustness of ST wave packets and their potential utility for deep illumination and imaging in scattering media such as biological tissues.


title: QuickSel: Quick Selectivity Learning with Mixture Models

abstract: Estimating the selectivity of a query is a key step in almost any cost-based query optimizer. Most of today's databases rely on histograms or samples that are periodically refreshed by re-scanning the data as the underlying data changes. Since frequent scans are costly, these statistics are often stale and lead to poor selectivity estimates. As an alternative to scans, query-driven histograms have been proposed, which refine the histograms based on the actual selectivities of the observed queries. Unfortunately, these approaches are either too costly to use in practice---i.e., require an exponential number of buckets---or quickly lose their advantage as they observe more queries. In this paper, we propose a selectivity learning framework, called QuickSel, which falls into the query-driven paradigm but does not use histograms. Instead, it builds an internal model of the underlying data, which can be refined significantly faster (e.g., only 1.9 milliseconds for 300 queries). This fast refinement allows QuickSel to continuously learn from each query and yield increasingly more accurate selectivity estimates over time. Unlike query-driven histograms, QuickSel relies on a mixture model and a new optimization algorithm for training its model. Our extensive experiments on two real-world datasets confirm that, given the same target accuracy, QuickSel is 34.0x-179.4x faster than state-of-the-art query-driven histograms, including ISOMER and STHoles. Further, given the same space budget, QuickSel is 26.8%-91.8% more accurate than periodically-updated histograms and samples, respectively.


title: Secure Estimation under Causative Attacks

abstract: This paper considers the problem of secure parameter estimation when the estimation algorithm is prone to causative attacks. Causative attacks, in principle, target decision-making algorithms to alter their decisions by making them oblivious to specific attacks. Such attacks influence inference algorithms by tampering with the mechanism through which the algorithm is provided with the statistical model of the population about which an inferential decision is made. Causative attacks are viable, for instance, by contaminating the historical or training data, or by compromising an expert who provides the model. In the presence of causative attacks, the inference algorithms operate under a distorted statistical model for the population from which they collect data samples. This paper introduces specific notions of secure estimation and provides a framework under which secure estimation under causative attacks can be formulated. A central premise underlying the secure estimation framework is that forming secure estimates introduces a new dimension to the estimation objective, which pertains to detecting attacks and isolating the true model. Since detection and isolation decisions are imperfect, their inclusion induces an inherent coupling between the desired secure estimation objective and the auxiliary detection and isolation decisions that need to be formed in conjunction with the estimates. This paper establishes the fundamental interplay among the decisions involved and characterizes the general decision rules in closed-form for any desired estimation cost function. Furthermore, to circumvent the computational complexity associated with growing parameter dimension or attack complexity, a scalable estimation algorithm and its attendant optimality guarantees are provided. The theory developed is applied to secure parameter estimation in a sensor network.


title: Implementing the inverse type-II seesaw mechanism into the 3-3-1 model

abstract: After the LHC is turning on and accumulating more data, the TeV scale seesaw mechanisms for small neutrino masses in the form of inverse seesaw mechanisms are gaining more and more attention once they provide neutrino masses at sub-eV scale and can be probed at the LHC. Here we restrict our investigation to the inverse type II seesaw case and implement it into the framework of the 3-3-1 model with right-handed neutrinos. As interesting result, the mechanism provides small masses to both the standard neutrinos as well as to the right-handed ones. Its best signature are the doubly charged scalars which are sextet by the 3-3-1 symmetry. We investigate their production at the LHC through the process $\sigma (p\,p \rightarrow Z^*, \gamma^* ,Z^{\prime} \rightarrow \Delta^{++}\,\Delta^{--})$ and their signal through four leptons final state decay channel.


title: Magnonic Band Structure Established by Chiral Spin-Density Waves in Thin Film Ferromagnets

abstract: Recent theoretical studies have demonstrated the possibility to excite and sustain noncollinear magnetization states in ferromagnetic nanowires. The resulting state is referred to as a spin-density wave (SDW). SDWs can be interpreted as hydrodynamic states with a constant fluid density and fluid velocity in systems with easy-plane anisotropy. Here, we consider the effect of the nonlocal dipole field arising from the finite thickness of magnetic thin films on the spatial profile of the SDW and on the associated magnon dispersion. Utilizing a hydrodynamic formulation of the Larmor torque equation, it is found that the nonlocal dipole field modulates the fluid velocity. Such a modulation induces a magnonic band structure unlike the typical dispersion relation for magnons on uniform magnetization. The analytical results are validated by micromagnetic simulations. Band gaps on the order of GHz are numerically observed to depend on the SDW fluid velocity and film thickness for realistic material parameters. The presented results suggest that SDWs can find applications as reconfigurable magnonic crystals.


title: Box algorithm for the solution of differential equations on a quantum annealer

abstract: Differential equations are ubiquitous in models of physical phenomena. Applications like steady-state analysis of heat flow and deflection in elastic bars often admit to a second order differential equation. In this paper, we discuss the use of a quantum annealer to solve such differential equations by recasting a finite element model in the form of an Ising hamiltonian. The discrete variables involved in the Ising model introduce complications when defining differential quantities, for instance, gradients involved in scientific computations of solid and fluid mechanics. To address this issue, a graph coloring based methodology is proposed which searches iteratively for solutions in a subspace of weak solutions defined over a graph, hereafter called as the 'box algorithm.' The box algorithm is demonstrated by solving a truss mechanics problem on the D-Wave quantum computer.


title: Realization of predicted exotic materials: The burden of proof

abstract: Trove of exotic topoloid structures has recently been predicted by searching for compounds whose calculated band structure crossing points fulfill specific symmetry requirements. Discovery of exciting physical phenomena by experimental studies of such predicted compounds is just around the corner. Yet, the examination of some of these assumed high-symmetry structures suggests that not always will assembly of atoms in a configuration that yields exotic topological properties be protected against energy-lowering symmetry breaking modes. Indeed, although bulk topological characteristics lead to protected surface/edge states, nothing protects bulk states from structural instability. The burden of proof for theoretical predictions of exciting physical phenomena should include some compelling hints that such phenomena can live in thermodynamically stable (or near stable) compounds. Herein, we illustrate how the use of the calculated total (electron + ion) energies of candidate structures can remove false-positive predicted topoloids from the list of likely realizable compounds, to the benefit of the much-cherished iterative process of theory-experiment materials discovery.


title: Systematics in nucleon matrix element calculations

abstract: The current status of calculations of simple nucleon structure observables is reviewed, with a focus on the axial charge. A major challenge is the combination of an exponentially decaying signal-to-noise ratio and the need for large source-sink separations to eliminate excited-state contributions; efforts to understand and deal with this problem are the focus of the largest section of this review. Finite-volume effects and chiral extrapolation are also briefly discussed.


title: Random batch methods (RBM) for interacting particle systems

abstract: We develop Random Batch Methods for interacting particle systems with large number of particles. These methods use small but random batches for particle interactions, thus the computational cost is reduced from $O(N^2)$ per time step to $O(N)$, for a system with $N$ particles with binary interactions. On one hand, these methods are efficient Asymptotic-Preserving schemes for the underlying particle systems, allowing $N$-independent time steps and also capture, in the $N \to \infty$ limit, the solution of the mean field limit which are nonlinear Fokker-Planck equations; on the other hand, the stochastic processes generated by the algorithms can also be regarded as new models for the underlying problems. For one of the methods, we give a particle number independent error estimate under some special interactions. Then, we apply these methods to some representative problems in mathematics, physics, social and data sciences, including the Dyson Brownian motion from random matrix theory, Thomson's problem, distribution of wealth, opinion dynamics and clustering. Numerical results show that the methods can capture both the transient solutions and the global equilibrium in these problems.


title: Deconfounding Reinforcement Learning in Observational Settings

abstract: We propose a general formulation for addressing reinforcement learning (RL) problems in settings with observational data. That is, we consider the problem of learning good policies solely from historical data in which unobserved factors (confounders) affect both observed actions and rewards. Our formulation allows us to extend a representative RL algorithm, the Actor-Critic method, to its deconfounding variant, with the methodology for this extension being easily applied to other RL algorithms. In addition to this, we develop a new benchmark for evaluating deconfounding RL algorithms by modifying the OpenAI Gym environments and the MNIST dataset. Using this benchmark, we demonstrate that the proposed algorithms are superior to traditional RL methods in confounded environments with observational data. To the best of our knowledge, this is the first time that confounders are taken into consideration for addressing full RL problems with observational data. Code is available at https://github.com/CausalRL/DRL.


title: A Combination Theorem for PD(n)-Pairs

abstract: We prove a combination theorem for PD(n)-pairs.


title: Towards effective AI-powered agile project management

abstract: The rise of Artificial intelligence (AI) has the potential to significantly transform the practice of project management. Project management has a large socio-technical element with many uncertainties arising from variability in human aspects e.g., customers' needs, developers' performance and team dynamics. AI can assist project managers and team members by automating repetitive, high-volume tasks to enable project analytics for estimation and risk prediction, providing actionable recommendations, and even making decisions. AI is potentially a game changer for project management in helping to accelerate productivity and increase project success rates. In this paper, we propose a framework where AI technologies can be leveraged to offer support for managing agile projects, which have become increasingly popular in the industry.


title: Linearized Gaussian Processes for Fast Data-driven Model Predictive Control

abstract: Data-driven Model Predictive Control (MPC), where the system model is learned from data with machine learning, has recently gained increasing interests in the control community. Gaussian Processes (GP), as a type of statistical models, are particularly attractive due to their modeling flexibility and their ability to provide probabilistic estimates of prediction uncertainty. GP-based MPC has been developed and applied, however the optimization problem is typically non-convex and highly demanding, and scales poorly with model size. This causes unsatisfactory solving performance, even with state-of-the-art solvers, and makes the approach less suitable for real-time control. We develop a method based on a new concept, called linearized Gaussian Process, and Sequential Convex Programming, that can significantly improve the solving performance of GP-based MPC. Our method is not only faster but also much more scalable and predictable than other commonly used methods, as it is much less influenced by the model size. The efficiency and advantages of the algorithm are demonstrated clearly in a numerical example.


title: Color-Doppler Echocardiography Flow Field Velocity Reconstruction Using a Streamfunction -Vorticity Formulation

abstract: We introduce a new method, (Doppler Velocity Reconstruction or DoVeR), for reconstructing two-component velocity fields from color Doppler scans. DoVeR employs the streamfunction-vorticity equation, which satisfies mass conservation while accurately approximating the flow rate of rotation. We validated DoVeR using artificial color Doppler images generated from computational fluid dynamics models of left ventricle (LV) flow. We compare DoVeR against the conventional intraventricular Vector Flow Mapping (iVFM1D) and reformulated iVFM (iVFM2D). LV model error analysis showed DoVeR is more robust to noise and probe placement, with noise RMS errors (nRMSE) between 3.81%-6.67%, while the iVFM methods delivered 4.16%-24.17% for iVFM1D and 4.06%-400.21% for iVFM2D. We test the DoVeR and iVFM methods using in-vivo mouse-LV ultrasound scans. DoVeR yielded more hemodynamically accurate reconstructions, suggesting that it can provide a more reliable approach for robust quantification of cardiac flow.


title: A Data-driven Framework for Error Estimation and Mesh-Model Optimization in System-level Thermal-Hydraulic Simulation

abstract: Over the past decades, several computer codes were developed for simulation and analysis of thermal-hydraulics of system behaviors in nuclear reactors under operating, abnormal transient and accident conditions. However, simulation errors and uncertainties still inevitably exist even while these codes have been extensively assessed and used. In this work, a data-driven framework (Optimal Mesh/Model Information System, OMIS) is formulated and demonstrated to estimate simulation error and suggest optimal selection of coarse mesh size and models for low-fidelity system-level thermal-hydraulic simulation, such as coarse-mesh Computational Fluid Dynamics-like (CFD-like) codes, to achieve accuracy comparable to that of high-fidelity simulation, such as high-resolution CFD. Based on high-fidelity data and massive fast-running low-fidelity simulations, error database is built and used to train a machine learning model and find the relationship between local simulation error and local physical features. This machine learning model is then used to generate insight and help correct low-fidelity simulations for similar physical conditions. The OMIS framework is designed as a modularized six-step procedure and accomplished with methods and algorithms in the state of the art. A mixed convection case study was performed to illustrate the entire framework.


title: Hierarchical Clustering for Euclidean Data

abstract: Recent works on Hierarchical Clustering (HC), a well-studied problem in exploratory data analysis, have focused on optimizing various objective functions for this problem under arbitrary similarity measures. In this paper we take the first step and give novel scalable algorithms for this problem tailored to Euclidean data in R^d and under vector-based similarity measures, a prevalent model in several typical machine learning applications. We focus primarily on the popular Gaussian kernel and other related measures, presenting our results through the lens of the objective introduced recently by Moseley and Wang [2017]. We show that the approximation factor in Moseley and Wang [2017] can be improved for Euclidean data. We further demonstrate both theoretically and experimentally that our algorithms scale to very high dimension d, while outperforming average-linkage and showing competitive results against other less scalable approaches.


title: Effects of interaction range on the behavior of opinion consensus

abstract: We have frequently encountered the rapid changes that prevalent opinion of the social community is toppled by a new and opposite opinion against the pre-exiting one. To understand this interesting process, mean-field model with infinite-interaction range has been mostly considered in previous studies S. A. Marvel et al., Phys. Rev. Lett. 110, 118702(2012). However, the mean-field interaction range is lack of reality in the sense that any individual cannot interact with all of the others in the community. Based on it, in the present work, we consider a simple model of opinion consensus so-called basic model on the low-dimensional lattices ($d$=1,2) with finite interaction range. The model consists of four types of subpopulations with different opinions: $A, B, AB$, and the zealot of $A$ denoted by $A_c$, following the basic model shown in the work by S. A. Marvel et al.. Comparing with their work, we consider the finite range of the interaction, and particularly reconstruct the lattice structure by adding new links when the two individuals have the distance $<\sigma$. We explore how the interaction range $\sigma$ affects the opinion consensus process on the reconstructed lattice structure. We find that the critical fraction of population for $A_c$ required for the opinion consensus on $A$ shows different behaviors in the small and large interaction ranges. Especially, the critical fraction for $A_c$ increases with the size of $\sigma$ in the region of small interaction range, which is counter-intuitive: When the interaction range is increased, not only the number of nodes affected by $A_c$ but also that affected by $B$ grows, which is believed to cause the increasing behavior of the critical fraction for $A_c$. We also present the difference of dynamic process to the opinion consensus between the regions of small and large interaction ranges.


title: Extending TCP for Accelerating Replication on Cluster File Systems over SDNs

abstract: This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.


title: Intersection homology duality and pairings: singular, PL, and sheaf-theoretic

abstract: We compare the sheaf-theoretic and singular chain versions of Poincare duality for intersection homology, showing that they are isomorphic via naturally defined maps. Similarly, we demonstrate the existence of canonical isomorphisms between the singular intersection cohomology cup product, the hypercohomology product induced by the Goresky-MacPherson sheaf pairing, and, for PL pseudomanifolds, the Goresky-MacPherson PL intersection product. We also show that the de Rham isomorphism of Brasselet, Hector, and Saralegi preserves product structures.


title: Associative $n$-categories

abstract: We define novel fully combinatorial models of higher categories. Our definitions are based on a connection of higher categories to "directed spaces". Directed spaces are locally modelled on manifold diagrams, which are stratifications of the n-cube such that strata are transversal to the flag foliation of the n-cube. The first part of this thesis develops a combinatorial model for manifold diagrams called singular n-cubes. In the second part we apply this model to build our notions of higher categories. Singular n-cubes are "directed triangulations" of space together with a decomposition into a collection of subspaces or strata. Singular n-cubes can be naturally organised into two categories. The first, whose morphisms are bundles themselves, is used for the inductive definition of singular (n+1)-cubes. The second, whose morphisms are "open" base changes, admits an (epi,mono) factorisation system. Monomorphisms will be called embeddings of cubes. Epimorphisms will be called collapses and describe how triangulations can be coarsened. Each cube has a unique coarsest triangulation called its normal form. The existence of normal forms makes the equality relation of (combinatorially represented) manifold diagrams decidable. As the main application of the resulting combinatorial framework for manifold diagrams, we give algebraic definitions of various notions of higher categories. Namely, we define associative n-categories, presented associative n-categories and presented associative n-groupoids. All three notions will have strict units and associators; the only weak coherences are homotopies, but we develop a mechanism for recovering the usual coherence data of weak n-categories, such as associators and pentagonators and their higher analogues. This will motivate the conjecture that the theory of associative higher categories is equivalent to its fully weak counterpart.


title: Learning Dynamic Generator Model by Alternating Back-Propagation Through Time

abstract: This paper studies the dynamic generator model for spatial-temporal processes such as dynamic textures and action sequences in video data. In this model, each time frame of the video sequence is generated by a generator model, which is a non-linear transformation of a latent state vector, where the non-linear transformation is parametrized by a top-down neural network. The sequence of latent state vectors follows a non-linear auto-regressive model, where the state vector of the next frame is a non-linear transformation of the state vector of the current frame as well as an independent noise vector that provides randomness in the transition. The non-linear transformation of this transition model can be parametrized by a feedforward neural network. We show that this model can be learned by an alternating back-propagation through time algorithm that iteratively samples the noise vectors and updates the parameters in the transition model and the generator model. We show that our training method can learn realistic models for dynamic textures and action patterns.


title: Synthesizing Robust Domains of Attraction for State-Constrained Perturbed Polynomial Systems

abstract: In this paper we propose a novel semi-definite programming based method to compute robust domains of attraction for state-constrained perturbed polynomial systems. A robust domain of attraction is a set of states such that every trajectory starting from it will approach an equilibrium while never violating a specified state constraint, regardless of the actual perturbation. The semi-definite program is constructed by relaxing a generalized Zubov's equation. The existence of solutions to the constructed semi-definite program is guaranteed and there exists a sequence of solutions such that their strict one sub-level sets inner-approximate the interior of the maximal robust domain of attraction in measure under appropriate assumptions. Some illustrative examples demonstrate the performance of our method.


title: Coefficient Estimates for Certain Subclass of Bi Functions Associated the Horadam Polynomials

abstract: In the present article, our goal is finding estimates on the Taylor-Maclaurin coefficients |a2| and |a3| for a new class of bi-univalent functions defined by means of the Horadam polynomials. Fekete-Szego inequalities of functions belonging to this subclass are also founded.


title: Bridge Damage Detection using a Single-Stage Detector and Field Inspection Images

abstract: Detecting concrete surface damages is a vital task for maintaining the structural health and reliability of highway bridges. Currently, most of these tasks are conducted manually which could be cumbersome and time-consuming. Recent rapid advancement in convolution neural network has enabled the development of deep learning-based visual inspection techniques for detecting multiple structural damages. However, most deep learning-based techniques are built on two-stage, proposal-driven detectors and using less complex image data, which is not promising to promote practical applications and integration within intelligent autonomous inspection systems. In this study, a faster, simpler single-stage detector is proposed based on YOLOv3 for detecting multiple concrete damages of highway bridges. To realize this, a bridge damage dataset consisting of field inspection images is prepared. These images have large variations in damage appearance and monitoring scene and are labeled with four types of concrete damages: crack, pop-out, spalling and exposed rebar. The original YOLOv3 is further improved by introducing a novel transfer learning method, Batch Renormalization and Focal Loss. The improved YOLOv3 is evaluated in terms of average precision and speed. The results show that the improved YOLOv3 has a detection accuracy of up to 80%. Its performance is about 13% better than the original YOLOv3.


title: Adjoint Difference Equation for a Nikiforov-Uvarov-Suslov difference equation of hypergeometric type on Non-uniform Lattices

abstract: In this article, we establish the adjoint equation for Nikiforov-Uvarov-Suslov difference equation of hypergeometric type on non-uniform lattices, and prove it to be a difference equation of hypergeometric type on non-uniform lattices as well. The particular solutions of the adjoint equation are then obtained. As an appliction of these particular solutions, we use them to obtain the particular solutions for the original difference equation of hypergeometric type on non-uniform lattices. Finally, we prove another kind of fundamental theorems for Nikiforov-Uvarov-Suslov difference equation of hypergeometric type, which are essentially new results, its expression is different from Suslov's Theorem.


title: Eyes on the Prize: Improved Biological Surface Registration via Forward Propagation

abstract: Many algorithms for surface registration risk producing significant errors if surfaces are significantly nonisometric. Manifold learning has been shown to be effective at improving registration quality, using information from an entire collection of surfaces to correct issues present in pairwise registrations. These methods, however, are not robust to changes in the collection of surfaces, or do not produce accurate registrations at a resolution high enough for subsequent downstream analysis. We propose a novel algorithm for efficiently registering such collections given initial correspondences with varying degrees of accuracy. By combining the initial information with recent developments in manifold learning, we employ a simple metric condition to construct a measure on the space of correspondences between any pair of shapes in our collection, which we then use to distill soft correspondences. We demonstrate that this measure can improve correspondence accuracy between feature points compared to currently employed, less robust methods on a diverse dataset of surfaces from evolutionary biology. We then show how our methods can be used, in combination with recent sampling and interpolation methods, to compute accurate and consistent homeomorphisms between surfaces.


title: On the Beta Transformation

abstract: The beta transformation is the iterated map $\beta x\,\mod1$; it generates the base-$\beta$ expansion of a real number x. Every iterated piece-wise monotonic map is topologically conjugate to the beta transformation. For all but a countable subset of $\beta$, the orbits of $x$ are ergodic; yet it is the finite orbits that determine overall behavior. This is a large text; it splits into four parts. The first part provides a review of general concepts and properties associated with the beta shift. The second part examines the spectrum of the Ruelle-Frobenius-Perron operator, and gives explicit expressions for a set of bounded eigenfunctions. These form a discrete spectrum, accumulating on a circle of radius $1/\beta$ in the complex plane. The third part examines the finite and the periodic orbits. These are in one-to-one correspondence with monic integer polynomials. They are "quasi-cyclotomic" and can be counted with Moreau's necklace-counting function; curiously, they do not have any obvious relation to other systems countable by the necklace function. The positive real roots are dense in the reals; they include the Golden and silver ratios, the Pisot numbers, the n-bonacci (tribonacci, tetranacci, etc.) numbers. The beta-polynomials yoke all of these together into a regular structure. An explicit bijection to the rationals is presented. The fourth part of this text examines small perturbations. These introduce Arnold tongues, which inflate the finite orbits, a set of measure zero, to finite size. This text assumes very little mathematical sophistication on the part of the reader, and should be approachable for any enthusiast with minimal or no prior experience in ergodic theory. Most of the development is casual. As a side effect, the introductory sections are perhaps a fair bit longer than strictly needed to present the new results.


title: Bayesian Fusion Estimation via t-Shrinkage

abstract: Shrinkage prior has gained great successes in many data analysis, however, its applications mostly focus on the Bayesian modeling of sparse parameters. In this work, we will apply Bayesian shrinkage to model high dimensional parameter that possesses an unknown blocking structure. We propose to impose heavy-tail shrinkage prior, e.g., $t$ prior, on the differences of successive parameter entries, and such a fusion prior will shrink successive differences towards zero and hence induce posterior blocking. Comparing to conventional Bayesian fused lasso which implements Laplace fusion prior, $t$ fusion prior induces stronger shrinkage effect and enjoys a nice posterior consistency property. Simulation studies and real data analyses show that $t$ fusion has superior performance to the frequentist fusion estimator and Bayesian Laplace-fusion prior. This $t$-fusion strategy is further developed to conduct a Bayesian clustering analysis, and simulation shows that the proposed algorithm obtains better posterior distributional convergence than the classical Dirichlet process modeling.


title: Deep Learning based Early Detection and Grading of Diabetic Retinopathy Using Retinal Fundus Images

abstract: Diabetic Retinopathy (DR) is a constantly deteriorating disease, being one of the leading causes of vision impairment and blindness. Subtle distinction among different grades and existence of many significant small features make the task of recognition very challenging. In addition, the present approach of retinopathy detection is a very laborious and time-intensive task, which heavily relies on the skill of a physician. Automated detection of diabetic retinopathy is essential to tackle these problems. Early-stage detection of diabetic retinopathy is also very important for diagnosis, which can prevent blindness with proper treatment. In this paper, we developed a novel deep convolutional neural network, which performs the early-stage detection by identifying all microaneurysms (MAs), the first signs of DR, along with correctly assigning labels to retinal fundus images which are graded into five categories. We have tested our network on the largest publicly available Kaggle diabetic retinopathy dataset, and achieved 0.851 quadratic weighted kappa score and 0.844 AUC score, which achieves the state-of-the-art performance on severity grading. In the early-stage detection, we have achieved a sensitivity of 98% and specificity of above 94%, which demonstrates the effectiveness of our proposed method. Our proposed architecture is at the same time very simple and efficient with respect to computational time and space are concerned.


title: Asymptotic Distribution of Centralized $r$ When Sampling from Cauchy

abstract: Assume that $X$ and $Y$ are independent random variables, each having a Cauchy distribution with a known median. Taking a random independent sample of size $n$ of each $X$ and $Y$, one can then compute their centralized empirical correlation coefficient $r$. Analytically investigating the sampling distribution of this $r$ appears possible only in the large $n$ limit; this is what we have done in this article, deriving several new and interesting results.


title: On modules with reducible complexity

abstract: In this paper we generalize a result, concerning a depth equality over local rings, proved independently by Araya and Yoshino, and Iyengar. Our result exploits complexity, a concept which was initially defined by Alperin for finitely generated modules over group algebras, introduced and studied in local algebra by Avramov, and subsequently further developed by Bergh.


title: Overstable Convective Modes of Rotating Hot Jupiters

abstract: We calculate overstable convective modes of uniformly rotating hot Jupiters, which have a convective core and a thin radiative envelope. Convective modes in rotating planets have complex frequency $\omega$ and are stabilized by rapid rotation so that their growth rates $\propto\omega_{\rm I}={\rm Im}(\omega)$ are much smaller than those for the non-rotating planets. The stabilized convective modes excite low frequency gravity waves in the radiative envelope by frequency resonance between them. We find that the convective modes that excite envelope gravity waves remain unstable even in the presence of non-adiabatic dissipations in the envelope. We calculate the heating rates due to non-adiabatic dissipations of the oscillation energy of the unstable convective modes and find that the magnitudes of the heating rates cannot be large enough to inflate hot Jupiters sufficiently so long as the oscillation amplitudes remain in the linear regime.


title: Quasi-homogeneous black hole thermodynamics

abstract: Although the fundamental equations of ordinary thermodynamic systems are known to correspond to first-degree homogeneous functions, in the case of non-ordinary systems like black holes the corresponding fundamental equations are not homogeneous. We present several arguments, indicating that black holes should be described by means of quasi-homogeneous functions of degree different from one. In particular, we show that imposing the first-degree condition leads to contradictory results in thermodynamics and geometrothermodynamics of black holes. As a consequence, we show that in generalized gravity theories the coupling constants like the cosmological constant, the Born-Infeld parameter or the Gauss-Bonnet constant must be considered as thermodynamic variables.


title: Rigidity of proper holomorphic mappings between generalized Fock-Bargmann-Hartogs domains

abstract: A generalized Fock-Bargmann-Hartogs domain $D_n^{\mathbf{m},\mathbf{p}}$ is defined as a domain fibered over $\mathbb{C}^{n}$ with the fiber over $z\in \mathbb{C}^{n}$ being a generalized complex ellipsoid $\Sigma_z({\mathbf{m},\mathbf{p}})$. In general, a generalized Fock-Bargmann-Hartogs domain is an unbounded non-hyperbolic domains without smooth boundary. The main contribution of this paper is as follows. By using the explicit formula of Bergman kernels of the generalized Fock-Bargmann-Hartogs domains, we obtain the rigidity results of proper holomorphic mappings between two equidimensional generalized Fock-Bargmann-Hartogs domains. We therefore exhibit an example of unbounded weakly pseudoconvex domains on which the rigidity results of proper holomorphic mappings can be built.


title: Hopping from Chebyshev polynomials to permutation statistics

abstract: We prove various formulas which express exponential generating functions counting permutations by the peak number, valley number, double ascent number, and double descent number statistics in terms of the exponential generating function for Chebyshev polynomials, as well as cyclic analogues of these formulas for derangements. We give several applications of these results, including formulas for the $(-1)$-evaluation of some of these distributions. Our proofs are combinatorial and involve the use of monomino-domino tilings, the modified Foata-Strehl action (a.k.a. valley-hopping), and a cyclic analogue of this action due to Sun and Wang.


title: Structural insights into characterizing binding sites in EGFR kinase mutants

abstract: Over the last two decades epidermal growth factor receptor (EGFR) kinase has become an important target to treat non-small cell lung cancer (NSCLC). Currently, three generations of EGFR kinase-targeted small molecule drugs have been FDA approved. They nominally produce a response at the start of treatment and lead to a substantial survival benefit for patients. However, long-term treatment results in acquired drug resistance and further vulnerability to NSCLC. Therefore, novel EGFR kinase inhibitors that specially overcome acquired mutations are urgently needed. To this end, we carried out a comprehensive study of different EGFR kinase mutants using a structural systems pharmacology strategy. Our analysis shows that both wild-type and mutated structures exhibit multiple conformational states that have not been observed in solved crystal structures. We show that this conformational flexibility accommodates diverse types of ligands with multiple types of binding modes. These results provide insights for designing a new-generation of EGFR kinase inhibitor that combats acquired drug-resistant mutations through a multi-conformation-based drug design strategy.


title: Self-consistent Force Scheme in the Discrete Boltzmann Equation

abstract: In the work of N. Martys et al. [Nicos S. Martys, Xiaowen Shan, Hudong Chen, Phys. Rev. E, Vol. 58, Num.5, 1998 ], a self-consistent force term to any order in the Boltzmann-BKG equation is derived by the Hermite basis with raw velocity. As an extension, in the present work, the force term is expanded by the Hermite basis with the relative velocity in the comoving coordinate and the Hermite basis with the relative velocity scaled by the local temperature. It is found that the force scheme proposed by He et al. [Xiaoyi He, Xiaowen Shan, Gary D. Doolen, Phys. Rev. E, Vol. 57, Num.1,1998] can be derived by the Hermite basis with the relative velocity. Furthermore, another new force scheme in which the velocity is scaled by the local temperature is obtained.


title: Cross-relation Cross-bag Attention for Distantly-supervised Relation Extraction

abstract: Distant supervision leverages knowledge bases to automatically label instances, thus allowing us to train relation extractor without human annotations. However, the generated training data typically contain massive noise, and may result in poor performances with the vanilla supervised learning. In this paper, we propose to conduct multi-instance learning with a novel Cross-relation Cross-bag Selective Attention (C$^2$SA), which leads to noise-robust training for distant supervised relation extractor. Specifically, we employ the sentence-level selective attention to reduce the effect of noisy or mismatched sentences, while the correlation among relations were captured to improve the quality of attention weights. Moreover, instead of treating all entity-pairs equally, we try to pay more attention to entity-pairs with a higher quality. Similarly, we adopt the selective attention mechanism to achieve this goal. Experiments with two types of relation extractor demonstrate the superiority of the proposed approach over the state-of-the-art, while further ablation studies verify our intuitions and demonstrate the effectiveness of our proposed two techniques.


title: Sanctorum: A lightweight security monitor for secure enclaves

abstract: Enclaves have emerged as a particularly compelling primitive to implement trusted execution environments: strongly isolated sensitive user-mode processes in a largely untrusted software environment. While the threat models employed by various enclave systems differ, the high-level guarantees they offer are essentially the same: attestation of an enclave's initial state, as well as a guarantee of enclave integrity and privacy in the presence of an adversary. This work describes Sanctorum, a small trusted code base (TCB), consisting of a generic enclave-capable system, which is sufficient to implement secure enclaves akin to the primitive offered by Intel's SGX. While enclaves may be implemented via unconditionally trusted hardware and microcode, as it is the case in SGX, we employ a smaller TCB principally consisting of authenticated, privileged software, which may be replaced or patched as needed. Sanctorum implements a formally verified specification for generic enclaves on an in-order multiprocessor system meeting baseline security requirements, e.g., the MIT Sanctum processor and the Keystone enclave framework. Sanctorum requires trustworthy hardware including a random number generator, a private cryptographic key pair derived via a secure bootstrapping protocol, and a robust isolation primitive to safeguard sensitive information. Sanctorum's threat model is informed by the threat model of the isolation primitive, and is suitable for adding enclaves to a variety of processor systems.


title: Melanopogenesis: Dark Matter of (almost) any Mass and Baryonic Matter from the Evaporation of Primordial Black Holes weighing a Ton (or less)

abstract: The evaporation of primordial black holes with a mass in the $1\ {\rm gram}\lesssim M_{\rm PBH}\lesssim$1000 kg range can lead to the production of dark matter particles of almost any mass in the range $0.1\ {\rm MeV}\lesssim m_{\rm DM}\lesssim 10^{18}$ GeV with the right relic density at very early times, $\tau\lesssim 10^{-10}$ s. We calculate, as a function of the primordial black holes mass and initial abundance, the combination of dark matter particle masses and number of effective dark degrees of freedom leading to the right abundance of dark matter today, whether or not evaporation stops around the Planck scale. In addition, since black hole evaporation can also lead to the production of a baryon asymmetry, we calculate where dark matter production and baryogenesis can concurrently happen, under a variety of assumptions: baryogenesis via grand unification boson decay, via leptogenesis, or via asymmetric co-genesis of dark matter and ordinary matter. Finally, we comment on possible ways to test this scenario.


title: Double Neural Counterfactual Regret Minimization

abstract: Counterfactual Regret Minimization (CRF) is a fundamental and effective technique for solving Imperfect Information Games (IIG). However, the original CRF algorithm only works for discrete state and action spaces, and the resulting strategy is maintained as a tabular representation. Such tabular representation limits the method from being directly applied to large games and continuing to improve from a poor strategy profile. In this paper, we propose a double neural representation for the imperfect information games, where one neural network represents the cumulative regret, and the other represents the average strategy. Furthermore, we adopt the counterfactual regret minimization algorithm to optimize this double neural representation. To make neural learning efficient, we also developed several novel techniques including a robust sampling method, mini-batch Monte Carlo Counterfactual Regret Minimization (MCCFR) and Monte Carlo Counterfactual Regret Minimization Plus (MCCFR+) which may be of independent interests. Experimentally, we demonstrate that the proposed double neural algorithm converges significantly better than the reinforcement learning counterpart.


title: Permanence properties of the second nilpotent product of groups

abstract: We show that amenability, the Haagerup property, the Kazhdan's property (T) and exactness are preserved under taking second nilpotent product of groups. We also define the restricted second nilpotent wreath product of groups, this is a semi-direct product akin to the restricted wreath product but constructed from the second nilpotent product. We then show that if two discrete groups have the Haagerup property, the restricted second nilpotent wreath product of them also has the Haagerup property. We finally show that if a discrete group is abelian, then the restricted second nilpotent wreath product constructed from it is unitarizable if and only if the acting group is amenable.