title: Bound states in the Brillouin zone continuum

abstract: Systems with space-periodic Hamiltonians have unique scattering properties. The discrete translational symmetry associated with periodicity of the Hamiltonian creates scattering channels that govern the scattering process. We consider a two-dimensional scattering system in which one dimension is a periodic lattice and the other is localized in space. The scattering and decay processes can then be described in terms of channels indexed by the Bloch momentum. We find the 1D periodic lattice can sustain two types of bound states in the positive energy continuum (BICs): one protected by reflection symmetry, the other protected by discrete translational symmetry. The lattice also sustains long-lived quasibound states. We expect that our results can be generalized to the behavior of states in the continuum of 2D periodic lattices.


title: Refractive index measurements of multicellular tumour spheroids using optical coherence tomography: dependence on growth phase and size

abstract: Knowledge of optical properties, such as the refractive index (RI), of biological tissues is important in optical imaging, as they influence the distribution and propagation of light in tissue. To accurately study the response of cancerous cells to drugs, optimised imaging protocols are required. This study uses a simple custom-built spectral domain optical coherence tomography (OCT) system to conduct RI measurements of multicellular spheroids, three-dimensional \textit{in-vitro} culture systems, of the cell line HCT116. The spheroid RIs are compared to study the effect of growth time. To improve confocal microscopy imaging protocols, two immersion media (glycerol and ScaleView-A2) matching the spheroid RIs were trialled, with the aim to reduce the RI mismatch between the spheroid and the immersion medium and thus improving imaging depth with confocal microscopy. ScaleView-A2 (n = 1.380) aided in achieving greater depths of imaging of the multicellular spheroids under confocal microscopy. This improvement in imaging depth confirmed the utility of our RI measurements, proving the promising outlook of OCT as a complementary tool to microscopy in cancer research.


title: Tracing Multi-Scale Magnetic Field Structure Using Multiple Chemical Tracers in Giant Molecular Clouds

abstract: Probing magnetic fields in Giant Molecular Clouds is often challenging. Fortunately, recently simulations show that analysis of velocity gradients (the Velocity Gradient Technique) can be used to map out the magnetic field morphology of different physical layers within molecular clouds when applied CO isotopologues with different optical depths. Here, we test the effectiveness of the Velocity Gradient Technique in reconstructing the magnetic field structure of the molecular cloud Vela C, employing seven chemical tracers that have different optical depths, i.e. 12CO, 13CO, C18O, CS, HNC, HCO+, and HCN. Our results show good correspondence between the magnetic field morphology inferred from velocity gradients using these different molecular tracers and the magnetic field morphology inferred from BLASTPol polarization observations. We also explore the possibility of using a combination of velocity gradients for multiple chemical tracers to explain the structure of the magnetic field in molecular clouds. We search for signatures of gravitational collapse in the alignment of the velocity gradients and magnetic field and conclude that collapsing regions constitute a small fraction of the cloud.


title: Probing the correlation between phase evolution and growth kinetics in the oxide layers of tungsten using Raman spectroscopy and EBSD

abstract: Tungsten, a plasma-facing material for future fusion reactors, may be exposed to air during abnormal operation or accidents. Only limited information is available on the evolution of related oxide phases. This work addresses the effect of substrate orientation on structural variations of tungsten oxides. Annealing experiments in an argon-oxygen atmosphere have been conducted at T = 400 {\deg}C under varying oxygen partial pressure and oxidation time. A combination of EBSD, Raman spectroscopy and confocal microscopy shows preferential oxidation initially on {111} base material planes. The oxide scale changes its phase composition dynamically, influencing the kinetics of its growth.


title: The Chemical/Dynamical Evolution of the Galactic Bulge

abstract: The last decade has seen apparent dramatic progress in large spectroscopic datasets aimed at the study of the Galactic bulge. We consider remaining problems that appear to be intractable with the existing data, including important issues such as whether the bulge and thick disk actually show distinct chemistry, and apparent dramatic changes in morphology at Solar metallicity, as well as large scale study of the heavy elements (including r-process) in the bulge. Although infrared spectroscopy is powerful, the lack of heavy element atomic transitions in the infrared renders impossible any survey of heavy elements from such data. We argue that uniform, high S/N, high resolution data in the optical offer an outstanding opportunity to resolve these problems and explore other populations in the bulge, such as RR Lyrae and hot HB stars.


title: QCD evolution based evidence for the onset of gluon saturation in exclusive photo-production of vector mesons

abstract: We investigate photo-production of vector mesons J/Psi and Upsilon measured both at HERA and LHC, using 2 particular fits of inclusive unintegrated gluon distributions, based on non-linear Balitsky-Kovchegov evolution (Kutak-Sapeta gluon; KS) and next-to-leading order Balitsky-Fadin-Kuraev-Lipatov evolution (Hentschinski-Sabio Vera-Salas gluon; HSS). We find that linear next-to-leading order evolution can only describe production at highest energies, if perturbative corrections are increased to unnaturally large values; rendering this corrections to a perturbative size, the growth with energy is too strong and the description fails. At the same time, the KS gluon, which we explore both with and without non-linear corrections, requires the latter to achieve an accurate description of the energy dependence of data. We interpret this observation as a clear signal for the presence of high gluon densities in the proton, characteristic for the onset of gluon saturation.


title: Extreme Learning Machine Based Non-Iterative and Iterative Nonlinearity Mitigation for LED Communications

abstract: This work concerns receiver design for light emitting diode (LED) communications where the LED nonlinearity can severely degrade the performance of communications. We propose extreme learning machine (ELM) based non-iterative receivers and iterative receivers to effectively handle the LED nonlinearity and memory effects. For the iterative receiver design, we also develop a data-aided receiver, where data is used as virtual training sequence in ELM training. It is shown that the ELM based receivers significantly outperform conventional polynomial based receivers; iterative receivers can achieve huge performance gain compared to non-iterative receivers; and the data-aided receiver can reduce training overhead considerably. This work can also be extended to radio frequency communications, e.g., to deal with the nonlinearity of power amplifiers.


title: Hypersparse Neural Network Analysis of Large-Scale Internet Traffic

abstract: The Internet is transforming our society, necessitating a quantitative understanding of Internet traffic. Our team collects and curates the largest publicly available Internet traffic data containing 50 billion packets. Utilizing a novel hypersparse neural network analysis of "video" streams of this traffic using 10,000 processors in the MIT SuperCloud reveals a new phenomena: the importance of otherwise unseen leaf nodes and isolated links in Internet traffic. Our neural network approach further shows that a two-parameter modified Zipf-Mandelbrot distribution accurately describes a wide variety of source/destination statistics on moving sample windows ranging from 100,000 to 100,000,000 packets over collections that span years and continents. The inferred model parameters distinguish different network streams and the model leaf parameter strongly correlates with the fraction of the traffic in different underlying network topologies. The hypersparse neural network pipeline is highly adaptable and different network statistics and training models can be incorporated with simple changes to the image filter functions.


title: A new invariant under congruence of nonsingular matrices

abstract: For a nonsingular matrix $A$, we propose the form $Tr(^t\!A A^{-1})$, the trace of the product of its transpose and inverse, as a new invariant under congruence of nonsingular matrices.


title: Disfluencies and Human Speech Transcription Errors

abstract: This paper explores contexts associated with errors in transcrip-tion of spontaneous speech, shedding light on human perceptionof disfluencies and other conversational speech phenomena. Anew version of the Switchboard corpus is provided with disfluency annotations for careful speech transcripts, together with results showing the impact of transcription errors on evaluation of automatic disfluency detection.


title: Sketchforme: Composing Sketched Scenes from Text Descriptions for Interactive Applications

abstract: Sketching and natural languages are effective communication media for interactive applications. We introduce Sketchforme, the first neural-network-based system that can generate sketches based on text descriptions specified by users. Sketchforme is capable of gaining high-level and low-level understanding of multi-object sketched scenes without being trained on sketched scene datasets annotated with text descriptions. The sketches composed by Sketchforme are expressive and realistic: we show in our user study that these sketches convey descriptions better than human-generated sketches in multiple cases, and 36.5% of those sketches are considered to be human-generated. We develop multiple interactive applications using these generated sketches, and show that Sketchforme can significantly improve language learning applications and support intelligent language-based sketching assistants.


title: The Dynamics of Human Society Evolution: An Energetics Approach

abstract: Human society is an open system that evolves by coupling with various known and unknown (energy) fluxes. How do these dynamics precisely unfold? Energetics may provide further insights. We expand on Navier Stokes' approach to study non-equilibrium dynamics in a field that evolves with time. Based on the social field theory, an induction of the classical field theories, we define social force, social energy and Hamiltonian of an individual in a society. The equations for the evolution of an individual and society are sketched based on the time-dependent Hamiltonian that includes power dynamics. In this paper, we will demonstrate that Lotka-Volterra type equations can be derived from the Hamiltonian equation in the social field.


title: The Constituents of Sets, Numbers, and Other Mathematical Objects, Part One

abstract: The sets used to construct other mathematical objects are pure sets, which means that all of their elements are sets, which are themselves pure. One set may therefore be within another, not as an element, but as an element of an element, or even deeper, inside several layers of sets within sets. The introduction of the term constituent to describe a set which is within a given set, however deep, induces an apparently novel partial order on sets, and assigns to any given set a diagram which specifies a directed graph, or category, herein dubbed its constituent structure, indicating which sets within it are constituents of which others. Sets with different numbers of elements can have exactly the same constituent structure. Consequently, constituent structure isomorphisms between sets need not preserve the number of elements, although they are still injective, surjective, and invertible. We consider in detail an example of an isomorphism between a one-element set and a five-element set, which is a surjective mapping despite the mismatch in cardinalities. The constituent structure of a set determines the mathematical objects for which the set is a suitable representation. Different schemes for constructing the natural numbers, such as those of von Neumann and Zermelo, generate sets with the same constituent structures. Objects share the constituent structures, not the elements, of the sets used to construct or represent them. The requirement that an object's properties be faithfully encoded within a set's constituent structure and not its non-constituent characteristics such as its cardinality, when made explicit, dictates a specific and novel way of representing ordered pairs and tuples of sets as sets, providing simple formulae for addressing and extracting sets located deep within nested tuples.


title: Towards Universal Object Detection by Domain Attention

abstract: Despite increasing efforts on universal representations for visual recognition, few have addressed object detection. In this paper, we develop an effective and efficient universal object detection system that is capable of working on various image domains, from human faces and traffic signs to medical CT images. Unlike multi-domain models, this universal model does not require prior knowledge of the domain of interest. This is achieved by the introduction of a new family of adaptation layers, based on the principles of squeeze and excitation, and a new domain-attention mechanism. In the proposed universal detector, all parameters and computations are shared across domains, and a single network processes all domains all the time. Experiments, on a newly established universal object detection benchmark of 11 diverse datasets, show that the proposed detector outperforms a bank of individual detectors, a multi-domain detector, and a baseline universal detector, with a 1.3x parameter increase over a single-domain baseline detector. The code and benchmark will be released at http://www.svcl.ucsd.edu/projects/universal-detection/.


title: Discovering Bands from Graphs

abstract: Discovering the underlying structure of a given graph is one of the fundamental goals in graph mining. Given a graph, we can often order vertices in a way that neighboring vertices have a higher probability of being connected to each other. This implies that the edges form a band around the diagonal in the adjacency matrix. Such structure may rise for example if the graph was created over time: each vertex had an active time interval during which the vertex was connected with other active vertices. The goal of this paper is to model this phenomenon. To this end, we formulate an optimization problem: given a graph and an integer $K$, we want to order graph vertices and partition the ordered adjacency matrix into $K$ bands such that bands closer to the diagonal are more dense. We measure the goodness of a segmentation using the log-likelihood of a log-linear model, a flexible family of distributions containing many standard distributions. We divide the problem into two subproblems: finding the order and finding the bands. We show that discovering bands can be done in polynomial time with isotonic regression, and we also introduce a heuristic iterative approach. For discovering the order we use Fiedler order accompanied with a simple combinatorial refinement. We demonstrate empirically that our heuristic works well in practice.


title: Embodied Visual Recognition

abstract: Passive visual systems typically fail to recognize objects in the amodal setting where they are heavily occluded. In contrast, humans and other embodied agents have the ability to move in the environment, and actively control the viewing angle to better understand object shapes and semantics. In this work, we introduce the task of Embodied Visual Recognition (EVR): An agent is instantiated in a 3D environment close to an occluded target object, and is free to move in the environment to perform object classification, amodal object localization, and amodal object segmentation. To address this, we develop a new model called Embodied Mask R-CNN, for agents to learn to move strategically to improve their visual recognition abilities. We conduct experiments using the House3D environment. Experimental results show that: 1) agents with embodiment (movement) achieve better visual recognition performance than passive ones; 2) in order to improve visual recognition abilities, agents can learn strategical moving paths that are different from shortest paths.


title: Extracting the longitudinal structure function FL(x,Q2) at small x from a Froissart-bounded parametrization of F2(x,Q2)

abstract: We present a method to extract, in the leading and next-to-leading order approximations, the longitudinal deep-inelastic scattering structure function FL(x,Q2) from the experimental data by relying on a Froissart-bounded parametrization of the transversal structure function F2(x,Q2) and, partially, on the Dokshitzer-Gribov-Lipatov-Altarelli-Parisi equations. Particular attention is paid on kinematics of low and ultra low values of the Bjorken variable x. Analytical expressions for FL(x,Q2) in terms of the effective parameters of the parametrization of F2(x,Q2) are presented explicitly. We argue that the obtained structure functions FL(x,Q2) within both, the leading and next-to-leading order approximations, manifestly obey the Froissart boundary conditions. Numerical calculations and comparison with available data from ZEUS and H1-Collaborations at HERA demonstrate that the suggested method provides reliable structure functions FL(x,Q2) at low x in a wide range of the momentum transfer (1 GeV2 < Q2 < 3000 GeV2) and can be applied as well in analyses of ultra-high energy processes with cosmic neutrinos.


title: Context-Aware Query Selection for Active Learning in Event Recognition

abstract: Activity recognition is a challenging problem with many practical applications. In addition to the visual features, recent approaches have benefited from the use of context, e.g., inter-relationships among the activities and objects. However, these approaches require data to be labeled, entirely available beforehand, and not designed to be updated continuously, which make them unsuitable for surveillance applications. In contrast, we propose a continuous-learning framework for context-aware activity recognition from unlabeled video, which has two distinct advantages over existing methods. First, it employs a novel active-learning technique that not only exploits the informativeness of the individual activities but also utilizes their contextual information during query selection; this leads to significant reduction in expensive manual annotation effort. Second, the learned models can be adapted online as more data is available. We formulate a conditional random field model that encodes the context and devise an information-theoretic approach that utilizes entropy and mutual information of the nodes to compute the set of most informative queries, which are labeled by a human. These labels are combined with graphical inference techniques for incremental updates. We provide a theoretical formulation of the active learning framework with an analytic solution. Experiments on six challenging datasets demonstrate that our framework achieves superior performance with significantly less manual labeling.


title: Decomposition of Amino Acids in Water with Application to In-Situ Measurements of Enceladus, Europa and Other Hydrothermally Active Icy Ocean Worlds

abstract: To test the potential of using amino acid abundances as a biosignature at icy ocean worlds, we investigate whether primordial amino acids (accreted or formed by early aqueous processes) could persist until the present time. By examining the decomposition kinetics of amino acids in aqueous solution based on existing laboratory rate data, we find that all fourteen proteinogenic amino acids considered in this study decompose to a very large extent (>99.9%) over relatively short lengths of time in hydrothermally active oceans. Therefore, as a rule of thumb, we suggest that if amino acids are detected at Enceladus, Europa, or other hydrothermally active ocean worlds above a concentration of 1 nM, they should have been formed recently and not be relicts of early processes. In particular, the detection of aspartic acid (Asp) and threonine (Thr) would strongly suggest active production within the ocean, as these amino acids cannot persist beyond 1 billion years even at the freezing point temperature of 273K. Identifying amino acids from the oceans of icy worlds can provide key insight into their history of organic chemistry.


title: Comments on Holographic Entanglement Entropy in TT Deformed CFTs

abstract: The Ryu-Takayanagi (RT) formula has been a key ingredient in our understanding of holography. Recent work on TT deformations has also boosted our understanding of holography away from the conformal boundary of AdS. In this short note, we aim to refine some recent work demonstrating the success of the RT formula in TT deformed theories. We emphasize general arguments that justify the use of the RT formula in general holographic theories that obey a GKPW-like dictionary. In doing so, we clarify subtleties related to holographic counterterms and discuss the implications for holography in general spacetimes.


title: Globular bundles and entangled network of proteins (CorA) by a coarse-grained Monte Carlo simulation

abstract: Using a coarse-grained model, self-organized assembly of proteins (e.g. CorA and its inner segment iCorA) is studied by examining quantities such as contact profile, radius of gyration, and structure factor as a function of protein concentration at a range of low (native phase) to high (denature phase) temperatures. Visual inspections show distinct structures, i.e. isolated globular bundles to entangled network on multiple length scales in dilute to crowded protein concentrations. In native phase, the radius of gyration of the protein does not vary much with the protein concentration while that of its inner segment increases systematically. In contrast, the radius of gyration of the protein shows enormous growth with the concentration due to entanglement while that of the inner segment remains almost constant in denatured phase. The multi-scale morphology of the collective assembly is quantified by estimating the effective dimension D of protein from scaling of the structure factor: collective assembly from inner segments remains globular (D aroud 3) at almost all length scales in its native phase while that from protein chains shows sparsely distributed morphology with D around 2 in entire temperature range due to entanglement except in crowded environment at low temperature where D around 2.6. Higher morphological response of chains with only the inner-segments due to selective interactions in its native phase may be more conducive to self-organizing mechanism than that of the remaining segments of the protein chains.


title: On complex symmetric block Toeplitz operators

abstract: In this paper, we study complex symmetry of Toeplitz operators and block Toeplitz operators. In particular, we give a characterization of complex symmetric block Toeplitz operators with the special conjugation on the vector-valued Hardy space $H_{{\mathbb C}^2}^2$. As some applications, we provide examples of such operators.


title: Unit Signatures in Real Biquadratic and Multiquadratic Number Fields

abstract: We consider the signature rank of the units in real multiquadratic fields. When the three quadratic subfields of a real biquadratic field $K$ either (a) all have signature rank 2 (that is, fundamental units of norm $-1$), or (b) all have signature rank 1 (that is, have totally positive fundamental units), we provide explicit examples to show there exist infinitely many $K$ having each of the possible unit signature ranks (namely signature rank 3 or 4 in case (a) and signature rank 1,2, or 3 in case (b)). We make some additional remarks for higher rank real multiquadratic fields, in particular proving the rank of the totally positive units modulo squares in such extensions (hence also in the totally real subfield of cyclotomic fields) can be arbitrarily large.


title: 3D Quantum Cuts for Automatic Segmentation of Porous Media in Tomography Images

abstract: Binary segmentation of volumetric images of porous media is a crucial step towards gaining a deeper understanding of the factors governing biogeochemical processes at minute scales. Contemporary work primarily revolves around primitive techniques based on global or local adaptive thresholding that have known common drawbacks in image segmentation. Moreover, absence of a unified benchmark prohibits quantitative evaluation, which further clouds the impact of existing methodologies. In this study, we tackle the issue on both fronts. Firstly, by drawing parallels with natural image segmentation, we propose a novel, and automatic segmentation technique, 3D Quantum Cuts (QCuts-3D) grounded on a state-of-the-art spectral clustering technique. Secondly, we curate and present a publicly available dataset of 68 multiphase volumetric images of porous media with diverse solid geometries, along with voxel-wise ground truth annotations for each constituting phase. We provide comparative evaluations between QCuts-3D and the current state-of-the-art over this dataset across a variety of evaluation metrics. The proposed systematic approach achieves a 26% increase in AUROC while achieving a substantial reduction of the computational complexity of the state-of-the-art competitors. Moreover, statistical analysis reveals that the proposed method exhibits significant robustness against the compositional variations of porous media.


title: Does shallow geological knowledge help neural-networks to predict deep units?

abstract: Geological interpretation of seismic images is a visual task that can be automated by training neural networks. While neural networks have shown to be effective at various interpretation tasks, a fundamental challenge is the lack of labeled data points in the subsurface. For example, the interpolation and extrapolation of well-based lithology using seismic images relies on a small number of known labels. Besides well-known data augmentation techniques, as well as regularization of the network output, we propose and test another approach to deal with the lack of labels. Non learning-based horizon trackers work very well in the shallow subsurface where seismic images are of higher quality and the geological units are roughly layered. We test if these segmented and shallow units can help train neural networks to predict deeper geological units that are not layered and flat. We show that knowledge of shallow geological units helps to predict deeper units when there are only a few labels for training using a dataset from the Sea of Ireland. We employ U-net based multi-resolution networks, and we show that these networks can be described using matrix-vector product notation in a similar fashion as standard geophysical inverse problems.


title: A Kaczmarz algorithm for sequences of projections, infinite products, and applications to frames in IFS $L^{2}$ spaces

abstract: We show that an idea, originating initially with a fundamental recursive iteration scheme (usually referred as "the" Kaczmarz algorithm), admits important applications in such infinite-dimensional, and non-commutative, settings as are central to spectral theory of operators in Hilbert space, to optimization, to large sparse systems, to iterated function systems (IFS), and to fractal harmonic analysis. We present a new recursive iteration scheme involving as input a prescribed sequence of selfadjoint projections. Applications include random Kaczmarz recursions, their limits, and their error-estimates.


title: Band structure of Ge$_{1-x}$Sn$_{x}$alloy: a full-zone 30-band $k$$\cdot$$p$ model

abstract: A full-zone 30-band $k$$\cdot$$p$ model is developed as an efficient and reliable tool to compute electronic band structure in Ge$_{1-x}$Sn$_{x}$ alloy. The model was first used to reproduce the electronic band structures in Ge and $\alpha$-Sn obtained with empirical tight binding and \textit{ab initio} methods. Input parameters for the 30-band $k$$\cdot$$p$ model are carefully calibrated against prior empirical predications and experimental data. Important material properties such as effective mass for electrons and holes, Luttinger parameters, and density of states are obtained for Ge$_{1-x}$Sn$_{x}$ alloy with the composition range $0<x<0.3$. The 30-band $k$$\cdot$$p$ model that requires far less computing resources is a necessary capability for optimization of sophisticated devices made from Ge$_{1-x}$Sn$_{x}$ alloy with a large parameter space to explore.


title: Pseudoradial spaces and copies of $\omega_1+1$

abstract: In this paper we compare the concepts of pseudoradial spaces and the recently defined strongly pseudoradial spaces in the realm of compact spaces. We show that $\mathrm{MA}+\mathfrak{c}=\omega_2$ implies that there is a compact pseudoradial space that is not strongly pseudoradial. We essentially construct a compact, sequentially compact space $X$ and a continuous function $f:X\to\omega_1+1$ in such a way that there is no copy of $\omega_1+1$ in $X$ that maps cofinally under $f$. We also give some conditions that imply the existence of copies of $\omega_1$ in spaces. In particular, $\mathrm{PFA}$ implies that compact almost radial spaces of radial character $\omega_1$ contain many copies of $\omega_1$.


title: Ultra High-dimensional Multivariate Posterior Contraction Rate Under Shrinkage Priors

abstract: In recent years, shrinkage priors have received much attention in high-dimensional data analysis from a Bayesian perspective. Compared with widely used spike-and-slab priors, shrinkage priors have better computational efficiency. But the theoretical properties, especially posterior contraction rate, which is important in uncertainty quantification, are not established in many cases. In this paper, we apply global-local shrinkage priors to high-dimensional multivariate linear regression with unknown covariance matrix. We show that when the prior is highly concentrated near zero and has heavy tail, the posterior contraction rates for both coefficients matrix and covariance matrix are nearly optimal. Our results hold when number of features p grows much faster than the sample size n, which is of great interest in modern data analysis. We show that a class of readily implementable scale mixture of normal priors satisfies the conditions of the main theorem.


title: Non-relativistic expansion of Dirac equation with spherical scalar and vector potentials by similarity renormalization group

abstract: By following the conventional similarity renormalization group (SRG) expansion of the Dirac equation developed in [J.-Y. Guo, Phys. Rev. C \textbf{85}, 021302 (2012)], we work out the analytic expression of the ${1}/{M^4}$ order and verify the convergence of this method. As a step further, the reconstituted SRG method is proposed by using the re-summation technique. The speed of convergence of the reconstituted SRG becomes much faster than the conventional one, and the single-particle densities with the reconstituted SRG are also almost identical to the exact values.


title: Embryo staging with weakly-supervised region selection and dynamically-decoded predictions

abstract: To optimize clinical outcomes, fertility clinics must strategically select which embryos to transfer. Common selection heuristics are formulas expressed in terms of the durations required to reach various developmental milestones, quantities historically annotated manually by experienced embryologists based on time-lapse EmbryoScope videos. We propose a new method for automatic embryo staging that exploits several sources of structure in this time-lapse data. First, noting that in each image the embryo occupies a small subregion, we jointly train a region proposal network with the downstream classifier to isolate the embryo. Notably, because we lack ground-truth bounding boxes, our we weakly supervise the region proposal network optimizing its parameters via reinforcement learning to improve the downstream classifier's loss. Moreover, noting that embryos reaching the blastocyst stage progress monotonically through earlier stages, we develop a dynamic-programming-based decoder that post-processes our predictions to select the most likely monotonic sequence of developmental stages. Our methods outperform vanilla residual networks and rival the best numbers in contemporary papers, as measured by both per-frame accuracy and transition prediction error, despite operating on smaller data than many.


title: Analog Nature of Quantum Adiabatic Unstructured Search

abstract: The quantum adiabatic unstructured search algorithm is one of only a handful of quantum adiabatic optimization algorithms to exhibit provable speedups over their classical counterparts. With no fault tolerance theorems to guarantee the resilience of such algorithms against errors, understanding the impact of imperfections on their performance is of both scientific and practical significance. We study the robustness of the algorithm against various types of imperfections: limited control over the interpolating schedule, Hamiltonian misspecification, and interactions with a thermal environment. We find that the unstructured search algorithm's quadratic speedup is generally not robust to the presence of any one of the above non-idealities, and in some cases we find that it imposes unrealistic conditions on how the strength of these noise sources must scale to maintain the quadratic speedup.


title: FPGA/DNN Co-Design: An Efficient Design Methodology for IoT Intelligence on the Edge

abstract: While embedded FPGAs are attractive platforms for DNN acceleration on edge-devices due to their low latency and high energy efficiency, the scarcity of resources of edge-scale FPGA devices also makes it challenging for DNN deployment. In this paper, we propose a simultaneous FPGA/DNN co-design methodology with both bottom-up and top-down approaches: a bottom-up hardware-oriented DNN model search for high accuracy, and a top-down FPGA accelerator design considering DNN-specific characteristics. We also build an automatic co-design flow, including an Auto-DNN engine to perform hardware-oriented DNN model search, as well as an Auto-HLS engine to generate synthesizable C code of the FPGA accelerator for explored DNNs. We demonstrate our co-design approach on an object detection task using PYNQ-Z1 FPGA. Results show that our proposed DNN model and accelerator outperform the state-of-the-art FPGA designs in all aspects including Intersection-over-Union (IoU) (6.2% higher), frames per second (FPS) (2.48X higher), power consumption (40% lower), and energy efficiency (2.5X higher). Compared to GPU-based solutions, our designs deliver similar accuracy but consume far less energy.


title: A long-term alternative formula for a stochastic stock price model

abstract: This study presents a long-term alternative formula for stock price variation described by a geometric Brownian motion on the basis of median instead of mean or expected values. The proposed method is motivated by the observation made in remote fields, where optimality of bet-hedging or diversification strategies is explained based on a measure different from expected value, like geometric mean. When the probability distribution of possible outcomes is significantly skewed, it is generally known that expected value leads to an erroneous picture owing to its sensitivity to outliers, extreme values of rare occurrence. Since geometric mean, or its counterpart median for the log-normal distribution, does not suffer from this drawback, it provides us with a more appropriate measure especially for evaluating long-term outcomes dominated by outliers. Thus, the present formula makes a more realistic prediction for long-term outcomes of a large volatility, for which the probability distribution becomes conspicuously heavy-tailed.


title: Merged H/H2 and C+/C/CO transitions in the Orion Bar

abstract: High-resolution ALMA images towards the Orion Bar show no discernible offset between the peak of H2 emission in the photodissociation region (PDR) and the CO(3-2) and HCO+(4-3) emission in the molecular region. This implies that positions of H2 and CO dissociation fronts are indistinguishable in the limit of ALMA resolution. We use the chemo-dynamical model MARION to show that the ALMA view of the Orion Bar, namely, no appreciable offset between the CO(3-2) and HCO+(4-3) peaks, merged H2 and CO dissociation fronts, and high intensity of HCO+(4-3) emission, can only be explained by the ongoing propagation of the dissociation fronts through the molecular cloud, coupled to the dust motion driven by the stellar radiation pressure, and are not reproduced in the model where the dissociation fronts are assumed to be stationary. Modelling line intensities, we demonstrate that after the fronts have merged, the angular separation of the CO(3-2) and HCO+(4-3) peaks is indeed unresolvable with the ALMA observations. Our model predictions are consistent with the results of the ALMA observations about the relation of the bright HCO+(4-3) emission to the compressed gas at the border of the PDR in the sense that the theoretical HCO+(4-3) peak does correspond to the gas density enhancement, which naturally appears in the dynamical simulation, and is located near the H2 dissociation front at the illuminated side of the CO dissociation front.


title: The First Two Thousand Years of Star Formation

abstract: Starting from a prestellar core with a size of $1.2\times10^4$ AU, we calculate the evolution of a gravitationally collapsing core until $\sim2000$ yr after protostar formation using a three-dimensional resistive magnetohydrodynamic simulation, in which the protostar is resolved with a spatial resolution of $5.6\times10^{-3}$ AU. Following protostar formation, a rotationally supported disk is formed. Although the disk size is as small as $\sim2-4$ AU, it remains present until the end of the simulation. Since the magnetic field dissipates and the angular momentum is then not effectively transferred by magnetic effects, the disk surface density gradually increases and spiral arms develop due to gravitational instability. The disk angular momentum is then transferred mainly by gravitational torques, which induce an episodic mass accretion onto the central protostar. The episodic accretion causes a highly time-variable mass ejection (the high-velocity jet) near the disk inner edge, where the magnetic field is well coupled with the neutral gas. As the mass of the central protostar increases, the jet velocity gradually increases and exceeds $\sim100$ km s$^{-1}$. The jet opening angle widens with time at its base, while the jet keeps a very good collimation on the large scale. In addition, a low-velocity outflow is driven from the disk outer edge. A cavity-like structure, a bow shock and several knots, all of which are usually observed in star-forming regions, are produced in the outflowing region.


title: Observation of Giant Quantized Phonon Modes in Graphene via Tunneling Spectra

abstract: Phonons, the fundamental vibrational modes of a crystal lattice, play a crucial role in determining electronic properties of materials through electron-phonon interaction. However, it has proved difficult to directly probe the phonon modes of materials in electrical measurements. Here, we report the observation of giant quantized phonon peaks of the K and K out-of-plane phonon in graphene monolayer in magnetic fields via tunneling spectra, which are usually used to measure local electronic properties of materials. A perpendicular magnetic field quantizes massless Dirac fermions in graphene into discrete Landau levels (LLs). We demonstrate that emission or absorption of phonons of quasiparticles in the LLs of graphene generates a new sequence of discrete states: the quantized phonon modes. In our tunneling spectra, the intensity of the observed phonon peaks is about 50 times larger than that of the LLs because that the K and K out-of-plane phonon opens an inelastic tunneling channel. We also show that it is possible to switch on off the quantized phonon modes at nanoscale by controlling interactions between graphene and the supporting substrate.


title: A Systematic Analysis of Stellar Populations in the Host Galaxies of SDSS Type I QSOs

abstract: We investigate the relationship between host galaxies' stellar content and active galactic nuclei (AGN) for optically selected QSOs with z$<$0.5. There are total 82 QSOs we select from Sloan Digital Sky Survey (SDSS) . These 82 QSOs both have Wide-field Infrared Survey Explorer (WISE) data and measurable stellar content. With the help of the stellar population synthesis code STARLIGHT, we determine the luminosity fraction of AGN ,stellar population ages and star-formation history (SFH) of host galaxies. We find out there is a correlation between the star formation history and AGN property which suggests a possible delay from star formation to AGN. This probably indicates that the AGN activity correlate with the star formation activity which consistent with a co-evolution scheme for black hole and host galaxies.


title: 3D Point Cloud Denoising via Deep Neural Network based Local Surface Estimation

abstract: We present a neural-network-based architecture for 3D point cloud denoising called neural projection denoising (NPD). In our previous work, we proposed a two-stage denoising algorithm, which first estimates reference planes and follows by projecting noisy points to estimated reference planes. Since the estimated reference planes are inevitably noisy, multi-projection is applied to stabilize the denoising performance. NPD algorithm uses a neural network to estimate reference planes for points in noisy point clouds. With more accurate estimations of reference planes, we are able to achieve better denoising performances with only one-time projection. To the best of our knowledge, NPD is the first work to denoise 3D point clouds with deep learning techniques. To conduct the experiments, we sample 40000 point clouds from the 3D data in ShapeNet to train a network and sample 350 point clouds from the 3D data in ModelNet10 to test. Experimental results show that our algorithm can estimate normal vectors of points in noisy point clouds. Comparing to five competitive methods, the proposed algorithm achieves better denoising performance and produces much smaller variances.


title: Text Generation with Exemplar-based Adaptive Decoding

abstract: We propose a novel conditioned text generation model. It draws inspiration from traditional template-based text generation techniques, where the source provides the content (i.e., what to say), and the template influences how to say it. Building on the successful encoder-decoder paradigm, it first encodes the content representation from the given input text; to produce the output, it retrieves exemplar text from the training data as "soft templates," which are then used to construct an exemplar-specific decoder. We evaluate the proposed model on abstractive text summarization and data-to-text generation. Empirical results show that this model achieves strong performance and outperforms comparable baselines.


title: Label Super Resolution with Inter-Instance Loss

abstract: For the task of semantic segmentation, high-resolution (pixel-level) ground truth is very expensive to collect, especially for high resolution images such as gigapixel pathology images. On the other hand, collecting low resolution labels (labels for a block of pixels) for these high resolution images is much more cost efficient. Conventional methods trained on these low-resolution labels are only capable of giving low-resolution predictions. The existing state-of-the-art label super resolution (LSR) method is capable of predicting high resolution labels, using only low-resolution supervision, given the joint distribution between low resolution and high resolution labels. However, it does not consider the inter-instance variance which is crucial in the ideal mathematical formulation. In this work, we propose a novel loss function modeling the inter-instance variance. We test our method on a real world application: infiltrating breast cancer region segmentation in histopathology slides. Experimental results show the effectiveness of our method.


title: Passive TCP Identification for Wired and WirelessNetworks: A Long-Short Term Memory Approach

abstract: Transmission control protocol (TCP) congestion control is one of the key techniques to improve network performance. TCP congestion control algorithm identification (TCP identification) can be used to significantly improve network efficiency. Existing TCP identification methods can only be applied to limited number of TCP congestion control algorithms and focus on wired networks. In this paper, we proposed a machine learning based passive TCP identification method for wired and wireless networks. After comparing among three typical machine learning models, we concluded that the 4-layers Long Short Term Memory (LSTM) model achieves the best identification accuracy. Our approach achieves better than 98% accuracy in wired and wireless networks and works for newly proposed TCP congestion control algorithms.


title: Stability-Preserving, Time-Efficient Mechanisms for School Choice in Two Rounds

abstract: We address the following dynamic version of the school choice question: a city, named City, admits students in two temporally-separated rounds, denoted $\mathcal{R}_1$ and $\mathcal{R}_2$. In round $\mathcal{R}_1$, the capacity of each school is fixed and mechanism $\mathcal{M}_1$ finds a student optimal stable matching. In round $\mathcal{R}_2$, certain parameters change, e.g., new students move into the City or the City is happy to allocate extra seats to specific schools. We study a number of Settings of this kind and give polynomial time algorithms for obtaining a stable matching for the new situations. It is well established that switching the school of a student midway, unsynchronized with her classmates, can cause traumatic effects. This fact guides us to two types of results, the first simply disallows any re-allocations in round $\mathcal{R}_2$, and the second asks for a stable matching that minimizes the number of re-allocations. For the latter, we prove that the stable matchings which minimize the number of re-allocations form a sublattice of the lattice of stable matchings. Observations about incentive compatibility are woven into these results. We also give a third type of results, namely proofs of NP-hardness for a mechanism for round $\mathcal{R}_2$ under certain settings.


title: $L_0$-ARM: Network Sparsification via Stochastic Binary Optimization

abstract: We consider network sparsification as an $L_0$-norm regularized binary optimization problem, where each unit of a neural network (e.g., weight, neuron, or channel, etc.) is attached with a stochastic binary gate, whose parameters are jointly optimized with original network parameters. The Augment-Reinforce-Merge (ARM), a recently proposed unbiased gradient estimator, is investigated for this binary optimization problem. Compared to the hard concrete gradient estimator from Louizos et al., ARM demonstrates superior performance of pruning network architectures while retaining almost the same accuracies of baseline methods. Similar to the hard concrete estimator, ARM also enables conditional computation during model training but with improved effectiveness due to the exact binary stochasticity. Thanks to the flexibility of ARM, many smooth or non-smooth parametric functions, such as scaled sigmoid or hard sigmoid, can be used to parameterize this binary optimization problem and the unbiasness of the ARM estimator is retained, while the hard concrete estimator has to rely on the hard sigmoid function to achieve conditional computation and thus accelerated training. Extensive experiments on multiple public datasets demonstrate state-of-the-art pruning rates with almost the same accuracies of baseline methods. The resulting algorithm $L_0$-ARM sparsifies the Wide-ResNet models on CIFAR-10 and CIFAR-100 while the hard concrete estimator cannot. The code is public available at https://github.com/leo-yangli/l0-arm.


title: Efficient Decision-based Black-box Adversarial Attacks on Face Recognition

abstract: Face recognition has obtained remarkable progress in recent years due to the great improvement of deep convolutional neural networks (CNNs). However, deep CNNs are vulnerable to adversarial examples, which can cause fateful consequences in real-world face recognition applications with security-sensitive purposes. Adversarial attacks are widely studied as they can identify the vulnerability of the models before they are deployed. In this paper, we evaluate the robustness of state-of-the-art face recognition models in the decision-based black-box attack setting, where the attackers have no access to the model parameters and gradients, but can only acquire hard-label predictions by sending queries to the target model. This attack setting is more practical in real-world face recognition systems. To improve the efficiency of previous methods, we propose an evolutionary attack algorithm, which can model the local geometries of the search directions and reduce the dimension of the search space. Extensive experiments demonstrate the effectiveness of the proposed method that induces a minimum perturbation to an input face image with fewer queries. We also apply the proposed method to attack a real-world face recognition system successfully.


title: Diffeomorphism invariance and the black hole information paradox

abstract: We argue that the resolution to the black hole information paradox lies in a proper accounting of the implications of diffeomorphism invariance for the Hilbert space and observables of quantum gravity. The setting of asymptotically Anti-de Sitter spacetime is adopted for most of the paper, but in the framework of canonical quantum gravity, without invoking AdS/CFT duality. We present Marolf's argument that boundary unitarity is a consequence of diffeomorphism invariance, and show that its failure to apply in the classical limit results from a lack of analyticity that has no quantum counterpart. We argue that boundary unitarity leads to a {\it boundary information paradox}, which generalizes the black hole information paradox and arises in virtually any scattering process. We propose a resolution that involves operators of the boundary algebra that redundantly encode information about physics in the bulk, and explain why such redundancy need not violate the algebraic no cloning theorem. We also argue that the infaller paradox, which has motivated the firewall hypothesis for black hole horizons, is ill-posed in quantum gravity, because it ignores essential aspects of the nature of the Hilbert space and observables in quantum gravity.


title: Experimental identification of quantum spin liquids

abstract: In condensed matter physics, there is a novel phase termed "quantum spin liquid", in which strong quantum fluctuations prevent the long-range magnetic order from being established, and so the electron spins do not form an ordered pattern but remain "liquid" like even at absolute zero temperature. Such a phase is not involved with any spontaneous symmetry breaking and local order parameter, and to understand it is beyond the conventional phase transition theory. Due to the rich physics and exotic properties of quantum spin liquids, such as the long-range entanglement and fractional quantum excitations, which are believed to hold great potentials in quantum communication and computation, they have been intensively studied since the concept was proposed in 1973 by P. W. Anderson. Currently, experimental identifications of a quantum spin liquid still remain as a great challenge. Here, we highlight some interesting experimental progress that has been made recently. We also discuss some outstanding issues and raise questions that we consider to be important for future research.


title: Inertial Bregman Proximal Gradient Algorithm For Nonconvex Problem with Smooth Adaptable Property

abstract: In this paper we study the problems of minimizing the sum of two nonconvex functions: one is differentiable and satisfies smooth adaptable property. The smooth adaptable property, also named relatively smooth condition, is weaker than the globally gradient Lipschitz continuity. We analyze an inertial version of the Bregman Proximal Gradient (BPG) algorithm and prove its stationary convergence. Besides, we prove a sublinear convergence of the inertial algorithm. Moreover, if the objective function satisfies Kurdyka--{\L}ojasiewicz (KL) property, its global convergence to a critical point of the objective function can be also guaranteed.


title: Cohomology of vector bundles and non-pluriharmonic loci

abstract: In this paper, we study cohomology groups of vector bundles on neighborhoods of a non-pluriharmonic locus in Stein manifolds and in projective manifolds. By using our results, we show variants of the Lefschetz hyperplane theorem.


title: On the hydrostatic approximation of the Navier-Stokes equations in a thin strip

abstract: In this paper, we first prove the global well-posedness of a scaled anisotropic Navier-Stokes system and the hydrostatic Navier-Stokes system in a 2-D striped domain with small analytic data in the tangential variable. Then we justify the limit from the anisotropic Navier-Stokes system to the hydrostatic Navier-Stokes system with analytic data.


title: On Representational Redundancy, Surplus Structure, and the Hole Argument

abstract: We address a recent proposal concerning 'surplus structure' due to Nguyen et al. ['Why Surplus Structure is Not Superfluous.' Br. J. Phi. Sci. Forthcoming.] We argue that the sense of 'surplus structure' captured by their formal criterion is importantly different from---and in a sense, opposite to---another sense of 'surplus structure' used by philosophers. We argue that minimizing structure in one sense is generally incompatible with minimizing structure in the other sense. We then show how these distinctions bear on Nguyen et al.'s arguments about Yang-Mills theory and on the hole argument.


title: Studying newborn neutron stars by the transient emission after stellar collapses and compact binary mergers

abstract: The formation of neutron stars (NSs), both from collapses of massive stars and mergers of compact objects, can be usually indicated by bright transients emitted from explosively-ejected material. In particular, if the newborn NSs can rotate at a millisecond period and have a sufficiently high magnetic field, then the spin-down of the NSs would provide a remarkable amount of energy to the emitting material. As a result, super-luminous supernovae could be produced in the massive stellar collapse cases, while some unusual fast evolving and luminous optical transients could arise from the cases of NS mergers and accretion-induced collapses of white dwarfs. In all cases, if the dipolar magnetic fields of the newborn NSs can be amplified to be as high as $10^{15}$ G, a relativistic jet could be launched and then a gamma-ray burst can be produced as the jet successfully breaks out from the surrounding nearly-isotropic ejected material.


title: Reliable and Efficient Image Cropping: A Grid Anchor based Approach

abstract: Image cropping aims to improve the composition as well as aesthetic quality of an image by removing extraneous content from it. Existing image cropping databases provide only one or several human-annotated bounding boxes as the groundtruth, which cannot reflect the non-uniqueness and flexibility of image cropping in practice. The employed evaluation metrics such as intersection-over-union cannot reliably reflect the real performance of cropping models, either. This work revisits the problem of image cropping, and presents a grid anchor based formulation by considering the special properties and requirements (e.g., local redundancy, content preservation, aspect ratio) of image cropping. Our formulation reduces the searching space of candidate crops from millions to less than one hundred. Consequently, a grid anchor based cropping benchmark is constructed, where all crops of each image are annotated and more reliable evaluation metrics are defined. We also design an effective and lightweight network module, which simultaneously considers the region of interest and region of discard for more accurate image cropping. Our model can stably output visually pleasing crops for images of different scenes and run at a speed of 125 FPS. Code and dataset are available at: https://github.com/HuiZeng/Grid-Anchor-based-Image-Cropping.


title: Reasoning about Block-based Cloud Storage Systems

abstract: Owing to the massive growth in the storage demands of big data, Cloud Storage Systems (CSSs) have been put forward to improve the storage capacity. Compared with traditional storage systems, CSSs have lots of advantages, such as higher capacity, lower cost, and easier scalability. But they are also with higher complexity. In order to ensure CSSs to be reliable, it is necessary to prove the correctness of CSSs management programs. In fact, we are going to verify Block-based Cloud Storage Systems (BCSSs), since BCSSs are the most popular CSSs. In this paper, the correctness of management programs in BCSSs have been proven, and a verification framework based on separation logic is proposed to finish the proven process. The main contributions are as follows. (1) A novel framework with two-tier heap structure is constructed to reflect the characteristics of BCSSs, and a modeling language is defined based on it. (2) Assertions based on separation logic is constructed to describe the properties of BCSSs. (3) The Hoare-style specifications are proposed to reason about the BCSSs. The results demonstrate that the correctness and reliability of BCSSs can be verified by the above proposed methods. Furthermore, the proposed specifications is sound in the application of reasoning about BCSSs.


title: Multimodal Style Transfer via Graph Cuts

abstract: An assumption widely used in recent neural style transfer methods is that image styles can be described by global statics of deep features like Gram or covariance matrices. Alternative approaches have represented styles by decomposing them into local pixel or neural patches. Despite the recent progress, most existing methods treat the semantic patterns of style image uniformly, resulting unpleasing results on complex styles. In this paper, we introduce a more flexible and general universal style transfer technique: multimodal style transfer (MST). MST explicitly considers the matching of semantic patterns in content and style images. Specifically, the style image features are clustered into sub-style components, which are matched with local content features under a graph cut formulation. A reconstruction network is trained to transfer each sub-style and render the final stylized result. We also generalize MST to improve some existing methods. Extensive experiments demonstrate the superior effectiveness, robustness, and flexibility of MST.


title: Bogomolov multiplier and the Lazard correspondence

abstract: In this paper we extend the notion of CP covers for groups to the field of Lie algebras, and show that despite the case of groups, all CP covers of a Lie algebra are isomorphic. Finally we show that CP covers of groups and Lie rings which are in Lazard correspondence, are in Lazard correspondence too, and the Bogomolov multipliers are isomorphic.


title: Semi-Supervised Segmentation of Salt Bodies in Seismic Images using an Ensemble of Convolutional Neural Networks

abstract: Seismic image analysis plays a crucial role in a wide range of industrial applications and has been receiving significant attention. One of the essential challenges of seismic imaging is detecting subsurface salt structure which is indispensable for identification of hydrocarbon reservoirs and drill path planning. Unfortunately, exact identification of large salt deposits is notoriously difficult and professional seismic imaging often requires expert human interpretation of salt bodies. Convolutional neural networks (CNNs) have been successfully applied in many fields, and several attempts have been made in the field of seismic imaging. But the high cost of manual annotations by geophysics experts and scarce publicly available labeled datasets hinder the performance of the existing CNN-based methods. In this work, we propose a semi-supervised method for segmentation (delineation) of salt bodies in seismic images which utilizes unlabeled data for multi-round self-training. To reduce error amplification during self-training we propose a scheme which uses an ensemble of CNNs. We show that our approach outperforms state-of-the-art on the TGS Salt Identification Challenge dataset and is ranked the first among the 3234 competing methods.


title: HiGRU: Hierarchical Gated Recurrent Units for Utterance-level Emotion Recognition

abstract: In this paper, we address three challenges in utterance-level emotion recognition in dialogue systems: (1) the same word can deliver different emotions in different contexts; (2) some emotions are rarely seen in general dialogues; (3) long-range contextual information is hard to be effectively captured. We therefore propose a hierarchical Gated Recurrent Unit (HiGRU) framework with a lower-level GRU to model the word-level inputs and an upper-level GRU to capture the contexts of utterance-level embeddings. Moreover, we promote the framework to two variants, HiGRU with individual features fusion (HiGRU-f) and HiGRU with self-attention and features fusion (HiGRU-sf), so that the word/utterance-level individual inputs and the long-range contextual information can be sufficiently utilized. Experiments on three dialogue emotion datasets, IEMOCAP, Friends, and EmotionPush demonstrate that our proposed HiGRU models attain at least 8.7%, 7.5%, 6.0% improvement over the state-of-the-art methods on each dataset, respectively. Particularly, by utilizing only the textual feature in IEMOCAP, our HiGRU models gain at least 3.8% improvement over the state-of-the-art conversational memory network (CMN) with the trimodal features of text, video, and audio.


title: Feature Generation by Convolutional Neural Network for Click-Through Rate Prediction

abstract: Click-Through Rate prediction is an important task in recommender systems, which aims to estimate the probability of a user to click on a given item. Recently, many deep models have been proposed to learn low-order and high-order feature interactions from original features. However, since useful interactions are always sparse, it is difficult for DNN to learn them effectively under a large number of parameters. In real scenarios, artificial features are able to improve the performance of deep models (such as Wide & Deep Learning), but feature engineering is expensive and requires domain knowledge, making it impractical in different scenarios. Therefore, it is necessary to augment feature space automatically. In this paper, We propose a novel Feature Generation by Convolutional Neural Network (FGCNN) model with two components: Feature Generation and Deep Classifier. Feature Generation leverages the strength of CNN to generate local patterns and recombine them to generate new features. Deep Classifier adopts the structure of IPNN to learn interactions from the augmented feature space. Experimental results on three large-scale datasets show that FGCNN significantly outperforms nine state-of-the-art models. Moreover, when applying some state-of-the-art models as Deep Classifier, better performance is always achieved, showing the great compatibility of our FGCNN model. This work explores a novel direction for CTR predictions: it is quite useful to reduce the learning difficulties of DNN by automatically identifying important features.


title: On Riemann Integration in Metrizable Vector Spaces

abstract: In classical analysis, Lebesgue first proved that $\mathbb{R}$ has the property that each Riemann integrable function from $[a,b]$ into $\mathbb{R}$ is continuous almost everywhere. This property is named as the Lebesgue property. Though the Lebesgue property may be breakdown in many infinite dimensional spaces including Banach or quasi Banach spaces, to determine spaces having this property is still an interesting problem. In this paper, we study Riemann integration for vector-value functions in metrizable vector spaces and prove the fundamental theorems of calculus and primitives for continuous functions. Further we discovery that $\mathbb{R}^{\omega}$, the countable infinite product of $\mathbb{R}$ with itself equipped with the product topology, is a metrizable vector space having the Lebesgue property and prove that $l^p(1<p\leq+\infty)$, as subspaces of $\mathbb{R}^{\omega}$, possess the Lebesgue property although they are Banach spaces having no such property.


title: Ultrafast Video Attention Prediction with Coupled Knowledge Distillation

abstract: Large convolutional neural network models have recently demonstrated impressive performance on video attention prediction. Conventionally, these models are with intensive computation and large memory. To address these issues, we design an extremely light-weight network with ultrafast speed, named UVA-Net. The network is constructed based on depth-wise convolutions and takes low-resolution images as input. However, this straight-forward acceleration method will decrease performance dramatically. To this end, we propose a coupled knowledge distillation strategy to augment and train the network effectively. With this strategy, the model can further automatically discover and emphasize implicit useful cues contained in the data. Both spatial and temporal knowledge learned by the high-resolution complex teacher networks also can be distilled and transferred into the proposed low-resolution light-weight spatiotemporal network. Experimental results show that the performance of our model is comparable to 11 state-of-the-art models in video attention prediction, while it costs only 0.68 MB memory footprint, runs about 10,106 FPS on GPU and 404 FPS on CPU, which is 206 times faster than previous models.


title: First-Principles Determination of Electron-Ion Couplings in the Warm Dense Matter Regime

abstract: We present first-principles calculations of the rate of energy exchanges between electrons and ions in nonequilibrium warm dense plasmas, liquid metals and hot solids, a fundamental property for which various models offer diverging predictions. To this end, a Kubo relation for the electron-ion coupling parameter is introduced, which includes self-consistently the quantum, thermal, non-linear and strong coupling effects that coexist in materials at the confluence of solids and plasmas. Most importantly, like other Kubo relations widely used for calculating electronic conductivities, the expression can be evaluated using quantum molecular dynamics simulations. Results are presented and compared to experimental and theoretical predictions for representative materials of various electronic complexity, including aluminum, copper, iron and nickel.


title: A surface birational to an Enriques surface with non-finitely generated automorphism group

abstract: We will show that there is a smooth complex projective surface, birational to some Enriques surface, such that the automorphism group is discrete but not finitely generated.


title: SPM-Tracker: Series-Parallel Matching for Real-Time Visual Object Tracking

abstract: The greatest challenge facing visual object tracking is the simultaneous requirements on robustness and discrimination power. In this paper, we propose a SiamFC-based tracker, named SPM-Tracker, to tackle this challenge. The basic idea is to address the two requirements in two separate matching stages. Robustness is strengthened in the coarse matching (CM) stage through generalized training while discrimination power is enhanced in the fine matching (FM) stage through a distance learning network. The two stages are connected in series as the input proposals of the FM stage are generated by the CM stage. They are also connected in parallel as the matching scores and box location refinements are fused to generate the final results. This innovative series-parallel structure takes advantage of both stages and results in superior performance. The proposed SPM-Tracker, running at 120fps on GPU, achieves an AUC of 0.687 on OTB-100 and an EAO of 0.434 on VOT-16, exceeding other real-time trackers by a notable margin.


title: Breaking Quadratic Time for Small Vertex Connectivity and an Approximation Scheme

abstract: Vertex connectivity a classic extensively-studied problem. Given an integer $k$, its goal is to decide if an $n$-node $m$-edge graph can be disconnected by removing $k$ vertices. Although a linear-time algorithm was postulated since 1974 [Aho, Hopcroft and Ullman], and despite its sibling problem of edge connectivity being resolved over two decades ago [Karger STOC'96], so far no vertex connectivity algorithms are faster than $O(n^2)$ time even for $k=4$ and $m=O(n)$. In the simplest case where $m=O(n)$ and $k=O(1)$, the $O(n^2)$ bound dates five decades back to [Kleitman IEEE Trans. Circuit Theory'69]. For general $k$ and $m$, the best bound is $\tilde{O}(\min(kn^2, n^\omega+nk^\omega))$. In this paper, we present a randomized Monte Carlo algorithm with $\tilde{O}(m+k^{7/3}n^{4/3})$ time for any $k=O(\sqrt{n})$. This gives the {\em first subquadratic time} bound for any $4\leq k \leq o(n^{2/7})$ and improves all above classic bounds for all $k\le n^{0.44}$. We also present a new randomized Monte Carlo $(1+\epsilon)$-approximation algorithm that is strictly faster than the previous Henzinger's 2-approximation algorithm [J. Algorithms'97] and all previous exact algorithms. The key to our results is to avoid computing single-source connectivity, which was needed by all previous exact algorithms and is not known to admit $o(n^2)$ time. Instead, we design the first local algorithm for computing vertex connectivity; without reading the whole graph, our algorithm can find a separator of size at most $k$ or certify that there is no separator of size at most $k$ `near' a given seed node.


title: Electronic Transport and quantum oscillation of Topological Semimetals

abstract: Three-dimensional (3D) topological semimetals represent a new class of topological matters. The study of this family of materials has been at the frontiers of condensed matter physics, and many breakthroughs have been made. Several topological semimetal phases, including Dirac semimetals (DSMs), Weyl semimetals (WSMs), nodal-line semimetals (NLSMs), and triple-point semimetals, have been theoretically predicted and experimentally demonstrated. The low-energy excitation around the Dirac/Weyl nodal points, nodal line, or triply degenerated nodal point can be viewed as emergent relativistic fermions. Experimental studies have shown that relativistic fermions can result in a rich variety of exotic transport properties, e.g., extremely large magnetoresistance, the chiral anomaly, and the intrinsic anomalous Hall effect. In this review, we first briefly introduce band structural characteristics of each topological semimetal phase, then review the current studies on quantum oscillations and exotic transport properties of various topological semimetals, and finally provide a perspective of this area.


title: Octave-wide phase-matched four-wave mixing in dispersion engineered crystalline microresonators

abstract: In this Letter, we report phase-matched four-wave mixing separated by over one-octave in a dispersion engineered crystalline microresonator. Experimental and numerical results presented here confirm that primary sidebands were generated with a frequency shift up to 140 THz, and that secondary sidebands formed a localized comb structure, known as a clustered comb in the vicinity of the primary sidebands. A theoretical analysis of the phase-matching condition validated our experimental observations, and our results good agree well with numerical simulations. These results offer the potential to realize a frequency tunable comb cluster generator operating from 1 um to mid-infrared wavelengths with a single and compact device.


title: Ionization potential depression and ionization balance in dense plasmas

abstract: Theoretical modelling of ionization potential depression and the related ionization equilibrium in dense plasmas, in particular in warm/hot dense matter, represents a significant challenge due to ionic coupling and electronic degeneracy effects. We present a quantum statistical model based on dynamical structure factors for the ionization potential depression, where quantum exchange and dynamical correlation effects in plasma environments are consistently and systematically taken into account in terms of the concept of self-energy. Under the condition of local thermodynamic equilibrium, the charge state distribution (or ionic fraction) characterized by the ionization balance is obtained by solving the coupled Saha equations. Calculations for the ionization potential depression of different chemical elements are performed with the electronic and ionic structure factors. The ionic structure factors are determined by solving the Ornstein-Zernike equation in combination with the hypernetted-chain equation. As a further application of our approach, we present results for the charge state distribution of aluminium plasmas at several temperatures and densities.


title: Hausdorff dimension of the large values of Weyl sums

abstract: The authors have recently obtained a lower bound of the Hausdorff dimension of the sets of vectors $(x_1, \ldots, x_d)\in [0,1)^d$ with large Weyl sums, namely of vectors for which $$ \left| \sum_{n=1}^{N}\exp(2\pi i (x_1 n+\ldots +x_d n^{d})) \right| \ge N^{\alpha} $$ for infinitely many integers $N \ge 1$. Here we obtain an upper bound for the Hausdorff dimension of these exceptional sets.


title: Knowledge-Augmented Language Model and its Application to Unsupervised Named-Entity Recognition

abstract: Traditional language models are unable to efficiently model entity names observed in text. All but the most popular named entities appear infrequently in text providing insufficient context. Recent efforts have recognized that context can be generalized between entity names that share the same type (e.g., \emph{person} or \emph{location}) and have equipped language models with access to an external knowledge base (KB). Our Knowledge-Augmented Language Model (KALM) continues this line of work by augmenting a traditional model with a KB. Unlike previous methods, however, we train with an end-to-end predictive objective optimizing the perplexity of text. We do not require any additional information such as named entity tags. In addition to improving language modeling performance, KALM learns to recognize named entities in an entirely unsupervised way by using entity type information latent in the model. On a Named Entity Recognition (NER) task, KALM achieves performance comparable with state-of-the-art supervised models. Our work demonstrates that named entities (and possibly other types of world knowledge) can be modeled successfully using predictive learning and training on large corpora of text without any additional information.


title: System modeling of a health issue: the case of preterm birth in Ohio

abstract: Preterm birth rate (PBR) stands out as a major public health concern in the U.S. However, effective policies for mitigating the problem is largely unknown. The complexities of the problem raise critical questions: Why is PBR increasing despite the massive investment for reducing it? What policies can decrease it? To address these questions, we develop a causal loop diagram to investigate mechanisms underlying high preterm rate in a community. Our boundary is broad and includes medical and education systems, as well as living conditions such as crime rate and housing price. Then, we built a simulation model and divided the population into two groups based on their chance of delivering a preterm baby. We calibrated the model using the historical data of a case study, Cuyahoga Ohio, from 1995 to 2017. Prior studies mostly applied reductionist approaches to determine factors associated with high preterm rate at the individual level. Our simulation model examines the reciprocal influences of multiple factors and investigates the effect of different resource allocation scenarios on the PBR. Results show that, in the case of Cuyahoga county with one of the highest rates of PBR in the U.S., estimated preterm birth rates will not be lower than the rates of 1995 during the next five years.


title: Attention-based Multi-instance Neural Network for Medical Diagnosis from Incomplete and Low Quality Data

abstract: One way to extract patterns from clinical records is to consider each patient record as a bag with various number of instances in the form of symptoms. Medical diagnosis is to discover informative ones first and then map them to one or more diseases. In many cases, patients are represented as vectors in some feature space and a classifier is applied after to generate diagnosis results. However, in many real-world cases, data is often of low-quality due to a variety of reasons, such as data consistency, integrity, completeness, accuracy, etc. In this paper, we propose a novel approach, attention based multi-instance neural network (AMI-Net), to make the single disease classification only based on the existing and valid information in the real-world outpatient records. In the context of a patient, it takes a bag of instances as input and output the bag label directly in end-to-end way. Embedding layer is adopted at the beginning, mapping instances into an embedding space which represents the individual patient condition. The correlations among instances and their importance for the final classification are captured by multi-head attention transformer, instance-level multi-instance pooling and bag-level multi-instance pooling. The proposed approach was test on two non-standardized and highly imbalanced datasets, one in the Traditional Chinese Medicine (TCM) domain and the other in the Western Medicine (WM) domain. Our preliminary results show that the proposed approach outperforms all baselines results by a significant margin.


title: Mixing syntagmatic and paradigmatic information for concept detection

abstract: In the last decades, philosophers have begun using empirical data for conceptual analysis, but corpus-based conceptual analysis has so far failed to develop, in part because of the absence of reliable methods to automatically detect concepts in textual data. Previous attempts have shown that topic models can constitute efficient concept detection heuristics, but while they leverage the syntagmatic relations in a corpus, they fail to exploit paradigmatic relations, and thus probably fail to model concepts accurately. In this article, we show that using a topic model that models concepts on a space of word embeddings (Hu and Tsujii, 2016) can lead to significant increases in concept detection performance, as well as enable the target concept to be expressed in more flexible ways using word vectors.


title: Characterizing nonclassical correlation using affinity

abstract: Geometric discord, a measure of quantumness of bipartite system, captures minimal nonlocal effects of a quantum state due to locally invariant von Neumann projective measurements. Original version of this measure is suffered by the local ancilla problem. In this article, we propose a new version of geometric discord using affinity. This quantity satisfies all criteria of a good measure of quantum correlation of the bipartite system and resolves local ancilla problem of Hilbert-Schmidt norm based discord. We evaluate analytically the proposed quantity for both pure and mixed states. For an arbitrary pure state, it is shown that affinity based geometric discord equal to geometric measure of entanglement. Further, we obtain a lower bound of this measure for m \times n dimensional arbitrary mixed state and a closed formula of proposed version of geometric discord for 2 \times n dimensional mixed state is obtained. Finally, as an illustration, we have studied the nonlocality of Bell diagonal state, isotropic and Werner states.


title: Dispersion points and rational curves

abstract: We construct two connected plane sets which can be embedded into rational curves. The first is a biconnected set with a dispersion point. It answers a question of Joachim Grispolakis. The second is indecomposable. Both examples are completely metrizable.


title: On the origin of the magnetic energy in the quiet solar chromosphere

abstract: The presence of magnetic field is crucial in the transport of energy through the solar atmosphere. Recent ground-based and space-borne observations of the quiet Sun have revealed that magnetic field accumulates at photospheric heights, via a local dynamo or from small-scale flux emergence events. However, most of this small-scale magnetic field may not expand into the chromosphere due to the entropy drop with height at the photosphere. Here we present a study that uses a high resolution 3D radiative MHD simulation of the solar atmosphere with non-grey and non-LTE radiative transfer and thermal conduction along the magnetic field to reveal that: 1) the net magnetic flux from the simulated quiet photosphere is not sufficient to maintain a chromospheric magnetic field (on average), 2) processes in the lower chromosphere, in the region dominated by magneto-acoustic shocks, are able to convert kinetic energy into magnetic energy, 3) the magnetic energy in the chromosphere increases linearly in time until the r.m.s. of the magnetic field strength saturates at roughly 4 to 30 G (horizontal average) due to conversion from kinetic energy, 4) and that the magnetic features formed in the chromosphere are localized to this region.


title: Convergence of Message-Passing for Distributed Convex Optimisation with Scaled Diagonal Dominance

abstract: This paper studies the convergence properties the well-known message-passing algorithm for convex optimisation. Under the assumption of pairwise separability and scaled diagonal dominance, asymptotic convergence is established and a simple bound for the convergence rate is provided for message-passing. In comparison with previous results, our results do not require the given convex program to have known convex pairwise components and that our bound for the convergence rate is tighter and simpler. When specialised to quadratic optimisation, we generalise known results by providing a very simple bound for the convergence rate.


title: Intra-Ensemble in Neural Networks

abstract: Improving model performance is always the key problem in machine learning including deep learning. However, stand-alone neural networks always suffer from marginal effect when stacking more layers. At the same time, ensemble is an useful technique to further enhance model performance. Nevertheless, training several independent deep neural networks for ensemble costs multiple resources. If so, is it possible to utilize ensemble in only one neural network? In this work, we propose Intra-Ensemble, an end-to-end ensemble strategy with stochastic channel recombination operations to train several sub-networks simultaneously within one neural network. Additional parameter size is marginal since the majority of parameters are mutually shared. Meanwhile, stochastic channel recombination significantly increases the diversity of sub-networks, which finally enhances ensemble performance. Extensive experiments and ablation studies prove the applicability of intra-ensemble on various kinds of datasets and network architectures.


title: Explaining Wrong Queries Using Small Examples

abstract: For testing the correctness of SQL queries, e.g., evaluating student submissions in a database course, a standard practice is to execute the query in question on some test database instance and compare its result with that of the correct query. Given two queries $Q_1$ and $Q_2$, we say that a database instance $D$ is a counterexample (for $Q_1$ and $Q_2$) if $Q_1(D)$ differs from $Q_2(D)$; such a counterexample can serve as an explanation of why $Q_1$ and $Q_2$ are not equivalent. While the test database instance may serve as a counterexample, it may be too large or complex to read and understand where the inequivalence comes from. Therefore, in this paper, given a known counterexample $D$ for $Q_1$ and $Q_2$, we aim to find the smallest counterexample $D' \subseteq D$ where $Q_1(D') \neq Q_2(D')$. The problem in general is NP-hard. We give a suite of algorithms for finding the smallest counterexample for different classes of queries, some more tractable than others. We also present an efficient provenance-based algorithm for SPJUD queries that uses a constraint solver, and extend it to more complex queries with aggregation, group-by, and nested queries. We perform extensive experiments indicating the effectiveness and scalability of our solution on student queries from an undergraduate database course and on queries from the TPC-H benchmark. We also report a user study from the course where we deployed our tool to help students with an assignment on relational algebra.


title: Private Pliable Index Coding

abstract: The Pliable Index CODing (PICOD) problem is a variant of the Index Coding (IC) problem, where the desired messages by the users, who are equipped with message side information, is part of the optimization. This paper studies the PICOD problem where users are subject to a privacy constraint. In particular, the following spacial class of private PICODs is investigated: 1) the side information structure is circular, and 2) each user can decode one and only one message. The first condition is a special case of the "circular-arc network topology hypergraph" class of PICOD studied in [Liu and D. Tuninetti, "Tight information theoretic converse results for some pliable index coding problems," ITW, 2018], for which an optimal solution was given without the privacy constraint. The second condition was first studied in [S. Sasi and B. S. Rajan, "On pliable index coding," arXiv:1901.05809] and was motivated by the need to keep content privacy is some distribution networks. This paper proposes both converse and achievable bounds. The proposed achievable scheme not only strictly outperforms the one in [S. Sasi and B. S. Rajan, "On pliable index coding," arXiv:1901.05809] for some values of the system parameters, but it is also information theoretically optimal in some settings. For the remaining cases, the proposed linear code is shown to require at most one more transmission than the converse bound derived by restricting the sender to only use linear codes.


title: Second Order and Moderate Deviation Analysis of a Block Fading Channel with Deterministic and Energy Harvesting Power Constraints

abstract: We consider a block fading additive white Gaussian noise (AWGN) channel with perfect channel state information (CSI) at the transmitter and the receiver. First, for a given codeword length and non-vanishing average probability of error, we obtain lower and upper bounds on the maximum transmission rate. We derive bounds for three kinds of power constraints inherent to a wireless transmitter. These include the canonical peak power constraint and average power constraint. In addition, we consider a time varying peak power constraint imposed by an \emph{energy harvesting device}-a mechanism that powers many modern-day wireless transmitters. The bounds characterize \emph{second order} deviation of finite blocklength coding rates from the channel capacity, which is in turn achieved by \textit{water-filling} power allocation across time. The bounds obtained also indicate the rate enhancement possible due to CSI at the transmitter in the finite blocklength regime. Next, we provide bounds on the optimal exponent with which error probability drops to zero when channel coding rate is simultaneously allowed to approach capacity \emph{at a certain rate}, as the codeword length increases. These bounds identify what is known as the moderate deviation regime of the block fading channel. We compare the bounds numerically to bring out the efficacy of our results.


title: Some remarks about trunks and morphisms of neural codes

abstract: We give intrinsic characterizations of neural rings and homomorphisms between them. Also we introduce the notion of a basic monomial code map and characterize monomial code maps as compositions of basic monomial code maps. Finally, we characterize monomial isomorphisms between neural codes. Our work is based on the 2015 paper by C.~Curto and N.~Youngs about neural ring homomorphisms and maps between neural codes and on the 2018 paper by R.~Amzi Jeffs about morphisms of neural rings.


title: Recursion relations for gravitational lensing

abstract: The weak gravitational lensing formalism can be extended to the strong lensing regime by integrating a nonlinear version of the geodesic deviation equation. The resulting "roulette" expansion generalises the notion of convergence, shear and flexion to arbitrary order. The independent coefficients of this expansion are screen space gradients of the optical tidal tensor which approximates to the usual lensing potential in the weak field limit. From lensed images, knowledge of the roulette coefficients can in principle be inverted to reconstruct the mass distribution of a lens. In this paper, we simplify the roulette expansion and derive a family of recursion relations between the various coefficients, generalising the Kaiser-Squires relations beyond the weak-lensing regime.


title: Probability density distillation with generative adversarial networks for high-quality parallel waveform generation

abstract: This paper proposes an effective probability density distillation (PDD) algorithm for WaveNet-based parallel waveform generation (PWG) systems. Recently proposed teacher-student frameworks in the PWG system have successfully achieved a real-time generation of speech signals. However, the difficulties optimizing the PDD criteria without auxiliary losses result in quality degradation of synthesized speech. To generate more natural speech signals within the teacher-student framework, we propose a novel optimization criterion based on generative adversarial networks (GANs). In the proposed method, the inverse autoregressive flow-based student model is incorporated as a generator in the GAN framework, and jointly optimized by the PDD mechanism with the proposed adversarial learning method. As this process encourages the student to model the distribution of realistic speech waveform, the perceptual quality of the synthesized speech becomes much more natural. Our experimental results verify that the PWG systems with the proposed method outperform both those using conventional approaches, and also autoregressive generation systems with a well-trained teacher WaveNet.


title: MVF-Net: Multi-View 3D Face Morphable Model Regression

abstract: We address the problem of recovering the 3D geometry of a human face from a set of facial images in multiple views. While recent studies have shown impressive progress in 3D Morphable Model (3DMM) based facial reconstruction, the settings are mostly restricted to a single view. There is an inherent drawback in the single-view setting: the lack of reliable 3D constraints can cause unresolvable ambiguities. We in this paper explore 3DMM-based shape recovery in a different setting, where a set of multi-view facial images are given as input. A novel approach is proposed to regress 3DMM parameters from multi-view inputs with an end-to-end trainable Convolutional Neural Network (CNN). Multiview geometric constraints are incorporated into the network by establishing dense correspondences between different views leveraging a novel self-supervised view alignment loss. The main ingredient of the view alignment loss is a differentiable dense optical flow estimator that can backpropagate the alignment errors between an input view and a synthetic rendering from another input view, which is projected to the target view through the 3D shape to be inferred. Through minimizing the view alignment loss, better 3D shapes can be recovered such that the synthetic projections from one view to another can better align with the observed image. Extensive experiments demonstrate the superiority of the proposed method over other 3DMM methods.


title: UG$^{2+}$ Track 2: A Collective Benchmark Effort for Evaluating and Advancing Image Understanding in Poor Visibility Environments

abstract: The UG$^{2+}$ challenge in IEEE CVPR 2019 aims to evoke a comprehensive discussion and exploration about how low-level vision techniques can benefit the high-level automatic visual recognition in various scenarios. In its second track, we focus on object or face detection in poor visibility enhancements caused by bad weathers (haze, rain) and low light conditions. While existing enhancement methods are empirically expected to help the high-level end task, that is observed to not always be the case in practice. To provide a more thorough examination and fair comparison, we introduce three benchmark sets collected in real-world hazy, rainy, and low-light conditions, respectively, with annotate objects/faces annotated. To our best knowledge, this is the first and currently largest effort of its kind. Baseline results by cascading existing enhancement and detection models are reported, indicating the highly challenging nature of our new data as well as the large room for further technical innovations. We expect a large participation from the broad research community to address these challenges together.


title: Private Hierarchical Clustering and Efficient Approximation

abstract: In collaborative learning, multiple parties contribute their datasets to jointly deduce global machine learning models for numerous predictive tasks. Despite its efficacy, this learning paradigm fails to encompass critical application domains that involve highly sensitive data, such as healthcare and security analytics, where privacy risks limit entities to individually train models using only their own datasets. In this work, we target privacy-preserving collaborative hierarchical clustering. We introduce a formal security definition that aims to achieve the balance between utility and privacy and present a two-party protocol that provably satisfies it. We then extend our protocol with: (i) an optimized version for the single-linkage clustering, and (ii) scalable approximation variants. We implement all our schemes and experimentally evaluate their performance and accuracy on synthetic and real datasets, obtaining very encouraging results. For example, end-to-end execution of our secure approximate protocol for over 1M 10-dimensional data samples requires 35sec of computation and achieves 97.09% accuracy.


title: On a system of difference equations of second order solved in a closed from

abstract: In this work we solve in closed form the system of difference equations \begin{equation*} x_{n+1}=\dfrac{ay_nx_{n-1}+bx_{n-1}+c}{y_nx_{n-1}},\; y_{n+1}=\dfrac{ax_ny_{n-1}+by_{n-1}+c}{x_ny_{n-1}},\;n=0,1,..., \end{equation*} where the initial values $x_{-1}$, $x_0$, $y_{-1}$ and $y_0$ are arbitrary nonzero real numbers and the parameters $a$, $b$ and $c$ are arbitrary real numbers with $c\ne 0$. In particular we represent the solutions of some particular cases of this system in terms of Tribonacci and Padovan numbers and we prove the global stability of the corresponding positive equilibrium points. The result obtained here extend those obtained in some recent papers.


title: On proper holomorphic maps between bounded symmetric domains

abstract: We study proper holomorphic maps between bounded symmetric domains $D$ and $\Omega$. In particular, when $D$ and $\Omega$ are of the same rank $\ge 2$ such that all irreducible factors of $D$ are of rank $\ge 2$, we prove that any proper holomorphic map from $D$ to $\Omega$ is a totally geodesic holomorphic isometric embedding with respect to certain canonical K\"ahler metrics of $D$ and $\Omega$. We also obtain some results regarding holomorphic maps $F:D\to \Omega$ which map minimal disks of $D$ properly into rank-$1$ characteristic symmetric subspaces of $\Omega$. On the other hand, we obtain new rigidity results regarding semi-product proper holomorphic maps between $D$ and $\Omega$ under a certain rank condition on $D$ and $\Omega$.


title: Kernelized Complete Conditional Stein Discrepancy

abstract: Much of machine learning relies on comparing distributions with discrepancy measures. Stein's method creates discrepancy measures between two distributions that require only the unnormalized density of one and samples from the other. Stein discrepancies can be combined with kernels to define kernelized Stein discrepancies (KSDs). While kernels make Stein discrepancies tractable, they pose several challenges in high dimensions. We introduce kernelized complete conditional Stein discrepancies (KCC-SDs). Complete conditionals turn a multivariate distribution into multiple univariate distributions. We show that KCC-SDs distinguish distributions. To show the efficacy of KCC-SDs in distinguishing distributions, we introduce a goodness-of-fit test using KCC-SDs. We empirically show that KCC-SDs have higher power over baselines and use KCC-SDs to assess sample quality in Markov chain Monte Carlo.


title: Who Needs Words? Lexicon-Free Speech Recognition

abstract: Lexicon-free speech recognition naturally deals with the problem of out-of-vocabulary (OOV) words. In this paper, we show that character-based language models (LM) can perform as well as word-based LMs for speech recognition, in word error rates (WER), even without restricting the decoding to a lexicon. We study character-based LMs and show that convolutional LMs can effectively leverage large (character) contexts, which is key for good speech recognition performance downstream. We specifically show that the lexicon-free decoding performance (WER) on utterances with OOV words using character-based LMs is better than lexicon-based decoding, both with character or word-based LMs.