title: KPynq: A Work-Efficient Triangle-Inequality based K-means on FPGA

abstract: K-means is a popular but computation-intensive algorithm for unsupervised learning. To address this issue, we present KPynq, a work-efficient triangle-inequality based K-means on FPGA for handling large-size, high-dimension datasets. KPynq leverages an algorithm-level optimization to balance the performance and computation irregularity, and a hardware architecture design to fully exploit the pipeline and parallel processing capability of various FPGAs. In the experiment, KPynq consistently outperforms the CPU-based standard K-means in terms of its speedup (up to 4.2x) and significant energy-efficiency (up to 218x).


title: Symmetry-protected localized states at defects in non-Hermitian systems

abstract: Understanding how local potentials affect system eigenmodes is crucial for experimental studies of nontrivial bulk topology. Recent studies have discovered many exotic and highly non-trivial topological states in non-Hermitian systems. As such, it would be interesting to see how non-Hermitian systems respond to local perturbations. In this work, we consider chiral and particle-hole -symmetric non-Hermitian systems on a bipartite lattice, including SSH model and photonic graphene, and find that a disordered local potential could induce bound states evolving from the bulk. When the local potential on a single site becomes infinite, which renders a lattice vacancy, chiral-symmetry-protected zero-energy mode and particle-hole symmetry-protected bound states with purely imaginary eigenvalues emerge near the vacancy. These modes are robust against any symmetry-preserved perturbations. Our work generalizes the symmetry-protected localized states to non-Hermitian systems.


title: Approximately Maximizing the Broker's Profit in a Two-sided Market

abstract: We study how to maximize the broker's (expected) profit in a two-sided market, where she buys items from a set of sellers and resells them to a set of buyers. Each seller has a single item to sell and holds a private value on her item, and each buyer has a valuation function over the bundles of the sellers' items. We consider the Bayesian setting where the agents' values are independently drawn from prior distributions, and aim at designing dominant-strategy incentive-compatible (DSIC) mechanisms that are approximately optimal. Production-cost markets, where each item has a publicly-known cost to be produced, provide a platform for us to study two-sided markets. Briefly, we show how to covert a mechanism for production-cost markets into a mechanism for the broker, whenever the former satisfies cost-monotonicity. This reduction holds even when buyers have general combinatorial valuation functions. When the buyers' valuations are additive, we generalize an existing mechanism to production-cost markets in an approximation-preserving way. We then show that the resulting mechanism is cost-monotone and thus can be converted into an 8-approximation mechanism for two-sided markets.


title: Treating different bonding situations: Revisiting Au-Cu alloys using the random phase approximation

abstract: The ground state equilibrium properties of copper-gold alloys have been explored with the state of art random phase approximation (RPA). Our estimated lattice constants agree with the experiment within a mean absolute percentage error (MAPE) of 1.4 percent. Semi-local functionals such as the generalized gradient approximation (GGA) of Perdew, Burke, and Ernzerhof (PBE) and strongly constrained and appropriately normed (SCAN) fail to provide accurate bulk moduli, which indicate their inability to describe the system in a stretched or compressed state with respect to the equilibrium geometry. We find that the non-locality present in RPA is able to describe the transition between two delocalized electron densities (bulk elemental constituents to crystallized alloys), as required to provide accurate formation energies. Based on our results, we conclude that it is difficult to find a universal density functional which can give accurate results for a wide range of properties of intermetallic alloys. However, RPA can capture different bonding situations, often better than other density functionals. It gives accurate results for a wide range of ground state properties for the alloys, generated from metals with completely filled d-shells.


title: Toward Optimal Performance with Network Assisted TCP at Mobile Edge

abstract: In contrast to the classic fashion for designing distributed end-to-end (e2e) TCP schemes for cellular networks (CN), we explore another design space by having the CN assist the task of the transport control. We show that in the emerging cellular architectures such as mobile/multi-access edge computing (MEC), where the servers are located close to the radio access network (RAN), significant improvements can be achieved by leveraging the nature of the logically centralized network measurements at the RAN and passing information such as its minimum e2e delay and access link capacity to each server. Particularly, a Network Assistance module (located at the mobile edge) will pair up with wireless scheduler to provide feedback information to each server and facilitate the task of congestion control. To that end, we present two Network Assisted schemes called NATCP (a clean-slate design replacing TCP at end-hosts) and NACubic (a backward compatible design requiring no change for TCP at end-hosts). Our preliminary evaluations using real cellular traces show that both schemes dramatically outperform existing schemes both in single-flow and multi-flow scenarios.


title: The tradeoff between the utility and risk of location data and implications for public good

abstract: High-resolution individual geolocation data passively collected from mobile phones is increasingly sold in private markets and shared with researchers. This data poses significant security, privacy, and ethical risks: it's been shown that users can be re-identified in such datasets, and its collection rarely involves their full consent or knowledge. This data is valuable to private firms (e.g. targeted marketing) but also presents clear value as a public good. Recent public interest research has demonstrated that high-resolution location data can more accurately measure segregation in cities and provide inexpensive transit modeling. But as data is aggregated to mitigate its re-identifiability risk, its value as a good diminishes. How do we rectify the clear security and safety risks of this data, its high market value, and its potential as a resource for public good? We extend the recently proposed concept of a tradeoff curve that illustrates the relationship between dataset utility and privacy. We then hypothesize how this tradeoff differs between private market use and its potential use for public good. We further provide real-world examples of how high resolution location data, aggregated to varying degrees of privacy protection, can be used in the public sphere and how it is currently used by private firms.


title: Optimal extensions of conformal mappings from the unit disk to cardioid-type domains

abstract: The conformal mapping $f(z)=(z+1)^2 $ from $\mathbb{D}$ onto the standard cardioid has a homeomorphic extension of finite distortion to entire $\mathbb{R}^2 .$ We study the optimal regularity of such extensions, in terms of the integrability degree of the distortion and of the derivatives, and these for the inverse. We generalize all outcomes to the case of conformal mappings from $\mathbb{D}$ onto cardioid-type domains.


title: Hey Google, What Exactly Do Your Security Patches Tell Us? A Large-Scale Empirical Study on Android Patched Vulnerabilities

abstract: In this paper, we perform a comprehensive study of 2,470 patched Android vulnerabilities that we collect from different data sources such as Android security bulletins, CVEDetails, Qualcomm Code Aurora, AOSP Git repository, and Linux Patchwork. In our data analysis, we focus on determining the affected layers, OS versions, severity levels, and common weakness enumerations (CWE) associated with the patched vulnerabilities. Further, we assess the timeline of each vulnerability, including discovery and patch dates. We find that (i) even though the number of patched vulnerabilities changes considerably from month to month, the relative number of patched vulnerabilities for each severity level remains stable over time, (ii) there is a significant delay in patching vulnerabilities that originate from the Linux community or concern Qualcomm components, even though Linux and Qualcomm provide and release their own patches earlier, (iii) different AOSP versions receive security updates for different periods of time, (iv) for 94% of patched Android vulnerabilities, the date of disclosure in public datasets is not before the patch release date, (v) there exist some inconsistencies among public vulnerability data sources, e.g., some CVE IDs are listed in Android Security bulletins with detailed information, but in CVEDetails they are listed as unknown, (vi) many patched vulnerabilities for newer Android versions likely also affect older versions that do not receive security patches due to end-of-life.


title: Physical Correlations of the Scatter between Galaxy Mass, Stellar Content, and Halo Mass

abstract: We use the UniverseMachine to analyze the source of scatter between the central galaxy mass, the total stellar mass in the halo, and the dark matter halo mass. We also propose a new halo mass estimator, the cen+N mass: the sum of the stellar mass of the central and the N most massive satellites. We show that, when real space positions are perfectly known, the cen+N mass has scatter competitive with that of richness-based estimators. However, in redshift space, the cen+N mass suffers less from projection effects in the UniverseMachine model. The cen+N mass is therefore a viable low scatter halo mass estimator, and should be considered an important tool to constrain cosmology with upcoming spectroscopic data from DESI. We analyze the scatter in stellar mass at fixed halo mass and show that the total stellar mass in a halo is uncorrelated with secondary halo properties, but that the central stellar mass is a function of both halo mass and halo age. This is because central galaxies in older halos have had more time to grow via accretion. If the UniverseMachine model is correct, accurate galaxy-halo modeling of mass selected samples therefore needs to consider halo age in addition to mass.


title: On the travel time tomography problem in 3D

abstract: Numerical issues for the 3D travel time tomography problem with non-overdetemined data are considered. Truncated Fourier series with respect to a special orthonormal basis of functions depending on the source position is used. In addition, truncated trigonometric Fourier series with respect to two out of three spatial variables is used. First, the Lipschitz stability estimate is obtained. Next, a globally convergent numerical method is constructed using a Carleman estimate for an integral operator.


title: Minimizing the Negative Side Effects of Planning with Reduced Models

abstract: Reduced models of large Markov decision processes accelerate planning by considering a subset of outcomes for each state-action pair. This reduction in reachable states leads to replanning when the agent encounters states without a precomputed action during plan execution. However, not all states are suitable for replanning. In the worst case, the agent may not be able to reach the goal from the newly encountered state. Agents should be better prepared to handle such risky situations and avoid replanning in risky states. Hence, we consider replanning in states that are unsafe for deliberation as a negative side effect of planning with reduced models. While the negative side effects can be minimized by always using the full model, this defeats the purpose of using reduced models. The challenge is to plan with reduced models, but somehow account for the possibility of encountering risky situations. An agent should thus only replan in states that the user has approved as safe for replanning. To that end, we propose planning using a portfolio of reduced models, a planning paradigm that minimizes the negative side effects of planning using reduced models by alternating between different outcome selection approaches. We empirically demonstrate the effectiveness of our approach on three domains: an electric vehicle charging domain using real-world data from a university campus and two benchmark planning problems.


title: Convergence Analyses of Online ADAM Algorithm in Convex Setting and Two-Layer ReLU Neural Network

abstract: Nowadays, online learning is an appealing learning paradigm, which is of great interest in practice due to the recent emergence of large scale applications such as online advertising placement and online web ranking. Standard online learning assumes a finite number of samples while in practice data is streamed infinitely. In such a setting gradient descent with a diminishing learning rate does not work. We first introduce regret with rolling window, a new performance metric for online streaming learning, which measures the performance of an algorithm on every fixed number of contiguous samples. At the same time, we propose a family of algorithms based on gradient descent with a constant or adaptive learning rate and provide very technical analyses establishing regret bound properties of the algorithms. We cover the convex setting showing the regret of the order of the square root of the size of the window in the constant and dynamic learning rate scenarios. Our proof is applicable also to the standard online setting where we provide the first analysis of the same regret order (the previous proofs have flaws). We also study a two layer neural network setting with ReLU activation. In this case we establish that if initial weights are close to a stationary point, the same square root regret bound is attainable. We conduct computational experiments demonstrating a superior performance of the proposed algorithms.


title: Quantum phase-sensitive diffraction and imaging using entangled photons

abstract: We propose a novel quantum diffraction imaging technique whereby one photon of an entangled pair is diffracted off a sample and detected in coincidence with its twin. The image is obtained by scanning the photon that did not interact with matter. We show that when a dynamical quantum system interacts with an external field, the phase information is imprinted in the state of the field in a detectable way. The contribution to the signal from photons that interact with the sample scales as $\propto I_{p}^{1/2}$, where $I_{p}$ is the source intensity, compared to $\propto I_{p}$ of classical diffraction. This makes imaging with weak-field possible, avoiding damage to delicate samples. A Schmidt decomposition of the state of the field can be used for image enhancement by reweighting the Schmidt modes contributions.


title: Illumination in Rational Billiards

abstract: We show that for a rational polygonal billiard, the set of pairs of points that do not illuminate each other (not connected by a billiard trajectory) is finite, and use the same method to extend the results of Leli\`evre, Monteil and Weiss, and of Apisa and Wright about the amount of pairs of points that are finitely blocked with a certain blocking cardinality. We rely on previous work about the blocking property in translation surfaces which ultimately stems from results of Eskin, Mirzakhani and Mohammadi on dynamics of moduli spaces of translation surfaces.


title: Towards Global Asset Management in Blockchain Systems

abstract: Permissionless blockchains (e.g., Bitcoin, Ethereum, etc) have shown a wide success in implementing global scale peer-to-peer cryptocurrency systems. In such blockchains, new currency units are generated through the mining process and are used in addition to transaction fees to incentivize miners to maintain the blockchain. Although it is clear how currency units are generated and transacted on, it is unclear how to use the infrastructure of permissionless blockchains to manage other assets than the blockchain's currency units (e.g., cars, houses, etc). In this paper, we propose a global asset management system by unifying permissioned and permissionless blockchains. A governmental permissioned blockchain authenticates the registration of end-user assets through smart contract deployments on a permissionless blockchain. Afterwards, end-users can transact on their assets through smart contract function calls (e.g., sell a car, rent a room in a house, etc). In return, end-users get paid in currency units of the same blockchain or other blockchains through atomic cross-chain transactions and governmental offices receive taxes on these transactions in cryptocurrency units.


title: Bounding the Charm Yukawa

abstract: The study of the properties of the observed Higgs boson is one of the main research activities in High Energy Physics. Although the couplings of the Higgs to the weak gauge bosons and third generation quark and leptons have been studied in detail, little is known about the Higgs couplings to first and second generation fermions. In this article, we study the charm quark Higgs coupling in the so-called $\kappa$ framework. We emphasize the existence of specific correlations between the Higgs couplings that can render the measured LHC Higgs production rates close to the SM values in the presence of large deviations of the charm coupling from its SM value, $\kappa_c = 1$. Based on this knowledge, we update the indirect bounds on $\kappa_c$ through a fit to the precision Higgs measurements at the LHC. We also examine the limits on $\kappa_c$ arising from the radiative decay $H \to J/\psi + \gamma$, the charm quark-associated Higgs production, charm quark decays of the Higgs field and charge asymmetry in $W^{\pm} + H$ production. Estimates for the future LHC sensitivity on $\kappa_c$ at the high luminosity run are provided.


title: On the morphology of two-dimensional laminar vortex streets behind triangles

abstract: The two-dimensional laminar vortex streets behind a triangle have two morphologically distinct structures depending on the Reynolds number and the aspect ratio of the triangle. These two structures are the conventional structure and the separated rows structure, where the latter is characterized by a thin layer of irrotational fluid between two vortex rows. In this paper, by means of numerical simulation, we find that the separated rows structure occurs when the thickness of boundary layers is less than 25% of their separation distance. We also show from the linear stability analysis that the criterion is related to the coupling of two boundary layers in producing unstable modes.


title: Sensitivity computation of statistically stationary quantities in turbulent flows

abstract: It is well-known that linearized perturbation methods for sensitivity analysis, such as tangent or adjoint equation-based, finite difference and automatic differentiation are not suitable for turbulent flows. The reason is that turbulent flows exhibit chaotic dynamics, leading to the norm of an infinitesimal perturbation to the state growing exponentially in time. As a result, these conventional methods cannot be used to compute the derivatives of long-time averaged quantities to control or design inputs. The ensemble-based approaches and shadowing-based approaches to circumvent the problems of the conventional methods in chaotic systems, also suffer from computational impracticality and lack of consistency guarantees, respectively. We introduce the space-split sensitivity, or the S3 algorithm, which is a Monte-Carlo approach to the chaotic sensitivity computation problem. In this work, we derive the S3 algorithm under simplifying assumptions on the dynamics and present a numerical validation on a low-dimensional example of chaos.


title: Associated production of Higgs boson with a photon at electron-positron colliders

abstract: A complete one-loop prediction for the single production of the neutral Higgs bosons in association with a photon in electron-positron collisions is presented in the framework the minimal supersymmetric standard model (MSSM), paying special attention to the individual contribution from each type of diagram. This process has no amplitude at tree level and is hence directly sensitive to one-loop impacts and the underlying dynamics of Higgs. To investigate the effect of the new physics, four different scenarios, which include a Higgs boson with mass and couplings consistent with those of the discovered Higgs boson and a considerable part of parameter space allowed by the bounds from the searches for additional Higgs bosons and sparticles, are chosen in the MSSM. The dependence of the cross section in both the standard model(SM) and MSSM on the center-of-mass energy is examined by considering the polarizations of the initial electron and positron beams. The effect of individual contributions from each type of one-loop diagram on the total cross section is also investigated in detail. Furthermore, the total cross sections of $e^- e^+ \rightarrow \gamma h^0$ as well as $e^- e^+ \rightarrow \gamma A^0$ are scanned over the plane $m_A-\tan\beta$ for each scenario. The full one-loop contributions are crucial for the analysis of beyond the SM physics at a future electron-positron collider.


title: FQL: An Extensible Feature Query Language and Toolkit on Searching Software Characteristics for HPC Applications

abstract: The amount of large-scale scientific computing software is dramatically increasing. In this work, we designed a new language, named feature query language (FQL), to collect and extract software features from a quick static code analysis. We designed and implemented an FQL toolkit to automatically detect and present the software features using an extensible query repository. Several large-scale, high performance computing (HPC) scientific codes have been used in the paper to demonstrate the HPC-related feature extraction and information collection. Although we emphasized the HPC features in the study, the toolkit can be easily extended to answer general software feature questions, such as coding pattern and hardware dependency.


title: Magnetic order in single crystals of Na3Co2SbO6 with a honeycomb arrangement of 3d$^7$ Co$^{2+}$ ions

abstract: We have synthesized single crystals of Na$_3$Co$_2$SbO$_6$ and characterized the structure and magnetic order by measuring anisotropic magnetic properties, heat capacity, x-ray and neutron single crystal diffraction. Magnetic properties and specific heat of polycrystalline Na$_3$Co$_2$SbO$_6$ were also measured for comparison. Na$_3$Co$_2$SbO$_6$ crystallizes in a monoclinic structure (space group $C2/m$) with [Co$_2$SbO$_6$]$^{3-}$ layers separated by Na$^+$ ions. The temperature dependence of magnetic susceptibility shows significant anisotropic behavior in the whole temperature range 2\,K-350\,K investigated in this work. An effective moment of about 5.5\,$\mu_B$/Co$^{2+}$ from a Curie-Weiss fitting of the magnetic susceptibility is larger than the spin only value and signals significant orbital contribution. Na$_3$Co$_2$SbO$_6$ single crystal undergoes a transition into a long-range antiferromagnetically ordered state below $T_N$=5\,K. Neutron single crystal diffraction confirmed the zigzag magnetic structure with a propagation vector k\,=\,(0.5, 0.5, 0). The ordered moment is found to be 0.9\,$\mu_B$ at 4\,K and align along the crystallographic \textit{b}-axis. Density functional theory calculations suggest that the experimentally observed zigzag order is energetically competing with the Neel order. It is also found that the covalency between Co $d$ and O $p$ is quite strong and competes with the local spin-orbit coupling, suggesting a $J_{eff}$=1/2 ground state may not be realized in this compound.


title: On the Schottky problem for genus five Jacobians with a vanishing theta null

abstract: We give a solution to the weak Schottky problem for genus five Jacobians with a vanishing theta null, answering a question of Grushevsky and Salvati Manni. More precisely, we show that if a principally polarized abelian variety of dimension five has a vanishing theta null with a quadric tangent cone of rank at most three, then it is in the Jacobian locus, up to extra irreducible components. We employ a degeneration argument, together with a study of the ramification loci for the Gauss map of a theta divisor.


title: Zero Mach Number Limit of the Compressible Primitive Equations Part I: Well-prepared Initial Data

abstract: This work concerns the zero Mach number limit of the compressible primitive equations. The primitive equations with the incompressibility condition are identified as the limiting equations. The convergence with well-prepared initial data (i.e., initial data without acoustic oscillations) is rigorously justified, and the convergence rate is shown to be of order $ \mathcal O(\varepsilon) $, as $ \varepsilon \rightarrow 0^+ $, where $ \varepsilon $ represents the Mach number. As a byproduct, we construct a class of global solutions to the compressible primitive equations, which are close to the incompressible flows.


title: Outlier Robust Extreme Learning Machine for Multi-Target Regression

abstract: The popularity of algorithms based on Extreme Learning Machine (ELM), which can be used to train Single Layer Feedforward Neural Networks (SLFN), has increased in the past years. They have been successfully applied to a wide range of classification and regression tasks. The most commonly used methods are the ones based on minimizing the $\ell_2$ norm of the error, which is not suitable to deal with outliers, essentially in regression tasks. The use of $\ell_1$ norm was proposed in Outlier Robust ELM (OR-ELM), which is defined to one-dimensional outputs. In this paper, we generalize OR-ELM to deal with multi-target regression problems, using the error $\ell_{2,1}$ norm and the Elastic Net theory, which can result in a more sparse network, resulting in our method, Generalized Outlier Robust ELM (GOR-ELM). We use Alternating Direction Method of Multipliers (ADMM) to solve the resulting optimization problem. An incremental version of GOR-ELM is also proposed. We chose 15 public real-world multi-target regression datasets to test our methods. Our conducted experiments show that they are statistically better than other ELM-based techniques, when considering data contaminated with outliers, and equivalent to them, otherwise.


title: Sparse Equisigned PCA: Algorithms and Performance Bounds in the Noisy Rank-1 Setting

abstract: Singular value decomposition (SVD) based principal component analysis (PCA) breaks down in the high-dimensional and limited sample size regime below a certain critical eigen-SNR that depends on the dimensionality of the system and the number of samples. Below this critical eigen-SNR, the estimates returned by the SVD are asymptotically uncorrelated with the latent principal components. We consider a setting where the left singular vector of the underlying rank one signal matrix is assumed to be sparse and the right singular vector is assumed to be equisigned, that is, having either only nonnegative or only nonpositive entries. We consider six different algorithms for estimating the sparse principal component based on different statistical criteria and prove that by exploiting sparsity, we recover consistent estimates in the low eigen-SNR regime where the SVD fails. Our analysis reveals conditions under which a coordinate selection scheme based on a \textit{sum-type decision statistic} outperforms schemes that utilize the $\ell_1$ and $\ell_2$ norm-based statistics. We derive lower bounds on the size of detectable coordinates of the principal left singular vector and utilize these lower bounds to derive lower bounds on the worst-case risk. Finally, we verify our findings with numerical simulations and illustrate the performance with a video data example, where the interest is in identifying objects.


title: Gravitational Wave "Echo" Spectra

abstract: Exotic compact objects may resemble black holes very closely while remaining horizonless. They may be distinguished from black holes because they effectively give rise to a resonant cavity for the propagation of low frequency gravity waves. In a Green's function approach, the resonance structure appears in a transfer function. The transfer function in turn is modulated by an initial-condition-dependent source integral to obtain the observed spectrum. We find that the source integral displays universal factors that tend to enhance low and negative frequencies, and this increases the complexity of the waveforms in the time domain. These waveforms also display a significant sensitivity to initial conditions. For these reasons a standard matched-filter search strategy is difficult. In contrast, the sharp and evenly spaced resonance spectrum presents a much more robust signal to target. It persists even in the absence of simple echoes. We also describe an additional two-component structure of this resonance pattern.


title: Restricted Spatial Regression Methods: Implications for Inference

abstract: The issue of spatial confounding between the spatial random effect and the fixed effects in regression analyses has been identified as a concern in the statistical literature. Multiple authors have offered perspectives and potential solutions. In this paper, for the areal spatial data setting, we show that many of the methods designed to alleviate spatial confounding can be viewed as special cases of a general class of models. We refer to this class as Restricted Spatial Regression (RSR) models, extending terminology currently in use. We offer a mathematically based exploration of the impact that RSR methods have on inference for regression coefficients for the linear model. We then explore whether these results hold in the generalized linear model setting for count data using simulations. We show that the use of these methods have counterintuitive consequences which defy the general expectations in the literature. In particular, our results and the accompanying simulations suggest that RSR methods will typically perform worse than non-spatial methods. These results have important implications for dimension reduction strategies in spatial regression modeling. Specifically, we demonstrate that the problems with RSR models cannot be fixed with a selection of "better" spatial basis vectors or dimension reduction techniques.


title: Lexicase Selection of Specialists

abstract: Lexicase parent selection filters the population by considering one random training case at a time, eliminating any individuals with errors for the current case that are worse than the best error in the selection pool, until a single individual remains. This process often stops before considering all training cases, meaning that it will ignore the error values on any cases that were not yet considered. Lexicase selection can therefore select specialist individuals that have poor errors on some training cases, if they have great errors on others and those errors come near the start of the random list of cases used for the parent selection event in question. We hypothesize here that selecting these specialists, which may have poor total error, plays an important role in lexicase selection's observed performance advantages over error-aggregating parent selection methods such as tournament selection, which select specialists much less frequently. We conduct experiments examining this hypothesis, and find that lexicase selection's performance and diversity maintenance degrade when we deprive it of the ability of selecting specialists. These findings help explain the improved performance of lexicase selection compared to tournament selection, and suggest that specialists help drive evolution under lexicase selection toward global solutions.


title: Robust Singular Smoothers For Tracking Using Low-Fidelity Data

abstract: Tracking underwater autonomous platforms is often difficult because of noisy, biased, and discretized input data. Classic filters and smoothers based on standard assumptions of Gaussian white noise break down when presented with any of these challenges. Robust models (such as the Huber loss) and constraints (e.g. maximum velocity) are used to attenuate these issues. Here, we consider robust smoothing with singular covariance, which covers bias and correlated noise, as well as many specific model types, such as those used in navigation. In particular, we show how to combine singular covariance models with robust losses and state-space constraints in a unified framework that can handle very low-fidelity data. A noisy, biased, and discretized navigation dataset from a submerged, low-cost inertial measurement unit (IMU) package, with ultra short baseline (USBL) data for ground truth, provides an opportunity to stress-test the proposed framework with promising results. We show how robust modeling elements improve our ability to analyze the data, and present batch processing results for 10 minutes of data with three different frequencies of available USBL position fixes (gaps of 30 seconds, 1 minute, and 2 minutes). The results suggest that the framework can be extended to real-time tracking using robust windowed estimation.


title: Comparing and Combining Lexicase Selection and Novelty Search

abstract: Lexicase selection and novelty search, two parent selection methods used in evolutionary computation, emphasize exploring widely in the search space more than traditional methods such as tournament selection. However, lexicase selection is not explicitly driven to select for novelty in the population, and novelty search suffers from lack of direction toward a goal, especially in unconstrained, highly-dimensional spaces. We combine the strengths of lexicase selection and novelty search by creating a novelty score for each test case, and adding those novelty scores to the normal error values used in lexicase selection. We use this new novelty-lexicase selection to solve automatic program synthesis problems, and find it significantly outperforms both novelty search and lexicase selection. Additionally, we find that novelty search has very little success in the problem domain of program synthesis. We explore the effects of each of these methods on population diversity and long-term problem solving performance, and give evidence to support the hypothesis that novelty-lexicase selection resists converging to local optima better than lexicase selection.


title: Critical Review of BugSwarm for Fault Localization and Program Repair

abstract: Benchmarks play an important role in evaluating the efficiency and effectiveness of solutions to automate several phases of the software development lifecycle. Moreover, if well designed, they also serve us well as an important artifact to compare different approaches amongst themselves. BugSwarm is a benchmark that has been recently published, which contains 3,091 pairs of failing and passing continuous integration builds. According to the authors, the benchmark has been designed with the automatic program repair and fault localization communities in mind. Given that a benchmark targeting these communities ought to have several characteristics (e.g., a buggy statement needs to be present), we have dissected the benchmark to fully understand whether the benchmark suits these communities well. Our critical analysis has found several limitations in the benchmark: only 112/3,091 (3.6%) are suitable to evaluate techniques for automatic fault localization or program repair.


title: semopy: A Python package for Structural Equation Modeling

abstract: Structural equation modelling (SEM) is a multivariate statistical technique for estimating complex relationships between observed and latent variables. Although numerous SEM packages exist, each of them has limitations. Some packages are not free or open-source; the most popular package not having this disadvantage is $\textbf{lavaan}$, but it is written in R language, which is behind current mainstream tendencies that make it harder to be incorporated into developmental pipelines (i.e. bioinformatical ones). Thus we developed the Python package $\textbf{semopy}$ to satisfy those criteria. The paper provides detailed examples of package usage and explains it's inner clockworks. Moreover, we developed the unique generator of SEM models to extensively test SEM packages and demonstrated that $\textbf{semopy}$ significantly outperforms $\textbf{lavaan}$ in execution time and accuracy.


title: On support varieties and tensor products for finite dimensional algebras

abstract: It has been asked whether there is a version of the tensor product property for support varieties over finite dimensional algebras defined in terms of Hochschild cohomology. We show that in general no such version can exist. In particular, we show that for certain quantum complete intersections, there are modules and bimodules for which the variety of the tensor product is not even contained in the variety of the one-sided module.


title: An alternate proof of idempotent relations among periodic points and quotients

abstract: We give a short proof of an idempotent relation formula for counting periodic points of endomorphisms defined over finite fields. The original proof of this result, due to Walton, uses formal manipulation of arithmetic zeta functions, whereas we deduce the result directly from a related theorem of Kani and Rosen.


title: A computational approach to the Frobenius-Schur indicators of finite exceptional groups

abstract: We prove that the finite exceptional groups $F_4(q)$, $E_7(q)_{\mathrm{ad}}$, and $E_8(q)$ have no irreducible complex characters with Frobenius-Schur indicator $-1$, and we list exactly which irreducible characters of these groups are not real-valued. We also give an exact list of complex irreducible characters of the Ree groups ${^2 F_4}(q^2)$ which are not real-valued, and we show the only character of this group which has Frobenius-Schur indicator $-1$ is the cuspidal unipotent character $\chi_{21}$ found by M. Geck.


title: Controlling single-photon detector ID210 with bright light

abstract: We experimentally demonstrate that a single-photon detector ID210 commercially available from ID Quantique is vulnerable to blinding and can be fully controlled by bright illumination. In quantum key distribution, this vulnerability can be exploited by an eavesdropper to perform a faked-state attack giving her full knowledge of the key without being noticed. We consider the attack on standard BB84 protocol and a subcarrier-wave scheme, and outline a possible countermeasure.


title: Learning to Prove Theorems via Interacting with Proof Assistants

abstract: Humans prove theorems by relying on substantial high-level reasoning and problem-specific insights. Proof assistants offer a formalism that resembles human mathematical reasoning, representing theorems in higher-order logic and proofs as high-level tactics. However, human experts have to construct proofs manually by entering tactics into the proof assistant. In this paper, we study the problem of using machine learning to automate the interaction with proof assistants. We construct CoqGym, a large-scale dataset and learning environment containing 71K human-written proofs from 123 projects developed with the Coq proof assistant. We develop ASTactic, a deep learning-based model that generates tactics as programs in the form of abstract syntax trees (ASTs). Experiments show that ASTactic trained on CoqGym can generate effective tactics and can be used to prove new theorems not previously provable by automated methods. Code is available at https://github.com/princeton-vl/CoqGym.


title: A new perspective on the Ermakov-Pinney and scalar wave equations

abstract: The first part of the paper proves that a subset of the general set of Ermakov-Pinney equations can be obtained by differentiation of a first-order non-linear differential equation. The second part of the paper proves that, similarly, the equation for the amplitude function for the parametrix of the scalar wave equation can be obtained by covariant differentiation of a first-order non-linear equation. The construction of such a first-order non-linear equation relies upon a pair of auxiliary 1-forms (psi,rho). The 1-form psi satisfies the divergenceless condition div(psi)=0, whereas the 1-form rho fulfills the non-linear equation div(rho)+rho**2=0. The auxiliary 1-forms (psi,rho) are evaluated explicitly in Kasner space-time, and hence also amplitude and phase function in the parametrix are obtained. Thus, the novel method developed in this paper can be used with profit in physical applications.


title: An Optimal Private Stochastic-MAB Algorithm Based on an Optimal Private Stopping Rule

abstract: We present a provably optimal differentially private algorithm for the stochastic multi-arm bandit problem, as opposed to the private analogue of the UCB-algorithm [Mishra and Thakurta, 2015; Tossou and Dimitrakakis, 2016] which doesn't meet the recently discovered lower-bound of $\Omega \left(\frac{K\log(T)}{\epsilon} \right)$ [Shariff and Sheffet, 2018]. Our construction is based on a different algorithm, Successive Elimination [Even-Dar et al. 2002], that repeatedly pulls all remaining arms until an arm is found to be suboptimal and is then eliminated. In order to devise a private analogue of Successive Elimination we visit the problem of private stopping rule, that takes as input a stream of i.i.d samples from an unknown distribution and returns a multiplicative $(1 \pm \alpha)$-approximation of the distribution's mean, and prove the optimality of our private stopping rule. We then present the private Successive Elimination algorithm which meets both the non-private lower bound [Lai and Robbins, 1985] and the above-mentioned private lower bound. We also compare empirically the performance of our algorithm with the private UCB algorithm.


title: Can a Multi-Hop Link Relying on Untrusted Amplify-and-Forward Relays Render Security?

abstract: Cooperative relaying is utilized as an efficient method for data communication in wireless sensor networks and the Internet of Things (IoT). However, sometimes due to the necessity of multi-hop relaying in such communication networks, it is challenging to guarantee the secrecy of cooperative transmissions when the relays may themselves be eavesdroppers, i.e., we may face with the untrusted relaying scenario where the relays are both necessary helpers and potential adversary. To obviate this issue, a new cooperative jamming scheme is proposed in this paper, in which the data can be confidentially communicated from the source to the destination through multiple untrusted relays. In our proposed secure transmission scheme, all the legitimate nodes contribute to providing secure communication by intelligently injecting artificial noises to the network in different communication phases. For the sake of analysis, we consider a multi-hop untrusted relaying network with two successive intermediate nodes, i.e, a three-hop communications network. Given this system model, a new closed-form expression is presented in the high signal-to-noise ratio (SNR) region for the Ergodic secrecy rate (ESR). Furthermore, we evaluate the high SNR slope and power offset of the ESR to gain an insightful comparison of the proposed secure transmission scheme and the state-of-arts. Our numerical results highlight that the proposed secure transmission scheme provides better secrecy rate performance compared with the two-hop untrusted relaying as well as the direct transmission schemes.


title: A Simple Proof of the Riemann's Hypothesis

abstract: We present a simple proof of the Riemann's Hypothesis (RH) where only undergraduate mathematics is needed.


title: A Sub-mm$^3$ Ultrasonic Free-floating Implant for Multi-mote Neural Recording

abstract: A 0.8 mm$^3$ wireless, ultrasonically powered, free-floating neural recording implant is presented. The device is comprised only of a 0.25 mm$^2$ recording IC and a single piezoceramic resonator that is used for both power harvesting and data transmission. Uplink data transmission is performed by analog amplitude modulation of the ultrasound echo. Using a 1.78 MHz main carrier, >35 kbps/mote equivalent uplink data rate is achieved. A technique to linearize the echo amplitude modulation is introduced, resulting in <1.2\% static nonlinearity of the received signal over a $\pm$10 mV input range. The IC dissipates 37.7 $\mu$W, while the neural recording front-end consumes 4 $\mu$W and achieves a noise floor of 5.3 $\mu$V$_{rms}$ in a 5 kHz bandwidth. This work improves sub-mm recording mote depth by >2.5x, resulting in the highest measured depth/volume ratio by $\sim$3x. Orthogonal subcarrier modulation enables simultaneous operation of multiple implants, using a single-element ultrasound external transducer. Dual-mote simultaneous power up and data transmission is demonstrated at a rate of 7 kS/s at the depth of 50 mm.


title: Compressive spectral imaging based on hexagonal blue noise coded apertures

abstract: Coded aperture snapshot spectral imager (CASSI) is a computational imaging system that acquires a three dimensional (3D) spectral data cube by single or a few two dimensional (2D) measurements. Binary random coded apertures with square pixels are primarily implemented in CASSI systems to modulate the spectral images in spatial domain. The design and optimization of coded apertures was shown to improve the imaging performance of these systems significantly. This work proposes a different approach to code design. Instead of traditional squared tiled coded elements, hexagonal tiled elements are used. The dislocation between the binary hexagonal pixels on coded apertures and the square pixels on detector introduces equivalent grey-scale spatial modulation to increase the degrees of freedom in the sensing matrix, thus further improving the spectral imaging performance. Then, this paper presents an optimal structure under the criterion of satisfying the restricted isometry property (RIP) with high probability, coined blue noise (BN) coded apertures. In addition, this paper studies and verifies the proposed hexagonal blue noise coded aperture method on a general CASSI system, where the resolution of the coded aperture is equivalent to that of the detector. Based on the RIP criterion, this paper theoretically proves the superiority of the hexagonal blue noise coded aperture over the traditional random coded aperture with square lattice.


title: Robust Wireless Fingerprinting via Complex-Valued Neural Networks

abstract: A "wireless fingerprint" which exploits hardware imperfections unique to each device is a potentially powerful tool for wireless security. Such a fingerprint should be able to distinguish between devices sending the same message, and should be robust against standard spoofing techniques. Since the information in wireless signals resides in complex baseband, in this paper, we explore the use of neural networks with complex-valued weights to learn fingerprints using supervised learning. We demonstrate that, while there are potential benefits to using sections of the signal beyond just the preamble to learn fingerprints, the network cheats when it can, using information such as transmitter ID (which can be easily spoofed) to artificially inflate performance. We also show that noise augmentation by inserting additional white Gaussian noise can lead to significant performance gains, which indicates that this counter-intuitive strategy helps in learning more robust fingerprints. We provide results for two different wireless protocols, WiFi and ADS-B, demonstrating the effectiveness of the proposed method.


title: Isomorphism Theorems for Groupoids and Some Applications

abstract: Using an algebraic point of view we present an introduction to the groupoid theory, that is, we give fundamental properties of groupoids as, uniqueness of inverses and properties of the identities, and study subgroupoids, wide subgroupoids and normal subgroupoids. We also present the isomorphism theorems for groupoids and as an applications we obtain the corresponding version of Zassenhaus Lemma and Jordan-H\"{o}lder Theorem for groupoids. Finally inspired by the Ehresmann-Schein-Nambooripad Theorem we improve a result of R. Exel concerning a one to one correspondence between partial actions of groups and actions of inverse semigroups.


title: Constructing and solving cosmologies of early universes with dark energy and matter. I

abstract: The main purpose of this paper is to advance a unified theory of dark matter, dark energy, and inflation first formulated in 2008. Our minimal affine extension of the GR has geodesics coinciding with the pseudo Riemannian ones, up to parameterizations. It predicts a `sterile' massive vecton and depends on two new dimensional constants, which can be measured in the limit of small vecton velocity. In a special gauge, this velocity has an upper limit near which it grows to infinity. The linearized vecton theory is similar to the scalar models of inflation except the fact of internal anisotropy of the vecton. For this reason we study general solutions of scalar analogs of the vecton theory without restricting the curvature parameter and anisotropy by using previously derived exact solutions as functions of the metric. It is shown that the effects of curvature and anisotropy fast decrease in expanding universes. Our approach can be applied to anisotropic universes, which is demonstrated on an exactly solvable strongly anisotropic cosmology. To characterize different cosmological scenarios in detail we introduce three characteristic functions, two of which are small and almost equal during inflation and grow near the exit. Instead of the potential it is possible to use one of the two characteristic functions. This allows to approximately derive flat isotropic universes with `prescribed' scenarios, which is the essence of our constructive cosmology of early universes. The most natural application of our approach is in analytically constructing characteristic functions of inflationary models with natural exits. However, the general construction can be applied to other problems, e.g., to evolution of contracting universes.


title: Accelerating Adjoint Variable Method Based Photonic Optimization with Schur Complement Domain Decomposition

abstract: Adjoint variable method in combination with gradient descent optimization has been widely used for the inverse design of nanophotonic devices. In many of such optimizations, the design region is only a small fraction of the total computational domain. Here we show that the adjoint variable method can be combined with the Schur complement domain decomposition method. With this combination, in each optimization step, the simulation only involves the degrees of freedom that are inside the design region. Our approach should significantly improve the computational efficiency of adjoint variable method based optimization of photonic structures.


title: Multi-epoch Low Radio Frequency Surveys of the Kepler K2 Mission Campaign Fields 3, 4, and 5 with the Murchison Widefield Array

abstract: We present Murchison Widefield Array (MWA) monitoring of the Kepler K2 mission Fields 3, 4, and 5 at frequencies of 155 and 186 MHz, from observations contemporaneous with the K2 observations. This work follows from previous MWA and GMRT surveys of Field 1, with the current work benefiting from a range of improvements in the data processing and analysis. We continue to build a body of systematic low frequency blind surveys overlapping with transient/variable survey fields at other wavelengths, providing multi-wavelength data for object classes such as flare stars. From the current work, we detect no variable objects at a surface density above 2e-4 per square degree, at flux densities of ~500 mJy, and observation cadence of days to weeks, representing almost an order of magnitude decrease in measured upper limits compared to previous results in this part of observational parameter space. This continues to show that radio transients at metre and centimetre wavelengths are rare.


title: Perturbation of Continuous Frames on Quaternionic Hilbert Spaces

abstract: In this note, following the theory of discrete frame perturbations in a complex Hilbert space, we examine perturbation of rank $n$ continuous frame, rank $n$ continuous Bessel family and rank $n$ continuous Riesz family in a non-commutative setting, namely in a right quaternionic Hilbert space.


title: Unconditional finite amplitude stability of a fluid in a mechanically isolated vessel with spatially non-uniform wall temperature

abstract: A fluid occupying a mechanically isolated vessel with walls kept at spatially non-uniform temperature is in the long run expected to reach the spatially inhomogeneous steady state. Irrespective of the initial conditions the velocity field is expected to vanish, and the temperature field is expected to be fully determined by the steady heat equation. This simple observation is however difficult to prove using the corresponding governing equations. The main difficulties are the presence of the dissipative heating term in the evolution equation for temperature and the lack of control on the heat fluxes through the boundary. Using thermodynamically based arguments, it is shown that these difficulties in the proof can be overcome, and it is proved that the velocity and temperature perturbations to the steady state actually vanish as the time goes to infinity.


title: The Stabilized Explicit Variable-Load Solver with Machine Learning Acceleration for the Rapid Solution of Stiff Chemical Kinetics

abstract: In this study, a fast and stable machine-learned hybrid algorithm implemented in TensorFlow for the integration of stiff chemical kinetics is introduced. Numerical solutions to differential equations are at the core of computational fluid dynamics calculations. As the size and complexity of the simulations grow, so does the need for computational power and time. Many efforts have been made to implement stiff chemistry solvers on GPUs but have not been highly successful because of the logical divergence in traditional stiff solver algorithms. Because of these constrains, a novel Explicit Stabilized Variable-load (STEV) solver has been developed. Overstepping due to the relatively large time steps is prevented by introducing limits to the maximum changes of chemical species per time step. To prevent oscillations, a discrete Fourier transform is introduced to dampen ringing. In contrast to conventional explicit approaches, a variable-load approach is used where each cell in the computational domain is advanced with its unique time step. This approach allows cells to be integrated simultaneously while maintaining warp convergence but finish at different iterations and be removed from the workload. To improve the computational performance of the introduced solver, specific thermodynamic quantities of interest were estimated using shallow neural networks in place of polynomial fits, leading to an additional 10% savings in clock time with minimal training and implementation requirements. However ML specific hardware could increase the time savings to as much as 28%. While the complexity of these particular machine learning models is not high by modern standards, the impact on computational efficiency should not be ignored. The results show a dramatic decrease in total chemistry solution time (over 200 times) while maintaining a similar degree of accuracy.


title: Predictive Control for Chasing a Ground Vehicle using a UAV

abstract: We propose a high-level planner for a multirotor to chase a ground vehicle, while simultaneously respecting various state and input constraints. Assuming a minimal kinematic model for the ground vehicle, we use data collected online to generate predictions for our planner within a model predictive control framework. Our solution is demonstrated, both via simulations and experiments on a stable quadcopter platform.


title: Cognitive Model Priors for Predicting Human Decisions

abstract: Human decision-making underlies all economic behavior. For the past four decades, human decision-making under uncertainty has continued to be explained by theoretical models based on prospect theory, a framework that was awarded the Nobel Prize in Economic Sciences. However, theoretical models of this kind have developed slowly, and robust, high-precision predictive models of human decisions remain a challenge. While machine learning is a natural candidate for solving these problems, it is currently unclear to what extent it can improve predictions obtained by current theories. We argue that this is mainly due to data scarcity, since noisy human behavior requires massive sample sizes to be accurately captured by off-the-shelf machine learning methods. To solve this problem, what is needed are machine learning models with appropriate inductive biases for capturing human behavior, and larger datasets. We offer two contributions towards this end: first, we construct "cognitive model priors" by pretraining neural networks with synthetic data generated by cognitive models (i.e., theoretical models developed by cognitive psychologists). We find that fine-tuning these networks on small datasets of real human decisions results in unprecedented state-of-the-art improvements on two benchmark datasets. Second, we present the first large-scale dataset for human decision-making, containing over 240,000 human judgments across over 13,000 decision problems. This dataset reveals the circumstances where cognitive model priors are useful, and provides a new standard for benchmarking prediction of human decisions under uncertainty.


title: Enhanced Habitability on High Obliquity Bodies near the Outer Edge of the Habitable Zone of Sun-like Stars

abstract: High obliquity planets represent potentially extreme limits of terrestrial climate, as they exhibit large seasonality, a reversed annual-mean pole-to-equator gradient of stellar heating, and novel cryospheres. A suite of 3-D global climate model simulations with a dynamic ocean is performed with Earthlike atmospheres for low and high obliquity planets with various stellar fluxes, CO2 concentrations, and initial conditions to explore the propensity for high obliquity climates approaching the outer edge of the Habitable Zone to undergo global glaciation. We also simulate planets with thick CO2 or H2 atmospheres, such as those expected to develop near or beyond the outer edge of the Habitable Zone. We show that high obliquity planets are hotter than their low obliquity counterparts due to ice-albedo feedbacks for cold climates, and water vapor in warm climates. We suggest that the water vapor greenhouse trapping is greater on high obliquity bodies due to the different dynamical regimes that occur between the two states. While equatorial ice-belts are stable at high obliquity in some climate regimes, it is harder to achieve global glaciation than for a low obliquity planet. Temperate polar conditions can be present at high obliquity at forcings for which low obliquity planets would be in a hard snowball state. We suggest the conditions on high obliquity planets are likely to be more favorable for a robust biosphere to develop approaching the outer edge of the HZ. However, the influence of obliquity diminishes for dense atmospheres, in agreement with calculations from 1-D Energy Balance Models.


title: Holographic Heat Engines as Quantum Heat Engines

abstract: Certain solutions of Einstein's equations in anti-de Sitter spacetime can be engineered, using extended gravitational thermodynamics, to yield `holographic heat engines', devices that turn heat into useful mechanical work. On the other hand, there are constructions (both experimental and theoretical) where a series of operations is performed on a small quantum system, defining what are known as `quantum heat engines'. We propose that certain holographic heat engines can be considered models of quantum heat engines, and the possible fruitfulness of this connection is discussed. Motivated by features of quantum heat engines that take a quantum system through analogues of certain classic thermodynamic cycles, some black hole Otto and Diesel cycles are presented and explored for the first time. In the expected regime of overlap, our Otto efficiency formulae are of the form exhibited by quantum and classical heat engines.


title: AttentionRNN: A Structured Spatial Attention Mechanism

abstract: Visual attention mechanisms have proven to be integrally important constituent components of many modern deep neural architectures. They provide an efficient and effective way to utilize visual information selectively, which has shown to be especially valuable in multi-modal learning tasks. However, all prior attention frameworks lack the ability to explicitly model structural dependencies among attention variables, making it difficult to predict consistent attention masks. In this paper we develop a novel structured spatial attention mechanism which is end-to-end trainable and can be integrated with any feed-forward convolutional neural network. This proposed AttentionRNN layer explicitly enforces structure over the spatial attention variables by sequentially predicting attention values in the spatial mask in a bi-directional raster-scan and inverse raster-scan order. As a result, each attention value depends not only on local image or contextual information, but also on the previously predicted attention values. Our experiments show consistent quantitative and qualitative improvements on a variety of recognition tasks and datasets; including image categorization, question answering and image generation.


title: Optimum Low-Complexity Decoder for Spatial Modulation

abstract: In this paper, a novel low-complexity detection algorithm for spatial modulation (SM), referred to as the minimum-distance of maximum-length (m-M) algorithm, is proposed and analyzed. The proposed m-M algorithm is a smart searching method that is applied for the SM tree-search decoders. The behavior of the m-M algorithm is studied for three different scenarios: i) perfect channel state information at the receiver side (CSIR), ii) imperfect CSIR of a fixed channel estimation error variance, and iii) imperfect CSIR of a variable channel estimation error variance. Moreover, the complexity of the m-M algorithm is considered as a random variable, which is carefully analyzed for all scenarios, using probabilistic tools. Based on a combination of the sphere decoder (SD) and ordering concepts, the m-M algorithm guarantees to find the maximum-likelihood (ML) solution with a significant reduction in the decoding complexity compared to SM-ML and existing SM-SD algorithms; it can reduce the complexity up to 94% and 85% in the perfect CSIR and the worst scenario of imperfect CSIR, respectively, compared to the SM-ML decoder. Monte Carlo simulation results are provided to support our findings as well as the derived analytical complexity reduction expressions.


title: Detecting Events of Daily Living Using Multimodal Data

abstract: Events are fundamental for understanding how people experience their lives. It is challenging, however, to automatically record all events in daily life. An understanding of multimedia signals allows recognizing events of daily living and getting their attributes as automatically as possible. In this paper, we consider the problem of recognizing a daily event by employing the commonly used multimedia data obtained from a smartphone and wearable device. We develop an unobtrusive approach to obtain latent semantic information from the data, and therefore an approach for daily event recognition based on semantic context enrichment. We represent the enrichment process through an event knowledge graph that semantically enriches a daily event from a low-level daily activity. To show a concrete example of this enrichment, we perform an experiment with eating activity, which may be one of the most complex events, by using 14 months of data for three users. In this process, to unobtrusively complement the lack of semantic information, we suggest a new food recognition/classification method that focuses only on a physical response to food consumption. Experimental results indicate that our approach is able to show automatic abstraction of life experience. These daily events can then be used to create a personal model that can capture how a person reacts to different stimuli under specific conditions.


title: Applied hybrid binary mixed logit to investigate pedestrian crossing safety at midblock and unsignalized intersection

abstract: Pedestrian's crossing from unsignalized locations at intersections or midblock locations is a risky decision that could lead to fatal accidents. Despite making a decision to accept a safe gap to cross the street is a personal choice, studying this phenomena and its affecting variables are crucial for accident analysis and traffic safety investigations. In this paper we used video taped data to study pedestrian gap acceptance behavior at an unsignalized intersection and a midblock facility in Tehran, Iran. Multi way ANOVA test indicates simultaneous effect of gender and child accompaniment have the highest effect on size of accepted gap and waiting time. In addition, number of rejected gap is mostly affected by the child accompaniment status. Investigation about critical gap shows in general, critical gap was bigger at unsignalized intersection and for women. We defined a latent variable named caution behavior based on some observable indicators and using structural equation modeling it was estimated and used as an input in a binary mixed logit model. This variable identified important in gap acceptance decision. Despite both structural equation and logit models are used in previous gap acceptance studies, but according to our best knowledge this is the first use of the hybrid mixed logit modeling approach in this field and we developed a new methodology to combine psychological and behavioral aspects of pedestrians' gap acceptance studies. Modeling approach shows pedestrian decision regarding acceptance or rejection of a gap to be highly influenced by the size of current gap, caution behavior and waiting time.


title: Local Berry curvature signatures in dichroic angle-resolved photoelectron spectroscopy

abstract: Topologically nontrivial two-dimensional materials hold great promise for next-generation optoelectronic applications. However, measuring the Hall or spin-Hall response is often a challenge and practically limited to the ground state. An experimental technique for tracing the topological character in a differential fashion would provide useful insights. In this work, we show that circular dichroism angle-resolved photoelectron spectroscopy (ARPES) provides a powerful tool which can resolve the topological and quantum-geometrical character in momentum space. In particular, we investigate how to map out the signatures of the local Berry curvature by exploiting its intimate connection to the orbital angular momentum. A spin-resolved detection of the photoelectrons allows to extend the approach to spin-Chern insulators. Our predictions are corroborated by state-of-the art \emph{ab initio} simulations employing time-dependent density functional theory, complemented with model calculations. The present proposal can be extended to address topological properties in materials out of equilibrium in a time-resolved fashion.


title: Targeted Smooth Bayesian Causal Forests: An analysis of heterogeneous treatment effects for simultaneous versus interval medical abortion regimens over gestation

abstract: We introduce Targeted Smooth Bayesian Causal Forests (tsBCF), a nonparametric Bayesian approach for estimating heterogeneous treatment effects which vary smoothly over a single covariate in the observational data setting. The tsBCF method induces smoothness by parameterizing terminal tree nodes with smooth functions, and allows for separate regularization of treatment effects versus prognostic effect of control covariates. Smoothing parameters for prognostic and treatment effects can be chosen to reflect prior knowledge or tuned in a data-dependent way. We use tsBCF to analyze a new clinical protocol for early medical abortion. Our aim is to assess relative effectiveness of simultaneous versus interval administration of mifepristone and misoprostol over the first nine weeks of gestation. The model reflects our expectation that the relative effectiveness varies smoothly over gestation, but not necessarily over other covariates. We demonstrate the performance of the tsBCF method on benchmarking experiments. Software for tsBCF is available at https://github.com/jestarling/tsbcf/.


title: The nature of symmetry breaking in the superconducting ground state

abstract: The order parameters which are thought to detect U(1) gauge symmetry breaking in a superconductor are both non-local and gauge dependent. For that reason they are also ambiguous as a guide to phase structure. We point out that a global subgroup of the local U(1) gauge symmetry may be regarded, in analogy to non-abelian theories, as a "custodial" symmetry affecting the matter field alone, and construct, along the lines of our previous work, a new gauge-invariant criterion for breaking symmetries of this kind. It is shown that spontaneous breaking of custodial symmetry is a necessary condition for the existence of spontaneous symmetry breaking of a global subgroup of the (abelian or non-abelian) gauge group in any given gauge, and a sufficient condition for the existence of spontaneous breaking of a global subgroup of the gauge group in some gauge. As an illustration we compute numerically, in the lattice version of the Ginzburg-Landau model, the phase boundaries of the theory and the order parameters associated with various symmetries in each phase.


title: Discovery of an Exceptionally Strong $\beta$-Decay Transition of $^{20}$F and Implications for the Fate of Intermediate-Mass Stars

abstract: A significant fraction of stars between 7-11 solar masses are thought to become supernovae, but the explosion mechanism is unclear. The answer depends critically on the rate of electron capture on $^{20}$Ne in the degenerate oxygen-neon stellar core. However, due to the unknown strength of the transition between the ground states of $^{20}$Ne and $^{20}$F, it has not previously been possible to fully constrain the rate. By measuring the transition, we have established that its strength is exceptionally large and enhances the capture rate by several orders of magnitude. This has a decisive impact on the evolution of the core, increasing the likelihood that the star is (partially) disrupted by a thermonuclear explosion rather than collapsing to form a neutron star. Importantly, our measurement resolves the last remaining nuclear physics uncertainty in the final evolution of degenerate oxygen-neon stellar cores, allowing future studies to address the critical role of convection, which at present is poorly understood.


title: Distributed quantum sensing in a continuous variable entangled network

abstract: Networking plays a ubiquitous role in quantum technology. It is an integral part of quantum communication and has significant potential for upscaling quantum computer technologies that are otherwise not scalable. Recently, it was realized that sensing of multiple spatially distributed parameters may also benefit from an entangled quantum network. Here we experimentally demonstrate how sensing of an averaged phase shift among four distributed nodes benefits from an entangled quantum network. Using a four-mode entangled continuous variable (CV) state, we demonstrate deterministic quantum phase sensing with a precision beyond what is attainable with separable probes. The techniques behind this result can have direct applications in a number of primitives ranging from biological imaging to quantum networks of atomic clocks.


title: Postponing the dynamical transition density using competing interactions

abstract: Systems of dense spheres interacting through very short-ranged attraction are known from theory, simulations and colloidal experiments to exhibit dynamical reentrance. The liquid state can thus be fluidized to higher densities than otherwise possible with interactions that are purely repulsive or long-ranged attractive. A recent mean-field, infinite-dimensional calculation predicts that the dynamical arrest of the fluid can be further delayed by adding a longer-ranged repulsive contribution to the short-ranged attraction. We examine this proposal by performing extensive numerical simulations in a three-dimensional system. We first find the short-ranged attraction parameters necessary to achieve the densest liquid state, and then explore the parameters space for an additional longer-ranged repulsion that could enhance the effect. In the family of systems studied, no significant (within numerical accuracy) delay of the dynamical arrest is observed beyond what is already achieved by the short-ranged attraction. Possible explanations are discussed.


title: Quenched tail estimate for the random walk in random scenery and in random layered conductance II

abstract: This is a continuation of our earlier work [Stochastic Processes and their Applications, 129(1), pp.102--128, 2019] on the random walk in random scenery and in random layered conductance. We complete the picture of upper deviation of the random walk in random scenery, and also prove a bound on lower deviation probability. Based on these results, we determine asymptotics of the return probability, a certain moderate deviation probability, and the Green function of the random walk in random layered conductance.


title: Upward-closed hereditary families in the dominance order

abstract: The majorization relation orders the degree sequences of simple graphs into posets called dominance orders. As shown by Ruch and Gutman (1979) and Merris (2002), the degree sequences of threshold and split graphs form upward-closed sets within the dominance orders they belong to, i.e., any degree sequence majorizing a split or threshold sequence must itself be split or threshold, respectively. Motivated by the fact that threshold graphs and split graphs have characterizations in terms of forbidden induced subgraphs, we define a class $\mathcal{F}$ of graphs to be dominance monotone if whenever no realization of $e$ contains an element $\mathcal{F}$ as an induced subgraph, and $d$ majorizes $e$, then no realization of $d$ induces an element of $\mathcal{F}$. We present conditions necessary for a set of graphs to be dominance monotone, and we identify the dominance monotone sets of order at most 3.


title: Charged Higgs bosons in the NMSSM under current LHC constraints

abstract: Charged Higgs boson is a crucial prediction of new physics beyond the SM. In this work, we perform a comprehensive scan over the parameter space of NMSSM considering various experimental constraints including the direct search limits from the 13 TeV LHC, and consider the scenario that the next-to-lightest CP-even Higgs boson is SM-like. We find that the masses of charged Higgs bosons can be as light as 350 GeV, the lightest CP-even Higgs boson $h_1$ is predominantly singlet and can be as light as 48 GeV, and the lightest CP-odd Higgs boson $a_1$ is also singlet-dominated and can be as light as 82 GeV. The charged Higgs bosons mainly decay to $t\bar{b}$ or $\bar{t} b$, but the branching ratio of the exotic decays $H^\pm\to W^\pm h_1$ and $H^\pm\to W^\pm a_1$ can maximally reach to 20\% and 11\%, respectively, which can be used to distinguish the NMSSM from MSSM. Such a heavy charged Higgs boson is unaccessible at the 13 TeV LHC with a luminosity of 36.1 $\rm fb^{-1}$ and its detection needs higher energy and/or higher luminosity.


title: The principle of information symmetry constrains the state-space in any physical theory

abstract: Symmetry shares an entwined history with the structure of physical theory. We propose a consequence of symmetry towards the axiomatic derivation of Hilbert space quantum theory. We introduce the notion of information symmetry (IS) and show that it constraints the state-space structure in any physical theory. To this end, we study the minimal error binary state discrimination problem in the framework of generalized probabilistic theories. A theory is said to satisfy IS if the probability of incorrectly identifying each of two randomly prepared states is same for both the states. It is found that this simple principle rules out several classes of theories while being perfectly compatible with quantum theory.


title: Quantifying Long Range Dependence in Language and User Behavior to improve RNNs

abstract: Characterizing temporal dependence patterns is a critical step in understanding the statistical properties of sequential data. Long Range Dependence (LRD) --- referring to long-range correlations decaying as a power law rather than exponentially w.r.t. distance --- demands a different set of tools for modeling the underlying dynamics of the sequential data. While it has been widely conjectured that LRD is present in language modeling and sequential recommendation, the amount of LRD in the corresponding sequential datasets has not yet been quantified in a scalable and model-independent manner. We propose a principled estimation procedure of LRD in sequential datasets based on established LRD theory for real-valued time series and apply it to sequences of symbols with million-item-scale dictionaries. In our measurements, the procedure estimates reliably the LRD in the behavior of users as they write Wikipedia articles and as they interact with YouTube. We further show that measuring LRD better informs modeling decisions in particular for RNNs whose ability to capture LRD is still an active area of research. The quantitative measure informs new Evolutive Recurrent Neural Networks (EvolutiveRNNs) designs, leading to state-of-the-art results on language understanding and sequential recommendation tasks at a fraction of the computational cost.


title: Dynamical mass generation in QED$_3$: A non-perturbative approach

abstract: In this work, we provide a non-perturbative description of the phenomenon of dynamical mass generation in the case of quantum electrodynamics in $2+1$ dimensions. We will use the Kugo-Ojima-Nakanishi formalism to conclude that the physical Hilbert space of the asymptotic photon field is the same as that of the Maxwell-Chern-Simons.


title: Optimal crosstalk suppression in multicore fibers

abstract: We study propagation in a cyclic symmetric multicore fiber where the core radii randomly fluctuate along the propagation direction. We propose a hybrid analytic-numerical method to optimize the amplitude and frequency of the fluctuations that suppress power transfer between outer and inner cores. Our predictions are confirmed by numerical experiments using finite difference beam propagation methods for realistic C-band fibers.


title: A Pseudodisk Threaded with a Toroidal and Pinched Poloidal Magnetic Field Morphology in the HH 211 Protostellar System

abstract: The HH 211 protostellar system is currently the youngest Class 0 system found with a rotating disk. We have mapped it at ~ 50 au (0.16") resolution, studying its magnetic field morphology with dust polarization in continuum at 232 and 358 GHz and its kinematics in C18O J=2-1 line. A flattened envelope extending out to ~ 400 au from the disk is detected in the continuum and C18O, slightly misaligned with the disk by 8 degree. It is spiraling inwards and expected to transform into a rotating disk at ~ 20 au, consistent with the disk radius estimated before. It appears to have a constant specific angular momentum and itself can result from an inside-out collapse of an extended envelope detected before in NH$_3$. In the flattened envelope, the polarization is mainly due to the magnetically aligned dust grains, inferring a highly pinched poloidal field morphology there. Thus, both the kinematics and field morphology support that the flattened envelope is a pseudodisk formed as the infalling gas is guided by the field lines to the equatorial plane. Interestingly, a point symmetric polarization distribution is also seen in the flattened envelope, implying that the pinched field lines also have a significant toroidal component generated by the rotation. No significant loss of angular momentum and thus no clear magnetic braking are detected in the flattened envelope around the disk probably because of the large misalignment between the axis of the rotation and the axis of the magnetic field in the cloud core.


title: Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned

abstract: Multi-head self-attention is a key component of the Transformer, a state-of-the-art architecture for neural machine translation. In this work we evaluate the contribution made by individual attention heads in the encoder to the overall performance of the model and analyze the roles played by them. We find that the most important and confident heads play consistent and often linguistically-interpretable roles. When pruning heads using a method based on stochastic gates and a differentiable relaxation of the L0 penalty, we observe that specialized heads are last to be pruned. Our novel pruning method removes the vast majority of heads without seriously affecting performance. For example, on the English-Russian WMT dataset, pruning 38 out of 48 encoder heads results in a drop of only 0.15 BLEU.


title: Effect of shapes of activation functions on predictability in the echo state network

abstract: We investigate prediction accuracy for time series of Echo state networks with respect to several kinds of activation functions. As a result, we found that some kinds of activation functions with an appropriate nonlinearity show high performance compared to the conventional sigmoid function.


title: Elliptical Perturbations for Differential Privacy

abstract: We study elliptical distributions in locally convex vector spaces, and determine conditions when they can or cannot be used to satisfy differential privacy (DP). A requisite condition for a sanitized statistical summary to satisfy DP is that the corresponding privacy mechanism must induce equivalent measures for all possible input databases. We show that elliptical distributions with the same dispersion operator, $C$, are equivalent if the difference of their means lies in the Cameron-Martin space of $C$. In the case of releasing finite-dimensional projections using elliptical perturbations, we show that the privacy parameter $\ep$ can be computed in terms of a one-dimensional maximization problem. We apply this result to consider multivariate Laplace, $t$, Gaussian, and $K$-norm noise. Surprisingly, we show that the multivariate Laplace noise does not achieve $\ep$-DP in any dimension greater than one. Finally, we show that when the dimension of the space is infinite, no elliptical distribution can be used to give $\ep$-DP; only $(\epsilon,\delta)$-DP is possible.


title: The Maxwell group in 2+1 dimensions and its infinite-dimensional enhancements

abstract: The Maxwell group in 2+1 dimensions is given by a particular extension of a semi-direct product. This mathematical structure provides a sound framework to study different generalizations of the Maxwell symmetry in three space-time dimensions. By giving a general definition of extended semi-direct products, we construct infinite-dimensional enhancements of the Maxwell group that enlarge the ${\rm ISL}(2,\mathbb{R})$ Kac-Moody group and the ${\rm BMS}_3$ group by including non-commutative supertranslations. The coadjoint representation in each case is defined, and the corresponding geometric actions on coadjoint orbits are presented. These actions lead to novel Wess-Zumino terms that naturally realize the aforementioned infinite-dimensional symmetries. We briefly elaborate on potential applications in the contexts of three-dimensional gravity, higher-spin symmetries, and quantum Hall systems.


title: Normalized solutions and mass concentration for supercritical nonlinear Schr\"{o}dinger equations

abstract: In this paper, we deal with the existence and concentration of normalized solutions to the supercritical nonlinear Schr\"{o}dinger equation \begin{equation*} \left\{ \begin{array}{l} -\Delta u + V(x) u = \mu_q u + a|u|^q u \quad {\rm in}\quad \mathbb{R}^2,\\ \int_{\mathbb{R}^2}|u|^2\,dx =1,\\ \end{array} \right. \end{equation*} where $\mu_q$ is the Lagrange multiplier. We show that for $q>2$ close to $2$, the equation admits two solutions: one is the local minimal solution $u_q$ and another one is the mountain pass solution $v_q$. Furthermore, we study the limiting behavior of $u_q$ and $v_q$ when $q\to 2_+$. Particularly, we describe precisely the blow-up formation of the excited state $v_q$.


title: Set Constraints, Pattern Match Analysis, and SMT

abstract: Set constraints provide a highly general way to formulate program analyses. However, solving arbitrary boolean combinations of set constraints is NEXPTIME-hard. Moreover, while theoretical algorithms to solve arbitrary set constraints exist, they are either too complex to realistically implement or too slow to ever run. We present a translation that converts a set constraint formula into an SMT problem. Our technique allows for arbitrary boolean combinations of set constraints, and leverages the performance of modern SMT solvers. To show the usefulness of unrestricted set constraints, we use them to devise a pattern match analysis for functional languages, which ensures that missing cases of pattern matches are always unreachable. We implement our analysis in the Elm compiler and show that our translation is fast enough to be used in practical verification.


title: Resistance distance-based graph invariants and the number of spanning trees of linear crossed octagonal graphs

abstract: Resistance distance is a novel distance function, also a new intrinsic graph metric, which makes some extensions of ordinary distance. Let On be a linear crossed octagonal graph. Recently, Pan and Li (2018) derived the closed formulas for the Kirchhoff index, multiplicative degree-Kirchhoff index and the number of spanning trees of Hn. They pointed that it is interesting to give the explicit formulas for the Kirchhoff and multiplicative degree-Kirchhoff indices of On. Inspired by these, in this paper, two resistance distance-based graph invariants, namely, Kirchhoff and multiplicative degree-Kirchhoff indices are studied. We firstly determine formulas for the Laplacian (normalized Laplacian, resp.) spectrum of On. Further, the formulas for those two resistance distance-based graph invariants and spanning trees are given. More surprising, we find that the Kirchhoff (multiplicative degree-Kirchhoff, resp.) index is almost one quarter to Wiener (Gutman, resp.) index of a linear crossed octagonal graph.


title: Interface ferromagnetism and anomalous Hall effect of CdO/ferromagnetic insulator heterostructures

abstract: The experimental observation of quantum anomalous Hall effect (QAHE) in magnetic topological insulators has stimulated enormous interest in condensed-matter physics and materials science. For the purpose of realizing high-temperature QAHE, several material candidates have been proposed, among which the interface states in the CdO/ferromagnetic insulator heterostructures are particularly interesting and favorable for technological applications. Here, we report the experimental observation of the interfacial ferromagnetism and anomalous Hall effect in the Fe3O4/CdO/Fe3O4 heterostructures grown via oxide molecular-beam epitaxy. Systematical variation of the CdO thickness reveals the interface ferromagnetism as the major cause for the observed planar magnetoresistance and anomalous Hall effect. Our results might pave the way to engineer oxide interface states for the exploration of QAHE towards exotic quantum-physical phenomena and potential applications.


title: Matrix scaling and explicit doubly stochastic limits

abstract: The process of alternately row scaling and column scaling a positive $n \times n$ matrix $A$ converges to a doubly stochastic positive $n \times n$ matrix $S(A)$, often called the \emph{Sinkhorn limit} of $A$. The main result in this paper is the computation of exact formulae for the Sinkhorn limits of certain symmetric positive $3\times 3$ matrices.


title: Bounding the State Covariance Matrix for a Randomly Switching Linear System with Noise

abstract: The propagation of a state vector is governed by a set of time-invariant state transition matrices that switch arbitrarily between two values. The evolution of the state is also perturbed by white Gaussian noise with a variance that switches randomly with the state transition relation. The behavior of this system can be characterized by the covariance matrix of the state vector, which is time varying. However, we can bound the set of covariances by comparing the switching system to an augmented system derived with Kronecker algebra. We formulate a matrix optimization problem to compute an ellipsoid that bounds the covariance dynamics, which in turn bounds the state covariance of the set of switching systems subject to white noise. In developing this approach, an invariant ellipsoid for a linear switching affine system is computed along the way.


title: On supercritical nonlinear Schr\"{o}dinger equations with ellipse-shaped potentials

abstract: In this paper, we study the existence and concentration of normalized solutions to the supercritical nonlinear Schr\"{o}dinger equation \begin{equation*} \left\{ \begin{array}{l} -\Delta u + V(x) u = \mu_q u + a|u|^q u \quad {\rm in}\quad \mathbb{R}^2,\\ \int_{\mathbb{R}^2}|u|^2\,dx =1,\\ \end{array} \right. \end{equation*} where $\mu_q$ is the Lagrange multiplier. For ellipse-shaped potentials $V(x)$, we show that for $q>2$ close to $2$, the equation admits an excited solution $u_q$, and furthermore, we study the limiting behavior of $u_q$ when $q\to 2_+$. Particularly, we describe precisely the blow-up formation of the excited state $u_q$.


title: Generic planar algebraic vector fields are disintegrated

abstract: In this article, we study model-theoretic properties of algebraic differential equations of order $2$, defined over constant differential fields. In particular, we show that the set of solutions of a general differential equation of order $2$ and of degree $d \geq 3$ in a differentially closed field is strongly minimal and disintegrated. We also give two other formulations of this result in terms of algebraic (non)-integrability and algebraic independence of the analytic solutions of a general planar algebraic vector field.


title: Hopf algebras of planar binary trees: an operated algebra approach

abstract: Parallel to operated algebras built on top of planar rooted trees via the grafting operator $B^+$, we introduce and study $\vee$-algebras and more generally $\vee_\Omega$-algebras based on planar binary trees. Involving an analogy of the Hochschild 1-cocycle condition, cocycle $\vee_\Omega$-bialgebras (resp.~$\vee_\Omega$-Hopf algebras) are also introduced and their free objects are constructed via decorated planar binary trees. As a special case, the well-known Loday-Ronco Hopf algebra $H_{LR}$ is a free cocycle $\vee$-Hopf algebra. By means of admissible cuts, a combinatorial description of the coproduct $\Delta_{LR(\Omega)}$ on decorated planar binary trees is given, as in the Connes-Kreimer Hopf algebra by admissible cuts.


title: Fast detection of giant permutation groups

abstract: We give a 1-sided randomised algorithm to detect when a permutation group of degree n, given by generators, contains the alternating group of degree n. This improves on standard methods, and on an algorithm of P. Cameron and J. Cannon.


title: Learning Discrete and Continuous Factors of Data via Alternating Disentanglement

abstract: We address the problem of unsupervised disentanglement of discrete and continuous explanatory factors of data. We first show a simple procedure for minimizing the total correlation of the continuous latent variables without having to use a discriminator network or perform importance sampling, via cascading the information flow in the $\beta$-vae framework. Furthermore, we propose a method which avoids offloading the entire burden of jointly modeling the continuous and discrete factors to the variational encoder by employing a separate discrete inference procedure. This leads to an interesting alternating minimization problem which switches between finding the most likely discrete configuration given the continuous factors and updating the variational encoder based on the computed discrete factors. Experiments show that the proposed method clearly disentangles discrete factors and significantly outperforms current disentanglement methods based on the disentanglement score and inference network classification score. The source code is available at https://github.com/snu-mllab/DisentanglementICML19.


title: FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Prediction

abstract: Advertising and feed ranking are essential to many Internet companies such as Facebook and Sina Weibo. Among many real-world advertising and feed ranking systems, click through rate (CTR) prediction plays a central role. There are many proposed models in this field such as logistic regression, tree based models, factorization machine based models and deep learning based CTR models. However, many current works calculate the feature interactions in a simple way such as Hadamard product and inner product and they care less about the importance of features. In this paper, a new model named FiBiNET as an abbreviation for Feature Importance and Bilinear feature Interaction NETwork is proposed to dynamically learn the feature importance and fine-grained feature interactions. On the one hand, the FiBiNET can dynamically learn the importance of features via the Squeeze-Excitation network (SENET) mechanism; on the other hand, it is able to effectively learn the feature interactions via bilinear function. We conduct extensive experiments on two real-world datasets and show that our shallow model outperforms other shallow models such as factorization machine(FM) and field-aware factorization machine(FFM). In order to improve performance further, we combine a classical deep neural network(DNN) component with the shallow model to be a deep model. The deep FiBiNET consistently outperforms the other state-of-the-art deep models such as DeepFM and extreme deep factorization machine(XdeepFM).


title: Automated Process Planning for Turning: A Feature-Free Approach

abstract: Turning is the most commonly available and least expensive machining operation, in terms of both machine-hour rates and tool insert prices. A practical CNC process planner has to maximize the utilization of turning, not only to attain precision requirements for turnable surfaces, but also to minimize the machining cost, while non-turnable features can be left for other processes such as milling. Most existing methods rely on separation of surface features and lack guarantees when analyzing complex parts with interacting features. In a previous study, we demonstrated successful implementation of a feature-free milling process planner based on configuration space methods used for spatial reasoning and AI search for planning. This paper extends the feature-free method to include turning process planning. It opens up the opportunity for seamless integration of turning actions into a mill-turn process planner that can handle arbitrarily complex shapes with or without a priori knowledge of feature semantics.


title: MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling

abstract: This paper studies the problem of error-runtime trade-off, typically encountered in decentralized training based on stochastic gradient descent (SGD) using a given network. While a denser (sparser) network topology results in faster (slower) error convergence in terms of iterations, it incurs more (less) communication time/delay per iteration. In this paper, we propose MATCHA, an algorithm that can achieve a win-win in this error-runtime trade-off for any arbitrary network topology. The main idea of MATCHA is to parallelize inter-node communication by decomposing the topology into matchings. To preserve fast error convergence speed, it identifies and communicates more frequently over critical links, and saves communication time by using other links less frequently. Experiments on a suite of datasets and deep neural networks validate the theoretical analyses and demonstrate that MATCHA takes up to $5\times$ less time than vanilla decentralized SGD to reach the same training loss.


title: KNG: The K-Norm Gradient Mechanism

abstract: This paper presents a new mechanism for producing sanitized statistical summaries that achieve \emph{differential privacy}, called the \emph{K-Norm Gradient} Mechanism, or KNG. This new approach maintains the strong flexibility of the exponential mechanism, while achieving the powerful utility performance of objective perturbation. KNG starts with an inherent objective function (often an empirical risk), and promotes summaries that are close to minimizing the objective by weighting according to how far the gradient of the objective function is from zero. Working with the gradient instead of the original objective function allows for additional flexibility as one can penalize using different norms. We show that, unlike the exponential mechanism, the noise added by KNG is asymptotically negligible compared to the statistical error for many problems. In addition to theoretical guarantees on privacy and utility, we confirm the utility of KNG empirically in the settings of linear and quantile regression through simulations.


title: Characterization of an underwater channel for quantum communications in the Ottawa River

abstract: We examine the propagation of optical beams possessing different polarization states and spatial modes through the Ottawa River in Canada. A Shack-Hartmann wavefront sensor is used to record the distorted beam's wavefront. The turbulence in the underwater channel is analysed, and associated Zernike coefficients are obtained in real-time. Finally, we explore the feasibility of transmitting polarization states as well as spatial modes through the underwater channel for applications in quantum cryptography.