title: Anisotropic Strain Induced Soliton Movement Changes Stacking Order and Bandstructure of Graphene Multilayers

abstract: The crystal structure of solid-state matter greatly affects its electronic properties. For example in multilayer graphene, precise knowledge of the lateral layer arrangement is crucial, since the most stable configurations, Bernal and rhombohedral stacking, exhibit very different electronic properties. Nevertheless, both stacking orders can coexist within one flake, separated by a strain soliton that can host topologically protected states. Clearly, accessing the transport properties of the two stackings and the soliton is of high interest. However, the stacking orders can transform into one another and therefore, the seemingly trivial question how reliable electrical contact can be made to either stacking order can a priori not be answered easily. Here, we show that manufacturing metal contacts to multilayer graphene can move solitons by several $\mu$m, unidirectionally enlarging Bernal domains due to arising mechanical strain. Furthermore, we also find that during dry transfer of multilayer graphene onto hexagonal Boron Nitride, such a transformation can happen. Using density functional theory modeling, we corroborate that anisotropic deformations of the multilayer graphene lattice decrease the rhombohedral stacking stability. Finally, we have devised systematics to avoid soliton movement, and how to reliably realize contacts to both stacking configurations.


title: Differentially Private Contextual Linear Bandits

abstract: We study the contextual linear bandit problem, a version of the standard stochastic multi-armed bandit (MAB) problem where a learner sequentially selects actions to maximize a reward which depends also on a user provided per-round context. Though the context is chosen arbitrarily or adversarially, the reward is assumed to be a stochastic function of a feature vector that encodes the context and selected action. Our goal is to devise private learners for the contextual linear bandit problem. We first show that using the standard definition of differential privacy results in linear regret. So instead, we adopt the notion of joint differential privacy, where we assume that the action chosen on day $t$ is only revealed to user $t$ and thus needn't be kept private that day, only on following days. We give a general scheme converting the classic linear-UCB algorithm into a joint differentially private algorithm using the tree-based algorithm. We then apply either Gaussian noise or Wishart noise to achieve joint-differentially private algorithms and bound the resulting algorithms' regrets. In addition, we give the first lower bound on the additional regret any private algorithms for the MAB problem must incur.


title: Adversarial Attacks and Defences: A Survey

abstract: Deep learning has emerged as a strong and efficient framework that can be applied to a broad spectrum of complex learning problems which were difficult to solve using the traditional machine learning techniques in the past. In the last few years, deep learning has advanced radically in such a way that it can surpass human-level performance on a number of tasks. As a consequence, deep learning is being extensively used in most of the recent day-to-day applications. However, security of deep learning systems are vulnerable to crafted adversarial examples, which may be imperceptible to the human eye, but can lead the model to misclassify the output. In recent times, different types of adversaries based on their threat model leverage these vulnerabilities to compromise a deep learning system where adversaries have high incentives. Hence, it is extremely important to provide robustness to deep learning algorithms against these adversaries. However, there are only a few strong countermeasures which can be used in all types of attack scenarios to design a robust deep learning system. In this paper, we attempt to provide a detailed discussion on different types of adversarial attacks with various threat models and also elaborate the efficiency and challenges of recent countermeasures against them.


title: Quantum Spin Hall Effect and Spin Bott Index in a Quasicrystal Lattice

abstract: Despite the rapid progresses in the field of quantum spin Hall (QSH) effect, most of the QSH systems studied up to now are based on crystalline materials. Here we propose that the QSH effect can be realized in quasicrystal lattices (QLs). We show that the electronic topology of aperiodic and amorphous insulators can be characterized by a spin Bott index $B_s$. The nontrivial QSH state in a QL is identified by a nonzero spin Bott index $B_s=1$, associated with robust edge states and quantized conductance. We also map out a topological phase diagram in which the QSH state lies in between a normal insulator and a weak metal phase due to the unique wavefunctions of QLs. Our findings not only provide a better understanding of electronic properties of quasicrystals but also extend the search of QSH phase to aperiodic and amorphous materials that are experimentally feasible.


title: PLL and Costas loop based carrier recovery circuits for 4QAM: non-linear analysis and simulation

abstract: Design of stable carrier recovery circuits are used in many applications: wireless digital communication, optical communication, microwave devices and other applications. Quadrature Phase-Shift Keying (QPSK, 4-QAM) is used as modulation technique in many of these applications, since QPSK provides double the data rate of classic Binary PSK (BPSK) modulation. Analysis of Costas loop is a hard task because of its non-linearity. In this work we consider two well-known modifications of 4QAM Costas loop circuits and discuss a new circuit proposed by J. Ladvanszky. MATLAB Simulink models of the circuits are provided and the noise analysis is performed.


title: Deep Residual Network for Off-Resonance Artifact Correction with Application to Pediatric Body Magnetic Resonance Angiography with 3D Cones

abstract: Purpose: Off-resonance artifact correction by deep-learning, to facilitate rapid pediatric body imaging with a scan time efficient 3D cones trajectory. Methods: A residual convolutional neural network to correct off-resonance artifacts (Off-ResNet) was trained with a prospective study of 30 pediatric magnetic resonance angiography exams. Each exam acquired a short-readout scan (1.18 ms +- 0.38) and a long-readout scan (3.35 ms +- 0.74) at 3T. Short-readout scans, with longer scan times but negligible off-resonance blurring, were used as reference images and augmented with additional off-resonance for supervised training examples. Long-readout scans, with greater off-resonance artifacts but shorter scan time, were corrected by autofocus and Off-ResNet and compared to short-readout scans by normalized root-mean-square error (NRMSE), structural similarity index (SSIM), and peak signal-to-noise ratio (PSNR). Scans were also compared by scoring on eight anatomical features by two radiologists, using analysis of variance with post-hoc Tukey's test. Reader agreement was determined with intraclass correlation. Results: Long-readout scans were on average 59.3% shorter than short-readout scans. Images from Off-ResNet had superior NRMSE, SSIM, and PSNR compared to uncorrected images across +-1kHz off-resonance (P<0.01). The proposed method had superior NRMSE over -677Hz to +1kHz and superior SSIM and PSNR over +-1kHz compared to autofocus (P<0.01). Radiologic scoring demonstrated that long-readout scans corrected with Off-ResNet were non-inferior to short-readout scans (P<0.01). Conclusion: The proposed method can correct off-resonance artifacts from rapid long-readout 3D cones scans to a non-inferior image quality compared to diagnostically standard short-readout scans.


title: Resonance absorption of a broadband laser pulse

abstract: Broad bandwidth, infrared light sources have the potential to revolutionize inertial confinement fusion (ICF) by suppressing laser-plasma instabilities. There is, however, a tradeoff: The broad bandwidth precludes high efficiency conversion to the ultraviolet, where laser-plasma interactions are weaker. Operation in the infrared could intensify the role of resonance absorption, an effect long suspected to be the shortcoming of early ICF experiments. Here we present simulations exploring the effect of bandwidth on resonance absorption. In the linear regime, bandwidth has little effect on resonance absorption; in the nonlinear regime, bandwidth suppresses enhanced absorption resulting from the electromagnetic decay instability. These findings evince that regardless of bandwidth, an ICF implosion will confront at least linear levels of resonance absorption.


title: Hoffmann-Ostenhof's conjecture for claw-free cubic graphs

abstract: Hoffmann-Ostenhof's Conjecture states that states that the edge set of every connected cubic graph can be decomposed into a spanning tree, a matching and a $2$-regular subgraph. In this paper, we show that the conjecture holds for claw-free cubic graphs.


title: Towards the Minimal Spectrum of Excited Baryons

abstract: In the light baryon sector resonances can be broad and overlapping and are in most cases not directly visible in the cross section data. Automatized model selection techniques that introduce penalties for resonances can be used to determine the minimally needed set of resonances to describe the data. Several possible penalization schemes are compared. As an application we perform a blindfold identification of hyperon resonances in the $\bar{K} N \to K \Xi$ reaction based on the Least Absolute Shrinkage and Selection Operator (LASSO) in combination with the Bayesian Information Criterion (BIC). We find ten resonances --- out of the 21 above-threshold hyperon resonances with spin $J\le 7/2$ listed by the Particle Data Group. In traditional analyses, it is practically impossible to test the relevance of all resonances and their combinations that may potentially contribute to the reaction. By contrast, the present method proves capable of determining the relevant resonances among a large pool of candidates.


title: A new goodness-of-fit statistic and its application to 21-cm cosmology

abstract: The reduced chi-squared statistic is a commonly used goodness-of-fit measure, but it cannot easily detect features near the noise level, even when a large amount of data is available. In this paper, we introduce a new goodness-of-fit measure that we name the reduced psi-squared statistic. It probes the two-point correlations in the residuals of a fit, whereas chi-squared accounts for only the absolute values of each residual point, not considering the relationship between these points. The new statistic maintains sensitivity to individual outliers, but is superior to chi-squared in detecting wide, low level features in the presence of a large number of noisy data points. After presenting this new statistic, we show an instance of its use in the context of analyzing radio spectroscopic data for 21-cm cosmology experiments. We perform fits to simulated data with four components: foreground emission, the global 21-cm signal, an idealized instrument systematic, and noise. This example is particularly timely given the ongoing efforts to confirm the first observational result for this signal, where this work found its original motivation. In addition, we release a Python script dubbed $\texttt{psipy}$ which allows for quick, efficient calculation of the reduced psi-squared statistic on arbitrary data arrays, to be applied in any field of study.


title: Millimeter Wave Beam Training: A Survey

abstract: The initial access is required to establish a connection between millimeter wave access point (AP) and users. The large isotropic pathloss at high frequencies can be mitigated by the use of highly directional antennas. However, it complicated the initial access procedures and increased the latency, defying one of the major low latency objective of 5G systems. Beam training algorithms are developed for the AP as well as for the users to find the desired beam quickly and reduce the initial access delay. But, these beam training protocols have to be run very frequently due to outage events, user's mobility and period of sleep cycles.


title: Equivariant K-theory and refined Vafa-Witten invariants

abstract: In [MT2] the Vafa-Witten theory of complex projective surfaces is lifted to oriented $\mathbb C^*$-equivariant cohomology theories. Here we study the K-theoretic refinement. It gives rational functions in $t^{1/2}$ invariant under $t^{1/2}\leftrightarrow t^{-1/2}$ which specialise to numerical Vafa-Witten invariants at $t=1$. On the "instanton branch" the invariants give the virtual $\chi_{-t}^{}$-genus refinement of G\"ottsche-Kool. Applying modularity to their calculations gives predictions for the contribution of the "monopole branch". We calculate some cases and find perfect agreement. We also do calculations on K3 surfaces, finding Jacobi forms refining the usual modular forms, proving a conjecture of G\"ottsche-Kool. We determine the K-theoretic virtual classes of degeneracy loci using Eagon-Northcott complexes, and show they calculate refined Vafa-Witten invariants. Using this Laarakker [Laa] proves universality results for the invariants.


title: A K-theoretic Fulton class

abstract: Fulton defined classes in the Chow group of a quasi-projective scheme $M$ which reduce to its Chern classes when $M$ is smooth. When $M$ has a perfect obstruction theory, Siebert gave a formula for its virtual cycle in terms of its total Fulton class. We describe K-theory classes on $M$ which reduce to the exterior algebra of differential forms when $M$ is smooth. When $M$ has a perfect obstruction theory, we give a formula for its K-theoretic virtual structure sheaf in terms of these classes.


title: Differential geometry of invariant surfaces in simply isotropic and pseudo-isotropic spaces

abstract: We study invariant surfaces generated by one-parameter subgroups of simply and pseudo isotropic rigid motions. Basically, the simply and pseudo isotropic geometries are the study of a three-dimensional space equipped with a rank 2 metric of index zero and one, respectively. We show that the one-parameter subgroups of isotropic rigid motions lead to seven types of invariant surfaces, which then generalizes the study of revolution and helicoidal surfaces in Euclidean and Lorentzian spaces to the context of singular metrics. After computing the two fundamental forms of these surfaces and their Gaussian and mean curvatures, we solve the corresponding problem of prescribed curvature for invariant surfaces whose generating curves lie on a plane containing the degenerated direction.


title: Theory of spin Bott index for quantum spin Hall states in non-periodic systems

abstract: This is a joint publication with the Letter by H. Huang and F. Liu [Phys. Rev. Lett. 121, 126401 (2018)]. In this work, we propose the spin Bott index to identify the quantum spin Hall (QSH) state in both crystalline and non-periodic systems. The applicability of the spin Bott index is confirmed by analyzing the periodic and disorder Kane-Mele models. As an example of non-periodic systems, we systematically investigate the QSH effect in a Penrose-type quasicrystal lattice (QL). We characterized the nontrivial electronic topology of the QL by directly calculating the spin Bott index. In addition, the topological edge states, the localization of wavefunctions and quantized transport signatures are also studied in detail.


title: Novel insights on swelling and dehydration of Laponite RD

abstract: This paper investigates water sorption and dehydration of a model synthetic clay (Laponite) and highlights the large differences with natural clays (montmorillonite, hectorite) belonging to smectite family of structure and composition. Measurements were done by combining for the first time thermogravimetric analysis and X Ray diffraction methods on Laponite powders stored in atmospheres with controlled relative humidity. Laponite exhibits a very good reproducibility of sorption diagram and appears as the most hygroscopic among smectites. The interlayer space increases from 11 to 20 Angstrom when r = n H2O /n Na increases from 2 to 22 in agreement with recent numeric simulations by Morrow et al. We show that the desorption process, for 2 < r < 22, in isothermal conditions follow a first order kinetic identifying two regimes around r* = 7 which is close to the coordination number of Na in concentrated NaCl solution. Activation energies and frequency factors are derived for the two regimes of water desorption and discussed in relation with stability of the cationic complex.


title: Pickering emulsions with alpha-cyclodextrin inclusions: Structure and thermal stability

abstract: This paper explores structural, interfacial and thermal properties of two types of Pickering emulsions containing alpha-cyclodextrin inclusion complexes: on one hand, emulsions were obtained between aqueous solutions of alpha-cyclodextrin and different oils (fatty acids, olive oil, silicone oil) and on the other hand, emulsions were obtained between these oils, water and micro or nano-platelet suspensions with inclusion complexes of hydrophobically-modified polysaccharides. The emulsions exhibit versatile properties according to the molecular architecture of the oils. Experiments were performed by microcalorimetry, X-ray diffraction and confocal microscopy. The aptitude of oil molecules to be threaded in alpha-cyclodextrin cavity is a determining parameter in emulsification and thermal stability. The heat flow traces and images showed dissolution, cooperative melting and de- threading of inclusion complexes which take place progressively, ending at high temperatures, close or above 100{\deg}C. Another important feature observed in the emulsions with micro-platelets is the partial substitution of the guest molecules occurring at room temperature at the oil/water interfaces without dissolution, possibly by a diffusion mechanism of the oil. Accordingly, the dissolution and the cooperative melting temperatures of the inclusion crystals changed, showing marked differences upon the type of guest molecules. The enthalpies of dissolution of crystals were measured and compared with soluble inclusions.


title: Dehydration, Dissolution and Melting of Cyclodextrin Crystals

abstract: Cyclodextrins are a family of oligosaccharides with a toroid shape which exhibit a unique ability of entrapping guest molecules in their internal cavity. Water is the primary guest molecule and is omnipresent in the crystalline phases stabilizing the overall architecture. Despite the presence of water molecules inside the cavity, cyclodextrins provide a hydrophobic environment where poorly soluble molecules can easily fit. In this investigation we put in evidence different types of water in the hydrated {\alpha} , \b{eta} and {\gamma} cyclodextrin crystals. Thermogravimetric measurements identify various binding sites of water and highlight the difference between the crystals equilibrated under various humid atmospheres. We establish by microcalorimetry the limit of solubility versus temperature and measure for the first time the melting temperatures of the hydrated crystals. Dissolution and melting enthalpies are derived and the solubility curves are compared to existing literature. The specific features of each cyclodextrin are underlined.


title: Auto-assemblies of Alpha-Cyclodextrin and Grafted Polysaccharides: Crystal Structure and Specific Properties of the Platelets

abstract: Cyclodextrins (CD) are a family of oligosaccharides with a toroid shape, which exhibit a remarkable ability to include guest molecules in their internal cavity providing a hydrophobic environment for poorly soluble molecules. Recently new types of inclusions of alpha CD with alkyl grafted polysaccharide chains (pullulan, chitosan, dextran, amylopectin, chondroitin sulfate) have been prepared which are auto assembled into micro and nano platelets. We report in this paper an extensive investigation of platelets with different compositions, including their reversible hydration (Thermo Gravimetric Analysis), crystalline structure (Powder X Rays Diffraction), dimensions and shapes, (Scanning Electron Microscopy Field Emission Gun), thermal properties, solubility and melting (Micro Differential Scanning Calorimetry). The crystalline platelets exhibit layered structures intercalating the polysaccharide backbones and CD complexes hosting the grafted alkyl chains. The monoclinic symmetry of columnar type crystals suggests a head to tail arrangement of the CDs. The platelets have a preferentially hexagonal shape with sharp edges, variable sizes, and thicknesses and sometimes show incomplete layers (terraces). The crystal parameters change upon dehydration. Melting temperatures of platelets in aqueous solutions exceeds 100 degree. Finally, we discuss the potential relation between the platelet structure and applications for mucoadhesive devices.


title: Correcting Emittance Growth Due to Stray Sextupole Fields

abstract: This paper discusses the emittance growth produced by sextupole fields in conjunction with a solenoidal focusing. The sextupole emittance is derived and compared with numerical simulations using a measured sextupole field for a vacuum chamber in a solenoidal field. It is found that the sextupole emittance is dominated by the field's radial non-linearity and the growth due to the skew angle is much smaller. It is shown that a corrector sextupole placed after the sextupole-solenoid system is effective at cancelling this emittance growth. Leaving only the growth due to the solenoid's spherical aberration.


title: Changing-Look Quasar Candidates: First Results from Follow-up Spectroscopy of Highly Optically Variable Quasars

abstract: Active galactic nuclei (AGN) that show strong rest-frame optical/UV variability in their blue continuum and broad line emission are classified as "changing-look" AGN, or at higher luminosities changing look quasars (CLQs). These surprisingly large and sometimes rapid transitions challenge accepted models of quasar physics and duty cycles, offer several new avenues for study of quasar host galaxies, and open a wider interpretation of the cause of differences between broad and narrow line AGN. To better characterize extreme quasar variability, we present follow-up spectroscopy as part of a comprehensive search for CLQs across the full SDSS footprint using spectroscopically confirmed quasars from the SDSS DR7 catalog. Our primary selection requires large-amplitude (|\Delta g|>1 mag, |\Delta r|>0.5 mag) variability over any of the available time baselines probed by the SDSS and Pan-STARRS 1 surveys. We employ photometry from the Catalina Sky Survey to verify variability behavior in CLQ candidates where available, and confirm CLQs using optical spectroscopy from the William Herschel, MMT, Magellan, and Palomar telescopes. For our adopted S/N threshold on variability of broad H\beta emission, we find 17 new CLQs, yielding a confirmation rate of >~ 20%. These candidates are at lower Eddington ratio relative to the overall quasar population which supports a disk-wind model for the broad line region. Based on our sample, the CLQ fraction increases from 10% to roughly half as the continuum flux ratio between repeat spectra at 3420 Angstroms increases from 1.5 to 6. We release a catalog of over 200 highly variable candidates to facilitate future CLQ searches.


title: TS-MPC for Autonomous Vehicles including a dynamic TS-MHE-UIO

abstract: In this work, a novel approach is presented to solve the problem of tracking trajectories in autonomous vehicles. This approach is based on the use of a cascade control where the external loop solves the position control using a novel Takagi Sugeno - Model Predictive Control (TS-MPC) approach and the internal loop is in charge of the dynamic control of the vehicle using a Takagi Sugeno - Linear Quadratic Regulator technique designed via Linear Matrix Inequalities (TS-LMI-LQR). Both techniques use a TS representation of the kinematic and dynamic models of the vehicle. In addition, a novel Takagi Sugeno estimator - Moving Horizon Estimator - Unknown Input Observer (TS-MHE-UIO) is presented. This method estimates the dynamic states of the vehicle optimally as well as the force of friction acting on the vehicle that is used to reduce the control efforts. The innovative contribution of the TS-MPC and TS-MHE-UIO techniques is that using the TS model formulation of the vehicle allows us to solve the nonlinear problem as if it were linear, reducing computation times by 40-50 times. To demonstrate the potential of the TS-MPC we propose a comparison between three methods of solving the kinematic control problem: using the non-linear MPC formulation (NL-MPC), using TS-MPC without updating the prediction model and using updated TS-MPC with the references of the planner.


title: Feedback Stabilization Using Koopman Operator

abstract: In this paper, we provide a systematic approach for the design of stabilizing feedback controllers for nonlinear control systems using the Koopman operator framework. The Koopman operator approach provides a linear representation for a nonlinear dynamical system and a bilinear representation for a nonlinear control system. The problem of feedback stabilization of a nonlinear control system is then transformed to the stabilization of a bilinear control system. We propose a control Lyapunov function (CLF)-based approach for the design of stabilizing feedback controllers for the bilinear system. The search for finding a CLF for the bilinear control system is formulated as a convex optimization problem. This leads to a schematic procedure for designing CLF-based stabilizing feedback controllers for the bilinear system and hence the original nonlinear system. Another advantage of the proposed controller design approach outlined in this paper is that it does not require explicit knowledge of system dynamics. In particular, the bilinear representation of a nonlinear control system in the Koopman eigenfunction space can be obtained from time-series data. Simulation results are presented to verify the main results on the design of stabilizing feedback controllers and the data-driven aspect of the proposed approach.


title: Cell Grid Architecture for Maritime Route Prediction on AIS Data Streams

abstract: The 2018 Grand Challenge targets the problem of accurate predictions on data streams produced by automatic identification system (AIS) equipment, describing naval traffic. This paper reports the technical details of a custom solution, which exposes multiple tuning parameters, making its configurability one of the main strengths. Our solution employs a cell grid architecture essentially based on a sequence of hash tables, specifically built for the targeted use case. This makes it particularly effective in prediction on AIS data, obtaining a high accuracy and scalable performance results. Moreover, the architecture proposed accommodates also an optionally semi-supervised learning process besides the basic supervised mode.


title: Reconciling Feature-Reuse and Overfitting in DenseNet with Specialized Dropout

abstract: Recently convolutional neural networks (CNNs) achieve great accuracy in visual recognition tasks. DenseNet becomes one of the most popular CNN models due to its effectiveness in feature-reuse. However, like other CNN models, DenseNets also face overfitting problem if not severer. Existing dropout method can be applied but not as effective due to the introduced nonlinear connections. In particular, the property of feature-reuse in DenseNet will be impeded, and the dropout effect will be weakened by the spatial correlation inside feature maps. To address these problems, we craft the design of a specialized dropout method from three aspects, dropout location, dropout granularity, and dropout probability. The insights attained here could potentially be applied as a general approach for boosting the accuracy of other CNN models with similar nonlinear connections. Experimental results show that DenseNets with our specialized dropout method yield better accuracy compared to vanilla DenseNet and state-of-the-art CNN models, and such accuracy boost increases with the model depth.


title: The Partially Observable Games We Play for Cyber Deception

abstract: Progressively intricate cyber infiltration mechanisms have made conventional means of defense, such as firewalls and malware detectors, incompetent. These sophisticated infiltration mechanisms can study the defender's behavior, identify security caveats, and modify their actions adaptively. To tackle these security challenges, cyber-infrastructures require active defense techniques that incorporate cyber deception, in which the defender (deceiver) implements a strategy to mislead the infiltrator. To this end, we use a two-player partially observable stochastic game (POSG) framework, wherein the deceiver has full observability over the states of the POSG, and the infiltrator has partial observability. Then, the deception problem is to compute a strategy for the deceiver that minimizes the expected cost of deception against all strategies of the infiltrator. We first show that the underlying problem is a robust mixed-integer linear program, which is intractable to solve in general. Towards a scalable approach, we compute optimal finite-memory strategies for the infiltrator by a reduction to a series of synthesis problems for parametric Markov decision processes. We use these infiltration strategies to find robust strategies for the deceiver using mixed-integer linear programming. We illustrate the performance of our technique on a POSG model for network security. Our experiments demonstrate that the proposed approach handles scenarios considerably larger than those of the state-of-the-art methods.


title: Barrier Certificates for Assured Machine Teaching

abstract: Machine teaching can be viewed as optimal control for learning. Given a learner's model, machine teaching aims to determine the optimal training data to steer the learner towards a target hypothesis. In this paper, we are interested in providing assurances for machine teaching algorithms using control theory. In particular, we study a well-established learner's model in the machine teaching literature that is captured by the local preference over a version space. We interpret the problem of teaching a preference-based learner as solving a partially observable Markov decision process (POMDP). We then show that the POMDP formulation can be cast as a special hybrid system, i.e., a discrete-time switched system. Subsequently, we use barrier certificates to verify set-theoric properties of this special hybrid system. We show how the computation of the barrier certificate can be decomposed and numerically implemented as the solution to a sum-of-squares (SOS) program. For illustration, we show how the proposed framework based on control theory can be used to verify the teaching performance of two well-known machine teaching methods.


title: Constructing the Unstable Motivic Homotopy Category Using $(\infty,1)$-Categories

abstract: This is an expository paper providing an overview of the unstable motivic homotopy category using the theory of $(\infty,1)$-categories. In this paper, we examine two constructions in the literature and discuss their equivalence.


title: A Mg-pair isoelectronic bound exciton identified by its isotopic fingerprint in $^{28}$Si

abstract: We use the greatly improved optical linewidths provided by highly enriched $^{28}$Si to study a photoluminescence line near 1017 meV previously observed in the luminescence spectrum of natural Si diffused with Mg, and suggested to result from the recombination of an isoelectronic bound exciton localized at a Mg-pair center. In $^{28}$Si this no-phonon line is found to be comprised of five components whose relative intensities closely match the relative abundances of Mg-pairs formed by random combinations of the three stable isotopes of Mg, thus confirming the Mg-pair hypothesis. We further present the results of temperature dependence studies of this center that reveal unusual and as yet unexplained behaviour.


title: Predicting Destinations by Nearest Neighbor Search on Training Vessel Routes

abstract: The DEBS Grand Challenge 2018 is set in the context of maritime route prediction. Vessel routes are modeled as streams of Automatic Identification System (AIS) data points selected from real-world tracking data. The challenge requires to correctly estimate the destination ports and arrival times of vessel trips, as early as possible. Our proposed solution partitions the training vessel routes by reported destination port and uses a nearest neighbor search to find the training routes that are closer to the query AIS point. Particular improvements have been included as well, such as a way to avoid changing the predicted ports frequently within one query route and automating the parameters tuning by the use of a genetic algorithm. This leads to significant improvements on the final score.


title: Cost-Bounded Active Classification Using Partially Observable Markov Decision Processes

abstract: Active classification, i.e., the sequential decision-making process aimed at data acquisition for classification purposes, arises naturally in many applications, including medical diagnosis, intrusion detection, and object tracking. In this work, we study the problem of actively classifying dynamical systems with a finite set of Markov decision process (MDP) models. We are interested in finding strategies that actively interact with the dynamical system, and observe its reactions so that the true model is determined efficiently with high confidence. To this end, we present a decision-theoretic framework based on partially observable Markov decision processes (POMDPs). The proposed framework relies on assigning a classification belief (a probability distribution) to each candidate MDP model. Given an initial belief, some misclassification probabilities, a cost bound, and a finite time horizon, we design POMDP strategies leading to classification decisions. We present two different approaches to find such strategies. The first approach computes the optimal strategy "exactly" using value iteration. To overcome the computational complexity of finding exact solutions, the second approach is based on adaptive sampling to approximate the optimal probability of reaching a classification decision. We illustrate the proposed methodology using two examples from medical diagnosis and intruder detection.


title: Collapsars as a major source of r-process elements

abstract: The production of elements by rapid neutron capture (r-process) in neutron-star mergers is expected theoretically and is supported by multimessenger observations of gravitational-wave event GW170817: this production route is in principle sufficient to account for most of the r-process elements in the Universe. Analysis of the kilonova that accompanied GW170817 identified delayed outflows from a remnant accretion disk formed around the newly born black hole as the dominant source of heavy r-process material from that event. Similar accretion disks are expected to form in collapsars (the supernova-triggering collapse of rapidly rotating massive stars), which have previously been speculated to produce r-process elements. Recent observations of stars rich in such elements in the dwarf galaxy Reticulum II, as well as the Galactic chemical enrichment of europium relative to iron over longer timescales, are more consistent with rare supernovae acting at low stellar metallicities than with neutron-star mergers. Here we report simulations that show that collapsar accretion disks yield sufficient r-process elements to explain observed abundances in the Universe. Although these supernovae are rarer than neutron-star mergers, the larger amount of material ejected per event compensates for the lower rate of occurrence. We calculate that collapsars may supply more than 80 per cent of the r-process content of the Universe.


title: Recent progress in Nuclear Parton Distributions

abstract: The determination of the parton distribution functions (PDFs) is crucial for a complete understanding of the protons and neutrons that make most of the visible matter in the universe. Years of dedicated studies have yielded a quite precise knowledge of the behavior of partons moving collinearly within a proton. However Deep Inelastic Scattering (DIS) experiments off nuclei have shown a non-trivial difference with respect to DIS in protons, hinting that the partons in a nuclear medium do not behave the same way as in a free proton. In this work we will discuss the latest results in nuclear parton distribution functions (nPDFs) and how data from planned future experiments can help broaden our understanding of the nPDFs.


title: Robust operation of a GaAs tunable barrier electron pump

abstract: We demonstrate the robust operation of a gallium arsenide tunable-barrier single-electron pump operating with 1 part-per-million accuracy at a temperature of $1.3$~K and a pumping frequency of $500$~MHz. The accuracy of current quantisation is investigated as a function of multiple control parameters, and robust plateaus are seen as a function of three control gate voltages and RF drive power. The electron capture is found to be in the decay-cascade, rather than the thermally-broadened regime. The observation of robust plateaus at an elevated temperature which does not require expensive refrigeration is an important step towards validating tunable-barrier pumps as practical current standards.


title: Memory and Resource Leak Defects and their Repairs in Java Projects

abstract: Despite huge software engineering efforts and programming language support, resource and memory leaks are still a troublesome issue, even in memory-managed languages such as Java. Understanding the properties of leak-inducing defects, how the leaks manifest, and how they are repaired is an essential prerequisite for designing better approaches for avoidance, diagnosis, and repair of leak-related bugs. We conduct a detailed empirical study on 491 issues from 15 large open-source Java projects. The study proposes taxonomies for the leak types, for the defects causing them, and for the repair actions. We investigate, under several aspects, the distributions within each taxonomy and the relationships between them. We find that manual code inspection and manual runtime detection are still the main methods for leak detection. We find that most of the errors manifest on error-free execution paths, and developers repair the leak defects in a shorter time than non-leak defects. We also identify 13 recurring code transformations in the repair patches. Based on our findings, we draw a variety of implications on how developers can avoid, detect, isolate and repair leak-related bugs.


title: Influence of host matrices on krypton electron binding energies and KLL Auger transition energies

abstract: The low-energy electron spectra emitted in the radioactive decay of the $^{83}$Rb and $^{83}$Sr isotopes were measured with a combined electrostatic electron spectrometer. Radioactive sources used were prepared by ion implantation of $^{83}$Sr into a high purity polycrystalline platinum foil at 30 keV and by vacuum-evaporation deposition of $^{83}$ Rb on the same type of foil. From the measured conversion electron spectra, the electron binding energies (referenced to the Fermi level) for the K, L$_1$ , L$_2$ , L$_3$ , M$_1$ , M$_2$, and M$_3$ shell/subshells of krypton in the platinum host were determined to be 14 316.4(12), 1 914.3(9), 1 720.3(9), 1 667.6(9), 281.5(9), 209.6(13), and 201.2(15) eV, respectively, and those for the evaporated layer were observed to be lower by 0.7(1) eV. For both host matrices, values of 2.3(2), 4.6(2), 1.7(2), 1.3(2), and 3.2(3) eV were obtained for the krypton K, L$_1$ , L$_2$ , L$_3$ , and M$_1$ natural atomic level widths, respectively. The absolute energies of 10 838.5(9) and 10 839.5(10) eV were measured for the KL$_2$L$_3$ ($^{1}$D$_2$) Auger transition in krypton implanted in Pt and generated in the evaporated rubidium layer, respectively. A value of 601.0(8) eV was measured for the energy difference of the KL$_2$L$_3$ ($^{1}$D$_2$) transitions in Rb and Kr in the Pt host. Multiconfiguration Dirac-Fock calculations of the krypton KLL transition energies and intensities were also performed.


title: Search for environmental effects on the KLL Auger spectrum of rubidium generated in radioactive decay

abstract: The KLL Auger spectrum of rubidium following the electron capture decay of $^{83}$Sr and $^{85}$Sr isotopes was experimentally studied in detail for the first time using one $^{83}$Sr source and three $^{85}$Sr sources in different host matrices. Energies, relative intensities, and natural widths of all the nine well-resolved basic spectrum components were determined and compared with both predictions and experimental data for krypton. Results of our multiconfiguration Dirac-Fock calculations demonstrated an influence of the "atomic structure effect" on absolute energies of the KLL transitions following the creation of initial vacancies by the electron capture decay. Environmental effects on the KLL Auger spectrum were distinctly observed only for the absolute transition energies.


title: Temporal Cliques Admit Sparse Spanners

abstract: Let $G=(V,E)$ be an undirected graph on $n$ vertices and $\lambda:E\to 2^{\mathbb{N}}$ a mapping that assigns to every edge a non-empty set of integer labels (times). Such a graph is {\em temporally connected} if a path exists with non-decreasing times from every vertex to every other vertex. In a seminal paper, Kempe, Kleinberg, and Kumar \cite{KKK02} asked whether, given such a temporal graph, a {\em sparse} subset of edges always exists whose labels suffice to preserve temporal connectivity -- a {\em temporal spanner}. Axiotis and Fotakis \cite{AF16} answered negatively by exhibiting a family of $\Theta(n^2)$-dense temporal graphs which admit no temporal spanner of density $o(n^2)$. In this paper, we give the first positive answer as to the existence of $o(n^2)$-sparse spanners in a dense class of temporal graphs, by showing (constructively) that if $G$ is a complete graph, then one can always find a temporal spanner of density $O(n \log n)$.


title: The KLM+KLN Auger electron spectrum of rubidium in different matrices

abstract: The KLM+KLN Auger electron spectrum of rubidium (Z=37) emitted in the electron capture decay of radioactive $^{83}$Sr in a polycrystalline platinum matrix and also $^{85}$Sr in polycrystalline platinum and carbon matrices as well as in an evaporated layer onto a carbon backing was experimentally studied in detail for the first time using a combined electrostatic electron spectrometer. Energies, relative intensities, and natural widths of fifteen basic spectrum components were determined and compared with both theoretical predictions and experimental data for krypton (Z=36). Relative spectrum line energies obtained from the semi-empirical calculations in intermediate coupling scheme were found to agree within 3$\sigma$ with the measured values while disagreement with experiment exceeding 3$\sigma$ was often observed for values obtained from our multiconfiguration Dirac-Hartree-Fock calculations. The absolute energy of the dominant spectrum component given by the semi-empirical approach agrees within 1$\sigma$ with the measured value. Shifts of + (0.2$\pm$0.2) and - (1.9$\pm$0.2) eV were measured for the dominant KLM spectrum components between the $^{85}$Sr sources prepared by vacuum evaporation on and implanted into the carbon foil, respectively, relative to $^{85}$Sr implanted into the platinum foil. A value of (713$\pm$2) eV was determined for the energy difference of the dominant components of the KLM+KLN Auger electron spectra of rubidium and krypton generated in the polycrystalline platinum matrix. From the detailed analysis of the measured data and available theoretical results, the general conclusion can be drawn that the proper description of the KLM+KLN Auger electron spectrum for Z around 37 should still be based on intermediate coupling of angular momenta taking into account relativistic effects.


title: Expander Graphs are Non-Malleable Codes

abstract: Any $d$-regular graph on $n$ vertices with spectral expansion $\lambda$ satisfying $n = \Omega(d^3\log(d)/\lambda)$ yields a $O\left(\frac{\lambda^{3/2}}{d}\right)$-non-malleable code for single-bit messages in the split-state model.


title: Superimposition-guided Facial Reconstruction from Skull

abstract: We develop a new algorithm to perform facial reconstruction from a given skull. This technique has forensic application in helping the identification of skeletal remains when other information is unavailable. Unlike most existing strategies that directly reconstruct the face from the skull, we utilize a database of portrait photos to create many face candidates, then perform a superimposition to get a well matched face, and then revise it according to the superimposition. To support this pipeline, we build an effective autoencoder for image-based facial reconstruction, and a generative model for constrained face inpainting. Our experiments have demonstrated that the proposed pipeline is stable and accurate.


title: Audio-Visual Speech Recognition With A Hybrid CTC/Attention Architecture

abstract: Recent works in speech recognition rely either on connectionist temporal classification (CTC) or sequence-to-sequence models for character-level recognition. CTC assumes conditional independence of individual characters, whereas attention-based models can provide nonsequential alignments. Therefore, we could use a CTC loss in combination with an attention-based model in order to force monotonic alignments and at the same time get rid of the conditional independence assumption. In this paper, we use the recently proposed hybrid CTC/attention architecture for audio-visual recognition of speech in-the-wild. To the best of our knowledge, this is the first time that such a hybrid architecture architecture is used for audio-visual recognition of speech. We use the LRS2 database and show that the proposed audio-visual model leads to an 1.3% absolute decrease in word error rate over the audio-only model and achieves the new state-of-the-art performance on LRS2 database (7% word error rate). We also observe that the audio-visual model significantly outperforms the audio-based model (up to 32.9% absolute improvement in word error rate) for several different types of noise as the signal-to-noise ratio decreases.


title: Diffraction limited centimeter scale radiator: metasurface grating antenna for phased array LiDAR

abstract: In this paper, we demonstrate a radiation-strength-chirped metasurface centimeter-long grating antenna, whose beam quality is approaching the diffraction limit in its footprint with 90 percent efficiency.Instead of chirping the duty cycle to tune radiation strength, which calls for non-scalable fabrication resolution, we design a 2D fish-bone surface grating with apodized width of the bone.The meta surface is made by silicon nitride on top of silicon waveguide to weakly perturb the mode. Moreover, a Monte Carlo Markov Chain(MCMC) algorithm is implemented to design the radiation strength profile, making the optimized trade off between efficiency, beam quality and fabrication challenge. A metal mirror is designed to deposit on the top of the cladding for unidirectional upside-down radiation and uniform lateral gain. For the 1cm grating, our design is for a 0.01 degree beam with 37000 1D directional gain and 90% efficiency, with 200nm feature size. Finally, we fabricated the antenna and measured the beam quality with Fourier imaging system, which gives result of 0.02 degree -10dB beam divergence. To the best of our knowledge, this is the state-of-the-art on-chip antenna with CMOS- foundry-compatible technology.


title: Open-Ended Content-Style Recombination Via Leakage Filtering

abstract: We consider visual domains in which a class label specifies the content of an image, and class-irrelevant properties that differentiate instances constitute the style. We present a domain-independent method that permits the open-ended recombination of style of one image with the content of another. Open ended simply means that the method generalizes to style and content not present in the training data. The method starts by constructing a content embedding using an existing deep metric-learning technique. This trained content encoder is incorporated into a variational autoencoder (VAE), paired with a to-be-trained style encoder. The VAE reconstruction loss alone is inadequate to ensure a decomposition of the latent representation into style and content. Our method thus includes an auxiliary loss, leakage filtering, which ensures that no style information remaining in the content representation is used for reconstruction and vice versa. We synthesize novel images by decoding the style representation obtained from one image with the content representation from another. Using this method for data-set augmentation, we obtain state-of-the-art performance on few-shot learning tasks.


title: DeepSSM: A Deep Learning Framework for Statistical Shape Modeling from Raw Images

abstract: Statistical shape modeling is an important tool to characterize variation in anatomical morphology. Typical shapes of interest are measured using 3D imaging and a subsequent pipeline of registration, segmentation, and some extraction of shape features or projections onto some lower-dimensional shape space, which facilitates subsequent statistical analysis. Many methods for constructing compact shape representations have been proposed, but are often impractical due to the sequence of image preprocessing operations, which involve significant parameter tuning, manual delineation, and/or quality control by the users. We propose DeepSSM: a deep learning approach to extract a low-dimensional shape representation directly from 3D images, requiring virtually no parameter tuning or user assistance. DeepSSM uses a convolutional neural network (CNN) that simultaneously localizes the biological structure of interest, establishes correspondences, and projects these points onto a low-dimensional shape representation in the form of PCA loadings within a point distribution model. To overcome the challenge of the limited availability of training images, we present a novel data augmentation procedure that uses existing correspondences on a relatively small set of processed images with shape statistics to create plausible training samples with known shape parameters. Hence, we leverage the limited CT/MRI scans (40-50) into thousands of images needed to train a CNN. After the training, the CNN automatically produces accurate low-dimensional shape representations for unseen images. We validate DeepSSM for three different applications pertaining to modeling pediatric cranial CT for characterization of metopic craniosynostosis, femur CT scans identifying morphologic deformities of the hip due to femoroacetabular impingement, and left atrium MRI scans for atrial fibrillation recurrence prediction.


title: The Prompt Emission of Gamma-Ray Bursts from the Wind of Newborn Millisecond Magnetars: A Case Study of GRB 160804A

abstract: In this paper, we revisit the scenario that an internal gradual magnetic dissipation takes place within the wind from a newborn millisecond magnetar can be responsible for gamma-ray burst production. We show that a combination of two emission components in this model, i.e., the photospheric emission from the wind and the synchrotron radiation within the magnetic reconnection region, can give a reasonable fit to the observed spectrum of the prompt emission phase of GRB 160804A. We obtain the physical parameters through a Monte Carlo procedure and deduce the initial spin period and magnetic field of the central magnetar. Furthermore, the independent afterglow fitting analysis gives a consistent result, adding great credibility to this scenario. In addition, we predict a subclass of GRBs called bursts from such a Magnetar wind Internal Gradual MAgnetic Dissipation (abbreviated as "MIGMAD bursts") that have several distinctive properties.


title: Predicting the Generalization Gap in Deep Networks with Margin Distributions

abstract: As shown in recent research, deep neural networks can perfectly fit randomly labeled data, but with very poor accuracy on held out data. This phenomenon indicates that loss functions such as cross-entropy are not a reliable indicator of generalization. This leads to the crucial question of how generalization gap should be predicted from the training data and network parameters. In this paper, we propose such a measure, and conduct extensive empirical studies on how well it can predict the generalization gap. Our measure is based on the concept of margin distribution, which are the distances of training points to the decision boundary. We find that it is necessary to use margin distributions at multiple layers of a deep network. On the CIFAR-10 and the CIFAR-100 datasets, our proposed measure correlates very strongly with the generalization gap. In addition, we find the following other factors to be of importance: normalizing margin values for scale independence, using characterizations of margin distribution rather than just the margin (closest distance to decision boundary), and working in log space instead of linear space (effectively using a product of margins rather than a sum). Our measure can be easily applied to feedforward deep networks with any architecture and may point towards new training loss functions that could enable better generalization.


title: Quantum Coherence is Preserved in Extremely Dispersive Plasmonic Media

abstract: Quantum plasmonics experiments have on multiple occasions reported the observation of quantum coherence of discrete plasmons, which exhibit remarkable preservation of quantum interference visibility, a seemingly surprising feature for systems mixing light and matter with high ohmic losses during propagation. However, most experiments to date used essentially weakly-confined plasmons, which experience limited light-matter hybridization, thus limiting the potential for decoherence. Here, we report quantum coherence of plasmons near the surface plasmon polariton (SPP) resonance frequency, where plasmonic dispersion and confinement is much stronger than in previous experiments. We generated polarization-entangled pairs of photons using spontaneous parametric down conversion and transmitted one of the photons through a plasmonic hole array designed to convert incident single photons into highly-dispersive single SPPs. We find the quality of photon entanglement after the plasmonic channel to be unperturbed by the introduction of a highly dispersive plasmonic element. Our findings provide a lower bound of 100 femtoseconds for the pure dephasing time for dispersive plasmons in gold, and show that even in a highly dispersive regime surface plasmons preserve quantum mechanical correlations, making possible harnessing the power of extreme light confinement for integrated quantum photonics.


title: The Role of Downflows in Establishing Solar Near-Surface Shear

abstract: The dynamical origins of the Sun's tachocline and near-surface shear layer (NSSL) are still not well understood. We have attempted to self-consistently reproduce a NSSL in numerical simulations of a solar-like convection zone by increasing the density contrast across rotating, 3D spherical shells. We explore the hypothesis that high density contrast leads to near-surface shear by creating a rotationally unconstrained layer of fast flows near the outer surface. Although our high-contrast models do have near-surface shear, it is confined primarily to low latitudes (between $\pm15^\circ$). Two distinct types of flow structures maintain the shear dynamically: rotationally $\textit{constrained}$ Busse columns aligned with the rotation axis and fast, rotationally $\textit{unconstrained}$ downflow plumes that deplete angular momentum from the outer fluid layers. The plumes form at all latitudes, and in fact are more efficient at transporting angular momentum inward at high latitudes. The presence of Busse columns at low latitudes thus appears essential to creating near-surface shear in our models. We conclude that a solar-like NSSL is unobtainable from a rotationally unconstrained outer fluid layer alone. In numerical models, the shear is eliminated through the advection of angular momentum by the meridional circulation. Therefore, a detailed understanding how the solar meridional circulation is dynamically achieved will be necessary to elucidate the origin of the Sun's NSSL.


title: Improved Gradient-Based Optimization Over Discrete Distributions

abstract: In many applications we seek to maximize an expectation with respect to a distribution over discrete variables. Estimating gradients of such objectives with respect to the distribution parameters is a challenging problem. We analyze existing solutions including finite-difference (FD) estimators and continuous relaxation (CR) estimators in terms of bias and variance. We show that the commonly used Gumbel-Softmax estimator is biased and propose a simple method to reduce it. We also derive a simpler piece-wise linear continuous relaxation that also possesses reduced bias. We demonstrate empirically that reduced bias leads to a better performance in variational inference and on binary optimization tasks.


title: Generalized Functional Pruning Optimal Partitioning (GFPOP) for Constrained Changepoint Detection in Genomic Data

abstract: We describe a new algorithm and R package for peak detection in genomic data sets using constrained changepoint algorithms. These detect changes from background to peak regions by imposing the constraint that the mean should alternately increase then decrease. An existing algorithm for this problem exists, and gives state-of-the-art accuracy results, but it is computationally expensive when the number of changes is large. We propose the GFPOP algorithm that jointly estimates the number of peaks and their locations by minimizing a cost function which consists of a data fitting term and a penalty for each changepoint. Empirically this algorithm has a cost that is $O(N \log(N))$ for analysing data of length $N$. We also propose a sequential search algorithm that finds the best solution with $K$ segments in $O(\log(K)N \log(N))$ time, which is much faster than the previous $O(KN \log(N))$ algorithm. We show that our disk-based implementation in the PeakSegDisk R package can be used to quickly compute constrained optimal models with many changepoints, which are needed to analyze typical genomic data sets that have tens of millions of observations.


title: Multilevel Optimal Transport: a Fast Approximation of Wasserstein-1 distances

abstract: We propose a fast algorithm for the calculation of the Wasserstein-1 distance, which is a particular type of optimal transport distance with homogeneous of degree one transport cost. Our algorithm is built on multilevel primal-dual algorithms. Several numerical examples and a complexity analysis are provided to demonstrate its computational speed. On some commonly used image examples of size $512\times512$, the proposed algorithm gives solutions within $0.2\sim 1.5$ seconds on a single CPU, which is much faster than the state-of-the-art algorithms.


title: Visual Object Tracking based on Adaptive Siamese and Motion Estimation Network

abstract: Recently, convolutional neural network (CNN) has attracted much attention in different areas of computer vision, due to its powerful abstract feature representation. Visual object tracking is one of the interesting and important areas in computer vision that achieves remarkable improvements in recent years. In this work, we aim to improve both the motion and observation models in visual object tracking by leveraging representation power of CNNs. To this end, a motion estimation network (named MEN) is utilized to seek the most likely locations of the target and prepare a further clue in addition to the previous target position. Hence the motion estimation would be enhanced by generating a small number of candidates near two plausible positions. The generated candidates are then fed into a trained Siamese network to detect the most probable candidate. Each candidate is compared to an adaptable buffer, which is updated under a predefined condition. To take into account the target appearance changes, a weighting CNN (called WCNN) adaptively assigns weights to the final similarity scores of the Siamese network using sequence-specific information. Evaluation results on well-known benchmark datasets (OTB100, OTB50 and OTB2013) prove that the proposed tracker outperforms the state-of-the-art competitors.


title: Energy-dependent 3-body loss in 1D Bose gases

abstract: We study the loss of atoms in quantum Newton's cradles (QNCs) with a range of average energies and transverse confinements. We find that the three-body collision rate in one-dimension is strongly energy dependent, as predicted by a strictly 1D theory. We adapt the theory to atoms in waveguides, then using detailed momentum measurements to infer all the collisions that occur, we compare the observed loss to the adapted theory and find that they agree well.


title: Discovering Interactions Using Covariate Informed Random Partition Models

abstract: Combination chemotherapy treatment regimens created for patients diagnosed with childhood acute lymphoblastic leukemia have had great success in improving cure rates. Unfortunately, patients prescribed these types of treatment regimens have displayed susceptibility to the onset of osteonecrosis. Some have suggested that this is due to pharmacokinetic interaction between two agents in the treatment regimen (asparaginase and dexamethasone) and other physiological variables. Determining which physiological variables to consider when searching for interactions in scenarios like these, minus a priori guidance, has proved to be a challenging problem, particularly if interactions influence the response distribution in ways beyond shifts in expectation or dispersion only. In this paper we propose an exploratory technique that is able to discover associations between covariates and responses in a very general way. The procedure connects covariates to responses very flexibly through dependent random partition prior distributions, and then employs machine learning techniques to highlight potential associations found in each cluster. We provide a simulation study to show utility and apply the method to data produced from a study dedicated to learning which physiological predictors influence severity of osteonecrosis multiplicatively.


title: A Quantitative Analysis of the Effect of Batch Normalization on Gradient Descent

abstract: Despite its empirical success and recent theoretical progress, there generally lacks a quantitative analysis of the effect of batch normalization (BN) on the convergence and stability of gradient descent. In this paper, we provide such an analysis on the simple problem of ordinary least squares (OLS). Since precise dynamical properties of gradient descent (GD) is completely known for the OLS problem, it allows us to isolate and compare the additional effects of BN. More precisely, we show that unlike GD, gradient descent with BN (BNGD) converges for arbitrary learning rates for the weights, and the convergence remains linear under mild conditions. Moreover, we quantify two different sources of acceleration of BNGD over GD -- one due to over-parameterization which improves the effective condition number and another due having a large range of learning rates giving rise to fast descent. These phenomena set BNGD apart from GD and could account for much of its robustness properties. These findings are confirmed quantitatively by numerical experiments, which further show that many of the uncovered properties of BNGD in OLS are also observed qualitatively in more complex supervised learning problems.


title: Generalization and Regularization in DQN

abstract: Deep reinforcement learning algorithms have shown an impressive ability to learn complex control policies in high-dimensional tasks. However, despite the ever-increasing performance on popular benchmarks, policies learned by deep reinforcement learning algorithms can struggle to generalize when evaluated in remarkably similar environments. In this paper we propose a protocol to evaluate generalization in reinforcement learning through different modes of Atari 2600 games. With that protocol we assess the generalization capabilities of DQN, one of the most traditional deep reinforcement learning algorithms, and we provide evidence suggesting that DQN overspecializes to the training environment. We then comprehensively evaluate the impact of dropout and $\ell_2$ regularization, as well as the impact of reusing learned representations to improve the generalization capabilities of DQN. Despite regularization being largely underutilized in deep reinforcement learning, we show that it can, in fact, help DQN learn more general features. These features can be reused and fine-tuned on similar tasks, considerably improving DQN's sample efficiency.


title: Homological norms on nonpositively curved manifolds

abstract: We relate the Gromov norm on homology classes to the harmonic norm on the dual cohomology and obtain double sided bounds in terms of the volume and other geometric quantities of the underlying manifold. Along the way, we provide comparisons to other related norms and quantities as well.


title: Towards Better Summarizing Bug Reports with Crowdsourcing Elicited Attributes

abstract: Recent years have witnessed the growing demands for resolving numerous bug reports in software maintenance. Aiming to reduce the time testers/developers take in perusing bug reports, the task of bug report summarization has attracted a lot of research efforts in the literature. However, no systematic analysis has been conducted on attribute construction which heavily impacts the performance of supervised algorithms for bug report summarization. In this study, we first conduct a survey to reveal the existing methods for attribute construction in mining software repositories. Then, we propose a new method named Crowd-Attribute to infer new effective attributes from the crowdgenerated data in crowdsourcing and develop a new tool named Crowdsourcing Software Engineering Platform to facilitate this method. With Crowd-Attribute, we successfully construct 11 new attributes and propose a new supervised algorithm named Logistic Regression with Crowdsourced Attributes (LRCA). To evaluate the effectiveness of LRCA, we build a series of large scale data sets with 105,177 bug reports. Experiments over both the public data set SDS with 36 manually annotated bug reports and new large-scale data sets demonstrate that LRCA can consistently outperform the state-of-the-art algorithms for bug report summarization.


title: Resilient Structural Stabilizability of Undirected Networks

abstract: In this paper, we consider the structural stabilizability problem of undirected networks. More specifically, we are tasked to infer the stabilizability of an undirected network from its underlying topology, where the undirected networks are modeled as continuous-time linear time-invariant (LTI) systems involving symmetric state matrices. Firstly, we derive a graph-theoretic necessary and sufficient condition for structural stabilizability of undirected networks. Then, we propose a method to infer the maximum dimension of stabilizable subspace solely based on the network structure. Based on these results, on one hand, we study the optimal actuator-disabling attack problem, i.e., removing a limited number of actuators to minimize the maximum dimension of stabilizable subspace. We show this problem is NP-hard. On the other hand, we study the optimal recovery problem with respect to the same kind of attacks, i.e., adding a limited number of new actuators such that the maximum dimension of stabilizable subspace is maximized. We prove the optimal recovery problem is also NP-hard, and we develop a (1-1/e) approximation algorithm to this problem.


title: A sausage body is a unique solution for a reverse isoperimetric problem

abstract: We consider the class of $\lambda$-concave bodies in $\mathbb R^{n+1}$; that is, convex bodies with the property that each of their boundary points supports a tangent ball of radius $1/\lambda$ that lies locally (around the boundary point) inside the body. In this class we solve a reverse isoperimetric problem: we show that the convex hull of two balls of radius $1/\lambda$ (a sausage body) is a unique volume minimizer among all $\lambda$-concave bodies of given surface area. This is in a surprising contrast to the standard isoperimetric problem for which, as it is well-known, the unique maximizer is a ball. We solve the reverse isoperimetric problem by proving a reverse quermassintegral inequality, the second main result of this paper.


title: Robot Vision: Calibration of Wide-Angle Lens Cameras Using Collinearity Condition and K-Nearest Neighbour Regression

abstract: Visual perception is regularly used by humans and robots for navigation. By either implicitly or explicitly mapping the environment, ego-motion can be determined and a path of actions can be planned. The process of mapping and navigation are delicately intertwined; therefore, improving one can often lead to an improvement of the other. Both processes are sensitive to the interior orientation parameters of the camera system and mathematically modelling these systematic errors can often improve the precision and accuracy of the overall solution. This paper presents an automatic camera calibration method suitable for any lens, without having prior knowledge about the sensor. Statistical inference is performed to map the environment and localize the camera simultaneously. K-nearest neighbour regression is used to model the geometric distortions of the images. A normal-angle lens Nikon camera and wide-angle lens GoPro camera were calibrated using the proposed method, as well as the conventional bundle adjustment with self-calibration method (for comparison). Results showed that the mapping error was reduced from an average of 14.9 mm to 1.2 mm (i.e. a 92% improvement) and 66.6 mm to 1.5 mm (i.e. a 98% improvement) using the proposed method for the Nikon and GoPro cameras, respectively. In contrast, the conventional approach achieved an average 3D error of 0.9 mm (i.e. 94% improvement) and 3.3 mm (i.e. 95% improvement) for the Nikon and GoPro cameras, respectively. Thus, the proposed method performs well irrespective of the lens/sensor used: it yields results that are comparable to the conventional approach for normal-angle lens cameras, and it has the additional benefit of improving calibration results for wide-angle lens cameras.


title: Optimization of Circuits for IBM's five-qubit Quantum Computers

abstract: IBM has made several quantum computers available to researchers around the world via cloud services. Two architectures with five qubits, one with 16, and one with 20 qubits are available to run experiments. The IBM architectures implement gates from the Clifford+T gate library. However, each architecture only implements a subset of the possible CNOT gates. In this paper, we show how Clifford+T circuits can efficiently be mapped into the two IBM quantum computers with 5 qubits. We further present an algorithm and a set of circuit identities that may be used to optimize the Clifford+T circuits in terms of gate count and number of levels. It is further shown that the optimized circuits can considerably reduce the gate count and number of levels and thus produce results with better fidelity.


title: The dual pair $Pin(2n)\times\mathfrak{osp}(1|2)$, the Dirac equation and the Bannai-Ito algebra

abstract: The Bannai-Ito algebra can be defined as the centralizer of the coproduct embedding of $\mathfrak{osp}(1|2)$ in $\mathfrak{osp}(1|2)^{\otimes n}$. It will be shown that it is also the commutant of a maximal Abelian subalgebra of $\mathfrak{o}(2n)$ in a spinorial representation and an embedding of the Racah algebra in this commutant will emerge. The connection between the two pictures for the Bannai-Ito algebra will be traced to the Howe duality which is embodied in the $Pin(2n)\times\mathfrak{osp}(1|2)$ symmetry of the massless Dirac equation in $\mathbb{R}^{2n}$. Dimensional reduction to $\mathbb{R}^{n}$ will provide an alternative to the Dirac-Dunkl equation as a model with Bannai-Ito symmetry.


title: Quantum interferometry via a coherent state mixed with a photon-added squeezed vacuum state

abstract: We theoretically investigate the phase sensitivity with parity detection on a Mach-Zehnder interferometer with a coherent state combined with a photon-added squeezed vacuum state. When the phase shift approaches zero, the squeezed vacuum state is indeed the optimal state within a constraint on the average number of photons. However, when the phase shift to be estimated slightly deviates from zero, the optimal state is neither the squeezed vacuum state nor the photon-subtracted squeezed vacuum state, but the photon-added squeezed vacuum state when they carry many photons. Finally, we show that the quantum Cram\'{e}r-Rao bound can be reached by parity detection.


title: A Framework to Support the Trust Process in News and Social Media

abstract: Current society is heavily influenced by the spread of online information, containing all sorts of claims, commonly found in news stories, tweets, and social media postings. Depending on the user, they may be considered "true" or "false", according to the agent's trust on the claim. In this paper, we discuss the concept of content trust and trust process, and propose a framework to describe the trust process, which can support various possible models of content trust.


title: A brief survey on operator theory in $H^2(\mathbb D^2)$

abstract: This survey aims to give a brief introduction to operator theory in the Hardy space over the bidisc $H^2(\mathbb D^2)$. As an important component of multivariable operator theory, the theory in $H^2(\mathbb D^2)$ focuses primarily on two pairs of commuting operators that are naturally associated with invariant subspaces (or submodules) in $H^2(\mathbb D^2)$. Connection between operator-theoretic properties of the pairs and the structure of the invariant subspaces is the main subject. The theory in $H^2(\mathbb D^2)$ is motivated by and still tightly related to several other influential theories, namely Nagy-Foias theory on operator models, Ando's dilation theorem of commuting operator pairs, Rudin's function theory on $H^2(\mathbb D^n)$, and Douglas-Paulsen's framework of Hilbert modules. Due to the simplicity of the setting, a great supply of examples in particular, the operator theory in $H^2(\mathbb D^2)$ has seen remarkable growth in the past two decades. This survey is far from a full account of this development but rather a glimpse from the author's perspective. Its goal is to show an organized structure of this theory, to bring together some results and references and to inspire curiosity on new researchers.


title: A Graph Partitioning Algorithm with Application in Synthesizing Single Flux Quantum Logic Circuits

abstract: In this paper, a new graph partitioning problem is introduced. The depth of each part is constrained, i.e., the node count in the longest path of the corresponding sub-graph is no more than a predetermined positive integer value p. An additional constraint is enforced such that each part contains only nodes selected from consecutive levels in the graph. The problem is therefore transformed into a Depth-bounded Levelized Graph Partitioning (DLGP) problem, which is solved optimally using a dynamic programming algorithm. As an example application, we have shown that DLGP can effectively generate timing-correct circuit solutions for Single Flux Quantum (SFQ) logic, which is a magnetic-pulse-based, gate-level pipelined superconductive computing fabric. Experimental results confirm that DLGP generates circuits with considerably lower path balancing overheads compared with a baseline full-path-balancing approach. For example, the balancing overhead (a critical measure of quality metric) for the SFQ circuit realization in terms of D-Flip-Flop count is reduced by 3.61 times on average for 10 benchmark circuit, given p=5.


title: A Simple Framework for Stability Analysis of State-Dependent Networks of Heterogeneous Agents

abstract: Stability and analysis of multi-agent network systems with state-dependent switching typologies have been a fundamental and longstanding challenge in control, social sciences, and many other related fields. These already complex systems become further complicated once one accounts for asymmetry or heterogeneity of the underlying agents/dynamics. Despite extensive progress in analysis of conventional networked decision systems where the network evolution and state dynamics are driven by independent or weakly coupled processes, most of the existing results fail to address multi-agent systems where the network and state dynamics are highly coupled and evolve based on status of heterogeneous agents. Motivated by numerous applications of such dynamics in social sciences, in this paper we provide a new direction toward analysis of dynamic networks of heterogeneous agents under complex time-varying environments. As a result we show how Lyapunov stability of several challenging problems from opinion dynamics can be established using a simple application of our framework. Moreover, we introduce a new class of asymmetric opinion dynamics, namely nearest neighbor dynamics, and show how our approach can be used to analyze their behavior. In particular, we extend our results to game-theoretic settings and provide new insights toward analysis of complex networked multi-agent systems using exciting field of sequential optimization.


title: FusedLSTM: Fusing frame-level and video-level features for Content-based Video Relevance Prediction

abstract: This paper describes two of my best performing approaches on the Content-based Video Relevance Prediction challenge. In the FusedLSTM based approach, the inception-pool3 and the C3D-pool5 features are combined using an LSTM and a dense layer to form embeddings with the objective to minimize the triplet loss function. In the second approach, an Online Kernel Similarity Learning method is proposed to learn a non-linear similarity measure to adhere the relevance training data. The last section gives a complete comparison of all the approaches implemented during this challenge, including the one presented in the baseline paper.


title: Mean Field Production Output Control with Sticky Prices: Nash and Social Solutions

abstract: This paper presents an application of mean field control to dynamic production optimization. Both noncooperative and cooperative solutions are considered. We first introduce a market of a large number of agents (firms) with sticky prices and adjustment costs. By solving auxiliary limiting optimal control problems subject to consistent mean field approximations, two sets of decentralized strategies are obtained and further shown to asymptotically attain Nash equilibria and social optima, respectively. The performance estimate of the social optimum strategies exploits a passivity property of the underlying model. A numerical example is given to compare market prices, firms' outputs and costs under two two solution frameworks.


title: Modelling Errors in X-ray Fluoroscopic Imaging Systems Using Photogrammetric Bundle Adjustment With a Data-Driven Self-Calibration Approach

abstract: X-ray imaging is a fundamental tool of routine clinical diagnosis. Fluoroscopic imaging can further acquire X-ray images at video frame rates, thus enabling non-invasive in-vivo motion studies of joints, gastrointestinal tract, etc. For both the qualitative and quantitative analysis of static and dynamic X-ray images, the data should be free of systematic biases. Besides precise fabrication of hardware, software-based calibration solutions are commonly used for modelling the distortions. In this primary research study, a robust photogrammetric bundle adjustment was used to model the projective geometry of two fluoroscopic X-ray imaging systems. However, instead of relying on an expert photogrammetrist's knowledge and judgement to decide on a parametric model for describing the systematic errors, a self-tuning data-driven approach is used to model the complex non-linear distortion profile of the sensors. Quality control from the experiment showed that 0.06 mm to 0.09 mm 3D reconstruction accuracy was achievable post-calibration using merely 15 X-ray images. As part of the bundle adjustment, the location of the virtual fluoroscopic system relative to the target field can also be spatially resected with an RMSE between 3.10 mm and 3.31 mm.


title: Knowledge-guided Semantic Computing Network

abstract: It is very useful to integrate human knowledge and experience into traditional neural networks for faster learning speed, fewer training samples and better interpretability. However, due to the obscured and indescribable black box model of neural networks, it is very difficult to design its architecture, interpret its features and predict its performance. Inspired by human visual cognition process, we propose a knowledge-guided semantic computing network which includes two modules: a knowledge-guided semantic tree and a data-driven neural network. The semantic tree is pre-defined to describe the spatial structural relations of different semantics, which just corresponds to the tree-like description of objects based on human knowledge. The object recognition process through the semantic tree only needs simple forward computing without training. Besides, to enhance the recognition ability of the semantic tree in aspects of the diversity, randomicity and variability, we use the traditional neural network to aid the semantic tree to learn some indescribable features. Only in this case, the training process is needed. The experimental results on MNIST and GTSRB datasets show that compared with the traditional data-driven network, our proposed semantic computing network can achieve better performance with fewer training samples and lower computational complexity. Especially, Our model also has better adversarial robustness than traditional neural network with the help of human knowledge.


title: Inferring geometric constraints in human demonstrations

abstract: This paper presents an approach for inferring geometric constraints in human demonstrations. In our method, geometric constraint models are built to create representations of kinematic constraints such as fixed point, axial rotation, prismatic motion, planar motion and others across multiple degrees of freedom. Our method infers geometric constraints using both kinematic and force/torque information. The approach first fits all the constraint models using kinematic information and evaluates them individually using position, force and moment criteria. Our approach does not require information about the constraint type or contact geometry; it can determine both simultaneously. We present experimental evaluations using instrumented tongs that show how constraints can be robustly inferred in recordings of human demonstrations.


title: Neuronized Priors for Bayesian Sparse Linear Regression

abstract: Although Bayesian variable selection methods have been intensively studied, their routine use in practice has not caught up with their non-Bayesian counterparts such as Lasso, likely due to difficulties in both computations and flexibilities of prior choices. To ease these challenges, we propose the neuronized priors to unify and extend some popular shrinkage priors, such as Laplace, Cauchy, horseshoe, and spike-and-slab priors. A neuronized prior can be written as the product of a Gaussian weight variable and a scale variable transformed from Gaussian via an activation function. Compared with classic spike-and-slab priors, the neuronized priors achieve the same explicit variable selection without employing any latent indicator variables, which results in both more efficient and flexible posterior sampling and more effective posterior modal estimation. Theoretically, we provide specific conditions on the neuronized formulation to achieve the optimal posterior contraction rate, and show that a broadly applicable MCMC algorithm achieves an exponentially fast convergence rate under the neuronized formulation. We also examine various simulated and real data examples and demonstrate that using the neuronization representation is computationally more or comparably efficient than its standard counterpart in all well-known cases. An R package NPrior is provided in the CRAN for using neuronized priors in Bayesian linear regression.


title: Resource Allocation for Secure Communications in Cooperative Cognitive Wireless Powered Communication Networks

abstract: We consider a cognitive wireless powered communication network (CWPCN) sharing the spectrum with a primary network who faces security threats from eavesdroppers (EAVs). We propose a new cooperative protocol for the wireless powered secondary users (SU) to cooperate with the primary user (PU). In the protocol, the SUs first harvest energy from the power signals transmitted by the cognitive hybrid access point during the wireless power transfer (WPT) phase, and then use the harvested energy to interfere with the EAVs and gain transmission opportunities at the same time during the wireless information transfer (WIT) phase. Taking the maximization of the SU ergodic rate as the design objective, resource allocation algorithms based on the dual optimization method and the block coordinate descent method are proposed for the cases of perfect channel state information (CSI) and collusive/non-collusive EAVs under the PU secrecy constraint. More PU favorable greedy algorithms aimed at minimizing the PU secrecy outage probability are also proposed. We furthermore consider the unknown EAVs' CSI case and propose an efficient algorithm to improve the PU security performance. Extensive simulations show that our proposed protocol and corresponding resource allocation algorithms can not only let the SU gain transmission opportunities but also improve the PU security performance even with unknown EAVs' CSI.


title: AdaShift: Decorrelation and Convergence of Adaptive Learning Rate Methods

abstract: Adam is shown not being able to converge to the optimal solution in certain cases. Researchers recently propose several algorithms to avoid the issue of non-convergence of Adam, but their efficiency turns out to be unsatisfactory in practice. In this paper, we provide new insight into the non-convergence issue of Adam as well as other adaptive learning rate methods. We argue that there exists an inappropriate correlation between gradient $g_t$ and the second-moment term $v_t$ in Adam ($t$ is the timestep), which results in that a large gradient is likely to have small step size while a small gradient may have a large step size. We demonstrate that such biased step sizes are the fundamental cause of non-convergence of Adam, and we further prove that decorrelating $v_t$ and $g_t$ will lead to unbiased step size for each gradient, thus solving the non-convergence problem of Adam. Finally, we propose AdaShift, a novel adaptive learning rate method that decorrelates $v_t$ and $g_t$ by temporal shifting, i.e., using temporally shifted gradient $g_{t-n}$ to calculate $v_t$. The experiment results demonstrate that AdaShift is able to address the non-convergence issue of Adam, while still maintaining a competitive performance with Adam in terms of both training speed and generalization.


title: Interpreting Adversarial Robustness: A View from Decision Surface in Input Space

abstract: One popular hypothesis of neural network generalization is that the flat local minima of loss surface in parameter space leads to good generalization. However, we demonstrate that loss surface in parameter space has no obvious relationship with generalization, especially under adversarial settings. Through visualizing decision surfaces in both parameter space and input space, we instead show that the geometry property of decision surface in input space correlates well with the adversarial robustness. We then propose an adversarial robustness indicator, which can evaluate a neural network's intrinsic robustness property without testing its accuracy under adversarial attacks. Guided by it, we further propose our robust training method. Without involving adversarial training, our method could enhance network's intrinsic adversarial robustness against various adversarial attacks.


title: A Short Guide to Orbifold Deconstruction

abstract: We study the problem of orbifold deconstruction, i.e., the process of recognizing, using only readily available information, whether a given conformal model can be realized as an orbifold, and the identification of the twist group and the original conformal model.


title: Auto-conditioned Recurrent Mixture Density Networks for Learning Generalizable Robot Skills

abstract: Personal robots assisting humans must perform complex manipulation tasks that are typically difficult to specify in traditional motion planning pipelines, where multiple objectives must be met and the high-level context be taken into consideration. Learning from demonstration (LfD) provides a promising way to learn these kind of complex manipulation skills even from non-technical users. However, it is challenging for existing LfD methods to efficiently learn skills that can generalize to task specifications that are not covered by demonstrations. In this paper, we introduce a state transition model (STM) that generates joint-space trajectories by imitating motions from expert behavior. Given a few demonstrations, we show in real robot experiments that the learned STM can quickly generalize to unseen tasks and synthesize motions having longer time horizons than the expert trajectories. Compared to conventional motion planners, our approach enables the robot to accomplish complex behaviors from high-level instructions without laborious hand-engineering of planning objectives, while being able to adapt to changing goals during the skill execution. In conjunction with a trajectory optimizer, our STM can construct a high-quality skeleton of a trajectory that can be further improved in smoothness and precision. In combination with a learned inverse dynamics model, we additionally present results where the STM is used as a high-level planner. A video of our experiments is available at https://youtu.be/85DX9Ojq-90


title: M$^3$RL: Mind-aware Multi-agent Management Reinforcement Learning

abstract: Most of the prior work on multi-agent reinforcement learning (MARL) achieves optimal collaboration by directly controlling the agents to maximize a common reward. In this paper, we aim to address this from a different angle. In particular, we consider scenarios where there are self-interested agents (i.e., worker agents) which have their own minds (preferences, intentions, skills, etc.) and can not be dictated to perform tasks they do not wish to do. For achieving optimal coordination among these agents, we train a super agent (i.e., the manager) to manage them by first inferring their minds based on both current and past observations and then initiating contracts to assign suitable tasks to workers and promise to reward them with corresponding bonuses so that they will agree to work together. The objective of the manager is maximizing the overall productivity as well as minimizing payments made to the workers for ad-hoc worker teaming. To train the manager, we propose Mind-aware Multi-agent Management Reinforcement Learning (M^3RL), which consists of agent modeling and policy learning. We have evaluated our approach in two environments, Resource Collection and Crafting, to simulate multi-agent management problems with various task settings and multiple designs for the worker agents. The experimental results have validated the effectiveness of our approach in modeling worker agents' minds online, and in achieving optimal ad-hoc teaming with good generalization and fast adaptation.


title: Linear compactness and combinatorial bialgebras

abstract: We present an expository overview of the monoidal structures in the category of linearly compact vector spaces. Bimonoids in this category are the natural duals of infinite-dimensional bialgebras. We classify the relations on words whose equivalence classes generate linearly compact bialgebras under shifted shuffling and deconcatenation. We also extend some of the theory of combinatorial Hopf algebras to bialgebras that are not connected or of finite graded dimension. Finally, we discuss several examples of quasi-symmetric functions, not necessarily of bounded degree, that may be constructed via terminal properties of combinatorial bialgebras.


title: Symbolic and Ordinary Powers of Ideals in Hibi Rings

abstract: We exhibit a class of Hibi rings which are diagonally F-regular over fields of positive characteristic, and diagonally $F$-regular type over fields of characteristic zero, in the sense of Carvajal-Rojas and Smolkin. It follows that such Hibi rings satisfy the uniform symbolic topology property effectively in all characteristics. Namely, for rings $R$ in this class of Hibi rings, we have $P^{(dn)} \subseteq P^n$ for all $P \in \operatorname{Spec} R$, where $d = \dim(R)$. Further, we demonstrate that all Hibi rings over fields of positive characteristic are 2-diagonally $F$-regular, and that the simplest Hibi ring not contained in the above class is not 3-diagonally $F$-regular in any characteristic. The former implies that $P^{(2d)} \subseteq P^2$ for all $P \in \operatorname{Spec} R$.


title: Directional Analysis of Stochastic Gradient Descent via von Mises-Fisher Distributions in Deep learning

abstract: Although stochastic gradient descent (SGD) is a driving force behind the recent success of deep learning, our understanding of its dynamics in a high-dimensional parameter space is limited. In recent years, some researchers have used the stochasticity of minibatch gradients, or the signal-to-noise ratio, to better characterize the learning dynamics of SGD. Inspired from these work, we here analyze SGD from a geometrical perspective by inspecting the stochasticity of the norms and directions of minibatch gradients. We propose a model of the directional concentration for minibatch gradients through von Mises-Fisher (VMF) distribution, and show that the directional uniformity of minibatch gradients increases over the course of SGD. We empirically verify our result using deep convolutional networks and observe a higher correlation between the gradient stochasticity and the proposed directional uniformity than that against the gradient norm stochasticity, suggesting that the directional statistics of minibatch gradients is a major factor behind SGD.


title: Thermal vorticity and spin polarization in heavy-ion collisions

abstract: The hot and dense matter generated in heavy-ion collisions contains intricate vortical structure in which the local fluid vorticity can be very large. Such vorticity can polarize the spin of the produced particles. We study the event-by-event generation of the so-called thermal vorticity in Au + Au collisions at energy region $\sqrt{s}=7.7-200$ GeV and calculate its time evolution, spatial distribution, etc., in a multiphase transport (AMPT) model. We then compute the spin polarization of the $\Lambda$ and $\bar{\Lambda}$ hyperons as a function of $\sqrt{s}$, transverse momentum $p_T$, rapidity, and azimuthal angle. Furthermore, we study the harmonic flow of the spin, in a manner analogous to the harmonic flow of the particle number. The measurement of the spin harmonic flow may provide a way to probe the vortical structure in heavy-ion collisions. We also discuss the spin polarization of $\Xi^0$ and $\Omega^-$ hyperons which may provide further information about the spin polarization mechanism of hadrons.


title: Optimization of the Principal Eigenvalue for Elliptic Operators

abstract: Maximization and minimization problems of the principle eigenvalue for divergence form second order elliptic operators with the Dirichlet boundary condition are considered. The principal eigen map of such elliptic operators is introduced and some basic properties of this map, including continuity, concavity, and differentiability with respect to the parameter in the diffusibility matrix, are established. For maximization problem, the admissible control set is convexified to get the existence of an optimal convexified relaxed solution. Whereas, for minimization problem, the relaxation of the problem under $H$-convergence is introduced to get an optimal $H$-relaxed solution for certain interesting special cases. Some necessary optimality conditions are presented for both problems and a couple of illustrative examples are presented as well.


title: Brown Measure Support and the Free Multiplicative Brownian Motion

abstract: The free multiplicative Brownian motion $b_{t}$ is the large-$N$ limit of Brownian motion $B_t^N$ on the general linear group $\mathrm{GL}(N;\mathbb{C})$. We prove that the Brown measure for $b_{t}$---which is an analog of the empirical eigenvalue distribution for matrices---is supported on the closure of a certain domain $\Sigma_{t}$ in the plane. The domain $\Sigma_t$ was introduced by Biane in the context of the large-$N$ limit of the Segal--Bargmann transform associated to $\mathrm{GL}(N;\mathbb{C})$. We also consider a two-parameter version, $b_{s,t}$: the large-$N$ limit of a related family of diffusion processes on $\mathrm{GL}(N;\mathbb{C})$ introduced by the second author. We show that the Brown measure of $b_{s,t}$ is supported on the closure of a certain planar domain $\Sigma_{s,t}$, generalizing $\Sigma_t$, introduced by Ho. In the process, we introduce a new family of spectral domains related to any operator in a tracial von Neumann algebra: the {\em $L^p_n$-spectrum} for $n\in\mathbb{N}$ and $p\ge 1$, a subset of the ordinary spectrum defined relative to potentially-unbounded inverses. We show that, in general, the support of the Brown measure of an operator is contained in its $L_2^2$-spectrum.

categories: math.FA hep-th math-ph math.MP math.PR quant-ph