title: Noncollinear magnetic structure and magnetoelectric coupling in buckled honeycomb Co$_4$Nb$_2$O$_9$:A single crystal neutron diffraction study

abstract: Through analysis of single crystal neutron diffraction data, we present the magnetic structures of magnetoelectric Co4Nb2O9 under various magnetic fields. In zero-field, neutron diffraction experiments below TN=27 K reveal that the Co2+ moments order primarily along the a* direction without any spin canting along the c axis, manifested by the magnetic symmetry C2/c'. The moments of nearest neighbor Co atoms order ferromagnetically with a small cant away from the next nearest neighbor Co moments along the c axis. In the applied magnetic field H//a, three magnetic domains were aligned with their major magnetic moments perpendicular to the magnetic field with no indication of magnetic phase transitions. The influences of magnetic fields on the magnetic structures associated with the observed magnetoelectric coupling are discussed.


title: Modeling intermolecular and intramolecular modes of liquid water using multiple heat baths: Machine learning approach

abstract: The vibrational motion of molecules in dissipative environments, such as solvation and protein molecules, is composed of contributions from both intermolecular and intramolecular modes. The existence of these collective modes introduces difficulty into quantum simulations of chemical and biological processes. In order to describe the complex molecular motion of the environment in a simple manner, we introduce a system-bath model in which the intramolecular modes with anharmonic mode-mode couplings are described by a system Hamiltonian, while the other degrees of freedom, arising from the environmental molecules, are described by heat bath. Employing a machine-learning based approach, we determine not only the system parameters of the intramolecular modes but also the spectral distribution of the system-bath coupling to describe the intermolecular modes, using the atomic trajectories obtained from molecular dynamics (MD) simulations. The capabilities of the present approach are demonstrated for liquid water using MD trajectories calculated from the SPC/E model and the polarizable water model for intramolecular and intermolecular vibrational spectroscopies (POLI2VS) by determining the system parameters describing the symmetric-stretch, asymmetric-stretch and bend modes with intramolecular interactions and the bath spectral distribution functions for each intramolecular mode representing the interaction with the intra-molecular modes. From these results, we were able to elucidate the energy relaxation pathway between the intramolecular modes and the intermolecular modes in a non-intuitive manner.


title: Comment on "Collision and radiative processes in emission of atmospheric carbon dioxide"

abstract: Recently, Smirnov published a paper (B. M. Smirnov, "Collision and radiative processes in emission of atmospheric carbon dioxide", 2018, J. Phys. D.: Appl. Phys., Vol. 51, No. 21, pp. 214004) which dismisses the role of increasing concentrations of anthropogenic CO$_2$ on global warming of planet Earth. We show that these conclusions are the consequence of two flaws in Smirnov's theoretical model which neglect the effects of the increased concentrations of CO$_2$ on the absorption of Earth's blackbody radiation in the 12-15$\mu$m region. The influence of doubling the concentration of CO$_2$ in the atmosphere on the surface temperature is not $\Delta$T=0.02K, or even $\Delta$T=0.4K if only one of the two mistakes in Smirnov's analysis is corrected. The correct value lies within $\Delta$T=1.1-1.3K as outlined by other authors analysis using simplified, yet more theoretically consistent models.


title: Quantum phase transition of the Bose-Hubbard model on cubic lattice with anisotropic hopping

abstract: In quantum many-body system, dimensionality plays a critical role on type of the quantum phase transition. In order to study the quantum system during dimensional crossover, we studied the Bose-Hubbard model on cubic lattice with anisotropic hopping by using the high order symbolic strong coupling expansion method. The analytic series expanded boundaries between the Mott-insulator and superfluid phase up to eighth order are calculated. The critical exponents are extracted by Pad\'{e} re-summation method, which clearly shows the dimensional crossover behavior. Meanwhile, the critical points at commensurate filling can also be obtained, and they match well with the prediction of renormalization group theory. The scaling of the gap energy and whole phase diagram are given at last, and they can be taken as the benchmark for experiment and numerical simulations in the future study.


title: Morse Index Bound for Minimal Two Spheres

abstract: Given a closed manifold of dimension at least three, with non trivial homotopy group \pi_3(M) and a generic metric, we prove that there is a finite collection of harmonic spheres with Morse index bound one, with sum of their energies realizes a geometric invariant width.


title: On the Premet conjecture for finite W-superalgebras

abstract: Let $\bullet^{\dag}$ be the map in sense of the Losev, which sends the set of two sided ideals of a finite W-algebras to that of the universal enveloping algebra of corresponding Lie algebras. The Premet conjecture which was proved in \cite{Lo11}, says that, restricted to the set of primitive ideals with finite codimension, any fiber of the map $\bullet^{\dag}$ is a single orbit under an action of a finite group. In this article we formulate and prove a similar fact in the super case. This will give a classification to the set of finite dimensional irreducible representations of W-superalgebras provided $C_{e}$ is a trivial group and the set of primitive ideals of the corresponding universal enveloping algebra of Lie superalgebra is known.


title: Determining Model-independent $H_0$ and Consistency Tests

abstract: We determine the Hubble constant $H_0$ precisely ($2.3\%$ uncertainty) in a manner independent of cosmological model through Gaussian process regression, using strong lensing and supernova data. Strong gravitational lensing of a variable source can provide a time-delay distance $D_{\Delta t}$ and angular diameter distance to the lens $D_{\rm{d}}$. These absolute distances can anchor Type Ia supernovae, which give an excellent constraint on the shape of the distance-redshift relation. Updating our previous results to use the H0LiCOW program's milestone dataset consisting of six lenses, four of which have both $D_{\Delta t}$ and $D_{\rm{d}}$ measurements, we obtain $H_0=72.8_{-1.7}^{+1.6}\rm{\ km/s/Mpc}$ for a flat universe and $H_0=77.3_{-3.0}^{+2.2}\rm{\ km/s/Mpc}$ for a non-flat universe. We carry out several consistency checks on the data and find no statistically significant tensions, though a noticeable redshift dependence persists in a particular systematic manner that we investigate. Speculating on the possibility that this trend of derived Hubble constant with lens distance is physical, we show how this can arise through modified gravity light propagation, which would also impact the weak lensing $\sigma_8$ tension.


title: Magnetic twist profile inside magnetic clouds derived with a superposed epoch analysis

abstract: Magnetic clouds (MCs) are large-scale interplanetary transient structures in the heliosphere that travel from the Sun into the interplanetary medium. The internal magnetic field lines inside the MCs are twisted, forming a flux rope (FR). This magnetic field structuring is determined by its initial solar configuration, by the processes involved during its eruption from the Sun, and by the dynamical evolution during its interaction with the ambient solar wind. One of the most important properties of the magnetic structure inside MCs is the twist of the field lines forming the FR (the number of turns per unit length). The detailed internal distribution of twist is under debate mainly because the magnetic field (B) in MCs is observed only along the spacecraft trajectory, and thus it is necessary to complete observations with theoretical assumptions. Estimating the twist from the study of a single event is difficult because the field fluctuations significantly increase the noise of the observed B time series and thus the bias of the deduced twist. The superposed epoch applied to MCs has proven to be a powerful technique, permitting the extraction of their common features, and removing the peculiarity of individual cases. We apply a superposed epoch technique to analyse the magnetic components in the local FR frame of a significant sample of moderately asymmetric MCs observed at 1 au. From the superposed profile of B components in the FR frame, we determine the typical twist distribution in MCs. The twist is nearly uniform in the FR core (central half part), and it increases moderately, up to a factor two, towards the MC boundaries. This profile is close to the Lundquist field model limited to the FR core where the axial field component is above about one-third of its central value.


title: Non-Newtonian Topological Mechanical Metamaterials Using Feedback Control

abstract: We introduce a method to design topological mechanical metamaterials that are not constrained by Newtonian dynamics. The unit cells in a mechanical lattice are subjected to active feedback forces that are processed through autonomous controllers, pre-programmed to generate the desired local response in real-time. As an example, we focus on the quantum Haldane model, which is a two-band system with directional complex coupling terms, violating Newton's third law. We demonstrate that the required topological phase, characterized by chiral edge modes, can be achieved in an analogous mechanical system only with closed-loop control. We then show that our approach enables to realize, for the first time, a modified version of the Haldane model in a mechanical metamaterial. Here, the complex-valued couplings are polarized in a way that modes on opposite edges of a lattice propagate in the same direction, and are balanced by counter-propagating diffusive bulk modes. The proposed method is general and flexible, and could be used to realize arbitrary lattice parameters, such as non-local or nonlinear couplings, time dependent potentials, non-Hermitian dynamics, and more, on a single platform.


title: Strain-Tuned Magnetic Anisotropy in Sputtered Thulium Iron Garnet Ultrathin Films and TIG/Au/TIG Valve Structures

abstract: Defining the magnetic anisotropy for in-plane or out-of-plane easy axis in ferrimagnetic insulators films by controlling the strain, while maintaining high-quality surfaces, is desirable for spintronic and magnonic applications. We investigate ways to tune the anisotropy of amorphous sputtered ultrathin thulium iron garnet (TIG) films, and thus tailor their magnetic properties by the thickness (7.5 to 60 nm), substrate choice (GGG and SGGG), and crystallization process. We correlate morphological and structural properties with the magnetic anisotropy of post-growth annealed films. 30 nm thick films annealed at 600 {\deg}C show compressive strain favoring an in-plane magnetic anisotropy (IPMA), whereas films annealed above 800 {\deg}C are under a tensile strain leading to a perpendicular magnetic anisotropy (PMA). Air-annealed films present a high degree of crystallinity and magnetization saturation close to the bulk value. These results lead to successful fabrication of trilayers TIG/Au/TIG, with coupling between the TIG layers depending on Au thickness. These results will facilitate the use of TIG to create various in situ clean hybrid structures for fundamental interface exchange studies, and towards the development of complex devices. Moreover, the sputtering technique is advantageous as it can be easily scaled up for industrial applications.


title: Consequences of Analytic Boundary Conditions in AdS

abstract: We investigate the effects of an analytic boundary metric for smooth asymptotically anti-de Sitter gravitational solutions. The boundary dynamics is then completely determined by the initial data due to corner conditions that all smooth solutions must obey. We perturb a number of familiar static solutions and explore the boundary dynamics that results. We find evidence for a nonlinear asymptotic instability of the planar black hole in four and six dimensions. In four dimensions we find indications of at least exponential growth, while in six dimensions, it appears that a singularity may form in finite time on the boundary. This instability extends to pure AdS (at least in the Poincare patch). For the class of perturbations we consider, there is no sign of this instability in five dimensions.


title: Federated Learning for Resource-Constrained IoT Devices: Panoramas and State-of-the-art

abstract: Nowadays, devices are equipped with advanced sensors with higher processing/computing capabilities. Further, widespread Internet availability enables communication among sensing devices. As a result, vast amounts of data are generated on edge devices to drive Internet-of-Things (IoT), crowdsourcing, and other emerging technologies. The collected extensive data can be pre-processed, scaled, classified, and finally, used for predicting future events using machine learning (ML) methods. In traditional ML approaches, data is sent to and processed in a central server, which encounters communication overhead, processing delay, privacy leakage, and security issues. To overcome these challenges, each client can be trained locally based on its available data and by learning from the global model. This decentralized learning structure is referred to as Federated Learning (FL). However, in large-scale networks, there may be clients with varying computational resource capabilities. This may lead to implementation and scalability challenges for FL techniques. In this paper, we first introduce some recently implemented real-life applications of FL. We then emphasize on the core challenges of implementing the FL algorithms from the perspective of resource limitations (e.g., memory, bandwidth, and energy budget) of client clients. We finally discuss open issues associated with FL and highlight future directions in the FL area concerning resource-constrained devices.


title: Left-orderability, branched covers and double twist knots

abstract: For some families of two-bridge knots, including double-twist knots with genus at least four, we determine precisely the set of integers $n>1$ such that the fundamental group of the $n$-fold cyclic branched cover of the 3-sphere along these knots is left-orderable. There are knots, including the figure-eight knot, for which this set is empty. We give the first class of hyperbolic knots, not of this type, for which these integers can be completely determined.


title: Semileptonic decays of $\Lambda_c^+$ in dynamical approaches

abstract: We study the semileptonic decays of $\Lambda_c^+ \to \Lambda(n)\ell^+ \nu_{\ell}$ in two relativistic dynamical approaches of the light-front constituent quark model (LFCQM) and MIT bag model (MBM). By considering the Fermi statistic between quarks and determining spin-flavor structures in baryons along with the helicity formalism in the two different dynamical models, we calculate the branching ratios (${\cal B}$s) and averaged asymmetry parameters ($\alpha$s) in the decays. Explicitly, we find that ${\cal B}( \Lambda_c^+ \to \Lambda e^+ \nu_{e})=(3.36\pm0.87,3.48)\%$ and ${\alpha}( \Lambda_c^+ \to \Lambda e^+ \nu_{e})=(-0.97\pm0.03,-0.83)$ in (LFCQM, MBM), in comparison with the data of ${\cal B}( \Lambda_c^+ \to \Lambda e^+ \nu_{e})=(3.6\pm0.4)\%$ and ${\alpha}( \Lambda_c^+ \to \Lambda e^+ \nu_{e})=-0.86\pm 0.04$ given by the Particle Data Group, respectively. We also predict that ${\cal B}( \Lambda_c^+ \to n e^+ \nu_{e})=(0.57\pm0.15, 3.6\pm1.5)\times 10^{-3}$ and ${\alpha}( \Lambda_c^+ \to n e^+ \nu_{e})=(-0.98\pm0.02,-0.96\pm0.04)$ in LFCQM with two different scenarios for the momentum distributions of quarks in the neutron, and ${\cal B}( \Lambda_c^+ \to n e^+ \nu_{e})= 0.279\times 10^{-2}$ and ${\alpha}( \Lambda_c^+ \to n e^+ \nu_{e})=-0.87$ in MBM, which could be tested by the ongoing experiments at BESIII, LHCb and BELLEII.


title: Demonstration of a Thermally-Coupled Row-Column SNSPD Imaging Array

abstract: While single-pixel superconducting nanowire single photon detectors (SNSPDs) have demonstrated remarkable efficiency and timing performance from the UV to near-IR, scaling these devices to large imaging arrays remains challenging. Here, we propose a new SNSPD multiplexing system using thermal coupling and detection correlations between two photosensitive layers of an array. Using this architecture with the channels of one layer oriented in rows and the second layer in columns, we demonstrate imaging capability in 16-pixel arrays with accurate spot tracking at the few photon level. We also explore the performance tradeoffs of orienting the top layer nanowires parallel and perpendicular to the bottom layer. The thermally-coupled row-column scheme is readily able to scale to the kilopixel size with existing readout systems, and when combined with other multiplexing architectures, has the potential to enable megapixel scale SNSPD imaging arrays.


title: Subspace Fitting Meets Regression: The Effects of Supervision and Orthonormality Constraints on Double Descent of Generalization Errors

abstract: We study the linear subspace fitting problem in the overparameterized setting, where the estimated subspace can perfectly interpolate the training examples. Our scope includes the least-squares solutions to subspace fitting tasks with varying levels of supervision in the training data (i.e., the proportion of input-output examples of the desired low-dimensional mapping) and orthonormality of the vectors defining the learned operator. This flexible family of problems connects standard, unsupervised subspace fitting that enforces strict orthonormality with a corresponding regression task that is fully supervised and does not constrain the linear operator structure. This class of problems is defined over a supervision-orthonormality plane, where each coordinate induces a problem instance with a unique pair of supervision level and softness of orthonormality constraints. We explore this plane and show that the generalization errors of the corresponding subspace fitting problems follow double descent trends as the settings become more supervised and less orthonormally constrained.


title: Ghost spintronic THz-emitter-array microscope

abstract: Terahertz (THz) wave shows great potential in non-destructive testing, bio detection and cancer imaging. Recent progresses on THz wave near-field probes/apertures enable mechanically raster scanning of an object's surface in the near-field region, while an efficient, non-scanning, non-invasive, deeply sub-diffraction-limited imaging still remains challenging. Here, we demonstrate a THz near-field microscopy using a reconfigurable spintronic THz emitter array (STEA) with computational ghost imaging. By illuminating an object with the reconfigurable STEA in near field and computing the correlation measurements, we reconstruct its image with deeply sub-diffraction resolution. By circulating an external magnetic field, the in-line polarization rotation of THz waves is realized, making the fused image contrast polarization-free. The time-of-flight (TOF) measurements of coherent THz pulses further enables to resolve objects at different distances or depths. The demonstrated ghost spintronic THz-emitter-array microscope (GHOSTEAM) is a new imaging tool for THz near-field real-time imaging (with potential of video framerate), especially opening up paradigm-shift opportunities in non-intrusive label-free bioimaging in a broadband frequency range from 0.1 THz to 30 THz (namely 3.3-1000 cm-1).


title: How many infections of COVID-19 there will be in the "Diamond Princess"-Predicted by a virus transmission model based on the simulation of crowd flow

abstract: Objectives: Simulate the transmission process of COVID-19 in a cruise ship, and then to judge how many infections there will be in the 3711 people in the "Diamond Princess" and analyze measures that could have prevented mass transmission. Methods: Based on the crowd flow model, the virus transmission rule between pedestrians is established, to simulate the spread of the virus caused by the close contact during pedestrians' daily activities on the cruise ship. Measurements and main results: Three types of simulation scenarios are designed, the Basic scenario focus on the process of virus transmission caused by a virus carrier and the effect of the personal protective measure against the virus. The condition that the original virus carriers had disembarked halfway and more and more people strengthen self-protection are considered in the Self-protection scenario, which would comparatively accord with the actual situation of "Diamond princess" cruise. Control scenario are set to simulate the effect of taking recommended or mandatory measures on virus transmission Conclusions: There are 850~1009 persons (with large probability) who have been infected with COVID-19 during the voyage of "Diamond Princess". The crowd infection percentage would be controlled effectively if the recommended or mandatory measures can be taken immediately during the alert phase of COVID-19 outbreaks.


title: Well-posedness and Regularity for Distribution Dependent SPDEs with Singular Drifts

abstract: In this paper, the distribution dependent stochastic differential equation in a separable Hilbert space with a Dini continuous drift is investigated. The existence and uniqueness of weak and strong solutions are obtained. Moreover, some regularity results as well as gradient estimates and log-Harnack inequality are derived for the associated semigroup. In addition, dimensional free Harnack inequality with power and shift Harnack inequality are also proved when the noise is additive. All of the results extend the ones in the distribution independent situation.


title: Dispersive detection of atomic ensembles in the presence of strong lensing

abstract: We experimentally and theoretically investigate in-medium propagation effects of off-resonant light in dense, spatially homogeneous ultacold atomic gases. Focussing on frequency modulation spectroscopy as the dispersive detection tool of atoms, we observe that the refractive gradient-index lenses presented by localised atomic ensembles can significantly modify the interpretation of the dispersive signal even for large probe detuning, owing to the collective dispersive response of the atoms. We identify criteria for distinguishing between thin and thick atomic lenses, leading to either diffraction-dominated and lensing dominated regimes for the outgoing probe beams. Our findings are consistent with experimental data and solutions of paraxial wave equation for light propagation. Our study provides important practical insights for dispersive, minimally intrusive optical detection and imaging schemes of ultracold atoms and will be valuable for choosing optimal parameter regimes in numerous applications.


title: Three Approaches for Personalization with Applications to Federated Learning

abstract: The standard objective in machine learning is to train a single model for all users. However, in many learning scenarios, such as cloud computing and federated learning, it is possible to learn a personalized model per user. In this work, we present a systematic learning-theoretic study of personalization. We propose and analyze three approaches: user clustering, data interpolation, and model interpolation. For all three approaches, we provide learning-theoretic guarantees and efficient algorithms for which we also demonstrate the performance empirically. All of our algorithms are model-agnostic and work for any hypothesis class.


title: On Reinforcement Learning for Turn-based Zero-sum Markov Games

abstract: We consider the problem of finding Nash equilibrium for two-player turn-based zero-sum games. Inspired by the AlphaGo Zero (AGZ) algorithm, we develop a Reinforcement Learning based approach. Specifically, we propose Explore-Improve-Supervise (EIS) method that combines "exploration", "policy improvement"' and "supervised learning" to find the value function and policy associated with Nash equilibrium. We identify sufficient conditions for convergence and correctness for such an approach. For a concrete instance of EIS where random policy is used for "exploration", Monte-Carlo Tree Search is used for "policy improvement" and Nearest Neighbors is used for "supervised learning", we establish that this method finds an $\varepsilon$-approximate value function of Nash equilibrium in $\widetilde{O}(\varepsilon^{-(d+4)})$ steps when the underlying state-space of the game is continuous and $d$-dimensional. This is nearly optimal as we establish a lower bound of $\widetilde{\Omega}(\varepsilon^{-(d+2)})$ for any policy.


title: Model-Based Reinforcement Learning for Physical Systems Without Velocity and Acceleration Measurements

abstract: In this paper, we propose a derivative-free model learning framework for Reinforcement Learning (RL) algorithms based on Gaussian Process Regression (GPR). In many mechanical systems, only positions can be measured by the sensing instruments. Then, instead of representing the system state as suggested by the physics with a collection of positions, velocities, and accelerations, we define the state as the set of past position measurements. However, the equation of motions derived by physical first principles cannot be directly applied in this framework, being functions of velocities and accelerations. For this reason, we introduce a novel derivative-free physically-inspired kernel, which can be easily combined with nonparametric derivative-free Gaussian Process models. Tests performed on two real platforms show that the considered state definition combined with the proposed model improves estimation performance and data-efficiency w.r.t. traditional models based on GPR. Finally, we validate the proposed framework by solving two RL control problems for two real robotic systems.

categories: cs.LG cs.RO cs.SY eess.SP eess.SY stat.ML


title: Fast Loop Closure Detection via Binary Content

abstract: Loop closure detection plays an important role in reducing localization drift in Simultaneous Localization And Mapping (SLAM). It aims to find repetitive scenes from historical data to reset localization. To tackle the loop closure problem, existing methods often leverage on the matching of visual features, which achieve good accuracy but require high computational resources. However, feature point based methods ignore the patterns of image, i.e., the shape of the objects as well as the distribution of objects in an image. It is believed that this information is usually unique for a scene and can be utilized to improve the performance of traditional loop closure detection methods. In this paper we leverage and compress the information into a binary image to accelerate an existing fast loop closure detection method via binary content. The proposed method can greatly reduce the computational cost without sacrificing recall rate. It consists of three parts: binary content construction, fast image retrieval and precise loop closure detection. No offline training is required. Our method is compared with the state-of-the-art loop closure detection methods and the results show that it outperforms the traditional methods at both recall rate and speed.


title: Feasible Computationally Efficient Path Planning for UAV Collision Avoidance

abstract: This paper presents a robust computationally efficient real-time collision avoidance algorithm for Unmanned Aerial Vehicle (UAV), namely Memory-based Wall Following-Artificial Potential Field (MWF-APF) method. The new algorithm switches between Wall-Following Method (WFM) and Artificial Potential Field method (APF) with improved situation awareness capability. Historical trajectory is taken into account to avoid repetitive wrong decision. Furthermore, it can be effectively applied to platform with low computing capability. As an example, a quad-rotor equipped with limited number of Time-of-Flight (TOF) rangefinders is adopted to validate the effectiveness and efficiency of this algorithm. Both software simulation and physical flight test have been conducted to demonstrate the capability of the MWF-APF method in complex scenarios.


title: A spectral triple for noncommutative compact surfaces

abstract: A Dirac operator is presented that will yield a 1+ summable regular even spectral triple for all noncommutative compact surfaces defined as subalgebras of the Toeplitz algebra. Connes' conditions for noncommutative spin geometries are analyzed and it is argued that the failure of some requirements is mainly due to a wrong choice of a noncommutative spin bundle.


title: A Node Embedding Framework for Integration of Similarity-based Drug Combination Prediction

abstract: Motivation: Drug combination is a sensible strategy for disease treatment by improving the efficacy and reducing concomitant side effects. Due to the large number of possible combinations among candidate compounds, exhaustive screening is prohibitive. Currently, a plenty of studies have focused on predicting potential drug combinations. However, these methods are not entirely satisfactory in performance and scalability. Results: In this paper, we proposed a Network Embedding framework in Multiplex Networks (NEMN) to predict synthetic drug combinations. Based on a multiplex drug similarity network, we offered alternative methods to integrate useful information from different aspects and to decide quantitative importance of each network. To explain the feasibility of NEMN, we applied our framework to the data of drug-drug interactions, on which it showed better performance in terms of AUPR and ROC. For Drug combination prediction, we found seven novel drug combinations which have been validated by external sources among the top-ranked predictions of our model.


title: Identification and Validation of the SNV Biomarkers Based on Multi-Dimensional Patterns

abstract: Background: Single nucleotide variants (SNVs) are detected as different distributions of DNA samples of distinct types of cancer patients. Even though, it is an exacting task to select the appropriate method to identify cancer to the greatest extent of SNVs. Results: In this paper, we proposed a biomarker concept based on SNV patterns in different feature dimensions. Raw dataset (2761 samples) consisting of twelve different cancers was obtained from TCGA (The Cancer Genome Atlas). After preliminary screening of 562,321 DNA mutation sites in the samples, the mutation sites were extracted and characterized by cancer types in six different SNV feature dimensions. In this study, we found that the extracted features showed similar distribution in the cluster center of the disease type of the samples. After the initial processing of the raw data, the sample was more focused on the subtype distribution of the cancer or the cancer at the SNV level. We used k-nearest neighbors (KNN) to classify the extracted features and Leave-One-Out cross verified them. The accuracy of classifying is stable at around 97% and reached 97.43% at the highest. During the validation phase, we found validated oncogenes in the loci of the features with the highest importance among nine cancers. Conclusions: In summary, the samples showed consistent patterns according to the cancer in which it belongs. It is feasible to classify the cancer of the sample by the distribution of different dimensions of the SNVs and has a high accuracy. And has potential implications for the discovery of cancer-causing genes.


title: Inducing Equilibria in Networked Public Goods Games through Network Structure Modification

abstract: Networked public goods games model scenarios in which self-interested agents decide whether or how much to invest in an action that benefits not only themselves, but also their network neighbors. Examples include vaccination, security investment, and crime reporting. While every agent's utility is increasing in their neighbors' joint investment, the specific form can vary widely depending on the scenario. A principal, such as a policymaker, may wish to induce large investment from the agents. Besides direct incentives, an important lever here is the network structure itself: by adding and removing edges, for example, through community meetings, the principal can change the nature of the utility functions, resulting in different, and perhaps socially preferable, equilibrium outcomes. We initiate an algorithmic study of targeted network modifications with the goal of inducing equilibria of a particular form. We study this question for a variety of equilibrium forms (induce all agents to invest, at least a given set $S$, exactly a given set $S$, at least $k$ agents), and for a variety of utility functions. While we show that the problem is NP-complete for a number of these scenarios, we exhibit a broad array of scenarios in which the problem can be solved in polynomial time by non-trivial reductions to (minimum-cost) matching problems.


title: Free boundary regularity in the triple membrane problem

abstract: We investigate the regularity of the free boundaries in the 3 elastic membranes problem. We show that the two free boundaries corresponding to the coincidence regions between consecutive membranes are $C^{1,\log}$-hypersurfaces near a regular intersection point. We also study two types of singular intersections. The first type of singular points are locally covered by a $C^{1,\alpha}$-hypersurface. The second type of singular points stratify and each stratum is locally covered by a $C^1$-manifold.


title: Alternating Minimization Based Trajectory Generation for Quadrotor Aggressive Flight

abstract: With much research has been conducted into trajectory planning for quadrotors, planning with spatial and temporal optimal trajectories in real-time is still challenging. In this paper, we propose a framework for generating large-scale piecewise polynomial trajectories for aggressive autonomous flights, with highlights on its superior computational efficiency and simultaneous spatial-temporal optimality. Exploiting the implicitly decoupled structure of the planning problem, we conduct alternating minimization between boundary conditions and time durations of trajectory pieces. In each minimization phase, we leverage the algebraic convenience of the sub-problem to escape poor local minima and achieve the lowest time consumption. Theoretical analysis for the global/local convergence rate of our proposed method is provided. Moreover, based on polynomial theory, an extremely fast feasibility check method is designed for various kinds of constraints. By incorporating the method into our alternating structure, a constrained minimization algorithm is constructed to optimize trajectories on the premise of feasibility. Benchmark evaluation shows that our algorithm outperforms state-of-the-art methods regarding efficiency, optimality, and scalability. Aggressive flight experiments in a limited space with dense obstacles are presented to demonstrate the performance of the proposed algorithm. We release our implementation as an open-source ros-package.


title: A Possible Origin of kHZ QPOs in Low-Mass X-ray Binaries

abstract: A possible origin of kHz QPOs in low-mass X-ray binaries is proposed. Recent numerical MHD simulations of accretion disks with turbulent magnetic fields of MRI definitely show the presence of two-armed spiral structure in quasi-steady state of accretion disks. In such deformed disks, two-armed ($m=2$) c-mode ($n=1$) oscillations are excited by wave-wave resonant instability. Among these excited oscillations, the fundamental in the radial direction ($n_r=0$) will be the higher kHz QPO of a twin QPOs, and the first overtone ($n_r=1$) in the radial direction will be the lower kHz QPO of the twin. A possible cause of the twin high-frequency QPOs (HFQPOs) in BH X-ray binaries is also discussed.


title: Batch norm with entropic regularization turns deterministic autoencoders into generative models

abstract: The variational autoencoder is a well defined deep generative model that utilizes an encoder-decoder framework where an encoding neural network outputs a non-deterministic code for reconstructing an input. The encoder achieves this by sampling from a distribution for every input, instead of outputting a deterministic code per input. The great advantage of this process is that it allows the use of the network as a generative model for sampling from the data distribution beyond provided samples for training. We show in this work that utilizing batch normalization as a source for non-determinism suffices to turn deterministic autoencoders into generative models on par with variational ones, so long as we add a suitable entropic regularization to the training objective.


title: Genetic Algorithm-Guided Deep Learning of Grain Boundary Diagrams: Addressing the Challenge of Five Degrees of Freedom

abstract: Grain boundaries (GBs) often control the processing and properties of polycrystalline materials. Here, a potentially transformative research is represented by constructing GB property diagrams as functions of temperature and bulk composition, also called "complexion diagrams," as a general materials science tool on par with phase diagrams. However, a GB has five macroscopic (crystallographic) degrees of freedom (DOFs). It is essentially a "mission impossible" to construct property diagrams for GBs as a function of five DOFs by either experiments or modeling. Herein, we combine isobaric semi-grand-canonical ensemble hybrid Monte Carlo and molecular dynamics (hybrid MC/MD) simulations with a genetic algorithm (GA) and deep neural network (DNN) models to tackle this grand challenge. The DNN prediction is ~108 faster than atomistic simulations, thereby enabling the construction of the property diagrams for millions of distinctly different GBs of five DOFs. Notably, excellent prediction accuracies have been achieved for not only symmetric-tilt and twist GBs, but also asymmetric-tilt and mixed tilt-twist GBs; the latter are more complex and much less understood, but they are ubiquitous and often limit the performance properties of real polycrystals as the weak links. The data-driven prediction of GB properties as function of temperature, bulk composition, and five crystallographic DOFs (i.e., in a 7D space) opens a new paradigm.


title: An Adaptive QRS Detection Algorithm for Ultra-Long-Term ECG Recordings

abstract: Background: Accurate detection of QRS complexes during mobile, ultra-long-term ECG monitoring is challenged by instances of high heart rate, dramatic and persistent changes in signal amplitude, and intermittent deformations in signal quality that arise due to subject motion, background noise, and misplacement of the ECG electrodes. Purpose: We propose a revised QRS detection algorithm which addresses the above-mentioned challenges. Methods and Results: Our proposed algorithm is based on a state-of-the-art algorithm after applying two key modifications. The first modification is implementing local estimates for the amplitude of the signal. The second modification is a mechanism by which the algorithm becomes adaptive to changes in heart rate. We validated our proposed algorithm against the state-of-the-art algorithm using short-term ECG recordings from eleven annotated databases available at Physionet, as well as four ultra-long-term (14-day) ECG recordings which were visually annotated at a central ECG core laboratory. On the database of ultra-long-term ECG recordings, our proposed algorithm showed a sensitivity of 99.90% and a positive predictive value of 99.73%. Meanwhile, the state-of-the-art QRS detection algorithm achieved a sensitivity of 99.30% and a positive predictive value of 99.68% on the same database. The numerical efficiency of our new algorithm was evident, as a 14-day recording sampled at 200 Hz was analyzed in approximately 157 seconds. Conclusions: We developed a new QRS detection algorithm. The efficiency and accuracy of our algorithm makes it a good fit for mobile health applications, ultra-long-term and pathological ECG recordings, and the batch processing of large ECG databases.


title: Ultramafic talc-carbonate unit -- The North Pole Dome and Dresser Formation

abstract: Here we describe the ultramafic talc-carbonate unit of the North Pole Dome. The North Pole Dome (NPD) is located in the centre of the East Pilbara Terrane (Van Kranendonk et al., 2007). The NPD is a structural dome of bedded, dominantly mafic volcanic rocks of the Warrawoona and Kelly Groups that dip gently away from the North Pole Monzogranite exposed in the core of the dome (Figure 1) (Van Kranendonk, 1999, 2000). Average dips vary from 30 to 60 degrees in the inner part of the dome to about 60 to 80 degrees in the outer part of the dome (Van Kranendonk, 2000). The North Pole Monzogranite is interpreted to represent a syn-volcanic laccolith to the Panorama Formation (Thorpe et al., 1992) and has been estimated to extend approximately 1.5km below the surface, based on gravity surveys (Blewett et al., 2004). Felsic volcanic formations are interbedded with the greenstones (Hickman, 1983), and these are capped by cherts that indicate hiatuses in volcanism (Barley, 1993; Van Kranendonk, 2006). An overall arc-related model for hydrothermal activity is favored by Barley (1993), whereas more recent studies have indicated a mantle-plume model for igneous and hydrothermal activity at the North Pole Dome (Van Kranendonk et al., 2002, 2007; Smithies et al., 2003; Van Kranendonk and Pirajno, 2004).


title: Formalizing Data Deletion in the Context of the Right to be Forgotten

abstract: The right of an individual to request the deletion of their personal data by an entity that might be storing it -- referred to as the right to be forgotten -- has been explicitly recognized, legislated, and exercised in several jurisdictions across the world, including the European Union, Argentina, and California. However, much of the discussion surrounding this right offers only an intuitive notion of what it means for it to be fulfilled -- of what it means for such personal data to be deleted. In this work, we provide a formal definitional framework for the right to be forgotten using tools and paradigms from cryptography. In particular, we provide a precise definition of what could be (or should be) expected from an entity that collects individuals' data when a request is made of it to delete some of this data. Our framework captures several, though not all, relevant aspects of typical systems involved in data processing. While it cannot be viewed as expressing the statements of current laws (especially since these are rather vague in this respect), our work offers technically precise definitions that represent possibilities for what the law could reasonably expect, and alternatives for what future versions of the law could explicitly require. Finally, with the goal of demonstrating the applicability of our framework and definitions, we consider various natural and simple scenarios where the right to be forgotten comes up. For each of these scenarios, we highlight the pitfalls that arise even in genuine attempts at implementing systems offering deletion guarantees, and also describe technological solutions that provably satisfy our definitions. These solutions bring together techniques built by various communities.


title: Non-Volatile Memory Array Based Quantization- and Noise-Resilient LSTM Neural Networks

abstract: In cloud and edge computing models, it is important that compute devices at the edge be as power efficient as possible. Long short-term memory (LSTM) neural networks have been widely used for natural language processing, time series prediction and many other sequential data tasks. Thus, for these applications there is increasing need for low-power accelerators for LSTM model inference at the edge. In order to reduce power dissipation due to data transfers within inference devices, there has been significant interest in accelerating vector-matrix multiplication (VMM) operations using non-volatile memory (NVM) weight arrays. In NVM array-based hardware, reduced bit-widths also significantly increases the power efficiency. In this paper, we focus on the application of quantization-aware training algorithm to LSTM models, and the benefits these models bring in terms of resilience against both quantization error and analog device noise. We have shown that only 4-bit NVM weights and 4-bit ADC/DACs are needed to produce equivalent LSTM network performance as floating-point baseline. Reasonable levels of ADC quantization noise and weight noise can be naturally tolerated within our NVMbased quantized LSTM network. Benchmark analysis of our proposed LSTM accelerator for inference has shown at least 2.4x better computing efficiency and 40x higher area efficiency than traditional digital approaches (GPU, FPGA, and ASIC). Some other novel approaches based on NVM promise to deliver higher computing efficiency (up to 4.7x) but require larger arrays with potential higher error rates.


title: Sparsity-promoting algorithms for the discovery of informative Koopman invariant subspaces

abstract: Koopman decomposition is a non-linear generalization of eigen-decomposition, and is being increasingly utilized in the analysis of spatio-temporal dynamics. Well-known techniques such as the dynamic mode decomposition (DMD) and its linear variants provide approximations to the Koopman operator, and have been applied extensively in many fluid dynamic problems. Despite being endowed with a richer dictionary of nonlinear observables, nonlinear variants of the DMD, such as extended/kernel dynamic mode decomposition (EDMD/KDMD) are seldom applied to large-scale problems primarily due to the difficulty of discerning the Koopman invariant subspace from thousands of resulting Koopman eigenmodes. To address this issue, we propose a framework based on multi-task feature learning to extract the most informative Koopman invariant subspace by removing redundant and spurious Koopman triplets. In particular, we develop a pruning procedure that penalizes departure from linear evolution. These algorithms can be viewed as sparsity promoting extensions of EDMD/KDMD. Further, we extend KDMD to a continuous-time setting and show a relationship between the present algorithm, sparsity-promoting DMD, and an empirical criterion from the viewpoint of non-convex optimization. The effectiveness of our algorithm is demonstrated on examples ranging from simple dynamical systems to two-dimensional cylinder wake flows at different Reynolds numbers and a three-dimensional turbulent ship air-wake flow. The latter two problems are designed such that very strong nonlinear transients are present, thus requiring an accurate approximation of the Koopman operator. Underlying physical mechanisms are analyzed, with an emphasis on characterizing transient dynamics. The results are compared to existing theoretical expositions and numerical approximations.


title: Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training

abstract: Learning to navigate in a visual environment following natural-language instructions is a challenging task, because the multimodal inputs to the agent are highly variable, and the training data on a new task is often limited. In this paper, we present the first pre-training and fine-tuning paradigm for vision-and-language navigation (VLN) tasks. By training on a large amount of image-text-action triplets in a self-supervised learning manner, the pre-trained model provides generic representations of visual environments and language instructions. It can be easily used as a drop-in for existing VLN frameworks, leading to the proposed agent called Prevalent. It learns more effectively in new tasks and generalizes better in a previously unseen environment. The performance is validated on three VLN tasks. On the Room-to-Room benchmark, our model improves the state-of-the-art from 47% to 51% on success rate weighted by path length. Further, the learned representation is transferable to other VLN tasks. On two recent tasks, vision-and-dialog navigation and "Help, Anna!" the proposed Prevalent leads to significant improvement over existing methods, achieving a new state of the art.


title: On free products of graphs

abstract: We define a free product of connected simple graphs that is equivalent to several existing definitions when the graphs are vertex-transitive but differs otherwise. The new definition is designed for the automorphism group of the free product to be as large as possible, and we give sufficient criteria for it to be non-discrete. Finally, we transfer Tits' classification of automorphisms of trees and simplicity criterion to free products of graphs.


title: Differentiable Reasoning over a Virtual Knowledge Base

abstract: We consider the task of answering complex multi-hop questions using a corpus as a virtual knowledge base (KB). In particular, we describe a neural module, DrKIT, that traverses textual data like a KB, softly following paths of relations between mentions of entities in the corpus. At each step the module uses a combination of sparse-matrix TFIDF indices and a maximum inner product search (MIPS) on a special index of contextual representations of the mentions. This module is differentiable, so the full system can be trained end-to-end using gradient based methods, starting from natural language inputs. We also describe a pretraining scheme for the contextual representation encoder by generating hard negative examples using existing knowledge bases. We show that DrKIT improves accuracy by 9 points on 3-hop questions in the MetaQA dataset, cutting the gap between text-based and KB-based state-of-the-art by 70%. On HotpotQA, DrKIT leads to a 10% improvement over a BERT-based re-ranking approach to retrieving the relevant passages required to answer a question. DrKIT is also very efficient, processing 10-100x more queries per second than existing multi-hop systems.


title: RMB-DPOP: Refining MB-DPOP by Reducing Redundant Inferences

abstract: MB-DPOP is an important complete algorithm for solving Distributed Constraint Optimization Problems (DCOPs) by exploiting a cycle-cut idea to implement memory-bounded inference. However, each cluster root in the algorithm is responsible for enumerating all the instantiations of its cycle-cut nodes, which would cause redundant inferences when its branches do not have the same cycle-cut nodes. Additionally, a large number of cycle-cut nodes and the iterative nature of MB-DPOP further exacerbate the pathology. As a result, MB-DPOP could suffer from huge coordination overheads and cannot scale up well. Therefore, we present RMB-DPOP which incorporates several novel mechanisms to reduce redundant inferences and improve the scalability of MB-DPOP. First, using the independence among the cycle-cut nodes in different branches, we distribute the enumeration of instantiations into different branches whereby the number of nonconcurrent instantiations reduces significantly and each branch can perform memory bounded inference asynchronously. Then, taking the topology into the consideration, we propose an iterative allocation mechanism to choose the cycle-cut nodes that cover a maximum of active nodes in a cluster and break ties according to their relative positions in a pseudo-tree. Finally, a caching mechanism is proposed to further reduce unnecessary inferences when the historical results are compatible with the current instantiations. We theoretically show that with the same number of cycle-cut nodes RMB-DPOP requires as many messages as MB-DPOP in the worst case and the experimental results show our superiorities over the state-of-the-art.


title: The super Frobenius-Schur indicator and finite group gauge theories on pin$^-$ surfaces

abstract: It is well-known that the value of the Frobenius-Schur indicator $|G|^{-1} \sum_{g\in G} \chi(g^2)=\pm1$ of a real irreducible representation of a finite group $G$ determines which of the two types of real representations it belongs to, i.e. whether it is strictly real or quaternionic. We study the extension to the case when a homomorphism $\varphi:G\to \mathbb{Z}/2\mathbb{Z}$ gives the group algebra $\mathbb{C}[G]$ the structure of a superalgebra. Namely, we construct of a super version of the Frobenius-Schur indicator whose value for a real irreducible super representation is an eighth root of unity, distinguishing which of the eight types of irreducible real super representations described in [Wall1964] it belongs to. We also discuss its significance in the context of two-dimensional finite-group gauge theories on pin$^-$ surfaces.

categories: math.RT cond-mat.str-el hep-th math-ph math.MP


title: Locally constrained curvature flows and geometric inequalities in hyperbolic space

abstract: In this paper, we first study the locally constrained curvature flow of hypersurfaces in hyperbolic space, which was introduced by Brendle, Guan and Li [7]. This flow preserves the $m$th quermassintegral and decreases $(m+1)$th quermassintegral, so the convergence of the flow yields sharp Alexandrov-Fenchel type inequalities in hyperbolic space. Some special cases have been studied in [7]. In the first part of this paper, we show that h-convexity of the hypersurface is preserved along the flow and then the smooth convergence of the flow for h-convex hypersurfaces follows. We then apply this result to establish some new sharp geometric inequalities comparing the integral of $k$th Gauss-Bonnet curvature of a smooth h-convex hypersurface to its $m$th quermassintegral (for $0\leq m\leq 2k+1\leq n$), and comparing the weighted integral of $k$th mean curvature to its $m$th quermassintegral (for $0\leq m\leq k\leq n$). In particular, we give an affirmative answer to a conjecture proposed by Ge, Wang and Wu in 2015. In the second part of this paper, we introduce a new locally constrained curvature flow using the shifted principal curvatures. This is natural in the context of h-convexity. We prove the smooth convergence to a geodesic sphere of the flow for h-convex hypersurfaces, and provide a new proof of the geometric inequalities proved by Andrews, Chen and the third author of this paper in 2018. We also prove a family of new sharp inequalities involving the weighted integral of $k$th shifted mean curvature for h-convex hypersurfaces, which as application implies a higher order analogue of Brendle, Hung and Wang's [8] inequality.


title: The SPOTS Models: A Grid of Theoretical Stellar Evolution Tracks and Isochrones For Testing The Effects of Starspots on Structure and Colors

abstract: One-dimensional stellar evolution models have been successful at representing the structure and evolution of stars in diverse astrophysical contexts, but complications have been noted in the context of young, magnetically active stars, as well as close binary stars with significant tidal interactions. Numerous puzzles are associated with pre-main sequence and active main-sequence stars, relating to their radii, their colors, certain elemental abundances, and the coevality of young clusters, among others. A promising explanation for these puzzles is the distorting effects of magnetic activity and starspots on the structure of active stars. To assist the community in evaluating this hypothesis, we present the Stellar Parameters Of Tracks with Starspots (SPOTS) models, a grid of solar-metallicity stellar evolutionary tracks and isochrones which include a treatment of the structural effects of starspots. The models range from 0.1-1.3\msun and from spot-less to a surface covering fraction of 85\%, and are evolved from the pre-main sequence to the red giant branch (or 15~Gyr). We also produce two-temperature synthetic colors for our models using empirically-calibrated color tables. We describe the physical ingredients included in the SPOTS models and compare their predictions to other modern evolution codes. Finally, we apply these models to several open questions in the field of active stars, including the radii of young eclipsing binaries, the color scale of pre-main sequence stars, and the existence of sub-subgiants, demonstrating that our models can explain many peculiar features of active stars.


title: Multivariate time-series modeling with generative neural networks

abstract: Generative moment matching networks (GMMNs) are introduced as dependence models for the joint innovation distribution of multivariate time series (MTS). Following the popular copula-GARCH approach for modeling dependent MTS data, a framework based on a GMMN-GARCH approach is presented. First, ARMA-GARCH models are utilized to capture the serial dependence within each univariate marginal time series. Second, if the number of marginal time series is large, principal component analysis (PCA) is used as a dimension-reduction step. Last, the remaining cross-sectional dependence is modeled via a GMMN, the main contribution of this work. GMMNs are highly flexible and easy to simulate from, which is a major advantage over the copula-GARCH approach. Applications involving yield curve modeling and the analysis of foreign exchange-rate returns demonstrate the utility of the GMMN-GARCH approach, especially in terms of producing better empirical predictive distributions and making better probabilistic forecasts.


title: A Note on Empty Balanced Tetrahedra in Two colored Point sets in $\mathbb{R}^3$

abstract: Let $S$ be a set of $n$ red and $n$ blue points in general position in $\mathbb{R}^3$. Let $\tau$ be a tetrahedra with vertices on $S$. We say that $\tau$ is \emph{empty} if it does not contain any point of $S$ in its interior. We say that $\tau$ is \emph{balanced} if it contains two blue vertices and two red vertices. In this paper we show that $S$ spans $\Omega(n^{5/2})$ empty balanced tetrahedra.


title: KAM estimates for the dissipative standard map

abstract: From the beginning of KAM theory, it was realized that its applicability to realistic problems depended on developing quantitative estimates on the sizes of the perturbations allowed. In this paper we present results on the existence of quasi-periodic solutions for conformally symplectic systems in non-perturbative regimes. We recall that, for conformally symplectic systems, finding the solution requires also to find a "drift parameter". We present a proof on the existence of solutions for values of the parameters which agree with more than three figures with the numerically conjectured optimal values. The verification of the estimates presented here is not completely rigorous since we do not control the round-off error. Nevertheless, running with different precision shows very little difference in the results. Given the high precision of the calculation and the simplicity of the estimates, this does not seem to affect the results. A full verification should be done implementing interval arithmetic. We make available the approximate solutions, the highly efficient algorithms to generate them (incorporating high precision based on the MPFR library) and the routines used to verify the applicability of the theorem.


title: I Am Going MAD: Maximum Discrepancy Competition for Comparing Classifiers Adaptively

abstract: The learning of hierarchical representations for image classification has experienced an impressive series of successes due in part to the availability of large-scale labeled data for training. On the other hand, the trained classifiers have traditionally been evaluated on small and fixed sets of test images, which are deemed to be extremely sparsely distributed in the space of all natural images. It is thus questionable whether recent performance improvements on the excessively re-used test sets generalize to real-world natural images with much richer content variations. Inspired by efficient stimulus selection for testing perceptual models in psychophysical and physiological studies, we present an alternative framework for comparing image classifiers, which we name the MAximum Discrepancy (MAD) competition. Rather than comparing image classifiers using fixed test images, we adaptively sample a small test set from an arbitrarily large corpus of unlabeled images so as to maximize the discrepancies between the classifiers, measured by the distance over WordNet hierarchy. Human labeling on the resulting model-dependent image sets reveals the relative performance of the competing classifiers, and provides useful insights on potential ways to improve them. We report the MAD competition results of eleven ImageNet classifiers while noting that the framework is readily extensible and cost-effective to add future classifiers into the competition. Codes can be found at https://github.com/TAMU-VITA/MAD.


title: Data analytics approach to predict the hardness of the copper matrix composites

abstract: Copper matrix composite materials have exhibited a high potential in applications where excellent conductivity and mechanical properties are required. In this study, the machine learning models have been applied to predict the hardness of the copper matrix composite materials produced via powder metallurgy technique. Two particular composites were considered in this work. From experiments, we extracted the independent variables (features) like the milling time (MT, Hours), dislocation density (DD, 1/m2 ), average particle size (PS,nm), density (gm/cm3 ) and yield stress (MPa) while the Vickers Hardness (MPa) was used as the dependent variable. Feature selection was performed by calculation the Pearson correlation coefficient (PCC) between the independent and dependent variables. We employed six different machine learning regression models to predict the hardness for the two matrix composites.


title: Copy and Paste GAN: Face Hallucination from Shaded Thumbnails

abstract: Existing face hallucination methods based on convolutional neural networks (CNN) have achieved impressive performance on low-resolution (LR) faces in a normal illumination condition. However, their performance degrades dramatically when LR faces are captured in low or non-uniform illumination conditions. This paper proposes a Copy and Paste Generative Adversarial Network (CPGAN) to recover authentic high-resolution (HR) face images while compensating for low and non-uniform illumination. To this end, we develop two key components in our CPGAN: internal and external Copy and Paste nets (CPnets). Specifically, our internal CPnet exploits facial information residing in the input image to enhance facial details; while our external CPnet leverages an external HR face for illumination compensation. A new illumination compensation loss is thus developed to capture illumination from the external guided face image effectively. Furthermore, our method offsets illumination and upsamples facial details alternately in a coarse-to-fine fashion, thus alleviating the correspondence ambiguity between LR inputs and external HR inputs. Extensive experiments demonstrate that our method manifests authentic HR face images in a uniform illumination condition and outperforms state-of-the-art methods qualitatively and quantitatively.


title: A Comparative Evaluation of Temporal Pooling Methods for Blind Video Quality Assessment

abstract: Many objective video quality assessment (VQA) algorithms include a key step of temporal pooling of frame-level quality scores. However, less attention has been paid to studying the relative efficiencies of different pooling methods on no-reference (blind) VQA. Here we conduct a large-scale comparative evaluation to assess the capabilities and limitations of multiple temporal pooling strategies on blind VQA of user-generated videos. The study yields insights and general guidance regarding the application and selection of temporal pooling models. In addition, we also propose an ensemble pooling model built on top of high-performing temporal pooling models. Our experimental results demonstrate the relative efficacies of the evaluated temporal pooling models, using several popular VQA algorithms, and evaluated on two recent large-scale natural video quality databases. In addition to the new ensemble model, we provide a general recipe for applying temporal pooling of frame-based quality predictions.


title: Interval State Estimation with Uncertainty of Distributed Generation and Line Parameters in Unbalanced Distribution Systems

abstract: Distribution system state estimation (DSSE), which provides critical information for system monitoring and control, is being challenged by multiple sources of uncertainties such as random meter errors, stochastic power output of distributed generation (DG), and imprecise network parameters. This paper originally proposes a general interval state estimation (ISE) model to simultaneously formulate these uncertainties in unbalanced distribution systems by interval arithmetic. Moreover, this model can accommodate partially available measurements of DG outputs and inaccurate line parameters. Further, a modified Krawczyk-operator (MKO) algorithm is proposed to solve the general ISE model efficiently, and effectively provides the upper and lower bounds of state variables under coordinated impacts of these uncertainties. The proposed algorithm is tested on unbalanced IEEE 13-bus and 123-bus systems. Comparison with various methods including Monte Carlo simulation indicates that the proposed algorithm is many orders of magnitude faster and encloses tighter boundaries of state variables.


title: Universal fast flux control of a coherent, low-frequency qubit

abstract: The \textit{heavy-fluxonium} circuit is a promising building block for superconducting quantum processors due to its long relaxation and dephasing time at the half-flux frustration point. However, the suppressed charge matrix elements and low transition frequency have made it challenging to perform fast single-qubit gates using standard protocols. We report on new protocols for reset, fast coherent control, and readout, that allow high-quality operation of the qubit with a 14 MHz transition frequency, an order of magnitude lower in energy than the ambient thermal energy scale. We utilize higher levels of the fluxonium to initialize the qubit with $97$\% fidelity, corresponding to cooling it to $190~\mathrm{\mu K}$. We realize high-fidelity control using a universal set of single-cycle flux gates, which are comprised of directly synthesizable fast pulses, while plasmon-assisted readout is used for measurements. On a qubit with $T_1, T_{2e}\sim$~300~$\mathrm{\mu s}$, we realize single-qubit gates in $20-60$~ns with an average gate fidelity of $99.8\%$ as characterized by randomized benchmarking.


title: The Power of Many Samples in Query Complexity

abstract: The randomized query complexity $R(f)$ of a boolean function $f\colon\{0,1\}^n\to\{0,1\}$ is famously characterized (via Yao's minimax) by the least number of queries needed to distinguish a distribution $D_0$ over $0$-inputs from a distribution $D_1$ over $1$-inputs, maximized over all pairs $(D_0,D_1)$. We ask: Does this task become easier if we allow query access to infinitely many samples from either $D_0$ or $D_1$? We show the answer is no: There exists a hard pair $(D_0,D_1)$ such that distinguishing $D_0^\infty$ from $D_1^\infty$ requires $\Theta(R(f))$ many queries. As an application, we show that for any composed function $f\circ g$ we have $R(f\circ g) \geq \Omega(\mathrm{fbs}(f)R(g))$ where $\mathrm{fbs}$ denotes fractional block sensitivity.


title: Attack Identification and Correction for PMU GPS Spoofing in Unbalanced Distribution Systems

abstract: Due to the vulnerability of civilian global positioning system (GPS) signals, the accuracy of phasor measurement units (PMUs) can be greatly compromised by GPS spoofing attacks (GSAs), which introduce phase shifts into true phase angle measurements. Focusing on simultaneous GSAs for multiple PMU locations, this paper proposes a novel identification and correction algorithm in distribution systems. A sensitivity analysis of state estimation residuals on a single GSA phase angle is firstly implemented. An identification algorithm using a probing technique is proposed to determine the locations of spoofed PMUs and the ranges of GSA phase shifts. Based on the identification results, these GSA phase shifts are determined via an estimation algorithm that minimizes the mismatch between measurements and system states. Further, with the attacked PMU data corrected, the system states are recovered. Simulations in unbalanced IEEE 34-bus and 123-bus distribution systems demonstrates the efficiency and accuracy of the proposed method.


title: Enhancing Physical Layer Security of Random Caching in Large-Scale Multi-Antenna Heterogeneous Wireless Networks

abstract: In this paper, we propose a novel secure random caching scheme for large-scale multi-antenna heterogeneous wireless networks, where the base stations (BSs) deliver randomly cached confidential contents to the legitimate users in the presence of passive eavesdroppers as well as active jammers. In order to safeguard the content delivery, we consider that the BSs transmits the artificial noise together with the useful signals. By using tools from stochastic geometry, we first analyze the average reliable transmission probability (RTP) and the average confidential transmission probability (CTP), which take both the impact of the eavesdroppers and the impact of the jammers into consideration. We further provide tight upper and lower bounds on the average RTP. These analytical results enable us to obtain rich insights into the behaviors of the average RTP and the average CTP with respect to key system parameters. Moreover, we optimize the caching distribution of the files to maximize the average RTP of the system, while satisfying the constraints on the caching size and the average CTP. Through numerical results, we show that our proposed secure random caching scheme can effectively boost the secrecy performance of the system compared to the existing solutions.


title: Coherent Gradients: An Approach to Understanding Generalization in Gradient Descent-based Optimization

abstract: An open question in the Deep Learning community is why neural networks trained with Gradient Descent generalize well on real datasets even though they are capable of fitting random data. We propose an approach to answering this question based on a hypothesis about the dynamics of gradient descent that we call Coherent Gradients: Gradients from similar examples are similar and so the overall gradient is stronger in certain directions where these reinforce each other. Thus changes to the network parameters during training are biased towards those that (locally) simultaneously benefit many examples when such similarity exists. We support this hypothesis with heuristic arguments and perturbative experiments and outline how this can explain several common empirical observations about Deep Learning. Furthermore, our analysis is not just descriptive, but prescriptive. It suggests a natural modification to gradient descent that can greatly reduce overfitting.


title: The Power of Recourse: Better Algorithms for Facility Location in Online and Dynamic Models

abstract: In this paper we study the facility location problem in the online with recourse and dynamic algorithm models. In the online with recourse model, clients arrive one by one and our algorithm needs to maintain good solutions at all time steps with only a few changes to the previously made decisions (called recourse). We show that the classic local search technique can lead to a $(1+\sqrt{2}+\epsilon)$-competitive online algorithm for facility location with only $O\left(\frac{\log n}{\epsilon}\log\frac1\epsilon\right)$ amortized facility and client recourse. We then turn to the dynamic algorithm model for the problem, where the main goal is to design fast algorithms that maintain good solutions at all time steps. We show that the result for online facility location, combined with the randomized local search technique of Charikar and Guha [10], leads to an $O(1+\sqrt{2}+\epsilon)$ approximation dynamic algorithm with amortized update time of $\tilde O(n)$ in the incremental setting. Notice that the running time is almost optimal, since in general metric space it takes $\Omega(n)$ time to specify a new client's position. The approximation factor of our algorithm also matches the best offline analysis of the classic local search algorithm. Finally, we study the fully dynamic model for facility location, where clients can both arrive and depart. Our main result is an $O(1)$-approximation algorithm in this model with $O(|F|)$ preprocessing time and $O(\log^3 D)$ amortized update time for the HST metric spaces. Using the seminal results of Bartal [4] and Fakcharoenphol, Rao and Talwar [17], which show that any arbitrary $N$-point metric space can be embedded into a distribution over HSTs such that the expected distortion is at most $O(\log N)$, we obtain a $O(\log |F|)$ approximation with preprocessing time of $O(|F|^2\log |F|)$ and $O(\log^3 D)$ amortized update time.


title: Relativistic combination of non-collinear 3-velocities using quaternions

abstract: Quaternions have an (over a century-old) extensive and quite complicated interaction with special relativity. Since quaternions are intrinsically 4-dimensional, and do such a good job of handling 3-dimensional rotations, the hope has always been that the use of quaternions would simplify some of the algebra of the Lorentz transformations. Herein we report a relatively nice result for the relativistic combination of non-collinear 3-velocities. If we work with the relativistic half-velocities $w$ defined by $v={2w\over1+w^2}$, and promote them to quaternions using $\mathbf{w} = w \; \mathbf{\hat n}$, where $\mathbf{\hat n}$ is a unit quaternion, then we shall show \[ \mathbf{w}_{1\oplus2} = \mathbf{w}_1 \oplus \mathbf{w}_2 =(1-\mathbf{w}_1\mathbf{w}_2)^{-1} (\mathbf{w}_1 +\mathbf{w}_2) = (\mathbf{w}_1 +\mathbf{w}_2)(1-\mathbf{w}_2\mathbf{w}_1)^{-1}. \] All of the complicated angular dependence for relativistic combination of non-collinear 3-velocities is now encoded in the quaternion multiplication of $\mathbf{w}_1$ with $\mathbf{w}_2$. This result can furthermore be extended to obtain an elegant and compact formula for the associated Wigner angle: \[ \mathrm{e}^{\mathbf{\Omega}} = \mathrm{e}^{\Omega \; \mathbf{\hat\Omega} } = (1-\mathbf{w}_1\mathbf{w}_2)^{-1} (1-\mathbf{w}_2\mathbf{w}_1), \] in terms of which \[ {\mathbf{\hat{n}}}_{1\oplus2} = \mathrm{e}^{\mathbf{\Omega}/2} \;\; {\mathbf{w}_1+\mathbf{w}_2\over |\mathbf{w}_1+\mathbf{w}_2|}; \qquad\qquad {\mathbf{\hat{n}}}_{2\oplus1} = \mathrm{e}^{-\mathbf{\Omega}/2} \;\; {\mathbf{w}_1+\mathbf{w}_2\over |\mathbf{w}_1+\mathbf{w}_2|}. \] Thus, we would argue, many key results that are ultimately due to the non-commutativity of non-collinear boosts can be easily rephrased in terms of the algebra of quaternions.


title: Electronic and vibrational spectroscopy of miscible MgO-ZnO ternary alloys

abstract: The ordered structure of MgO-ZnO alloy system is a versatile tunable optical material promising for diverse optoelectronic applications. However, isovalent and isostructural alloy compositions of MgO-ZnO are generally unstable at ambient conditions. Using state-of-the-art \textit{ab initio} evolutionary simulations, we predict and study the properties of stable phases of MgO-ZnO. We establish the dynamical stability of the predicted crystal structures through the phonon and Raman spectroscopy. Detailed analyses of two of the most stable structures reveal highly tunable properties that could be explored for photonic and optical applications.


title: Energy Optimization in Extrasolar Planetary Systems: The Transition from Peas-in-a-Pod to Runaway Growth

abstract: Motivated by the trends found in the observed sample of extrasolar planets, this paper determines tidal equilibrium states for forming planetary systems --- subject to conservation of angular momentum, constant total mass, and fixed orbital spacing. In the low-mass limit, valid for superearth-class planets with masses of order $m_{\rm p}\sim10M_\oplus$, previous work showed that energy optimization leads to nearly equal mass planets, with circular orbits confined to a plane. The present treatment generalizes previous results by including the self-gravity of the planetary bodies. For systems with sufficiently large total mass $m_{\scriptstyle T}$ in planets, the optimized energy state switches over from the case of nearly equal mass planets to a configuration where one planet contains most of the material. This transition occurs for a critical mass threshold of approximately $m_{\scriptstyle T} \ge m_{\scriptstyle C}\sim40M_\oplus$ (where the value depends on the semimajor axes of the planetary orbits, the stellar mass, and other system properties). These considerations of energy optimization apply over a wide range of mass scales, from binary stars to planetary systems to the collection of moons orbiting the giant planets in our solar system.


title: Secure and efficient synchronization scheme for quantum key distribution

abstract: To establish a time reference frame between two users in quantum key distribution, a synchronization calibration process is usually applied for the case of using gated mode single-photon detectors (SPDs). Traditionally, the synchronization calibration is independently implemented by the line length measurement for each SPD. However, this will leave a loophole which has been experimentally demonstrated by a special attack. Here, we propose an alternative synchronization scheme by fixing the relative delay of the signal time window among all SPDs and jointly performing the line length measurement with multiple SPDs under combining low-precision with high-precision synchronization. The new scheme is not only immune to the vulnerability but also improves the synchronization time from usually a few seconds to tens of milliseconds.


title: Learning Beam Codebooks with Neural Networks: Towards Environment-Aware mmWave MIMO

abstract: Scaling the number of antennas up is a key characteristic of current and future wireless communication systems. The hardware cost and power consumption, however, motivate large-scale MIMO systems, especially at millimeter wave (mmWave) bands, to rely on analog-only or hybrid analog/digital transceiver architectures. With these architectures, mmWave base stations normally use pre-defined beamforming codebooks for both initial access and data transmissions. Current beam codebooks, however, generally adopt single-lobe narrow beams and scan the entire angular space. This leads to high beam training overhead and loss in the achievable beamforming gains. In this paper, we propose a new machine learning framework for learning beamforming codebooks in hardware-constrained large-scale MIMO systems. More specifically, we develop a neural network architecture that accounts for the hardware constraints and learns beam codebooks that adapt to the surrounding environment and the user locations. Simulation results highlight the capability of the proposed solution in learning multi-lobe beams and reducing the codebook size, which leads to noticeable gains compared to classical codebook design approaches.


title: Derivation of the critical point scaling hypothesis using thermodynamics only

abstract: Based on the foundations of thermodynamics and the equilibrium conditions for the coexistence of two phases in a magnetic Ising-like system, we show, first, that there is a critical point where the isothermal susceptibility diverges and the specific heat may remain finite, and second, that near the critical point the entropy of the system, and therefore all free energies, do obey scaling. Although we limit ourselves to such a system, we elaborate about the possibilities of finding universality, as well as the precise values of the critical exponents using thermodynamics only.


title: Declarative Memory-based Structure for the Representation of Text Data

abstract: In the era of intelligent computing, computational progress in text processing is an essential consideration. Many systems have been developed to process text over different languages. Though, there is considerable development, they still lack in understanding of the text, i.e., instead of keeping text as knowledge, many treat text as a data. In this work we introduce a text representation scheme which is influenced by human memory infrastructure. Since texts are declarative in nature, a structural organization would foster efficient computation over text. We exploit long term episodic memory to keep text information observed over time. This not only keep fragments of text in an organized fashion but also reduces redundancy and stores the temporal relation among them. Wordnet has been used to imitate semantic memory, which works at word level to facilitate the understanding about individual words within text. Experimental results of various operation performed over episodic memory and growth of knowledge infrastructure over time is reported.


title: NuRIA: Numerical Relativity Injection Analysis of spinning binary black hole signals in Advanced LIGO data

abstract: The advent of gravitational wave (GW) astronomy has provided us with observations of black holes more massive than those known from X-ray astronomy. However, the observation of an intermediate-mass black hole (IMBH) remains a big challenge. After their second observing run, the LIGO \& Virgo Scientific collaborations (LVC) placed upper limits on the coalescence rate density of non-precessing IMBH binaries (IMBHBs). In this article, we explore the sensitivity of two of the search pipelines used by the LVC to signals from 69 numerically simulated IMBHBs with generic spins, out of which 27 have a precessing orbital plane. In particular, we compare the matched-filter search PyCBC, and the coherent model-independent search technique cWB. We find that, in general, cWB is more sensitive to IMBHBs than PyCBC, with their difference depending on the masses and spins of the source. Consequently, we use cWB to place the first upper limits on the merger rate of generically spinning IMBH binaries using publicly available data from the first Advanced LIGO observing run.


title: CybORG: An Autonomous Cyber Operations Research Gym

abstract: Autonomous Cyber Operations (ACO) involves the consideration of blue team (defender) and red team (attacker) decision-making models in adversarial scenarios. To support the application of machine learning algorithms to solve this problem, and to encourage such practitioners to attend to problems in the ACO setting, a suitable gym (toolkit for experiments) is necessary. We introduce CybORG, a work-in-progress gym for ACO research. Driven by the need to efficiently support reinforcement learning to train adversarial decision-making models through simulation and emulation, our design differs from prior related work. Our early evaluation provides some evidence that CybORG is appropriate for our purpose and may provide a basis for advancing ACO research towards practical applications.


title: Experimental composable security decoy-state quantum key distribution using time-phase encoding

abstract: Quantum key distribution (QKD) promises provably secure communications. In order to improve the secret key rate, combining a biased basis choice with the decoy-state method is proposed. Concomitantly, there is a basis-independent detection efficiency condition, which usually cannot be satisfied in a practical system, such as the time-phase encoding. Fortunately, this flaw has been recently removed theoretically and experimentally using the fact that the expected yields of single-photon states prepared in two bases stay the same for a given measurement basis. However, the security proofs do not fully consider the finite-key effects for general attacks. In this work, we provide the rigorous finite-key security bounds for four-intensity decoy-state BB84 QKD against coherent attacks in the universally composable framework. Furthermore, we build a time-phase encoding system with 200 MHz clocked to implement this protocol, in which the real-time secret key rate is more than 60 kbps over 50 km single-mode fiber.


title: Binary Scoring Rules that Incentivize Precision

abstract: All proper scoring rules incentivize an expert to predict \emph{accurately} (report their true estimate), but not all proper scoring rules equally incentivize \emph{precision}. Rather than treating the expert's belief as exogenously given, we consider a model where a rational expert can endogenously refine their belief by repeatedly paying a fixed cost, and is incentivized to do so by a proper scoring rule. Specifically, our expert aims to predict the probability that a biased coin flipped tomorrow will land heads, and can flip the coin any number of times today at a cost of $c$ per flip. Our first main result defines an \emph{incentivization index} for proper scoring rules, and proves that this index measures the expected error of the expert's estimate (where the number of flips today is chosen adaptively to maximize the predictor's expected payoff). Our second main result finds the unique scoring rule which optimizes the incentivization index over all proper scoring rules. We also consider extensions to minimizing the $\ell^{th}$ moment of error, and again provide an incentivization index and optimal proper scoring rule. In some cases, the resulting scoring rule is differentiable, but not infinitely differentiable. In these cases, we further prove that the optimum can be uniformly approximated by polynomial scoring rules. Finally, we compare common scoring rules via our measure, and include simulations confirming the relevance of our measure even in domains outside where it provably applies.


title: Exploring BERT Parameter Efficiency on the Stanford Question Answering Dataset v2.0

abstract: In this paper we explore the parameter efficiency of BERT arXiv:1810.04805 on version 2.0 of the Stanford Question Answering dataset (SQuAD2.0). We evaluate the parameter efficiency of BERT while freezing a varying number of final transformer layers as well as including the adapter layers proposed in arXiv:1902.00751. Additionally, we experiment with the use of context-aware convolutional (CACNN) filters, as described in arXiv:1709.08294v3, as a final augmentation layer for the SQuAD2.0 tasks. This exploration is motivated in part by arXiv:1907.10597, which made a compelling case for broadening the evaluation criteria of artificial intelligence models to include various measures of resource efficiency. While we do not evaluate these models based on their floating point operation efficiency as proposed in arXiv:1907.10597, we examine efficiency with respect to training time, inference time, and total number of model parameters. Our results largely corroborate those of arXiv:1902.00751 for adapter modules, while also demonstrating that gains in F1 score from adding context-aware convolutional filters are not practical due to the increase in training and inference time.


title: Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge based Framework

abstract: Internet of Things (IoT) have widely penetrated in different aspects of modern life and many intelligent IoT services and applications are emerging. Recently, federated learning is proposed to train a globally shared model by exploiting a massive amount of user-generated data samples on IoT devices while preventing data leakage. However, the device, statistical and model heterogeneities inherent in the complex IoT environments pose great challenges to traditional federated learning, making it unsuitable to be directly deployed. In this article we advocate a personalized federated learning framework in a cloud-edge architecture for intelligent IoT applications. To cope with the heterogeneity issues in IoT environments, we investigate emerging personalized federated learning methods which are able to mitigate the negative effects caused by heterogeneity in different aspects. With the power of edge computing, the requirements for fast-processing capacity and low latency in intelligent IoT applications can also be achieved. We finally provide a case study of IoT based human activity recognition to demonstrate the effectiveness of personalized federated learning for intelligent IoT applications.


title: Algorithms for Subpath Convex Hull Queries and Ray-Shooting Among Segments

abstract: In this paper, we first consider the subpath convex hull query problem: Given a simple path $\pi$ of $n$ vertices, preprocess it so that the convex hull of any query subpath of $\pi$ can be quickly obtained. Previously, Guibas, Hershberger, and Snoeyink [SODA 90'] proposed a data structure of $O(n)$ space and $O(\log n\log\log n)$ query time; reducing the query time to $O(\log n)$ increases the space to $O(n\log\log n)$. We present an improved result that uses $O(n)$ space while achieving $O(\log n)$ query time. Like the previous work, our query algorithm returns a compact interval tree representing the convex hull so that standard binary-search-based queries on the hull can be performed in $O(\log n)$ time each. Our new result leads to improvements for several other problems. In particular, with the help of the above result, we present new algorithms for the ray-shooting problem among segments. Given a set of $n$ (possibly intersecting) line segments in the plane, preprocess it so that the first segment hit by a query ray can be quickly found. We give a data structure of $O(n\log n)$ space that can answer each query in $(\sqrt{n}\log n)$ time. If the segments are nonintersecting or if the segments are lines, then the space can be reduced to $O(n)$. All these are classical problems that have been studied extensively. Previously data structures of $\widetilde{O}(\sqrt{n})$ query time (the notation $\widetilde{O}$ suppresses a polylogarithmic factor) were known in early 1990s; nearly no progress has been made for over two decades. For all problems, our results provide improvements by reducing the space of the data structures by at least a logarithmic factor while the preprocessing and query times are the same as before or even better.


title: On the simplicity and conditioning of low rank semidefinite programs

abstract: Low rank matrix recovery problems appear widely in statistics, combinatorics, and imaging. One celebrated method for solving these problems is to formulate and solve a semidefinite program (SDP). It is often known that the exact solution to the SDP with perfect data recovers the solution to the original low rank matrix recovery problem. It is more challenging to show that an approximate solution to the SDP formulated with noisy problem data acceptably solves the original problem; arguments are usually ad hoc for each problem setting, and can be complex. In this note, we identify a set of conditions that we call simplicity that limit the error due to noisy problem data or incomplete convergence. In this sense, simple SDPs are robust: simple SDPs can be (approximately) solved efficiently at scale; and the resulting approximate solutions, even with noisy data, can be trusted. Moreover, we show that simplicity holds generically, and also for many structured low rank matrix recovery problems, including the stochastic block model, $\mathbb{Z}_2$ synchronization, and matrix completion. Formally, we call an SDP simple if it has a surjective constraint map, admits a unique primal and dual solution pair, and satisfies strong duality and strict complementarity. However, simplicity is not a panacea: we show the Burer-Monteiro formulation of the SDP may have spurious second-order critical points, even for a simple SDP with a rank 1 solution.


title: Separating the Effects of Batch Normalization on CNN Training Speed and Stability Using Classical Adaptive Filter Theory

abstract: Batch Normalization (BatchNorm) is commonly used in Convolutional Neural Networks (CNNs) to improve training speed and stability. However, there is still limited consensus on why this technique is effective. This paper uses concepts from the traditional adaptive filter domain to provide insight into the dynamics and inner workings of BatchNorm. First, we show that the convolution weight updates have natural modes whose stability and convergence speed are tied to the eigenvalues of the input autocorrelation matrices, which are controlled by BatchNorm through the convolution layers' channel-wise structure. Furthermore, our experiments demonstrate that the speed and stability benefits are distinct effects. At low learning rates, it is BatchNorm's amplification of the smallest eigenvalues that improves convergence speed, while at high learning rates, it is BatchNorm's suppression of the largest eigenvalues that ensures stability. Lastly, we prove that in the first training step, when normalization is needed most, BatchNorm satisfies the same optimization as Normalized Least Mean Square (NLMS), while it continues to approximate this condition in subsequent steps. The analyses provided in this paper lay the groundwork for gaining further insight into the operation of modern neural network structures using adaptive filter theory.


title: Towards Better Surgical Instrument Segmentation in Endoscopic Vision: Multi-Angle Feature Aggregation and Contour Supervision

abstract: Accurate and real-time surgical instrument segmentation is important in the endoscopic vision of robot-assisted surgery, and significant challenges are posed by frequent instrument-tissue contacts and continuous change of observation perspective. For these challenging tasks more and more deep neural networks (DNN) models are designed in recent years. We are motivated to propose a general embeddable approach to improve these current DNN segmentation models without increasing the model parameter number. Firstly, observing the limited rotation-invariance performance of DNN, we proposed the Multi-Angle Feature Aggregation (MAFA) method, leveraging active image rotation to gain richer visual cues and make the prediction more robust to instrument orientation changes. Secondly, in the end-to-end training stage, the auxiliary contour supervision is utilized to guide the model to learn the boundary awareness, so that the contour shape of segmentation mask is more precise. The proposed method is validated with ablation experiments on the novel Sinus-Surgery datasets collected from surgeons' operations, and is compared to the existing methods on a public dataset collected with a da Vinci Xi Robot.


title: LATIS: The Ly$\alpha$ Tomography IMACS Survey

abstract: We introduce LATIS, the Ly$\alpha$ Tomography IMACS Survey, a spectroscopic survey at Magellan designed to map the z=2.2-2.8 intergalactic medium (IGM) in three dimensions by observing the Ly$\alpha$ forest in the spectra of galaxies and QSOs. Within an area of 1.7 deg${}^2$, we will observe approximately half of $\gtrsim L^*$ galaxies at z=2.2-3.2 for typically 12 hours, providing a dense network of sightlines piercing the IGM with an average transverse separation of 2.5 $h^{-1}$ comoving Mpc (1 physical Mpc). At these scales, the opacity of the IGM is expected to be closely related to the dark matter density, and LATIS will therefore map the density field in the $z \sim 2.5$ universe at $\sim$Mpc resolution over the largest volume to date. Ultimately LATIS will produce approximately 3800 spectra of z=2.2-3.2 galaxies that probe the IGM within a volume of $4 \times 10^6 h^{-3}$ Mpc${}^3$, large enough to contain a representative sample of structures from protoclusters to large voids. Observations are already complete over one-third of the survey area. In this paper, we describe the survey design and execution. We present the largest IGM tomographic maps at comparable resolution yet made. We show that the recovered matter overdensities are broadly consistent with cosmological expectations based on realistic mock surveys, that they correspond to galaxy overdensities, and that we can recover structures identified using other tracers. LATIS is conducted in Canada-France-Hawaii Telescope Legacy Survey fields, including COSMOS. Coupling the LATIS tomographic maps with the rich data sets collected in these fields will enable novel studies of environment-dependent galaxy evolution and the galaxy-IGM connection at cosmic noon.


title: Light Nuclei ($d$, $t$) Production in Au + Au Collisions at $\sqrt{s_{NN}}$ = 7.7 - 200 GeV

abstract: In high-energy nuclear collisions, light nuclei can be regarded as a cluster of baryons and their yields are sensitive to the baryon density fluctuations. Thus, the production of light nuclei can be used to study the QCD phase transition, at which the baryon density fluctuation will be enhanced. The yield ratio of light nuclei, defined as $N(t)$$\times$$N(p)$/$N^2(d)$, is predicted to be sensitive observable to search for the 1st-order phase transition and/or QCD critical point in heavy-ion collisions. In this paper, we present the energy and centrality dependence of (anti)deuteron and triton production in Au+Au collisions at $\sqrt{s_{\mathrm{NN}}}$ = 7.7, 11.5, 14.5, 19.6, 27, 39, 54.4, 62.4, and 200 GeV measured by the STAR experiment at RHIC. We show beam-energy dependence for the coalescence parameter, $B_2(d)$ and $B_3(t)$, particle ratios, $d/p$, $t/p$, and $t/d$, and the yield ratio of $N(t)$$\times$$N(p)$/$N^2(d)$. More importantly, non-monotonic energy dependence is observed for the yield ratio, $N(t)$$\times$$N(p)$/$N^2(d)$, in 0-10\% central Au+Au collisions with a peak around 20-30 GeV. Their physics implications on QCD critical point search and change of the equation of state will be discussed.


title: Novel Change of Measure Inequalities with Applications to PAC-Bayesian Bounds and Monte Carlo Estimation

abstract: We introduce several novel change of measure inequalities for two families of divergences: $f$-divergences and $\alpha$-divergences. We show how the variational representation for $f$-divergences leads to novel change of measure inequalities. We also present a multiplicative change of measure inequality for $\alpha$-divergences and a generalized version of Hammersley-Chapman-Robbins inequality. Finally, we present several applications of our change of measure inequalities, including PAC-Bayesian bounds for various classes of losses and non-asymptotic intervals for Monte Carlo estimates.