title: Probing Higgs exotic decay at the LHC with machine learning

abstract: We study the tagging of Higgs exotic decay signals using different types of deep neural networks (DNNs), focusing on the $W^\pm h$ associated production channel followed by Higgs decaying into $n$ $b$-quarks with $n=4$, 6 and 8. All the Higgs decay products are collected into a fat-jet, to which we apply further selection using the DNNs. Three kinds of DNNs are considered, namely convolutional neural network (CNN), recursive neural network (RecNN) and particle flow network (PFN). The PFN can achieve the best performance because its structure allows enfolding more information in addition to the four-momentums of the jet constituents, such as particle ID and tracks parameters. Using the PFN as an example, we verify that it can serve as an efficient tagger even though it is trained on a different event topology with different $b$-multiplicity from the actual signal. The projected sensitivity to the branching ratio of Higgs decaying into $n$ $b$-quarks at the HL-LHC are 10\%, 3\% and 1\%, for $n=4$, 6 and 8, respectively.


title: Leighton's Theorem and Regular Cube Complexes

abstract: Leighton's graph covering theorem states that two finite graphs with common universal cover have a common finite cover. We generalize this to a large family of non-positively curved special cube complexes that form a natural generalization of regular graphs. This family includes both hyperbolic and non-hyperbolic CAT(0) cube complexes.


title: Sifting Through the Static: Moving Object Detection in Difference Images

abstract: Trans-Neptunian Objects (TNOs) provide a window into the history of the Solar System, but they can be challenging to observe due to their distance from the Sun and relatively low brightness. Here we report the detection of 75 moving objects that we could not link to any other known objects, the faintest of which has a VR magnitude of $25.02 \pm 0.93$ using the KBMOD platform. We recover an additional 24 sources with previously-known orbits. We place constraints on the barycentric distance, inclination, and longitude of ascending node of these objects. The unidentified objects have a median barycentric distance of 41.28 au, placing them in the outer Solar System. The observed inclination and magnitude distribution of all detected objects is consistent with previously published KBO distributions. We describe extensions to KBMOD, including a robust percentile-based lightcurve filter, an in-line graphics processing unit (GPU) filter, new coadded stamp generation, and a convolutional neural network (CNN) stamp filter, which allow KBMOD to take advantage of difference images. These enchancements mark a significant improvement in the readiness of KBMOD for deployment on future big data surveys such as LSST.


title: Spacetime Relationalism in GR and QG

abstract: We provide here a philosophical basis for [arXiv:2012.03994, arXiv:2107.06693] based on the notion of spacetime relationalism. We argue that the view which is more cleanly compatible with GR is that in which the spacetime manifold is a relational (or 'emergent') property of the aggregate or physical sum of gravitational field portions, field that is considered material and for which spacetime geometry (in the sense of the metric properties) is one of its material properties. All of the previous philosophical notions are defined in relation to a clear ontology of material individuals, briefly described in the appendix. Furthermore, this fits well with the phase space of GR, thing that also may inform how to proceed in the quantum realm.


title: Degenerate squeezing in a dual-pumped integrated microresonator: parasitic processes and their suppression

abstract: Using a general Hamiltonian treatment, we theoretically study the generation of degenerate quadrature squeezing in a dual-pumped integrated microring resonator coupled to a waveguide. Considering a dual-pump four-wave mixing configuration in an integrated $\text{Si}_3\text{N}_4$ platform, and following the coupled-mode theory approach, we investigate the effects of parasitic quantum nonlinear optical processes on the generation of squeezed light. Considering five resonance modes in this approach allows us to include the most important four-wave mixing processes involved in such a configuration. We theoretically explore the effects of the pump detunings on different nonlinear processes and show that the effects of some of the parasitic processes are effectively neutralized by symmetrically detuning the two pumps. This yields a significant enhancement in the output squeezing quality without physically changing the structure, but suffers from the trade-off of requiring substantially higher pump power for a fixed target level of squeezing.


title: Self-Supervised Representation Learning using Visual Field Expansion on Digital Pathology

abstract: The examination of histopathology images is considered to be the gold standard for the diagnosis and stratification of cancer patients. A key challenge in the analysis of such images is their size, which can run into the gigapixels and can require tedious screening by clinicians. With the recent advances in computational medicine, automatic tools have been proposed to assist clinicians in their everyday practice. Such tools typically process these large images by slicing them into tiles that can then be encoded and utilized for different clinical models. In this study, we propose a novel generative framework that can learn powerful representations for such tiles by learning to plausibly expand their visual field. In particular, we developed a progressively grown generative model with the objective of visual field expansion. Thus trained, our model learns to generate different tissue types with fine details, while simultaneously learning powerful representations that can be used for different clinical endpoints, all in a self-supervised way. To evaluate the performance of our model, we conducted classification experiments on CAMELYON17 and CRC benchmark datasets, comparing favorably to other self-supervised and pre-trained strategies that are commonly used in digital pathology. Our code is available at https://github.com/jcboyd/cdpath21-gan.


title: Hi, my name is Martha: Using names to measure and mitigate bias in generative dialogue models

abstract: All AI models are susceptible to learning biases in data that they are trained on. For generative dialogue models, being trained on real human conversations containing unbalanced gender and race/ethnicity references can lead to models that display learned biases, which we define here broadly as any measurable differences in the distributions of words or semantic content of conversations based on demographic groups. We measure the strength of such biases by producing artificial conversations between two copies of a dialogue model, conditioning one conversational partner to state a name commonly associated with a certain gender and/or race/ethnicity. We find that larger capacity models tend to exhibit more gender bias and greater stereotyping of occupations by gender. We show that several methods of tuning these dialogue models, specifically name scrambling, controlled generation, and unlikelihood training, are effective in reducing bias in conversation, including on a downstream conversational task. Name scrambling is also effective in lowering differences in token usage across conversations where partners have names associated with different genders or races/ethnicities.


title: Searching for the Feynman diagram IIc

abstract: The calculation of the electron g-factor was carried out in 1950 by Karplus and Kroll. Seven years later, Petermann detected and corrected a serious error in the calculation of a Feynman diagram. Although it is hard to believe, neither the original calculation nor the subsequent correction was ever published. Therefore, the entire prestige of QED and the Standard Model depends on the calculation of a single Feynman diagram (IIc) that has never been published and cannot be independently verified. In this article we begin the search for any published recalculation of this Feynman diagram IIc that allows us to independently validate the theoretical calculation.


title: Homology representations of compactified configurations on graphs applied to $\mathcal{M}_{2,n}$

abstract: We obtain new calculations of the top weight rational cohomology of the moduli spaces $\mathcal{M}_{2,n}$, equivalently the rational homology of the tropical moduli spaces $\Delta_{2,n}$, as a representation of $S_n$. These calculations are achieved fully for all $n\leq 10$, and partially -- for specific irreducible representations of $S_n$ -- for $n\le 22$. We also present conjectures, verified up to $n=22$, for the multiplicities of the irreducible representations $\mathrm{std}_n$ and $\mathrm{std}_n\otimes \mathrm{sgn}_n$. We achieve our calculations via a comparison with the homology of compactified configuration spaces of graphs. These homology groups are equipped with commuting actions of a symmetric group and the outer automorphism group of a free group. In this paper, we construct an efficient free resolution for these homology representations, from which we extract calculations on irreducible representations one at a time, simplifying the calculation of these homology representations.


title: Measurement and Memory in the Periodically Driven Complex Ginzburg-Landau equation

abstract: In the present work we illustrate that classical but nonlinear systems may possess features reminiscent of quantum ones, such as memory, upon suitable external perturbation. As our prototypical example, we use the two-dimensional complex Ginzburg-Landau equation in its vortex glass regime. We impose an external drive as a perturbation mimicking a quantum measurement protocol, with a given "measurement rate" (the rate of repetition of the drive) and "mixing rate" (characterized by the intensity of the drive). Using a variety of measures, we find that the system may or may not retain its coherence, statistically retrieving its original glass state, depending on the strength and periodicity of the perturbing field. The corresponding parametric regimes and the associated energy cascade mechanisms involving the dynamics of vortex waveforms and domain boundaries are discussed.


title: Multi-center decomposition of molecular densities: a mathematical perspective

abstract: The aim of this paper is to analyze from a mathematical perspective some existing schemes to partition a molecular density into several atomic contributions, with a specific focus on Iterative Stockholder Atom (ISA) methods. We provide a unified mathematical framework to describe the latter family of methods and propose a new scheme, named L-ISA (for linear approximation of ISA). We prove several important mathematical properties of the ISA and L-ISA minimization problems and show that the so-called ISA algorithms can be viewed as alternating minimization schemes, which in turn enables us to obtain new convergence results for these numerical methods. Specific mathematical properties of the ISA decomposition for diatomic systems are also presented. We also review the basis-space oriented Distributed Multipole Analysis method, the mathematical formulation of which is also clarified. Different schemes are numerically compared on different molecules and we discuss the advantages and drawbacks of each approach.


title: CLASH-VLT: Abell~S1063. Cluster assembly history and spectroscopic catalogue

abstract: Using the CLASH-VLT survey, we assembled an unprecedented sample of 1234 spectroscopically confirmed members in Abell~S1063, finding a dynamically complex structure at z_cl=0.3457 with a velocity dispersion \sigma_v=1380 -32 +26 km s^-1. We investigate cluster environmental and dynamical effects by analysing the projected phase-space diagram and the orbits as a function of galaxy spectral properties. We classify cluster galaxies according to the presence and strength of the [OII] emission line, the strength of the H$\delta$ absorption line, and colours. We investigate the relationship between the spectral classes of galaxies and their position in the projected phase-space diagram. We analyse separately red and blue galaxy orbits. By correlating the observed positions and velocities with the projected phase-space constructed from simulations, we constrain the accretion redshift of galaxies with different spectral types. Passive galaxies are mainly located in the virialised region, while emission-line galaxies are outside r_200, and are accreted later into the cluster. Emission-lines and post-starbursts show an asymmetric distribution in projected phase-space within r_200, with the first being prominent at Delta_v/sigma <~-1.5$, and the second at Delta_v/ sigma >~ 1.5, suggesting that backsplash galaxies lie at large positive velocities. We find that low-mass passive galaxies are accreted in the cluster before the high-mass ones. This suggests that we observe as passives only the low-mass galaxies accreted early in the cluster as blue galaxies, that had the time to quench their star formation. We also find that red galaxies move on more radial orbits than blue galaxies. This can be explained if infalling galaxies can remain blue moving on tangential orbits.


title: Algorithm for computing Representations of the Braid Group and Temperley-Lieb algebra

abstract: The braid group appears in many scientific fields and its representations are instrumental in understanding topological quantum algorithms, topological entropy, classification of manifolds and so on. In this work, we study planer diagrams which are Kauffman's reduction of the braid group algebra to the Temperley-Lieb algebra. We introduce an algorithm for computing all planer diagrams in a given dimension. The algorithm can also be used to multiply planer diagrams and find their matrix representation.


title: Safe Dynamic Programming

abstract: We incorporate safety specifications into dynamic programming. Explicitly, we address the minimization problem of a Markov decision process up to a stopping time with safety constraints. To incorporate safety into dynamic programming, we establish a formalism leaning upon the evolution equation. We show how to compute the safety function with the method of dynamic programming. In the last part of the paper, we develop several algorithms for safe dynamic programming.


title: Hybridized Methods for Quantum Simulation in the Interaction Picture

abstract: Conventional methods of quantum simulation involve trade-offs that limit their applicability to specific contexts where their use is optimal. In particular, the interaction picture simulation has been found to provide substantial asymptotic advantages for some Hamiltonians, but incurs prohibitive constant factors and is incompatible with methods like qubitization. We provide a framework that allows different simulation methods to be hybridized and thereby improve performance for interaction picture simulations over known algorithms. These approaches show asymptotic improvements over the individual methods that comprise them and further make interaction picture simulation methods practical in the near term. Physical applications of these hybridized methods yield a gate complexity scaling as $\log^2 \Lambda$ in the electric cutoff $\Lambda$ for the Schwinger Model and independent of the electron density for collective neutrino oscillations, outperforming the scaling for all current algorithms with these parameters. For the general problem of Hamiltonian simulation subject to dynamical constraints, these methods yield a query complexity independent of the penalty parameter $\lambda$ used to impose an energy cost on time-evolution into an unphysical subspace.


title: CRNNTL: convolutional recurrent neural network and transfer learning for QSAR modelling

abstract: In this study, we propose the convolutional recurrent neural network and transfer learning (CRNNTL) for QSAR modelling. The method was inspired by the applications of polyphonic sound detection and electrocardiogram classification. Our strategy takes advantages of both convolutional and recurrent neural networks for feature extraction, as well as the data augmentation method. Herein, CRNNTL is evaluated on 20 benchmark datasets in comparison with baseline methods. In addition, one isomers based dataset is used to elucidate its ability for both local and global feature extraction. Then, knowledge transfer performance of CRNNTL is tested, especially for small biological activity datasets. Finally, different latent representations from other type of AEs were used for versatility study of our model. The results show the effectiveness of CRNNTL using different latent representation. Moreover, efficient knowledge transfer is achieved to overcome data scarcity considering binding site similarity between different targets.


title: Melatect: A Machine Learning Model Approach For Identifying Malignant Melanoma in Skin Growths

abstract: Malignant melanoma is a common skin cancer that is mostly curable before metastasis -when growths spawn in organs away from the original site. Melanoma is the most dangerous type of skin cancer if left untreated due to the high risk of metastasis. This paper presents Melatect, a machine learning (ML) model embedded in an iOS app that identifies potential malignant melanoma. Melatect accurately classifies lesions as malignant or benign over 96.6% of the time with no apparent bias or overfitting. Using the Melatect app, users have the ability to take pictures of skin lesions (moles) and subsequently receive a mole classification. The Melatect app provides a convenient way to get free advice on lesions and track these lesions over time. A recursive computer image analysis algorithm and modified MLOps pipeline was developed to create a model that performs at a higher accuracy than existing models. Our training dataset included 18,400 images of benign and malignant lesions, including 18,000 from the International Skin Imaging Collaboration (ISIC) archive, as well as 400 images gathered from local dermatologists; these images were augmented using DeepAugment, an AutoML tool, to 54,054 images.


title: Neural network approaches for solving Schr\"odinger equation in arbitrary quantum wells

abstract: In this work we approach the Schr\"odinger equation in quantum wells with arbitrary potentials, using the machine learning technique. Two neural networks with different architectures are proposed and trained using a set of potentials, energies, and wave functions previously generated with the classical finite element method. Three accuracy indicators have been proposed for testing the estimates given by the neural networks. The networks are trained by the gradient descent method and the training validation is done with respect to a large training data set. The two networks are then tested for two different potential data sets and the results are compared. Several cases with analytical potential have also been solved.


title: Self-adaptive Architectures in IoT Systems: A Systematic Literature Review

abstract: Over the past few years, the relevance of the Internet of Things (IoT) has grown significantly and is now a key component of many industrial processes and even a transparent participant in various activities performed in our daily life. IoT systems are subjected to changes in the dynamic environments they operate in. These changes (e.g. variations in bandwidth consumption or new devices joining/leaving) may impact the Quality of Service (QoS) of the IoT system. A number of self-adaptation strategies for IoT architectures to better deal with these changes have been proposed in the literature. Nevertheless, they focus on isolated types of changes. We lack a comprehensive view of the trade-offs of each proposal and how they could be combined to cope with simultaneous events of different types. In this paper, we identify, analyze, and interpret relevant studies related to IoT adaptation and develop a comprehensive and holistic view of the interplay of different dynamic events, their consequences on QoS, and the alternatives for the adaptation. To do so, we have conducted a systematic literature review of existing scientific proposals and defined a research agenda for the near future based on the findings and weaknesses identified in the literature.


title: Radiation pressure confinement -- V. The predicted free-free absorption and emission in active galactic nuclei

abstract: The effect of radiation pressure compression (RPC) on ionized gas in Active Galactic Nuclei (AGN) likely sets the photoionized gas density structure. The photoionized gas free-free absorption and emission are therefore uniquely set by the incident ionizing flux. We use the photoionization code Cloudy RPC model results to derive the expected relations between the free-free emission and absorption properties and the distance from the AGN centre, for a given AGN luminosity. The free-free absorption frequency of RPC gas is predicted to increases from $\sim$100 MHz on the kpc scale, to $\sim$100 GHz on the sub-pc scale, consistent with observations of spatially resolved free-free absorption. The free-free emission at 5 GHz is predicted to yield a radio loudness of $R\sim 0.03$, below the typical observed values of $R\sim 0.1-1$ in radio-quiet AGN. However, the flat free-free radio continuum may become dominant above 100 GHz. The suggested detection of optically thin free-free emission in NGC 1068, on the sub pc torus scale, is excluded as the brightness temperature is too high for optically thin free-free emission. However, excess emission observed with ALMA above 150 GHz in NGC 1068, is consistent with the predicted free-free emission from gas just outside the broad line region, a region which overlaps the hot dust disc resolved with GRAVITY. Extended $\sim$100 pc scale free-free emission is also likely present in NGC 1068. Future sub mm observation of radio quiet AGN with ALMA may allow to image the free-free emission of warm photoionized gas in AGN down to the 30 mas scale, including highly absorbed AGN.


title: Some Methods for Relatively Strongly Monotone Variational Inequalities

abstract: The article is devoted to the development of numerical methods for solving variational inequalities with relatively strongly monotone operators. We consider two classes of variational inequalities related to some analogs of the Lipschitz condition of the operator that appeared several years ago. One of these classes is associated with the relative boundedness of the operator, and the other one with the analog of the Lipschitz condition (namely, relative smoothness). For variational inequalities with relatively bounded and relatively strongly monotone operators, we introduce a modification of the Mirror Descent method, which optimizes the convergence rate. We also propose the adaptive Proximal Pirror algorithm and its restarted version with a linear convergence rate for problems with relatively smooth and relatively strongly monotone operators.


title: Multipartite entanglement of the topologically ordered state in a perturbed toric code

abstract: We demonstrate that multipartite entanglement, witnessed by the quantum Fisher information (QFI), can characterize topological quantum phase transitions in the spin-$\frac{1}{2}$ toric code model on a square lattice with external fields. We show that the QFI density of the ground state can be written in terms of the expectation values of gauge-invariant Wilson loops for different sizes of square regions and identify $\mathbb{Z}_2$ topological order by its scaling behavior. Furthermore, we use this multipartite entanglement witness to investigate thermalization and disorder-assisted stabilization of topological order after a quantum quench. Moreover, with an upper bound of the QFI, we demonstrate the absence of finite-temperature topological order in the 2D toric code model in the thermodynamic limit. Our results provide insights to topological phases, which are robust against external disturbances, and are candidates for topologically protected quantum computation.


title: Infinitely many quasi-arithmetic maximal reflection groups

abstract: In contrast to the fact that there are only finitely many maximal arithmetic reflection groups acting on the hyperbolic space $\mathbb{H}^n$, $n\geq 2$, we show that: (a) one can produce infinitely many maximal quasi-arithmetic reflection groups acting on $\mathbb{H}^2$; (b) they admit infinitely many different fields of definition; (c) the degrees of their fields of definition are unbounded. However, for $n\geq 14$ an approach initially developed by Vinberg shows that there are still finitely many fields of definitions in the quasi-arithmetic case.


title: Additive Polynomial Time Integrators, Part I: Framework and Fully-Implicit-Explicit (FIMEX) Collocation Methods

abstract: In this paper we generalize the polynomial time integration framework to additively partitioned initial value problems. The framework we present is general and enables the construction of many new families of additive integrators with arbitrary order-of-accuracy and varying degree of implicitness. In this first work, we focus on a new class of implicit-explicit polynomial block methods that are based on fully-implicit Runge-Kutta methods with Radau nodes, and possess high stage order. We show that the new fully-implicit-explicit (FIMEX) integrators have improved stability compared to existing IMEX Runge-Kutta methods, while also being more computationally efficient due to recent developments in preconditioning techniques for solving the associated systems of nonlinear equations. For PDEs on periodic domains where the implicit component is trivial to invert, we will show how parallelization of the right-hand-side evaluations can be exploited to obtain significant speedup compared to existing serial IMEX Runge-Kutta methods. For parallel (in space) finite-element discretizations, the new methods can achieve orders of magnitude better accuracy than existing IMEX Runge-Kutta methods, and/or achieve a given accuracy several times times faster in terms of computational runtime.


title: The Santa Cruz Extreme AO Lab (SEAL): Design and First Light

abstract: The Santa Cruz Extreme AO Lab (SEAL) is a new visible-wavelength testbed designed to advance the state of the art in wavefront control for high contrast imaging on large, segmented, ground-based telescopes. SEAL provides multiple options for simulating atmospheric turbulence, including rotating phase plates and a custom Meadowlark spatial light modulator that delivers phase offsets of up to 6pi at 635nm. A 37-segment IrisAO deformable mirror (DM) simulates the W. M. Keck Observatory segmented primary mirror. The adaptive optics system consists of a woofer/tweeter deformable mirror system (a 97-actuator ALPAO DM and 1024-actuator Boston Micromachines MEMs DM, respectively), and four wavefront sensor arms: 1) a high-speed Shack-Hartmann WFS, 2) a reflective pyramid WFS, designed as a prototype for the ShaneAO system at Lick Observatory, 3) a vector-Zernike WFS, and 4) a Fast Atmospheric Self Coherent Camera Technique (FAST) demonstration arm, consisting of a custom focal plane mask and high-speed sCMOS detector. Finally, science arms preliminarily include a classical Lyot-style coronagraph as well as FAST (which doubles as a WFS and science camera). SEAL's real time control system is based on the Compute and Control for Adaptive optics (CACAO) package, and is designed to support the efficient transfer of software between SEAL and the Keck II AO system. In this paper, we present an overview of the design and first light performance of SEAL.


title: Quantized flag manifolds and non-restricted modules over quantum groups at roots of unity

abstract: We give a proof of Lusztig's conjectural multiplicity formula for non-restricted modules over the De Concini-Kac type quantized enveloping algebra at the $\ell$-th root of unity, where $\ell$ is an odd prime power satisfying certain reasonable conditions.


title: A momentum dependent optical lattice induced by artificial gauge potential

abstract: We propose an experimentally feasible method to generate a one-dimensional optical lattice potential in an ultracold Bose gas system that depends on the transverse momentum of the atoms. The optical lattice is induced by the artificial gauge potential generated by a periodically driven multi-laser Raman process, which depends on the transverse momentum of the atoms. We study the many-body Bose-Hubbard model in an effective 1D case and show that the superfluid--Mott-insulator transition can be controlled via tuning the transverse momentum of the atomic gas. We examined our prediction via a strong-coupling expansion to an effective 1D Bose-Hubbard model and a quantum Monte Carlo calculation, and discuss possible applications of our system.


title: The Planetary Systems Imager Adaptive Optics System: An Initial Optical Design and Performance Analysis Tools for the PSI-Red AO System

abstract: The Planetary Systems Imager (PSI) is a proposed instrument for the Thirty Meter Telescope (TMT) that provides an extreme adaptive optics (AO) correction to a multi-wavelength instrument suite optimized for high contrast science. PSI's broad range of capabilities, spanning imaging, polarimetry, integral field spectroscopy, and high resolution spectroscopy from 0.6-5 microns, with a potential channel at 10 microns, will enable breakthrough science in the areas of exoplanet formation and evolution. Here, we present a preliminary optical design and performance analysis toolset for the 2-5 microns component of the PSI AO system, which must deliver the wavefront quality necessary to support infrared high contrast science cases. PSI-AO is a two-stage system, with an initial deformable mirror and infrared wavefront sensor providing a common wavefront correction to all PSI science instruments followed by a dichroic that separates "PSI-Red" (2-5 microns) from "PSI-Blue" (0.5-1.8 microns). To meet the demands of visible-wavelength high contrast science, the PSI-Blue arm will include a second deformable mirror and a visible-wavelength wavefront sensor. In addition to an initial optical design of the PSI-Red AO system, we present a preliminary set of tools for an end-to-end AO simulation that in future work will be used to demonstrate the planet-to-star contrast ratios achievable with PSI-Red.


title: Corpus-based Open-Domain Event Type Induction

abstract: Traditional event extraction methods require predefined event types and their corresponding annotations to learn event extractors. These prerequisites are often hard to be satisfied in real-world applications. This work presents a corpus-based open-domain event type induction method that automatically discovers a set of event types from a given corpus. As events of the same type could be expressed in multiple ways, we propose to represent each event type as a cluster of <predicate sense, object head> pairs. Specifically, our method (1) selects salient predicates and object heads, (2) disambiguates predicate senses using only a verb sense dictionary, and (3) obtains event types by jointly embedding and clustering <predicate sense, object head> pairs in a latent spherical space. Our experiments, on three datasets from different domains, show our method can discover salient and high-quality event types, according to both automatic and human evaluations.


title: Effective and interpretable dispatching rules for dynamic job shops via guided empirical learning

abstract: The emergence of Industry 4.0 is making production systems more flexible and also more dynamic. In these settings, schedules often need to be adapted in real-time by dispatching rules. Although substantial progress was made until the '90s, the performance of these rules is still rather limited. The machine learning literature is developing a variety of methods to improve them, but the resulting rules are difficult to interpret and do not generalise well for a wide range of settings. This paper is the first major attempt at combining machine learning with domain problem reasoning for scheduling. The idea consists of using the insights obtained with the latter to guide the empirical search of the former. Our hypothesis is that this guided empirical learning process should result in dispatching rules that are effective and interpretable and which generalise well to different instance classes. We test our approach in the classical dynamic job shop scheduling problem minimising tardiness, which is one of the most well-studied scheduling problems. Nonetheless, results suggest that our approach was able to find new state-of-the-art rules, which significantly outperform the existing literature in the vast majority of settings, from loose to tight due dates and from low utilisation conditions to congested shops. Overall, the average improvement is 19%. Moreover, the rules are compact, interpretable, and generalise well to extreme, unseen scenarios.


title: Fractional magnetic Schr\"{o}dinger equations with potential vanishing at infinity and supercritical exponents

abstract: This paper focuses on the following class of fractional magnetic Schr\"{o}dinger equations \begin{equation*} (-\Delta)_{A}^{s}u+V(x)u=g(\vert u\vert^{2})u+\lambda\vert u\vert^{q-2}u, \quad \mbox{in } \mathbb{R}^{N}, \end{equation*} where $(-\Delta)_{A}^{s}$ is the fractional magnetic Laplacian, $A :\mathbb{R}^N \rightarrow \mathbb{R}^N$ is the magnetic potential, $s\in (0,1)$, $N>2s$, $\lambda \geq0$ is a parameter, $V:\mathbb{R}^N \rightarrow \mathbb{R}$ is a potential function that may decay to zero at infinity and $g: \mathbb{R}_{+} \rightarrow \mathbb{R}$ is a continuous function with subcritical growth. We deal with supercritical case $q\geq 2^*_s:=2N/(N-2s)$. Our approach is based on variational methods combined with penalization technique and $L^{\infty}$-estimates.


title: Fast random number generator based on optical physical unclonable functions

abstract: We propose an approach for fast random number generation based on homemade optical physical unclonable functions (PUFs). The optical PUF is illuminated with input laser wavefront of continuous modulation to obtain different speckle patterns. Random numbers are fully extracted from speckle patterns through a simple post-processing algorithm. Our proof-of-principle experiment achieves total random number generation rate of 0.96 Gbit/s with verified randomness, which is far faster than previous optical-PUF-based schemes. Our results demonstrate that the presented random number generator (RNG) proposal has great potential to achieve ultrafast random number generation rate up to several hundreds of Gbit/s.


title: DexRay: A Simple, yet Effective Deep Learning Approach to Android Malware Detection based on Image Representation of Bytecode

abstract: Computer vision has witnessed several advances in recent years, with unprecedented performance provided by deep representation learning research. Image formats thus appear attractive to other fields such as malware detection, where deep learning on images alleviates the need for comprehensively hand-crafted features generalising to different malware variants. We postulate that this research direction could become the next frontier in Android malware detection, and therefore requires a clear roadmap to ensure that new approaches indeed bring novel contributions. We contribute with a first building block by developing and assessing a baseline pipeline for image-based malware detection with straightforward steps. We propose DexRay, which converts the bytecode of the app DEX files into grey-scale "vector" images and feeds them to a 1-dimensional Convolutional Neural Network model. We view DexRay as foundational due to the exceedingly basic nature of the design choices, allowing to infer what could be a minimal performance that can be obtained with image-based learning in malware detection. The performance of DexRay evaluated on over 158k apps demonstrates that, while simple, our approach is effective with a high detection rate(F1-score= 0.96). Finally, we investigate the impact of time decay and image-resizing on the performance of DexRay and assess its resilience to obfuscation. This work-in-progress paper contributes to the domain of Deep Learning based Malware detection by providing a sound, simple, yet effective approach (with available artefacts) that can be the basis to scope the many profound questions that will need to be investigated to fully develop this domain.


title: Reconstructing High-resolution Turbulent Flows Using Physics-Guided Neural Networks

abstract: Direct numerical simulation (DNS) of turbulent flows is computationally expensive and cannot be applied to flows with large Reynolds numbers. Large eddy simulation (LES) is an alternative that is computationally less demanding, but is unable to capture all of the scales of turbulent transport accurately. Our goal in this work is to build a new data-driven methodology based on super-resolution techniques to reconstruct DNS data from LES predictions. We leverage the underlying physical relationships to regularize the relationships amongst different physical variables. We also introduce a hierarchical generative process and a reverse degradation process to fully explore the correspondence between DNS and LES data. We demonstrate the effectiveness of our method through a single-snapshot experiment and a cross-time experiment. The results confirm that our method can better reconstruct high-resolution DNS data over space and over time in terms of pixel-wise reconstruction error and structural similarity. Visual comparisons show that our method performs much better in capturing fine-level flow dynamics.


title: Predicting Process Name from Network Data

abstract: The ability to identify applications based on the network data they generate could be a valuable tool for cyber defense. We report on a machine learning technique capable of using netflow-like features to predict the application that generated the traffic. In our experiments, we used ground-truth labels obtained from host-based sensors deployed in a large enterprise environment; we applied random forests and multilayer perceptrons to the tasks of browser vs. non-browser identification, browser fingerprinting, and process name prediction. For each of these tasks, we demonstrate how machine learning models can achieve high classification accuracy using only netflow-like features as the basis for classification.


title: Real-World Adversarial Examples involving Makeup Application

abstract: Deep neural networks have developed rapidly and have achieved outstanding performance in several tasks, such as image classification and natural language processing. However, recent studies have indicated that both digital and physical adversarial examples can fool neural networks. Face-recognition systems are used in various applications that involve security threats from physical adversarial examples. Herein, we propose a physical adversarial attack with the use of full-face makeup. The presence of makeup on the human face is a reasonable possibility, which possibly increases the imperceptibility of attacks. In our attack framework, we combine the cycle-adversarial generative network (cycle-GAN) and a victimized classifier. The Cycle-GAN is used to generate adversarial makeup, and the architecture of the victimized classifier is VGG 16. Our experimental results show that our attack can effectively overcome manual errors in makeup application, such as color and position-related errors. We also demonstrate that the approaches used to train the models can influence physical attacks; the adversarial perturbations crafted from the pre-trained model are affected by the corresponding training data.


title: Any-horizon uniform random sampling and enumeration of constrained scenarios for simulation-based formal verification

abstract: Model-based approaches to the verification of non-terminating Cyber-Physical Systems (CPSs) usually rely on numerical simulation of the System Under Verification (SUV) model under input scenarios of possibly varying duration, chosen among those satisfying given constraints. Such constraints typically stem from requirements (or assumptions) on the SUV inputs and its operational environment as well as from the enforcement of additional conditions aiming at, e.g., prioritising the (often extremely long) verification activity, by, e.g., focusing on scenarios explicitly exercising selected requirements, or avoiding vacuity in their satisfaction. In this setting, the possibility to efficiently sample at random (with a known distribution, e.g., uniformly) within, or to efficiently enumerate (possibly in a uniformly random order) scenarios among those satisfying the given constraints is a key enabler for the viability of the verification process, e.g., via simulation-based statistical model checking. Unfortunately, in case of non-trivial combinations of constraints, iterative approaches like Markovian random walks in the space of sequences of inputs in general fail in extracting scenarios according to a given distribution, and can be very inefficient to produce legal scenarios of interest. We show how, given a set of constraints on the input scenarios succinctly defined by finite memory monitors, a data structure (scenario generator) can be synthesised, from which any-horizon scenarios satisfying the input constraints can be efficiently extracted by (possibly uniform) random sampling or (randomised) enumeration. Our approach enables seamless support to virtually all simulation-based approaches to CPS verification, ranging from simple random testing to statistical model checking and formal (i.e., exhaustive) verification.


title: CyGIL: A Cyber Gym for Training Autonomous Agents over Emulated Network Systems

abstract: Given the success of reinforcement learning (RL) in various domains, it is promising to explore the application of its methods to the development of intelligent and autonomous cyber agents. Enabling this development requires a representative RL training environment. To that end, this work presents CyGIL: an experimental testbed of an emulated RL training environment for network cyber operations. CyGIL uses a stateless environment architecture and incorporates the MITRE ATT&CK framework to establish a high fidelity training environment, while presenting a sufficiently abstracted interface to enable RL training. Its comprehensive action space and flexible game design allow the agent training to focus on particular advanced persistent threat (APT) profiles, and to incorporate a broad range of potential threats and vulnerabilities. By striking a balance between fidelity and simplicity, it aims to leverage state of the art RL algorithms for application to real-world cyber defence.


title: COVID-19 Diagnostics: Past, Present, and Future

abstract: In winter of 2020, SARS-CoV-2 emerged as a global threat, impacting not only health but also financial and political stability. To address the societal need for monitoring the spread of SARS-CoV-2, many existing diagnostic technologies were quickly adapted to detect SARS-CoV-2 RNA and antigens as well as the immune response and new testing strategies were developed to accelerate time-to-decision. In parallel, the infusion of research support accelerated the development of new spectroscopic methods. While these methods have significantly reduced the impact of SARS-CoV-2 on society when coupled with behavioral changes, they also lay the groundwork for a new generation of platform technologies. With several epidemics on the horizon, such as the rise of antibiotic-resistant bacteria, the ability to quickly pivot the target pathogen of this diagnostic toolset will continue to have an impact.


title: Wide Dust Gaps in Protoplanetary Disks Induced by Eccentric Planets: A Mass-Eccentricity Degeneracy

abstract: The tidal perturbation of embedded protoplanets on their natal disks has been widely attributed to be the cause of gap-ring structures in sub-mm images of protoplanetary disks around T Tauri stars. Numerical simulations of this process have been used to propose scalings of characteristic dust gap width/gap-ring distance with respect to planet mass. Applying such scalings to analyze observed gap samples yields a continuous mass distribution for a rich population of hypothetical planets in the range of several Earth to Jupiter masses. In contrast, the conventional core-accretion scenario of planet formation predicts a bi-modal mass function due to 1) the onset of runaway gas accretion above \sim20 Earth masses and 2) suppression of accretion induced by gap opening. Here we examine the dust disk response to the tidal perturbation of eccentric planets as a possible resolution of this paradox. Based on simulated gas and dust distributions, we show the gap-ring separation of Neptune-mass planets with small eccentricities might become comparable to that induced by Saturn-mass planets on circular orbits. This degeneracy may obliterate the discrepancy between the theoretical bi-modal mass distribution and the observed continuous gap width distribution. Despite damping due to planet-disk interaction, modest eccentricity may be sustained either in the outer regions of relatively thick disks or through resonant excitation among multiple super Earths. Moreover, the ring-like dust distribution induced by planets with small eccentricities is axisymmetric even in low viscosity environments, consistent with the paucity of vortices in ALMA images.


title: On the Challenges of Evaluating Compositional Explanations in Multi-Hop Inference: Relevance, Completeness, and Expert Ratings

abstract: Building compositional explanations requires models to combine two or more facts that, together, describe why the answer to a question is correct. Typically, these "multi-hop" explanations are evaluated relative to one (or a small number of) gold explanations. In this work, we show these evaluations substantially underestimate model performance, both in terms of the relevance of included facts, as well as the completeness of model-generated explanations, because models regularly discover and produce valid explanations that are different than gold explanations. To address this, we construct a large corpus of 126k domain-expert (science teacher) relevance ratings that augment a corpus of explanations to standardized science exam questions, discovering 80k additional relevant facts not rated as gold. We build three strong models based on different methodologies (generation, ranking, and schemas), and empirically show that while expert-augmented ratings provide better estimates of explanation quality, both original (gold) and expert-augmented automatic evaluations still substantially underestimate performance by up to 36% when compared with full manual expert judgements, with different models being disproportionately affected. This poses a significant methodological challenge to accurately evaluating explanations produced by compositional reasoning models.


title: Aerodynamic Risk Assessment using Parametric, Three-Dimensional Unstructured, High-Fidelity CFD and Adaptive Sampling

abstract: We demonstrate an adaptive sampling approach for computing the probability of a rare event for a set of three-dimensional airplane geometries under various flight conditions. We develop a fully automated method to generate parameterized airplanes geometries and create volumetric mesh for viscous CFD solution. With the automatic geometry and meshing, we perform the adaptive sampling procedure to compute the probability of the rare event. We show that the computational cost of our adaptive sampling approach is hundreds of times lower than a brute-force Monte Carlo method.


title: Multi-Branch Deep Radial Basis Function Networks for Facial Emotion Recognition

abstract: Emotion recognition (ER) from facial images is one of the landmark tasks in affective computing with major developments in the last decade. Initial efforts on ER relied on handcrafted features that were used to characterize facial images and then feed to standard predictive models. Recent methodologies comprise end-to-end trainable deep learning methods that simultaneously learn both, features and predictive model. Perhaps the most successful models are based on convolutional neural networks (CNNs). While these models have excelled at this task, they still fail at capturing local patterns that could emerge in the learning process. We hypothesize these patterns could be captured by variants based on locally weighted learning. Specifically, in this paper we propose a CNN based architecture enhanced with multiple branches formed by radial basis function (RBF) units that aims at exploiting local information at the final stage of the learning process. Intuitively, these RBF units capture local patterns shared by similar instances using an intermediate representation, then the outputs of the RBFs are feed to a softmax layer that exploits this information to improve the predictive performance of the model. This feature could be particularly advantageous in ER as cultural / ethnicity differences may be identified by the local units. We evaluate the proposed method in several ER datasets and show the proposed methodology achieves state-of-the-art in some of them, even when we adopt a pre-trained VGG-Face model as backbone. We show it is the incorporation of local information what makes the proposed model competitive.


title: C-MinHash: Rigorously Reducing $K$ Permutations to Two

abstract: Minwise hashing (MinHash) is an important and practical algorithm for generating random hashes to approximate the Jaccard (resemblance) similarity in massive binary (0/1) data. The basic theory of MinHash requires applying hundreds or even thousands of independent random permutations to each data vector in the dataset, in order to obtain reliable results for (e.g.,) building large-scale learning models or approximate near neighbor search in massive data. In this paper, we propose {\bf Circulant MinHash (C-MinHash)} and provide the surprising theoretical results that we just need \textbf{two} independent random permutations. For C-MinHash, we first conduct an initial permutation on the data vector, then we use a second permutation to generate hash values. Basically, the second permutation is re-used $K$ times via circulant shifting to produce $K$ hashes. Unlike classical MinHash, these $K$ hashes are obviously correlated, but we are able to provide rigorous proofs that we still obtain an unbiased estimate of the Jaccard similarity and the theoretical variance is uniformly smaller than that of the classical MinHash with $K$ independent permutations. The theoretical proofs of C-MinHash require some non-trivial efforts. Numerical experiments are conducted to justify the theory and demonstrate the effectiveness of C-MinHash.


title: $\mathcal{N}$IPM-MPC: An Efficient Null-Space Method Based Interior-Point Method for Model Predictive Control

abstract: Linear Model Predictive Control (MPC) is a widely used method to control systems with linear dynamics. Efficient interior-point methods have been proposed which leverage the block diagonal structure of the quadratic program (QP) resulting from the receding horizon control formulation. However, they require two matrix factorizations per interior-point method iteration, one each for the computation of the dual and the primal. Recently though an interior point method based on the null-space method has been proposed which requires only a single decomposition per iteration. While the then used null-space basis leads to dense null-space projections, in this work we propose a sparse null-space basis which preserves the block diagonal structure of the MPC matrices. Since it is based on the inverse of the transfer matrix we introduce the notion of so-called virtual controls which enables just that invertibility. A combination of the reduced number of factorizations and omission of the evaluation of the dual lets our solver outperform others in terms of computational speed by an increasing margin dependent on the number of state and control variables.

categories: math.OC cs.NA cs.PF cs.SY eess.SY math.NA


title: Some Applications of Dynamical Belyi Polynomials

abstract: We give necessary and sufficient conditions for post-critically finite polynomials to have persistent bad reduction at a given prime. We also answer in the negative a pair of questions posed by Silverman about conservative polynomials. Our proofs rely on conservative dynamical Belyi polynomials as exemplars of PCF (resp. conservative) maps.


title: Study of quark and gluon jet substructure in Z+jet and dijet events from pp collisions

abstract: Measurements of jet substructure describing the composition of quark- and gluon-initiated jets are presented. Proton-proton (pp) collision data at $\sqrt{s}$ =13 TeV collected with the CMS detector are used, corresponding to an integrated luminosity of 35.9 fb$^{-1}$. Generalized angularities are measured that characterize the jet substructure and distinguish quark- and gluon-initiated jets. These observables are sensitive to the distributions of transverse momenta and angular distances within a jet. The analysis is performed using a data sample of dijet events enriched in gluon-initiated jets, and, for the first time, a Z+jet event sample enriched in quark-initiated jets. The observables are measured in bins of jet transverse momentum, and as a function of the jet radius parameter. Each measurement is repeated applying a "soft drop" grooming procedure that removes soft and large angle radiation from the jet. Using these measurements, the ability of various models to describe jet substructure is assessed, showing a clear need for improvements in Monte Carlo generators.


title: Software Vulnerability Detection via Deep Learning over Disaggregated Code Graph Representation

abstract: Identifying vulnerable code is a precautionary measure to counter software security breaches. Tedious expert effort has been spent to build static analyzers, yet insecure patterns are barely fully enumerated. This work explores a deep learning approach to automatically learn the insecure patterns from code corpora. Because code naturally admits graph structures with parsing, we develop a novel graph neural network (GNN) to exploit both the semantic context and structural regularity of a program, in order to improve prediction performance. Compared with a generic GNN, our enhancements include a synthesis of multiple representations learned from the several parsed graphs of a program, and a new training loss metric that leverages the fine granularity of labeling. Our model outperforms multiple text, image and graph-based approaches, across two real-world datasets.


title: A note on the permutation distribution of generalized correlation coefficients

abstract: We provide sufficient conditions for the asymptotic normality of the generalized correlation coefficient $\sum a_{ij}b_{ij}$ under the permutation null distribution when $a_{ij}$'s are symmetric and $b_{ij}$'s are symmetric.


title: Latent Space Network Modelling with Hyperbolic and Spherical Geometries

abstract: A rich class of network models associate each node with a low-dimensional latent coordinate that controls the propensity for connections to form. Models of this type are well established in the network analysis literature, where it is typical to assume that the underlying geometry is Euclidean. Recent work has explored the consequences of this choice and has motivated the study of models which rely on non-Euclidean latent geometries, with a primary focus on spherical and hyperbolic geometry. In this paper, we examine to what extent latent features can be inferred from the observable links in the network, considering network models which rely on spherical and hyperbolic geometries. For each geometry, we describe a latent space network model, detail constraints on the latent coordinates which remove the well-known identifiability issues, and present Bayesian estimation schemes. Thus, we develop computational procedures to perform inference for network models in which the properties of the underlying geometry play a vital role. Finally, we assess the validity of these models on real data.


title: SoMIAP: Social media images analysis and prediction framework

abstract: The personal photos captured and submitted by users on social networks can provide several interesting insights about the location of the user, which is a key indicator of their daily activities. This information is invaluable for security organisations, especially for security monitoring and tracking criminal activities. Hence, we propose in this paper a novel approach for location prediction based on the image analysis of the photos posted on social media. Our approach combines two main methods to perform the image analysis, place and face recognition. The first method is used to determine the location area in the analysed image. The second is used to identify people in the analysed image, by locating a face in the image and comparing it with a dataset of images that have been collected from different social platforms. The effectiveness of the proposed approach is demonstrated through performance analysis and experimental results.


title: Systematically Measuring Ultra-Diffuse Galaxies (SMUDGes). II. Expanded Survey Description and the Stripe 82 Catalog

abstract: We present 226 large ultra-diffuse galaxy (UDG) candidates ($r_e > 5.3$\arcsec, $\mu_{0,g} > 24$ mag arcsec$^{-2}$) in the SDSS Stripe 82 region recovered using our improved procedure developed in anticipation of processing the entire Legacy Surveys footprint. The advancements include less constrained structural parameter fitting, expanded wavelet filtering criteria, consideration of Galactic dust, estimates of parameter uncertainties and completeness based on simulated sources, and refinements of our automated candidate classification. We have a sensitivity $\sim$1 mag fainter in $\mu_{0,g}$ than the largest published catalog of this region. Using our completeness-corrected sample, we find that (1) there is no significant decline in the number of UDG candidates as a function of $\mu_{0,g}$ to the limit of our survey ($\sim$ 26.5 mag arcsec$^{-2}$); (2) bluer candidates have smaller S\'ersic $n$; (3) most blue ($g-r < 0.45$ mag) candidates have $\mu_{0,g} \lesssim 25$ mag arcsec$^{-2}$ and will fade to populate the UDG red sequence we observe to $\sim 26.5$ mag arcsec$^{-2}$; (4) any red UDGs that exist significantly below our $\mu_{0,g}$ sensitivity limit are not descended from blue UDGs in our sample; and (5) candidates with lower $\mu_{0,g}$ tend to smaller $n$. We anticipate that the final SMUDGes sample will contain $\sim$ 30$\times$ as many candidates.


title: The K2-OjOS Project: New and revisited planets and candidates in K2 campaigns 5, 16, & 18

abstract: We present the first results of K2-OjOS, a collaborative project between professional and amateur astronomers primarily aimed to detect, characterize, and validate new extrasolar planets. For this work, 10 amateur astronomers looked for planetary signals by visually inspecting the 20 427 light curves of K2 campaign 18 (C18). They found 42 planet candidates, of which 18 are new detections and 24 had been detected in the overlapping C5 by previous works. We used archival photometric and spectroscopic observations, as well as new high-spatial resolution images in order to carry out a complete analysis of the candidates found, including a homogeneous characterization of the host stars, transit modelling, search for transit timing variations and statistical validation. As a result, we report four new planets (K2-355 b, K2-356 b, K2-357 b, and K2-358 b) and 14 planet candidates. Besides, we refine the transit ephemeris of the previously published planets and candidates by modelling C5, C16 (when available) and C18 photometric data jointly, largely improving the period and mid-transit time precision. Regarding individual systems, we highlight the new planet K2-356 b and candidate EPIC 211537087.02 being near a 2:1 period commensurability, the detection of significant TTVs in the bright star K2-184 (V = 10.35), the location of K2-103 b inside the habitable zone according to optimistic models, the detection of a new single transit in the known system K2-274, and the disposition reassignment of K2-120 b, which we consider as a planet candidate as the origin of the signal cannot be ascertained.


title: Exploring tidal obliquity variations with SMERCURY-T

abstract: We introduce our new code, SMERCURY-T, which is based on existing codes SMERCURY (Lissauer et al. 2012) and Mercury-T (Bolmont et al. 2015). The result is a mixed-variable symplectic N-body integrator that can compute the orbital and spin evolution of a planet within a multi-planet system under the influence of tidal spin torques from its star. We validate our implementation by comparing our experimental results to that of a secular model. As we demonstrate in a series of experiments, SMERCURY-T allows for the study of secular spin-orbit resonance crossings and captures for planets within complex multi-planet systems. These processes can drive a planet's spin state to evolve along vastly different pathways on its road toward tidal equilibrium, as tidal spin torques dampen the planet's spin rate and evolve its obliquity. Additionally, we show the results of a scenario that exemplifies the crossing of a chaotic region that exists as the overlap of two spin-orbit resonances. The test planet experiences violent and chaotic swings in its obliquity until its eventual escape from resonance as it tidally evolves. All of these processes are and have been important over the obliquity evolution of many bodies within the Solar System and beyond, and have implications for planetary climate and habitability. SMERCURY-T is a powerful and versatile tool that allows for further study of these phenomena.


title: Single crystal studies and electronic structure investigation of a room-temperature semiconductor NaMnAs

abstract: We report synthesis of single crystalline NaMnAs, confirm its antiferromagnetic order and characterise the sample by photoemission spectroscopy. The electronic structure was studied using optical transmittance, x-ray and ultraviolet spectroscopy and by theoretical modeling using local density approximation (LDA) extended to LDA+U when Heisenberg model parameters were determined. Optical transmittance measurement have confirmed the theoretical predictions that NaMnAs is a semiconductor. Also the N\'eel temperature was closer determined for the first time from temperature dependence of magnetization, in agreement with our Monte Carlo simulations.


title: Certifiably Optimal Outlier-Robust Geometric Perception: Semidefinite Relaxations and Scalable Global Optimization

abstract: We propose the first general and scalable framework to design certifiable algorithms for robust geometric perception in the presence of outliers. Our first contribution is to show that estimation using common robust costs, such as truncated least squares (TLS), maximum consensus, Geman-McClure, Tukey's biweight, among others, can be reformulated as polynomial optimization problems (POPs). By focusing on the TLS cost, our second contribution is to exploit sparsity in the POP and propose a sparse semidefinite programming (SDP) relaxation that is much smaller than the standard Lasserre's hierarchy while preserving empirical exactness, i.e., the SDP recovers the optimizer of the nonconvex POP with an optimality certificate. Our third contribution is to solve the SDP relaxations at an unprecedented scale and accuracy by presenting STRIDE, a solver that blends global descent on the convex SDP with fast local search on the nonconvex POP. Our fourth contribution is an evaluation of the proposed framework on six geometric perception problems including single and multiple rotation averaging, point cloud and mesh registration, absolute pose estimation, and category-level object pose and shape estimation. Our experiments demonstrate that (i) our sparse SDP relaxation is empirically exact with up to 60%-90% outliers across applications; (ii) while still being far from real-time, STRIDE is up to 100 times faster than existing SDP solvers on medium-scale problems, and is the only solver that can solve large-scale SDPs with hundreds of thousands of constraints to high accuracy; (iii) STRIDE safeguards existing fast heuristics for robust estimation (e.g., RANSAC or Graduated Non-Convexity), i.e., it certifies global optimality if the heuristic estimates are optimal, or detects and allows escaping local optima when the heuristic estimates are suboptimal.


title: Federated Learning Beyond the Star: Local D2D Model Consensus with Global Cluster Sampling

abstract: Federated learning has emerged as a popular technique for distributing model training across the network edge. Its learning architecture is conventionally a star topology between the devices and a central server. In this paper, we propose two timescale hybrid federated learning (TT-HF), which migrates to a more distributed topology via device-to-device (D2D) communications. In TT-HF, local model training occurs at devices via successive gradient iterations, and the synchronization process occurs at two timescales: (i) macro-scale, where global aggregations are carried out via device-server interactions, and (ii) micro-scale, where local aggregations are carried out via D2D cooperative consensus formation in different device clusters. Our theoretical analysis reveals how device, cluster, and network-level parameters affect the convergence of TT-HF, and leads to a set of conditions under which a convergence rate of O(1/t) is guaranteed. Experimental results demonstrate the improvements in convergence and utilization that can be obtained by TT-HF over state-of-the-art federated learning baselines.


title: Capturing the objects of vision with neural networks

abstract: Human visual perception carves a scene at its physical joints, decomposing the world into objects, which are selectively attended, tracked, and predicted as we engage our surroundings. Object representations emancipate perception from the sensory input, enabling us to keep in mind that which is out of sight and to use perceptual content as a basis for action and symbolic cognition. Human behavioral studies have documented how object representations emerge through grouping, amodal completion, proto-objects, and object files. Deep neural network (DNN) models of visual object recognition, by contrast, remain largely tethered to the sensory input, despite achieving human-level performance at labeling objects. Here, we review related work in both fields and examine how these fields can help each other. The cognitive literature provides a starting point for the development of new experimental tasks that reveal mechanisms of human object perception and serve as benchmarks driving development of deep neural network models that will put the object into object recognition.


title: Dense quasi-free subalgebras of the Toeplitz algebra

abstract: We introduce a family of dense subalgebras of the Toeplitz algebra and give conditions under which our algebras are quasi-free. As a corollary, we show that the smooth Toeplitz algebra introduced by Cuntz is quasi-free.


title: Abelian Complex Structures and Generalizations

abstract: After a review on the development of deformation theory of abelian complex structures from both the classical and generalized sense, we propose the concept of semi-abelian generalized complex structure. We present some observations on such structure and illustrate this new concept with a variety of examples.


title: Direct Geometric Probe of Singularities in Band Structure

abstract: The band structure of a crystal may have points where two or more bands are degenerate in energy and where the geometry of the Bloch state manifold is singular, with consequences for material and transport properties. Ultracold atoms in optical lattices have been used to characterize such points only indirectly, e.g., by detection of an Abelian Berry phase, and only at singularities with linear dispersion (Dirac points). Here, we probe band-structure singularities through the non-Abelian transformation produced by transport directly through the singular points. We prepare atoms in one Bloch band, accelerate them along a quasi-momentum trajectory that enters, turns, and then exits the singularities at linear and quadratic touching points of a honeycomb lattice. Measurements of the band populations after transport identify the winding numbers of these singularities to be 1 and 2, respectively. Our work opens the study of quadratic band touching points in ultracold-atom quantum simulators, and also provides a novel method for probing other band geometry singularities.


title: Signatures of Type III Solar Radio Bursts from Nanoflares: Modeling

abstract: There is a wide consensus that the ubiquitous presence of magnetic reconnection events and the associated impulsive heating (nanoflares) is a strong candidate for solving the solar coronal heating problem. Whether nanoflares accelerate particles to high energies like full-sized flares is unknown. We investigate this question by studying the type III radio bursts that the nanoflares may produce on closed loops. The characteristic frequency-drifts that type III bursts exhibit can be detected using a novel application of the time-lag technique developed by Viall & Klimchuk (2012) even when there are multiple overlapping bursts. We present a simple numerical model that simulates the expected radio emission from nanoflares in an active region (AR), which we use to test and calibrate the technique. We find that in the case of closed loops the frequency spectrum of type III bursts is expected to be extremely steep such that significant emission is produced at a given frequency only for a rather narrow range of loop lengths. We also find that the signature of bursts in the time-lag signal diminishes as: (1)the variety of participating loops within that range increases; (2)the occurrence rate of bursts increases; (3) the duration of bursts increases; and (4) the brightness of the bursts decreases relative to noise. In addition, our model suggests a possible origin of type I bursts as a natural consequence of type III emission in a closed-loop geometry.


title: Soft particles reinforce robotic grippers: Robotic grippers based on granular jamming of soft particles

abstract: Granular jamming has been identified as a fundamental mechanism for the operation of robotic grippers. In this work, we show, that soft particles like expanded polystyrene beads lead to significantly larger gripping forces in comparison to rigid particles. In contradiction to naive expectation, the combination of jamming and elasticity gives rise to very different properties of the jammed phase, compared to hard-particle systems. This may be of interest also beyond the application in robotic grippers.


title: An Exact Method for (Constrained) Assortment Optimization Problems with Product Costs

abstract: We study the problem of optimizing assortment decisions in the presence of product-specific costs when customers choose according to a multinomial logit model. This problem is NP-hard and approximate solutions methods have been proposed in the literature to obtain both lower and upper bounds in a tractable manner. We propose the first exact solution method for this problem and show that provably optimal assortments of instances with up to one thousand products can be found, on average, in about two tenths of a second. In particular, we propose a bounding procedure based on the approximation method of Feldman and Topaloglu (2015a) to provide tight lower and upper bounds at a fraction of their computing times. We show how these bounds can be used to effectively identify an optimal assortment. We also describe how to adapt our approach to handle cardinality or space/resource capacity constraints on the assortment as well as assortment optimization under a mixed-multinomial logit model. In both cases, our solution method provides significant computational boosts compared to exact methods from the literature.


title: Integral equation models for solvent in macromolecular crystals

abstract: Solvent can occupy up to ~70% of macromolecular crystals and hence having models that predict solvent distributions in periodic systems could improve in the interpretation of crystallographic data. Yet there are few implicit solvent models applicable to periodic solutes while crystallographic structures are commonly solved assuming a flat solvent model. Here we present a newly-developed periodic version of the 3D-RISM integral equation method that is able to solve for efficiently and describe accurately water and ions distributions in periodic systems; the code can compute accurate gradients that can be used in minimizations or molecular dynamics simulations. The new method includes an extension of the OZ equation needed to yield charge neutrality for charged solutes which requires an additional contribution to the excess chemical potential that has not been previously identified; this is an important consideration for nucleic acids or any other charged system where most or all of the counter- and co-ions are part of the "disordered" solvent. We present of several calculations of protein, RNA and small molecule crystals to show that X-ray scattering intensities and solvent structure predicted by the periodic 3D-RISM solvent model are in closer agreement with experiment than are intensities computed using the default flat solvent model in the refmac5 or phenix refinement programs, with the greatest improvement in the 2 to 4 {\AA} range. Prospects for incorporating integral equation models into crystallographic refinement are discussed.


title: Measuring an off-Center Detonation through Infrared Line Profiles: The peculiar Type Ia Supernova SN~2020qxp/ASASSN-20jq

abstract: We present and analyze a near infrared(NIR) spectrum of the under-luminous Type Ia supernova SN~2020qxp/ASASSN-20jq obtained with NIRES at the Keck Observatory 191 days after B-band maximum. The spectrum is dominated by a number of broad emission features including the [FeII] at 1.644mu which is highly asymmetric with a tilted top and a peak red-shifted by ~2,000km/s. In comparison with 2-D non-LTE synthetic spectra computed from 3-D simulations of off-center delayed-detonation Chandrasekhar-mass white-dwarf(WD) models, we find good agreement between the observed lines and the synthetic profiles, and are able to unravel the structure of the progenitor's envelope. We find that the size and tilt of the [Fe II] 1.644mu-profile (in velocity space) is an effective way to determine the location of an off-center delayed-detonation transition (DDT) and the viewing angle, and it requires a WD with a high central density of ~4E9$g/cm^3$. We also tentatively identify a stable Ni feature around 1.9mu characterized by a `pot-belly' profile that is slightly offset with respect to the kinematic center. In the case of SN~2020qxp/ASASSN-20jq, we estimate that the location of the DDT is ~0.3M(WD) off-center, which gives rise to an asymmetric distribution of the underlying ejecta. We also demonstrate that low-luminosity and high-density WD SNIa progenitors exhibit a very strong overlap of Ca and 56Ni in physical space. This results in the formation of a prevalent [Ca II] 0.73mu emission feature, which is sensitive to asymmetry effects. Our findings are discussed within the context of alternative scenarios, including off-center C/O detonations in He-triggered sub-M(Ch)-WDs and the direct collision of two WDs. Snapshot programs with Gemini/Keck/VLT/ELT class instruments and our spectropolarimetry program are complementary to mid-IR spectra by JWST.


title: Polynomials that preserve nonnegative matrices

abstract: In further pursuit of a solution to the celebrated nonnegative inverse eigenvalue problem, Loewy and London [Linear and Multilinear Algebra 6 (1978/79), no.~1, 83--90] posed the problem of characterizing all polynomials that preserve all nonnegative matrices of a fixed order. If $\mathscr{P}_n$ denotes the set of all polynomials that preserve all $n$-by-$n$ nonnegative matrices, then it is clear that polynomials with nonnegative coefficients belong to $\mathscr{P}_n$. However, it is known that $\mathscr{P}_n$ contains polynomials with negative entries. In this work, novel results for $\mathscr{P}_n$ with respect to the coefficients of the polynomials belonging to $\mathscr{P}_n$. Along the way, a generalization for the even-part and odd-part are given and shown to be equivalent to another construction that appeared in the literature. Implications for further research are discussed.


title: A series expansion formula of the scale matrix with applications in change-point detection

abstract: We introduce a new Levy fluctuation theoretic method to analyze the cumulative sum (CUSUM) procedure in sequential change-point detection. When observations are phase-type distributed and the post-change distribution is given by exponential tilting of its pre-change distribution, the first passage analysis of the CUSUM statistic is reduced to that of a certain Markov additive process. We develop a novel series expansion formula of the scale matrix for Markov additive processes of finite activity, and apply it to derive exact expressions of the average run length, average detection delay, and false alarm probability under the CUSUM procedure.


title: On the space of coefficients of a Feed Forward Neural Network

abstract: We define and establish the conditions for `equivalent neural networks' - neural networks with different weights, biases, and threshold functions that result in the same associated function. We prove that given a neural network $\mathcal{N}$ with piece-wise linear activation, the space of coefficients describing all equivalent neural networks is given by a semialgebraic set. This result is obtained by studying different representations of a given piece-wise linear function using the Tarski-Seidenberg theorem.


title: Beyond second-moment approximation in fuzzy-field-theory-like matrix models

abstract: We investigate the phase structure of a special class of multi-trace hermitian matrix models, which are candidates for the description of scalar field theory on fuzzy spaces. We include up to the fourth moment of the eigenvalue distribution into the multi-trace part of the probability distribution, which stems from the kinetic term of the field theory action. We show that by considering different multi-trace behavior in the large moment and in the small moment regimes of the model, it is possible to obtain a matrix model, which describes the numerically observed phase structure of fuzzy field theories. Including the existence of uniform order phase, triple point, and an approximately straight transition line between the uniform and non-uniform order phases.


title: Search for Lepton Flavor Violation in $\Upsilon (3S)\rightarrow e^{\pm}\mu^{\mp}$

abstract: We report on the first search for electron-muon lepton flavor violation (LFV) in the decay of a $b$~quark and $b$~antiquark bound state. We look for the LFV decay $\Upsilon (3S)\rightarrow e^{\pm}\mu^{\mp}$ in a sample of 118~million $\Upsilon (3S)$ mesons from 27~fb$^{-1}$ of data collected with the \babar\ detector at the SLAC PEP-II $e^+e^-$ collider operating with a 10.36~GeV center-of-mass energy. No evidence for a signal is found and we set a limit on the branching fraction $\mathcal{B}(\Upsilon(3S)\rightarrow e^{\pm}\mu^{\mp})<3.6\times10^{-7}\mathrm{at~ 90\%~ CL}$. This result can be interpreted as a limit $\Lambda_{NP}/g^2_{NP} > 80~$TeV on the energy scale $\Lambda_{NP}$ divided by the coupling-squared $g^2_{NP}$ of relevant new physics.


title: SIHR: Statistical Inference in High-Dimensional Linear and Logistic Regression Models

abstract: We introduce the R package \CRANpkg{SIHR} for statistical inference in high-dimensional generalized linear models with continuous and binary outcomes. The package provides functionalities for constructing confidence intervals and performing hypothesis tests for low-dimensional objectives in both one-sample and two-sample regression settings. We illustrate the usage of \CRANpkg{SIHR} through numerical examples and present real data applications to demonstrate the package's performance and practicality.


title: Forward and Inverse models in HCI:Physical simulation and deep learning for inferring 3D finger pose

abstract: We outline the role of forward and inverse modelling approaches in the design of human--computer interaction systems. Causal, forward models tend to be easier to specify and simulate, but HCI requires solutions of the inverse problem. We infer finger 3D position $(x,y,z)$ and pose (pitch and yaw) on a mobile device using capacitive sensors which can sense the finger up to 5cm above the screen. We use machine learning to develop data-driven models to infer position, pose and sensor readings, based on training data from: 1. data generated by robots, 2. data from electrostatic simulators 3. human-generated data. Machine learned emulation is used to accelerate the electrostatic simulation performance by a factor of millions. We combine a Conditional Variational Autoencoder with domain expertise/models experimentally collected data. We compare forward and inverse model approaches to direct inference of finger pose. The combination gives the most accurate reported results on inferring 3D position and pose with a capacitive sensor on a mobile device.


title: SiS formation in the interstellar medium through Si+SH gas phase reactions

abstract: Silicon monosulfide is an important silicon bearing molecule detected in circumstellar envelopes and star forming regions. Its formation and destruction routes are not well understood, partially due to the lack of a detailed knowledge on the involved reactions and their rate coefficients. In this work we have calculated and modeled the potential energy surface (PES) of the HSiS system employing highly accurate multireference electronic structure methods. After obtaining an accurate analytic representation of the PES, which includes long-range energy terms in a realistic way via the DMBE method, we have calculated rate coefficients for the Si+SH$\rightarrow$SiS+H reaction over the temperature range of 25-1000K. This reaction is predicted to be fast, with a rate coefficient of $\sim 1\times 10^{-10}\rm cm^3\, s^{-1}$ at 200K, which substantially increases for lower temperatures (the temperature dependence can be described by a modified Arrhenius equation with $\alpha=0.770\times 10^{-10}\rm cm^3\,s^{-1}$, $\beta=-0.756$ and $\gamma=9.873\, \rm K$). An astrochemical gas-grain model of a shock region similar to L1157-B1 shows that the inclusion of the Si+SH reaction increases the SiS gas-phase abundance relative to \ce{H2} from $5\times 10^{-10}$ to $1.4\times 10^{-8}$, which perfectly matches the observed abundance of $\sim 2\times 10^{-8}$.


title: Probing the superconducting ground state of noncentrosymmetric high entropy alloys using muon-spin rotation and relaxation

abstract: Recently, high entropy alloys (HEAs) have emerged as a new platform for discovering superconducting materials and offer avenues to explore exotic superconductivity. The highly disordered nature of HEA suggests regular phonon required for BCS superconductivity may be unlikely to occur. Therefore understanding the microscopic properties of these superconducting HEA is important. We report the first detailed characterization of the superconducting properties of the noncentrosymmetric ($\alpha$-Mn structure) HEA {(HfNb)}$_{0.10}${(MoReRu)}$_{0.90}$, and {(ZrNb)}$_{0.10}${(MoReRu)}$_{0.90}$ by using magnetization, specific heat, AC transport, and muon-spin relaxation/rotation ($\mu$SR). Despite the disordered nature, low temperature specific heat and transverse-field muon spin rotation measurements suggest nodeless isotropic superconducting gap and Zero-field $\mu$SR measurements confirm that time reversal symmetry is preserved in the superconducting ground state.


title: Non-uniform random graphs on the plane: A scaling study

abstract: We consider random geometric graphs on the plane characterized by a non-uniform density of vertices. In particular, we introduce a graph model where $n$ vertices are independently distributed in the unit disc with positions, in polar coordinates $(l,\theta)$, obeying the probability density functions $\rho(l)$ and $\rho(\theta)$. Here we choose $\rho(l)$ as a normal distribution with zero mean and variance $\sigma\in(0,\infty)$ and $\rho(\theta)$ as an uniform distribution in the interval $\theta\in [0,2\pi)$. Then, two vertices are connected by an edge if their Euclidian distance is less or equal than the connection radius $\ell$. We characterize the topological properties of this random graph model, which depends on the parameter set $(n,\sigma,\ell)$, by the use of the average degree $\left\langle k \right\rangle$ and the number of non-isolated vertices $V_\times$; while we approach their spectral properties with two measures on the graph adjacency matrix: the ratio of consecutive eigenvalue spacings $r$ and the Shannon entropy $S$ of eigenvectors. First we propose a heuristic expression for $\left\langle k(n,\sigma,\ell) \right\rangle$. Then, we look for the scaling properties of the normalized average measure $\left\langle \overline{X} \right\rangle$ (where $X$ stands for $V_\times$, $r$ and $S$) over graph ensembles. We demonstrate that the scaling parameter of $\left\langle \overline{V_\times} \right\rangle=\left\langle V_\times \right\rangle/n$ is indeed $\left\langle k \right\rangle$; with $\left\langle \overline{V_\times} \right\rangle \approx 1-\exp(-\left\langle k \right\rangle)$. Meanwhile, the scaling parameter of both $\left\langle \overline{r} \right\rangle$ and $\left\langle \overline{S} \right\rangle$ is proportional to $n^{-\gamma} \left\langle k \right\rangle$ with $\gamma\approx 0.16$.


title: Monotone Equilibrium in Matching Markets with Signaling

abstract: We introduce a notion of competitive signaling equilibrium (CSE) in one-to-one matching markets with a continuum of heterogeneous senders and receivers. We then study monotone CSE where equilibrium outcomes - sender actions, receiver reactions, beliefs, and matching - are all monotone in the stronger set order. We show that if the sender utility is monotone-supermodular and the receiver's utility is weakly monotone-supermodular, a CSE is stronger monotone if and only if it passes Criterion D1 (Cho and Kreps (1987), Banks and Sobel (1987)). Given any interval of feasible reactions that receivers can take, we fully characterize a unique stronger monotone CSE and establishes its existence with quasilinear utility functions.


title: Paulihedral: A Generalized Block-Wise Compiler Optimization Framework For Quantum Simulation Kernels

abstract: The quantum simulation kernel is an important subroutine appearing as a very long gate sequence in many quantum programs. In this paper, we propose Paulihedral, a block-wise compiler framework that can deeply optimize this subroutine by exploiting high-level program structure and optimization opportunities. Paulihedral first employs a new Pauli intermediate representation that can maintain the high-level semantics and constraints in quantum simulation kernels. This naturally enables new large-scale optimizations that are hard to implement at the low gate-level. In particular, we propose two technology-independent instruction scheduling passes, and two technology-dependent code optimization passes which reconcile the circuit synthesis, gate cancellation, and qubit mapping stages of the compiler. Experimental results show that Paulihedral can outperform state-of-the-art compiler infrastructures in a wide-range of applications on both near-term superconducting quantum processors and future fault-tolerant quantum computers.


title: Identifying Influential Nodes in Two-mode Data Networks using Formal Concept Analysis

abstract: Identifying important actors (or nodes) in a two-mode network often remains a crucial challenge in mining, analyzing, and interpreting real-world networks. While traditional bipartite centrality indices are often used to recognize key nodes that influence the network information flow, they frequently produce poor results in intricate situations such as massive networks with complex local structures or a lack of complete knowledge about the network topology and certain properties. In this paper, we introduce Bi-face (BF), a new bipartite centrality measurement for identifying important nodes in two-mode networks. Using the powerful mathematical formalism of Formal Concept Analysis, the BF measure exploits the faces of concept intents to identify nodes that have influential bicliques connectivity and are not located in irrelevant bridges. Unlike off-the shelf centrality indices, it quantifies how a node has a cohesive-substructure influence on its neighbour nodes via bicliques while not being in network core-peripheral ones through its absence from non-influential bridges. Our experiments on several real-world and synthetic networks show the efficiency of BF over existing prominent bipartite centrality measures such as betweenness, closeness, eigenvector, and vote-rank among others.


title: IceClave: A Trusted Execution Environment for In-Storage Computing

abstract: In-storage computing with modern solid-state drives (SSDs) enables developers to offload programs from the host to the SSD. It has been proven to be an effective approach to alleviate the I/O bottleneck. To facilitate in-storage computing, many frameworks have been proposed. However, few of them treat the in-storage security as the first citizen. Specifically, since modern SSD controllers do not have a trusted execution environment, an offloaded (malicious) program could steal, modify, and even destroy the data stored in the SSD. In this paper, we first investigate the attacks that could be conducted by offloaded in-storage programs. To defend against these attacks, we build a lightweight trusted execution environment, named IceClave for in-storage computing. IceClave enables security isolation between in-storage programs and flash management functions that include flash address translation, data access control, and garbage collection, with TrustZone extensions. IceClave also achieves security isolation between in-storage programs by enforcing memory integrity verification of in-storage DRAM with low overhead. To protect data loaded from flash chips, IceClave develops a lightweight data encryption/decryption mechanism in flash controllers. We develop IceClave with a full system simulator. We evaluate IceClave with a variety of data-intensive applications such as databases. Compared to state-of-the-art in-storage computing approaches, IceClave introduces only 7.6% performance overhead, while enforcing security isolation in the SSD controller with minimal hardware cost. IceClave still keeps the performance benefit of in-storage computing by delivering up to 2.31$\times$ better performance than the conventional host-based trusted computing approach.


abstract: Inverse kinematics (IK) is the problem of finding robot joint configurations that satisfy constraints on the position or pose of one or more end-effectors. For robots with redundant degrees of freedom, there is often an infinite, nonconvex set of solutions. The IK problem is further complicated when collision avoidance constraints are imposed by obstacles in the workspace. In general, closed-form expressions yielding feasible configurations do not exist, motivating the use of numerical solution methods. However, these approaches rely on local optimization of nonconvex problems, often requiring an accurate initialization or numerous re-initializations to converge to a valid solution. In this work, we first formulate inverse kinematics with complex workspace constraints as a convex feasibility problem whose low-rank feasible points provide exact IK solutions. We then present \texttt{CIDGIK} (Convex Iteration for Distance-Geometric Inverse Kinematics), an algorithm that solves this feasibility problem with a sequence of semidefinite programs whose objectives are designed to encourage low-rank minimizers. Our problem formulation elegantly unifies the configuration space and workspace constraints of a robot: intrinsic robot geometry and obstacle avoidance are both expressed as simple linear matrix equations and inequalities. Our experimental results for a variety of popular manipulator models demonstrate faster and more accurate convergence than a conventional nonlinear optimization-based approach, especially in environments with many obstacles.


title: Malware Squid: A Novel IoT Malware Traffic Analysis Framework using Convolutional Neural Network and Binary Visualisation

abstract: Internet of Things devices have seen a rapid growth and popularity in recent years with many more ordinary devices gaining network capability and becoming part of the ever growing IoT network. With this exponential growth and the limitation of resources, it is becoming increasingly harder to protect against security threats such as malware due to its evolving faster than the defence mechanisms can handle with. The traditional security systems are not able to detect unknown malware as they use signature-based methods. In this paper, we aim to address this issue by introducing a novel IoT malware traffic analysis approach using neural network and binary visualisation. The prime motivation of the proposed approach is to faster detect and classify new malware (zero-day malware). The experiment results show that our method can satisfy the accuracy requirement of practical application.


title: Near-horizon microstructure and superradiant instability of black holes

abstract: Ultralight bosons, as important candidates of dark matter, can condense around spinning black holes (BHs) to form long-lived ``boson clouds'' due to superradiance instability. The boson-BH system can be observed through gravitational wave detection and may become a new window to find traces of ultralight bosons. In this letter we explore the effects on the superradiant instability of BHs from the near-horizon microstructure. By introducing the reflection parameter near a BH horizon, we derived analytical results on the corrections to both energy levels of bosonic cloud and its characteristic frequencies of superradiance instability. Our results imply that the evolution of a boson-BH system and gravitational waves it emits would be influenced by the near-horizon physics of a BH.


title: The Moduli of Sections Has a Canonical Obstruction Theory

abstract: We give a detailed proof that locally Noetherian moduli stacks of sections carry canonical obstruction theories. As part of the argument we construct a dualizing sheaf and trace map, in the lisse-etale topology, for families of tame twisted curves, when the base stack is locally Noetherian.


title: Rethinking Multidimensional Discriminator Output for Generative Adversarial Networks

abstract: The study of multidimensional discriminator (critic) output for Generative Adversarial Networks has been underexplored in the literature. In this paper, we generalize the Wasserstein GAN framework to take advantage of multidimensional critic output and explore its properties. We also introduce a square-root velocity transformation (SRVT) block which favors training in the multidimensional setting. Proofs of properties are based on our proposed maximal p-centrality discrepancy, which is bounded above by p-Wasserstein distance and fits the Wasserstein GAN framework with multidimensional critic output n. Especially when n = 1 and p = 1, the proposed discrepancy equals 1-Wasserstein distance. Theoretical analysis and empirical evidence show that high-dimensional critic output has its advantage on distinguishing real and fake distributions, and benefits faster convergence and diversity of results.


title: Application of Ghost-DeblurGAN to Fiducial Marker Detection

abstract: Feature extraction or localization based on the fiducial marker could fail due to motion blur in real-world robotic applications. To solve this problem, a lightweight generative adversarial network, named Ghost-DeblurGAN, for real-time motion deblurring is developed in this paper. Furthermore, on account that there is no existing deblurring benchmark for such task, a new large-scale dataset, YorkTag, is proposed that provides pairs of sharp/blurred images containing fiducial markers. With the proposed model trained and tested on YorkTag, it is demonstrated that when applied along with fiducial marker systems to motion-blurred images, Ghost-DeblurGAN improves the marker detection significantly. The datasets and codes used in this paper are available at: https://github.com/York-SDCNLab/Ghost-DeblurGAN.


title: A two phase boundary obstacle-type problem for the bi-Laplacian

abstract: In this paper we are concerned with a two phase boundary obstacle-type problem for the bi-Laplace operator in the upper unit ball. The problem arises in connection with unilateral phenomena for flat elastic plates. It can also be seen as an extension problem to an obstacle problem for the fractional Laplacian $(-\Delta )^{3/2}$, as first observed in \cite{Y}. We establish the well-posedness and the optimal regularity of the solution, and we study the structure of the free boundary. Our proofs are based on monotonicity formulas of Almgren- and Monneau-type.


title: Self-supervised Contrastive Cross-Modality Representation Learning for Spoken Question Answering

abstract: Spoken question answering (SQA) requires fine-grained understanding of both spoken documents and questions for the optimal answer prediction. In this paper, we propose novel training schemes for spoken question answering with a self-supervised training stage and a contrastive representation learning stage. In the self-supervised stage, we propose three auxiliary self-supervised tasks, including utterance restoration, utterance insertion, and question discrimination, and jointly train the model to capture consistency and coherence among speech documents without any additional data or annotations. We then propose to learn noise-invariant utterance representations in a contrastive objective by adopting multiple augmentation strategies, including span deletion and span substitution. Besides, we design a Temporal-Alignment attention to semantically align the speech-text clues in the learned common space and benefit the SQA tasks. By this means, the training schemes can more effectively guide the generation model to predict more proper answers. Experimental results show that our model achieves state-of-the-art results on three SQA benchmarks.