title: MAESTRO-X: Distributed Orchestration of Rotary-Wing UAV-Relay Swarms

abstract: This work details a scalable framework to orchestrate a swarm of rotary-wing UAVs serving as cellular relays to facilitate beyond line-of-sight connectivity and traffic offloading for ground users. First, a Multiscale Adaptive Energy-conscious Scheduling and TRajectory Optimization (MAESTRO) framework is developed for a single UAV. Aiming to minimize the time-averaged latency to serve user requests, subject to an average UAV power constraint, it is shown that the optimization problem can be cast as a semi-Markov decision process, and exhibits a multiscale structure: outer actions on radial wait velocities and terminal service positions minimize the long-term delay-power trade-off, optimized via value iteration; given these outer actions, inner actions on angular wait velocities and service trajectories minimize a short-term delay-energy cost. A novel hierarchical competitive swarm optimization scheme is developed in the inner optimization, to devise high-resolution trajectories via iterative pair-wise updates. Next, MAESTRO is eXtended to UAV swarms (MAESTRO-X) via scalable policy replication: enabled by a decentralized command-and-control network, the optimal single-agent policy is augmented with spread maximization, consensus-driven conflict resolution, adaptive frequency reuse, and piggybacking. Numerical evaluations show that, for user requests of 10 Mbits, generated according to a Poisson arrival process with rate 0.2 req/min/UAV, single-agent MAESTRO offers 3.8x faster service than a high-altitude platform and 29% faster than a static UAV deployment; moreover, for a swarm of 3 UAV-relays, MAESTRO-X delivers data payloads 4.7x faster than a successive convex approximation scheme; and remarkably, a single UAV optimized via MAESTRO outclasses 3 UAVs optimized via a deep-Q network by 38%.


title: Laplacian Change Point Detection for Dynamic Graphs

abstract: Dynamic and temporal graphs are rich data structures that are used to model complex relationships between entities over time. In particular, anomaly detection in temporal graphs is crucial for many real world applications such as intrusion identification in network systems, detection of ecosystem disturbances and detection of epidemic outbreaks. In this paper, we focus on change point detection in dynamic graphs and address two main challenges associated with this problem: I) how to compare graph snapshots across time, II) how to capture temporal dependencies. To solve the above challenges, we propose Laplacian Anomaly Detection (LAD) which uses the spectrum of the Laplacian matrix of the graph structure at each snapshot to obtain low dimensional embeddings. LAD explicitly models short term and long term dependencies by applying two sliding windows. In synthetic experiments, LAD outperforms the state-of-the-art method. We also evaluate our method on three real dynamic networks: UCI message network, US senate co-sponsorship network and Canadian bill voting network. In all three datasets, we demonstrate that our method can more effectively identify anomalous time points according to significant real world events.


title: Climbing the WOL: Training for Cheaper Inference

abstract: Efficient inference for wide output layers (WOLs) is an essential yet challenging task in large scale machine learning. Most approaches reduce this problem to approximate maximum inner product search (MIPS), which relies heavily on the observation that for a given model, ground truth labels correspond to logits of highest value during full model inference. However, such an assumption is restrictive in practice. In this paper, we argue that approximate MIPS subroutines, despite having sub-linear computation time, are sub-optimal because they are tailored for retrieving large inner products with high recall instead of retrieving the correct labels. With WOL, the labels often have moderate inner products, which makes approximate MIPS more challenging. We propose an alternative problem formulation, called Label Superior Sampling (LSS), where the objective is to tailor the system to ensure retrieval of the correct label. Accordingly, we propose a novel learned hash approach, which is significantly more efficient and sufficient for high inference accuracy than MIPS baselines. Our extensive evaluation indicates that LSS can match or even outperform full inference accuracy with around 5x speed up and 87% energy reduction.


title: Software Engineering Event Modeling using Relative Time in Temporal Knowledge Graphs

abstract: We present a multi-relational temporal Knowledge Graph based on the daily interactions between artifacts in GitHub, one of the largest social coding platforms. Such representation enables posing many user-activity and project management questions as link prediction and time queries over the knowledge graph. In particular, we introduce two new datasets for i) interpolated time-conditioned link prediction and ii) extrapolated time-conditioned link/time prediction queries, each with distinguished properties. Our experiments on these datasets highlight the potential of adapting knowledge graphs to answer broad software engineering questions. Meanwhile, it also reveals the unsatisfactory performance of existing temporal models on extrapolated queries and time prediction queries in general. To overcome these shortcomings, we introduce an extension to current temporal models using relative temporal information with regards to past events.


title: The Multi-faceted Inverted Harmonic Oscillator: Chaos and Complexity

abstract: The harmonic oscillator is the paragon of physical models; conceptually and computationally simple, yet rich enough to teach us about physics on scales that span classical mechanics to quantum field theory. This multifaceted nature extends also to its inverted counterpart, in which the oscillator frequency is analytically continued to pure imaginary values. In this article we probe the inverted harmonic oscillator (IHO) with recently developed quantum chaos diagnostics such as the out-of-time-order correlator (OTOC) and the circuit complexity. In particular, we study the OTOC for the displacement operator of the IHO with and without a non-Gaussian cubic perturbation to explore genuine and quasi scrambling respectively. In addition, we compute the full quantum Lyapunov spectrum for the inverted oscillator, finding a paired structure among the Lyapunov exponents. We also use the Heisenberg group to compute the complexity for the time evolved displacement operator, which displays chaotic behaviour. Finally, we extended our analysis to N-inverted harmonic oscillators to study the behaviour of complexity at the different timescales encoded in dissipation, scrambling and asymptotic regimes.


title: "Most of" leads to undecidability: Failure of adding frequencies to LTL

abstract: Linear Temporal Logic (LTL) interpreted on finite traces is a robust specification framework popular in formal verification. However, despite the high interest in the logic in recent years, the topic of their quantitative extensions is not yet fully explored. The main goal of this work is to study the effect of adding weak forms of percentage constraints (e.g. that most of the positions in the past satisfy a given condition, or that sigma is the most-frequent letter occurring in the past) to fragments of LTL. Such extensions could potentially be used for the verification of influence networks or statistical reasoning. Unfortunately, as we prove in the paper, it turns out that percentage extensions of even tiny fragments of LTL have undecidable satisfiability and model-checking problems. Our undecidability proofs not only sharpen most of the undecidability results on logics with arithmetics interpreted on words known from the literature, but also are fairly simple. We also show that the undecidability can be avoided by restricting the allowed usage of the negation, and briefly discuss how the undecidability results transfer to first-order logic on words.


title: Cartan sub-algebra approach to efficient measurements of quantum observables

abstract: An arbitrary operator corresponding to a physical observable cannot be measured in a single measurement on currently available quantum hardware. To obtain the expectation value of the observable, one needs to partition its operator to measurable fragments. However, the observable and its fragments generally do not share any eigenstates, and thus the number of measurements needed to obtain the expectation value of the observable can grow rapidly even when the wavefunction prepared is close to an eigenstate of the observable. We provide a unified Lie algebraic framework for developing efficient measurement schemes for quantum observables, it is based on two elements: 1) embedding the observable operator in a Lie algebra and 2) transforming Lie algebra elements into those of a Cartan sub-algebra (CSA) using unitary operators. The CSA plays the central role because all its elements are mutually commutative and thus can be measured simultaneously. We illustrate the framework on measuring expectation values of Hamiltonians appearing in the Variational Quantum Eigensolver approach to quantum chemistry. The CSA approach puts many recently proposed methods for the measurement optimization within a single framework, and allows one not only to reduce the number of measurable fragments but also the total number of measurements.


title: Gray tensor product and saturated $N$-complicial sets

abstract: We show that the pretensor and tensor products of simplicial sets with marking are compatible with the homotopy theory of saturated $N$-complicial sets (which are a proposed model of $(\infty,N)$-categories), in the form of a Quillen bifunctor and a homotopical bifunctor, respectively.


title: Calibration of Biophysical Models for tau-Protein Spreading in Alzheimer's Disease from PET-MRI

abstract: Aggregates of misfolded tau proteins (or just 'tau' for brevity) play a crucial role in the progression of Alzheimer's disease (AD) as they correlate with cell death and accelerated tissue atrophy. Longitudinal positron emission tomography (PET) scans can be used quantify the extend of abnormal tau spread. Such PET-based image biomarkers are a promising technology for AD diagnosis and prognosis. Here, we propose to calibrate an organ-scale biophysical mathematical model using longitudinal PET scans to extract characteristic growth patterns and spreading of tau. The biophysical model is a reaction-advection-diffusion partial differential equation (PDE) with only two scalar unknown parameters, one representing the spreading (the diffusion part of the PDE) and the other one the growth of tau (the reaction part of the PDE). The advection term captures tissue atrophy and is obtained from diffeomorphic registration of longitudinal magnetic resonance imaging (MRI) scans. We describe the method, present a numerical scheme for the calibration of the growth and spreading parameters, perform a sensitivity study using synthetic data, and we perform a preliminary evaluation on clinical scans from the ADNI dataset. We study whether such model calibration is possible and investigate the sensitivity of such calibration to the time between consecutive scans and the presence of atrophy. Our findings show that despite using only two calibration parameters, the model can reconstruct clinical scans quite accurately. We discovered that small time intervals between scans and the presence of background noise create difficulties. Our reconstructed model fits the data well, yet the study on clinical data also reveals shortcomings of the simplistic model. Interestingly, the parameters show significant variability across patients, an indication that these parameters could be useful biomarkers.


title: A Scale-free Approach for False Discovery Rate Control in Generalized Linear Models

abstract: The generalized linear models (GLM) have been widely used in practice to model non-Gaussian response variables. When the number of explanatory features is relatively large, scientific researchers are of interest to perform controlled feature selection in order to simplify the downstream analysis. This paper introduces a new framework for feature selection in GLMs that can achieve false discovery rate (FDR) control in two asymptotic regimes. The key step is to construct a mirror statistic to measure the importance of each feature, which is based upon two (asymptotically) independent estimates of the corresponding true coefficient obtained via either the data-splitting method or the Gaussian mirror method. The FDR control is achieved by taking advantage of the mirror statistic's property that, for any null feature, its sampling distribution is (asymptotically) symmetric about 0. In the moderate-dimensional setting in which the ratio between the dimension (number of features) p and the sample size n converges to a fixed value, we construct the mirror statistic based on the maximum likelihood estimation. In the high-dimensional setting where p is much larger than n, we use the debiased Lasso to build the mirror statistic. Compared to the Benjamini-Hochberg procedure, which crucially relies on the asymptotic normality of the Z statistic, the proposed methodology is scale free as it only hinges on the symmetric property, thus is expected to be more robust in finite-sample cases. Both simulation results and a real data application show that the proposed methods are capable of controlling the FDR, and are often more powerful than existing methods including the Benjamini-Hochberg procedure and the knockoff filter.


title: A Perspective on Gaussian Processes for Earth Observation

abstract: Earth observation (EO) by airborne and satellite remote sensing and in-situ observations play a fundamental role in monitoring our planet. In the last decade, machine learning and Gaussian processes (GPs) in particular has attained outstanding results in the estimation of bio-geo-physical variables from the acquired images at local and global scales in a time-resolved manner. GPs provide not only accurate estimates but also principled uncertainty estimates for the predictions, can easily accommodate multimodal data coming from different sensors and from multitemporal acquisitions, allow the introduction of physical knowledge, and a formal treatment of uncertainty quantification and error propagation. Despite great advances in forward and inverse modelling, GP models still have to face important challenges that are revised in this perspective paper. GP models should evolve towards data-driven physics-aware models that respect signal characteristics, be consistent with elementary laws of physics, and move from pure regression to observational causal inference.


title: Tracking with A Common Tracking Software

abstract: In high energy physics (HEP) experiments, the reconstruction of charged particle trajectories is one of the most fundamental yet computationally expensive parts of event processing. At future hadron colliders such as the High-Luminosity Large Hadron Collider (HL-LHC), there can be up to ten thousand particles per event. This increases the track reconstruction time by a factor about 5 compared to the current tracking environment. Efficient and fast tracking software is necessary to maintain and improve the tracking performance. This can benefit from both fast tracking algorithms and modern computing architectures with many cores and accelerators. The Acts (A Common Tracking Software) project encapsulates the current ATLAS tracking software into an experiment-independent software designed for modern computing architectures. It provides a set of high-level track reconstruction tools agnostic to the details of the detector and magnetic field configuration. Particular emphasis is placed on thread-safety of the code in order to support concurrent event processing with context-dependent detector conditions, such as detector alignments or calibrations. Acts aims in addition to be a research and development platform for studying innovative tracking techniques and exploiting modern hardware architectures.


title: Statistical characterization and classification of astronomical transients with Machine Learning in the era of the Vera C. Rubin Observatory

abstract: Astronomy has entered the multi-messenger data era and Machine Learning has found widespread use in a large variety of applications. The exploitation of synoptic (multi-band and multi-epoch) surveys, like LSST (Legacy Survey of Space and Time), requires an extensive use of automatic methods for data processing and interpretation. With data volumes in the petabyte domain, the discrimination of time-critical information has already exceeded the capabilities of human operators and crowds of scientists have extreme difficulty to manage such amounts of data in multi-dimensional domains. This work is focused on an analysis of critical aspects related to the approach, based on Machine Learning, to variable sky sources classification, with special care to the various types of Supernovae, one of the most important subjects of Time Domain Astronomy, due to their crucial role in Cosmology. The work is based on a test campaign performed on simulated data. The classification was carried out by comparing the performances among several Machine Learning algorithms on statistical parameters extracted from the light curves. The results make in evidence some critical aspects related to the data quality and their parameter space characterization, propaedeutic to the preparation of processing machinery for the real data exploitation in the incoming decade.


title: Riemannian Geometry of a Discretized Circle and Torus

abstract: We extend the results of Riemannian geometry over finite groups and provide a full classification of all linear connections for the minimal noncommutative differential calculus over a finite cyclic group. We solve the torsion-free and metric compatibility condition in general and show that there are several classes of solutions, out of which only special ones are compatible with a metric that gives a Hilbert $C^\ast$-module structure on the space of the one-forms. We compute curvature and scalar curvature for these metrics and find their continuous limits.


title: Evolving Methods for Evaluating and Disseminating Computing Research

abstract: Social and technical trends have significantly changed methods for evaluating and disseminating computing research. Traditional venues for reviewing and publishing, such as conferences and journals, worked effectively in the past. Recently, trends have created new opportunities but also put new pressures on the process of review and dissemination. For example, many conferences have seen large increases in the number of submissions. Likewise, dissemination of research ideas has become dramatically through publication venues such as arXiv.org and social media networks. While these trends predate COVID-19, the pandemic could accelerate longer term changes. Based on interviews with leading academics in computing research, our findings include: (1) Trends impacting computing research are largely positive and have increased the participation, scope, accessibility, and speed of the research process. (2) Challenges remain in securing the integrity of the process, including addressing ways to scale the review process, avoiding attempts to misinform or confuse the dissemination of results, and ensuring fairness and broad participation in the process itself. Based on these findings, we recommend: (1) Regularly polling members of the computing research community, including program and general conference chairs, journal editors, authors, reviewers, etc., to identify specific challenges they face to better understand these issues. (2) An influential body, such as the Computing Research Association regularly issues a "State of the Computing Research Enterprise" report to update the community on trends, both positive and negative, impacting the computing research enterprise. (3) A deeper investigation, specifically to better understand the influence that social media and preprint archives have on computing research, is conducted.


title: Learning ordered pooling weights in image classification

abstract: Spatial pooling is an important step in computer vision systems like Convolutional Neural Networks or the Bag-of-Words method. The spatial pooling purpose is to combine neighbouring descriptors to obtain a single descriptor for a given region (local or global). The resultant combined vector must be as discriminant as possible, in other words, must contain relevant information, while removing irrelevant and confusing details. Maximum and average are the most common aggregation functions used in the pooling step. To improve the aggregation of relevant information without degrading their discriminative power for image classification, we introduce a simple but effective scheme based on Ordered Weighted Average (OWA) aggregation operators. We present a method to learn the weights of the OWA aggregation operator in a Bag-of-Words framework and in Convolutional Neural Networks, and provide an extensive evaluation showing that OWA based pooling outperforms classical aggregation operators.


title: Integrability of classical affine W-algebras

abstract: We prove that all classical affine W-algebras W(g,f), where g is a simple Lie algebra and f is its non-zero nilpotent element, admit an integrable hierarchy of bi-Hamiltonian PDEs, except possibly for one nilpotent conjugacy class in G_2, one in F_4, and five in E_8.


title: Predicting trajectories and mechanisms of antibiotic resistance evolution

abstract: Bacteria evolve resistance to antibiotics by a multitude of mechanisms. A central, yet unsolved question is how resistance evolution affects cell growth at different drug levels. Here we develop a fitness model that predicts growth rates of common resistance mutants from their effects on cell metabolism. We map metabolic effects of resistance mutations in drug-free environments and under drug challenge; the resulting fitness trade-off defines a Pareto surface of resistance evolution. We predict evolutionary trajectories of dosage-dependent growth rates and resistance levels, as well as the prevalent resistance mechanism depending on drug and nutrient levels. These predictions are confirmed by empirical growth curves and genomic data of E. coli populations. Our results show that resistance evolution, by coupling major metabolic pathways, is strongly intertwined with systems biology and ecology of microbial populations.


title: Five-Layers SDP-Based Hierarchical Security Paradigm for Multi-access Edge Computing

abstract: The rise in embedded and IoT device usage comes with an increase in LTE usage as well. About 70\% of an estimated 18 billion IoT devices will be using cellular LTE networks for efficient connections. This introduces several challenges such as security, latency, scalability, and quality of service, for which reason Edge Computing or Fog Computing has been introduced. The edge is capable of offloading resources to the edge to reduce workload at the cloud. Several security challenges come with Multi-access Edge Computing (MEC) such as location-based attacks, the man in the middle attacks, and sniffing. This paper proposes a Software-Defined Perimeter (SDP) framework to supplement MEC and provide added security. The SDP is capable of protecting the cloud from the edge by only authorizing authenticated users at the edge to access services in the cloud. The SDP is implemented within a Mobile Edge LTE network. Delay analysis of the implementation is performed, followed by a DoS attack to demonstrate the resilience of the proposed SDP. Further analyses such as CPU usage and Port Scanning were performed to verify the efficiency of the proposed SDP. This analysis is followed by concluding remarks with insight into the future of the SDP in MEC.


title: Autonomous and cooperative design of the monitor positions for a team of UAVs to maximize the quantity and quality of detected objects

abstract: This paper tackles the problem of positioning a swarm of UAVs inside a completely unknown terrain, having as objective to maximize the overall situational awareness. The situational awareness is expressed by the number and quality of unique objects of interest, inside the UAVs' fields of view. YOLOv3 and a system to identify duplicate objects of interest were employed to assign a single score to each UAVs' configuration. Then, a novel navigation algorithm, capable of optimizing the previously defined score, without taking into consideration the dynamics of either UAVs or environment, is proposed. A cornerstone of the proposed approach is that it shares the same convergence characteristics as the block coordinate descent (BCD) family of approaches. The effectiveness and performance of the proposed navigation scheme were evaluated utilizing a series of experiments inside the AirSim simulator. The experimental evaluation indicates that the proposed navigation algorithm was able to consistently navigate the swarm of UAVs to "strategic" monitoring positions and also adapt to the different number of swarm sizes. Source code is available at https://github.com/dimikout3/ConvCAOAirSim.


title: Worpitzky-compatible subarrangements of braid arrangements and cocomparability graphs

abstract: The class of Worpitzky-compatible subarrangements of a Weyl arrangement together with an associated Eulerian polynomial was recently introduced by Ashraf, Yoshinaga and the first author, which brings the characteristic and Ehrhart quasi-polynomials into one formula. The subarrangements of the braid arrangement, the Weyl arrangement of type $A$, are known as the graphic arrangements. We prove that the Worpitzky-compatible graphic arrangements are characterized by cocomparability graphs. Our main result yields new formulas for the chromatic and graphic Eulerian polynomials of cocomparability graphs.


title: Entanglement-Assisted Quantum Communication Beating the Quantum Singleton Bound

abstract: Brun, Devetak, and Hsieh [Science 314, 436 (2006)] demonstrated that pre-shared entanglement between sender and receiver enables quantum communication protocols that have better parameters than schemes without the assistance of entanglement. Subsequently, the same authors derived a version of the so-called quantum Singleton bound that relates the parameters of the entanglement-assisted quantum-error correcting codes proposed by them. We present a new entanglement-assisted quantum communication scheme with parameters violating this bound in certain ranges.


title: Ground States for translationally invariant Pauli-Fierz Models at zero Momentum

abstract: We consider the translationally invariant Pauli-Fierz model describing a charged particle interacting with the electromagnetic field. We show under natural assumptions that the fiber Hamiltonian at zero momentum has a ground state.


title: Image Processing and Quality Control for Abdominal Magnetic Resonance Imaging in the UK Biobank

abstract: An end-to-end image analysis pipeline is presented for the abdominal MRI protocol used in the UK Biobank on the first 38,971 participants. Emphasis is on the processing steps necessary to ensure a high-level of data quality and consistency is produced in order to prepare the datasets for downstream quantitative analysis, such as segmentation and parameter estimation. Quality control procedures have been incorporated to detect and, where possible, correct issues in the raw data. Detection of fat-water swaps in the Dixon series is performed by a deep learning model and corrected automatically. Bone joints are predicted using a hybrid atlas-based registration and deep learning model for the shoulders, hips and knees. Simultaneous estimation of proton density fat fraction and transverse relaxivity (R2*) is performed using both the magnitude and phase information for the single-slice multiecho series. Approximately 98.1% of the two-point Dixon acquisitions were successfully processed and passed quality control, with 99.98% of the high-resolution T1-weighted 3D volumes succeeding. Approximately 99.98% of the single-slice multiecho acquisitions covering the liver were successfully processed and passed quality control, with 97.6% of the single-slice multiecho acquisitions covering the pancreas succeeding. At least one fat-water swap was detected in 1.8% of participants. With respect to the bone joints, approximately 3.3% of participants were missing at least one knee joint and 0.8% were missing at least one shoulder joint. For the participants who received both single-slice multiecho acquisition protocols for the liver a systematic difference between the two protocols was identified and modeled using multiple linear regression. The findings presented here will be invaluable for scientists who seek to use image-derived phenotypes from the abdominal MRI protocol.


title: Approximating Sparse Quadratic Programs

abstract: Given a matrix $A \in \mathbb{R}^{n\times n}$, we consider the problem of maximizing $x^TAx$ subject to the constraint $x \in \{-1,1\}^n$. This problem, called MaxQP by Charikar and Wirth [FOCS'04], generalizes MaxCut and has natural applications in data clustering and in the study of disordered magnetic phases of matter. Charikar and Wirth showed that the problem admits an $\Omega(1/\lg n)$ approximation via semidefinite programming, and Alon, Makarychev, Makarychev, and Naor [STOC'05] showed that the same approach yields an $\Omega(1)$ approximation when $A$ corresponds to a graph of bounded chromatic number. Both these results rely on solving the semidefinite relaxation of MaxQP, whose currently best running time is $\tilde{O}(n^{1.5}\cdot \min\{N,n^{1.5}\})$, where $N$ is the number of nonzero entries in $A$ and $\tilde{O}$ ignores polylogarithmic factors. In this sequel, we abandon the semidefinite approach and design purely combinatorial approximation algorithms for special cases of MaxQP where $A$ is sparse (i.e., has $O(n)$ nonzero entries). Our algorithms are superior to the semidefinite approach in terms of running time, yet are still competitive in terms of their approximation guarantees. More specifically, we show that: - MaxQP admits a $(1/2\Delta)$-approximation in $O(n \lg n)$ time, where $\Delta$ is the maximum degree of the corresponding graph. - UnitMaxQP, where $A \in \{-1,0,1\}^{n\times n}$, admits a $(1/2d)$-approximation in $O(n)$ time when the corresponding graph is $d$-degenerate, and a $(1/3\delta)$-approximation in $O(n^{1.5})$ time when the corresponding graph has $\delta n$ edges. - MaxQP admits a $(1-\varepsilon)$-approximation in $O(n)$ time when the corresponding graph and each of its minors have bounded local treewidth. - UnitMaxQP admits a $(1-\varepsilon)$-approximation in $O(n^2)$ time when the corresponding graph is $H$-minor free.


title: Contrast Specific Propensity Scores

abstract: Basic propensity score methodology is designed to balance multivariate pre-treatment covariates when comparing one active treatment with one control treatment. Practical settings often involve comparing more than two treatments, where more complicated contrasts than the basic treatment-control one,(1,-1), are relevant. Here, we propose the use of contrast-specific propensity scores (CSPS). CSPS allow the creation of treatment groups of units that are balanced with respect to bifurcations of the specified contrasts and the multivariate space spanned by them.


title: Asymptotics of the persistence exponent of integrated fractional Brownian motion and fractionally integrated Brownian motion

abstract: We consider the persistence probability for the integrated fractional Brownian motion and the fractionally integrated Brownian motion with parameter $H,$ respectively. For the integrated fractional Brownian motion, we discuss a conjecture of Molchan and Khokhlov and determine the asymptotic behavior of the persistence exponent as $H\to 0$ and $H\to 1,$ which is in accordance with the conjecture. For the fractionally integrated Brownian motion, also called Riemann-Liouville process, we find the asymptotic behavior of the persistence exponent as $H\to 0$.


title: AutoBayes: Automated Bayesian Graph Exploration for Nuisance-Robust Inference

abstract: Learning data representations that capture task-related features, but are invariant to nuisance variations remains a key challenge in machine learning. We introduce an automated Bayesian inference framework, called AutoBayes, that explores different graphical models linking classifier, encoder, decoder, estimator and adversarial network blocks to optimize nuisance-invariant machine learning pipelines. AutoBayes also enables learning disentangled representations, where the latent variable is split into multiple pieces to impose various relationships with the nuisance variation and task labels. We benchmark the framework on several public datasets, and provide analysis of its capability for subject-transfer learning with/without variational modeling and adversarial training. We demonstrate a significant performance improvement with ensemble learning across explored graphical models.


title: Directing Near-Infrared Photon Transport with Core@Shell Particles

abstract: Directing the propagation of near-infrared radiation is a major concern in improving the efficiency of solar cells and thermal insulators. A facile approach to scatter light in the near-infrared region without excessive heating is to embed compact layers with semiconductor particles. The directional scattering by semiconductor@oxide (core@shell) spherical particles (containing Si, InP, TiO$_2$, SiO$_2$, or ZrO$_2$) with a total radius varying from 0.1 to 4.0 {\mu}m and in an insulating medium at low volume fraction is investigated using Lorenz-Mie theory and multiscale modelling. The optical response of each layers is calculated under irradiation by the sun or a blackbody emitter at 1180 K. Reflectance efficiency factors of up to 83.7% and 63.9% are achieved for near-infrared solar and blackbody radiation in 200 {\mu}m thick compact layers with only 1% volume fraction of bare Si particles with a radius of 0.23 {\mu}m and 0.50 {\mu}m, respectively. The maximum solar and blackbody efficiency factors of layers containing InP particles was slightly less (80.2% and 60.7% for bare particles with a radius of 0.25 {\mu}m and 0.60 {\mu}m, respectively). The addition of an oxide coating modifies the surrounding dielectric environment, which improves the solar reflectance efficiency factor to over 90% provided it matches the scattering mode energies with the incident spectral density. The layers are spectrally-sensitive and can be applied as a back or front reflector for solar devices, high temperature thermal insulators, and optical filters in Gradient Heat Flux Sensors for fire safety applications.


title: Asymptotic gravitational charges

abstract: We present a method for finding, in principle, all asymptotic gravitational charges. The basic idea is that one must consider all possible contributions to the action that do not affect the equations of motion for the theory of interest; such terms include topological terms. As a result we observe that the first order formalism is best suited to an analysis of asymptotic charges. In particular, this method can be used to provide a Hamiltonian derivation of recently found dual charges.


title: On the use of historical estimates

abstract: The use of historical estimates in current studies is common in a wide variety of application areas. Nevertheless, despite their routine use the uncertainty associated with historical estimates is rarely properly accounted for in the analysis. In this communication we review common practices and then provide a mathematical formulation and a principled methodology for addressing the problem of drawing inferences in the presence of historical data. Three distinct variants are investigated in detail; the corresponding limiting distributions are found and compared. The design of future studies, given historical data, is also explored and relations with a variety of other well--studied statistical problems discussed.


title: Globally Optimal Segmentation of Mutually Interacting Surfaces using Deep Learning

abstract: Segmentation of multiple surfaces in medical images is a challenging problem, further complicated by the frequent presence of weak boundary and mutual influence between adjacent objects. The traditional graph-based optimal surface segmentation method has proven its effectiveness with its ability of capturing various surface priors in a uniform graph model. However, its efficacy heavily relies on handcrafted features that are used to define the surface cost for the "goodness" of a surface. Recently, deep learning (DL) is emerging as powerful tools for medical image segmentation thanks to its superior feature learning capability. Unfortunately, due to the scarcity of training data in medical imaging, it is nontrivial for DL networks to implicitly learn the global structure of the target surfaces, including surface interactions. In this work, we propose to parameterize the surface cost functions in the graph model and leverage DL to learn those parameters. The multiple optimal surfaces are then simultaneously detected by minimizing the total surface cost while explicitly enforcing the mutual surface interaction constraints. The optimization problem is solved by the primal-dual Internal Point Method, which can be implemented by a layer of neural networks, enabling efficient end-to-end training of the whole network. Experiments on Spectral Domain Optical Coherence Tomography (SD-OCT) retinal layer segmentation and Intravascular Ultrasound (IVUS) vessel wall segmentation demonstrated very promising results. All source code is public to facilitate further research at this direction.


title: S2CE: A Hybrid Cloud and Edge Orchestrator for Mining Exascale Distributed Streams

abstract: The explosive increase in volume, velocity, variety, and veracity of data generated by distributed and heterogeneous nodes such as IoT and other devices, continuously challenge the state of art in big data processing platforms and mining techniques. Consequently, it reveals an urgent need to address the ever-growing gap between this expected exascale data generation and the extraction of insights from these data. To address this need, this paper proposes Stream to Cloud & Edge (S2CE), a first of its kind, optimized, multi-cloud and edge orchestrator, easily configurable, scalable, and extensible. S2CE will enable machine and deep learning over voluminous and heterogeneous data streams running on hybrid cloud and edge settings, while offering the necessary functionalities for practical and scalable processing: data fusion and preprocessing, sampling and synthetic stream generation, cloud and edge smart resource management, and distributed processing.


title: Curriculum Manager for Source Selection in Multi-Source Domain Adaptation

abstract: The performance of Multi-Source Unsupervised Domain Adaptation depends significantly on the effectiveness of transfer from labeled source domain samples. In this paper, we proposed an adversarial agent that learns a dynamic curriculum for source samples, called Curriculum Manager for Source Selection (CMSS). The Curriculum Manager, an independent network module, constantly updates the curriculum during training, and iteratively learns which domains or samples are best suited for aligning to the target. The intuition behind this is to force the Curriculum Manager to constantly re-measure the transferability of latent domains over time to adversarially raise the error rate of the domain discriminator. CMSS does not require any knowledge of the domain labels, yet it outperforms other methods on four well-known benchmarks by significant margins. We also provide interpretable results that shed light on the proposed method.


title: Probing P- and CP-violation in dark matter interactions

abstract: Discrete symmetries played a central role in elucidating the structure of the weak interactions, and they will probably be equally crucial regarding the interactions of the dark matter (DM) particle -- whose nature remains elusive. In this work we show that signals in future direct detection experiments can be used to test, in a model-independent way, for P- and CP-violation in DM-nucleus interactions. The analysis is performed within the most general effective theory for non-relativistic spin-0 DM-nucleus interactions mediated by the exchange of a heavy particle. Assuming an idealised xenon detector, we calculate the expected number of DM signal events required to reject P and CP invariant DM-nucleus interactions. For a DM mass of 30 GeV (or higher), this number lies between about 10 and 300 DM signal events, depending on how P and CP invariance are modeled. Future direct detection experiments, therefore, have the potential to reveal P- and CP-violation in DM interactions, making a decisive step toward the identification of the DM particle.


title: Outlier Detection through Null Space Analysis of Neural Networks

abstract: Many machine learning classification systems lack competency awareness. Specifically, many systems lack the ability to identify when outliers (e.g., samples that are distinct from and not represented in the training data distribution) are being presented to the system. The ability to detect outliers is of practical significance since it can help the system behave in an reasonable way when encountering unexpected data. In prior work, outlier detection is commonly carried out in a processing pipeline that is distinct from the classification model. Thus, for a complete system that incorporates outlier detection and classification, two models must be trained, increasing the overall complexity of the approach. In this paper we use the concept of the null space to integrate an outlier detection method directly into a neural network used for classification. Our method, called Null Space Analysis (NuSA) of neural networks, works by computing and controlling the magnitude of the null space projection as data is passed through a network. Using these projections, we can then calculate a score that can differentiate between normal and abnormal data. Results are shown that indicate networks trained with NuSA retain their classification performance while also being able to detect outliers at rates similar to commonly used outlier detection algorithms.


title: The entropy method under curvature-dimension conditions in the spirit of Bakry-\'Emery in the discrete setting of Markov chains

abstract: We consider continuous-time (not necessarily finite) Markov chains on discrete spaces and identify a curvature-dimension inequality, the condition $CD_\Upsilon(\kappa,\infty)$, which serves as a natural analogue of the classical Bakry-\'Emery condition $CD(\kappa,\infty)$ in several respects. In particular, it is tailor-made to the classical approach of proofing the modified logarithmic Sobolev inequality via computing and estimating the second time derivative of the entropy along the heat flow generated by the generator of the Markov chain. We prove that curvature bounds in the sense of $CD_\Upsilon$ are preserved under tensorization, discuss links to other notions of discrete curvature and consider a variety of examples including complete graphs, the hypercube and birth-death processes. We further consider power type entropies and determine, in the same spirit, a natural CD condition which leads to Beckner inequalities. The $CD_\Upsilon$ condition is also shown to be compatible with the diffusive setting, in the sense that corresponding hybrid processes enjoy a tensorization property.


title: Multi-exponential Error Extrapolation and Combining Error Mitigation Techniques for NISQ Applications

abstract: Noise in quantum hardware remains the biggest roadblock for the implementation of quantum computers. To fight the noise in the practical application of near-term quantum computers, instead of relying on quantum error correction which requires large qubit overhead, we turn to quantum error mitigation, in which we make use of extra measurements. Error extrapolation is an error mitigation technique that has been successfully implemented experimentally. Numerical simulation and heuristic arguments have indicated that exponential curves are effective for extrapolation in the large circuit limit with an expected circuit error count around unity. In this article, we extend this to multi-exponential error extrapolation and provide more rigorous proof for its effectiveness under Pauli noise. This is further validated via our numerical simulations, showing orders of magnitude improvements in the estimation accuracy over single-exponential extrapolation. Moreover, we develop methods to combine error extrapolation with two other error mitigation techniques: quasi-probability and symmetry verification, through exploiting features of these individual techniques. As shown in our simulation, our combined method can achieve low estimation bias with a sampling cost multiple times smaller than quasi-probability while without needing to be able to adjust the hardware error rate as required in canonical error extrapolation.


title: Analysing Spatial Properties on Neighbourhood Spaces

abstract: We present a bisimulation relation for neighbourhood spaces, a generalisation of topological spaces. We show that this notion, path preserving bisimulation, preserves formulas of the spatial logic SLCS. We then use this preservation result to show that SLCS cannot express standard topological properties such as separation and connectedness. Furthermore, we compare the bisimulation relation with standard modal bisimulation and modal bisimulation with converse on graphs and prove it coincides with the latter.


title: Generalized KdV-type equations versus Boussinesq's equations for uneven bottom -- numerical study

abstract: The paper's main goal is to compare the motion of solitary surface waves resulting from two similar but slightly different approaches. In the first approach, the numerical evolution of soliton surface waves moving over the uneven bottom is obtained using single wave equations. In the second approach, the numerical evolution of the same initial conditions is obtained by the solution of a coupled set of the Boussinesq equations for the same Euler equations system. We discuss four physically relevant cases of relationships between small parameters $\alpha,\beta,\delta$. For the flat bottom, these cases imply the Korteweg-de Vries equation (KdV), the extended KdV (KdV2), fifth-order KdV (KdV5), and the Gardner equation (GE). In all studied cases, the influence of the bottom variations on the amplitude and velocity of a surface wave calculated from the Boussinesq equations is substantially more significant than that obtained from single wave equations.


title: 2DNMR data inversion using locally adapted multi-penalty regularization

abstract: A crucial issue in two-dimensional Nuclear Magnetic Resonance (NMR) is the speed and accuracy of the data inversion. This paper proposes a multi-penalty method with locally adapted regularization parameters for fast and accurate inversion of 2DNMR data. The method solves an unconstrained optimization problem whose objective contains a data-fitting term, a single $L1$ penalty parameter and a multiple parameter $L2$ penalty. We propose an adaptation of the Fast Iterative Shrinkage and Thresholding (FISTA) method to solve the multi-penalty minimization problem, and an automatic procedure to compute all the penalty parameters. This procedure generalizes the Uniform Penalty principle introduced in [Bortolotti et al., \emph{Inverse Problems}, 33(1), 2016]. The proposed approach allows us to obtain accurate relaxation time distributions while keeping short the computation time. Results of numerical experiments on synthetic and real data prove that the proposed method is efficient and effective in reconstructing the peaks and the flat regions that usually characterize NMR relaxation time distributions.


title: Khovanov homology detects the figure-eight knot

abstract: Using Dowlin's spectral sequence from Khovanov homology to knot Floer homology, we prove that reduced Khovanov homology (over $\mathbb{Q}$) detects the figure-eight knot.


title: Non-Wilsonian ultraviolet completion via transseries

abstract: We study some of the implications for the perturbative renormalization program when augmented with the Borel-Ecalle resummation. We show the emergence of a new kind of non-perturbative fixed point for the scalar $\phi^4$ model, representing an ultraviolet self-completion by transseries. We argue that this completion is purely non-Wilsonian and it depends on one arbitrary constant stemming from the transseries solution of the renormalization group equation. On the other hand, if no fixed points are demanded through the adjustment of this arbitrary constant, we end up with an effective theory in which the scalar mass is quadratically-sensitive to the cut-off, even working in dimensional regularization. Complete decoupling of the scalar mass to this energy scale can be used to determine a physical prescription for the Borel-Laplace resummation of the renormalons in non-asymptotically free models. We also comment on possible orthogonal scenarios available in the literature that might play a role when no fixed points exist.


title: Teaching labs during a pandemic: Lessons from Spring 2020 and an outlook for the future

abstract: We report results from a survey of lab instructors on how they adapted their courses in the transition to emergency remote teaching due to the COVID-19 pandemic. The purpose of this report is to share the experiences of instructors in order to prepare for future remote teaching of labs. We include summaries of responses to help illustrate the types of lab activities that were done, learning goals for the remote labs, motivations for instructors' choices, challenges instructors faced, and ways in which instructors and students communicated. This is a first step in a larger project as part of an NSF RAPID grant to understand what happened during the switch to remote labs and how it impacted teaching methods and student learning.


title: RELATE: Physically Plausible Multi-Object Scene Synthesis Using Structured Latent Spaces

abstract: We present RELATE, a model that learns to generate physically plausible scenes and videos of multiple interacting objects. Similar to other generative approaches, RELATE is trained end-to-end on raw, unlabeled data. RELATE combines an object-centric GAN formulation with a model that explicitly accounts for correlations between individual objects. This allows the model to generate realistic scenes and videos from a physically-interpretable parameterization. Furthermore, we show that modeling the object correlation is necessary to learn to disentangle object positions and identity. We find that RELATE is also amenable to physically realistic scene editing and that it significantly outperforms prior art in object-centric scene generation in both synthetic (CLEVR, ShapeStacks) and real-world data (cars). In addition, in contrast to state-of-the-art methods in object-centric generative modeling, RELATE also extends naturally to dynamic scenes and generates videos of high visual fidelity. Source code, datasets and more results are available at http://geometry.cs.ucl.ac.uk/projects/2020/relate/.


title: An Implementation of Partial Transmit Sequences to Design Energy Efficient Underwater Acoustic OFDM Communication System

abstract: In this article we research about underwater acoustics transceivers. As Underwater acoustic transceivers consume more power than Radio frequency transceivers. The techniques which are being utilized in radio frequency cannot be implemented directly in underwater acoustic system it needs to be re investigated to design new methods. To achieve reliable acoustic data transmission new techniques should be achieved or the traditional Orthogonal frequency divisional multiplexing techniques should be revised. The power consumption also relies upon underwater acoustic signal propagation and transmission distances. Several underwater acoustic applications require long-term monitoring of the sea. For the battery powered modems, it becomes very serious problem. By designing an Energy efficient OFDM Communication system we can solve this problem. We study about peak to average power ratio in an Orthogonal frequency divisional multiplexing system by reducing the major draw-back of OFDM system. The PAPR reduction utilized in this paper is Partial Transmit Sequences for underwater acoustic OFDM communication system which has lesser complexity. The results have provided better performance in underwater acoustic OFDM communication system.


title: Approximate solution of the integral equations involving kernel with additional singularity

abstract: The paper is devoted to the approximate solutions of the Fredholm integral equations of the second kind with the weak singular kernel that can have additional singularity in the numerator. We describe two problems that lead to such equations. They are the problem of minimization of small deviation and the entropy minimization problem. Both of them appear when considering dynamical system involving mixed fractional Brownian motion. In order to deal with the kernel with additional singularity applying well-known methods for weakly singular kernels, we prove the theorem on the approximation of solution of integral equation with the kernel containing additional singularity by the solutions of the integral equations whose kernels are weakly singular but the numerator is continuous. We demonstrate numerically how our methods work being applied to our specific integral equations.


title: Normalization in integral models of Shimura varieties of Hodge type

abstract: Let $(G,X)$ be a Shimura datum of Hodge type, and $\mathscr{S}_K(G,X)$ its integral model with hyperspecial (resp. parahoric, assuming the group is unramified) level structure. We prove that $\mathscr{S}_K(G,X)$ admits a closed embedding, which is compatible with moduli interpretations, into the integral model $\mathscr{S}_{K'}(\mathrm{GSp},S^{\pm})$ for a Siegel modular variety. In particular, the normalization step in the construction of $\mathscr{S}_K(G,X)$ is redundant. In particular, our results apply to the earlier integral models constructed by Rapoport, Kottwitz etc. (resp. Rapoport-Zink etc.), as those models agree with the Hodge type integral models for appropriately chosen Shimura data. Moreover, combined with a result of Lan's on the boundary components of toroidal compactifications of integral models, our result also implies that there exist closed embeddings of toroidal compactifications of integral models of Hodge type into toroidal compactifications of Siegel integral models, for suitable choices of cone decompositions.


title: Epileptic Seizures Detection Using Deep Learning Techniques: A Review

abstract: A variety of screening approaches have been proposed to diagnose epileptic seizures, using electroencephalography (EEG) and magnetic resonance imaging (MRI) modalities. Artificial intelligence encompasses a variety of areas, and one of its branches is deep learning (DL). Before the rise of DL, conventional machine learning algorithms involving feature extraction were performed. This limited their performance to the ability of those handcrafting the features. However, in DL, the extraction of features and classification are entirely automated. The advent of these techniques in many areas of medicine, such as in the diagnosis of epileptic seizures, has made significant advances. In this study, a comprehensive overview of works focused on automated epileptic seizure detection using DL techniques and neuroimaging modalities is presented. Various methods proposed to diagnose epileptic seizures automatically using EEG and MRI modalities are described. In addition, rehabilitation systems developed for epileptic seizures using DL have been analyzed, and a summary is provided. The rehabilitation tools include cloud computing techniques and hardware required for implementation of DL algorithms. The important challenges in accurate detection of automated epileptic seizures using DL with EEG and MRI modalities are discussed. The advantages and limitations in employing DL-based techniques for epileptic seizures diagnosis are presented. Finally, the most promising DL models proposed and possible future works on automated epileptic seizure detection are delineated.


title: Automatic Horizontal Fusion for GPU Kernels

abstract: We present automatic horizontal fusion, a novel optimization technique that complements the standard kernel fusion techniques for GPU programs. Unlike the standard fusion, whose goal is to eliminate intermediate data round trips, our horizontal fusion technique aims to increase the thread-level parallelism to hide instruction latencies. We also present HFuse, a new source to source CUDA compiler that implements automatic horizontal fusion. Our experimental results show that horizontal fusion can speed up the running time by 2.5%-60.8%. Our results reveal that the horizontal fusion is especially beneficial for fusing kernels with instructions that require different kinds of GPU resources (e.g., a memory-intensive kernel and a compute-intensive kernel).


title: Eruption of Solar Magnetic Flux Ropes Caused by Flux Feeding

abstract: Large-scale solar eruptions are believed to have a magnetic flux rope as the core structure. However, it remains elusive as to how the flux rope builds up and what triggers its eruption. Recent observations found that a prominence erupted following multiple episodes of "flux feeding". During each episode, a chromospheric fibril rose and merged with the prominence lying above. In this letter, we carried out 2.5-dimensional magnetohydrodynamic (MHD) numerical simulations to investigate whether the flux-feeding mechanism can explain such an eruption. The simulations demonstrate that the discrete emergence of small flux ropes can initiate eruptions by feeding axial flux into the preexistent flux rope until its total axial flux reaches a critical value. The onset of the eruption is dominated by an ideal MHD process. Our simulation results corroborate that the flux feeding is a viable mechanism to cause the eruption of solar magnetic flux ropes.


title: Weak Boundary Condition Enforcement for Linear Kirchhoff-Love Shells: Formulation, Error Analysis, and Verification

abstract: Stable and accurate modeling of thin shells requires proper enforcement of all types of boundary conditions. Unfortunately, for Kirchhoff-Love shells, strong enforcement of Dirichlet boundary conditions is difficult because both functional and derivative boundary conditions must be applied. A popular alternative is to employ Nitsche's method to weakly enforce all boundary conditions. However, while many Nitsche-based formulations have been proposed in the literature, they lack comprehensive error analyses and verifications. In fact, existing formulations are variationally inconsistent and yield sub-optimal convergence rates when used with common boundary condition specifications. In this paper, we present a novel Nitsche-based formulation for the linear Kirchhoff-Love shell that is provably stable and optimally convergent for general sets of admissible boundary conditions. To arrive at our formulation, we first present a framework for constructing Nitsche's method for any abstract variational constrained minimization problem. We then apply this framework to the linear Kirchhoff-Love shell and, for the particular case of NURBS-based isogeometric analysis, we prove that the resulting formulation yields optimal convergence rates in both the shell energy norm and the standard $L^2$-norm. In the process, we derive the Euler-Lagrange equations for general sets of admissible boundary conditions and show that the Euler-Lagrange boundary conditions typically presented in the literature is incorrect. We verify our formulation by manufacturing solutions for a new shell obstacle course that encompasses flat, parabolic, hyperbolic, and elliptic geometric configurations. These manufactured solutions allow us to robustly measure the error across the entire shell in contrast with current best practices where displacement and stress errors are only measured at specific locations.


title: Multicommodity Flows in Planar Graphs with Demands on Faces

abstract: We consider the problem of multicommodity flows in planar graphs. Seymour showed that if the union of supply and demand graphs is planar, then the cut condition is sufficient for routing demands. Okamura-Seymour showed that if all demands are incident on one face, then again cut condition is sufficient for routing demands. We consider a common generalization of these settings where the end points of each demand are on the same face of the planar graph. We show that if the source sink pairs on each face of the graph are such that sources and sinks appear contiguously on the cycle bounding the face, then the flow cut gap is at most 3. We come up with a notion of approximating demands on a face by convex combination of laminar demands to prove this result.


title: Efficient estimation of the ANOVA mean dimension, with an application to neural net classification

abstract: The mean dimension of a black box function of $d$ variables is a convenient way to summarize the extent to which it is dominated by high or low order interactions. It is expressed in terms of $2^d-1$ variance components but it can be written as the sum of $d$ Sobol' indices that can be estimated by leave one out methods. We compare the variance of these leave one out methods: a Gibbs sampler called winding stairs, a radial sampler that changes each variable one at a time from a baseline, and a naive sampler that never reuses function evaluations and so costs about double the other methods. For an additive function the radial and winding stairs are most efficient. For a multiplicative function the naive method can easily be most efficient if the factors have high kurtosis. As an illustration we consider the mean dimension of a neural network classifier of digits from the MNIST data set. The classifier is a function of $784$ pixels. For that problem, winding stairs is the best algorithm. We find that inputs to the final softmax layer have mean dimensions ranging from $1.35$ to $2.0$.


title: Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering

abstract: Generative models for open domain question answering have proven to be competitive, without resorting to external knowledge. While promising, this approach requires to use models with billions of parameters, which are expensive to train and query. In this paper, we investigate how much these models can benefit from retrieving text passages, potentially containing evidence. We obtain state-of-the-art results on the Natural Questions and TriviaQA open benchmarks. Interestingly, we observe that the performance of this method significantly improves when increasing the number of retrieved passages. This is evidence that generative models are good at aggregating and combining evidence from multiple passages.


title: Floodgate: inference for model-free variable importance

abstract: Many modern applications seek to understand the relationship between an outcome variable $Y$ and a covariate $X$ in the presence of a (possibly high-dimensional) confounding variable $Z$. Although much attention has been paid to testing \emph{whether} $Y$ depends on $X$ given $Z$, in this paper we seek to go beyond testing by inferring the \emph{strength} of that dependence. We first define our estimand, the minimum mean squared error (mMSE) gap, which quantifies the conditional relationship between $Y$ and $X$ in a way that is deterministic, model-free, interpretable, and sensitive to nonlinearities and interactions. We then propose a new inferential approach called \emph{floodgate} that can leverage any working regression function chosen by the user (allowing, e.g., it to be fitted by a state-of-the-art machine learning algorithm or be derived from qualitative domain knowledge) to construct asymptotic confidence bounds, and we apply it to the mMSE gap. \acc{We additionally show that floodgate's accuracy (distance from confidence bound to estimand) is adaptive to the error of the working regression function.} We then show we can apply the same floodgate principle to a different measure of variable importance when $Y$ is binary. Finally, we demonstrate floodgate's performance in a series of simulations and apply it to data from the UK Biobank to infer the strengths of dependence of platelet count on various groups of genetic mutations.


title: Rate-improved Inexact Augmented Lagrangian Method for Constrained Nonconvex Optimization

abstract: First-order methods have been studied for nonlinear constrained optimization within the framework of the augmented Lagrangian method (ALM) or penalty method. We propose an improved inexact ALM (iALM) and conduct a unified analysis for nonconvex problems with either affine equality or nonconvex constraints. Under certain regularity conditions (that are also assumed by existing works), we show an $\tilde{O}(\varepsilon^{-\frac{5}{2}})$ complexity result for a problem with a nonconvex objective and affine equality constraints and an $\tilde{O}(\varepsilon^{-3})$ complexity result for a problem with a nonconvex objective and nonconvex constraints, where the complexity is measured by the number of first-order oracles to yield an $\varepsilon$-KKT solution. Both results are the best known. The same-order complexity results have been achieved by penalty methods. However, two different analysis techniques are used to obtain the results, and more importantly, the penalty methods generally perform significantly worse than iALM in practice. Our improved iALM and analysis close the gap between theory and practice. Numerical experiments on nonconvex problems with affine equality or nonconvex constraints are provided to demonstrate the effectiveness of our proposed method.


title: Deep Learning for Neuroimaging-based Diagnosis and Rehabilitation of Autism Spectrum Disorder: A Review

abstract: Accurate diagnosis of Autism Spectrum Disorder (ASD) followed by effective rehabilitation is essential for the management of this disorder. Artificial intelligence (AI) techniques can aid physicians to apply automatic diagnosis and rehabilitation procedures. AI techniques comprise traditional machine learning (ML) approaches and deep learning (DL) techniques. Conventional ML methods employ various feature extraction and classification techniques, but in DL, the process of feature extraction and classification is accomplished intelligently and integrally. DL methods for diagnosis of ASD have been focused on neuroimaging-based approaches. Neuroimaging techniques are non-invasive disease markers potentially useful for ASD diagnosis. Structural and functional neuroimaging techniques provide physicians substantial information about the structure (anatomy and structural connectivity) and function (activity and functional connectivity) of the brain. Due to the intricate structure and function of the brain, proposing optimum procedures for ASD diagnosis with neuroimaging data without exploiting powerful AI techniques like DL may be challenging. In this paper, studies conducted with the aid of DL networks to distinguish ASD are investigated. Rehabilitation tools provided for supporting ASD patients utilizing DL networks are also assessed. Finally, we will present important challenges in the automated detection and rehabilitation of ASD and propose some future works.


title: Prethermalisation and Thermalisation in the Entanglement Dynamics

abstract: We investigate the crossover of the entanglement entropy towards its thermal value in nearly integrable systems. We employ equation of motion techniques to study the entanglement dynamics in a lattice model of weakly interacting spinless fermions after a quantum quench. For weak enough interactions we observe a two-step relaxation of the entanglement entropies of finite subsystems. Initially the entropies follow a nearly integrable evolution, approaching the value predicted by the Generalized Gibbs Ensemble (GGE) of the unperturbed model. Then, they start a slow drift towards the thermal stationary value described by a standard Gibbs Ensemble (GE). While the initial relaxation to the GGE is independent of the interaction, the slow drift from GGE to GE values happens on time scales proportional to the inverse interaction squared. For asymptotically large times and subsystem sizes the dynamics of the entropies can be predicted using a modified quasiparticle picture that keeps track of the evolution of the fermionic occupations caused by the integrability breaking. This picture gives a quantitative description of the results as long as the integrability-breaking timescale is much larger than the one associated with the (quasi) saturation to the GGE. In the opposite limit the quasiparticle picture still provides the correct late-time behaviour, but it underestimates the initial slope of the entanglement entropy.


title: Riemannian geometry and automatic differentiation for optimization problems of quantum physics and quantum technologies

abstract: Optimization with constraints is a typical problem in quantum physics and quantum information science that becomes especially challenging for high-dimensional systems and complex architectures like tensor networks. Here we use ideas of Riemannian geometry to perform optimization on manifolds of unitary and isometric matrices as well as the cone of positive-definite matrices. Combining this approach with the up-to-date computational methods of automatic differentiation, we demonstrate the efficacy of the Riemannian optimization in the study of the low-energy spectrum and eigenstates of multipartite Hamiltonians, variational search of a tensor network in the form of the multiscale entanglement-renormalization ansatz, preparation of arbitrary states (including highly entangled ones) in the circuit implementation of quantum computation, decomposition of quantum gates, and tomography of quantum states. Universality of the developed approach together with the provided open source software enable one to apply the Riemannian optimization to complex quantum architectures well beyond the listed problems, for instance, to the optimal control of noisy quantum systems.


title: Robust ambiguity for contact tracing

abstract: A known drawback of `decentralised' contact tracing architectures is that users who have been in contact with an infected person are able to precisely identify the relevant contact, and thereby perhaps identify the infected person. In their proposal, the PACT team discuss a simple DH-based protocol to mitigate this problem, but dismiss it because it is vulnerable to a malicious user who may deviate from the specified behaviour. This note presents a modified protocol which achieves robustness against a fully malicious user, and establishes some simple security properties.


title: Image Shape Manipulation from a Single Augmented Training Sample

abstract: In this paper, we present DeepSIM, a generative model for conditional image manipulation based on a single image. We find that extensive augmentation is key for enabling single image training, and incorporate the use of thin-plate-spline (TPS) as an effective augmentation. Our network learns to map between a primitive representation of the image to the image itself. The choice of a primitive representation has an impact on the ease and expressiveness of the manipulations and can be automatic (e.g. edges), manual (e.g. segmentation) or hybrid such as edges on top of segmentations. At manipulation time, our generator allows for making complex image changes by modifying the primitive input representation and mapping it through the network. Our method is shown to achieve remarkable performance on image manipulation tasks.


title: Provably Efficient Neural Estimation of Structural Equation Model: An Adversarial Approach

abstract: Structural equation models (SEMs) are widely used in sciences, ranging from economics to psychology, to uncover causal relationships underlying a complex system under consideration and estimate structural parameters of interest. We study estimation in a class of generalized SEMs where the object of interest is defined as the solution to a linear operator equation. We formulate the linear operator equation as a min-max game, where both players are parameterized by neural networks (NNs), and learn the parameters of these neural networks using the stochastic gradient descent. We consider both 2-layer and multi-layer NNs with ReLU activation functions and prove global convergence in an overparametrized regime, where the number of neurons is diverging. The results are established using techniques from online learning and local linearization of NNs, and improve in several aspects the current state-of-the-art. For the first time we provide a tractable estimation procedure for SEMs based on NNs with provable convergence and without the need for sample splitting.


title: Free-standing 2D metals from binary metal alloys

abstract: Recent experiment demonstrated the formation of free-standing Au monolayers by exposing Au-Ag alloy to electron beam irradiation. Inspired by this discovery, we used semi-empirical effective medium theory simulations to investigate monolayer formation in 30 different binary metal alloys composed of late d-series metals Ni, Cu, Pd, Ag, Pt, and Au. In qualitative agreement with the experiment, we find that the beam energy required to dealloy Ag atoms from Au-Ag alloy is smaller than the energy required to break the dealloyed Au monolayer. Our simulations suggest that similar method could also be used to form Au monolayers from Au-Cu alloy and Pt monolayers from Pt-Cu, Pt-Ni, and Pt-Pd alloys.


title: MeerKAT-16 HI observation of the dIrr galaxy WLM

abstract: We present observations and models of the kinematics and the distribution of the neutral hydrogen (HI) in the isolated dwarf irregular galaxy, Wolf-Lundmark-Melotte (WLM). We observed WLM with the Green Bank Telescope (GBT) and as part of the MeerKAT Early Science Programme, where 16 dishes were available. The HI disc of WLM extends out to a major axis diameter of 30 arcmin (8.5 kpc), and a minor axis diameter of 20 arcmin (5.6 kpc) as measured by the GBT. We use the MeerKAT data to model WLM using the TiRiFiC software suite, allowing us to fit different tilted-ring models and select the one that best matches the observation. Our final best-fitting model is a flat disc with a vertical thickness, a constant inclination and dispersion, and a radially-varying surface brightness with harmonic distortions. To simulate bar-like motions, we include second-order harmonic distortions in velocity in the tangential and the vertical directions. We present a model with only circular motions included and a model with non-circular motions. The latter describes the data better. Overall, the models reproduce the global distribution and the kinematics of the gas, except for some faint emission at the 2-sigma level. We model the mass distribution of WLM with a pseudo-isothermal (ISO) and a Navarro-Frenk-White (NFW) dark matter halo models. The NFW and the ISO models fit the derived rotation curves within the formal errors, but with the ISO model giving better reduced chi-square values. The mass distribution in WLM is dominated by dark matter at all radii.


title: Not All Unlabeled Data are Equal: Learning to Weight Data in Semi-supervised Learning

abstract: Existing semi-supervised learning (SSL) algorithms use a single weight to balance the loss of labeled and unlabeled examples, i.e., all unlabeled examples are equally weighted. But not all unlabeled data are equal. In this paper we study how to use a different weight for every unlabeled example. Manual tuning of all those weights -- as done in prior work -- is no longer possible. Instead, we adjust those weights via an algorithm based on the influence function, a measure of a model's dependency on one training example. To make the approach efficient, we propose a fast and effective approximation of the influence function. We demonstrate that this technique outperforms state-of-the-art methods on semi-supervised image and language classification tasks.


title: A Closer Look at Local Aggregation Operators in Point Cloud Analysis

abstract: Recent advances of network architecture for point cloud processing are mainly driven by new designs of local aggregation operators. However, the impact of these operators to network performance is not carefully investigated due to different overall network architecture and implementation details in each solution. Meanwhile, most of operators are only applied in shallow architectures. In this paper, we revisit the representative local aggregation operators and study their performance using the same deep residual architecture. Our investigation reveals that despite the different designs of these operators, all of these operators make surprisingly similar contributions to the network performance under the same network input and feature numbers and result in the state-of-the-art accuracy on standard benchmarks. This finding stimulate us to rethink the necessity of sophisticated design of local aggregation operator for point cloud processing. To this end, we propose a simple local aggregation operator without learnable weights, named Position Pooling (PosPool), which performs similarly or slightly better than existing sophisticated operators. In particular, a simple deep residual network with PosPool layers achieves outstanding performance on all benchmarks, which outperforms the previous state-of-the methods on the challenging PartNet datasets by a large margin (7.4 mIoU). The code is publicly available at https://github.com/zeliu98/CloserLook3D


title: Compartmental model with loss of immunity: analysis and parameters estimation for Covid-19

abstract: The outbreak of Covid-19 led the world to an unprecedent health and economical crisis. In an attempt to responde to this emergency researchers worldwide are intensively studying the Covid-19 pandemic dynamics. In this work, a SIRSi compartmental model is proposed, which is a modification of the known classical SIR model. The proposed SIRSi model considers differences in the immunization within a population, and the possibility of unreported or asymptomatic cases. The model is adjusted to three major cities of S\~ao Paulo State, in Brazil, namely, S\~ao Paulo, Santos and Campinas, providing estimates on the duration and peaks of the outbreak.


title: Putting SMEFT Fits to Work

abstract: The Standard Model Effective Field Theory (SMEFT) provides a consistent framework for comparing precision measurements at the LHC to the Standard Model. The observation of statistically significant non-zero SMEFT coefficients would correspond to physics beyond the Standard Model (BSM) of some sort. A more difficult question to answer is what, if any, detailed information about the nature of the underlying high scale model can be obtained from these measurements. In this work, we consider the patterns of SMEFT operators present in five example models and discuss the assumptions inherent in using global fits to make BSM conclusions. We find that including renormalization group effects has a significant impact on the interpretation of the results. As a by-product of our study, we present an up-dated global fit to SMEFT coefficients in the Warsaw basis including some next-to-leading order QCD corrections in the SMEFT theory.


title: The solar abundance problem and eMSTOs in clusters

abstract: We study the impact of accretion from protoplanetary discs on stellar evolution of AFG-type stars. We use a simplified disc model computed using the Two-Pop-Py code that contains the growth and drift of dust particles in the protoplanetary disc. It is used to model the accretion scenarios for a range of physical conditions of protoplanetary discs. Two limiting cases are combined with the evolution of stellar convective envelopes computed using the Garstec stellar evolution code. We find that the accretion of metal-poor (gas) or metal-rich (dust) material has a significant impact on the chemical composition of the stellar convective envelope. As a consequence, the evolutionary track of the star diverts from the standard scenario predicted by canonical stellar evolution models, which assume a constant and homogeneous chemical composition after the assembly of the star has finished. In the case of the Sun, we find a modest impact on the solar chemical composition. Accretion of metal-poor material indeed reduces the overall metallicity of the solar atmosphere, and it is consistent, within the uncertainty, with the solar Z reported by Caffau et al. (2011), but our model is not consistent with the measurement by Asplund et al. (2009). Another effect is the change of the position of the star in the colour-magnitude diagram. We compare our predictions to a set of open clusters from the Gaia DR2 and show that it is possible to produce a scatter close to the turn-off of young clusters that could contribute to explain the observed scatter in CMDs. Detailed measurements of metallicities and abundances in the nearby open clusters will provide a stringent observational test of our proposed scenario.


title: Image Classification by Reinforcement Learning with Two-State Q-Learning

abstract: In this paper, a simple and efficient Hybrid Classifier is presented which is based on deep learning and reinforcement learning. Here, Q-Learning has been used with two states and 'two or three' actions. Other techniques found in the literature use feature map extracted from Convolutional Neural Networks and use these in the Q-states along with past history. This leads to technical difficulties in these approaches because the number of states is high due to large dimensions of the feature map. Because the proposed technique uses only two Q-states it is straightforward and consequently has much lesser number of optimization parameters, and thus also has a simple reward function. Also, the proposed technique uses novel actions for processing images as compared to other techniques found in literature. The performance of the proposed technique is compared with other recent algorithms like ResNet50, InceptionV3, etc. on popular databases including ImageNet, Cats and Dogs Dataset, and Caltech-101 Dataset. The proposed approach outperforms others techniques on all the datasets used.


title: Generating Adversarial Examples with Controllable Non-transferability

abstract: Adversarial attacks against Deep Neural Networks have been widely studied. One significant feature that makes such attacks particularly powerful is transferability, where the adversarial examples generated from one model can be effective against other similar models as well. A large number of works have been done to increase the transferability. However, how to decrease the transferability and craft malicious samples only for specific target models are not explored yet. In this paper, we design novel attack methodologies to generate adversarial examples with controllable non-transferability. With these methods, an adversary can efficiently produce precise adversarial examples to attack a set of target models he desires, while keeping benign to other models. The first method is Reversed Loss Function Ensemble, where the adversary can craft qualified examples from the gradients of a reversed loss function. This approach is effective for the white-box and gray-box settings. The second method is Transferability Classification: the adversary trains a transferability-aware classifier from the perturbations of adversarial examples. This classifier further provides the guidance for the generation of non-transferable adversarial examples. This approach can be applied to the black-box scenario. Evaluation results demonstrate the effectiveness and efficiency of our proposed methods. This work opens up a new route for generating adversarial examples with new features and applications.


title: Integral equienergetic non-isospectral unitary Cayley graphs

abstract: We prove that the Cayley graphs $X(G,S)$ and $X^+(G,S)$ are equienergetic for any abelian group $G$ and any symmetric subset $S$. We then focus on the family of unitary Cayley graphs $G_R=X(R,R^*)$, where $R$ is a finite commutative ring with identity. We show that under mild conditions, $\{G_R, G_R^+\}$ are pairs of integral equienergetic non-isospectral graphs (generically connected and non-bipartite). Then, we obtain conditions such that $\{G_R, \bar G_R\}$ are equienergetic non-isospectral graphs. Finally, we characterize all integral equienergetic non-isospectral triples $\{G_R, G_R^+, \bar G_R \}$ such that all the graphs are also Ramanujan.


title: Statistical Microlensing Toward Magnified High-Redshift Star Clusters

abstract: We study light variability of gravitationally magnified high-redshift star clusters induced by a foreground population of microlenses. This arises as the incoherent superposition of light variations from a large number of source stars traversing the random magnification pattern on the source plane. The light curve resembles a scale-invariant, Gaussian process on timescales of years to decades, while exhibits rapid and frequent micro-caustic crossing flares of larger amplitudes on timescales of days to months. For a concrete example, we study a young Lyman-continuum-leaking star cluster recently discovered in the lensed Sunburst Arc at $z=2.37$. We show that one magnified image happens to be intervened by a faint foreground galaxy, and hence should exhibit a variable flux at the $1$--$2\%$ level, which is measurable in space with $\sim 1$--$3\,$ks exposures on the Hubble Space Telescope and more easily with the James Webb Space Telescope, or from the ground using a $\sim$4-meter telescope without adaptive optics. Detailed measurement of this variability will enable us to determine the absolute macro magnification and hence the intrinsic mass and length scales of the star cluster, test synthetic models of stellar population, and probe multiplicity of massive stars. We furthermore suggest that monitoring the other lensed images of the star cluster, which are free from significant intervention by foreground stellar microlenses, will allow us to probe planetary to stellar mass compact objects constituting as little as just a few percent of the dark matter. Given the typical surface density of intracluster stars, we expect this phenomenon to be relevant for many other gravitationally magnified star clusters at Cosmic Noon behind galaxy cluster lenses.


title: Signature of Energy Losses on the Cosmic Ray Electron Spectrum

abstract: We show that the fine structure of the electron spectrum in cosmic rays, especially the excess claimed by AMS-02 at energies $\sim$42 GeV, is fully accounted for in terms of inverse Compton losses in the photon background dominated by ultraviolet, infrared and CMB photons, plus the standard synchrotron losses in the Galactic magnetic field. The transition to the Klein-Nishina regime on the ultraviolet background causes the feature. Hence, contrary to previous statements, observations do not require the overlap of different components. We stress that the feature observed by AMS-02 at energies $\sim$42 GeV is not related to the positron excess, which instead requires the existence of positron sources, such as pulsars. Because energy losses are the physical explanation of this feature, we indirectly confirm that the transport of leptons in the Galaxy is loss-dominated down to energies of the order of tens of GeV. This finding imposes strong constraints on the feasibility of alternative theories of cosmic transport in which the grammage is accumulated in cocoons concentrated around sources, requiring that electrons and positrons become loss dominated only at very high energies.


title: Conformal field theories are magical

abstract: "Magic" is the degree to which a state cannot be approximated by Clifford gates. We study mana, a measure of magic, in the ground state of the $\mathbb Z_3$ Potts model, and argue that it is a broadly useful diagnostic for many-body physics. In particular we find that the $q = 3$ ground state has large mana at the model's critical point, and that this mana resides in the system's correlations. We explain the form of the mana by a simple tensor-counting calculation based on a MERA representation of the state. Because mana is present at all length scales, we conclude that the conformal field theory describing the 3-state Potts model critical point is magical. These results control the difficulty of preparing the Potts ground state on an error-corrected quantum computer, and constrain tensor network models of AdS-CFT.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el hep-th


title: An attractive spin-orbit potential from the Skyrme model

abstract: We derive the nucleon-nucleon isoscalar spin-orbit potential from the Skyrme model and find good agreement with the Paris potential. This solves a problem that has been open for more than thirty years and gives a new geometric understanding of the spin-orbit force. Our calculation is based on the dipole approximation to skyrmion dynamics and higher order perturbation theory.


title: Time-domain properties of electromagnetic signals in a dynamical axion background

abstract: Electromagnetic waves in a dynamical axion background exhibit superluminal group velocities at high frequencies and instabilities at low frequencies, altering how photons propagate through space. Local disturbances propagate causally, but unlike in ordinary Maxwell theory, propagation occurs inside as well as on the lightcone. For the unstable modes, the energy density in the electromagnetic field grows exponentially along timelike displacements. In this paper we derive retarded Green functions in axion electrodynamics in various limits and study the time-domain properties of propagating signals.


title: On the relation between mini-halos and AGN feedback in clusters of galaxies

abstract: A variety of large-scale diffuse radio structures have been identified in many clusters with the advent of new state-of-the-art facilities in radio astronomy. Among these diffuse radio structures, radio mini-halos are found in the central regions of cool core clusters. Their origin is still unknown and they are challenging to discover; less than thirty have been published to date. Based on new VLA observations, we confirmed the mini-halo in the massive strong cool core cluster PKS 0745$-$191 ($z=0.1028$) and discovered one in the massive cool core cluster MACS J1447.4+0827 ($z=0.3755$). Furthermore, using a detailed analysis of all known mini-halos, we explore the relation between mini-halos and AGN feedback processes from the central galaxy. We find evidence of strong, previously unknown correlations between mini-halo radio power and X-ray cavity power, and between mini-halo and the central galaxy radio power related to the relativistic jets when spectrally decomposing the AGN radio emission into a component for past outbursts and one for on-going accretion. Overall, our study indicates that mini-halos are directly connected to the central AGN in clusters, following previous suppositions. We hypothesize that AGN feedback may be one of the dominant mechanisms giving rise to mini-halos by injecting energy into the intra-cluster medium and reaccelerating an old population of particles, while sloshing motion may drive the overall shape of mini-halos inside cold fronts. AGN feedback may therefore not only play a vital role in offsetting cooling in cool core clusters, but may also play a fundamental role in re-energizing non-thermal particles in clusters.


title: Autonomous Temporal Probability Concentration: Clockworks and the Second Law of Thermodynamics

abstract: According to thermodynamics, the inevitable increase of entropy allows the past to be distinguished from the future. From this perspective, any clock must incorporate an irreversible process that allows this flow of entropy to be tracked. In addition, an integral part of a clock is a clockwork, that is, a system whose purpose is to temporally concentrate the irreversible events that drive this entropic flow, thereby increasing the accuracy of the resulting clock ticks compared to counting purely random equilibration events. In this article, we formalise the task of autonomous temporal probability concentration as the inherent goal of any clockwork based on thermal gradients. Within this framework, we show that a perfect clockwork can be approximated arbitrarily well by increasing its complexity. Furthermore, we combine such an idealised clockwork model, comprised of many qubits, with an irreversible decay mechanism to showcase the ultimate thermodynamic limits to the measurement of time.


title: TDCOSMO III: Dark matter substructure meets dark energy -- the effects of (sub)halos on strong-lensing measurements of $H_0$

abstract: Time delay cosmography uses the arrival time delays between images in strong gravitational lenses to measure cosmological parameters, in particular the Hubble constant $H_0$. The lens models used in time delay cosmography omit dark matter subhalos and line-of-sight halos because their effects are assumed to be negligible. We explicitly quantify this assumption by analyzing mock lens systems that include full populations of dark matter subhalos and line-of-sight halos, applying the same modeling assumptions used in the literature to infer $H_0$. We base the mock lenses on six quadruply-imaged quasars that have delivered measurements of the Hubble constant, and quantify the additional uncertainties and/or bias on a lens-by-lens basis. We show that omitting dark substructure does not bias inferences of $H_0$. However, perturbations from substructure contribute an additional source of random uncertainty in the inferred value of $H_0$ that scales as the square root of the lensing volume divided by the longest time delay. This additional source of uncertainty, for which we provide a fitting function, ranges from $0.7 - 2.4\%$. It may need to be incorporated in the error budget as the precision of cosmographic inferences from single lenses improves, and sets a precision limit on inferences from single lenses.


title: Learning-based Defect Recognition for Quasi-Periodic Microscope Images

abstract: Controlling crystalline material defects is crucial, as they affect properties of the material that may be detrimental or beneficial for the final performance of a device. Defect analysis on the sub-nanometer scale is enabled by high-resolution (scanning) transmission electron microscopy [HR(S)TEM], where the identification of defects is currently carried out based on human expertise. However, the process is tedious, highly time consuming and, in some cases, yields ambiguous results. Here we propose a semi-supervised machine learning method that assists in the detection of lattice defects from atomic resolution microscope images. It involves a convolutional neural network that classifies image patches as defective or non-defective, a graph-based heuristic that chooses one non-defective patch as a model, and finally an automatically generated convolutional filter bank, which highlights symmetry breaking such as stacking faults, twin defects and grain boundaries. Additionally, we suggest a variance filter to segment amorphous regions and beam defects. The algorithm is tested on III-V/Si crystalline materials and successfully evaluated against different metrics, showing promising results even for extremely small training data sets. By combining the data-driven classification generality, robustness and speed of deep learning with the effectiveness of image filters in segmenting faulty symmetry arrangements, we provide a valuable open-source tool to the microscopist community that can streamline future HR(S)TEM analyses of crystalline materials.


title: The Size and Pervasiveness of Ly$\alpha$-UV Spatial Offsets in Star-Forming Galaxies at $z\sim6$

abstract: We study the projected spatial offset between the ultraviolet continuum and Ly$\alpha$ emission for 65 lensed and unlensed galaxies in the Epoch of Reionization ($5\leq z\leq7$), the first such study at these redshifts, in order to understand the potential for these offsets to confuse estimates of the Ly$\alpha$ properties of galaxies observed in slit spectroscopy. While we find that ~40% of galaxies in our sample show significant projected spatial offsets ($|\Delta_{Ly\alpha-UV}|$), we find a modest average offset of 0.61$\pm$0.08 kpc. A small fraction of our sample, ~10%, exhibits offsets of 2-4 kpc, sizes that are larger than the effective radii of typical galaxies at these redshifts. An internal comparison and a comparison to studies at lower redshift yielded no significant evidence of evolution of $|\Delta_{Ly\alpha-UV}|$ with redshift. In our own sample, UV-bright galaxies showed offsets a factor of three greater than their fainter counterparts, 0.89$\pm$0.18 vs. 0.27$\pm$0.05 kpc, respectively. We argue that offsets are likely not the result of merging processes, but are rather due to internal anisotropic processes resulting from stellar feedback facilitates Ly$\alpha$ fluorescence and/or backscattering from nearby or outflowing gas. The reduction in the Ly$\alpha$ flux due to offset effects for various observational setups was quantified through mock observations of simple simulations. It was found that the loss of Ly$\alpha$ photons for galaxies with average offsets is not, if corrected for, a limiting factor for all but the narrowest slit widths (<0.4''). However, for the largest offsets, if such offsets are mostly perpendicular to the slit major axis, slit losses were found to be extremely severe in cases where slit widths of $\leq$1'' were employed, such as those planned for James Webb Space Telescope/NIRSpec observations. (abridged)