title: A Unified Framework for Quantum Supervised Learning

abstract: Quantum machine learning is an emerging field that combines machine learning with advances in quantum technologies. Many works have suggested great possibilities of using near-term quantum hardware in supervised learning. Motivated by these developments, we present an embedding-based framework for supervised learning with trainable quantum circuits. We introduce both explicit and implicit approaches. The aim of these approaches is to map data from different classes to separated locations in the Hilbert space via the quantum feature map. We will show that the implicit approach is a generalization of a recently introduced strategy, so-called \textit{quantum metric learning}. In particular, with the implicit approach, the number of separated classes (or their labels) in supervised learning problems can be arbitrarily high with respect to the number of given qubits, which surpasses the capacity of some current quantum machine learning models. Compared to the explicit method, this implicit approach exhibits certain advantages over small training sizes. Furthermore, we establish an intrinsic connection between the explicit approach and other quantum supervised learning models. Combined with the implicit approach, this connection provides a unified framework for quantum supervised learning. The utility of our framework is demonstrated by performing both noise-free and noisy numerical simulations. Moreover, we have conducted classification testing with both implicit and explicit approaches using several IBM Q devices.


title: Improving the Reconstruction of Disentangled Representation Learners via Multi-Stage Modeling

abstract: Current autoencoder-based disentangled representation learning methods achieve disentanglement by penalizing the (aggregate) posterior to encourage statistical independence of the latent factors. This approach introduces a trade-off between disentangled representation learning and reconstruction quality since the model does not have enough capacity to learn correlated latent variables that capture detail information present in most image data. To overcome this trade-off, we present a novel multi-stage modeling approach where the disentangled factors are first learned using a penalty-based disentangled representation learning method; then, the low-quality reconstruction is improved with another deep generative model that is trained to model the missing correlated latent variables, adding detail information while maintaining conditioning on the previously learned disentangled factors. Taken together, our multi-stage modelling approach results in a single, coherent probabilistic model that is theoretically justified by the principal of D-separation and can be realized with a variety of model classes including likelihood-based models such as variational autoencoders, implicit models such as generative adversarial networks, and tractable models like normalizing flows or mixtures of Gaussians. We demonstrate that our multi-stage model has higher reconstruction quality than current state-of-the-art methods with equivalent disentanglement performance across multiple standard benchmarks. In addition, we apply the multi-stage model to generate synthetic tabular datasets, showcasing an enhanced performance over benchmark models across a variety of metrics. The interpretability analysis further indicates that the multi-stage model can effectively uncover distinct and meaningful features of variations from which the original distribution can be recovered.


title: Equilibrium and non-equilibrium furanose selection in the ribose isomerisation network

abstract: The exclusive presence of $\beta$-D-ribofuranose in nucleic acids is still a conundrum in prebiotic chemistry, given that pyranose species are substantially more stable at equilibrium. However, a precise characterisation of the relative furanose/pyranose fraction at temperatures higher than about 50$^{\,\rm o}$C is still lacking. Here, we employ a combination of NMR measurements and statistical mechanics modelling to predict a population inversion between furanose and pyranose at equilibrium at high temperatures. More importantly, we show that a steady temperature gradient may steer an open isomerisation network into a non-equilibrium steady state where furanose is boosted beyond the limits set by equilibrium thermodynamics. Moreover, we demonstrate that nonequilibrium selection of furanose is maximum at optimal dissipation, as gauged by the temperature gradient and energy barriers for isomerisation. The predicted optimum is compatible with temperature drops found in hydrothermal vents associated with extremely fresh lava flows on the seafloor.


title: Black holes and wormholes in the Einstein-scalar-Gauss-Bonnet generalized theories of gravity

abstract: In this Ph.D. dissertation we study the emergence of black-hole and wormhole solutions in the framework of the Einstein-scalar-Gauss-Bonnet (EsGB) theory. Particularly we study a family of theories where the coupling function $f(\phi)$ between the scalar field of the theory and the quadratic Gauss-Bonnet gravitational term has an arbitrary form. At first, we analytically derive that the aforementioned family of theories may evade the constraints imposed by Bekenstein's No-Scalar Hair theorems and new solutions for black holes may be found. Then, using numerical integration methods we find solutions for black holes for many different forms of the coupling function. Also we derive their physical characteristics namely their mass, scalar charge, horizon area and entropy as well. Subsequently, by introducing a cosmological constant in the theory we investigate the existence of novel black-hole solutions. Specifically, assuming that the cosmological constant may be positive or negative we find numerical solutions which are asymptotically de Sitter or anti-de Sitter. In addition, as in the case of the asymptotically flat black holes, for each case we derive their physical characteristics. Finally, in the framework of the EsGB theory we derive novel wormhole solutions. The Gauss-Bonnet wormholes are traversable, may have a single or a double throat and do not demand the existence of exotic matter.


title: Machine Learning Based Network Coverage Guidance System

abstract: With the advent of 4G, there has been a huge consumption of data and the availability of mobile networks has become paramount. Also, with the burst of network traffic based on user consumption, data availability and network anomalies have increased substantially. In this paper, we introduce a novel approach, to identify the regions that have poor network connectivity thereby providing feedback to both the service providers to improve the coverage as well as to the customers to choose the network judiciously. In addition to this, the solution enables customers to navigate to a better mobile network coverage area with stronger signal strength location using Machine Learning Clustering Algorithms, whilst deploying it as a Mobile Application. It also provides a dynamic visual representation of varying network strength and range across nearby geographical areas.


title: Giving Semantics to Program-Counter Labels via Secure Effects

abstract: Type systems designed for information-flow control commonly use a program-counter label to track the sensitivity of the context and rule out data leakage arising from effectful computation in a sensitive context. Currently, type-system designers reason about this label informally except in security proofs, where they use ad-hoc techniques. We develop a framework based on monadic semantics for effects to give semantics to program-counter labels. This framework leads to three results about program-counter labels. First, we develop a new proof technique for noninterference, the core security theorem for information-flow control in effectful languages. Second, we unify notions of security for different types of effects, including state, exceptions, and nontermination. Finally, we formalize the folklore that program-counter labels are a lower bound on effects. We show that, while not universally true, this folklore has a good semantic foundation.


title: The LMU Munich System for the WMT 2020 Unsupervised Machine Translation Shared Task

abstract: This paper describes the submission of LMU Munich to the WMT 2020 unsupervised shared task, in two language directions, German<->Upper Sorbian. Our core unsupervised neural machine translation (UNMT) system follows the strategy of Chronopoulou et al. (2020), using a monolingual pretrained language generation model (on German) and fine-tuning it on both German and Upper Sorbian, before initializing a UNMT model, which is trained with online backtranslation. Pseudo-parallel data obtained from an unsupervised statistical machine translation (USMT) system is used to fine-tune the UNMT model. We also apply BPE-Dropout to the low resource (Upper Sorbian) data to obtain a more robust system. We additionally experiment with residual adapters and find them useful in the Upper Sorbian->German direction. We explore sampling during backtranslation and curriculum learning to use SMT translations in a more principled way. Finally, we ensemble our best-performing systems and reach a BLEU score of 32.4 on German->Upper Sorbian and 35.2 on Upper Sorbian->German.


title: A very easy approach to the holomorphic discrete series

abstract: Based on the material in an old article of Wallach a short proof of the Harish-Chandra condition is given.


title: Variational and parquet-diagram calculations for neutron matter. III. S-wave pairing

abstract: We apply parquet-diagram summation methods for the calculation of the superfluid gap in $S$-wave pairing in neutron matter for realistic nucleon-nucleon interactions such as the Argonne $v_6$ and the Reid $v_6$ potentials. It is shown that diagrammatic contributions that are outside the parquet class play an important role. These are, in variational theories, identified as so-called "commutator contributions". Moreover, using a particle-hole propagator appropriate for a superfluid system results in the suppression of the spin-channel contribution to the induced interaction. Applying these corrections to the pairing interaction, our results agree quite well with Quantum Monte Carlo data.


title: A family of convex sets in the plane satisfying the $(4,3)$-property can be pierced by nine points

abstract: We prove that every finite family of convex sets in the plane satisfying the $(4,3)$-property can be pierced by $9$ points. This improves the bound of $13$ proved by Gy\'arf\'as, Kleitman, and T\'oth in 2001.


title: Surface band characters of Weyl semimetal candidate material MoTe$_2$ revealed by one-step ARPES theory

abstract: The layered 2D-material MoTe$_2$ in the T$_d$ crystal phase is a semimetal which has theoretically been predicted to possess topologically non-trivial bands corresponding to Weyl fermions. Clear experimental evidence by angle-resolved photoemission spectroscopy (ARPES) is, however, lacking, which calls for a careful examination of the relation between ground state band structure calculations and ARPES intensity plots. Here we report a study of the near Fermi-energy band structure of MoTe$_2$(T$_d$) by means of ARPES measurements, density functional theory, and one-step-model ARPES calculations. Good agreement between theory and experiment is obtained. We analyze the orbital character of the surface bands and its relation to the ARPES polarization dependence. We find that light polarization has a major efect on which bands can be observed by ARPES. For s-polarized light, the ARPES intensity is dominated by subsurface Mo d orbitals, while p-polarized light reveals the bands composed mainly derived from Te p orbitals. Suitable light polarization for observing either electron or hole pocket are determined


title: Gestop : Customizable Gesture Control of Computer Systems

abstract: The established way of interfacing with most computer systems is a mouse and keyboard. Hand gestures are an intuitive and effective touchless way to interact with computer systems. However, hand gesture based systems have seen low adoption among end-users primarily due to numerous technical hurdles in detecting in-air gestures accurately. This paper presents Gestop, a framework developed to bridge this gap. The framework learns to detect gestures from demonstrations, is customizable by end-users and enables users to interact in real-time with computers having only RGB cameras, using gestures.


title: The Case for Hop-by-Hop Traffic Engineering

abstract: State-of-the-art Internet traffic engineering uses source-based explicit routing via MPLS or Segment Routing. Though widely adopted in practice, source routing can face certain inefficiencies and operational issues, caused by its use of bandwidth reservations. In this work, we make the case for Hop-by-Hop (HBH) Traffic Engineering: splitting traffic among nexthops at every router, rather than splitting traffic among paths only at edge routers. We show that HBH traffic engineering can achieve the original goals of MPLS (i.e., efficient use of network resources), with a much simpler design that does not need bandwidth reservations or predictions of traffic demand. We implement a prototype in the ns-3 network simulator, to investigate the cost imposed by 1) the restricted path choice of loop-free HBH multipath routing, and 2) the distributed decisions of each router, based on its local network view. We show that the former is more important than the latter, but that, other than a few outliers, our design shows a performance (= aggregate user utility) close to the theoretical optimum.


title: Tracking the variety of interleavings

abstract: In topological data analysis persistence modules are used to distinguish the legitimate topological features of a finite data set from noise. Interleavings between persistence modules feature prominantly in the analysis. One can show that for $\epsilon$ positive, the collection of $\epsilon$-interleavings between two persistence modules $M$ and $N$ has the structure of an affine variety, Thus, the smallest value of $\epsilon$ corresponding to a nonempty variety is the interleaving distance. With this in mind, it is natural to wonder how this variety changes with the value of $\epsilon$, and what information about $M$ and $N$ can be seen from just the knowledge of their varieties. In this paper, we focus on the special case where $M$ and $N$ are interval modules. In this situation we classify all possible progressions of varieties, and determine what information about $M$ and $N$ is present in the progression.


title: Subjective Evaluation of Noise Suppression Algorithms in Crowdsourcing

abstract: The quality of the speech communication systems, which include noise suppression algorithms, are typically evaluated in laboratory experiments according to the ITU-T Rec. P.835, in which participants rate background noise, speech signal, and overall quality separately. This paper introduces an open-source toolkit for conducting subjective quality evaluation of noise suppressed speech in crowdsourcing. We followed the ITU-T Rec. P.835, and P.808 and highly automate the process to prevent moderator's error. To assess the validity of our evaluation method, we compared the Mean Opinion Scores (MOS), calculate using ratings collected with our implementation, and the MOS values from a standard laboratory experiment conducted according to the ITU-T Rec P.835. Results show a high validity in all three scales namely background noise, speech signal and overall quality (average PCC = 0.961). Results of a round-robin test (N=5) showed that our implementation is also a highly reproducible evaluation method (PCC=0.99). Finally, we used our implementation in the INTERSPEECH 2021 Deep Noise Suppression Challenge as the primary evaluation metric, which demonstrates it is practical to use at scale. The results are analyzed to determine why the overall performance was the best in terms of background noise and speech quality.


title: Spectral synthesis for exponentials and logarithmic length

abstract: We study hereditary completeness of systems of exponentials on an interval such that the corresponding generating function $G$ is small outside of a lacunary sequence of intervals $I_k$. We show that, under some technical conditions, an exponential system is hereditarily complete if and only if the logarithmic length of the union of these intervals is infinite, i.e., $\sum_k\int_{I_k} \frac{dx}{1+|x|}=\infty$.


title: Nano-thermodynamics of chemically induced graphene-diamond transformation

abstract: Nearly two-dimensional diamond, or diamane, is coveted as ultrathin $sp^3$-carbon film with unique mechanics and electro-optics. The very thinness ($~h$) makes it possible for the surface chemistry, e.g. adsorbed atoms, to shift the bulk phase thermodynamics in favor of diamond, from multilayer graphene. Thermodynamic theory coupled with atomistic first principles computations predicts not only the reduction of required pressure ($p/p_{\infty}>1-h_0/h$), but also the nucleation barriers, definitive for the kinetic feasibility of diamane formation. Moreover, the optimal adsorbent chair-pattern on a bilayer graphene results in a cubic diamond lattice, while for thicker precursors the adsorbent boat-structure tends to produce hexagonal diamond (lonsdaleite), if graphene was in AA` stacking to start with. As adsorbents, H and F are conducive to diamond formation, while Cl appears sterically hindered.


title: Higher Ideal Approximation Theory

abstract: Let ${\mathscr{C}}$ be an $n$-cluster tilting subcategory of an exact category $({\mathscr{A}}, {\mathscr{E}})$, where $n \geq 1$ is an integer. It is proved by Jasso that if $n> 1$, then ${\mathscr{C}}$ although is no longer exact, but has a nice structure known as $n$-exact structure. In this new structure conflations are called admissible $n$-exact sequences and are ${\mathscr{E}}$-acyclic complexes with $n+2$ terms in ${\mathscr{C}}$. Since their introduction by Iyama, cluster tilting subcategories has gained a lot of traction, due largely to their links and applications to many research areas, many of them unexpected. On the other hand, ideal approximation theory, that is a gentle generalization of the classical approximation theory and deals with morphisms and ideals instead of objects and subcategories, is an active area that has been the subject of several researches. Our aim in this paper is to introduce the so-called `ideal approximation theory' into `higher homological algebra'. To this end, we introduce some important notions in approximation theory into the theory of $n$-exact categories and prove some results. In particular, the higher version of the notions such as ideal cotorsion pairs, phantom ideals, Salce's Lemma and Wakamatsu's Lemma for ideals will be introduced and studied. Our results motivate the definitions and show that $n$-exact categories are the appropriate context for the study of `higher ideal approximation theory'.


title: Active Photon Regeneration for ALPS II

abstract: ALPS II, the Any Light Particle Search, is a second-generation Light Shining through a Wall experiment that hunts for axion-like particles. It uses two optical cavities; one on each side of the wall, to first generate light particles from a very strong intra-cavity optical field and then turn these particles back into photons in the second cavity called the regeneration cavity. ALPS II will either detect axion-like particles or provide an upper limit on their coupling strength to two photons of $g_{a\gamma\gamma}\leq2\times10^{-11}\text{GeV}^{-1}$. The experiment is currently transitioning from the design and construction phase to the commissioning phase with science runs expected to start in 2021. One of the challenges of ALPS II is that one of the cavities will have to track the length of the other cavity at the pm level. This paper discusses the possibility of replacing the regeneration cavity with an active regeneration system which promises a similar signal to noise ratio. For ALPS II, this is a risk reduction activity. However, the regeneration cavity in ALPS is fundamentally very similar to signal recycling in interferometric gravitational wave detectors (LIGO, VIRGO, GEO, and KAGRA) and the basic idea might very well be applicable there as well.


title: Cognitive Preadaptation for Resilient Adaptive Control

abstract: In this paper, we investigate a novel control architecture and algorithm for incorporating preadaption functions. We propose a preadaptation mechanism that can augment any adaptive control scheme and improve its resilience. Through simulations of a flight control system we illustrate the effectiveness of the preadaptation mechanism in improving the adaptation. We show that the preadaptation mechanism we propose can reduce the peak of the response by as much as $50\%$. The scenarios we present also show that the preadaptation mechanism is effective across a wide range of scenarios suggesting that the mechanism is reliable.


title: Taming the snake instabilities in a polariton superfluid

abstract: The dark solitons observed in a large variety of nonlinear media are unstable against the modulational (snake) instabilities and can break in vortex streets. This behavior has been investigated in nonlinear optical crystals and ultracold atomic gases. However, a deep characterization of this phenomenon is still missing. In a resonantly pumped 2D polariton superfluid, we use an all-optical imprinting technique together with the bistability of the polariton system to create dark solitons in confined channels. Due to the snake instabilities, the solitons are unstable and break in arrays of vortex streets whose dynamical evolution is frozen by the pump-induced confining potential, allowing their direct observation in our system. A deep quantitative study shows that the vortex street period is proportional to the quantum fluid healing length, in agreement with the theoretical predictions. Finally, the full control achieved on the soliton patterns is exploited to give a proof of principle of an efficient, ultra-fast, analog, all-optical maze solving machine in this photonic platform.


title: Scheduling with Complete Multipartite Incompatibility Graph on Parallel Machines

abstract: In this paper we consider the problem of scheduling on parallel machines with a presence of incompatibilities between jobs. The incompatibility relation can be modeled as a complete multipartite graph in which each edge denotes a pair of jobs that cannot be scheduled on the same machine. Our research stems from the work of Bodlaender et al.~[1992, 1993]. In particular, we pursue the line investigated partially by Mallek et al.~[2019], where the graph is complete multipartite so each machine can do jobs only from one partition. We also tie our results to the recent approach for so-called identical machines with class constraints by Jansen et al.~[2019], providing a link between our case and their generalization. In the paper we provide several algorithms constructing schedules, optimal or approximate with respect to the two most popular criteria of optimality: Cmax (the makespan) and {\Sigma}Cj(the total completion time). We consider a variety of machine types in our paper: identical, uniform, unrelated, and a natural subcase of unrelated machines. Our results consist of delimitation of the easy (polynomial) and NP-hard problems within these constraints. In the case when the problem is hard, we also provide algorithm, either with a guaranteed constant worst-case approximation ratio or even in some cases a PTAS. In particular, we fill the gap on research for the problem of finding a schedule with smallest total completion time on uniform machines. We address this problem by developing a linear programming relaxation technique with an appropriate rounding, which to our knowledge is a novelty for this criterion in the considered setting.


title: Preresolving categories and derived equivalences

abstract: It is well known that a resolving subcategory $\mathcal{A}$ of an abelian subcategory $\mathcal{E}$ induces several derived equivalences: a triangle equivalence $\mathbf{D}^-(\mathcal{A})\to \mathbf{D}^-(\mathcal{E})$ exists in general and furthermore restricts to a triangle equivalence $\mathbf{D}^{\mathsf{b}}(\mathcal{A})\to \mathbf{D}^{\mathsf{b}}(\mathcal{E})$ if $\operatorname{res.dim}_{\mathcal{A}}(E)<\infty$ for any object $E\in \mathcal{E}$. If the category $\mathcal{E}$ is uniformly bounded, i.e. $\operatorname{res.dim}_{\mathcal{A}}(\mathcal{E})<\infty$, one obtains a triangle equivalence $\mathbf{D}(\mathcal{A})\to \mathbf{D}(\mathcal{E})$. In this paper, we show that all of the above statements hold for preresolving subcategories of (one-sided) exact categories. By passing to a one-sided language, one can remove the assumption that $\mathcal{A}\subseteq \mathcal{E}$ is extension-closed completely from the classical setting, yielding easier criteria and more examples. To illustrate this point, we consider the Isbell category $\mathcal{I}$ and show that $\mathcal{I}\subseteq \mathsf{Ab}$ is preresolving but $\mathcal{I}$ cannot be realized as an extension-closed subcategory of an exact category. We also consider a criterion given by Keller to produce derived equivalences of fully exact subcategories. We show that this criterion fits into the framework of preresolving subcategories by considering the relative weak idempotent completion of said subcategory.


title: Multi-Graph Tensor Networks

abstract: The irregular and multi-modal nature of numerous modern data sources poses serious challenges for traditional deep learning algorithms. To this end, recent efforts have generalized existing algorithms to irregular domains through graphs, with the aim to gain additional insights from data through the underlying graph topology. At the same time, tensor-based methods have demonstrated promising results in bypassing the bottlenecks imposed by the Curse of Dimensionality. In this paper, we introduce a novel Multi-Graph Tensor Network (MGTN) framework, which exploits both the ability of graphs to handle irregular data sources and the compression properties of tensor networks in a deep learning setting. The potential of the proposed framework is demonstrated through an MGTN based deep Q agent for Foreign Exchange (FOREX) algorithmic trading. By virtue of the MGTN, a FOREX currency graph is leveraged to impose an economically meaningful structure on this demanding task, resulting in a highly superior performance against three competing models and at a drastically lower complexity.


title: Variational Properties Of The Second Eigenvalue Of The Conformal Laplacian

abstract: Let $(M^n,g)$ be a closed Riemannian manifold of dimension $n\ge 3$. Assume $[g]$ is a conformal class for which the Conformal Laplacian $L_g$ has at least two negative eigenvalues. We show the existence of a (generalized) metric that maximizes the second eigenvalue of $L_g$ over all conformal metrics (the first eigenvalue is maximized by the Yamabe metric). We also show that a maximal metric defines either a nodal solution of the Yamabe equation, or a harmonic map to a sphere. Moreover, we construct examples of each possibility.


title: D-VDAMP: Denoising-based Approximate Message Passing for Compressive MRI

abstract: Plug and play (P&P) algorithms iteratively apply highly optimized image denoisers to impose priors and solve computational image reconstruction problems, to great effect. However, in general the "effective noise", that is the difference between the true signal and the intermediate solution, within the iterations of P&P algorithms is neither Gaussian nor white. This fact makes existing denoising algorithms suboptimal. In this work, we propose a CNN architecture for removing colored Gaussian noise and combine it with the recently proposed VDAMP algorithm, whose effective noise follows a predictable colored Gaussian distribution. We apply the resulting denoising-based VDAMP (D-VDAMP) algorithm to variable density sampled compressive MRI where it substantially outperforms existing techniques.


title: $L^{\infty} $ norms of Husimi distributions of eigenfunctions

abstract: Husimi distributions of Laplace eigenfunctions are special types of `microlocal lifts' of eigenfunctions to phase space. Their weak * limits are the well-known quantum limits or microlocal defect measures of an orthonormal basis $\{ \phi_j\}$ of eigenfunctions on a Riemannian manifold $(M,g)$ . Husimi distributions are normalized mod squares of analytic continuations of eigenfunctions to the complexification of $M$, which may be identified with an open subset of the cotangent bundle $T^*M$. Husimi distributions are probability measures whose density at $\zeta$ is the probability density of a quantum particle at the phase space point $\zeta$. We given universal upper bounds on the sup norms of the Husimi distributions. We also give necessary conditions to obtain the upper bounds in terms of the type of the geodesic through $\zeta$. The bounds are sharp and are achieved by complexified Gaussian beams. These results open the question of relating sup norms (or other natural norms) of Husimi distributions to properties of the weak * limits.


title: Multi-resolution lattice Green's function method for incompressible flows

abstract: We propose a multi-resolution strategy that is compatible with the lattice Green's function (LGF) technique for solving viscous, incompressible flows on unbounded domains. The LGF method exploits the regularity of a finite-volume scheme on a formally unbounded Cartesian mesh to yield robust and computationally efficient solutions. The original method is spatially adaptive, but challenging to integrate with embedded mesh refinement as the underlying LGF is only defined for a fixed resolution. We present an ansatz for adaptive mesh refinement, where the solutions to the pressure Poisson equation are approximated using the LGF technique on a composite mesh constructed from a series of infinite lattices of differing resolution. To solve the incompressible Navier-Stokes equations, this is further combined with an integrating factor for the viscous terms and an appropriate Runge-Kutta scheme for the resulting differential-algebraic equations. The parallelized algorithm is verified through with numerical simulations of vortex rings, and the collision of vortex rings at high Reynolds number is simulated to demonstrate the reduction in computational cells achievable with both spatial and refinement adaptivity.


title: SUREMap: Predicting Uncertainty in CNN-based Image Reconstruction Using Stein's Unbiased Risk Estimate

abstract: Convolutional neural networks (CNN) have emerged as a powerful tool for solving computational imaging reconstruction problems. However, CNNs are generally difficult-to-understand black-boxes. Accordingly, it is challenging to know when they will work and, more importantly, when they will fail. This limitation is a major barrier to their use in safety-critical applications like medical imaging: Is that blob in the reconstruction an artifact or a tumor? In this work we use Stein's unbiased risk estimate (SURE) to develop per-pixel confidence intervals, in the form of heatmaps, for compressive sensing reconstruction using the approximate message passing (AMP) framework with CNN-based denoisers. These heatmaps tell end-users how much to trust an image formed by a CNN, which could greatly improve the utility of CNNs in various computational imaging applications.


title: Semiclassical gravitational collapse of a radially symmetric massless scalar quantum field

abstract: We present a method to study the semiclassical gravitational collapse of a radially symmetric scalar quantum field in a coherent initial state. The formalism utilizes a Fock space basis in the initial metric, is unitary and time reversal invariant up to numerical precision. It maintains exact compatibility of the metric with the expectation values of the energy momentum tensor in the scalar field coherent state throughout the entire time evolution. We find a simple criterion for the smallness of discretization effects, which is violated when a horizon forms. As a first example, we study the collapse of a specific state in the angular momentum $l=0$ approximation. Outside the simulated volume it produces a Schwarzschild metric with $r_s \sim 3.5 \ell_p$. We see behaviour that is compatible with the onset of horizon formation both in the semiclassical and corresponding classical cases in a regime where we see no evidence for large discretization artefacts. In our example setting, we see that quantum effects accelerate the possible horizon formation and move it radially outward. We find that this effect is robust against variations of the radial resolution, the time step, the volume, the initial position and shape of the inmoving state, the vacuum subtraction, the discretization of the time evolution operator and the integration scheme of the metric. We briefly discuss potential improvements of the method and the possibility of applying it to black hole evaporation. We also briefly touch on the extension of our formalism to higher angular momenta, but leave the details and numerics for a forthcoming publication.


title: Performance Analysis of Scientific Computing Workloads on Trusted Execution Environments

abstract: Scientific computing sometimes involves computation on sensitive data. Depending on the data and the execution environment, the HPC (high-performance computing) user or data provider may require confidentiality and/or integrity guarantees. To study the applicability of hardware-based trusted execution environments (TEEs) to enable secure scientific computing, we deeply analyze the performance impact of AMD SEV and Intel SGX for diverse HPC benchmarks including traditional scientific computing, machine learning, graph analytics, and emerging scientific computing workloads. We observe three main findings: 1) SEV requires careful memory placement on large scale NUMA machines (1$\times$$-$3.4$\times$ slowdown without and 1$\times$$-$1.15$\times$ slowdown with NUMA aware placement), 2) virtualization$-$a prerequisite for SEV$-$results in performance degradation for workloads with irregular memory accesses and large working sets (1$\times$$-$4$\times$ slowdown compared to native execution for graph applications) and 3) SGX is inappropriate for HPC given its limited secure memory size and inflexible programming model (1.2$\times$$-$126$\times$ slowdown over unsecure execution). Finally, we discuss forthcoming new TEE designs and their potential impact on scientific computing.


title: Nonabelian stable envelopes, vertex functions with descendents, and integral solutions of $q$-difference equations

abstract: We generalize the construction of elliptic stable envelopes to actions of connected reductive groups and give a direct inductive proof of their existence and uniqueness in a rather general situation. We show these have powerful enumerative applications, in particular, to the computation of vertex functions and their monodromy.


title: The common origin of family and non-family asteroids

abstract: All asteroids are currently classified as either family, originating from the disruption of known bodies, or non-family. An outstanding question is the origin of these non-family asteroids. Were they formed individually, or as members of known families but with chaotically evolving orbits, or are they members of old ghost families, that is, asteroids with a common parent body but with orbits that no longer cluster in orbital element space? Here, we show that the sizes of the non-family asteroids in the inner belt are correlated with their orbital eccentricities and anticorrelated with their inclinations, suggesting that both non-family and family asteroids originate from a small number of large primordial planetesimals. We estimate that ~85% of the asteroids in the inner main belt originate from the Flora, Vesta, Nysa, Polana and Eulalia families, with the remaining ~15% originating from either the same families or, more likely, a few ghost families. These new results imply that we must seek explanations for the differing characteristics of the various meteorite groups in the evolutionary histories of a few, large, precursor bodies. Our findings also support the model that asteroids formed big through the gravitational collapse of material in a protoplanetary disk.


title: IR-GAN: Room Impulse Response Generator for Far-field Speech Recognition

abstract: We present a Generative Adversarial Network (GAN) based room impulse response generator (IR-GAN) for generating realistic synthetic room impulse responses (RIRs). IR-GAN extracts acoustic parameters from captured real-world RIRs and uses these parameters to generate new synthetic RIRs. We use these generated synthetic RIRs to improve far-field automatic speech recognition in new environments that are different from the ones used in training datasets. In particular, we augment the far-field speech training set by convolving our synthesized RIRs with a clean LibriSpeech dataset. We evaluate the quality of our synthetic RIRs on the real-world LibriSpeech test set created using real-world RIRs from the BUT ReverbDB and AIR datasets. Our IR-GAN reports up to an 8.95% lower error rate than Geometric Acoustic Simulator (GAS) in far-field speech recognition benchmarks. We further improve the performance when we combine our synthetic RIRs with synthetic impulse responses generated using GAS. This combination can reduce the word error rate by up to 14.3% in far-field speech recognition benchmarks.


title: Wideband Index Modulation with Circularly-Shifted Chirps

abstract: In this study, we propose a wideband index modulation (IM) based on circularly-shifted chirps. To derive the proposed method, we first prove that a Golay complementary pair (GCP) can be constructed by linearly combining the Fourier series of chirps. We show that Fresnel integrals and/or Bessel functions, arising from sinusoidal and linear chirps, respectively, can lead to GCPs. We then exploit discrete Fourier transform-spread orthogonal frequency division multiplexing (DFT-s-OFDM) to obtain a low-complexity transmitter and receiver. We also discuss its generalization for achieving a trade-off between peak-to-mean envelope power ratio (PMEPR) and spectral efficiency (SE). Through comprehensive simulations, we compare the proposed scheme with DFT-s-OFDM with IM, orthogonal frequency division multiplexing (OFDM) with IM and complementary sequences (CSs) from Reed-Muller (RM) code. Our numerical results show that the proposed method limits the PMEPR while exploiting the frequency.


title: A forward-modelling method to infer the dark matter particle mass from strong gravitational lenses

abstract: A fundamental prediction of the cold dark matter (CDM) model of structure formation is the existence of a vast population of dark matter haloes extending to subsolar masses. By contrast, other dark matter models, such as a warm thermal relic (WDM), predict a cutoff in the mass function at a mass which, for popular models, lies approximately between $10^7$ and $10^{10}~{\rm M}_\odot$. We use mock observations to demonstrate the viability of a forward modelling approach to extract information about low-mass dark haloes lying along the line-of-sight to galaxy-galaxy strong lenses. This can be used to constrain the mass of a thermal relic dark matter particle, $m_\mathrm{DM}$. With 50 strong lenses at Hubble Space Telescope resolution and a maximum pixel signal-to-noise ratio of $\sim50$, the expected median 2$\sigma$ constraint for a CDM-like model (with a halo mass cutoff at $10^{7}~{\rm M}_\odot$) is $m_\mathrm{DM} > 4.10 \, \mathrm{keV}$ (50% chance of constraining $m_{\rm DM}$ to be better than 4.10 keV). If, however, the dark matter is a warm particle of $m_\mathrm{DM}=2.2 \, \mathrm{keV}$, our 'Approximate Bayesian Computation' method would result in a median estimate of $m_\mathrm{DM}$ between 1.43 and 3.21 keV. Our method can be extended to the large samples of strong lenses that will be observed by future telescopes, and could potentially rule out the standard CDM model of cosmogony. To aid future survey design, we quantify how these constraints will depend on data quality (spatial resolution and integration time) as well as on the lensing geometry (source and lens redshifts).


title: Subgroup Separability of Artin Groups

abstract: We find a condition on the underlying graph of an Artin group that fully determines if it is subgroup separable. As a consequence, an Artin group is subgroup separable if and only if it can be obtained from Artin groups of ranks at most 2 via a finite sequence of free products and direct products with the infinite cyclic group. This result generalizes the Metaftsis-Raptis criterion for Right-Angled Artin groups.


title: Performance Analysis of Cell-Free Massive MIMO Systems: A Stochastic Geometry Approach

abstract: Cell-free (CF) massive multiple-input-multiple-output (MIMO) has emerged as an alternative deployment for conventional cellular massive MIMO networks. Prior works relied on the strong assumption (quite idealized) that the APs are uniformly distributed, and actually, this randomness was considered during the simulation and not in the analysis. However, in practice, ongoing and future networks become denser and increasingly irregular. Having this in mind, we consider that the AP locations are modeled by means of a Poisson point process (PPP) which is a more realistic model for the spatial randomness than a grid or uniform deployment. In particular, by virtue of stochastic geometry tools, we derive both the downlink coverage probability and achievable rate. Notably, this is the only work providing the coverage probability and shedding light on this aspect of CF massive MIMO systems. Focusing on the extraction of interesting insights, we consider small-cells (SCs) as a benchmark for comparison. Among the findings, CF massive MIMO systems achieve both higher coverage and rate with comparison to SCs due to the properties of favorable propagation, channel hardening, and interference suppression. Especially, we showed for both architectures that increasing the AP density results in a higher coverage which saturates after a certain value and increasing the number of users decreases the achievable rate but CF massive MIMO systems take advantage of the aforementioned properties, and thus, outperform SCs. In general, the performance gap between CF massive MIMO systems and SCs is enhanced by increasing the AP density. Another interesting observation concerns that a higher path-loss exponent decreases the rate while the users closer to the APs affect more the performance in terms of the rate.


title: Multiwavelength analysis and the difference in the behavior of the spectral features during the 2010 and 2014 flaring periods of the blazar 3C 454.3

abstract: The flat-spectrum radio quasar 3C~454.3 throughout the years has presented very high activity phases (flares) in which the different wavebands increase their flux dramatically. In this work, we perform multiwavelength analysis from radio to gamma-rays and study the Mg~II~$\lambda 2798$\AA\ emission line and the UV~Fe~II band from 2008-2018. We found that an increase in the 43 GHz flux density of the quasi-stationary component C, coincides with the estimated time at which a superluminal blob ejected from the radio core (which caused the brightest flare of 2010) collides with the quasi-stationary component (at a projected distance of $\sim4.6$ pc from the radio core). The spectral index different behavior in the first ($5000 < \text{JD}-2450000 < 5600$) and second ($6600 < \text{JD}-2450000 < 7900$) flaring periods suggest changes in the physical conditions. The complex nature of the second period can be a result of a superposition of multiple events at different locations. The Mg~II has an anti-correlation with the UV-continuum while Fe~II correlates positively. Except by the time of the brightest flare of 2010, when both have a strong response at high continuum luminosities. Our results suggest that the dominant gamma-ray emission mechanism for the first flaring period is External Compton. For the second flaring period the seed photons emission region is co-spatial with the gamma-ray emission region. However, a SED study using a multizone jet emission model is required to confirm the nature of each significant flare during the second period.


title: Thermodynamics of Graviton Condensate

abstract: In this work, we present the thermodynamic study of a model that considers the black hole as a condensate of gravitons. In this model, the spacetime is not asymptotically flat because of a topological defect that introduces an angle deficit in the spacetime like in Global Monopole solutions. We have obtained a correction to the Hawking temperature plus a negative pressure associated with the black hole of mass $M$. In this way, the graviton condensate, which is assumed to be at the critical point defined by the condition $\mu_{ch}$=0, has well-defined thermodynamic quantities $P$, $V$, $T_{h}$, $S$, and $U$ as any other Bose-Einstein condensate (BEC). In addition, we present a formal equivalence between the Letelier spacetime and the line element that describes the graviton condensate. We also discuss the Kiselev black hole, which can parametrize the most well-known spherically symmetric black holes. Finally, we present a new metric, which we will call the BEC-Kiselev solution, that allows us to extend the graviton condensate to the case of solutions with different matter contents.


title: Hom-Jordan-Malcev-Poisson algebras

abstract: The purpose of this paper is to provide and study a Hom-type generalization of Jordan-Malcev-Poisson algebras, called Hom-Jordan-Malcev-Poisson algebras. We show that they are closed under twisting by suitable self-maps and give a characterization of admissible Hom-Jordan-Malcev-Poisson algebras. In addition, we introduce the notion of pseudo-Euclidian Hom-Jordan-Malcev-Poisson algebras and describe its $T^*$-extension. Finally, we generalize the notion of Lie-Jordan-Poisson triple system to the Hom setting and establish its relationships with Hom-Jordan-Malcev-Poisson algebras.


title: Coexistence of active Brownian discs: Van der Waals theory and analytical results

abstract: At thermal equilibrium, intensive quantities like temperature and pressure have to be uniform throughout the system, restricting inhomogeneous systems composed of different phases. The paradigmatic example is the coexistence of vapor and liquid, a state that can also be observed for active Brownian particles steadily driven away from equilibrium. Recently, a strategy has been proposed that allows to predict phase equilibria of active particles [Phys. Rev. E \textbf{97}, 020602(R)(2018)]. Here we elaborate on this strategy and formulate it in the framework of a van der Waals theory for active discs. For a given equation of state, we derive the effective free energy analytically and show that it yields coexisting densities in very good agreement with numerical results. We discuss the interfacial tension and the relation to Cahn-Hilliard models.


title: Unified Gradient Reweighting for Model Biasing with Applications to Source Separation

abstract: Recent deep learning approaches have shown great improvement in audio source separation tasks. However, the vast majority of such work is focused on improving average separation performance, often neglecting to examine or control the distribution of the results. In this paper, we propose a simple, unified gradient reweighting scheme, with a lightweight modification to bias the learning process of a model and steer it towards a certain distribution of results. More specifically, we reweight the gradient updates of each batch, using a user-specified probability distribution. We apply this method to various source separation tasks, in order to shift the operating point of the models towards different objectives. We demonstrate different parameterizations of our unified reweighting scheme can be used towards addressing several real-world problems, such as unreliable separation estimates. Our framework enables the user to control a robustness trade-off between worst and average performance. Moreover, we experimentally show that our unified reweighting scheme can also be used in order to shift the focus of the model towards being more accurate for user-specified sound classes or even towards easier examples in order to enable faster convergence.


title: Latent Network Estimation and Variable Selection for Compositional Data via Variational EM

abstract: Network estimation and variable selection have been extensively studied in the statistical literature, but only recently have those two challenges been addressed simultaneously. In this paper, we seek to develop a novel method to simultaneously estimate network interactions and associations to relevant covariates for count data, and specifically for compositional data, which have a fixed sum constraint. We use a hierarchical Bayesian model with latent layers and employ spike-and-slab priors for both edge and covariate selection. For posterior inference, we develop a novel variational inference scheme with an expectation maximization step, to enable efficient estimation. Through simulation studies, we demonstrate that the proposed model outperforms existing methods in its accuracy of network recovery. We show the practical utility of our model via an application to microbiome data. The human microbiome has been shown to contribute to many of the functions of the human body, and also to be linked with a number of diseases. In our application, we seek to better understand the interaction between microbes and relevant covariates, as well as the interaction of microbes with each other. We provide a Python implementation of our algorithm, called SINC (Simultaneous Inference for Networks and Covariates), available online.


title: Flavor Symmetry of 5d SCFTs, Part 1: General Setup

abstract: A large class of 5d superconformal field theories (SCFTs) can be constructed by integrating out BPS particles from 6d SCFTs compactified on a circle. We describe a general method for extracting the flavor symmetry of any 5d SCFT lying in this class. For this purpose, we utilize the geometric engineering of 5d N=1 theories in M-theory, where the flavor symmetry is encoded in a collection of non-compact surfaces.


title: Human or Machine? It Is Not What You Write, But How You Write It

abstract: Online fraud often involves identity theft. Since most security measures are weak or can be spoofed, we investigate a more nuanced and less explored avenue: behavioral biometrics via handwriting movements. This kind of data can be used to verify whether a user is operating a device or a computer application, so it is important to distinguish between human and machine-generated movements reliably. For this purpose, we study handwritten symbols (isolated characters, digits, gestures, and signatures) produced by humans and machines, and compare and contrast several deep learning models. We find that if symbols are presented as static images, they can fool state-of-the-art classifiers (near 75% accuracy in the best case) but can be distinguished with remarkable accuracy if they are presented as temporal sequences (95% accuracy in the average case). We conclude that an accurate detection of fake movements has more to do with how users write, rather than what they write. Our work has implications for computerized systems that need to authenticate or verify legitimate human users, and provides an additional layer of security to keep attackers at bay.


title: Self-Supervised Training For Low Dose CT Reconstruction

abstract: Ionizing radiation has been the biggest concern in CT imaging. To reduce the dose level without compromising the image quality, low-dose CT reconstruction has been offered with the availability of compressed sensing based reconstruction methods. Recently, data-driven methods got attention with the rise of deep learning, the availability of high computational power, and big datasets. Deep learning based methods have also been used in low-dose CT reconstruction problem in different manners. Usually, the success of these methods depends on labeled data. However, recent studies showed that training can be achieved successfully with noisy datasets. In this study, we defined a training scheme to use low-dose sinograms as their own training targets. We applied the self-supervision principle in the projection domain where the noise is element-wise independent which is a requirement for self-supervised training methods. Using the self-supervised training, the filtering part of the FBP method and the parameters of a denoiser neural network are optimized. We demonstrate that our method outperforms both conventional and compressed sensing based iterative reconstruction methods qualitatively and quantitatively in the reconstruction of analytic CT phantoms and real-world CT images in low-dose CT reconstruction task.


title: Now You See Me (CME): Concept-based Model Extraction

abstract: Deep Neural Networks (DNNs) have achieved remarkable performance on a range of tasks. A key step to further empowering DNN-based approaches is improving their explainability. In this work we present CME: a concept-based model extraction framework, used for analysing DNN models via concept-based extracted models. Using two case studies (dSprites, and Caltech UCSD Birds), we demonstrate how CME can be used to (i) analyse the concept information learned by a DNN model (ii) analyse how a DNN uses this concept information when predicting output labels (iii) identify key concept information that can further improve DNN predictive performance (for one of the case studies, we showed how model accuracy can be improved by over 14%, using only 30% of the available concepts).


title: DistPrivacy: Privacy-Aware Distributed Deep Neural Networks in IoT surveillance systems

abstract: With the emergence of smart cities, Internet of Things (IoT) devices as well as deep learning technologies have witnessed an increasing adoption. To support the requirements of such paradigm in terms of memory and computation, joint and real-time deep co-inference framework with IoT synergy was introduced. However, the distribution of Deep Neural Networks (DNN) has drawn attention to the privacy protection of sensitive data. In this context, various threats have been presented, including black-box attacks, where a malicious participant can accurately recover an arbitrary input fed into his device. In this paper, we introduce a methodology aiming to secure the sensitive data through re-thinking the distribution strategy, without adding any computation overhead. First, we examine the characteristics of the model structure that make it susceptible to privacy threats. We found that the more we divide the model feature maps into a high number of devices, the better we hide proprieties of the original image. We formulate such a methodology, namely DistPrivacy, as an optimization problem, where we establish a trade-off between the latency of co-inference, the privacy level of the data, and the limited-resources of IoT participants. Due to the NP-hardness of the problem, we introduce an online heuristic that supports heterogeneous IoT devices as well as multiple DNNs and datasets, making the pervasive system a general-purpose platform for privacy-aware and low decision-latency applications.


title: Flavor Symmetry of 5d SCFTs, Part 2: Applications

abstract: In Part 1 of this series of papers, we described a general method for determining the flavor symmetry of any 5d SCFT which can be constructed by integrating out BPS particles from some 6d SCFT compactified on a circle. In this part, we apply the method to explicitly determine the flavor symmetry of those 5d SCFTs which reduce, upon a mass deformation, to some 5d N=1 gauge theory carrying a simple gauge algebra. In these cases, the flavor symmetry of the 5d gauge theory is often enhanced at the conformal point. We use our method to determine this enhancement.


title: Automatic Learning of Topological Phase Boundaries

abstract: Topological phase transitions, which do not adhere to Landau's phenomenological model (i.e. a spontaneous symmetry breaking process and vanishing local order parameters) have been actively researched in condensed matter physics. Machine learning of topological phase transitions has generally proved difficult due to the global nature of the topological indices. Only recently has the method of diffusion maps been shown to be effective at identifying changes in topological order. However, previous diffusion map results required adjustments of two hyperparameters: a data length-scale and the number of phase boundaries. In this article we introduce a heuristic that requires no such tuning. This heuristic allows computer programs to locate appropriate hyperparameters without user input. We demonstrate this method's efficacy by drawing remarkably accurate phase diagrams in three physical models: the Haldane model of graphene, a generalization of the Su-Schreiffer-Haeger (SSH) model, and a model for a quantum ring with tunnel junctions. These diagrams are drawn, without human intervention, from a supplied range of model parameters.


title: Surface Energy and Separation Mechanics of Droplet Interface Phospholipid Bilayers

abstract: Droplet interface bilayers are a convenient model system to study the physio-chemical properties of phospholipid bilayers, the major component of the cell membrane. The mechanical response of these bilayers to various external mechanical stimuli is an active area of research due to implications for cellular viability and development of artificial cells. In this manuscript we characterize the separation mechanics of droplet interface bilayers under step strain using a combination of experiments and numerical modeling. Initially, we show that the bilayer surface energy can be obtained using principles of energy conservation. Subsequently, we subject the system to a step strain by separating the drops in a step wise manner, and track the evolution of the bilayer contact angle and radius. The relaxation time of the bilayer contact angle and radius, along with the decay magnitude of the bilayer radius were observed to increase with each separation step. By analyzing the forces acting on the bilayer and the rate of separation, we show that the bilayer separates primarily through the peeling process with the dominant resistance to separation coming from viscous dissipation associated with corner flows. Finally, we explain the intrinsic features of the observed bilayer separation by means of a mathematical model comprising of the Young-Laplace equation and an evolution equation. We believe that the reported experimental and numerical results extend the scientific understanding of lipid bilayer mechanics, and that the developed experimental and numerical tools offer a convenient platform to study the mechanics of other types of bilayers.


title: Vector mesons spectrum in a medium with a chiral imbalance induced by the vacuum of fermions

abstract: The properties of the light vector mesons in the presence of local parity breaking medium with a chiral imbalance are considered in the vector-meson dominance model. Applying the finite lowest-order radiatively induced local effective Lagrangian, initially developed for the QED, for the vector $\rho$ and $\omega$ mesons, we obtained the mass spectrum as a function of momentum and chiral chemical potential $\mu_5$. We showed that in addition to the Chern-Simons term, splitting the transverse polarisations of the mesons, there is another radiatively induced contribution that becomes important at momentum and $\mu_5$ around a few hundred MeV.


title: Galois Theory for Inverse Semigroup Orthogonal Actions

abstract: A Galois correspondence theorem is proved for the case of inverse semigroups acting orthogonally on commutative rings as a consequence of the Galois correspondence theorem for groupoid actions. To this end, we use a classic result of inverse semigroup theory that establishes a one-to-one correspondence between inverse semigroups and inductive groupoids.


title: Nonideal Mixing Effects in Warm Dense Matter Studied with First-Principles Computer Simulations

abstract: We study nonideal mixing effects in the regime of warm dense matter (WDM) by computing the shock Hugoniot curves of BN, MgO, and MgSiO_3. First, we derive these curves from the equations of state (EOS) of the fully interacting systems, which were obtained using a combination of path integral Monte Carlo calculations at high temperature and density functional molecular dynamics simulations at lower temperatures. We then use the ideal mixing approximation at constant pressure and temperature to rederive these Hugoniot curves from the EOS tables of the individual elements. We find that the linear mixing approximation works remarkably well at temperatures above ~2*10^5 K, where the shock compression ratio exceeds ~3.2. The shape of the Hugoniot curve of each compound is well reproduced. Regions of increased shock compression, that emerge because of the ionization of L and K shell electrons, are well represented and the maximum compression ratio on the Hugoniot curves is reproduced with high precision. Some deviations are seen near the onset of the L shell ionization regime, where ionization equilibrium in the fully interacting system cannot be well reproduced by the ideal mixing approximation. This approximation also breaks down at lower temperatures, where chemical bonds play an increasingly import role. However, the results imply that equilibrium properties of binary and ternary mixtures in the regime of WDM can be derived from the EOS tables of the individual elements. This significantly simplifies the characterization of binary and ternary mixtures in the WDM and plasma phases, which otherwise requires large numbers of more computationally expensive first-principles computer simulations.


title: A Bayesian Surrogate Constitutive Model to Estimate Failure Probability of Rubber-Like Materials

abstract: In this study, a stochastic constitutive modeling approach for elastomeric materials is developed to consider uncertainty in material behavior and its prediction. This effort leads to a demonstration of the deterministic approaches error compared to probabilistic approaches in order to calculate the probability of failure. First, the Bayesian linear regression model calibration approach is employed for the Carroll model representing a hyperelastic constitutive model. The developed model is calibrated based on the Maximum Likelihood Estimation (MLE) and Maximum a Priori (MAP) estimation. Next, a Gaussian process (GP) as a non-parametric approach is utilized to estimate the probabilistic behavior of elastomeric materials. In this approach, hyper-parameters of the radial basis kernel in GP are calculated using L-BFGS method. To demonstrate model calibration and uncertainty propagation, these approaches are conducted on two experimental data sets for silicon-based and polyurethane-based adhesives, with four samples from each material. These uncertainties stem from model, measurement, to name but a few. Finally, failure probability calculation analysis is conducted with First Order Reliability Method (FORM) analysis and Crude Monte Carlo (CMC) simulation for these data sets by creating a limit state function based on the stochastic constitutive model at failure stretch. Furthermore, sensitivity analysis is used to show the importance of each parameter in the probability of failure. Results show the performance of the proposed approach not only for uncertainty quantification and model calibration but also for failure probability calculation of hyperelastic materials.


title: Co-embedding of Nodes and Edges with Graph Neural Networks

abstract: Graph, as an important data representation, is ubiquitous in many real world applications ranging from social network analysis to biology. How to correctly and effectively learn and extract information from graph is essential for a large number of machine learning tasks. Graph embedding is a way to transform and encode the data structure in high dimensional and non-Euclidean feature space to a low dimensional and structural space, which is easily exploited by other machine learning algorithms. We have witnessed a huge surge of such embedding methods, from statistical approaches to recent deep learning methods such as the graph convolutional networks (GCN). Deep learning approaches usually outperform the traditional methods in most graph learning benchmarks by building an end-to-end learning framework to optimize the loss function directly. However, most of the existing GCN methods can only perform convolution operations with node features, while ignoring the handy information in edge features, such as relations in knowledge graphs. To address this problem, we present CensNet, Convolution with Edge-Node Switching graph neural network, for learning tasks in graph-structured data with both node and edge features. CensNet is a general graph embedding framework, which embeds both nodes and edges to a latent feature space. By using line graph of the original undirected graph, the role of nodes and edges are switched, and two novel graph convolution operations are proposed for feature propagation. Experimental results on real-world academic citation networks and quantum chemistry graphs show that our approach achieves or matches the state-of-the-art performance in four graph learning tasks, including semi-supervised node classification, multi-task graph classification, graph regression, and link prediction.


title: V.I. Arnold's "Global" KAM Theorem and geometric measure estimates

abstract: This paper continues the discussion started in [CK19] concerning Arnold's legacy on classical KAM theory and (some of) its modern developments. We prove a detailed and explicit `global' Arnold's KAM Theorem, which yields, in particular, the Whitney conjugacy of a non-degenerate, real-analytic, nearly-integrable Hamiltonian system to an integrable system on a closed, nowhere dense, positive measure subset of the phase space. Detailed measure estimates on the Kolmogorov's set are provided in the case the phase space is: (A) a uniform neighborhood of an arbitrary (bounded) set times the d-torus and (B) a domain with $C^2$ boundary times the d-torus. All constants are explicitly given.


title: Generalized Iris Presentation Attack Detection Algorithm under Cross-Database Settings

abstract: Presentation attacks are posing major challenges to most of the biometric modalities. Iris recognition, which is considered as one of the most accurate biometric modality for person identification, has also been shown to be vulnerable to advanced presentation attacks such as 3D contact lenses and textured lens. While in the literature, several presentation attack detection (PAD) algorithms are presented; a significant limitation is the generalizability against an unseen database, unseen sensor, and different imaging environment. To address this challenge, we propose a generalized deep learning-based PAD network, MVANet, which utilizes multiple representation layers. It is inspired by the simplicity and success of hybrid algorithm or fusion of multiple detection networks. The computational complexity is an essential factor in training deep neural networks; therefore, to reduce the computational complexity while learning multiple feature representation layers, a fixed base model has been used. The performance of the proposed network is demonstrated on multiple databases such as IIITD-WVU MUIPA and IIITD-CLI databases under cross-database training-testing settings, to assess the generalizability of the proposed algorithm.


title: Endogenous Representation of Asset Returns

abstract: Factor modeling of asset returns has been a dominant practice in investment science since the introduction of the Capital Asset Pricing Model (CAPM) and the Arbitrage Pricing Theory (APT). The factors, which account for the systematic risk, are either specified or interpreted to be exogenous. They explain a significant portion of the risk in large portfolios. We propose a framework that asks how much of the risk, that we see in equity markets, may be explained by the asset returns themselves. To answer this question, we decompose the asset returns into an endogenous component and the remainder, and analyze the properties of the resulting risk decomposition. Statistical methods to estimate this decomposition from data are provided along with empirical tests. Our results point to the possibility that most of the risk in equity markets may be explained by a sparse network of interacting assets (or their issuing firms). This sparse network can give the appearance of a set exogenous factors where, in fact, there may be none. We illustrate our results with several case studies.


title: MixNet for Generalized Face Presentation Attack Detection

abstract: The non-intrusive nature and high accuracy of face recognition algorithms have led to their successful deployment across multiple applications ranging from border access to mobile unlocking and digital payments. However, their vulnerability against sophisticated and cost-effective presentation attack mediums raises essential questions regarding its reliability. In the literature, several presentation attack detection algorithms are presented; however, they are still far behind from reality. The major problem with existing work is the generalizability against multiple attacks both in the seen and unseen setting. The algorithms which are useful for one kind of attack (such as print) perform unsatisfactorily for another type of attack (such as silicone masks). In this research, we have proposed a deep learning-based network termed as \textit{MixNet} to detect presentation attacks in cross-database and unseen attack settings. The proposed algorithm utilizes state-of-the-art convolutional neural network architectures and learns the feature mapping for each attack category. Experiments are performed using multiple challenging face presentation attack databases such as SMAD and Spoof In the Wild (SiW-M) databases. Extensive experiments and comparison with existing state of the art algorithms show the effectiveness of the proposed algorithm.


title: Attack Agnostic Adversarial Defense via Visual Imperceptible Bound

abstract: The high susceptibility of deep learning algorithms against structured and unstructured perturbations has motivated the development of efficient adversarial defense algorithms. However, the lack of generalizability of existing defense algorithms and the high variability in the performance of the attack algorithms for different databases raises several questions on the effectiveness of the defense algorithms. In this research, we aim to design a defense model that is robust within a certain bound against both seen and unseen adversarial attacks. This bound is related to the visual appearance of an image, and we termed it as \textit{Visual Imperceptible Bound (VIB)}. To compute this bound, we propose a novel method that uses the database characteristics. The VIB is further used to measure the effectiveness of attack algorithms. The performance of the proposed defense model is evaluated on the MNIST, CIFAR-10, and Tiny ImageNet databases on multiple attacks that include C\&W ($l_2$) and DeepFool. The proposed defense model is not only able to increase the robustness against several attacks but also retain or improve the classification accuracy on an original clean test set. The proposed algorithm is attack agnostic, i.e. it does not require any knowledge of the attack algorithm.


title: Aronszajn and Sikorski subcartesian differential spaces

abstract: We construct a natural transformation between the category of Aronszajn subcartesian spaces and the category of subcartesian differential spaces, which is a subcategory of Sikorski differential spaces.


title: Hat Guessing on Books and Windmills

abstract: The hat-guessing number is a graph invariant defined by Butler, Hajiaghayi, Kleinberg, and Leighton. We determine the hat-guessing number exactly for book graphs with sufficiently many pages, improving previously known lower bounds of He and Li and exactly matching an upper bound of Gadouleau. We prove that the hat-guessing number of $K_{3,3}$ is $3$, making this the first complete bipartite graph $K_{n,n}$ for which the hat-guessing number is known to be smaller than the upper bound of $n+1$ of Gadouleau and Georgiou. Finally, we determine the hat-guessing number of windmill graphs for most choices of parameters.


title: An Approach to Preamble Collision Reduction in Grant-Free Random Access with Massive MIMO

abstract: In this paper, we study grant-free random access with massive multiple input multiple output (MIMO) systems. We first show that the performance of massive MIMO based grant-free random access is mainly decided by the probability of preamble collision. The implication of this is that although the number of antennas can be arbitrarily large, the (average) number of successful packet transmissions can be limited by the number of preambles. Then, we propose an approach to preamble collision reduction without increasing the number of preambles using the notion of superpositioned preambles (S-preambles). Since the channel estimation for conjugate beamforming can be carried out when unused S-preambles are known, a simple approach is derived to detect unused S-preambles and its performance is analyzed for a special case (superpositions with 2 preambles). Based on analysis and simulation results, it is confirmed that the proposed approach with S-preambles can increase the success probability with the same spectral efficiency as the conventional approach.


title: Potential and pH dependence of the buried interface of membrane-coated electrocatalysts

abstract: Semipermeable silica membranes are attractive as protective coatings for metal electrocatalysts such as platinum but their impact on the catalytic properties has not been fully understood. Here, we develop a first principles formalism to investigate how silica membranes interact with the surface of platinum metal electrocatalysts to develop a better understanding of the membrane-metal interplay. By generalizing the concept of Pourbaix diagrams to electrochemical solid-solid interfaces, we establish which bonds are formed between the SiO$_2$ membrane and the Pt(111) surface in aqueous electrolytes for different pH values and potential biases. We find that the membrane termination changes as a function of the pH and the potential, which affects the adhesion strength and the energy requirements for partial membrane detachment, controlling the Pt surface area that is accessible for reactant species. The charge-transfer between the Pt surface and the SiO$_2$ membrane is also pH and potential dependent and results in changes of the Pt surface d-band states, which are known to correlate with catalytic activity. Our analysis reveals the complex response of a buried interface to the electrochemical environment and identifies trends that are expected to apply also to other membrane-coated electrocatalysts.


title: Exploring data subsets with vtree

abstract: Variable trees are a new method for the exploration of discrete multivariate data. They display nested subsets and corresponding frequencies and percentages. Manual calculation of these quantities can be laborious, especially when there are many multi-level factors and missing data. Here we introduce variable trees and their implementation in the vtree R package, draw comparisons with existing methods (contingency tables, mosaic plots, Venn/Euler diagrams, and UpSet), and illustrate their utility using two case studies. Variable trees can be used to (1) reveal patterns in nested subsets, (2) explore missing data, and (3) generate study flow diagrams (e.g., CONSORT diagrams) directly from data frames, to support reproducible research and open science.


title: Dual-energy Computed Tomography Imaging from Contrast-enhanced Single-energy Computed Tomography

abstract: In a standard computed tomography (CT) image, pixels having the same Hounsfield Units (HU) can correspond to different materials and it is therefore challenging to differentiate and quantify materials. Dual-energy CT (DECT) is desirable to differentiate multiple materials, but DECT scanners are not widely available as single-energy CT (SECT) scanners. Here we purpose a deep learning approach to perform DECT imaging by using standard SECT data. We designed a predenoising and difference learning mechanism to generate DECT images from SECT data. The performance of the deep learning-based DECT approach was studied using images from patients who received contrast-enhanced abdomen DECT scan with a popular DE application: virtual non-contrast (VNC) imaging and contrast quantification. Clinically relevant metrics were used for quantitative assessment. The absolute HU difference between the predicted and original high-energy CT images are 1.3 HU, 1.6 HU, 1.8 HU and 1.3 HU for the ROIs on aorta, liver, spine and stomach, respectively. The aorta iodine quantification difference between iodine maps obtained from the original and deep learning DECT images is smaller than 1.0\%, and the noise levels in the material images have been reduced by more than 7-folds for the latter. This study demonstrates that highly accurate DECT imaging with single low-energy data is achievable by using a deep learning approach. The proposed method allows us to obtain high-quality DECT images without paying the overhead of conventional hardware-based DECT solutions and thus leads to a new paradigm of spectral CT imaging.


title: Early Warning of COVID-19 Hotspots using Mobility of High Risk Users from Web Search Queries

abstract: COVID-19 has disrupted the global economy and well-being of people at an unprecedented scale and magnitude. To contain the disease, an effective early warning system that predicts the locations of outbreaks is of crucial importance. Studies have shown the effectiveness of using large-scale mobility data to monitor the impacts of non-pharmaceutical interventions (e.g., lockdowns) through population density analysis. However, predicting the locations of potential outbreak occurrence is difficult using mobility data alone. Meanwhile, web search queries have been shown to be good predictors of the disease spread. In this study, we utilize a unique dataset of human mobility trajectories (GPS traces) and web search queries with common user identifiers (> 450K users), to predict COVID-19 hotspot locations beforehand. More specifically, web search query analysis is conducted to identify users with high risk of COVID-19 contraction, and social contact analysis was further performed on the mobility patterns of these users to quantify the risk of an outbreak. Our approach is empirically tested using data collected from users in Tokyo, Japan. We show that by integrating COVID-19 related web search query analytics with social contact networks, we are able to predict COVID-19 hotspot locations 1-2 weeks beforehand, compared to just using social contact indexes or web search data analysis. This study proposes a novel method that can be used in early warning systems for disease outbreak hotspots, which can assist government agencies to prepare effective strategies to prevent further disease spread.


title: High-harmonic generation in one-dimensional Mott insulator

abstract: We study high-harmonic generation (HHG) in the one-dimensional Hubbard model in order to understand its relation to elementary excitations as well as the similarities and differences to semiconductors. The simulations are based on the infinite time-evolving block decimation (iTEBD) method and exact diagonalization. We clarify that the HHG originates from the doublon-holon recombination, and the scaling of the cutoff frequency is consistent with a linear dependence on the external field. We demonstrate that the subcycle features of the HHG can be reasonably described by a phenomenological three step model for a doublon-holon pair. We argue that the HHG in the one-dimensional Mott insulator is closely related to the dispersion of the doublon-holon pair with respect to its relative momentum, which is not necessarily captured by the single-particle spectrum due to the many-body nature of the elementary excitations. For the comparison to semiconductors, we introduce effective models obtained from the Schrieffer-Wolff transformation, i.e. a strong-coupling expansion, which allows us to disentangle the different processes involved in the Hubbard model: intraband dynamics of doublons and holons, interband dipole excitations, and spin exchanges. These demonstrate the formal similarity of the Mott system to the semiconductor models in the dipole gauge, and reveal that the spin dynamics, which does not directly affect the charge dynamics, can reduce the HHG intensity. We also show that the long-range component of the intraband dipole moment has a substantial effect on the HHG intensity, while the correlated hopping terms for the doublons and holons essentially determine the shape of the HHG spectrum. A new numerical method to evaluate single-particle spectra within the iTEBD method is also introduced.


title: Counting Parabolic Double Cosets in Symmetric Groups

abstract: Billey, Konvalinka, Petersen, Solfstra, and Tenner recently presented a method for counting parabolic double cosets in Coxeter groups, and used it to compute $p_n$, the number of parabolic double cosets in $S_n$, for $n\leq13$. In this paper, we derive a new formula for $p_n$ and an efficient polynomial time algorithm for evaluating this formula. We use these results to compute $p_n$ for $n\leq5000$ and to prove an asymptotic formula for $p_n$ that was conjectured by Billey et al.


title: Improved Treatment of Dark Matter Capture in Neutron Stars II: Leptonic Targets

abstract: Neutron stars harbour matter under extreme conditions, providing a unique testing ground for fundamental interactions. We recently developed an improved treatment of dark matter (DM) capture in neutron stars that properly incorporates many of the important physical effects, and outlined useful analytic approximations that are valid when the scattering amplitude is independent of the centre of mass energy. We now extend that analysis to all interaction types. We also discuss the effect of going beyond the zero-temperature approximation, which provides a boost to the capture rate of low mass dark matter, and give approximations for the dark matter up-scattering rate and evaporation mass. We apply these results to scattering of dark matter from leptonic targets, for which a correct relativistic description is essential. We find that the potential neutron star sensitivity to DM-lepton scattering cross sections greatly exceeds electron-recoil experiments, particularly in the sub-GeV regime, with a sensitivity to sub-MeV DM well beyond the reach of future terrestrial experiments.


title: Gaussian Asymptotics of Jack Measures on Partitions from Weighted Enumeration of Ribbon Paths

abstract: In this paper we determine two asymptotic results for Jack measures on partitions, a model defined by two specializations of Jack polynomials proposed by Borodin-Olshanski in [European J. Combin. 26.6 (2005): 795-834]. Assuming these two specializations are the same, we derive limit shapes and Gaussian fluctuations for the anisotropic profiles of these random partitions in three asymptotic regimes associated to diverging, fixed, and vanishing values of the Jack parameter. To do so, we introduce a generalization of Motzkin paths we call "ribbon paths", show for general Jack measures that certain joint cumulants are weighted sums of connected ribbon paths on $n$ sites with $n-1+g$ pairings, and derive our two results from the contributions of $(n,g)=(1,0)$ and $(2,0)$, respectively. Our analysis makes use of Nazarov-Sklyanin's spectral theory for Jack polynomials. As a consequence, we give new proofs of several results for Schur measures, Plancherel measures, and Jack-Plancherel measures. In addition, we relate our weighted sums of ribbon paths to the weighted sums of ribbon graphs of maps on non-oriented real surfaces recently introduced by Chapuy-Dol\k{e}ga.


title: A Systematic Comparison of Forecasting for Gross Domestic Product in an Emergent Economy

abstract: Gross domestic product (GDP) is an important economic indicator that aggregates useful information to assist economic agents and policymakers in their decision-making process. In this context, GDP forecasting becomes a powerful decision optimization tool in several areas. In order to contribute in this direction, we investigated the efficiency of classical time series models, the state-space models, and the neural network models, applied to Brazilian gross domestic product. The models used were: a Seasonal Autoregressive Integrated Moving Average (SARIMA) and a Holt-Winters method, which are classical time series models; the dynamic linear model, a state-space model; and neural network autoregression and the multilayer perceptron, artificial neural network models. Based on statistical metrics of model comparison, the multilayer perceptron presented the best in-sample and out-sample forecasting performance for the analyzed period, also incorporating the growth rate structure significantly.


title: Effect of Language Proficiency on Subjective Evaluation of Noise Suppression Algorithms

abstract: Speech communication systems based on Voice-over-IP technology are frequently used by native as well as non-native speakers of a target language, e.g. in international phone calls or telemeetings. Frequently, such calls also occur in a noisy environment, making noise suppression modules necessary to increase perceived quality of experience. Whereas standard tests for assessing perceived quality make use of native listeners, we assume that noise-reduced speech and residual noise may affect native and non-native listeners of a target language in different ways. To test this assumption, we report results of two subjective tests conducted with English and German native listeners who judge the quality of speech samples recorded by native English, German, and Mandarin speakers, which are degraded with different background noise levels and noise suppression effects. The experiments were conducted following the standardized ITU-T Rec. P.835 approach, however implemented in a crowdsourcing setting according to ITU-T Rec. P.808. Our results show a significant influence of language on speech signal ratings and, consequently, on the overall perceived quality in specific conditions.


title: Transfer Learning for Input Estimation of Vehicle Systems

abstract: This study proposes a learning-based method with domain adaptability for input estimation of vehicle suspension systems. In a crowdsensing setting for bridge health monitoring, vehicles carry sensors to collect samples of the bridge's dynamic response. The primary challenge is in preprocessing; signals are highly contaminated from road profile roughness and vehicle suspension dynamics. Additionally, signals are collected from a diverse set of vehicles vitiating model-based approaches. In our data-driven approach, two autoencoders for the cabin signal and the tire-level signal are constrained to force the separation of the tire-level input from the suspension system in the latent state representation. From the extracted features, we estimate the tire-level signal and determine the vehicle class with high accuracy (98% classification accuracy). Compared to existing solutions for the vehicle suspension deconvolution problem, we show that the proposed methodology is robust to vehicle dynamic variations and suspension system nonlinearity.


title: Development of next-generation timing system for the Japan Proton Accelerator Research Complex

abstract: A precise and stable timing system is necessary for high intensity proton accelerators such as the J-PARC. The original timing system, which was developed during the construction period of the J-PARC, has been working without major issues since 2006. After a decade of operation, the optical modules, which are key components for signal transfer, were discontinued already. Thus, the next-generation timing system for the J-PARC has been developed and built. The new system is designed to be compatible with the original system in terms of the operating principle. The new system utilizes modern high speed serial communication for the transfer of the clock, reference trigger, and type code. We describe the system configuration of the next-generation timing system and current status.


title: PoliWAM: An Exploration of a Large Scale Corpus of Political Discussions on WhatsApp Messenger

abstract: WhatsApp Messenger is one of the most popular channels for spreading information with a current reach of more than 180 countries and 2 billion people. Its widespread usage has made it one of the most popular media for information propagation among the masses during any socially engaging event. In the recent past, several countries have witnessed its effectiveness and influence in political and social campaigns. We observe a high surge in information and propaganda flow during election campaigning. In this paper, we explore a high-quality large-scale user-generated dataset curated from WhatsApp comprising of 281 groups, 31,078 unique users, and 223,404 messages shared before, during, and after the Indian General Elections 2019, encompassing all major Indian political parties and leaders. In addition to the raw noisy user-generated data, we present a fine-grained annotated dataset of 3,848 messages that will be useful to understand the various dimensions of WhatsApp political campaigning. We present several complementary insights into the investigative and sensational news stories from the same period. Exploratory data analysis and experiments showcase several exciting results and future research opportunities. To facilitate reproducible research, we make the anonymized datasets available in the public domain.


title: Blockchain-Empowered Socially Optimal Transactive Energy System: Framework and Implementation

abstract: Transactive energy plays a key role in the operation and energy management of future power systems. However, the conventional operational mechanism, which follows a centralized design, is often less secure, vulnerable to malicious behaviors, and suffers from privacy leakage. In this work, we introduce blockchain technology in transactive energy to address these challenges. Specifically, we develop a novel blockchain-based transactive energy framework for prosumers and design a decentralized energy trading algorithm that matches the operation of the underlying blockchain system. We prove that the trading algorithm improves the individual benefit and guarantees the socially optimal performance, and thus incentivizes prosumers to join the transactive energy platform. Moreover, we evaluate the feasibility of the transactive energy platform throughout the implementation of a small-scale network of Internet of Things (IoT) devices and extensive simulations using real-world data. Our results show that this blockchain-based transactive energy platform is feasible in practice, and the decentralized trading algorithm reduces the user's individual cost by up to 77% and lowers the overall cost by 24%.


title: Cooperative Energy Management of HVAC via Transactive Energy

abstract: Heating, Ventilation, and Air Conditioning (HVAC) energy consumption accounts for a significant part of the total energy consumption of buildings and households. The ubiquitous adoption of distributed renewable energy and smart meters helps to decarbonize the HVAC energy consumption and improve energy efficiency. However, how to scale up HVAC energy management for a group of users while persevering users' privacy remains a big challenge. In this work, we utilize the concept of transactive energy to build a cooperative energy management system for independent HVAC units in a distributed manner. Specifically, we develop a distributed energy trading algorithm that consists of two layers based on the alternating direction method of multipliers method. The distributed energy trading algorithm achieves optimal trading performance and also preserves users' privacy. Furthermore, we evaluate the performance of the distributed trading algorithm by extensive simulations with real-world data. Simulation results show that the energy trading algorithm converges fast and the cooperative energy platform reduces the user's individual cost by up to 50% and lowers the overall cost of all users by 23%.


title: Biases in Generative Art -- A Causal Look from the Lens of Art History

abstract: With rapid progress in artificial intelligence (AI), popularity of generative art has grown substantially. From creating paintings to generating novel art styles, AI based generative art has showcased a variety of applications. However, there has been little focus concerning the ethical impacts of AI based generative art. In this work, we investigate biases in the generative art AI pipeline right from those that can originate due to improper problem formulation to those related to algorithm design. Viewing from the lens of art history, we discuss the socio-cultural impacts of these biases. Leveraging causal models, we highlight how current methods fall short in modeling the process of art creation and thus contribute to various types of biases. We illustrate the same through case studies, in particular those related to style transfer. To the best of our knowledge, this is the first extensive analysis that investigates biases in the generative art AI pipeline from the perspective of art history. We hope our work sparks interdisciplinary discussions related to accountability of generative art.


title: Quadratic Killing structure Jacobi operator for real hypersurfaces in complex two-plane Grassmannians

abstract: In this paper, we introduce a notion of quadratic Killing structure Jacobi operator (simply, Killing structure Jacobi operator) and its geometric meaning for real hypersurfaces in the complex two-plane Grassmannians. In addition, we give a classification theorem for Hopf real hypersurfaces with quadratic Killing structure Jacobi operator in complex two-plane Grassmannians.


title: A Joint Convolutional and Spatial Quad-Directional LSTM Network for Phase Unwrapping

abstract: Phase unwrapping is a classical ill-posed problem which aims to recover the true phase from wrapped phase. In this paper, we introduce a novel Convolutional Neural Network (CNN) that incorporates a Spatial Quad-Directional Long Short Term Memory (SQD-LSTM) for phase unwrapping, by formulating it as a regression problem. Incorporating SQD-LSTM can circumvent the typical CNNs' inherent difficulty of learning global spatial dependencies which are vital when recovering the true phase. Furthermore, we employ a problem specific composite loss function to train this network. The proposed network is found to be performing better than the existing methods under severe noise conditions (Normalized Root Mean Square Error of 1.3 % at SNR = 0 dB) while spending a significantly less computational time (0.054 s). The network also does not require a large scale dataset during training, thus making it ideal for applications with limited data that require fast and accurate phase unwrapping.


title: Revisiting convolutional neural network on graphs with polynomial approximations of Laplace-Beltrami spectral filtering

abstract: This paper revisits spectral graph convolutional neural networks (graph-CNNs) given in Defferrard (2016) and develops the Laplace-Beltrami CNN (LB-CNN) by replacing the graph Laplacian with the LB operator. We then define spectral filters via the LB operator on a graph. We explore the feasibility of Chebyshev, Laguerre, and Hermite polynomials to approximate LB-based spectral filters and define an update of the LB operator for pooling in the LBCNN. We employ the brain image data from Alzheimer's Disease Neuroimaging Initiative (ADNI) and demonstrate the use of the proposed LB-CNN. Based on the cortical thickness of the ADNI dataset, we showed that the LB-CNN didn't improve classification accuracy compared to the spectral graph-CNN. The three polynomials had a similar computational cost and showed comparable classification accuracy in the LB-CNN or spectral graph-CNN. Our findings suggest that even though the shapes of the three polynomials are different, deep learning architecture allows us to learn spectral filters such that the classification performance is not dependent on the type of the polynomials or the operators (graph Laplacian and LB operator).


title: Improved Mask-CTC for Non-Autoregressive End-to-End ASR

abstract: For real-world deployment of automatic speech recognition (ASR), the system is desired to be capable of fast inference while relieving the requirement of computational resources. The recently proposed end-to-end ASR system based on mask-predict with connectionist temporal classification (CTC), Mask-CTC, fulfills this demand by generating tokens in a non-autoregressive fashion. While Mask-CTC achieves remarkably fast inference speed, its recognition performance falls behind that of conventional autoregressive (AR) systems. To boost the performance of Mask-CTC, we first propose to enhance the encoder network architecture by employing a recently proposed architecture called Conformer. Next, we propose new training and decoding methods by introducing auxiliary objective to predict the length of a partial target sequence, which allows the model to delete or insert tokens during inference. Experimental results on different ASR tasks show that the proposed approaches improve Mask-CTC significantly, outperforming a standard CTC model (15.5% $\rightarrow$ 9.1% WER on WSJ). Moreover, Mask-CTC now achieves competitive results to AR models with no degradation of inference speed ($<$ 0.1 RTF using CPU). We also show a potential application of Mask-CTC to end-to-end speech translation.